-- Logs begin at Tue 2022-07-19 13:14:17 UTC, end at Tue 2022-07-19 16:00:19 UTC. -- Jul 19 13:50:03.246604 n-d-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Jul 19 13:50:03.256875 n-d-master-1 devstack@keystone.service[80668]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 19 13:50:03.258951 n-d-master-1 devstack@keystone.service[80668]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 13:50:03 2022] *** Jul 19 13:50:03.258951 n-d-master-1 devstack@keystone.service[80668]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 13:50:03.258951 n-d-master-1 devstack@keystone.service[80668]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 13:50:03.258951 n-d-master-1 devstack@keystone.service[80668]: nodename: n-d-master-1 Jul 19 13:50:03.258951 n-d-master-1 devstack@keystone.service[80668]: machine: x86_64 Jul 19 13:50:03.258951 n-d-master-1 devstack@keystone.service[80668]: clock source: unix Jul 19 13:50:03.258951 n-d-master-1 devstack@keystone.service[80668]: pcre jit disabled Jul 19 13:50:03.258951 n-d-master-1 devstack@keystone.service[80668]: detected number of CPU cores: 4 Jul 19 13:50:03.258951 n-d-master-1 devstack@keystone.service[80668]: current working directory: / Jul 19 13:50:03.258951 n-d-master-1 devstack@keystone.service[80668]: detected binary path: /usr/bin/uwsgi-core Jul 19 13:50:03.259592 n-d-master-1 devstack@keystone.service[80668]: your processes number limit is 47680 Jul 19 13:50:03.259592 n-d-master-1 devstack@keystone.service[80668]: your memory page size is 4096 bytes Jul 19 13:50:03.259592 n-d-master-1 devstack@keystone.service[80668]: detected max file descriptor number: 2048 Jul 19 13:50:03.259592 n-d-master-1 devstack@keystone.service[80668]: lock engine: pthread robust mutexes Jul 19 13:50:03.259592 n-d-master-1 devstack@keystone.service[80668]: thunder lock: enabled Jul 19 13:50:03.259592 n-d-master-1 devstack@keystone.service[80668]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 19 13:50:03.259592 n-d-master-1 devstack@keystone.service[80668]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 13:50:03.303302 n-d-master-1 devstack@keystone.service[80668]: Python main interpreter initialized at 0x5585908079c0 Jul 19 13:50:03.303302 n-d-master-1 devstack@keystone.service[80668]: python threads support enabled Jul 19 13:50:03.303302 n-d-master-1 devstack@keystone.service[80668]: your server socket listen backlog is limited to 100 connections Jul 19 13:50:03.303302 n-d-master-1 devstack@keystone.service[80668]: your mercy for graceful operations on workers is 90 seconds Jul 19 13:50:03.303622 n-d-master-1 devstack@keystone.service[80668]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 13:50:03.303725 n-d-master-1 devstack@keystone.service[80668]: *** Operational MODE: preforking *** Jul 19 13:50:03.304001 n-d-master-1 devstack@keystone.service[80668]: *** uWSGI is running in multiple interpreter mode *** Jul 19 13:50:03.304001 n-d-master-1 devstack@keystone.service[80668]: spawned uWSGI master process (pid: 80668) Jul 19 13:50:03.304193 n-d-master-1 systemd[1]: Started Devstack devstack@keystone.service. Jul 19 13:50:03.308421 n-d-master-1 devstack@keystone.service[80668]: spawned uWSGI worker 1 (pid: 80679, cores: 1) Jul 19 13:50:03.308421 n-d-master-1 devstack@keystone.service[80668]: spawned uWSGI worker 2 (pid: 80680, cores: 1) Jul 19 13:50:03.308421 n-d-master-1 devstack@keystone.service[80668]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 13:50:08.809121 n-d-master-1 devstack@keystone.service[80680]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 13:50:08.809121 n-d-master-1 devstack@keystone.service[80680]: from cryptography.utils import int_from_bytes Jul 19 13:50:08.809921 n-d-master-1 devstack@keystone.service[80680]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 13:50:08.809921 n-d-master-1 devstack@keystone.service[80680]: from cryptography.utils import int_from_bytes Jul 19 13:50:08.812138 n-d-master-1 devstack@keystone.service[80679]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 13:50:08.812138 n-d-master-1 devstack@keystone.service[80679]: from cryptography.utils import int_from_bytes Jul 19 13:50:08.812603 n-d-master-1 devstack@keystone.service[80679]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 13:50:08.812603 n-d-master-1 devstack@keystone.service[80679]: from cryptography.utils import int_from_bytes Jul 19 13:50:08.859443 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 13:50:08.859642 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 13:50:08.859837 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] command line args: [] {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 13:50:08.860022 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 13:50:08.860114 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 13:50:08.860230 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 13:50:08.860309 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ================================================================================ {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 13:50:08.860423 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] command line args: [] {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 13:50:08.860508 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] admin_token = **** {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.860689 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 13:50:08.860772 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] config_dir = [] {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.860847 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ================================================================================ {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 13:50:08.860921 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.861091 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] config_source = [] {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.861176 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] admin_token = **** {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.861286 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] debug = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.861362 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] config_dir = [] {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.861502 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.861583 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.861812 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] config_source = [] {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.861912 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] debug = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.862004 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.862147 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.862281 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.862385 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.862488 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.862585 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.862685 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.862784 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.862889 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] list_limit = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.862994 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.863092 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] log_config_append = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.863185 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] list_limit = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.863283 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.863374 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] log_config_append = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.863471 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] log_dir = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.863574 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.863673 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] log_file = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.863776 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] log_dir = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.863776 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] log_file = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.863969 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.864049 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.864173 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.864253 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.864345 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.864426 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.864593 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.864680 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.864804 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.864880 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.864994 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.865068 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.865186 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.865269 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.865383 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.865457 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.865620 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.865740 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.865866 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.865953 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.866139 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.866230 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.866386 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.866502 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.866654 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.866785 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.866917 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.867029 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.867213 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.867343 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.867713 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.867808 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.867885 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] publish_errors = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.868028 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] publish_errors = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.868095 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.868154 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.868305 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.868390 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.868480 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.869220 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.869414 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.869507 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.869720 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.869807 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] standard_threads = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.869953 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.870035 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.870213 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] standard_threads = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.870291 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.870393 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.870478 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.870571 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] use_journal = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.870679 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.870756 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] use_json = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.870826 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.870894 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] use_stderr = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.870998 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] use_journal = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.871076 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] use_syslog = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.871172 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] use_json = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.871287 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.871363 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] use_stderr = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.871505 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] use_syslog = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.871663 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.871738 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 13:50:08.871813 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.871969 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.872082 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.872206 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.872290 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.872461 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.872543 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.872696 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.872771 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.872942 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.873026 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.873178 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.873253 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.873422 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.873506 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.873653 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.873741 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.873894 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.873971 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.874143 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.874232 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.874393 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.874476 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.874652 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.874763 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.874866 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.874947 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.875096 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.875184 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.875329 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.875411 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.875569 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.875651 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.875802 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.875885 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.876048 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.876128 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.876283 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.876365 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.876519 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.876596 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.876748 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.876824 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.876993 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.877069 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.877249 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.877334 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.877476 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.877552 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.877707 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.877783 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.877937 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.878014 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.878184 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.878263 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.878412 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.878490 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.878643 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.878720 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.878877 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.878952 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.879108 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.879184 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.879332 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.879414 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.879558 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.879634 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.879799 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.879881 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.880040 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.880123 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.880268 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.880343 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.880504 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.880586 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.880729 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.880805 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.880958 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.881034 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.881185 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.881271 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.881410 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.881488 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.881634 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.881712 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.881860 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.881943 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.882084 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.882179 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.882334 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.882411 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.882569 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.882655 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.882799 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.882884 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.883031 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.883114 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.883256 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.883334 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.883485 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.883570 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.883713 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.883790 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.883948 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.884030 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.884761 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.884856 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.885014 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.885251 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.886143 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.886228 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.886313 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.886395 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.886469 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.886546 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.886618 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.886689 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.886767 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.886847 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.886920 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.886997 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.887076 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.887149 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.887220 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.887298 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.887371 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.887441 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.887511 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.887589 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.887741 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.887827 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.887981 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.888092 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.888209 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.888311 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.888442 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.888552 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.888734 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.888847 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.888960 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.889080 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.889183 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.889369 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.889484 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.889595 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.889697 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.889813 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.889926 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.890036 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.890179 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.890295 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.890406 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.890518 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.890639 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.890760 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.890880 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.890993 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.891094 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.891205 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.891316 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.891427 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.891536 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.891648 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.891765 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.891868 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.891978 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.892088 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.892210 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.892331 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.892442 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.892553 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.892663 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.892774 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.892892 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.893005 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.893115 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.893229 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.893341 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.893452 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.893571 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.893683 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.893794 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.893910 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.894022 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.894157 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.894286 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.894402 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.894513 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.894624 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.894742 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.894854 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.894973 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.895086 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.895204 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.895317 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.895317 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.895526 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.895646 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.895758 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.895869 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.895979 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.896090 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.896201 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.896324 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.896439 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] auth.external = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.896550 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.896661 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.896779 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.896892 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.897013 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.897126 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.897244 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] auth.external = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.897383 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] auth.password = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.897506 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.897620 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] auth.token = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.897731 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.897844 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.897967 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.898087 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.898217 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] auth.password = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.898329 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.898441 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] auth.token = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.898554 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.898677 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.898792 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.898904 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.899016 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.899129 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.899241 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.899361 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.899475 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] credential.caching = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.899595 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.899708 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.899862 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.899976 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.900097 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.900211 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.900211 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.900430 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.900569 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] credential.caching = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.900692 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.900815 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.900928 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.901070 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.901194 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.901314 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.901437 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.901559 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.901674 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.901786 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.901898 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.902010 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.902166 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.902294 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.902415 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.902528 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.902640 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.902753 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.902945 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.903062 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.903175 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] federation.caching = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.903293 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.903406 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.903518 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.903638 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.903753 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.903865 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.903978 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.904090 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.904202 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.904321 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.904436 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] federation.caching = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.904548 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.904660 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.904772 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.904886 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.905012 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.905127 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.905239 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.905352 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.905464 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.905576 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.905697 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.905812 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.905925 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] identity.caching = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.906037 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.906163 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.906279 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.906403 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.906519 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.906632 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.906745 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.906857 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.906970 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.907090 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.907204 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] identity.caching = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.907323 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.907437 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.907549 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.907661 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.907781 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.907895 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.908010 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.908123 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.908235 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.908354 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.908475 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.908589 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.908708 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.908822 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.908935 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.909048 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.909168 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.909288 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.909402 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.909515 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.909627 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.909739 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.909859 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.909974 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.910226 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.910345 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.910458 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.910570 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.910699 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.910814 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.910927 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.911039 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.911154 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.911266 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.911387 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.911501 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.911613 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.911725 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.911837 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.911958 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.912072 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.912185 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.912297 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.912409 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.912522 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.912642 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.912762 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.912883 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.912996 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.913113 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.913227 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.913347 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.913461 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.913573 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.913685 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.913797 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.913901 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.914019 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.914184 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.914300 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.914413 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.914525 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.914637 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.914762 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.914877 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.914996 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.915110 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.915223 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.915337 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.915461 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.915576 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.915688 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.915800 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.915912 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.916024 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.916257 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.916382 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.916496 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.916608 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.916720 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.916833 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.916953 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.917068 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.917180 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.917292 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.917405 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.917517 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.917637 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.917751 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.917870 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.user = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.917984 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.918115 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.918231 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.918356 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.918472 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.918585 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.918698 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.918810 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.918922 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.919042 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.919155 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.919274 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.user = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.919388 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.919501 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.919613 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.919733 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.919846 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.919958 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.920077 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.920191 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.920303 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.920424 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.920539 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.920651 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.920764 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.920876 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.920989 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.921110 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.921224 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.921342 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.921456 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.921456 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.921673 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.921796 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.921909 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.922028 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.922155 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.922269 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.922382 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.922506 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.922628 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.922743 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.922854 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.922967 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.927273 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.927273 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.927529 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.927529 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.927746 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.927861 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.927974 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.928097 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.928211 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.928324 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.928437 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.928549 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.928661 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.928781 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.928896 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.929010 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.929121 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.929233 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.929345 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.929532 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.929649 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.929762 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.929874 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.929988 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.930128 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.930258 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.930373 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.930486 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.930598 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.930710 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.930831 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] resource.caching = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.930952 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.931583 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.931733 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.931849 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.931962 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.932084 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.932206 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.932319 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.932431 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.932543 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.932655 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] resource.caching = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.932774 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.932888 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.933000 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.933113 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.933226 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.933344 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.933464 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.933578 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.933689 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] role.caching = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.933802 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.933914 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] role.driver = sql {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.934031 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.934206 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.934324 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.934436 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.934548 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.934659 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.934771 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.934890 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.935004 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] role.caching = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.935115 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.935228 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] role.driver = sql {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.935340 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.935709 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.935830 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.935944 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.936055 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.936167 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.936280 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.936391 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.936511 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.936511 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.936729 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.936842 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.936954 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.937065 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.937065 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.937285 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.937285 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.937494 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.937606 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.937720 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.937840 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.937953 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.938065 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.938193 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.938306 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.938418 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.938541 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.938656 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.938768 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.938880 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.938992 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.939111 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.939225 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.939336 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.939449 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.939561 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.939673 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.939792 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.939906 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.940017 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.940017 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.940228 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.940228 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.940446 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.940560 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.940671 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.940783 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.940894 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.941006 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.941125 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.941238 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.941350 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.941461 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.941573 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.941684 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.941804 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] token.caching = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.941917 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.942029 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.942189 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.942303 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.942415 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.942538 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.942654 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.942765 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.942878 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.942989 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.943102 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.943222 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.943335 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] token.caching = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.943447 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.943559 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.943672 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.943783 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.943903 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.944017 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.944129 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.944240 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.944352 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.944464 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.944584 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.944699 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.944811 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.944923 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.945034 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.945146 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.945266 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.945379 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.945490 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.945602 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.945715 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.945827 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.945947 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] database.connection = **** {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.946070 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.946213 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.946328 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.946440 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.946552 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.946703 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.947335 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.947451 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.947563 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.947680 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.947794 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.947906 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.948026 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] database.connection = **** {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.948148 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.948273 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.948387 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.948500 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.948612 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.948725 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.948838 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.949022 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.949139 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.949251 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.949363 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.949475 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.949587 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.949707 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.949822 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.949935 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.950047 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.950188 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.950303 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.950428 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.950544 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.950657 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.950770 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.950883 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.951005 n-d-master-1 devstack@keystone.service[80680]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80680) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 13:50:08.951128 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.951128 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.951128 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.951128 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.951128 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.951128 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 13:50:08.951128 n-d-master-1 devstack@keystone.service[80679]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80679) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 13:50:08.977457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:08.977687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:08.977972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:08.979213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:08.979446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:08.979672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:08.986571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:08.987888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.015429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.015663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.017483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.017714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.158867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.161446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.208485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.208719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.210794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.211030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.273418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.273643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.273868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.273956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.274090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.274199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.274330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.274416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.274546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.274631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.274931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.275384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.300080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.300295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.300389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.300527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.300629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.300750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.300834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.300971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.301055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.301185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.301278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.301396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.301480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.301607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.312945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.313770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.326549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.326777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.327001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.327222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.327383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.327470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.327601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.327680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.327822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.327904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80680) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.328038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.328247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.328454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.328662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80679) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 13:50:09.345146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.345356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 13:50:09.345508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.345689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.345775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 13:50:09.345889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 13:50:09.346035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.346186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.346272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 13:50:09.346450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.346533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.346707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.346803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.346961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.347043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.347236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.358801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.359077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.359347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.359506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.359627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.359775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.360041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.360311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.367721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.368426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.371707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.371988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.372267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.372657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.372740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.372931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.373013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.373189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.373319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.373456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.373600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.373729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.373881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.373999 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.374161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.374302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.374428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.374569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.374696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.374961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.375228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.375491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.402693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.403657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.404302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.404582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.405260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.405535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.409850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.410150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.410434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.410817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.411073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.411347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.418458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.418738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.419678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.419958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.423361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.423649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.423927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.424206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.424481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.424562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.424754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.424845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.425022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.425104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.425286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.425368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.425579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.425847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.426126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.426391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.444186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.444462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.445615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.445886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.449612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.451337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.453333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.453627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.455095 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.455387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.458683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.460369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.462423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.464655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.466410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.466708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.466996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.467286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.467568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.467844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.468405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.468699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.468988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.469276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.469563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.469837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.487484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.487862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.488137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.488400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.489764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.490156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.490425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.490688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.496434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.498167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.498444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.499061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.500755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.501027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.501474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.501753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.502031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.502334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.502619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.504092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.504367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.504642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.504916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.505198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.516092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.516369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.516649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.516927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.517204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.517503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.517786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.519061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.519340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.519617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.519893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.520167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.520452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.520724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.537574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.541010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.542342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.544324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.545610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.545930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.547601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.547880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.548162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.548915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.550513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.552139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.552416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.552700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.555670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.557813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.561282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.561415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.561619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.561899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.562204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.563000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.566220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.566510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.566790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.567057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.571435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.571801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.572084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.576765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.577047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.577323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.579964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80680) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.580246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.580522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.580793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.581059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.581333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.581604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.581872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.582179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.582451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.582724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.582983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.583244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.583504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80680) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.585151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80679) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 13:50:09.585427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.585702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.585974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.586267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.586545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.586821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.587084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.588014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.588611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.588892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.589156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.589430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.589697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80679) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 13:50:09.623125 n-d-master-1 devstack@keystone.service[80680]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5585908079c0 pid: 80680 (default app) Jul 19 13:50:09.626413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4d081-0ff3-43a6-9ed9-0d15bf137b07 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:09.626711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4d081-0ff3-43a6-9ed9-0d15bf137b07 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:09.627000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed4d081-0ff3-43a6-9ed9-0d15bf137b07 None None] PATH_INFO: `/v3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:09.628896 n-d-master-1 devstack@keystone.service[80679]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5585908079c0 pid: 80679 (default app) Jul 19 13:50:09.631217 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Tue Jul 19 13:50:09 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:18.361729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a052b-48db-4502-ada1-53988d944a46 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:18.362325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a052b-48db-4502-ada1-53988d944a46 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:18.362325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a052b-48db-4502-ada1-53988d944a46 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:18.366583 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:50:18.372351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af08b30-f5e2-403e-b217-d7d674dd98af None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:18.372785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af08b30-f5e2-403e-b217-d7d674dd98af None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:18.372913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af08b30-f5e2-403e-b217-d7d674dd98af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:18.443479 n-d-master-1 devstack@keystone.service[80680]: INFO dbcounter [None req-2af08b30-f5e2-403e-b217-d7d674dd98af None None] Registered counter for database keystone Jul 19 13:50:18.464742 n-d-master-1 devstack@keystone.service[80680]: DEBUG oslo_db.sqlalchemy.engines [None req-2af08b30-f5e2-403e-b217-d7d674dd98af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80680) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 13:50:18.471017 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writer thread running {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 13:50:18.647807 n-d-master-1 devstack@keystone.service[80680]: DEBUG passlib.handlers.bcrypt [None req-2af08b30-f5e2-403e-b217-d7d674dd98af None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80680) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 19 13:50:18.648229 n-d-master-1 devstack@keystone.service[80680]: DEBUG passlib.handlers.bcrypt [None req-2af08b30-f5e2-403e-b217-d7d674dd98af None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80680) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 19 13:50:18.703642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2af08b30-f5e2-403e-b217-d7d674dd98af None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:18.705253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2af08b30-f5e2-403e-b217-d7d674dd98af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:18.826721 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 19 13:50:19.009681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a052b-48db-4502-ada1-53988d944a46 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:19.089384 n-d-master-1 devstack@keystone.service[80679]: INFO dbcounter [None req-401a052b-48db-4502-ada1-53988d944a46 None None] Registered counter for database keystone Jul 19 13:50:19.100060 n-d-master-1 devstack@keystone.service[80679]: DEBUG oslo_db.sqlalchemy.engines [None req-401a052b-48db-4502-ada1-53988d944a46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80679) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 13:50:19.106250 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writer thread running {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 13:50:19.224997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a052b-48db-4502-ada1-53988d944a46 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:19.229859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c8080-5b50-4f59-a881-c5bdd2c28d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:19.230569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c8080-5b50-4f59-a881-c5bdd2c28d3e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:19.230859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c8080-5b50-4f59-a881-c5bdd2c28d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:19.231143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c8080-5b50-4f59-a881-c5bdd2c28d3e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:19.239329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c8080-5b50-4f59-a881-c5bdd2c28d3e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:19.292232 n-d-master-1 devstack@keystone.service[80679]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f51c8080-5b50-4f59-a881-c5bdd2c28d3e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 19 13:50:19.292570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c8080-5b50-4f59-a881-c5bdd2c28d3e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:19.302041 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Jul 19 13:50:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 13:50:19.308516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af08b30-f5e2-403e-b217-d7d674dd98af None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:19.322997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af08b30-f5e2-403e-b217-d7d674dd98af None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:19.327324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3906f-2d90-45b3-96ce-2bb8750171ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:19.328433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3906f-2d90-45b3-96ce-2bb8750171ba admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:19.328720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3906f-2d90-45b3-96ce-2bb8750171ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:19.328995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3906f-2d90-45b3-96ce-2bb8750171ba admin admin] PATH_INFO: `/v3/projects/11ee5637d3dd4cec833ee8254662fa0b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:19.330497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3906f-2d90-45b3-96ce-2bb8750171ba admin admin] RBAC: Authorizing `identity:get_project(project_id=11ee5637d3dd4cec833ee8254662fa0b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:19.384508 n-d-master-1 devstack@keystone.service[80680]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b1c3906f-2d90-45b3-96ce-2bb8750171ba admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 19 13:50:19.385063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3906f-2d90-45b3-96ce-2bb8750171ba admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:19.389320 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Tue Jul 19 13:50:19 2022] GET /identity/v3/projects/11ee5637d3dd4cec833ee8254662fa0b => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:21.402906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5559b2-6940-455c-819b-18a169162ee9 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:21.403404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5559b2-6940-455c-819b-18a169162ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:21.403485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5559b2-6940-455c-819b-18a169162ee9 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:21.407565 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:21.412974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b49507-e06a-4f3a-bd17-5135f17bc17b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:21.413358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b49507-e06a-4f3a-bd17-5135f17bc17b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:21.413537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b49507-e06a-4f3a-bd17-5135f17bc17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:21.432956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b3b49507-e06a-4f3a-bd17-5135f17bc17b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:21.434484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b3b49507-e06a-4f3a-bd17-5135f17bc17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:21.442438 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 19 13:50:21.464696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5559b2-6940-455c-819b-18a169162ee9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:21.476718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5559b2-6940-455c-819b-18a169162ee9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:21.481392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bf903-567d-4a6c-b41e-d063a1a46fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:21.482025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bf903-567d-4a6c-b41e-d063a1a46fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:21.482347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bf903-567d-4a6c-b41e-d063a1a46fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:21.482632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bf903-567d-4a6c-b41e-d063a1a46fe9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:21.491323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bf903-567d-4a6c-b41e-d063a1a46fe9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:21.493083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bf903-567d-4a6c-b41e-d063a1a46fe9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:21.502409 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Tue Jul 19 13:50:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 13:50:21.507830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b49507-e06a-4f3a-bd17-5135f17bc17b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:21.516793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b49507-e06a-4f3a-bd17-5135f17bc17b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:21.521141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90911ce6-f53a-4d41-9e72-8d4f3f34a646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:21.521994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90911ce6-f53a-4d41-9e72-8d4f3f34a646 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:21.522305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90911ce6-f53a-4d41-9e72-8d4f3f34a646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:21.522582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90911ce6-f53a-4d41-9e72-8d4f3f34a646 admin admin] PATH_INFO: `/v3/users/aee44b6994c447199831be944ec7980c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:21.523963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90911ce6-f53a-4d41-9e72-8d4f3f34a646 admin admin] RBAC: Authorizing `identity:get_user(user_id=aee44b6994c447199831be944ec7980c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:21.526319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90911ce6-f53a-4d41-9e72-8d4f3f34a646 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:21.527872 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Tue Jul 19 13:50:21 2022] GET /identity/v3/users/aee44b6994c447199831be944ec7980c => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:23.620315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d106fe-38db-4cd4-b602-500bd0f3f67e None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:23.620870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d106fe-38db-4cd4-b602-500bd0f3f67e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:23.620870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d106fe-38db-4cd4-b602-500bd0f3f67e None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:23.622318 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:50:23.627145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3db2a-c247-4dc7-8846-be5238abf3e7 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:23.627529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3db2a-c247-4dc7-8846-be5238abf3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:23.627711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe3db2a-c247-4dc7-8846-be5238abf3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:23.643987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4fe3db2a-c247-4dc7-8846-be5238abf3e7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:23.645156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4fe3db2a-c247-4dc7-8846-be5238abf3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:23.693266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28b6b6-0439-4758-87bb-214677c84ac9 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:23.693555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28b6b6-0439-4758-87bb-214677c84ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:23.693833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28b6b6-0439-4758-87bb-214677c84ac9 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:23.695204 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:50:23.700561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92939b7a-0d77-4ef9-8a9f-316d3dc1e5b7 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:23.700847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92939b7a-0d77-4ef9-8a9f-316d3dc1e5b7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:23.701126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92939b7a-0d77-4ef9-8a9f-316d3dc1e5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:23.727151 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:50:23.741486 n-d-master-1 devstack@keystone.service[80679]: DEBUG passlib.handlers.bcrypt [None req-92939b7a-0d77-4ef9-8a9f-316d3dc1e5b7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80679) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 19 13:50:23.741898 n-d-master-1 devstack@keystone.service[80679]: DEBUG passlib.handlers.bcrypt [None req-92939b7a-0d77-4ef9-8a9f-316d3dc1e5b7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80679) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 19 13:50:23.751163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3db2a-c247-4dc7-8846-be5238abf3e7 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:23.774081 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:23.789234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-92939b7a-0d77-4ef9-8a9f-316d3dc1e5b7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:23.792031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-92939b7a-0d77-4ef9-8a9f-316d3dc1e5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:23.853879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe3db2a-c247-4dc7-8846-be5238abf3e7 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:23.887096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b21fee-990d-4919-ac1c-13c517c9a945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:23.887830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b21fee-990d-4919-ac1c-13c517c9a945 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:23.888127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b21fee-990d-4919-ac1c-13c517c9a945 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:23.888401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b21fee-990d-4919-ac1c-13c517c9a945 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:23.893118 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:50:23.900105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b21fee-990d-4919-ac1c-13c517c9a945 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:23.911426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-05b21fee-990d-4919-ac1c-13c517c9a945 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:50:23.911426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:23.911426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:23.911426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:23.911426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:23.911426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:23.911426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:23.911426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:23.911426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:23.911426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:23.911426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:23.911426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:23.911426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:23.911426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:23.911426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:23.911426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:23.912359 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:23.912359 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:23.912359 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:23.912359 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:23.912359 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:23.912359 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:23.912359 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:23.912359 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:23.912359 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:23.912359 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:23.912359 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:23.912359 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:23.912359 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:23.912359 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:23.912359 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:23.912359 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:23.913180 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:23.913180 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:23.913180 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:23.913180 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:23.913180 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:23.913180 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:23.913180 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:23.913180 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:23.913180 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:23.913180 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:23.913180 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:50:23.913180 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:50:23.913180 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 7/14] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:50:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:50:23.916164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92939b7a-0d77-4ef9-8a9f-316d3dc1e5b7 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:23.919022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b21fee-990d-4919-ac1c-13c517c9a945 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:24.000446 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:24.017589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92939b7a-0d77-4ef9-8a9f-316d3dc1e5b7 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:24.018517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b21fee-990d-4919-ac1c-13c517c9a945 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:24.019959 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:24.052895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587ef17-8bb2-405f-aef2-fe62973ef076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:24.053574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587ef17-8bb2-405f-aef2-fe62973ef076 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:24.053867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587ef17-8bb2-405f-aef2-fe62973ef076 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:24.054182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587ef17-8bb2-405f-aef2-fe62973ef076 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:24.054941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587ef17-8bb2-405f-aef2-fe62973ef076 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:24.055254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587ef17-8bb2-405f-aef2-fe62973ef076 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:24.056640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51477a-f495-4635-a688-eb051e07b868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:24.057185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5587ef17-8bb2-405f-aef2-fe62973ef076 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:24.057586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51477a-f495-4635-a688-eb051e07b868 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:24.057872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51477a-f495-4635-a688-eb051e07b868 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:24.058211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51477a-f495-4635-a688-eb051e07b868 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:24.069135 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 8/15] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:50:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:24.074773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587ef17-8bb2-405f-aef2-fe62973ef076 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:24.126955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51477a-f495-4635-a688-eb051e07b868 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:24.128481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51477a-f495-4635-a688-eb051e07b868 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:24.175221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587ef17-8bb2-405f-aef2-fe62973ef076 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:24.209794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fa88f-6784-43cd-b1b1-caf251c7d06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:24.210939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fa88f-6784-43cd-b1b1-caf251c7d06c None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:24.211071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fa88f-6784-43cd-b1b1-caf251c7d06c None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:24.211250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fa88f-6784-43cd-b1b1-caf251c7d06c None admin] PATH_INFO: `/v3/users/aee44b6994c447199831be944ec7980c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:24.212780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fa88f-6784-43cd-b1b1-caf251c7d06c None admin] RBAC: Authorizing `identity:get_user(user_id=aee44b6994c447199831be944ec7980c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:24.214351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fa88f-6784-43cd-b1b1-caf251c7d06c None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:24.215980 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 9/16] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:24 2022] GET /identity/v3/users/aee44b6994c447199831be944ec7980c => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:50:24.221271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fa88f-6784-43cd-b1b1-caf251c7d06c None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:24.226987 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 8/17] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:50:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:50:24.233703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51477a-f495-4635-a688-eb051e07b868 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:24.236482 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:24.236858 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:24.321696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fa88f-6784-43cd-b1b1-caf251c7d06c None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:24.332853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51477a-f495-4635-a688-eb051e07b868 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:24.354841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473033d4-a38d-4d66-9369-983c579edd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:24.355639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473033d4-a38d-4d66-9369-983c579edd1f None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:24.355926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473033d4-a38d-4d66-9369-983c579edd1f None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:24.356209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473033d4-a38d-4d66-9369-983c579edd1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:24.357395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473033d4-a38d-4d66-9369-983c579edd1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:24.358870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473033d4-a38d-4d66-9369-983c579edd1f None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:24.360474 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 10/18] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:50:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:50:24.366135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473033d4-a38d-4d66-9369-983c579edd1f None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:24.366695 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25950e-7bb0-4ad1-abf7-f8ebb5f24ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:24.367495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25950e-7bb0-4ad1-abf7-f8ebb5f24ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:24.367776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25950e-7bb0-4ad1-abf7-f8ebb5f24ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:24.368051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25950e-7bb0-4ad1-abf7-f8ebb5f24ad2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:24.387062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25950e-7bb0-4ad1-abf7-f8ebb5f24ad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:24.388541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25950e-7bb0-4ad1-abf7-f8ebb5f24ad2 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:24.410021 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-1e25950e-7bb0-4ad1-abf7-f8ebb5f24ad2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:50:24.410021 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:24.410021 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:24.410021 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:24.410021 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:24.410021 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:24.410021 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:24.410021 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:24.410021 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:24.410021 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:24.410021 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:24.410021 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:24.410021 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:50:24.410021 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:50:24.410021 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:50:24.411051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:50:24.411051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:24.411051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:24.411051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:24.411051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:24.411051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:24.411051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:24.411051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:24.411051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:24.411051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:24.411051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:24.411051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:24.411051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:24.411051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:24.411051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:24.411051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:24.411051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:24.412079 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:50:24.412079 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:50:24.412079 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:50:24.412079 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:50:24.412079 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 9/19] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:50:24.417138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25950e-7bb0-4ad1-abf7-f8ebb5f24ad2 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:24.447234 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:24.466353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473033d4-a38d-4d66-9369-983c579edd1f None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:24.472613 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:24.502377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a48ef-4bb9-43e7-8239-d52deeba4e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:24.503037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a48ef-4bb9-43e7-8239-d52deeba4e51 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:24.503326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a48ef-4bb9-43e7-8239-d52deeba4e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:24.503602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a48ef-4bb9-43e7-8239-d52deeba4e51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:24.504431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a48ef-4bb9-43e7-8239-d52deeba4e51 None admin] RBAC: Adding query filter params (role.id=bc315edf089d43b18acf9790031f3fcb, scope.domain.id=default, user.id=aee44b6994c447199831be944ec7980c) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:24.504742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a48ef-4bb9-43e7-8239-d52deeba4e51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:24.506205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a48ef-4bb9-43e7-8239-d52deeba4e51 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:24.513189 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 11/20] 10.222.0.43 () {56 vars in 1322 bytes} [Tue Jul 19 13:50:24 2022] GET /identity/v3/role_assignments?user.id=aee44b6994c447199831be944ec7980c&scope.domain.id=default&role.id=bc315edf089d43b18acf9790031f3fcb => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:24.519015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25950e-7bb0-4ad1-abf7-f8ebb5f24ad2 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:24.558368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27699c-5dc3-48ab-bb60-2b33812b27b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:24.559047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27699c-5dc3-48ab-bb60-2b33812b27b5 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:24.559331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27699c-5dc3-48ab-bb60-2b33812b27b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:24.559605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27699c-5dc3-48ab-bb60-2b33812b27b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:24.560367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27699c-5dc3-48ab-bb60-2b33812b27b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:24.560673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27699c-5dc3-48ab-bb60-2b33812b27b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:24.562381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27699c-5dc3-48ab-bb60-2b33812b27b5 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:24.581706 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 10/21] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:27.044436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c202eef-3657-481c-a25d-e7270c42843c None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:27.045424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c202eef-3657-481c-a25d-e7270c42843c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:27.045917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c202eef-3657-481c-a25d-e7270c42843c None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:27.047488 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 12/22] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:27.058412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac2288-b16c-4972-b297-feae86b3280a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:27.059341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac2288-b16c-4972-b297-feae86b3280a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:27.059816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac2288-b16c-4972-b297-feae86b3280a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:27.080478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f6ac2288-b16c-4972-b297-feae86b3280a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:27.090464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f6ac2288-b16c-4972-b297-feae86b3280a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:27.091102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb42db2-62b6-4beb-bb90-de9c249ce65e None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:27.091597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb42db2-62b6-4beb-bb90-de9c249ce65e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:27.092064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb42db2-62b6-4beb-bb90-de9c249ce65e None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:27.093609 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 13/23] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:27.099233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9e319-92ae-4f1d-92f8-88859b5ba29c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:27.099758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9e319-92ae-4f1d-92f8-88859b5ba29c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:27.100249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9e319-92ae-4f1d-92f8-88859b5ba29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:27.127744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c5f9e319-92ae-4f1d-92f8-88859b5ba29c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:27.130463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c5f9e319-92ae-4f1d-92f8-88859b5ba29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:27.202287 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 11/24] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:50:27.203705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329e569-7d18-4567-ac64-947bddb16e11 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:27.203991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329e569-7d18-4567-ac64-947bddb16e11 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:27.204273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329e569-7d18-4567-ac64-947bddb16e11 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:27.211616 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 12/25] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:27.226128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08948561-5b71-402e-840e-0788295749af None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:27.226128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08948561-5b71-402e-840e-0788295749af None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:27.226128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08948561-5b71-402e-840e-0788295749af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:27.255844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-08948561-5b71-402e-840e-0788295749af None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:27.257043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-08948561-5b71-402e-840e-0788295749af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:27.276025 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 14/26] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:50:27.276958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9e319-92ae-4f1d-92f8-88859b5ba29c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:27.336345 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:27.394510 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:27.396409 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 13/27] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 19 13:50:27.397270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08948561-5b71-402e-840e-0788295749af None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:27.457958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9e319-92ae-4f1d-92f8-88859b5ba29c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:27.537496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47987961-7207-4fcf-8b57-ce44bae3ae34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:27.542669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47987961-7207-4fcf-8b57-ce44bae3ae34 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:27.542977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47987961-7207-4fcf-8b57-ce44bae3ae34 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:27.543263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47987961-7207-4fcf-8b57-ce44bae3ae34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:27.555058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47987961-7207-4fcf-8b57-ce44bae3ae34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:27.556986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47987961-7207-4fcf-8b57-ce44bae3ae34 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:27.563291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08948561-5b71-402e-840e-0788295749af None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:27.576538 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-47987961-7207-4fcf-8b57-ce44bae3ae34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:50:27.576538 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:27.576538 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:27.576538 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:27.576538 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:27.576538 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:27.576538 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:27.576538 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:27.576538 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:27.576538 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:27.576538 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:27.576538 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:27.576538 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:50:27.576538 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:50:27.576538 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:50:27.577507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:50:27.577507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:27.577507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:27.577507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:27.577507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:27.577507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:27.577507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:27.577507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:27.577507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:27.577507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:27.577507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:27.577507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:27.577507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:27.577507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:27.577507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:27.577507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:27.577507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:27.578478 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:50:27.578478 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:50:27.578478 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:50:27.578478 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:50:27.580036 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 15/28] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:50:27.581050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47987961-7207-4fcf-8b57-ce44bae3ae34 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:27.674838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb007f-681d-4298-83be-bdc2da193bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:27.675900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb007f-681d-4298-83be-bdc2da193bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:27.676325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb007f-681d-4298-83be-bdc2da193bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:27.676772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbb007f-681d-4298-83be-bdc2da193bb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:27.699888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47987961-7207-4fcf-8b57-ce44bae3ae34 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:27.704960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbb007f-681d-4298-83be-bdc2da193bb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:27.720898 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-8bbb007f-681d-4298-83be-bdc2da193bb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:50:27.720898 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:27.720898 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:27.720898 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:27.720898 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:27.720898 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:27.720898 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:27.720898 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:27.720898 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:27.720898 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:27.720898 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:27.720898 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:27.720898 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:27.720898 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:27.720898 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:27.720898 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:27.721980 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:27.721980 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:27.721980 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:27.721980 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:27.721980 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:27.721980 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:27.721980 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:27.721980 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:27.721980 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:27.721980 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:27.721980 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:27.721980 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:27.721980 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:27.721980 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:27.721980 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:27.721980 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:27.722932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:27.722932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:27.722932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:27.722932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:27.722932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:27.722932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:27.722932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:27.722932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:27.722932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:27.722932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:27.722932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:50:27.722932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:50:27.724872 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 14/29] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:50:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:50:27.725862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb007f-681d-4298-83be-bdc2da193bb3 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:27.734234 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:27.745496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cb4981-4654-459e-996f-f18e1edfee4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:27.746203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb4981-4654-459e-996f-f18e1edfee4b None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:27.746493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb4981-4654-459e-996f-f18e1edfee4b None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:27.746772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cb4981-4654-459e-996f-f18e1edfee4b None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:27.747533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb4981-4654-459e-996f-f18e1edfee4b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:27.754335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cb4981-4654-459e-996f-f18e1edfee4b None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:27.782369 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:27.851400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbb007f-681d-4298-83be-bdc2da193bb3 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:27.890660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177f3d8-f1be-41ab-91be-0ba437e4d693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:27.891330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177f3d8-f1be-41ab-91be-0ba437e4d693 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:27.891614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177f3d8-f1be-41ab-91be-0ba437e4d693 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:27.891890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6177f3d8-f1be-41ab-91be-0ba437e4d693 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:27.892671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177f3d8-f1be-41ab-91be-0ba437e4d693 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:27.892982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177f3d8-f1be-41ab-91be-0ba437e4d693 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:27.894432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6177f3d8-f1be-41ab-91be-0ba437e4d693 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:27.907859 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 15/30] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:27.908676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177f3d8-f1be-41ab-91be-0ba437e4d693 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:27.978610 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 16/31] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Jul 19 13:50:27 2022] POST /identity/v3/roles => generated 219 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:50:27.980277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337b989-a0a4-462a-bc9b-6b6cd8b52f52 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:27.980656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337b989-a0a4-462a-bc9b-6b6cd8b52f52 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:27.981043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337b989-a0a4-462a-bc9b-6b6cd8b52f52 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:27.988055 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 17/32] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:27.989017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337b989-a0a4-462a-bc9b-6b6cd8b52f52 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:28.024136 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:28.032798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6177f3d8-f1be-41ab-91be-0ba437e4d693 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:28.077892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e6428f-5956-48e3-9def-3646b6518eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:28.078644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6428f-5956-48e3-9def-3646b6518eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:28.078888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6428f-5956-48e3-9def-3646b6518eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:28.079170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e6428f-5956-48e3-9def-3646b6518eb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:28.079945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6428f-5956-48e3-9def-3646b6518eb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:28.080252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6428f-5956-48e3-9def-3646b6518eb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:28.081704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e6428f-5956-48e3-9def-3646b6518eb8 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:28.096929 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 16/33] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:50:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:28.103236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f88e96-6b0d-4913-ab39-79871b57bee3 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:28.103728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f88e96-6b0d-4913-ab39-79871b57bee3 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:28.104071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f88e96-6b0d-4913-ab39-79871b57bee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:28.123207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a1f88e96-6b0d-4913-ab39-79871b57bee3 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:28.124410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a1f88e96-6b0d-4913-ab39-79871b57bee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:28.195046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337b989-a0a4-462a-bc9b-6b6cd8b52f52 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:28.198924 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 17/34] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:50:28.199889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f88e96-6b0d-4913-ab39-79871b57bee3 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:28.270732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579212e-5e03-41fa-b8ac-3d341a1448d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:28.271621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579212e-5e03-41fa-b8ac-3d341a1448d7 None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:28.271943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579212e-5e03-41fa-b8ac-3d341a1448d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:28.272863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579212e-5e03-41fa-b8ac-3d341a1448d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:28.274027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579212e-5e03-41fa-b8ac-3d341a1448d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:28.276714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579212e-5e03-41fa-b8ac-3d341a1448d7 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:28.323823 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:28.338016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f88e96-6b0d-4913-ab39-79871b57bee3 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:28.373728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05afd48-3d22-47c6-8c0d-51d301506b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:28.374706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05afd48-3d22-47c6-8c0d-51d301506b5c None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:28.374995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05afd48-3d22-47c6-8c0d-51d301506b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:28.375275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05afd48-3d22-47c6-8c0d-51d301506b5c None admin] PATH_INFO: `/v3/users/aee44b6994c447199831be944ec7980c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:28.376833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05afd48-3d22-47c6-8c0d-51d301506b5c None admin] RBAC: Authorizing `identity:get_user(user_id=aee44b6994c447199831be944ec7980c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:28.378339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05afd48-3d22-47c6-8c0d-51d301506b5c None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:28.379968 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 18/35] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:28 2022] GET /identity/v3/users/aee44b6994c447199831be944ec7980c => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:28.380785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05afd48-3d22-47c6-8c0d-51d301506b5c None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:28.408202 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 18/36] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 19 13:50:27 2022] POST /identity/v3/projects => generated 301 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:50:28.410360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39f7c3-0672-4f6d-8f92-ffad210573ed None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:28.411139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39f7c3-0672-4f6d-8f92-ffad210573ed None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:28.411643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f39f7c3-0672-4f6d-8f92-ffad210573ed None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:28.414325 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 19/37] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:28.416922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39f7c3-0672-4f6d-8f92-ffad210573ed None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:28.483649 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:28.509610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05afd48-3d22-47c6-8c0d-51d301506b5c None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:28.554275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3b51d7-acf2-4576-904c-27a4e435c501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:28.554952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b51d7-acf2-4576-904c-27a4e435c501 None admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:28.555245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b51d7-acf2-4576-904c-27a4e435c501 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:28.555529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3b51d7-acf2-4576-904c-27a4e435c501 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:28.557230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b51d7-acf2-4576-904c-27a4e435c501 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:28.558583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3b51d7-acf2-4576-904c-27a4e435c501 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:28.575367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f39f7c3-0672-4f6d-8f92-ffad210573ed None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:28.610682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af196e15-a914-4492-a039-130717cc785b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:28.611477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af196e15-a914-4492-a039-130717cc785b None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:28.611767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af196e15-a914-4492-a039-130717cc785b None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:28.612046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af196e15-a914-4492-a039-130717cc785b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:28.613322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af196e15-a914-4492-a039-130717cc785b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:28.614898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af196e15-a914-4492-a039-130717cc785b None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:28.616539 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 20/38] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:50:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:28.617808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b9fae-0b0e-4660-8893-1d2bab798ddb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:28.618129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b9fae-0b0e-4660-8893-1d2bab798ddb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:28.618980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5b9fae-0b0e-4660-8893-1d2bab798ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:28.638091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ae5b9fae-0b0e-4660-8893-1d2bab798ddb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:28.639915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ae5b9fae-0b0e-4660-8893-1d2bab798ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:28.749300 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 19/39] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Jul 19 13:50:28 2022] POST /identity/v3/roles => generated 225 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:50:28.751105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51100a-75a3-4436-870e-89e5b37493f7 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:28.751409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51100a-75a3-4436-870e-89e5b37493f7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:28.751745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e51100a-75a3-4436-870e-89e5b37493f7 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:28.757472 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 20/40] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:28.757472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51100a-75a3-4436-870e-89e5b37493f7 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:28.781570 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:28.822554 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 21/41] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:50:28.824201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa85f78-2558-4748-8564-bb71a181492d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:28.824498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa85f78-2558-4748-8564-bb71a181492d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:28.824783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa85f78-2558-4748-8564-bb71a181492d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:28.853675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6aa85f78-2558-4748-8564-bb71a181492d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:28.855040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6aa85f78-2558-4748-8564-bb71a181492d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:28.886619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e51100a-75a3-4436-870e-89e5b37493f7 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:28.891706 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:28.929985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19091150-550a-4cfc-9b6c-f00d13a007a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:28.930997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19091150-550a-4cfc-9b6c-f00d13a007a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:28.931298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19091150-550a-4cfc-9b6c-f00d13a007a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:28.931583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19091150-550a-4cfc-9b6c-f00d13a007a9 None admin] PATH_INFO: `/v3/domains/default/users/aee44b6994c447199831be944ec7980c/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:28.933950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19091150-550a-4cfc-9b6c-f00d13a007a9 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=aee44b6994c447199831be944ec7980c, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:28.935563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19091150-550a-4cfc-9b6c-f00d13a007a9 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:28.938892 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 22/42] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:50:28.939548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa85f78-2558-4748-8564-bb71a181492d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:29.037122 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 21/43] 10.222.0.43 () {58 vars in 1361 bytes} [Tue Jul 19 13:50:28 2022] PUT /identity/v3/domains/default/users/aee44b6994c447199831be944ec7980c/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:50:29.038014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19091150-550a-4cfc-9b6c-f00d13a007a9 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:29.051758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa85f78-2558-4748-8564-bb71a181492d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:29.097018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a387b-2b59-46b6-a41e-dbaac03205af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:29.098106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a387b-2b59-46b6-a41e-dbaac03205af None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:29.098454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a387b-2b59-46b6-a41e-dbaac03205af None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:29.098741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a387b-2b59-46b6-a41e-dbaac03205af None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:29.099639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a387b-2b59-46b6-a41e-dbaac03205af None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:29.100973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a387b-2b59-46b6-a41e-dbaac03205af None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:29.130770 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:29.154643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19091150-550a-4cfc-9b6c-f00d13a007a9 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:29.194992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e2924-c3ae-48d8-9350-8207dd28fe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:29.195842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e2924-c3ae-48d8-9350-8207dd28fe5e None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:29.196134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e2924-c3ae-48d8-9350-8207dd28fe5e None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:29.196497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e2924-c3ae-48d8-9350-8207dd28fe5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:29.197949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e2924-c3ae-48d8-9350-8207dd28fe5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:29.199505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e2924-c3ae-48d8-9350-8207dd28fe5e None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:29.201316 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 22/44] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:50:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:29.206763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e2924-c3ae-48d8-9350-8207dd28fe5e None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:29.250284 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 23/45] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Jul 19 13:50:28 2022] POST /identity/v3/roles => generated 223 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:50:29.423285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e2924-c3ae-48d8-9350-8207dd28fe5e None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:29.462402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19c631-9e88-47b7-b006-1bf191dc857d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:29.463196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19c631-9e88-47b7-b006-1bf191dc857d None admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:29.463487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19c631-9e88-47b7-b006-1bf191dc857d None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:29.463774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19c631-9e88-47b7-b006-1bf191dc857d None admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:29.464504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19c631-9e88-47b7-b006-1bf191dc857d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:29.465971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19c631-9e88-47b7-b006-1bf191dc857d None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:29.482756 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:29.547833 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 23/46] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 19 13:50:29 2022] POST /identity/v3/projects => generated 312 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 13:50:31.111028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030a209-645a-4626-a23d-7dc72fd3d943 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:31.111583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030a209-645a-4626-a23d-7dc72fd3d943 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:31.111583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030a209-645a-4626-a23d-7dc72fd3d943 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:31.112977 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 24/47] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:31.118485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aeb4e-5731-436c-ac7b-affe95597736 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:31.118882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aeb4e-5731-436c-ac7b-affe95597736 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:31.118882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194aeb4e-5731-436c-ac7b-affe95597736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:31.136821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-194aeb4e-5731-436c-ac7b-affe95597736 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:31.138344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-194aeb4e-5731-436c-ac7b-affe95597736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:31.204949 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 24/48] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:50:31.227535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030a209-645a-4626-a23d-7dc72fd3d943 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:31.257000 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:31.333801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030a209-645a-4626-a23d-7dc72fd3d943 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:31.367110 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03b61d-d3a3-48d4-bd17-f33d662c153a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:31.367829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03b61d-d3a3-48d4-bd17-f33d662c153a None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:31.368114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03b61d-d3a3-48d4-bd17-f33d662c153a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:31.369314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03b61d-d3a3-48d4-bd17-f33d662c153a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:31.379196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03b61d-d3a3-48d4-bd17-f33d662c153a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:31.387845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-af03b61d-d3a3-48d4-bd17-f33d662c153a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:50:31.387845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:31.387845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:31.387845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:31.387845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:31.387845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:31.387845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:31.387845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:31.387845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:31.387845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:31.387845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:31.387845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:31.387845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:31.387845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:31.387845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:31.387845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:31.388670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:31.388670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:31.388670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:31.388670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:31.388670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:31.388670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:31.388670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:31.388670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:31.388670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:31.388670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:31.388670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:31.388670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:31.388670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:31.388670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:31.388670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:31.388670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:31.389425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:31.389425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:31.389425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:31.389425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:31.389425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:31.389425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:31.389425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:31.389425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:31.389425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:31.389425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:31.389425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:50:31.389425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:50:31.389425 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 25/49] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:50:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:50:31.394812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194aeb4e-5731-436c-ac7b-affe95597736 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:31.494579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194aeb4e-5731-436c-ac7b-affe95597736 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:31.519649 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:31.528774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d513e1a-66d6-4420-ab7b-ad21c3f0da03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:31.529453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d513e1a-66d6-4420-ab7b-ad21c3f0da03 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:31.530654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d513e1a-66d6-4420-ab7b-ad21c3f0da03 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:31.530654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d513e1a-66d6-4420-ab7b-ad21c3f0da03 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:31.530945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d513e1a-66d6-4420-ab7b-ad21c3f0da03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:31.531274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d513e1a-66d6-4420-ab7b-ad21c3f0da03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:31.532679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d513e1a-66d6-4420-ab7b-ad21c3f0da03 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:31.541891 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 25/50] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:50:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:31.547288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03b61d-d3a3-48d4-bd17-f33d662c153a None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:31.592052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7458e45-fa70-4489-8b9e-71950b6a061f None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:31.592343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7458e45-fa70-4489-8b9e-71950b6a061f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:31.592630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7458e45-fa70-4489-8b9e-71950b6a061f None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:31.593994 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 26/51] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:50:31.598909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc9048-93b4-4195-beed-8a14ebed447b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:31.599199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc9048-93b4-4195-beed-8a14ebed447b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:31.599483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc9048-93b4-4195-beed-8a14ebed447b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:31.616514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-91dc9048-93b4-4195-beed-8a14ebed447b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:31.617774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-91dc9048-93b4-4195-beed-8a14ebed447b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:31.636194 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:31.651233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03b61d-d3a3-48d4-bd17-f33d662c153a None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:31.684685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f112305-3568-461e-beea-fe9efca5afe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:31.685558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f112305-3568-461e-beea-fe9efca5afe0 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:31.685844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f112305-3568-461e-beea-fe9efca5afe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:31.686475 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 27/52] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:50:31.686582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f112305-3568-461e-beea-fe9efca5afe0 None admin] PATH_INFO: `/v3/users/aee44b6994c447199831be944ec7980c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:31.687590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f112305-3568-461e-beea-fe9efca5afe0 None admin] RBAC: Authorizing `identity:get_user(user_id=aee44b6994c447199831be944ec7980c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:31.689043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f112305-3568-461e-beea-fe9efca5afe0 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:31.690687 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 26/53] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:31 2022] GET /identity/v3/users/aee44b6994c447199831be944ec7980c => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:31.695958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc9048-93b4-4195-beed-8a14ebed447b None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:31.709849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f112305-3568-461e-beea-fe9efca5afe0 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:31.796484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc9048-93b4-4195-beed-8a14ebed447b None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:31.806464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f112305-3568-461e-beea-fe9efca5afe0 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:31.814388 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:31.831088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3bff4-f10e-47e8-be0a-3c4e886a8f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:31.831881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3bff4-f10e-47e8-be0a-3c4e886a8f77 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:31.832170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3bff4-f10e-47e8-be0a-3c4e886a8f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:31.832447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd3bff4-f10e-47e8-be0a-3c4e886a8f77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:31.833626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3bff4-f10e-47e8-be0a-3c4e886a8f77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:31.835128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd3bff4-f10e-47e8-be0a-3c4e886a8f77 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:31.837621 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 28/54] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:50:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:50:31.841590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b463c5-ceb1-45c6-9ad0-66a034c6f75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:31.842674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b463c5-ceb1-45c6-9ad0-66a034c6f75b None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:31.842965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b463c5-ceb1-45c6-9ad0-66a034c6f75b None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:31.843075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3bff4-f10e-47e8-be0a-3c4e886a8f77 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:31.843245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b463c5-ceb1-45c6-9ad0-66a034c6f75b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:31.844427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b463c5-ceb1-45c6-9ad0-66a034c6f75b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:31.845856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b463c5-ceb1-45c6-9ad0-66a034c6f75b None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:31.847492 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 27/55] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:50:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:50:31.852786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b463c5-ceb1-45c6-9ad0-66a034c6f75b None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:31.876257 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:31.943880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd3bff4-f10e-47e8-be0a-3c4e886a8f77 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:31.951764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b463c5-ceb1-45c6-9ad0-66a034c6f75b None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:31.978638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193092fb-1dff-40fa-9f39-b2dcd96f8bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:31.979295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193092fb-1dff-40fa-9f39-b2dcd96f8bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:31.979586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193092fb-1dff-40fa-9f39-b2dcd96f8bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:31.979868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193092fb-1dff-40fa-9f39-b2dcd96f8bc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:31.980711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193092fb-1dff-40fa-9f39-b2dcd96f8bc9 None admin] RBAC: Adding query filter params (role.id=bc315edf089d43b18acf9790031f3fcb, scope.domain.id=default, user.id=aee44b6994c447199831be944ec7980c) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:31.981026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193092fb-1dff-40fa-9f39-b2dcd96f8bc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:31.982505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193092fb-1dff-40fa-9f39-b2dcd96f8bc9 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:31.985007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9037a43-a65e-4b2d-90b0-a73a85008596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:31.985668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9037a43-a65e-4b2d-90b0-a73a85008596 None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:31.985959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9037a43-a65e-4b2d-90b0-a73a85008596 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:31.986287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9037a43-a65e-4b2d-90b0-a73a85008596 None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:31.987003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9037a43-a65e-4b2d-90b0-a73a85008596 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:31.988441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9037a43-a65e-4b2d-90b0-a73a85008596 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:31.990620 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 29/56] 10.222.0.43 () {56 vars in 1322 bytes} [Tue Jul 19 13:50:31 2022] GET /identity/v3/role_assignments?user.id=aee44b6994c447199831be944ec7980c&scope.domain.id=default&role.id=bc315edf089d43b18acf9790031f3fcb => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:50:32.085434 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 28/57] 10.222.0.43 () {60 vars in 1140 bytes} [Tue Jul 19 13:50:31 2022] POST /identity/v3/projects => generated 298 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 13:50:34.151680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4e2c9-8f34-43d7-8079-d2f643f68a6d None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:34.152198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4e2c9-8f34-43d7-8079-d2f643f68a6d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:34.152282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae4e2c9-8f34-43d7-8079-d2f643f68a6d None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:34.153623 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 30/58] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:34.158854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ce361-66bc-4d66-b9e7-887715105180 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:34.159277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ce361-66bc-4d66-b9e7-887715105180 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:34.159432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ce361-66bc-4d66-b9e7-887715105180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:34.176117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0b7ce361-66bc-4d66-b9e7-887715105180 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:34.177304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0b7ce361-66bc-4d66-b9e7-887715105180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:34.243034 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 29/59] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:50:34.267532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4e2c9-8f34-43d7-8079-d2f643f68a6d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:34.319275 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:34.369753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae4e2c9-8f34-43d7-8079-d2f643f68a6d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:34.402808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe558d-7357-45ae-8367-3b6853cc1d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:34.403534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe558d-7357-45ae-8367-3b6853cc1d51 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:34.403825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe558d-7357-45ae-8367-3b6853cc1d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:34.404110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe558d-7357-45ae-8367-3b6853cc1d51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:34.405290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe558d-7357-45ae-8367-3b6853cc1d51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:34.406784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fe558d-7357-45ae-8367-3b6853cc1d51 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:34.408387 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 31/60] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:50:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:34.413749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ce361-66bc-4d66-b9e7-887715105180 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:34.417505 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:34.510191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ce361-66bc-4d66-b9e7-887715105180 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:34.542995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ac7b7-1693-4f9b-adfd-df79f27fe219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:34.543657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ac7b7-1693-4f9b-adfd-df79f27fe219 None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:34.543946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ac7b7-1693-4f9b-adfd-df79f27fe219 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:34.544223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ac7b7-1693-4f9b-adfd-df79f27fe219 None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:34.544945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ac7b7-1693-4f9b-adfd-df79f27fe219 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:34.546419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0ac7b7-1693-4f9b-adfd-df79f27fe219 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:34.636053 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 30/61] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 19 13:50:34 2022] POST /identity/v3/users => generated 275 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 13:50:37.825998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd07a2-322d-49c1-a987-76a5c0916a68 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:37.827092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd07a2-322d-49c1-a987-76a5c0916a68 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:37.827592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd07a2-322d-49c1-a987-76a5c0916a68 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:37.829364 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 32/62] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:37.834632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a255d3-9d6f-4af7-a0b7-1c65ae52694d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:37.835469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a255d3-9d6f-4af7-a0b7-1c65ae52694d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:37.835952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a255d3-9d6f-4af7-a0b7-1c65ae52694d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:37.858682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-83a255d3-9d6f-4af7-a0b7-1c65ae52694d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:37.860273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-83a255d3-9d6f-4af7-a0b7-1c65ae52694d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:37.942919 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:37.950684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05101774-5381-4c7a-9974-449e52a9d122 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:37.950977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05101774-5381-4c7a-9974-449e52a9d122 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:37.951264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05101774-5381-4c7a-9974-449e52a9d122 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:37.957266 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 33/63] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:37.959195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1bd8a-0b72-4d3f-ae56-203dedcfe0c0 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:37.959692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1bd8a-0b72-4d3f-ae56-203dedcfe0c0 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:37.960284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e1bd8a-0b72-4d3f-ae56-203dedcfe0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:37.961559 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 31/64] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:50:37.986578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a255d3-9d6f-4af7-a0b7-1c65ae52694d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:37.991930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f8e1bd8a-0b72-4d3f-ae56-203dedcfe0c0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:37.993141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f8e1bd8a-0b72-4d3f-ae56-203dedcfe0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:38.108401 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 34/65] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:50:38.110053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49179d1b-0bd6-48ca-b918-0d5b0702d021 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:38.110519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49179d1b-0bd6-48ca-b918-0d5b0702d021 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:38.110963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49179d1b-0bd6-48ca-b918-0d5b0702d021 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:38.112684 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 35/66] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:38.118012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507afbd-6178-4738-9d3e-f0fec2c97627 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:38.119045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507afbd-6178-4738-9d3e-f0fec2c97627 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:38.119432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5507afbd-6178-4738-9d3e-f0fec2c97627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:38.151866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5507afbd-6178-4738-9d3e-f0fec2c97627 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:38.153476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5507afbd-6178-4738-9d3e-f0fec2c97627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:38.160629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a255d3-9d6f-4af7-a0b7-1c65ae52694d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:38.198975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556b3ca-5536-4704-866a-1161918517a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:38.200097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556b3ca-5536-4704-866a-1161918517a6 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:38.200564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556b3ca-5536-4704-866a-1161918517a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:38.201011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556b3ca-5536-4704-866a-1161918517a6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:38.212522 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:38.224060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556b3ca-5536-4704-866a-1161918517a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:38.232718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-3556b3ca-5536-4704-866a-1161918517a6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:50:38.232718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:38.232718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:38.232718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:38.232718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:38.232718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:38.232718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:38.232718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:38.232718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:38.232718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:38.232718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:38.232718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:38.232718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:38.232718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:38.232718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:38.232718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:38.233566 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:38.233566 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:38.233566 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:38.233566 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:38.233566 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:38.233566 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:38.233566 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:38.233566 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:38.233566 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:38.233566 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:38.233566 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:38.233566 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:38.233566 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:38.233566 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:38.233566 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:38.233566 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:38.234353 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:38.234353 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:38.234353 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:38.234353 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:38.234353 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:38.234353 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:38.234353 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:38.234353 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:38.234353 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:38.234353 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:38.234353 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:50:38.234353 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:50:38.237047 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 32/67] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:50:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:50:38.238145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556b3ca-5536-4704-866a-1161918517a6 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:38.244835 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 36/68] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:50:38.245927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507afbd-6178-4738-9d3e-f0fec2c97627 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:38.299278 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:38.357008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556b3ca-5536-4704-866a-1161918517a6 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:38.359519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5507afbd-6178-4738-9d3e-f0fec2c97627 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:38.392084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18402158-6e16-4367-ad9e-3f2439de045b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:38.392889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18402158-6e16-4367-ad9e-3f2439de045b None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:38.393176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18402158-6e16-4367-ad9e-3f2439de045b None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:38.393456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18402158-6e16-4367-ad9e-3f2439de045b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:38.396000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d04bc9f-a440-4a58-810a-ca3cdd8f98bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:38.396671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04bc9f-a440-4a58-810a-ca3cdd8f98bc None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:38.396954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04bc9f-a440-4a58-810a-ca3cdd8f98bc None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:38.397232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04bc9f-a440-4a58-810a-ca3cdd8f98bc None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:38.397990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d04bc9f-a440-4a58-810a-ca3cdd8f98bc None admin] RBAC: Adding query filter params (name=member) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:38.398333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d04bc9f-a440-4a58-810a-ca3cdd8f98bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:38.399972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d04bc9f-a440-4a58-810a-ca3cdd8f98bc None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:38.404401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18402158-6e16-4367-ad9e-3f2439de045b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:38.412709 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 37/69] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:50:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:38.412709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836acc1-4770-4c9f-92d4-6de334cf78f6 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:38.412709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836acc1-4770-4c9f-92d4-6de334cf78f6 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:38.412709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836acc1-4770-4c9f-92d4-6de334cf78f6 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:38.412709 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 38/70] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:38.412709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836acc1-4770-4c9f-92d4-6de334cf78f6 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:38.416716 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-18402158-6e16-4367-ad9e-3f2439de045b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:50:38.416716 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:38.416716 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:38.416716 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:38.416716 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:38.416716 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:38.416716 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:38.416716 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:38.416716 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:38.416716 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:38.416716 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:38.416716 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:38.416716 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:38.416716 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:38.416716 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:38.416716 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:38.417630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:38.417630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:38.417630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:38.417630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:38.417630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:38.417630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:38.417630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:38.417630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:38.417630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:38.417630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:38.417630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:38.417630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:38.417630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:38.417630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:38.417630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:38.417630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:38.418456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:38.418456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:38.418456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:38.418456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:38.418456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:38.418456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:38.418456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:38.418456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:38.418456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:38.418456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:38.418456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:50:38.418456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:50:38.418456 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 33/71] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:50:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:50:38.419559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18402158-6e16-4367-ad9e-3f2439de045b None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:38.464513 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:38.524475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836acc1-4770-4c9f-92d4-6de334cf78f6 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:38.526746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18402158-6e16-4367-ad9e-3f2439de045b None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:38.537020 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:38.558893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f836ea-b123-4602-a287-49e4aeb6c6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:38.559707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f836ea-b123-4602-a287-49e4aeb6c6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:38.559992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f836ea-b123-4602-a287-49e4aeb6c6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:38.560079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f227ce6-1071-4bc1-a5b7-11b97d76bec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:38.560270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f836ea-b123-4602-a287-49e4aeb6c6c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:38.560895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f227ce6-1071-4bc1-a5b7-11b97d76bec8 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:38.561444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f227ce6-1071-4bc1-a5b7-11b97d76bec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:38.561726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f227ce6-1071-4bc1-a5b7-11b97d76bec8 None admin] PATH_INFO: `/v3/users/66c3af913fab4b349ffa0c81a1cd84a8` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:38.570469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f836ea-b123-4602-a287-49e4aeb6c6c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:38.575584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f227ce6-1071-4bc1-a5b7-11b97d76bec8 None admin] RBAC: Authorizing `identity:get_user(user_id=66c3af913fab4b349ffa0c81a1cd84a8)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:38.577053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f227ce6-1071-4bc1-a5b7-11b97d76bec8 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:38.578754 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 34/72] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:38 2022] GET /identity/v3/users/66c3af913fab4b349ffa0c81a1cd84a8 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:38.579926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ada57-2ba4-4b30-8faa-54ee1d06b078 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:38.580046 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-24f836ea-b123-4602-a287-49e4aeb6c6c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:50:38.580046 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:38.580046 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:38.580046 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:38.580046 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:38.580046 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:38.580046 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:38.580046 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:38.580046 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:38.580046 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:38.580046 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:38.580046 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:38.580046 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:38.580046 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:38.580046 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:38.580046 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:38.580828 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:38.580828 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:38.580828 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:38.580828 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:38.580828 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:38.580828 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:38.580828 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:38.580828 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:38.580828 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:38.580828 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:38.580828 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:38.580828 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:38.580828 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:38.580828 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:38.580828 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:38.580828 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:38.581591 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:38.581591 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:38.581591 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:38.581591 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:38.581591 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:38.581591 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:38.581591 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:38.581591 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:38.581591 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:38.581591 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:38.581591 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:50:38.581591 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:50:38.582206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ada57-2ba4-4b30-8faa-54ee1d06b078 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:38.582206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ada57-2ba4-4b30-8faa-54ee1d06b078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:38.582333 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 39/73] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 19 13:50:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:50:38.582333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f836ea-b123-4602-a287-49e4aeb6c6c6 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:38.598501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0c1ada57-2ba4-4b30-8faa-54ee1d06b078 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:38.599685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0c1ada57-2ba4-4b30-8faa-54ee1d06b078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:38.679444 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 35/74] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:50:38.681146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd3b61-2ad1-48b1-84ab-c36ee006c550 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:38.681492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd3b61-2ad1-48b1-84ab-c36ee006c550 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:38.681732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd3b61-2ad1-48b1-84ab-c36ee006c550 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:38.683057 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 36/75] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:38.687304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd3b61-2ad1-48b1-84ab-c36ee006c550 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:38.695315 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:38.699300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f836ea-b123-4602-a287-49e4aeb6c6c6 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:38.735041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a566e92-35f5-4622-92d8-547588235c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:38.735715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a566e92-35f5-4622-92d8-547588235c91 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:38.736026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a566e92-35f5-4622-92d8-547588235c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:38.736372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a566e92-35f5-4622-92d8-547588235c91 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:38.737074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a566e92-35f5-4622-92d8-547588235c91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:38.737388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a566e92-35f5-4622-92d8-547588235c91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:38.738807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a566e92-35f5-4622-92d8-547588235c91 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:38.747538 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 40/76] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:50:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:38.748329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a566e92-35f5-4622-92d8-547588235c91 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:38.788666 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:38.793886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd3b61-2ad1-48b1-84ab-c36ee006c550 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:38.830166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d05fb-2b47-4444-a277-9a8d4c21211c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:38.830827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d05fb-2b47-4444-a277-9a8d4c21211c None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:38.831119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d05fb-2b47-4444-a277-9a8d4c21211c None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:38.831404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d05fb-2b47-4444-a277-9a8d4c21211c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:38.848345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a566e92-35f5-4622-92d8-547588235c91 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:38.882504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3aa501-b1ad-4c03-8ba3-e0ce12269baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:38.883175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3aa501-b1ad-4c03-8ba3-e0ce12269baf None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:38.883463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3aa501-b1ad-4c03-8ba3-e0ce12269baf None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:38.883841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3aa501-b1ad-4c03-8ba3-e0ce12269baf None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:38.885104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3aa501-b1ad-4c03-8ba3-e0ce12269baf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:38.885416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3aa501-b1ad-4c03-8ba3-e0ce12269baf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:38.886841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3aa501-b1ad-4c03-8ba3-e0ce12269baf None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:38.898996 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 41/77] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:50:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:38.898996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31daae48-25eb-4f94-a9d4-1fe1b2115174 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:38.898996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31daae48-25eb-4f94-a9d4-1fe1b2115174 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:38.898996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31daae48-25eb-4f94-a9d4-1fe1b2115174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:38.899395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d05fb-2b47-4444-a277-9a8d4c21211c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:38.900291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32d05fb-2b47-4444-a277-9a8d4c21211c None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:38.914810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-31daae48-25eb-4f94-a9d4-1fe1b2115174 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:38.916318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-31daae48-25eb-4f94-a9d4-1fe1b2115174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:38.934076 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:38.985338 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 42/78] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:50:38.986193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31daae48-25eb-4f94-a9d4-1fe1b2115174 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:38.995812 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:38.999791 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 37/79] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:50:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:50:39.000443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d05fb-2b47-4444-a277-9a8d4c21211c None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:39.084449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31daae48-25eb-4f94-a9d4-1fe1b2115174 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:39.099572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d05fb-2b47-4444-a277-9a8d4c21211c None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:39.119442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1a5aa-272e-4d25-b763-6c3afb8c6510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:39.120244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1a5aa-272e-4d25-b763-6c3afb8c6510 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:39.120529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1a5aa-272e-4d25-b763-6c3afb8c6510 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:39.120807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1a5aa-272e-4d25-b763-6c3afb8c6510 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:39.130839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1a5aa-272e-4d25-b763-6c3afb8c6510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:39.133530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905f830-2d6b-4fad-9d46-9274887b43e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:39.135108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905f830-2d6b-4fad-9d46-9274887b43e4 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:39.135412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905f830-2d6b-4fad-9d46-9274887b43e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:39.135689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905f830-2d6b-4fad-9d46-9274887b43e4 None admin] PATH_INFO: `/v3/users/aee44b6994c447199831be944ec7980c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:39.136885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905f830-2d6b-4fad-9d46-9274887b43e4 None admin] RBAC: Authorizing `identity:get_user(user_id=aee44b6994c447199831be944ec7980c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:39.138411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905f830-2d6b-4fad-9d46-9274887b43e4 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:39.139230 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-79f1a5aa-272e-4d25-b763-6c3afb8c6510 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:50:39.139230 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:39.139230 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:39.139230 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:39.139230 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:39.139230 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:39.139230 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:39.139230 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:39.139230 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:39.139230 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:39.139230 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:39.139230 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:39.139230 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:39.139230 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:39.139230 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:39.139230 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:39.140106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:39.140106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:39.140106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:39.140106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:39.140106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:39.140106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:39.140106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:39.140106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:39.140106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:39.140106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:39.140106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:39.140106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:39.140106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:39.140106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:39.140106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:39.140106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:39.140878 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:39.140878 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:39.140878 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:39.140878 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:39.140878 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:39.140878 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:39.140878 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:39.140878 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:39.140878 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:39.140878 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:39.140878 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:50:39.140878 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:50:39.141464 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 38/80] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:38 2022] GET /identity/v3/users/aee44b6994c447199831be944ec7980c => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:39.141529 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 43/81] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:50:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:50:39.141601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905f830-2d6b-4fad-9d46-9274887b43e4 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:39.141675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1a5aa-272e-4d25-b763-6c3afb8c6510 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:39.158621 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:39.207694 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:39.244008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905f830-2d6b-4fad-9d46-9274887b43e4 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:39.244467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1a5aa-272e-4d25-b763-6c3afb8c6510 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:39.277731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dc02f-3b1d-44d2-83ae-f56487f92028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:39.278627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dc02f-3b1d-44d2-83ae-f56487f92028 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:39.278916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dc02f-3b1d-44d2-83ae-f56487f92028 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:39.279146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd443950-8d9c-451f-a34d-868524186b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:39.279340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dc02f-3b1d-44d2-83ae-f56487f92028 None admin] PATH_INFO: `/v3/users/66c3af913fab4b349ffa0c81a1cd84a8` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:39.280013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd443950-8d9c-451f-a34d-868524186b36 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:39.280306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd443950-8d9c-451f-a34d-868524186b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:39.280399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6dc02f-3b1d-44d2-83ae-f56487f92028 None admin] RBAC: Authorizing `identity:get_user(user_id=66c3af913fab4b349ffa0c81a1cd84a8)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:39.280594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd443950-8d9c-451f-a34d-868524186b36 None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:39.281800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd443950-8d9c-451f-a34d-868524186b36 None admin] RBAC: Authorizing `identity:get_project(project_id=488e2680f33948a99baf67e759f3e3fe)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:39.281897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6dc02f-3b1d-44d2-83ae-f56487f92028 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:39.283289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd443950-8d9c-451f-a34d-868524186b36 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:39.283487 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 39/82] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:39 2022] GET /identity/v3/users/66c3af913fab4b349ffa0c81a1cd84a8 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:39.284245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dc02f-3b1d-44d2-83ae-f56487f92028 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:39.285230 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 44/83] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:50:39 2022] GET /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:39.285753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd443950-8d9c-451f-a34d-868524186b36 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:39.367911 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:39.385152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dc02f-3b1d-44d2-83ae-f56487f92028 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:39.386012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd443950-8d9c-451f-a34d-868524186b36 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:39.419156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5c1fd-6013-4469-a2e0-268d2f6f880e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:39.419609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12223ed-1b7e-467b-bf45-8459856be6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:39.419945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5c1fd-6013-4469-a2e0-268d2f6f880e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:39.420234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5c1fd-6013-4469-a2e0-268d2f6f880e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:39.420320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12223ed-1b7e-467b-bf45-8459856be6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:39.420515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5c1fd-6013-4469-a2e0-268d2f6f880e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:39.420616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12223ed-1b7e-467b-bf45-8459856be6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:39.420814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12223ed-1b7e-467b-bf45-8459856be6b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:39.421684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5c1fd-6013-4469-a2e0-268d2f6f880e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:39.423183 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5c1fd-6013-4469-a2e0-268d2f6f880e None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:39.424823 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 40/84] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:50:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:39.426205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5c1fd-6013-4469-a2e0-268d2f6f880e None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:39.428084 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:39.492342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12223ed-1b7e-467b-bf45-8459856be6b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:39.494334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12223ed-1b7e-467b-bf45-8459856be6b2 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:39.523889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5c1fd-6013-4469-a2e0-268d2f6f880e None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:39.557879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d961a7a-cdbe-4b6d-890e-d46580f24603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:39.558569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d961a7a-cdbe-4b6d-890e-d46580f24603 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:39.558861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d961a7a-cdbe-4b6d-890e-d46580f24603 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:39.559143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d961a7a-cdbe-4b6d-890e-d46580f24603 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:39.559895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d961a7a-cdbe-4b6d-890e-d46580f24603 None admin] RBAC: Adding query filter params (name=member) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:39.560206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d961a7a-cdbe-4b6d-890e-d46580f24603 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:39.561840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d961a7a-cdbe-4b6d-890e-d46580f24603 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:39.569896 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 41/85] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:50:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:39.570712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d961a7a-cdbe-4b6d-890e-d46580f24603 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:39.575385 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:39.594546 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 45/86] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:50:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:50:39.595372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12223ed-1b7e-467b-bf45-8459856be6b2 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:39.634023 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:39.671073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d961a7a-cdbe-4b6d-890e-d46580f24603 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:39.694944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12223ed-1b7e-467b-bf45-8459856be6b2 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:39.704218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969e17b-4f7b-4c22-8eb4-df03c6521d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:39.704871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969e17b-4f7b-4c22-8eb4-df03c6521d74 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:39.705161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969e17b-4f7b-4c22-8eb4-df03c6521d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:39.705450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969e17b-4f7b-4c22-8eb4-df03c6521d74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:39.728596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea10b70-c498-4cbb-b23e-d70be062caca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:39.729251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea10b70-c498-4cbb-b23e-d70be062caca None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:39.729540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea10b70-c498-4cbb-b23e-d70be062caca None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:39.729823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea10b70-c498-4cbb-b23e-d70be062caca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:39.730709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea10b70-c498-4cbb-b23e-d70be062caca None admin] RBAC: Adding query filter params (role.id=e17d8526e56c4d319080a377398b9c74, scope.project.id=488e2680f33948a99baf67e759f3e3fe, user.id=66c3af913fab4b349ffa0c81a1cd84a8) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:39.731030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea10b70-c498-4cbb-b23e-d70be062caca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:39.732478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea10b70-c498-4cbb-b23e-d70be062caca None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:39.737757 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 46/87] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:50:39 2022] GET /identity/v3/role_assignments?user.id=66c3af913fab4b349ffa0c81a1cd84a8&scope.project.id=488e2680f33948a99baf67e759f3e3fe&role.id=e17d8526e56c4d319080a377398b9c74 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:39.738670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea10b70-c498-4cbb-b23e-d70be062caca None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:39.778423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969e17b-4f7b-4c22-8eb4-df03c6521d74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:39.779834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969e17b-4f7b-4c22-8eb4-df03c6521d74 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:39.790146 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:39.847936 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:39.861353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea10b70-c498-4cbb-b23e-d70be062caca None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:39.893372 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 42/88] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:50:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:50:39.894940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969e17b-4f7b-4c22-8eb4-df03c6521d74 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:39.907912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f1e4a-5fed-41f0-b99a-7ed51a7f8117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:39.908604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f1e4a-5fed-41f0-b99a-7ed51a7f8117 None admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:39.908904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f1e4a-5fed-41f0-b99a-7ed51a7f8117 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:39.909180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f1e4a-5fed-41f0-b99a-7ed51a7f8117 None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:39.909910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f1e4a-5fed-41f0-b99a-7ed51a7f8117 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:39.911397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f1e4a-5fed-41f0-b99a-7ed51a7f8117 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:39.996346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969e17b-4f7b-4c22-8eb4-df03c6521d74 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:40.030232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd4dac-88dc-461a-b3b3-edb44c3c7815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:40.031135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd4dac-88dc-461a-b3b3-edb44c3c7815 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:40.031426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd4dac-88dc-461a-b3b3-edb44c3c7815 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:40.031621 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 47/89] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 19 13:50:39 2022] POST /identity/v3/users => generated 289 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:50:40.031717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd4dac-88dc-461a-b3b3-edb44c3c7815 None admin] PATH_INFO: `/v3/users/66c3af913fab4b349ffa0c81a1cd84a8` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:40.032918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd4dac-88dc-461a-b3b3-edb44c3c7815 None admin] RBAC: Authorizing `identity:get_user(user_id=66c3af913fab4b349ffa0c81a1cd84a8)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:40.034397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdd4dac-88dc-461a-b3b3-edb44c3c7815 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:40.036083 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 43/90] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:39 2022] GET /identity/v3/users/66c3af913fab4b349ffa0c81a1cd84a8 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:40.041370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd4dac-88dc-461a-b3b3-edb44c3c7815 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:40.041452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f1e4a-5fed-41f0-b99a-7ed51a7f8117 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:40.086748 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:40.166894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd4dac-88dc-461a-b3b3-edb44c3c7815 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:40.212905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f1e4a-5fed-41f0-b99a-7ed51a7f8117 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:40.214534 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:40.220723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc05e7d-f719-4b72-a7af-9e3d74fef876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:40.221637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc05e7d-f719-4b72-a7af-9e3d74fef876 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:40.221881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc05e7d-f719-4b72-a7af-9e3d74fef876 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:40.222938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc05e7d-f719-4b72-a7af-9e3d74fef876 None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:40.223440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc05e7d-f719-4b72-a7af-9e3d74fef876 None admin] RBAC: Authorizing `identity:get_project(project_id=488e2680f33948a99baf67e759f3e3fe)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:40.224907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc05e7d-f719-4b72-a7af-9e3d74fef876 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:40.227019 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 44/91] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:50:40 2022] GET /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:40.227967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc05e7d-f719-4b72-a7af-9e3d74fef876 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:40.269618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34622a92-3309-4370-a464-fbe71bbe4aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:40.271464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34622a92-3309-4370-a464-fbe71bbe4aac None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:40.271464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34622a92-3309-4370-a464-fbe71bbe4aac None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:40.271464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34622a92-3309-4370-a464-fbe71bbe4aac None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:40.272653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34622a92-3309-4370-a464-fbe71bbe4aac None admin] RBAC: Authorizing `identity:get_project(project_id=488e2680f33948a99baf67e759f3e3fe)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:40.274581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34622a92-3309-4370-a464-fbe71bbe4aac None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:40.280665 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 48/92] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:50:40 2022] GET /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:40.280665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34622a92-3309-4370-a464-fbe71bbe4aac None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:40.361982 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:40.365700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc05e7d-f719-4b72-a7af-9e3d74fef876 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:40.412543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34622a92-3309-4370-a464-fbe71bbe4aac None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:40.417439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4ed98-9692-4ff3-9e29-3fe41819ba92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:40.418133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4ed98-9692-4ff3-9e29-3fe41819ba92 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:40.418428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4ed98-9692-4ff3-9e29-3fe41819ba92 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:40.418718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b4ed98-9692-4ff3-9e29-3fe41819ba92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:40.455318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05caa0b-37fb-4699-a14c-65b7916cb3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:40.456809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05caa0b-37fb-4699-a14c-65b7916cb3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:40.457571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05caa0b-37fb-4699-a14c-65b7916cb3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:40.458048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05caa0b-37fb-4699-a14c-65b7916cb3f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:40.459623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05caa0b-37fb-4699-a14c-65b7916cb3f8 None admin] RBAC: Adding query filter params (role.id=b73e411ed06b463fb578c06789886960, scope.project.id=488e2680f33948a99baf67e759f3e3fe, user.id=66c3af913fab4b349ffa0c81a1cd84a8) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:40.460394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05caa0b-37fb-4699-a14c-65b7916cb3f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:40.463124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05caa0b-37fb-4699-a14c-65b7916cb3f8 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:40.472528 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 49/93] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:50:40 2022] GET /identity/v3/role_assignments?user.id=66c3af913fab4b349ffa0c81a1cd84a8&scope.project.id=488e2680f33948a99baf67e759f3e3fe&role.id=b73e411ed06b463fb578c06789886960 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:40.473984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05caa0b-37fb-4699-a14c-65b7916cb3f8 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:40.530990 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:40.532914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4ed98-9692-4ff3-9e29-3fe41819ba92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:40.534688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b4ed98-9692-4ff3-9e29-3fe41819ba92 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:40.679750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05caa0b-37fb-4699-a14c-65b7916cb3f8 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:40.718001 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:40.722734 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 45/94] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:50:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:50:40.726159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17ec5c-2929-4325-ac42-d58129cb3525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:40.726805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17ec5c-2929-4325-ac42-d58129cb3525 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:40.727390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17ec5c-2929-4325-ac42-d58129cb3525 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:40.728408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17ec5c-2929-4325-ac42-d58129cb3525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:40.729266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4ed98-9692-4ff3-9e29-3fe41819ba92 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:40.734123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17ec5c-2929-4325-ac42-d58129cb3525 None admin] RBAC: Adding query filter params (role.id=bc315edf089d43b18acf9790031f3fcb, scope.project.id=488e2680f33948a99baf67e759f3e3fe, user.id=aee44b6994c447199831be944ec7980c) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:40.734123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17ec5c-2929-4325-ac42-d58129cb3525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:40.734123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17ec5c-2929-4325-ac42-d58129cb3525 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:40.737652 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 50/95] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:50:40 2022] GET /identity/v3/role_assignments?user.id=aee44b6994c447199831be944ec7980c&scope.project.id=488e2680f33948a99baf67e759f3e3fe&role.id=bc315edf089d43b18acf9790031f3fcb => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:40.872741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b4ed98-9692-4ff3-9e29-3fe41819ba92 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:40.917939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1def23b-ba7b-4d2e-b54a-14351c483e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:40.918847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1def23b-ba7b-4d2e-b54a-14351c483e43 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:40.919190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1def23b-ba7b-4d2e-b54a-14351c483e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:40.919468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1def23b-ba7b-4d2e-b54a-14351c483e43 None admin] PATH_INFO: `/v3/projects/b098aba0d6094bf5bc84b5be9dfadc3f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:40.920737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1def23b-ba7b-4d2e-b54a-14351c483e43 None admin] RBAC: Authorizing `identity:get_project(project_id=b098aba0d6094bf5bc84b5be9dfadc3f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:40.922221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1def23b-ba7b-4d2e-b54a-14351c483e43 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:40.924135 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 46/96] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:50:40 2022] GET /identity/v3/projects/b098aba0d6094bf5bc84b5be9dfadc3f => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:50:40.930199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17ec5c-2929-4325-ac42-d58129cb3525 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:41.092457 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:41.097508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17ec5c-2929-4325-ac42-d58129cb3525 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:41.145512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970f697-2dd0-4d25-9f00-ed27bf0036e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:41.146594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970f697-2dd0-4d25-9f00-ed27bf0036e8 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:41.147089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970f697-2dd0-4d25-9f00-ed27bf0036e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:41.147596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970f697-2dd0-4d25-9f00-ed27bf0036e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:41.148661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970f697-2dd0-4d25-9f00-ed27bf0036e8 None admin] RBAC: Adding query filter params (role.id=e17d8526e56c4d319080a377398b9c74, scope.project.id=b098aba0d6094bf5bc84b5be9dfadc3f, user.id=66c3af913fab4b349ffa0c81a1cd84a8) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:41.149210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970f697-2dd0-4d25-9f00-ed27bf0036e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:41.151925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970f697-2dd0-4d25-9f00-ed27bf0036e8 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:41.162705 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 51/97] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:50:40 2022] GET /identity/v3/role_assignments?user.id=66c3af913fab4b349ffa0c81a1cd84a8&scope.project.id=b098aba0d6094bf5bc84b5be9dfadc3f&role.id=e17d8526e56c4d319080a377398b9c74 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:41.986243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601414a-08b1-45e6-aa9c-654c71608ded None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:41.986779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601414a-08b1-45e6-aa9c-654c71608ded None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:41.986779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6601414a-08b1-45e6-aa9c-654c71608ded None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:41.988298 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 47/98] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:41.994324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62bbad-1617-407b-848d-e7ad821d1378 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:41.994812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62bbad-1617-407b-848d-e7ad821d1378 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:41.995011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62bbad-1617-407b-848d-e7ad821d1378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:42.023102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3a62bbad-1617-407b-848d-e7ad821d1378 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:42.024309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3a62bbad-1617-407b-848d-e7ad821d1378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:42.110138 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 52/99] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:50:42.138779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601414a-08b1-45e6-aa9c-654c71608ded None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:42.308856 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:42.359345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6601414a-08b1-45e6-aa9c-654c71608ded None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:42.401617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dea421-063a-4929-89ca-d85d1433b122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:42.402452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dea421-063a-4929-89ca-d85d1433b122 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:42.402744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dea421-063a-4929-89ca-d85d1433b122 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:42.403026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dea421-063a-4929-89ca-d85d1433b122 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:42.415721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dea421-063a-4929-89ca-d85d1433b122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:42.424154 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-40dea421-063a-4929-89ca-d85d1433b122 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:50:42.424154 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:42.424154 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:42.424154 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:42.424154 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:42.424154 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:42.424154 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:42.424154 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:42.424154 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:42.424154 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:42.424154 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:42.424154 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:42.424154 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:42.424154 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:42.424154 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:42.424154 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:42.425009 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:42.425009 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:42.425009 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:42.425009 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:42.425009 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:42.425009 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:42.425009 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:42.425009 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:42.425009 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:42.425009 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:42.425009 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:42.425009 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:42.425009 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:42.425009 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:42.425009 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:42.425009 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:42.425769 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:42.425769 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:42.425769 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:42.425769 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:42.425769 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:42.425769 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:42.425769 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:42.425769 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:42.425769 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:42.425769 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:42.425769 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:50:42.425769 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:50:42.425769 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 48/100] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:50:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:50:42.433820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62bbad-1617-407b-848d-e7ad821d1378 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:42.542461 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:42.553049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62bbad-1617-407b-848d-e7ad821d1378 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:42.595912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1a79e-dbad-4b3e-a1cb-13e56f54e402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:42.596517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1a79e-dbad-4b3e-a1cb-13e56f54e402 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:42.596809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1a79e-dbad-4b3e-a1cb-13e56f54e402 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:42.597093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb1a79e-dbad-4b3e-a1cb-13e56f54e402 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:42.597867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1a79e-dbad-4b3e-a1cb-13e56f54e402 None admin] RBAC: Adding query filter params (name=member) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:42.598205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1a79e-dbad-4b3e-a1cb-13e56f54e402 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:42.599609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb1a79e-dbad-4b3e-a1cb-13e56f54e402 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:42.614214 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 53/101] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:50:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:42.621363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dea421-063a-4929-89ca-d85d1433b122 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:42.738769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dea421-063a-4929-89ca-d85d1433b122 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:42.767187 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:42.781627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d4b51-279c-4689-ab87-77f359a23cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:42.782547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d4b51-279c-4689-ab87-77f359a23cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:42.782841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d4b51-279c-4689-ab87-77f359a23cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:42.783122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d4b51-279c-4689-ab87-77f359a23cb9 None admin] PATH_INFO: `/v3/users/66c3af913fab4b349ffa0c81a1cd84a8` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:42.784367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d4b51-279c-4689-ab87-77f359a23cb9 None admin] RBAC: Authorizing `identity:get_user(user_id=66c3af913fab4b349ffa0c81a1cd84a8)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:42.785835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d4b51-279c-4689-ab87-77f359a23cb9 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:42.787691 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 49/102] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:42 2022] GET /identity/v3/users/66c3af913fab4b349ffa0c81a1cd84a8 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:42.794829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1a79e-dbad-4b3e-a1cb-13e56f54e402 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:42.887369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0080a4e-7f2c-44ee-9375-523b77f33cb0 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:42.887658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0080a4e-7f2c-44ee-9375-523b77f33cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:42.887860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0080a4e-7f2c-44ee-9375-523b77f33cb0 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:42.889375 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 50/103] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:42.906540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c8bf6-c898-4bb8-8ff1-f3377a698a35 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:42.906824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c8bf6-c898-4bb8-8ff1-f3377a698a35 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:42.907109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c8bf6-c898-4bb8-8ff1-f3377a698a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:42.930318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5a8c8bf6-c898-4bb8-8ff1-f3377a698a35 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:42.932197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5a8c8bf6-c898-4bb8-8ff1-f3377a698a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:42.960403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb1a79e-dbad-4b3e-a1cb-13e56f54e402 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:43.024208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4abf09-a88a-47c0-9f0c-5d7a64dc25d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:43.025553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4abf09-a88a-47c0-9f0c-5d7a64dc25d2 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:43.025553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4abf09-a88a-47c0-9f0c-5d7a64dc25d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:43.025828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4abf09-a88a-47c0-9f0c-5d7a64dc25d2 None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:43.028198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4abf09-a88a-47c0-9f0c-5d7a64dc25d2 None admin] RBAC: Authorizing `identity:get_project(project_id=488e2680f33948a99baf67e759f3e3fe)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:43.029653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4abf09-a88a-47c0-9f0c-5d7a64dc25d2 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:43.031865 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 54/104] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:50:42 2022] GET /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:43.037638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4abf09-a88a-47c0-9f0c-5d7a64dc25d2 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:43.066906 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 51/105] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:50:43.084827 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:43.098420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c8bf6-c898-4bb8-8ff1-f3377a698a35 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:43.225242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4abf09-a88a-47c0-9f0c-5d7a64dc25d2 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:43.322725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8c8bf6-c898-4bb8-8ff1-f3377a698a35 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:43.328962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b00c57-b588-4326-b7a7-8652e04e4c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:43.330223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b00c57-b588-4326-b7a7-8652e04e4c08 None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:43.330707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b00c57-b588-4326-b7a7-8652e04e4c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:43.331178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b00c57-b588-4326-b7a7-8652e04e4c08 None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe/users/66c3af913fab4b349ffa0c81a1cd84a8/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:43.339510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b00c57-b588-4326-b7a7-8652e04e4c08 None admin] RBAC: Authorizing `identity:create_grant(project_id=488e2680f33948a99baf67e759f3e3fe, user_id=66c3af913fab4b349ffa0c81a1cd84a8, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:43.341274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b00c57-b588-4326-b7a7-8652e04e4c08 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:43.379761 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:43.391776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e36f2-2c4b-4c59-bacb-c68ec1b8136c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:43.392598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e36f2-2c4b-4c59-bacb-c68ec1b8136c None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:43.392889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e36f2-2c4b-4c59-bacb-c68ec1b8136c None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:43.393173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e36f2-2c4b-4c59-bacb-c68ec1b8136c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:43.394401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e36f2-2c4b-4c59-bacb-c68ec1b8136c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:43.395881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e36f2-2c4b-4c59-bacb-c68ec1b8136c None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:43.397859 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 52/106] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:50:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:43.403952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e36f2-2c4b-4c59-bacb-c68ec1b8136c None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:43.429889 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 55/107] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:50:43 2022] PUT /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe/users/66c3af913fab4b349ffa0c81a1cd84a8/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 13:50:43.562872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e36f2-2c4b-4c59-bacb-c68ec1b8136c None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:43.612025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d2ba6-799e-4702-a137-34e71916cf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:43.612709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d2ba6-799e-4702-a137-34e71916cf4b None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:43.613001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d2ba6-799e-4702-a137-34e71916cf4b None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:43.613288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d2ba6-799e-4702-a137-34e71916cf4b None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:43.614020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d2ba6-799e-4702-a137-34e71916cf4b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:43.619177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d2ba6-799e-4702-a137-34e71916cf4b None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:43.725051 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 53/108] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 19 13:50:43 2022] POST /identity/v3/projects => generated 302 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 13:50:43.766548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2041c4d-185e-42b9-b29f-4fa2ab4fd2f8 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:43.767199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2041c4d-185e-42b9-b29f-4fa2ab4fd2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:43.767706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2041c4d-185e-42b9-b29f-4fa2ab4fd2f8 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:43.769327 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 56/109] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:43.775820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ce6e5-fd4b-4f52-a669-8bccd566ed29 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:43.776004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ce6e5-fd4b-4f52-a669-8bccd566ed29 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:43.776252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ce6e5-fd4b-4f52-a669-8bccd566ed29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:43.794998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-218ce6e5-fd4b-4f52-a669-8bccd566ed29 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:43.796218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-218ce6e5-fd4b-4f52-a669-8bccd566ed29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:43.845133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24dd056-6c55-4c1e-9eed-ee01db446edc None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:43.845738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24dd056-6c55-4c1e-9eed-ee01db446edc None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:43.846240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24dd056-6c55-4c1e-9eed-ee01db446edc None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:43.847674 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:43.848309 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 57/110] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:43.855656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090f462-d86a-4edc-94ab-a00e2ac64633 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:43.856242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090f462-d86a-4edc-94ab-a00e2ac64633 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:43.856682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9090f462-d86a-4edc-94ab-a00e2ac64633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:43.878972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9090f462-d86a-4edc-94ab-a00e2ac64633 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:43.879998 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 54/111] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:50:43.881151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9090f462-d86a-4edc-94ab-a00e2ac64633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:43.884789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ea0e2-f9ce-4260-b87a-1dc28f6ae363 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:43.885446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ea0e2-f9ce-4260-b87a-1dc28f6ae363 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:43.885446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ea0e2-f9ce-4260-b87a-1dc28f6ae363 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:43.890924 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 55/112] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:43.892990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbf79f-5d55-4fec-8a05-b6b79376407a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:43.893289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbf79f-5d55-4fec-8a05-b6b79376407a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:43.893578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fbf79f-5d55-4fec-8a05-b6b79376407a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:43.923985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e5fbf79f-5d55-4fec-8a05-b6b79376407a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:43.925566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e5fbf79f-5d55-4fec-8a05-b6b79376407a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:44.017680 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 58/113] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:50:44.023039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090f462-d86a-4edc-94ab-a00e2ac64633 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:44.039525 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 56/114] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:50:44.059166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbf79f-5d55-4fec-8a05-b6b79376407a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:44.062154 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:44.197924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9090f462-d86a-4edc-94ab-a00e2ac64633 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:44.200575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fbf79f-5d55-4fec-8a05-b6b79376407a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:44.210890 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:44.249595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614979a8-ac31-4f5b-a2b2-668a151827c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:44.250701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614979a8-ac31-4f5b-a2b2-668a151827c4 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:44.251176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614979a8-ac31-4f5b-a2b2-668a151827c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:44.251649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614979a8-ac31-4f5b-a2b2-668a151827c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:44.252610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c5754-a7aa-47f7-bdf5-a2dcc7e20d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:44.253544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c5754-a7aa-47f7-bdf5-a2dcc7e20d4e None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:44.253963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c5754-a7aa-47f7-bdf5-a2dcc7e20d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:44.254577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c5754-a7aa-47f7-bdf5-a2dcc7e20d4e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:44.265057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614979a8-ac31-4f5b-a2b2-668a151827c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:44.267231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c5754-a7aa-47f7-bdf5-a2dcc7e20d4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:44.274207 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-614979a8-ac31-4f5b-a2b2-668a151827c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:50:44.274207 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:44.274207 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:44.274207 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:44.274207 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:44.274207 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:44.274207 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:44.274207 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:44.274207 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:44.274207 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:44.274207 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:44.274207 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:44.274207 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:44.274207 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:44.274207 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:44.274207 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:44.275612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:44.275612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:44.275612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:44.275612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:44.275612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:44.275612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:44.275612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:44.275612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:44.275612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:44.275612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:44.275612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:44.275612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:44.275612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:44.275612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:44.275612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:44.275612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:44.276436 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:44.276436 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:44.276436 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:44.276436 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:44.276436 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:44.276436 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:44.276436 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:44.276436 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:44.276436 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:44.276436 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:44.276436 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:50:44.276436 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:50:44.277010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-846c5754-a7aa-47f7-bdf5-a2dcc7e20d4e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 13:50:44.277010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:44.277010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:44.277010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:44.277010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:44.277010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:44.277010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:44.277010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:44.277010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:44.277010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:44.277010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:44.277010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:44.277010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:44.277010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:44.277010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:44.277010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:44.277787 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:44.277787 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:44.277787 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:44.277787 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:44.277787 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:44.277787 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:44.277787 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:44.277787 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:44.277787 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:44.277787 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:44.277787 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:44.277787 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:44.277787 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:44.277787 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:44.277787 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:44.277787 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:44.278627 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:44.278627 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:44.278627 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:44.278627 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:44.278627 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:44.278627 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:44.278627 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:44.278627 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:44.278627 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:44.278627 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:44.278627 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 13:50:44.278627 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:50:44.278627 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 59/115] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:50:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:50:44.278627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c5754-a7aa-47f7-bdf5-a2dcc7e20d4e None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:44.281745 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 57/116] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:50:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:50:44.291189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614979a8-ac31-4f5b-a2b2-668a151827c4 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:44.395325 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:44.402451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614979a8-ac31-4f5b-a2b2-668a151827c4 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:44.442198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7deef-b7cc-4eb1-926f-41fdfc74a3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:44.443262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7deef-b7cc-4eb1-926f-41fdfc74a3f5 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:44.443752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7deef-b7cc-4eb1-926f-41fdfc74a3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:44.444232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a7deef-b7cc-4eb1-926f-41fdfc74a3f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:44.445194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7deef-b7cc-4eb1-926f-41fdfc74a3f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:44.445828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7deef-b7cc-4eb1-926f-41fdfc74a3f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:44.448070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a7deef-b7cc-4eb1-926f-41fdfc74a3f5 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:44.455674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c5754-a7aa-47f7-bdf5-a2dcc7e20d4e None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:44.457758 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 58/117] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:50:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:44.458826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7deef-b7cc-4eb1-926f-41fdfc74a3f5 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:44.489996 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:44.530474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290c156-e8c9-4499-b780-6d2f6b9e4487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:44.531367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290c156-e8c9-4499-b780-6d2f6b9e4487 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:44.531672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290c156-e8c9-4499-b780-6d2f6b9e4487 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:44.531931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290c156-e8c9-4499-b780-6d2f6b9e4487 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:44.556035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290c156-e8c9-4499-b780-6d2f6b9e4487 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:44.573208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a7deef-b7cc-4eb1-926f-41fdfc74a3f5 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:44.573608 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-7290c156-e8c9-4499-b780-6d2f6b9e4487 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:50:44.573608 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:44.573608 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:44.573608 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:44.573608 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:44.573608 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:44.573608 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:44.573608 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:44.573608 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:44.573608 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:44.573608 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:44.573608 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:44.573608 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:44.573608 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:44.573608 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:44.573608 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:44.574635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:44.574635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:44.574635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:44.574635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:44.574635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:44.574635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:44.574635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:44.574635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:44.574635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:44.574635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:44.574635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:44.574635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:44.574635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:44.574635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:44.574635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:44.574635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:44.575595 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:44.575595 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:44.575595 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:44.575595 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:44.575595 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:44.575595 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:44.575595 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:44.575595 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:44.575595 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:44.575595 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:44.575595 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:50:44.575595 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:50:44.578135 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 60/118] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 19 13:50:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:50:44.579105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290c156-e8c9-4499-b780-6d2f6b9e4487 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:44.613541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a2b7b-cd44-4c2a-8123-2f1639c23f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:44.614685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a2b7b-cd44-4c2a-8123-2f1639c23f28 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:44.618221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a2b7b-cd44-4c2a-8123-2f1639c23f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:44.618221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a2b7b-cd44-4c2a-8123-2f1639c23f28 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:44.618221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a2b7b-cd44-4c2a-8123-2f1639c23f28 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:44.618221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a2b7b-cd44-4c2a-8123-2f1639c23f28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:44.619577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a2b7b-cd44-4c2a-8123-2f1639c23f28 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:44.629035 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 59/119] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:50:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:44.629816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a2b7b-cd44-4c2a-8123-2f1639c23f28 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:44.730530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290c156-e8c9-4499-b780-6d2f6b9e4487 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:44.732706 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:44.743880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a2b7b-cd44-4c2a-8123-2f1639c23f28 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:44.772591 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:44.779813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed5e3e-e0f8-456a-ad91-1cf654cf8bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:44.780327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441da64a-d8fa-40be-8b40-60d2140cd37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:44.780690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed5e3e-e0f8-456a-ad91-1cf654cf8bbb None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:44.781137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed5e3e-e0f8-456a-ad91-1cf654cf8bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:44.781245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441da64a-d8fa-40be-8b40-60d2140cd37d None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:44.781669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441da64a-d8fa-40be-8b40-60d2140cd37d None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:44.781843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed5e3e-e0f8-456a-ad91-1cf654cf8bbb None admin] PATH_INFO: `/v3/users/a393084949ed4d999afb7c253b9c6e5b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:44.782074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441da64a-d8fa-40be-8b40-60d2140cd37d None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:44.783188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441da64a-d8fa-40be-8b40-60d2140cd37d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:44.783571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441da64a-d8fa-40be-8b40-60d2140cd37d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:44.785120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441da64a-d8fa-40be-8b40-60d2140cd37d None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:44.798061 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 60/120] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:50:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:44.799572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d6a30-bd51-4bf5-adc6-b40931bb9819 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:44.799960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d6a30-bd51-4bf5-adc6-b40931bb9819 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:44.800334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d6a30-bd51-4bf5-adc6-b40931bb9819 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:44.801951 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 61/121] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:44.802763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d6a30-bd51-4bf5-adc6-b40931bb9819 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:44.808850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed5e3e-e0f8-456a-ad91-1cf654cf8bbb None admin] RBAC: Authorizing `identity:get_user(user_id=a393084949ed4d999afb7c253b9c6e5b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:44.810374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ed5e3e-e0f8-456a-ad91-1cf654cf8bbb None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:44.812526 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 61/122] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:44 2022] GET /identity/v3/users/a393084949ed4d999afb7c253b9c6e5b => generated 289 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:44.818874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed5e3e-e0f8-456a-ad91-1cf654cf8bbb None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:44.925789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ed5e3e-e0f8-456a-ad91-1cf654cf8bbb None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:44.927558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d6a30-bd51-4bf5-adc6-b40931bb9819 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:44.970052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbf22d-cd4e-4178-b1f2-1e24105cdb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:44.970651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4df14-b734-44a2-9481-2bc3ec6494ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:44.971019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbf22d-cd4e-4178-b1f2-1e24105cdb53 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:44.971315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbf22d-cd4e-4178-b1f2-1e24105cdb53 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:44.971537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4df14-b734-44a2-9481-2bc3ec6494ea None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:44.971643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbf22d-cd4e-4178-b1f2-1e24105cdb53 None admin] PATH_INFO: `/v3/users/66c3af913fab4b349ffa0c81a1cd84a8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:44.971839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4df14-b734-44a2-9481-2bc3ec6494ea None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:44.972130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf4df14-b734-44a2-9481-2bc3ec6494ea None admin] PATH_INFO: `/v3/users/aee44b6994c447199831be944ec7980c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:44.972807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbf22d-cd4e-4178-b1f2-1e24105cdb53 None admin] RBAC: Authorizing `identity:get_user(user_id=66c3af913fab4b349ffa0c81a1cd84a8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:44.973713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4df14-b734-44a2-9481-2bc3ec6494ea None admin] RBAC: Authorizing `identity:get_user(user_id=aee44b6994c447199831be944ec7980c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:44.974409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefbf22d-cd4e-4178-b1f2-1e24105cdb53 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:44.975228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf4df14-b734-44a2-9481-2bc3ec6494ea None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:44.976184 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 62/123] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:44 2022] GET /identity/v3/users/66c3af913fab4b349ffa0c81a1cd84a8 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:44.977523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb394e39-0a19-4050-b48f-30e020811462 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:44.978537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb394e39-0a19-4050-b48f-30e020811462 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:44.978828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb394e39-0a19-4050-b48f-30e020811462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:44.982887 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 62/124] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:44 2022] GET /identity/v3/users/aee44b6994c447199831be944ec7980c => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:44.984013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4df14-b734-44a2-9481-2bc3ec6494ea None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:44.999364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-eb394e39-0a19-4050-b48f-30e020811462 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:45.000875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eb394e39-0a19-4050-b48f-30e020811462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:45.016661 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:45.073879 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:45.094716 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 63/125] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:50:45.095860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb394e39-0a19-4050-b48f-30e020811462 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:45.110682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf4df14-b734-44a2-9481-2bc3ec6494ea None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:45.155771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56b53e-efba-4b67-8496-ffc253318b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:45.156475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56b53e-efba-4b67-8496-ffc253318b92 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:45.156772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56b53e-efba-4b67-8496-ffc253318b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:45.157200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f56b53e-efba-4b67-8496-ffc253318b92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:45.225270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb394e39-0a19-4050-b48f-30e020811462 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:45.254341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56b53e-efba-4b67-8496-ffc253318b92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:45.256078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f56b53e-efba-4b67-8496-ffc253318b92 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:45.263471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ce465-c5da-40e2-a188-9f0a8e75b14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:45.264587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ce465-c5da-40e2-a188-9f0a8e75b14b None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:45.265072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ce465-c5da-40e2-a188-9f0a8e75b14b None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:45.265584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ce465-c5da-40e2-a188-9f0a8e75b14b None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:45.267080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ce465-c5da-40e2-a188-9f0a8e75b14b None admin] RBAC: Authorizing `identity:get_project(project_id=488e2680f33948a99baf67e759f3e3fe)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:45.268727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490ce465-c5da-40e2-a188-9f0a8e75b14b None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:45.270719 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 64/126] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:50:45 2022] GET /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:45.271683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ce465-c5da-40e2-a188-9f0a8e75b14b None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:45.280463 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:45.340322 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:45.380162 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 63/127] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:50:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:50:45.380928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56b53e-efba-4b67-8496-ffc253318b92 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:45.394011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ce465-c5da-40e2-a188-9f0a8e75b14b None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:45.435389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f97db-dcbc-4601-959d-0dec4c02aa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:45.437019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f97db-dcbc-4601-959d-0dec4c02aa3e None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:45.437503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f97db-dcbc-4601-959d-0dec4c02aa3e None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:45.437975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f97db-dcbc-4601-959d-0dec4c02aa3e None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:45.440267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f97db-dcbc-4601-959d-0dec4c02aa3e None admin] RBAC: Authorizing `identity:get_project(project_id=488e2680f33948a99baf67e759f3e3fe)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:45.442803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f97db-dcbc-4601-959d-0dec4c02aa3e None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:45.444791 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 65/128] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:50:45 2022] GET /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:45.450598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f97db-dcbc-4601-959d-0dec4c02aa3e None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:45.505914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f56b53e-efba-4b67-8496-ffc253318b92 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:45.533428 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:45.551155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419db4c3-d664-4696-8301-f9891ad4632c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:45.551982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419db4c3-d664-4696-8301-f9891ad4632c None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:45.552401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419db4c3-d664-4696-8301-f9891ad4632c None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:45.552697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419db4c3-d664-4696-8301-f9891ad4632c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:45.567696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419db4c3-d664-4696-8301-f9891ad4632c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:45.572535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f97db-dcbc-4601-959d-0dec4c02aa3e None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:45.578742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-419db4c3-d664-4696-8301-f9891ad4632c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:50:45.578742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:45.578742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:45.578742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:45.578742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:45.578742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:45.578742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:45.578742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:45.578742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:45.578742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:45.578742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:45.578742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:45.578742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:45.578742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:45.578742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:45.578742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:45.579652 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:45.579652 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:45.579652 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:45.579652 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:45.579652 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:45.579652 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:45.579652 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:45.579652 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:45.579652 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:45.579652 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:45.579652 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:45.579652 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:45.579652 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:45.579652 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:45.579652 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:45.579652 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:45.580426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:45.580426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:45.580426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:45.580426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:45.580426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:45.580426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:45.580426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:45.580426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:45.580426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:45.580426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:45.580426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:50:45.580426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:50:45.580426 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 64/129] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:50:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:50:45.581553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419db4c3-d664-4696-8301-f9891ad4632c None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:45.602350 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:45.617169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeadac1-80dc-47e8-9115-2ef9d83a8213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:45.619157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeadac1-80dc-47e8-9115-2ef9d83a8213 None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:45.619650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeadac1-80dc-47e8-9115-2ef9d83a8213 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:45.620147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeadac1-80dc-47e8-9115-2ef9d83a8213 None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe/users/66c3af913fab4b349ffa0c81a1cd84a8/roles/b73e411ed06b463fb578c06789886960` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:45.623048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeadac1-80dc-47e8-9115-2ef9d83a8213 None admin] RBAC: Authorizing `identity:create_grant(project_id=488e2680f33948a99baf67e759f3e3fe, user_id=66c3af913fab4b349ffa0c81a1cd84a8, role_id=b73e411ed06b463fb578c06789886960)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:45.624926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeadac1-80dc-47e8-9115-2ef9d83a8213 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:45.695922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419db4c3-d664-4696-8301-f9891ad4632c None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:45.732111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c6cac-29ec-4cc5-9c9f-26b1836d2d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:45.732999 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c6cac-29ec-4cc5-9c9f-26b1836d2d7e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:45.733335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c6cac-29ec-4cc5-9c9f-26b1836d2d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:45.733685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c6cac-29ec-4cc5-9c9f-26b1836d2d7e None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:45.734989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c6cac-29ec-4cc5-9c9f-26b1836d2d7e None admin] RBAC: Authorizing `identity:get_project(project_id=488e2680f33948a99baf67e759f3e3fe)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:45.736462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c6cac-29ec-4cc5-9c9f-26b1836d2d7e None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:45.742593 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 66/130] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:50:45 2022] PUT /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe/users/66c3af913fab4b349ffa0c81a1cd84a8/roles/b73e411ed06b463fb578c06789886960 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:50:45.742725 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 65/131] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:50:45 2022] GET /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:45.742725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c6cac-29ec-4cc5-9c9f-26b1836d2d7e None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:45.743679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeadac1-80dc-47e8-9115-2ef9d83a8213 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:45.797062 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:45.866210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c6cac-29ec-4cc5-9c9f-26b1836d2d7e None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:45.883498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeadac1-80dc-47e8-9115-2ef9d83a8213 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:45.916467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641bc53-788b-4a83-b7a7-e10f02c21d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:45.916898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641bc53-788b-4a83-b7a7-e10f02c21d44 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:45.917189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641bc53-788b-4a83-b7a7-e10f02c21d44 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:45.917473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641bc53-788b-4a83-b7a7-e10f02c21d44 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:45.918297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641bc53-788b-4a83-b7a7-e10f02c21d44 None admin] RBAC: Adding query filter params (name=member) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:45.918675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641bc53-788b-4a83-b7a7-e10f02c21d44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:45.920056 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641bc53-788b-4a83-b7a7-e10f02c21d44 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:45.927671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a2690-87a2-4fac-b04c-db7285ba9295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:45.929243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a2690-87a2-4fac-b04c-db7285ba9295 None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:45.929736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a2690-87a2-4fac-b04c-db7285ba9295 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:45.930294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a2690-87a2-4fac-b04c-db7285ba9295 None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe/users/aee44b6994c447199831be944ec7980c/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:45.930396 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 66/132] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:50:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:45.931920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641bc53-788b-4a83-b7a7-e10f02c21d44 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:45.933852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a2690-87a2-4fac-b04c-db7285ba9295 None admin] RBAC: Authorizing `identity:create_grant(project_id=488e2680f33948a99baf67e759f3e3fe, user_id=aee44b6994c447199831be944ec7980c, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:45.937431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a2690-87a2-4fac-b04c-db7285ba9295 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:46.008155 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 67/133] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:50:45 2022] PUT /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe/users/aee44b6994c447199831be944ec7980c/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:50:46.009838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c76152-1553-410a-845f-fd9dc71eec3e None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:46.010160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c76152-1553-410a-845f-fd9dc71eec3e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:46.010452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c76152-1553-410a-845f-fd9dc71eec3e None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:46.011976 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 68/134] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:46.012690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c76152-1553-410a-845f-fd9dc71eec3e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:46.065115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641bc53-788b-4a83-b7a7-e10f02c21d44 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:46.073125 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:46.079192 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:46.105990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fa987-69c8-4174-877b-da6fe86b4137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:46.107632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fa987-69c8-4174-877b-da6fe86b4137 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:46.107936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fa987-69c8-4174-877b-da6fe86b4137 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:46.108222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fa987-69c8-4174-877b-da6fe86b4137 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:46.109130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fa987-69c8-4174-877b-da6fe86b4137 None admin] RBAC: Adding query filter params (role.id=5361e6fea90e41aa8954e83ea952bc2b, scope.project.id=488e2680f33948a99baf67e759f3e3fe, user.id=a393084949ed4d999afb7c253b9c6e5b) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:46.109403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fa987-69c8-4174-877b-da6fe86b4137 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:46.111079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fa987-69c8-4174-877b-da6fe86b4137 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:46.117251 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 67/135] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:50:45 2022] GET /identity/v3/role_assignments?user.id=a393084949ed4d999afb7c253b9c6e5b&scope.project.id=488e2680f33948a99baf67e759f3e3fe&role.id=5361e6fea90e41aa8954e83ea952bc2b => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:46.119082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128679e-6ccb-46db-a30e-a542283e3a78 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:46.123982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128679e-6ccb-46db-a30e-a542283e3a78 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:46.123982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128679e-6ccb-46db-a30e-a542283e3a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:46.155173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f128679e-6ccb-46db-a30e-a542283e3a78 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:46.156521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f128679e-6ccb-46db-a30e-a542283e3a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:46.184084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c76152-1553-410a-845f-fd9dc71eec3e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:46.287568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42f4d9-c67f-4971-9704-84034d45cea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:46.288592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42f4d9-c67f-4971-9704-84034d45cea1 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:46.288887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42f4d9-c67f-4971-9704-84034d45cea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:46.289168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42f4d9-c67f-4971-9704-84034d45cea1 None admin] PATH_INFO: `/v3/users/66c3af913fab4b349ffa0c81a1cd84a8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:46.295108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42f4d9-c67f-4971-9704-84034d45cea1 None admin] RBAC: Authorizing `identity:get_user(user_id=66c3af913fab4b349ffa0c81a1cd84a8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:46.297819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42f4d9-c67f-4971-9704-84034d45cea1 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:46.298820 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 69/136] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:46 2022] GET /identity/v3/users/66c3af913fab4b349ffa0c81a1cd84a8 => generated 275 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:46.304591 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 68/137] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:50:46.305080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42f4d9-c67f-4971-9704-84034d45cea1 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:46.355397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128679e-6ccb-46db-a30e-a542283e3a78 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:46.473356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42f4d9-c67f-4971-9704-84034d45cea1 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:46.487350 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:46.531259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816175c-da9b-4456-b3e6-dcce40d24be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:46.532417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816175c-da9b-4456-b3e6-dcce40d24be7 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:46.532872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816175c-da9b-4456-b3e6-dcce40d24be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:46.533440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816175c-da9b-4456-b3e6-dcce40d24be7 None admin] PATH_INFO: `/v3/projects/b098aba0d6094bf5bc84b5be9dfadc3f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:46.535992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816175c-da9b-4456-b3e6-dcce40d24be7 None admin] RBAC: Authorizing `identity:get_project(project_id=b098aba0d6094bf5bc84b5be9dfadc3f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:46.538722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816175c-da9b-4456-b3e6-dcce40d24be7 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:46.543077 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 70/138] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:50:46 2022] GET /identity/v3/projects/b098aba0d6094bf5bc84b5be9dfadc3f => generated 312 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:46.548165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816175c-da9b-4456-b3e6-dcce40d24be7 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:46.564315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128679e-6ccb-46db-a30e-a542283e3a78 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:46.574190 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:46.639987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad454a5f-9647-4b19-bbd8-301179759155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:46.641158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad454a5f-9647-4b19-bbd8-301179759155 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:46.641641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad454a5f-9647-4b19-bbd8-301179759155 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:46.642081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad454a5f-9647-4b19-bbd8-301179759155 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:46.653505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad454a5f-9647-4b19-bbd8-301179759155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:46.661608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-ad454a5f-9647-4b19-bbd8-301179759155 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:50:46.661608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:46.661608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:46.661608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:46.661608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:46.661608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:46.661608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:46.661608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:46.661608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:46.661608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:46.661608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:46.661608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:46.661608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:46.661608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:46.661608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:46.661608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:46.662730 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:46.662730 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:46.662730 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:46.662730 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:46.662730 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:46.662730 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:46.662730 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:46.662730 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:46.662730 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:46.662730 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:46.662730 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:46.662730 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:46.662730 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:46.662730 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:46.662730 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:46.662730 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:46.663712 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:46.663712 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:46.663712 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:46.663712 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:46.663712 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:46.663712 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:46.663712 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:46.663712 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:46.663712 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:46.663712 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:46.663712 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:50:46.663712 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:50:46.666481 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 69/139] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:50:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:50:46.672133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad454a5f-9647-4b19-bbd8-301179759155 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:46.741423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816175c-da9b-4456-b3e6-dcce40d24be7 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:46.812296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b3acd-6a0b-497a-b61e-ecca6c36ab3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:46.813470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b3acd-6a0b-497a-b61e-ecca6c36ab3f None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:46.813918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b3acd-6a0b-497a-b61e-ecca6c36ab3f None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:46.814519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b3acd-6a0b-497a-b61e-ecca6c36ab3f None admin] PATH_INFO: `/v3/projects/b098aba0d6094bf5bc84b5be9dfadc3f/users/66c3af913fab4b349ffa0c81a1cd84a8/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:46.817229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b3acd-6a0b-497a-b61e-ecca6c36ab3f None admin] RBAC: Authorizing `identity:create_grant(project_id=b098aba0d6094bf5bc84b5be9dfadc3f, user_id=66c3af913fab4b349ffa0c81a1cd84a8, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:46.818888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b3acd-6a0b-497a-b61e-ecca6c36ab3f None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:46.849818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad454a5f-9647-4b19-bbd8-301179759155 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:46.886593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84121dad-4c06-464a-a49f-c851a00e4162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:46.887572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84121dad-4c06-464a-a49f-c851a00e4162 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:46.888016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84121dad-4c06-464a-a49f-c851a00e4162 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:46.888452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84121dad-4c06-464a-a49f-c851a00e4162 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:46.889347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84121dad-4c06-464a-a49f-c851a00e4162 None admin] RBAC: Adding query filter params (name=member) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:46.889815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84121dad-4c06-464a-a49f-c851a00e4162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:46.891432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84121dad-4c06-464a-a49f-c851a00e4162 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:46.901152 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 70/140] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:50:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:50:46.902786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffb634-e87b-4997-a4c1-e7bd250439e4 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:46.903356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffb634-e87b-4997-a4c1-e7bd250439e4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:46.903788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffb634-e87b-4997-a4c1-e7bd250439e4 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:46.905484 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 71/141] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:46.910943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d0e26-c543-4903-b73a-034f86ac0da6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:46.911410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d0e26-c543-4903-b73a-034f86ac0da6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:46.911895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d0e26-c543-4903-b73a-034f86ac0da6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:46.935397 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 71/142] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:50:46 2022] PUT /identity/v3/projects/b098aba0d6094bf5bc84b5be9dfadc3f/users/66c3af913fab4b349ffa0c81a1cd84a8/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:50:46.936956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b3acd-6a0b-497a-b61e-ecca6c36ab3f None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:46.942716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-177d0e26-c543-4903-b73a-034f86ac0da6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:46.948461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-177d0e26-c543-4903-b73a-034f86ac0da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:46.990969 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:47.022795 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:47.091640 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 72/143] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:50:47.128127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b3acd-6a0b-497a-b61e-ecca6c36ab3f None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:47.133256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d0e26-c543-4903-b73a-034f86ac0da6 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:47.209146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46142da7-08ef-4e26-8d99-5e73a22a7a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:47.209146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46142da7-08ef-4e26-8d99-5e73a22a7a2b None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:47.209146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46142da7-08ef-4e26-8d99-5e73a22a7a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:47.209794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46142da7-08ef-4e26-8d99-5e73a22a7a2b None admin] PATH_INFO: `/v3/users/66c3af913fab4b349ffa0c81a1cd84a8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:47.212720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46142da7-08ef-4e26-8d99-5e73a22a7a2b None admin] RBAC: Authorizing `identity:get_user(user_id=66c3af913fab4b349ffa0c81a1cd84a8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:47.216025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46142da7-08ef-4e26-8d99-5e73a22a7a2b None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:47.220719 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 72/144] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:46 2022] GET /identity/v3/users/66c3af913fab4b349ffa0c81a1cd84a8 => generated 275 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:47.224337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46142da7-08ef-4e26-8d99-5e73a22a7a2b None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:47.340337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d0e26-c543-4903-b73a-034f86ac0da6 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:47.388989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46142da7-08ef-4e26-8d99-5e73a22a7a2b None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:47.403345 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:47.423034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994ee0b-b8f5-4261-af8a-3598d2cabd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:47.424173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994ee0b-b8f5-4261-af8a-3598d2cabd94 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:47.424173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994ee0b-b8f5-4261-af8a-3598d2cabd94 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:47.424716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994ee0b-b8f5-4261-af8a-3598d2cabd94 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:47.426961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994ee0b-b8f5-4261-af8a-3598d2cabd94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:47.428419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994ee0b-b8f5-4261-af8a-3598d2cabd94 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:47.430089 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 73/145] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:50:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:50:47.437576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994ee0b-b8f5-4261-af8a-3598d2cabd94 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:47.450288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63159793-c5e2-4194-8b12-c00846d4dd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:47.451239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63159793-c5e2-4194-8b12-c00846d4dd20 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:47.451708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63159793-c5e2-4194-8b12-c00846d4dd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:47.452181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63159793-c5e2-4194-8b12-c00846d4dd20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:47.504188 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:47.607173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63159793-c5e2-4194-8b12-c00846d4dd20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:47.608647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63159793-c5e2-4194-8b12-c00846d4dd20 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:47.691015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994ee0b-b8f5-4261-af8a-3598d2cabd94 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:47.753881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519beb5-71a8-49fc-ae14-99d7cbda1157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:47.754742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519beb5-71a8-49fc-ae14-99d7cbda1157 None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:47.754981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519beb5-71a8-49fc-ae14-99d7cbda1157 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:47.755261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f519beb5-71a8-49fc-ae14-99d7cbda1157 None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:47.756006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519beb5-71a8-49fc-ae14-99d7cbda1157 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:47.757454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f519beb5-71a8-49fc-ae14-99d7cbda1157 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:47.828944 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 73/146] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:50:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:50:47.834658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63159793-c5e2-4194-8b12-c00846d4dd20 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:47.848926 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:47.873074 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 74/147] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 19 13:50:47 2022] POST /identity/v3/users => generated 283 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 13:50:47.966900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63159793-c5e2-4194-8b12-c00846d4dd20 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:48.018315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b05ad-9215-47ef-b0f4-4bf52dcce8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:48.019551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b05ad-9215-47ef-b0f4-4bf52dcce8a8 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:48.020051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b05ad-9215-47ef-b0f4-4bf52dcce8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:48.020535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b05ad-9215-47ef-b0f4-4bf52dcce8a8 None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:48.021965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b05ad-9215-47ef-b0f4-4bf52dcce8a8 None admin] RBAC: Authorizing `identity:get_project(project_id=488e2680f33948a99baf67e759f3e3fe)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:48.023682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b05ad-9215-47ef-b0f4-4bf52dcce8a8 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:48.030479 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 74/148] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:50:47 2022] GET /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:48.035196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519beb5-71a8-49fc-ae14-99d7cbda1157 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:48.184407 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:48.213859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f519beb5-71a8-49fc-ae14-99d7cbda1157 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:48.252361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36610c1-5b73-4f02-a462-e89dce271e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:48.253033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36610c1-5b73-4f02-a462-e89dce271e1e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:48.253404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36610c1-5b73-4f02-a462-e89dce271e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:48.253696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36610c1-5b73-4f02-a462-e89dce271e1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:48.254604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36610c1-5b73-4f02-a462-e89dce271e1e None admin] RBAC: Adding query filter params (role.id=e17d8526e56c4d319080a377398b9c74, scope.project.id=488e2680f33948a99baf67e759f3e3fe, user.id=66c3af913fab4b349ffa0c81a1cd84a8) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:48.254920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36610c1-5b73-4f02-a462-e89dce271e1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:48.256390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36610c1-5b73-4f02-a462-e89dce271e1e None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:48.263698 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 75/149] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:50:48 2022] GET /identity/v3/role_assignments?user.id=66c3af913fab4b349ffa0c81a1cd84a8&scope.project.id=488e2680f33948a99baf67e759f3e3fe&role.id=e17d8526e56c4d319080a377398b9c74 => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:48.704317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440dd93-11fb-459c-8f02-9f58c9255178 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:48.704846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440dd93-11fb-459c-8f02-9f58c9255178 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:48.704846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440dd93-11fb-459c-8f02-9f58c9255178 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:48.706405 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 75/150] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:48.712653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb619d-8a5a-4ded-a424-419ea325f0ac None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:48.713126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb619d-8a5a-4ded-a424-419ea325f0ac None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:48.713399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feb619d-8a5a-4ded-a424-419ea325f0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:48.721277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f97e9-61ba-4c10-b4ee-ea2a180860b2 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:48.721579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f97e9-61ba-4c10-b4ee-ea2a180860b2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:48.721867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25f97e9-61ba-4c10-b4ee-ea2a180860b2 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:48.723429 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 76/151] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:50:48.729301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cbea4-bf3c-479e-8ba2-bb799788df7e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:48.729755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cbea4-bf3c-479e-8ba2-bb799788df7e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:48.730051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cbea4-bf3c-479e-8ba2-bb799788df7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:48.734206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5feb619d-8a5a-4ded-a424-419ea325f0ac None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:48.735406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5feb619d-8a5a-4ded-a424-419ea325f0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:48.757312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b57cbea4-bf3c-479e-8ba2-bb799788df7e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:48.758829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b57cbea4-bf3c-479e-8ba2-bb799788df7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:48.835612 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 76/152] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:50:48.851647 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 77/153] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:50:48.865246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb619d-8a5a-4ded-a424-419ea325f0ac None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:48.874821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cbea4-bf3c-479e-8ba2-bb799788df7e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:48.884448 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:48.953247 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:48.982159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cbea4-bf3c-479e-8ba2-bb799788df7e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:48.982465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feb619d-8a5a-4ded-a424-419ea325f0ac None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:49.018984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fa9cf-309e-4741-b3aa-12a5c1deac0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:49.019821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fa9cf-309e-4741-b3aa-12a5c1deac0b None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:49.020026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fa9cf-309e-4741-b3aa-12a5c1deac0b None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:49.020287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6fa9cf-309e-4741-b3aa-12a5c1deac0b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:49.022148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933662e-aa1f-40a2-a3fd-ec278e02353e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:49.023268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933662e-aa1f-40a2-a3fd-ec278e02353e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:49.023771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933662e-aa1f-40a2-a3fd-ec278e02353e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:49.024281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d933662e-aa1f-40a2-a3fd-ec278e02353e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:49.035502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d933662e-aa1f-40a2-a3fd-ec278e02353e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:49.043857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6fa9cf-309e-4741-b3aa-12a5c1deac0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:49.045280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-d933662e-aa1f-40a2-a3fd-ec278e02353e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:50:49.045280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:49.045280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:49.045280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:49.045280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:49.045280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:49.045280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:49.045280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:49.045280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:49.045280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:49.045280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:49.045280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:49.045280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:49.045280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:49.045280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:49.045280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:49.046175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:49.046175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:49.046175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:49.046175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:49.046175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:49.046175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:49.046175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:49.046175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:49.046175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:49.046175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:49.046175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:49.046175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:49.046175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:49.046175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:49.046175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:49.046175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:49.046950 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:49.046950 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:49.046950 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:49.046950 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:49.046950 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:49.046950 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:49.046950 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:49.046950 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:49.046950 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:49.046950 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:49.046950 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:50:49.046950 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:50:49.049540 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 77/154] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 19 13:50:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:50:49.055157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933662e-aa1f-40a2-a3fd-ec278e02353e None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:49.056992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-ad6fa9cf-309e-4741-b3aa-12a5c1deac0b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 13:50:49.056992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:49.056992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:49.056992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:49.056992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:49.056992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:49.056992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:49.056992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:49.056992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:49.056992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:49.056992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:49.056992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:49.056992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:49.056992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:49.056992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:49.056992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:49.057940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:49.057940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:49.057940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:49.057940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:49.057940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:49.057940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:49.057940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:49.057940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:49.057940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:49.057940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:49.057940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:49.057940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:49.057940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:49.057940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:49.057940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:49.057940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:49.058780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:49.058780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:49.058780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:49.058780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:49.058780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:49.058780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:49.058780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:49.058780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:49.058780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:49.058780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:49.058780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 13:50:49.058780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:50:49.064383 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 78/155] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:50:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:50:49.070034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fa9cf-309e-4741-b3aa-12a5c1deac0b None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:49.161998 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:49.208105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6fa9cf-309e-4741-b3aa-12a5c1deac0b None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:49.213138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d933662e-aa1f-40a2-a3fd-ec278e02353e None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:49.248982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a54f6b-67f1-4295-a8c4-dd1e3f163886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:49.249740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a54f6b-67f1-4295-a8c4-dd1e3f163886 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:49.250190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a54f6b-67f1-4295-a8c4-dd1e3f163886 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:49.250477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a54f6b-67f1-4295-a8c4-dd1e3f163886 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:49.251237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a54f6b-67f1-4295-a8c4-dd1e3f163886 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:49.251545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a54f6b-67f1-4295-a8c4-dd1e3f163886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:49.253770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a54f6b-67f1-4295-a8c4-dd1e3f163886 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:49.264881 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 79/156] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:50:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:49.265211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7f790f-bb7d-459b-b56c-05596f783120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:49.265895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f790f-bb7d-459b-b56c-05596f783120 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:49.266001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34c19a-8d07-4e82-87df-22c96567dc45 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:49.266215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f790f-bb7d-459b-b56c-05596f783120 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:49.266501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7f790f-bb7d-459b-b56c-05596f783120 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:49.267401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f790f-bb7d-459b-b56c-05596f783120 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:49.267722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f790f-bb7d-459b-b56c-05596f783120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:49.269180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7f790f-bb7d-459b-b56c-05596f783120 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:49.270398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34c19a-8d07-4e82-87df-22c96567dc45 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:49.271016 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:49.271931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34c19a-8d07-4e82-87df-22c96567dc45 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:49.274140 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 80/157] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:49.279897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34c19a-8d07-4e82-87df-22c96567dc45 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:49.284447 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 78/158] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:50:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:49.284719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf30429-2939-4ea2-9402-9801b3165cda None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:49.285149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf30429-2939-4ea2-9402-9801b3165cda None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:49.285529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf30429-2939-4ea2-9402-9801b3165cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:49.306893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5cf30429-2939-4ea2-9402-9801b3165cda None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:49.308227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5cf30429-2939-4ea2-9402-9801b3165cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:49.407024 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 79/159] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:50:49.407878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf30429-2939-4ea2-9402-9801b3165cda None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:49.414000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34c19a-8d07-4e82-87df-22c96567dc45 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:49.443736 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:49.453439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bf12e-c78c-4237-89f8-53eab50d84b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:49.457856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bf12e-c78c-4237-89f8-53eab50d84b4 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:49.457856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bf12e-c78c-4237-89f8-53eab50d84b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:49.457856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516bf12e-c78c-4237-89f8-53eab50d84b4 None admin] PATH_INFO: `/v3/users/a393084949ed4d999afb7c253b9c6e5b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:49.457856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bf12e-c78c-4237-89f8-53eab50d84b4 None admin] RBAC: Authorizing `identity:get_user(user_id=a393084949ed4d999afb7c253b9c6e5b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:49.457856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516bf12e-c78c-4237-89f8-53eab50d84b4 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:49.459230 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 81/160] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:49 2022] GET /identity/v3/users/a393084949ed4d999afb7c253b9c6e5b => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:50:49.460221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bf12e-c78c-4237-89f8-53eab50d84b4 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:49.515447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf30429-2939-4ea2-9402-9801b3165cda None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:49.543616 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:49.556136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db217d-4758-45ad-972f-5691c48311d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:49.557158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db217d-4758-45ad-972f-5691c48311d8 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:49.557441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db217d-4758-45ad-972f-5691c48311d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:49.557714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db217d-4758-45ad-972f-5691c48311d8 None admin] PATH_INFO: `/v3/users/66c3af913fab4b349ffa0c81a1cd84a8` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:49.558998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db217d-4758-45ad-972f-5691c48311d8 None admin] RBAC: Authorizing `identity:get_user(user_id=66c3af913fab4b349ffa0c81a1cd84a8)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:49.560583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36db217d-4758-45ad-972f-5691c48311d8 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:49.562636 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 80/161] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:49 2022] GET /identity/v3/users/66c3af913fab4b349ffa0c81a1cd84a8 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:49.563404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db217d-4758-45ad-972f-5691c48311d8 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:49.570745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516bf12e-c78c-4237-89f8-53eab50d84b4 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:49.607757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d70fc3-41dc-4cfe-998c-b73e069c4251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:49.608567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d70fc3-41dc-4cfe-998c-b73e069c4251 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:49.608856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d70fc3-41dc-4cfe-998c-b73e069c4251 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:49.609135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d70fc3-41dc-4cfe-998c-b73e069c4251 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:49.621220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d70fc3-41dc-4cfe-998c-b73e069c4251 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:49.629134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-90d70fc3-41dc-4cfe-998c-b73e069c4251 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:50:49.629134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:49.629134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:49.629134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:49.629134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:49.629134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:49.629134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:49.629134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:49.629134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:49.629134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:49.629134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:49.629134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:49.629134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:49.629134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:49.629134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:49.629134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:49.630031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:49.630031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:49.630031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:49.630031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:49.630031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:49.630031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:49.630031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:49.630031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:49.630031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:49.630031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:49.630031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:49.630031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:49.630031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:49.630031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:49.630031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:49.630031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:49.631842 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:49.631842 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:49.631842 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:49.631842 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:49.631842 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:49.631842 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:49.631842 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:49.631842 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:49.631842 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:49.631842 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:49.631842 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:50:49.631842 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:50:49.631842 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 82/162] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:50:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:50:49.631842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d70fc3-41dc-4cfe-998c-b73e069c4251 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:49.693081 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:49.706041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db217d-4758-45ad-972f-5691c48311d8 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:49.740887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d70fc3-41dc-4cfe-998c-b73e069c4251 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:49.763261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae5720-0f01-4e19-89ab-0bb5c089f8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:49.764130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae5720-0f01-4e19-89ab-0bb5c089f8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:49.764411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae5720-0f01-4e19-89ab-0bb5c089f8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:49.764686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae5720-0f01-4e19-89ab-0bb5c089f8c5 None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:49.768724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae5720-0f01-4e19-89ab-0bb5c089f8c5 None admin] RBAC: Authorizing `identity:get_project(project_id=488e2680f33948a99baf67e759f3e3fe)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:49.770212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ae5720-0f01-4e19-89ab-0bb5c089f8c5 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:49.771994 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 81/163] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:50:49 2022] GET /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:49.772756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae5720-0f01-4e19-89ab-0bb5c089f8c5 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:49.777242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d69890-0151-46f8-8b4f-34976bce73f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:49.777910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d69890-0151-46f8-8b4f-34976bce73f2 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:49.778230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d69890-0151-46f8-8b4f-34976bce73f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:49.778515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d69890-0151-46f8-8b4f-34976bce73f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:49.851506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d69890-0151-46f8-8b4f-34976bce73f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:49.853544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d69890-0151-46f8-8b4f-34976bce73f2 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:49.911500 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:49.930463 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:49.962131 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 83/164] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:50:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:50:49.969950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d69890-0151-46f8-8b4f-34976bce73f2 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:50.017753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae5720-0f01-4e19-89ab-0bb5c089f8c5 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:50.071907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d69890-0151-46f8-8b4f-34976bce73f2 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:50.102596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34135333-7c51-4928-b407-c599bcf4b9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:50.103386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34135333-7c51-4928-b407-c599bcf4b9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:50.103671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34135333-7c51-4928-b407-c599bcf4b9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:50.103955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34135333-7c51-4928-b407-c599bcf4b9b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:50.104933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34135333-7c51-4928-b407-c599bcf4b9b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:50.105050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34135333-7c51-4928-b407-c599bcf4b9b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:50.111810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34135333-7c51-4928-b407-c599bcf4b9b4 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:50.121450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec432e20-763b-4ce4-9dba-f5ae671c9713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:50.122659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec432e20-763b-4ce4-9dba-f5ae671c9713 None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:50.123119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec432e20-763b-4ce4-9dba-f5ae671c9713 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:50.123546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec432e20-763b-4ce4-9dba-f5ae671c9713 None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe/users/a393084949ed4d999afb7c253b9c6e5b/roles/5361e6fea90e41aa8954e83ea952bc2b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:50.125751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec432e20-763b-4ce4-9dba-f5ae671c9713 None admin] RBAC: Authorizing `identity:create_grant(project_id=488e2680f33948a99baf67e759f3e3fe, user_id=a393084949ed4d999afb7c253b9c6e5b, role_id=5361e6fea90e41aa8954e83ea952bc2b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:50.127500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec432e20-763b-4ce4-9dba-f5ae671c9713 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:50.133062 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 82/165] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:50:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:50.134858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34135333-7c51-4928-b407-c599bcf4b9b4 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:50.250547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34135333-7c51-4928-b407-c599bcf4b9b4 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:50.275795 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:50.286511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce1ed4-a479-4f27-a827-84500a4f1857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:50.287437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce1ed4-a479-4f27-a827-84500a4f1857 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:50.287719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce1ed4-a479-4f27-a827-84500a4f1857 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:50.287994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce1ed4-a479-4f27-a827-84500a4f1857 None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:50.289221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce1ed4-a479-4f27-a827-84500a4f1857 None admin] RBAC: Authorizing `identity:get_project(project_id=488e2680f33948a99baf67e759f3e3fe)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:50.290757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce1ed4-a479-4f27-a827-84500a4f1857 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:50.292836 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 83/166] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:50:50 2022] GET /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:50.294080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47405a0-5ec4-418b-a87a-14a867b24f4e None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:50.294388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47405a0-5ec4-418b-a87a-14a867b24f4e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:50.294666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47405a0-5ec4-418b-a87a-14a867b24f4e None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:50.296129 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 84/167] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:50.296831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47405a0-5ec4-418b-a87a-14a867b24f4e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:50.320696 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 84/168] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:50:49 2022] PUT /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe/users/a393084949ed4d999afb7c253b9c6e5b/roles/5361e6fea90e41aa8954e83ea952bc2b => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:50:50.322789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc157c9b-11ed-4f85-824a-057ca17b315b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:50.323023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc157c9b-11ed-4f85-824a-057ca17b315b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:50.323301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc157c9b-11ed-4f85-824a-057ca17b315b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:50.356022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-bc157c9b-11ed-4f85-824a-057ca17b315b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:50.357215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bc157c9b-11ed-4f85-824a-057ca17b315b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:50.372651 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:50.428327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47405a0-5ec4-418b-a87a-14a867b24f4e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:50.479073 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 85/169] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:50:50.480392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc157c9b-11ed-4f85-824a-057ca17b315b None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:50.513782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1b747-fc53-48ee-a25c-e1c796524505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:50.515247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1b747-fc53-48ee-a25c-e1c796524505 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:50.515732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1b747-fc53-48ee-a25c-e1c796524505 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:50.516242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1b747-fc53-48ee-a25c-e1c796524505 None admin] PATH_INFO: `/v3/users/aee44b6994c447199831be944ec7980c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:50.518351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1b747-fc53-48ee-a25c-e1c796524505 None admin] RBAC: Authorizing `identity:get_user(user_id=aee44b6994c447199831be944ec7980c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:50.520216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1b747-fc53-48ee-a25c-e1c796524505 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:50.526381 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 85/170] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:50 2022] GET /identity/v3/users/aee44b6994c447199831be944ec7980c => generated 247 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:50.533409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1b747-fc53-48ee-a25c-e1c796524505 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:50.627131 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:50.672119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1b747-fc53-48ee-a25c-e1c796524505 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:50.697330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc157c9b-11ed-4f85-824a-057ca17b315b None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:50.713326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4acc5-afa9-49ba-92fd-5799f6eb1ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:50.714549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4acc5-afa9-49ba-92fd-5799f6eb1ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:50.715047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4acc5-afa9-49ba-92fd-5799f6eb1ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:50.715526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4acc5-afa9-49ba-92fd-5799f6eb1ee0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:50.743904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ad6e3-e3c4-4691-9f4c-f2ba36795d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:50.744590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ad6e3-e3c4-4691-9f4c-f2ba36795d66 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:50.744884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ad6e3-e3c4-4691-9f4c-f2ba36795d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:50.745168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ad6e3-e3c4-4691-9f4c-f2ba36795d66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:50.746697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ad6e3-e3c4-4691-9f4c-f2ba36795d66 None admin] RBAC: Adding query filter params (role.id=b73e411ed06b463fb578c06789886960, scope.project.id=488e2680f33948a99baf67e759f3e3fe, user.id=66c3af913fab4b349ffa0c81a1cd84a8) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:50.746697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ad6e3-e3c4-4691-9f4c-f2ba36795d66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:50.747924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5ad6e3-e3c4-4691-9f4c-f2ba36795d66 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:50.759803 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 86/171] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:50:50 2022] GET /identity/v3/role_assignments?user.id=66c3af913fab4b349ffa0c81a1cd84a8&scope.project.id=488e2680f33948a99baf67e759f3e3fe&role.id=b73e411ed06b463fb578c06789886960 => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:50.759803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ad6e3-e3c4-4691-9f4c-f2ba36795d66 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:50.791528 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:50.800173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4acc5-afa9-49ba-92fd-5799f6eb1ee0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:50.802405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4acc5-afa9-49ba-92fd-5799f6eb1ee0 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:50.876128 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:50.921991 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 86/172] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:50:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 13:50:50.923296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4acc5-afa9-49ba-92fd-5799f6eb1ee0 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:50.962626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ad6e3-e3c4-4691-9f4c-f2ba36795d66 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:51.037491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4acc5-afa9-49ba-92fd-5799f6eb1ee0 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:51.039466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552efc00-b3e0-48b4-acf3-401d14cc4ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:51.040343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552efc00-b3e0-48b4-acf3-401d14cc4ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:51.041010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552efc00-b3e0-48b4-acf3-401d14cc4ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:51.041010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552efc00-b3e0-48b4-acf3-401d14cc4ef7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:51.063811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552efc00-b3e0-48b4-acf3-401d14cc4ef7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:51.076691 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-552efc00-b3e0-48b4-acf3-401d14cc4ef7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:50:51.076691 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:51.076691 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:51.076691 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:51.076691 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:51.076691 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:51.076691 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:51.076691 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:51.076691 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:51.076691 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:51.076691 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:51.076691 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:51.076691 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:51.076691 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:51.076691 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:51.076691 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:51.077625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:51.077625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:51.077625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:51.077625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:51.077625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:51.077625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:51.077625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:51.077625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:51.077625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:51.077625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:51.077625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:51.077625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:51.077625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:51.077625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:51.077625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:51.077625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:51.078430 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:51.078430 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:51.078430 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:51.078430 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:51.078430 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:51.078430 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:51.078430 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:51.078430 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:51.078430 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:51.078430 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:51.078430 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:50:51.078430 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:50:51.082531 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 87/173] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:50:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:50:51.083054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc126dff-6448-4dc6-b874-6026f03f3876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:51.084132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc126dff-6448-4dc6-b874-6026f03f3876 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:51.084604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc126dff-6448-4dc6-b874-6026f03f3876 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:51.085034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc126dff-6448-4dc6-b874-6026f03f3876 None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:51.086615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc126dff-6448-4dc6-b874-6026f03f3876 None admin] RBAC: Authorizing `identity:get_project(project_id=488e2680f33948a99baf67e759f3e3fe)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:51.087957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552efc00-b3e0-48b4-acf3-401d14cc4ef7 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:51.089397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc126dff-6448-4dc6-b874-6026f03f3876 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:51.096283 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 87/174] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:50:50 2022] GET /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:51.097445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc126dff-6448-4dc6-b874-6026f03f3876 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:51.130580 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:51.210899 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:51.216466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc126dff-6448-4dc6-b874-6026f03f3876 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:51.261505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23beaf-2643-42d2-8030-0faa8a8f19cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:51.262495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23beaf-2643-42d2-8030-0faa8a8f19cc None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:51.262979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23beaf-2643-42d2-8030-0faa8a8f19cc None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:51.263437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23beaf-2643-42d2-8030-0faa8a8f19cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:51.264291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552efc00-b3e0-48b4-acf3-401d14cc4ef7 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:51.264643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23beaf-2643-42d2-8030-0faa8a8f19cc None admin] RBAC: Adding query filter params (role.id=bc315edf089d43b18acf9790031f3fcb, scope.project.id=488e2680f33948a99baf67e759f3e3fe, user.id=aee44b6994c447199831be944ec7980c) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:51.265175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23beaf-2643-42d2-8030-0faa8a8f19cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:51.266916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23beaf-2643-42d2-8030-0faa8a8f19cc None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:51.273345 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 88/175] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:50:51 2022] GET /identity/v3/role_assignments?user.id=aee44b6994c447199831be944ec7980c&scope.project.id=488e2680f33948a99baf67e759f3e3fe&role.id=bc315edf089d43b18acf9790031f3fcb => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:51.315523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03206b-cf44-4038-8484-8ea7e3b7f40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:51.316227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03206b-cf44-4038-8484-8ea7e3b7f40e None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:51.316520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03206b-cf44-4038-8484-8ea7e3b7f40e None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:51.316806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03206b-cf44-4038-8484-8ea7e3b7f40e None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:51.317595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03206b-cf44-4038-8484-8ea7e3b7f40e None admin] RBAC: Adding query filter params (name=member) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:51.317910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03206b-cf44-4038-8484-8ea7e3b7f40e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:51.319370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03206b-cf44-4038-8484-8ea7e3b7f40e None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:51.329829 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 88/176] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:50:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:50:51.335585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23beaf-2643-42d2-8030-0faa8a8f19cc None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:51.473061 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:51.483764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23beaf-2643-42d2-8030-0faa8a8f19cc None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:51.526206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a3df7-2f09-4943-b22d-a9d277310fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:51.527099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a3df7-2f09-4943-b22d-a9d277310fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:51.527379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a3df7-2f09-4943-b22d-a9d277310fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:51.527648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a3df7-2f09-4943-b22d-a9d277310fb9 None admin] PATH_INFO: `/v3/users/66c3af913fab4b349ffa0c81a1cd84a8` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:51.528886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a3df7-2f09-4943-b22d-a9d277310fb9 None admin] RBAC: Authorizing `identity:get_user(user_id=66c3af913fab4b349ffa0c81a1cd84a8)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:51.530387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a3df7-2f09-4943-b22d-a9d277310fb9 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:51.532585 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 89/177] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:51 2022] GET /identity/v3/users/66c3af913fab4b349ffa0c81a1cd84a8 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:51.538034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03206b-cf44-4038-8484-8ea7e3b7f40e None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:51.660096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03206b-cf44-4038-8484-8ea7e3b7f40e None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:51.691050 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:51.695931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abd2e3-963f-43e6-a658-44d6dfb44544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:51.696702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abd2e3-963f-43e6-a658-44d6dfb44544 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:51.697089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abd2e3-963f-43e6-a658-44d6dfb44544 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:51.697377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4abd2e3-963f-43e6-a658-44d6dfb44544 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:51.768410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abd2e3-963f-43e6-a658-44d6dfb44544 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:51.769794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4abd2e3-963f-43e6-a658-44d6dfb44544 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:51.794302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc811215-0a9d-4a20-a875-c162442caf0e None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:51.794618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc811215-0a9d-4a20-a875-c162442caf0e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:51.794860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc811215-0a9d-4a20-a875-c162442caf0e None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:51.796514 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 90/178] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:51.801733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c24aa8-a010-4540-8e60-cf3b299e6d32 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:51.802302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c24aa8-a010-4540-8e60-cf3b299e6d32 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:51.802302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c24aa8-a010-4540-8e60-cf3b299e6d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:51.825390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-62c24aa8-a010-4540-8e60-cf3b299e6d32 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:51.826602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-62c24aa8-a010-4540-8e60-cf3b299e6d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:51.888739 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 89/179] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:50:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:50:51.895036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abd2e3-963f-43e6-a658-44d6dfb44544 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:51.940475 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 91/180] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:50:51.950445 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:52.009647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c24aa8-a010-4540-8e60-cf3b299e6d32 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:52.028898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4abd2e3-963f-43e6-a658-44d6dfb44544 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:52.067153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1f78f-5e70-4631-aeb4-c543c4ea1d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:52.068183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1f78f-5e70-4631-aeb4-c543c4ea1d65 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:52.068474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1f78f-5e70-4631-aeb4-c543c4ea1d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:52.068753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c1f78f-5e70-4631-aeb4-c543c4ea1d65 None admin] PATH_INFO: `/v3/projects/b098aba0d6094bf5bc84b5be9dfadc3f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:52.069945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1f78f-5e70-4631-aeb4-c543c4ea1d65 None admin] RBAC: Authorizing `identity:get_project(project_id=b098aba0d6094bf5bc84b5be9dfadc3f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:52.072452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c1f78f-5e70-4631-aeb4-c543c4ea1d65 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:52.074211 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 90/181] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:50:51 2022] GET /identity/v3/projects/b098aba0d6094bf5bc84b5be9dfadc3f => generated 312 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:52.080510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1f78f-5e70-4631-aeb4-c543c4ea1d65 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:52.191551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c1f78f-5e70-4631-aeb4-c543c4ea1d65 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:52.194494 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:52.234699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb73978-00f5-4bf9-b968-b8e66e00b310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:52.235376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb73978-00f5-4bf9-b968-b8e66e00b310 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:52.235666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb73978-00f5-4bf9-b968-b8e66e00b310 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:52.235949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb73978-00f5-4bf9-b968-b8e66e00b310 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:52.236795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb73978-00f5-4bf9-b968-b8e66e00b310 None admin] RBAC: Adding query filter params (role.id=e17d8526e56c4d319080a377398b9c74, scope.project.id=b098aba0d6094bf5bc84b5be9dfadc3f, user.id=66c3af913fab4b349ffa0c81a1cd84a8) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:52.237110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb73978-00f5-4bf9-b968-b8e66e00b310 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:52.239091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb73978-00f5-4bf9-b968-b8e66e00b310 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:52.248039 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 91/182] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:50:52 2022] GET /identity/v3/role_assignments?user.id=66c3af913fab4b349ffa0c81a1cd84a8&scope.project.id=b098aba0d6094bf5bc84b5be9dfadc3f&role.id=e17d8526e56c4d319080a377398b9c74 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:50:52.266524 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:52.278090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c24aa8-a010-4540-8e60-cf3b299e6d32 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:52.279183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58374c2-35cd-480d-92ac-3848816caa9a None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:52.279511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58374c2-35cd-480d-92ac-3848816caa9a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:52.279885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58374c2-35cd-480d-92ac-3848816caa9a None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:52.281721 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 92/183] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:52.287320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c349049-d25f-40a6-a92e-28976d720508 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:52.288766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c349049-d25f-40a6-a92e-28976d720508 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:52.289152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c349049-d25f-40a6-a92e-28976d720508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:52.317553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f8e66-f73d-47a0-95db-02cf0f6e2e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:52.318439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f8e66-f73d-47a0-95db-02cf0f6e2e96 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:52.318726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f8e66-f73d-47a0-95db-02cf0f6e2e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:52.319003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f8e66-f73d-47a0-95db-02cf0f6e2e96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:52.331782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f8e66-f73d-47a0-95db-02cf0f6e2e96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:52.340061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8c349049-d25f-40a6-a92e-28976d720508 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:52.340531 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-908f8e66-f73d-47a0-95db-02cf0f6e2e96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:50:52.340531 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:52.340531 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:52.340531 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:52.340531 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:52.340531 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:52.340531 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:52.340531 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:52.340531 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:52.340531 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:52.340531 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:52.340531 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:52.340531 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:52.340531 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:52.340531 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:52.340531 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:52.341404 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:52.341404 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:52.341404 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:52.341404 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:52.341404 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:52.341404 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:52.341404 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:52.341404 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:52.341404 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:52.341404 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:52.341404 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:52.341404 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:52.341404 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:52.341404 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:52.341404 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:52.341404 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:52.342233 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:52.342233 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:52.342233 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:52.342233 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:52.342233 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:52.342233 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:52.342233 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:52.342233 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:52.342233 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:52.342233 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:52.342233 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:50:52.342233 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:50:52.342844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8c349049-d25f-40a6-a92e-28976d720508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:52.342913 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 92/184] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:50:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:50:52.347925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f8e66-f73d-47a0-95db-02cf0f6e2e96 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:52.480767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f8e66-f73d-47a0-95db-02cf0f6e2e96 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:52.484044 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 93/185] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:50:52.513980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c349049-d25f-40a6-a92e-28976d720508 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:52.517132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57751350-5f89-46c7-9aef-3a6f855ae424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:52.517454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57751350-5f89-46c7-9aef-3a6f855ae424 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:52.517793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57751350-5f89-46c7-9aef-3a6f855ae424 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:52.518077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57751350-5f89-46c7-9aef-3a6f855ae424 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:52.518859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57751350-5f89-46c7-9aef-3a6f855ae424 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:52.519955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57751350-5f89-46c7-9aef-3a6f855ae424 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:52.520564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57751350-5f89-46c7-9aef-3a6f855ae424 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:52.530233 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 93/186] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:50:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:50:52.536246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57751350-5f89-46c7-9aef-3a6f855ae424 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:52.551983 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:52.626834 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:52.636754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c349049-d25f-40a6-a92e-28976d720508 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:52.644189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57751350-5f89-46c7-9aef-3a6f855ae424 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:52.678718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd2839-f126-4ab9-b493-4fb3a0e49ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:52.680009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd2839-f126-4ab9-b493-4fb3a0e49ece None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:52.680430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c0e11-4677-4142-994d-fe332ae8e8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:52.681313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd2839-f126-4ab9-b493-4fb3a0e49ece None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:52.681883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd2839-f126-4ab9-b493-4fb3a0e49ece None admin] PATH_INFO: `/v3/domains/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:52.682063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c0e11-4677-4142-994d-fe332ae8e8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:52.682375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c0e11-4677-4142-994d-fe332ae8e8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:52.682654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2c0e11-4677-4142-994d-fe332ae8e8b7 None admin] PATH_INFO: `/v3/users/f3746a0b069c403b8e4bbd2b21fce597` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:52.683956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd2839-f126-4ab9-b493-4fb3a0e49ece None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:52.685849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd2839-f126-4ab9-b493-4fb3a0e49ece None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:52.688321 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 94/187] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:50:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:50:52.693962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd2839-f126-4ab9-b493-4fb3a0e49ece None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:52.698132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c0e11-4677-4142-994d-fe332ae8e8b7 None admin] RBAC: Authorizing `identity:get_user(user_id=f3746a0b069c403b8e4bbd2b21fce597)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:52.699632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2c0e11-4677-4142-994d-fe332ae8e8b7 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:52.701371 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 94/188] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:52 2022] GET /identity/v3/users/f3746a0b069c403b8e4bbd2b21fce597 => generated 283 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:50:52.706929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c0e11-4677-4142-994d-fe332ae8e8b7 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:52.780160 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:52.806231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd2839-f126-4ab9-b493-4fb3a0e49ece None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:52.815499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2c0e11-4677-4142-994d-fe332ae8e8b7 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:52.845735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cfc6b-008a-4590-a62b-f3e5350d8b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:52.846443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cfc6b-008a-4590-a62b-f3e5350d8b55 None admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:52.846738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cfc6b-008a-4590-a62b-f3e5350d8b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:52.847018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cfc6b-008a-4590-a62b-f3e5350d8b55 None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:52.847750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cfc6b-008a-4590-a62b-f3e5350d8b55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:52.849207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cfc6b-008a-4590-a62b-f3e5350d8b55 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:52.853137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082dc48-c062-496d-a544-cb9f119ff9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:52.854080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082dc48-c062-496d-a544-cb9f119ff9ab None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:52.854554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082dc48-c062-496d-a544-cb9f119ff9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:52.854977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082dc48-c062-496d-a544-cb9f119ff9ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:52.923911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082dc48-c062-496d-a544-cb9f119ff9ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:52.925378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082dc48-c062-496d-a544-cb9f119ff9ab None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:52.948878 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 95/189] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 19 13:50:52 2022] POST /identity/v3/users => generated 297 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 13:50:52.948878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423ce6c-ccee-49c4-83bb-0f81a6aaba9b None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:52.948878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423ce6c-ccee-49c4-83bb-0f81a6aaba9b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:52.948878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423ce6c-ccee-49c4-83bb-0f81a6aaba9b None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:52.948878 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 96/190] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:52.955441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62744f21-064b-4871-9cf2-e1057797e823 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:52.955858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62744f21-064b-4871-9cf2-e1057797e823 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:52.956221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62744f21-064b-4871-9cf2-e1057797e823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:52.975150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-62744f21-064b-4871-9cf2-e1057797e823 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:52.976799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-62744f21-064b-4871-9cf2-e1057797e823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:52.994207 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:53.050503 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:53.063016 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 97/191] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:50:53.075184 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 95/192] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:50:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 13:50:53.081019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62744f21-064b-4871-9cf2-e1057797e823 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:53.092534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082dc48-c062-496d-a544-cb9f119ff9ab None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:53.225544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082dc48-c062-496d-a544-cb9f119ff9ab None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:53.231298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62744f21-064b-4871-9cf2-e1057797e823 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:53.275421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87938db-f60f-46a7-9201-52e2fbf57aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:53.276910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87938db-f60f-46a7-9201-52e2fbf57aac None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:53.277386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87938db-f60f-46a7-9201-52e2fbf57aac None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:53.277667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87938db-f60f-46a7-9201-52e2fbf57aac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:53.277849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138abed3-3fd1-425a-8840-b7ca98584f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:53.278747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138abed3-3fd1-425a-8840-b7ca98584f56 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:53.279029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138abed3-3fd1-425a-8840-b7ca98584f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:53.279299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138abed3-3fd1-425a-8840-b7ca98584f56 None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:53.280498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138abed3-3fd1-425a-8840-b7ca98584f56 None admin] RBAC: Authorizing `identity:get_project(project_id=2b597c406357445d8679d4b27fa90b63)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:53.281956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138abed3-3fd1-425a-8840-b7ca98584f56 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:53.285384 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 98/193] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:50:53 2022] GET /identity/v3/projects/2b597c406357445d8679d4b27fa90b63 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:53.290190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87938db-f60f-46a7-9201-52e2fbf57aac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:53.292540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138abed3-3fd1-425a-8840-b7ca98584f56 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:53.298588 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-f87938db-f60f-46a7-9201-52e2fbf57aac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:50:53.298588 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:53.298588 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:53.298588 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:53.298588 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:53.298588 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:53.298588 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:53.298588 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:53.298588 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:53.298588 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:53.298588 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:53.298588 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:53.298588 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:53.298588 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:53.298588 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:53.298588 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:53.299493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:53.299493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:53.299493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:53.299493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:53.299493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:53.299493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:53.299493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:53.299493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:53.299493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:53.299493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:53.299493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:53.299493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:53.299493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:53.299493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:53.299493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:53.299493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:53.300299 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:53.300299 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:53.300299 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:53.300299 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:53.300299 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:53.300299 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:53.300299 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:53.300299 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:53.300299 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:53.300299 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:53.300299 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:50:53.300299 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:50:53.300299 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 96/194] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 19 13:50:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:50:53.306998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87938db-f60f-46a7-9201-52e2fbf57aac None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:53.317540 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:53.349631 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:53.427193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138abed3-3fd1-425a-8840-b7ca98584f56 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:53.435739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87938db-f60f-46a7-9201-52e2fbf57aac None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:53.468768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d598627-adf6-493b-a403-01ff8748c5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:53.469920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598627-adf6-493b-a403-01ff8748c5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:53.470518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598627-adf6-493b-a403-01ff8748c5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:53.471001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d598627-adf6-493b-a403-01ff8748c5b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:53.472149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d598627-adf6-493b-a403-01ff8748c5b0 None admin] RBAC: Adding query filter params (role.id=bc315edf089d43b18acf9790031f3fcb, scope.project.id=2b597c406357445d8679d4b27fa90b63, user.id=f3746a0b069c403b8e4bbd2b21fce597) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:53.472667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d598627-adf6-493b-a403-01ff8748c5b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:53.474551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d598627-adf6-493b-a403-01ff8748c5b0 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:53.475326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3f739-6136-4c1f-a741-b4b8a69ce068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:53.476162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3f739-6136-4c1f-a741-b4b8a69ce068 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:53.476871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3f739-6136-4c1f-a741-b4b8a69ce068 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:53.477325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3f739-6136-4c1f-a741-b4b8a69ce068 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:53.479559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3f739-6136-4c1f-a741-b4b8a69ce068 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:53.480277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3f739-6136-4c1f-a741-b4b8a69ce068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:53.481704 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 99/195] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:50:53 2022] GET /identity/v3/role_assignments?user.id=f3746a0b069c403b8e4bbd2b21fce597&scope.project.id=2b597c406357445d8679d4b27fa90b63&role.id=bc315edf089d43b18acf9790031f3fcb => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:50:53.481989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3f739-6136-4c1f-a741-b4b8a69ce068 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:53.483168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa395b-4997-4847-831f-f03b84940351 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:53.490638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa395b-4997-4847-831f-f03b84940351 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:53.491019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa395b-4997-4847-831f-f03b84940351 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:53.491778 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 97/196] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:50:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:53.497191 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 100/197] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:53 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:53.498917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3f739-6136-4c1f-a741-b4b8a69ce068 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:53.499351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12bb59-5fad-4277-bb24-fa576ea09c21 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:53.499771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12bb59-5fad-4277-bb24-fa576ea09c21 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:53.500062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12bb59-5fad-4277-bb24-fa576ea09c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:53.534319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8e12bb59-5fad-4277-bb24-fa576ea09c21 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:53.535525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8e12bb59-5fad-4277-bb24-fa576ea09c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:53.640965 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 101/198] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:50:53.657034 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:53.668218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3f739-6136-4c1f-a741-b4b8a69ce068 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:53.697800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12bb59-5fad-4277-bb24-fa576ea09c21 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:53.709800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037932de-0f0d-4e0f-9298-7e9a7dcfc3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:53.710710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037932de-0f0d-4e0f-9298-7e9a7dcfc3e2 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:53.710997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037932de-0f0d-4e0f-9298-7e9a7dcfc3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:53.711275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037932de-0f0d-4e0f-9298-7e9a7dcfc3e2 None admin] PATH_INFO: `/v3/users/f3746a0b069c403b8e4bbd2b21fce597` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:53.712657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037932de-0f0d-4e0f-9298-7e9a7dcfc3e2 None admin] RBAC: Authorizing `identity:get_user(user_id=f3746a0b069c403b8e4bbd2b21fce597)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:53.714157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037932de-0f0d-4e0f-9298-7e9a7dcfc3e2 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:53.716128 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 98/199] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:53 2022] GET /identity/v3/users/f3746a0b069c403b8e4bbd2b21fce597 => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:53.716665 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:53.722107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037932de-0f0d-4e0f-9298-7e9a7dcfc3e2 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:53.845230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12bb59-5fad-4277-bb24-fa576ea09c21 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:53.893696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50ac05-98c7-4f74-9496-cd29753a3cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:53.894451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50ac05-98c7-4f74-9496-cd29753a3cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:53.894732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50ac05-98c7-4f74-9496-cd29753a3cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:53.895007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50ac05-98c7-4f74-9496-cd29753a3cf8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:53.912536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037932de-0f0d-4e0f-9298-7e9a7dcfc3e2 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:53.920824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50ac05-98c7-4f74-9496-cd29753a3cf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:53.928618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-aa50ac05-98c7-4f74-9496-cd29753a3cf8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 13:50:53.928618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:53.928618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:53.928618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:53.928618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:53.928618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:53.928618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:53.928618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:53.928618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:53.928618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:53.928618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:53.928618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:53.928618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:53.928618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:53.928618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:53.928618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:53.929514 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:53.929514 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:53.929514 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:53.929514 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:53.929514 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:53.929514 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:53.929514 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:53.929514 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:53.929514 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:53.929514 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:53.929514 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:53.929514 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:53.929514 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:53.929514 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:53.929514 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:53.929514 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:53.932233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:53.932233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:53.932233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:53.932233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:53.932233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:53.932233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:53.932233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:53.932233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:53.932233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:53.932233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:53.932233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 13:50:53.932233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:50:53.932233 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 102/200] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:50:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:50:53.942998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50ac05-98c7-4f74-9496-cd29753a3cf8 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:53.968544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc4f32-abc6-4ca4-9509-e6eba0b3d176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:53.969834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc4f32-abc6-4ca4-9509-e6eba0b3d176 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:53.970356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc4f32-abc6-4ca4-9509-e6eba0b3d176 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:53.970887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc4f32-abc6-4ca4-9509-e6eba0b3d176 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:54.014483 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:54.093841 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:54.103059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc4f32-abc6-4ca4-9509-e6eba0b3d176 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:54.105109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc4f32-abc6-4ca4-9509-e6eba0b3d176 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:54.152120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50ac05-98c7-4f74-9496-cd29753a3cf8 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:54.192629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0efae1-d824-41cd-8318-b5d905540e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:54.193438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0efae1-d824-41cd-8318-b5d905540e88 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:54.193722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0efae1-d824-41cd-8318-b5d905540e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:54.193994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0efae1-d824-41cd-8318-b5d905540e88 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:54.194774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0efae1-d824-41cd-8318-b5d905540e88 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:54.195077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0efae1-d824-41cd-8318-b5d905540e88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:54.198128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0efae1-d824-41cd-8318-b5d905540e88 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:54.210261 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 103/201] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:50:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:54.215535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0efae1-d824-41cd-8318-b5d905540e88 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:54.281323 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 99/202] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:50:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 13:50:54.287105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc4f32-abc6-4ca4-9509-e6eba0b3d176 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:54.356391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0efae1-d824-41cd-8318-b5d905540e88 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:54.387958 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:54.398139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef9286-466d-4b28-8b6d-6cd9213d1674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:54.399031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef9286-466d-4b28-8b6d-6cd9213d1674 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:54.399909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef9286-466d-4b28-8b6d-6cd9213d1674 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:54.400894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ef9286-466d-4b28-8b6d-6cd9213d1674 None admin] PATH_INFO: `/v3/users/a393084949ed4d999afb7c253b9c6e5b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:54.406982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef9286-466d-4b28-8b6d-6cd9213d1674 None admin] RBAC: Authorizing `identity:get_user(user_id=a393084949ed4d999afb7c253b9c6e5b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:54.408406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ef9286-466d-4b28-8b6d-6cd9213d1674 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:54.410471 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:54.410587 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 104/203] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:54 2022] GET /identity/v3/users/a393084949ed4d999afb7c253b9c6e5b => generated 289 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:54.420085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef9286-466d-4b28-8b6d-6cd9213d1674 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:54.490410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc4f32-abc6-4ca4-9509-e6eba0b3d176 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:54.554606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518a71b-f6c4-4a32-8321-a24bfa98320b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:54.556920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518a71b-f6c4-4a32-8321-a24bfa98320b None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:54.557704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518a71b-f6c4-4a32-8321-a24bfa98320b None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:54.557987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518a71b-f6c4-4a32-8321-a24bfa98320b None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:54.564590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518a71b-f6c4-4a32-8321-a24bfa98320b None admin] RBAC: Authorizing `identity:get_project(project_id=2b597c406357445d8679d4b27fa90b63)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:54.566050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518a71b-f6c4-4a32-8321-a24bfa98320b None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:54.567818 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 100/204] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:50:54 2022] GET /identity/v3/projects/2b597c406357445d8679d4b27fa90b63 => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:50:54.579069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518a71b-f6c4-4a32-8321-a24bfa98320b None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:54.587438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ef9286-466d-4b28-8b6d-6cd9213d1674 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:54.624911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344db34-0035-4eeb-815e-73f4c3d837c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:54.625919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344db34-0035-4eeb-815e-73f4c3d837c5 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:54.626455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344db34-0035-4eeb-815e-73f4c3d837c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:54.626939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0344db34-0035-4eeb-815e-73f4c3d837c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:54.727138 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:54.728806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344db34-0035-4eeb-815e-73f4c3d837c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:54.731194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0344db34-0035-4eeb-815e-73f4c3d837c5 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:54.757659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518a71b-f6c4-4a32-8321-a24bfa98320b None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:54.808861 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:54.826508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1acd05-c28e-42f8-982f-605d5a180e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:54.827483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1acd05-c28e-42f8-982f-605d5a180e86 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:54.827987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1acd05-c28e-42f8-982f-605d5a180e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:54.828479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1acd05-c28e-42f8-982f-605d5a180e86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:54.829527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1acd05-c28e-42f8-982f-605d5a180e86 None admin] RBAC: Adding query filter params (role.id=b73e411ed06b463fb578c06789886960, scope.project.id=2b597c406357445d8679d4b27fa90b63, user.id=f3746a0b069c403b8e4bbd2b21fce597) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:54.830124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1acd05-c28e-42f8-982f-605d5a180e86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:54.831941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1acd05-c28e-42f8-982f-605d5a180e86 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:54.839040 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 101/205] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:50:54 2022] GET /identity/v3/role_assignments?user.id=f3746a0b069c403b8e4bbd2b21fce597&scope.project.id=2b597c406357445d8679d4b27fa90b63&role.id=b73e411ed06b463fb578c06789886960 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:54.913307 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 105/206] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:50:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:50:54.919852 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1acd05-c28e-42f8-982f-605d5a180e86 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:55.064099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1acd05-c28e-42f8-982f-605d5a180e86 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:55.105732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebab8b37-697c-4031-8f1b-66363b5dfbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:55.106642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8b37-697c-4031-8f1b-66363b5dfbb5 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:55.106926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8b37-697c-4031-8f1b-66363b5dfbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:55.107201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebab8b37-697c-4031-8f1b-66363b5dfbb5 None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:55.114810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab8b37-697c-4031-8f1b-66363b5dfbb5 None admin] RBAC: Authorizing `identity:get_project(project_id=488e2680f33948a99baf67e759f3e3fe)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:55.116308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebab8b37-697c-4031-8f1b-66363b5dfbb5 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:55.120469 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 102/207] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:50:54 2022] GET /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:55.128132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344db34-0035-4eeb-815e-73f4c3d837c5 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:55.265232 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:55.270810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0344db34-0035-4eeb-815e-73f4c3d837c5 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:55.318424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e802a-b534-4d9a-b65a-676cd0e2d63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:55.319009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e802a-b534-4d9a-b65a-676cd0e2d63a None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:55.319291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e802a-b534-4d9a-b65a-676cd0e2d63a None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:55.319565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e802a-b534-4d9a-b65a-676cd0e2d63a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:55.320408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e802a-b534-4d9a-b65a-676cd0e2d63a None admin] RBAC: Adding query filter params (role.id=5361e6fea90e41aa8954e83ea952bc2b, scope.project.id=488e2680f33948a99baf67e759f3e3fe, user.id=a393084949ed4d999afb7c253b9c6e5b) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:55.320719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e802a-b534-4d9a-b65a-676cd0e2d63a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:55.322827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245e802a-b534-4d9a-b65a-676cd0e2d63a None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:55.331026 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 106/208] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:50:55 2022] GET /identity/v3/role_assignments?user.id=a393084949ed4d999afb7c253b9c6e5b&scope.project.id=488e2680f33948a99baf67e759f3e3fe&role.id=5361e6fea90e41aa8954e83ea952bc2b => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:55.551070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811ad78-b26a-49df-816e-ac9927acf7ce None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:55.551710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811ad78-b26a-49df-816e-ac9927acf7ce None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:55.552212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a811ad78-b26a-49df-816e-ac9927acf7ce None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:55.553782 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 103/209] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:55.560219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8d6c5-dd37-4356-a8d6-de9cc85a4bd8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:55.560514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8d6c5-dd37-4356-a8d6-de9cc85a4bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:55.560799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8d6c5-dd37-4356-a8d6-de9cc85a4bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:55.580975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d3d8d6c5-dd37-4356-a8d6-de9cc85a4bd8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:55.582085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d3d8d6c5-dd37-4356-a8d6-de9cc85a4bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:55.625635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fee95-a696-41e5-82ab-93d320800595 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:55.625939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fee95-a696-41e5-82ab-93d320800595 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:55.626243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fee95-a696-41e5-82ab-93d320800595 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:55.627826 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 104/210] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:55.634414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b00a6-5aad-4f5f-a38c-40c3fe8c6b05 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:55.635066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b00a6-5aad-4f5f-a38c-40c3fe8c6b05 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:55.635563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b00a6-5aad-4f5f-a38c-40c3fe8c6b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:55.657219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-290b00a6-5aad-4f5f-a38c-40c3fe8c6b05 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:55.661415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-290b00a6-5aad-4f5f-a38c-40c3fe8c6b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:55.664568 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 107/211] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:50:55.688973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8d6c5-dd37-4356-a8d6-de9cc85a4bd8 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:55.741582 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:55.755783 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 105/212] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:50:55.786403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b00a6-5aad-4f5f-a38c-40c3fe8c6b05 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:55.817837 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:55.827180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8d6c5-dd37-4356-a8d6-de9cc85a4bd8 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:55.866148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b6bb1-9e3b-4e31-8712-76ca2f6dbb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:55.867443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b6bb1-9e3b-4e31-8712-76ca2f6dbb56 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:55.867991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b6bb1-9e3b-4e31-8712-76ca2f6dbb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:55.868602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b6bb1-9e3b-4e31-8712-76ca2f6dbb56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:55.880869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b6bb1-9e3b-4e31-8712-76ca2f6dbb56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:55.889823 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-469b6bb1-9e3b-4e31-8712-76ca2f6dbb56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:50:55.889823 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:55.889823 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:55.889823 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:55.889823 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:55.889823 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:55.889823 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:55.889823 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:55.889823 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:55.889823 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:55.889823 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:55.889823 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:55.889823 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:55.889823 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:55.889823 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:55.889823 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:55.890736 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:55.890736 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:55.890736 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:55.890736 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:55.890736 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:55.890736 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:55.890736 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:55.890736 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:55.890736 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:55.890736 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:55.890736 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:55.890736 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:55.890736 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:55.890736 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:55.890736 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:55.890736 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:55.891531 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:55.891531 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:55.891531 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:55.891531 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:55.891531 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:55.891531 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:55.891531 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:55.891531 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:55.891531 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:55.891531 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:55.891531 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:50:55.891531 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:50:55.894351 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 108/213] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:50:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:50:55.900860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b6bb1-9e3b-4e31-8712-76ca2f6dbb56 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:55.918298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b00a6-5aad-4f5f-a38c-40c3fe8c6b05 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:55.961783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38e553-5c2d-44ee-8b4c-463506e5e936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:55.962628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38e553-5c2d-44ee-8b4c-463506e5e936 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:55.962925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38e553-5c2d-44ee-8b4c-463506e5e936 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:55.963217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38e553-5c2d-44ee-8b4c-463506e5e936 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:55.965102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38e553-5c2d-44ee-8b4c-463506e5e936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:55.966778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38e553-5c2d-44ee-8b4c-463506e5e936 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:55.968726 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 106/214] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:50:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:55.975802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38e553-5c2d-44ee-8b4c-463506e5e936 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:56.038783 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:56.041485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b6bb1-9e3b-4e31-8712-76ca2f6dbb56 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:56.082915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38e553-5c2d-44ee-8b4c-463506e5e936 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:56.087762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b690cf-af30-4a87-ac54-7dab1e0e7890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:56.090524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b690cf-af30-4a87-ac54-7dab1e0e7890 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:56.091057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b690cf-af30-4a87-ac54-7dab1e0e7890 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:56.091534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b690cf-af30-4a87-ac54-7dab1e0e7890 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:56.092519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b690cf-af30-4a87-ac54-7dab1e0e7890 None admin] RBAC: Adding query filter params (name=member) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:56.093486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b690cf-af30-4a87-ac54-7dab1e0e7890 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:56.095500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b690cf-af30-4a87-ac54-7dab1e0e7890 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:56.107163 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 109/215] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:50:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:50:56.111409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3722abf-cccb-41ba-a30c-6922ab4465e9 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:56.112728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3722abf-cccb-41ba-a30c-6922ab4465e9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:56.113019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3722abf-cccb-41ba-a30c-6922ab4465e9 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:56.114317 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 110/216] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:56.115009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3722abf-cccb-41ba-a30c-6922ab4465e9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:56.132476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cd5af-ae51-41fc-85c9-bf21dc37b8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:56.133712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cd5af-ae51-41fc-85c9-bf21dc37b8b5 None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:56.134531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cd5af-ae51-41fc-85c9-bf21dc37b8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:56.134817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cd5af-ae51-41fc-85c9-bf21dc37b8b5 None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:56.135535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cd5af-ae51-41fc-85c9-bf21dc37b8b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:56.136149 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:56.137143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cd5af-ae51-41fc-85c9-bf21dc37b8b5 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:56.224235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3722abf-cccb-41ba-a30c-6922ab4465e9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:56.240281 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 107/217] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 19 13:50:55 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:50:56.242730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2b465-8b99-423a-a85f-37f983311840 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:56.243871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2b465-8b99-423a-a85f-37f983311840 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:56.244327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2b465-8b99-423a-a85f-37f983311840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:56.266842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bfeb4-ec20-4904-a628-e3ef6daa6122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:56.267810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bfeb4-ec20-4904-a628-e3ef6daa6122 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:56.268170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bfeb4-ec20-4904-a628-e3ef6daa6122 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:56.270272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78bfeb4-ec20-4904-a628-e3ef6daa6122 None admin] PATH_INFO: `/v3/users/875036a344f34aa3a6d1aad21120e880` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:56.276230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e8b2b465-8b99-423a-a85f-37f983311840 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:56.277880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e8b2b465-8b99-423a-a85f-37f983311840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:56.286461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bfeb4-ec20-4904-a628-e3ef6daa6122 None admin] RBAC: Authorizing `identity:get_user(user_id=875036a344f34aa3a6d1aad21120e880)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:56.288058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78bfeb4-ec20-4904-a628-e3ef6daa6122 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:56.289884 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 111/218] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:56 2022] GET /identity/v3/users/875036a344f34aa3a6d1aad21120e880 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:56.296714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bfeb4-ec20-4904-a628-e3ef6daa6122 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:56.380304 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 108/219] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:50:56.395769 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:56.405734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2b465-8b99-423a-a85f-37f983311840 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:56.431653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78bfeb4-ec20-4904-a628-e3ef6daa6122 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:56.469502 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:56.480455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1c959-37cd-47b2-a947-c58d465c2861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:56.481115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1c959-37cd-47b2-a947-c58d465c2861 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:56.481396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1c959-37cd-47b2-a947-c58d465c2861 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:56.481666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1c959-37cd-47b2-a947-c58d465c2861 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:56.541249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2b465-8b99-423a-a85f-37f983311840 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:56.565549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1c959-37cd-47b2-a947-c58d465c2861 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:56.567781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1c959-37cd-47b2-a947-c58d465c2861 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:56.580836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30065b-4628-4164-b236-16657266372f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:56.581906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30065b-4628-4164-b236-16657266372f None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:56.582416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30065b-4628-4164-b236-16657266372f None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:56.582872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af30065b-4628-4164-b236-16657266372f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:56.595189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af30065b-4628-4164-b236-16657266372f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:56.603201 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-af30065b-4628-4164-b236-16657266372f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:50:56.603201 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:56.603201 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:56.603201 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:56.603201 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:56.603201 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:56.603201 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:56.603201 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:56.603201 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:56.603201 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:56.603201 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:56.603201 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:56.603201 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:56.603201 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:56.603201 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:56.603201 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:56.604149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:56.604149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:56.604149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:56.604149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:56.604149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:56.604149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:56.604149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:56.604149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:56.604149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:56.604149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:56.604149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:56.604149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:56.604149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:56.604149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:56.604149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:56.604149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:56.605183 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:56.605183 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:56.605183 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:56.605183 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:56.605183 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:56.605183 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:56.605183 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:56.605183 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:56.605183 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:56.605183 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:56.605183 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:50:56.605183 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:50:56.605183 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 109/220] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:50:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:50:56.613069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30065b-4628-4164-b236-16657266372f None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:56.669600 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:56.702371 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 112/221] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:50:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:50:56.704958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1c959-37cd-47b2-a947-c58d465c2861 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:56.738506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af30065b-4628-4164-b236-16657266372f None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:56.741806 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:56.796254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5565cc6-dd29-4d4f-a9d6-4c492216b673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:56.797167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5565cc6-dd29-4d4f-a9d6-4c492216b673 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:56.797578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5565cc6-dd29-4d4f-a9d6-4c492216b673 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:56.797989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5565cc6-dd29-4d4f-a9d6-4c492216b673 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:56.798999 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5565cc6-dd29-4d4f-a9d6-4c492216b673 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:56.799436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5565cc6-dd29-4d4f-a9d6-4c492216b673 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:56.806506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5565cc6-dd29-4d4f-a9d6-4c492216b673 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:56.832385 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 110/222] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:50:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:56.837063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5565cc6-dd29-4d4f-a9d6-4c492216b673 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:56.886473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1c959-37cd-47b2-a947-c58d465c2861 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:56.942031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a18349-e439-4e14-9b3b-7fd507fd45cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:56.943278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a18349-e439-4e14-9b3b-7fd507fd45cc None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:56.944963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a18349-e439-4e14-9b3b-7fd507fd45cc None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:56.945392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a18349-e439-4e14-9b3b-7fd507fd45cc None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:56.948673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a18349-e439-4e14-9b3b-7fd507fd45cc None admin] RBAC: Authorizing `identity:get_project(project_id=2b597c406357445d8679d4b27fa90b63)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:56.951132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a18349-e439-4e14-9b3b-7fd507fd45cc None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:56.953218 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 113/223] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:50:56 2022] GET /identity/v3/projects/2b597c406357445d8679d4b27fa90b63 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:50:56.960609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a18349-e439-4e14-9b3b-7fd507fd45cc None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:57.033333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5565cc6-dd29-4d4f-a9d6-4c492216b673 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:57.040571 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:57.095593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ea34f-a835-4b52-b558-f5ba2b430fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:57.096766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ea34f-a835-4b52-b558-f5ba2b430fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:57.097227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ea34f-a835-4b52-b558-f5ba2b430fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:57.097650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ea34f-a835-4b52-b558-f5ba2b430fb0 None admin] PATH_INFO: `/v3/users/f3746a0b069c403b8e4bbd2b21fce597` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:57.099273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ea34f-a835-4b52-b558-f5ba2b430fb0 None admin] RBAC: Authorizing `identity:get_user(user_id=f3746a0b069c403b8e4bbd2b21fce597)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:57.103366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ea34f-a835-4b52-b558-f5ba2b430fb0 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:57.111691 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 111/224] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:56 2022] GET /identity/v3/users/f3746a0b069c403b8e4bbd2b21fce597 => generated 283 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:57.115067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ea34f-a835-4b52-b558-f5ba2b430fb0 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:57.139009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a18349-e439-4e14-9b3b-7fd507fd45cc None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:57.243696 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:57.262984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87e4dc-f022-4d4b-ab4a-b2d2e4bcdb67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:57.263671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87e4dc-f022-4d4b-ab4a-b2d2e4bcdb67 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:57.263958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87e4dc-f022-4d4b-ab4a-b2d2e4bcdb67 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:57.264236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87e4dc-f022-4d4b-ab4a-b2d2e4bcdb67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:57.268073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87e4dc-f022-4d4b-ab4a-b2d2e4bcdb67 None admin] RBAC: Adding query filter params (role.id=e17d8526e56c4d319080a377398b9c74, scope.project.id=2b597c406357445d8679d4b27fa90b63, user.id=875036a344f34aa3a6d1aad21120e880) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:57.268073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87e4dc-f022-4d4b-ab4a-b2d2e4bcdb67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:57.268073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87e4dc-f022-4d4b-ab4a-b2d2e4bcdb67 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:57.282481 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 114/225] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:50:56 2022] GET /identity/v3/role_assignments?user.id=875036a344f34aa3a6d1aad21120e880&scope.project.id=2b597c406357445d8679d4b27fa90b63&role.id=e17d8526e56c4d319080a377398b9c74 => generated 259 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:50:57.283962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bddc53-99ab-461e-aa8a-276d56cd873e None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:57.284252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bddc53-99ab-461e-aa8a-276d56cd873e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:57.284531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bddc53-99ab-461e-aa8a-276d56cd873e None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:57.285795 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 115/226] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:57.292180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5c7af-3e33-4d15-a473-560b229b6838 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:57.292472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5c7af-3e33-4d15-a473-560b229b6838 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:57.292759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b5c7af-3e33-4d15-a473-560b229b6838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:57.310742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-82b5c7af-3e33-4d15-a473-560b229b6838 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:57.312220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-82b5c7af-3e33-4d15-a473-560b229b6838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:57.339219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ea34f-a835-4b52-b558-f5ba2b430fb0 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:57.426257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0910d-6156-4f00-9e00-9cc2fb74c3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:57.427500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0910d-6156-4f00-9e00-9cc2fb74c3b1 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:57.427967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0910d-6156-4f00-9e00-9cc2fb74c3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:57.428421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0910d-6156-4f00-9e00-9cc2fb74c3b1 None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:57.429962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0910d-6156-4f00-9e00-9cc2fb74c3b1 None admin] RBAC: Authorizing `identity:get_project(project_id=2b597c406357445d8679d4b27fa90b63)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:57.432028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0910d-6156-4f00-9e00-9cc2fb74c3b1 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:57.434069 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 112/227] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:50:57 2022] GET /identity/v3/projects/2b597c406357445d8679d4b27fa90b63 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:57.440167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0910d-6156-4f00-9e00-9cc2fb74c3b1 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:57.470830 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 116/228] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:50:57.496469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5c7af-3e33-4d15-a473-560b229b6838 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:57.572881 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:57.580817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0910d-6156-4f00-9e00-9cc2fb74c3b1 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:57.588852 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:57.627926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b586f6c-99f1-41cb-b462-ef935de6e2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:57.629234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b586f6c-99f1-41cb-b462-ef935de6e2db None admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:57.629720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b586f6c-99f1-41cb-b462-ef935de6e2db None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:57.630225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b586f6c-99f1-41cb-b462-ef935de6e2db None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63/users/f3746a0b069c403b8e4bbd2b21fce597/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:57.634780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b586f6c-99f1-41cb-b462-ef935de6e2db None admin] RBAC: Authorizing `identity:create_grant(project_id=2b597c406357445d8679d4b27fa90b63, user_id=f3746a0b069c403b8e4bbd2b21fce597, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:57.637603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b586f6c-99f1-41cb-b462-ef935de6e2db None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:57.674902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b5c7af-3e33-4d15-a473-560b229b6838 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:57.708387 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 113/229] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:50:57 2022] PUT /identity/v3/projects/2b597c406357445d8679d4b27fa90b63/users/f3746a0b069c403b8e4bbd2b21fce597/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 13:50:57.719311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bd149-0411-4d03-aff1-daab4d2f20df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:57.720141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bd149-0411-4d03-aff1-daab4d2f20df None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:57.720428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bd149-0411-4d03-aff1-daab4d2f20df None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:57.720704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6bd149-0411-4d03-aff1-daab4d2f20df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:57.735057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6bd149-0411-4d03-aff1-daab4d2f20df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:57.748232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-cc6bd149-0411-4d03-aff1-daab4d2f20df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:50:57.748232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:57.748232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:57.748232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:57.748232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:57.748232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:57.748232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:57.748232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:57.748232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:57.748232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:57.748232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:57.748232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:57.748232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:57.748232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:57.748232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:57.748232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:57.749193 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:57.749193 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:57.749193 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:57.749193 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:57.749193 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:57.749193 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:57.749193 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:57.749193 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:57.749193 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:57.749193 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:57.749193 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:57.749193 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:57.749193 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:57.749193 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:57.749193 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:57.749193 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:57.750043 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:57.750043 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:57.750043 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:57.750043 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:57.750043 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:57.750043 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:57.750043 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:57.750043 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:57.750043 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:57.750043 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:57.750043 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:50:57.750043 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:50:57.750043 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 117/230] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 19 13:50:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:50:57.759364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b586f6c-99f1-41cb-b462-ef935de6e2db None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:57.928141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b586f6c-99f1-41cb-b462-ef935de6e2db None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:57.968306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27232f99-f844-4999-b22d-414fe76189b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:57.969418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27232f99-f844-4999-b22d-414fe76189b1 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:57.969908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27232f99-f844-4999-b22d-414fe76189b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:57.970475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27232f99-f844-4999-b22d-414fe76189b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:57.971494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27232f99-f844-4999-b22d-414fe76189b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:57.972016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27232f99-f844-4999-b22d-414fe76189b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:57.973604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27232f99-f844-4999-b22d-414fe76189b1 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:57.985837 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 114/231] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:50:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:57.995561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bd149-0411-4d03-aff1-daab4d2f20df None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:58.108879 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:58.118859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6bd149-0411-4d03-aff1-daab4d2f20df None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:58.160506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6dd1d-7584-41da-9b45-0ddcf94db632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:58.161402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6dd1d-7584-41da-9b45-0ddcf94db632 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:58.161694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6dd1d-7584-41da-9b45-0ddcf94db632 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:58.161974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa6dd1d-7584-41da-9b45-0ddcf94db632 None admin] PATH_INFO: `/v3/users/f3746a0b069c403b8e4bbd2b21fce597` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:58.163237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6dd1d-7584-41da-9b45-0ddcf94db632 None admin] RBAC: Authorizing `identity:get_user(user_id=f3746a0b069c403b8e4bbd2b21fce597)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:58.164699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa6dd1d-7584-41da-9b45-0ddcf94db632 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:58.167973 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 118/232] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:57 2022] GET /identity/v3/users/f3746a0b069c403b8e4bbd2b21fce597 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:58.172579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27232f99-f844-4999-b22d-414fe76189b1 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:58.236166 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:58.325575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27232f99-f844-4999-b22d-414fe76189b1 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:58.370605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3f24ad-6c36-4542-be73-4d4ea1dbcb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:58.371396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f24ad-6c36-4542-be73-4d4ea1dbcb11 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:58.371680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f24ad-6c36-4542-be73-4d4ea1dbcb11 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:58.371951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3f24ad-6c36-4542-be73-4d4ea1dbcb11 None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:58.378841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f24ad-6c36-4542-be73-4d4ea1dbcb11 None admin] RBAC: Authorizing `identity:get_project(project_id=2b597c406357445d8679d4b27fa90b63)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:58.380414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3f24ad-6c36-4542-be73-4d4ea1dbcb11 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:58.382215 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 115/233] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:50:58 2022] GET /identity/v3/projects/2b597c406357445d8679d4b27fa90b63 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:58.389176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6dd1d-7584-41da-9b45-0ddcf94db632 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:58.501751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa6dd1d-7584-41da-9b45-0ddcf94db632 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:58.542160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01df7fb3-ab82-4bb1-af85-5a0d85513978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:58.543068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df7fb3-ab82-4bb1-af85-5a0d85513978 None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:58.543351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df7fb3-ab82-4bb1-af85-5a0d85513978 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:58.543626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01df7fb3-ab82-4bb1-af85-5a0d85513978 None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63/users/f3746a0b069c403b8e4bbd2b21fce597/roles/b73e411ed06b463fb578c06789886960` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:58.545891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df7fb3-ab82-4bb1-af85-5a0d85513978 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b597c406357445d8679d4b27fa90b63, user_id=f3746a0b069c403b8e4bbd2b21fce597, role_id=b73e411ed06b463fb578c06789886960)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:58.547392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01df7fb3-ab82-4bb1-af85-5a0d85513978 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:58.660119 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 119/234] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:50:58 2022] PUT /identity/v3/projects/2b597c406357445d8679d4b27fa90b63/users/f3746a0b069c403b8e4bbd2b21fce597/roles/b73e411ed06b463fb578c06789886960 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:50:59.008345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00d1f1-a8c2-42d6-bbd8-448aac3ff131 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:59.009655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00d1f1-a8c2-42d6-bbd8-448aac3ff131 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:59.010172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f00d1f1-a8c2-42d6-bbd8-448aac3ff131 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:59.012035 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 116/235] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:59.017097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f086395-7052-485c-85d2-aed2f9befec5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:59.017623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f086395-7052-485c-85d2-aed2f9befec5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:59.018112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f086395-7052-485c-85d2-aed2f9befec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:59.035780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5f086395-7052-485c-85d2-aed2f9befec5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:59.037243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5f086395-7052-485c-85d2-aed2f9befec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:59.045240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fec9d-34a1-4c98-b2db-8895d7050dad None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:59.045530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fec9d-34a1-4c98-b2db-8895d7050dad None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:59.045810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fec9d-34a1-4c98-b2db-8895d7050dad None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:59.047235 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 117/236] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:59.052191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed304a07-42fb-4cae-873a-6369e0d795a1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:59.052483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed304a07-42fb-4cae-873a-6369e0d795a1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:59.052769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed304a07-42fb-4cae-873a-6369e0d795a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:59.060446 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:59.072936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ed304a07-42fb-4cae-873a-6369e0d795a1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:59.074451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ed304a07-42fb-4cae-873a-6369e0d795a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:59.131807 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 120/237] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:50:59.164084 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 118/238] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:50:59.191750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f086395-7052-485c-85d2-aed2f9befec5 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:59.205466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed304a07-42fb-4cae-873a-6369e0d795a1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:59.234845 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:59.318943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed304a07-42fb-4cae-873a-6369e0d795a1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:59.357654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4962c-9e36-4bd0-b53c-6ef88ebdbd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:59.358866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4962c-9e36-4bd0-b53c-6ef88ebdbd2f None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:59.359358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4962c-9e36-4bd0-b53c-6ef88ebdbd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:59.359951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4962c-9e36-4bd0-b53c-6ef88ebdbd2f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:59.371747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4962c-9e36-4bd0-b53c-6ef88ebdbd2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:50:59.380113 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-e8e4962c-9e36-4bd0-b53c-6ef88ebdbd2f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 13:50:59.380113 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:50:59.380113 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:50:59.380113 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:50:59.380113 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:50:59.380113 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:50:59.380113 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:50:59.380113 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:50:59.380113 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:50:59.380113 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:50:59.380113 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:50:59.380113 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:50:59.380113 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:50:59.380113 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:50:59.380113 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:50:59.380113 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:50:59.380991 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:50:59.380991 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:50:59.380991 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:50:59.380991 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:50:59.380991 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:50:59.380991 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:50:59.380991 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:50:59.380991 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:50:59.380991 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:50:59.380991 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:50:59.380991 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:50:59.380991 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:50:59.380991 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:50:59.380991 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:50:59.380991 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:50:59.380991 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:50:59.381793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:50:59.381793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:50:59.381793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:50:59.381793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:50:59.381793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:50:59.381793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:50:59.381793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:50:59.381793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:50:59.381793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:50:59.381793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:50:59.381793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 13:50:59.381793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:50:59.384799 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 119/239] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:50:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:50:59.390902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f086395-7052-485c-85d2-aed2f9befec5 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:59.393758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4962c-9e36-4bd0-b53c-6ef88ebdbd2f None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:59.472168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d02a7-b190-4fbe-82cf-75a56d1504f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:59.472989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d02a7-b190-4fbe-82cf-75a56d1504f5 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:59.473275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d02a7-b190-4fbe-82cf-75a56d1504f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:59.473550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874d02a7-b190-4fbe-82cf-75a56d1504f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:59.480051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d02a7-b190-4fbe-82cf-75a56d1504f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:59.480051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874d02a7-b190-4fbe-82cf-75a56d1504f5 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:59.480051 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 121/240] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:50:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:59.485600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d02a7-b190-4fbe-82cf-75a56d1504f5 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:59.505440 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:59.527110 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:59.542208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4962c-9e36-4bd0-b53c-6ef88ebdbd2f None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:59.610162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d7ea3-2172-496b-bb28-7b897fdf92a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:59.610770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d7ea3-2172-496b-bb28-7b897fdf92a3 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:59.611056 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d7ea3-2172-496b-bb28-7b897fdf92a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:59.611335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d7ea3-2172-496b-bb28-7b897fdf92a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:59.612098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d7ea3-2172-496b-bb28-7b897fdf92a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:50:59.612405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d7ea3-2172-496b-bb28-7b897fdf92a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:59.613824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d7ea3-2172-496b-bb28-7b897fdf92a3 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:59.634626 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 120/241] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:50:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:59.640323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d7ea3-2172-496b-bb28-7b897fdf92a3 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:59.668606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874d02a7-b190-4fbe-82cf-75a56d1504f5 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:59.706467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09a2ed-d0ac-4e18-a3ff-1887dfea93d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:59.707146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09a2ed-d0ac-4e18-a3ff-1887dfea93d5 None admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:59.707432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09a2ed-d0ac-4e18-a3ff-1887dfea93d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:59.707708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09a2ed-d0ac-4e18-a3ff-1887dfea93d5 None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:59.708428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09a2ed-d0ac-4e18-a3ff-1887dfea93d5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:59.709865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09a2ed-d0ac-4e18-a3ff-1887dfea93d5 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:59.792438 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 122/242] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 19 13:50:59 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 13:50:59.793818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231fcd5-4ec1-4283-bbcd-f92d0cf0b659 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:59.794122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231fcd5-4ec1-4283-bbcd-f92d0cf0b659 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:59.794407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231fcd5-4ec1-4283-bbcd-f92d0cf0b659 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:59.795918 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 123/243] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:50:59.802064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295900d-5d39-4218-8355-678f0ccfdd73 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:59.802382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295900d-5d39-4218-8355-678f0ccfdd73 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:59.802662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9295900d-5d39-4218-8355-678f0ccfdd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:59.804298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d7ea3-2172-496b-bb28-7b897fdf92a3 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:50:59.822783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9295900d-5d39-4218-8355-678f0ccfdd73 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:50:59.824040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9295900d-5d39-4218-8355-678f0ccfdd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:50:59.845479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df398fc0-a342-495c-ab4e-4ab3e1de3bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:50:59.846409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df398fc0-a342-495c-ab4e-4ab3e1de3bae None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:50:59.846693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df398fc0-a342-495c-ab4e-4ab3e1de3bae None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:50:59.846964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df398fc0-a342-495c-ab4e-4ab3e1de3bae None admin] PATH_INFO: `/v3/users/05451eb45ab94b93a3367009c99fa47a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:50:59.875244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df398fc0-a342-495c-ab4e-4ab3e1de3bae None admin] RBAC: Authorizing `identity:get_user(user_id=05451eb45ab94b93a3367009c99fa47a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:50:59.878196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df398fc0-a342-495c-ab4e-4ab3e1de3bae None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:50:59.880904 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 121/244] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:50:59 2022] GET /identity/v3/users/05451eb45ab94b93a3367009c99fa47a => generated 297 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:50:59.887062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df398fc0-a342-495c-ab4e-4ab3e1de3bae None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:50:59.894463 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:50:59.983149 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 124/245] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:00.019421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295900d-5d39-4218-8355-678f0ccfdd73 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:00.037811 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:00.060703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df398fc0-a342-495c-ab4e-4ab3e1de3bae None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:00.112318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f697042-8147-4929-8bfb-632931721d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:00.112987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f697042-8147-4929-8bfb-632931721d69 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:00.113273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f697042-8147-4929-8bfb-632931721d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:00.113553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f697042-8147-4929-8bfb-632931721d69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:00.159968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9295900d-5d39-4218-8355-678f0ccfdd73 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:00.213515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa551403-49e6-41e2-bf20-e34c7a54ff00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:00.216603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa551403-49e6-41e2-bf20-e34c7a54ff00 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:00.216603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa551403-49e6-41e2-bf20-e34c7a54ff00 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:00.216603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa551403-49e6-41e2-bf20-e34c7a54ff00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:00.230022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f697042-8147-4929-8bfb-632931721d69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:00.231320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa551403-49e6-41e2-bf20-e34c7a54ff00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:00.232466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f697042-8147-4929-8bfb-632931721d69 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:00.239537 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-fa551403-49e6-41e2-bf20-e34c7a54ff00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:51:00.239537 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:00.239537 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:00.239537 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:00.239537 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:00.239537 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:00.239537 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:00.239537 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:00.239537 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:00.239537 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:00.239537 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:00.239537 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:00.239537 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:00.239537 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:00.239537 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:00.239537 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:00.240596 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:00.240596 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:00.240596 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:00.240596 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:00.240596 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:00.240596 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:00.240596 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:00.240596 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:00.240596 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:00.240596 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:00.240596 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:00.240596 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:00.240596 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:00.240596 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:00.240596 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:00.240596 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:00.241391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:00.241391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:00.241391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:00.241391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:00.241391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:00.241391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:00.241391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:00.241391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:00.241391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:00.241391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:00.241391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:51:00.241391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:00.242409 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 125/246] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:51:00.248035 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:00.263605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa551403-49e6-41e2-bf20-e34c7a54ff00 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:00.352065 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:00.394437 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 122/247] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:50:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:00.396150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed5211-fa78-4d2d-9ede-a3763f1ee70a None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:00.396663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed5211-fa78-4d2d-9ede-a3763f1ee70a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:00.397136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed5211-fa78-4d2d-9ede-a3763f1ee70a None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:00.400311 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 123/248] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:00.402521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa551403-49e6-41e2-bf20-e34c7a54ff00 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:00.404983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed5211-fa78-4d2d-9ede-a3763f1ee70a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:00.445043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e510b-de18-4102-ba85-c2cfbb3122fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:00.445639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e510b-de18-4102-ba85-c2cfbb3122fb None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:00.445927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e510b-de18-4102-ba85-c2cfbb3122fb None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:00.446380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e510b-de18-4102-ba85-c2cfbb3122fb None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:00.447149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e510b-de18-4102-ba85-c2cfbb3122fb None admin] RBAC: Adding query filter params (name=member) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:00.447519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e510b-de18-4102-ba85-c2cfbb3122fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:00.448846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e510b-de18-4102-ba85-c2cfbb3122fb None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:00.459102 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 126/249] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:51:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:00.460435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91f1bb-be64-4930-8706-b1f2144a099c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:00.460728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91f1bb-be64-4930-8706-b1f2144a099c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:00.461009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91f1bb-be64-4930-8706-b1f2144a099c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:00.480781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ee91f1bb-be64-4930-8706-b1f2144a099c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:00.481974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ee91f1bb-be64-4930-8706-b1f2144a099c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:00.545479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed5211-fa78-4d2d-9ede-a3763f1ee70a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:00.547339 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:00.585711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb0f87-24b4-4c6a-aade-9fbd91d36128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:00.586606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb0f87-24b4-4c6a-aade-9fbd91d36128 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:00.587534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb0f87-24b4-4c6a-aade-9fbd91d36128 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:00.587810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdb0f87-24b4-4c6a-aade-9fbd91d36128 None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:00.589025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb0f87-24b4-4c6a-aade-9fbd91d36128 None admin] RBAC: Authorizing `identity:get_project(project_id=2b597c406357445d8679d4b27fa90b63)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:00.590517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdb0f87-24b4-4c6a-aade-9fbd91d36128 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:00.593084 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 124/250] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:51:00 2022] GET /identity/v3/projects/2b597c406357445d8679d4b27fa90b63 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:00.593765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb0f87-24b4-4c6a-aade-9fbd91d36128 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:00.606220 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 127/251] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:00.607289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91f1bb-be64-4930-8706-b1f2144a099c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:00.722537 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:00.791491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91f1bb-be64-4930-8706-b1f2144a099c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:00.794709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdb0f87-24b4-4c6a-aade-9fbd91d36128 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:00.844844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a055b32-9e7a-4b65-a33f-ffce59008b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:00.845718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a055b32-9e7a-4b65-a33f-ffce59008b52 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:00.846002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a055b32-9e7a-4b65-a33f-ffce59008b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:00.846437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a055b32-9e7a-4b65-a33f-ffce59008b52 None admin] PATH_INFO: `/v3/users/875036a344f34aa3a6d1aad21120e880` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:00.847896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a055b32-9e7a-4b65-a33f-ffce59008b52 None admin] RBAC: Authorizing `identity:get_user(user_id=875036a344f34aa3a6d1aad21120e880)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:00.849400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a055b32-9e7a-4b65-a33f-ffce59008b52 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:00.851598 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 125/252] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:51:00 2022] GET /identity/v3/users/875036a344f34aa3a6d1aad21120e880 => generated 297 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:00.853403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a055b32-9e7a-4b65-a33f-ffce59008b52 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:00.867492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592278b6-b9e4-4d95-bfd0-9855bfe3dc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:00.868280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592278b6-b9e4-4d95-bfd0-9855bfe3dc92 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:00.868564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592278b6-b9e4-4d95-bfd0-9855bfe3dc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:00.868844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592278b6-b9e4-4d95-bfd0-9855bfe3dc92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:00.869814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592278b6-b9e4-4d95-bfd0-9855bfe3dc92 None admin] RBAC: Adding query filter params (role.id=5361e6fea90e41aa8954e83ea952bc2b, scope.project.id=2b597c406357445d8679d4b27fa90b63, user.id=05451eb45ab94b93a3367009c99fa47a) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:00.870151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592278b6-b9e4-4d95-bfd0-9855bfe3dc92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:00.871723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592278b6-b9e4-4d95-bfd0-9855bfe3dc92 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:00.885931 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 128/253] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:51:00 2022] GET /identity/v3/role_assignments?user.id=05451eb45ab94b93a3367009c99fa47a&scope.project.id=2b597c406357445d8679d4b27fa90b63&role.id=5361e6fea90e41aa8954e83ea952bc2b => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:00.886898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592278b6-b9e4-4d95-bfd0-9855bfe3dc92 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:00.938521 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:01.082555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a055b32-9e7a-4b65-a33f-ffce59008b52 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:01.117775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592278b6-b9e4-4d95-bfd0-9855bfe3dc92 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:01.156254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbc5c6-5cfa-415f-a103-01507547b32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:01.157466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbc5c6-5cfa-415f-a103-01507547b32d None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:01.157983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbc5c6-5cfa-415f-a103-01507547b32d None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:01.158483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefbc5c6-5cfa-415f-a103-01507547b32d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:01.180638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefbc5c6-5cfa-415f-a103-01507547b32d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:01.189152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-aefbc5c6-5cfa-415f-a103-01507547b32d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:51:01.189152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:01.189152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:01.189152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:01.189152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:01.189152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:01.189152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:01.189152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:01.189152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:01.189152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:01.189152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:01.189152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:01.189152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:01.189152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:01.189152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:01.189152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:01.190082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:01.190082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:01.190082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:01.190082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:01.190082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:01.190082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:01.190082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:01.190082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:01.190082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:01.190082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:01.190082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:01.190082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:01.190082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:01.190082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:01.190082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:01.190082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:01.190934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:01.190934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:01.190934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:01.190934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:01.190934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:01.190934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:01.190934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:01.190934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:01.190934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:01.190934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:01.190934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:51:01.190934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:01.193337 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 126/254] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:51:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:01.200503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbc5c6-5cfa-415f-a103-01507547b32d None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:01.229255 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:01.248240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d715f98-69ee-4155-ac2b-f54bea79b127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:01.249941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d715f98-69ee-4155-ac2b-f54bea79b127 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:01.250255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d715f98-69ee-4155-ac2b-f54bea79b127 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:01.250535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d715f98-69ee-4155-ac2b-f54bea79b127 None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:01.252336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d715f98-69ee-4155-ac2b-f54bea79b127 None admin] RBAC: Authorizing `identity:get_project(project_id=2b597c406357445d8679d4b27fa90b63)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:01.253802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d715f98-69ee-4155-ac2b-f54bea79b127 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:01.255725 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 129/255] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:51:00 2022] GET /identity/v3/projects/2b597c406357445d8679d4b27fa90b63 => generated 302 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:01.263336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d715f98-69ee-4155-ac2b-f54bea79b127 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:01.384246 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:01.388550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefbc5c6-5cfa-415f-a103-01507547b32d None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:01.454349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30292dd3-b866-40dc-a42d-e2f1566691f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:01.455715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30292dd3-b866-40dc-a42d-e2f1566691f5 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:01.456004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30292dd3-b866-40dc-a42d-e2f1566691f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:01.456286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30292dd3-b866-40dc-a42d-e2f1566691f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:01.457049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30292dd3-b866-40dc-a42d-e2f1566691f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:01.457360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30292dd3-b866-40dc-a42d-e2f1566691f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:01.458777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30292dd3-b866-40dc-a42d-e2f1566691f5 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:01.463003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d715f98-69ee-4155-ac2b-f54bea79b127 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:01.476928 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 127/256] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:01.480488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3ec9e-f29b-475c-a70b-1e1c003d62f5 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:01.480780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3ec9e-f29b-475c-a70b-1e1c003d62f5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:01.481059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3ec9e-f29b-475c-a70b-1e1c003d62f5 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:01.483809 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 128/257] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:01.485513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3ec9e-f29b-475c-a70b-1e1c003d62f5 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:01.521597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592a1f61-f0ea-41bb-befa-b619733894b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:01.522525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a1f61-f0ea-41bb-befa-b619733894b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:01.522810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a1f61-f0ea-41bb-befa-b619733894b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:01.523490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592a1f61-f0ea-41bb-befa-b619733894b3 None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63/users/875036a344f34aa3a6d1aad21120e880/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:01.526088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a1f61-f0ea-41bb-befa-b619733894b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2b597c406357445d8679d4b27fa90b63, user_id=875036a344f34aa3a6d1aad21120e880, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:01.528272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592a1f61-f0ea-41bb-befa-b619733894b3 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:01.604167 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 130/258] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:51:01 2022] PUT /identity/v3/projects/2b597c406357445d8679d4b27fa90b63/users/875036a344f34aa3a6d1aad21120e880/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:51:01.605605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e9ae8-17f4-4723-94ac-42ab248c7e5f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:01.605950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e9ae8-17f4-4723-94ac-42ab248c7e5f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:01.606261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e9ae8-17f4-4723-94ac-42ab248c7e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:01.646785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-176e9ae8-17f4-4723-94ac-42ab248c7e5f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:01.647901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-176e9ae8-17f4-4723-94ac-42ab248c7e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:01.664382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3ec9e-f29b-475c-a70b-1e1c003d62f5 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:01.718344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42eca87-e76d-45f7-84e1-3e6911e81016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:01.719375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eca87-e76d-45f7-84e1-3e6911e81016 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:01.719659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eca87-e76d-45f7-84e1-3e6911e81016 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:01.719935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42eca87-e76d-45f7-84e1-3e6911e81016 None admin] PATH_INFO: `/v3/users/f3746a0b069c403b8e4bbd2b21fce597` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:01.721290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42eca87-e76d-45f7-84e1-3e6911e81016 None admin] RBAC: Authorizing `identity:get_user(user_id=f3746a0b069c403b8e4bbd2b21fce597)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:01.722837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42eca87-e76d-45f7-84e1-3e6911e81016 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:01.724755 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 129/259] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:51:01 2022] GET /identity/v3/users/f3746a0b069c403b8e4bbd2b21fce597 => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:01.731287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42eca87-e76d-45f7-84e1-3e6911e81016 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:01.763277 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:01.765153 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:01.814376 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 131/260] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:01.849646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42eca87-e76d-45f7-84e1-3e6911e81016 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:01.860306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e9ae8-17f4-4723-94ac-42ab248c7e5f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:01.896918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a0cc7-cdb9-4a43-bbcb-2bd80ade8a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:01.897501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a0cc7-cdb9-4a43-bbcb-2bd80ade8a9d None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:01.897784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a0cc7-cdb9-4a43-bbcb-2bd80ade8a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:01.898057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a0cc7-cdb9-4a43-bbcb-2bd80ade8a9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:01.972438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a0cc7-cdb9-4a43-bbcb-2bd80ade8a9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:01.973932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a0cc7-cdb9-4a43-bbcb-2bd80ade8a9d None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:02.002503 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:02.079377 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 130/261] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 13:51:02.084906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a0cc7-cdb9-4a43-bbcb-2bd80ade8a9d None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:02.137237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e9ae8-17f4-4723-94ac-42ab248c7e5f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:02.189552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a0cc7-cdb9-4a43-bbcb-2bd80ade8a9d None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:02.219166 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:02.230278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8359e3b-c94a-4cf8-a3c8-92a13c1d2ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:02.240968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8359e3b-c94a-4cf8-a3c8-92a13c1d2ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:02.240968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8359e3b-c94a-4cf8-a3c8-92a13c1d2ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:02.240968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8359e3b-c94a-4cf8-a3c8-92a13c1d2ed2 None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:02.240968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8359e3b-c94a-4cf8-a3c8-92a13c1d2ed2 None admin] RBAC: Authorizing `identity:get_project(project_id=2b597c406357445d8679d4b27fa90b63)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:02.240968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8359e3b-c94a-4cf8-a3c8-92a13c1d2ed2 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:02.241372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108e7ce-889d-4ad1-8306-80ab0308d67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:02.241372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108e7ce-889d-4ad1-8306-80ab0308d67f None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:02.241372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108e7ce-889d-4ad1-8306-80ab0308d67f None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:02.241372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108e7ce-889d-4ad1-8306-80ab0308d67f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:02.242133 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 131/262] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:51:02 2022] GET /identity/v3/projects/2b597c406357445d8679d4b27fa90b63 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:02.244642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8359e3b-c94a-4cf8-a3c8-92a13c1d2ed2 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:02.269005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8108e7ce-889d-4ad1-8306-80ab0308d67f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:02.282675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-8108e7ce-889d-4ad1-8306-80ab0308d67f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:51:02.282675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:02.282675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:02.282675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:02.282675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:02.282675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:02.282675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:02.282675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:02.282675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:02.282675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:02.282675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:02.282675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:02.282675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:02.282675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:02.282675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:02.282675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:02.283798 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:02.283798 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:02.283798 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:02.283798 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:02.283798 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:02.283798 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:02.283798 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:02.283798 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:02.283798 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:02.283798 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:02.283798 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:02.283798 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:02.283798 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:02.283798 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:02.283798 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:02.283798 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:02.284760 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:02.284760 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:02.284760 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:02.284760 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:02.284760 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:02.284760 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:02.284760 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:02.284760 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:02.284760 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:02.284760 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:02.284760 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:51:02.284760 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:02.284760 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 132/263] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 19 13:51:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 424 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:51:02.289579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108e7ce-889d-4ad1-8306-80ab0308d67f None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:02.356367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8359e3b-c94a-4cf8-a3c8-92a13c1d2ed2 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:02.363957 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:02.393413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9f622-34dd-407a-8757-fad7308d7112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:02.394715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9f622-34dd-407a-8757-fad7308d7112 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:02.395173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9f622-34dd-407a-8757-fad7308d7112 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:02.395597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9f622-34dd-407a-8757-fad7308d7112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:02.396589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9f622-34dd-407a-8757-fad7308d7112 None admin] RBAC: Adding query filter params (role.id=bc315edf089d43b18acf9790031f3fcb, scope.project.id=2b597c406357445d8679d4b27fa90b63, user.id=f3746a0b069c403b8e4bbd2b21fce597) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:02.397050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9f622-34dd-407a-8757-fad7308d7112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:02.398683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9f622-34dd-407a-8757-fad7308d7112 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:02.410246 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 132/264] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:51:02 2022] GET /identity/v3/role_assignments?user.id=f3746a0b069c403b8e4bbd2b21fce597&scope.project.id=2b597c406357445d8679d4b27fa90b63&role.id=bc315edf089d43b18acf9790031f3fcb => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:02.456348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108e7ce-889d-4ad1-8306-80ab0308d67f None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:02.499044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9727a-2277-45d1-8084-b0bdcdc1edfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:02.499737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9727a-2277-45d1-8084-b0bdcdc1edfa None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:02.500029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9727a-2277-45d1-8084-b0bdcdc1edfa None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:02.500311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9727a-2277-45d1-8084-b0bdcdc1edfa None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:02.501090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9727a-2277-45d1-8084-b0bdcdc1edfa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:02.501405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9727a-2277-45d1-8084-b0bdcdc1edfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:02.502826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9727a-2277-45d1-8084-b0bdcdc1edfa None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:02.513023 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 133/265] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:02.518405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9f622-34dd-407a-8757-fad7308d7112 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:02.607164 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:02.656217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9f622-34dd-407a-8757-fad7308d7112 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:02.693427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2916a-fe07-41a9-a849-0047723b6dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:02.694357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2916a-fe07-41a9-a849-0047723b6dbf None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:02.694645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2916a-fe07-41a9-a849-0047723b6dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:02.694923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2916a-fe07-41a9-a849-0047723b6dbf None admin] PATH_INFO: `/v3/users/f3746a0b069c403b8e4bbd2b21fce597` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:02.696775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2916a-fe07-41a9-a849-0047723b6dbf None admin] RBAC: Authorizing `identity:get_user(user_id=f3746a0b069c403b8e4bbd2b21fce597)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:02.698355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2916a-fe07-41a9-a849-0047723b6dbf None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:02.700367 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 133/266] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:51:02 2022] GET /identity/v3/users/f3746a0b069c403b8e4bbd2b21fce597 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:02.705578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9727a-2277-45d1-8084-b0bdcdc1edfa None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:02.832936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9727a-2277-45d1-8084-b0bdcdc1edfa None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:02.835276 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:02.875249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60ecf6-a717-42ab-95a6-51fef462e545 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:02.875865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60ecf6-a717-42ab-95a6-51fef462e545 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:02.876351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e60ecf6-a717-42ab-95a6-51fef462e545 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:02.876477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8ffe2-4cc0-4393-951d-9ac4403d000d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:02.877151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8ffe2-4cc0-4393-951d-9ac4403d000d None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:02.877439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8ffe2-4cc0-4393-951d-9ac4403d000d None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:02.877723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8ffe2-4cc0-4393-951d-9ac4403d000d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:02.879250 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 134/267] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:02.885308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e0c15-89ab-449c-8863-a63bbb7d9b4c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:02.885859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e0c15-89ab-449c-8863-a63bbb7d9b4c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:02.886395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e0c15-89ab-449c-8863-a63bbb7d9b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:02.907924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9f6e0c15-89ab-449c-8863-a63bbb7d9b4c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:02.909451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9f6e0c15-89ab-449c-8863-a63bbb7d9b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:03.010292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8ffe2-4cc0-4393-951d-9ac4403d000d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:03.012198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8ffe2-4cc0-4393-951d-9ac4403d000d None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:03.039653 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 135/268] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:03.115121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e0c15-89ab-449c-8863-a63bbb7d9b4c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:03.168815 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 134/269] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:03.174130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8ffe2-4cc0-4393-951d-9ac4403d000d None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:03.177945 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:03.230456 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:03.303177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e0c15-89ab-449c-8863-a63bbb7d9b4c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:03.324742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8ffe2-4cc0-4393-951d-9ac4403d000d None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:03.338742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617b22d-88c5-4a4c-b3a8-0279869e2983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:03.339603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617b22d-88c5-4a4c-b3a8-0279869e2983 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:03.339897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617b22d-88c5-4a4c-b3a8-0279869e2983 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:03.340182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617b22d-88c5-4a4c-b3a8-0279869e2983 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:03.350809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617b22d-88c5-4a4c-b3a8-0279869e2983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:03.359268 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-e617b22d-88c5-4a4c-b3a8-0279869e2983 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:51:03.359268 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:03.359268 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:03.359268 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:03.359268 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:03.359268 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:03.359268 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:03.359268 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:03.359268 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:03.359268 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:03.359268 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:03.359268 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:03.359268 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:03.359268 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:03.359268 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:03.359268 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:03.360152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:03.360152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:03.360152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:03.360152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:03.360152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:03.360152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:03.360152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:03.360152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:03.360152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:03.360152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:03.360152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:03.360152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:03.360152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:03.360152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:03.360152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:03.360152 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:03.360974 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:03.360974 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:03.360974 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:03.360974 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:03.360974 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:03.360974 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:03.360974 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:03.360974 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:03.360974 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:03.360974 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:03.360974 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:51:03.360974 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:03.360974 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 136/270] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:03.362849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4125272-0a3b-4eda-ac53-53619d3a6351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:03.363732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4125272-0a3b-4eda-ac53-53619d3a6351 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:03.364024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4125272-0a3b-4eda-ac53-53619d3a6351 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:03.364306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4125272-0a3b-4eda-ac53-53619d3a6351 None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:03.366647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf3d40-70ba-47b5-8338-e6fe85acff68 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:03.366882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf3d40-70ba-47b5-8338-e6fe85acff68 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:03.367165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf3d40-70ba-47b5-8338-e6fe85acff68 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:03.367508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4125272-0a3b-4eda-ac53-53619d3a6351 None admin] RBAC: Authorizing `identity:get_project(project_id=2b597c406357445d8679d4b27fa90b63)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:03.368809 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 137/271] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:03.373693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf3d40-70ba-47b5-8338-e6fe85acff68 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:03.373811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4125272-0a3b-4eda-ac53-53619d3a6351 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:03.376218 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 135/272] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:51:03 2022] GET /identity/v3/projects/2b597c406357445d8679d4b27fa90b63 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:03.377659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96f04c-3f60-41d6-9cc4-95524bd697cf None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:03.378175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96f04c-3f60-41d6-9cc4-95524bd697cf None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:03.378660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96f04c-3f60-41d6-9cc4-95524bd697cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:03.395921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8d96f04c-3f60-41d6-9cc4-95524bd697cf None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:03.397390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8d96f04c-3f60-41d6-9cc4-95524bd697cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:03.469808 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 136/273] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:03.479204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96f04c-3f60-41d6-9cc4-95524bd697cf None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:03.481928 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:03.490805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf3d40-70ba-47b5-8338-e6fe85acff68 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:03.510575 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:03.530786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698e1c7-35d3-4db4-a47e-883c79d21410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:03.531617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698e1c7-35d3-4db4-a47e-883c79d21410 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:03.532007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698e1c7-35d3-4db4-a47e-883c79d21410 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:03.532545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f698e1c7-35d3-4db4-a47e-883c79d21410 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:03.533827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698e1c7-35d3-4db4-a47e-883c79d21410 None admin] RBAC: Adding query filter params (name=member) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:03.534533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698e1c7-35d3-4db4-a47e-883c79d21410 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:03.536171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f698e1c7-35d3-4db4-a47e-883c79d21410 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:03.554289 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 138/274] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:51:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:03.555971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698e1c7-35d3-4db4-a47e-883c79d21410 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:03.631516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96f04c-3f60-41d6-9cc4-95524bd697cf None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:03.667991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b0725-f7fe-478b-8cfd-145d4b647764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:03.668647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f698e1c7-35d3-4db4-a47e-883c79d21410 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:03.668754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b0725-f7fe-478b-8cfd-145d4b647764 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:03.668931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b0725-f7fe-478b-8cfd-145d4b647764 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:03.669211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b0725-f7fe-478b-8cfd-145d4b647764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:03.670242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b0725-f7fe-478b-8cfd-145d4b647764 None admin] RBAC: Adding query filter params (role.id=b73e411ed06b463fb578c06789886960, scope.project.id=2b597c406357445d8679d4b27fa90b63, user.id=f3746a0b069c403b8e4bbd2b21fce597) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:03.670556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b0725-f7fe-478b-8cfd-145d4b647764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:03.672796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b0725-f7fe-478b-8cfd-145d4b647764 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:03.679954 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 137/275] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:51:03 2022] GET /identity/v3/role_assignments?user.id=f3746a0b069c403b8e4bbd2b21fce597&scope.project.id=2b597c406357445d8679d4b27fa90b63&role.id=b73e411ed06b463fb578c06789886960 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:03.686360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b0725-f7fe-478b-8cfd-145d4b647764 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:03.704001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45ce4b-8250-4ceb-ad91-0e8f3fed99ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:03.704793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45ce4b-8250-4ceb-ad91-0e8f3fed99ae None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:03.705080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45ce4b-8250-4ceb-ad91-0e8f3fed99ae None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:03.705404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45ce4b-8250-4ceb-ad91-0e8f3fed99ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:03.706671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45ce4b-8250-4ceb-ad91-0e8f3fed99ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:03.708148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45ce4b-8250-4ceb-ad91-0e8f3fed99ae None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:03.710234 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 139/276] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:03.711548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2896d-3ee0-4a87-9409-f39307b9286f None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:03.712558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2896d-3ee0-4a87-9409-f39307b9286f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:03.712956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada2896d-3ee0-4a87-9409-f39307b9286f None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:03.714933 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 140/277] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:03.731714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795ba07-4fb3-4afa-9e53-ad92dde0bee5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:03.732039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795ba07-4fb3-4afa-9e53-ad92dde0bee5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:03.732290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795ba07-4fb3-4afa-9e53-ad92dde0bee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:03.755416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e795ba07-4fb3-4afa-9e53-ad92dde0bee5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:03.758845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e795ba07-4fb3-4afa-9e53-ad92dde0bee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:03.775384 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:03.808840 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:03.818152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b0725-f7fe-478b-8cfd-145d4b647764 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:03.846122 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 141/278] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:03.846122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795ba07-4fb3-4afa-9e53-ad92dde0bee5 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:03.866372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5716a1-5c65-4cac-85f8-d97f0be1adaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:03.867463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5716a1-5c65-4cac-85f8-d97f0be1adaf None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:03.867761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5716a1-5c65-4cac-85f8-d97f0be1adaf None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:03.868072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5716a1-5c65-4cac-85f8-d97f0be1adaf None admin] PATH_INFO: `/v3/users/be0c5c8ea2d14f40ba8d675c01f49752` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:03.888182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5716a1-5c65-4cac-85f8-d97f0be1adaf None admin] RBAC: Authorizing `identity:get_user(user_id=be0c5c8ea2d14f40ba8d675c01f49752)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:03.889602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5716a1-5c65-4cac-85f8-d97f0be1adaf None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:03.891388 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 138/279] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:51:03 2022] GET /identity/v3/users/be0c5c8ea2d14f40ba8d675c01f49752 => generated 293 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:03.896824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5716a1-5c65-4cac-85f8-d97f0be1adaf None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:03.964504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795ba07-4fb3-4afa-9e53-ad92dde0bee5 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:04.010411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c734b-c0d0-4090-bf85-0c29a00e23c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:04.011188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c734b-c0d0-4090-bf85-0c29a00e23c9 None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:04.011568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c734b-c0d0-4090-bf85-0c29a00e23c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:04.011919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c734b-c0d0-4090-bf85-0c29a00e23c9 None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:04.012706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c734b-c0d0-4090-bf85-0c29a00e23c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:04.014280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c734b-c0d0-4090-bf85-0c29a00e23c9 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:04.017267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5716a1-5c65-4cac-85f8-d97f0be1adaf None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:04.042392 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:04.052726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e59cf-2240-40f4-bc59-76016bc8e141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:04.053545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e59cf-2240-40f4-bc59-76016bc8e141 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:04.053817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e59cf-2240-40f4-bc59-76016bc8e141 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:04.054116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e59cf-2240-40f4-bc59-76016bc8e141 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:04.064967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05e59cf-2240-40f4-bc59-76016bc8e141 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:04.073290 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-b05e59cf-2240-40f4-bc59-76016bc8e141 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 13:51:04.073290 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:04.073290 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:04.073290 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:04.073290 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:04.073290 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:04.073290 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:04.073290 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:04.073290 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:04.073290 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:04.073290 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:04.073290 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:04.073290 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:04.073290 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:04.073290 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:04.073290 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:04.074464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:04.074464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:04.074464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:04.074464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:04.074464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:04.074464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:04.074464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:04.074464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:04.074464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:04.074464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:04.074464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:04.074464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:04.074464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:04.074464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:04.074464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:04.074464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:04.075306 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:04.075306 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:04.075306 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:04.075306 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:04.075306 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:04.075306 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:04.075306 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:04.075306 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:04.075306 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:04.075306 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:04.075306 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 13:51:04.075306 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:04.075306 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 139/280] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:04.076428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e59cf-2240-40f4-bc59-76016bc8e141 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:04.089908 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 142/281] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 19 13:51:03 2022] POST /identity/v3/users => generated 293 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:51:04.099655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c734b-c0d0-4090-bf85-0c29a00e23c9 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:04.133424 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:04.226453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e59cf-2240-40f4-bc59-76016bc8e141 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:04.229498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c734b-c0d0-4090-bf85-0c29a00e23c9 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:04.272728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81835265-be9b-4cf5-87b7-66f7430b1a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:04.273729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81835265-be9b-4cf5-87b7-66f7430b1a03 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:04.274295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81835265-be9b-4cf5-87b7-66f7430b1a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:04.274736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81835265-be9b-4cf5-87b7-66f7430b1a03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:04.276933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81835265-be9b-4cf5-87b7-66f7430b1a03 None admin] RBAC: Adding query filter params (role.id=e17d8526e56c4d319080a377398b9c74, user.id=be0c5c8ea2d14f40ba8d675c01f49752, scope.system=all) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:04.276933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81835265-be9b-4cf5-87b7-66f7430b1a03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:04.277884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81835265-be9b-4cf5-87b7-66f7430b1a03 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:04.281150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6808243-4242-444a-8ea9-e5276bc7b85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:04.281815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6808243-4242-444a-8ea9-e5276bc7b85e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:04.282115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6808243-4242-444a-8ea9-e5276bc7b85e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:04.282398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6808243-4242-444a-8ea9-e5276bc7b85e None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:04.283157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6808243-4242-444a-8ea9-e5276bc7b85e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:04.283463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6808243-4242-444a-8ea9-e5276bc7b85e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:04.283695 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 140/282] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Jul 19 13:51:04 2022] GET /identity/v3/role_assignments?user.id=be0c5c8ea2d14f40ba8d675c01f49752&scope.system=all&role.id=e17d8526e56c4d319080a377398b9c74 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:04.291782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6808243-4242-444a-8ea9-e5276bc7b85e None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:04.304114 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 143/283] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:51:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:04.310714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81835265-be9b-4cf5-87b7-66f7430b1a03 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:04.373070 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:04.434776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81835265-be9b-4cf5-87b7-66f7430b1a03 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:04.475275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e499b-6d56-4d57-af07-5209ffd6ef7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:04.476158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e499b-6d56-4d57-af07-5209ffd6ef7c None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:04.476440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e499b-6d56-4d57-af07-5209ffd6ef7c None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:04.476762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e499b-6d56-4d57-af07-5209ffd6ef7c None admin] PATH_INFO: `/v3/users/05451eb45ab94b93a3367009c99fa47a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:04.478239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e499b-6d56-4d57-af07-5209ffd6ef7c None admin] RBAC: Authorizing `identity:get_user(user_id=05451eb45ab94b93a3367009c99fa47a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:04.479684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e499b-6d56-4d57-af07-5209ffd6ef7c None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:04.481487 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 141/284] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:51:04 2022] GET /identity/v3/users/05451eb45ab94b93a3367009c99fa47a => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:04.486936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6808243-4242-444a-8ea9-e5276bc7b85e None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:04.500247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e937868-2e55-4d18-bb23-7c04290d3780 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:04.500531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e937868-2e55-4d18-bb23-7c04290d3780 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:04.500804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e937868-2e55-4d18-bb23-7c04290d3780 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:04.502454 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 142/285] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:04.507545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0be5d9-6da4-4bf7-b40f-4795cbf70e11 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:04.507835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0be5d9-6da4-4bf7-b40f-4795cbf70e11 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:04.508112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0be5d9-6da4-4bf7-b40f-4795cbf70e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:04.528770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-de0be5d9-6da4-4bf7-b40f-4795cbf70e11 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:04.529941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-de0be5d9-6da4-4bf7-b40f-4795cbf70e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:04.605603 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 143/286] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:51:04.612316 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:04.620195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6808243-4242-444a-8ea9-e5276bc7b85e None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:04.629438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0be5d9-6da4-4bf7-b40f-4795cbf70e11 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:04.668848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81876dab-24c9-418c-9bd4-68a46902cbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:04.670344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81876dab-24c9-418c-9bd4-68a46902cbdc None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:04.671810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81876dab-24c9-418c-9bd4-68a46902cbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:04.672282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81876dab-24c9-418c-9bd4-68a46902cbdc None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:04.673723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81876dab-24c9-418c-9bd4-68a46902cbdc None admin] RBAC: Authorizing `identity:get_project(project_id=2b597c406357445d8679d4b27fa90b63)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:04.675386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81876dab-24c9-418c-9bd4-68a46902cbdc None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:04.678528 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 144/287] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:51:04 2022] GET /identity/v3/projects/2b597c406357445d8679d4b27fa90b63 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:04.686346 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:04.687705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81876dab-24c9-418c-9bd4-68a46902cbdc None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:04.802008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0be5d9-6da4-4bf7-b40f-4795cbf70e11 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:04.841826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e1461-cfaf-46a5-bf75-e22b068164ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:04.844076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e1461-cfaf-46a5-bf75-e22b068164ef None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:04.844571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e1461-cfaf-46a5-bf75-e22b068164ef None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:04.845050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e1461-cfaf-46a5-bf75-e22b068164ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:04.858504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e1461-cfaf-46a5-bf75-e22b068164ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:04.866970 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-ed8e1461-cfaf-46a5-bf75-e22b068164ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:51:04.866970 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:04.866970 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:04.866970 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:04.866970 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:04.866970 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:04.866970 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:04.866970 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:04.866970 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:04.866970 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:04.866970 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:04.866970 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:04.866970 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:04.866970 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:04.866970 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:04.866970 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:04.867916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:04.867916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:04.867916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:04.867916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:04.867916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:04.867916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:04.867916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:04.867916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:04.867916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:04.867916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:04.867916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:04.867916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:04.867916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:04.867916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:04.867916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:04.867916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:04.868795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:04.868795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:04.868795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:04.868795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:04.868795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:04.868795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:04.868795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:04.868795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:04.868795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:04.868795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:04.868795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:51:04.868795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:04.871392 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 144/288] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:04.877262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e1461-cfaf-46a5-bf75-e22b068164ef None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:04.910054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81876dab-24c9-418c-9bd4-68a46902cbdc None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:04.950412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524f000-12ef-420e-9a82-35bf4e5a010f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:04.952013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524f000-12ef-420e-9a82-35bf4e5a010f None admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:04.952504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524f000-12ef-420e-9a82-35bf4e5a010f None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:04.952982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8524f000-12ef-420e-9a82-35bf4e5a010f None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63/users/05451eb45ab94b93a3367009c99fa47a/roles/5361e6fea90e41aa8954e83ea952bc2b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:04.955801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524f000-12ef-420e-9a82-35bf4e5a010f None admin] RBAC: Authorizing `identity:create_grant(project_id=2b597c406357445d8679d4b27fa90b63, user_id=05451eb45ab94b93a3367009c99fa47a, role_id=5361e6fea90e41aa8954e83ea952bc2b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:04.957578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8524f000-12ef-420e-9a82-35bf4e5a010f None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:05.034874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e1461-cfaf-46a5-bf75-e22b068164ef None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:05.043784 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:05.045856 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 145/289] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:51:04 2022] PUT /identity/v3/projects/2b597c406357445d8679d4b27fa90b63/users/05451eb45ab94b93a3367009c99fa47a/roles/5361e6fea90e41aa8954e83ea952bc2b => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:51:05.076048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a44e09-8ea7-4aa1-8158-59992cdb8eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:05.076693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a44e09-8ea7-4aa1-8158-59992cdb8eef None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:05.076988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a44e09-8ea7-4aa1-8158-59992cdb8eef None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:05.077276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a44e09-8ea7-4aa1-8158-59992cdb8eef None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:05.078092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a44e09-8ea7-4aa1-8158-59992cdb8eef None admin] RBAC: Adding query filter params (name=member) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:05.078428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a44e09-8ea7-4aa1-8158-59992cdb8eef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:05.079869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a44e09-8ea7-4aa1-8158-59992cdb8eef None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:05.090294 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 145/290] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:51:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:05.099275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524f000-12ef-420e-9a82-35bf4e5a010f None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:05.133928 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:05.247284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8524f000-12ef-420e-9a82-35bf4e5a010f None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:05.301982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeed275-2b1f-48c3-b940-13e47a1e68c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:05.302884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeed275-2b1f-48c3-b940-13e47a1e68c4 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:05.303164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeed275-2b1f-48c3-b940-13e47a1e68c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:05.303435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeed275-2b1f-48c3-b940-13e47a1e68c4 None admin] PATH_INFO: `/v3/users/875036a344f34aa3a6d1aad21120e880` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:05.306932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeed275-2b1f-48c3-b940-13e47a1e68c4 None admin] RBAC: Authorizing `identity:get_user(user_id=875036a344f34aa3a6d1aad21120e880)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:05.308619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeed275-2b1f-48c3-b940-13e47a1e68c4 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:05.310909 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 146/291] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:51:05 2022] GET /identity/v3/users/875036a344f34aa3a6d1aad21120e880 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:05.316279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a44e09-8ea7-4aa1-8158-59992cdb8eef None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:05.420788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a44e09-8ea7-4aa1-8158-59992cdb8eef None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:05.456299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2d5b3-5d72-46bf-88cc-5473d3ce4f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:05.457372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2d5b3-5d72-46bf-88cc-5473d3ce4f0b None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:05.457878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2d5b3-5d72-46bf-88cc-5473d3ce4f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:05.458397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf2d5b3-5d72-46bf-88cc-5473d3ce4f0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:05.501470 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:05.549575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2d5b3-5d72-46bf-88cc-5473d3ce4f0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:05.551150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf2d5b3-5d72-46bf-88cc-5473d3ce4f0b None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:05.668374 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 146/292] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:05.674304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeed275-2b1f-48c3-b940-13e47a1e68c4 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:05.779181 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:05.787869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeed275-2b1f-48c3-b940-13e47a1e68c4 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:05.833910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4953e2d8-53c3-41bd-ad07-01aa45cf0ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:05.834805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953e2d8-53c3-41bd-ad07-01aa45cf0ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:05.835089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953e2d8-53c3-41bd-ad07-01aa45cf0ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:05.835365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4953e2d8-53c3-41bd-ad07-01aa45cf0ff6 None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:05.838397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953e2d8-53c3-41bd-ad07-01aa45cf0ff6 None admin] RBAC: Authorizing `identity:get_project(project_id=2b597c406357445d8679d4b27fa90b63)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:05.839853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4953e2d8-53c3-41bd-ad07-01aa45cf0ff6 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:05.841951 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 147/293] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:51:05 2022] GET /identity/v3/projects/2b597c406357445d8679d4b27fa90b63 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:05.847909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2d5b3-5d72-46bf-88cc-5473d3ce4f0b None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:05.941786 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:05.975515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf2d5b3-5d72-46bf-88cc-5473d3ce4f0b None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:06.010489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17588c5a-9c49-41a3-b43e-0abdd367af39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:06.011158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17588c5a-9c49-41a3-b43e-0abdd367af39 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:06.011446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17588c5a-9c49-41a3-b43e-0abdd367af39 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:06.011728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17588c5a-9c49-41a3-b43e-0abdd367af39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:06.012572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17588c5a-9c49-41a3-b43e-0abdd367af39 None admin] RBAC: Adding query filter params (role.id=e17d8526e56c4d319080a377398b9c74, scope.project.id=2b597c406357445d8679d4b27fa90b63, user.id=875036a344f34aa3a6d1aad21120e880) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:06.012890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17588c5a-9c49-41a3-b43e-0abdd367af39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:06.014345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17588c5a-9c49-41a3-b43e-0abdd367af39 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:06.020744 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 147/294] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:51:05 2022] GET /identity/v3/role_assignments?user.id=875036a344f34aa3a6d1aad21120e880&scope.project.id=2b597c406357445d8679d4b27fa90b63&role.id=e17d8526e56c4d319080a377398b9c74 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:06.715490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da95384-1143-460d-a087-db4ecabcc5a8 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:06.716492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da95384-1143-460d-a087-db4ecabcc5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:06.716981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da95384-1143-460d-a087-db4ecabcc5a8 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:06.718912 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 148/295] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:06.723977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822e6dd-4d16-4b0d-9555-fd0d94a2ea00 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:06.724772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822e6dd-4d16-4b0d-9555-fd0d94a2ea00 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:06.725247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4822e6dd-4d16-4b0d-9555-fd0d94a2ea00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:06.743834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4822e6dd-4d16-4b0d-9555-fd0d94a2ea00 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:06.745478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4822e6dd-4d16-4b0d-9555-fd0d94a2ea00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:06.807768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba80e7c-ede3-40f4-a1d8-7dfc32108b10 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:06.808396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba80e7c-ede3-40f4-a1d8-7dfc32108b10 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:06.808904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba80e7c-ede3-40f4-a1d8-7dfc32108b10 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:06.810786 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 149/296] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:06.816199 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 148/297] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:51:06.816514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f48c5f-73c5-45f8-b38d-13de11a221c7 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:06.817004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f48c5f-73c5-45f8-b38d-13de11a221c7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:06.817480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f48c5f-73c5-45f8-b38d-13de11a221c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:06.838797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-36f48c5f-73c5-45f8-b38d-13de11a221c7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:06.840387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-36f48c5f-73c5-45f8-b38d-13de11a221c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:06.840775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822e6dd-4d16-4b0d-9555-fd0d94a2ea00 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:06.903550 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:06.912896 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 150/298] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:51:06.915955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5422e-453a-440c-89b1-5f2357a41406 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:06.916522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5422e-453a-440c-89b1-5f2357a41406 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:06.922222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5422e-453a-440c-89b1-5f2357a41406 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:06.922585 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 151/299] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:06.923834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762da380-873f-44aa-9c4f-1890a0c00ec2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:06.924126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762da380-873f-44aa-9c4f-1890a0c00ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:06.924412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762da380-873f-44aa-9c4f-1890a0c00ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:06.943519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-762da380-873f-44aa-9c4f-1890a0c00ec2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:06.944704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-762da380-873f-44aa-9c4f-1890a0c00ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:06.952740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4822e6dd-4d16-4b0d-9555-fd0d94a2ea00 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:06.988266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c301f-4f18-4094-b2c1-fe469abbf666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:06.988994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c301f-4f18-4094-b2c1-fe469abbf666 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:06.989283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c301f-4f18-4094-b2c1-fe469abbf666 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:06.989901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c301f-4f18-4094-b2c1-fe469abbf666 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:07.001204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c301f-4f18-4094-b2c1-fe469abbf666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:07.009182 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-e77c301f-4f18-4094-b2c1-fe469abbf666 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 13:51:07.009182 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:07.009182 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:07.009182 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:07.009182 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:07.009182 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:07.009182 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:07.009182 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:07.009182 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:07.009182 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:07.009182 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:07.009182 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:07.009182 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:07.009182 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:07.009182 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:07.009182 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:07.010056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:07.010056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:07.010056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:07.010056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:07.010056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:07.010056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:07.010056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:07.010056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:07.010056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:07.010056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:07.010056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:07.010056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:07.010056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:07.010056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:07.010056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:07.010056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:07.015966 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:07.015966 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:07.015966 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:07.015966 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:07.015966 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:07.015966 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:07.015966 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:07.015966 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:07.015966 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:07.015966 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:07.015966 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 13:51:07.015966 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:07.015966 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 149/300] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:51:07.015966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c301f-4f18-4094-b2c1-fe469abbf666 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:07.024249 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 152/301] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:07.025177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762da380-873f-44aa-9c4f-1890a0c00ec2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:07.048675 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:07.152550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762da380-873f-44aa-9c4f-1890a0c00ec2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:07.153932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c301f-4f18-4094-b2c1-fe469abbf666 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:07.176677 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:07.189458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a5e20-9a2f-400d-88fd-f6c26c5e1396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:07.190292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a5e20-9a2f-400d-88fd-f6c26c5e1396 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:07.190534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898037e6-920b-43bd-a658-b52ea22a0c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:07.192032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a5e20-9a2f-400d-88fd-f6c26c5e1396 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:07.192032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28a5e20-9a2f-400d-88fd-f6c26c5e1396 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:07.192178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898037e6-920b-43bd-a658-b52ea22a0c62 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:07.192178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898037e6-920b-43bd-a658-b52ea22a0c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:07.192178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898037e6-920b-43bd-a658-b52ea22a0c62 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:07.192366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a5e20-9a2f-400d-88fd-f6c26c5e1396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:07.192634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898037e6-920b-43bd-a658-b52ea22a0c62 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:07.192941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898037e6-920b-43bd-a658-b52ea22a0c62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:07.193600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28a5e20-9a2f-400d-88fd-f6c26c5e1396 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:07.194340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898037e6-920b-43bd-a658-b52ea22a0c62 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:07.195488 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 150/302] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:07.196121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a5e20-9a2f-400d-88fd-f6c26c5e1396 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:07.215567 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 153/303] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:51:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:07.215567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898037e6-920b-43bd-a658-b52ea22a0c62 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:07.306509 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:07.307252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28a5e20-9a2f-400d-88fd-f6c26c5e1396 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:07.326870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898037e6-920b-43bd-a658-b52ea22a0c62 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:07.341699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b90b1-405e-4197-af20-da79a607a337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:07.342532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b90b1-405e-4197-af20-da79a607a337 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:07.342823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b90b1-405e-4197-af20-da79a607a337 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:07.343108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b90b1-405e-4197-af20-da79a607a337 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:07.353317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b90b1-405e-4197-af20-da79a607a337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:07.361036 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-335b90b1-405e-4197-af20-da79a607a337 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:51:07.361036 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:07.361036 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:07.361036 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:07.361036 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:07.361036 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:07.361036 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:07.361036 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:07.361036 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:07.361036 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:07.361036 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:07.361036 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:07.361036 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:07.361036 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:07.361036 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:07.361036 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:07.361916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:07.361916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:07.361916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:07.361916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:07.361916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:07.361916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:07.361916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:07.361916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:07.361916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:07.361916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:07.361916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:07.361916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:07.361916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:07.361916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:07.361916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:07.361916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:07.363223 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:07.363223 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:07.363223 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:07.363223 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:07.363223 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:07.363223 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:07.363223 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:07.363223 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:07.363223 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:07.363223 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:07.363223 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:51:07.363223 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:07.363223 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 151/304] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:07.363223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b90b1-405e-4197-af20-da79a607a337 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:07.367656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aa792-58de-4d08-b65d-0e344d8d932c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:07.369073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa792-58de-4d08-b65d-0e344d8d932c None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:07.369543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa792-58de-4d08-b65d-0e344d8d932c None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:07.369849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa792-58de-4d08-b65d-0e344d8d932c None admin] PATH_INFO: `/v3/groups` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:07.370642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939aa792-58de-4d08-b65d-0e344d8d932c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:07.372079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939aa792-58de-4d08-b65d-0e344d8d932c None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:07.418071 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:07.443374 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 154/305] 10.222.0.43 () {60 vars in 1134 bytes} [Tue Jul 19 13:51:07 2022] POST /identity/v3/groups => generated 229 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:51:07.444392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aa792-58de-4d08-b65d-0e344d8d932c None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:07.471744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b90b1-405e-4197-af20-da79a607a337 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:07.511072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165529e-a162-4f2e-9f84-8ee642ac93f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:07.512253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165529e-a162-4f2e-9f84-8ee642ac93f9 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:07.512534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165529e-a162-4f2e-9f84-8ee642ac93f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:07.512809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165529e-a162-4f2e-9f84-8ee642ac93f9 None admin] PATH_INFO: `/v3/users/f0168cf42ca6485c99612f1a298da7ae` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:07.529274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165529e-a162-4f2e-9f84-8ee642ac93f9 None admin] RBAC: Authorizing `identity:get_user(user_id=f0168cf42ca6485c99612f1a298da7ae)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:07.530826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165529e-a162-4f2e-9f84-8ee642ac93f9 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:07.537309 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 152/306] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:51:07 2022] GET /identity/v3/users/f0168cf42ca6485c99612f1a298da7ae => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:07.537309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43ee81-6798-4317-8d60-7ba5f71d6e1d None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:07.537309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43ee81-6798-4317-8d60-7ba5f71d6e1d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:07.537309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43ee81-6798-4317-8d60-7ba5f71d6e1d None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:07.537309 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 153/307] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:07.539345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43ee81-6798-4317-8d60-7ba5f71d6e1d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:07.591988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aa792-58de-4d08-b65d-0e344d8d932c None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:07.630470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad91bb9-b197-41c9-8a30-e8661ab18b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:07.631151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad91bb9-b197-41c9-8a30-e8661ab18b84 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:07.631441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad91bb9-b197-41c9-8a30-e8661ab18b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:07.631809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad91bb9-b197-41c9-8a30-e8661ab18b84 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:07.632482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad91bb9-b197-41c9-8a30-e8661ab18b84 None admin] RBAC: Adding query filter params (name=member) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:07.632792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad91bb9-b197-41c9-8a30-e8661ab18b84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:07.634765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad91bb9-b197-41c9-8a30-e8661ab18b84 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:07.646961 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 155/308] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:51:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:07.648040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8ef0f-548f-49f0-814b-ab6cc1f506a2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:07.648346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8ef0f-548f-49f0-814b-ab6cc1f506a2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:07.648632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8ef0f-548f-49f0-814b-ab6cc1f506a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:07.655910 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:07.662914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43ee81-6798-4317-8d60-7ba5f71d6e1d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:07.666718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8fa8ef0f-548f-49f0-814b-ab6cc1f506a2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:07.667923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8fa8ef0f-548f-49f0-814b-ab6cc1f506a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:07.673123 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:07.699865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121c639-2200-4dcb-9f41-1bafb1e6f2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:07.700561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121c639-2200-4dcb-9f41-1bafb1e6f2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:07.700850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121c639-2200-4dcb-9f41-1bafb1e6f2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:07.701132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7121c639-2200-4dcb-9f41-1bafb1e6f2b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:07.702005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121c639-2200-4dcb-9f41-1bafb1e6f2b8 None admin] RBAC: Adding query filter params (role.id=5361e6fea90e41aa8954e83ea952bc2b, user.id=f0168cf42ca6485c99612f1a298da7ae, scope.system=all) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:07.704843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121c639-2200-4dcb-9f41-1bafb1e6f2b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:07.704843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7121c639-2200-4dcb-9f41-1bafb1e6f2b8 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:07.710028 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 154/309] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Jul 19 13:51:07 2022] GET /identity/v3/role_assignments?user.id=f0168cf42ca6485c99612f1a298da7ae&scope.system=all&role.id=5361e6fea90e41aa8954e83ea952bc2b => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:07.711105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121c639-2200-4dcb-9f41-1bafb1e6f2b8 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:07.745413 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 156/310] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:07.768365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8ef0f-548f-49f0-814b-ab6cc1f506a2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:07.864877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7121c639-2200-4dcb-9f41-1bafb1e6f2b8 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:07.897544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8ef0f-548f-49f0-814b-ab6cc1f506a2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:07.913764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce7dd2-e68f-454a-8251-ad0f026c2086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:07.915781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce7dd2-e68f-454a-8251-ad0f026c2086 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:07.916171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce7dd2-e68f-454a-8251-ad0f026c2086 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:07.916570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce7dd2-e68f-454a-8251-ad0f026c2086 None admin] PATH_INFO: `/v3/users/be0c5c8ea2d14f40ba8d675c01f49752` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:07.918611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce7dd2-e68f-454a-8251-ad0f026c2086 None admin] RBAC: Authorizing `identity:get_user(user_id=be0c5c8ea2d14f40ba8d675c01f49752)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:07.920199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce7dd2-e68f-454a-8251-ad0f026c2086 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:07.922569 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 155/311] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:51:07 2022] GET /identity/v3/users/be0c5c8ea2d14f40ba8d675c01f49752 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:07.928570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce7dd2-e68f-454a-8251-ad0f026c2086 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:07.937058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4c8bf-985c-4a45-aaaa-d3aba9d6ec83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:07.938074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4c8bf-985c-4a45-aaaa-d3aba9d6ec83 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:07.938530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4c8bf-985c-4a45-aaaa-d3aba9d6ec83 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:07.938966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4c8bf-985c-4a45-aaaa-d3aba9d6ec83 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:07.941304 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:07.952350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4c8bf-985c-4a45-aaaa-d3aba9d6ec83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:07.961181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-7cd4c8bf-985c-4a45-aaaa-d3aba9d6ec83 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 13:51:07.961181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:07.961181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:07.961181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:07.961181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:07.961181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:07.961181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:07.961181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:07.961181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:07.961181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:07.961181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:07.961181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:07.961181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:07.961181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:07.961181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:07.961181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:07.962796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:07.962796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:07.962796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:07.962796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:07.962796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:07.962796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:07.962796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:07.962796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:07.962796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:07.962796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:07.962796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:07.962796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:07.962796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:07.962796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:07.962796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:07.962796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:07.963775 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:07.963775 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:07.963775 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:07.963775 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:07.963775 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:07.963775 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:07.963775 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:07.963775 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:07.963775 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:07.963775 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:07.963775 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 13:51:07.963775 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:07.966171 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 157/312] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:51:07.973109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4c8bf-985c-4a45-aaaa-d3aba9d6ec83 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:07.984859 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:08.070337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce7dd2-e68f-454a-8251-ad0f026c2086 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:08.108806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a247f0-2ecf-457d-bfa3-40a57e811d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:08.110032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a247f0-2ecf-457d-bfa3-40a57e811d41 None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:08.110552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a247f0-2ecf-457d-bfa3-40a57e811d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:08.111015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a247f0-2ecf-457d-bfa3-40a57e811d41 None admin] PATH_INFO: `/v3/system/users/be0c5c8ea2d14f40ba8d675c01f49752/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:08.111969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4c8bf-985c-4a45-aaaa-d3aba9d6ec83 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:08.112873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a247f0-2ecf-457d-bfa3-40a57e811d41 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=be0c5c8ea2d14f40ba8d675c01f49752, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:08.114560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a247f0-2ecf-457d-bfa3-40a57e811d41 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:08.148505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf75c81-a4a2-4c92-90f4-4dd933f129f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:08.149606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf75c81-a4a2-4c92-90f4-4dd933f129f1 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:08.149897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf75c81-a4a2-4c92-90f4-4dd933f129f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:08.150766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf75c81-a4a2-4c92-90f4-4dd933f129f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:08.151308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf75c81-a4a2-4c92-90f4-4dd933f129f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:08.151608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf75c81-a4a2-4c92-90f4-4dd933f129f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:08.153040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf75c81-a4a2-4c92-90f4-4dd933f129f1 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:08.162254 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 158/313] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:51:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:08.168289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf75c81-a4a2-4c92-90f4-4dd933f129f1 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:08.209820 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 156/314] 10.222.0.43 () {58 vars in 1334 bytes} [Tue Jul 19 13:51:07 2022] PUT /identity/v3/system/users/be0c5c8ea2d14f40ba8d675c01f49752/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 13:51:08.249033 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:08.305375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf75c81-a4a2-4c92-90f4-4dd933f129f1 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:08.344743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b91d6e-a644-4a63-b1cf-ec443bc6768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:08.346024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b91d6e-a644-4a63-b1cf-ec443bc6768a None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:08.346534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b91d6e-a644-4a63-b1cf-ec443bc6768a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:08.347024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b91d6e-a644-4a63-b1cf-ec443bc6768a None admin] PATH_INFO: `/v3/users/05451eb45ab94b93a3367009c99fa47a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:08.348496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b91d6e-a644-4a63-b1cf-ec443bc6768a None admin] RBAC: Authorizing `identity:get_user(user_id=05451eb45ab94b93a3367009c99fa47a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:08.350180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b91d6e-a644-4a63-b1cf-ec443bc6768a None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:08.352932 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 159/315] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:51:08 2022] GET /identity/v3/users/05451eb45ab94b93a3367009c99fa47a => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:08.358737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a247f0-2ecf-457d-bfa3-40a57e811d41 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:08.463308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a247f0-2ecf-457d-bfa3-40a57e811d41 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:08.465655 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:08.497947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17362148-7848-4204-93cc-e2ef7041ec4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:08.498636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17362148-7848-4204-93cc-e2ef7041ec4c None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:08.498916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17362148-7848-4204-93cc-e2ef7041ec4c None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:08.499190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17362148-7848-4204-93cc-e2ef7041ec4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:08.569898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17362148-7848-4204-93cc-e2ef7041ec4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:08.572140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17362148-7848-4204-93cc-e2ef7041ec4c None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:08.677225 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 157/316] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:08.682616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b91d6e-a644-4a63-b1cf-ec443bc6768a None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:08.794902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b91d6e-a644-4a63-b1cf-ec443bc6768a None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:08.819976 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:08.831444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca65794-d8b7-4393-b0e9-e51a8c3631ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:08.832329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca65794-d8b7-4393-b0e9-e51a8c3631ff None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:08.832617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca65794-d8b7-4393-b0e9-e51a8c3631ff None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:08.838259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca65794-d8b7-4393-b0e9-e51a8c3631ff None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:08.838259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca65794-d8b7-4393-b0e9-e51a8c3631ff None admin] RBAC: Authorizing `identity:get_project(project_id=2b597c406357445d8679d4b27fa90b63)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:08.838259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca65794-d8b7-4393-b0e9-e51a8c3631ff None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:08.838259 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 160/317] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:51:08 2022] GET /identity/v3/projects/2b597c406357445d8679d4b27fa90b63 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:08.847205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17362148-7848-4204-93cc-e2ef7041ec4c None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:08.850866 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:08.953170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17362148-7848-4204-93cc-e2ef7041ec4c None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:08.986384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e29361-4a98-48d3-9710-eb5ba033f35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:08.987047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e29361-4a98-48d3-9710-eb5ba033f35a None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:08.987331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e29361-4a98-48d3-9710-eb5ba033f35a None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:08.987612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e29361-4a98-48d3-9710-eb5ba033f35a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:08.988455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e29361-4a98-48d3-9710-eb5ba033f35a None admin] RBAC: Adding query filter params (role.id=5361e6fea90e41aa8954e83ea952bc2b, scope.project.id=2b597c406357445d8679d4b27fa90b63, user.id=05451eb45ab94b93a3367009c99fa47a) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:08.988769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e29361-4a98-48d3-9710-eb5ba033f35a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:08.990222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e29361-4a98-48d3-9710-eb5ba033f35a None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:08.997362 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 158/318] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:51:08 2022] GET /identity/v3/role_assignments?user.id=05451eb45ab94b93a3367009c99fa47a&scope.project.id=2b597c406357445d8679d4b27fa90b63&role.id=5361e6fea90e41aa8954e83ea952bc2b => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:09.624373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2026e3-bed3-444e-b61c-2ca1620b7dba None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:09.624989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2026e3-bed3-444e-b61c-2ca1620b7dba None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:09.625480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2026e3-bed3-444e-b61c-2ca1620b7dba None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:09.627372 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 161/319] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:09.632103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1993284-e834-4996-8bc4-8121e1abd88b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:09.632397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1993284-e834-4996-8bc4-8121e1abd88b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:09.632676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1993284-e834-4996-8bc4-8121e1abd88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:09.650935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d1993284-e834-4996-8bc4-8121e1abd88b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:09.652117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d1993284-e834-4996-8bc4-8121e1abd88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:09.716729 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:09.722287 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 159/320] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:09.745550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2026e3-bed3-444e-b61c-2ca1620b7dba None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:09.830551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8952b-3f2d-4452-9a7d-3f66d20c21e4 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:09.830869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8952b-3f2d-4452-9a7d-3f66d20c21e4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:09.831156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c8952b-3f2d-4452-9a7d-3f66d20c21e4 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:09.832661 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 160/321] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:09.837783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a254a34-8b75-4a80-8c36-c8284d2de723 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:09.838168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a254a34-8b75-4a80-8c36-c8284d2de723 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:09.838456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a254a34-8b75-4a80-8c36-c8284d2de723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:09.854361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2026e3-bed3-444e-b61c-2ca1620b7dba None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:09.855210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6a254a34-8b75-4a80-8c36-c8284d2de723 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:09.856395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6a254a34-8b75-4a80-8c36-c8284d2de723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:09.891488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8217a4-bb0e-49b2-841a-c970801dfa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:09.892206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8217a4-bb0e-49b2-841a-c970801dfa6b None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:09.892494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8217a4-bb0e-49b2-841a-c970801dfa6b None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:09.892771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8217a4-bb0e-49b2-841a-c970801dfa6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:09.893934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8217a4-bb0e-49b2-841a-c970801dfa6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:09.895429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8217a4-bb0e-49b2-841a-c970801dfa6b None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:09.897056 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 162/322] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:09.902857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8217a4-bb0e-49b2-841a-c970801dfa6b None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:09.926603 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 161/323] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:51:09.950110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a254a34-8b75-4a80-8c36-c8284d2de723 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:09.972294 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:10.019293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8217a4-bb0e-49b2-841a-c970801dfa6b None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:10.054611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4cd4e-6298-4fe4-947e-b61a2559ef1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:10.055284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4cd4e-6298-4fe4-947e-b61a2559ef1f None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:10.055659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4cd4e-6298-4fe4-947e-b61a2559ef1f None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:10.055937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4cd4e-6298-4fe4-947e-b61a2559ef1f None admin] PATH_INFO: `/v3/groups` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:10.056633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4cd4e-6298-4fe4-947e-b61a2559ef1f None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:10.058083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4cd4e-6298-4fe4-947e-b61a2559ef1f None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:10.058195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a254a34-8b75-4a80-8c36-c8284d2de723 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:10.087614 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:10.095487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fda6e-d6a1-4205-804a-090677509f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:10.096311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fda6e-d6a1-4205-804a-090677509f6e None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:10.096598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fda6e-d6a1-4205-804a-090677509f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:10.096876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fda6e-d6a1-4205-804a-090677509f6e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:10.107102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fda6e-d6a1-4205-804a-090677509f6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:10.114745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-348fda6e-d6a1-4205-804a-090677509f6e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 13:51:10.114745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:10.114745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:10.114745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:10.114745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:10.114745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:10.114745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:10.114745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:10.114745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:10.114745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:10.114745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:10.114745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:10.114745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:10.114745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:10.114745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:10.114745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:10.115803 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:10.115803 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:10.115803 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:10.115803 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:10.115803 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:10.115803 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:10.115803 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:10.115803 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:10.115803 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:10.115803 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:10.115803 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:10.115803 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:10.115803 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:10.115803 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:10.115803 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:10.115803 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:10.116738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:10.116738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:10.116738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:10.116738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:10.116738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:10.116738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:10.116738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:10.116738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:10.116738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:10.116738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:10.116738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 13:51:10.116738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:10.116738 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 162/324] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:51:10.122141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fda6e-d6a1-4205-804a-090677509f6e None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:10.141118 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 163/325] 10.222.0.43 () {60 vars in 1134 bytes} [Tue Jul 19 13:51:09 2022] POST /identity/v3/groups => generated 226 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 13:51:10.242464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fda6e-d6a1-4205-804a-090677509f6e None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:10.284749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9313d88-4383-4eb0-9bd2-9a733ebb8a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:10.285671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9313d88-4383-4eb0-9bd2-9a733ebb8a3e None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:10.286156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9313d88-4383-4eb0-9bd2-9a733ebb8a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:10.286605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9313d88-4383-4eb0-9bd2-9a733ebb8a3e None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:10.287543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9313d88-4383-4eb0-9bd2-9a733ebb8a3e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:10.288001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9313d88-4383-4eb0-9bd2-9a733ebb8a3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:10.289409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9313d88-4383-4eb0-9bd2-9a733ebb8a3e None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:10.299301 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 163/326] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:51:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:10.305250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4cd4e-6298-4fe4-947e-b61a2559ef1f None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:10.347915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cadcc5-52e4-4ba3-b405-f4db31897075 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:10.348208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cadcc5-52e4-4ba3-b405-f4db31897075 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:10.348488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cadcc5-52e4-4ba3-b405-f4db31897075 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:10.349846 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 164/327] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:51:10.355495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69760ed2-b131-4d92-8578-a8afe2ad1473 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:10.355783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69760ed2-b131-4d92-8578-a8afe2ad1473 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:10.356065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69760ed2-b131-4d92-8578-a8afe2ad1473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:10.372833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-69760ed2-b131-4d92-8578-a8afe2ad1473 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:10.374021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-69760ed2-b131-4d92-8578-a8afe2ad1473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:10.447561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4cd4e-6298-4fe4-947e-b61a2559ef1f None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:10.469683 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:10.487854 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:10.510382 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 165/328] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:51:10.526129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3b9dc-a86f-4f2b-8eb3-f8b2f594c431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:10.526129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3b9dc-a86f-4f2b-8eb3-f8b2f594c431 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:10.526129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3b9dc-a86f-4f2b-8eb3-f8b2f594c431 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:10.526129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae3b9dc-a86f-4f2b-8eb3-f8b2f594c431 None admin] PATH_INFO: `/v3/users/f0168cf42ca6485c99612f1a298da7ae` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:10.526550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3b9dc-a86f-4f2b-8eb3-f8b2f594c431 None admin] RBAC: Authorizing `identity:get_user(user_id=f0168cf42ca6485c99612f1a298da7ae)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:10.526550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae3b9dc-a86f-4f2b-8eb3-f8b2f594c431 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:10.526550 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 164/329] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:51:10 2022] GET /identity/v3/users/f0168cf42ca6485c99612f1a298da7ae => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:10.531438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69760ed2-b131-4d92-8578-a8afe2ad1473 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:10.543597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3b9dc-a86f-4f2b-8eb3-f8b2f594c431 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:10.674819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69760ed2-b131-4d92-8578-a8afe2ad1473 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:10.716810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae3b9dc-a86f-4f2b-8eb3-f8b2f594c431 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:10.744966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31125d88-8006-4465-98e6-bbc1228b2c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:10.747190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31125d88-8006-4465-98e6-bbc1228b2c01 None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:10.747745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31125d88-8006-4465-98e6-bbc1228b2c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:10.747745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31125d88-8006-4465-98e6-bbc1228b2c01 None admin] PATH_INFO: `/v3/system/users/f0168cf42ca6485c99612f1a298da7ae/roles/5361e6fea90e41aa8954e83ea952bc2b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:10.750516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31125d88-8006-4465-98e6-bbc1228b2c01 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f0168cf42ca6485c99612f1a298da7ae, role_id=5361e6fea90e41aa8954e83ea952bc2b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:10.751755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31125d88-8006-4465-98e6-bbc1228b2c01 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:10.776750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577e8d5-9e64-4b76-bff3-ce68cefa1e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:10.777701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577e8d5-9e64-4b76-bff3-ce68cefa1e3e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:10.778258 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577e8d5-9e64-4b76-bff3-ce68cefa1e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:10.778635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577e8d5-9e64-4b76-bff3-ce68cefa1e3e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:10.793644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577e8d5-9e64-4b76-bff3-ce68cefa1e3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:10.804095 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-8577e8d5-9e64-4b76-bff3-ce68cefa1e3e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:51:10.804095 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:10.804095 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:10.804095 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:10.804095 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:10.804095 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:10.804095 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:10.804095 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:10.804095 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:10.804095 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:10.804095 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:10.804095 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:10.804095 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:10.804095 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:10.804095 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:10.804095 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:10.805192 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:10.805192 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:10.805192 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:10.805192 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:10.805192 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:10.805192 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:10.805192 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:10.805192 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:10.805192 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:10.805192 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:10.805192 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:10.805192 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:10.805192 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:10.805192 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:10.805192 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:10.805192 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:10.806881 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:10.806881 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:10.806881 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:10.806881 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:10.806881 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:10.806881 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:10.806881 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:10.806881 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:10.806881 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:10.806881 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:10.806881 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:51:10.806881 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:10.809148 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 165/330] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:10.816983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577e8d5-9e64-4b76-bff3-ce68cefa1e3e None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:10.827872 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 166/331] 10.222.0.43 () {58 vars in 1334 bytes} [Tue Jul 19 13:51:10 2022] PUT /identity/v3/system/users/f0168cf42ca6485c99612f1a298da7ae/roles/5361e6fea90e41aa8954e83ea952bc2b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 13:51:10.886693 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:10.945835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577e8d5-9e64-4b76-bff3-ce68cefa1e3e None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:10.994268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a1ba7-524c-4869-b919-91aa912297b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:10.994944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a1ba7-524c-4869-b919-91aa912297b7 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:10.995281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a1ba7-524c-4869-b919-91aa912297b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:10.995530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09a1ba7-524c-4869-b919-91aa912297b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:10.996267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a1ba7-524c-4869-b919-91aa912297b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:10.996574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a1ba7-524c-4869-b919-91aa912297b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:10.997958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09a1ba7-524c-4869-b919-91aa912297b7 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:11.008882 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 166/332] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:51:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:11.014467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31125d88-8006-4465-98e6-bbc1228b2c01 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:11.069463 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:11.132097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31125d88-8006-4465-98e6-bbc1228b2c01 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:11.169914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddef6ae-242c-4207-873c-e91a5a2ddcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:11.170874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddef6ae-242c-4207-873c-e91a5a2ddcda None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:11.171150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddef6ae-242c-4207-873c-e91a5a2ddcda None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:11.171430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddef6ae-242c-4207-873c-e91a5a2ddcda None admin] PATH_INFO: `/v3/users/be0c5c8ea2d14f40ba8d675c01f49752` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:11.172660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddef6ae-242c-4207-873c-e91a5a2ddcda None admin] RBAC: Authorizing `identity:get_user(user_id=be0c5c8ea2d14f40ba8d675c01f49752)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:11.174088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddef6ae-242c-4207-873c-e91a5a2ddcda None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:11.176095 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 167/333] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:51:11 2022] GET /identity/v3/users/be0c5c8ea2d14f40ba8d675c01f49752 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:11.182460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a1ba7-524c-4869-b919-91aa912297b7 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:11.332405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09a1ba7-524c-4869-b919-91aa912297b7 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:11.344696 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:11.377173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0887b5-c162-45f4-bf27-b310dd0e2d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:11.377839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0887b5-c162-45f4-bf27-b310dd0e2d87 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:11.382547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0887b5-c162-45f4-bf27-b310dd0e2d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:11.382547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0887b5-c162-45f4-bf27-b310dd0e2d87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:11.382547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0887b5-c162-45f4-bf27-b310dd0e2d87 None admin] RBAC: Adding query filter params (role.id=e17d8526e56c4d319080a377398b9c74, user.id=be0c5c8ea2d14f40ba8d675c01f49752, scope.system=all) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:11.382547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0887b5-c162-45f4-bf27-b310dd0e2d87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:11.382547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0887b5-c162-45f4-bf27-b310dd0e2d87 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:11.397929 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 167/334] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Jul 19 13:51:11 2022] GET /identity/v3/role_assignments?user.id=be0c5c8ea2d14f40ba8d675c01f49752&scope.system=all&role.id=e17d8526e56c4d319080a377398b9c74 => generated 510 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:12.645888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c81a05-dc08-43b6-98fe-6ee85fdeb9ce None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:12.646428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c81a05-dc08-43b6-98fe-6ee85fdeb9ce None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:12.646428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c81a05-dc08-43b6-98fe-6ee85fdeb9ce None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:12.647858 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 168/335] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:12.654623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68693b2b-2a2e-47eb-94e4-8911482c6fed None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:12.655131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68693b2b-2a2e-47eb-94e4-8911482c6fed None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:12.655205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68693b2b-2a2e-47eb-94e4-8911482c6fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:12.676158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-68693b2b-2a2e-47eb-94e4-8911482c6fed None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:12.677974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-68693b2b-2a2e-47eb-94e4-8911482c6fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:12.759136 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 168/336] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:12.802813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c81a05-dc08-43b6-98fe-6ee85fdeb9ce None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:12.935367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c81a05-dc08-43b6-98fe-6ee85fdeb9ce None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:12.938091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e433c-920d-4daa-9255-c45e44833996 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:12.938409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e433c-920d-4daa-9255-c45e44833996 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:12.938691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e433c-920d-4daa-9255-c45e44833996 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:12.940349 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 169/337] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:12.946962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fec7b-fd96-488e-9fb0-92c0609cea54 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:12.947259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fec7b-fd96-488e-9fb0-92c0609cea54 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:12.947536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fec7b-fd96-488e-9fb0-92c0609cea54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:12.954460 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:12.980250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b41fec7b-fd96-488e-9fb0-92c0609cea54 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:12.981918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b41fec7b-fd96-488e-9fb0-92c0609cea54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:12.986828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49236d-a5bc-4321-9aea-fb742b0a54a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:12.987663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49236d-a5bc-4321-9aea-fb742b0a54a0 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:12.987953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49236d-a5bc-4321-9aea-fb742b0a54a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:12.988238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49236d-a5bc-4321-9aea-fb742b0a54a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:13.018567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49236d-a5bc-4321-9aea-fb742b0a54a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:13.022940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-2f49236d-a5bc-4321-9aea-fb742b0a54a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:51:13.022940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:13.022940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:13.022940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:13.022940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:13.022940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:13.022940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:13.022940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:13.022940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:13.022940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:13.022940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:13.022940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:13.022940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:13.022940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:13.022940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:13.022940 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:13.023832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:13.023832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:13.023832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:13.023832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:13.023832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:13.023832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:13.023832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:13.023832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:13.023832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:13.023832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:13.023832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:13.023832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:13.023832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:13.023832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:13.023832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:13.023832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:13.025285 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:13.025285 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:13.025285 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:13.025285 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:13.025285 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:13.025285 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:13.025285 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:13.025285 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:13.025285 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:13.025285 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:13.025285 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:51:13.025285 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:13.025285 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 169/338] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:13.039109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49236d-a5bc-4321-9aea-fb742b0a54a0 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:13.089247 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 170/339] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:51:13.130665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fec7b-fd96-488e-9fb0-92c0609cea54 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:13.186553 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:13.263458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49236d-a5bc-4321-9aea-fb742b0a54a0 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:13.326437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fec7b-fd96-488e-9fb0-92c0609cea54 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:13.335830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081747a-ab67-4f00-96c1-8593527eef46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:13.336558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081747a-ab67-4f00-96c1-8593527eef46 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:13.336839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081747a-ab67-4f00-96c1-8593527eef46 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:13.337136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081747a-ab67-4f00-96c1-8593527eef46 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:13.337917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081747a-ab67-4f00-96c1-8593527eef46 None admin] RBAC: Adding query filter params (name=member) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:13.338253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081747a-ab67-4f00-96c1-8593527eef46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:13.339644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081747a-ab67-4f00-96c1-8593527eef46 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:13.355967 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 170/340] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:51:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:13.363366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081747a-ab67-4f00-96c1-8593527eef46 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:13.404772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fe34e-1a85-42bb-aa3e-803b99ba2ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:13.405590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fe34e-1a85-42bb-aa3e-803b99ba2ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:13.405872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fe34e-1a85-42bb-aa3e-803b99ba2ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:13.406165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fe34e-1a85-42bb-aa3e-803b99ba2ba1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:13.423827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728fe34e-1a85-42bb-aa3e-803b99ba2ba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:13.428536 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:13.442982 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-728fe34e-1a85-42bb-aa3e-803b99ba2ba1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:51:13.442982 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:13.442982 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:13.442982 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:13.442982 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:13.442982 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:13.442982 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:13.442982 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:13.442982 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:13.442982 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:13.442982 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:13.442982 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:13.442982 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:13.442982 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:13.442982 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:13.442982 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:13.443898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:13.443898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:13.443898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:13.443898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:13.443898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:13.443898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:13.443898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:13.443898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:13.443898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:13.443898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:13.443898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:13.443898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:13.443898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:13.443898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:13.443898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:13.443898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:13.444725 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:13.444725 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:13.444725 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:13.444725 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:13.444725 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:13.444725 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:13.444725 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:13.444725 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:13.444725 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:13.444725 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:13.444725 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:51:13.444725 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:13.447193 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 171/341] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 19 13:51:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:51:13.451977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fe34e-1a85-42bb-aa3e-803b99ba2ba1 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:13.525408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081747a-ab67-4f00-96c1-8593527eef46 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:13.556532 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:13.569290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49af248-dc85-4c37-b9e9-4a5719392c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:13.569952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49af248-dc85-4c37-b9e9-4a5719392c1d None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:13.570271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49af248-dc85-4c37-b9e9-4a5719392c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:13.578335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49af248-dc85-4c37-b9e9-4a5719392c1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:13.593879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fe34e-1a85-42bb-aa3e-803b99ba2ba1 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:13.651177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49af248-dc85-4c37-b9e9-4a5719392c1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:13.652723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49af248-dc85-4c37-b9e9-4a5719392c1d None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:13.694334 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:13.723429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d18f6d-884f-400c-84b3-410059819c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:13.724116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d18f6d-884f-400c-84b3-410059819c16 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:13.724404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d18f6d-884f-400c-84b3-410059819c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:13.724676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d18f6d-884f-400c-84b3-410059819c16 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:13.725437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d18f6d-884f-400c-84b3-410059819c16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:13.725740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d18f6d-884f-400c-84b3-410059819c16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:13.727681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d18f6d-884f-400c-84b3-410059819c16 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:13.748212 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 172/342] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:13.749588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53eb97-00e7-4c45-a77f-fe9aa5c7a9e7 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:13.749874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53eb97-00e7-4c45-a77f-fe9aa5c7a9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:13.750168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e53eb97-00e7-4c45-a77f-fe9aa5c7a9e7 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:13.751400 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 173/343] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:13.756055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53eb97-00e7-4c45-a77f-fe9aa5c7a9e7 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:13.774203 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 171/344] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:13.776483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91d4d6-7a0a-4759-a84c-6d97e9582c40 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:13.776774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91d4d6-7a0a-4759-a84c-6d97e9582c40 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:13.777107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91d4d6-7a0a-4759-a84c-6d97e9582c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:13.795656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9c91d4d6-7a0a-4759-a84c-6d97e9582c40 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:13.797214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9c91d4d6-7a0a-4759-a84c-6d97e9582c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:13.875304 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 172/345] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:13.876307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91d4d6-7a0a-4759-a84c-6d97e9582c40 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:13.969481 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:13.993567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91d4d6-7a0a-4759-a84c-6d97e9582c40 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:14.035244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3119c-d598-45fd-a638-59072c990384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:14.036466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3119c-d598-45fd-a638-59072c990384 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:14.036762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3119c-d598-45fd-a638-59072c990384 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:14.037047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e3119c-d598-45fd-a638-59072c990384 None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:14.038295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3119c-d598-45fd-a638-59072c990384 None admin] RBAC: Authorizing `identity:get_project(project_id=488e2680f33948a99baf67e759f3e3fe)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:14.041177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e3119c-d598-45fd-a638-59072c990384 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:14.042953 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 173/346] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:51:13 2022] GET /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:14.046914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3119c-d598-45fd-a638-59072c990384 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:14.110320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e53eb97-00e7-4c45-a77f-fe9aa5c7a9e7 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:14.149967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26fe49-bb4b-45a1-b8dc-fad5c1d21336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:14.150947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26fe49-bb4b-45a1-b8dc-fad5c1d21336 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:14.151230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26fe49-bb4b-45a1-b8dc-fad5c1d21336 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:14.151568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26fe49-bb4b-45a1-b8dc-fad5c1d21336 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:14.172753 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:14.188364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e3119c-d598-45fd-a638-59072c990384 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:14.239578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26fe49-bb4b-45a1-b8dc-fad5c1d21336 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:14.239777 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:14.241768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26fe49-bb4b-45a1-b8dc-fad5c1d21336 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:14.246763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4ae62-6e96-4351-93f7-65ba7601501a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:14.247573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4ae62-6e96-4351-93f7-65ba7601501a None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:14.247858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4ae62-6e96-4351-93f7-65ba7601501a None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:14.248135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c4ae62-6e96-4351-93f7-65ba7601501a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:14.270356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c4ae62-6e96-4351-93f7-65ba7601501a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:14.286632 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-39c4ae62-6e96-4351-93f7-65ba7601501a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 13:51:14.286632 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:14.286632 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:14.286632 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:14.286632 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:14.286632 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:14.286632 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:14.286632 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:14.286632 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:14.286632 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:14.286632 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:14.286632 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:14.286632 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:14.286632 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:14.286632 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:14.286632 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:14.287618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:14.287618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:14.287618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:14.287618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:14.287618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:14.287618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:14.287618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:14.287618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:14.287618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:14.287618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:14.287618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:14.287618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:14.287618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:14.287618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:14.287618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:14.287618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:14.288847 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:14.288847 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:14.288847 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:14.288847 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:14.288847 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:14.288847 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:14.288847 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:14.288847 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:14.288847 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:14.288847 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:14.288847 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 13:51:14.288847 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:14.288847 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 174/347] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:14.288847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4ae62-6e96-4351-93f7-65ba7601501a None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:14.383463 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 174/348] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:14.385377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557db684-6088-4a28-be21-2c6fd163c387 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:14.385864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557db684-6088-4a28-be21-2c6fd163c387 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:14.386389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557db684-6088-4a28-be21-2c6fd163c387 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:14.388250 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 175/349] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:14.389187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557db684-6088-4a28-be21-2c6fd163c387 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:14.415230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c4ae62-6e96-4351-93f7-65ba7601501a None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:14.447237 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:14.456416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee894dde-5a9d-4de3-a281-b9f5060257dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:14.465274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee894dde-5a9d-4de3-a281-b9f5060257dc None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:14.465274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee894dde-5a9d-4de3-a281-b9f5060257dc None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:14.465274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee894dde-5a9d-4de3-a281-b9f5060257dc None admin] PATH_INFO: `/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:14.465274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee894dde-5a9d-4de3-a281-b9f5060257dc None admin] RBAC: Authorizing `identity:get_group(group_id=df068e9a5b4a4a06bef2f78bf02f55aa)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:14.465873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee894dde-5a9d-4de3-a281-b9f5060257dc None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:14.472511 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 175/350] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 19 13:51:14 2022] GET /identity/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:14.472511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee894dde-5a9d-4de3-a281-b9f5060257dc None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:14.506481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557db684-6088-4a28-be21-2c6fd163c387 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:14.533971 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:14.543662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade20525-93b0-4409-be65-01d01bdfafc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:14.544540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade20525-93b0-4409-be65-01d01bdfafc2 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:14.545466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade20525-93b0-4409-be65-01d01bdfafc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:14.545466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade20525-93b0-4409-be65-01d01bdfafc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:14.546275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade20525-93b0-4409-be65-01d01bdfafc2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:14.546725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade20525-93b0-4409-be65-01d01bdfafc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:14.548253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade20525-93b0-4409-be65-01d01bdfafc2 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:14.557719 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 176/351] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:51:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:14.559429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed99e5-2b39-4d42-a938-d03ed69d91c0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:14.559898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed99e5-2b39-4d42-a938-d03ed69d91c0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:14.560350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bed99e5-2b39-4d42-a938-d03ed69d91c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:14.578437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3bed99e5-2b39-4d42-a938-d03ed69d91c0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:14.579977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3bed99e5-2b39-4d42-a938-d03ed69d91c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:14.584956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee894dde-5a9d-4de3-a281-b9f5060257dc None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:14.627283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1d9eb-8c0b-4356-a5e6-bc43a26cc437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:14.628154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1d9eb-8c0b-4356-a5e6-bc43a26cc437 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:14.628436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1d9eb-8c0b-4356-a5e6-bc43a26cc437 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:14.628718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d1d9eb-8c0b-4356-a5e6-bc43a26cc437 None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:14.630061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1d9eb-8c0b-4356-a5e6-bc43a26cc437 None admin] RBAC: Authorizing `identity:get_project(project_id=488e2680f33948a99baf67e759f3e3fe)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:14.631547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d1d9eb-8c0b-4356-a5e6-bc43a26cc437 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:14.633772 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 176/352] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:51:14 2022] GET /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:14.634777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1d9eb-8c0b-4356-a5e6-bc43a26cc437 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:14.654752 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 177/353] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:14.656133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed99e5-2b39-4d42-a938-d03ed69d91c0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:14.703615 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:14.746139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d1d9eb-8c0b-4356-a5e6-bc43a26cc437 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:14.765704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bed99e5-2b39-4d42-a938-d03ed69d91c0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:14.771696 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:14.787286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a6d80-fa51-4b46-a37e-e2cd75d35345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:14.787950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a6d80-fa51-4b46-a37e-e2cd75d35345 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:14.788233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a6d80-fa51-4b46-a37e-e2cd75d35345 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:14.788511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a6d80-fa51-4b46-a37e-e2cd75d35345 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:14.789350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a6d80-fa51-4b46-a37e-e2cd75d35345 None admin] RBAC: Adding query filter params (group.id=df068e9a5b4a4a06bef2f78bf02f55aa, role.id=e17d8526e56c4d319080a377398b9c74, scope.project.id=488e2680f33948a99baf67e759f3e3fe) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:14.789728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a6d80-fa51-4b46-a37e-e2cd75d35345 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:14.791409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a6d80-fa51-4b46-a37e-e2cd75d35345 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:14.799700 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 177/354] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jul 19 13:51:14 2022] GET /identity/v3/role_assignments?group.id=df068e9a5b4a4a06bef2f78bf02f55aa&scope.project.id=488e2680f33948a99baf67e759f3e3fe&role.id=e17d8526e56c4d319080a377398b9c74 => generated 260 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:14.801488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a6d80-fa51-4b46-a37e-e2cd75d35345 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:14.811440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976e9ad-1f47-4c18-addd-af319280c562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:14.812951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976e9ad-1f47-4c18-addd-af319280c562 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:14.813445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976e9ad-1f47-4c18-addd-af319280c562 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:14.813902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976e9ad-1f47-4c18-addd-af319280c562 None admin] PATH_INFO: `/v3/users/f0168cf42ca6485c99612f1a298da7ae` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:14.815557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976e9ad-1f47-4c18-addd-af319280c562 None admin] RBAC: Authorizing `identity:get_user(user_id=f0168cf42ca6485c99612f1a298da7ae)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:14.817415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976e9ad-1f47-4c18-addd-af319280c562 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:14.823688 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 178/355] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:51:14 2022] GET /identity/v3/users/f0168cf42ca6485c99612f1a298da7ae => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:14.823688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976e9ad-1f47-4c18-addd-af319280c562 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:14.959928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976e9ad-1f47-4c18-addd-af319280c562 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:14.965529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a6d80-fa51-4b46-a37e-e2cd75d35345 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:14.980070 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:15.011097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906cf0ae-7e90-46e6-9ecd-5800d1bcda4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:15.012105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a2bad-9c99-473f-88af-b15912425164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:15.012549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cf0ae-7e90-46e6-9ecd-5800d1bcda4d None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:15.013031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a2bad-9c99-473f-88af-b15912425164 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:15.013146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cf0ae-7e90-46e6-9ecd-5800d1bcda4d None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:15.013412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a2bad-9c99-473f-88af-b15912425164 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:15.013725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cf0ae-7e90-46e6-9ecd-5800d1bcda4d None admin] PATH_INFO: `/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:15.013833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a2bad-9c99-473f-88af-b15912425164 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:15.015819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906cf0ae-7e90-46e6-9ecd-5800d1bcda4d None admin] RBAC: Authorizing `identity:get_group(group_id=df068e9a5b4a4a06bef2f78bf02f55aa)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:15.018252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906cf0ae-7e90-46e6-9ecd-5800d1bcda4d None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:15.020073 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 178/356] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 19 13:51:14 2022] GET /identity/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:15.021714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a639fad-a19f-4598-a47c-fee5a3f0f8dd None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:15.022247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a639fad-a19f-4598-a47c-fee5a3f0f8dd None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:15.022725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a639fad-a19f-4598-a47c-fee5a3f0f8dd None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:15.025049 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 179/357] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:15.026423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a639fad-a19f-4598-a47c-fee5a3f0f8dd None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:15.033750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a2bad-9c99-473f-88af-b15912425164 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:15.043981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-bd4a2bad-9c99-473f-88af-b15912425164 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:51:15.043981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:15.043981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:15.043981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:15.043981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:15.043981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:15.043981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:15.043981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:15.043981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:15.043981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:15.043981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:15.043981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:15.043981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:15.043981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:15.043981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:15.043981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:15.044894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:15.044894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:15.044894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:15.044894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:15.044894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:15.044894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:15.044894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:15.044894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:15.044894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:15.044894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:15.044894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:15.044894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:15.044894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:15.044894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:15.044894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:15.044894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:15.046303 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:15.046303 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:15.046303 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:15.046303 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:15.046303 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:15.046303 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:15.046303 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:15.046303 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:15.046303 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:15.046303 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:15.046303 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:51:15.046303 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:15.046303 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 179/358] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:15.047073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a2bad-9c99-473f-88af-b15912425164 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:15.159656 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:15.220180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a2bad-9c99-473f-88af-b15912425164 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:15.225932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a639fad-a19f-4598-a47c-fee5a3f0f8dd None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:15.259796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda7a66-1a5c-46ec-957d-aa7177bc77b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:15.260574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda7a66-1a5c-46ec-957d-aa7177bc77b6 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:15.260820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda7a66-1a5c-46ec-957d-aa7177bc77b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:15.261013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda7a66-1a5c-46ec-957d-aa7177bc77b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:15.261924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda7a66-1a5c-46ec-957d-aa7177bc77b6 None admin] RBAC: Adding query filter params (group.id=df068e9a5b4a4a06bef2f78bf02f55aa, role.id=b73e411ed06b463fb578c06789886960, scope.project.id=488e2680f33948a99baf67e759f3e3fe) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:15.262204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda7a66-1a5c-46ec-957d-aa7177bc77b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:15.263653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda7a66-1a5c-46ec-957d-aa7177bc77b6 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:15.278030 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 180/359] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jul 19 13:51:15 2022] GET /identity/v3/role_assignments?group.id=df068e9a5b4a4a06bef2f78bf02f55aa&scope.project.id=488e2680f33948a99baf67e759f3e3fe&role.id=b73e411ed06b463fb578c06789886960 => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:15.278030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a98bb-c586-4a59-8f5c-619c96b1cd82 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:15.278030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a98bb-c586-4a59-8f5c-619c96b1cd82 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:15.278030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a98bb-c586-4a59-8f5c-619c96b1cd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:15.282004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb6042-f37a-4989-a40d-466432309559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:15.282956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb6042-f37a-4989-a40d-466432309559 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:15.283454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb6042-f37a-4989-a40d-466432309559 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:15.283938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb6042-f37a-4989-a40d-466432309559 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:15.284985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb6042-f37a-4989-a40d-466432309559 None admin] RBAC: Adding query filter params (role.id=5361e6fea90e41aa8954e83ea952bc2b, user.id=f0168cf42ca6485c99612f1a298da7ae, scope.system=all) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:15.285542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb6042-f37a-4989-a40d-466432309559 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:15.287209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb6042-f37a-4989-a40d-466432309559 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:15.294203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b64a98bb-c586-4a59-8f5c-619c96b1cd82 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:15.294203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b64a98bb-c586-4a59-8f5c-619c96b1cd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:15.308115 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 180/360] 10.222.0.43 () {56 vars in 1308 bytes} [Tue Jul 19 13:51:15 2022] GET /identity/v3/role_assignments?user.id=f0168cf42ca6485c99612f1a298da7ae&scope.system=all&role.id=5361e6fea90e41aa8954e83ea952bc2b => generated 510 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:15.309347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb6042-f37a-4989-a40d-466432309559 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:15.364035 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:15.447656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb6042-f37a-4989-a40d-466432309559 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:15.463976 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:15.465943 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 181/361] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:15.467171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b570bff-a41c-4c22-ace2-b6cdb93ab703 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:15.467472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b570bff-a41c-4c22-ace2-b6cdb93ab703 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:15.467753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b570bff-a41c-4c22-ace2-b6cdb93ab703 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:15.469331 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 182/362] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:15.474882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675bd5a-750a-4deb-aeb2-9f23de0e99ad None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:15.478789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675bd5a-750a-4deb-aeb2-9f23de0e99ad None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:15.478789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675bd5a-750a-4deb-aeb2-9f23de0e99ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:15.495728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd460b27-1185-4b14-9501-69a8d98bff75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:15.496824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd460b27-1185-4b14-9501-69a8d98bff75 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:15.497306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd460b27-1185-4b14-9501-69a8d98bff75 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:15.497798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd460b27-1185-4b14-9501-69a8d98bff75 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:15.498809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd460b27-1185-4b14-9501-69a8d98bff75 None admin] RBAC: Adding query filter params (name=member) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:15.499329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd460b27-1185-4b14-9501-69a8d98bff75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:15.500961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd460b27-1185-4b14-9501-69a8d98bff75 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:15.514486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f675bd5a-750a-4deb-aeb2-9f23de0e99ad None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:15.517538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f675bd5a-750a-4deb-aeb2-9f23de0e99ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:15.522421 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 181/363] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:51:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:15.523366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd460b27-1185-4b14-9501-69a8d98bff75 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:15.623029 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 183/364] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:51:15.624022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675bd5a-750a-4deb-aeb2-9f23de0e99ad None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:15.664025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd460b27-1185-4b14-9501-69a8d98bff75 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:15.716729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed97bb-3854-4f0c-aa06-13b30c91537b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:15.717950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed97bb-3854-4f0c-aa06-13b30c91537b None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:15.718474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed97bb-3854-4f0c-aa06-13b30c91537b None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:15.718942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed97bb-3854-4f0c-aa06-13b30c91537b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:15.746364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ed97bb-3854-4f0c-aa06-13b30c91537b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:15.754606 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-a8ed97bb-3854-4f0c-aa06-13b30c91537b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:51:15.754606 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:15.754606 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:15.754606 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:15.754606 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:15.754606 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:15.754606 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:15.754606 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:15.754606 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:15.754606 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:15.754606 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:15.754606 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:15.754606 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:15.754606 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:15.754606 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:15.754606 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:15.755511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:15.755511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:15.755511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:15.755511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:15.755511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:15.755511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:15.755511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:15.755511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:15.755511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:15.755511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:15.755511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:15.755511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:15.755511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:15.755511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:15.755511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:15.755511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:15.756313 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:15.756313 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:15.756313 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:15.756313 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:15.756313 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:15.756313 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:15.756313 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:15.756313 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:15.756313 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:15.756313 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:15.756313 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:51:15.756313 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:15.756313 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 182/365] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 19 13:51:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:15.756998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed97bb-3854-4f0c-aa06-13b30c91537b None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:15.779417 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:15.788535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675bd5a-750a-4deb-aeb2-9f23de0e99ad None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:15.813819 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:15.845034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75029c55-c035-4c66-90a2-51f866861a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:15.846215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75029c55-c035-4c66-90a2-51f866861a4f None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:15.846727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75029c55-c035-4c66-90a2-51f866861a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:15.847198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75029c55-c035-4c66-90a2-51f866861a4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:15.905286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed97bb-3854-4f0c-aa06-13b30c91537b None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:15.936226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75029c55-c035-4c66-90a2-51f866861a4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:15.938019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75029c55-c035-4c66-90a2-51f866861a4f None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:15.952255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a52a4b-16b5-4df6-8ba0-3c240d4dc242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:15.953789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a52a4b-16b5-4df6-8ba0-3c240d4dc242 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:15.954454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a52a4b-16b5-4df6-8ba0-3c240d4dc242 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:15.955021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a52a4b-16b5-4df6-8ba0-3c240d4dc242 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:15.970227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a52a4b-16b5-4df6-8ba0-3c240d4dc242 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:15.981422 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-81a52a4b-16b5-4df6-8ba0-3c240d4dc242 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:51:15.981422 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:15.981422 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:15.981422 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:15.981422 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:15.981422 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:15.981422 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:15.981422 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:15.981422 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:15.981422 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:15.981422 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:15.981422 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:15.981422 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:15.981422 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:15.981422 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:15.981422 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:15.982366 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:15.982366 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:15.982366 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:15.982366 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:15.982366 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:15.982366 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:15.982366 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:15.982366 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:15.982366 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:15.982366 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:15.982366 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:15.982366 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:15.982366 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:15.982366 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:15.982366 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:15.982366 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:15.983168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:15.983168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:15.983168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:15.983168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:15.983168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:15.983168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:15.983168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:15.983168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:15.983168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:15.983168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:15.983168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:51:15.983168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:15.985142 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 183/366] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:51:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:15.985142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a52a4b-16b5-4df6-8ba0-3c240d4dc242 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:16.059799 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:16.068222 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 184/367] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:16.068944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75029c55-c035-4c66-90a2-51f866861a4f None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:16.114634 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:16.123367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a52a4b-16b5-4df6-8ba0-3c240d4dc242 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:16.169277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78f105-1cc2-4df7-97fa-9a7e6a591402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:16.170608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78f105-1cc2-4df7-97fa-9a7e6a591402 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:16.172443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78f105-1cc2-4df7-97fa-9a7e6a591402 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:16.172443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff78f105-1cc2-4df7-97fa-9a7e6a591402 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:16.173165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78f105-1cc2-4df7-97fa-9a7e6a591402 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:16.173472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78f105-1cc2-4df7-97fa-9a7e6a591402 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:16.175686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff78f105-1cc2-4df7-97fa-9a7e6a591402 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:16.189401 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 184/368] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:16.190712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78f105-1cc2-4df7-97fa-9a7e6a591402 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:16.214744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75029c55-c035-4c66-90a2-51f866861a4f None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:16.272399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ff7ec-5886-4080-9270-10e611d09aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:16.273731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ff7ec-5886-4080-9270-10e611d09aee None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:16.274998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ff7ec-5886-4080-9270-10e611d09aee None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:16.275478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ff7ec-5886-4080-9270-10e611d09aee None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:16.276876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ff7ec-5886-4080-9270-10e611d09aee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:16.277615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ff7ec-5886-4080-9270-10e611d09aee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:16.279252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ff7ec-5886-4080-9270-10e611d09aee None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:16.295022 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 185/369] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:16.296246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ff7ec-5886-4080-9270-10e611d09aee None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:16.332108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff78f105-1cc2-4df7-97fa-9a7e6a591402 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:16.376543 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:16.377643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7de1b2-1766-4607-8446-5e0d482b01ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:16.379875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7de1b2-1766-4607-8446-5e0d482b01ce None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:16.380125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7de1b2-1766-4607-8446-5e0d482b01ce None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:16.380399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7de1b2-1766-4607-8446-5e0d482b01ce None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:16.382265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7de1b2-1766-4607-8446-5e0d482b01ce None admin] RBAC: Authorizing `identity:get_project(project_id=2b597c406357445d8679d4b27fa90b63)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:16.387222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7de1b2-1766-4607-8446-5e0d482b01ce None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:16.387222 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 185/370] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:51:16 2022] GET /identity/v3/projects/2b597c406357445d8679d4b27fa90b63 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:16.387222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7de1b2-1766-4607-8446-5e0d482b01ce None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:16.415817 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:16.433423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ff7ec-5886-4080-9270-10e611d09aee None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:16.473991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b74b2-541c-46f1-a5f7-b51e332e6009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:16.475029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b74b2-541c-46f1-a5f7-b51e332e6009 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:16.475532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b74b2-541c-46f1-a5f7-b51e332e6009 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:16.475947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b74b2-541c-46f1-a5f7-b51e332e6009 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:16.494339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7de1b2-1766-4607-8446-5e0d482b01ce None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:16.529785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f5425-61a6-4805-8ecb-396f88b366f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:16.530262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f5425-61a6-4805-8ecb-396f88b366f9 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:16.530546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f5425-61a6-4805-8ecb-396f88b366f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:16.530825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f5425-61a6-4805-8ecb-396f88b366f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:16.554414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b74b2-541c-46f1-a5f7-b51e332e6009 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:16.557357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b74b2-541c-46f1-a5f7-b51e332e6009 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:16.603159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f5425-61a6-4805-8ecb-396f88b366f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:16.604358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f5425-61a6-4805-8ecb-396f88b366f9 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:16.623676 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:16.630953 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:16.675427 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 186/371] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:16.676688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b74b2-541c-46f1-a5f7-b51e332e6009 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:16.713523 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 186/372] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:16.715214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f5425-61a6-4805-8ecb-396f88b366f9 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:16.797693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b74b2-541c-46f1-a5f7-b51e332e6009 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:16.818485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f5425-61a6-4805-8ecb-396f88b366f9 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:16.839995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9eb4fb-b89c-42be-a53c-d9089115f8b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:16.841198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eb4fb-b89c-42be-a53c-d9089115f8b4 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:16.841747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eb4fb-b89c-42be-a53c-d9089115f8b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:16.842249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9eb4fb-b89c-42be-a53c-d9089115f8b4 None admin] PATH_INFO: `/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:16.844788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9eb4fb-b89c-42be-a53c-d9089115f8b4 None admin] RBAC: Authorizing `identity:get_group(group_id=df068e9a5b4a4a06bef2f78bf02f55aa)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:16.846639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9eb4fb-b89c-42be-a53c-d9089115f8b4 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:16.847929 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:16.849375 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 187/373] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 19 13:51:16 2022] GET /identity/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:16.850417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9eb4fb-b89c-42be-a53c-d9089115f8b4 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:16.858483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541a4bf-5e43-4338-a944-609c641c1dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:16.859290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541a4bf-5e43-4338-a944-609c641c1dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:16.859574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541a4bf-5e43-4338-a944-609c641c1dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:16.859850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541a4bf-5e43-4338-a944-609c641c1dc0 None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:16.861049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541a4bf-5e43-4338-a944-609c641c1dc0 None admin] RBAC: Authorizing `identity:get_project(project_id=2b597c406357445d8679d4b27fa90b63)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:16.862528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9541a4bf-5e43-4338-a944-609c641c1dc0 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:16.864251 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 187/374] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:51:16 2022] GET /identity/v3/projects/2b597c406357445d8679d4b27fa90b63 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:16.864977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541a4bf-5e43-4338-a944-609c641c1dc0 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:16.886487 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:16.971726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9eb4fb-b89c-42be-a53c-d9089115f8b4 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:16.975502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9541a4bf-5e43-4338-a944-609c641c1dc0 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:17.010653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a20e22-5262-4041-8a88-11a3ebd76c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:17.012083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a20e22-5262-4041-8a88-11a3ebd76c23 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:17.012573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a20e22-5262-4041-8a88-11a3ebd76c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:17.013128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a20e22-5262-4041-8a88-11a3ebd76c23 None admin] PATH_INFO: `/v3/projects/11ee5637d3dd4cec833ee8254662fa0b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:17.013359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549e952-be71-404a-898e-a8262aeaa61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:17.014020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549e952-be71-404a-898e-a8262aeaa61f None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:17.014448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549e952-be71-404a-898e-a8262aeaa61f None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:17.014730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549e952-be71-404a-898e-a8262aeaa61f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:17.015396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a20e22-5262-4041-8a88-11a3ebd76c23 None admin] RBAC: Authorizing `identity:get_project(project_id=11ee5637d3dd4cec833ee8254662fa0b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:17.015568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549e952-be71-404a-898e-a8262aeaa61f None admin] RBAC: Adding query filter params (group.id=df068e9a5b4a4a06bef2f78bf02f55aa, role.id=e17d8526e56c4d319080a377398b9c74, scope.project.id=2b597c406357445d8679d4b27fa90b63) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:17.015875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549e952-be71-404a-898e-a8262aeaa61f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:17.017308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549e952-be71-404a-898e-a8262aeaa61f None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:17.018817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a20e22-5262-4041-8a88-11a3ebd76c23 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:17.020949 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 188/375] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:51:16 2022] GET /identity/v3/projects/11ee5637d3dd4cec833ee8254662fa0b => generated 344 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:17.021920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a20e22-5262-4041-8a88-11a3ebd76c23 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:17.023334 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 188/376] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jul 19 13:51:16 2022] GET /identity/v3/role_assignments?group.id=df068e9a5b4a4a06bef2f78bf02f55aa&scope.project.id=2b597c406357445d8679d4b27fa90b63&role.id=e17d8526e56c4d319080a377398b9c74 => generated 260 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:17.027153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549e952-be71-404a-898e-a8262aeaa61f None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:17.095887 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:17.129395 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:17.140265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a20e22-5262-4041-8a88-11a3ebd76c23 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:17.144738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549e952-be71-404a-898e-a8262aeaa61f None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:17.183871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a0190-2413-4075-8712-1c445eb659d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:17.184779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a0190-2413-4075-8712-1c445eb659d5 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:17.185069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a0190-2413-4075-8712-1c445eb659d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:17.185349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a0190-2413-4075-8712-1c445eb659d5 None admin] PATH_INFO: `/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:17.186544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b12344-0c34-4e14-93d0-6a97e872669c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:17.186790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a0190-2413-4075-8712-1c445eb659d5 None admin] RBAC: Authorizing `identity:get_group(group_id=df068e9a5b4a4a06bef2f78bf02f55aa)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:17.188093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b12344-0c34-4e14-93d0-6a97e872669c None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:17.188453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a0190-2413-4075-8712-1c445eb659d5 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:17.188772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b12344-0c34-4e14-93d0-6a97e872669c None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:17.189233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b12344-0c34-4e14-93d0-6a97e872669c None admin] PATH_INFO: `/v3/groups/f71497dd3edc43c89513acef547abb90` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:17.190299 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 189/377] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 19 13:51:17 2022] GET /identity/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:17.195336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b12344-0c34-4e14-93d0-6a97e872669c None admin] RBAC: Authorizing `identity:get_group(group_id=f71497dd3edc43c89513acef547abb90)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:17.196938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a0190-2413-4075-8712-1c445eb659d5 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:17.197902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b12344-0c34-4e14-93d0-6a97e872669c None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:17.200138 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 189/378] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 19 13:51:17 2022] GET /identity/v3/groups/f71497dd3edc43c89513acef547abb90 => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:17.207413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b12344-0c34-4e14-93d0-6a97e872669c None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:17.328800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a0190-2413-4075-8712-1c445eb659d5 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:17.364873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b12344-0c34-4e14-93d0-6a97e872669c None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:17.368600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e11275-c252-4383-b3da-44bbfc7593f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:17.369551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e11275-c252-4383-b3da-44bbfc7593f8 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:17.370970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e11275-c252-4383-b3da-44bbfc7593f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:17.371510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e11275-c252-4383-b3da-44bbfc7593f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:17.372649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e11275-c252-4383-b3da-44bbfc7593f8 None admin] RBAC: Adding query filter params (group.id=df068e9a5b4a4a06bef2f78bf02f55aa, role.id=b73e411ed06b463fb578c06789886960, scope.project.id=2b597c406357445d8679d4b27fa90b63) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:17.373177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e11275-c252-4383-b3da-44bbfc7593f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:17.374914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e11275-c252-4383-b3da-44bbfc7593f8 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:17.381602 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 190/379] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jul 19 13:51:17 2022] GET /identity/v3/role_assignments?group.id=df068e9a5b4a4a06bef2f78bf02f55aa&scope.project.id=2b597c406357445d8679d4b27fa90b63&role.id=b73e411ed06b463fb578c06789886960 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:17.387524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2db35-392d-4c04-92b5-f7c4c92f0878 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:17.388124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2db35-392d-4c04-92b5-f7c4c92f0878 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:17.388615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2db35-392d-4c04-92b5-f7c4c92f0878 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:17.390244 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 191/380] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:17.398555 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:17.400728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732ef2e-43df-4f5c-8e43-b458220873b1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:17.401266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732ef2e-43df-4f5c-8e43-b458220873b1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:17.401802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732ef2e-43df-4f5c-8e43-b458220873b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:17.409745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833d50a-9c2f-48b3-9688-dbf266056e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:17.411661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833d50a-9c2f-48b3-9688-dbf266056e79 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:17.411661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833d50a-9c2f-48b3-9688-dbf266056e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:17.411661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b833d50a-9c2f-48b3-9688-dbf266056e79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:17.413855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833d50a-9c2f-48b3-9688-dbf266056e79 None admin] RBAC: Adding query filter params (group.id=f71497dd3edc43c89513acef547abb90, role.id=bc315edf089d43b18acf9790031f3fcb, scope.project.id=11ee5637d3dd4cec833ee8254662fa0b) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:17.413855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833d50a-9c2f-48b3-9688-dbf266056e79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:17.414213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b833d50a-9c2f-48b3-9688-dbf266056e79 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:17.423245 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 190/381] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jul 19 13:51:17 2022] GET /identity/v3/role_assignments?group.id=f71497dd3edc43c89513acef547abb90&scope.project.id=11ee5637d3dd4cec833ee8254662fa0b&role.id=bc315edf089d43b18acf9790031f3fcb => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:17.439120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7732ef2e-43df-4f5c-8e43-b458220873b1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:17.440425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7732ef2e-43df-4f5c-8e43-b458220873b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:17.482598 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:17.534646 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 192/382] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:17.579722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833d50a-9c2f-48b3-9688-dbf266056e79 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:17.717847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b833d50a-9c2f-48b3-9688-dbf266056e79 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:17.759041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381a1df-e68f-4fc7-b8f8-4cae7b2620b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:17.760010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381a1df-e68f-4fc7-b8f8-4cae7b2620b4 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:17.760292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381a1df-e68f-4fc7-b8f8-4cae7b2620b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:17.760566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381a1df-e68f-4fc7-b8f8-4cae7b2620b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:17.777638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381a1df-e68f-4fc7-b8f8-4cae7b2620b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:17.785330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-6381a1df-e68f-4fc7-b8f8-4cae7b2620b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:51:17.785330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:17.785330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:17.785330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:17.785330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:17.785330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:17.785330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:17.785330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:17.785330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:17.785330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:17.785330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:17.785330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:17.785330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:17.785330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:17.785330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:17.785330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:17.786310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:17.786310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:17.786310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:17.786310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:17.786310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:17.786310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:17.786310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:17.786310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:17.786310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:17.786310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:17.786310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:17.786310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:17.786310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:17.786310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:17.786310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:17.786310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:17.787155 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:17.787155 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:17.787155 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:17.787155 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:17.787155 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:17.787155 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:17.787155 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:17.787155 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:17.787155 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:17.787155 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:17.787155 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:51:17.787155 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:17.787155 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 191/383] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:17.793157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732ef2e-43df-4f5c-8e43-b458220873b1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:17.897422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602adf8-fbf3-4a1c-a5ab-4cc2e8ccaebd None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:17.897962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602adf8-fbf3-4a1c-a5ab-4cc2e8ccaebd None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:17.897962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602adf8-fbf3-4a1c-a5ab-4cc2e8ccaebd None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:17.899978 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 192/384] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:17.905758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92c985-f162-400b-a220-1edc62260268 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:17.906332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92c985-f162-400b-a220-1edc62260268 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:17.906619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92c985-f162-400b-a220-1edc62260268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:17.927947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0b92c985-f162-400b-a220-1edc62260268 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:17.929384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0b92c985-f162-400b-a220-1edc62260268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:17.968975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732ef2e-43df-4f5c-8e43-b458220873b1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:18.010455 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:18.044244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fc633-be96-43f3-b7c6-6fa8540c88ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:18.044931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fc633-be96-43f3-b7c6-6fa8540c88ea None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:18.045218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fc633-be96-43f3-b7c6-6fa8540c88ea None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:18.045497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2fc633-be96-43f3-b7c6-6fa8540c88ea None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:18.046294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fc633-be96-43f3-b7c6-6fa8540c88ea None admin] RBAC: Adding query filter params (name=member) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:18.046606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fc633-be96-43f3-b7c6-6fa8540c88ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:18.048012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2fc633-be96-43f3-b7c6-6fa8540c88ea None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:18.060642 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 193/385] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:51:18.066740 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 193/386] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:51:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:18.083616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92c985-f162-400b-a220-1edc62260268 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:18.097375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fc633-be96-43f3-b7c6-6fa8540c88ea None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:18.125968 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:18.263919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92c985-f162-400b-a220-1edc62260268 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:18.298485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2fc633-be96-43f3-b7c6-6fa8540c88ea None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:18.331254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c11fd-a9a4-4c0a-9a81-0fa4e1901092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:18.332386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c11fd-a9a4-4c0a-9a81-0fa4e1901092 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:18.332676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c11fd-a9a4-4c0a-9a81-0fa4e1901092 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:18.333386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c11fd-a9a4-4c0a-9a81-0fa4e1901092 None admin] PATH_INFO: `/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:18.334779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c11fd-a9a4-4c0a-9a81-0fa4e1901092 None admin] RBAC: Authorizing `identity:get_group(group_id=df068e9a5b4a4a06bef2f78bf02f55aa)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:18.337052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c11fd-a9a4-4c0a-9a81-0fa4e1901092 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:18.342635 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 194/387] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 19 13:51:18 2022] GET /identity/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:18.350286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c11fd-a9a4-4c0a-9a81-0fa4e1901092 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:18.357822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52ad74-b43a-4422-9803-eb1d6b3e3719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:18.362530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52ad74-b43a-4422-9803-eb1d6b3e3719 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:18.362817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52ad74-b43a-4422-9803-eb1d6b3e3719 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:18.363095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52ad74-b43a-4422-9803-eb1d6b3e3719 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:18.381747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52ad74-b43a-4422-9803-eb1d6b3e3719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:18.395488 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-4c52ad74-b43a-4422-9803-eb1d6b3e3719 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:51:18.395488 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:18.395488 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:18.395488 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:18.395488 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:18.395488 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:18.395488 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:18.395488 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:18.395488 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:18.395488 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:18.395488 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:18.395488 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:18.395488 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:18.395488 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:18.395488 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:18.395488 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:18.396453 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:18.396453 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:18.396453 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:18.396453 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:18.396453 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:18.396453 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:18.396453 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:18.396453 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:18.396453 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:18.396453 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:18.396453 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:18.396453 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:18.396453 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:18.396453 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:18.396453 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:18.396453 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:18.397309 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:18.397309 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:18.397309 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:18.397309 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:18.397309 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:18.397309 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:18.397309 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:18.397309 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:18.397309 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:18.397309 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:18.397309 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:51:18.397309 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:18.397309 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 194/388] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 19 13:51:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:51:18.403358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52ad74-b43a-4422-9803-eb1d6b3e3719 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:18.442493 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:18.491835 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:18.517116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52ad74-b43a-4422-9803-eb1d6b3e3719 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:18.554555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655e912-d21e-45db-85f7-a3ddb5ec9687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:18.556704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655e912-d21e-45db-85f7-a3ddb5ec9687 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:18.557155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655e912-d21e-45db-85f7-a3ddb5ec9687 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:18.557577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655e912-d21e-45db-85f7-a3ddb5ec9687 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:18.558517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655e912-d21e-45db-85f7-a3ddb5ec9687 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:18.559167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655e912-d21e-45db-85f7-a3ddb5ec9687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:18.561892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7655e912-d21e-45db-85f7-a3ddb5ec9687 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:18.567069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c11fd-a9a4-4c0a-9a81-0fa4e1901092 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:18.585986 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 195/389] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:18.591922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655e912-d21e-45db-85f7-a3ddb5ec9687 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:18.638077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea052fe-d193-4f9f-8e7c-81b60af4cf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:18.641416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea052fe-d193-4f9f-8e7c-81b60af4cf6f None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:18.641863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea052fe-d193-4f9f-8e7c-81b60af4cf6f None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:18.642311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea052fe-d193-4f9f-8e7c-81b60af4cf6f None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:18.644731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea052fe-d193-4f9f-8e7c-81b60af4cf6f None admin] RBAC: Authorizing `identity:get_project(project_id=488e2680f33948a99baf67e759f3e3fe)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:18.647527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea052fe-d193-4f9f-8e7c-81b60af4cf6f None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:18.655014 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 195/390] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:51:18 2022] GET /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:18.657951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea052fe-d193-4f9f-8e7c-81b60af4cf6f None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:18.738034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655e912-d21e-45db-85f7-a3ddb5ec9687 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:18.781527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6caf7c6-d34e-4e33-acca-46870c36361d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:18.782817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6caf7c6-d34e-4e33-acca-46870c36361d None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:18.784327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6caf7c6-d34e-4e33-acca-46870c36361d None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:18.785442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6caf7c6-d34e-4e33-acca-46870c36361d None admin] PATH_INFO: `/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:18.787375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6caf7c6-d34e-4e33-acca-46870c36361d None admin] RBAC: Authorizing `identity:get_group(group_id=df068e9a5b4a4a06bef2f78bf02f55aa)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:18.790937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6caf7c6-d34e-4e33-acca-46870c36361d None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:18.794235 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 196/391] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 19 13:51:18 2022] GET /identity/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:18.798072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6caf7c6-d34e-4e33-acca-46870c36361d None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:18.808216 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:18.850644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea052fe-d193-4f9f-8e7c-81b60af4cf6f None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:18.877836 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:18.924424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60bc065-2a88-4b7a-95fb-81e0cb78e99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:18.925319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bc065-2a88-4b7a-95fb-81e0cb78e99f None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:18.925623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bc065-2a88-4b7a-95fb-81e0cb78e99f None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:18.925888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60bc065-2a88-4b7a-95fb-81e0cb78e99f None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe/groups/df068e9a5b4a4a06bef2f78bf02f55aa/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:18.930073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bc065-2a88-4b7a-95fb-81e0cb78e99f None admin] RBAC: Authorizing `identity:create_grant(project_id=488e2680f33948a99baf67e759f3e3fe, group_id=df068e9a5b4a4a06bef2f78bf02f55aa, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:18.931648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60bc065-2a88-4b7a-95fb-81e0cb78e99f None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:18.950922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6caf7c6-d34e-4e33-acca-46870c36361d None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:18.986854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b219fd-e568-4c97-8baf-fe50c0697c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:18.987824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b219fd-e568-4c97-8baf-fe50c0697c48 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:18.988196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b219fd-e568-4c97-8baf-fe50c0697c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:18.988548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b219fd-e568-4c97-8baf-fe50c0697c48 None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:18.989843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b219fd-e568-4c97-8baf-fe50c0697c48 None admin] RBAC: Authorizing `identity:get_project(project_id=488e2680f33948a99baf67e759f3e3fe)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:18.991466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b219fd-e568-4c97-8baf-fe50c0697c48 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:18.993878 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 197/392] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:51:18 2022] GET /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:19.001477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b219fd-e568-4c97-8baf-fe50c0697c48 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:19.020990 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 196/393] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Jul 19 13:51:18 2022] PUT /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe/groups/df068e9a5b4a4a06bef2f78bf02f55aa/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:51:19.100551 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:19.128263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b219fd-e568-4c97-8baf-fe50c0697c48 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:19.167271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c2017-a8a9-4eac-9395-d0a77ef029d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:19.168214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c2017-a8a9-4eac-9395-d0a77ef029d5 None admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:19.168510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c2017-a8a9-4eac-9395-d0a77ef029d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:19.168794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c2017-a8a9-4eac-9395-d0a77ef029d5 None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe/groups/df068e9a5b4a4a06bef2f78bf02f55aa/roles/b73e411ed06b463fb578c06789886960` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:19.171234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c2017-a8a9-4eac-9395-d0a77ef029d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=488e2680f33948a99baf67e759f3e3fe, group_id=df068e9a5b4a4a06bef2f78bf02f55aa, role_id=b73e411ed06b463fb578c06789886960)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:19.172681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c2017-a8a9-4eac-9395-d0a77ef029d5 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:19.267215 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 198/394] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Jul 19 13:51:19 2022] PUT /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe/groups/df068e9a5b4a4a06bef2f78bf02f55aa/roles/b73e411ed06b463fb578c06789886960 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:51:19.649196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81299f96-ec81-48a3-99c9-a4f0ef6e8eed None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:19.649552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81299f96-ec81-48a3-99c9-a4f0ef6e8eed None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:19.650008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81299f96-ec81-48a3-99c9-a4f0ef6e8eed None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:19.651712 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 197/395] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:19.657147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53599bf1-0277-405b-9889-ed966cbb58c7 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:19.657441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53599bf1-0277-405b-9889-ed966cbb58c7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:19.657722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53599bf1-0277-405b-9889-ed966cbb58c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:19.683132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-53599bf1-0277-405b-9889-ed966cbb58c7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:19.684340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-53599bf1-0277-405b-9889-ed966cbb58c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:19.761964 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 199/396] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:19.797258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81299f96-ec81-48a3-99c9-a4f0ef6e8eed None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:19.917387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81299f96-ec81-48a3-99c9-a4f0ef6e8eed None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:19.953964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f053f-fbe7-497a-9dd7-8aa9cd1f38cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:19.954801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f053f-fbe7-497a-9dd7-8aa9cd1f38cf None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:19.955081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f053f-fbe7-497a-9dd7-8aa9cd1f38cf None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:19.955356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f053f-fbe7-497a-9dd7-8aa9cd1f38cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:19.966572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f053f-fbe7-497a-9dd7-8aa9cd1f38cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:19.974318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-f44f053f-fbe7-497a-9dd7-8aa9cd1f38cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:51:19.974318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:19.974318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:19.974318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:19.974318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:19.974318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:19.974318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:19.974318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:19.974318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:19.974318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:19.974318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:19.974318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:19.974318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:19.974318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:19.974318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:19.974318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:19.976352 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:19.976352 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:19.976352 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:19.976352 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:19.976352 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:19.976352 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:19.976352 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:19.976352 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:19.976352 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:19.976352 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:19.976352 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:19.976352 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:19.976352 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:19.976352 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:19.976352 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:19.976352 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:19.978337 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:19.978337 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:19.978337 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:19.978337 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:19.978337 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:19.978337 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:19.978337 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:19.978337 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:19.978337 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:19.978337 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:19.978337 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:51:19.978337 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:19.978337 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 198/397] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:19.982375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53599bf1-0277-405b-9889-ed966cbb58c7 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:20.047376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f6397-67d5-46f4-b60c-9dab58814de7 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:20.047788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f6397-67d5-46f4-b60c-9dab58814de7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:20.048135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1f6397-67d5-46f4-b60c-9dab58814de7 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:20.049811 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 199/398] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:20.054680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb9677-4f08-4840-8120-307c87bb3d10 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:20.055043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb9677-4f08-4840-8120-307c87bb3d10 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:20.055913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedb9677-4f08-4840-8120-307c87bb3d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:20.073146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-eedb9677-4f08-4840-8120-307c87bb3d10 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:20.074729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eedb9677-4f08-4840-8120-307c87bb3d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:20.082466 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:20.109603 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:20.124041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53599bf1-0277-405b-9889-ed966cbb58c7 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:20.152180 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 200/399] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:51:20.169203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d096e68-0514-4a6f-9eea-f7231e641a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:20.169945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d096e68-0514-4a6f-9eea-f7231e641a2f None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:20.170333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d096e68-0514-4a6f-9eea-f7231e641a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:20.170742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d096e68-0514-4a6f-9eea-f7231e641a2f None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:20.171580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d096e68-0514-4a6f-9eea-f7231e641a2f None admin] RBAC: Adding query filter params (name=member) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:20.172015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d096e68-0514-4a6f-9eea-f7231e641a2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:20.173567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d096e68-0514-4a6f-9eea-f7231e641a2f None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:20.174827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb9677-4f08-4840-8120-307c87bb3d10 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:20.184830 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 200/400] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:51:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:20.190266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d096e68-0514-4a6f-9eea-f7231e641a2f None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:20.304401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedb9677-4f08-4840-8120-307c87bb3d10 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:20.325075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d096e68-0514-4a6f-9eea-f7231e641a2f None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:20.353427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250ca56-270b-4487-82a3-9b4fe90fdca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:20.354806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250ca56-270b-4487-82a3-9b4fe90fdca6 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:20.355290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250ca56-270b-4487-82a3-9b4fe90fdca6 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:20.356096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250ca56-270b-4487-82a3-9b4fe90fdca6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:20.357866 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:20.368843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d5bad-3f0b-4bd6-80dd-0b1cb3c54047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:20.370015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d5bad-3f0b-4bd6-80dd-0b1cb3c54047 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:20.371353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d5bad-3f0b-4bd6-80dd-0b1cb3c54047 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:20.371458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2250ca56-270b-4487-82a3-9b4fe90fdca6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:20.371568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d5bad-3f0b-4bd6-80dd-0b1cb3c54047 None admin] PATH_INFO: `/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:20.372347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d5bad-3f0b-4bd6-80dd-0b1cb3c54047 None admin] RBAC: Authorizing `identity:get_group(group_id=df068e9a5b4a4a06bef2f78bf02f55aa)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:20.373952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d5bad-3f0b-4bd6-80dd-0b1cb3c54047 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:20.376087 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 201/401] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 19 13:51:20 2022] GET /identity/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:20.377506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3c91b-cb2e-4a36-a65b-84eaba698f77 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:20.377952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3c91b-cb2e-4a36-a65b-84eaba698f77 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:20.378481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3c91b-cb2e-4a36-a65b-84eaba698f77 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:20.379910 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 202/402] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:20.380513 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-2250ca56-270b-4487-82a3-9b4fe90fdca6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:51:20.380513 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:20.380513 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:20.380513 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:20.380513 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:20.380513 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:20.380513 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:20.380513 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:20.380513 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:20.380513 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:20.380513 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:20.380513 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:20.380513 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:20.380513 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:20.380513 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:20.380513 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:20.381428 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:20.381428 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:20.381428 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:20.381428 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:20.381428 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:20.381428 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:20.381428 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:20.381428 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:20.381428 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:20.381428 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:20.381428 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:20.381428 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:20.381428 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:20.381428 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:20.381428 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:20.381428 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:20.382311 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:20.382311 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:20.382311 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:20.382311 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:20.382311 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:20.382311 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:20.382311 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:20.382311 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:20.382311 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:20.382311 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:20.382311 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:51:20.382311 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:20.382311 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 201/403] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 19 13:51:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:20.386947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3c91b-cb2e-4a36-a65b-84eaba698f77 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:20.387570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e117179-b574-4ca3-ac85-36b660dfa6e4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:20.387928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e117179-b574-4ca3-ac85-36b660dfa6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:20.388284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e117179-b574-4ca3-ac85-36b660dfa6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:20.410883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7e117179-b574-4ca3-ac85-36b660dfa6e4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:20.412163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7e117179-b574-4ca3-ac85-36b660dfa6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:20.433655 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:20.496862 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 202/404] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:20.497828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e117179-b574-4ca3-ac85-36b660dfa6e4 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:20.513562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3c91b-cb2e-4a36-a65b-84eaba698f77 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:20.554702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba45e4-66bb-4dee-a1cc-2e0f2b49acce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:20.556144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba45e4-66bb-4dee-a1cc-2e0f2b49acce None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:20.556614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba45e4-66bb-4dee-a1cc-2e0f2b49acce None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:20.557126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba45e4-66bb-4dee-a1cc-2e0f2b49acce None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:20.558578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba45e4-66bb-4dee-a1cc-2e0f2b49acce None admin] RBAC: Authorizing `identity:get_project(project_id=2b597c406357445d8679d4b27fa90b63)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:20.560251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba45e4-66bb-4dee-a1cc-2e0f2b49acce None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:20.562772 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 203/405] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:51:20 2022] GET /identity/v3/projects/2b597c406357445d8679d4b27fa90b63 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:20.563750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba45e4-66bb-4dee-a1cc-2e0f2b49acce None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:20.616015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e117179-b574-4ca3-ac85-36b660dfa6e4 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:20.641753 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:20.660666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d15c6-ae55-40de-abb8-5912b07f3c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:20.661345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d15c6-ae55-40de-abb8-5912b07f3c8a None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:20.661628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d15c6-ae55-40de-abb8-5912b07f3c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:20.661902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d15c6-ae55-40de-abb8-5912b07f3c8a None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:20.663004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d15c6-ae55-40de-abb8-5912b07f3c8a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:20.663314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d15c6-ae55-40de-abb8-5912b07f3c8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:20.665533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d15c6-ae55-40de-abb8-5912b07f3c8a None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:20.675550 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 203/406] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:20.679008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d15c6-ae55-40de-abb8-5912b07f3c8a None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:20.697308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba45e4-66bb-4dee-a1cc-2e0f2b49acce None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:20.702509 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:20.740894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fdd5c-b7a4-43d5-8fd3-5f5fade3672e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:20.741851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fdd5c-b7a4-43d5-8fd3-5f5fade3672e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:20.742160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fdd5c-b7a4-43d5-8fd3-5f5fade3672e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:20.742749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32fdd5c-b7a4-43d5-8fd3-5f5fade3672e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:20.757748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32fdd5c-b7a4-43d5-8fd3-5f5fade3672e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:20.768185 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-f32fdd5c-b7a4-43d5-8fd3-5f5fade3672e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:51:20.768185 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:20.768185 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:20.768185 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:20.768185 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:20.768185 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:20.768185 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:20.768185 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:20.768185 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:20.768185 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:20.768185 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:20.768185 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:20.768185 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:20.768185 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:20.768185 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:20.768185 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:20.769153 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:20.769153 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:20.769153 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:20.769153 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:20.769153 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:20.769153 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:20.769153 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:20.769153 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:20.769153 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:20.769153 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:20.769153 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:20.769153 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:20.769153 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:20.769153 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:20.769153 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:20.769153 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:20.769993 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:20.769993 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:20.769993 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:20.769993 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:20.769993 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:20.769993 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:20.769993 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:20.769993 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:20.769993 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:20.769993 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:20.769993 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:51:20.769993 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:20.771153 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 204/407] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:51:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:20.772114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fdd5c-b7a4-43d5-8fd3-5f5fade3672e None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:20.811984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d15c6-ae55-40de-abb8-5912b07f3c8a None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:20.856672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0e032-c94c-4d47-8670-9cdf53c8168e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:20.857577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0e032-c94c-4d47-8670-9cdf53c8168e None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:20.857859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0e032-c94c-4d47-8670-9cdf53c8168e None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:20.858157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0e032-c94c-4d47-8670-9cdf53c8168e None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63/groups/df068e9a5b4a4a06bef2f78bf02f55aa/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:20.861682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0e032-c94c-4d47-8670-9cdf53c8168e None admin] RBAC: Authorizing `identity:create_grant(project_id=2b597c406357445d8679d4b27fa90b63, group_id=df068e9a5b4a4a06bef2f78bf02f55aa, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:20.863172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0e032-c94c-4d47-8670-9cdf53c8168e None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:20.892851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32fdd5c-b7a4-43d5-8fd3-5f5fade3672e None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:20.917615 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:20.932586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3601488-d8e2-4590-a598-26efc1866274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:20.933458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3601488-d8e2-4590-a598-26efc1866274 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:20.933742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3601488-d8e2-4590-a598-26efc1866274 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:20.934055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3601488-d8e2-4590-a598-26efc1866274 None admin] PATH_INFO: `/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:20.938705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3601488-d8e2-4590-a598-26efc1866274 None admin] RBAC: Authorizing `identity:get_group(group_id=df068e9a5b4a4a06bef2f78bf02f55aa)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:20.938705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3601488-d8e2-4590-a598-26efc1866274 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:20.939025 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 205/408] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 19 13:51:20 2022] GET /identity/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:20.939813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3601488-d8e2-4590-a598-26efc1866274 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:20.993794 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 204/409] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Jul 19 13:51:20 2022] PUT /identity/v3/projects/2b597c406357445d8679d4b27fa90b63/groups/df068e9a5b4a4a06bef2f78bf02f55aa/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:51:20.993794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0e032-c94c-4d47-8670-9cdf53c8168e None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:21.049269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3601488-d8e2-4590-a598-26efc1866274 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:21.086268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600edeb-9426-4ea9-b067-89d820e5b9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:21.088268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600edeb-9426-4ea9-b067-89d820e5b9dc None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:21.088596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600edeb-9426-4ea9-b067-89d820e5b9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:21.088843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600edeb-9426-4ea9-b067-89d820e5b9dc None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:21.089607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600edeb-9426-4ea9-b067-89d820e5b9dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:21.089912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600edeb-9426-4ea9-b067-89d820e5b9dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:21.091313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600edeb-9426-4ea9-b067-89d820e5b9dc None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:21.100688 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 206/410] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:21.106962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600edeb-9426-4ea9-b067-89d820e5b9dc None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:21.176748 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:21.190716 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:21.233874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600edeb-9426-4ea9-b067-89d820e5b9dc None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:21.263243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0e032-c94c-4d47-8670-9cdf53c8168e None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:21.275685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f4bf1-a54f-45be-8e76-0421ebc8ff67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:21.276577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f4bf1-a54f-45be-8e76-0421ebc8ff67 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:21.276863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f4bf1-a54f-45be-8e76-0421ebc8ff67 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:21.277288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f4bf1-a54f-45be-8e76-0421ebc8ff67 None admin] PATH_INFO: `/v3/groups/f71497dd3edc43c89513acef547abb90` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:21.278663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f4bf1-a54f-45be-8e76-0421ebc8ff67 None admin] RBAC: Authorizing `identity:get_group(group_id=f71497dd3edc43c89513acef547abb90)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:21.280255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f4bf1-a54f-45be-8e76-0421ebc8ff67 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:21.282607 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 207/411] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 19 13:51:21 2022] GET /identity/v3/groups/f71497dd3edc43c89513acef547abb90 => generated 229 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:21.287916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f4bf1-a54f-45be-8e76-0421ebc8ff67 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:21.305997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc5722-abf9-4f1c-82b0-a4b891bc1a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:21.306906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc5722-abf9-4f1c-82b0-a4b891bc1a28 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:21.307189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc5722-abf9-4f1c-82b0-a4b891bc1a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:21.307465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc5722-abf9-4f1c-82b0-a4b891bc1a28 None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:21.308860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc5722-abf9-4f1c-82b0-a4b891bc1a28 None admin] RBAC: Authorizing `identity:get_project(project_id=2b597c406357445d8679d4b27fa90b63)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:21.310322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc5722-abf9-4f1c-82b0-a4b891bc1a28 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:21.312686 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 205/412] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:51:20 2022] GET /identity/v3/projects/2b597c406357445d8679d4b27fa90b63 => generated 302 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:21.318312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc5722-abf9-4f1c-82b0-a4b891bc1a28 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:21.397754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f4bf1-a54f-45be-8e76-0421ebc8ff67 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:21.427072 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:21.436095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b1883-9fea-4bff-aea2-9057183105f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:21.436962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b1883-9fea-4bff-aea2-9057183105f4 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:21.437495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b1883-9fea-4bff-aea2-9057183105f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:21.437769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b1883-9fea-4bff-aea2-9057183105f4 None admin] PATH_INFO: `/v3/projects/11ee5637d3dd4cec833ee8254662fa0b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:21.439356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b1883-9fea-4bff-aea2-9057183105f4 None admin] RBAC: Authorizing `identity:get_project(project_id=11ee5637d3dd4cec833ee8254662fa0b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:21.441020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b1883-9fea-4bff-aea2-9057183105f4 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:21.443387 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 208/413] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:51:21 2022] GET /identity/v3/projects/11ee5637d3dd4cec833ee8254662fa0b => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:21.448834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc5722-abf9-4f1c-82b0-a4b891bc1a28 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:21.450421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b1883-9fea-4bff-aea2-9057183105f4 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:21.551469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ca2ba-20e9-4af5-9fcf-92c875df4a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:21.552292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ca2ba-20e9-4af5-9fcf-92c875df4a0e None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:21.552577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ca2ba-20e9-4af5-9fcf-92c875df4a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:21.552854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ca2ba-20e9-4af5-9fcf-92c875df4a0e None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63/groups/df068e9a5b4a4a06bef2f78bf02f55aa/roles/b73e411ed06b463fb578c06789886960` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:21.558004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b1883-9fea-4bff-aea2-9057183105f4 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:21.563145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ca2ba-20e9-4af5-9fcf-92c875df4a0e None admin] RBAC: Authorizing `identity:create_grant(project_id=2b597c406357445d8679d4b27fa90b63, group_id=df068e9a5b4a4a06bef2f78bf02f55aa, role_id=b73e411ed06b463fb578c06789886960)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:21.564588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ca2ba-20e9-4af5-9fcf-92c875df4a0e None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:21.594903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0409ca3c-a25b-47a7-ad0b-0225bca23c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:21.595835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409ca3c-a25b-47a7-ad0b-0225bca23c82 None admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:21.596146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409ca3c-a25b-47a7-ad0b-0225bca23c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:21.596417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0409ca3c-a25b-47a7-ad0b-0225bca23c82 None admin] PATH_INFO: `/v3/projects/11ee5637d3dd4cec833ee8254662fa0b/groups/f71497dd3edc43c89513acef547abb90/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:21.598455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409ca3c-a25b-47a7-ad0b-0225bca23c82 None admin] RBAC: Authorizing `identity:create_grant(project_id=11ee5637d3dd4cec833ee8254662fa0b, group_id=f71497dd3edc43c89513acef547abb90, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:21.600022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0409ca3c-a25b-47a7-ad0b-0225bca23c82 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:21.675697 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 206/414] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Jul 19 13:51:21 2022] PUT /identity/v3/projects/2b597c406357445d8679d4b27fa90b63/groups/df068e9a5b4a4a06bef2f78bf02f55aa/roles/b73e411ed06b463fb578c06789886960 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 13:51:21.684721 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 209/415] 10.222.0.43 () {58 vars in 1442 bytes} [Tue Jul 19 13:51:21 2022] PUT /identity/v3/projects/11ee5637d3dd4cec833ee8254662fa0b/groups/f71497dd3edc43c89513acef547abb90/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:51:21.781688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8b75a-d3b5-4394-b786-aa28f1615779 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:21.782024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8b75a-d3b5-4394-b786-aa28f1615779 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:21.782271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8b75a-d3b5-4394-b786-aa28f1615779 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:21.783839 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 207/416] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:21.789888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479adff4-0903-491f-9574-c0da5d2fb089 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:21.790693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479adff4-0903-491f-9574-c0da5d2fb089 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:21.790693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479adff4-0903-491f-9574-c0da5d2fb089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:21.815294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-479adff4-0903-491f-9574-c0da5d2fb089 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:21.816443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-479adff4-0903-491f-9574-c0da5d2fb089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:21.876918 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:21.904080 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 210/417] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:21.929539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8b75a-d3b5-4394-b786-aa28f1615779 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:21.933204 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:21.964137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f784a12-8ac6-45e7-a902-e374c785f03e None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:21.964137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f784a12-8ac6-45e7-a902-e374c785f03e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:21.964383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f784a12-8ac6-45e7-a902-e374c785f03e None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:21.965970 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 211/418] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:51:21.971333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347dc0a-d89a-4477-91a9-7100e246a7dc None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:21.971620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347dc0a-d89a-4477-91a9-7100e246a7dc None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:21.971904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347dc0a-d89a-4477-91a9-7100e246a7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:21.994124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9347dc0a-d89a-4477-91a9-7100e246a7dc None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:21.995603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9347dc0a-d89a-4477-91a9-7100e246a7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:22.077614 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 212/419] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:51:22.105540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347dc0a-d89a-4477-91a9-7100e246a7dc None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:22.106203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8b75a-d3b5-4394-b786-aa28f1615779 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:22.145088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657148d5-2fa5-4387-bbbc-5975470447dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:22.146237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657148d5-2fa5-4387-bbbc-5975470447dd None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:22.146747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657148d5-2fa5-4387-bbbc-5975470447dd None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:22.147284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657148d5-2fa5-4387-bbbc-5975470447dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:22.167061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657148d5-2fa5-4387-bbbc-5975470447dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:22.181391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-657148d5-2fa5-4387-bbbc-5975470447dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:51:22.181391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:22.181391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:22.181391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:22.181391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:22.181391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:22.181391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:22.181391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:22.181391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:22.181391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:22.181391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:22.181391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:22.181391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:22.181391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:22.181391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:22.181391 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:22.182356 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:22.182356 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:22.182356 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:22.182356 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:22.182356 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:22.182356 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:22.182356 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:22.182356 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:22.182356 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:22.182356 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:22.182356 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:22.182356 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:22.182356 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:22.182356 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:22.182356 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:22.182356 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:22.183170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:22.183170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:22.183170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:22.183170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:22.183170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:22.183170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:22.183170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:22.183170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:22.183170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:22.183170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:22.183170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:51:22.183170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:22.192153 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 208/420] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 19 13:51:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:22.203060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657148d5-2fa5-4387-bbbc-5975470447dd None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:22.287846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347dc0a-d89a-4477-91a9-7100e246a7dc None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:22.303556 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:22.316213 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:22.347372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46e4ea-0206-4b06-8f11-a78f25109441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:22.348104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46e4ea-0206-4b06-8f11-a78f25109441 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:22.348387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46e4ea-0206-4b06-8f11-a78f25109441 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:22.348662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46e4ea-0206-4b06-8f11-a78f25109441 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:22.366967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46e4ea-0206-4b06-8f11-a78f25109441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:22.379755 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-4b46e4ea-0206-4b06-8f11-a78f25109441 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:51:22.379755 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:22.379755 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:22.379755 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:22.379755 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:22.379755 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:22.379755 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:22.379755 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:22.379755 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:22.379755 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:22.379755 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:22.379755 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:22.379755 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:22.379755 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:22.379755 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:22.379755 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:22.380864 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:22.380864 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:22.380864 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:22.380864 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:22.380864 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:22.380864 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:22.380864 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:22.380864 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:22.380864 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:22.380864 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:22.380864 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:22.380864 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:22.380864 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:22.380864 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:22.380864 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:22.380864 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:22.381877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:22.381877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:22.381877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:22.381877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:22.381877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:22.381877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:22.381877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:22.381877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:22.381877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:22.381877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:22.381877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:51:22.381877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:22.382692 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 213/421] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:51:22.388598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46e4ea-0206-4b06-8f11-a78f25109441 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:22.398608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657148d5-2fa5-4387-bbbc-5975470447dd None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:22.450799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724214d-f0bb-491e-a889-c65408ec0706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:22.451813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724214d-f0bb-491e-a889-c65408ec0706 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:22.452279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724214d-f0bb-491e-a889-c65408ec0706 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:22.452733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724214d-f0bb-491e-a889-c65408ec0706 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:22.453668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724214d-f0bb-491e-a889-c65408ec0706 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:22.454283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724214d-f0bb-491e-a889-c65408ec0706 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:22.455867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724214d-f0bb-491e-a889-c65408ec0706 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:22.475375 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 209/422] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:22.482206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724214d-f0bb-491e-a889-c65408ec0706 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:22.592992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46e4ea-0206-4b06-8f11-a78f25109441 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:22.606728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724214d-f0bb-491e-a889-c65408ec0706 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:22.634530 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:22.646138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5503e7-a6ca-44a3-8fd8-fb99880476de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:22.647275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5503e7-a6ca-44a3-8fd8-fb99880476de None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:22.648056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5503e7-a6ca-44a3-8fd8-fb99880476de None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:22.648716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5503e7-a6ca-44a3-8fd8-fb99880476de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:22.673502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd89283-de26-49eb-8044-f4ef5a9a3c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:22.674588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd89283-de26-49eb-8044-f4ef5a9a3c92 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:22.676570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd89283-de26-49eb-8044-f4ef5a9a3c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:22.677082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd89283-de26-49eb-8044-f4ef5a9a3c92 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:22.679854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd89283-de26-49eb-8044-f4ef5a9a3c92 None admin] RBAC: Adding query filter params (name=member) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:22.680460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd89283-de26-49eb-8044-f4ef5a9a3c92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:22.682985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd89283-de26-49eb-8044-f4ef5a9a3c92 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:22.693957 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 214/423] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:51:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:22.703069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd89283-de26-49eb-8044-f4ef5a9a3c92 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:22.750679 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:22.764749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5503e7-a6ca-44a3-8fd8-fb99880476de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:22.766319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5503e7-a6ca-44a3-8fd8-fb99880476de None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:22.826310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd89283-de26-49eb-8044-f4ef5a9a3c92 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:22.894343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0aad5c-f7ed-498a-bfaa-c226cc6369c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:22.895325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aad5c-f7ed-498a-bfaa-c226cc6369c4 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:22.895972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aad5c-f7ed-498a-bfaa-c226cc6369c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:22.898772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0aad5c-f7ed-498a-bfaa-c226cc6369c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:22.970428 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 210/424] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:22.971965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5503e7-a6ca-44a3-8fd8-fb99880476de None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:23.014470 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:23.039642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0aad5c-f7ed-498a-bfaa-c226cc6369c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:23.041855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0aad5c-f7ed-498a-bfaa-c226cc6369c4 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:23.110845 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:23.154285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5503e7-a6ca-44a3-8fd8-fb99880476de None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:23.228828 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 215/425] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:23.228990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7dfef-f923-4e3f-9b52-c2d9305d6d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:23.229857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7dfef-f923-4e3f-9b52-c2d9305d6d8d None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:23.234173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7dfef-f923-4e3f-9b52-c2d9305d6d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:23.234173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb7dfef-f923-4e3f-9b52-c2d9305d6d8d None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:23.235271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0aad5c-f7ed-498a-bfaa-c226cc6369c4 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:23.236073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7dfef-f923-4e3f-9b52-c2d9305d6d8d None admin] RBAC: Authorizing `identity:get_project(project_id=488e2680f33948a99baf67e759f3e3fe)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:23.237664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb7dfef-f923-4e3f-9b52-c2d9305d6d8d None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:23.250364 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 211/426] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:51:22 2022] GET /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:23.254523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7dfef-f923-4e3f-9b52-c2d9305d6d8d None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:23.398465 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:23.409760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb7dfef-f923-4e3f-9b52-c2d9305d6d8d None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:23.461238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2998993-1a34-4c21-873b-9c0039fd8f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:23.462237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2998993-1a34-4c21-873b-9c0039fd8f58 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:23.462522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2998993-1a34-4c21-873b-9c0039fd8f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:23.462800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2998993-1a34-4c21-873b-9c0039fd8f58 None admin] PATH_INFO: `/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:23.464032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2998993-1a34-4c21-873b-9c0039fd8f58 None admin] RBAC: Authorizing `identity:get_group(group_id=df068e9a5b4a4a06bef2f78bf02f55aa)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:23.465540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2998993-1a34-4c21-873b-9c0039fd8f58 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:23.469060 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 212/427] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 19 13:51:23 2022] GET /identity/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:23.473993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2998993-1a34-4c21-873b-9c0039fd8f58 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:23.490032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0aad5c-f7ed-498a-bfaa-c226cc6369c4 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:23.522465 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:23.534113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ea7f6-61be-4f9d-b95f-72398b64b336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:23.534995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ea7f6-61be-4f9d-b95f-72398b64b336 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:23.535281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ea7f6-61be-4f9d-b95f-72398b64b336 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:23.535559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ea7f6-61be-4f9d-b95f-72398b64b336 None admin] PATH_INFO: `/v3/projects/488e2680f33948a99baf67e759f3e3fe` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:23.538261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ea7f6-61be-4f9d-b95f-72398b64b336 None admin] RBAC: Authorizing `identity:get_project(project_id=488e2680f33948a99baf67e759f3e3fe)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:23.540317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ea7f6-61be-4f9d-b95f-72398b64b336 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:23.542170 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 216/428] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:51:23 2022] GET /identity/v3/projects/488e2680f33948a99baf67e759f3e3fe => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:23.548508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ea7f6-61be-4f9d-b95f-72398b64b336 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:23.654940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2998993-1a34-4c21-873b-9c0039fd8f58 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:23.668462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ea7f6-61be-4f9d-b95f-72398b64b336 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:23.699341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b673e1-9960-4eea-8232-51ceb713c0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:23.700387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b673e1-9960-4eea-8232-51ceb713c0fc None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:23.700864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b673e1-9960-4eea-8232-51ceb713c0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:23.701332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b673e1-9960-4eea-8232-51ceb713c0fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:23.702423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b673e1-9960-4eea-8232-51ceb713c0fc None admin] RBAC: Adding query filter params (group.id=df068e9a5b4a4a06bef2f78bf02f55aa, role.id=b73e411ed06b463fb578c06789886960, scope.project.id=488e2680f33948a99baf67e759f3e3fe) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:23.702967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b673e1-9960-4eea-8232-51ceb713c0fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:23.704577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b673e1-9960-4eea-8232-51ceb713c0fc None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:23.708696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7533d2-3365-4ce3-99b1-e36d2d9813e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:23.709843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7533d2-3365-4ce3-99b1-e36d2d9813e6 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:23.710154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7533d2-3365-4ce3-99b1-e36d2d9813e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:23.710441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7533d2-3365-4ce3-99b1-e36d2d9813e6 None admin] PATH_INFO: `/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:23.711699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7533d2-3365-4ce3-99b1-e36d2d9813e6 None admin] RBAC: Authorizing `identity:get_group(group_id=df068e9a5b4a4a06bef2f78bf02f55aa)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:23.712803 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 213/429] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jul 19 13:51:23 2022] GET /identity/v3/role_assignments?group.id=df068e9a5b4a4a06bef2f78bf02f55aa&scope.project.id=488e2680f33948a99baf67e759f3e3fe&role.id=b73e411ed06b463fb578c06789886960 => generated 611 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:23.713148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7533d2-3365-4ce3-99b1-e36d2d9813e6 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:23.714601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bce07-c5a1-4bea-9056-6888d5156ac8 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:23.715113 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 217/430] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 19 13:51:23 2022] GET /identity/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:23.715218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bce07-c5a1-4bea-9056-6888d5156ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:23.715682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bce07-c5a1-4bea-9056-6888d5156ac8 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:23.717221 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 214/431] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:23.721333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7533d2-3365-4ce3-99b1-e36d2d9813e6 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:23.723017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7583778-903a-40df-af34-57be928c4f84 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:23.723541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7583778-903a-40df-af34-57be928c4f84 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:23.724013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7583778-903a-40df-af34-57be928c4f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:23.742699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b7583778-903a-40df-af34-57be928c4f84 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:23.744350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b7583778-903a-40df-af34-57be928c4f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:23.779775 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:23.863444 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:23.888814 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 215/432] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:23.900525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7533d2-3365-4ce3-99b1-e36d2d9813e6 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:23.916922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7583778-903a-40df-af34-57be928c4f84 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:23.945467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35b034-76ae-4439-9abf-e5cee1f07ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:23.947375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35b034-76ae-4439-9abf-e5cee1f07ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:23.948145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35b034-76ae-4439-9abf-e5cee1f07ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:23.948650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35b034-76ae-4439-9abf-e5cee1f07ee5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:23.950372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35b034-76ae-4439-9abf-e5cee1f07ee5 None admin] RBAC: Adding query filter params (group.id=df068e9a5b4a4a06bef2f78bf02f55aa, role.id=e17d8526e56c4d319080a377398b9c74, scope.project.id=488e2680f33948a99baf67e759f3e3fe) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:23.950707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35b034-76ae-4439-9abf-e5cee1f07ee5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:23.952877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35b034-76ae-4439-9abf-e5cee1f07ee5 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:23.962939 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 218/433] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jul 19 13:51:23 2022] GET /identity/v3/role_assignments?group.id=df068e9a5b4a4a06bef2f78bf02f55aa&scope.project.id=488e2680f33948a99baf67e759f3e3fe&role.id=e17d8526e56c4d319080a377398b9c74 => generated 611 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:24.051556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7583778-903a-40df-af34-57be928c4f84 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:24.095542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6a40c-fd7e-4d62-a275-9c7c73b1da8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:24.096374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6a40c-fd7e-4d62-a275-9c7c73b1da8c None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:24.096659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6a40c-fd7e-4d62-a275-9c7c73b1da8c None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:24.096935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa6a40c-fd7e-4d62-a275-9c7c73b1da8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:24.112927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa6a40c-fd7e-4d62-a275-9c7c73b1da8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:24.118266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fc94d-072c-4be9-bec9-25d75b3b58be None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:24.118817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fc94d-072c-4be9-bec9-25d75b3b58be None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:24.118817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fc94d-072c-4be9-bec9-25d75b3b58be None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:24.120639 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 219/434] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:24.122984 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-caa6a40c-fd7e-4d62-a275-9c7c73b1da8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:51:24.122984 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:24.122984 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:24.122984 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:24.122984 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:24.122984 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:24.122984 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:24.122984 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:24.122984 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:24.122984 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:24.122984 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:24.122984 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:24.122984 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:24.122984 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:24.122984 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:24.122984 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:24.123981 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:24.123981 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:24.123981 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:24.123981 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:24.123981 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:24.123981 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:24.123981 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:24.123981 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:24.123981 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:24.123981 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:24.123981 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:24.123981 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:24.123981 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:24.123981 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:24.123981 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:24.123981 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:24.124788 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:24.124788 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:24.124788 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:24.124788 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:24.124788 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:24.124788 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:24.124788 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:24.124788 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:24.124788 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:24.124788 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:24.124788 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 13:51:24.124788 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:24.124788 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 216/435] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:51:24.129058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a92f6-ca3b-4db1-b2bc-4977d2fbe333 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:24.134761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a92f6-ca3b-4db1-b2bc-4977d2fbe333 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:24.134761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a92f6-ca3b-4db1-b2bc-4977d2fbe333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:24.134928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6a40c-fd7e-4d62-a275-9c7c73b1da8c None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:24.149145 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:24.159046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-223a92f6-ca3b-4db1-b2bc-4977d2fbe333 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:24.160289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-223a92f6-ca3b-4db1-b2bc-4977d2fbe333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:24.261622 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 220/436] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:24.270291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa6a40c-fd7e-4d62-a275-9c7c73b1da8c None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:24.275177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90490213-0b75-46da-ab54-e866889b5f35 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:24.275652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90490213-0b75-46da-ab54-e866889b5f35 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:24.275940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90490213-0b75-46da-ab54-e866889b5f35 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:24.277312 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 221/437] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:51:24.283471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d41af-4d34-4007-9d56-bd727422ea04 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:24.283826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d41af-4d34-4007-9d56-bd727422ea04 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:24.284175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d41af-4d34-4007-9d56-bd727422ea04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:24.303403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e03d41af-4d34-4007-9d56-bd727422ea04 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:24.304618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e03d41af-4d34-4007-9d56-bd727422ea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:24.314011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504c418-c3a4-4829-b7dd-4b33633660a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:24.314728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504c418-c3a4-4829-b7dd-4b33633660a3 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:24.315015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504c418-c3a4-4829-b7dd-4b33633660a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:24.315295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504c418-c3a4-4829-b7dd-4b33633660a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:24.316053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504c418-c3a4-4829-b7dd-4b33633660a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:24.316366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504c418-c3a4-4829-b7dd-4b33633660a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:24.317746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504c418-c3a4-4829-b7dd-4b33633660a3 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:24.328507 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 217/438] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:51:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:24.330769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504c418-c3a4-4829-b7dd-4b33633660a3 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:24.374361 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:24.387584 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 222/439] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:24.388431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d41af-4d34-4007-9d56-bd727422ea04 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:24.425417 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:24.453984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504c418-c3a4-4829-b7dd-4b33633660a3 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:24.492446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8df61-8c8b-4a8a-9724-18945aeb861f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:24.494242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8df61-8c8b-4a8a-9724-18945aeb861f None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:24.494534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8df61-8c8b-4a8a-9724-18945aeb861f None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:24.494812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef8df61-8c8b-4a8a-9724-18945aeb861f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:24.510342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef8df61-8c8b-4a8a-9724-18945aeb861f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:24.513046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d41af-4d34-4007-9d56-bd727422ea04 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:24.518065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-fef8df61-8c8b-4a8a-9724-18945aeb861f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:51:24.518065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:24.518065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:24.518065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:24.518065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:24.518065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:24.518065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:24.518065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:24.518065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:24.518065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:24.518065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:24.518065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:24.518065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:24.518065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:24.518065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:24.518065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:24.518998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:24.518998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:24.518998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:24.518998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:24.518998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:24.518998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:24.518998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:24.518998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:24.518998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:24.518998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:24.518998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:24.518998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:24.518998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:24.518998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:24.518998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:24.518998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:24.519797 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:24.519797 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:24.519797 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:24.519797 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:24.519797 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:24.519797 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:24.519797 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:24.519797 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:24.519797 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:24.519797 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:24.519797 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:51:24.519797 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:24.519797 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 218/440] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:51:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:24.520451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8df61-8c8b-4a8a-9724-18945aeb861f None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:24.555861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e9e07-3b6b-45fd-bb3f-1d4ce1369d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:24.556529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e9e07-3b6b-45fd-bb3f-1d4ce1369d4d None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:24.556816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e9e07-3b6b-45fd-bb3f-1d4ce1369d4d None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:24.557097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e9e07-3b6b-45fd-bb3f-1d4ce1369d4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:24.619868 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:24.630340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e9e07-3b6b-45fd-bb3f-1d4ce1369d4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:24.631884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e9e07-3b6b-45fd-bb3f-1d4ce1369d4d None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:24.632985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef8df61-8c8b-4a8a-9724-18945aeb861f None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:24.668491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcf7ac-965e-4168-b716-423e448f8394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:24.669291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcf7ac-965e-4168-b716-423e448f8394 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:24.669573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcf7ac-965e-4168-b716-423e448f8394 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:24.669848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bcf7ac-965e-4168-b716-423e448f8394 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:24.672438 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:24.681909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bcf7ac-965e-4168-b716-423e448f8394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:24.690442 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-13bcf7ac-965e-4168-b716-423e448f8394 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:51:24.690442 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:24.690442 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:24.690442 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:24.690442 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:24.690442 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:24.690442 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:24.690442 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:24.690442 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:24.690442 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:24.690442 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:24.690442 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:24.690442 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:24.690442 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:24.690442 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:24.690442 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:24.691373 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:24.691373 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:24.691373 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:24.691373 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:24.691373 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:24.691373 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:24.691373 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:24.691373 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:24.691373 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:24.691373 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:24.691373 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:24.691373 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:24.691373 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:24.691373 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:24.691373 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:24.691373 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:24.692170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:24.692170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:24.692170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:24.692170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:24.692170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:24.692170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:24.692170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:24.692170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:24.692170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:24.692170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:24.692170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:51:24.692170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:24.692170 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 219/441] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 19 13:51:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:24.693345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcf7ac-965e-4168-b716-423e448f8394 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:24.736067 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 223/442] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:24.736898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e9e07-3b6b-45fd-bb3f-1d4ce1369d4d None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:24.793493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bcf7ac-965e-4168-b716-423e448f8394 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:24.824734 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:24.830554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed7f5b-916f-4a9d-ad05-054ce47d3387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:24.831221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed7f5b-916f-4a9d-ad05-054ce47d3387 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:24.831561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed7f5b-916f-4a9d-ad05-054ce47d3387 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:24.831774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed7f5b-916f-4a9d-ad05-054ce47d3387 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:24.832520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed7f5b-916f-4a9d-ad05-054ce47d3387 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:24.832824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed7f5b-916f-4a9d-ad05-054ce47d3387 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:24.834211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed7f5b-916f-4a9d-ad05-054ce47d3387 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:24.834466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e9e07-3b6b-45fd-bb3f-1d4ce1369d4d None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:24.842464 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 220/443] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:24.843242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed7f5b-916f-4a9d-ad05-054ce47d3387 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:24.869198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0d6cb-4552-420c-9d05-7dd90ade8a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:24.869869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0d6cb-4552-420c-9d05-7dd90ade8a2e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:24.870186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0d6cb-4552-420c-9d05-7dd90ade8a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:24.870471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0d6cb-4552-420c-9d05-7dd90ade8a2e None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:24.871226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0d6cb-4552-420c-9d05-7dd90ade8a2e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:24.871542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0d6cb-4552-420c-9d05-7dd90ade8a2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:24.872904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0d6cb-4552-420c-9d05-7dd90ade8a2e None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:24.880754 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 224/444] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:24.881528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0d6cb-4552-420c-9d05-7dd90ade8a2e None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:24.901265 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:24.942365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed7f5b-916f-4a9d-ad05-054ce47d3387 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:24.974504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077a81e-df65-4cd1-9e09-9a477be9ec66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:24.975355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077a81e-df65-4cd1-9e09-9a477be9ec66 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:24.975645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077a81e-df65-4cd1-9e09-9a477be9ec66 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:24.975920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077a81e-df65-4cd1-9e09-9a477be9ec66 None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:24.977632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077a81e-df65-4cd1-9e09-9a477be9ec66 None admin] RBAC: Authorizing `identity:get_project(project_id=2b597c406357445d8679d4b27fa90b63)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:24.979178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077a81e-df65-4cd1-9e09-9a477be9ec66 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:24.980871 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 221/445] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:51:24 2022] GET /identity/v3/projects/2b597c406357445d8679d4b27fa90b63 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:24.981622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077a81e-df65-4cd1-9e09-9a477be9ec66 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:24.982954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0d6cb-4552-420c-9d05-7dd90ade8a2e None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:25.017389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe997c-7432-4248-8d8a-ae661573b7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:25.018029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe997c-7432-4248-8d8a-ae661573b7ed None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:25.018345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe997c-7432-4248-8d8a-ae661573b7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:25.018624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe997c-7432-4248-8d8a-ae661573b7ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:25.040356 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:25.083464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077a81e-df65-4cd1-9e09-9a477be9ec66 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:25.088370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe997c-7432-4248-8d8a-ae661573b7ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:25.089970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe997c-7432-4248-8d8a-ae661573b7ed None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:25.108283 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:25.116870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9b513-789c-4c81-a31c-fd342a8db6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:25.117515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9b513-789c-4c81-a31c-fd342a8db6ec None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:25.118705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9b513-789c-4c81-a31c-fd342a8db6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:25.118988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9b513-789c-4c81-a31c-fd342a8db6ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:25.185331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9b513-789c-4c81-a31c-fd342a8db6ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:25.186790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9b513-789c-4c81-a31c-fd342a8db6ec None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:25.188379 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 225/446] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:25.189371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe997c-7432-4248-8d8a-ae661573b7ed None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:25.241056 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:25.288133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe997c-7432-4248-8d8a-ae661573b7ed None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:25.296949 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 222/447] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:25.296949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9b513-789c-4c81-a31c-fd342a8db6ec None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:25.324553 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:25.324848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0411e5c-b03d-4d60-a6df-53098adcfbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:25.325711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0411e5c-b03d-4d60-a6df-53098adcfbe1 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:25.325998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0411e5c-b03d-4d60-a6df-53098adcfbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:25.326306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0411e5c-b03d-4d60-a6df-53098adcfbe1 None admin] PATH_INFO: `/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:25.327482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0411e5c-b03d-4d60-a6df-53098adcfbe1 None admin] RBAC: Authorizing `identity:get_group(group_id=df068e9a5b4a4a06bef2f78bf02f55aa)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:25.329006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0411e5c-b03d-4d60-a6df-53098adcfbe1 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:25.335308 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 226/448] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 19 13:51:25 2022] GET /identity/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:25.335308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0411e5c-b03d-4d60-a6df-53098adcfbe1 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:25.395908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9b513-789c-4c81-a31c-fd342a8db6ec None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:25.429220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8930f1-2dd8-49b9-a24b-77eaca550a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:25.430078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8930f1-2dd8-49b9-a24b-77eaca550a12 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:25.430961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8930f1-2dd8-49b9-a24b-77eaca550a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:25.431244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8930f1-2dd8-49b9-a24b-77eaca550a12 None admin] PATH_INFO: `/v3/projects/11ee5637d3dd4cec833ee8254662fa0b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:25.432439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8930f1-2dd8-49b9-a24b-77eaca550a12 None admin] RBAC: Authorizing `identity:get_project(project_id=11ee5637d3dd4cec833ee8254662fa0b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:25.433216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0411e5c-b03d-4d60-a6df-53098adcfbe1 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:25.433882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8930f1-2dd8-49b9-a24b-77eaca550a12 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:25.435730 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 223/449] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:51:25 2022] GET /identity/v3/projects/11ee5637d3dd4cec833ee8254662fa0b => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:25.436488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8930f1-2dd8-49b9-a24b-77eaca550a12 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:25.453613 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:25.467028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473863f-e964-406d-82fd-317477c7e9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:25.467895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473863f-e964-406d-82fd-317477c7e9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:25.468175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473863f-e964-406d-82fd-317477c7e9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:25.468455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473863f-e964-406d-82fd-317477c7e9b4 None admin] PATH_INFO: `/v3/projects/2b597c406357445d8679d4b27fa90b63` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:25.477445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473863f-e964-406d-82fd-317477c7e9b4 None admin] RBAC: Authorizing `identity:get_project(project_id=2b597c406357445d8679d4b27fa90b63)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:25.477445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473863f-e964-406d-82fd-317477c7e9b4 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:25.477445 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 227/450] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:51:25 2022] GET /identity/v3/projects/2b597c406357445d8679d4b27fa90b63 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:25.477445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473863f-e964-406d-82fd-317477c7e9b4 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:25.529738 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:25.535954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8930f1-2dd8-49b9-a24b-77eaca550a12 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:25.569798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70272a8-f283-4200-ac3b-6525d0848eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:25.570474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70272a8-f283-4200-ac3b-6525d0848eb7 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:25.570759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70272a8-f283-4200-ac3b-6525d0848eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:25.571139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70272a8-f283-4200-ac3b-6525d0848eb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:25.572067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70272a8-f283-4200-ac3b-6525d0848eb7 None admin] RBAC: Adding query filter params (group.id=df068e9a5b4a4a06bef2f78bf02f55aa, role.id=e17d8526e56c4d319080a377398b9c74, scope.project.id=2b597c406357445d8679d4b27fa90b63) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:25.572377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70272a8-f283-4200-ac3b-6525d0848eb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:25.573795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70272a8-f283-4200-ac3b-6525d0848eb7 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:25.576043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473863f-e964-406d-82fd-317477c7e9b4 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:25.579506 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 224/451] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jul 19 13:51:25 2022] GET /identity/v3/role_assignments?group.id=df068e9a5b4a4a06bef2f78bf02f55aa&scope.project.id=2b597c406357445d8679d4b27fa90b63&role.id=e17d8526e56c4d319080a377398b9c74 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:25.580268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70272a8-f283-4200-ac3b-6525d0848eb7 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:25.614772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a770e2-dfc1-4a1a-9eb4-f0e5ac4abff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:25.615573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a770e2-dfc1-4a1a-9eb4-f0e5ac4abff7 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:25.616393 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a770e2-dfc1-4a1a-9eb4-f0e5ac4abff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:25.616393 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a770e2-dfc1-4a1a-9eb4-f0e5ac4abff7 None admin] PATH_INFO: `/v3/groups/f71497dd3edc43c89513acef547abb90` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:25.617479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a770e2-dfc1-4a1a-9eb4-f0e5ac4abff7 None admin] RBAC: Authorizing `identity:get_group(group_id=f71497dd3edc43c89513acef547abb90)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:25.619106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a770e2-dfc1-4a1a-9eb4-f0e5ac4abff7 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:25.620806 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 228/452] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 19 13:51:25 2022] GET /identity/v3/groups/f71497dd3edc43c89513acef547abb90 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:25.631391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a770e2-dfc1-4a1a-9eb4-f0e5ac4abff7 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:25.697519 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:25.706353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70272a8-f283-4200-ac3b-6525d0848eb7 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:25.745670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627b3a9-a0b5-4cad-b488-f4b60c59cd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:25.746571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627b3a9-a0b5-4cad-b488-f4b60c59cd92 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:25.746862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627b3a9-a0b5-4cad-b488-f4b60c59cd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:25.747050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a770e2-dfc1-4a1a-9eb4-f0e5ac4abff7 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:25.747170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3627b3a9-a0b5-4cad-b488-f4b60c59cd92 None admin] PATH_INFO: `/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:25.749150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627b3a9-a0b5-4cad-b488-f4b60c59cd92 None admin] RBAC: Authorizing `identity:get_group(group_id=df068e9a5b4a4a06bef2f78bf02f55aa)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:25.749783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3627b3a9-a0b5-4cad-b488-f4b60c59cd92 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:25.752577 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 225/453] 10.222.0.43 () {56 vars in 1180 bytes} [Tue Jul 19 13:51:25 2022] GET /identity/v3/groups/df068e9a5b4a4a06bef2f78bf02f55aa => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:25.759152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627b3a9-a0b5-4cad-b488-f4b60c59cd92 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:25.784126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e032e-edfc-4559-b0d5-646f0eee33a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:25.784754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e032e-edfc-4559-b0d5-646f0eee33a8 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:25.785043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e032e-edfc-4559-b0d5-646f0eee33a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:25.785322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e032e-edfc-4559-b0d5-646f0eee33a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:25.786237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e032e-edfc-4559-b0d5-646f0eee33a8 None admin] RBAC: Adding query filter params (group.id=f71497dd3edc43c89513acef547abb90, role.id=bc315edf089d43b18acf9790031f3fcb, scope.project.id=11ee5637d3dd4cec833ee8254662fa0b) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:25.786558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e032e-edfc-4559-b0d5-646f0eee33a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:25.787973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e032e-edfc-4559-b0d5-646f0eee33a8 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:25.791938 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:25.794698 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 229/454] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jul 19 13:51:25 2022] GET /identity/v3/role_assignments?group.id=f71497dd3edc43c89513acef547abb90&scope.project.id=11ee5637d3dd4cec833ee8254662fa0b&role.id=bc315edf089d43b18acf9790031f3fcb => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:25.884976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3627b3a9-a0b5-4cad-b488-f4b60c59cd92 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:25.923379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd688f-f11c-4eae-a39d-76e8393d3da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:25.924393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd688f-f11c-4eae-a39d-76e8393d3da4 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:25.924877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd688f-f11c-4eae-a39d-76e8393d3da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:25.925160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd688f-f11c-4eae-a39d-76e8393d3da4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:25.926023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd688f-f11c-4eae-a39d-76e8393d3da4 None admin] RBAC: Adding query filter params (group.id=df068e9a5b4a4a06bef2f78bf02f55aa, role.id=b73e411ed06b463fb578c06789886960, scope.project.id=2b597c406357445d8679d4b27fa90b63) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:25.926395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd688f-f11c-4eae-a39d-76e8393d3da4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:25.927866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bd688f-f11c-4eae-a39d-76e8393d3da4 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:25.936080 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 226/455] 10.222.0.43 () {56 vars in 1376 bytes} [Tue Jul 19 13:51:25 2022] GET /identity/v3/role_assignments?group.id=df068e9a5b4a4a06bef2f78bf02f55aa&scope.project.id=2b597c406357445d8679d4b27fa90b63&role.id=b73e411ed06b463fb578c06789886960 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:28.617559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4fd01-bdf1-46e6-8349-f006096f4a53 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:28.619068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4fd01-bdf1-46e6-8349-f006096f4a53 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:28.619577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4fd01-bdf1-46e6-8349-f006096f4a53 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:28.621368 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 230/456] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:28.627205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4ca2f-a1e3-4fcb-8a31-bf287266da49 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:28.627686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4ca2f-a1e3-4fcb-8a31-bf287266da49 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:28.627779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d4ca2f-a1e3-4fcb-8a31-bf287266da49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:28.650340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-97d4ca2f-a1e3-4fcb-8a31-bf287266da49 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:28.651543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-97d4ca2f-a1e3-4fcb-8a31-bf287266da49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:28.743423 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 227/457] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:28.768415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df8d15-1781-4f94-8947-32849a592569 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:28.768708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df8d15-1781-4f94-8947-32849a592569 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:28.768990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df8d15-1781-4f94-8947-32849a592569 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:28.770645 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 231/458] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:28.776001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d65dd-8570-49ec-99cd-8c8302b3c8c8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:28.776293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d65dd-8570-49ec-99cd-8c8302b3c8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:28.776574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d65dd-8570-49ec-99cd-8c8302b3c8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:28.793937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-546d65dd-8570-49ec-99cd-8c8302b3c8c8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:28.795535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df8d15-1781-4f94-8947-32849a592569 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:28.796926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-546d65dd-8570-49ec-99cd-8c8302b3c8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:28.831347 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:28.894674 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 228/459] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:28.896414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b7c46-04a8-4015-b2c8-c45ae80a8da8 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:28.896908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b7c46-04a8-4015-b2c8-c45ae80a8da8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:28.897386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736b7c46-04a8-4015-b2c8-c45ae80a8da8 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:28.903325 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 229/460] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:28.904830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6eb278-6f82-4bc7-81b2-ad9c52171031 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:28.905322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6eb278-6f82-4bc7-81b2-ad9c52171031 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:28.905798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6eb278-6f82-4bc7-81b2-ad9c52171031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:28.923459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-bb6eb278-6f82-4bc7-81b2-ad9c52171031 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:28.924986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bb6eb278-6f82-4bc7-81b2-ad9c52171031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:28.951132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df8d15-1781-4f94-8947-32849a592569 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:28.982033 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:29.002786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe126fbe-8bf9-4a2d-b700-4f7e0735955e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:29.004164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe126fbe-8bf9-4a2d-b700-4f7e0735955e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:29.004741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe126fbe-8bf9-4a2d-b700-4f7e0735955e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:29.005245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe126fbe-8bf9-4a2d-b700-4f7e0735955e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:29.005733 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 230/461] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:29.014465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6eb278-6f82-4bc7-81b2-ad9c52171031 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:29.018698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe126fbe-8bf9-4a2d-b700-4f7e0735955e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:29.021187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe126fbe-8bf9-4a2d-b700-4f7e0735955e None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:29.042724 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-fe126fbe-8bf9-4a2d-b700-4f7e0735955e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:29.042724 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:29.042724 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:29.042724 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:29.042724 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:29.042724 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:29.042724 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:29.042724 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:29.042724 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:29.042724 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:29.042724 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:29.042724 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:29.042724 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:29.042724 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:29.042724 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:29.043630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:29.043630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:29.043630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:29.043630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:29.043630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:29.043630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:29.043630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:29.043630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:29.043630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:29.043630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:29.043630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:29.043630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:29.043630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:29.043630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:29.043630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:29.043630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:29.043630 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:29.044494 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:29.044494 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:29.044494 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:29.044494 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:29.047046 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 232/462] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:51:29.052251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe126fbe-8bf9-4a2d-b700-4f7e0735955e None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:29.139988 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:29.164252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6eb278-6f82-4bc7-81b2-ad9c52171031 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:29.193198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe126fbe-8bf9-4a2d-b700-4f7e0735955e None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:29.204412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a118bf-a4ce-4749-b11a-a650ecc699b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:29.205609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a118bf-a4ce-4749-b11a-a650ecc699b4 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:29.206118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a118bf-a4ce-4749-b11a-a650ecc699b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:29.206661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a118bf-a4ce-4749-b11a-a650ecc699b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:29.222350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a118bf-a4ce-4749-b11a-a650ecc699b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:29.224210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a118bf-a4ce-4749-b11a-a650ecc699b4 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:29.246888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba626c68-08e4-4104-86c6-f8cb20643aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:29.247755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba626c68-08e4-4104-86c6-f8cb20643aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:29.248155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba626c68-08e4-4104-86c6-f8cb20643aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:29.248438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba626c68-08e4-4104-86c6-f8cb20643aa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:29.248816 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-44a118bf-a4ce-4749-b11a-a650ecc699b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:29.248816 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:29.248816 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:29.248816 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:29.248816 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:29.248816 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:29.248816 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:29.248816 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:29.248816 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:29.248816 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:29.248816 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:29.248816 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:29.248816 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:29.248816 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:29.248816 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:29.249664 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:29.249664 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:29.249664 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:29.249664 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:29.249664 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:29.249664 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:29.249664 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:29.249664 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:29.249664 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:29.249664 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:29.249664 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:29.249664 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:29.249664 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:29.249664 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:29.249664 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:29.249664 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:29.249664 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:29.250537 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:29.250537 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:29.250537 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:29.250537 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:29.252711 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 231/463] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:29.253697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a118bf-a4ce-4749-b11a-a650ecc699b4 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:29.268928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba626c68-08e4-4104-86c6-f8cb20643aa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:29.270524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba626c68-08e4-4104-86c6-f8cb20643aa1 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:29.289384 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-ba626c68-08e4-4104-86c6-f8cb20643aa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:29.289384 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:29.289384 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:29.289384 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:29.289384 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:29.289384 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:29.289384 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:29.289384 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:29.289384 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:29.289384 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:29.289384 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:29.289384 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:29.289384 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:29.289384 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:29.289384 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:29.291104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:29.291104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:29.291104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:29.291104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:29.291104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:29.291104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:29.291104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:29.291104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:29.291104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:29.291104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:29.291104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:29.291104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:29.291104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:29.291104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:29.291104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:29.291104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:29.291104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:29.292475 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:29.292475 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:29.292475 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:29.292475 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:29.292475 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 233/464] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:51:29.292475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba626c68-08e4-4104-86c6-f8cb20643aa1 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:29.324756 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:29.365911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a118bf-a4ce-4749-b11a-a650ecc699b4 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:29.398666 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:29.401668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba626c68-08e4-4104-86c6-f8cb20643aa1 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:29.405318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c431d5-ae85-4a31-a27a-860be35ce0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:29.406074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c431d5-ae85-4a31-a27a-860be35ce0f4 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:29.406563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c431d5-ae85-4a31-a27a-860be35ce0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:29.407016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c431d5-ae85-4a31-a27a-860be35ce0f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:29.408010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c431d5-ae85-4a31-a27a-860be35ce0f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:29.408521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c431d5-ae85-4a31-a27a-860be35ce0f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:29.410211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c431d5-ae85-4a31-a27a-860be35ce0f4 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:29.423094 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 232/465] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:29.428597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5edf5-9a95-47d4-8a4c-f0b10746a276 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:29.428947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5edf5-9a95-47d4-8a4c-f0b10746a276 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:29.429175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5edf5-9a95-47d4-8a4c-f0b10746a276 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:29.431199 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 233/466] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:29.431735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5edf5-9a95-47d4-8a4c-f0b10746a276 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:29.442721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65e5c4-a413-4a80-963d-f8e099beaae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:29.443392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65e5c4-a413-4a80-963d-f8e099beaae6 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:29.445925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65e5c4-a413-4a80-963d-f8e099beaae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:29.445925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65e5c4-a413-4a80-963d-f8e099beaae6 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:29.445925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65e5c4-a413-4a80-963d-f8e099beaae6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:29.445925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65e5c4-a413-4a80-963d-f8e099beaae6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:29.446400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65e5c4-a413-4a80-963d-f8e099beaae6 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:29.469771 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 234/467] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:29.469771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65e5c4-a413-4a80-963d-f8e099beaae6 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:29.548583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5edf5-9a95-47d4-8a4c-f0b10746a276 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:29.559391 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:29.578067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65e5c4-a413-4a80-963d-f8e099beaae6 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:29.586009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16254521-8835-4a0a-aedb-959655482036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:29.587437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16254521-8835-4a0a-aedb-959655482036 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:29.587730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16254521-8835-4a0a-aedb-959655482036 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:29.588009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16254521-8835-4a0a-aedb-959655482036 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:29.588743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16254521-8835-4a0a-aedb-959655482036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:29.589052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16254521-8835-4a0a-aedb-959655482036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:29.590489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16254521-8835-4a0a-aedb-959655482036 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:29.607455 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 234/468] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:29.607455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c40d3-0702-4b8a-9177-c826c634a758 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:29.607455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c40d3-0702-4b8a-9177-c826c634a758 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:29.607455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c40d3-0702-4b8a-9177-c826c634a758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:29.617044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63436d00-d0b7-41cb-a696-e782aebc0c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:29.617747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63436d00-d0b7-41cb-a696-e782aebc0c67 None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:29.618486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63436d00-d0b7-41cb-a696-e782aebc0c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:29.618486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63436d00-d0b7-41cb-a696-e782aebc0c67 None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:29.619202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63436d00-d0b7-41cb-a696-e782aebc0c67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:29.620658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63436d00-d0b7-41cb-a696-e782aebc0c67 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:29.624217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-974c40d3-0702-4b8a-9177-c826c634a758 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:29.625448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-974c40d3-0702-4b8a-9177-c826c634a758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:29.674771 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:29.694316 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 235/469] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:29.697926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c40d3-0702-4b8a-9177-c826c634a758 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:29.724591 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 235/470] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 19 13:51:29 2022] POST /identity/v3/users => generated 248 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:51:29.725537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63436d00-d0b7-41cb-a696-e782aebc0c67 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:29.837125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c40d3-0702-4b8a-9177-c826c634a758 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:29.854819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63436d00-d0b7-41cb-a696-e782aebc0c67 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:29.876621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2d773-7e27-45b7-8f9d-8c0ba40b999e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:29.877606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2d773-7e27-45b7-8f9d-8c0ba40b999e None admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:29.878159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2d773-7e27-45b7-8f9d-8c0ba40b999e None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:29.878583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf2d773-7e27-45b7-8f9d-8c0ba40b999e None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:29.879503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2d773-7e27-45b7-8f9d-8c0ba40b999e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:29.881141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf2d773-7e27-45b7-8f9d-8c0ba40b999e None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:29.899961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38233cad-fd04-4cb4-b1b2-69a366db1287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:29.900985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38233cad-fd04-4cb4-b1b2-69a366db1287 None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:29.901269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38233cad-fd04-4cb4-b1b2-69a366db1287 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:29.908207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38233cad-fd04-4cb4-b1b2-69a366db1287 None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:29.908207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38233cad-fd04-4cb4-b1b2-69a366db1287 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:29.908207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38233cad-fd04-4cb4-b1b2-69a366db1287 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:29.913780 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:29.964812 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 236/471] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 19 13:51:29 2022] POST /identity/v3/users => generated 248 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:51:29.965711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2d773-7e27-45b7-8f9d-8c0ba40b999e None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:29.994014 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 236/472] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 19 13:51:29 2022] POST /identity/v3/users => generated 246 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:51:30.027764 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:30.085300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95196baa-1c90-4dc5-91d3-11e7955f36d1 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:30.085617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95196baa-1c90-4dc5-91d3-11e7955f36d1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:30.085870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95196baa-1c90-4dc5-91d3-11e7955f36d1 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:30.088449 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 237/473] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:30.101072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5177e9-b246-4300-82d3-48f2efe4e675 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:30.101741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5177e9-b246-4300-82d3-48f2efe4e675 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:30.102082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5177e9-b246-4300-82d3-48f2efe4e675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:30.113039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf2d773-7e27-45b7-8f9d-8c0ba40b999e None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:30.138939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4c5177e9-b246-4300-82d3-48f2efe4e675 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:30.140836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4c5177e9-b246-4300-82d3-48f2efe4e675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:30.189158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc3289-f71c-45e7-b55a-4466b5049733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:30.190327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc3289-f71c-45e7-b55a-4466b5049733 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:30.190823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc3289-f71c-45e7-b55a-4466b5049733 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:30.191291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc3289-f71c-45e7-b55a-4466b5049733 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:30.207229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc3289-f71c-45e7-b55a-4466b5049733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:30.209693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcc3289-f71c-45e7-b55a-4466b5049733 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:30.238515 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-0fcc3289-f71c-45e7-b55a-4466b5049733 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:30.238515 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:30.238515 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:30.238515 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:30.238515 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:30.238515 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:30.238515 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:30.238515 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:30.238515 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:30.238515 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:30.238515 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:30.238515 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:30.238515 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:30.238515 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:30.238515 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:30.239598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:30.239598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:30.239598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:30.239598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:30.239598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:30.239598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:30.239598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:30.239598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:30.239598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:30.239598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:30.239598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:30.239598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:30.239598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:30.239598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:30.239598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:30.239598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:30.239598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:30.240657 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:30.240657 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:30.240657 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:30.240657 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:30.242555 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 237/474] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:30.252815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc3289-f71c-45e7-b55a-4466b5049733 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:30.266047 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 238/475] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:51:30.290849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5177e9-b246-4300-82d3-48f2efe4e675 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:30.365344 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:30.376529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc3289-f71c-45e7-b55a-4466b5049733 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:30.415157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5177e9-b246-4300-82d3-48f2efe4e675 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:30.421619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21eec1c-6e90-46f1-8172-df633c92d983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:30.422326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21eec1c-6e90-46f1-8172-df633c92d983 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:30.422615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21eec1c-6e90-46f1-8172-df633c92d983 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:30.422896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21eec1c-6e90-46f1-8172-df633c92d983 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:30.424196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21eec1c-6e90-46f1-8172-df633c92d983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:30.424509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21eec1c-6e90-46f1-8172-df633c92d983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:30.426515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21eec1c-6e90-46f1-8172-df633c92d983 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:30.443816 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:30.444002 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 238/476] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:30.451950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21eec1c-6e90-46f1-8172-df633c92d983 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:30.455549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fabf1-da13-4b1d-ae3e-8c5f92c5d29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:30.456403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fabf1-da13-4b1d-ae3e-8c5f92c5d29f None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:30.459726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fabf1-da13-4b1d-ae3e-8c5f92c5d29f None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:30.459726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165fabf1-da13-4b1d-ae3e-8c5f92c5d29f None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:30.459726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fabf1-da13-4b1d-ae3e-8c5f92c5d29f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:30.459726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165fabf1-da13-4b1d-ae3e-8c5f92c5d29f None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:30.505466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.sql.core [None req-165fabf1-da13-4b1d-ae3e-8c5f92c5d29f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 19 13:51:30.505466 n-d-master-1 devstack@keystone.service[80680]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 19 13:51:30.505466 n-d-master-1 devstack@keystone.service[80680]: [parameters: {'id': '7009840f3a614fa2a94dae45c786e526', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 19 13:51:30.505466 n-d-master-1 devstack@keystone.service[80680]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80680) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 13:51:30.536854 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-165fabf1-da13-4b1d-ae3e-8c5f92c5d29f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 19 13:51:30.536854 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:30.536854 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 13:51:30.536854 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 13:51:30.536854 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 13:51:30.536854 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 13:51:30.536854 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 13:51:30.536854 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 13:51:30.536854 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 13:51:30.536854 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application conn.query(q) Jul 19 13:51:30.536854 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 13:51:30.536854 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 13:51:30.536854 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 13:51:30.536854 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application result.read() Jul 19 13:51:30.536854 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 13:51:30.537849 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 13:51:30.537849 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 13:51:30.537849 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 13:51:30.537849 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 13:51:30.537849 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 13:51:30.537849 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 13:51:30.537849 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 13:51:30.537849 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 19 13:51:30.537849 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:30.537849 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 13:51:30.537849 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:30.537849 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:30.537849 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 13:51:30.537849 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 13:51:30.537849 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 19 13:51:30.537849 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return ref.to_dict() Jul 19 13:51:30.537849 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 13:51:30.537849 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application next(self.gen) Jul 19 13:51:30.538866 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 13:51:30.538866 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application yield resource Jul 19 13:51:30.538866 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 13:51:30.538866 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application next(self.gen) Jul 19 13:51:30.538866 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 13:51:30.538866 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 13:51:30.538866 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 13:51:30.538866 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 13:51:30.538866 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 13:51:30.538866 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise self.value Jul 19 13:51:30.538866 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 13:51:30.538866 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 13:51:30.538866 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 13:51:30.538866 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application session.commit() Jul 19 13:51:30.538866 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 13:51:30.538866 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 13:51:30.538866 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 13:51:30.539770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 13:51:30.539770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 13:51:30.539770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.session.flush() Jul 19 13:51:30.539770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 13:51:30.539770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 13:51:30.539770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 13:51:30.539770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 13:51:30.539770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 13:51:30.539770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application compat.raise_( Jul 19 13:51:30.539770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 13:51:30.539770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception Jul 19 13:51:30.539770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 13:51:30.539770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 13:51:30.539770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 13:51:30.539770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 13:51:30.539770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 13:51:30.539770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 13:51:30.540683 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 13:51:30.540683 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 13:51:30.540683 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 19 13:51:30.540683 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 19 13:51:30.540683 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 13:51:30.540683 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 13:51:30.540683 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 13:51:30.540683 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 13:51:30.540683 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 13:51:30.540683 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 13:51:30.540683 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 13:51:30.540683 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 13:51:30.540683 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 13:51:30.540683 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 13:51:30.540683 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 13:51:30.540683 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception Jul 19 13:51:30.541518 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 13:51:30.541518 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 13:51:30.541518 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 13:51:30.541518 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 13:51:30.541518 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 13:51:30.541518 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 13:51:30.541518 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 13:51:30.541518 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application conn.query(q) Jul 19 13:51:30.541518 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 13:51:30.541518 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 13:51:30.541518 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 13:51:30.541518 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application result.read() Jul 19 13:51:30.541518 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 13:51:30.541518 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 13:51:30.541518 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 13:51:30.541518 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 13:51:30.542745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 13:51:30.542745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 13:51:30.542745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 13:51:30.542745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 13:51:30.542745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 19 13:51:30.542745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 19 13:51:30.542745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [parameters: {'id': '7009840f3a614fa2a94dae45c786e526', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 19 13:51:30.542745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 13:51:30.542745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:30.542745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:51:30.542745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:30.542745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:30.542745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:30.542745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:30.542745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:30.542745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:30.544382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:30.544382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:30.544382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:30.544382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:30.544382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:30.544382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:30.544382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 19 13:51:30.544382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 19 13:51:30.544382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:30.544382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:30.544382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 19 13:51:30.544382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 19 13:51:30.544382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 13:51:30.544382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 13:51:30.544382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 19 13:51:30.544382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:30.546444 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 239/477] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Jul 19 13:51:30 2022] POST /identity/v3/roles => generated 144 bytes in 249 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:30.550144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fabf1-da13-4b1d-ae3e-8c5f92c5d29f None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:30.619609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21eec1c-6e90-46f1-8172-df633c92d983 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:30.663386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dae4ca-5427-43e4-be41-eebb9d501df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:30.664074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dae4ca-5427-43e4-be41-eebb9d501df1 None admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:30.664356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dae4ca-5427-43e4-be41-eebb9d501df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:30.665580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dae4ca-5427-43e4-be41-eebb9d501df1 None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:30.666339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dae4ca-5427-43e4-be41-eebb9d501df1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:30.667781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dae4ca-5427-43e4-be41-eebb9d501df1 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:30.738892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165fabf1-da13-4b1d-ae3e-8c5f92c5d29f None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:30.757094 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 239/478] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 19 13:51:30 2022] POST /identity/v3/users => generated 249 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:51:30.786349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade83882-d87c-4ad5-a417-58248481029f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:30.787166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade83882-d87c-4ad5-a417-58248481029f None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:30.787446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade83882-d87c-4ad5-a417-58248481029f None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:30.787721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade83882-d87c-4ad5-a417-58248481029f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:30.799679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade83882-d87c-4ad5-a417-58248481029f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:30.809821 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-ade83882-d87c-4ad5-a417-58248481029f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:51:30.809821 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:30.809821 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:30.809821 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:30.809821 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:30.809821 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:30.809821 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:30.809821 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:30.809821 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:30.809821 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:30.809821 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:30.809821 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:30.809821 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:30.809821 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:30.809821 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:30.809821 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:30.810818 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:30.810818 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:30.810818 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:30.810818 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:30.810818 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:30.810818 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:30.810818 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:30.810818 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:30.810818 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:30.810818 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:30.810818 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:30.810818 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:30.810818 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:30.810818 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:30.810818 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:30.810818 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:30.811655 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:30.811655 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:30.811655 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:30.811655 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:30.811655 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:30.811655 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:30.811655 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:30.811655 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:30.811655 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:30.811655 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:30.811655 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 13:51:30.811655 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:30.811655 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 240/479] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 19 13:51:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:51:30.819945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dae4ca-5427-43e4-be41-eebb9d501df1 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:30.831282 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:30.968096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dae4ca-5427-43e4-be41-eebb9d501df1 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:31.008630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6b170-ae0f-4a18-afad-8762124f1acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:31.009267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6b170-ae0f-4a18-afad-8762124f1acb None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:31.009552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6b170-ae0f-4a18-afad-8762124f1acb None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:31.009940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6b170-ae0f-4a18-afad-8762124f1acb None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:31.010684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6b170-ae0f-4a18-afad-8762124f1acb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:31.010971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6b170-ae0f-4a18-afad-8762124f1acb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:31.012337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6b170-ae0f-4a18-afad-8762124f1acb None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:31.020984 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 240/480] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:32.241180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03696daa-bde2-4fa3-9f5d-40c94430a976 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:32.241670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03696daa-bde2-4fa3-9f5d-40c94430a976 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:32.241747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03696daa-bde2-4fa3-9f5d-40c94430a976 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:32.243969 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 241/481] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:32.249268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d899d59-e747-43a6-ba6d-d4288fdb0b32 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:32.250177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d899d59-e747-43a6-ba6d-d4288fdb0b32 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:32.250665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d899d59-e747-43a6-ba6d-d4288fdb0b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:32.271937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1d899d59-e747-43a6-ba6d-d4288fdb0b32 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:32.273417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1d899d59-e747-43a6-ba6d-d4288fdb0b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:32.350873 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:32.364733 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 241/482] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:32.401389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03696daa-bde2-4fa3-9f5d-40c94430a976 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:32.476471 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:32.552064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03696daa-bde2-4fa3-9f5d-40c94430a976 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:32.553050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d15a28-603b-4d9b-9699-583ffe0778d5 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:32.553338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d15a28-603b-4d9b-9699-583ffe0778d5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:32.553745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d15a28-603b-4d9b-9699-583ffe0778d5 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:32.556168 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 242/483] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:32.563545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc7b25-3857-4958-a895-f16f7ee0471b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:32.563887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc7b25-3857-4958-a895-f16f7ee0471b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:32.564101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc7b25-3857-4958-a895-f16f7ee0471b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:32.606920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-36bc7b25-3857-4958-a895-f16f7ee0471b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:32.607576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a6fd2-c269-4849-befc-6e286480731a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:32.608097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-36bc7b25-3857-4958-a895-f16f7ee0471b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:32.608382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a6fd2-c269-4849-befc-6e286480731a None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:32.608668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a6fd2-c269-4849-befc-6e286480731a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:32.608945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0a6fd2-c269-4849-befc-6e286480731a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:32.626261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0a6fd2-c269-4849-befc-6e286480731a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:32.634561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-fa0a6fd2-c269-4849-befc-6e286480731a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:32.634561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:32.634561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:32.634561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:32.634561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:32.634561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:32.634561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:32.634561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:32.634561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:32.634561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:32.634561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:32.634561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:32.634561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:32.634561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:32.634561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:32.634561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:32.635470 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:32.635470 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:32.635470 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:32.635470 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:32.635470 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:32.635470 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:32.635470 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:32.635470 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:32.635470 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:32.635470 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:32.635470 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:32.635470 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:32.635470 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:32.635470 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:32.635470 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:32.635470 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:32.636280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:32.636280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:32.636280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:32.636280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:32.636280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:32.636280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:32.636280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:32.636280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:32.636280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:32.636280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:32.636280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:32.636280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:32.638045 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 242/484] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:51:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:32.644916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a6fd2-c269-4849-befc-6e286480731a None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:32.743685 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 243/485] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:32.766032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48650110-6b0f-4431-bb2a-5c11851e6589 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:32.766363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48650110-6b0f-4431-bb2a-5c11851e6589 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:32.766626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48650110-6b0f-4431-bb2a-5c11851e6589 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:32.767988 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 244/486] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:32.771446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48650110-6b0f-4431-bb2a-5c11851e6589 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:32.798384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0a6fd2-c269-4849-befc-6e286480731a None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:32.811680 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:32.840231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d4023-a0ec-4392-80d2-af62d8e388c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:32.840945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d4023-a0ec-4392-80d2-af62d8e388c2 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:32.841334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d4023-a0ec-4392-80d2-af62d8e388c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:32.841659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d4023-a0ec-4392-80d2-af62d8e388c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:32.842450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d4023-a0ec-4392-80d2-af62d8e388c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:32.842760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d4023-a0ec-4392-80d2-af62d8e388c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:32.844133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d4023-a0ec-4392-80d2-af62d8e388c2 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:32.858777 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 243/487] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 19 13:51:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:32.858777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb1193-0508-4b64-9902-69a66f11f9be None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:32.858777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb1193-0508-4b64-9902-69a66f11f9be None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:32.858777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebb1193-0508-4b64-9902-69a66f11f9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:32.876088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2ebb1193-0508-4b64-9902-69a66f11f9be None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:32.877316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2ebb1193-0508-4b64-9902-69a66f11f9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:32.888500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48650110-6b0f-4431-bb2a-5c11851e6589 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:32.917919 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:32.927099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d7215-7922-4fe3-8be1-4e26a6c7522a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:32.928369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d7215-7922-4fe3-8be1-4e26a6c7522a None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:32.928849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d7215-7922-4fe3-8be1-4e26a6c7522a None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:32.929335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d7215-7922-4fe3-8be1-4e26a6c7522a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:32.941445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d7215-7922-4fe3-8be1-4e26a6c7522a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:32.947267 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 244/488] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:32.951128 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-7c1d7215-7922-4fe3-8be1-4e26a6c7522a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:32.951128 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:32.951128 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:32.951128 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:32.951128 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:32.951128 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:32.951128 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:32.951128 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:32.951128 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:32.951128 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:32.951128 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:32.951128 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:32.951128 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:32.951128 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:32.951128 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:32.951128 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:32.951995 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:32.951995 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:32.951995 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:32.951995 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:32.951995 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:32.951995 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:32.951995 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:32.951995 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:32.951995 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:32.951995 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:32.951995 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:32.951995 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:32.951995 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:32.951995 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:32.951995 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:32.951995 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:32.952795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:32.952795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:32.952795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:32.952795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:32.952795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:32.952795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:32.952795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:32.952795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:32.952795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:32.952795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:32.952795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:32.952795 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:32.954910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb1193-0508-4b64-9902-69a66f11f9be None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:32.955591 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 245/489] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:51:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:51:32.961254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d7215-7922-4fe3-8be1-4e26a6c7522a None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:33.065922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebb1193-0508-4b64-9902-69a66f11f9be None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:33.067409 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:33.080428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d7215-7922-4fe3-8be1-4e26a6c7522a None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:33.101454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035603e-ef8b-4377-9a72-2e4ba9f59c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:33.102800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035603e-ef8b-4377-9a72-2e4ba9f59c6f None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:33.103081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035603e-ef8b-4377-9a72-2e4ba9f59c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:33.103355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e035603e-ef8b-4377-9a72-2e4ba9f59c6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:33.116416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035603e-ef8b-4377-9a72-2e4ba9f59c6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:33.118438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e035603e-ef8b-4377-9a72-2e4ba9f59c6f None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:33.126843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecfcab-c7dd-482f-bbe1-f4aac82e58ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:33.128250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecfcab-c7dd-482f-bbe1-f4aac82e58ad None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:33.128735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecfcab-c7dd-482f-bbe1-f4aac82e58ad None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:33.129224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ecfcab-c7dd-482f-bbe1-f4aac82e58ad None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:33.130294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecfcab-c7dd-482f-bbe1-f4aac82e58ad None admin] RBAC: Adding query filter params (name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:33.130837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecfcab-c7dd-482f-bbe1-f4aac82e58ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:33.132420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ecfcab-c7dd-482f-bbe1-f4aac82e58ad None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:33.137865 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-e035603e-ef8b-4377-9a72-2e4ba9f59c6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:33.137865 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:33.137865 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:33.137865 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:33.137865 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:33.137865 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:33.137865 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:33.137865 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:33.137865 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:33.137865 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:33.137865 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:33.137865 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:33.137865 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:33.137865 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:33.137865 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:33.138747 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:33.138747 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:33.138747 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:33.138747 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:33.138747 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:33.138747 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:33.138747 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:33.138747 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:33.138747 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:33.138747 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:33.138747 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:33.138747 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:33.138747 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:33.138747 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:33.138747 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:33.138747 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:33.138747 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:33.139585 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:33.139585 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:33.139585 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:33.139585 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:33.139585 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 245/490] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:33.144745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035603e-ef8b-4377-9a72-2e4ba9f59c6f None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:33.150852 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 246/491] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 19 13:51:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:33.152123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecfcab-c7dd-482f-bbe1-f4aac82e58ad None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:33.214484 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:33.248352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e035603e-ef8b-4377-9a72-2e4ba9f59c6f None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:33.280041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ecfcab-c7dd-482f-bbe1-f4aac82e58ad None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:33.284843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db380a-72ee-4beb-ac76-c1e22c8f5787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:33.285644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db380a-72ee-4beb-ac76-c1e22c8f5787 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:33.285925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db380a-72ee-4beb-ac76-c1e22c8f5787 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:33.286320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db380a-72ee-4beb-ac76-c1e22c8f5787 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:33.303288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db380a-72ee-4beb-ac76-c1e22c8f5787 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:33.312060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-03db380a-72ee-4beb-ac76-c1e22c8f5787 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:33.312060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:33.312060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:33.312060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:33.312060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:33.312060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:33.312060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:33.312060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:33.312060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:33.312060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:33.312060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:33.312060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:33.312060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:33.312060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:33.312060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:33.312060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:33.313261 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:33.313261 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:33.313261 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:33.313261 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:33.313261 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:33.313261 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:33.313261 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:33.313261 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:33.313261 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:33.313261 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:33.313261 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:33.313261 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:33.313261 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:33.313261 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:33.313261 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:33.313261 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:33.319378 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:33.319378 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:33.319378 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:33.319378 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:33.319378 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:33.319378 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:33.319378 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:33.319378 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:33.319378 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:33.319378 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:33.319378 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:33.319378 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:33.319378 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 246/492] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:51:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:33.319378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db380a-72ee-4beb-ac76-c1e22c8f5787 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:33.330732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc60df-223c-46ba-a4a6-86cb6b60c27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:33.331986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc60df-223c-46ba-a4a6-86cb6b60c27f None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:33.332476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc60df-223c-46ba-a4a6-86cb6b60c27f None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:33.332917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc60df-223c-46ba-a4a6-86cb6b60c27f None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:33.333926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc60df-223c-46ba-a4a6-86cb6b60c27f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:33.334417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc60df-223c-46ba-a4a6-86cb6b60c27f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:33.336046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fc60df-223c-46ba-a4a6-86cb6b60c27f None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:33.341298 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:33.353387 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 247/493] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:33.359473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc60df-223c-46ba-a4a6-86cb6b60c27f None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:33.436737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db380a-72ee-4beb-ac76-c1e22c8f5787 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:33.474747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31277d-4784-4a52-a9a9-5907cc35148a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:33.475544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31277d-4784-4a52-a9a9-5907cc35148a None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:33.475825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31277d-4784-4a52-a9a9-5907cc35148a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:33.476100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31277d-4784-4a52-a9a9-5907cc35148a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:33.478929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fc60df-223c-46ba-a4a6-86cb6b60c27f None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:33.489031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31277d-4784-4a52-a9a9-5907cc35148a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:33.490534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d31277d-4784-4a52-a9a9-5907cc35148a None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:33.492244 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:33.514484 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-6d31277d-4784-4a52-a9a9-5907cc35148a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:33.514484 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:33.514484 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:33.514484 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:33.514484 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:33.514484 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:33.514484 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:33.514484 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:33.514484 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:33.514484 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:33.514484 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:33.514484 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:33.514484 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:33.514484 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:33.514484 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:33.515715 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:33.515715 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:33.515715 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:33.515715 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:33.515715 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:33.515715 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:33.515715 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:33.515715 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:33.515715 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:33.515715 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:33.515715 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:33.515715 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:33.515715 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:33.515715 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:33.515715 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:33.515715 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:33.515715 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:33.516574 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:33.516574 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:33.516574 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:33.516574 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:33.516574 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 247/494] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:33.517099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31277d-4784-4a52-a9a9-5907cc35148a None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:33.538343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28000e0-928e-4635-9782-fedc69b1857a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:33.538777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28000e0-928e-4635-9782-fedc69b1857a None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:33.539099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28000e0-928e-4635-9782-fedc69b1857a None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:33.539376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28000e0-928e-4635-9782-fedc69b1857a None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:33.541436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28000e0-928e-4635-9782-fedc69b1857a None admin] RBAC: Adding query filter params (name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:33.541751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28000e0-928e-4635-9782-fedc69b1857a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:33.543186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28000e0-928e-4635-9782-fedc69b1857a None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:33.553605 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 248/495] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 19 13:51:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:33.554571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28000e0-928e-4635-9782-fedc69b1857a None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:33.600998 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:33.640328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31277d-4784-4a52-a9a9-5907cc35148a None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:33.669136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28000e0-928e-4635-9782-fedc69b1857a None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:33.684501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dce4d9-0a63-4a90-8d06-054e8372c09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:33.685297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dce4d9-0a63-4a90-8d06-054e8372c09e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:33.685586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dce4d9-0a63-4a90-8d06-054e8372c09e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:33.685977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dce4d9-0a63-4a90-8d06-054e8372c09e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:33.694680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dce4d9-0a63-4a90-8d06-054e8372c09e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:33.696309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dce4d9-0a63-4a90-8d06-054e8372c09e None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:33.702619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90ad73-e2d5-45cd-9fb6-9726f6941900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:33.703290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90ad73-e2d5-45cd-9fb6-9726f6941900 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:33.703578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90ad73-e2d5-45cd-9fb6-9726f6941900 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:33.703856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90ad73-e2d5-45cd-9fb6-9726f6941900 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:33.704584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90ad73-e2d5-45cd-9fb6-9726f6941900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:33.704892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90ad73-e2d5-45cd-9fb6-9726f6941900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:33.706361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90ad73-e2d5-45cd-9fb6-9726f6941900 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:33.717513 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-88dce4d9-0a63-4a90-8d06-054e8372c09e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 19 13:51:33.717513 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:33.717513 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:33.717513 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:33.717513 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:33.717513 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:33.717513 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:33.717513 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:33.717513 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:33.717513 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:33.717513 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:33.717513 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:33.717513 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:51:33.717513 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:51:33.717513 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:51:33.717513 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:51:33.718633 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:33.718633 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:33.718633 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:51:33.718633 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:33.718633 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:51:33.718633 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:33.718633 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:33.718633 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:33.718633 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:33.718633 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:33.718633 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:33.718633 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:33.718633 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:33.718633 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:33.718633 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:33.718633 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:33.718633 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:33.718633 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:33.719554 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:33.719554 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:33.719554 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:51:33.719554 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:51:33.719554 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:51:33.719554 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:51:33.719554 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:51:33.719554 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:51:33.719554 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 19 13:51:33.719554 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:33.719554 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 248/496] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:33.720125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bea5f6-93f2-4399-844f-b6d25577dd74 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:33.720645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bea5f6-93f2-4399-844f-b6d25577dd74 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:33.720738 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 249/497] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:33.720809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bea5f6-93f2-4399-844f-b6d25577dd74 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:33.721277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90ad73-e2d5-45cd-9fb6-9726f6941900 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:33.722429 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 249/498] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:33.723386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542bc86-3a09-46ed-a587-a501edc81f63 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:33.723671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542bc86-3a09-46ed-a587-a501edc81f63 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:33.723982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542bc86-3a09-46ed-a587-a501edc81f63 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:33.725168 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 250/499] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:33.725863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542bc86-3a09-46ed-a587-a501edc81f63 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:33.763715 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:33.841262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90ad73-e2d5-45cd-9fb6-9726f6941900 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:33.845349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542bc86-3a09-46ed-a587-a501edc81f63 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:33.875411 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:33.877038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed14ca-fcf5-4132-aeff-8e7cf132d5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:33.878333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed14ca-fcf5-4132-aeff-8e7cf132d5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:33.878792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed14ca-fcf5-4132-aeff-8e7cf132d5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:33.879247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed14ca-fcf5-4132-aeff-8e7cf132d5e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:33.884419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b1184-076d-404e-a0d7-0b8bd7e97d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:33.885229 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b1184-076d-404e-a0d7-0b8bd7e97d4e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:33.889403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b1184-076d-404e-a0d7-0b8bd7e97d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:33.889403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b1184-076d-404e-a0d7-0b8bd7e97d4e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:33.892454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed14ca-fcf5-4132-aeff-8e7cf132d5e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:33.893125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b1184-076d-404e-a0d7-0b8bd7e97d4e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:33.894331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed14ca-fcf5-4132-aeff-8e7cf132d5e5 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:33.894603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b1184-076d-404e-a0d7-0b8bd7e97d4e None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:33.911674 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-e92b1184-076d-404e-a0d7-0b8bd7e97d4e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 13:51:33.911674 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:33.911674 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:33.911674 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:33.911674 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:33.911674 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:33.911674 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:33.911674 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:33.911674 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:33.911674 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:33.911674 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:33.911674 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:33.911674 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:51:33.911674 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:51:33.911674 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:51:33.911674 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:51:33.912605 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:33.912605 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:33.912605 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:51:33.912605 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:33.912605 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:51:33.912605 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:33.912605 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:33.912605 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:33.912605 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:33.912605 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:33.912605 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:33.912605 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:33.912605 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:33.912605 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:33.912605 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:33.912605 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:33.912605 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:33.912605 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:33.913519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:33.913519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:33.913519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:51:33.913519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:51:33.913519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:51:33.913519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:51:33.913519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:51:33.913519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:51:33.913519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 13:51:33.913519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:33.913519 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 251/500] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jul 19 13:51:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:33.914495 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-a5ed14ca-fcf5-4132-aeff-8e7cf132d5e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:33.914495 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:33.914495 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:33.914495 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:33.914495 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:33.914495 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:33.914495 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:33.914495 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:33.914495 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:33.914495 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:33.914495 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:33.914495 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:33.914495 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:33.914495 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:33.914495 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:33.915683 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:33.915683 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:33.915683 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:33.915683 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:33.915683 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:33.915683 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:33.915683 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:33.915683 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:33.915683 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:33.915683 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:33.915683 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:33.915683 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:33.915683 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:33.915683 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:33.915683 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:33.915683 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:33.915683 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:33.917111 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:33.917111 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:33.917111 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:33.917111 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:33.922182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae5301-dc4b-4594-b900-844ac60ddb01 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:33.922297 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 250/501] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:33.922394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae5301-dc4b-4594-b900-844ac60ddb01 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:33.922394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fae5301-dc4b-4594-b900-844ac60ddb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:33.922577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d079f59-5aac-4e00-924c-79d0c6c95adc None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:33.922577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d079f59-5aac-4e00-924c-79d0c6c95adc None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:33.922577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d079f59-5aac-4e00-924c-79d0c6c95adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:33.938172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5d079f59-5aac-4e00-924c-79d0c6c95adc None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:33.938402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9fae5301-dc4b-4594-b900-844ac60ddb01 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:33.939386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5d079f59-5aac-4e00-924c-79d0c6c95adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:33.939547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9fae5301-dc4b-4594-b900-844ac60ddb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:34.012675 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 251/503] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:34.012896 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 252/503] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:34.013403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae5301-dc4b-4594-b900-844ac60ddb01 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:34.015004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d079f59-5aac-4e00-924c-79d0c6c95adc None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:34.044760 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:34.126184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fae5301-dc4b-4594-b900-844ac60ddb01 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:34.140388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d079f59-5aac-4e00-924c-79d0c6c95adc None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:34.143303 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:34.161507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e018be-19a4-46e4-9de9-8853e9531225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:34.162192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e018be-19a4-46e4-9de9-8853e9531225 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:34.162734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e018be-19a4-46e4-9de9-8853e9531225 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:34.163182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e018be-19a4-46e4-9de9-8853e9531225 None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:34.164088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e018be-19a4-46e4-9de9-8853e9531225 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:34.164725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e018be-19a4-46e4-9de9-8853e9531225 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:34.166325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e018be-19a4-46e4-9de9-8853e9531225 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:34.184050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7e854-b16d-46b8-90c4-00e34b19d0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:34.184729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7e854-b16d-46b8-90c4-00e34b19d0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:34.185018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7e854-b16d-46b8-90c4-00e34b19d0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:34.185298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7e854-b16d-46b8-90c4-00e34b19d0e6 None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:34.186221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7e854-b16d-46b8-90c4-00e34b19d0e6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:34.186547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7e854-b16d-46b8-90c4-00e34b19d0e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:34.188243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7e854-b16d-46b8-90c4-00e34b19d0e6 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:34.207497 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 253/504] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jul 19 13:51:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:34.207497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e018be-19a4-46e4-9de9-8853e9531225 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:34.235647 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 252/505] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Jul 19 13:51:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:34.236522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7e854-b16d-46b8-90c4-00e34b19d0e6 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:34.311501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e018be-19a4-46e4-9de9-8853e9531225 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:34.313470 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:34.344217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7e854-b16d-46b8-90c4-00e34b19d0e6 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:34.346868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774f893-af11-40c5-a18e-6a815da652c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:34.347603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774f893-af11-40c5-a18e-6a815da652c5 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:34.347896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774f893-af11-40c5-a18e-6a815da652c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:34.348178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774f893-af11-40c5-a18e-6a815da652c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:34.348907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774f893-af11-40c5-a18e-6a815da652c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:34.349215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774f893-af11-40c5-a18e-6a815da652c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:34.350635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774f893-af11-40c5-a18e-6a815da652c5 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:34.362028 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 254/506] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:34.362876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774f893-af11-40c5-a18e-6a815da652c5 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:34.381644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e778e4-1b19-4de6-8033-8e27e5115743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:34.382405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e778e4-1b19-4de6-8033-8e27e5115743 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:34.382693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e778e4-1b19-4de6-8033-8e27e5115743 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:34.382970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e778e4-1b19-4de6-8033-8e27e5115743 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:34.394043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e778e4-1b19-4de6-8033-8e27e5115743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:34.396986 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:34.401922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-41e778e4-1b19-4de6-8033-8e27e5115743 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:34.401922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:34.401922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:34.401922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:34.401922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:34.401922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:34.401922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:34.401922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:34.401922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:34.401922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:34.401922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:34.401922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:34.401922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:34.401922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:34.401922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:34.401922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:34.402924 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:34.402924 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:34.402924 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:34.402924 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:34.402924 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:34.402924 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:34.402924 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:34.402924 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:34.402924 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:34.402924 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:34.402924 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:34.402924 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:34.402924 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:34.402924 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:34.402924 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:34.402924 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:34.403887 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:34.403887 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:34.403887 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:34.403887 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:34.403887 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:34.403887 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:34.403887 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:34.403887 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:34.403887 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:34.403887 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:34.403887 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:34.403887 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:34.403887 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 253/507] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:51:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:34.404897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e778e4-1b19-4de6-8033-8e27e5115743 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:34.464135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774f893-af11-40c5-a18e-6a815da652c5 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:34.498554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f74ba7-e5b0-47e0-90c1-52e6ff293cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:34.499342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f74ba7-e5b0-47e0-90c1-52e6ff293cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:34.499625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f74ba7-e5b0-47e0-90c1-52e6ff293cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:34.499907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f74ba7-e5b0-47e0-90c1-52e6ff293cc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:34.508471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e778e4-1b19-4de6-8033-8e27e5115743 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:34.510386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f74ba7-e5b0-47e0-90c1-52e6ff293cc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:34.511853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f74ba7-e5b0-47e0-90c1-52e6ff293cc2 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:34.528986 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-71f74ba7-e5b0-47e0-90c1-52e6ff293cc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:34.528986 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:34.528986 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:34.528986 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:34.528986 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:34.528986 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:34.528986 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:34.528986 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:34.528986 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:34.528986 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:34.528986 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:34.528986 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:34.528986 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:34.528986 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:34.528986 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:34.529972 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:34.529972 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:34.529972 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:34.529972 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:34.529972 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:34.529972 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:34.529972 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:34.529972 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:34.529972 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:34.529972 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:34.529972 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:34.529972 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:34.529972 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:34.529972 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:34.529972 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:34.529972 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:34.529972 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:34.531158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:34.531158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:34.531158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:34.531158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:34.531158 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 255/508] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:34.531158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f74ba7-e5b0-47e0-90c1-52e6ff293cc2 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:34.539759 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:34.544713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dcc32-c325-4d26-bf9f-e7285f13bf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:34.545400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dcc32-c325-4d26-bf9f-e7285f13bf49 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:34.545682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dcc32-c325-4d26-bf9f-e7285f13bf49 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:34.545963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0dcc32-c325-4d26-bf9f-e7285f13bf49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:34.613722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0dcc32-c325-4d26-bf9f-e7285f13bf49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:34.615221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0dcc32-c325-4d26-bf9f-e7285f13bf49 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:34.618070 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:34.632946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f74ba7-e5b0-47e0-90c1-52e6ff293cc2 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:34.668077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfc8f9-e14f-4e38-8e78-5b773efc4d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:34.668787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfc8f9-e14f-4e38-8e78-5b773efc4d4a None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:34.669082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfc8f9-e14f-4e38-8e78-5b773efc4d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:34.669358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfc8f9-e14f-4e38-8e78-5b773efc4d4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:34.713732 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 254/509] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:34.719018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dcc32-c325-4d26-bf9f-e7285f13bf49 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:34.737351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfc8f9-e14f-4e38-8e78-5b773efc4d4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:34.738833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfc8f9-e14f-4e38-8e78-5b773efc4d4a None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:34.748323 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:34.815483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0dcc32-c325-4d26-bf9f-e7285f13bf49 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:34.822438 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:34.838209 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 256/510] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:34.839017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfc8f9-e14f-4e38-8e78-5b773efc4d4a None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:34.854831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df1b1e-7949-4d79-ae76-8623abe4929d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:34.855627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df1b1e-7949-4d79-ae76-8623abe4929d None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:34.855908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df1b1e-7949-4d79-ae76-8623abe4929d None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:34.856179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df1b1e-7949-4d79-ae76-8623abe4929d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:34.863245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df1b1e-7949-4d79-ae76-8623abe4929d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:34.864670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df1b1e-7949-4d79-ae76-8623abe4929d None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:34.880611 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-85df1b1e-7949-4d79-ae76-8623abe4929d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 13:51:34.880611 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:34.880611 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:34.880611 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:34.880611 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:34.880611 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:34.880611 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:34.880611 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:34.880611 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:34.880611 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:34.880611 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:34.880611 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:34.880611 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:51:34.880611 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:51:34.880611 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:51:34.880611 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:51:34.881502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:34.881502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:34.881502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:51:34.881502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:34.881502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:51:34.881502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:34.881502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:34.881502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:34.881502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:34.881502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:34.881502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:34.881502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:34.881502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:34.881502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:34.881502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:34.881502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:34.881502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:34.881502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:34.882449 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:34.882449 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:34.882449 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:51:34.882449 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:51:34.882449 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:51:34.882449 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:51:34.882449 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:51:34.882449 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:51:34.882449 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 13:51:34.882449 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:34.882449 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 255/511] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:34.883071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df1b1e-7949-4d79-ae76-8623abe4929d None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:34.942710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfc8f9-e14f-4e38-8e78-5b773efc4d4a None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:34.973501 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:34.976553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcf0f6-85d9-4eab-a347-7377c03deda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:34.978240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcf0f6-85d9-4eab-a347-7377c03deda5 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:34.978530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcf0f6-85d9-4eab-a347-7377c03deda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:34.978807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bcf0f6-85d9-4eab-a347-7377c03deda5 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:34.979580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcf0f6-85d9-4eab-a347-7377c03deda5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:34.979884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcf0f6-85d9-4eab-a347-7377c03deda5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:34.981309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bcf0f6-85d9-4eab-a347-7377c03deda5 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:34.982988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df1b1e-7949-4d79-ae76-8623abe4929d None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:34.989101 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 257/512] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 19 13:51:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:34.989878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcf0f6-85d9-4eab-a347-7377c03deda5 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:35.018639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc803e7f-95b6-491e-a149-451937df5cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:35.019297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc803e7f-95b6-491e-a149-451937df5cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:35.019581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc803e7f-95b6-491e-a149-451937df5cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:35.019856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc803e7f-95b6-491e-a149-451937df5cb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:35.020585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc803e7f-95b6-491e-a149-451937df5cb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:35.020897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc803e7f-95b6-491e-a149-451937df5cb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:35.022299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc803e7f-95b6-491e-a149-451937df5cb8 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:35.034437 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 256/513] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:35.035232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc803e7f-95b6-491e-a149-451937df5cb8 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:35.039220 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:35.090326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bcf0f6-85d9-4eab-a347-7377c03deda5 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:35.122892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331f138-02bc-46e2-b96b-7c2bf2f11895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:35.123667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331f138-02bc-46e2-b96b-7c2bf2f11895 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:35.123948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331f138-02bc-46e2-b96b-7c2bf2f11895 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:35.124221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331f138-02bc-46e2-b96b-7c2bf2f11895 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:35.135136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331f138-02bc-46e2-b96b-7c2bf2f11895 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:35.135796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc803e7f-95b6-491e-a149-451937df5cb8 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:35.136511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331f138-02bc-46e2-b96b-7c2bf2f11895 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:35.153279 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-0331f138-02bc-46e2-b96b-7c2bf2f11895 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:35.153279 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:35.153279 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:35.153279 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:35.153279 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:35.153279 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:35.153279 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:35.153279 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:35.153279 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:35.153279 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:35.153279 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:35.153279 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:35.153279 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:35.153279 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:35.153279 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:35.154210 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:35.154210 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:35.154210 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:35.154210 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:35.154210 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:35.154210 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:35.154210 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:35.154210 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:35.154210 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:35.154210 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:35.154210 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:35.154210 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:35.154210 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:35.154210 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:35.154210 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:35.154210 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:35.154210 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:35.155071 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:35.155071 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:35.155071 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:35.155071 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:35.155071 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 258/514] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:35.155561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331f138-02bc-46e2-b96b-7c2bf2f11895 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:35.170767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b2b44-cc2d-4492-ba55-81243ab22581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:35.171564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b2b44-cc2d-4492-ba55-81243ab22581 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:35.171852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b2b44-cc2d-4492-ba55-81243ab22581 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:35.172134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b2b44-cc2d-4492-ba55-81243ab22581 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:35.183939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b2b44-cc2d-4492-ba55-81243ab22581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:35.185397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b2b44-cc2d-4492-ba55-81243ab22581 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:35.202738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-ee9b2b44-cc2d-4492-ba55-81243ab22581 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:35.202738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:35.202738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:35.202738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:35.202738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:35.202738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:35.202738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:35.202738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:35.202738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:35.202738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:35.202738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:35.202738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:35.202738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:35.202738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:35.202738 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:35.203628 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:35.203628 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:35.203628 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:35.203628 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:35.203628 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:35.203628 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:35.203628 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:35.203628 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:35.203628 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:35.203628 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:35.203628 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:35.203628 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:35.203628 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:35.203628 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:35.203628 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:35.203628 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:35.203628 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:35.204510 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:35.204510 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:35.204510 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:35.204510 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:35.206534 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 257/515] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:35.207452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b2b44-cc2d-4492-ba55-81243ab22581 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:35.212661 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:35.253682 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:35.257347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331f138-02bc-46e2-b96b-7c2bf2f11895 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:35.292113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14996f-85b7-4fdc-8fe7-befa42b8a1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:35.292804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14996f-85b7-4fdc-8fe7-befa42b8a1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:35.293086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14996f-85b7-4fdc-8fe7-befa42b8a1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:35.293442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14996f-85b7-4fdc-8fe7-befa42b8a1b7 None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:35.294326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14996f-85b7-4fdc-8fe7-befa42b8a1b7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:35.294637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14996f-85b7-4fdc-8fe7-befa42b8a1b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:35.296080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14996f-85b7-4fdc-8fe7-befa42b8a1b7 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:35.308497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b2b44-cc2d-4492-ba55-81243ab22581 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:35.314267 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 259/516] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Jul 19 13:51:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:35.315057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14996f-85b7-4fdc-8fe7-befa42b8a1b7 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:35.342889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e411b-57c2-4f59-9efe-db5ae0e9ee69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:35.343675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e411b-57c2-4f59-9efe-db5ae0e9ee69 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:35.343964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e411b-57c2-4f59-9efe-db5ae0e9ee69 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:35.344241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e411b-57c2-4f59-9efe-db5ae0e9ee69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:35.354825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e411b-57c2-4f59-9efe-db5ae0e9ee69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:35.356261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889e411b-57c2-4f59-9efe-db5ae0e9ee69 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:35.372763 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-889e411b-57c2-4f59-9efe-db5ae0e9ee69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:35.372763 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:35.372763 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:35.372763 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:35.372763 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:35.372763 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:35.372763 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:35.372763 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:35.372763 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:35.372763 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:35.372763 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:35.372763 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:35.372763 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:35.372763 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:35.372763 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:35.373605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:35.373605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:35.373605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:35.373605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:35.373605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:35.373605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:35.373605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:35.373605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:35.373605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:35.373605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:35.373605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:35.373605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:35.373605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:35.373605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:35.373605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:35.373605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:35.373605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:35.378997 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:35.378997 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:35.378997 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:35.378997 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:35.378997 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 258/517] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:35.378997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e411b-57c2-4f59-9efe-db5ae0e9ee69 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:35.418401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14996f-85b7-4fdc-8fe7-befa42b8a1b7 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:35.431283 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:35.453045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e261956-7c6e-4359-a8f2-1ec5ccf44992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:35.454020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e261956-7c6e-4359-a8f2-1ec5ccf44992 None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:35.454336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e261956-7c6e-4359-a8f2-1ec5ccf44992 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:35.454615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e261956-7c6e-4359-a8f2-1ec5ccf44992 None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:35.455323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e261956-7c6e-4359-a8f2-1ec5ccf44992 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:35.456758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e261956-7c6e-4359-a8f2-1ec5ccf44992 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:35.473526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e411b-57c2-4f59-9efe-db5ae0e9ee69 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:35.507136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cac3a-dfa6-467a-8691-f09cec938409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:35.507792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cac3a-dfa6-467a-8691-f09cec938409 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:35.508079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cac3a-dfa6-467a-8691-f09cec938409 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:35.508540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4cac3a-dfa6-467a-8691-f09cec938409 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:35.509412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4cac3a-dfa6-467a-8691-f09cec938409 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:35.509729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4cac3a-dfa6-467a-8691-f09cec938409 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:35.511174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4cac3a-dfa6-467a-8691-f09cec938409 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:35.522613 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 259/518] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:35.523380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cac3a-dfa6-467a-8691-f09cec938409 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:35.540847 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 260/519] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 19 13:51:35 2022] POST /identity/v3/users => generated 247 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:51:35.540847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e261956-7c6e-4359-a8f2-1ec5ccf44992 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:35.555096 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:35.642335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4cac3a-dfa6-467a-8691-f09cec938409 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:35.654807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e261956-7c6e-4359-a8f2-1ec5ccf44992 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:35.660749 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:35.680187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cc823-e2b5-41ed-8c8c-c6fb007302c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:35.680848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cc823-e2b5-41ed-8c8c-c6fb007302c9 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:35.681138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cc823-e2b5-41ed-8c8c-c6fb007302c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:35.681414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909cc823-e2b5-41ed-8c8c-c6fb007302c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:35.682270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909cc823-e2b5-41ed-8c8c-c6fb007302c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:35.682582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909cc823-e2b5-41ed-8c8c-c6fb007302c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:35.683959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909cc823-e2b5-41ed-8c8c-c6fb007302c9 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:35.693435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c65d1-7d11-4a55-a201-947f108dda8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:35.694116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c65d1-7d11-4a55-a201-947f108dda8d None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:35.694408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c65d1-7d11-4a55-a201-947f108dda8d None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:35.694692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c65d1-7d11-4a55-a201-947f108dda8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:35.698451 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 260/520] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:35.699271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cc823-e2b5-41ed-8c8c-c6fb007302c9 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:35.772887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c65d1-7d11-4a55-a201-947f108dda8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:35.775154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c65d1-7d11-4a55-a201-947f108dda8d None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:35.792149 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:35.817532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909cc823-e2b5-41ed-8c8c-c6fb007302c9 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:35.852978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7e7d4-3b82-42f3-b509-2e40b25fe31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:35.853649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7e7d4-3b82-42f3-b509-2e40b25fe31c None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:35.853944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7e7d4-3b82-42f3-b509-2e40b25fe31c None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:35.854254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7e7d4-3b82-42f3-b509-2e40b25fe31c None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:35.854987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7e7d4-3b82-42f3-b509-2e40b25fe31c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:35.855298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7e7d4-3b82-42f3-b509-2e40b25fe31c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:35.856683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7e7d4-3b82-42f3-b509-2e40b25fe31c None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:35.874251 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 261/521] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:35.875108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7e7d4-3b82-42f3-b509-2e40b25fe31c None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:35.892991 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 261/522] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:35.892991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c65d1-7d11-4a55-a201-947f108dda8d None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:35.916924 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:35.983741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7e7d4-3b82-42f3-b509-2e40b25fe31c None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:35.996389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c65d1-7d11-4a55-a201-947f108dda8d None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:36.010738 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:36.021939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242bb8c-a0d6-45f4-8d28-db8ea1283480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:36.022768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242bb8c-a0d6-45f4-8d28-db8ea1283480 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:36.023055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242bb8c-a0d6-45f4-8d28-db8ea1283480 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:36.025584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242bb8c-a0d6-45f4-8d28-db8ea1283480 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:36.031066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242bb8c-a0d6-45f4-8d28-db8ea1283480 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:36.031633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b317e-0a4a-4761-8fa4-7efc106d01bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:36.032432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b317e-0a4a-4761-8fa4-7efc106d01bc None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:36.032531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242bb8c-a0d6-45f4-8d28-db8ea1283480 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:36.032726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b317e-0a4a-4761-8fa4-7efc106d01bc None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:36.032983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b317e-0a4a-4761-8fa4-7efc106d01bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:36.042241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b317e-0a4a-4761-8fa4-7efc106d01bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:36.044652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b317e-0a4a-4761-8fa4-7efc106d01bc None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:36.047294 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-6242bb8c-a0d6-45f4-8d28-db8ea1283480 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:36.047294 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:36.047294 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:36.047294 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:36.047294 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:36.047294 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:36.047294 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:36.047294 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:36.047294 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:36.047294 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:36.047294 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:36.047294 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:36.047294 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:51:36.047294 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:51:36.047294 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:51:36.048121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:51:36.048121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:36.048121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:36.048121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:36.048121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:36.048121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:36.048121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:36.048121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:36.048121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:36.048121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:36.048121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:36.048121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:36.048121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:36.048121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:36.048121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:36.048121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:36.048121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:36.048968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:51:36.048968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:51:36.048968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:51:36.048968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:51:36.048968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:51:36.048968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:51:36.048968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:36.048968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:36.048968 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 262/523] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:36.050285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242bb8c-a0d6-45f4-8d28-db8ea1283480 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:36.063840 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-df1b317e-0a4a-4761-8fa4-7efc106d01bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:36.063840 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:36.063840 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:36.063840 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:36.063840 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:36.063840 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:36.063840 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:36.063840 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:36.063840 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:36.063840 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:36.063840 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:36.063840 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:36.063840 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:51:36.063840 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:51:36.063840 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:51:36.064742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:51:36.064742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:36.064742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:36.064742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:36.064742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:36.064742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:36.064742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:36.064742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:36.064742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:36.064742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:36.064742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:36.064742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:36.064742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:36.064742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:36.064742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:36.064742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:36.064742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:36.065685 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:51:36.065685 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:51:36.065685 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:51:36.065685 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:51:36.065685 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:51:36.065685 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:51:36.065685 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:36.065685 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:36.069793 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 262/524] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:36.070672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b317e-0a4a-4761-8fa4-7efc106d01bc None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:36.153712 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:36.159738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242bb8c-a0d6-45f4-8d28-db8ea1283480 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:36.180065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b317e-0a4a-4761-8fa4-7efc106d01bc None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:36.197898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5510dac-b6dc-4ebe-a099-b69c5ae95ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:36.198729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5510dac-b6dc-4ebe-a099-b69c5ae95ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:36.199021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5510dac-b6dc-4ebe-a099-b69c5ae95ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:36.199302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5510dac-b6dc-4ebe-a099-b69c5ae95ff8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:36.208649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5510dac-b6dc-4ebe-a099-b69c5ae95ff8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:36.210129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5510dac-b6dc-4ebe-a099-b69c5ae95ff8 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:36.221984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5881a3-5b74-470b-a796-14425b452463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:36.222801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5881a3-5b74-470b-a796-14425b452463 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:36.223081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5881a3-5b74-470b-a796-14425b452463 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:36.223361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5881a3-5b74-470b-a796-14425b452463 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:36.231207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-f5510dac-b6dc-4ebe-a099-b69c5ae95ff8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 13:51:36.231207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:36.231207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:36.231207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:36.231207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:36.231207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:36.231207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:36.231207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:36.231207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:36.231207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:36.231207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:36.231207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:36.231207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:51:36.231207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:51:36.231207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:51:36.231207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:51:36.232279 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:36.232279 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:36.232279 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:51:36.232279 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:36.232279 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:51:36.232279 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:36.232279 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:36.232279 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:36.232279 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:36.232279 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:36.232279 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:36.232279 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:36.232279 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:36.232279 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:36.232279 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:36.232279 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:36.232279 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:36.232279 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:36.233477 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:36.233477 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:36.233477 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:51:36.233477 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:51:36.233477 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:51:36.233477 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:51:36.233477 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:51:36.233477 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:51:36.233477 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 13:51:36.233477 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:36.235501 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 263/525] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:51:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:36.235670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5881a3-5b74-470b-a796-14425b452463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:36.236687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5510dac-b6dc-4ebe-a099-b69c5ae95ff8 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:36.237150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5881a3-5b74-470b-a796-14425b452463 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:36.254871 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-cb5881a3-5b74-470b-a796-14425b452463 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:36.254871 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:36.254871 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:36.254871 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:36.254871 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:36.254871 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:36.254871 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:36.254871 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:36.254871 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:36.254871 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:36.254871 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:36.254871 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:36.254871 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:36.254871 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:36.254871 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:36.255940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:36.255940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:36.255940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:36.255940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:36.255940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:36.255940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:36.255940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:36.255940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:36.255940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:36.255940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:36.255940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:36.255940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:36.255940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:36.255940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:36.255940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:36.255940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:36.255940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:36.256795 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:36.256795 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:36.256795 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:36.256795 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:36.256795 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 263/526] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:36.256795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5881a3-5b74-470b-a796-14425b452463 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:36.291020 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:36.343763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5510dac-b6dc-4ebe-a099-b69c5ae95ff8 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:36.370863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5881a3-5b74-470b-a796-14425b452463 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:36.379132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcfdf3-be56-493e-b0ba-dc0a270a11b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:36.379789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcfdf3-be56-493e-b0ba-dc0a270a11b4 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:36.380067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcfdf3-be56-493e-b0ba-dc0a270a11b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:36.380345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcfdf3-be56-493e-b0ba-dc0a270a11b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:36.381129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcfdf3-be56-493e-b0ba-dc0a270a11b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:36.381436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcfdf3-be56-493e-b0ba-dc0a270a11b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:36.382888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dcfdf3-be56-493e-b0ba-dc0a270a11b4 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:36.401694 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 264/527] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:51:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:36.402322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcfdf3-be56-493e-b0ba-dc0a270a11b4 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:36.407099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcee195-d50b-4bcd-847a-49e31fcc7046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:36.407859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcee195-d50b-4bcd-847a-49e31fcc7046 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:36.408408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcee195-d50b-4bcd-847a-49e31fcc7046 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:36.408689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcee195-d50b-4bcd-847a-49e31fcc7046 None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:36.410353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcee195-d50b-4bcd-847a-49e31fcc7046 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:36.410673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcee195-d50b-4bcd-847a-49e31fcc7046 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:36.412100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcee195-d50b-4bcd-847a-49e31fcc7046 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:36.425949 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:36.432443 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 264/528] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:51:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:36.433256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcee195-d50b-4bcd-847a-49e31fcc7046 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:36.518778 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:36.519409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dcfdf3-be56-493e-b0ba-dc0a270a11b4 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:36.534347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcee195-d50b-4bcd-847a-49e31fcc7046 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:36.557475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbbf35-0f4c-4138-b665-2abdf355e8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:36.558179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbbf35-0f4c-4138-b665-2abdf355e8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:36.558462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbbf35-0f4c-4138-b665-2abdf355e8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:36.559014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbbbf35-0f4c-4138-b665-2abdf355e8b3 None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:36.559645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbbf35-0f4c-4138-b665-2abdf355e8b3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:36.559950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbbf35-0f4c-4138-b665-2abdf355e8b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:36.561381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbbbf35-0f4c-4138-b665-2abdf355e8b3 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:36.573806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855312d4-ecc2-4323-bef8-e4c47291ea43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:36.574507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855312d4-ecc2-4323-bef8-e4c47291ea43 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:36.574794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855312d4-ecc2-4323-bef8-e4c47291ea43 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:36.575070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855312d4-ecc2-4323-bef8-e4c47291ea43 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:36.575792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855312d4-ecc2-4323-bef8-e4c47291ea43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:36.576097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855312d4-ecc2-4323-bef8-e4c47291ea43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:36.577450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855312d4-ecc2-4323-bef8-e4c47291ea43 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:36.579993 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 265/529] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Jul 19 13:51:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:36.580682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbbf35-0f4c-4138-b665-2abdf355e8b3 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:36.598898 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 265/530] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:36.598898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855312d4-ecc2-4323-bef8-e4c47291ea43 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:36.664095 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:36.689958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbbbf35-0f4c-4138-b665-2abdf355e8b3 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:36.705237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855312d4-ecc2-4323-bef8-e4c47291ea43 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:36.731045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68937d63-453b-41e8-9595-dab19b19a771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:36.731708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68937d63-453b-41e8-9595-dab19b19a771 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:36.731995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68937d63-453b-41e8-9595-dab19b19a771 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:36.732275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68937d63-453b-41e8-9595-dab19b19a771 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:36.733117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68937d63-453b-41e8-9595-dab19b19a771 None admin] RBAC: Adding query filter params (role.id=56d47830104f4dc09f1076c75acf3ffd, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=dfe9762955004354ab4f1fe02f05a427) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:36.733672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68937d63-453b-41e8-9595-dab19b19a771 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:36.735002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68937d63-453b-41e8-9595-dab19b19a771 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:36.740997 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 266/531] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:51:36 2022] GET /identity/v3/role_assignments?user.id=dfe9762955004354ab4f1fe02f05a427&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=56d47830104f4dc09f1076c75acf3ffd => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:36.741685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fbb63-c251-4d28-86aa-038ed27aac6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:36.742451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fbb63-c251-4d28-86aa-038ed27aac6d None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:36.743335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fbb63-c251-4d28-86aa-038ed27aac6d None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:36.743621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fbb63-c251-4d28-86aa-038ed27aac6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:36.744189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68937d63-453b-41e8-9595-dab19b19a771 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:36.744467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fbb63-c251-4d28-86aa-038ed27aac6d None admin] RBAC: Adding query filter params (role.id=56d47830104f4dc09f1076c75acf3ffd, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=75efea22b2484c1ea79a74e6793050f5) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:36.744784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fbb63-c251-4d28-86aa-038ed27aac6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:36.746405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737fbb63-c251-4d28-86aa-038ed27aac6d None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:36.757577 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 266/532] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:51:36 2022] GET /identity/v3/role_assignments?user.id=75efea22b2484c1ea79a74e6793050f5&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=56d47830104f4dc09f1076c75acf3ffd => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:36.759657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fbb63-c251-4d28-86aa-038ed27aac6d None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:36.779965 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:36.883974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68937d63-453b-41e8-9595-dab19b19a771 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:36.900491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fbb63-c251-4d28-86aa-038ed27aac6d None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:36.938920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f18402-9904-459a-8a22-6f1cbd589c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:36.940254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f18402-9904-459a-8a22-6f1cbd589c9d None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:36.940744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f18402-9904-459a-8a22-6f1cbd589c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:36.941248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f18402-9904-459a-8a22-6f1cbd589c9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:36.943633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1076a1e-bdad-47a9-8e62-8c5c9b4487d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:36.944431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1076a1e-bdad-47a9-8e62-8c5c9b4487d3 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:36.944713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1076a1e-bdad-47a9-8e62-8c5c9b4487d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:36.944986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1076a1e-bdad-47a9-8e62-8c5c9b4487d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:36.953912 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:36.954246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1076a1e-bdad-47a9-8e62-8c5c9b4487d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:36.955740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1076a1e-bdad-47a9-8e62-8c5c9b4487d3 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:36.972825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-d1076a1e-bdad-47a9-8e62-8c5c9b4487d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:36.972825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:36.972825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:36.972825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:36.972825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:36.972825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:36.972825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:36.972825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:36.972825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:36.972825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:36.972825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:36.972825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:36.972825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:51:36.972825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:51:36.972825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:51:36.974013 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:51:36.974013 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:36.974013 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:36.974013 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:36.974013 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:36.974013 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:36.974013 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:36.974013 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:36.974013 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:36.974013 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:36.974013 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:36.974013 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:36.974013 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:36.974013 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:36.974013 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:36.974013 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:36.974013 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:36.974919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:51:36.974919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:51:36.974919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:51:36.974919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:51:36.974919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:51:36.974919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:51:36.974919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:36.974919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:36.979838 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 267/533] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:36.981887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1076a1e-bdad-47a9-8e62-8c5c9b4487d3 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:37.031728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f18402-9904-459a-8a22-6f1cbd589c9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:37.033110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f18402-9904-459a-8a22-6f1cbd589c9d None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:37.064602 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:37.099447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1076a1e-bdad-47a9-8e62-8c5c9b4487d3 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:37.137530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927c380-cff0-47af-8dc1-b81ab7d33d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:37.138341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927c380-cff0-47af-8dc1-b81ab7d33d84 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:37.138626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927c380-cff0-47af-8dc1-b81ab7d33d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:37.138905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5927c380-cff0-47af-8dc1-b81ab7d33d84 None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:37.139806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927c380-cff0-47af-8dc1-b81ab7d33d84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:37.140123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927c380-cff0-47af-8dc1-b81ab7d33d84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:37.141587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5927c380-cff0-47af-8dc1-b81ab7d33d84 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:37.159506 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 267/535] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:37.159739 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 268/535] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:51:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:37.162864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f18402-9904-459a-8a22-6f1cbd589c9d None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:37.165361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927c380-cff0-47af-8dc1-b81ab7d33d84 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:37.250822 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:37.337980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5927c380-cff0-47af-8dc1-b81ab7d33d84 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:37.366088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f18402-9904-459a-8a22-6f1cbd589c9d None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:37.370570 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:37.382909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9475ad-a2a2-4982-83a9-5553dc557f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:37.384338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9475ad-a2a2-4982-83a9-5553dc557f71 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:37.384621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9475ad-a2a2-4982-83a9-5553dc557f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:37.384891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9475ad-a2a2-4982-83a9-5553dc557f71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:37.404653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9475ad-a2a2-4982-83a9-5553dc557f71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:37.406552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9475ad-a2a2-4982-83a9-5553dc557f71 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:37.420538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc4b2e-1381-434d-a285-ef45fe462533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:37.421512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc4b2e-1381-434d-a285-ef45fe462533 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:37.421991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc4b2e-1381-434d-a285-ef45fe462533 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:37.422495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc4b2e-1381-434d-a285-ef45fe462533 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:37.423629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc4b2e-1381-434d-a285-ef45fe462533 None admin] RBAC: Adding query filter params (role.id=56d47830104f4dc09f1076c75acf3ffd, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=ef77d9ec7712434287347d959dcf1cc0) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:37.424152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc4b2e-1381-434d-a285-ef45fe462533 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:37.425770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc4b2e-1381-434d-a285-ef45fe462533 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:37.432604 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 268/536] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:51:37 2022] GET /identity/v3/role_assignments?user.id=ef77d9ec7712434287347d959dcf1cc0&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=56d47830104f4dc09f1076c75acf3ffd => generated 259 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:37.450914 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-bb9475ad-a2a2-4982-83a9-5553dc557f71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:37.450914 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:37.450914 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:37.450914 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:37.450914 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:37.450914 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:37.450914 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:37.450914 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:37.450914 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:37.450914 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:37.450914 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:37.450914 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:37.450914 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:37.450914 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:37.450914 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:37.451841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:37.451841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:37.451841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:37.451841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:37.451841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:37.451841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:37.451841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:37.451841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:37.451841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:37.451841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:37.451841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:37.451841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:37.451841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:37.451841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:37.451841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:37.451841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:37.451841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:37.452674 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:37.452674 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:37.452674 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:37.452674 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:37.452674 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 269/537] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:51:37.462655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc4b2e-1381-434d-a285-ef45fe462533 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:37.623870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc4b2e-1381-434d-a285-ef45fe462533 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:37.625455 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:37.668990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc99849-9fd9-45a2-8aca-3023bdbc99e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:37.669669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc99849-9fd9-45a2-8aca-3023bdbc99e6 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:37.669959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc99849-9fd9-45a2-8aca-3023bdbc99e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:37.670269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc99849-9fd9-45a2-8aca-3023bdbc99e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:37.671012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc99849-9fd9-45a2-8aca-3023bdbc99e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:37.671324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc99849-9fd9-45a2-8aca-3023bdbc99e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:37.672714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc99849-9fd9-45a2-8aca-3023bdbc99e6 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:37.689277 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 269/538] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:37.694533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9475ad-a2a2-4982-83a9-5553dc557f71 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:37.820396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e762c7f-20c1-4ea2-9bd2-f69ee21027c1 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:37.820792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e762c7f-20c1-4ea2-9bd2-f69ee21027c1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:37.820959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e762c7f-20c1-4ea2-9bd2-f69ee21027c1 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:37.822373 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 270/539] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:51:37.835476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40469a0c-8b88-47a0-98bc-8f7d12b73aba None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:37.836065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40469a0c-8b88-47a0-98bc-8f7d12b73aba None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:37.836597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40469a0c-8b88-47a0-98bc-8f7d12b73aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:37.857797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9475ad-a2a2-4982-83a9-5553dc557f71 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:37.867059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-40469a0c-8b88-47a0-98bc-8f7d12b73aba None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:37.871583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-40469a0c-8b88-47a0-98bc-8f7d12b73aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:37.899099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cbcea-9c76-4f76-986d-0b42678c2d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:37.900306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cbcea-9c76-4f76-986d-0b42678c2d06 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:37.900785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cbcea-9c76-4f76-986d-0b42678c2d06 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:37.901252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cbcea-9c76-4f76-986d-0b42678c2d06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:37.916806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cbcea-9c76-4f76-986d-0b42678c2d06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:37.918717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cbcea-9c76-4f76-986d-0b42678c2d06 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:37.934218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-fc6cbcea-9c76-4f76-986d-0b42678c2d06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:37.934218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:37.934218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:37.934218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:37.934218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:37.934218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:37.934218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:37.934218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:37.934218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:37.934218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:37.934218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:37.934218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:37.934218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:51:37.934218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:51:37.934218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:51:37.935082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:51:37.935082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:37.935082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:37.935082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:37.935082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:37.935082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:37.935082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:37.935082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:37.935082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:37.935082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:37.935082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:37.935082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:37.935082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:37.935082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:37.935082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:37.935082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:37.935082 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:37.935927 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:51:37.935927 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:51:37.935927 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:51:37.935927 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:51:37.935927 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:51:37.935927 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:51:37.935927 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:37.935927 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:37.938636 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 270/540] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:37.951122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cbcea-9c76-4f76-986d-0b42678c2d06 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:37.988427 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 271/541] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:38.010465 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:38.027161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40469a0c-8b88-47a0-98bc-8f7d12b73aba None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:38.069177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cbcea-9c76-4f76-986d-0b42678c2d06 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:38.133832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d13ea4-7bee-46bf-818e-afccc6de9023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:38.134530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d13ea4-7bee-46bf-818e-afccc6de9023 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:38.134811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d13ea4-7bee-46bf-818e-afccc6de9023 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:38.135093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d13ea4-7bee-46bf-818e-afccc6de9023 None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:38.136255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d13ea4-7bee-46bf-818e-afccc6de9023 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:38.136570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d13ea4-7bee-46bf-818e-afccc6de9023 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:38.138542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d13ea4-7bee-46bf-818e-afccc6de9023 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:38.170503 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 271/542] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:51:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:38.171442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d13ea4-7bee-46bf-818e-afccc6de9023 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:38.191229 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:38.201885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40469a0c-8b88-47a0-98bc-8f7d12b73aba None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:38.283760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be159366-966b-48ca-ad2b-ac2afdbf383b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:38.284581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be159366-966b-48ca-ad2b-ac2afdbf383b None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:38.284868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be159366-966b-48ca-ad2b-ac2afdbf383b None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:38.285145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be159366-966b-48ca-ad2b-ac2afdbf383b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:38.300328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be159366-966b-48ca-ad2b-ac2afdbf383b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:38.309310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-be159366-966b-48ca-ad2b-ac2afdbf383b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:38.309310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:38.309310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:38.309310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:38.309310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:38.309310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:38.309310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:38.309310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:38.309310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:38.309310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:38.309310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:38.309310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:38.309310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:38.309310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:38.309310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:38.309310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:38.310233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:38.310233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:38.310233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:38.310233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:38.310233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:38.310233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:38.310233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:38.310233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:38.310233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:38.310233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:38.310233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:38.310233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:38.310233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:38.310233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:38.310233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:38.310233 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:38.311023 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:38.311023 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:38.311023 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:38.311023 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:38.311023 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:38.311023 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:38.311023 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:38.311023 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:38.311023 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:38.311023 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:38.311023 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:38.311023 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:38.311023 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 272/543] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:51:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:38.318773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be159366-966b-48ca-ad2b-ac2afdbf383b None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:38.336446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d13ea4-7bee-46bf-818e-afccc6de9023 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:38.342428 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:38.410802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d787b9-d448-48d2-b983-e813720945fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:38.411572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d787b9-d448-48d2-b983-e813720945fa None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:38.411755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d787b9-d448-48d2-b983-e813720945fa None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:38.412010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d787b9-d448-48d2-b983-e813720945fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:38.412854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d787b9-d448-48d2-b983-e813720945fa None admin] RBAC: Adding query filter params (role.id=56d47830104f4dc09f1076c75acf3ffd, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=e997b70d7158446daa1dfa225eb7afca) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:38.413167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d787b9-d448-48d2-b983-e813720945fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:38.416149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d787b9-d448-48d2-b983-e813720945fa None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:38.432867 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 272/544] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:51:38 2022] GET /identity/v3/role_assignments?user.id=e997b70d7158446daa1dfa225eb7afca&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=56d47830104f4dc09f1076c75acf3ffd => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:38.453198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be159366-966b-48ca-ad2b-ac2afdbf383b None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:38.490581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f75a22-a917-4bca-8ebd-4bfba772efcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:38.491277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f75a22-a917-4bca-8ebd-4bfba772efcf None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:38.491567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f75a22-a917-4bca-8ebd-4bfba772efcf None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:38.491849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f75a22-a917-4bca-8ebd-4bfba772efcf None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:38.492694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f75a22-a917-4bca-8ebd-4bfba772efcf None admin] RBAC: Adding query filter params (name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:38.493015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f75a22-a917-4bca-8ebd-4bfba772efcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:38.494485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f75a22-a917-4bca-8ebd-4bfba772efcf None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:38.503857 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 273/545] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 19 13:51:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:38.511267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d787b9-d448-48d2-b983-e813720945fa None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:38.671559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d787b9-d448-48d2-b983-e813720945fa None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:38.713328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f0ee5-a932-4078-b23f-8a496b6d7a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:38.714059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f0ee5-a932-4078-b23f-8a496b6d7a23 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:38.714382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f0ee5-a932-4078-b23f-8a496b6d7a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:38.714661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f0ee5-a932-4078-b23f-8a496b6d7a23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:38.725270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f0ee5-a932-4078-b23f-8a496b6d7a23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:38.731729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f0ee5-a932-4078-b23f-8a496b6d7a23 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:38.754000 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-b14f0ee5-a932-4078-b23f-8a496b6d7a23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:38.754000 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:38.754000 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:38.754000 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:38.754000 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:38.754000 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:38.754000 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:38.754000 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:38.754000 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:38.754000 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:38.754000 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:38.754000 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:38.754000 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:38.754000 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:38.754000 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:38.754934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:38.754934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:38.754934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:38.754934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:38.754934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:38.754934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:38.754934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:38.754934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:38.754934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:38.754934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:38.754934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:38.754934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:38.754934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:38.754934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:38.754934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:38.754934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:38.754934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:38.755769 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:38.755769 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:38.755769 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:38.755769 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:38.755769 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 273/546] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:38.761724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f75a22-a917-4bca-8ebd-4bfba772efcf None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:38.785862 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:38.918441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f75a22-a917-4bca-8ebd-4bfba772efcf None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:38.963211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857cfaa-456d-4883-834d-964eba68a95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:38.963939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857cfaa-456d-4883-834d-964eba68a95c None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:38.964174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857cfaa-456d-4883-834d-964eba68a95c None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:38.964452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857cfaa-456d-4883-834d-964eba68a95c None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:38.965190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857cfaa-456d-4883-834d-964eba68a95c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:38.965499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857cfaa-456d-4883-834d-964eba68a95c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:38.966900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857cfaa-456d-4883-834d-964eba68a95c None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:38.978955 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 274/547] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:38.987438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f0ee5-a932-4078-b23f-8a496b6d7a23 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:39.012207 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:39.101845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f0ee5-a932-4078-b23f-8a496b6d7a23 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:39.139040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb074f6d-2aef-4601-95e9-1307b998af3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:39.139844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb074f6d-2aef-4601-95e9-1307b998af3d None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:39.140126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb074f6d-2aef-4601-95e9-1307b998af3d None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:39.140400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb074f6d-2aef-4601-95e9-1307b998af3d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:39.148078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb074f6d-2aef-4601-95e9-1307b998af3d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:39.150430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb074f6d-2aef-4601-95e9-1307b998af3d None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:39.165478 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-cb074f6d-2aef-4601-95e9-1307b998af3d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 13:51:39.165478 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:39.165478 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:39.165478 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:39.165478 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:39.165478 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:39.165478 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:39.165478 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:39.165478 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:39.165478 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:39.165478 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:39.165478 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:39.165478 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:51:39.165478 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:51:39.165478 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:51:39.165478 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:51:39.166620 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:39.166620 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:39.166620 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:51:39.166620 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:39.166620 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:51:39.166620 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:39.166620 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:39.166620 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:39.166620 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:39.166620 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:39.166620 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:39.166620 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:39.166620 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:39.166620 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:39.166620 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:39.166620 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:39.166620 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:39.166620 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:39.167521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:39.167521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:39.167521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:51:39.167521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:51:39.167521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:51:39.167521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:51:39.167521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:51:39.167521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:51:39.167521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 13:51:39.167521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:39.167521 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 274/548] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:51:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:39.175178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857cfaa-456d-4883-834d-964eba68a95c None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:39.242077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4536b-90b7-4eb5-b152-685cc1377c16 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:39.242401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4536b-90b7-4eb5-b152-685cc1377c16 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:39.242800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c4536b-90b7-4eb5-b152-685cc1377c16 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:39.244429 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 275/549] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:39.249412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1c97d-b55a-46c9-9286-3a573c256fb5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:39.249703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1c97d-b55a-46c9-9286-3a573c256fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:39.249984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef1c97d-b55a-46c9-9286-3a573c256fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:39.274528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-aef1c97d-b55a-46c9-9286-3a573c256fb5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:39.275734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-aef1c97d-b55a-46c9-9286-3a573c256fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:39.290464 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:39.330492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857cfaa-456d-4883-834d-964eba68a95c None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:39.384815 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 276/550] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:51:39.403897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f615d2-ebcb-464b-b9ee-58cf9556a403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:39.404586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f615d2-ebcb-464b-b9ee-58cf9556a403 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:39.404871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f615d2-ebcb-464b-b9ee-58cf9556a403 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:39.405154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f615d2-ebcb-464b-b9ee-58cf9556a403 None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:39.406019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f615d2-ebcb-464b-b9ee-58cf9556a403 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:39.406366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f615d2-ebcb-464b-b9ee-58cf9556a403 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:39.407813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f615d2-ebcb-464b-b9ee-58cf9556a403 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:39.430002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1c97d-b55a-46c9-9286-3a573c256fb5 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:39.432242 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 275/551] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Jul 19 13:51:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:39.441118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f615d2-ebcb-464b-b9ee-58cf9556a403 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:39.447476 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:39.588557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f615d2-ebcb-464b-b9ee-58cf9556a403 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:39.614858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef1c97d-b55a-46c9-9286-3a573c256fb5 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:39.623442 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:39.628511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7990c-a352-447b-b3f2-32c2da035361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:39.629164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7990c-a352-447b-b3f2-32c2da035361 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:39.629448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7990c-a352-447b-b3f2-32c2da035361 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:39.629727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7990c-a352-447b-b3f2-32c2da035361 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:39.665490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216a7404-0453-418e-a47e-3eee3b78d92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:39.667001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a7404-0453-418e-a47e-3eee3b78d92a None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:39.667495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a7404-0453-418e-a47e-3eee3b78d92a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:39.668735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216a7404-0453-418e-a47e-3eee3b78d92a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:39.681810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216a7404-0453-418e-a47e-3eee3b78d92a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:39.692200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-216a7404-0453-418e-a47e-3eee3b78d92a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:39.692200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:39.692200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:39.692200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:39.692200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:39.692200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:39.692200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:39.692200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:39.692200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:39.692200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:39.692200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:39.692200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:39.692200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:39.692200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:39.692200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:39.692200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:39.693105 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:39.693105 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:39.693105 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:39.693105 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:39.693105 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:39.693105 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:39.693105 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:39.693105 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:39.693105 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:39.693105 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:39.693105 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:39.693105 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:39.693105 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:39.693105 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:39.693105 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:39.693105 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:39.693916 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:39.693916 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:39.693916 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:39.693916 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:39.693916 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:39.693916 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:39.693916 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:39.693916 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:39.693916 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:39.693916 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:39.693916 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:39.693916 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:39.700073 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 277/552] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:51:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:39.700073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6a7be-b869-4d0c-b6e9-92fd4c09bf1b None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:39.700073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6a7be-b869-4d0c-b6e9-92fd4c09bf1b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:39.700073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb6a7be-b869-4d0c-b6e9-92fd4c09bf1b None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:39.702174 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 278/553] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:39.703114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6a7be-b869-4d0c-b6e9-92fd4c09bf1b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:39.714357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a7990c-a352-447b-b3f2-32c2da035361 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:39.715975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a7990c-a352-447b-b3f2-32c2da035361 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:39.795393 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:39.836105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb6a7be-b869-4d0c-b6e9-92fd4c09bf1b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:39.842589 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 276/554] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:39.844740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f6d18-8c09-4c48-adaa-0c885f96ea91 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:39.845249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f6d18-8c09-4c48-adaa-0c885f96ea91 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:39.846234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f6d18-8c09-4c48-adaa-0c885f96ea91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:39.868933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-986f6d18-8c09-4c48-adaa-0c885f96ea91 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:39.870313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-986f6d18-8c09-4c48-adaa-0c885f96ea91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:39.872601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d257fe-45df-4b06-8091-99900029c624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:39.873453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d257fe-45df-4b06-8091-99900029c624 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:39.873942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d257fe-45df-4b06-8091-99900029c624 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:39.874494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d257fe-45df-4b06-8091-99900029c624 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:39.875440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d257fe-45df-4b06-8091-99900029c624 None admin] RBAC: Adding query filter params (name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:39.875993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d257fe-45df-4b06-8091-99900029c624 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:39.877569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d257fe-45df-4b06-8091-99900029c624 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:39.887805 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 279/555] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 19 13:51:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:39.888892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d257fe-45df-4b06-8091-99900029c624 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:39.915560 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:39.978152 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 277/556] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:39.978152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f6d18-8c09-4c48-adaa-0c885f96ea91 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:40.005502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d257fe-45df-4b06-8091-99900029c624 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:40.038484 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:40.044767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7170b-7551-44c1-928e-9e39fd443528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:40.045610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7170b-7551-44c1-928e-9e39fd443528 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:40.045899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7170b-7551-44c1-928e-9e39fd443528 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:40.046202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7170b-7551-44c1-928e-9e39fd443528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:40.057482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7170b-7551-44c1-928e-9e39fd443528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:40.059027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7170b-7551-44c1-928e-9e39fd443528 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:40.078179 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-d5c7170b-7551-44c1-928e-9e39fd443528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:40.078179 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:40.078179 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:40.078179 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:40.078179 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:40.078179 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:40.078179 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:40.078179 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:40.078179 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:40.078179 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:40.078179 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:40.078179 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:40.078179 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:40.078179 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:40.078179 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:40.079149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:40.079149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:40.079149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:40.079149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:40.079149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:40.079149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:40.079149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:40.079149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:40.079149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:40.079149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:40.079149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:40.079149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:40.079149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:40.079149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:40.079149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:40.079149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:40.079149 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:40.080034 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:40.080034 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:40.080034 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:40.080034 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:40.080034 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 280/557] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:40.080757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a801f-5740-41fa-af66-6640c94b03d6 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:40.080921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a801f-5740-41fa-af66-6640c94b03d6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:40.081308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a801f-5740-41fa-af66-6640c94b03d6 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:40.087097 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 281/558] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:40.091017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a801f-5740-41fa-af66-6640c94b03d6 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:40.093382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f6d18-8c09-4c48-adaa-0c885f96ea91 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:40.130665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51c661-f4ab-41be-a509-63d12e36818d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:40.131456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51c661-f4ab-41be-a509-63d12e36818d None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:40.131740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51c661-f4ab-41be-a509-63d12e36818d None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:40.132017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51c661-f4ab-41be-a509-63d12e36818d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:40.142078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51c661-f4ab-41be-a509-63d12e36818d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:40.143537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51c661-f4ab-41be-a509-63d12e36818d None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:40.162482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-ee51c661-f4ab-41be-a509-63d12e36818d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:40.162482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:40.162482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:40.162482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:40.162482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:40.162482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:40.162482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:40.162482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:40.162482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:40.162482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:40.162482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:40.162482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:40.162482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:40.162482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:40.162482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:40.163903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:40.163903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:40.163903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:40.163903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:40.163903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:40.163903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:40.163903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:40.163903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:40.163903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:40.163903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:40.163903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:40.163903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:40.163903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:40.163903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:40.163903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:40.163903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:40.163903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:40.166027 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:40.166027 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:40.166027 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:40.166027 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:40.166027 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 278/559] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:40.166027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51c661-f4ab-41be-a509-63d12e36818d None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:40.183751 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:40.235678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a801f-5740-41fa-af66-6640c94b03d6 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:40.271419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51c661-f4ab-41be-a509-63d12e36818d None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:40.274889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b14fc-d94c-43f9-90c3-47a62c751c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:40.275687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b14fc-d94c-43f9-90c3-47a62c751c7e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:40.275966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b14fc-d94c-43f9-90c3-47a62c751c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:40.276238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b14fc-d94c-43f9-90c3-47a62c751c7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:40.287598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b14fc-d94c-43f9-90c3-47a62c751c7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:40.296160 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-3f9b14fc-d94c-43f9-90c3-47a62c751c7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:40.296160 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:40.296160 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:40.296160 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:40.296160 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:40.296160 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:40.296160 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:40.296160 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:40.296160 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:40.296160 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:40.296160 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:40.296160 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:40.296160 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:40.296160 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:40.296160 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:40.296160 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:40.297112 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:40.297112 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:40.297112 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:40.297112 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:40.297112 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:40.297112 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:40.297112 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:40.297112 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:40.297112 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:40.297112 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:40.297112 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:40.297112 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:40.297112 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:40.297112 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:40.297112 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:40.297112 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:40.298021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:40.298021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:40.298021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:40.298021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:40.298021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:40.298021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:40.298021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:40.298021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:40.298021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:40.298021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:40.298021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:40.298021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:40.298021 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 282/560] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:51:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:40.299238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c740f3-b4af-4dfc-b64b-8fa0969a36c8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:40.299397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c740f3-b4af-4dfc-b64b-8fa0969a36c8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:40.299678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c740f3-b4af-4dfc-b64b-8fa0969a36c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:40.314319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5715189-c685-48f8-a9c6-15698a24a730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:40.314989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5715189-c685-48f8-a9c6-15698a24a730 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:40.315276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5715189-c685-48f8-a9c6-15698a24a730 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:40.315556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5715189-c685-48f8-a9c6-15698a24a730 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:40.316286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5715189-c685-48f8-a9c6-15698a24a730 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:40.316595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5715189-c685-48f8-a9c6-15698a24a730 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:40.318029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5715189-c685-48f8-a9c6-15698a24a730 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:40.318336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-63c740f3-b4af-4dfc-b64b-8fa0969a36c8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:40.319522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-63c740f3-b4af-4dfc-b64b-8fa0969a36c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:40.334488 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 279/561] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:40.334488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5715189-c685-48f8-a9c6-15698a24a730 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:40.361223 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:40.393753 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 283/562] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:40.394840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c740f3-b4af-4dfc-b64b-8fa0969a36c8 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:40.419416 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:40.445563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5715189-c685-48f8-a9c6-15698a24a730 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:40.481124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50459788-e309-4d4c-85bb-7942e46445a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:40.482172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50459788-e309-4d4c-85bb-7942e46445a1 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:40.482465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50459788-e309-4d4c-85bb-7942e46445a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:40.482748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50459788-e309-4d4c-85bb-7942e46445a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:40.483794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50459788-e309-4d4c-85bb-7942e46445a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:40.484261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50459788-e309-4d4c-85bb-7942e46445a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:40.485628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50459788-e309-4d4c-85bb-7942e46445a1 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:40.503625 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 280/563] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:40.503625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50459788-e309-4d4c-85bb-7942e46445a1 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:40.512260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c740f3-b4af-4dfc-b64b-8fa0969a36c8 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:40.550821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c0213-c24a-460e-8dc7-26ab03236c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:40.551600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c0213-c24a-460e-8dc7-26ab03236c54 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:40.551886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c0213-c24a-460e-8dc7-26ab03236c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:40.552162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1c0213-c24a-460e-8dc7-26ab03236c54 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:40.552912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c0213-c24a-460e-8dc7-26ab03236c54 None admin] RBAC: Adding query filter params (name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:40.553219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c0213-c24a-460e-8dc7-26ab03236c54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:40.554748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1c0213-c24a-460e-8dc7-26ab03236c54 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:40.568818 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 284/564] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 19 13:51:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:40.568818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c0213-c24a-460e-8dc7-26ab03236c54 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:40.604985 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:40.605175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50459788-e309-4d4c-85bb-7942e46445a1 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:40.644479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c257b6-1d58-4db8-90ff-885e2c1adb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:40.645200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c257b6-1d58-4db8-90ff-885e2c1adb72 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:40.645489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c257b6-1d58-4db8-90ff-885e2c1adb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:40.645766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c257b6-1d58-4db8-90ff-885e2c1adb72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:40.648209 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:40.655801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c257b6-1d58-4db8-90ff-885e2c1adb72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:40.659818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c257b6-1d58-4db8-90ff-885e2c1adb72 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:40.673386 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-f9c257b6-1d58-4db8-90ff-885e2c1adb72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:40.673386 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:40.673386 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:40.673386 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:40.673386 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:40.673386 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:40.673386 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:40.673386 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:40.673386 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:40.673386 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:40.673386 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:40.673386 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:40.673386 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:51:40.673386 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:51:40.673386 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:51:40.674502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:51:40.674502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:40.674502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:40.674502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:40.674502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:40.674502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:40.674502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:40.674502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:40.674502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:40.674502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:40.674502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:40.674502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:40.674502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:40.674502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:40.674502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:40.674502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:40.674502 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:40.675627 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:51:40.675627 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:51:40.675627 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:51:40.675627 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:51:40.675627 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:51:40.675627 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:51:40.675627 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:40.675627 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:40.676167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1c0213-c24a-460e-8dc7-26ab03236c54 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:40.677500 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 281/565] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:40.678441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c257b6-1d58-4db8-90ff-885e2c1adb72 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:40.715690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f674c8e-1b36-4294-88a1-e9239550ea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:40.716491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f674c8e-1b36-4294-88a1-e9239550ea91 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:40.716776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f674c8e-1b36-4294-88a1-e9239550ea91 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:40.717055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f674c8e-1b36-4294-88a1-e9239550ea91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:40.727761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f674c8e-1b36-4294-88a1-e9239550ea91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:40.735442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-0f674c8e-1b36-4294-88a1-e9239550ea91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:40.735442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:40.735442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:40.735442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:40.735442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:40.735442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:40.735442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:40.735442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:40.735442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:40.735442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:40.735442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:40.735442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:40.735442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:40.735442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:40.735442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:40.735442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:40.736374 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:40.736374 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:40.736374 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:40.736374 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:40.736374 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:40.736374 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:40.736374 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:40.736374 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:40.736374 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:40.736374 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:40.736374 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:40.736374 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:40.736374 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:40.736374 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:40.736374 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:40.736374 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:40.737213 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:40.737213 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:40.737213 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:40.737213 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:40.737213 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:40.737213 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:40.737213 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:40.737213 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:40.737213 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:40.737213 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:40.737213 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:40.737213 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:40.737213 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 285/566] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:51:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:40.737911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f674c8e-1b36-4294-88a1-e9239550ea91 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:40.788448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c257b6-1d58-4db8-90ff-885e2c1adb72 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:40.823281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e53e22-3197-4b8f-b5e8-b30bb31b2e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:40.824316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e53e22-3197-4b8f-b5e8-b30bb31b2e1b None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:40.824433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e53e22-3197-4b8f-b5e8-b30bb31b2e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:40.824650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e53e22-3197-4b8f-b5e8-b30bb31b2e1b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:40.832089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e53e22-3197-4b8f-b5e8-b30bb31b2e1b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:40.832865 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:40.833644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e53e22-3197-4b8f-b5e8-b30bb31b2e1b None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:40.839909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f674c8e-1b36-4294-88a1-e9239550ea91 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:40.847860 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-06e53e22-3197-4b8f-b5e8-b30bb31b2e1b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 13:51:40.847860 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:40.847860 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:40.847860 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:40.847860 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:40.847860 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:40.847860 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:40.847860 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:40.847860 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:40.847860 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:40.847860 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:40.847860 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:40.847860 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:51:40.847860 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:51:40.847860 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:51:40.847860 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:51:40.848814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:40.848814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:40.848814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:51:40.848814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:40.848814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:51:40.848814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:40.848814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:40.848814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:40.848814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:40.848814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:40.848814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:40.848814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:40.848814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:40.848814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:40.848814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:40.848814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:40.848814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:40.848814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:40.850014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:40.850014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:40.850014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:51:40.850014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:51:40.850014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:51:40.850014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:51:40.850014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:51:40.850014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:51:40.850014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 13:51:40.850014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:40.850014 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 282/567] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jul 19 13:51:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:40.850014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e53e22-3197-4b8f-b5e8-b30bb31b2e1b None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:40.877621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b09d2-b9ce-4e7a-9f6d-cb3ac226ae07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:40.878447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b09d2-b9ce-4e7a-9f6d-cb3ac226ae07 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:40.878736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b09d2-b9ce-4e7a-9f6d-cb3ac226ae07 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:40.879015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b09d2-b9ce-4e7a-9f6d-cb3ac226ae07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:40.889550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b09d2-b9ce-4e7a-9f6d-cb3ac226ae07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:40.891031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b09d2-b9ce-4e7a-9f6d-cb3ac226ae07 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:40.905834 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:40.908853 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-dd6b09d2-b9ce-4e7a-9f6d-cb3ac226ae07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:40.908853 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:40.908853 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:40.908853 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:40.908853 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:40.908853 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:40.908853 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:40.908853 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:40.908853 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:40.908853 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:40.908853 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:40.908853 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:40.908853 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:40.908853 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:40.908853 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:40.909742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:40.909742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:40.909742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:40.909742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:40.909742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:40.909742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:40.909742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:40.909742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:40.909742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:40.909742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:40.909742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:40.909742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:40.909742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:40.909742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:40.909742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:40.909742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:40.909742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:40.910878 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:40.910878 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:40.910878 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:40.910878 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:40.910878 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 286/568] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:40.910878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b09d2-b9ce-4e7a-9f6d-cb3ac226ae07 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:40.956199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e53e22-3197-4b8f-b5e8-b30bb31b2e1b None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:40.990768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb3782-fa44-4f50-adc6-7f759c64545b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:40.991428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb3782-fa44-4f50-adc6-7f759c64545b None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:40.991715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb3782-fa44-4f50-adc6-7f759c64545b None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:40.991994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb3782-fa44-4f50-adc6-7f759c64545b None admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:40.993478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb3782-fa44-4f50-adc6-7f759c64545b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:40.993894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb3782-fa44-4f50-adc6-7f759c64545b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:40.995236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb3782-fa44-4f50-adc6-7f759c64545b None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:41.007101 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 283/569] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:51:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:41.008539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b09d2-b9ce-4e7a-9f6d-cb3ac226ae07 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:41.009073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4582fcb-6d26-40fa-ba5d-c13bbb7607cb None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:41.009073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4582fcb-6d26-40fa-ba5d-c13bbb7607cb None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:41.009233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4582fcb-6d26-40fa-ba5d-c13bbb7607cb None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:41.014346 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 284/570] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:41.014346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4582fcb-6d26-40fa-ba5d-c13bbb7607cb None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:41.047226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355f135-f519-4791-bcfb-fcaf519517a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:41.047891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355f135-f519-4791-bcfb-fcaf519517a8 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:41.048168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355f135-f519-4791-bcfb-fcaf519517a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:41.048442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355f135-f519-4791-bcfb-fcaf519517a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:41.049185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355f135-f519-4791-bcfb-fcaf519517a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:41.049487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355f135-f519-4791-bcfb-fcaf519517a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:41.050875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355f135-f519-4791-bcfb-fcaf519517a8 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:41.059837 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 287/571] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 19 13:51:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:41.060624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355f135-f519-4791-bcfb-fcaf519517a8 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:41.071447 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:41.123215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4582fcb-6d26-40fa-ba5d-c13bbb7607cb None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:41.137305 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:41.158625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c552e-0714-451b-8b6d-bc9edb391ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:41.159226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c552e-0714-451b-8b6d-bc9edb391ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:41.159661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c552e-0714-451b-8b6d-bc9edb391ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:41.159986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c552e-0714-451b-8b6d-bc9edb391ea4 None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:41.160837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c552e-0714-451b-8b6d-bc9edb391ea4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:41.161148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c552e-0714-451b-8b6d-bc9edb391ea4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:41.162614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c552e-0714-451b-8b6d-bc9edb391ea4 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:41.163445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355f135-f519-4791-bcfb-fcaf519517a8 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:41.180502 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 285/572] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jul 19 13:51:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:41.181496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c552e-0714-451b-8b6d-bc9edb391ea4 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:41.202416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4a7ae-03e5-4b99-b2a3-df73e072efaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:41.203076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4a7ae-03e5-4b99-b2a3-df73e072efaf None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:41.203362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4a7ae-03e5-4b99-b2a3-df73e072efaf None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:41.203636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4a7ae-03e5-4b99-b2a3-df73e072efaf None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:41.204373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4a7ae-03e5-4b99-b2a3-df73e072efaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:41.204666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4a7ae-03e5-4b99-b2a3-df73e072efaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:41.206036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4a7ae-03e5-4b99-b2a3-df73e072efaf None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:41.223971 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 288/573] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:41.223971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108ad2a-5705-4bb2-9245-cb37cbf85623 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:41.223971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108ad2a-5705-4bb2-9245-cb37cbf85623 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:41.223971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3108ad2a-5705-4bb2-9245-cb37cbf85623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:41.237937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3108ad2a-5705-4bb2-9245-cb37cbf85623 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:41.239157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3108ad2a-5705-4bb2-9245-cb37cbf85623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:41.283188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c552e-0714-451b-8b6d-bc9edb391ea4 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:41.298950 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:41.304419 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 289/574] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:41.305088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108ad2a-5705-4bb2-9245-cb37cbf85623 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:41.325902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8a8a7-a519-4b38-8fe6-4341a3b642d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:41.326610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8a8a7-a519-4b38-8fe6-4341a3b642d7 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:41.326898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8a8a7-a519-4b38-8fe6-4341a3b642d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:41.327204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8a8a7-a519-4b38-8fe6-4341a3b642d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:41.328470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8a8a7-a519-4b38-8fe6-4341a3b642d7 None admin] RBAC: Adding query filter params (role.id=56d47830104f4dc09f1076c75acf3ffd, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=0789b4be9dae4c05bb3ec4a5e0f1f308) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:41.328793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8a8a7-a519-4b38-8fe6-4341a3b642d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:41.330240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8a8a7-a519-4b38-8fe6-4341a3b642d7 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:41.335795 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 286/575] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:51:41 2022] GET /identity/v3/role_assignments?user.id=0789b4be9dae4c05bb3ec4a5e0f1f308&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=56d47830104f4dc09f1076c75acf3ffd => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:41.337134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8a8a7-a519-4b38-8fe6-4341a3b642d7 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:41.390513 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:41.421243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3108ad2a-5705-4bb2-9245-cb37cbf85623 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:41.463077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8a8a7-a519-4b38-8fe6-4341a3b642d7 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:41.468609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324c2f5-c69b-4f0c-a336-8788da40e3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:41.469753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324c2f5-c69b-4f0c-a336-8788da40e3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:41.470256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324c2f5-c69b-4f0c-a336-8788da40e3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:41.470715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b324c2f5-c69b-4f0c-a336-8788da40e3e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:41.483800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324c2f5-c69b-4f0c-a336-8788da40e3e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:41.485524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b324c2f5-c69b-4f0c-a336-8788da40e3e3 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:41.502409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b23305-c168-4805-b302-6eaa800220c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:41.503210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b23305-c168-4805-b302-6eaa800220c5 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:41.503490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b23305-c168-4805-b302-6eaa800220c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:41.503767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b23305-c168-4805-b302-6eaa800220c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:41.507021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-b324c2f5-c69b-4f0c-a336-8788da40e3e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:41.507021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:41.507021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:41.507021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:41.507021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:41.507021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:41.507021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:41.507021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:41.507021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:41.507021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:41.507021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:41.507021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:41.507021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:41.507021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:41.507021 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:41.507877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:41.507877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:41.507877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:41.507877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:41.507877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:41.507877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:41.507877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:41.507877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:41.507877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:41.507877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:41.507877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:41.507877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:41.507877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:41.507877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:41.507877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:41.507877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:41.507877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:41.508820 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:41.508820 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:41.508820 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:41.508820 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:41.513568 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 290/576] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:41.514460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324c2f5-c69b-4f0c-a336-8788da40e3e3 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:41.516877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b23305-c168-4805-b302-6eaa800220c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:41.518388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b23305-c168-4805-b302-6eaa800220c5 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:41.536500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-99b23305-c168-4805-b302-6eaa800220c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:41.536500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:41.536500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:41.536500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:41.536500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:41.536500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:41.536500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:41.536500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:41.536500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:41.536500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:41.536500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:41.536500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:41.536500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:41.536500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:41.536500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:41.537439 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:41.537439 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:41.537439 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:41.537439 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:41.537439 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:41.537439 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:41.537439 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:41.537439 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:41.537439 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:41.537439 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:41.537439 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:41.537439 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:41.537439 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:41.537439 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:41.537439 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:41.537439 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:41.537439 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:41.538390 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:41.538390 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:41.538390 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:41.538390 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:41.538390 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 287/577] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:41.538667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b23305-c168-4805-b302-6eaa800220c5 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:41.575378 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:41.629040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b324c2f5-c69b-4f0c-a336-8788da40e3e3 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:41.641844 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:41.653733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b23305-c168-4805-b302-6eaa800220c5 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:41.671845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cedac-856a-4f1c-90f5-0aa8a0abc2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:41.672576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cedac-856a-4f1c-90f5-0aa8a0abc2f5 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:41.672862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cedac-856a-4f1c-90f5-0aa8a0abc2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:41.673139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77cedac-856a-4f1c-90f5-0aa8a0abc2f5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:41.681971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cedac-856a-4f1c-90f5-0aa8a0abc2f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:41.683594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77cedac-856a-4f1c-90f5-0aa8a0abc2f5 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:41.691691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a51e47-8a10-4f4c-b889-51f3cdff02b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:41.692482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a51e47-8a10-4f4c-b889-51f3cdff02b0 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:41.695407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a51e47-8a10-4f4c-b889-51f3cdff02b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:41.695713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a51e47-8a10-4f4c-b889-51f3cdff02b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:41.698806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-c77cedac-856a-4f1c-90f5-0aa8a0abc2f5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 19 13:51:41.698806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:41.698806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:41.698806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:41.698806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:41.698806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:41.698806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:41.698806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:41.698806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:41.698806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:41.698806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:41.698806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:41.698806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:51:41.698806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:51:41.698806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:51:41.698806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:51:41.699723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:41.699723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:41.699723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:51:41.699723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:41.699723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:51:41.699723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:41.699723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:41.699723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:41.699723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:41.699723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:41.699723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:41.699723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:41.699723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:41.699723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:41.699723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:41.699723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:41.699723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:41.699723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:41.705719 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:41.705719 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:41.705719 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:51:41.705719 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:51:41.705719 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:51:41.705719 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:51:41.705719 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:51:41.705719 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:51:41.705719 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 19 13:51:41.705719 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:41.705719 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 291/578] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:41.705719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cedac-856a-4f1c-90f5-0aa8a0abc2f5 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:41.716667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a51e47-8a10-4f4c-b889-51f3cdff02b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:41.725133 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-b4a51e47-8a10-4f4c-b889-51f3cdff02b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:41.725133 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:41.725133 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:41.725133 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:41.725133 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:41.725133 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:41.725133 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:41.725133 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:41.725133 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:41.725133 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:41.725133 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:41.725133 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:41.725133 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:41.725133 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:41.725133 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:41.725133 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:41.726250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:41.726250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:41.726250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:41.726250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:41.726250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:41.726250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:41.726250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:41.726250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:41.726250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:41.726250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:41.726250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:41.726250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:41.726250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:41.726250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:41.726250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:41.726250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:41.728555 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:41.728555 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:41.728555 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:41.728555 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:41.728555 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:41.728555 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:41.728555 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:41.728555 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:41.728555 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:41.728555 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:41.728555 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:41.728555 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:41.728555 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 288/579] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:51:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:41.728555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a51e47-8a10-4f4c-b889-51f3cdff02b0 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:41.819158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77cedac-856a-4f1c-90f5-0aa8a0abc2f5 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:41.832973 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:41.833153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a51e47-8a10-4f4c-b889-51f3cdff02b0 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:41.859514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e970a-5fb7-49a9-bf30-4a84b722453f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:41.860993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e970a-5fb7-49a9-bf30-4a84b722453f None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:41.861296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e970a-5fb7-49a9-bf30-4a84b722453f None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:41.861574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e970a-5fb7-49a9-bf30-4a84b722453f None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:41.862334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e970a-5fb7-49a9-bf30-4a84b722453f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:41.862645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e970a-5fb7-49a9-bf30-4a84b722453f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:41.864287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e970a-5fb7-49a9-bf30-4a84b722453f None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:41.869492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619e756-0fb5-494a-81f9-48d4354c55a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:41.870178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619e756-0fb5-494a-81f9-48d4354c55a7 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:41.870465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619e756-0fb5-494a-81f9-48d4354c55a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:41.870741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619e756-0fb5-494a-81f9-48d4354c55a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:41.871466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619e756-0fb5-494a-81f9-48d4354c55a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:41.871771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619e756-0fb5-494a-81f9-48d4354c55a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:41.873112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619e756-0fb5-494a-81f9-48d4354c55a7 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:41.881956 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 292/580] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:41.882701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e970a-5fb7-49a9-bf30-4a84b722453f None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:41.885558 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 289/581] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:41.886367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619e756-0fb5-494a-81f9-48d4354c55a7 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:41.897152 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:41.996142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619e756-0fb5-494a-81f9-48d4354c55a7 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:42.002478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e970a-5fb7-49a9-bf30-4a84b722453f None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:42.034356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbf5dd-13da-43a4-a84a-f41a75bb0241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:42.035026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbf5dd-13da-43a4-a84a-f41a75bb0241 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:42.035308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbf5dd-13da-43a4-a84a-f41a75bb0241 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:42.035583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbf5dd-13da-43a4-a84a-f41a75bb0241 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:42.036329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbf5dd-13da-43a4-a84a-f41a75bb0241 None admin] RBAC: Adding query filter params (name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:42.036634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbf5dd-13da-43a4-a84a-f41a75bb0241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:42.037252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08713d7f-4df5-4425-a08b-4f8b4936d1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:42.037937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08713d7f-4df5-4425-a08b-4f8b4936d1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:42.038035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbf5dd-13da-43a4-a84a-f41a75bb0241 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:42.038238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08713d7f-4df5-4425-a08b-4f8b4936d1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:42.038514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08713d7f-4df5-4425-a08b-4f8b4936d1f8 None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:42.039355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08713d7f-4df5-4425-a08b-4f8b4936d1f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:42.039664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08713d7f-4df5-4425-a08b-4f8b4936d1f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:42.041079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08713d7f-4df5-4425-a08b-4f8b4936d1f8 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:42.052042 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 290/582] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 19 13:51:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:42.052042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbf5dd-13da-43a4-a84a-f41a75bb0241 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:42.064668 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 293/583] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Jul 19 13:51:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:42.065478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08713d7f-4df5-4425-a08b-4f8b4936d1f8 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:42.094887 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:42.137424 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:42.168684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbf5dd-13da-43a4-a84a-f41a75bb0241 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:42.173547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08713d7f-4df5-4425-a08b-4f8b4936d1f8 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:42.201991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e54233-baef-4a74-bef0-8831e59fc879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:42.202821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e54233-baef-4a74-bef0-8831e59fc879 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:42.203111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e54233-baef-4a74-bef0-8831e59fc879 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:42.203395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e54233-baef-4a74-bef0-8831e59fc879 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:42.213911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00da940-d796-4f4a-89eb-8b1eb4ca7286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:42.214752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00da940-d796-4f4a-89eb-8b1eb4ca7286 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:42.215036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00da940-d796-4f4a-89eb-8b1eb4ca7286 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:42.215156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e54233-baef-4a74-bef0-8831e59fc879 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:42.215323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00da940-d796-4f4a-89eb-8b1eb4ca7286 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:42.216535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e54233-baef-4a74-bef0-8831e59fc879 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:42.222389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00da940-d796-4f4a-89eb-8b1eb4ca7286 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:42.223826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00da940-d796-4f4a-89eb-8b1eb4ca7286 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:42.237675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-d4e54233-baef-4a74-bef0-8831e59fc879 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 13:51:42.237675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:42.237675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:42.237675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:42.237675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:42.237675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:42.237675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:42.237675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:42.237675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:42.237675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:42.237675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:42.237675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:42.237675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:51:42.237675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:51:42.237675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:51:42.237675 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:51:42.238648 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:42.238648 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:42.238648 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:51:42.238648 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:42.238648 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:51:42.238648 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:42.238648 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:42.238648 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:42.238648 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:42.238648 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:42.238648 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:42.238648 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:42.238648 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:42.238648 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:42.238648 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:42.238648 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:42.238648 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:42.238648 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:42.244786 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:42.244786 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:42.244786 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:51:42.244786 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:51:42.244786 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:51:42.244786 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:51:42.244786 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:51:42.244786 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:51:42.244786 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 13:51:42.244786 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:42.245335 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-f00da940-d796-4f4a-89eb-8b1eb4ca7286 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:42.245335 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:42.245335 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:42.245335 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:42.245335 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:42.245335 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:42.245335 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:42.245335 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:42.245335 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:42.245335 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:42.245335 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:42.245335 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:42.245335 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:51:42.245335 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:51:42.245335 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:51:42.246215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:51:42.246215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:42.246215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:42.246215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:42.246215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:42.246215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:42.246215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:42.246215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:42.246215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:42.246215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:42.246215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:42.246215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:42.246215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:42.246215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:42.246215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:42.246215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:42.246215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:42.247104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:51:42.247104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:51:42.247104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:51:42.247104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:51:42.247104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:51:42.247104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:51:42.247104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:42.247104 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:42.247555 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 291/584] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:42.247555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e54233-baef-4a74-bef0-8831e59fc879 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:42.247688 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 294/585] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:42.247688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00da940-d796-4f4a-89eb-8b1eb4ca7286 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:42.338852 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:42.352693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00da940-d796-4f4a-89eb-8b1eb4ca7286 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:42.358252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e54233-baef-4a74-bef0-8831e59fc879 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:42.386931 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:42.387897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d6332-b0b1-4e75-9da1-c399383aa1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:42.388699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d6332-b0b1-4e75-9da1-c399383aa1fc None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:42.388990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d6332-b0b1-4e75-9da1-c399383aa1fc None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:42.389250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d6332-b0b1-4e75-9da1-c399383aa1fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:42.393578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0268846-3379-44e2-a13c-4d788178e27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:42.394661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0268846-3379-44e2-a13c-4d788178e27b None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:42.394758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0268846-3379-44e2-a13c-4d788178e27b None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:42.395010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0268846-3379-44e2-a13c-4d788178e27b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:42.402176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d6332-b0b1-4e75-9da1-c399383aa1fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:42.404060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d6332-b0b1-4e75-9da1-c399383aa1fc None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:42.406605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0268846-3379-44e2-a13c-4d788178e27b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:42.408046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0268846-3379-44e2-a13c-4d788178e27b None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:42.424696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-1a3d6332-b0b1-4e75-9da1-c399383aa1fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:42.424696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:42.424696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:42.424696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:42.424696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:42.424696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:42.424696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:42.424696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:42.424696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:42.424696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:42.424696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:42.424696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:42.424696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:42.424696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:42.424696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:42.425612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:42.425612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:42.425612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:42.425612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:42.425612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:42.425612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:42.425612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:42.425612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:42.425612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:42.425612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:42.425612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:42.425612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:42.425612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:42.425612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:42.425612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:42.425612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:42.425612 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:42.426513 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:42.426513 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:42.426513 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:42.426513 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:42.426513 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 295/586] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:42.427225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d6332-b0b1-4e75-9da1-c399383aa1fc None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:42.430845 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-e0268846-3379-44e2-a13c-4d788178e27b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:42.430845 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:42.430845 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:42.430845 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:42.430845 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:42.430845 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:42.430845 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:42.430845 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:42.430845 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:42.430845 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:42.430845 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:42.430845 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:42.430845 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:42.430845 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:42.430845 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:42.431945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:42.431945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:42.431945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:42.431945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:42.431945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:42.431945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:42.431945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:42.431945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:42.431945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:42.431945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:42.431945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:42.431945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:42.431945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:42.431945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:42.431945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:42.431945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:42.431945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:42.432834 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:42.432834 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:42.432834 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:42.432834 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:42.438242 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 292/587] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:42.439235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0268846-3379-44e2-a13c-4d788178e27b None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:42.538930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d6332-b0b1-4e75-9da1-c399383aa1fc None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:42.551389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0268846-3379-44e2-a13c-4d788178e27b None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:42.580177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3acab06-a6dd-4fd7-b1b8-7540e2abfd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:42.581218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acab06-a6dd-4fd7-b1b8-7540e2abfd9a None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:42.581689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acab06-a6dd-4fd7-b1b8-7540e2abfd9a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:42.582308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3acab06-a6dd-4fd7-b1b8-7540e2abfd9a None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:42.583281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3acab06-a6dd-4fd7-b1b8-7540e2abfd9a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:42.583595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3acab06-a6dd-4fd7-b1b8-7540e2abfd9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:42.585244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3acab06-a6dd-4fd7-b1b8-7540e2abfd9a None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:42.585422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eda1b8-c967-402d-9483-1c32223af776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:42.586039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eda1b8-c967-402d-9483-1c32223af776 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:42.586878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eda1b8-c967-402d-9483-1c32223af776 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:42.587330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eda1b8-c967-402d-9483-1c32223af776 None admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:42.588248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eda1b8-c967-402d-9483-1c32223af776 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:42.589232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eda1b8-c967-402d-9483-1c32223af776 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:42.589965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eda1b8-c967-402d-9483-1c32223af776 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:42.596624 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:42.607081 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 293/588] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:51:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:42.607081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eda1b8-c967-402d-9483-1c32223af776 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:42.614781 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 296/589] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Jul 19 13:51:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:42.615550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3acab06-a6dd-4fd7-b1b8-7540e2abfd9a None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:42.653048 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:42.713049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eda1b8-c967-402d-9483-1c32223af776 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:42.720051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3acab06-a6dd-4fd7-b1b8-7540e2abfd9a None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:42.749460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef22d76-7eac-4880-aeb4-8b57397046f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:42.750316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef22d76-7eac-4880-aeb4-8b57397046f5 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:42.750578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef22d76-7eac-4880-aeb4-8b57397046f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:42.751172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef22d76-7eac-4880-aeb4-8b57397046f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:42.752104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef22d76-7eac-4880-aeb4-8b57397046f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:42.752362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef22d76-7eac-4880-aeb4-8b57397046f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:42.753735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef22d76-7eac-4880-aeb4-8b57397046f5 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:42.755412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b28ede-5faf-4d78-836c-3a3a5c570ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:42.756076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b28ede-5faf-4d78-836c-3a3a5c570ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:42.756359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b28ede-5faf-4d78-836c-3a3a5c570ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:42.756639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b28ede-5faf-4d78-836c-3a3a5c570ab6 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:42.757363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b28ede-5faf-4d78-836c-3a3a5c570ab6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:42.757673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b28ede-5faf-4d78-836c-3a3a5c570ab6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:42.759777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b28ede-5faf-4d78-836c-3a3a5c570ab6 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:42.767176 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 294/590] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:42.768144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef22d76-7eac-4880-aeb4-8b57397046f5 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:42.775861 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 297/591] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:42.776946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b28ede-5faf-4d78-836c-3a3a5c570ab6 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:42.840146 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:42.885048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b28ede-5faf-4d78-836c-3a3a5c570ab6 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:42.886196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef22d76-7eac-4880-aeb4-8b57397046f5 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:42.888466 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:42.920742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20bb5e-b40f-42f7-b438-0b5f254e2f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:42.921075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3de51-9061-4758-a258-4b3d0a89271c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:42.921647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20bb5e-b40f-42f7-b438-0b5f254e2f28 None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:42.921860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3de51-9061-4758-a258-4b3d0a89271c None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:42.921960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20bb5e-b40f-42f7-b438-0b5f254e2f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:42.922171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3de51-9061-4758-a258-4b3d0a89271c None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:42.922270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20bb5e-b40f-42f7-b438-0b5f254e2f28 None admin] PATH_INFO: `/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/dfe9762955004354ab4f1fe02f05a427/roles/56d47830104f4dc09f1076c75acf3ffd` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:42.922455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3de51-9061-4758-a258-4b3d0a89271c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:42.933402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3de51-9061-4758-a258-4b3d0a89271c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:42.934884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3de51-9061-4758-a258-4b3d0a89271c None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:42.939041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20bb5e-b40f-42f7-b438-0b5f254e2f28 None admin] RBAC: Authorizing `identity:create_grant(project_id=dfcbe281a77242bbb3774c4aacef50d4, user_id=dfe9762955004354ab4f1fe02f05a427, role_id=56d47830104f4dc09f1076c75acf3ffd)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:42.941090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20bb5e-b40f-42f7-b438-0b5f254e2f28 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:42.952766 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-6ed3de51-9061-4758-a258-4b3d0a89271c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:42.952766 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:42.952766 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:42.952766 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:42.952766 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:42.952766 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:42.952766 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:42.952766 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:42.952766 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:42.952766 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:42.952766 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:42.952766 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:42.952766 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:42.952766 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:42.952766 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:42.956373 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:42.956373 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:42.956373 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:42.956373 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:42.956373 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:42.956373 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:42.956373 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:42.956373 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:42.956373 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:42.956373 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:42.956373 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:42.956373 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:42.956373 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:42.956373 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:42.956373 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:42.956373 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:42.956373 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:42.957266 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:42.957266 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:42.957266 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:42.957266 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:42.957266 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 298/592] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:42.957266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3de51-9061-4758-a258-4b3d0a89271c None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:43.037830 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 295/593] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:51:42 2022] PUT /identity/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/dfe9762955004354ab4f1fe02f05a427/roles/56d47830104f4dc09f1076c75acf3ffd => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:51:43.047088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20bb5e-b40f-42f7-b438-0b5f254e2f28 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:43.058808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3de51-9061-4758-a258-4b3d0a89271c None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:43.072066 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:43.099035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18747dc-9909-4855-9992-dd76495b7d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:43.099867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18747dc-9909-4855-9992-dd76495b7d49 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:43.100548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18747dc-9909-4855-9992-dd76495b7d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:43.101167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18747dc-9909-4855-9992-dd76495b7d49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:43.109721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18747dc-9909-4855-9992-dd76495b7d49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:43.111306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18747dc-9909-4855-9992-dd76495b7d49 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:43.127060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-e18747dc-9909-4855-9992-dd76495b7d49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:43.127060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:43.127060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:43.127060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:43.127060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:43.127060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:43.127060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:43.127060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:43.127060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:43.127060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:43.127060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:43.127060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:43.127060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:51:43.127060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:51:43.127060 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:51:43.128360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:51:43.128360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:43.128360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:43.128360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:43.128360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:43.128360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:43.128360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:43.128360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:43.128360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:43.128360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:43.128360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:43.128360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:43.128360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:43.128360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:43.128360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:43.128360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:43.128360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:43.129509 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:51:43.129509 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:51:43.129509 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:51:43.129509 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:51:43.129509 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:51:43.129509 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:51:43.129509 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:43.129509 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:43.136618 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 299/594] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:43.137796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18747dc-9909-4855-9992-dd76495b7d49 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:43.226884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20bb5e-b40f-42f7-b438-0b5f254e2f28 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:43.267884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18747dc-9909-4855-9992-dd76495b7d49 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:43.269681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29009dfc-2013-4067-9b86-f93b086c5905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:43.270858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29009dfc-2013-4067-9b86-f93b086c5905 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:43.271495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29009dfc-2013-4067-9b86-f93b086c5905 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:43.271968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29009dfc-2013-4067-9b86-f93b086c5905 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:43.280272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29009dfc-2013-4067-9b86-f93b086c5905 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:43.282003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29009dfc-2013-4067-9b86-f93b086c5905 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:43.299054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-29009dfc-2013-4067-9b86-f93b086c5905 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 13:51:43.299054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:43.299054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:43.299054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:43.299054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:43.299054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:43.299054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:43.299054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:43.299054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:43.299054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:43.299054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:43.299054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:43.299054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:51:43.299054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:51:43.299054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:51:43.299054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:51:43.300012 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:43.300012 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:43.300012 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:51:43.300012 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:43.300012 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:51:43.300012 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:43.300012 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:43.300012 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:43.300012 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:43.300012 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:43.300012 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:43.300012 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:43.300012 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:43.300012 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:43.300012 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:43.300012 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:43.300012 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:43.300012 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:43.300955 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:43.300955 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:43.300955 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:51:43.300955 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:51:43.300955 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:51:43.300955 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:51:43.300955 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:51:43.300955 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:51:43.300955 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 13:51:43.300955 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:43.303113 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 296/595] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:51:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:43.304036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29009dfc-2013-4067-9b86-f93b086c5905 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:43.311853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebfb0a-9f8f-49b2-b2e7-591d2ffca663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:43.313085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebfb0a-9f8f-49b2-b2e7-591d2ffca663 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:43.313567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebfb0a-9f8f-49b2-b2e7-591d2ffca663 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:43.314200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ebfb0a-9f8f-49b2-b2e7-591d2ffca663 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:43.315121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebfb0a-9f8f-49b2-b2e7-591d2ffca663 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:43.315621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebfb0a-9f8f-49b2-b2e7-591d2ffca663 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:43.317198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ebfb0a-9f8f-49b2-b2e7-591d2ffca663 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:43.329340 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 300/596] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:43.330459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebfb0a-9f8f-49b2-b2e7-591d2ffca663 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:43.358569 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:43.367247 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:43.416646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29009dfc-2013-4067-9b86-f93b086c5905 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:43.440658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ebfb0a-9f8f-49b2-b2e7-591d2ffca663 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:43.457251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a79f5c-029b-4b15-b7ce-ab17d14c54a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:43.458431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a79f5c-029b-4b15-b7ce-ab17d14c54a1 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:43.459014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a79f5c-029b-4b15-b7ce-ab17d14c54a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:43.459484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a79f5c-029b-4b15-b7ce-ab17d14c54a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:43.460729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a79f5c-029b-4b15-b7ce-ab17d14c54a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:43.461195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a79f5c-029b-4b15-b7ce-ab17d14c54a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:43.463267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a79f5c-029b-4b15-b7ce-ab17d14c54a1 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:43.476022 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 297/597] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:51:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:43.476814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a79f5c-029b-4b15-b7ce-ab17d14c54a1 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:43.485856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f068e8e-518a-4389-a58f-7ee215640f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:43.486880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f068e8e-518a-4389-a58f-7ee215640f65 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:43.487345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f068e8e-518a-4389-a58f-7ee215640f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:43.487810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f068e8e-518a-4389-a58f-7ee215640f65 None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:43.488661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f068e8e-518a-4389-a58f-7ee215640f65 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:43.488981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f068e8e-518a-4389-a58f-7ee215640f65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:43.490464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f068e8e-518a-4389-a58f-7ee215640f65 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:43.509819 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 301/598] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Jul 19 13:51:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:43.511497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98275428-4a69-40da-9249-9a1dcb49f66e None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:43.511783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98275428-4a69-40da-9249-9a1dcb49f66e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:43.512128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98275428-4a69-40da-9249-9a1dcb49f66e None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:43.517546 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 302/599] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:43.517546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98275428-4a69-40da-9249-9a1dcb49f66e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:43.565277 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:43.598855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a79f5c-029b-4b15-b7ce-ab17d14c54a1 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:43.612531 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:43.626271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98275428-4a69-40da-9249-9a1dcb49f66e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:43.636935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798bfed-41f6-4669-99d1-3e5f6b78e979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:43.637705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798bfed-41f6-4669-99d1-3e5f6b78e979 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:43.637989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798bfed-41f6-4669-99d1-3e5f6b78e979 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:43.638331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798bfed-41f6-4669-99d1-3e5f6b78e979 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:43.645149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798bfed-41f6-4669-99d1-3e5f6b78e979 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:43.646822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798bfed-41f6-4669-99d1-3e5f6b78e979 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:43.660942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d9e17-08d9-42a0-831e-301eac78e87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:43.661106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-6798bfed-41f6-4669-99d1-3e5f6b78e979 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:43.661106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:43.661106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:43.661106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:43.661106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:43.661106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:43.661106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:43.661106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:43.661106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:43.661106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:43.661106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:43.661106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:43.661106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:51:43.661106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:51:43.661106 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:51:43.662298 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:51:43.662298 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:43.662298 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:43.662298 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:43.662298 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:43.662298 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:43.662298 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:43.662298 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:43.662298 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:43.662298 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:43.662298 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:43.662298 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:43.662298 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:43.662298 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:43.662298 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:43.662298 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:43.662298 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:43.668693 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:51:43.668693 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:51:43.668693 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:51:43.668693 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:51:43.668693 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:51:43.668693 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:51:43.668693 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:43.668693 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:43.669113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d9e17-08d9-42a0-831e-301eac78e87e None admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:43.669113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d9e17-08d9-42a0-831e-301eac78e87e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:43.669113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d9e17-08d9-42a0-831e-301eac78e87e None admin] PATH_INFO: `/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/75efea22b2484c1ea79a74e6793050f5/roles/56d47830104f4dc09f1076c75acf3ffd` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:43.669303 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 298/600] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:43.669303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798bfed-41f6-4669-99d1-3e5f6b78e979 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:43.685200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d9e17-08d9-42a0-831e-301eac78e87e None admin] RBAC: Authorizing `identity:create_grant(project_id=dfcbe281a77242bbb3774c4aacef50d4, user_id=75efea22b2484c1ea79a74e6793050f5, role_id=56d47830104f4dc09f1076c75acf3ffd)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:43.686704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d9e17-08d9-42a0-831e-301eac78e87e None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:43.757093 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 303/601] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:51:43 2022] PUT /identity/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/75efea22b2484c1ea79a74e6793050f5/roles/56d47830104f4dc09f1076c75acf3ffd => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:51:43.759315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0003940-07d7-4730-a6d5-6b13c607689a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:43.759607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0003940-07d7-4730-a6d5-6b13c607689a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:43.759893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0003940-07d7-4730-a6d5-6b13c607689a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:43.788833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c0003940-07d7-4730-a6d5-6b13c607689a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:43.790640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c0003940-07d7-4730-a6d5-6b13c607689a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:43.794322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798bfed-41f6-4669-99d1-3e5f6b78e979 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:43.829426 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:43.835746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aaaf0c-8fae-430e-80ab-9b0e5dd47647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:43.836583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aaaf0c-8fae-430e-80ab-9b0e5dd47647 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:43.837034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aaaf0c-8fae-430e-80ab-9b0e5dd47647 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:43.837329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aaaf0c-8fae-430e-80ab-9b0e5dd47647 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:43.853361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aaaf0c-8fae-430e-80ab-9b0e5dd47647 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:43.855597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aaaf0c-8fae-430e-80ab-9b0e5dd47647 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:43.873928 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 304/602] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:43.875147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0003940-07d7-4730-a6d5-6b13c607689a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:43.889401 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-a7aaaf0c-8fae-430e-80ab-9b0e5dd47647 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:43.889401 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:43.889401 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:43.889401 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:43.889401 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:43.889401 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:43.889401 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:43.889401 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:43.889401 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:43.889401 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:43.889401 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:43.889401 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:43.889401 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:43.889401 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:43.889401 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:43.890405 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:43.890405 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:43.890405 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:43.890405 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:43.890405 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:43.890405 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:43.890405 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:43.890405 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:43.890405 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:43.890405 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:43.890405 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:43.890405 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:43.890405 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:43.890405 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:43.890405 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:43.890405 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:43.890405 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:43.891311 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:43.891311 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:43.891311 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:43.891311 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:43.894333 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 299/603] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:43.898956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aaaf0c-8fae-430e-80ab-9b0e5dd47647 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:43.968781 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:44.011355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0003940-07d7-4730-a6d5-6b13c607689a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:44.026738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aaaf0c-8fae-430e-80ab-9b0e5dd47647 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:44.052540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea370e-1c6f-44aa-b466-4db6594afa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:44.053527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea370e-1c6f-44aa-b466-4db6594afa52 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:44.054013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea370e-1c6f-44aa-b466-4db6594afa52 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:44.054549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea370e-1c6f-44aa-b466-4db6594afa52 None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:44.055607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea370e-1c6f-44aa-b466-4db6594afa52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:44.056130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea370e-1c6f-44aa-b466-4db6594afa52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:44.057799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ea370e-1c6f-44aa-b466-4db6594afa52 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:44.065231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f17c43-ac41-467e-a83e-3bda6a2a69f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:44.066313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f17c43-ac41-467e-a83e-3bda6a2a69f5 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:44.066736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f17c43-ac41-467e-a83e-3bda6a2a69f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:44.067150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f17c43-ac41-467e-a83e-3bda6a2a69f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:44.071523 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 305/604] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:51:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:44.076969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea370e-1c6f-44aa-b466-4db6594afa52 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:44.085842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f17c43-ac41-467e-a83e-3bda6a2a69f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:44.095749 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-c1f17c43-ac41-467e-a83e-3bda6a2a69f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:44.095749 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:44.095749 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:44.095749 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:44.095749 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:44.095749 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:44.095749 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:44.095749 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:44.095749 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:44.095749 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:44.095749 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:44.095749 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:44.095749 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:44.095749 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:44.095749 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:44.095749 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:44.096873 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:44.096873 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:44.096873 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:44.096873 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:44.096873 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:44.096873 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:44.096873 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:44.096873 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:44.096873 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:44.096873 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:44.096873 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:44.096873 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:44.096873 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:44.096873 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:44.096873 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:44.096873 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:44.097694 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:44.097694 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:44.097694 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:44.097694 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:44.097694 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:44.097694 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:44.097694 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:44.097694 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:44.097694 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:44.097694 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:44.097694 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:44.097694 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:44.100733 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 300/605] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:51:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:51:44.101857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f17c43-ac41-467e-a83e-3bda6a2a69f5 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:44.162270 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:44.199411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ea370e-1c6f-44aa-b466-4db6594afa52 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:44.224271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f17c43-ac41-467e-a83e-3bda6a2a69f5 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:44.233204 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:44.242511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1643ecf-637d-4301-962f-96027c11b2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:44.243347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1643ecf-637d-4301-962f-96027c11b2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:44.243619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1643ecf-637d-4301-962f-96027c11b2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:44.243904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1643ecf-637d-4301-962f-96027c11b2b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:44.244829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1643ecf-637d-4301-962f-96027c11b2b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:44.245143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1643ecf-637d-4301-962f-96027c11b2b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:44.246722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1643ecf-637d-4301-962f-96027c11b2b2 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:44.261693 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 306/606] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:44.262645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1643ecf-637d-4301-962f-96027c11b2b2 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:44.266703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2db59-d468-4d16-a3f9-cf0cd67649ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:44.267862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2db59-d468-4d16-a3f9-cf0cd67649ff None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:44.268344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2db59-d468-4d16-a3f9-cf0cd67649ff None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:44.268817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2db59-d468-4d16-a3f9-cf0cd67649ff None admin] PATH_INFO: `/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/ef77d9ec7712434287347d959dcf1cc0/roles/56d47830104f4dc09f1076c75acf3ffd` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:44.286375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2db59-d468-4d16-a3f9-cf0cd67649ff None admin] RBAC: Authorizing `identity:create_grant(project_id=dfcbe281a77242bbb3774c4aacef50d4, user_id=ef77d9ec7712434287347d959dcf1cc0, role_id=56d47830104f4dc09f1076c75acf3ffd)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:44.288203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd2db59-d468-4d16-a3f9-cf0cd67649ff None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:44.366411 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 301/607] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:51:44 2022] PUT /identity/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/ef77d9ec7712434287347d959dcf1cc0/roles/56d47830104f4dc09f1076c75acf3ffd => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:51:44.369252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2db59-d468-4d16-a3f9-cf0cd67649ff None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:44.388759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1643ecf-637d-4301-962f-96027c11b2b2 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:44.451945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b74807-9051-4789-bf80-c9685774c5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:44.456416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b74807-9051-4789-bf80-c9685774c5aa None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:44.456693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b74807-9051-4789-bf80-c9685774c5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:44.456976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b74807-9051-4789-bf80-c9685774c5aa None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:44.457770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b74807-9051-4789-bf80-c9685774c5aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:44.458082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b74807-9051-4789-bf80-c9685774c5aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:44.459659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b74807-9051-4789-bf80-c9685774c5aa None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:44.480257 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 307/608] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 19 13:51:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:44.487017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b74807-9051-4789-bf80-c9685774c5aa None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:44.582187 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:44.593970 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:44.600794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd2db59-d468-4d16-a3f9-cf0cd67649ff None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:44.649518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e965efa-9b1e-4239-a12c-d2007a134965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:44.651312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e965efa-9b1e-4239-a12c-d2007a134965 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:44.651790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e965efa-9b1e-4239-a12c-d2007a134965 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:44.652254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e965efa-9b1e-4239-a12c-d2007a134965 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:44.660449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b74807-9051-4789-bf80-c9685774c5aa None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:44.662712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e965efa-9b1e-4239-a12c-d2007a134965 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:44.665221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e965efa-9b1e-4239-a12c-d2007a134965 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:44.682075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-3e965efa-9b1e-4239-a12c-d2007a134965 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:44.682075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:44.682075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:44.682075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:44.682075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:44.682075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:44.682075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:44.682075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:44.682075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:44.682075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:44.682075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:44.682075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:44.682075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:51:44.682075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:51:44.682075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:51:44.683116 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:51:44.683116 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:44.683116 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:44.683116 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:44.683116 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:44.683116 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:44.683116 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:44.683116 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:44.683116 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:44.683116 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:44.683116 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:44.683116 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:44.683116 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:44.683116 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:44.683116 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:44.683116 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:44.683116 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:44.684010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:51:44.684010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:51:44.684010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:51:44.684010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:51:44.684010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:51:44.684010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:51:44.684010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:44.684010 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:44.686641 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 302/609] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:44.696388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e965efa-9b1e-4239-a12c-d2007a134965 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:44.734425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b400c9-b57c-4266-b5af-a4ec9f45c4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:44.735146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b400c9-b57c-4266-b5af-a4ec9f45c4a8 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:44.735431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b400c9-b57c-4266-b5af-a4ec9f45c4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:44.735707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b400c9-b57c-4266-b5af-a4ec9f45c4a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:44.751983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b400c9-b57c-4266-b5af-a4ec9f45c4a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:44.753441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b400c9-b57c-4266-b5af-a4ec9f45c4a8 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:44.784050 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-63b400c9-b57c-4266-b5af-a4ec9f45c4a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:44.784050 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:44.784050 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:44.784050 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:44.784050 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:44.784050 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:44.784050 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:44.784050 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:44.784050 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:44.784050 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:44.784050 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:44.784050 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:44.784050 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:44.784050 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:44.784050 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:44.784994 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:44.784994 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:44.784994 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:44.784994 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:44.784994 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:44.784994 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:44.784994 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:44.784994 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:44.784994 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:44.784994 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:44.784994 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:44.784994 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:44.784994 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:44.784994 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:44.784994 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:44.784994 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:44.784994 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:44.785896 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:44.785896 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:44.785896 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:44.785896 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:44.785896 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 308/610] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:44.790821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b400c9-b57c-4266-b5af-a4ec9f45c4a8 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:44.903238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b400c9-b57c-4266-b5af-a4ec9f45c4a8 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:44.905161 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:44.920270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e965efa-9b1e-4239-a12c-d2007a134965 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:44.940888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af55f0-3a89-4d43-935f-357e0a83e98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:44.941914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af55f0-3a89-4d43-935f-357e0a83e98f None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:44.942453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af55f0-3a89-4d43-935f-357e0a83e98f None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:44.942934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af55f0-3a89-4d43-935f-357e0a83e98f None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:44.943865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af55f0-3a89-4d43-935f-357e0a83e98f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:44.944458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af55f0-3a89-4d43-935f-357e0a83e98f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:44.947169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6af55f0-3a89-4d43-935f-357e0a83e98f None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:44.959886 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 309/611] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:44.970363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af55f0-3a89-4d43-935f-357e0a83e98f None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:44.990671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d7d83-2034-4198-a9d6-29bc052bdbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:44.991323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d7d83-2034-4198-a9d6-29bc052bdbfd None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:44.991608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d7d83-2034-4198-a9d6-29bc052bdbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:44.991884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85d7d83-2034-4198-a9d6-29bc052bdbfd None admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:44.993354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d7d83-2034-4198-a9d6-29bc052bdbfd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:44.993711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d7d83-2034-4198-a9d6-29bc052bdbfd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:44.995254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85d7d83-2034-4198-a9d6-29bc052bdbfd None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:45.023739 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 303/612] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:51:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:45.041169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d7d83-2034-4198-a9d6-29bc052bdbfd None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:45.059016 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:45.163744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af55f0-3a89-4d43-935f-357e0a83e98f None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:45.210669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85d7d83-2034-4198-a9d6-29bc052bdbfd None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:45.231904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f8db9-cf8f-4e56-9b6c-fb56a9e67833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:45.232936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f8db9-cf8f-4e56-9b6c-fb56a9e67833 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:45.233369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f8db9-cf8f-4e56-9b6c-fb56a9e67833 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:45.233915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f8db9-cf8f-4e56-9b6c-fb56a9e67833 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:45.242519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f8db9-cf8f-4e56-9b6c-fb56a9e67833 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:45.244299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00f8db9-cf8f-4e56-9b6c-fb56a9e67833 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:45.253563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887efdb0-1ba2-4aea-8e36-2e134fc478a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:45.254481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887efdb0-1ba2-4aea-8e36-2e134fc478a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:45.254765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887efdb0-1ba2-4aea-8e36-2e134fc478a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:45.255043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887efdb0-1ba2-4aea-8e36-2e134fc478a6 None admin] PATH_INFO: `/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/e997b70d7158446daa1dfa225eb7afca/roles/56d47830104f4dc09f1076c75acf3ffd` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:45.260426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-b00f8db9-cf8f-4e56-9b6c-fb56a9e67833 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 13:51:45.260426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:45.260426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:45.260426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:45.260426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:45.260426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:45.260426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:45.260426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:45.260426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:45.260426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:45.260426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:45.260426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:45.260426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:51:45.260426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:51:45.260426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:51:45.260426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:51:45.261542 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:45.261542 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:45.261542 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:51:45.261542 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:45.261542 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:51:45.261542 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:45.261542 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:45.261542 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:45.261542 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:45.261542 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:45.261542 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:45.261542 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:45.261542 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:45.261542 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:45.261542 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:45.261542 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:45.261542 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:45.261542 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:45.262648 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:45.262648 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:45.262648 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:51:45.262648 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:51:45.262648 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:51:45.262648 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:51:45.262648 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:51:45.262648 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:51:45.262648 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 13:51:45.262648 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:45.264886 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 310/613] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:51:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:45.266364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ae9a9-1c60-4d11-b009-a66df516bf68 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:45.266862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ae9a9-1c60-4d11-b009-a66df516bf68 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:45.267286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ae9a9-1c60-4d11-b009-a66df516bf68 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:45.272787 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 311/614] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:45.273784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ae9a9-1c60-4d11-b009-a66df516bf68 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:45.276270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887efdb0-1ba2-4aea-8e36-2e134fc478a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=dfcbe281a77242bbb3774c4aacef50d4, user_id=e997b70d7158446daa1dfa225eb7afca, role_id=56d47830104f4dc09f1076c75acf3ffd)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:45.278955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887efdb0-1ba2-4aea-8e36-2e134fc478a6 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:45.301944 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:45.343386 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 304/615] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:51:45 2022] PUT /identity/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/e997b70d7158446daa1dfa225eb7afca/roles/56d47830104f4dc09f1076c75acf3ffd => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:51:45.345345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7eb9da-68ac-481a-9393-5b4b01d204b0 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:45.346280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7eb9da-68ac-481a-9393-5b4b01d204b0 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:45.347070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7eb9da-68ac-481a-9393-5b4b01d204b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:45.369385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0b7eb9da-68ac-481a-9393-5b4b01d204b0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:45.371655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0b7eb9da-68ac-481a-9393-5b4b01d204b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:45.393590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ae9a9-1c60-4d11-b009-a66df516bf68 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:45.434249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8df2c-7135-4d6a-b5d8-47e2b2ca9805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:45.434957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8df2c-7135-4d6a-b5d8-47e2b2ca9805 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:45.435243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8df2c-7135-4d6a-b5d8-47e2b2ca9805 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:45.435522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf8df2c-7135-4d6a-b5d8-47e2b2ca9805 None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:45.436388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8df2c-7135-4d6a-b5d8-47e2b2ca9805 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:45.436701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8df2c-7135-4d6a-b5d8-47e2b2ca9805 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:45.438914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf8df2c-7135-4d6a-b5d8-47e2b2ca9805 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:45.453395 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:45.462534 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 312/617] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Jul 19 13:51:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:45.462786 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 305/617] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:45.468318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8df2c-7135-4d6a-b5d8-47e2b2ca9805 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:45.488904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7eb9da-68ac-481a-9393-5b4b01d204b0 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:45.578226 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:45.599035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7eb9da-68ac-481a-9393-5b4b01d204b0 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:45.604114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf8df2c-7135-4d6a-b5d8-47e2b2ca9805 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:45.643011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e9ca8-b351-4aaf-8953-31f522f591d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:45.643637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6536c-9850-4334-b42b-63c2392493ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:45.644057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e9ca8-b351-4aaf-8953-31f522f591d3 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:45.644435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e9ca8-b351-4aaf-8953-31f522f591d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:45.644803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e9ca8-b351-4aaf-8953-31f522f591d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:45.645064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6536c-9850-4334-b42b-63c2392493ea None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:45.645486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6536c-9850-4334-b42b-63c2392493ea None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:45.645918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6536c-9850-4334-b42b-63c2392493ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:45.657371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e9ca8-b351-4aaf-8953-31f522f591d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:45.659976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6536c-9850-4334-b42b-63c2392493ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:45.661603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6536c-9850-4334-b42b-63c2392493ea None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:45.666983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-ef3e9ca8-b351-4aaf-8953-31f522f591d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:45.666983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:45.666983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:45.666983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:45.666983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:45.666983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:45.666983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:45.666983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:45.666983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:45.666983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:45.666983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:45.666983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:45.666983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:45.666983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:45.666983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:45.666983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:45.668261 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:45.668261 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:45.668261 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:45.668261 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:45.668261 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:45.668261 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:45.668261 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:45.668261 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:45.668261 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:45.668261 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:45.668261 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:45.668261 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:45.668261 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:45.668261 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:45.668261 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:45.668261 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:45.669254 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:45.669254 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:45.669254 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:45.669254 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:45.669254 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:45.669254 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:45.669254 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:45.669254 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:45.669254 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:45.669254 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:45.669254 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:45.669254 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:45.669254 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 306/618] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:51:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:51:45.677915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e9ca8-b351-4aaf-8953-31f522f591d3 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:45.688540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-bde6536c-9850-4334-b42b-63c2392493ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:45.688540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:45.688540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:45.688540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:45.688540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:45.688540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:45.688540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:45.688540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:45.688540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:45.688540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:45.688540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:45.688540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:45.688540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:45.688540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:45.688540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:45.689492 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:45.689492 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:45.689492 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:45.689492 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:45.689492 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:45.689492 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:45.689492 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:45.689492 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:45.689492 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:45.689492 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:45.689492 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:45.689492 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:45.689492 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:45.689492 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:45.689492 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:45.689492 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:45.689492 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:45.690432 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:45.690432 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:45.690432 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:45.690432 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:45.692744 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 313/619] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:45.699834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6536c-9850-4334-b42b-63c2392493ea None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:45.745284 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:45.799698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e9ca8-b351-4aaf-8953-31f522f591d3 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:45.816267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6536c-9850-4334-b42b-63c2392493ea None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:45.840408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea70064-4b90-41f6-840b-a99e15bb2959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:45.841007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea70064-4b90-41f6-840b-a99e15bb2959 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:45.841292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea70064-4b90-41f6-840b-a99e15bb2959 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:45.841569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea70064-4b90-41f6-840b-a99e15bb2959 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:45.842375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea70064-4b90-41f6-840b-a99e15bb2959 None admin] RBAC: Adding query filter params (name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:45.842660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea70064-4b90-41f6-840b-a99e15bb2959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:45.844026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea70064-4b90-41f6-840b-a99e15bb2959 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:45.852668 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:45.853526 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 307/620] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 19 13:51:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:45.859438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea70064-4b90-41f6-840b-a99e15bb2959 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:45.863354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ed35d-cc99-4f33-b2d6-8fd6ae78fe18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:45.864372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ed35d-cc99-4f33-b2d6-8fd6ae78fe18 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:45.866269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ed35d-cc99-4f33-b2d6-8fd6ae78fe18 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:45.866269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ed35d-cc99-4f33-b2d6-8fd6ae78fe18 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:45.866269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ed35d-cc99-4f33-b2d6-8fd6ae78fe18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:45.866269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ed35d-cc99-4f33-b2d6-8fd6ae78fe18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:45.868309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ed35d-cc99-4f33-b2d6-8fd6ae78fe18 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:45.883755 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 314/621] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:45.890690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ed35d-cc99-4f33-b2d6-8fd6ae78fe18 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:46.029386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea70064-4b90-41f6-840b-a99e15bb2959 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:46.066037 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:46.101560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8161bb96-90f1-4224-8ea7-f0f3f939886f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:46.103930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161bb96-90f1-4224-8ea7-f0f3f939886f None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:46.105939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ed35d-cc99-4f33-b2d6-8fd6ae78fe18 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:46.106460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161bb96-90f1-4224-8ea7-f0f3f939886f None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:46.106938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8161bb96-90f1-4224-8ea7-f0f3f939886f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:46.128562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161bb96-90f1-4224-8ea7-f0f3f939886f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:46.133736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8161bb96-90f1-4224-8ea7-f0f3f939886f None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:46.160560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-8161bb96-90f1-4224-8ea7-f0f3f939886f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:46.160560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:46.160560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:46.160560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:46.160560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:46.160560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:46.160560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:46.160560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:46.160560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:46.160560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:46.160560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:46.160560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:46.160560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:46.160560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:46.160560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:46.161525 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:46.161525 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:46.161525 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:46.161525 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:46.161525 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:46.161525 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:46.161525 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:46.161525 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:46.161525 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:46.161525 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:46.161525 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:46.161525 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:46.161525 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:46.161525 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:46.161525 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:46.161525 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:46.161525 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:46.162462 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:46.162462 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:46.162462 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:46.162462 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:46.162462 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 308/622] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:46.168611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfc5c4-74bd-4f40-ab43-4e4cbf93ec25 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:46.168611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfc5c4-74bd-4f40-ab43-4e4cbf93ec25 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:46.168611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfc5c4-74bd-4f40-ab43-4e4cbf93ec25 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:46.170597 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 309/623] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:46.171423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfc5c4-74bd-4f40-ab43-4e4cbf93ec25 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:46.176512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b08c3a4-3436-4fac-851d-6157119b8d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:46.177577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08c3a4-3436-4fac-851d-6157119b8d27 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:46.178062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08c3a4-3436-4fac-851d-6157119b8d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:46.178561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b08c3a4-3436-4fac-851d-6157119b8d27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:46.186836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08c3a4-3436-4fac-851d-6157119b8d27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:46.189053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b08c3a4-3436-4fac-851d-6157119b8d27 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:46.210041 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-4b08c3a4-3436-4fac-851d-6157119b8d27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:46.210041 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:46.210041 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:46.210041 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:46.210041 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:46.210041 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:46.210041 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:46.210041 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:46.210041 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:46.210041 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:46.210041 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:46.210041 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:46.210041 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:51:46.210041 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:51:46.210041 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:51:46.211068 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:51:46.211068 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:46.211068 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:46.211068 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:46.211068 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:46.211068 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:46.211068 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:46.211068 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:46.211068 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:46.211068 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:46.211068 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:46.211068 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:46.211068 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:46.211068 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:46.211068 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:46.211068 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:46.211068 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:46.212540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:51:46.212540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:51:46.212540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:51:46.212540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:51:46.212540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:51:46.212540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:51:46.212540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:46.212540 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:46.215248 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 315/624] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:46.221307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898ac8c-47f2-4198-9911-e977ff386b69 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:46.221943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898ac8c-47f2-4198-9911-e977ff386b69 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:46.222348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898ac8c-47f2-4198-9911-e977ff386b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:46.244585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5898ac8c-47f2-4198-9911-e977ff386b69 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:46.246312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5898ac8c-47f2-4198-9911-e977ff386b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:46.296645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfc5c4-74bd-4f40-ab43-4e4cbf93ec25 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:46.318650 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:46.336553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbb32b-8898-4b67-84d6-6ec3ec0370bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:46.338679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbb32b-8898-4b67-84d6-6ec3ec0370bc None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:46.338679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbb32b-8898-4b67-84d6-6ec3ec0370bc None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:46.338679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bbb32b-8898-4b67-84d6-6ec3ec0370bc None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:46.339939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbb32b-8898-4b67-84d6-6ec3ec0370bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:46.340408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbb32b-8898-4b67-84d6-6ec3ec0370bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:46.342240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bbb32b-8898-4b67-84d6-6ec3ec0370bc None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:46.350121 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 316/625] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:46.350121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898ac8c-47f2-4198-9911-e977ff386b69 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:46.368429 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 310/626] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:46.374388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbb32b-8898-4b67-84d6-6ec3ec0370bc None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:46.404702 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:46.468636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898ac8c-47f2-4198-9911-e977ff386b69 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:46.482548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bbb32b-8898-4b67-84d6-6ec3ec0370bc None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:46.506316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0ba08-09cb-4aad-a219-40084c0cb3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:46.507329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0ba08-09cb-4aad-a219-40084c0cb3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:46.507848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0ba08-09cb-4aad-a219-40084c0cb3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:46.508517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0ba08-09cb-4aad-a219-40084c0cb3e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:46.509621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0ba08-09cb-4aad-a219-40084c0cb3e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:46.510170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0ba08-09cb-4aad-a219-40084c0cb3e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:46.511837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0ba08-09cb-4aad-a219-40084c0cb3e8 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:46.520027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98723e39-eff7-48c6-8865-ebbe6a576a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:46.520827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98723e39-eff7-48c6-8865-ebbe6a576a38 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:46.521115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98723e39-eff7-48c6-8865-ebbe6a576a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:46.521393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98723e39-eff7-48c6-8865-ebbe6a576a38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:46.526008 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 317/627] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:51:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:46.527083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0ba08-09cb-4aad-a219-40084c0cb3e8 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:46.538071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98723e39-eff7-48c6-8865-ebbe6a576a38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:46.546132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-98723e39-eff7-48c6-8865-ebbe6a576a38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:46.546132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:46.546132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:46.546132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:46.546132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:46.546132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:46.546132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:46.546132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:46.546132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:46.546132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:46.546132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:46.546132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:46.546132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:46.546132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:46.546132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:46.546132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:46.547086 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:46.547086 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:46.547086 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:46.547086 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:46.547086 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:46.547086 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:46.547086 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:46.547086 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:46.547086 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:46.547086 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:46.547086 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:46.547086 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:46.547086 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:46.547086 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:46.547086 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:46.547086 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:46.547939 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:46.547939 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:46.547939 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:46.547939 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:46.547939 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:46.547939 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:46.547939 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:46.547939 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:46.547939 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:46.547939 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:46.547939 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:46.547939 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:46.552197 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 311/628] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:51:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:46.553007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98723e39-eff7-48c6-8865-ebbe6a576a38 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:46.578042 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:46.640624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0ba08-09cb-4aad-a219-40084c0cb3e8 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:46.647506 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:46.660305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98723e39-eff7-48c6-8865-ebbe6a576a38 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:46.678700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01c1e8-3212-47b2-ad80-24ff179d34c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:46.680961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01c1e8-3212-47b2-ad80-24ff179d34c4 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:46.681461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01c1e8-3212-47b2-ad80-24ff179d34c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:46.681993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01c1e8-3212-47b2-ad80-24ff179d34c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:46.691109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01c1e8-3212-47b2-ad80-24ff179d34c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:46.692833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01c1e8-3212-47b2-ad80-24ff179d34c4 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:46.696487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e8f65-98bf-4425-a49c-cfa60db496c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:46.697497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e8f65-98bf-4425-a49c-cfa60db496c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:46.697885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e8f65-98bf-4425-a49c-cfa60db496c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:46.698300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e8f65-98bf-4425-a49c-cfa60db496c0 None admin] PATH_INFO: `/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/0789b4be9dae4c05bb3ec4a5e0f1f308/roles/56d47830104f4dc09f1076c75acf3ffd` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:46.708785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-7c01c1e8-3212-47b2-ad80-24ff179d34c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 13:51:46.708785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:46.708785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:46.708785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:46.708785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:46.708785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:46.708785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:46.708785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:46.708785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:46.708785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:46.708785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:46.708785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:46.708785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:51:46.708785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:51:46.708785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:51:46.708785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:51:46.709833 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:46.709833 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:46.709833 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:51:46.709833 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:46.709833 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:51:46.709833 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:46.709833 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:46.709833 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:46.709833 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:46.709833 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:46.709833 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:46.709833 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:46.709833 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:46.709833 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:46.709833 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:46.709833 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:46.709833 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:46.709833 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:46.710832 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:46.710832 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:46.710832 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:51:46.710832 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:51:46.710832 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:51:46.710832 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:51:46.710832 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:51:46.710832 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:51:46.710832 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 13:51:46.710832 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:46.713654 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 318/629] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jul 19 13:51:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:46.714769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01c1e8-3212-47b2-ad80-24ff179d34c4 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:46.719724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e8f65-98bf-4425-a49c-cfa60db496c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=dfcbe281a77242bbb3774c4aacef50d4, user_id=0789b4be9dae4c05bb3ec4a5e0f1f308, role_id=56d47830104f4dc09f1076c75acf3ffd)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:46.720676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240e8f65-98bf-4425-a49c-cfa60db496c0 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:46.798210 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 312/630] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:51:46 2022] PUT /identity/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/0789b4be9dae4c05bb3ec4a5e0f1f308/roles/56d47830104f4dc09f1076c75acf3ffd => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:51:46.799568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e8f65-98bf-4425-a49c-cfa60db496c0 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:46.850456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01c1e8-3212-47b2-ad80-24ff179d34c4 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:46.858166 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:46.901720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2211fc-3ab1-47ce-924b-71b5d0ae676a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:46.902824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2211fc-3ab1-47ce-924b-71b5d0ae676a None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:46.903302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2211fc-3ab1-47ce-924b-71b5d0ae676a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:46.903926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2211fc-3ab1-47ce-924b-71b5d0ae676a None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:46.904913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2211fc-3ab1-47ce-924b-71b5d0ae676a None admin] RBAC: Adding query filter params (name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:46.905427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2211fc-3ab1-47ce-924b-71b5d0ae676a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:46.907232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2211fc-3ab1-47ce-924b-71b5d0ae676a None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:46.918031 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 319/631] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 19 13:51:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:46.920198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010dbad-b8be-46fa-a1c8-0fb03588a157 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:46.920719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010dbad-b8be-46fa-a1c8-0fb03588a157 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:46.921281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7010dbad-b8be-46fa-a1c8-0fb03588a157 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:46.923007 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 320/632] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:46.923947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010dbad-b8be-46fa-a1c8-0fb03588a157 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:46.970283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e8f65-98bf-4425-a49c-cfa60db496c0 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:47.016663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94c6b9-ff57-4997-a6ef-f009a8cdb791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:47.017353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94c6b9-ff57-4997-a6ef-f009a8cdb791 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:47.017642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94c6b9-ff57-4997-a6ef-f009a8cdb791 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:47.017925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94c6b9-ff57-4997-a6ef-f009a8cdb791 None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:47.018824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94c6b9-ff57-4997-a6ef-f009a8cdb791 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:47.019137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94c6b9-ff57-4997-a6ef-f009a8cdb791 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:47.020568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94c6b9-ff57-4997-a6ef-f009a8cdb791 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:47.030383 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:47.042542 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 313/633] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jul 19 13:51:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:47.043817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ed297-914d-4679-be13-fdebed7e8f22 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:47.044107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ed297-914d-4679-be13-fdebed7e8f22 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:47.045341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ed297-914d-4679-be13-fdebed7e8f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:47.053549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7010dbad-b8be-46fa-a1c8-0fb03588a157 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:47.067590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f90ed297-914d-4679-be13-fdebed7e8f22 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:47.068781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f90ed297-914d-4679-be13-fdebed7e8f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:47.099080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5ca05-e635-4297-88e5-f722e30fb785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:47.099883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5ca05-e635-4297-88e5-f722e30fb785 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:47.100169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5ca05-e635-4297-88e5-f722e30fb785 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:47.100642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5ca05-e635-4297-88e5-f722e30fb785 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:47.113523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5ca05-e635-4297-88e5-f722e30fb785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:47.115454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5ca05-e635-4297-88e5-f722e30fb785 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:47.138918 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-efa5ca05-e635-4297-88e5-f722e30fb785 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:47.138918 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:47.138918 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:47.138918 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:47.138918 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:47.138918 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:47.138918 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:47.138918 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:47.138918 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:47.138918 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:47.138918 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:47.138918 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:47.138918 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:47.138918 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:47.138918 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:47.140042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:47.140042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:47.140042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:47.140042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:47.140042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:47.140042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:47.140042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:47.140042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:47.140042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:47.140042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:47.140042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:47.140042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:47.140042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:47.140042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:47.140042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:47.140042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:47.140042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:47.140938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:47.140938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:47.140938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:47.140938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:47.145199 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 321/634] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:47.146290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5ca05-e635-4297-88e5-f722e30fb785 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:47.147201 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 314/635] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:47.150930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ed297-914d-4679-be13-fdebed7e8f22 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:47.177194 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:47.289628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ed297-914d-4679-be13-fdebed7e8f22 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:47.297705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5ca05-e635-4297-88e5-f722e30fb785 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:47.318918 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:47.328959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c7f96-4766-42bc-94df-71ebafbd41ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:47.329637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c7f96-4766-42bc-94df-71ebafbd41ee None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:47.329922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c7f96-4766-42bc-94df-71ebafbd41ee None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:47.330331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c7f96-4766-42bc-94df-71ebafbd41ee None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:47.331084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c7f96-4766-42bc-94df-71ebafbd41ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:47.331499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c7f96-4766-42bc-94df-71ebafbd41ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:47.333156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c7f96-4766-42bc-94df-71ebafbd41ee None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:47.349741 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 315/636] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:47.350692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cb120-ea48-496a-a3f8-b7c91e08884c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:47.350934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c7f96-4766-42bc-94df-71ebafbd41ee None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:47.352930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cb120-ea48-496a-a3f8-b7c91e08884c None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:47.353436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cb120-ea48-496a-a3f8-b7c91e08884c None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:47.353917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cb120-ea48-496a-a3f8-b7c91e08884c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:47.451981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cb120-ea48-496a-a3f8-b7c91e08884c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:47.454688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cb120-ea48-496a-a3f8-b7c91e08884c None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:47.464756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c7f96-4766-42bc-94df-71ebafbd41ee None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:47.479258 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:47.502182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee30b5-8968-46dc-85c3-9ec045251643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:47.502991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee30b5-8968-46dc-85c3-9ec045251643 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:47.503275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee30b5-8968-46dc-85c3-9ec045251643 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:47.503553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee30b5-8968-46dc-85c3-9ec045251643 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:47.518714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee30b5-8968-46dc-85c3-9ec045251643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:47.527229 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-d1ee30b5-8968-46dc-85c3-9ec045251643 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:47.527229 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:47.527229 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:47.527229 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:47.527229 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:47.527229 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:47.527229 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:47.527229 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:47.527229 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:47.527229 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:47.527229 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:47.527229 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:47.527229 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:47.527229 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:47.527229 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:47.527229 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:47.528221 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:47.528221 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:47.528221 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:47.528221 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:47.528221 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:47.528221 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:47.528221 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:47.528221 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:47.528221 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:47.528221 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:47.528221 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:47.528221 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:47.528221 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:47.528221 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:47.528221 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:47.528221 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:47.529073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:47.529073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:47.529073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:47.529073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:47.529073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:47.529073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:47.529073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:47.529073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:47.529073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:47.529073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:47.529073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:47.529073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:47.533735 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 316/637] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:51:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:47.534377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee30b5-8968-46dc-85c3-9ec045251643 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:47.580400 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 322/638] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:47.581557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cb120-ea48-496a-a3f8-b7c91e08884c None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:47.588781 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:47.646043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee30b5-8968-46dc-85c3-9ec045251643 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:47.681165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46546c-1d23-489b-8863-542f1753f7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:47.682020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46546c-1d23-489b-8863-542f1753f7ab None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:47.682339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46546c-1d23-489b-8863-542f1753f7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:47.682621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46546c-1d23-489b-8863-542f1753f7ab None admin] PATH_INFO: `/v3/users/glance` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:47.690747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46546c-1d23-489b-8863-542f1753f7ab None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:47.692354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46546c-1d23-489b-8863-542f1753f7ab None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:47.693219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cb120-ea48-496a-a3f8-b7c91e08884c None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:47.707983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-6c46546c-1d23-489b-8863-542f1753f7ab None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 19 13:51:47.707983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:47.707983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:47.707983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:47.707983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:47.707983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:47.707983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:47.707983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:47.707983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:47.707983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:47.707983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:47.707983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:47.707983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:51:47.707983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:51:47.707983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:51:47.707983 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:51:47.709262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:47.709262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:47.709262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:51:47.709262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:47.709262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:51:47.709262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:47.709262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:47.709262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:47.709262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:47.709262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:47.709262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:47.709262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:47.709262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:47.709262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:47.709262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:47.709262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:47.709262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:47.709262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:47.710703 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:47.710703 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:47.710703 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:51:47.710703 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:51:47.710703 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:51:47.710703 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:51:47.710703 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:51:47.710703 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:51:47.710703 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 19 13:51:47.710703 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:47.714269 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 317/639] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:47.715143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46546c-1d23-489b-8863-542f1753f7ab None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:47.716356 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:47.736585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbebbd2-1f3a-4a5f-9164-ba6b0da3d5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:47.737584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbebbd2-1f3a-4a5f-9164-ba6b0da3d5bf None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:47.738090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbebbd2-1f3a-4a5f-9164-ba6b0da3d5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:47.738639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbebbd2-1f3a-4a5f-9164-ba6b0da3d5bf None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:47.739688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbebbd2-1f3a-4a5f-9164-ba6b0da3d5bf None admin] RBAC: Adding query filter params (name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:47.740204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbebbd2-1f3a-4a5f-9164-ba6b0da3d5bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:47.741791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbebbd2-1f3a-4a5f-9164-ba6b0da3d5bf None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:47.752421 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 323/640] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 19 13:51:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:47.753568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbebbd2-1f3a-4a5f-9164-ba6b0da3d5bf None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:47.833532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46546c-1d23-489b-8863-542f1753f7ab None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:47.842050 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:47.865476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbebbd2-1f3a-4a5f-9164-ba6b0da3d5bf None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:47.871692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c79667-f5e0-4510-b34d-8bbbc9c2f78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:47.872495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c79667-f5e0-4510-b34d-8bbbc9c2f78c None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:47.872777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c79667-f5e0-4510-b34d-8bbbc9c2f78c None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:47.873056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c79667-f5e0-4510-b34d-8bbbc9c2f78c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:47.884021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c79667-f5e0-4510-b34d-8bbbc9c2f78c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:47.885436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c79667-f5e0-4510-b34d-8bbbc9c2f78c None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:47.903063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4489476-bf0a-475b-bb84-b684daa6da89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:47.903742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4489476-bf0a-475b-bb84-b684daa6da89 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:47.904029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4489476-bf0a-475b-bb84-b684daa6da89 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:47.904310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4489476-bf0a-475b-bb84-b684daa6da89 None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:47.904468 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-55c79667-f5e0-4510-b34d-8bbbc9c2f78c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:47.904468 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:47.904468 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:47.904468 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:47.904468 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:47.904468 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:47.904468 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:47.904468 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:47.904468 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:47.904468 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:47.904468 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:47.904468 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:47.904468 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:47.904468 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:47.904468 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:47.905387 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:47.905387 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:47.905387 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:47.905387 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:47.905387 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:47.905387 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:47.905387 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:47.905387 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:47.905387 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:47.905387 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:47.905387 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:47.905387 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:47.905387 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:47.905387 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:47.905387 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:47.905387 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:47.905387 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:47.911390 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:47.911390 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:47.911390 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:47.911390 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:47.911621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4489476-bf0a-475b-bb84-b684daa6da89 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:47.911621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4489476-bf0a-475b-bb84-b684daa6da89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:47.911770 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 318/641] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:47.911770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c79667-f5e0-4510-b34d-8bbbc9c2f78c None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:47.911907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4489476-bf0a-475b-bb84-b684daa6da89 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:47.929716 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 324/642] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Jul 19 13:51:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:47.931898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ceef4f-a377-4402-bc85-b66b958fe16f None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:47.932191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ceef4f-a377-4402-bc85-b66b958fe16f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:47.932470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ceef4f-a377-4402-bc85-b66b958fe16f None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:47.933700 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 325/643] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:47.937738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ceef4f-a377-4402-bc85-b66b958fe16f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:47.975315 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:48.036969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c79667-f5e0-4510-b34d-8bbbc9c2f78c None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:48.049790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ceef4f-a377-4402-bc85-b66b958fe16f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:48.073010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7361c93c-6f52-4de3-8c59-657316452912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:48.073802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361c93c-6f52-4de3-8c59-657316452912 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:48.074113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361c93c-6f52-4de3-8c59-657316452912 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:48.074394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7361c93c-6f52-4de3-8c59-657316452912 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:48.084470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ea50c-e858-4fde-a2cd-c9cc889435aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:48.085055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361c93c-6f52-4de3-8c59-657316452912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:48.085171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ea50c-e858-4fde-a2cd-c9cc889435aa None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:48.085404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ea50c-e858-4fde-a2cd-c9cc889435aa None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:48.085682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ea50c-e858-4fde-a2cd-c9cc889435aa None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:48.086486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ea50c-e858-4fde-a2cd-c9cc889435aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:48.087096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ea50c-e858-4fde-a2cd-c9cc889435aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:48.087180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7361c93c-6f52-4de3-8c59-657316452912 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:48.088262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ea50c-e858-4fde-a2cd-c9cc889435aa None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:48.099517 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 326/644] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:48.104730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ea50c-e858-4fde-a2cd-c9cc889435aa None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:48.105022 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-7361c93c-6f52-4de3-8c59-657316452912 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:48.105022 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:48.105022 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:48.105022 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:48.105022 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:48.105022 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:48.105022 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:48.105022 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:48.105022 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:48.105022 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:48.105022 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:48.105022 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:48.105022 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:48.105022 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:48.105022 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:48.105931 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:48.105931 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:48.105931 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:48.105931 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:48.105931 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:48.105931 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:48.105931 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:48.105931 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:48.105931 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:48.105931 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:48.105931 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:48.105931 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:48.105931 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:48.105931 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:48.105931 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:48.105931 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:48.105931 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:48.107065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:48.107065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:48.107065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:48.107065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:48.107065 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 319/645] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:48.107779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698ae38-d7df-4748-b832-569d7d24429f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:48.112471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698ae38-d7df-4748-b832-569d7d24429f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:48.112471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e698ae38-d7df-4748-b832-569d7d24429f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:48.126150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e698ae38-d7df-4748-b832-569d7d24429f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:48.127349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e698ae38-d7df-4748-b832-569d7d24429f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:48.130735 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:48.193702 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 320/646] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:48.194554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698ae38-d7df-4748-b832-569d7d24429f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:48.228186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ea50c-e858-4fde-a2cd-c9cc889435aa None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:48.262923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229bbbe-d11a-4469-af2b-8ee205dcc0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:48.263596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229bbbe-d11a-4469-af2b-8ee205dcc0f8 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:48.263853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229bbbe-d11a-4469-af2b-8ee205dcc0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:48.264127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229bbbe-d11a-4469-af2b-8ee205dcc0f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:48.299702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e698ae38-d7df-4748-b832-569d7d24429f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:48.333555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229bbbe-d11a-4469-af2b-8ee205dcc0f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:48.336971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5283c25-aa86-4928-9c1c-27ce30acc79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:48.337101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4229bbbe-d11a-4469-af2b-8ee205dcc0f8 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:48.337205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5283c25-aa86-4928-9c1c-27ce30acc79f None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:48.337205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5283c25-aa86-4928-9c1c-27ce30acc79f None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:48.337205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5283c25-aa86-4928-9c1c-27ce30acc79f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:48.339606 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:48.344482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5283c25-aa86-4928-9c1c-27ce30acc79f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:48.347742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5283c25-aa86-4928-9c1c-27ce30acc79f None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:48.360015 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-f5283c25-aa86-4928-9c1c-27ce30acc79f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:48.360015 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:48.360015 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:48.360015 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:48.360015 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:48.360015 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:48.360015 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:48.360015 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:48.360015 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:48.360015 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:48.360015 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:48.360015 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:48.360015 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:51:48.360015 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:51:48.360015 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:51:48.360951 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:51:48.360951 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:48.360951 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:48.360951 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:48.360951 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:48.360951 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:48.360951 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:48.360951 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:48.360951 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:48.360951 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:48.360951 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:48.360951 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:48.360951 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:48.360951 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:48.360951 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:48.360951 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:48.360951 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:48.361941 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:51:48.361941 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:51:48.361941 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:51:48.361941 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:51:48.361941 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:51:48.361941 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:51:48.361941 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:48.361941 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:48.361941 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 321/647] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:48.361941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5283c25-aa86-4928-9c1c-27ce30acc79f None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:48.369272 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:48.445449 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:48.453135 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 327/648] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:48.454250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229bbbe-d11a-4469-af2b-8ee205dcc0f8 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:48.474018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5283c25-aa86-4928-9c1c-27ce30acc79f None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:48.510676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffc523-1651-4bf8-85c5-2f2a8631d705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:48.511262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffc523-1651-4bf8-85c5-2f2a8631d705 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:48.511545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffc523-1651-4bf8-85c5-2f2a8631d705 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:48.511826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ffc523-1651-4bf8-85c5-2f2a8631d705 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:48.512548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffc523-1651-4bf8-85c5-2f2a8631d705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:48.512852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffc523-1651-4bf8-85c5-2f2a8631d705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:48.514278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ffc523-1651-4bf8-85c5-2f2a8631d705 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:48.531381 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 322/649] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:48.531381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffc523-1651-4bf8-85c5-2f2a8631d705 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:48.558849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229bbbe-d11a-4469-af2b-8ee205dcc0f8 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:48.591364 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:48.595162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d5a2b-9810-47eb-a1f9-ae0282e03c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:48.595967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d5a2b-9810-47eb-a1f9-ae0282e03c82 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:48.596255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d5a2b-9810-47eb-a1f9-ae0282e03c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:48.596534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d5a2b-9810-47eb-a1f9-ae0282e03c82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:48.607587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d5a2b-9810-47eb-a1f9-ae0282e03c82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:48.615562 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-998d5a2b-9810-47eb-a1f9-ae0282e03c82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:48.615562 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:48.615562 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:48.615562 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:48.615562 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:48.615562 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:48.615562 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:48.615562 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:48.615562 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:48.615562 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:48.615562 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:48.615562 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:48.615562 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:48.615562 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:48.615562 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:48.615562 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:48.616505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:48.616505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:48.616505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:48.616505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:48.616505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:48.616505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:48.616505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:48.616505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:48.616505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:48.616505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:48.616505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:48.616505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:48.616505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:48.616505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:48.616505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:48.616505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:48.617357 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:48.617357 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:48.617357 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:48.617357 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:48.617357 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:48.617357 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:48.617357 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:48.617357 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:48.617357 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:48.617357 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:48.617357 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:48.617357 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:48.622212 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 328/650] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:51:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:48.623060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d5a2b-9810-47eb-a1f9-ae0282e03c82 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:48.639748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ffc523-1651-4bf8-85c5-2f2a8631d705 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:48.676587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556abea-dba3-4e6d-9f1c-8f58a5707c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:48.677254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556abea-dba3-4e6d-9f1c-8f58a5707c15 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:48.677537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556abea-dba3-4e6d-9f1c-8f58a5707c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:48.677816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f556abea-dba3-4e6d-9f1c-8f58a5707c15 None admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:48.678760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556abea-dba3-4e6d-9f1c-8f58a5707c15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:48.679069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556abea-dba3-4e6d-9f1c-8f58a5707c15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:48.681124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f556abea-dba3-4e6d-9f1c-8f58a5707c15 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:48.682609 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:48.698867 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 323/651] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:51:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:48.698867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556abea-dba3-4e6d-9f1c-8f58a5707c15 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:48.735467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d5a2b-9810-47eb-a1f9-ae0282e03c82 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:48.772062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459e59c-7a9d-4369-bf20-155a5af2e333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:48.772776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459e59c-7a9d-4369-bf20-155a5af2e333 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:48.773063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459e59c-7a9d-4369-bf20-155a5af2e333 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:48.773342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c459e59c-7a9d-4369-bf20-155a5af2e333 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:48.784884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459e59c-7a9d-4369-bf20-155a5af2e333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:48.786355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c459e59c-7a9d-4369-bf20-155a5af2e333 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:48.800055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f556abea-dba3-4e6d-9f1c-8f58a5707c15 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:48.803469 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-c459e59c-7a9d-4369-bf20-155a5af2e333 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:48.803469 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:48.803469 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:48.803469 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:48.803469 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:48.803469 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:48.803469 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:48.803469 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:48.803469 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:48.803469 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:48.803469 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:48.803469 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:48.803469 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:48.803469 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:48.803469 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:48.804360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:48.804360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:48.804360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:48.804360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:48.804360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:48.804360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:48.804360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:48.804360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:48.804360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:48.804360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:48.804360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:48.804360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:48.804360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:48.804360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:48.804360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:48.804360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:48.804360 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:48.805957 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:48.805957 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:48.805957 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:48.805957 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:48.805957 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 329/652] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:48.806770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459e59c-7a9d-4369-bf20-155a5af2e333 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:48.826909 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:48.841752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34523648-232c-4f40-a359-0a52a6ee3ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:48.842590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34523648-232c-4f40-a359-0a52a6ee3ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:48.842914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34523648-232c-4f40-a359-0a52a6ee3ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:48.843207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34523648-232c-4f40-a359-0a52a6ee3ff7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:48.850474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34523648-232c-4f40-a359-0a52a6ee3ff7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:48.852032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34523648-232c-4f40-a359-0a52a6ee3ff7 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:48.867890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-34523648-232c-4f40-a359-0a52a6ee3ff7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 13:51:48.867890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:48.867890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:48.867890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:48.867890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:48.867890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:48.867890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:48.867890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:48.867890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:48.867890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:48.867890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:48.867890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:48.867890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:51:48.867890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:51:48.867890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:51:48.867890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:51:48.869310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:48.869310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:48.869310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:51:48.869310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:48.869310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:51:48.869310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:48.869310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:48.869310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:48.869310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:48.869310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:48.869310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:48.869310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:48.869310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:48.869310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:48.869310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:48.869310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:48.869310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:48.869310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:48.870314 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:48.870314 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:48.870314 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:51:48.870314 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:51:48.870314 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:51:48.870314 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:51:48.870314 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:51:48.870314 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:51:48.870314 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 13:51:48.870314 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:48.871292 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 324/653] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:48.871367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34523648-232c-4f40-a359-0a52a6ee3ff7 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:48.916163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c459e59c-7a9d-4369-bf20-155a5af2e333 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:48.924637 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:48.949662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9712e6-d2b6-424e-ab03-33d803ab6d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:48.950429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9712e6-d2b6-424e-ab03-33d803ab6d41 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:48.950906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9712e6-d2b6-424e-ab03-33d803ab6d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:48.951336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9712e6-d2b6-424e-ab03-33d803ab6d41 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:48.952443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9712e6-d2b6-424e-ab03-33d803ab6d41 None admin] RBAC: Adding query filter params (name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:48.952755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9712e6-d2b6-424e-ab03-33d803ab6d41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:48.954153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9712e6-d2b6-424e-ab03-33d803ab6d41 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:48.962002 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 330/654] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 19 13:51:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:48.962807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9712e6-d2b6-424e-ab03-33d803ab6d41 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:48.974718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34523648-232c-4f40-a359-0a52a6ee3ff7 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:49.008890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf77a1f-5276-43c0-bc31-98c2864ee897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:49.009559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf77a1f-5276-43c0-bc31-98c2864ee897 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:49.009840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf77a1f-5276-43c0-bc31-98c2864ee897 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:49.010138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf77a1f-5276-43c0-bc31-98c2864ee897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:49.010981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf77a1f-5276-43c0-bc31-98c2864ee897 None admin] RBAC: Adding query filter params (role.id=56d47830104f4dc09f1076c75acf3ffd, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=dfe9762955004354ab4f1fe02f05a427) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:49.011294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf77a1f-5276-43c0-bc31-98c2864ee897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:49.012714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf77a1f-5276-43c0-bc31-98c2864ee897 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:49.018643 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 325/655] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:51:48 2022] GET /identity/v3/role_assignments?user.id=dfe9762955004354ab4f1fe02f05a427&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=56d47830104f4dc09f1076c75acf3ffd => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:49.019235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf77a1f-5276-43c0-bc31-98c2864ee897 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:49.074046 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:49.074483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9712e6-d2b6-424e-ab03-33d803ab6d41 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:49.113492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480f176-08ed-48e1-be13-899d7cd6722e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:49.114303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480f176-08ed-48e1-be13-899d7cd6722e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:49.114588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480f176-08ed-48e1-be13-899d7cd6722e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:49.114861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480f176-08ed-48e1-be13-899d7cd6722e None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:49.115627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480f176-08ed-48e1-be13-899d7cd6722e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:49.116008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480f176-08ed-48e1-be13-899d7cd6722e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:49.117401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480f176-08ed-48e1-be13-899d7cd6722e None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:49.131205 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 331/656] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:49.132596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cdaff-5cd4-4293-b76d-c08cc7890537 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:49.132885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cdaff-5cd4-4293-b76d-c08cc7890537 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:49.133164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cdaff-5cd4-4293-b76d-c08cc7890537 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:49.138290 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 332/657] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:49.138290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cdaff-5cd4-4293-b76d-c08cc7890537 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:49.144226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf77a1f-5276-43c0-bc31-98c2864ee897 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:49.171952 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:49.183156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b088b-30eb-4f9c-8206-73114823ee86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:49.183924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b088b-30eb-4f9c-8206-73114823ee86 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:49.184215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b088b-30eb-4f9c-8206-73114823ee86 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:49.184492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9b088b-30eb-4f9c-8206-73114823ee86 None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:49.186184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b088b-30eb-4f9c-8206-73114823ee86 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:49.187040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b088b-30eb-4f9c-8206-73114823ee86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:49.188215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9b088b-30eb-4f9c-8206-73114823ee86 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:49.215091 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 326/658] 10.222.0.43 () {56 vars in 1137 bytes} [Tue Jul 19 13:51:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:49.215091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b088b-30eb-4f9c-8206-73114823ee86 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:49.267928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cdaff-5cd4-4293-b76d-c08cc7890537 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:49.306896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43520bb7-5c38-429a-aaf9-83b74fefae8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:49.307694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43520bb7-5c38-429a-aaf9-83b74fefae8f None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:49.307985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43520bb7-5c38-429a-aaf9-83b74fefae8f None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:49.308260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43520bb7-5c38-429a-aaf9-83b74fefae8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:49.319090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43520bb7-5c38-429a-aaf9-83b74fefae8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:49.320535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43520bb7-5c38-429a-aaf9-83b74fefae8f None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:49.335252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9b088b-30eb-4f9c-8206-73114823ee86 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:49.337618 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:49.339726 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-43520bb7-5c38-429a-aaf9-83b74fefae8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:49.339726 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:49.339726 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:49.339726 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:49.339726 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:49.339726 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:49.339726 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:49.339726 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:49.339726 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:49.339726 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:49.339726 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:49.339726 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:49.339726 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:49.339726 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:49.339726 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:49.340619 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:49.340619 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:49.340619 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:49.340619 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:49.340619 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:49.340619 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:49.340619 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:49.340619 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:49.340619 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:49.340619 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:49.340619 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:49.340619 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:49.340619 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:49.340619 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:49.340619 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:49.340619 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:49.340619 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:49.350874 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:49.350874 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:49.350874 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:49.350874 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:49.350874 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 333/659] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:49.350874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbfe22-6e08-416d-9b26-a24371493e97 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:49.350874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbfe22-6e08-416d-9b26-a24371493e97 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:49.350874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adbfe22-6e08-416d-9b26-a24371493e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:49.360695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2adbfe22-6e08-416d-9b26-a24371493e97 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:49.362063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2adbfe22-6e08-416d-9b26-a24371493e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:49.376307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd05212-2012-4e42-81eb-57158b301c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:49.377254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd05212-2012-4e42-81eb-57158b301c6a None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:49.377648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd05212-2012-4e42-81eb-57158b301c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:49.378024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd05212-2012-4e42-81eb-57158b301c6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:49.385700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd05212-2012-4e42-81eb-57158b301c6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:49.387288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd05212-2012-4e42-81eb-57158b301c6a None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:49.401554 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-7fd05212-2012-4e42-81eb-57158b301c6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:49.401554 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:49.401554 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:49.401554 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:49.401554 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:49.401554 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:49.401554 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:49.401554 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:49.401554 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:49.401554 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:49.401554 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:49.401554 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:49.401554 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:51:49.401554 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:51:49.401554 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:51:49.402713 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:51:49.402713 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:49.402713 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:49.402713 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:49.402713 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:49.402713 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:49.402713 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:49.402713 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:49.402713 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:49.402713 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:49.402713 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:49.402713 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:49.402713 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:49.402713 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:49.402713 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:49.402713 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:49.402713 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:49.403840 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:51:49.403840 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:51:49.403840 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:51:49.403840 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:51:49.403840 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:51:49.403840 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:51:49.403840 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:49.403840 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:49.407469 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 327/660] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:49.408303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd05212-2012-4e42-81eb-57158b301c6a None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:49.446315 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 334/661] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:49.446315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbfe22-6e08-416d-9b26-a24371493e97 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:49.464265 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:49.523817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd05212-2012-4e42-81eb-57158b301c6a None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:49.556798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adbfe22-6e08-416d-9b26-a24371493e97 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:49.558554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c51e96-fe3e-4a10-bdae-b2d558de13e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:49.559292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c51e96-fe3e-4a10-bdae-b2d558de13e2 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:49.559653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c51e96-fe3e-4a10-bdae-b2d558de13e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:49.560001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c51e96-fe3e-4a10-bdae-b2d558de13e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:49.592774 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:49.595589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf2a25-5ef1-4b7b-92ab-38945eba2e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:49.596265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf2a25-5ef1-4b7b-92ab-38945eba2e0c None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:49.596550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf2a25-5ef1-4b7b-92ab-38945eba2e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:49.596831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cf2a25-5ef1-4b7b-92ab-38945eba2e0c None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:49.597561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf2a25-5ef1-4b7b-92ab-38945eba2e0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:49.598625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf2a25-5ef1-4b7b-92ab-38945eba2e0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:49.599288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cf2a25-5ef1-4b7b-92ab-38945eba2e0c None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:49.615659 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 335/662] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:49.615659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf2a25-5ef1-4b7b-92ab-38945eba2e0c None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:49.638238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c51e96-fe3e-4a10-bdae-b2d558de13e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:49.639791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c51e96-fe3e-4a10-bdae-b2d558de13e2 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:49.690588 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:49.722411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cf2a25-5ef1-4b7b-92ab-38945eba2e0c None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:49.745644 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 328/663] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:49.746509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c51e96-fe3e-4a10-bdae-b2d558de13e2 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:49.765689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a64aa-e465-40c5-b21e-7da08c66aa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:49.766931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a64aa-e465-40c5-b21e-7da08c66aa47 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:49.767219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a64aa-e465-40c5-b21e-7da08c66aa47 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:49.767502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a64aa-e465-40c5-b21e-7da08c66aa47 None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:49.768370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a64aa-e465-40c5-b21e-7da08c66aa47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:49.768599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a64aa-e465-40c5-b21e-7da08c66aa47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:49.770059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a64aa-e465-40c5-b21e-7da08c66aa47 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:49.782709 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 336/664] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:51:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:49.783421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a64aa-e465-40c5-b21e-7da08c66aa47 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:49.819111 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:49.859971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c51e96-fe3e-4a10-bdae-b2d558de13e2 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:49.890389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a64aa-e465-40c5-b21e-7da08c66aa47 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:49.893487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c91fb2-4dfe-4e38-b07a-55d685e29dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:49.894351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c91fb2-4dfe-4e38-b07a-55d685e29dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:49.894626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c91fb2-4dfe-4e38-b07a-55d685e29dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:49.894902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c91fb2-4dfe-4e38-b07a-55d685e29dc0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:49.905041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c91fb2-4dfe-4e38-b07a-55d685e29dc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:49.912724 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-a1c91fb2-4dfe-4e38-b07a-55d685e29dc0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:49.912724 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:49.912724 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:49.912724 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:49.912724 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:49.912724 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:49.912724 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:49.912724 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:49.912724 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:49.912724 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:49.912724 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:49.912724 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:49.912724 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:49.912724 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:49.912724 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:49.912724 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:49.913655 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:49.913655 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:49.913655 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:49.913655 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:49.913655 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:49.913655 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:49.913655 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:49.913655 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:49.913655 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:49.913655 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:49.913655 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:49.913655 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:49.913655 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:49.913655 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:49.913655 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:49.913655 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:49.915604 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:49.915604 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:49.915604 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:49.915604 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:49.915604 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:49.915604 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:49.915604 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:49.915604 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:49.915604 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:49.915604 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:49.915604 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:49.915604 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:49.919517 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 329/665] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:51:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:49.920227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c91fb2-4dfe-4e38-b07a-55d685e29dc0 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:49.925671 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:49.931388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2b4ad-3ff7-47c5-9c73-fb885df2e542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:49.932308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2b4ad-3ff7-47c5-9c73-fb885df2e542 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:49.932602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2b4ad-3ff7-47c5-9c73-fb885df2e542 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:49.932884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e2b4ad-3ff7-47c5-9c73-fb885df2e542 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:49.940714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2b4ad-3ff7-47c5-9c73-fb885df2e542 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:49.942294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e2b4ad-3ff7-47c5-9c73-fb885df2e542 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:49.959272 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-a3e2b4ad-3ff7-47c5-9c73-fb885df2e542 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 13:51:49.959272 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:49.959272 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:49.959272 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:49.959272 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:49.959272 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:49.959272 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:49.959272 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:49.959272 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:49.959272 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:49.959272 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:49.959272 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:49.959272 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:51:49.959272 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:51:49.959272 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:51:49.959272 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:51:49.960236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:49.960236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:49.960236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:51:49.960236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:49.960236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:51:49.960236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:49.960236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:49.960236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:49.960236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:49.960236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:49.960236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:49.960236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:49.960236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:49.960236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:49.960236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:49.960236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:49.960236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:49.960236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:49.961183 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:49.961183 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:49.961183 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:51:49.961183 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:51:49.961183 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:51:49.961183 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:51:49.961183 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:51:49.961183 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:51:49.961183 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 13:51:49.961183 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:49.962659 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 337/666] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:51:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:49.963152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2b4ad-3ff7-47c5-9c73-fb885df2e542 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:50.028240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c91fb2-4dfe-4e38-b07a-55d685e29dc0 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:50.051878 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:50.064307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926f615-a59c-4dce-bb94-fe4bcdc813b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:50.071418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926f615-a59c-4dce-bb94-fe4bcdc813b1 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:50.071418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926f615-a59c-4dce-bb94-fe4bcdc813b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:50.071418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7926f615-a59c-4dce-bb94-fe4bcdc813b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:50.071690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e2b4ad-3ff7-47c5-9c73-fb885df2e542 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:50.076466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926f615-a59c-4dce-bb94-fe4bcdc813b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:50.078024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7926f615-a59c-4dce-bb94-fe4bcdc813b1 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:50.096801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-7926f615-a59c-4dce-bb94-fe4bcdc813b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:50.096801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:50.096801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:50.096801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:50.096801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:50.096801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:50.096801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:50.096801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:50.096801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:50.096801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:50.096801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:50.096801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:50.096801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:50.096801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:50.096801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:50.097723 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:50.097723 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:50.097723 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:50.097723 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:50.097723 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:50.097723 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:50.097723 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:50.097723 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:50.097723 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:50.097723 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:50.097723 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:50.097723 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:50.097723 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:50.097723 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:50.097723 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:50.097723 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:50.097723 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:50.098647 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:50.098647 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:50.098647 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:50.098647 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:50.098647 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 330/667] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:50.099452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926f615-a59c-4dce-bb94-fe4bcdc813b1 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:50.108677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbb871-6237-4fea-82d9-e2c0ef64516c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:50.109337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbb871-6237-4fea-82d9-e2c0ef64516c None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:50.110085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbb871-6237-4fea-82d9-e2c0ef64516c None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:50.110367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dbb871-6237-4fea-82d9-e2c0ef64516c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:50.111213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbb871-6237-4fea-82d9-e2c0ef64516c None admin] RBAC: Adding query filter params (role.id=56d47830104f4dc09f1076c75acf3ffd, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=75efea22b2484c1ea79a74e6793050f5) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:50.111881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbb871-6237-4fea-82d9-e2c0ef64516c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:50.113652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dbb871-6237-4fea-82d9-e2c0ef64516c None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:50.120432 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 338/668] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:51:49 2022] GET /identity/v3/role_assignments?user.id=75efea22b2484c1ea79a74e6793050f5&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=56d47830104f4dc09f1076c75acf3ffd => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:50.121068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbb871-6237-4fea-82d9-e2c0ef64516c None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:50.191550 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:50.248506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7926f615-a59c-4dce-bb94-fe4bcdc813b1 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:50.255594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dbb871-6237-4fea-82d9-e2c0ef64516c None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:50.293047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cb083-57bf-4391-9adf-7f226b8244b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:50.293739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cb083-57bf-4391-9adf-7f226b8244b9 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:50.294286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cb083-57bf-4391-9adf-7f226b8244b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:50.294394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1cb083-57bf-4391-9adf-7f226b8244b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:50.295097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cb083-57bf-4391-9adf-7f226b8244b9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:50.295409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cb083-57bf-4391-9adf-7f226b8244b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:50.296848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1cb083-57bf-4391-9adf-7f226b8244b9 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:50.303638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec239cb-1a0c-4d94-b8e1-796e04535ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:50.304317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec239cb-1a0c-4d94-b8e1-796e04535ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:50.304605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec239cb-1a0c-4d94-b8e1-796e04535ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:50.304886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec239cb-1a0c-4d94-b8e1-796e04535ae5 None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:50.306432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec239cb-1a0c-4d94-b8e1-796e04535ae5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:50.306743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec239cb-1a0c-4d94-b8e1-796e04535ae5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:50.307179 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 331/669] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 19 13:51:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:50.308011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cb083-57bf-4391-9adf-7f226b8244b9 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:50.310821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec239cb-1a0c-4d94-b8e1-796e04535ae5 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:50.338736 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 339/670] 10.222.0.43 () {56 vars in 1139 bytes} [Tue Jul 19 13:51:50 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:50.339419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec239cb-1a0c-4d94-b8e1-796e04535ae5 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:50.355644 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:50.440987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1cb083-57bf-4391-9adf-7f226b8244b9 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:50.461692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec239cb-1a0c-4d94-b8e1-796e04535ae5 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:50.476835 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:50.486408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f667a-24cb-4eb7-bc23-edefea1b7337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:50.487397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f667a-24cb-4eb7-bc23-edefea1b7337 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:50.487997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f667a-24cb-4eb7-bc23-edefea1b7337 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:50.489145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f667a-24cb-4eb7-bc23-edefea1b7337 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:50.490194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f667a-24cb-4eb7-bc23-edefea1b7337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:50.490656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f667a-24cb-4eb7-bc23-edefea1b7337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:50.493198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f667a-24cb-4eb7-bc23-edefea1b7337 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:50.500647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd12d8f-b75c-4d8e-9d3a-cc420365e2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:50.501560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd12d8f-b75c-4d8e-9d3a-cc420365e2ce None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:50.501940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd12d8f-b75c-4d8e-9d3a-cc420365e2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:50.502335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd12d8f-b75c-4d8e-9d3a-cc420365e2ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:50.507594 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 332/671] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:50.509182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f667a-24cb-4eb7-bc23-edefea1b7337 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:50.514566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd12d8f-b75c-4d8e-9d3a-cc420365e2ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:50.515860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd12d8f-b75c-4d8e-9d3a-cc420365e2ce None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:50.533863 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-6cd12d8f-b75c-4d8e-9d3a-cc420365e2ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:50.533863 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:50.533863 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:50.533863 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:50.533863 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:50.533863 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:50.533863 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:50.533863 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:50.533863 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:50.533863 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:50.533863 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:50.533863 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:50.533863 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:50.533863 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:50.533863 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:50.535001 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:50.535001 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:50.535001 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:50.535001 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:50.535001 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:50.535001 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:50.535001 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:50.535001 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:50.535001 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:50.535001 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:50.535001 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:50.535001 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:50.535001 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:50.535001 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:50.535001 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:50.535001 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:50.535001 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:50.536100 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:50.536100 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:50.536100 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:50.536100 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:50.537646 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 340/672] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:50.538629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd12d8f-b75c-4d8e-9d3a-cc420365e2ce None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:50.635913 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:50.642768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f667a-24cb-4eb7-bc23-edefea1b7337 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:50.649609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd12d8f-b75c-4d8e-9d3a-cc420365e2ce None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:50.678019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eefb68-5439-429e-bc09-109097df5f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:50.678833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eefb68-5439-429e-bc09-109097df5f09 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:50.679214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eefb68-5439-429e-bc09-109097df5f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:50.679584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eefb68-5439-429e-bc09-109097df5f09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:50.697088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dba7d-9cea-420a-a193-57b225d1895a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:50.697806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dba7d-9cea-420a-a193-57b225d1895a None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:50.698085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dba7d-9cea-420a-a193-57b225d1895a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:50.698369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864dba7d-9cea-420a-a193-57b225d1895a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:50.708721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864dba7d-9cea-420a-a193-57b225d1895a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:50.710191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864dba7d-9cea-420a-a193-57b225d1895a None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:50.724944 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-864dba7d-9cea-420a-a193-57b225d1895a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:50.724944 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:50.724944 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:50.724944 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:50.724944 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:50.724944 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:50.724944 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:50.724944 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:50.724944 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:50.724944 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:50.724944 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:50.724944 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:50.724944 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:51:50.724944 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:51:50.724944 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:51:50.725882 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:51:50.725882 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:50.725882 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:50.725882 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:50.725882 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:50.725882 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:50.725882 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:50.725882 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:50.725882 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:50.725882 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:50.725882 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:50.725882 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:50.725882 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:50.725882 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:50.725882 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:50.725882 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:50.725882 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:50.726825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:51:50.726825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:51:50.726825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:51:50.726825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:51:50.726825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:51:50.726825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:51:50.726825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:50.726825 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:50.726825 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 341/673] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:50.728309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dba7d-9cea-420a-a193-57b225d1895a None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:50.765083 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:50.767289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eefb68-5439-429e-bc09-109097df5f09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:50.768930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eefb68-5439-429e-bc09-109097df5f09 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:50.853543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864dba7d-9cea-420a-a193-57b225d1895a None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:50.889540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8c126-e6c2-430a-bff8-7acb5e1250c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:50.890229 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8c126-e6c2-430a-bff8-7acb5e1250c6 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:50.890514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8c126-e6c2-430a-bff8-7acb5e1250c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:50.890787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8c126-e6c2-430a-bff8-7acb5e1250c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:50.891509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8c126-e6c2-430a-bff8-7acb5e1250c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:50.891811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8c126-e6c2-430a-bff8-7acb5e1250c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:50.893240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8c126-e6c2-430a-bff8-7acb5e1250c6 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:50.901414 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 333/674] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:50.902860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eefb68-5439-429e-bc09-109097df5f09 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:50.906705 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:50.910825 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 342/675] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:50.911926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8c126-e6c2-430a-bff8-7acb5e1250c6 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:51.001476 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:51.015261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eefb68-5439-429e-bc09-109097df5f09 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:51.016411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8c126-e6c2-430a-bff8-7acb5e1250c6 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:51.053630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1a7bf-3063-4213-9bd8-53986e84f5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:51.053877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b16a3-eabd-4bc9-983e-abbaf4acc222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:51.054630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b16a3-eabd-4bc9-983e-abbaf4acc222 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:51.054914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b16a3-eabd-4bc9-983e-abbaf4acc222 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:51.055264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b16a3-eabd-4bc9-983e-abbaf4acc222 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:51.056460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1a7bf-3063-4213-9bd8-53986e84f5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:51.056738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1a7bf-3063-4213-9bd8-53986e84f5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:51.057007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1a7bf-3063-4213-9bd8-53986e84f5d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:51.057822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1a7bf-3063-4213-9bd8-53986e84f5d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:51.058141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1a7bf-3063-4213-9bd8-53986e84f5d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:51.059570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1a7bf-3063-4213-9bd8-53986e84f5d5 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:51.069988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b16a3-eabd-4bc9-983e-abbaf4acc222 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:51.072398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b16a3-eabd-4bc9-983e-abbaf4acc222 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:51.076925 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 334/676] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:51:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:51.077891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1a7bf-3063-4213-9bd8-53986e84f5d5 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:51.094785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-902b16a3-eabd-4bc9-983e-abbaf4acc222 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:51.094785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:51.094785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:51.094785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:51.094785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:51.094785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:51.094785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:51.094785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:51.094785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:51.094785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:51.094785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:51.094785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:51.094785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:51.094785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:51.094785 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:51.101934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:51.101934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:51.101934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:51.101934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:51.101934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:51.101934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:51.101934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:51.101934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:51.101934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:51.101934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:51.101934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:51.101934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:51.101934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:51.101934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:51.101934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:51.101934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:51.101934 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:51.103450 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:51.103450 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:51.103450 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:51.103450 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:51.103450 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 343/677] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:51.103450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b16a3-eabd-4bc9-983e-abbaf4acc222 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:51.186500 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:51.196227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1a7bf-3063-4213-9bd8-53986e84f5d5 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:51.212397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b16a3-eabd-4bc9-983e-abbaf4acc222 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:51.237545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc9970-b220-40bf-91a0-880c52b78422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:51.238451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc9970-b220-40bf-91a0-880c52b78422 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:51.238795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc9970-b220-40bf-91a0-880c52b78422 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:51.239133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc9970-b220-40bf-91a0-880c52b78422 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:51.247226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc9970-b220-40bf-91a0-880c52b78422 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:51.248664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc9970-b220-40bf-91a0-880c52b78422 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:51.249991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585edb73-0392-4529-8ae8-5c0d9fa6e9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:51.250801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585edb73-0392-4529-8ae8-5c0d9fa6e9ad None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:51.251215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585edb73-0392-4529-8ae8-5c0d9fa6e9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:51.251554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585edb73-0392-4529-8ae8-5c0d9fa6e9ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:51.252346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585edb73-0392-4529-8ae8-5c0d9fa6e9ad None admin] RBAC: Adding query filter params (role.id=56d47830104f4dc09f1076c75acf3ffd, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=ef77d9ec7712434287347d959dcf1cc0) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:51.252660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585edb73-0392-4529-8ae8-5c0d9fa6e9ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:51.254080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585edb73-0392-4529-8ae8-5c0d9fa6e9ad None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:51.260223 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 344/678] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:51:51 2022] GET /identity/v3/role_assignments?user.id=ef77d9ec7712434287347d959dcf1cc0&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=56d47830104f4dc09f1076c75acf3ffd => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:51.261008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585edb73-0392-4529-8ae8-5c0d9fa6e9ad None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:51.264097 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-d6cc9970-b220-40bf-91a0-880c52b78422 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 13:51:51.264097 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:51.264097 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:51.264097 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:51.264097 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:51.264097 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:51.264097 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:51.264097 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:51.264097 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:51.264097 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:51.264097 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:51.264097 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:51.264097 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:51:51.264097 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:51:51.264097 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:51:51.264097 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:51:51.265082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:51.265082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:51.265082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:51:51.265082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:51.265082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:51:51.265082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:51.265082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:51.265082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:51.265082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:51.265082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:51.265082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:51.265082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:51.265082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:51.265082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:51.265082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:51.265082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:51.265082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:51.265082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:51.266037 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:51.266037 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:51.266037 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:51:51.266037 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:51:51.266037 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:51:51.266037 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:51:51.266037 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:51:51.266037 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:51:51.266037 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 13:51:51.266037 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:51.266037 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 335/679] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:51:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:51.266679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890d665-1eab-4d4b-95ab-1d4bcd9c790d None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:51.267099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890d665-1eab-4d4b-95ab-1d4bcd9c790d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:51.267206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890d665-1eab-4d4b-95ab-1d4bcd9c790d None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:51.268705 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 336/680] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:51.272003 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:51.274084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f4ed8-7b59-4721-a26c-14aa6501b949 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:51.274554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f4ed8-7b59-4721-a26c-14aa6501b949 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:51.274992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f4ed8-7b59-4721-a26c-14aa6501b949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:51.294280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-334f4ed8-7b59-4721-a26c-14aa6501b949 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:51.296108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-334f4ed8-7b59-4721-a26c-14aa6501b949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:51.387730 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 337/681] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:51:51.391044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f4ed8-7b59-4721-a26c-14aa6501b949 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:51.422087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585edb73-0392-4529-8ae8-5c0d9fa6e9ad None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:51.465848 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:51.468699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f97a0-8bf1-41ef-bf6d-e1eda52e3f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:51.469611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f97a0-8bf1-41ef-bf6d-e1eda52e3f19 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:51.469721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f97a0-8bf1-41ef-bf6d-e1eda52e3f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:51.469929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f97a0-8bf1-41ef-bf6d-e1eda52e3f19 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:51.471424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f97a0-8bf1-41ef-bf6d-e1eda52e3f19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:51.471424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f97a0-8bf1-41ef-bf6d-e1eda52e3f19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:51.472495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40f97a0-8bf1-41ef-bf6d-e1eda52e3f19 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:51.487634 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 345/682] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:51.488218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f97a0-8bf1-41ef-bf6d-e1eda52e3f19 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:51.531778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f4ed8-7b59-4721-a26c-14aa6501b949 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:51.569534 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:51.571079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549811c4-b0d7-434c-b2e9-a2b1a85eca44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:51.572177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549811c4-b0d7-434c-b2e9-a2b1a85eca44 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:51.572675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549811c4-b0d7-434c-b2e9-a2b1a85eca44 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:51.573161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549811c4-b0d7-434c-b2e9-a2b1a85eca44 None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:51.574296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549811c4-b0d7-434c-b2e9-a2b1a85eca44 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:51.580352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549811c4-b0d7-434c-b2e9-a2b1a85eca44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:51.580352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549811c4-b0d7-434c-b2e9-a2b1a85eca44 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:51.596485 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 338/683] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Jul 19 13:51:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:51.598001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549811c4-b0d7-434c-b2e9-a2b1a85eca44 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:51.617856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f97a0-8bf1-41ef-bf6d-e1eda52e3f19 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:51.654868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794c732-aef4-4137-bf2f-eccb5e0ddebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:51.656135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794c732-aef4-4137-bf2f-eccb5e0ddebc None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:51.656624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794c732-aef4-4137-bf2f-eccb5e0ddebc None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:51.657143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794c732-aef4-4137-bf2f-eccb5e0ddebc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:51.668773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794c732-aef4-4137-bf2f-eccb5e0ddebc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:51.676807 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-a794c732-aef4-4137-bf2f-eccb5e0ddebc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:51:51.676807 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:51.676807 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:51.676807 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:51.676807 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:51.676807 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:51.676807 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:51.676807 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:51.676807 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:51.676807 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:51.676807 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:51.676807 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:51.676807 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:51.676807 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:51.676807 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:51.676807 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:51.677742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:51.677742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:51.677742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:51.677742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:51.677742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:51.677742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:51.677742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:51.677742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:51.677742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:51.677742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:51.677742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:51.677742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:51.677742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:51.677742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:51.677742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:51.677742 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:51.678629 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:51.678629 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:51.678629 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:51.678629 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:51.678629 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:51.678629 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:51.678629 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:51.678629 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:51.678629 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:51.678629 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:51.678629 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:51:51.678629 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:51.681652 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 346/684] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:51:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:51.687200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794c732-aef4-4137-bf2f-eccb5e0ddebc None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:51.726687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549811c4-b0d7-434c-b2e9-a2b1a85eca44 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:51.730389 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:51.765373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49914e7b-98f5-4a5f-b326-dda91840eac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:51.766572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49914e7b-98f5-4a5f-b326-dda91840eac4 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:51.767067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49914e7b-98f5-4a5f-b326-dda91840eac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:51.767544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49914e7b-98f5-4a5f-b326-dda91840eac4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:51.775934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49914e7b-98f5-4a5f-b326-dda91840eac4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:51.777724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49914e7b-98f5-4a5f-b326-dda91840eac4 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:51.792801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-49914e7b-98f5-4a5f-b326-dda91840eac4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:51.792801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:51.792801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:51.792801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:51.792801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:51.792801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:51.792801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:51.792801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:51.792801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:51.792801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:51.792801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:51.792801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:51.792801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:51:51.792801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:51:51.792801 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:51:51.793745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:51:51.793745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:51.793745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:51.793745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:51.793745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:51.793745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:51.793745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:51.793745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:51.793745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:51.793745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:51.793745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:51.793745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:51.793745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:51.793745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:51.793745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:51.793745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:51.793745 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:51.794681 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:51:51.794681 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:51:51.794681 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:51:51.794681 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:51:51.794681 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:51:51.794681 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:51:51.794681 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:51.794681 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:51.797175 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 339/685] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:51.798260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49914e7b-98f5-4a5f-b326-dda91840eac4 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:51.805737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794c732-aef4-4137-bf2f-eccb5e0ddebc None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:51.831791 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:51.844443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b358b6-38ab-49c5-984f-84b1ff9d83ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:51.849317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b358b6-38ab-49c5-984f-84b1ff9d83ca None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:51.849317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b358b6-38ab-49c5-984f-84b1ff9d83ca None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:51.849317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b358b6-38ab-49c5-984f-84b1ff9d83ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:51.911392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49914e7b-98f5-4a5f-b326-dda91840eac4 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:51.920882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b358b6-38ab-49c5-984f-84b1ff9d83ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:51.922328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b358b6-38ab-49c5-984f-84b1ff9d83ca None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:51.950859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e942aea-00fc-4331-acbc-4270ce7d4c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:51.952025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e942aea-00fc-4331-acbc-4270ce7d4c90 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:51.952612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e942aea-00fc-4331-acbc-4270ce7d4c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:51.953090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e942aea-00fc-4331-acbc-4270ce7d4c90 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:51.954037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e942aea-00fc-4331-acbc-4270ce7d4c90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:51.954696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e942aea-00fc-4331-acbc-4270ce7d4c90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:51.956358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e942aea-00fc-4331-acbc-4270ce7d4c90 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:51.970317 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 340/686] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:51.971651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e942aea-00fc-4331-acbc-4270ce7d4c90 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:52.001507 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:52.032831 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 347/687] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:52.033803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b358b6-38ab-49c5-984f-84b1ff9d83ca None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:52.060063 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:52.082274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e942aea-00fc-4331-acbc-4270ce7d4c90 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:52.121328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23dc69-e246-4ae5-a40b-8c59be9c04f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:52.122383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23dc69-e246-4ae5-a40b-8c59be9c04f6 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:52.122914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23dc69-e246-4ae5-a40b-8c59be9c04f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:52.123394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c23dc69-e246-4ae5-a40b-8c59be9c04f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:52.124542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23dc69-e246-4ae5-a40b-8c59be9c04f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:52.125100 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23dc69-e246-4ae5-a40b-8c59be9c04f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:52.126790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c23dc69-e246-4ae5-a40b-8c59be9c04f6 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:52.141030 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 341/688] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:51:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:52.142304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23dc69-e246-4ae5-a40b-8c59be9c04f6 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:52.144936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b358b6-38ab-49c5-984f-84b1ff9d83ca None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:52.183603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b9662-27eb-4646-b120-fd049e324d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:52.184403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b9662-27eb-4646-b120-fd049e324d47 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:52.184691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b9662-27eb-4646-b120-fd049e324d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:52.184972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b9662-27eb-4646-b120-fd049e324d47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:52.196329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b9662-27eb-4646-b120-fd049e324d47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:52.197924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b9662-27eb-4646-b120-fd049e324d47 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:52.225058 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-6c2b9662-27eb-4646-b120-fd049e324d47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:52.225058 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:52.225058 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:52.225058 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:52.225058 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:52.225058 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:52.225058 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:52.225058 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:52.225058 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:52.225058 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:52.225058 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:52.225058 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:52.225058 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:52.225058 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:52.225058 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:52.225940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:52.225940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:52.225940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:52.225940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:52.225940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:52.225940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:52.225940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:52.225940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:52.225940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:52.225940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:52.225940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:52.225940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:52.225940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:52.225940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:52.225940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:52.225940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:52.225940 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:52.226879 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:52.226879 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:52.226879 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:52.226879 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:52.231426 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 348/689] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:52.232295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b9662-27eb-4646-b120-fd049e324d47 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:52.251296 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:52.269365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c23dc69-e246-4ae5-a40b-8c59be9c04f6 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:52.310046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deff4e5-c953-440b-b759-19c8e710e3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:52.312054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deff4e5-c953-440b-b759-19c8e710e3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:52.312497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deff4e5-c953-440b-b759-19c8e710e3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:52.312923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deff4e5-c953-440b-b759-19c8e710e3d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:52.316820 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:52.327534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deff4e5-c953-440b-b759-19c8e710e3d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:52.329214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deff4e5-c953-440b-b759-19c8e710e3d6 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:52.343440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b9662-27eb-4646-b120-fd049e324d47 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:52.355044 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-4deff4e5-c953-440b-b759-19c8e710e3d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:52.355044 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:52.355044 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:52.355044 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:52.355044 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:52.355044 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:52.355044 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:52.355044 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:52.355044 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:52.355044 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:52.355044 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:52.355044 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:52.355044 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:52.355044 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:52.355044 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:52.356161 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:52.356161 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:52.356161 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:52.356161 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:52.356161 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:52.356161 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:52.356161 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:52.356161 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:52.356161 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:52.356161 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:52.356161 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:52.356161 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:52.356161 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:52.356161 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:52.356161 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:52.356161 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:52.356161 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:52.357170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:52.357170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:52.357170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:52.357170 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:52.359333 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 342/690] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:52.360436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deff4e5-c953-440b-b759-19c8e710e3d6 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:52.388941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb09be-b573-4da5-add3-335366f31e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:52.389860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb09be-b573-4da5-add3-335366f31e99 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:52.390177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb09be-b573-4da5-add3-335366f31e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:52.390474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb09be-b573-4da5-add3-335366f31e99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:52.391293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb09be-b573-4da5-add3-335366f31e99 None admin] RBAC: Adding query filter params (role.id=56d47830104f4dc09f1076c75acf3ffd, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=e997b70d7158446daa1dfa225eb7afca) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:52.391631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb09be-b573-4da5-add3-335366f31e99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:52.393036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb09be-b573-4da5-add3-335366f31e99 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:52.399217 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 349/691] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:51:52 2022] GET /identity/v3/role_assignments?user.id=e997b70d7158446daa1dfa225eb7afca&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=56d47830104f4dc09f1076c75acf3ffd => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:52.400209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17120e0-9840-4063-92c2-bf702b747be1 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:52.400488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17120e0-9840-4063-92c2-bf702b747be1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:52.400766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17120e0-9840-4063-92c2-bf702b747be1 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:52.402124 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 350/692] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:52.406833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17120e0-9840-4063-92c2-bf702b747be1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:52.504323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deff4e5-c953-440b-b759-19c8e710e3d6 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:52.541145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17120e0-9840-4063-92c2-bf702b747be1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:52.543373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa11e5-ef31-4cf4-9ff8-3cde24db8212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:52.544077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa11e5-ef31-4cf4-9ff8-3cde24db8212 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:52.544363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa11e5-ef31-4cf4-9ff8-3cde24db8212 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:52.544643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa11e5-ef31-4cf4-9ff8-3cde24db8212 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:52.545408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa11e5-ef31-4cf4-9ff8-3cde24db8212 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:52.545723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa11e5-ef31-4cf4-9ff8-3cde24db8212 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:52.547199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa11e5-ef31-4cf4-9ff8-3cde24db8212 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:52.556775 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:52.570220 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 343/693] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:52.570220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4553b8-4d44-4ec5-b9be-6d922596d63b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:52.570220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4553b8-4d44-4ec5-b9be-6d922596d63b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:52.570220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4553b8-4d44-4ec5-b9be-6d922596d63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:52.588040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3a4553b8-4d44-4ec5-b9be-6d922596d63b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:52.589334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3a4553b8-4d44-4ec5-b9be-6d922596d63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:52.592325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edff72-3144-4e9c-bcf1-02bcecaca16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:52.593005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edff72-3144-4e9c-bcf1-02bcecaca16e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:52.593293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edff72-3144-4e9c-bcf1-02bcecaca16e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:52.593572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24edff72-3144-4e9c-bcf1-02bcecaca16e None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:52.594344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24edff72-3144-4e9c-bcf1-02bcecaca16e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:52.594656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24edff72-3144-4e9c-bcf1-02bcecaca16e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:52.596045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24edff72-3144-4e9c-bcf1-02bcecaca16e None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:52.605410 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:52.612453 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 351/694] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:52.612453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edff72-3144-4e9c-bcf1-02bcecaca16e None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:52.672988 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 344/695] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:52.673849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4553b8-4d44-4ec5-b9be-6d922596d63b None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:52.764466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24edff72-3144-4e9c-bcf1-02bcecaca16e None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:52.784212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4553b8-4d44-4ec5-b9be-6d922596d63b None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:52.811558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51428990-63a3-4f54-845a-22d1ec46645c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:52.813469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51428990-63a3-4f54-845a-22d1ec46645c None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:52.813753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51428990-63a3-4f54-845a-22d1ec46645c None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:52.814026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51428990-63a3-4f54-845a-22d1ec46645c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:52.816925 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:52.827927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51428990-63a3-4f54-845a-22d1ec46645c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:52.829764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcbff3-28bd-4eab-a550-3adc8ff2b65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:52.830233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51428990-63a3-4f54-845a-22d1ec46645c None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:52.830595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcbff3-28bd-4eab-a550-3adc8ff2b65c None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:52.830878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcbff3-28bd-4eab-a550-3adc8ff2b65c None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:52.831155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcbff3-28bd-4eab-a550-3adc8ff2b65c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:52.841077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefcbff3-28bd-4eab-a550-3adc8ff2b65c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:52.842556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefcbff3-28bd-4eab-a550-3adc8ff2b65c None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:52.849211 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-51428990-63a3-4f54-845a-22d1ec46645c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 13:51:52.849211 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:52.849211 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:52.849211 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:52.849211 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:52.849211 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:52.849211 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:52.849211 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:52.849211 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:52.849211 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:52.849211 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:52.849211 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:52.849211 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:51:52.849211 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:51:52.849211 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:51:52.849211 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:51:52.850181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:52.850181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:52.850181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:51:52.850181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:52.850181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:51:52.850181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:52.850181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:52.850181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:52.850181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:52.850181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:52.850181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:52.850181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:52.850181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:52.850181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:52.850181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:52.850181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:52.850181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:52.850181 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:52.851136 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:52.851136 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:52.851136 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:51:52.851136 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:51:52.851136 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:51:52.851136 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:51:52.851136 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:51:52.851136 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:51:52.851136 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 13:51:52.851136 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:52.858433 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-cefcbff3-28bd-4eab-a550-3adc8ff2b65c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:52.858433 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:52.858433 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:52.858433 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:52.858433 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:52.858433 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:52.858433 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:52.858433 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:52.858433 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:52.858433 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:52.858433 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:52.858433 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:52.858433 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:51:52.858433 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:51:52.858433 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:51:52.859320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:51:52.859320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:52.859320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:52.859320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:52.859320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:52.859320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:52.859320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:52.859320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:52.859320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:52.859320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:52.859320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:52.859320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:52.859320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:52.859320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:52.859320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:52.859320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:52.859320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:52.860216 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:51:52.860216 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:51:52.860216 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:51:52.860216 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:51:52.860216 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:51:52.860216 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:51:52.860216 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:52.860216 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:52.860216 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 345/696] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:52.860216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcbff3-28bd-4eab-a550-3adc8ff2b65c None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:52.861718 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 352/697] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jul 19 13:51:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:52.862753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51428990-63a3-4f54-845a-22d1ec46645c None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:52.949202 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:52.974705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcbff3-28bd-4eab-a550-3adc8ff2b65c None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:53.000084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51428990-63a3-4f54-845a-22d1ec46645c None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:53.017982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda4e83-0b89-4a9c-b732-ddec08e289ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:53.019288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda4e83-0b89-4a9c-b732-ddec08e289ef None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:53.020117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda4e83-0b89-4a9c-b732-ddec08e289ef None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:53.020590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda4e83-0b89-4a9c-b732-ddec08e289ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:53.035859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda4e83-0b89-4a9c-b732-ddec08e289ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:53.037914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda4e83-0b89-4a9c-b732-ddec08e289ef None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:53.039792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdf176-f03b-4b46-b719-524834d61948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:53.040573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdf176-f03b-4b46-b719-524834d61948 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:53.040994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdf176-f03b-4b46-b719-524834d61948 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:53.041364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdf176-f03b-4b46-b719-524834d61948 None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:53.042414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdf176-f03b-4b46-b719-524834d61948 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:53.042824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdf176-f03b-4b46-b719-524834d61948 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:53.044401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdf176-f03b-4b46-b719-524834d61948 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:53.061809 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-5cda4e83-0b89-4a9c-b732-ddec08e289ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:53.061809 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:53.061809 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:53.061809 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:53.061809 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:53.061809 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:53.061809 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:53.061809 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:53.061809 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:53.061809 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:53.061809 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:53.061809 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:53.061809 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:53.061809 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:53.061809 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:53.062945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:53.062945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:53.062945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:53.062945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:53.062945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:53.062945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:53.062945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:53.062945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:53.062945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:53.062945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:53.062945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:53.062945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:53.062945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:53.062945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:53.062945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:53.062945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:53.062945 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:53.064310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:53.064310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:53.064310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:53.064310 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:53.070285 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 353/698] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jul 19 13:51:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:53.070285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdf176-f03b-4b46-b719-524834d61948 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:53.070841 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 346/699] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:53.072017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda4e83-0b89-4a9c-b732-ddec08e289ef None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:53.129661 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:53.200608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda4e83-0b89-4a9c-b732-ddec08e289ef None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:53.201109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdf176-f03b-4b46-b719-524834d61948 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:53.230426 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:53.244692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6222c0-cb19-46dc-9fef-a1a3462c20ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:53.245600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6222c0-cb19-46dc-9fef-a1a3462c20ea None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:53.245955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6222c0-cb19-46dc-9fef-a1a3462c20ea None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:53.246354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6222c0-cb19-46dc-9fef-a1a3462c20ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:53.253972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dac315-b4f0-4d6a-a304-9c9429be6f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:53.254875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dac315-b4f0-4d6a-a304-9c9429be6f84 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:53.255311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dac315-b4f0-4d6a-a304-9c9429be6f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:53.256212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dac315-b4f0-4d6a-a304-9c9429be6f84 None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:53.257211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dac315-b4f0-4d6a-a304-9c9429be6f84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:53.257687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dac315-b4f0-4d6a-a304-9c9429be6f84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:53.260207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dac315-b4f0-4d6a-a304-9c9429be6f84 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:53.277101 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 354/700] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:51:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:53.278487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dac315-b4f0-4d6a-a304-9c9429be6f84 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:53.324140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6222c0-cb19-46dc-9fef-a1a3462c20ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:53.325602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6222c0-cb19-46dc-9fef-a1a3462c20ea None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:53.382563 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:53.384126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dac315-b4f0-4d6a-a304-9c9429be6f84 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:53.425453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf16fb7-11ae-4dde-a300-09ceadafafb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:53.426568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf16fb7-11ae-4dde-a300-09ceadafafb2 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:53.427085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf16fb7-11ae-4dde-a300-09ceadafafb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:53.427563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf16fb7-11ae-4dde-a300-09ceadafafb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:53.428516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf16fb7-11ae-4dde-a300-09ceadafafb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:53.429026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf16fb7-11ae-4dde-a300-09ceadafafb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:53.430728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf16fb7-11ae-4dde-a300-09ceadafafb2 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:53.444161 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 355/701] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:53.445317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf16fb7-11ae-4dde-a300-09ceadafafb2 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:53.452568 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 347/702] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:53.458087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6222c0-cb19-46dc-9fef-a1a3462c20ea None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:53.490723 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:53.567306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6222c0-cb19-46dc-9fef-a1a3462c20ea None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:53.568954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf16fb7-11ae-4dde-a300-09ceadafafb2 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:53.605906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8090d-fbc0-4d83-bd5a-c5444bc9280a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:53.606129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc15b9-2bf0-48fb-9ef9-a2cf62bc19db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:53.606622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc15b9-2bf0-48fb-9ef9-a2cf62bc19db None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:53.606750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8090d-fbc0-4d83-bd5a-c5444bc9280a None admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:53.606935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc15b9-2bf0-48fb-9ef9-a2cf62bc19db None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:53.607033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8090d-fbc0-4d83-bd5a-c5444bc9280a None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:53.607203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc15b9-2bf0-48fb-9ef9-a2cf62bc19db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:53.607295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8090d-fbc0-4d83-bd5a-c5444bc9280a None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:53.607945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8090d-fbc0-4d83-bd5a-c5444bc9280a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:53.608040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc15b9-2bf0-48fb-9ef9-a2cf62bc19db None admin] RBAC: Adding query filter params (role.id=56d47830104f4dc09f1076c75acf3ffd, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=0789b4be9dae4c05bb3ec4a5e0f1f308) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:53.608319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc15b9-2bf0-48fb-9ef9-a2cf62bc19db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:53.609358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b8090d-fbc0-4d83-bd5a-c5444bc9280a None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:53.609742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc15b9-2bf0-48fb-9ef9-a2cf62bc19db None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:53.626487 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 356/703] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:51:53 2022] GET /identity/v3/role_assignments?user.id=0789b4be9dae4c05bb3ec4a5e0f1f308&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=56d47830104f4dc09f1076c75acf3ffd => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:53.626487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc15b9-2bf0-48fb-9ef9-a2cf62bc19db None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:53.631092 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:53.708563 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 348/704] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 19 13:51:53 2022] POST /identity/v3/users => generated 254 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:51:53.710963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54529b6c-8aa0-49db-86c3-c2bd554802cf None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:53.712021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54529b6c-8aa0-49db-86c3-c2bd554802cf None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:53.713419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54529b6c-8aa0-49db-86c3-c2bd554802cf None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:53.718389 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 349/705] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:53.736103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980431d-50a5-4cb1-9684-843f9e15857f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:53.741157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980431d-50a5-4cb1-9684-843f9e15857f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:53.741157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980431d-50a5-4cb1-9684-843f9e15857f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:53.764761 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:53.768660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc15b9-2bf0-48fb-9ef9-a2cf62bc19db None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:53.769547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d980431d-50a5-4cb1-9684-843f9e15857f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:53.770801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d980431d-50a5-4cb1-9684-843f9e15857f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:53.810531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c28121-1dae-4e40-9c64-62a4661e27b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:53.811758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c28121-1dae-4e40-9c64-62a4661e27b3 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:53.812329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c28121-1dae-4e40-9c64-62a4661e27b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:53.812818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c28121-1dae-4e40-9c64-62a4661e27b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:53.825520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c28121-1dae-4e40-9c64-62a4661e27b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:53.827470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c28121-1dae-4e40-9c64-62a4661e27b3 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:53.849195 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-55c28121-1dae-4e40-9c64-62a4661e27b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:53.849195 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:53.849195 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:53.849195 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:53.849195 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:53.849195 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:53.849195 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:53.849195 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:53.849195 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:53.849195 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:53.849195 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:53.849195 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:53.849195 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:53.849195 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:53.849195 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:53.850276 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:53.850276 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:53.850276 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:53.850276 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:53.850276 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:53.850276 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:53.850276 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:53.850276 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:53.850276 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:53.850276 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:53.850276 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:53.850276 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:53.850276 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:53.850276 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:53.850276 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:53.850276 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:53.850276 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:53.851407 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:53.851407 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:53.851407 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:53.851407 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:53.853541 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 357/706] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:53.859355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c28121-1dae-4e40-9c64-62a4661e27b3 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:53.864945 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 350/707] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:53.890121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980431d-50a5-4cb1-9684-843f9e15857f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:54.023716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d980431d-50a5-4cb1-9684-843f9e15857f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:54.062828 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:54.077280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e02583-6c70-4eb6-8ee1-7d2ef9d1e6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:54.081412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e02583-6c70-4eb6-8ee1-7d2ef9d1e6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:54.081412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e02583-6c70-4eb6-8ee1-7d2ef9d1e6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:54.081412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e02583-6c70-4eb6-8ee1-7d2ef9d1e6f4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:54.081412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e02583-6c70-4eb6-8ee1-7d2ef9d1e6f4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:54.081412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e02583-6c70-4eb6-8ee1-7d2ef9d1e6f4 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:54.097096 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-a0e02583-6c70-4eb6-8ee1-7d2ef9d1e6f4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 13:51:54.097096 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:54.097096 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:51:54.097096 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:51:54.097096 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:51:54.097096 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:51:54.097096 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:51:54.097096 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:51:54.097096 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 13:51:54.097096 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:54.097096 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:51:54.097096 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:54.097096 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:54.097096 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:54.097096 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:54.097096 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:54.098376 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:54.098376 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:54.098376 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:54.098376 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:54.098376 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:54.098376 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:54.098376 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:54.098376 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:51:54.098376 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:51:54.098376 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:51:54.098376 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:51:54.098376 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:54.098376 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:54.098376 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:54.098376 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:54.098376 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:54.099251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:54.099251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:54.099251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:54.099251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:54.099251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:54.099251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:54.099251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:54.099251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:54.099251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:54.099251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:54.099251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:54.099251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:51:54.099251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:51:54.099251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 13:51:54.099251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:54.102634 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 351/708] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Jul 19 13:51:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:51:54.109039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e02583-6c70-4eb6-8ee1-7d2ef9d1e6f4 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:54.118449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c28121-1dae-4e40-9c64-62a4661e27b3 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:54.158810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2d043-effe-488c-b433-4c98defd712f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:54.159882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2d043-effe-488c-b433-4c98defd712f None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:54.160486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2d043-effe-488c-b433-4c98defd712f None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:54.160990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b2d043-effe-488c-b433-4c98defd712f None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:54.162218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2d043-effe-488c-b433-4c98defd712f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:54.162734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2d043-effe-488c-b433-4c98defd712f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:54.164601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b2d043-effe-488c-b433-4c98defd712f None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:54.177919 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 358/709] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:54.187313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2d043-effe-488c-b433-4c98defd712f None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:54.216216 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:54.221734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e02583-6c70-4eb6-8ee1-7d2ef9d1e6f4 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:54.256568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f251e5-3bad-4bc1-becc-83d766c222ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:54.257272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f251e5-3bad-4bc1-becc-83d766c222ab None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:54.257558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f251e5-3bad-4bc1-becc-83d766c222ab None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:54.257835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f251e5-3bad-4bc1-becc-83d766c222ab None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:54.259710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f251e5-3bad-4bc1-becc-83d766c222ab None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:54.260039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f251e5-3bad-4bc1-becc-83d766c222ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:54.261548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f251e5-3bad-4bc1-becc-83d766c222ab None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:54.274520 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 352/710] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Jul 19 13:51:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:54.274520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f251e5-3bad-4bc1-becc-83d766c222ab None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:54.332117 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:54.378773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f251e5-3bad-4bc1-becc-83d766c222ab None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:54.398302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b2d043-effe-488c-b433-4c98defd712f None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:54.418520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316c007-a63d-419b-b081-fdb492f676e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:54.418520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316c007-a63d-419b-b081-fdb492f676e4 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:54.418520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316c007-a63d-419b-b081-fdb492f676e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:54.418520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316c007-a63d-419b-b081-fdb492f676e4 None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:54.418996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316c007-a63d-419b-b081-fdb492f676e4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:54.418996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316c007-a63d-419b-b081-fdb492f676e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:54.419475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316c007-a63d-419b-b081-fdb492f676e4 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:54.425945 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 353/711] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Jul 19 13:51:54 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:51:54.450817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee91bd-2481-4edb-a0a9-15d11632abb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:54.451893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee91bd-2481-4edb-a0a9-15d11632abb1 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:54.452336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee91bd-2481-4edb-a0a9-15d11632abb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:54.452786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee91bd-2481-4edb-a0a9-15d11632abb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:54.461079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee91bd-2481-4edb-a0a9-15d11632abb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:54.464938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee91bd-2481-4edb-a0a9-15d11632abb1 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:54.479521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-22ee91bd-2481-4edb-a0a9-15d11632abb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:54.479521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:54.479521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:54.479521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:54.479521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:54.479521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:54.479521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:54.479521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:54.479521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:54.479521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:54.479521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:54.479521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:54.479521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:51:54.479521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:51:54.479521 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:51:54.480590 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:51:54.480590 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:54.480590 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:54.480590 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:54.480590 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:54.480590 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:54.480590 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:54.480590 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:54.480590 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:54.480590 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:54.480590 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:54.480590 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:54.480590 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:54.480590 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:54.480590 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:54.480590 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:54.480590 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:54.481592 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:51:54.481592 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:51:54.481592 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:51:54.481592 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:51:54.481592 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:51:54.481592 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:51:54.481592 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:54.481592 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:54.483863 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 359/712] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:54.489847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316c007-a63d-419b-b081-fdb492f676e4 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:54.622894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316c007-a63d-419b-b081-fdb492f676e4 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:54.641276 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:54.659254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478de60d-3794-42ee-b795-91ea64be39fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:54.659937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478de60d-3794-42ee-b795-91ea64be39fe None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:54.660219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478de60d-3794-42ee-b795-91ea64be39fe None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:54.660494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478de60d-3794-42ee-b795-91ea64be39fe None admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:54.661287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478de60d-3794-42ee-b795-91ea64be39fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:54.661594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478de60d-3794-42ee-b795-91ea64be39fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:54.663062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478de60d-3794-42ee-b795-91ea64be39fe None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:54.672459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83b146-b0da-4649-b187-3f72736ad246 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:54.672747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83b146-b0da-4649-b187-3f72736ad246 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:54.673010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83b146-b0da-4649-b187-3f72736ad246 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:54.674445 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 360/713] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:54.677291 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 354/714] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:51:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:54.683491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83b146-b0da-4649-b187-3f72736ad246 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:54.685729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf370990-a841-489b-ab48-dbe47fdb24d2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:54.686019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf370990-a841-489b-ab48-dbe47fdb24d2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:54.686333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf370990-a841-489b-ab48-dbe47fdb24d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:54.704378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-cf370990-a841-489b-ab48-dbe47fdb24d2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:54.705564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cf370990-a841-489b-ab48-dbe47fdb24d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:54.792776 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 355/715] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:54.822059 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:54.835526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf370990-a841-489b-ab48-dbe47fdb24d2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:54.858781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83b146-b0da-4649-b187-3f72736ad246 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:54.891517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5dfe5-578e-4f32-9464-9a4d7f15240e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:54.892097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5dfe5-578e-4f32-9464-9a4d7f15240e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:54.892379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5dfe5-578e-4f32-9464-9a4d7f15240e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:54.892655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea5dfe5-578e-4f32-9464-9a4d7f15240e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:54.893494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5dfe5-578e-4f32-9464-9a4d7f15240e None admin] RBAC: Adding query filter params (role.id=bc315edf089d43b18acf9790031f3fcb, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=dfe9762955004354ab4f1fe02f05a427) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:54.893805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5dfe5-578e-4f32-9464-9a4d7f15240e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:54.895268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea5dfe5-578e-4f32-9464-9a4d7f15240e None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:54.901631 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 361/716] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:51:54 2022] GET /identity/v3/role_assignments?user.id=dfe9762955004354ab4f1fe02f05a427&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=bc315edf089d43b18acf9790031f3fcb => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:54.967400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf370990-a841-489b-ab48-dbe47fdb24d2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:54.979744 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:55.013765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab96116-6cf5-4216-a319-118a422dbefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:55.015071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab96116-6cf5-4216-a319-118a422dbefe None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:55.015574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab96116-6cf5-4216-a319-118a422dbefe None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:55.016059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab96116-6cf5-4216-a319-118a422dbefe None admin] PATH_INFO: `/v3/services/network` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:55.016979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab96116-6cf5-4216-a319-118a422dbefe None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:55.019811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab96116-6cf5-4216-a319-118a422dbefe None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:55.038755 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-dab96116-6cf5-4216-a319-118a422dbefe None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 13:51:55.038755 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:55.038755 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:51:55.038755 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:51:55.038755 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:51:55.038755 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:51:55.038755 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:51:55.038755 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:51:55.038755 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 13:51:55.038755 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:55.038755 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:51:55.038755 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:55.038755 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:55.038755 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:55.038755 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:55.038755 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:55.038755 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:55.041112 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:55.041112 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:55.041112 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:55.041112 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:55.041112 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:55.041112 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:55.041112 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:51:55.041112 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:51:55.041112 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:51:55.041112 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:51:55.041112 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:55.041112 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:55.041112 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:55.041112 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:55.041112 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:55.041112 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:55.041965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:55.041965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:55.041965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:55.041965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:55.041965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:55.041965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:55.041965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:55.041965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:55.041965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:55.041965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:55.041965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:51:55.041965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:51:55.041965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 13:51:55.041965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:55.050188 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 356/717] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:54 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:55.057925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5dfe5-578e-4f32-9464-9a4d7f15240e None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:55.202623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea5dfe5-578e-4f32-9464-9a4d7f15240e None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:55.269531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cab5a8-6032-4930-a506-0d505494acce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:55.270228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cab5a8-6032-4930-a506-0d505494acce None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:55.270512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cab5a8-6032-4930-a506-0d505494acce None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:55.270785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cab5a8-6032-4930-a506-0d505494acce None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:55.271497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cab5a8-6032-4930-a506-0d505494acce None admin] RBAC: Adding query filter params (name=network) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:55.271799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cab5a8-6032-4930-a506-0d505494acce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:55.273166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cab5a8-6032-4930-a506-0d505494acce None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:55.277116 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:55.284242 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 362/718] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 19 13:51:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:55.290333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab96116-6cf5-4216-a319-118a422dbefe None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:55.407563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab96116-6cf5-4216-a319-118a422dbefe None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:55.449664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4e646-2d62-4224-8992-d17456d5a771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:55.450848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4e646-2d62-4224-8992-d17456d5a771 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:55.451343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4e646-2d62-4224-8992-d17456d5a771 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:55.451825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4e646-2d62-4224-8992-d17456d5a771 None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:55.452832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4e646-2d62-4224-8992-d17456d5a771 None admin] RBAC: Adding query filter params (type=network) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:55.453346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4e646-2d62-4224-8992-d17456d5a771 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:55.454952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c4e646-2d62-4224-8992-d17456d5a771 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:55.460184 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 357/719] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 19 13:51:55 2022] GET /identity/v3/services?type=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:56.463175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0060eba-ce58-40ee-a3c8-54458ef6ab2e None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:56.463862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0060eba-ce58-40ee-a3c8-54458ef6ab2e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:56.463862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0060eba-ce58-40ee-a3c8-54458ef6ab2e None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:56.465315 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 363/720] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:56.470605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acdfca-8736-4567-9c0f-bb8156f026c5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:56.471188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acdfca-8736-4567-9c0f-bb8156f026c5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:56.471188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82acdfca-8736-4567-9c0f-bb8156f026c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:56.491075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-82acdfca-8736-4567-9c0f-bb8156f026c5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:56.492248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-82acdfca-8736-4567-9c0f-bb8156f026c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:56.538713 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:56.604715 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 358/721] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:56.628642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0060eba-ce58-40ee-a3c8-54458ef6ab2e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:56.734595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0060eba-ce58-40ee-a3c8-54458ef6ab2e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:56.754029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2698aef-d18e-465f-832a-cad6fec9442d None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:56.754428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2698aef-d18e-465f-832a-cad6fec9442d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:56.754623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2698aef-d18e-465f-832a-cad6fec9442d None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:56.756109 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 359/722] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:51:56.761340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bede532-971e-4355-b088-7dafcbe32939 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:56.761623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bede532-971e-4355-b088-7dafcbe32939 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:56.761956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bede532-971e-4355-b088-7dafcbe32939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:56.780434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ac5b0-5825-4d3c-bd97-0eb53d19ed87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:56.781571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ac5b0-5825-4d3c-bd97-0eb53d19ed87 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:56.782076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ac5b0-5825-4d3c-bd97-0eb53d19ed87 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:56.782567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ac5b0-5825-4d3c-bd97-0eb53d19ed87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:56.788243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6bede532-971e-4355-b088-7dafcbe32939 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:56.790945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6bede532-971e-4355-b088-7dafcbe32939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:56.806629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2ac5b0-5825-4d3c-bd97-0eb53d19ed87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:56.814697 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-df2ac5b0-5825-4d3c-bd97-0eb53d19ed87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:51:56.814697 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:56.814697 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:56.814697 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:56.814697 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:56.814697 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:56.814697 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:56.814697 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:56.814697 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:56.814697 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:56.814697 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:56.814697 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:56.814697 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:56.814697 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:56.814697 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:56.814697 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:56.815595 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:56.815595 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:56.815595 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:56.815595 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:56.815595 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:56.815595 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:56.815595 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:56.815595 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:56.815595 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:56.815595 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:56.815595 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:56.815595 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:56.815595 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:56.815595 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:56.815595 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:56.815595 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:56.816426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:56.816426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:56.816426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:56.816426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:56.816426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:56.816426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:56.816426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:56.816426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:56.816426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:56.816426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:56.816426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:51:56.816426 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:56.823556 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 364/723] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:51:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:56.831425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ac5b0-5825-4d3c-bd97-0eb53d19ed87 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:56.919507 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:56.946545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ac5b0-5825-4d3c-bd97-0eb53d19ed87 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:56.964800 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 360/724] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 13:51:56.983003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18da147-ef76-4b1b-9c34-5f01f0470774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:56.983982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18da147-ef76-4b1b-9c34-5f01f0470774 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:56.984481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18da147-ef76-4b1b-9c34-5f01f0470774 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:56.985016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18da147-ef76-4b1b-9c34-5f01f0470774 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:56.985958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18da147-ef76-4b1b-9c34-5f01f0470774 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:56.986640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18da147-ef76-4b1b-9c34-5f01f0470774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:56.988255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18da147-ef76-4b1b-9c34-5f01f0470774 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:56.998516 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 365/725] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:57.004316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bede532-971e-4355-b088-7dafcbe32939 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:57.005383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18da147-ef76-4b1b-9c34-5f01f0470774 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:57.177647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18da147-ef76-4b1b-9c34-5f01f0470774 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:57.190494 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:57.199681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bede532-971e-4355-b088-7dafcbe32939 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:57.204611 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:57.223939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf4834-a261-4734-b79b-aac4302d89e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:57.225074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf4834-a261-4734-b79b-aac4302d89e4 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:57.233542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf4834-a261-4734-b79b-aac4302d89e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:57.233542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf4834-a261-4734-b79b-aac4302d89e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:57.253004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf4834-a261-4734-b79b-aac4302d89e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:57.261471 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-15bf4834-a261-4734-b79b-aac4302d89e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:57.261471 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:57.261471 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:57.261471 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:57.261471 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:57.261471 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:57.261471 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:57.261471 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:57.261471 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:57.261471 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:57.261471 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:57.261471 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:57.261471 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:57.261471 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:57.261471 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:57.261471 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:57.262902 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:57.262902 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:57.262902 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:57.262902 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:57.262902 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:57.262902 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:57.262902 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:57.262902 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:57.262902 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:57.262902 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:57.262902 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:57.262902 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:57.262902 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:57.262902 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:57.262902 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:57.262902 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:57.264215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:57.264215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:57.264215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:57.264215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:57.264215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:57.264215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:57.264215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:57.264215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:57.264215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:57.264215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:57.264215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:51:57.264215 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:57.274845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261cc13-9f1b-4fa3-ab83-99695db05d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:57.275909 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 366/726] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:51:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:57.276198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261cc13-9f1b-4fa3-ab83-99695db05d52 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:57.276423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261cc13-9f1b-4fa3-ab83-99695db05d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:57.276695 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261cc13-9f1b-4fa3-ab83-99695db05d52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:57.283125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf4834-a261-4734-b79b-aac4302d89e4 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:57.288314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261cc13-9f1b-4fa3-ab83-99695db05d52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:57.290424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b261cc13-9f1b-4fa3-ab83-99695db05d52 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:57.310054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-b261cc13-9f1b-4fa3-ab83-99695db05d52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:57.310054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:57.310054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:57.310054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:57.310054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:57.310054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:57.310054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:57.310054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:57.310054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:57.310054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:57.310054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:57.310054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:57.310054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:57.310054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:57.310054 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:57.311066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:57.311066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:57.311066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:57.311066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:57.311066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:57.311066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:57.311066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:57.311066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:57.311066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:57.311066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:57.311066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:57.311066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:57.311066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:57.311066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:57.311066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:57.311066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:57.311066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:57.312016 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:57.312016 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:57.312016 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:57.312016 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:57.312016 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 361/727] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:51:57.313622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e21394-502a-497e-a2fd-229253998939 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:57.313932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e21394-502a-497e-a2fd-229253998939 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:57.314232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e21394-502a-497e-a2fd-229253998939 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:57.315804 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 362/728] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:57.321644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e21394-502a-497e-a2fd-229253998939 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:57.435813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e21394-502a-497e-a2fd-229253998939 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:57.436474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf4834-a261-4734-b79b-aac4302d89e4 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:57.476855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3e229-36df-4f76-a097-3e990df998e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:57.478719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a12f7c-6fe3-47f5-958a-d59cd56ebb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:57.478719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a12f7c-6fe3-47f5-958a-d59cd56ebb8b None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:57.479151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a12f7c-6fe3-47f5-958a-d59cd56ebb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:57.479151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a12f7c-6fe3-47f5-958a-d59cd56ebb8b None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:57.479886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a12f7c-6fe3-47f5-958a-d59cd56ebb8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:57.480194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a12f7c-6fe3-47f5-958a-d59cd56ebb8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:57.480796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3e229-36df-4f76-a097-3e990df998e3 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:57.481284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3e229-36df-4f76-a097-3e990df998e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:57.481570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a12f7c-6fe3-47f5-958a-d59cd56ebb8b None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:57.481949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d3e229-36df-4f76-a097-3e990df998e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:57.482957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3e229-36df-4f76-a097-3e990df998e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:57.483522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3e229-36df-4f76-a097-3e990df998e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:57.485212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d3e229-36df-4f76-a097-3e990df998e3 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:57.494446 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 363/729] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:57.495739 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 367/730] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 19 13:51:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:57.495867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742e3db-8c3b-485b-9a62-69820e2097ab None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:57.496105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742e3db-8c3b-485b-9a62-69820e2097ab None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:57.496384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742e3db-8c3b-485b-9a62-69820e2097ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:57.499480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3e229-36df-4f76-a097-3e990df998e3 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:57.516551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0742e3db-8c3b-485b-9a62-69820e2097ab None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:57.518176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0742e3db-8c3b-485b-9a62-69820e2097ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:57.519955 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:57.553481 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:57.610196 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 364/731] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:57.610196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742e3db-8c3b-485b-9a62-69820e2097ab None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:57.640870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d3e229-36df-4f76-a097-3e990df998e3 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:57.684067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d584a-0a5c-476d-8902-a8c0b645bb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:57.685147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d584a-0a5c-476d-8902-a8c0b645bb27 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:57.685595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d584a-0a5c-476d-8902-a8c0b645bb27 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:57.686014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d584a-0a5c-476d-8902-a8c0b645bb27 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:57.696487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d584a-0a5c-476d-8902-a8c0b645bb27 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:57.698558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d584a-0a5c-476d-8902-a8c0b645bb27 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:57.713398 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-410d584a-0a5c-476d-8902-a8c0b645bb27 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 13:51:57.713398 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:57.713398 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:57.713398 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:57.713398 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:57.713398 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:57.713398 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:57.713398 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:57.713398 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:57.713398 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:57.713398 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:57.713398 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:57.713398 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:51:57.713398 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:51:57.713398 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:51:57.713398 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:51:57.714534 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:57.714534 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:57.714534 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:51:57.714534 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:57.714534 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:51:57.714534 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:57.714534 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:57.714534 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:57.714534 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:57.714534 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:57.714534 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:57.714534 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:57.714534 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:57.714534 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:57.714534 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:57.714534 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:57.714534 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:57.714534 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:57.723509 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:57.723509 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:57.723509 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:51:57.723509 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:51:57.723509 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:51:57.723509 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:51:57.723509 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:51:57.723509 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:51:57.723509 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 13:51:57.723509 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:57.723509 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 368/732] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:51:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:57.723509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa9b5d-4ca6-4820-9b0c-908e1e224ca2 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:57.723509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa9b5d-4ca6-4820-9b0c-908e1e224ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:57.724385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa9b5d-4ca6-4820-9b0c-908e1e224ca2 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:57.724385 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 369/733] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:57.724385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa9b5d-4ca6-4820-9b0c-908e1e224ca2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:57.724798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742e3db-8c3b-485b-9a62-69820e2097ab None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:57.767551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bd5ea-7a02-4aa7-be91-caadb1ecf3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:57.768267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bd5ea-7a02-4aa7-be91-caadb1ecf3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:57.768554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bd5ea-7a02-4aa7-be91-caadb1ecf3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:57.768833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621bd5ea-7a02-4aa7-be91-caadb1ecf3d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:57.777129 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:57.783049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621bd5ea-7a02-4aa7-be91-caadb1ecf3d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:57.785168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621bd5ea-7a02-4aa7-be91-caadb1ecf3d3 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:57.811987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-621bd5ea-7a02-4aa7-be91-caadb1ecf3d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:57.811987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:57.811987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:57.811987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:57.811987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:57.811987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:57.811987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:57.811987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:57.811987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:57.811987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:57.811987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:57.811987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:57.811987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:57.811987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:57.811987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:57.813168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:57.813168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:57.813168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:57.813168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:57.813168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:57.813168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:57.813168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:57.813168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:57.813168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:57.813168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:57.813168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:57.813168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:57.813168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:57.813168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:57.813168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:57.813168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:57.813168 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:57.814597 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:57.814597 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:57.814597 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:57.814597 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:57.819653 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 365/734] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:57.821319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bd5ea-7a02-4aa7-be91-caadb1ecf3d3 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:57.847208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa9b5d-4ca6-4820-9b0c-908e1e224ca2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:57.850530 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:57.889603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b0ba8e-544f-45e7-bb62-270555c0c8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:57.890366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0ba8e-544f-45e7-bb62-270555c0c8b3 None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:57.890673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0ba8e-544f-45e7-bb62-270555c0c8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:57.890955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b0ba8e-544f-45e7-bb62-270555c0c8b3 None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:57.891687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0ba8e-544f-45e7-bb62-270555c0c8b3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:57.893139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b0ba8e-544f-45e7-bb62-270555c0c8b3 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:57.927740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621bd5ea-7a02-4aa7-be91-caadb1ecf3d3 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:57.962082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d964baf-a8c4-4166-a4c9-70af45b785c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:57.962819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d964baf-a8c4-4166-a4c9-70af45b785c3 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:57.963105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d964baf-a8c4-4166-a4c9-70af45b785c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:57.963384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d964baf-a8c4-4166-a4c9-70af45b785c3 None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:57.964223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d964baf-a8c4-4166-a4c9-70af45b785c3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:57.964534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d964baf-a8c4-4166-a4c9-70af45b785c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:57.965951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d964baf-a8c4-4166-a4c9-70af45b785c3 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:57.974809 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 370/735] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 19 13:51:57 2022] POST /identity/v3/services => generated 251 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:51:57.976160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff78b9b-7b3b-46c4-ac4e-859eedb8f46d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:57.976464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff78b9b-7b3b-46c4-ac4e-859eedb8f46d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:57.976737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff78b9b-7b3b-46c4-ac4e-859eedb8f46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:57.996954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8ff78b9b-7b3b-46c4-ac4e-859eedb8f46d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:58.000359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8ff78b9b-7b3b-46c4-ac4e-859eedb8f46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:58.000867 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 366/736] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Jul 19 13:51:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:58.001857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d964baf-a8c4-4166-a4c9-70af45b785c3 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:58.079120 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:58.110584 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 371/737] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:57 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:58.119783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff78b9b-7b3b-46c4-ac4e-859eedb8f46d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:58.149103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d964baf-a8c4-4166-a4c9-70af45b785c3 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:58.196701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b260c92-5c08-4673-ba3c-56b58ea68db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:58.197638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b260c92-5c08-4673-ba3c-56b58ea68db6 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:58.198039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b260c92-5c08-4673-ba3c-56b58ea68db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:58.198490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b260c92-5c08-4673-ba3c-56b58ea68db6 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:58.199557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b260c92-5c08-4673-ba3c-56b58ea68db6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:58.200003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b260c92-5c08-4673-ba3c-56b58ea68db6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:58.202085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b260c92-5c08-4673-ba3c-56b58ea68db6 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:58.222155 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 367/738] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:58.222155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e203ff-a0af-4dc7-9317-3535720303c4 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:58.222155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e203ff-a0af-4dc7-9317-3535720303c4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:58.222155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e203ff-a0af-4dc7-9317-3535720303c4 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:58.223730 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 368/739] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:51:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:51:58.224722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e203ff-a0af-4dc7-9317-3535720303c4 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:58.240335 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:58.250826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff78b9b-7b3b-46c4-ac4e-859eedb8f46d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:58.286949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7911f-22b4-4a8a-8061-010cfaaa9704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:58.288033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7911f-22b4-4a8a-8061-010cfaaa9704 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:58.288326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7911f-22b4-4a8a-8061-010cfaaa9704 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:58.288606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7911f-22b4-4a8a-8061-010cfaaa9704 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:58.361369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e203ff-a0af-4dc7-9317-3535720303c4 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:58.372021 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:58.381757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7911f-22b4-4a8a-8061-010cfaaa9704 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:58.384034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7911f-22b4-4a8a-8061-010cfaaa9704 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:58.403536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e88b47-1418-44dd-98ef-e6a24be356f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:58.404341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e88b47-1418-44dd-98ef-e6a24be356f1 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:58.404656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e88b47-1418-44dd-98ef-e6a24be356f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:58.404920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e88b47-1418-44dd-98ef-e6a24be356f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:58.416367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e88b47-1418-44dd-98ef-e6a24be356f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:51:58.424014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-90e88b47-1418-44dd-98ef-e6a24be356f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:51:58.424014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:58.424014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:58.424014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:58.424014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:58.424014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:58.424014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:58.424014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:58.424014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:58.424014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:58.424014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:58.424014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:58.424014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:51:58.424014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:51:58.424014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:51:58.424014 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:51:58.424986 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:51:58.424986 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:51:58.424986 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:51:58.424986 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:51:58.424986 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:58.424986 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:58.424986 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:58.424986 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:58.424986 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:58.424986 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:58.424986 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:58.424986 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:58.424986 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:58.424986 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:58.424986 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:58.424986 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:58.425861 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:58.425861 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:58.425861 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:58.425861 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:58.425861 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:51:58.425861 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:51:58.425861 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:51:58.425861 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:51:58.425861 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:51:58.425861 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:51:58.425861 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:51:58.425861 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:58.429922 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 369/740] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:51:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:58.431020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e88b47-1418-44dd-98ef-e6a24be356f1 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:58.493000 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:58.503488 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 372/741] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:58 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 13:51:58.503488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a49d0d-6488-4d57-ae31-ddaf43bc720d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:58.503488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a49d0d-6488-4d57-ae31-ddaf43bc720d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:58.503488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a49d0d-6488-4d57-ae31-ddaf43bc720d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:58.522749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-95a49d0d-6488-4d57-ae31-ddaf43bc720d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:51:58.524490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-95a49d0d-6488-4d57-ae31-ddaf43bc720d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:51:58.552778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e88b47-1418-44dd-98ef-e6a24be356f1 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:58.591923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dcb8fd-41ed-4f43-b1af-55ca343b1335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:58.592781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcb8fd-41ed-4f43-b1af-55ca343b1335 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:58.593035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcb8fd-41ed-4f43-b1af-55ca343b1335 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:58.593316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dcb8fd-41ed-4f43-b1af-55ca343b1335 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:58.602540 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 373/742] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:51:58 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 13:51:58.602540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a49d0d-6488-4d57-ae31-ddaf43bc720d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:58.611611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dcb8fd-41ed-4f43-b1af-55ca343b1335 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:58.613601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dcb8fd-41ed-4f43-b1af-55ca343b1335 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:58.634089 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-43dcb8fd-41ed-4f43-b1af-55ca343b1335 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 13:51:58.634089 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:58.634089 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:58.634089 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:58.634089 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:58.634089 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:58.634089 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:58.634089 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:58.634089 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:58.634089 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:58.634089 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:58.634089 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:58.634089 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:51:58.634089 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:51:58.634089 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:51:58.634089 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:51:58.635255 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:58.635255 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:58.635255 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:51:58.635255 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:58.635255 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:51:58.635255 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:58.635255 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:58.635255 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:58.635255 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:58.635255 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:58.635255 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:58.635255 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:58.635255 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:58.635255 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:58.635255 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:58.635255 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:58.635255 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:58.635255 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:58.636390 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:58.636390 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:58.636390 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:51:58.636390 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:51:58.636390 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:51:58.636390 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:51:58.636390 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:51:58.636390 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:51:58.636390 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 13:51:58.636390 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:58.640118 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 370/743] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jul 19 13:51:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:58.641010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dcb8fd-41ed-4f43-b1af-55ca343b1335 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:58.672313 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:58.721027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a49d0d-6488-4d57-ae31-ddaf43bc720d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:58.742847 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:58.759902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22316414-e51c-4804-86cc-699e468913f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:58.760577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dcb8fd-41ed-4f43-b1af-55ca343b1335 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:58.760689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22316414-e51c-4804-86cc-699e468913f5 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:58.760865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22316414-e51c-4804-86cc-699e468913f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:58.761265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22316414-e51c-4804-86cc-699e468913f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:58.762033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22316414-e51c-4804-86cc-699e468913f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:58.762364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22316414-e51c-4804-86cc-699e468913f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:58.763740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22316414-e51c-4804-86cc-699e468913f5 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:58.777451 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 374/744] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:51:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:58.777451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22316414-e51c-4804-86cc-699e468913f5 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:58.809326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a0fb2-9e5e-4a86-80ad-e97848300b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:58.810445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0fb2-9e5e-4a86-80ad-e97848300b5b None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:58.810875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0fb2-9e5e-4a86-80ad-e97848300b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:58.811314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1a0fb2-9e5e-4a86-80ad-e97848300b5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:58.823972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a0fb2-9e5e-4a86-80ad-e97848300b5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:58.826237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1a0fb2-9e5e-4a86-80ad-e97848300b5b None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:58.848892 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-af1a0fb2-9e5e-4a86-80ad-e97848300b5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:58.848892 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:58.848892 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:58.848892 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:58.848892 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:58.848892 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:58.848892 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:58.848892 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:58.848892 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:58.848892 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:58.848892 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:58.848892 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:58.848892 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:58.848892 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:58.848892 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:58.849856 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:58.849856 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:58.849856 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:58.849856 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:58.849856 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:58.849856 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:58.849856 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:58.849856 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:58.849856 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:58.849856 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:58.849856 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:58.849856 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:58.849856 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:58.849856 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:58.849856 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:58.849856 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:58.849856 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:58.850793 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:58.850793 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:58.850793 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:58.850793 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:58.850793 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 371/745] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:58.851086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a0fb2-9e5e-4a86-80ad-e97848300b5b None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:58.894822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22316414-e51c-4804-86cc-699e468913f5 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:58.936979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e753520-09b9-49d9-89fa-a6028854bf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:58.938134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e753520-09b9-49d9-89fa-a6028854bf1f None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:58.938917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e753520-09b9-49d9-89fa-a6028854bf1f None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:58.939427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e753520-09b9-49d9-89fa-a6028854bf1f None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:58.940178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e753520-09b9-49d9-89fa-a6028854bf1f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:58.942306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e753520-09b9-49d9-89fa-a6028854bf1f None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:58.958887 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:58.979108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1a0fb2-9e5e-4a86-80ad-e97848300b5b None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:59.014086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab68276-656b-446d-8ff9-3870f1780a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:59.014781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab68276-656b-446d-8ff9-3870f1780a53 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:59.015064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab68276-656b-446d-8ff9-3870f1780a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:59.015339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab68276-656b-446d-8ff9-3870f1780a53 None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:59.016178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab68276-656b-446d-8ff9-3870f1780a53 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:59.016477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab68276-656b-446d-8ff9-3870f1780a53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:59.017882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab68276-656b-446d-8ff9-3870f1780a53 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:59.034120 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 375/746] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 19 13:51:58 2022] POST /identity/v3/services => generated 240 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:51:59.034120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e753520-09b9-49d9-89fa-a6028854bf1f None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:59.050901 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 372/747] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Jul 19 13:51:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:59.051769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab68276-656b-446d-8ff9-3870f1780a53 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:59.103063 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:59.184261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab68276-656b-446d-8ff9-3870f1780a53 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:59.199786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e753520-09b9-49d9-89fa-a6028854bf1f None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:59.241987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accab75b-f9fc-41b9-8097-7c4585d50a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:59.243857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accab75b-f9fc-41b9-8097-7c4585d50a69 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:59.243857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accab75b-f9fc-41b9-8097-7c4585d50a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:59.244033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accab75b-f9fc-41b9-8097-7c4585d50a69 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:59.245246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accab75b-f9fc-41b9-8097-7c4585d50a69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:59.245246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accab75b-f9fc-41b9-8097-7c4585d50a69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:59.246716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accab75b-f9fc-41b9-8097-7c4585d50a69 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:59.248056 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b2ff2-4f2b-4c7c-ab9f-7da72ee9c265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:59.249209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b2ff2-4f2b-4c7c-ab9f-7da72ee9c265 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:59.249570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b2ff2-4f2b-4c7c-ab9f-7da72ee9c265 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:59.249919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b2ff2-4f2b-4c7c-ab9f-7da72ee9c265 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:59.255635 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:59.267158 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 373/748] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:59.268187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accab75b-f9fc-41b9-8097-7c4585d50a69 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:59.269468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b2ff2-4f2b-4c7c-ab9f-7da72ee9c265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:59.271194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b2ff2-4f2b-4c7c-ab9f-7da72ee9c265 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:59.291200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-875b2ff2-4f2b-4c7c-ab9f-7da72ee9c265 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:59.291200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:59.291200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:59.291200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:59.291200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:59.291200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:59.291200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:59.291200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:59.291200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:59.291200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:59.291200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:59.291200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:59.291200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:51:59.291200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:51:59.291200 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:51:59.292137 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:51:59.292137 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:59.292137 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:59.292137 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:59.292137 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:59.292137 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:59.292137 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:59.292137 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:59.292137 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:59.292137 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:59.292137 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:59.292137 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:59.292137 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:59.292137 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:59.292137 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:59.292137 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:59.292137 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:59.293020 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:51:59.293020 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:51:59.293020 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:51:59.293020 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:59.295419 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 376/749] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:59.296498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b2ff2-4f2b-4c7c-ab9f-7da72ee9c265 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:59.387125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accab75b-f9fc-41b9-8097-7c4585d50a69 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:59.410440 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:59.424069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b2ff2-4f2b-4c7c-ab9f-7da72ee9c265 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:59.429446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238666cc-91d7-4472-9888-8f2f8d53b314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:59.431076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238666cc-91d7-4472-9888-8f2f8d53b314 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:59.431479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238666cc-91d7-4472-9888-8f2f8d53b314 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:59.431906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238666cc-91d7-4472-9888-8f2f8d53b314 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:59.474702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2609b-e1dc-4434-a25a-7278c69cd363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:59.476010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2609b-e1dc-4434-a25a-7278c69cd363 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:59.476441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2609b-e1dc-4434-a25a-7278c69cd363 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:59.478382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2609b-e1dc-4434-a25a-7278c69cd363 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:59.487709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2609b-e1dc-4434-a25a-7278c69cd363 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:59.489787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2609b-e1dc-4434-a25a-7278c69cd363 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:59.510049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-e1f2609b-e1dc-4434-a25a-7278c69cd363 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:59.510049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:59.510049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:59.510049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:59.510049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:59.510049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:59.510049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:59.510049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:59.510049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:59.510049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:59.510049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:59.510049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:59.510049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:51:59.510049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:51:59.510049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:51:59.511563 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:51:59.511563 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:59.511563 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:59.511563 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:59.511563 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:59.511563 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:59.511563 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:59.511563 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:59.511563 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:59.511563 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:59.511563 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:59.511563 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:59.511563 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:59.511563 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:59.511563 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:59.511563 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:59.511563 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:59.512628 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:51:59.512628 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:51:59.512628 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:51:59.512628 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:51:59.512628 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:51:59.512628 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:51:59.512628 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:51:59.512628 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:51:59.520122 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 377/750] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:51:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:59.520122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2609b-e1dc-4434-a25a-7278c69cd363 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:59.527186 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:59.531625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238666cc-91d7-4472-9888-8f2f8d53b314 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:59.533457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238666cc-91d7-4472-9888-8f2f8d53b314 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:59.630878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2609b-e1dc-4434-a25a-7278c69cd363 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:59.672104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ae5db-f007-406c-93c4-94ac925c2864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:59.672784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ae5db-f007-406c-93c4-94ac925c2864 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:59.673067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ae5db-f007-406c-93c4-94ac925c2864 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:59.673346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11ae5db-f007-406c-93c4-94ac925c2864 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:59.674127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ae5db-f007-406c-93c4-94ac925c2864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:59.674439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ae5db-f007-406c-93c4-94ac925c2864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:59.675838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11ae5db-f007-406c-93c4-94ac925c2864 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:59.691126 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 378/751] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:59.691792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ae5db-f007-406c-93c4-94ac925c2864 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:59.705094 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:59.787071 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 374/752] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:51:59 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 13:51:59.788578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238666cc-91d7-4472-9888-8f2f8d53b314 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:59.810264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11ae5db-f007-406c-93c4-94ac925c2864 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:59.847656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccaabaf-d859-4312-91fc-53ec69ebfab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:59.848325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccaabaf-d859-4312-91fc-53ec69ebfab0 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:59.848611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccaabaf-d859-4312-91fc-53ec69ebfab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:59.848883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccaabaf-d859-4312-91fc-53ec69ebfab0 None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:59.849818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccaabaf-d859-4312-91fc-53ec69ebfab0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:51:59.850210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccaabaf-d859-4312-91fc-53ec69ebfab0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:59.851663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccaabaf-d859-4312-91fc-53ec69ebfab0 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:59.864658 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 379/753] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:51:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:51:59.865508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccaabaf-d859-4312-91fc-53ec69ebfab0 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:51:59.903745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238666cc-91d7-4472-9888-8f2f8d53b314 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:51:59.922461 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:59.956759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52177191-7662-4d80-b88a-54b70fe82719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:51:59.957554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52177191-7662-4d80-b88a-54b70fe82719 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:51:59.957832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52177191-7662-4d80-b88a-54b70fe82719 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:51:59.958119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52177191-7662-4d80-b88a-54b70fe82719 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:51:59.959755 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:51:59.967430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52177191-7662-4d80-b88a-54b70fe82719 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:51:59.969072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52177191-7662-4d80-b88a-54b70fe82719 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:51:59.985460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-52177191-7662-4d80-b88a-54b70fe82719 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 13:51:59.985460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:51:59.985460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:51:59.985460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:51:59.985460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:51:59.985460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:51:59.985460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:51:59.985460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:51:59.985460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:51:59.985460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:51:59.985460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:51:59.985460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:51:59.985460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:51:59.985460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:51:59.985460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:51:59.985460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:51:59.988056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:51:59.988056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:51:59.988056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:51:59.988056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:59.988056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:51:59.988056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:51:59.988056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:51:59.988056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:51:59.988056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:51:59.988056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:51:59.988056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:51:59.988056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:51:59.988056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:51:59.988056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:51:59.988056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:51:59.988056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:51:59.988056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:51:59.988056 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:51:59.989224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:51:59.989224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:51:59.989224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:51:59.989224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:51:59.989224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:51:59.989224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:51:59.989224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:51:59.989224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:51:59.989224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 13:51:59.989224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:51:59.994528 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 375/754] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jul 19 13:51:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:51:59.995648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52177191-7662-4d80-b88a-54b70fe82719 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:00.009552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccaabaf-d859-4312-91fc-53ec69ebfab0 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:00.062438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccd618-6bb8-4449-93ed-ba9549d3a3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:00.063879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccd618-6bb8-4449-93ed-ba9549d3a3df None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:00.064581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccd618-6bb8-4449-93ed-ba9549d3a3df None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:00.064980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccd618-6bb8-4449-93ed-ba9549d3a3df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:00.080685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccd618-6bb8-4449-93ed-ba9549d3a3df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:00.083028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccd618-6bb8-4449-93ed-ba9549d3a3df None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:00.106078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52177191-7662-4d80-b88a-54b70fe82719 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:00.113947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-16ccd618-6bb8-4449-93ed-ba9549d3a3df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:00.113947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:00.113947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:00.113947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:00.113947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:00.113947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:00.113947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:00.113947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:00.113947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:00.113947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:00.113947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:00.113947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:00.113947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:00.113947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:00.113947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:00.115084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:00.115084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:00.115084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:00.115084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:00.115084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:00.115084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:00.115084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:00.115084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:00.115084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:00.115084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:00.115084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:00.115084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:00.115084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:00.115084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:00.115084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:00.115084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:00.115084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:00.116171 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:00.116171 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:00.116171 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:00.116171 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:00.120704 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 380/755] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:51:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:00.122010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccd618-6bb8-4449-93ed-ba9549d3a3df None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:00.145236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30736d-1345-424f-b03d-3adef85f9620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:00.145900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30736d-1345-424f-b03d-3adef85f9620 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:00.146224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30736d-1345-424f-b03d-3adef85f9620 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:00.146550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30736d-1345-424f-b03d-3adef85f9620 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:00.147381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30736d-1345-424f-b03d-3adef85f9620 None admin] RBAC: Adding query filter params (role.id=bc315edf089d43b18acf9790031f3fcb, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=0789b4be9dae4c05bb3ec4a5e0f1f308) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:00.147684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30736d-1345-424f-b03d-3adef85f9620 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:00.149942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30736d-1345-424f-b03d-3adef85f9620 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:00.158241 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 376/756] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:51:59 2022] GET /identity/v3/role_assignments?user.id=0789b4be9dae4c05bb3ec4a5e0f1f308&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=bc315edf089d43b18acf9790031f3fcb => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:00.158241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30736d-1345-424f-b03d-3adef85f9620 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:00.193287 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:00.296050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccd618-6bb8-4449-93ed-ba9549d3a3df None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:00.298769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30736d-1345-424f-b03d-3adef85f9620 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:00.330245 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:00.341664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b788f-65c4-4ede-89f2-14a93513dc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:00.342536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b788f-65c4-4ede-89f2-14a93513dc97 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:00.342939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b788f-65c4-4ede-89f2-14a93513dc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:00.343298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b788f-65c4-4ede-89f2-14a93513dc97 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:00.343886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f8792-d9dc-4354-bcf3-d3adfc2ad461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:00.344085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b788f-65c4-4ede-89f2-14a93513dc97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:00.344539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b788f-65c4-4ede-89f2-14a93513dc97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:00.344659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f8792-d9dc-4354-bcf3-d3adfc2ad461 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:00.344830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f8792-d9dc-4354-bcf3-d3adfc2ad461 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:00.345103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f8792-d9dc-4354-bcf3-d3adfc2ad461 None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:00.345920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b788f-65c4-4ede-89f2-14a93513dc97 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:00.346038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f8792-d9dc-4354-bcf3-d3adfc2ad461 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:00.346274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f8792-d9dc-4354-bcf3-d3adfc2ad461 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:00.347760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6f8792-d9dc-4354-bcf3-d3adfc2ad461 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:00.364209 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 377/757] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:00.365982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545968b2-27ec-4feb-a7ae-a2f62b7482ca None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:00.366339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545968b2-27ec-4feb-a7ae-a2f62b7482ca None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:00.366619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545968b2-27ec-4feb-a7ae-a2f62b7482ca None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:00.368080 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 378/758] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:00.370628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545968b2-27ec-4feb-a7ae-a2f62b7482ca None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:00.373838 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 381/759] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jul 19 13:52:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:00.378973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f8792-d9dc-4354-bcf3-d3adfc2ad461 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:00.481426 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:00.488477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6f8792-d9dc-4354-bcf3-d3adfc2ad461 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:00.508574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545968b2-27ec-4feb-a7ae-a2f62b7482ca None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:00.528866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb754d0-f837-4938-a38b-c4b62ca7aa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:00.531244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb754d0-f837-4938-a38b-c4b62ca7aa55 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:00.531735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb754d0-f837-4938-a38b-c4b62ca7aa55 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:00.532255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb754d0-f837-4938-a38b-c4b62ca7aa55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:00.547190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb754d0-f837-4938-a38b-c4b62ca7aa55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:00.549515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb754d0-f837-4938-a38b-c4b62ca7aa55 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:00.554703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a429ff-4d50-46f8-b008-adaacc2a9826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:00.555653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a429ff-4d50-46f8-b008-adaacc2a9826 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:00.556034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a429ff-4d50-46f8-b008-adaacc2a9826 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:00.556411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a429ff-4d50-46f8-b008-adaacc2a9826 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:00.565172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a429ff-4d50-46f8-b008-adaacc2a9826 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:00.566776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a429ff-4d50-46f8-b008-adaacc2a9826 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:00.571189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-aeb754d0-f837-4938-a38b-c4b62ca7aa55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:00.571189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:00.571189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:00.571189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:00.571189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:00.571189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:00.571189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:00.571189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:00.571189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:00.571189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:00.571189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:00.571189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:00.571189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:00.571189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:00.571189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:00.572198 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:00.572198 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:00.572198 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:00.572198 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:00.572198 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:00.572198 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:00.572198 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:00.572198 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:00.572198 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:00.572198 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:00.572198 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:00.572198 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:00.572198 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:00.572198 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:00.572198 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:00.572198 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:00.572198 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:00.573102 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:00.573102 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:00.573102 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:00.573102 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:00.575239 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 382/760] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:00.576689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1129be-c714-4bce-82a5-600788afe0cf None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:00.577122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1129be-c714-4bce-82a5-600788afe0cf None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:00.577561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1129be-c714-4bce-82a5-600788afe0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:00.583250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-f6a429ff-4d50-46f8-b008-adaacc2a9826 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:00.583250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:00.583250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:00.583250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:00.583250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:00.583250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:00.583250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:00.583250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:00.583250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:00.583250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:00.583250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:00.583250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:00.583250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:52:00.583250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:52:00.583250 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:52:00.584329 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:52:00.584329 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:00.584329 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:00.584329 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:00.584329 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:00.584329 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:00.584329 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:00.584329 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:00.584329 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:00.584329 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:00.584329 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:00.584329 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:00.584329 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:00.584329 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:00.584329 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:00.584329 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:00.584329 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:00.585478 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:52:00.585478 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:52:00.585478 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:52:00.585478 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:52:00.585478 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:52:00.585478 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:52:00.585478 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:00.585478 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:00.588625 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 379/761] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:52:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:00.589585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a429ff-4d50-46f8-b008-adaacc2a9826 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:00.600368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8f1129be-c714-4bce-82a5-600788afe0cf None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:00.601754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8f1129be-c714-4bce-82a5-600788afe0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:00.636946 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:00.698120 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 383/762] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:00.698120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1129be-c714-4bce-82a5-600788afe0cf None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:00.735517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a429ff-4d50-46f8-b008-adaacc2a9826 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:00.785870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622f02c-3dcd-4c50-bf47-1163958c6c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:00.786861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622f02c-3dcd-4c50-bf47-1163958c6c2f None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:00.787356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622f02c-3dcd-4c50-bf47-1163958c6c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:00.788212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622f02c-3dcd-4c50-bf47-1163958c6c2f None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:00.789101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622f02c-3dcd-4c50-bf47-1163958c6c2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:00.790184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622f02c-3dcd-4c50-bf47-1163958c6c2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:00.792151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622f02c-3dcd-4c50-bf47-1163958c6c2f None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:00.810138 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 380/763] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:00.811658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622f02c-3dcd-4c50-bf47-1163958c6c2f None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:00.815873 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:00.818416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1129be-c714-4bce-82a5-600788afe0cf None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:00.858087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1994b8-746d-4384-93df-f175b15617e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:00.859304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1994b8-746d-4384-93df-f175b15617e4 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:00.859304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1994b8-746d-4384-93df-f175b15617e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:00.859704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1994b8-746d-4384-93df-f175b15617e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:00.860654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1994b8-746d-4384-93df-f175b15617e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:00.861061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1994b8-746d-4384-93df-f175b15617e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:00.862714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1994b8-746d-4384-93df-f175b15617e4 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:00.876335 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 384/764] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:52:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:00.877496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1994b8-746d-4384-93df-f175b15617e4 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:00.905167 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:00.944189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622f02c-3dcd-4c50-bf47-1163958c6c2f None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:00.991674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4862e7-6226-4d0c-9ce3-20a5ef316872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:00.993774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4862e7-6226-4d0c-9ce3-20a5ef316872 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:00.994247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4862e7-6226-4d0c-9ce3-20a5ef316872 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:00.994676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4862e7-6226-4d0c-9ce3-20a5ef316872 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:00.995505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4862e7-6226-4d0c-9ce3-20a5ef316872 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:00.995782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1994b8-746d-4384-93df-f175b15617e4 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:00.997204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4862e7-6226-4d0c-9ce3-20a5ef316872 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:01.014516 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-6c4862e7-6226-4d0c-9ce3-20a5ef316872 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 13:52:01.014516 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:01.014516 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:52:01.014516 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:52:01.014516 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:52:01.014516 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:52:01.014516 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:52:01.014516 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:01.014516 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 13:52:01.014516 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:01.014516 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:01.014516 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:01.014516 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:01.014516 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:01.014516 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:01.014516 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:01.015670 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:01.015670 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:01.015670 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:01.015670 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:01.015670 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:01.015670 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:01.015670 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:01.015670 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:52:01.015670 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:52:01.015670 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:52:01.015670 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:52:01.015670 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:01.015670 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:01.015670 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:01.015670 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:01.015670 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:01.016704 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:01.016704 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:01.016704 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:01.016704 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:01.016704 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:01.016704 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:01.016704 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:01.016704 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:01.016704 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:01.016704 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:01.016704 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:01.016704 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:52:01.016704 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:01.016704 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 13:52:01.016704 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:01.025420 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 381/765] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Jul 19 13:52:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:01.025420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4862e7-6226-4d0c-9ce3-20a5ef316872 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:01.047583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332a8d1-7eed-4aa9-8957-c2031ca19297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:01.048514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332a8d1-7eed-4aa9-8957-c2031ca19297 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:01.048898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332a8d1-7eed-4aa9-8957-c2031ca19297 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:01.049281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332a8d1-7eed-4aa9-8957-c2031ca19297 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:01.057143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332a8d1-7eed-4aa9-8957-c2031ca19297 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:01.059043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332a8d1-7eed-4aa9-8957-c2031ca19297 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:01.074217 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-6332a8d1-7eed-4aa9-8957-c2031ca19297 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:01.074217 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:01.074217 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:01.074217 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:01.074217 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:01.074217 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:01.074217 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:01.074217 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:01.074217 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:01.074217 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:01.074217 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:01.074217 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:01.074217 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:52:01.074217 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:52:01.074217 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:52:01.075412 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:52:01.075412 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:01.075412 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:01.075412 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:01.075412 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:01.075412 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:01.075412 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:01.075412 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:01.075412 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:01.075412 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:01.075412 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:01.075412 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:01.075412 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:01.075412 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:01.075412 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:01.075412 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:01.075412 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:01.076524 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:52:01.076524 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:52:01.076524 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:52:01.076524 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:52:01.076524 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:52:01.076524 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:52:01.076524 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:01.076524 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:01.078472 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 385/766] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:52:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:01.079351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332a8d1-7eed-4aa9-8957-c2031ca19297 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:01.106111 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:01.142566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4862e7-6226-4d0c-9ce3-20a5ef316872 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:01.172391 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:01.178742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2af94e-60a1-486c-b1b5-aec428093552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:01.179600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2af94e-60a1-486c-b1b5-aec428093552 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:01.180105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2af94e-60a1-486c-b1b5-aec428093552 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:01.180569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2af94e-60a1-486c-b1b5-aec428093552 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:01.181654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2af94e-60a1-486c-b1b5-aec428093552 None admin] RBAC: Adding query filter params (role.id=56d47830104f4dc09f1076c75acf3ffd, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=ec07a12b28934ef9b04325404fd3c950) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:01.182173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2af94e-60a1-486c-b1b5-aec428093552 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:01.183745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2af94e-60a1-486c-b1b5-aec428093552 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:01.190472 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 382/767] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:52:01 2022] GET /identity/v3/role_assignments?user.id=ec07a12b28934ef9b04325404fd3c950&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=56d47830104f4dc09f1076c75acf3ffd => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:01.191524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2af94e-60a1-486c-b1b5-aec428093552 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:01.194028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332a8d1-7eed-4aa9-8957-c2031ca19297 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:01.265367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43239ff-2b25-4319-957c-fccf8fcbaf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:01.266400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43239ff-2b25-4319-957c-fccf8fcbaf8e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:01.266733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43239ff-2b25-4319-957c-fccf8fcbaf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:01.267125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43239ff-2b25-4319-957c-fccf8fcbaf8e None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:01.269427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43239ff-2b25-4319-957c-fccf8fcbaf8e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:01.269427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43239ff-2b25-4319-957c-fccf8fcbaf8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:01.269427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43239ff-2b25-4319-957c-fccf8fcbaf8e None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:01.283313 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 386/768] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Jul 19 13:52:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:01.290131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043122a8-6dd1-43ec-ba57-f65b182cb389 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:01.290131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043122a8-6dd1-43ec-ba57-f65b182cb389 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:01.290131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043122a8-6dd1-43ec-ba57-f65b182cb389 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:01.290544 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 387/769] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:01.293228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293910d-f610-4085-977d-411021c548c8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:01.293490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293910d-f610-4085-977d-411021c548c8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:01.293773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293910d-f610-4085-977d-411021c548c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:01.313199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2293910d-f610-4085-977d-411021c548c8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:01.314961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2293910d-f610-4085-977d-411021c548c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:01.341414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2af94e-60a1-486c-b1b5-aec428093552 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:01.376654 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:01.384584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486df44-85ca-4839-92e6-55e870505441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:01.385285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486df44-85ca-4839-92e6-55e870505441 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:01.385285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486df44-85ca-4839-92e6-55e870505441 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:01.385615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486df44-85ca-4839-92e6-55e870505441 None admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:01.386598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486df44-85ca-4839-92e6-55e870505441 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:01.386956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486df44-85ca-4839-92e6-55e870505441 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:01.388410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486df44-85ca-4839-92e6-55e870505441 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:01.402611 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 383/770] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:52:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:01.402803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486df44-85ca-4839-92e6-55e870505441 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:01.406030 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 388/771] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:01.411997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293910d-f610-4085-977d-411021c548c8 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:01.499747 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:01.524728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486df44-85ca-4839-92e6-55e870505441 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:01.529757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293910d-f610-4085-977d-411021c548c8 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:01.564051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a8af6-6069-4388-bfdd-23e3c6212713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:01.564961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a8af6-6069-4388-bfdd-23e3c6212713 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:01.565309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a8af6-6069-4388-bfdd-23e3c6212713 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:01.565658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a8af6-6069-4388-bfdd-23e3c6212713 None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:01.567018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a8af6-6069-4388-bfdd-23e3c6212713 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:01.567397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a8af6-6069-4388-bfdd-23e3c6212713 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:01.569038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a8af6-6069-4388-bfdd-23e3c6212713 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:01.573915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a011cf-d4a5-4914-8e0d-75198dfbc160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:01.575108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a011cf-d4a5-4914-8e0d-75198dfbc160 None admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:01.575363 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 384/772] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Jul 19 13:52:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:01.575818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a011cf-d4a5-4914-8e0d-75198dfbc160 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:01.576291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a8af6-6069-4388-bfdd-23e3c6212713 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:01.576536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a011cf-d4a5-4914-8e0d-75198dfbc160 None admin] PATH_INFO: `/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/dfe9762955004354ab4f1fe02f05a427/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:01.578833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a011cf-d4a5-4914-8e0d-75198dfbc160 None admin] RBAC: Authorizing `identity:create_grant(project_id=dfcbe281a77242bbb3774c4aacef50d4, user_id=dfe9762955004354ab4f1fe02f05a427, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:01.580581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a011cf-d4a5-4914-8e0d-75198dfbc160 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:01.646823 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 389/773] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:52:01 2022] PUT /identity/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/dfe9762955004354ab4f1fe02f05a427/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:52:01.646823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a011cf-d4a5-4914-8e0d-75198dfbc160 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:01.647079 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:01.748834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a8af6-6069-4388-bfdd-23e3c6212713 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:01.823963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be29a6a-3a04-4f4c-b393-c228373e4eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:01.824834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be29a6a-3a04-4f4c-b393-c228373e4eab None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:01.825121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be29a6a-3a04-4f4c-b393-c228373e4eab None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:01.825396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be29a6a-3a04-4f4c-b393-c228373e4eab None admin] PATH_INFO: `/v3/services/network` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:01.826067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be29a6a-3a04-4f4c-b393-c228373e4eab None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:01.827471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be29a6a-3a04-4f4c-b393-c228373e4eab None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:01.844635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a011cf-d4a5-4914-8e0d-75198dfbc160 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:01.851489 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-8be29a6a-3a04-4f4c-b393-c228373e4eab None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 13:52:01.851489 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:01.851489 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:52:01.851489 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:52:01.851489 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:52:01.851489 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:52:01.851489 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:52:01.851489 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:01.851489 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 13:52:01.851489 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:01.851489 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:01.851489 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:01.851489 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:01.851489 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:01.851489 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:01.851489 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:01.851489 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:01.852990 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:01.852990 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:01.852990 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:01.852990 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:01.852990 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:01.852990 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:01.852990 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:52:01.852990 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:52:01.852990 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:52:01.852990 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:52:01.852990 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:01.852990 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:01.852990 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:01.852990 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:01.852990 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:01.852990 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:01.853932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:01.853932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:01.853932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:01.853932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:01.853932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:01.853932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:01.853932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:01.853932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:01.853932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:01.853932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:01.853932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:52:01.853932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:01.853932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 13:52:01.853932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:01.856126 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 385/774] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:52:01 2022] GET /identity/v3/services/network => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:01.862636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be29a6a-3a04-4f4c-b393-c228373e4eab None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:01.899788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be1dba-5089-4795-b90e-a335c317d0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:01.900174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be1dba-5089-4795-b90e-a335c317d0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:01.900389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be1dba-5089-4795-b90e-a335c317d0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:01.900671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be1dba-5089-4795-b90e-a335c317d0e8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:01.901645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be1dba-5089-4795-b90e-a335c317d0e8 None admin] RBAC: Adding query filter params (interface=public, service_id=c6671036441747e0a3ac030d512c27b9, region_id=RegionOne) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:01.901972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be1dba-5089-4795-b90e-a335c317d0e8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:01.904031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be1dba-5089-4795-b90e-a335c317d0e8 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:01.911208 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:01.923153 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 390/775] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jul 19 13:52:01 2022] GET /identity/v3/endpoints?service_id=c6671036441747e0a3ac030d512c27b9&interface=public®ion_id=RegionOne => generated 194 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:01.931930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be1dba-5089-4795-b90e-a335c317d0e8 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:01.995969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be29a6a-3a04-4f4c-b393-c228373e4eab None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:02.023367 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:02.056890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583636a-762c-421f-8bab-fea576982a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:02.057563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583636a-762c-421f-8bab-fea576982a33 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:02.057847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583636a-762c-421f-8bab-fea576982a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:02.058141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583636a-762c-421f-8bab-fea576982a33 None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:02.058941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583636a-762c-421f-8bab-fea576982a33 None admin] RBAC: Adding query filter params (name=network) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:02.059247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583636a-762c-421f-8bab-fea576982a33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:02.060613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583636a-762c-421f-8bab-fea576982a33 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:02.068686 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 386/776] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 19 13:52:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:02.076057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583636a-762c-421f-8bab-fea576982a33 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:02.097162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be1dba-5089-4795-b90e-a335c317d0e8 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:02.137651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead0831-bd57-47b6-8b4c-3062337376c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:02.138343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead0831-bd57-47b6-8b4c-3062337376c2 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:02.138659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead0831-bd57-47b6-8b4c-3062337376c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:02.138936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead0831-bd57-47b6-8b4c-3062337376c2 None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:02.139625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead0831-bd57-47b6-8b4c-3062337376c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:02.140986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead0831-bd57-47b6-8b4c-3062337376c2 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:02.158224 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 391/777] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jul 19 13:52:01 2022] GET /identity/v3/services => generated 772 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:02.238270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583636a-762c-421f-8bab-fea576982a33 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:02.276106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b391cf0-adc4-4835-81eb-2ca75c385862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:02.276701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b391cf0-adc4-4835-81eb-2ca75c385862 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:02.276984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b391cf0-adc4-4835-81eb-2ca75c385862 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:02.277263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b391cf0-adc4-4835-81eb-2ca75c385862 None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:02.277981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b391cf0-adc4-4835-81eb-2ca75c385862 None admin] RBAC: Adding query filter params (type=network) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:02.278316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b391cf0-adc4-4835-81eb-2ca75c385862 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:02.279679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b391cf0-adc4-4835-81eb-2ca75c385862 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:02.287068 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 387/778] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 19 13:52:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:02.294529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead0831-bd57-47b6-8b4c-3062337376c2 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:02.372978 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:02.419115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913d0d8-9547-4fbb-a582-3c2ef0696389 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:02.419455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913d0d8-9547-4fbb-a582-3c2ef0696389 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:02.419677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913d0d8-9547-4fbb-a582-3c2ef0696389 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:02.421275 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 388/779] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:52:02.426737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d21d6-0ce0-4f6e-92dc-db70f49d315c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:02.427024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d21d6-0ce0-4f6e-92dc-db70f49d315c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:02.427301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d21d6-0ce0-4f6e-92dc-db70f49d315c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:02.435318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead0831-bd57-47b6-8b4c-3062337376c2 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:02.458013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-fe0d21d6-0ce0-4f6e-92dc-db70f49d315c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:02.459236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fe0d21d6-0ce0-4f6e-92dc-db70f49d315c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:02.480721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3299ec0-7af5-403c-a8c1-379e285c5bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:02.481500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299ec0-7af5-403c-a8c1-379e285c5bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:02.481785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299ec0-7af5-403c-a8c1-379e285c5bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:02.482078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3299ec0-7af5-403c-a8c1-379e285c5bb0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:02.482966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3299ec0-7af5-403c-a8c1-379e285c5bb0 None admin] RBAC: Adding query filter params (interface=public, service_id=91375e11ca474c0e89c80c72e8007531, region_id=RegionOne) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:02.483276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3299ec0-7af5-403c-a8c1-379e285c5bb0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:02.484642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3299ec0-7af5-403c-a8c1-379e285c5bb0 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:02.490499 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 392/780] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jul 19 13:52:02 2022] GET /identity/v3/endpoints?service_id=91375e11ca474c0e89c80c72e8007531&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:02.496289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3299ec0-7af5-403c-a8c1-379e285c5bb0 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:02.537644 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:02.556969 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 389/781] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 13:52:02.581737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d21d6-0ce0-4f6e-92dc-db70f49d315c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:02.700896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3299ec0-7af5-403c-a8c1-379e285c5bb0 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:02.756415 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:02.766980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0d21d6-0ce0-4f6e-92dc-db70f49d315c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:02.772098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b2f37-b4e9-45a7-9613-6adb7a9e3428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:02.773035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b2f37-b4e9-45a7-9613-6adb7a9e3428 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:02.775618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b2f37-b4e9-45a7-9613-6adb7a9e3428 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:02.776123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b2f37-b4e9-45a7-9613-6adb7a9e3428 None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:02.782037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b2f37-b4e9-45a7-9613-6adb7a9e3428 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:02.783677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b2f37-b4e9-45a7-9613-6adb7a9e3428 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:02.794156 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 393/782] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jul 19 13:52:02 2022] GET /identity/v3/services => generated 772 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:02.838967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa242f9-d1ac-45f6-9a78-40c1c6f0e677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:02.840547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa242f9-d1ac-45f6-9a78-40c1c6f0e677 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:02.841106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa242f9-d1ac-45f6-9a78-40c1c6f0e677 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:02.841596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa242f9-d1ac-45f6-9a78-40c1c6f0e677 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:02.868471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa242f9-d1ac-45f6-9a78-40c1c6f0e677 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:52:02.876750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-afa242f9-d1ac-45f6-9a78-40c1c6f0e677 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:52:02.876750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:02.876750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:02.876750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:02.876750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:02.876750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:02.876750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:02.876750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:02.876750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:02.876750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:02.876750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:02.876750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:02.876750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:52:02.876750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:52:02.876750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:52:02.876750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:52:02.877768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:52:02.877768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:52:02.877768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:52:02.877768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:52:02.877768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:02.877768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:02.877768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:02.877768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:02.877768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:02.877768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:02.877768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:02.877768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:02.877768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:02.877768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:02.877768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:02.877768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:02.882877 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:02.882877 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:02.882877 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:02.882877 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:02.882877 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:52:02.882877 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:52:02.882877 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:52:02.882877 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:52:02.882877 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:52:02.882877 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:52:02.882877 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:52:02.882877 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:02.885647 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 390/783] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:52:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:02.891315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b2f37-b4e9-45a7-9613-6adb7a9e3428 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:03.045624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b2f37-b4e9-45a7-9613-6adb7a9e3428 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:03.084573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d9e76-22bb-4976-9f54-e8b65ae38be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:03.085254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d9e76-22bb-4976-9f54-e8b65ae38be7 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:03.085530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d9e76-22bb-4976-9f54-e8b65ae38be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:03.085888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d9e76-22bb-4976-9f54-e8b65ae38be7 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:03.087238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d9e76-22bb-4976-9f54-e8b65ae38be7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:03.087541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d9e76-22bb-4976-9f54-e8b65ae38be7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:03.088964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d9e76-22bb-4976-9f54-e8b65ae38be7 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:03.098280 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 394/784] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:52:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:03.104067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa242f9-d1ac-45f6-9a78-40c1c6f0e677 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:03.163143 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:03.256037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa242f9-d1ac-45f6-9a78-40c1c6f0e677 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:03.304218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa9544-3ae3-4823-bde5-a998d99a230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:03.304988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa9544-3ae3-4823-bde5-a998d99a230c None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:03.305279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa9544-3ae3-4823-bde5-a998d99a230c None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:03.305560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa9544-3ae3-4823-bde5-a998d99a230c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:03.322406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa9544-3ae3-4823-bde5-a998d99a230c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:03.323854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa9544-3ae3-4823-bde5-a998d99a230c None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:03.346530 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-63fa9544-3ae3-4823-bde5-a998d99a230c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:03.346530 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:03.346530 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:03.346530 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:03.346530 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:03.346530 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:03.346530 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:03.346530 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:03.346530 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:03.346530 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:03.346530 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:03.346530 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:03.346530 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:03.346530 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:03.346530 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:03.347488 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:03.347488 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:03.347488 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:03.347488 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:03.347488 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:03.347488 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:03.347488 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:03.347488 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:03.347488 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:03.347488 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:03.347488 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:03.347488 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:03.347488 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:03.347488 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:03.347488 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:03.347488 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:03.347488 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:03.349474 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:03.349474 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:03.349474 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:03.349474 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:03.349474 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 391/785] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:03.355172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d9e76-22bb-4976-9f54-e8b65ae38be7 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:03.424302 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:03.474090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d9e76-22bb-4976-9f54-e8b65ae38be7 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:03.518808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3115e-5f85-4035-8edc-ce68c424873d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:03.519758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3115e-5f85-4035-8edc-ce68c424873d None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:03.520190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3115e-5f85-4035-8edc-ce68c424873d None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:03.520634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3115e-5f85-4035-8edc-ce68c424873d None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:03.521511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3115e-5f85-4035-8edc-ce68c424873d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:03.521974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3115e-5f85-4035-8edc-ce68c424873d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:03.523516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3115e-5f85-4035-8edc-ce68c424873d None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:03.537106 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 395/786] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:03.542876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa9544-3ae3-4823-bde5-a998d99a230c None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:03.661227 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:03.673855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa9544-3ae3-4823-bde5-a998d99a230c None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:03.686586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a2ac9-49af-489c-81ad-e8d433531b3c None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:03.686873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a2ac9-49af-489c-81ad-e8d433531b3c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:03.687321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a2ac9-49af-489c-81ad-e8d433531b3c None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:03.689211 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 396/787] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:03.694650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aba87c-5d37-4fe8-8c27-097b105d8ab5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:03.695006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aba87c-5d37-4fe8-8c27-097b105d8ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:03.695351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aba87c-5d37-4fe8-8c27-097b105d8ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:03.715572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd6604-0ffc-4a6f-acbf-064416fbaacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:03.716705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd6604-0ffc-4a6f-acbf-064416fbaacf None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:03.717166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd6604-0ffc-4a6f-acbf-064416fbaacf None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:03.717621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd6604-0ffc-4a6f-acbf-064416fbaacf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:03.725272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd6604-0ffc-4a6f-acbf-064416fbaacf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:03.727558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd6604-0ffc-4a6f-acbf-064416fbaacf None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:03.739161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a7aba87c-5d37-4fe8-8c27-097b105d8ab5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:03.740372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a7aba87c-5d37-4fe8-8c27-097b105d8ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:03.743932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-70fd6604-0ffc-4a6f-acbf-064416fbaacf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 13:52:03.743932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:03.743932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:03.743932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:03.743932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:03.743932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:03.743932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:03.743932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:03.743932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:03.743932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:03.743932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:03.743932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:03.743932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:52:03.743932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:52:03.743932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:52:03.743932 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:52:03.744883 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:03.744883 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:03.744883 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:52:03.744883 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:03.744883 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:52:03.744883 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:03.744883 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:03.744883 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:03.744883 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:03.744883 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:03.744883 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:03.744883 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:03.744883 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:03.744883 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:03.744883 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:03.744883 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:03.744883 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:03.744883 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:03.745829 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:03.745829 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:03.745829 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:52:03.745829 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:52:03.745829 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:52:03.745829 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:52:03.745829 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:52:03.745829 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:52:03.745829 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 13:52:03.745829 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:03.748642 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 392/788] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:52:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:03.759179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd6604-0ffc-4a6f-acbf-064416fbaacf None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:03.880524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd6604-0ffc-4a6f-acbf-064416fbaacf None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:03.900818 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 397/789] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 13:52:03.929532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda32cca-cdca-49c8-8edf-f9922ab2ebf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:03.930370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda32cca-cdca-49c8-8edf-f9922ab2ebf8 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:03.930744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda32cca-cdca-49c8-8edf-f9922ab2ebf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:03.931157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda32cca-cdca-49c8-8edf-f9922ab2ebf8 None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:03.932016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda32cca-cdca-49c8-8edf-f9922ab2ebf8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:03.932327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda32cca-cdca-49c8-8edf-f9922ab2ebf8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:03.933751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda32cca-cdca-49c8-8edf-f9922ab2ebf8 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:03.959914 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 393/790] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Jul 19 13:52:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:03.967329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aba87c-5d37-4fe8-8c27-097b105d8ab5 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:03.967456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda32cca-cdca-49c8-8edf-f9922ab2ebf8 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:03.982452 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:04.076511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda32cca-cdca-49c8-8edf-f9922ab2ebf8 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:04.114845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488f39e-6009-41b7-b63d-7d71b65e5174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:04.115728 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:04.116518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488f39e-6009-41b7-b63d-7d71b65e5174 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:04.116800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488f39e-6009-41b7-b63d-7d71b65e5174 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:04.117073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488f39e-6009-41b7-b63d-7d71b65e5174 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:04.128507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7488f39e-6009-41b7-b63d-7d71b65e5174 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:52:04.137184 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-7488f39e-6009-41b7-b63d-7d71b65e5174 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:52:04.137184 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:04.137184 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:04.137184 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:04.137184 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:04.137184 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:04.137184 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:04.137184 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:04.137184 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:04.137184 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:04.137184 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:04.137184 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:04.137184 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:52:04.137184 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:52:04.137184 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:52:04.137184 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:52:04.138186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:52:04.138186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:52:04.138186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:52:04.138186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:52:04.138186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:04.138186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:04.138186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:04.138186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:04.138186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:04.138186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:04.138186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:04.138186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:04.138186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:04.138186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:04.138186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:04.138186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:04.139092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:04.139092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:04.139092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:04.139092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:04.139092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:52:04.139092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:52:04.139092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:52:04.139092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:52:04.139092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:52:04.139092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:52:04.139092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:52:04.139092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:04.139092 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 394/791] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:52:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:04.144829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488f39e-6009-41b7-b63d-7d71b65e5174 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:04.218493 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:04.231758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aba87c-5d37-4fe8-8c27-097b105d8ab5 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:04.255009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7488f39e-6009-41b7-b63d-7d71b65e5174 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:04.280115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ae9ab-bc78-4e13-8cc6-ab8d6a26c1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:04.281233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ae9ab-bc78-4e13-8cc6-ab8d6a26c1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:04.281520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ae9ab-bc78-4e13-8cc6-ab8d6a26c1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:04.282050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ae9ab-bc78-4e13-8cc6-ab8d6a26c1b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:04.292057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53bba9-4ad7-4087-bac4-a58ad951cb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:04.292984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53bba9-4ad7-4087-bac4-a58ad951cb52 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:04.293471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53bba9-4ad7-4087-bac4-a58ad951cb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:04.293927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53bba9-4ad7-4087-bac4-a58ad951cb52 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:04.294851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ae9ab-bc78-4e13-8cc6-ab8d6a26c1b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:04.295065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53bba9-4ad7-4087-bac4-a58ad951cb52 None admin] RBAC: Adding query filter params (name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:04.295541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53bba9-4ad7-4087-bac4-a58ad951cb52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:04.296311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ae9ab-bc78-4e13-8cc6-ab8d6a26c1b8 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:04.297480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53bba9-4ad7-4087-bac4-a58ad951cb52 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:04.308709 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 395/792] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 19 13:52:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:04.310357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53b5b7-1bcb-4654-b047-23783aab6406 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:04.310828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53b5b7-1bcb-4654-b047-23783aab6406 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:04.311319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f53b5b7-1bcb-4654-b047-23783aab6406 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:04.313257 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 396/793] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:04.315171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53b5b7-1bcb-4654-b047-23783aab6406 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:04.325579 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-e92ae9ab-bc78-4e13-8cc6-ab8d6a26c1b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:04.325579 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:04.325579 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:04.325579 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:04.325579 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:04.325579 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:04.325579 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:04.325579 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:04.325579 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:04.325579 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:04.325579 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:04.325579 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:04.325579 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:04.325579 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:04.325579 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:04.326541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:04.326541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:04.326541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:04.326541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:04.326541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:04.326541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:04.326541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:04.326541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:04.326541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:04.326541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:04.326541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:04.326541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:04.326541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:04.326541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:04.326541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:04.326541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:04.326541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:04.327842 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:04.327842 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:04.327842 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:04.327842 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:04.330262 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 398/794] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:04.331824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632cea6-0859-4012-b72e-0d26d69dccf9 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:04.333899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632cea6-0859-4012-b72e-0d26d69dccf9 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:04.334207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632cea6-0859-4012-b72e-0d26d69dccf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:04.354040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e632cea6-0859-4012-b72e-0d26d69dccf9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:04.355284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e632cea6-0859-4012-b72e-0d26d69dccf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:04.444705 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 399/795] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:04.446678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632cea6-0859-4012-b72e-0d26d69dccf9 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:04.466865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f53b5b7-1bcb-4654-b047-23783aab6406 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:04.490560 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:04.507613 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:04.516636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfe996-4074-450e-aa5d-f8d90f6938ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:04.517494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfe996-4074-450e-aa5d-f8d90f6938ba None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:04.517775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfe996-4074-450e-aa5d-f8d90f6938ba None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:04.521436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfe996-4074-450e-aa5d-f8d90f6938ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:04.529734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bfe996-4074-450e-aa5d-f8d90f6938ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:04.530870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bfe996-4074-450e-aa5d-f8d90f6938ba None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:04.549962 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-69bfe996-4074-450e-aa5d-f8d90f6938ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:04.549962 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:04.549962 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:04.549962 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:04.549962 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:04.549962 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:04.549962 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:04.549962 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:04.549962 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:04.549962 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:04.549962 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:04.549962 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:04.549962 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:04.549962 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:04.549962 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:04.558132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:04.558132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:04.558132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:04.558132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:04.558132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:04.558132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:04.558132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:04.558132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:04.558132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:04.558132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:04.558132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:04.558132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:04.558132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:04.558132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:04.558132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:04.558132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:04.558132 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:04.559065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:04.559065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:04.559065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:04.559065 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:04.559065 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 397/796] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:04.559065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfe996-4074-450e-aa5d-f8d90f6938ba None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:04.565982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632cea6-0859-4012-b72e-0d26d69dccf9 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:04.601739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf19b1-9dd0-4855-8eaf-693d0c6b4c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:04.603388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf19b1-9dd0-4855-8eaf-693d0c6b4c46 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:04.603818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf19b1-9dd0-4855-8eaf-693d0c6b4c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:04.604262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bf19b1-9dd0-4855-8eaf-693d0c6b4c46 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:04.605127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf19b1-9dd0-4855-8eaf-693d0c6b4c46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:04.605592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf19b1-9dd0-4855-8eaf-693d0c6b4c46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:04.607201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bf19b1-9dd0-4855-8eaf-693d0c6b4c46 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:04.620288 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 400/797] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:04.625715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf19b1-9dd0-4855-8eaf-693d0c6b4c46 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:04.660751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfe996-4074-450e-aa5d-f8d90f6938ba None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:04.699361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e9c25-0453-4146-b1c9-a11e01033bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:04.700332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e9c25-0453-4146-b1c9-a11e01033bba None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:04.700545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e9c25-0453-4146-b1c9-a11e01033bba None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:04.700822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e9c25-0453-4146-b1c9-a11e01033bba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:04.712235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e9c25-0453-4146-b1c9-a11e01033bba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:52:04.717820 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:04.719825 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-c17e9c25-0453-4146-b1c9-a11e01033bba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:52:04.719825 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:04.719825 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:04.719825 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:04.719825 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:04.719825 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:04.719825 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:04.719825 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:04.719825 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:04.719825 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:04.719825 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:04.719825 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:04.719825 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:52:04.719825 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:52:04.719825 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:52:04.719825 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:52:04.720765 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:52:04.720765 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:52:04.720765 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:52:04.720765 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:52:04.720765 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:04.720765 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:04.720765 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:04.720765 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:04.720765 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:04.720765 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:04.720765 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:04.720765 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:04.720765 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:04.720765 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:04.720765 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:04.720765 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:04.721609 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:04.721609 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:04.721609 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:04.721609 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:04.721609 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:52:04.721609 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:52:04.721609 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:52:04.721609 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:52:04.721609 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:52:04.721609 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:52:04.721609 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:52:04.721609 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:04.725712 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 398/798] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:52:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:04.726573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e9c25-0453-4146-b1c9-a11e01033bba None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:04.733339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bf19b1-9dd0-4855-8eaf-693d0c6b4c46 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:04.770783 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:04.771064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a446d72-2024-4084-a01c-b8d41747fd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:04.771745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a446d72-2024-4084-a01c-b8d41747fd61 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:04.772015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a446d72-2024-4084-a01c-b8d41747fd61 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:04.772290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a446d72-2024-4084-a01c-b8d41747fd61 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:04.773019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a446d72-2024-4084-a01c-b8d41747fd61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:04.773339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a446d72-2024-4084-a01c-b8d41747fd61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:04.775905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a446d72-2024-4084-a01c-b8d41747fd61 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:04.792471 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 401/799] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:04.792471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d858d6-9c13-43b7-8619-e5fcd2b1716c None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:04.792471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d858d6-9c13-43b7-8619-e5fcd2b1716c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:04.792471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d858d6-9c13-43b7-8619-e5fcd2b1716c None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:04.792471 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 402/800] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:04.792977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d858d6-9c13-43b7-8619-e5fcd2b1716c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:04.842630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e9c25-0453-4146-b1c9-a11e01033bba None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:04.878237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476350d-92c1-48a9-a1d5-3aebf71c1b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:04.879031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476350d-92c1-48a9-a1d5-3aebf71c1b84 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:04.879313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476350d-92c1-48a9-a1d5-3aebf71c1b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:04.879584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9476350d-92c1-48a9-a1d5-3aebf71c1b84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:04.888297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476350d-92c1-48a9-a1d5-3aebf71c1b84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:04.889732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9476350d-92c1-48a9-a1d5-3aebf71c1b84 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:04.902793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d858d6-9c13-43b7-8619-e5fcd2b1716c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:04.905108 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-9476350d-92c1-48a9-a1d5-3aebf71c1b84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:04.905108 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:04.905108 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:04.905108 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:04.905108 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:04.905108 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:04.905108 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:04.905108 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:04.905108 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:04.905108 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:04.905108 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:04.905108 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:04.905108 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:52:04.905108 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:52:04.905108 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:52:04.906013 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:52:04.906013 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:04.906013 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:04.906013 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:04.906013 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:04.906013 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:04.906013 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:04.906013 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:04.906013 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:04.906013 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:04.906013 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:04.906013 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:04.906013 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:04.906013 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:04.906013 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:04.906013 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:04.906013 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:04.907081 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:52:04.907081 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:52:04.907081 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:52:04.907081 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:52:04.907081 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:52:04.907081 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:52:04.907081 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:04.907081 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:04.910882 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 399/801] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:52:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:04.911689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476350d-92c1-48a9-a1d5-3aebf71c1b84 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:04.947611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882fe73-eab8-4a8d-a579-f2da6058aed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:04.948391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882fe73-eab8-4a8d-a579-f2da6058aed6 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:04.948671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882fe73-eab8-4a8d-a579-f2da6058aed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:04.948942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882fe73-eab8-4a8d-a579-f2da6058aed6 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:04.949692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882fe73-eab8-4a8d-a579-f2da6058aed6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:04.949995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882fe73-eab8-4a8d-a579-f2da6058aed6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:04.951398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882fe73-eab8-4a8d-a579-f2da6058aed6 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:04.961393 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 403/802] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:52:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:04.963315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b8143-0f18-49a7-8dff-ec3839b72468 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:04.963605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b8143-0f18-49a7-8dff-ec3839b72468 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:04.963879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b8143-0f18-49a7-8dff-ec3839b72468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:04.982156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-621b8143-0f18-49a7-8dff-ec3839b72468 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:04.983331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-621b8143-0f18-49a7-8dff-ec3839b72468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:04.985555 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:05.015994 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:05.019134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9476350d-92c1-48a9-a1d5-3aebf71c1b84 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:05.056061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91aa7ba-c9b5-4429-a746-aa1754153091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:05.066408 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 404/803] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:05.066537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aa7ba-c9b5-4429-a746-aa1754153091 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:05.066537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aa7ba-c9b5-4429-a746-aa1754153091 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:05.066537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91aa7ba-c9b5-4429-a746-aa1754153091 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:05.066794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b8143-0f18-49a7-8dff-ec3839b72468 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:05.075056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91aa7ba-c9b5-4429-a746-aa1754153091 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:05.076786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91aa7ba-c9b5-4429-a746-aa1754153091 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:05.092907 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-d91aa7ba-c9b5-4429-a746-aa1754153091 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 13:52:05.092907 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:05.092907 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:05.092907 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:05.092907 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:05.092907 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:05.092907 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:05.092907 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:05.092907 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:05.092907 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:05.092907 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:05.092907 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:05.092907 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:52:05.092907 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:52:05.092907 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:52:05.092907 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:52:05.093925 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:05.093925 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:05.093925 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:52:05.093925 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:05.093925 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:52:05.093925 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:05.093925 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:05.093925 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:05.093925 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:05.093925 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:05.093925 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:05.093925 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:05.093925 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:05.093925 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:05.093925 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:05.093925 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:05.093925 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:05.093925 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:05.095020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:05.095020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:05.095020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:52:05.095020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:52:05.095020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:52:05.095020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:52:05.095020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:52:05.095020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:52:05.095020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 13:52:05.095020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:05.095020 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 400/804] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jul 19 13:52:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:05.095020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91aa7ba-c9b5-4429-a746-aa1754153091 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:05.175676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b8143-0f18-49a7-8dff-ec3839b72468 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:05.203334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91aa7ba-c9b5-4429-a746-aa1754153091 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:05.216098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67dba2-5394-48ae-8557-6710c577aa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:05.216863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67dba2-5394-48ae-8557-6710c577aa37 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:05.219948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67dba2-5394-48ae-8557-6710c577aa37 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:05.219948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67dba2-5394-48ae-8557-6710c577aa37 None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:05.219948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67dba2-5394-48ae-8557-6710c577aa37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:05.219948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67dba2-5394-48ae-8557-6710c577aa37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:05.220308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67dba2-5394-48ae-8557-6710c577aa37 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:05.229331 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:05.235566 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 405/805] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:52:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:05.236204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67dba2-5394-48ae-8557-6710c577aa37 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:05.248036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663047c-affd-475b-86d6-e71ab43db338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:05.248834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663047c-affd-475b-86d6-e71ab43db338 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:05.249343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663047c-affd-475b-86d6-e71ab43db338 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:05.249451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663047c-affd-475b-86d6-e71ab43db338 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:05.260776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663047c-affd-475b-86d6-e71ab43db338 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:05.262237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a663047c-affd-475b-86d6-e71ab43db338 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:05.280075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-a663047c-affd-475b-86d6-e71ab43db338 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:05.280075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:05.280075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:05.280075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:05.280075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:05.280075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:05.280075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:05.280075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:05.280075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:05.280075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:05.280075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:05.280075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:05.280075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:05.280075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:05.280075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:05.281003 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:05.281003 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:05.281003 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:05.281003 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:05.281003 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:05.281003 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:05.281003 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:05.281003 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:05.281003 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:05.281003 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:05.281003 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:05.281003 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:05.281003 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:05.281003 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:05.281003 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:05.281003 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:05.281003 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:05.281903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:05.281903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:05.281903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:05.281903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:05.281903 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 401/806] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:05.282679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663047c-affd-475b-86d6-e71ab43db338 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:05.298287 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:05.350565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67dba2-5394-48ae-8557-6710c577aa37 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:05.385479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0634f-bc98-444c-a544-735b3a140d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:05.386306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0634f-bc98-444c-a544-735b3a140d4e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:05.386586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0634f-bc98-444c-a544-735b3a140d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:05.386859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0634f-bc98-444c-a544-735b3a140d4e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:05.387509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0634f-bc98-444c-a544-735b3a140d4e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:05.388554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663047c-affd-475b-86d6-e71ab43db338 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:05.388974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0634f-bc98-444c-a544-735b3a140d4e None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:05.404425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-c3f0634f-bc98-444c-a544-735b3a140d4e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 13:52:05.404425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:05.404425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:52:05.404425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:52:05.404425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:52:05.404425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:52:05.404425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:52:05.404425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:05.404425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 13:52:05.404425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:05.404425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:05.404425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:05.404425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:05.404425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:05.404425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:05.404425 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:05.405419 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:05.405419 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:05.405419 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:05.405419 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:05.405419 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:05.405419 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:05.405419 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:05.405419 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:52:05.405419 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:52:05.405419 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:52:05.405419 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:52:05.405419 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:05.405419 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:05.405419 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:05.405419 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:05.405419 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:05.406599 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:05.406599 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:05.406599 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:05.406599 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:05.406599 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:05.406599 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:05.406599 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:05.406599 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:05.406599 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:05.406599 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:05.406599 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:05.406599 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:52:05.406599 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:05.406599 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 13:52:05.406599 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:05.406599 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 406/807] 10.222.0.43 () {56 vars in 1129 bytes} [Tue Jul 19 13:52:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:05.407705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0634f-bc98-444c-a544-735b3a140d4e None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:05.426975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd738195-6fde-466b-9a11-b02dbfa9246e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:05.427634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd738195-6fde-466b-9a11-b02dbfa9246e None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:05.427919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd738195-6fde-466b-9a11-b02dbfa9246e None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:05.428196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd738195-6fde-466b-9a11-b02dbfa9246e None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:05.429037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd738195-6fde-466b-9a11-b02dbfa9246e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:05.429354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd738195-6fde-466b-9a11-b02dbfa9246e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:05.431043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd738195-6fde-466b-9a11-b02dbfa9246e None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:05.448996 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 402/808] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Jul 19 13:52:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:05.449686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd738195-6fde-466b-9a11-b02dbfa9246e None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:05.472214 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:05.510553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0634f-bc98-444c-a544-735b3a140d4e None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:05.517715 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:05.544746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e97e73-d1bf-458d-baf1-3b05b2fd928a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:05.545639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e97e73-d1bf-458d-baf1-3b05b2fd928a None admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:05.545923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e97e73-d1bf-458d-baf1-3b05b2fd928a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:05.546228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e97e73-d1bf-458d-baf1-3b05b2fd928a None admin] PATH_INFO: `/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/0789b4be9dae4c05bb3ec4a5e0f1f308/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:05.548184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e97e73-d1bf-458d-baf1-3b05b2fd928a None admin] RBAC: Authorizing `identity:create_grant(project_id=dfcbe281a77242bbb3774c4aacef50d4, user_id=0789b4be9dae4c05bb3ec4a5e0f1f308, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:05.548508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd738195-6fde-466b-9a11-b02dbfa9246e None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:05.549614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e97e73-d1bf-458d-baf1-3b05b2fd928a None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:05.582965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ef63c-e884-47d9-9c11-b8ca0ecf787e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:05.583625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ef63c-e884-47d9-9c11-b8ca0ecf787e None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:05.583932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ef63c-e884-47d9-9c11-b8ca0ecf787e None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:05.584296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ef63c-e884-47d9-9c11-b8ca0ecf787e None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:05.585015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ef63c-e884-47d9-9c11-b8ca0ecf787e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:05.585321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ef63c-e884-47d9-9c11-b8ca0ecf787e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:05.586862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ef63c-e884-47d9-9c11-b8ca0ecf787e None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:05.590907 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 407/809] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:52:05 2022] PUT /identity/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/0789b4be9dae4c05bb3ec4a5e0f1f308/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:52:05.593645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30450c-f288-4174-8c56-20ab6ea1cdf3 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:05.593645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30450c-f288-4174-8c56-20ab6ea1cdf3 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:05.593645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30450c-f288-4174-8c56-20ab6ea1cdf3 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:05.598358 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 408/810] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:05.598358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30450c-f288-4174-8c56-20ab6ea1cdf3 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:05.603961 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 403/811] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:05.604592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ef63c-e884-47d9-9c11-b8ca0ecf787e None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:05.717378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30450c-f288-4174-8c56-20ab6ea1cdf3 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:05.722953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ef63c-e884-47d9-9c11-b8ca0ecf787e None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:05.742251 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:05.760022 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:05.762341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfc0cb-0fb7-4d15-973a-88ff30a7237f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:05.763067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfc0cb-0fb7-4d15-973a-88ff30a7237f None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:05.763404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfc0cb-0fb7-4d15-973a-88ff30a7237f None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:05.765459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfc0cb-0fb7-4d15-973a-88ff30a7237f None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:05.765459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfc0cb-0fb7-4d15-973a-88ff30a7237f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:05.765459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfc0cb-0fb7-4d15-973a-88ff30a7237f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:05.766075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfc0cb-0fb7-4d15-973a-88ff30a7237f None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:05.767818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5294b-26d8-4205-9fa3-90e4c84ef0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:05.768323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5294b-26d8-4205-9fa3-90e4c84ef0ed None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:05.768610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5294b-26d8-4205-9fa3-90e4c84ef0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:05.768889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5294b-26d8-4205-9fa3-90e4c84ef0ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:05.771174 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 409/812] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Jul 19 13:52:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:05.772482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef9e8c-9917-4979-aeb7-7935397252c2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:05.772801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef9e8c-9917-4979-aeb7-7935397252c2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:05.773462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fef9e8c-9917-4979-aeb7-7935397252c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:05.780797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5294b-26d8-4205-9fa3-90e4c84ef0ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:05.782308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5294b-26d8-4205-9fa3-90e4c84ef0ed None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:05.791758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0fef9e8c-9917-4979-aeb7-7935397252c2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:05.792954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0fef9e8c-9917-4979-aeb7-7935397252c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:05.801613 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-ebe5294b-26d8-4205-9fa3-90e4c84ef0ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:05.801613 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:05.801613 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:05.801613 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:05.801613 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:05.801613 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:05.801613 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:05.801613 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:05.801613 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:05.801613 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:05.801613 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:05.801613 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:05.801613 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:05.801613 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:05.801613 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:05.802560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:05.802560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:05.802560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:05.802560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:05.802560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:05.802560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:05.802560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:05.802560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:05.802560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:05.802560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:05.802560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:05.802560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:05.802560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:05.802560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:05.802560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:05.802560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:05.802560 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:05.803495 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:05.803495 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:05.803495 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:05.803495 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:05.803495 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 404/813] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:05.803943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5294b-26d8-4205-9fa3-90e4c84ef0ed None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:05.868822 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 410/814] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:05.869414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef9e8c-9917-4979-aeb7-7935397252c2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:05.926752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5294b-26d8-4205-9fa3-90e4c84ef0ed None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:05.964131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bfa12-bef9-410e-bdc4-ca8140942396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:05.964938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bfa12-bef9-410e-bdc4-ca8140942396 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:05.965224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bfa12-bef9-410e-bdc4-ca8140942396 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:05.965505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bfa12-bef9-410e-bdc4-ca8140942396 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:05.973169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0bfa12-bef9-410e-bdc4-ca8140942396 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:05.974632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0bfa12-bef9-410e-bdc4-ca8140942396 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:05.979046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fef9e8c-9917-4979-aeb7-7935397252c2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:05.989118 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-ee0bfa12-bef9-410e-bdc4-ca8140942396 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 13:52:05.989118 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:05.989118 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:05.989118 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:05.989118 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:05.989118 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:05.989118 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:05.989118 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:05.989118 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:05.989118 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:05.989118 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:05.989118 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:05.989118 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:52:05.989118 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:52:05.989118 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:52:05.989118 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:52:05.990077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:05.990077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:05.990077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:52:05.990077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:05.990077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:52:05.990077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:05.990077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:05.990077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:05.990077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:05.990077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:05.990077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:05.990077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:05.990077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:05.990077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:05.990077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:05.990077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:05.990077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:05.990077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:05.991099 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:05.991099 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:05.991099 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:52:05.991099 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:52:05.991099 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:52:05.991099 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:52:05.991099 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:52:05.991099 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:52:05.991099 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 13:52:05.991099 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:05.991099 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 405/815] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jul 19 13:52:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:05.991719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bfa12-bef9-410e-bdc4-ca8140942396 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:06.002321 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:06.021510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df22c5-a9cb-4263-9eee-649c0c9557be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:06.022465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df22c5-a9cb-4263-9eee-649c0c9557be None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:06.022902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df22c5-a9cb-4263-9eee-649c0c9557be None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:06.023334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df22c5-a9cb-4263-9eee-649c0c9557be None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:06.024740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df22c5-a9cb-4263-9eee-649c0c9557be None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:06.025201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df22c5-a9cb-4263-9eee-649c0c9557be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:06.026751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df22c5-a9cb-4263-9eee-649c0c9557be None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:06.033486 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 411/816] 10.222.0.43 () {56 vars in 1124 bytes} [Tue Jul 19 13:52:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:06.035275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df22c5-a9cb-4263-9eee-649c0c9557be None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:06.043516 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:06.105446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bfa12-bef9-410e-bdc4-ca8140942396 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:06.141286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17868ced-309c-4274-a48b-e8ed0c4ff1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:06.141867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17868ced-309c-4274-a48b-e8ed0c4ff1bf None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:06.142174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17868ced-309c-4274-a48b-e8ed0c4ff1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:06.142452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17868ced-309c-4274-a48b-e8ed0c4ff1bf None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:06.143171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17868ced-309c-4274-a48b-e8ed0c4ff1bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:06.143477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17868ced-309c-4274-a48b-e8ed0c4ff1bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:06.144861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17868ced-309c-4274-a48b-e8ed0c4ff1bf None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:06.162128 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 406/817] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:06.162128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17868ced-309c-4274-a48b-e8ed0c4ff1bf None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:06.168942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df22c5-a9cb-4263-9eee-649c0c9557be None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:06.208585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088c0ed-7853-47dc-8350-39d2ed4d394f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:06.209674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088c0ed-7853-47dc-8350-39d2ed4d394f None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:06.210169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088c0ed-7853-47dc-8350-39d2ed4d394f None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:06.210659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088c0ed-7853-47dc-8350-39d2ed4d394f None admin] PATH_INFO: `/v3/services/network` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:06.212092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088c0ed-7853-47dc-8350-39d2ed4d394f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:06.213546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088c0ed-7853-47dc-8350-39d2ed4d394f None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:06.226413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-e088c0ed-7853-47dc-8350-39d2ed4d394f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 13:52:06.226413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:06.226413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:52:06.226413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:52:06.226413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:52:06.226413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:52:06.226413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:52:06.226413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:06.226413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 13:52:06.226413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:06.226413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:06.226413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:06.226413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:06.226413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:06.226413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:06.226413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:06.226413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:06.227670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:06.227670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:06.227670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:06.227670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:06.227670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:06.227670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:06.227670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:52:06.227670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:52:06.227670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:52:06.227670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:52:06.227670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:06.227670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:06.227670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:06.227670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:06.227670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:06.227670 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:06.228646 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:06.228646 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:06.228646 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:06.228646 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:06.228646 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:06.228646 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:06.228646 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:06.228646 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:06.228646 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:06.228646 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:06.228646 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:52:06.228646 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:06.228646 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 13:52:06.228646 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:06.232553 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 412/818] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:52:06 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:06.233376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088c0ed-7853-47dc-8350-39d2ed4d394f None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:06.273572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17868ced-309c-4274-a48b-e8ed0c4ff1bf None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:06.275610 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:06.281226 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:06.311127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4eeac-1369-4de8-8f9a-72666a4b584e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:06.311799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4eeac-1369-4de8-8f9a-72666a4b584e None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:06.312079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4eeac-1369-4de8-8f9a-72666a4b584e None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:06.312344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4eeac-1369-4de8-8f9a-72666a4b584e None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:06.313237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4eeac-1369-4de8-8f9a-72666a4b584e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:06.313791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4eeac-1369-4de8-8f9a-72666a4b584e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:06.317261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4eeac-1369-4de8-8f9a-72666a4b584e None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:06.340895 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 407/819] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jul 19 13:52:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:06.340895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4eeac-1369-4de8-8f9a-72666a4b584e None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:06.345120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088c0ed-7853-47dc-8350-39d2ed4d394f None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:06.379982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96678604-3b7b-49ca-9e6d-ddee68308d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:06.380731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96678604-3b7b-49ca-9e6d-ddee68308d08 None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:06.381039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96678604-3b7b-49ca-9e6d-ddee68308d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:06.381303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96678604-3b7b-49ca-9e6d-ddee68308d08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:06.382048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96678604-3b7b-49ca-9e6d-ddee68308d08 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:06.384096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96678604-3b7b-49ca-9e6d-ddee68308d08 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:06.439884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4eeac-1369-4de8-8f9a-72666a4b584e None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:06.454646 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 413/820] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jul 19 13:52:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:52:06.455699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96678604-3b7b-49ca-9e6d-ddee68308d08 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:06.496781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9f190-6bb6-425a-945f-425cf94409ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:06.497669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9f190-6bb6-425a-945f-425cf94409ca None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:06.497960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9f190-6bb6-425a-945f-425cf94409ca None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:06.498316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9f190-6bb6-425a-945f-425cf94409ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:06.505916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9f190-6bb6-425a-945f-425cf94409ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:06.507426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9f190-6bb6-425a-945f-425cf94409ca None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:06.523475 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-3bf9f190-6bb6-425a-945f-425cf94409ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:06.523475 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:06.523475 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:06.523475 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:06.523475 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:06.523475 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:06.523475 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:06.523475 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:06.523475 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:06.523475 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:06.523475 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:06.523475 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:06.523475 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:52:06.523475 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:52:06.523475 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:52:06.524490 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:52:06.524490 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:06.524490 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:06.524490 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:06.524490 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:06.524490 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:06.524490 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:06.524490 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:06.524490 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:06.524490 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:06.524490 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:06.524490 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:06.524490 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:06.524490 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:06.524490 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:06.524490 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:06.524490 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:06.525419 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:52:06.525419 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:52:06.525419 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:52:06.525419 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:52:06.525419 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:52:06.525419 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:52:06.525419 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:06.525419 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:06.529875 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 408/821] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:52:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:06.530887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9f190-6bb6-425a-945f-425cf94409ca None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:06.551062 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:06.618881 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:06.623111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96678604-3b7b-49ca-9e6d-ddee68308d08 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:06.649283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9f190-6bb6-425a-945f-425cf94409ca None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:06.665700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20bdc5-7ea6-485f-93d9-5c5259b51ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:06.666698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20bdc5-7ea6-485f-93d9-5c5259b51ffd None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:06.666988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20bdc5-7ea6-485f-93d9-5c5259b51ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:06.668166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e20bdc5-7ea6-485f-93d9-5c5259b51ffd None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:06.668166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20bdc5-7ea6-485f-93d9-5c5259b51ffd None admin] RBAC: Adding query filter params (name=network) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:06.669641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20bdc5-7ea6-485f-93d9-5c5259b51ffd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:06.670208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e20bdc5-7ea6-485f-93d9-5c5259b51ffd None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:06.677742 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 414/822] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 19 13:52:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:06.679126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20bdc5-7ea6-485f-93d9-5c5259b51ffd None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:06.693393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d79bb8-a39e-4d24-a5e3-94d2be486e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:06.694950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d79bb8-a39e-4d24-a5e3-94d2be486e27 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:06.694950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d79bb8-a39e-4d24-a5e3-94d2be486e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:06.695231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d79bb8-a39e-4d24-a5e3-94d2be486e27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:06.775641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d79bb8-a39e-4d24-a5e3-94d2be486e27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:06.777093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d79bb8-a39e-4d24-a5e3-94d2be486e27 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:06.794619 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:06.801009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e20bdc5-7ea6-485f-93d9-5c5259b51ffd None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:06.840804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2d5f5-ac62-41e3-8d47-ed2f62ce1a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:06.841757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2d5f5-ac62-41e3-8d47-ed2f62ce1a5e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:06.842248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2d5f5-ac62-41e3-8d47-ed2f62ce1a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:06.842679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2d5f5-ac62-41e3-8d47-ed2f62ce1a5e None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:06.843618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2d5f5-ac62-41e3-8d47-ed2f62ce1a5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:06.844129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2d5f5-ac62-41e3-8d47-ed2f62ce1a5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:06.845837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2d5f5-ac62-41e3-8d47-ed2f62ce1a5e None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:06.864018 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 415/823] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:52:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:06.865170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2d5f5-ac62-41e3-8d47-ed2f62ce1a5e None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:06.880248 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 409/824] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:52:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 13:52:06.881191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d79bb8-a39e-4d24-a5e3-94d2be486e27 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:06.893872 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:06.972215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2d5f5-ac62-41e3-8d47-ed2f62ce1a5e None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:06.986956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d79bb8-a39e-4d24-a5e3-94d2be486e27 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:07.005104 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:07.009366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a04e1-676a-4211-b0b4-43a26809e2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:07.010248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a04e1-676a-4211-b0b4-43a26809e2fa None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:07.011837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a04e1-676a-4211-b0b4-43a26809e2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:07.011837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a04e1-676a-4211-b0b4-43a26809e2fa None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:07.011837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a04e1-676a-4211-b0b4-43a26809e2fa None admin] RBAC: Adding query filter params (type=network) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:07.012350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a04e1-676a-4211-b0b4-43a26809e2fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:07.013864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a04e1-676a-4211-b0b4-43a26809e2fa None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:07.023744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997b7e5-d7a2-4d80-a606-431581e2e0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:07.024547 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 416/825] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 19 13:52:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:07.025633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a04e1-676a-4211-b0b4-43a26809e2fa None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:07.025977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997b7e5-d7a2-4d80-a606-431581e2e0a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:07.026303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997b7e5-d7a2-4d80-a606-431581e2e0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:07.026562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997b7e5-d7a2-4d80-a606-431581e2e0a4 None admin] PATH_INFO: `/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/ec07a12b28934ef9b04325404fd3c950/roles/56d47830104f4dc09f1076c75acf3ffd` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:07.043256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997b7e5-d7a2-4d80-a606-431581e2e0a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=dfcbe281a77242bbb3774c4aacef50d4, user_id=ec07a12b28934ef9b04325404fd3c950, role_id=56d47830104f4dc09f1076c75acf3ffd)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:07.044622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997b7e5-d7a2-4d80-a606-431581e2e0a4 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:07.118856 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 410/826] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:52:06 2022] PUT /identity/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/ec07a12b28934ef9b04325404fd3c950/roles/56d47830104f4dc09f1076c75acf3ffd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:52:07.118856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997b7e5-d7a2-4d80-a606-431581e2e0a4 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:07.130362 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:07.152488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a04e1-676a-4211-b0b4-43a26809e2fa None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:07.246200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ce765-3d4d-4e77-8280-456870de78ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:07.247313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ce765-3d4d-4e77-8280-456870de78ad None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:07.247782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ce765-3d4d-4e77-8280-456870de78ad None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:07.248212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ce765-3d4d-4e77-8280-456870de78ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:07.255638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997b7e5-d7a2-4d80-a606-431581e2e0a4 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:07.279396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ce765-3d4d-4e77-8280-456870de78ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:07.280882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849ce765-3d4d-4e77-8280-456870de78ad None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:07.299162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642451c8-5f14-41d8-a90f-66ab8b48e2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:07.299882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642451c8-5f14-41d8-a90f-66ab8b48e2db None admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:07.300175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642451c8-5f14-41d8-a90f-66ab8b48e2db None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:07.300461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642451c8-5f14-41d8-a90f-66ab8b48e2db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:07.301234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642451c8-5f14-41d8-a90f-66ab8b48e2db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:07.302701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642451c8-5f14-41d8-a90f-66ab8b48e2db None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:07.326443 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-849ce765-3d4d-4e77-8280-456870de78ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:07.326443 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:07.326443 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:07.326443 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:07.326443 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:07.326443 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:07.326443 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:07.326443 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:07.326443 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:07.326443 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:07.326443 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:07.326443 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:07.326443 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:07.326443 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:07.326443 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:07.328066 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:07.328066 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:07.328066 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:07.328066 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:07.328066 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:07.328066 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:07.328066 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:07.328066 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:07.328066 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:07.328066 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:07.328066 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:07.328066 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:07.328066 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:07.328066 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:07.328066 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:07.328066 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:07.328066 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:07.328981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:07.328981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:07.328981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:07.328981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:07.328981 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 417/827] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:07.333594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ce765-3d4d-4e77-8280-456870de78ad None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:07.403888 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 411/828] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jul 19 13:52:07 2022] POST /identity/v3/endpoints => generated 327 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:52:07.457410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ce765-3d4d-4e77-8280-456870de78ad None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:07.541054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b875d-84c5-4c12-909e-8187689b031d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:07.541657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b875d-84c5-4c12-909e-8187689b031d None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:07.541940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b875d-84c5-4c12-909e-8187689b031d None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:07.542257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98b875d-84c5-4c12-909e-8187689b031d None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:07.542996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b875d-84c5-4c12-909e-8187689b031d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:07.543380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b875d-84c5-4c12-909e-8187689b031d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:07.544832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98b875d-84c5-4c12-909e-8187689b031d None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:07.547653 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:07.559339 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 418/829] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:07.565307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642451c8-5f14-41d8-a90f-66ab8b48e2db None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:07.593276 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:07.699496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642451c8-5f14-41d8-a90f-66ab8b48e2db None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:07.740072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8607b21a-c081-424c-915a-f7fa0d80e232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:07.740894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607b21a-c081-424c-915a-f7fa0d80e232 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:07.741175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607b21a-c081-424c-915a-f7fa0d80e232 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:07.741447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8607b21a-c081-424c-915a-f7fa0d80e232 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:07.749238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607b21a-c081-424c-915a-f7fa0d80e232 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:07.750708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8607b21a-c081-424c-915a-f7fa0d80e232 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:07.765369 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-8607b21a-c081-424c-915a-f7fa0d80e232 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:07.765369 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:07.765369 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:07.765369 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:07.765369 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:07.765369 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:07.765369 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:07.765369 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:07.765369 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:07.765369 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:07.765369 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:07.765369 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:07.765369 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:52:07.765369 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:52:07.765369 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:52:07.766413 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:52:07.766413 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:07.766413 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:07.766413 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:07.766413 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:07.766413 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:07.766413 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:07.766413 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:07.766413 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:07.766413 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:07.766413 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:07.766413 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:07.766413 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:07.766413 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:07.766413 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:07.766413 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:07.766413 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:07.767402 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:52:07.767402 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:52:07.767402 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:52:07.767402 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:52:07.767402 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:52:07.767402 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:52:07.767402 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:07.767402 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:07.767402 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 412/830] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:52:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:07.772313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b875d-84c5-4c12-909e-8187689b031d None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:07.794586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b48bc-4ea9-401a-abdd-18cdf3ce9ca9 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:07.794951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b48bc-4ea9-401a-abdd-18cdf3ce9ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:07.795060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b48bc-4ea9-401a-abdd-18cdf3ce9ca9 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:07.796697 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 413/831] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:52:07.803437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27588b8a-073b-4539-87dc-e55afaf8b987 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:07.803722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27588b8a-073b-4539-87dc-e55afaf8b987 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:07.804003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27588b8a-073b-4539-87dc-e55afaf8b987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:07.822788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-27588b8a-073b-4539-87dc-e55afaf8b987 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:07.823994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-27588b8a-073b-4539-87dc-e55afaf8b987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:07.897910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98b875d-84c5-4c12-909e-8187689b031d None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:07.914242 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 414/832] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:07.936125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5ca66-b6eb-41e5-a3f7-6fca39428a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:07.937147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5ca66-b6eb-41e5-a3f7-6fca39428a96 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:07.937670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5ca66-b6eb-41e5-a3f7-6fca39428a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:07.938181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b5ca66-b6eb-41e5-a3f7-6fca39428a96 None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:07.938883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27588b8a-073b-4539-87dc-e55afaf8b987 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:07.939651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5ca66-b6eb-41e5-a3f7-6fca39428a96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:07.940166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5ca66-b6eb-41e5-a3f7-6fca39428a96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:07.942039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b5ca66-b6eb-41e5-a3f7-6fca39428a96 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:07.954798 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:07.957288 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 419/833] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:52:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:07.964055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5ca66-b6eb-41e5-a3f7-6fca39428a96 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:08.049748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27588b8a-073b-4539-87dc-e55afaf8b987 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:08.053534 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:08.087121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db82950-b35d-4e2f-8289-aaeb1309ddf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:08.088083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db82950-b35d-4e2f-8289-aaeb1309ddf3 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:08.088415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db82950-b35d-4e2f-8289-aaeb1309ddf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:08.088703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db82950-b35d-4e2f-8289-aaeb1309ddf3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:08.099917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db82950-b35d-4e2f-8289-aaeb1309ddf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:52:08.108282 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-9db82950-b35d-4e2f-8289-aaeb1309ddf3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:52:08.108282 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:08.108282 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:08.108282 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:08.108282 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:08.108282 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:08.108282 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:08.108282 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:08.108282 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:08.108282 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:08.108282 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:08.108282 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:08.108282 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:52:08.108282 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:52:08.108282 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:52:08.108282 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:52:08.109246 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:52:08.109246 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:52:08.109246 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:52:08.109246 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:52:08.109246 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:08.109246 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:08.109246 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:08.109246 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:08.109246 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:08.109246 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:08.109246 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:08.109246 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:08.109246 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:08.109246 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:08.109246 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:08.109246 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:08.110130 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:08.110130 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:08.110130 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:08.110130 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:08.110130 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:52:08.110130 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:52:08.110130 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:52:08.110130 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:52:08.110130 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:52:08.110130 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:52:08.110130 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:52:08.110130 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:08.114202 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 415/834] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:52:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:08.115680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db82950-b35d-4e2f-8289-aaeb1309ddf3 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:08.116868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b5ca66-b6eb-41e5-a3f7-6fca39428a96 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:08.162965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90e7a7-e86e-47d2-865d-6876edf9dacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:08.164004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90e7a7-e86e-47d2-865d-6876edf9dacc None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:08.164731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90e7a7-e86e-47d2-865d-6876edf9dacc None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:08.165677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c90e7a7-e86e-47d2-865d-6876edf9dacc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:08.167048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90e7a7-e86e-47d2-865d-6876edf9dacc None admin] RBAC: Adding query filter params (role.id=bc315edf089d43b18acf9790031f3fcb, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=dfe9762955004354ab4f1fe02f05a427) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:08.167611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90e7a7-e86e-47d2-865d-6876edf9dacc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:08.169704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c90e7a7-e86e-47d2-865d-6876edf9dacc None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:08.178208 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 420/835] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:52:07 2022] GET /identity/v3/role_assignments?user.id=dfe9762955004354ab4f1fe02f05a427&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=bc315edf089d43b18acf9790031f3fcb => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:08.190993 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:08.228454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db82950-b35d-4e2f-8289-aaeb1309ddf3 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:08.268087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6e6c7-8db4-4497-adaa-0a71204f69de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:08.268833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6e6c7-8db4-4497-adaa-0a71204f69de None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:08.269120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6e6c7-8db4-4497-adaa-0a71204f69de None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:08.269398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6e6c7-8db4-4497-adaa-0a71204f69de None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:08.270251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6e6c7-8db4-4497-adaa-0a71204f69de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:08.270560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6e6c7-8db4-4497-adaa-0a71204f69de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:08.271949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6e6c7-8db4-4497-adaa-0a71204f69de None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:08.287436 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 416/836] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:52:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:08.288894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90e7a7-e86e-47d2-865d-6876edf9dacc None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:08.406772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c90e7a7-e86e-47d2-865d-6876edf9dacc None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:08.432521 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:08.444388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee288e-f002-4f4f-91fb-61af29c4e35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:08.445188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee288e-f002-4f4f-91fb-61af29c4e35c None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:08.445472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee288e-f002-4f4f-91fb-61af29c4e35c None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:08.446394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee288e-f002-4f4f-91fb-61af29c4e35c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:08.457708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee288e-f002-4f4f-91fb-61af29c4e35c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:08.459215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdee288e-f002-4f4f-91fb-61af29c4e35c None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:08.478125 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-cdee288e-f002-4f4f-91fb-61af29c4e35c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:08.478125 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:08.478125 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:08.478125 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:08.478125 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:08.478125 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:08.478125 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:08.478125 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:08.478125 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:08.478125 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:08.478125 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:08.478125 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:08.478125 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:08.478125 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:08.478125 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:08.479084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:08.479084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:08.479084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:08.479084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:08.479084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:08.479084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:08.479084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:08.479084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:08.479084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:08.479084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:08.479084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:08.479084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:08.479084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:08.479084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:08.479084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:08.479084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:08.479084 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:08.479970 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:08.479970 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:08.479970 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:08.479970 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:08.483842 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 421/837] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:08.485182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6e6c7-8db4-4497-adaa-0a71204f69de None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:08.594334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6e6c7-8db4-4497-adaa-0a71204f69de None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:08.629393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3591e99-31f0-4abd-af63-fa6706521337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:08.630066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3591e99-31f0-4abd-af63-fa6706521337 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:08.630380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3591e99-31f0-4abd-af63-fa6706521337 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:08.630715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3591e99-31f0-4abd-af63-fa6706521337 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:08.631450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3591e99-31f0-4abd-af63-fa6706521337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:08.631803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3591e99-31f0-4abd-af63-fa6706521337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:08.633745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3591e99-31f0-4abd-af63-fa6706521337 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:08.635328 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:08.646778 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 417/838] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:08.652567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee288e-f002-4f4f-91fb-61af29c4e35c None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:08.759902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee288e-f002-4f4f-91fb-61af29c4e35c None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:08.780388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cbe96-7aee-4bcd-beb8-dbe49fe4f7cc None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:08.780709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cbe96-7aee-4bcd-beb8-dbe49fe4f7cc None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:08.780958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cbe96-7aee-4bcd-beb8-dbe49fe4f7cc None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:08.782387 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 418/839] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:52:08.787462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681235f1-dccc-4a80-be4e-62557a00fecf None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:08.787744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681235f1-dccc-4a80-be4e-62557a00fecf None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:08.788014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681235f1-dccc-4a80-be4e-62557a00fecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:08.799546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671ac8d-dc04-465f-a638-c975acd8fb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:08.800716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671ac8d-dc04-465f-a638-c975acd8fb4b None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:08.801216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671ac8d-dc04-465f-a638-c975acd8fb4b None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:08.801703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f671ac8d-dc04-465f-a638-c975acd8fb4b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:08.806686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-681235f1-dccc-4a80-be4e-62557a00fecf None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:08.807973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-681235f1-dccc-4a80-be4e-62557a00fecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:08.810993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671ac8d-dc04-465f-a638-c975acd8fb4b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:08.812501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f671ac8d-dc04-465f-a638-c975acd8fb4b None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:08.828601 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-f671ac8d-dc04-465f-a638-c975acd8fb4b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 13:52:08.828601 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:08.828601 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:08.828601 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:08.828601 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:08.828601 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:08.828601 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:08.828601 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:08.828601 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:08.828601 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:08.828601 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:08.828601 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:08.828601 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:52:08.828601 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:52:08.828601 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:52:08.828601 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:52:08.829581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:08.829581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:08.829581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:52:08.829581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:08.829581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:52:08.829581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:08.829581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:08.829581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:08.829581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:08.829581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:08.829581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:08.829581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:08.829581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:08.829581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:08.829581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:08.829581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:08.829581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:08.829581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:08.830569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:08.830569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:08.830569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:52:08.830569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:52:08.830569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:52:08.830569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:52:08.830569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:52:08.830569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:52:08.830569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 13:52:08.830569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:08.830569 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 422/840] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:52:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:08.835470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671ac8d-dc04-465f-a638-c975acd8fb4b None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:08.869687 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:08.886431 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 419/841] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:08.905476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681235f1-dccc-4a80-be4e-62557a00fecf None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:08.942218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f671ac8d-dc04-465f-a638-c975acd8fb4b None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:08.982791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17000b-4e74-4173-860d-9f211ebfed21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:08.983465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17000b-4e74-4173-860d-9f211ebfed21 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:08.983750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17000b-4e74-4173-860d-9f211ebfed21 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:08.984027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17000b-4e74-4173-860d-9f211ebfed21 None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:08.984878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17000b-4e74-4173-860d-9f211ebfed21 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:08.985188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17000b-4e74-4173-860d-9f211ebfed21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:08.986770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17000b-4e74-4173-860d-9f211ebfed21 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:09.010772 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 423/842] 10.222.0.43 () {56 vars in 1135 bytes} [Tue Jul 19 13:52:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:09.012276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17000b-4e74-4173-860d-9f211ebfed21 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:09.020138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681235f1-dccc-4a80-be4e-62557a00fecf None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:09.051733 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:09.065449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb5e6f-2db1-4fb4-9e94-074b4194f9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:09.066426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb5e6f-2db1-4fb4-9e94-074b4194f9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:09.066783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb5e6f-2db1-4fb4-9e94-074b4194f9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:09.067128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fb5e6f-2db1-4fb4-9e94-074b4194f9b7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:09.067882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb5e6f-2db1-4fb4-9e94-074b4194f9b7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:09.069752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fb5e6f-2db1-4fb4-9e94-074b4194f9b7 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:09.086927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-91fb5e6f-2db1-4fb4-9e94-074b4194f9b7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 13:52:09.086927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:09.086927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:52:09.086927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:52:09.086927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:52:09.086927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:52:09.086927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:52:09.086927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:09.086927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 13:52:09.086927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:09.086927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:09.086927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:09.086927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:09.086927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:09.086927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:09.086927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:09.086927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:09.088224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:09.088224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:09.088224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:09.088224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:09.088224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:09.088224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:09.088224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:52:09.088224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:52:09.088224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:52:09.088224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:52:09.088224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:09.088224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:09.088224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:09.088224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:09.088224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:09.088224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:09.089064 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:09.089064 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:09.089064 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:09.089064 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:09.089064 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:09.089064 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:09.089064 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:09.089064 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:09.089064 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:09.089064 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:09.089064 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:52:09.089064 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:09.089064 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 13:52:09.089064 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:09.093360 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 420/843] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 19 13:52:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:09.095032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb5e6f-2db1-4fb4-9e94-074b4194f9b7 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:09.139157 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:09.151949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17000b-4e74-4173-860d-9f211ebfed21 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:09.189698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b75661-b947-4246-9173-982629f04498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:09.190768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b75661-b947-4246-9173-982629f04498 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:09.190893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b75661-b947-4246-9173-982629f04498 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:09.191254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b75661-b947-4246-9173-982629f04498 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:09.230615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fb5e6f-2db1-4fb4-9e94-074b4194f9b7 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:09.266010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b75661-b947-4246-9173-982629f04498 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:09.267540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b75661-b947-4246-9173-982629f04498 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:09.269162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f70ca2-2e76-4f08-9ce6-331b26fd1a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:09.270070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f70ca2-2e76-4f08-9ce6-331b26fd1a3a None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:09.270619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f70ca2-2e76-4f08-9ce6-331b26fd1a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:09.271111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f70ca2-2e76-4f08-9ce6-331b26fd1a3a None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:09.272020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f70ca2-2e76-4f08-9ce6-331b26fd1a3a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:09.272526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f70ca2-2e76-4f08-9ce6-331b26fd1a3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:09.274854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f70ca2-2e76-4f08-9ce6-331b26fd1a3a None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:09.281655 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 421/844] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 19 13:52:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:09.287754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f70ca2-2e76-4f08-9ce6-331b26fd1a3a None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:09.357106 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:09.390045 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:09.405958 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 424/845] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:52:09 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 13:52:09.411853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b75661-b947-4246-9173-982629f04498 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:09.417249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f70ca2-2e76-4f08-9ce6-331b26fd1a3a None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:09.454014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae09ce1-642f-4482-967c-61b31e482fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:09.454738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae09ce1-642f-4482-967c-61b31e482fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:09.455021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae09ce1-642f-4482-967c-61b31e482fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:09.455298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae09ce1-642f-4482-967c-61b31e482fe5 None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:09.456025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae09ce1-642f-4482-967c-61b31e482fe5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:09.456335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae09ce1-642f-4482-967c-61b31e482fe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:09.457775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae09ce1-642f-4482-967c-61b31e482fe5 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:09.463565 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 422/846] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 19 13:52:09 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:09.529413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b75661-b947-4246-9173-982629f04498 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:09.560178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a743a0-61b7-4cb1-a1ed-529ffab0f7aa None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:09.560500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a743a0-61b7-4cb1-a1ed-529ffab0f7aa None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:09.560749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a743a0-61b7-4cb1-a1ed-529ffab0f7aa None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:09.562410 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 423/847] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:52:09.567230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20a69e-6c93-44fa-a4c5-5c8288b7fbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:09.568044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20a69e-6c93-44fa-a4c5-5c8288b7fbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:09.568324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20a69e-6c93-44fa-a4c5-5c8288b7fbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:09.568432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee659aef-b6e0-4ee1-86ca-eff61916e5df None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:09.568592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f20a69e-6c93-44fa-a4c5-5c8288b7fbf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:09.568698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee659aef-b6e0-4ee1-86ca-eff61916e5df None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:09.568950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee659aef-b6e0-4ee1-86ca-eff61916e5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:09.582656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20a69e-6c93-44fa-a4c5-5c8288b7fbf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:09.584460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f20a69e-6c93-44fa-a4c5-5c8288b7fbf1 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:09.587826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ee659aef-b6e0-4ee1-86ca-eff61916e5df None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:09.589067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ee659aef-b6e0-4ee1-86ca-eff61916e5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:09.609523 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-5f20a69e-6c93-44fa-a4c5-5c8288b7fbf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:09.609523 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:09.609523 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:09.609523 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:09.609523 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:09.609523 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:09.609523 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:09.609523 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:09.609523 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:09.609523 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:09.609523 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:09.609523 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:09.609523 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:09.609523 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:09.609523 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:09.610512 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:09.610512 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:09.610512 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:09.610512 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:09.610512 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:09.610512 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:09.610512 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:09.610512 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:09.610512 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:09.610512 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:09.610512 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:09.610512 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:09.610512 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:09.610512 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:09.610512 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:09.610512 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:09.610512 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:09.611423 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:09.611423 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:09.611423 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:09.611423 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:09.611423 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 425/848] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:09.618366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20a69e-6c93-44fa-a4c5-5c8288b7fbf1 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:09.672119 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:09.678371 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 424/849] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:09 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:09.698385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee659aef-b6e0-4ee1-86ca-eff61916e5df None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:09.742152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f20a69e-6c93-44fa-a4c5-5c8288b7fbf1 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:09.755874 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:09.780757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e4bd5-f0e8-4f1a-b126-a4ae57831f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:09.781353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e4bd5-f0e8-4f1a-b126-a4ae57831f05 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:09.781639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e4bd5-f0e8-4f1a-b126-a4ae57831f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:09.782278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e4bd5-f0e8-4f1a-b126-a4ae57831f05 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:09.782680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e4bd5-f0e8-4f1a-b126-a4ae57831f05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:09.782989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e4bd5-f0e8-4f1a-b126-a4ae57831f05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:09.784512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e4bd5-f0e8-4f1a-b126-a4ae57831f05 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:09.798325 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 426/850] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:09.803319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e4bd5-f0e8-4f1a-b126-a4ae57831f05 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:09.825014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee659aef-b6e0-4ee1-86ca-eff61916e5df None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:09.877334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2e550-9d3a-41e3-a5ac-5d0e33d65c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:09.878798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2e550-9d3a-41e3-a5ac-5d0e33d65c80 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:09.879885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2e550-9d3a-41e3-a5ac-5d0e33d65c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:09.880389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2e550-9d3a-41e3-a5ac-5d0e33d65c80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:09.894940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2e550-9d3a-41e3-a5ac-5d0e33d65c80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:52:09.904087 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-8dd2e550-9d3a-41e3-a5ac-5d0e33d65c80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:52:09.904087 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:09.904087 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:09.904087 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:09.904087 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:09.904087 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:09.904087 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:09.904087 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:09.904087 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:09.904087 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:09.904087 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:09.904087 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:09.904087 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:52:09.904087 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:52:09.904087 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:52:09.904087 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:52:09.905068 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:52:09.905068 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:52:09.905068 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:52:09.905068 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:52:09.905068 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:09.905068 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:09.905068 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:09.905068 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:09.905068 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:09.905068 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:09.905068 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:09.905068 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:09.905068 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:09.905068 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:09.905068 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:09.905068 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:09.905936 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:09.905936 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:09.905936 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:09.905936 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:09.905936 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:52:09.905936 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:52:09.905936 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:52:09.905936 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:52:09.905936 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:52:09.905936 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:52:09.905936 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:52:09.905936 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:09.910533 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 425/851] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:52:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:09.911427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2e550-9d3a-41e3-a5ac-5d0e33d65c80 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:09.925796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e4bd5-f0e8-4f1a-b126-a4ae57831f05 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:09.928130 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:09.971876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836d1a7-db14-4deb-b05d-3da48ec8259d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:09.973701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836d1a7-db14-4deb-b05d-3da48ec8259d None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:09.974161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836d1a7-db14-4deb-b05d-3da48ec8259d None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:09.974744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836d1a7-db14-4deb-b05d-3da48ec8259d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:09.984943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836d1a7-db14-4deb-b05d-3da48ec8259d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:09.986811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836d1a7-db14-4deb-b05d-3da48ec8259d None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:10.005106 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-a836d1a7-db14-4deb-b05d-3da48ec8259d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:10.005106 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:10.005106 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:10.005106 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:10.005106 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:10.005106 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:10.005106 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:10.005106 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:10.005106 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:10.005106 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:10.005106 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:10.005106 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:10.005106 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:52:10.005106 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:52:10.005106 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:52:10.006264 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:52:10.006264 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:10.006264 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:10.006264 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:10.006264 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:10.006264 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:10.006264 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:10.006264 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:10.006264 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:10.006264 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:10.006264 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:10.006264 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:10.006264 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:10.006264 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:10.006264 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:10.006264 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:10.006264 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:10.007395 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:52:10.007395 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:52:10.007395 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:52:10.007395 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:52:10.007395 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:52:10.007395 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:52:10.007395 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:10.007395 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:10.015058 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 427/852] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:52:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:10.016684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836d1a7-db14-4deb-b05d-3da48ec8259d None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:10.033326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2e550-9d3a-41e3-a5ac-5d0e33d65c80 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:10.041602 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:10.072613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196a771-2dd1-48f5-bfe0-24250ef7cd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:10.073261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196a771-2dd1-48f5-bfe0-24250ef7cd2b None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:10.073501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196a771-2dd1-48f5-bfe0-24250ef7cd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:10.073682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196a771-2dd1-48f5-bfe0-24250ef7cd2b None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:10.074479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196a771-2dd1-48f5-bfe0-24250ef7cd2b None admin] RBAC: Adding query filter params (name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:10.074788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196a771-2dd1-48f5-bfe0-24250ef7cd2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:10.077280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9196a771-2dd1-48f5-bfe0-24250ef7cd2b None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:10.090486 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 426/853] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 19 13:52:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:10.092449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196a771-2dd1-48f5-bfe0-24250ef7cd2b None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:10.149782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836d1a7-db14-4deb-b05d-3da48ec8259d None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:10.201435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7b8af-c37c-47c8-9939-068b6d28dee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:10.202596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7b8af-c37c-47c8-9939-068b6d28dee7 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:10.203309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7b8af-c37c-47c8-9939-068b6d28dee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:10.204163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7b8af-c37c-47c8-9939-068b6d28dee7 None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:10.207801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7b8af-c37c-47c8-9939-068b6d28dee7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:10.207801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7b8af-c37c-47c8-9939-068b6d28dee7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:10.208781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d7b8af-c37c-47c8-9939-068b6d28dee7 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:10.222045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9196a771-2dd1-48f5-bfe0-24250ef7cd2b None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:10.236807 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 428/854] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:52:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:10.237599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7b8af-c37c-47c8-9939-068b6d28dee7 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:10.265099 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:10.265288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3a281-e92e-4d3f-98d0-adbdbfb86262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:10.266602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3a281-e92e-4d3f-98d0-adbdbfb86262 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:10.266916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3a281-e92e-4d3f-98d0-adbdbfb86262 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:10.267388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3a281-e92e-4d3f-98d0-adbdbfb86262 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:10.279740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3a281-e92e-4d3f-98d0-adbdbfb86262 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:10.287886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3a281-e92e-4d3f-98d0-adbdbfb86262 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:10.300162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-68c3a281-e92e-4d3f-98d0-adbdbfb86262 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:10.300162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:10.300162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:10.300162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:10.300162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:10.300162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:10.300162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:10.300162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:10.300162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:10.300162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:10.300162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:10.300162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:10.300162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:10.300162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:10.300162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:10.301058 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:10.301058 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:10.301058 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:10.301058 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:10.301058 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:10.301058 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:10.301058 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:10.301058 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:10.301058 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:10.301058 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:10.301058 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:10.301058 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:10.301058 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:10.301058 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:10.301058 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:10.301058 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:10.301058 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:10.301980 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:10.301980 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:10.301980 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:10.301980 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:10.307379 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 427/855] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:10.308970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3a281-e92e-4d3f-98d0-adbdbfb86262 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:10.333497 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:10.351680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7b8af-c37c-47c8-9939-068b6d28dee7 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:10.388039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb613c9a-921c-4648-a8c1-6ff93c423a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:10.389064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb613c9a-921c-4648-a8c1-6ff93c423a3c None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:10.389574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb613c9a-921c-4648-a8c1-6ff93c423a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:10.390064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb613c9a-921c-4648-a8c1-6ff93c423a3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:10.391128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb613c9a-921c-4648-a8c1-6ff93c423a3c None admin] RBAC: Adding query filter params (role.id=bc315edf089d43b18acf9790031f3fcb, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=0789b4be9dae4c05bb3ec4a5e0f1f308) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:10.391641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb613c9a-921c-4648-a8c1-6ff93c423a3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:10.393262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb613c9a-921c-4648-a8c1-6ff93c423a3c None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:10.406388 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 429/856] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:52:10 2022] GET /identity/v3/role_assignments?user.id=0789b4be9dae4c05bb3ec4a5e0f1f308&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=bc315edf089d43b18acf9790031f3fcb => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:10.417455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81d639-b579-4ce8-a1d4-7017f8b0af2a None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:10.417777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81d639-b579-4ce8-a1d4-7017f8b0af2a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:10.418009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81d639-b579-4ce8-a1d4-7017f8b0af2a None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:10.423202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3a281-e92e-4d3f-98d0-adbdbfb86262 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:10.423794 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 430/857] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:52:10.425213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84f2bc-f3c6-4aad-9877-0223924a74ff None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:10.425611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84f2bc-f3c6-4aad-9877-0223924a74ff None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:10.425894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84f2bc-f3c6-4aad-9877-0223924a74ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:10.444126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1a84f2bc-f3c6-4aad-9877-0223924a74ff None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:10.445338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1a84f2bc-f3c6-4aad-9877-0223924a74ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:10.468107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7e80c-40ce-4b70-b312-91a3cd5b9622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:10.468805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7e80c-40ce-4b70-b312-91a3cd5b9622 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:10.469092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7e80c-40ce-4b70-b312-91a3cd5b9622 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:10.469371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce7e80c-40ce-4b70-b312-91a3cd5b9622 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:10.470148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7e80c-40ce-4b70-b312-91a3cd5b9622 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:10.470460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7e80c-40ce-4b70-b312-91a3cd5b9622 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:10.472002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce7e80c-40ce-4b70-b312-91a3cd5b9622 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:10.491095 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 428/858] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:10.492276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7e80c-40ce-4b70-b312-91a3cd5b9622 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:10.534477 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 431/859] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 13:52:10.553330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84f2bc-f3c6-4aad-9877-0223924a74ff None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:10.584397 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:10.591168 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:10.621433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce7e80c-40ce-4b70-b312-91a3cd5b9622 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:10.671596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb95c5-4aba-4d17-80a6-408fa508e675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:10.673059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb95c5-4aba-4d17-80a6-408fa508e675 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:10.673940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb95c5-4aba-4d17-80a6-408fa508e675 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:10.674514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb95c5-4aba-4d17-80a6-408fa508e675 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:10.684528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb95c5-4aba-4d17-80a6-408fa508e675 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:10.686830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb95c5-4aba-4d17-80a6-408fa508e675 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:10.691060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84f2bc-f3c6-4aad-9877-0223924a74ff None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:10.707207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-6fcb95c5-4aba-4d17-80a6-408fa508e675 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 13:52:10.707207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:10.707207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:10.707207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:10.707207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:10.707207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:10.707207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:10.707207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:10.707207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:10.707207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:10.707207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:10.707207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:10.707207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:52:10.707207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:52:10.707207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:52:10.707207 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:52:10.708173 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:10.708173 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:10.708173 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:52:10.708173 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:10.708173 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:52:10.708173 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:10.708173 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:10.708173 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:10.708173 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:10.708173 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:10.708173 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:10.708173 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:10.708173 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:10.708173 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:10.708173 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:10.708173 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:10.708173 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:10.708173 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:10.709123 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:10.709123 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:10.709123 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:52:10.709123 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:52:10.709123 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:52:10.709123 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:52:10.709123 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:52:10.709123 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:52:10.709123 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 13:52:10.709123 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:10.712817 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 429/860] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jul 19 13:52:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:10.719406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb95c5-4aba-4d17-80a6-408fa508e675 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:10.738913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee0404-e2b8-4436-b75b-abda7a3f13ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:10.739982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee0404-e2b8-4436-b75b-abda7a3f13ee None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:10.740277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee0404-e2b8-4436-b75b-abda7a3f13ee None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:10.740555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ee0404-e2b8-4436-b75b-abda7a3f13ee None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:10.741763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee0404-e2b8-4436-b75b-abda7a3f13ee None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:10.743802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ee0404-e2b8-4436-b75b-abda7a3f13ee None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:10.760549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-b9ee0404-e2b8-4436-b75b-abda7a3f13ee None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 13:52:10.760549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:10.760549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:52:10.760549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:52:10.760549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:52:10.760549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:52:10.760549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:52:10.760549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:10.760549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 13:52:10.760549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:10.760549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:10.760549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:10.760549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:10.760549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:10.760549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:10.760549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:10.761537 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:10.761537 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:10.761537 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:10.761537 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:10.761537 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:10.761537 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:10.761537 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:10.761537 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:52:10.761537 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:52:10.761537 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:52:10.761537 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:52:10.761537 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:10.761537 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:10.761537 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:10.761537 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:10.761537 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:10.762507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:10.762507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:10.762507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:10.762507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:10.762507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:10.762507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:10.762507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:10.762507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:10.762507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:10.762507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:10.762507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:10.762507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:52:10.762507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:10.762507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 13:52:10.762507 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:10.770121 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 432/861] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Jul 19 13:52:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:10.771666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee0404-e2b8-4436-b75b-abda7a3f13ee None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:10.840582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb95c5-4aba-4d17-80a6-408fa508e675 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:10.874432 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:10.879089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e596d-f8ee-4fd5-8119-1f70fe68c2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:10.879764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e596d-f8ee-4fd5-8119-1f70fe68c2bf None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:10.880049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e596d-f8ee-4fd5-8119-1f70fe68c2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:10.880326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e596d-f8ee-4fd5-8119-1f70fe68c2bf None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:10.881182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e596d-f8ee-4fd5-8119-1f70fe68c2bf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:10.881496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e596d-f8ee-4fd5-8119-1f70fe68c2bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:10.882949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e596d-f8ee-4fd5-8119-1f70fe68c2bf None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:10.893685 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:10.904516 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 430/862] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Jul 19 13:52:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:10.909786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e596d-f8ee-4fd5-8119-1f70fe68c2bf None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:10.913360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ee0404-e2b8-4436-b75b-abda7a3f13ee None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:10.982208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cf216-04f2-4d61-b9c8-8d4adb430567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:10.983079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cf216-04f2-4d61-b9c8-8d4adb430567 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:10.983744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cf216-04f2-4d61-b9c8-8d4adb430567 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:10.984135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cf216-04f2-4d61-b9c8-8d4adb430567 None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:10.984960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cf216-04f2-4d61-b9c8-8d4adb430567 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:10.985508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cf216-04f2-4d61-b9c8-8d4adb430567 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:10.987365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cf216-04f2-4d61-b9c8-8d4adb430567 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:10.999853 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 433/863] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jul 19 13:52:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:10.999853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cf216-04f2-4d61-b9c8-8d4adb430567 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:11.085837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e596d-f8ee-4fd5-8119-1f70fe68c2bf None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:11.118420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cf216-04f2-4d61-b9c8-8d4adb430567 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:11.158869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538ea72-277d-4c10-812a-bc79c6561bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:11.159232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644a665-0702-4df4-b5e2-6e56eaa28ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:11.159856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644a665-0702-4df4-b5e2-6e56eaa28ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:11.160140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644a665-0702-4df4-b5e2-6e56eaa28ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:11.160456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644a665-0702-4df4-b5e2-6e56eaa28ea3 None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:11.161268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644a665-0702-4df4-b5e2-6e56eaa28ea3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:11.161579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644a665-0702-4df4-b5e2-6e56eaa28ea3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:11.162670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538ea72-277d-4c10-812a-bc79c6561bdc None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:11.162976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644a665-0702-4df4-b5e2-6e56eaa28ea3 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:11.164008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538ea72-277d-4c10-812a-bc79c6561bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:11.164997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538ea72-277d-4c10-812a-bc79c6561bdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:11.174634 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 434/864] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jul 19 13:52:10 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:11.353810 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:11.358867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538ea72-277d-4c10-812a-bc79c6561bdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:11.360326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538ea72-277d-4c10-812a-bc79c6561bdc None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:11.510355 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 431/865] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:52:10 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 13:52:11.516307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644a665-0702-4df4-b5e2-6e56eaa28ea3 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:11.527767 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:11.595466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983cb28-4efc-46a3-a497-e3172cc7aa0b None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:11.595786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983cb28-4efc-46a3-a497-e3172cc7aa0b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:11.596033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7983cb28-4efc-46a3-a497-e3172cc7aa0b None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:11.597660 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 432/866] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:11.603506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd53190-e1d1-416d-a500-c866be0d9861 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:11.603796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd53190-e1d1-416d-a500-c866be0d9861 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:11.604082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd53190-e1d1-416d-a500-c866be0d9861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:11.626120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-afd53190-e1d1-416d-a500-c866be0d9861 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:11.627370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-afd53190-e1d1-416d-a500-c866be0d9861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:11.628162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644a665-0702-4df4-b5e2-6e56eaa28ea3 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:11.666254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4adb9-c87f-4bb7-a609-6f646588ae14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:11.667396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4adb9-c87f-4bb7-a609-6f646588ae14 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:11.667879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4adb9-c87f-4bb7-a609-6f646588ae14 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:11.668325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4adb9-c87f-4bb7-a609-6f646588ae14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:11.679802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4adb9-c87f-4bb7-a609-6f646588ae14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:11.682203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4adb9-c87f-4bb7-a609-6f646588ae14 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:11.700793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-20b4adb9-c87f-4bb7-a609-6f646588ae14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:11.700793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:11.700793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:11.700793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:11.700793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:11.700793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:11.700793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:11.700793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:11.700793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:11.700793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:11.700793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:11.700793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:11.700793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:11.700793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:11.700793 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:11.701738 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:11.701738 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:11.701738 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:11.701738 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:11.701738 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:11.701738 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:11.701738 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:11.701738 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:11.701738 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:11.701738 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:11.701738 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:11.701738 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:11.701738 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:11.701738 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:11.701738 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:11.701738 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:11.701738 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:11.702665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:11.702665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:11.702665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:11.702665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:11.708920 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 435/867] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:11.709928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4adb9-c87f-4bb7-a609-6f646588ae14 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:11.718173 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 433/868] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 13:52:11.735868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd53190-e1d1-416d-a500-c866be0d9861 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:11.770381 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:11.779529 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:11.826466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4adb9-c87f-4bb7-a609-6f646588ae14 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:11.863395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd53190-e1d1-416d-a500-c866be0d9861 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:11.864478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de48e5-bd02-4a8f-896f-09ef179fccb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:11.865382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de48e5-bd02-4a8f-896f-09ef179fccb7 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:11.865875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de48e5-bd02-4a8f-896f-09ef179fccb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:11.866247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de48e5-bd02-4a8f-896f-09ef179fccb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:11.867039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de48e5-bd02-4a8f-896f-09ef179fccb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:11.867910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de48e5-bd02-4a8f-896f-09ef179fccb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:11.869562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de48e5-bd02-4a8f-896f-09ef179fccb7 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:11.886540 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 436/869] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:11.888290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de48e5-bd02-4a8f-896f-09ef179fccb7 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:11.909121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4455b8a-1db9-4956-a3ec-6971c302e965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:11.909913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4455b8a-1db9-4956-a3ec-6971c302e965 None admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:11.910233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4455b8a-1db9-4956-a3ec-6971c302e965 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:11.910518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4455b8a-1db9-4956-a3ec-6971c302e965 None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:11.911570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4455b8a-1db9-4956-a3ec-6971c302e965 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:11.913308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4455b8a-1db9-4956-a3ec-6971c302e965 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:11.971794 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 434/870] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 19 13:52:11 2022] POST /identity/v3/services => generated 251 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:52:12.008962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de48e5-bd02-4a8f-896f-09ef179fccb7 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:12.034240 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:12.059863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121da17-99ff-46be-9bc0-0ab903ff6813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:12.060857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121da17-99ff-46be-9bc0-0ab903ff6813 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:12.061141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121da17-99ff-46be-9bc0-0ab903ff6813 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:12.061416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121da17-99ff-46be-9bc0-0ab903ff6813 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:12.070062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121da17-99ff-46be-9bc0-0ab903ff6813 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:12.071943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121da17-99ff-46be-9bc0-0ab903ff6813 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:12.087894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-4121da17-99ff-46be-9bc0-0ab903ff6813 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:12.087894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:12.087894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:12.087894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:12.087894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:12.087894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:12.087894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:12.087894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:12.087894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:12.087894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:12.087894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:12.087894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:12.087894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:52:12.087894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:52:12.087894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:52:12.088861 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:52:12.088861 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:12.088861 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:12.088861 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:12.088861 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:12.088861 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:12.088861 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:12.088861 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:12.088861 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:12.088861 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:12.088861 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:12.088861 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:12.088861 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:12.088861 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:12.088861 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:12.088861 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:12.088861 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:12.089757 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:52:12.089757 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:52:12.089757 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:52:12.089757 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:52:12.089757 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:52:12.089757 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:52:12.089757 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:12.089757 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:12.089757 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 437/871] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:52:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:12.095419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4455b8a-1db9-4956-a3ec-6971c302e965 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:12.189992 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:12.202982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4455b8a-1db9-4956-a3ec-6971c302e965 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:12.238663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fedf17f-b481-452b-9bbc-cc33279f8a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:12.239331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedf17f-b481-452b-9bbc-cc33279f8a68 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:12.239613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedf17f-b481-452b-9bbc-cc33279f8a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:12.239885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fedf17f-b481-452b-9bbc-cc33279f8a68 None admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:12.240675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedf17f-b481-452b-9bbc-cc33279f8a68 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:12.240981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedf17f-b481-452b-9bbc-cc33279f8a68 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:12.242517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fedf17f-b481-452b-9bbc-cc33279f8a68 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:12.254972 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 435/872] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:52:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:12.261459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121da17-99ff-46be-9bc0-0ab903ff6813 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:12.367220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121da17-99ff-46be-9bc0-0ab903ff6813 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:12.402459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7310e6ae-ca94-443e-bfaf-9465c6642500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:12.403239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310e6ae-ca94-443e-bfaf-9465c6642500 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:12.403557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310e6ae-ca94-443e-bfaf-9465c6642500 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:12.403834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7310e6ae-ca94-443e-bfaf-9465c6642500 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:12.404666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310e6ae-ca94-443e-bfaf-9465c6642500 None admin] RBAC: Adding query filter params (role.id=56d47830104f4dc09f1076c75acf3ffd, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=ec07a12b28934ef9b04325404fd3c950) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:12.404976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310e6ae-ca94-443e-bfaf-9465c6642500 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:12.406471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7310e6ae-ca94-443e-bfaf-9465c6642500 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:12.412789 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 438/873] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:52:12 2022] GET /identity/v3/role_assignments?user.id=ec07a12b28934ef9b04325404fd3c950&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=56d47830104f4dc09f1076c75acf3ffd => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:12.614576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dab72d-db50-4bac-b0b0-02cfbdddea9a None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:12.615332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dab72d-db50-4bac-b0b0-02cfbdddea9a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:12.615892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dab72d-db50-4bac-b0b0-02cfbdddea9a None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:12.618281 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 436/874] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:12.623666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7d28c-b051-4eb7-99e0-d50b62fdad33 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:12.624202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7d28c-b051-4eb7-99e0-d50b62fdad33 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:12.624682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae7d28c-b051-4eb7-99e0-d50b62fdad33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:12.641763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9ae7d28c-b051-4eb7-99e0-d50b62fdad33 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:12.643227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9ae7d28c-b051-4eb7-99e0-d50b62fdad33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:12.679399 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:12.714513 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 439/875] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:12 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:12.737729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dab72d-db50-4bac-b0b0-02cfbdddea9a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:12.846314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dab72d-db50-4bac-b0b0-02cfbdddea9a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:12.883553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9f000-3a0d-4e89-960a-de825c7a5591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:12.884314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9f000-3a0d-4e89-960a-de825c7a5591 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:12.884602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9f000-3a0d-4e89-960a-de825c7a5591 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:12.884880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca9f000-3a0d-4e89-960a-de825c7a5591 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:12.885539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca9f000-3a0d-4e89-960a-de825c7a5591 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:12.886932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca9f000-3a0d-4e89-960a-de825c7a5591 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:12.899630 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-2ca9f000-3a0d-4e89-960a-de825c7a5591 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 13:52:12.899630 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:12.899630 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:52:12.899630 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:52:12.899630 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:52:12.899630 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:52:12.899630 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:52:12.899630 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:12.899630 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 13:52:12.899630 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:12.899630 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:12.899630 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:12.899630 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:12.899630 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:12.899630 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:12.899630 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:12.899630 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:12.900666 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:12.900666 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:12.900666 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:12.900666 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:12.900666 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:12.900666 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:12.900666 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:52:12.900666 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:52:12.900666 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:52:12.900666 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:52:12.900666 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:12.900666 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:12.900666 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:12.900666 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:12.900666 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:12.900666 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:12.901930 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:12.901930 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:12.901930 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:12.901930 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:12.901930 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:12.901930 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:12.901930 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:12.901930 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:12.901930 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:12.901930 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:12.901930 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:52:12.901930 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:12.901930 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 13:52:12.901930 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:12.901930 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 437/876] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jul 19 13:52:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:12.907129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae7d28c-b051-4eb7-99e0-d50b62fdad33 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:13.015623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae7d28c-b051-4eb7-99e0-d50b62fdad33 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:13.050993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4b5252-bbb5-4133-97c9-9d29cf2a9a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:13.051665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b5252-bbb5-4133-97c9-9d29cf2a9a3d None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:13.052002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b5252-bbb5-4133-97c9-9d29cf2a9a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:13.052284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4b5252-bbb5-4133-97c9-9d29cf2a9a3d None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:13.052999 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b5252-bbb5-4133-97c9-9d29cf2a9a3d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:13.053306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b5252-bbb5-4133-97c9-9d29cf2a9a3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:13.054701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4b5252-bbb5-4133-97c9-9d29cf2a9a3d None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:13.060441 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 440/877] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jul 19 13:52:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:13.066385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9f000-3a0d-4e89-960a-de825c7a5591 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:13.082536 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:13.174493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca9f000-3a0d-4e89-960a-de825c7a5591 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:13.230590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e40722-b6b0-47ae-920b-b1a3b68cb7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:13.231282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e40722-b6b0-47ae-920b-b1a3b68cb7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:13.231568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e40722-b6b0-47ae-920b-b1a3b68cb7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:13.231842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e40722-b6b0-47ae-920b-b1a3b68cb7d1 None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:13.232563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e40722-b6b0-47ae-920b-b1a3b68cb7d1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:13.232869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e40722-b6b0-47ae-920b-b1a3b68cb7d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:13.234260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e40722-b6b0-47ae-920b-b1a3b68cb7d1 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:13.239801 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 438/878] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jul 19 13:52:13 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:13.424187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ccad1-c453-4258-a51d-b66c41daf741 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:13.424624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ccad1-c453-4258-a51d-b66c41daf741 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:13.424730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ccad1-c453-4258-a51d-b66c41daf741 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:13.426424 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 441/879] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:13.432089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ca4b8-22a8-4764-b5d4-d17f55c017b4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:13.432602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ca4b8-22a8-4764-b5d4-d17f55c017b4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:13.433110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ca4b8-22a8-4764-b5d4-d17f55c017b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:13.450331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-cc0ca4b8-22a8-4764-b5d4-d17f55c017b4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:13.451781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cc0ca4b8-22a8-4764-b5d4-d17f55c017b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:13.524836 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 439/880] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:13 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 13:52:13.542275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ccad1-c453-4258-a51d-b66c41daf741 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:13.580731 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:13.653253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ccad1-c453-4258-a51d-b66c41daf741 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:13.689352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48228b-5a7e-41ab-87d7-2159790ffede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:13.689936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48228b-5a7e-41ab-87d7-2159790ffede None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:13.690251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48228b-5a7e-41ab-87d7-2159790ffede None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:13.690527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48228b-5a7e-41ab-87d7-2159790ffede None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:13.691318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48228b-5a7e-41ab-87d7-2159790ffede None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:13.692726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48228b-5a7e-41ab-87d7-2159790ffede None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:13.793483 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 442/881] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 19 13:52:13 2022] POST /identity/v3/services => generated 269 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:52:14.209987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde6155-fd62-43a2-9836-8206e751d7e7 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:14.209987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde6155-fd62-43a2-9836-8206e751d7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:14.209987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde6155-fd62-43a2-9836-8206e751d7e7 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:14.210943 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 440/882] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:14.217782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b72ec-36c5-4154-bf6d-3fd4b9487d3e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:14.218656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b72ec-36c5-4154-bf6d-3fd4b9487d3e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:14.219159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b72ec-36c5-4154-bf6d-3fd4b9487d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:14.240598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-aa4b72ec-36c5-4154-bf6d-3fd4b9487d3e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:14.241773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-aa4b72ec-36c5-4154-bf6d-3fd4b9487d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:14.319988 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 443/883] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:14.343681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde6155-fd62-43a2-9836-8206e751d7e7 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:14.354775 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:14.455745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde6155-fd62-43a2-9836-8206e751d7e7 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:14.492210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7de99b-7d5d-4b2e-9982-a8119916ca81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:14.493880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7de99b-7d5d-4b2e-9982-a8119916ca81 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:14.494393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7de99b-7d5d-4b2e-9982-a8119916ca81 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:14.494887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7de99b-7d5d-4b2e-9982-a8119916ca81 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:14.495739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7de99b-7d5d-4b2e-9982-a8119916ca81 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:14.497309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7de99b-7d5d-4b2e-9982-a8119916ca81 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:14.510758 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-0a7de99b-7d5d-4b2e-9982-a8119916ca81 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 13:52:14.510758 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:14.510758 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:52:14.510758 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:52:14.510758 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:52:14.510758 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:52:14.510758 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:52:14.510758 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:14.510758 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 13:52:14.510758 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:14.510758 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:14.510758 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:14.510758 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:14.510758 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:14.510758 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:14.510758 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:14.510758 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:14.511784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:14.511784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:14.511784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:14.511784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:14.511784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:14.511784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:14.511784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:52:14.511784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:52:14.511784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:52:14.511784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:52:14.511784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:14.511784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:14.511784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:14.511784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:14.511784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:14.511784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:14.512612 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:14.512612 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:14.512612 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:14.512612 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:14.512612 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:14.512612 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:14.512612 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:14.512612 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:14.512612 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:14.512612 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:14.512612 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:52:14.512612 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:14.512612 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 13:52:14.512612 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:14.515482 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 441/884] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 19 13:52:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:14.521444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b72ec-36c5-4154-bf6d-3fd4b9487d3e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:14.544096 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:14.607107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a26189-33af-43e0-82e9-846670d5fe97 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:14.607751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a26189-33af-43e0-82e9-846670d5fe97 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:14.608230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a26189-33af-43e0-82e9-846670d5fe97 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:14.610023 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 442/885] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:14.615974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987527c4-75ca-46b1-8035-e32c5ba8c097 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:14.616883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987527c4-75ca-46b1-8035-e32c5ba8c097 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:14.617424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987527c4-75ca-46b1-8035-e32c5ba8c097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:14.628897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b72ec-36c5-4154-bf6d-3fd4b9487d3e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:14.638809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-987527c4-75ca-46b1-8035-e32c5ba8c097 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:14.640822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-987527c4-75ca-46b1-8035-e32c5ba8c097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:14.661960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47988ac-8cf3-4226-bada-a0b0e822a276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:14.662937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47988ac-8cf3-4226-bada-a0b0e822a276 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:14.663382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47988ac-8cf3-4226-bada-a0b0e822a276 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:14.663659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47988ac-8cf3-4226-bada-a0b0e822a276 None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:14.664877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47988ac-8cf3-4226-bada-a0b0e822a276 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:14.665269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47988ac-8cf3-4226-bada-a0b0e822a276 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:14.666669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47988ac-8cf3-4226-bada-a0b0e822a276 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:14.671693 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 444/886] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 19 13:52:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:14.678245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47988ac-8cf3-4226-bada-a0b0e822a276 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:14.721823 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:14.734090 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 443/887] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:14 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:14.752820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987527c4-75ca-46b1-8035-e32c5ba8c097 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:14.775436 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:14.793770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47988ac-8cf3-4226-bada-a0b0e822a276 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:14.834048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72919fe-73a1-46bc-b89d-6d6aa845ca58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:14.835118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72919fe-73a1-46bc-b89d-6d6aa845ca58 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:14.835643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72919fe-73a1-46bc-b89d-6d6aa845ca58 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:14.836656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72919fe-73a1-46bc-b89d-6d6aa845ca58 None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:14.837586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72919fe-73a1-46bc-b89d-6d6aa845ca58 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:14.838166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72919fe-73a1-46bc-b89d-6d6aa845ca58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:14.839778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72919fe-73a1-46bc-b89d-6d6aa845ca58 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:14.845359 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 445/888] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 19 13:52:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:14.855120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72919fe-73a1-46bc-b89d-6d6aa845ca58 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:14.882630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987527c4-75ca-46b1-8035-e32c5ba8c097 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:14.922476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a31bdc-d432-40bf-b7fd-49feaf118fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:14.923303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a31bdc-d432-40bf-b7fd-49feaf118fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:14.923588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a31bdc-d432-40bf-b7fd-49feaf118fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:14.923871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a31bdc-d432-40bf-b7fd-49feaf118fb6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:14.937232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a31bdc-d432-40bf-b7fd-49feaf118fb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:52:14.947066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-33a31bdc-d432-40bf-b7fd-49feaf118fb6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 13:52:14.947066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:14.947066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:14.947066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:14.947066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:14.947066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:14.947066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:14.947066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:14.947066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:14.947066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:14.947066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:14.947066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:14.947066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:52:14.947066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:52:14.947066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:52:14.947066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:52:14.948084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:52:14.948084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:52:14.948084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:52:14.948084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:52:14.948084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:14.948084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:14.948084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:14.948084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:14.948084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:14.948084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:14.948084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:14.948084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:14.948084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:14.948084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:14.948084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:14.948084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:14.948927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:14.948927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:14.948927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:14.948927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:14.948927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:52:14.948927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:52:14.948927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:52:14.948927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:52:14.948927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:52:14.948927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:52:14.948927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 13:52:14.948927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:14.948927 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 444/889] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Jul 19 13:52:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:14.954324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a31bdc-d432-40bf-b7fd-49feaf118fb6 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:14.967759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72919fe-73a1-46bc-b89d-6d6aa845ca58 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:15.004037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090d2f4-46ac-4c36-8a38-12ccca19035e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:15.004931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090d2f4-46ac-4c36-8a38-12ccca19035e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:15.005371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090d2f4-46ac-4c36-8a38-12ccca19035e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:15.005805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c090d2f4-46ac-4c36-8a38-12ccca19035e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:15.006763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090d2f4-46ac-4c36-8a38-12ccca19035e None admin] RBAC: Adding query filter params (interface=public, service_id=91814b99a4194a87b3bb6097a09dc5d0, region_id=RegionOne) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:15.007217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090d2f4-46ac-4c36-8a38-12ccca19035e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:15.008895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c090d2f4-46ac-4c36-8a38-12ccca19035e None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:15.014872 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 446/890] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jul 19 13:52:14 2022] GET /identity/v3/endpoints?service_id=91814b99a4194a87b3bb6097a09dc5d0&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:15.021446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090d2f4-46ac-4c36-8a38-12ccca19035e None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:15.028766 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:15.045009 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:15.078841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a31bdc-d432-40bf-b7fd-49feaf118fb6 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:15.117213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab9fbb-01c9-4828-afd3-7b68d5705fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:15.118229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab9fbb-01c9-4828-afd3-7b68d5705fda None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:15.118751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab9fbb-01c9-4828-afd3-7b68d5705fda None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:15.119225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ab9fbb-01c9-4828-afd3-7b68d5705fda None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:15.120170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab9fbb-01c9-4828-afd3-7b68d5705fda None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:15.120692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab9fbb-01c9-4828-afd3-7b68d5705fda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:15.122271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ab9fbb-01c9-4828-afd3-7b68d5705fda None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:15.131400 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 445/891] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Jul 19 13:52:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:15.140066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab9fbb-01c9-4828-afd3-7b68d5705fda None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:15.143515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c090d2f4-46ac-4c36-8a38-12ccca19035e None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:15.183424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645df34-7710-456b-88e3-18517c4b614a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:15.184216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645df34-7710-456b-88e3-18517c4b614a None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:15.184507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645df34-7710-456b-88e3-18517c4b614a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:15.184786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645df34-7710-456b-88e3-18517c4b614a None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:15.185550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645df34-7710-456b-88e3-18517c4b614a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:15.187058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645df34-7710-456b-88e3-18517c4b614a None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:15.202462 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 447/892] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jul 19 13:52:15 2022] GET /identity/v3/services => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 13:52:15.262750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ab9fbb-01c9-4828-afd3-7b68d5705fda None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:15.288356 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:15.302941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26994f0-6074-4d91-89ff-85af9cadaaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:15.303777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26994f0-6074-4d91-89ff-85af9cadaaca None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:15.306962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26994f0-6074-4d91-89ff-85af9cadaaca None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:15.306962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26994f0-6074-4d91-89ff-85af9cadaaca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:15.317650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26994f0-6074-4d91-89ff-85af9cadaaca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:15.319230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26994f0-6074-4d91-89ff-85af9cadaaca None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:15.339578 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-c26994f0-6074-4d91-89ff-85af9cadaaca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:15.339578 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:15.339578 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:15.339578 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:15.339578 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:15.339578 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:15.339578 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:15.339578 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:15.339578 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:15.339578 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:15.339578 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:15.339578 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:15.339578 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:15.339578 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:15.339578 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:15.340574 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:15.340574 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:15.340574 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:15.340574 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:15.340574 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:15.340574 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:15.340574 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:15.340574 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:15.340574 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:15.340574 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:15.340574 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:15.340574 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:15.340574 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:15.340574 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:15.340574 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:15.340574 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:15.340574 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:15.341482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:15.341482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:15.341482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:15.341482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:15.341482 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 446/893] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:15.348044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645df34-7710-456b-88e3-18517c4b614a None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:15.433673 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:15.456776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87aa57b-9130-43c7-a836-da0c6113fa43 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:15.457110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87aa57b-9130-43c7-a836-da0c6113fa43 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:15.457334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87aa57b-9130-43c7-a836-da0c6113fa43 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:15.459041 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 447/894] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:52:15.459152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645df34-7710-456b-88e3-18517c4b614a None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:15.464348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5537c-2b3c-4e01-a56c-a30748e118a5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:15.464720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5537c-2b3c-4e01-a56c-a30748e118a5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:15.465008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5537c-2b3c-4e01-a56c-a30748e118a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:15.484627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a3a5537c-2b3c-4e01-a56c-a30748e118a5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:15.485806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a3a5537c-2b3c-4e01-a56c-a30748e118a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:15.498615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c5bf9-93ba-44dc-8b4f-f7b947985875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:15.499293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c5bf9-93ba-44dc-8b4f-f7b947985875 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:15.499580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c5bf9-93ba-44dc-8b4f-f7b947985875 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:15.499862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c5bf9-93ba-44dc-8b4f-f7b947985875 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:15.500595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c5bf9-93ba-44dc-8b4f-f7b947985875 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:15.501005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c5bf9-93ba-44dc-8b4f-f7b947985875 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:15.502528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c5bf9-93ba-44dc-8b4f-f7b947985875 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:15.515481 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 448/895] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:15.520601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c5bf9-93ba-44dc-8b4f-f7b947985875 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:15.570244 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 448/896] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:15 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 13:52:15.591854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5537c-2b3c-4e01-a56c-a30748e118a5 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:15.648178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c5bf9-93ba-44dc-8b4f-f7b947985875 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:15.683589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f7fad-0ee4-483a-b951-51dbb2cfbe56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:15.684402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f7fad-0ee4-483a-b951-51dbb2cfbe56 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:15.684926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f7fad-0ee4-483a-b951-51dbb2cfbe56 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:15.685426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f7fad-0ee4-483a-b951-51dbb2cfbe56 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:15.688536 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:15.694353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f7fad-0ee4-483a-b951-51dbb2cfbe56 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:15.695887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f7fad-0ee4-483a-b951-51dbb2cfbe56 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:15.711696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-a18f7fad-0ee4-483a-b951-51dbb2cfbe56 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 13:52:15.711696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:15.711696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:15.711696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:15.711696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:15.711696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:15.711696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:15.711696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:15.711696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:15.711696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:15.711696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:15.711696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:15.711696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:52:15.711696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:52:15.711696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:52:15.711696 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:52:15.712706 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:15.712706 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:15.712706 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:52:15.712706 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:15.712706 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:52:15.712706 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:15.712706 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:15.712706 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:15.712706 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:15.712706 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:15.712706 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:15.712706 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:15.712706 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:15.712706 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:15.712706 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:15.712706 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:15.712706 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:15.712706 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:15.713704 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:15.713704 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:15.713704 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:52:15.713704 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:52:15.713704 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:52:15.713704 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:52:15.713704 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:52:15.713704 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:52:15.713704 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 13:52:15.713704 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:15.714272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5537c-2b3c-4e01-a56c-a30748e118a5 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:15.720742 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 449/897] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jul 19 13:52:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:15.721196 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:15.721928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f7fad-0ee4-483a-b951-51dbb2cfbe56 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:15.755282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1c61c-8d64-4582-b011-7d7dbf2bd08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:15.756386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1c61c-8d64-4582-b011-7d7dbf2bd08a None admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:15.756681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1c61c-8d64-4582-b011-7d7dbf2bd08a None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:15.756960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1c61c-8d64-4582-b011-7d7dbf2bd08a None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:15.757978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1c61c-8d64-4582-b011-7d7dbf2bd08a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:15.759588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1c61c-8d64-4582-b011-7d7dbf2bd08a None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:15.830851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f7fad-0ee4-483a-b951-51dbb2cfbe56 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:15.850337 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 449/898] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 19 13:52:15 2022] POST /identity/v3/services => generated 241 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 13:52:15.881348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c2f24-0620-4805-a0e9-b24cf1739828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:15.882038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c2f24-0620-4805-a0e9-b24cf1739828 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:15.882404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c2f24-0620-4805-a0e9-b24cf1739828 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:15.882733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c2f24-0620-4805-a0e9-b24cf1739828 None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:15.884303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c2f24-0620-4805-a0e9-b24cf1739828 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:15.884672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c2f24-0620-4805-a0e9-b24cf1739828 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:15.885873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3325b0-3377-4b57-b797-fcd86a38b90c None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:15.886059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c2f24-0620-4805-a0e9-b24cf1739828 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:15.886215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3325b0-3377-4b57-b797-fcd86a38b90c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:15.886476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3325b0-3377-4b57-b797-fcd86a38b90c None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:15.888060 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 450/899] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:52:15.893654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193d2df-24ea-4e8d-9bec-36e99e5e0e65 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:15.893950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193d2df-24ea-4e8d-9bec-36e99e5e0e65 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:15.894257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193d2df-24ea-4e8d-9bec-36e99e5e0e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:15.907916 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 450/900] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Jul 19 13:52:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:15.912626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6193d2df-24ea-4e8d-9bec-36e99e5e0e65 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:15.913557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c2f24-0620-4805-a0e9-b24cf1739828 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:15.913850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6193d2df-24ea-4e8d-9bec-36e99e5e0e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:15.978297 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:16.015220 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 451/901] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 13:52:16.040457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193d2df-24ea-4e8d-9bec-36e99e5e0e65 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:16.045674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c2f24-0620-4805-a0e9-b24cf1739828 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:16.085834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3052c9-d096-4ccf-8461-89909c33ffd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:16.086502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3052c9-d096-4ccf-8461-89909c33ffd6 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:16.086785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3052c9-d096-4ccf-8461-89909c33ffd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:16.087067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3052c9-d096-4ccf-8461-89909c33ffd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:16.156711 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:16.163583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193d2df-24ea-4e8d-9bec-36e99e5e0e65 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:16.181910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3052c9-d096-4ccf-8461-89909c33ffd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:16.183397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3052c9-d096-4ccf-8461-89909c33ffd6 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:16.200222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8814b-32a2-420c-8c2e-c848f97187a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:16.201144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8814b-32a2-420c-8c2e-c848f97187a1 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:16.201431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8814b-32a2-420c-8c2e-c848f97187a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:16.201715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8814b-32a2-420c-8c2e-c848f97187a1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:16.202489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8814b-32a2-420c-8c2e-c848f97187a1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:16.203919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8814b-32a2-420c-8c2e-c848f97187a1 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:16.217344 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-d7d8814b-32a2-420c-8c2e-c848f97187a1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 13:52:16.217344 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:16.217344 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:52:16.217344 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:52:16.217344 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:52:16.217344 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:52:16.217344 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:52:16.217344 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:16.217344 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 13:52:16.217344 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:16.217344 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:16.217344 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:16.217344 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:16.217344 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:16.217344 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:16.217344 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:16.218635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:16.218635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:16.218635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:16.218635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:16.218635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:16.218635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:16.218635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:16.218635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:52:16.218635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:52:16.218635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:52:16.218635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:52:16.218635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:16.218635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:16.218635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:16.218635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:16.218635 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:16.219654 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:16.219654 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:16.219654 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:16.219654 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:16.219654 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:16.219654 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:16.219654 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:16.219654 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:16.219654 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:16.219654 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:16.219654 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:16.219654 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:52:16.219654 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:16.219654 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 13:52:16.219654 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:16.219654 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 452/902] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Jul 19 13:52:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:16.225357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8814b-32a2-420c-8c2e-c848f97187a1 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:16.256041 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:16.317998 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 451/903] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:52:15 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 13:52:16.319389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3052c9-d096-4ccf-8461-89909c33ffd6 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:16.337281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8814b-32a2-420c-8c2e-c848f97187a1 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:16.374694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8df089-1c77-4ffc-bcc2-66d6bee0fe33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:16.375380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8df089-1c77-4ffc-bcc2-66d6bee0fe33 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:16.375668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8df089-1c77-4ffc-bcc2-66d6bee0fe33 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:16.375949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8df089-1c77-4ffc-bcc2-66d6bee0fe33 None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:16.376676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8df089-1c77-4ffc-bcc2-66d6bee0fe33 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:16.376984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8df089-1c77-4ffc-bcc2-66d6bee0fe33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:16.378445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8df089-1c77-4ffc-bcc2-66d6bee0fe33 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:16.391262 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 453/904] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jul 19 13:52:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:16.392535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8df089-1c77-4ffc-bcc2-66d6bee0fe33 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:16.422998 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:16.438082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3052c9-d096-4ccf-8461-89909c33ffd6 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:16.479821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962d301-ad8c-4217-9806-cc161c656cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:16.480155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962d301-ad8c-4217-9806-cc161c656cbd None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:16.480391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962d301-ad8c-4217-9806-cc161c656cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:16.480668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962d301-ad8c-4217-9806-cc161c656cbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:16.492062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962d301-ad8c-4217-9806-cc161c656cbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:16.494729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962d301-ad8c-4217-9806-cc161c656cbd None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:16.511844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8df089-1c77-4ffc-bcc2-66d6bee0fe33 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:16.513971 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-2962d301-ad8c-4217-9806-cc161c656cbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:16.513971 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:16.513971 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:16.513971 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:16.513971 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:16.513971 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:16.513971 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:16.513971 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:16.513971 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:16.513971 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:16.513971 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:16.513971 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:16.513971 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:16.513971 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:16.513971 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:16.514890 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:16.514890 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:16.514890 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:16.514890 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:16.514890 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:16.514890 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:16.514890 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:16.514890 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:16.514890 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:16.514890 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:16.514890 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:16.514890 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:16.514890 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:16.514890 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:16.514890 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:16.514890 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:16.514890 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:16.515783 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:16.515783 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:16.515783 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:16.515783 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:16.519994 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 452/905] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:16.520825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962d301-ad8c-4217-9806-cc161c656cbd None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:16.523560 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:16.554061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105f3af-079b-474d-bd02-b6f454feca85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:16.555777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105f3af-079b-474d-bd02-b6f454feca85 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:16.556414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105f3af-079b-474d-bd02-b6f454feca85 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:16.556981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2105f3af-079b-474d-bd02-b6f454feca85 None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:16.557884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105f3af-079b-474d-bd02-b6f454feca85 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:16.558434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105f3af-079b-474d-bd02-b6f454feca85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:16.560103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2105f3af-079b-474d-bd02-b6f454feca85 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:16.570441 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 454/906] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jul 19 13:52:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:16.571822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105f3af-079b-474d-bd02-b6f454feca85 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:16.635097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962d301-ad8c-4217-9806-cc161c656cbd None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:16.667532 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:16.673046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd6b1b-7066-45d0-92cf-381bc475ebc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:16.673744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd6b1b-7066-45d0-92cf-381bc475ebc1 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:16.674039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd6b1b-7066-45d0-92cf-381bc475ebc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:16.674355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd6b1b-7066-45d0-92cf-381bc475ebc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:16.675136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd6b1b-7066-45d0-92cf-381bc475ebc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:16.675448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd6b1b-7066-45d0-92cf-381bc475ebc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:16.676887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd6b1b-7066-45d0-92cf-381bc475ebc1 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:16.686134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2105f3af-079b-474d-bd02-b6f454feca85 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:16.694771 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 453/907] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:16.696253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd6b1b-7066-45d0-92cf-381bc475ebc1 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:16.727296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5b9d5-efd8-45da-88ae-53b7e89291d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:16.728630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5b9d5-efd8-45da-88ae-53b7e89291d8 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:16.729378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5b9d5-efd8-45da-88ae-53b7e89291d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:16.730282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5b9d5-efd8-45da-88ae-53b7e89291d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:16.731568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5b9d5-efd8-45da-88ae-53b7e89291d8 None admin] RBAC: Adding query filter params (interface=public, service_id=cdde6d8beef645c28f150e66d134d0a7, region_id=RegionOne) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:16.732093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5b9d5-efd8-45da-88ae-53b7e89291d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:16.734484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5b9d5-efd8-45da-88ae-53b7e89291d8 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:16.746127 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 455/908] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jul 19 13:52:16 2022] GET /identity/v3/endpoints?service_id=cdde6d8beef645c28f150e66d134d0a7&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:16.757765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5b9d5-efd8-45da-88ae-53b7e89291d8 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:16.768833 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:16.821915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd6b1b-7066-45d0-92cf-381bc475ebc1 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:16.864295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4b854-d4ad-4815-9526-42029291c49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:16.865405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4b854-d4ad-4815-9526-42029291c49a None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:16.865687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4b854-d4ad-4815-9526-42029291c49a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:16.866000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4b854-d4ad-4815-9526-42029291c49a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:16.874872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4b854-d4ad-4815-9526-42029291c49a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:16.875433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5b9d5-efd8-45da-88ae-53b7e89291d8 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:16.876318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4b854-d4ad-4815-9526-42029291c49a None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:16.894632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-41a4b854-d4ad-4815-9526-42029291c49a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:16.894632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:16.894632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:16.894632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:16.894632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:16.894632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:16.894632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:16.894632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:16.894632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:16.894632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:16.894632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:16.894632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:16.894632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:52:16.894632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:52:16.894632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:52:16.895536 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:52:16.895536 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:16.895536 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:16.895536 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:16.895536 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:16.895536 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:16.895536 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:16.895536 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:16.895536 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:16.895536 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:16.895536 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:16.895536 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:16.895536 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:16.895536 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:16.895536 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:16.895536 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:16.895536 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:16.896439 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:52:16.896439 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:52:16.896439 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:52:16.896439 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:52:16.896439 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:52:16.896439 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:52:16.896439 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:16.896439 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:16.901738 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 454/909] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:52:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:16.902818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4b854-d4ad-4815-9526-42029291c49a None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:16.917706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa76ad1-4072-444d-8b93-bb79f0af8975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:16.918753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa76ad1-4072-444d-8b93-bb79f0af8975 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:16.919234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa76ad1-4072-444d-8b93-bb79f0af8975 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:16.919731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa76ad1-4072-444d-8b93-bb79f0af8975 None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:16.920670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa76ad1-4072-444d-8b93-bb79f0af8975 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:16.922309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa76ad1-4072-444d-8b93-bb79f0af8975 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:16.934229 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 456/910] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jul 19 13:52:16 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 13:52:17.025493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4b854-d4ad-4815-9526-42029291c49a None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:17.051381 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:17.064913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91400d05-8596-4bb3-9302-b97e81843b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:17.065600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91400d05-8596-4bb3-9302-b97e81843b7e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:17.072985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91400d05-8596-4bb3-9302-b97e81843b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:17.072985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91400d05-8596-4bb3-9302-b97e81843b7e None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:17.072985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91400d05-8596-4bb3-9302-b97e81843b7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:17.072985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91400d05-8596-4bb3-9302-b97e81843b7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:17.072985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91400d05-8596-4bb3-9302-b97e81843b7e None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:17.083057 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 455/911] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:52:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:17.089764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa76ad1-4072-444d-8b93-bb79f0af8975 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:17.108439 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:17.196540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa76ad1-4072-444d-8b93-bb79f0af8975 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:17.233378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5efe24-9e2c-4618-b464-60bfc448019b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:17.234037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5efe24-9e2c-4618-b464-60bfc448019b None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:17.234346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5efe24-9e2c-4618-b464-60bfc448019b None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:17.234620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5efe24-9e2c-4618-b464-60bfc448019b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:17.235454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5efe24-9e2c-4618-b464-60bfc448019b None admin] RBAC: Adding query filter params (role.id=3841e5d49ee04bf08c66d1134dc3b552, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=ec07a12b28934ef9b04325404fd3c950) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:17.235763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5efe24-9e2c-4618-b464-60bfc448019b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:17.237176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5efe24-9e2c-4618-b464-60bfc448019b None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:17.243999 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 457/912] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:52:17 2022] GET /identity/v3/role_assignments?user.id=ec07a12b28934ef9b04325404fd3c950&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=3841e5d49ee04bf08c66d1134dc3b552 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:17.379956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898314d-d69b-4e67-b0ef-73e2905d9c66 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:17.380603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898314d-d69b-4e67-b0ef-73e2905d9c66 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:17.381087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898314d-d69b-4e67-b0ef-73e2905d9c66 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:17.383697 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 456/913] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:17.389557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a15cb5-c18d-43d9-8dd3-a8eb8cc1ceb2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:17.390471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a15cb5-c18d-43d9-8dd3-a8eb8cc1ceb2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:17.390975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a15cb5-c18d-43d9-8dd3-a8eb8cc1ceb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:17.408713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-09a15cb5-c18d-43d9-8dd3-a8eb8cc1ceb2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:17.410282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-09a15cb5-c18d-43d9-8dd3-a8eb8cc1ceb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:17.484541 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 458/914] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:17.511534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898314d-d69b-4e67-b0ef-73e2905d9c66 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:17.624536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898314d-d69b-4e67-b0ef-73e2905d9c66 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:17.659965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb67c9-265b-4077-9be8-6e5a93312ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:17.660764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb67c9-265b-4077-9be8-6e5a93312ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:17.661043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb67c9-265b-4077-9be8-6e5a93312ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:17.661313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb67c9-265b-4077-9be8-6e5a93312ae4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:17.661963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb67c9-265b-4077-9be8-6e5a93312ae4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:17.663421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb67c9-265b-4077-9be8-6e5a93312ae4 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:17.675764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-feeb67c9-265b-4077-9be8-6e5a93312ae4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 13:52:17.675764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:17.675764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:52:17.675764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:52:17.675764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:52:17.675764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:52:17.675764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:52:17.675764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:17.675764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 13:52:17.675764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:17.675764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:17.675764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:17.675764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:17.675764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:17.675764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:17.675764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:17.675764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:17.676791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:17.676791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:17.676791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:17.676791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:17.676791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:17.676791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:17.676791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:52:17.676791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:52:17.676791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:52:17.676791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:52:17.676791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:17.676791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:17.676791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:17.676791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:17.676791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:17.676791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:17.678049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:17.678049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:17.678049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:17.678049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:17.678049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:17.678049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:17.678049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:17.678049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:17.678049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:17.678049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:17.678049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:52:17.678049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:17.678049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 13:52:17.678049 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:17.678049 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 457/915] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 19 13:52:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:17.685251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a15cb5-c18d-43d9-8dd3-a8eb8cc1ceb2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:17.696651 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:17.790567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a15cb5-c18d-43d9-8dd3-a8eb8cc1ceb2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:17.825748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a13dfe-ba2a-4eb3-b5cd-7b265e198b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:17.826447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a13dfe-ba2a-4eb3-b5cd-7b265e198b8b None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:17.826727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a13dfe-ba2a-4eb3-b5cd-7b265e198b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:17.827003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a13dfe-ba2a-4eb3-b5cd-7b265e198b8b None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:17.827709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a13dfe-ba2a-4eb3-b5cd-7b265e198b8b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:17.828009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a13dfe-ba2a-4eb3-b5cd-7b265e198b8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:17.829362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a13dfe-ba2a-4eb3-b5cd-7b265e198b8b None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:17.834558 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 459/916] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 19 13:52:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:17.843185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb67c9-265b-4077-9be8-6e5a93312ae4 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:17.891257 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:17.948318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb67c9-265b-4077-9be8-6e5a93312ae4 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:17.986819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e12278-88ac-4656-a8f7-7437303adfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:17.987485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e12278-88ac-4656-a8f7-7437303adfd9 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:17.987765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e12278-88ac-4656-a8f7-7437303adfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:17.988038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e12278-88ac-4656-a8f7-7437303adfd9 None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:17.988745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e12278-88ac-4656-a8f7-7437303adfd9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:17.989044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e12278-88ac-4656-a8f7-7437303adfd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:17.990433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e12278-88ac-4656-a8f7-7437303adfd9 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:17.996746 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 458/917] 10.222.0.43 () {56 vars in 1114 bytes} [Tue Jul 19 13:52:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:18.003162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a13dfe-ba2a-4eb3-b5cd-7b265e198b8b None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:18.060337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706098ad-8b86-4907-b595-de85732e678f None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:18.060641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706098ad-8b86-4907-b595-de85732e678f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:18.060808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706098ad-8b86-4907-b595-de85732e678f None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:18.062312 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 459/918] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:18.068948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda5678-3a5f-42ab-82d8-69745c61b67a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:18.069233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda5678-3a5f-42ab-82d8-69745c61b67a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:18.069510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda5678-3a5f-42ab-82d8-69745c61b67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:18.076904 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:18.086050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-eeda5678-3a5f-42ab-82d8-69745c61b67a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:18.088823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-eeda5678-3a5f-42ab-82d8-69745c61b67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:18.117922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a13dfe-ba2a-4eb3-b5cd-7b265e198b8b None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:18.160460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f8b52-5705-42af-bccc-703769e6f8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:18.161127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f8b52-5705-42af-bccc-703769e6f8b3 None admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:18.161413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f8b52-5705-42af-bccc-703769e6f8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:18.161690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f8b52-5705-42af-bccc-703769e6f8b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:18.162492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f8b52-5705-42af-bccc-703769e6f8b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:18.163862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f8b52-5705-42af-bccc-703769e6f8b3 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:18.172054 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 460/919] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 13:52:18.195687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda5678-3a5f-42ab-82d8-69745c61b67a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:18.250783 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 460/920] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jul 19 13:52:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:52:18.255778 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:18.320215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda5678-3a5f-42ab-82d8-69745c61b67a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:18.364614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e747916-2c20-4611-a7f5-0c9b5f577113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:18.365437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e747916-2c20-4611-a7f5-0c9b5f577113 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:18.365773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e747916-2c20-4611-a7f5-0c9b5f577113 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:18.366057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e747916-2c20-4611-a7f5-0c9b5f577113 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:18.366753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e747916-2c20-4611-a7f5-0c9b5f577113 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:18.368304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e747916-2c20-4611-a7f5-0c9b5f577113 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:18.381442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-7e747916-2c20-4611-a7f5-0c9b5f577113 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 13:52:18.381442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:18.381442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:52:18.381442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:52:18.381442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:52:18.381442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:52:18.381442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:52:18.381442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:18.381442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 13:52:18.381442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:18.381442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:18.381442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:18.381442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:18.381442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:18.381442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:18.381442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:18.381442 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:18.382529 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:18.382529 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:18.382529 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:18.382529 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:18.382529 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:18.382529 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:18.382529 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:52:18.382529 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:52:18.382529 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:52:18.382529 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:52:18.382529 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:18.382529 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:18.382529 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:18.382529 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:18.382529 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:18.382529 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:18.384430 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:18.384430 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:18.384430 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:18.384430 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:18.384430 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:18.384430 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:18.384430 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:18.384430 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:18.384430 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:18.384430 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:18.384430 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:52:18.384430 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:18.384430 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 13:52:18.384430 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:18.384430 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 461/921] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jul 19 13:52:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:18.391576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f8b52-5705-42af-bccc-703769e6f8b3 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:18.508073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f8b52-5705-42af-bccc-703769e6f8b3 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:18.535607 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:18.543982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d49d6-6f27-4c54-9042-3114be4b6db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:18.544654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d49d6-6f27-4c54-9042-3114be4b6db1 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:18.544943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d49d6-6f27-4c54-9042-3114be4b6db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:18.545225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d49d6-6f27-4c54-9042-3114be4b6db1 None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:18.545943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d49d6-6f27-4c54-9042-3114be4b6db1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:18.546303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d49d6-6f27-4c54-9042-3114be4b6db1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:18.547663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d49d6-6f27-4c54-9042-3114be4b6db1 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:18.553037 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 461/922] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jul 19 13:52:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:18.559413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e747916-2c20-4611-a7f5-0c9b5f577113 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:18.665706 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:18.669303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e747916-2c20-4611-a7f5-0c9b5f577113 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:18.707875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06487c2a-509f-4edf-9e1c-2446b90350f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:18.709279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06487c2a-509f-4edf-9e1c-2446b90350f6 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:18.709807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06487c2a-509f-4edf-9e1c-2446b90350f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:18.710324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06487c2a-509f-4edf-9e1c-2446b90350f6 None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:18.711970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06487c2a-509f-4edf-9e1c-2446b90350f6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:18.712518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06487c2a-509f-4edf-9e1c-2446b90350f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:18.714706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06487c2a-509f-4edf-9e1c-2446b90350f6 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:18.721054 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 462/923] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jul 19 13:52:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:18.728190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d49d6-6f27-4c54-9042-3114be4b6db1 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:18.843814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d49d6-6f27-4c54-9042-3114be4b6db1 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:18.882824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db692f-7b48-4f4d-a621-3912b4fa630c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:18.884366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db692f-7b48-4f4d-a621-3912b4fa630c None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:18.884933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db692f-7b48-4f4d-a621-3912b4fa630c None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:18.885422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db692f-7b48-4f4d-a621-3912b4fa630c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:18.886504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db692f-7b48-4f4d-a621-3912b4fa630c None admin] RBAC: Adding query filter params (interface=public, service_id=05103691c0d04dc998e35c1cf7a319ef, region_id=RegionOne) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:18.887036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db692f-7b48-4f4d-a621-3912b4fa630c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:18.888602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db692f-7b48-4f4d-a621-3912b4fa630c None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:18.898194 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 462/924] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jul 19 13:52:18 2022] GET /identity/v3/endpoints?service_id=05103691c0d04dc998e35c1cf7a319ef&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:18.900480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06487c2a-509f-4edf-9e1c-2446b90350f6 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:19.007682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06487c2a-509f-4edf-9e1c-2446b90350f6 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:19.044863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94006971-146f-46f6-827c-bd954ace61a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:19.045537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94006971-146f-46f6-827c-bd954ace61a1 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:19.045823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94006971-146f-46f6-827c-bd954ace61a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:19.046117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94006971-146f-46f6-827c-bd954ace61a1 None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:19.046818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94006971-146f-46f6-827c-bd954ace61a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:19.048198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94006971-146f-46f6-827c-bd954ace61a1 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:19.054832 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 463/925] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jul 19 13:52:18 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 13:52:19.089838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f7494-281b-4844-9180-f97e15b976f1 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:19.090528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f7494-281b-4844-9180-f97e15b976f1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:19.091023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f7494-281b-4844-9180-f97e15b976f1 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:19.092981 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 463/926] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:19.098895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5c8f6-e994-4d04-8d08-a15822f6877a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:19.112625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5c8f6-e994-4d04-8d08-a15822f6877a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:19.112625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c5c8f6-e994-4d04-8d08-a15822f6877a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:19.119807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e6c5c8f6-e994-4d04-8d08-a15822f6877a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:19.121028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e6c5c8f6-e994-4d04-8d08-a15822f6877a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:19.149889 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:19.198948 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 464/927] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:19.222466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f7494-281b-4844-9180-f97e15b976f1 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:19.290296 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:19.335307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f7494-281b-4844-9180-f97e15b976f1 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:19.369976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a8ca2c-240a-4c23-8d4e-6a4ac42454ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:19.371106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8ca2c-240a-4c23-8d4e-6a4ac42454ed None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:19.371554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8ca2c-240a-4c23-8d4e-6a4ac42454ed None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:19.371984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a8ca2c-240a-4c23-8d4e-6a4ac42454ed None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:19.372799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8ca2c-240a-4c23-8d4e-6a4ac42454ed None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:19.374329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a8ca2c-240a-4c23-8d4e-6a4ac42454ed None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:19.387126 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-d4a8ca2c-240a-4c23-8d4e-6a4ac42454ed None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 13:52:19.387126 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:19.387126 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:52:19.387126 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:52:19.387126 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:52:19.387126 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:52:19.387126 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:52:19.387126 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:19.387126 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 13:52:19.387126 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:19.387126 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:19.387126 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:19.387126 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:19.387126 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:19.387126 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:19.387126 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:19.388361 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:19.388361 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:19.388361 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:19.388361 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:19.388361 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:19.388361 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:19.388361 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:19.388361 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:52:19.388361 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:52:19.388361 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:52:19.388361 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:52:19.388361 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:19.388361 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:19.388361 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:19.388361 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:19.388361 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:19.389460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:19.389460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:19.389460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:19.389460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:19.389460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:19.389460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:19.389460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:19.389460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:19.389460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:19.389460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:19.389460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:19.389460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:52:19.389460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:19.389460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 13:52:19.389460 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:19.392085 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 464/928] 10.222.0.43 () {56 vars in 1132 bytes} [Tue Jul 19 13:52:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:19.398141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5c8f6-e994-4d04-8d08-a15822f6877a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:19.462077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cb54d-b8fc-4d27-8aa2-8ea711b0db9d None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:19.462799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cb54d-b8fc-4d27-8aa2-8ea711b0db9d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:19.463353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cb54d-b8fc-4d27-8aa2-8ea711b0db9d None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:19.465190 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 465/929] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:19.470258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707503c-4272-4f76-beaa-d333c382301b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:19.470550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707503c-4272-4f76-beaa-d333c382301b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:19.470833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707503c-4272-4f76-beaa-d333c382301b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:19.488553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b707503c-4272-4f76-beaa-d333c382301b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:19.489901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b707503c-4272-4f76-beaa-d333c382301b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:19.513165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c5c8f6-e994-4d04-8d08-a15822f6877a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:19.561121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8c939-1885-47ad-bbfd-24779bdd998b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:19.561745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8c939-1885-47ad-bbfd-24779bdd998b None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:19.561984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8c939-1885-47ad-bbfd-24779bdd998b None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:19.562301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e8c939-1885-47ad-bbfd-24779bdd998b None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:19.563452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8c939-1885-47ad-bbfd-24779bdd998b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:19.564281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8c939-1885-47ad-bbfd-24779bdd998b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:19.565826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e8c939-1885-47ad-bbfd-24779bdd998b None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:19.573359 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 465/930] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jul 19 13:52:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:19.578890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8c939-1885-47ad-bbfd-24779bdd998b None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:19.579664 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 466/931] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 13:52:19.608775 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:19.610314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707503c-4272-4f76-beaa-d333c382301b None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:19.664984 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:19.686685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e8c939-1885-47ad-bbfd-24779bdd998b None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:19.720701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707503c-4272-4f76-beaa-d333c382301b None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:19.724907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a028c-d12e-446d-9619-72cb102998cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:19.725755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a028c-d12e-446d-9619-72cb102998cf None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:19.726248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a028c-d12e-446d-9619-72cb102998cf None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:19.726696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27a028c-d12e-446d-9619-72cb102998cf None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:19.728369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a028c-d12e-446d-9619-72cb102998cf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:19.728836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a028c-d12e-446d-9619-72cb102998cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:19.730431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27a028c-d12e-446d-9619-72cb102998cf None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:19.740874 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 466/932] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jul 19 13:52:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:19.742286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a028c-d12e-446d-9619-72cb102998cf None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:19.758606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85da94-12b6-48bd-9c7d-f4a5824d3a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:19.760129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85da94-12b6-48bd-9c7d-f4a5824d3a55 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:19.760423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85da94-12b6-48bd-9c7d-f4a5824d3a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:19.760686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85da94-12b6-48bd-9c7d-f4a5824d3a55 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:19.771641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85da94-12b6-48bd-9c7d-f4a5824d3a55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:52:19.781266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-8f85da94-12b6-48bd-9c7d-f4a5824d3a55 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 13:52:19.781266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:19.781266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:19.781266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:19.781266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:19.781266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:19.781266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:19.781266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:19.781266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:19.781266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:19.781266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:19.781266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:19.781266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:52:19.781266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:52:19.781266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:52:19.781266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:52:19.782456 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:52:19.782456 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:52:19.782456 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:52:19.782456 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:52:19.782456 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:19.782456 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:19.782456 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:19.782456 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:19.782456 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:19.782456 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:19.782456 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:19.782456 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:19.782456 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:19.782456 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:19.782456 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:19.782456 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:19.783523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:19.783523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:19.783523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:19.783523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:19.783523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:52:19.783523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:52:19.783523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:52:19.783523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:52:19.783523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:52:19.783523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:52:19.783523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 13:52:19.783523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:19.786191 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 467/933] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Jul 19 13:52:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:19.788506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85da94-12b6-48bd-9c7d-f4a5824d3a55 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:19.839063 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:19.855724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27a028c-d12e-446d-9619-72cb102998cf None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:19.893688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e71f6-d15e-4527-bc3f-1af148ab55bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:19.894737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e71f6-d15e-4527-bc3f-1af148ab55bf None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:19.895170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e71f6-d15e-4527-bc3f-1af148ab55bf None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:19.895665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e71f6-d15e-4527-bc3f-1af148ab55bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:19.896583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e71f6-d15e-4527-bc3f-1af148ab55bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:19.898235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e71f6-d15e-4527-bc3f-1af148ab55bf None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:19.902274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85da94-12b6-48bd-9c7d-f4a5824d3a55 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:19.913753 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:19.936683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c40ad-be41-4b2a-af59-0a159685efa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:19.937362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c40ad-be41-4b2a-af59-0a159685efa7 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:19.937651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c40ad-be41-4b2a-af59-0a159685efa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:19.937946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c40ad-be41-4b2a-af59-0a159685efa7 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:19.938712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c40ad-be41-4b2a-af59-0a159685efa7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:19.939270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c40ad-be41-4b2a-af59-0a159685efa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:19.940624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c40ad-be41-4b2a-af59-0a159685efa7 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:19.954297 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 468/934] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Jul 19 13:52:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:19.956471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c40ad-be41-4b2a-af59-0a159685efa7 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:19.986066 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 467/935] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jul 19 13:52:19 2022] POST /identity/v3/endpoints => generated 347 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 13:52:20.085595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c40ad-be41-4b2a-af59-0a159685efa7 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:20.133344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c9bd6-4ee2-4d03-897d-aac363fad67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:20.134598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c9bd6-4ee2-4d03-897d-aac363fad67e None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:20.135093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c9bd6-4ee2-4d03-897d-aac363fad67e None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:20.135627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c9bd6-4ee2-4d03-897d-aac363fad67e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:20.147836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c9bd6-4ee2-4d03-897d-aac363fad67e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:20.150256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8c9bd6-4ee2-4d03-897d-aac363fad67e None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:20.169748 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-1e8c9bd6-4ee2-4d03-897d-aac363fad67e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:20.169748 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:20.169748 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:20.169748 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:20.169748 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:20.169748 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:20.169748 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:20.169748 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:20.169748 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:20.169748 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:20.169748 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:20.169748 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:20.169748 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:20.169748 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:20.169748 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:20.170814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:20.170814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:20.170814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:20.170814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:20.170814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:20.170814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:20.170814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:20.170814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:20.170814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:20.170814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:20.170814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:20.170814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:20.170814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:20.170814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:20.170814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:20.170814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:20.170814 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:20.171723 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:20.171723 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:20.171723 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:20.171723 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:20.173510 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 469/936] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:20.178347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e71f6-d15e-4527-bc3f-1af148ab55bf None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:20.297620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e71f6-d15e-4527-bc3f-1af148ab55bf None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:20.334571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c2176d-148d-4283-8c04-87950f88f702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:20.335645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2176d-148d-4283-8c04-87950f88f702 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:20.336242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2176d-148d-4283-8c04-87950f88f702 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:20.336729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2176d-148d-4283-8c04-87950f88f702 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:20.337828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2176d-148d-4283-8c04-87950f88f702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:20.338381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2176d-148d-4283-8c04-87950f88f702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:20.339967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c2176d-148d-4283-8c04-87950f88f702 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:20.356803 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 468/937] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:20.359384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c9bd6-4ee2-4d03-897d-aac363fad67e None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:20.382736 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:20.470338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c9bd6-4ee2-4d03-897d-aac363fad67e None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:20.499802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c0666-5202-40ec-bfa7-1d0b8b45472c None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:20.500101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c0666-5202-40ec-bfa7-1d0b8b45472c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:20.500360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c0666-5202-40ec-bfa7-1d0b8b45472c None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:20.501969 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 469/938] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:20.506446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf4c3d-f521-4669-8f04-cd5af4fde9e4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:20.506724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf4c3d-f521-4669-8f04-cd5af4fde9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:20.506996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdf4c3d-f521-4669-8f04-cd5af4fde9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:20.513156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcd7fc-7329-4be8-a101-8072ef54dc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:20.513890 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:20.514466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcd7fc-7329-4be8-a101-8072ef54dc80 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:20.515626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcd7fc-7329-4be8-a101-8072ef54dc80 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:20.515922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dcd7fc-7329-4be8-a101-8072ef54dc80 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:20.524428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcd7fc-7329-4be8-a101-8072ef54dc80 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:20.525877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dcd7fc-7329-4be8-a101-8072ef54dc80 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:20.527424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2fdf4c3d-f521-4669-8f04-cd5af4fde9e4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:20.529494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2fdf4c3d-f521-4669-8f04-cd5af4fde9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:20.546071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-33dcd7fc-7329-4be8-a101-8072ef54dc80 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 13:52:20.546071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:20.546071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:20.546071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:20.546071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:20.546071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:20.546071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:20.546071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:20.546071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:20.546071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:20.546071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:20.546071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:20.546071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:52:20.546071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:52:20.546071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:52:20.546071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:52:20.547107 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:20.547107 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:20.547107 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:52:20.547107 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:20.547107 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:52:20.547107 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:20.547107 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:20.547107 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:20.547107 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:20.547107 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:20.547107 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:20.547107 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:20.547107 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:20.547107 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:20.547107 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:20.547107 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:20.547107 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:20.547107 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:20.548226 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:20.548226 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:20.548226 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:52:20.548226 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:52:20.548226 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:52:20.548226 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:52:20.548226 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:52:20.548226 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:52:20.548226 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 13:52:20.548226 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:20.548226 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 470/939] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jul 19 13:52:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:20.555912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcd7fc-7329-4be8-a101-8072ef54dc80 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:20.614380 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 470/940] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:20.634431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf4c3d-f521-4669-8f04-cd5af4fde9e4 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:20.640826 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:20.660308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dcd7fc-7329-4be8-a101-8072ef54dc80 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:20.696386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5540800-5070-40c6-8f57-c663ea116954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:20.697063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5540800-5070-40c6-8f57-c663ea116954 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:20.697340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5540800-5070-40c6-8f57-c663ea116954 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:20.697609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5540800-5070-40c6-8f57-c663ea116954 None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:20.698487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5540800-5070-40c6-8f57-c663ea116954 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:20.698795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5540800-5070-40c6-8f57-c663ea116954 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:20.700212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5540800-5070-40c6-8f57-c663ea116954 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:20.718237 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 471/941] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Jul 19 13:52:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:20.724061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5540800-5070-40c6-8f57-c663ea116954 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:20.744623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdf4c3d-f521-4669-8f04-cd5af4fde9e4 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:20.782643 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:20.789766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd13ad-9cb5-4d68-a1db-2100580f86b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:20.790703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd13ad-9cb5-4d68-a1db-2100580f86b6 None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:20.796980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd13ad-9cb5-4d68-a1db-2100580f86b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:20.796980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd13ad-9cb5-4d68-a1db-2100580f86b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:20.796980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd13ad-9cb5-4d68-a1db-2100580f86b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:20.796980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd13ad-9cb5-4d68-a1db-2100580f86b6 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:20.796980 n-d-master-1 devstack@keystone.service[80680]: WARNING keystone.server.flask.common [None req-a8dd13ad-9cb5-4d68-a1db-2100580f86b6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 19 13:52:20.843825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5540800-5070-40c6-8f57-c663ea116954 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:20.854849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.sql.core [None req-a8dd13ad-9cb5-4d68-a1db-2100580f86b6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 19 13:52:20.854849 n-d-master-1 devstack@keystone.service[80680]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 19 13:52:20.854849 n-d-master-1 devstack@keystone.service[80680]: [parameters: {'id': '0d7ba79572a9468d9508c8050b9217cc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 19 13:52:20.854849 n-d-master-1 devstack@keystone.service[80680]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80680) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 13:52:20.865995 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-a8dd13ad-9cb5-4d68-a1db-2100580f86b6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0d7ba79572a9468d9508c8050b9217cc.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0d7ba79572a9468d9508c8050b9217cc. Jul 19 13:52:20.865995 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:20.865995 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 13:52:20.865995 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 13:52:20.865995 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 13:52:20.865995 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 13:52:20.865995 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 13:52:20.865995 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 13:52:20.865995 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 13:52:20.865995 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application conn.query(q) Jul 19 13:52:20.865995 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 13:52:20.865995 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 13:52:20.865995 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 13:52:20.866860 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application result.read() Jul 19 13:52:20.866860 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 13:52:20.866860 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 13:52:20.866860 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 13:52:20.866860 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 13:52:20.866860 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 13:52:20.866860 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 13:52:20.866860 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 13:52:20.866860 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 13:52:20.866860 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 19 13:52:20.866860 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:20.866860 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 13:52:20.866860 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:20.866860 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:20.866860 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 13:52:20.866860 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 13:52:20.866860 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 19 13:52:20.866860 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 19 13:52:20.867899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 13:52:20.867899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application next(self.gen) Jul 19 13:52:20.867899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 13:52:20.867899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application yield resource Jul 19 13:52:20.867899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 13:52:20.867899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application next(self.gen) Jul 19 13:52:20.867899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 13:52:20.867899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 13:52:20.867899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 13:52:20.867899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 13:52:20.867899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 13:52:20.867899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise self.value Jul 19 13:52:20.867899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 13:52:20.867899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 13:52:20.867899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 13:52:20.867899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application session.commit() Jul 19 13:52:20.867899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 13:52:20.868823 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 13:52:20.868823 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 13:52:20.868823 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 13:52:20.868823 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 13:52:20.868823 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.session.flush() Jul 19 13:52:20.868823 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 13:52:20.868823 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 13:52:20.868823 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 13:52:20.868823 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 13:52:20.868823 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 13:52:20.868823 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application compat.raise_( Jul 19 13:52:20.868823 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 13:52:20.868823 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception Jul 19 13:52:20.868823 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 13:52:20.868823 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 13:52:20.868823 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 13:52:20.868823 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 13:52:20.869745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 13:52:20.869745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 13:52:20.869745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 13:52:20.869745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 13:52:20.869745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 19 13:52:20.869745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 19 13:52:20.869745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 13:52:20.869745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 13:52:20.869745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 13:52:20.869745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 13:52:20.869745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 13:52:20.869745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 13:52:20.869745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 13:52:20.869745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 13:52:20.869745 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 13:52:20.875206 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 13:52:20.875206 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 13:52:20.875206 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception Jul 19 13:52:20.875206 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 13:52:20.875206 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 13:52:20.875206 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 13:52:20.875206 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 13:52:20.875206 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 13:52:20.875206 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 13:52:20.875206 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 13:52:20.875206 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application conn.query(q) Jul 19 13:52:20.875206 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 13:52:20.875206 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 13:52:20.875206 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 13:52:20.875206 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application result.read() Jul 19 13:52:20.875206 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 13:52:20.875206 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 13:52:20.876140 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 13:52:20.876140 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 13:52:20.876140 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 13:52:20.876140 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 13:52:20.876140 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 13:52:20.876140 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 13:52:20.876140 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 19 13:52:20.876140 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 19 13:52:20.876140 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [parameters: {'id': '0d7ba79572a9468d9508c8050b9217cc', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 19 13:52:20.876140 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 13:52:20.876140 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:20.876140 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:20.876140 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:20.876140 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:20.876140 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 19 13:52:20.876955 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 19 13:52:20.876955 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 13:52:20.876955 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 13:52:20.876955 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 19 13:52:20.876955 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:20.876955 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:20.876955 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:20.876955 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:20.876955 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:20.876955 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:20.876955 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:20.876955 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:20.876955 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:20.876955 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:20.876955 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:20.876955 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:20.876955 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:20.878061 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:20.878061 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 19 13:52:20.878061 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 19 13:52:20.878061 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:20.878061 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:20.878061 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 19 13:52:20.878061 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 19 13:52:20.878061 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 0d7ba79572a9468d9508c8050b9217cc. Jul 19 13:52:20.878061 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:20.878061 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 471/942] 10.222.0.43 () {60 vars in 1140 bytes} [Tue Jul 19 13:52:20 2022] POST /identity/v3/projects => generated 262 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:20.879739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd13ad-9cb5-4d68-a1db-2100580f86b6 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:20.893223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47d849-bff3-453b-980e-755732bb7864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:20.894299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47d849-bff3-453b-980e-755732bb7864 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:20.894744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47d849-bff3-453b-980e-755732bb7864 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:20.895223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd47d849-bff3-453b-980e-755732bb7864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:20.903727 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:20.908443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47d849-bff3-453b-980e-755732bb7864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:20.910231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd47d849-bff3-453b-980e-755732bb7864 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:20.929805 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-bd47d849-bff3-453b-980e-755732bb7864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:20.929805 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:20.929805 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:20.929805 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:20.929805 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:20.929805 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:20.929805 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:20.929805 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:20.929805 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:20.929805 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:20.929805 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:20.929805 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:20.929805 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:20.929805 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:20.929805 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:20.930934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:20.930934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:20.930934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:20.930934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:20.930934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:20.930934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:20.930934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:20.930934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:20.930934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:20.930934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:20.930934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:20.930934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:20.930934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:20.930934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:20.930934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:20.930934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:20.930934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:20.931891 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:20.931891 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:20.931891 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:20.931891 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:20.934247 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 472/943] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:20.941210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47d849-bff3-453b-980e-755732bb7864 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:21.001479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd13ad-9cb5-4d68-a1db-2100580f86b6 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:21.041626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb2d9f-5058-48f6-ad92-57c85fd67359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:21.042513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb2d9f-5058-48f6-ad92-57c85fd67359 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:21.043001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb2d9f-5058-48f6-ad92-57c85fd67359 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:21.043107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb2d9f-5058-48f6-ad92-57c85fd67359 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:21.050362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb2d9f-5058-48f6-ad92-57c85fd67359 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:21.052031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb2d9f-5058-48f6-ad92-57c85fd67359 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:21.067224 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-3ceb2d9f-5058-48f6-ad92-57c85fd67359 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:21.067224 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:21.067224 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:21.067224 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:21.067224 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:21.067224 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:21.067224 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:21.067224 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:21.067224 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:21.067224 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:21.067224 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:21.067224 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:21.067224 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:52:21.067224 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:52:21.067224 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:52:21.068349 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:52:21.068349 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:21.068349 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:21.068349 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:21.068349 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:21.068349 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:21.068349 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:21.068349 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:21.068349 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:21.068349 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:21.068349 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:21.068349 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:21.068349 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:21.068349 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:21.068349 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:21.068349 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:21.068349 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:21.069608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:52:21.069608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:52:21.069608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:52:21.069608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:52:21.069608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:52:21.069608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:52:21.069608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:21.069608 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:21.069608 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 472/944] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:52:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:21.072782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd47d849-bff3-453b-980e-755732bb7864 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:21.076143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb2d9f-5058-48f6-ad92-57c85fd67359 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:21.110949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d2abb-eb7b-4188-aa42-4b5f3bd8e9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:21.111587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d2abb-eb7b-4188-aa42-4b5f3bd8e9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:21.111876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d2abb-eb7b-4188-aa42-4b5f3bd8e9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:21.112157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d2abb-eb7b-4188-aa42-4b5f3bd8e9a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:21.113075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d2abb-eb7b-4188-aa42-4b5f3bd8e9a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:21.113305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d2abb-eb7b-4188-aa42-4b5f3bd8e9a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:21.114728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908d2abb-eb7b-4188-aa42-4b5f3bd8e9a0 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:21.132082 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 473/945] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:21.134737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d2abb-eb7b-4188-aa42-4b5f3bd8e9a0 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:21.156047 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:21.195140 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:21.258611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908d2abb-eb7b-4188-aa42-4b5f3bd8e9a0 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:21.266523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb2d9f-5058-48f6-ad92-57c85fd67359 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:21.300685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dac1757-4de2-4f9a-bd5f-17aba8c079f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:21.301489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac1757-4de2-4f9a-bd5f-17aba8c079f8 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:21.301785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac1757-4de2-4f9a-bd5f-17aba8c079f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:21.302066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dac1757-4de2-4f9a-bd5f-17aba8c079f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:21.307912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6f310-de3c-413e-969b-43a8298af6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:21.308569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6f310-de3c-413e-969b-43a8298af6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:21.308850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6f310-de3c-413e-969b-43a8298af6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:21.309130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6f310-de3c-413e-969b-43a8298af6e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:21.309875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6f310-de3c-413e-969b-43a8298af6e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:21.310063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac1757-4de2-4f9a-bd5f-17aba8c079f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:21.310265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6f310-de3c-413e-969b-43a8298af6e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:21.311532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dac1757-4de2-4f9a-bd5f-17aba8c079f8 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:21.311630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6f310-de3c-413e-969b-43a8298af6e5 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:21.326360 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-1dac1757-4de2-4f9a-bd5f-17aba8c079f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:21.326360 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:21.326360 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:21.326360 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:21.326360 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:21.326360 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:21.326360 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:21.326360 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:21.326360 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:21.326360 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:21.326360 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:21.326360 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:21.326360 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:52:21.326360 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:52:21.326360 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:52:21.327334 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:52:21.327334 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:21.327334 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:21.327334 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:21.327334 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:21.327334 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:21.327334 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:21.327334 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:21.327334 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:21.327334 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:21.327334 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:21.327334 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:21.327334 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:21.327334 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:21.327334 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:21.327334 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:21.327334 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:21.328238 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:52:21.328238 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:52:21.328238 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:52:21.328238 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:52:21.328238 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:52:21.328238 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:52:21.328238 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:21.328238 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:21.328238 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 474/946] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:52:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:21.329633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053b567-c3de-422f-acd6-df8d2fe8a0c8 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:21.329633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053b567-c3de-422f-acd6-df8d2fe8a0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:21.329633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f053b567-c3de-422f-acd6-df8d2fe8a0c8 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:21.331037 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 475/947] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:21.335188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053b567-c3de-422f-acd6-df8d2fe8a0c8 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:21.339810 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 473/948] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 19 13:52:21 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:21.341029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f24cf0-28a4-4570-b12b-a26ee6b54994 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:21.341315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f24cf0-28a4-4570-b12b-a26ee6b54994 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:21.341587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f24cf0-28a4-4570-b12b-a26ee6b54994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:21.365047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-12f24cf0-28a4-4570-b12b-a26ee6b54994 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:21.366657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-12f24cf0-28a4-4570-b12b-a26ee6b54994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:21.450141 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 474/949] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:21.472961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f24cf0-28a4-4570-b12b-a26ee6b54994 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:21.487667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f053b567-c3de-422f-acd6-df8d2fe8a0c8 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:21.500399 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:21.526775 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:21.527987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42b6c8-193a-48c1-861f-71645debfccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:21.530018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42b6c8-193a-48c1-861f-71645debfccb None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:21.530337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42b6c8-193a-48c1-861f-71645debfccb None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:21.530624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42b6c8-193a-48c1-861f-71645debfccb None admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:21.531815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42b6c8-193a-48c1-861f-71645debfccb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:21.532131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42b6c8-193a-48c1-861f-71645debfccb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:21.533628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42b6c8-193a-48c1-861f-71645debfccb None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:21.548769 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 476/950] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:52:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:21.554425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42b6c8-193a-48c1-861f-71645debfccb None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:21.608507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f24cf0-28a4-4570-b12b-a26ee6b54994 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:21.654638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747f356-0155-4670-ab01-2b5e8bf31647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:21.655551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747f356-0155-4670-ab01-2b5e8bf31647 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:21.655926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747f356-0155-4670-ab01-2b5e8bf31647 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:21.656297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747f356-0155-4670-ab01-2b5e8bf31647 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:21.657255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747f356-0155-4670-ab01-2b5e8bf31647 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:21.658767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747f356-0155-4670-ab01-2b5e8bf31647 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:21.672593 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-d747f356-0155-4670-ab01-2b5e8bf31647 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 13:52:21.672593 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:21.672593 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:52:21.672593 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:52:21.672593 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:52:21.672593 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:52:21.672593 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:52:21.672593 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:21.672593 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 13:52:21.672593 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:21.672593 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:21.672593 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:21.672593 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:21.672593 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:21.672593 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:21.672593 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:21.672593 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:21.673845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:21.673845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:21.673845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:21.673845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:21.673845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:21.673845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:21.673845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:52:21.673845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:52:21.673845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:52:21.673845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:52:21.673845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:21.673845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:21.673845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:21.673845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:21.673845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:21.673845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:21.675173 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:21.675173 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:21.675173 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:21.675173 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:21.675173 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:21.675173 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:21.675173 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:21.675173 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:21.675173 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:21.675173 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:21.675173 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:52:21.675173 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:21.675173 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 13:52:21.675173 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:21.677239 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 475/951] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jul 19 13:52:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:21.683542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747f356-0155-4670-ab01-2b5e8bf31647 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:21.684576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42b6c8-193a-48c1-861f-71645debfccb None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:21.720844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3a9b3-ab51-4ca5-98ca-b0bcee8ff39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:21.722068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3a9b3-ab51-4ca5-98ca-b0bcee8ff39e None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:21.722555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3a9b3-ab51-4ca5-98ca-b0bcee8ff39e None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:21.723006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3a9b3-ab51-4ca5-98ca-b0bcee8ff39e None admin] PATH_INFO: `/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/ec07a12b28934ef9b04325404fd3c950/roles/3841e5d49ee04bf08c66d1134dc3b552` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:21.725409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3a9b3-ab51-4ca5-98ca-b0bcee8ff39e None admin] RBAC: Authorizing `identity:create_grant(project_id=dfcbe281a77242bbb3774c4aacef50d4, user_id=ec07a12b28934ef9b04325404fd3c950, role_id=3841e5d49ee04bf08c66d1134dc3b552)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:21.727167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3a9b3-ab51-4ca5-98ca-b0bcee8ff39e None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:21.790655 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 477/952] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:52:21 2022] PUT /identity/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/ec07a12b28934ef9b04325404fd3c950/roles/3841e5d49ee04bf08c66d1134dc3b552 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 13:52:21.792891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747f356-0155-4670-ab01-2b5e8bf31647 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:21.802140 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:21.841331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12792364-dd96-489c-a075-636d60b0b493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:21.843228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12792364-dd96-489c-a075-636d60b0b493 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:21.843549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12792364-dd96-489c-a075-636d60b0b493 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:21.843833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12792364-dd96-489c-a075-636d60b0b493 None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:21.844687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12792364-dd96-489c-a075-636d60b0b493 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:21.845100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12792364-dd96-489c-a075-636d60b0b493 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:21.846680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12792364-dd96-489c-a075-636d60b0b493 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:21.853884 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 476/953] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jul 19 13:52:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:21.859899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3a9b3-ab51-4ca5-98ca-b0bcee8ff39e None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:21.895216 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:21.972527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3a9b3-ab51-4ca5-98ca-b0bcee8ff39e None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:22.012433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493774c-d699-485d-8274-f3627d1a033f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:22.013105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493774c-d699-485d-8274-f3627d1a033f None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:22.013389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493774c-d699-485d-8274-f3627d1a033f None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:22.013665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493774c-d699-485d-8274-f3627d1a033f None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:22.014411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493774c-d699-485d-8274-f3627d1a033f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:22.014711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493774c-d699-485d-8274-f3627d1a033f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:22.016062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493774c-d699-485d-8274-f3627d1a033f None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:22.021680 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 478/954] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jul 19 13:52:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:22.027520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12792364-dd96-489c-a075-636d60b0b493 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:22.135388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12792364-dd96-489c-a075-636d60b0b493 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:22.172861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079aa936-2d89-4855-ad6a-e39f37c426ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:22.173531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079aa936-2d89-4855-ad6a-e39f37c426ec None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:22.173816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079aa936-2d89-4855-ad6a-e39f37c426ec None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:22.174108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079aa936-2d89-4855-ad6a-e39f37c426ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:22.174889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079aa936-2d89-4855-ad6a-e39f37c426ec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:22.176260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079aa936-2d89-4855-ad6a-e39f37c426ec None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:22.255916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbae071-ffca-4d65-9671-362686633e2f None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:22.256242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbae071-ffca-4d65-9671-362686633e2f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:22.256499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbae071-ffca-4d65-9671-362686633e2f None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:22.257887 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 479/955] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:52:22.263055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b44258-3f84-42fb-9807-29e891bc8b18 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:22.263449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b44258-3f84-42fb-9807-29e891bc8b18 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:22.263825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b44258-3f84-42fb-9807-29e891bc8b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:22.280200 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 477/956] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jul 19 13:52:22 2022] POST /identity/v3/endpoints => generated 349 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:52:22.291490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b2b44258-3f84-42fb-9807-29e891bc8b18 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:22.292966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b2b44258-3f84-42fb-9807-29e891bc8b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:22.387708 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 480/957] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 13:52:22.409568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079aa936-2d89-4855-ad6a-e39f37c426ec None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:22.441087 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:22.521921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079aa936-2d89-4855-ad6a-e39f37c426ec None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:22.559397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349e03c-80d3-46bb-b408-7d1e2bbc790b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:22.560290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349e03c-80d3-46bb-b408-7d1e2bbc790b None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:22.560644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349e03c-80d3-46bb-b408-7d1e2bbc790b None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:22.560988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349e03c-80d3-46bb-b408-7d1e2bbc790b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:22.561717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349e03c-80d3-46bb-b408-7d1e2bbc790b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:22.563176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3349e03c-80d3-46bb-b408-7d1e2bbc790b None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:22.576189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-3349e03c-80d3-46bb-b408-7d1e2bbc790b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 13:52:22.576189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:22.576189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:52:22.576189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:52:22.576189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:52:22.576189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:52:22.576189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:52:22.576189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:22.576189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 13:52:22.576189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:22.576189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:22.576189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:22.576189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:22.576189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:22.576189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:22.576189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:22.576189 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:22.577580 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:22.577580 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:22.577580 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:22.577580 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:22.577580 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:22.577580 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:22.577580 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:52:22.577580 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:52:22.577580 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:52:22.577580 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:52:22.577580 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:22.577580 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:22.577580 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:22.577580 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:22.577580 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:22.577580 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:22.578654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:22.578654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:22.578654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:22.578654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:22.578654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:22.578654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:22.578654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:22.578654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:22.578654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:22.578654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:22.578654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:52:22.578654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:22.578654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 13:52:22.578654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:22.582146 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 478/958] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:52:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:22.585583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b44258-3f84-42fb-9807-29e891bc8b18 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:22.612354 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:22.702608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b44258-3f84-42fb-9807-29e891bc8b18 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:22.737816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f36a85-2ea4-4afb-8f91-d019fbb43959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:22.738520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f36a85-2ea4-4afb-8f91-d019fbb43959 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:22.738807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f36a85-2ea4-4afb-8f91-d019fbb43959 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:22.739086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f36a85-2ea4-4afb-8f91-d019fbb43959 None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:22.739805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f36a85-2ea4-4afb-8f91-d019fbb43959 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:22.740111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f36a85-2ea4-4afb-8f91-d019fbb43959 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:22.741481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f36a85-2ea4-4afb-8f91-d019fbb43959 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:22.747561 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 481/959] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 19 13:52:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:22.755403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349e03c-80d3-46bb-b408-7d1e2bbc790b None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:22.841883 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:22.857466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349e03c-80d3-46bb-b408-7d1e2bbc790b None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:22.894217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c843ed-a815-4104-ac57-9718ffd3ec7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:22.894893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c843ed-a815-4104-ac57-9718ffd3ec7a None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:22.895181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c843ed-a815-4104-ac57-9718ffd3ec7a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:22.895463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c843ed-a815-4104-ac57-9718ffd3ec7a None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:22.896178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c843ed-a815-4104-ac57-9718ffd3ec7a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:22.896488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c843ed-a815-4104-ac57-9718ffd3ec7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:22.897855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c843ed-a815-4104-ac57-9718ffd3ec7a None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:22.903362 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 479/960] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 19 13:52:22 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:23.656101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca2830-5876-46c8-ba4f-b50e220d52e9 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:23.656609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca2830-5876-46c8-ba4f-b50e220d52e9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:23.656609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca2830-5876-46c8-ba4f-b50e220d52e9 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:23.658072 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 482/961] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:23.663359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7d87e-b2cc-44a5-ad49-ff29949a93de None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:23.663653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7d87e-b2cc-44a5-ad49-ff29949a93de None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:23.663931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7d87e-b2cc-44a5-ad49-ff29949a93de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:23.681177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-36b7d87e-b2cc-44a5-ad49-ff29949a93de None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:23.682395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-36b7d87e-b2cc-44a5-ad49-ff29949a93de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:23.751768 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 480/962] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:23.777129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca2830-5876-46c8-ba4f-b50e220d52e9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:23.868911 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:23.885777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca2830-5876-46c8-ba4f-b50e220d52e9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:23.921508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74eecdc-335b-49a2-944b-4316da06a450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:23.922288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74eecdc-335b-49a2-944b-4316da06a450 None admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:23.922585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74eecdc-335b-49a2-944b-4316da06a450 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:23.922868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74eecdc-335b-49a2-944b-4316da06a450 None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:23.923585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74eecdc-335b-49a2-944b-4316da06a450 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:23.925021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74eecdc-335b-49a2-944b-4316da06a450 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:23.926367 n-d-master-1 devstack@keystone.service[80679]: WARNING keystone.server.flask.common [None req-c74eecdc-335b-49a2-944b-4316da06a450 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 19 13:52:23.937241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a37024-b7e0-4212-9e2c-69790c57cde7 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:23.937768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a37024-b7e0-4212-9e2c-69790c57cde7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:23.937768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a37024-b7e0-4212-9e2c-69790c57cde7 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:23.939478 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 481/963] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:23.944648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240fcd4-ba0d-4b28-a9d0-9093e7c6c53e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:23.944943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240fcd4-ba0d-4b28-a9d0-9093e7c6c53e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:23.945221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240fcd4-ba0d-4b28-a9d0-9093e7c6c53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:23.962987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b240fcd4-ba0d-4b28-a9d0-9093e7c6c53e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:23.964164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b240fcd4-ba0d-4b28-a9d0-9093e7c6c53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:23.968331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.sql.core [None req-c74eecdc-335b-49a2-944b-4316da06a450 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 19 13:52:23.968331 n-d-master-1 devstack@keystone.service[80679]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 19 13:52:23.968331 n-d-master-1 devstack@keystone.service[80679]: [parameters: {'user_id': '7c0cec1899b34d3d9978bdab971614a7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 19 13:52:23.968331 n-d-master-1 devstack@keystone.service[80679]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80679) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 13:52:23.985503 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-c74eecdc-335b-49a2-944b-4316da06a450 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 19 13:52:23.985503 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:23.985503 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 13:52:23.985503 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 13:52:23.985503 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 13:52:23.985503 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 13:52:23.985503 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 13:52:23.985503 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 13:52:23.985503 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 13:52:23.985503 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application conn.query(q) Jul 19 13:52:23.985503 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 13:52:23.985503 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 13:52:23.985503 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 13:52:23.985503 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application result.read() Jul 19 13:52:23.985503 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 13:52:23.986511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 13:52:23.986511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 13:52:23.986511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 13:52:23.986511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 13:52:23.986511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 13:52:23.986511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 13:52:23.986511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 13:52:23.986511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 19 13:52:23.986511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:23.986511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 13:52:23.986511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:23.986511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:23.986511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 13:52:23.986511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 13:52:23.986511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 19 13:52:23.986511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 19 13:52:23.986511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 13:52:23.986511 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application next(self.gen) Jul 19 13:52:23.987524 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 13:52:23.987524 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application yield resource Jul 19 13:52:23.987524 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 13:52:23.987524 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application next(self.gen) Jul 19 13:52:23.987524 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 13:52:23.987524 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 13:52:23.987524 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 13:52:23.987524 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 13:52:23.987524 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 13:52:23.987524 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise self.value Jul 19 13:52:23.987524 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 13:52:23.987524 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 13:52:23.987524 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 13:52:23.987524 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application session.commit() Jul 19 13:52:23.987524 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 13:52:23.987524 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 13:52:23.987524 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 13:52:23.988437 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 13:52:23.988437 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 13:52:23.988437 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self.session.flush() Jul 19 13:52:23.988437 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 13:52:23.988437 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 13:52:23.988437 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 13:52:23.988437 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 13:52:23.988437 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 13:52:23.988437 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application compat.raise_( Jul 19 13:52:23.988437 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 13:52:23.988437 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception Jul 19 13:52:23.988437 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 13:52:23.988437 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 13:52:23.988437 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 13:52:23.988437 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 13:52:23.988437 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 13:52:23.988437 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 13:52:23.989556 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 13:52:23.989556 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 13:52:23.989556 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 19 13:52:23.989556 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 19 13:52:23.989556 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 13:52:23.989556 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 13:52:23.989556 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 13:52:23.989556 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 13:52:23.989556 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 13:52:23.989556 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 13:52:23.989556 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 13:52:23.989556 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 13:52:23.989556 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 13:52:23.989556 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 13:52:23.989556 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 13:52:23.989556 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception Jul 19 13:52:23.990564 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 13:52:23.990564 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 13:52:23.990564 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 13:52:23.990564 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 13:52:23.990564 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 13:52:23.990564 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 13:52:23.990564 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 13:52:23.990564 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application conn.query(q) Jul 19 13:52:23.990564 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 13:52:23.990564 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 13:52:23.990564 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 13:52:23.990564 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application result.read() Jul 19 13:52:23.990564 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 13:52:23.990564 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 13:52:23.990564 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 13:52:23.990564 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 13:52:23.991750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 13:52:23.991750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 13:52:23.991750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 13:52:23.991750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 13:52:23.991750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 19 13:52:23.991750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 19 13:52:23.991750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [parameters: {'user_id': '7c0cec1899b34d3d9978bdab971614a7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 19 13:52:23.991750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 13:52:23.991750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:23.991750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:23.991750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:23.991750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:23.991750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:23.991750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:23.991750 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:23.993776 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:23.993776 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:23.993776 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:23.993776 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:23.993776 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:23.993776 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:23.993776 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:23.993776 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 19 13:52:23.993776 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 19 13:52:23.993776 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:23.993776 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:23.993776 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:52:23.993776 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:23.993776 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:52:23.993776 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:23.993776 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 19 13:52:23.993776 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 19 13:52:23.995819 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 19 13:52:23.995819 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 19 13:52:23.995819 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 13:52:23.995819 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 13:52:23.995819 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 19 13:52:23.995819 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:23.995819 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 483/964] 10.222.0.43 () {60 vars in 1131 bytes} [Tue Jul 19 13:52:23 2022] POST /identity/v3/users => generated 160 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:23.995819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74eecdc-335b-49a2-944b-4316da06a450 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:24.064546 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 482/965] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 13:52:24.085979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240fcd4-ba0d-4b28-a9d0-9093e7c6c53e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:24.105307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74eecdc-335b-49a2-944b-4316da06a450 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:24.114456 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:24.141142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf852806-ec35-410a-b803-1797e4fc627d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:24.141953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf852806-ec35-410a-b803-1797e4fc627d None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:24.142345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf852806-ec35-410a-b803-1797e4fc627d None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:24.142540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf852806-ec35-410a-b803-1797e4fc627d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:24.150383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf852806-ec35-410a-b803-1797e4fc627d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:24.152022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf852806-ec35-410a-b803-1797e4fc627d None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:24.167518 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-bf852806-ec35-410a-b803-1797e4fc627d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 13:52:24.167518 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:24.167518 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:24.167518 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:24.167518 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:24.167518 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:24.167518 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:24.167518 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:24.167518 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:24.167518 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:24.167518 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:24.167518 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:24.167518 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:52:24.167518 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:52:24.167518 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:52:24.167518 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:52:24.168708 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:24.168708 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:24.168708 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:52:24.168708 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:24.168708 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:52:24.168708 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:24.168708 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:24.168708 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:24.168708 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:24.168708 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:24.168708 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:24.168708 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:24.168708 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:24.168708 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:24.168708 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:24.168708 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:24.168708 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:24.168708 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:24.169673 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:24.169673 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:24.169673 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:52:24.169673 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:52:24.169673 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:52:24.169673 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:52:24.169673 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:52:24.169673 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:52:24.169673 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 13:52:24.169673 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:24.169673 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 484/966] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:52:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:24.174267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf852806-ec35-410a-b803-1797e4fc627d None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:24.183064 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:24.208279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240fcd4-ba0d-4b28-a9d0-9093e7c6c53e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:24.248869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a7f6c-f184-4f8d-955e-befb235781b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:24.250079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a7f6c-f184-4f8d-955e-befb235781b0 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:24.250664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a7f6c-f184-4f8d-955e-befb235781b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:24.251243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a7f6c-f184-4f8d-955e-befb235781b0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:24.263228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a7f6c-f184-4f8d-955e-befb235781b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:52:24.272771 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-701a7f6c-f184-4f8d-955e-befb235781b0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 13:52:24.272771 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:24.272771 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:24.272771 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:24.272771 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:24.272771 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:24.272771 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:24.272771 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:24.272771 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:24.272771 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:24.272771 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:24.272771 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:24.272771 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:52:24.272771 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:52:24.272771 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:52:24.272771 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:52:24.273806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:52:24.273806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:52:24.273806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:52:24.273806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:52:24.273806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:24.273806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:24.273806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:24.273806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:24.273806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:24.273806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:24.273806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:24.273806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:24.273806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:24.273806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:24.273806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:24.273806 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:24.274805 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:24.274805 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:24.274805 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:24.274805 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:24.274805 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:52:24.274805 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:52:24.274805 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:52:24.274805 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:52:24.274805 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:52:24.274805 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:52:24.274805 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 13:52:24.274805 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:24.276959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf852806-ec35-410a-b803-1797e4fc627d None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:24.282366 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 483/967] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Jul 19 13:52:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:24.284047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a7f6c-f184-4f8d-955e-befb235781b0 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:24.312719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1454117-9e41-4cf9-a2d0-f9ef0ec5e16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:24.313372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1454117-9e41-4cf9-a2d0-f9ef0ec5e16b None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:24.313659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1454117-9e41-4cf9-a2d0-f9ef0ec5e16b None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:24.313935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1454117-9e41-4cf9-a2d0-f9ef0ec5e16b None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:24.315037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1454117-9e41-4cf9-a2d0-f9ef0ec5e16b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:24.315352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1454117-9e41-4cf9-a2d0-f9ef0ec5e16b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:24.316751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1454117-9e41-4cf9-a2d0-f9ef0ec5e16b None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:24.355554 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 485/968] 10.222.0.43 () {56 vars in 1101 bytes} [Tue Jul 19 13:52:24 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:24.374523 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:24.399891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a7f6c-f184-4f8d-955e-befb235781b0 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:24.441085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32726cc-d20a-4058-a984-ab5107d8f0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:24.442197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32726cc-d20a-4058-a984-ab5107d8f0fb None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:24.442720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32726cc-d20a-4058-a984-ab5107d8f0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:24.443213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32726cc-d20a-4058-a984-ab5107d8f0fb None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:24.444221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32726cc-d20a-4058-a984-ab5107d8f0fb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:24.444748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32726cc-d20a-4058-a984-ab5107d8f0fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:24.447467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32726cc-d20a-4058-a984-ab5107d8f0fb None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:24.457759 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 484/969] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Jul 19 13:52:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:24.464644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1454117-9e41-4cf9-a2d0-f9ef0ec5e16b None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:24.535782 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:24.546796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44085cbb-d805-4f16-a722-bc6a1d5e3032 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:24.547908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44085cbb-d805-4f16-a722-bc6a1d5e3032 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:24.547908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44085cbb-d805-4f16-a722-bc6a1d5e3032 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:24.548841 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 485/970] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:52:24.556466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff910f9-37fd-42a5-84eb-27406112c8fb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:24.556754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff910f9-37fd-42a5-84eb-27406112c8fb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:24.557022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff910f9-37fd-42a5-84eb-27406112c8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:24.577071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9ff910f9-37fd-42a5-84eb-27406112c8fb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:24.578322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9ff910f9-37fd-42a5-84eb-27406112c8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:24.593016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1454117-9e41-4cf9-a2d0-f9ef0ec5e16b None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:24.629670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66692529-46ed-4328-99c6-bcbba63e28a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:24.630674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66692529-46ed-4328-99c6-bcbba63e28a1 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:24.631069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66692529-46ed-4328-99c6-bcbba63e28a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:24.631451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66692529-46ed-4328-99c6-bcbba63e28a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:24.643531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66692529-46ed-4328-99c6-bcbba63e28a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:24.644993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66692529-46ed-4328-99c6-bcbba63e28a1 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:24.662275 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 486/971] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 13:52:24.665162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-66692529-46ed-4328-99c6-bcbba63e28a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:24.665162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:24.665162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:24.665162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:24.665162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:24.665162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:24.665162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:24.665162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:24.665162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:24.665162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:24.665162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:24.665162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:24.665162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:24.665162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:24.665162 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:24.666662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:24.666662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:24.666662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:24.666662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:24.666662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:24.666662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:24.666662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:24.666662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:24.666662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:24.666662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:24.666662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:24.666662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:24.666662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:24.666662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:24.666662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:24.666662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:24.666662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:24.667584 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:24.667584 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:24.667584 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:24.667584 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:24.667584 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 486/972] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:24.672073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff910f9-37fd-42a5-84eb-27406112c8fb None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:24.687222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66692529-46ed-4328-99c6-bcbba63e28a1 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:24.739062 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:24.781029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff910f9-37fd-42a5-84eb-27406112c8fb None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:24.797568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66692529-46ed-4328-99c6-bcbba63e28a1 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:24.813853 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:24.819611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3fcc4-b688-4edf-8b01-702abb89409d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:24.820274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3fcc4-b688-4edf-8b01-702abb89409d None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:24.820643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3fcc4-b688-4edf-8b01-702abb89409d None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:24.821436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f3fcc4-b688-4edf-8b01-702abb89409d None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:24.822290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3fcc4-b688-4edf-8b01-702abb89409d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:24.822523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3fcc4-b688-4edf-8b01-702abb89409d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:24.823885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f3fcc4-b688-4edf-8b01-702abb89409d None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:24.833177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de5210-64cf-463d-b484-f1cc000c47e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:24.833989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de5210-64cf-463d-b484-f1cc000c47e6 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:24.834303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de5210-64cf-463d-b484-f1cc000c47e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:24.834580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de5210-64cf-463d-b484-f1cc000c47e6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:24.835239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de5210-64cf-463d-b484-f1cc000c47e6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:24.840768 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 487/973] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:24.840921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de5210-64cf-463d-b484-f1cc000c47e6 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:24.841732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3fcc4-b688-4edf-8b01-702abb89409d None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:24.852144 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-55de5210-64cf-463d-b484-f1cc000c47e6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 13:52:24.852144 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:24.852144 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:52:24.852144 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:52:24.852144 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:52:24.852144 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:52:24.852144 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:52:24.852144 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:24.852144 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 13:52:24.852144 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:24.852144 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:24.852144 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:24.852144 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:24.852144 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:24.852144 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:24.852144 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:24.852144 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:24.853870 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:24.853870 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:24.853870 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:24.853870 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:24.853870 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:24.853870 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:24.853870 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:52:24.853870 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:52:24.853870 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:52:24.853870 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:52:24.853870 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:24.853870 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:24.853870 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:24.853870 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:24.853870 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:24.853870 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:24.854934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:24.854934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:24.854934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:24.854934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:24.854934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:24.854934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:24.854934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:24.854934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:24.854934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:24.854934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:24.854934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:52:24.854934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:24.854934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 13:52:24.854934 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:24.854934 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 487/974] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jul 19 13:52:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:24.859841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de5210-64cf-463d-b484-f1cc000c47e6 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:24.958625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f3fcc4-b688-4edf-8b01-702abb89409d None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:24.966531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de5210-64cf-463d-b484-f1cc000c47e6 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:24.984794 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:25.000146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02574dd7-f02a-4084-bf41-956495558f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:25.000146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02574dd7-f02a-4084-bf41-956495558f5a None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:25.000146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02574dd7-f02a-4084-bf41-956495558f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:25.000146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02574dd7-f02a-4084-bf41-956495558f5a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:25.002234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88362db-6cb0-4e19-8055-83a4bef6c8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:25.002904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88362db-6cb0-4e19-8055-83a4bef6c8ff None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:25.003190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88362db-6cb0-4e19-8055-83a4bef6c8ff None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:25.003468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88362db-6cb0-4e19-8055-83a4bef6c8ff None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:25.004185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88362db-6cb0-4e19-8055-83a4bef6c8ff None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:25.004501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88362db-6cb0-4e19-8055-83a4bef6c8ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:25.005443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02574dd7-f02a-4084-bf41-956495558f5a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:25.005837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88362db-6cb0-4e19-8055-83a4bef6c8ff None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:25.006933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02574dd7-f02a-4084-bf41-956495558f5a None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:25.011799 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 488/975] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jul 19 13:52:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:25.017152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88362db-6cb0-4e19-8055-83a4bef6c8ff None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:25.023147 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-02574dd7-f02a-4084-bf41-956495558f5a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 13:52:25.023147 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:25.023147 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:25.023147 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:25.023147 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:25.023147 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:25.023147 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:25.023147 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:25.023147 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:25.023147 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:25.023147 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:25.023147 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:25.023147 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:52:25.023147 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:52:25.023147 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:52:25.023147 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:52:25.024541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:25.024541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:25.024541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:52:25.024541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:25.024541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:52:25.024541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:25.024541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:25.024541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:25.024541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:25.024541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:25.024541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:25.024541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:25.024541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:25.024541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:25.024541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:25.024541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:25.024541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:25.024541 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:25.025664 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:25.025664 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:25.025664 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:52:25.025664 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:52:25.025664 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:52:25.025664 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:52:25.025664 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:52:25.025664 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:52:25.025664 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 13:52:25.025664 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:25.029878 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 488/976] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jul 19 13:52:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:25.031912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837885c-0933-4cb6-896e-691e18433790 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:25.032444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837885c-0933-4cb6-896e-691e18433790 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:25.032729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837885c-0933-4cb6-896e-691e18433790 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:25.034193 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 489/977] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:25.034886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837885c-0933-4cb6-896e-691e18433790 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:25.068824 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:25.123951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88362db-6cb0-4e19-8055-83a4bef6c8ff None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:25.136101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837885c-0933-4cb6-896e-691e18433790 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:25.157000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44711d-bb9f-40d1-ad17-dc8bc869de9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:25.157668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44711d-bb9f-40d1-ad17-dc8bc869de9f None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:25.157956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44711d-bb9f-40d1-ad17-dc8bc869de9f None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:25.158295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44711d-bb9f-40d1-ad17-dc8bc869de9f None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:25.159010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44711d-bb9f-40d1-ad17-dc8bc869de9f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:25.159321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44711d-bb9f-40d1-ad17-dc8bc869de9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:25.160684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44711d-bb9f-40d1-ad17-dc8bc869de9f None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:25.166025 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 489/978] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jul 19 13:52:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:25.167307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f9e30-66c9-4594-b39b-546060c4f699 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:25.167605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f9e30-66c9-4594-b39b-546060c4f699 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:25.167903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f9e30-66c9-4594-b39b-546060c4f699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:25.171867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f807a-f9eb-44de-b815-955cfb7dbdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:25.172533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f807a-f9eb-44de-b815-955cfb7dbdfd None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:25.172864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f807a-f9eb-44de-b815-955cfb7dbdfd None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:25.173086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8f807a-f9eb-44de-b815-955cfb7dbdfd None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:25.173924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f807a-f9eb-44de-b815-955cfb7dbdfd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:25.174256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f807a-f9eb-44de-b815-955cfb7dbdfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:25.175668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8f807a-f9eb-44de-b815-955cfb7dbdfd None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:25.184652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2b9f9e30-66c9-4594-b39b-546060c4f699 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:25.190426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2b9f9e30-66c9-4594-b39b-546060c4f699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:25.194573 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 490/979] 10.222.0.43 () {56 vars in 1149 bytes} [Tue Jul 19 13:52:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:25.195370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f807a-f9eb-44de-b815-955cfb7dbdfd None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:25.238004 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:25.258734 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 490/980] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:25.259523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f9e30-66c9-4594-b39b-546060c4f699 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:25.299417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8f807a-f9eb-44de-b815-955cfb7dbdfd None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:25.303184 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:25.333577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff49f37-1fff-4969-b440-ad8cedd6ce63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:25.334497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff49f37-1fff-4969-b440-ad8cedd6ce63 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:25.334782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff49f37-1fff-4969-b440-ad8cedd6ce63 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:25.335058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff49f37-1fff-4969-b440-ad8cedd6ce63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:25.335862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff49f37-1fff-4969-b440-ad8cedd6ce63 None admin] RBAC: Adding query filter params (interface=admin, service_id=05103691c0d04dc998e35c1cf7a319ef, region_id=RegionOne) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:25.336706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff49f37-1fff-4969-b440-ad8cedd6ce63 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:25.338181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff49f37-1fff-4969-b440-ad8cedd6ce63 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:25.343593 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 491/981] 10.222.0.43 () {56 vars in 1249 bytes} [Tue Jul 19 13:52:25 2022] GET /identity/v3/endpoints?service_id=05103691c0d04dc998e35c1cf7a319ef&interface=admin®ion_id=RegionOne => generated 193 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:25.344346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff49f37-1fff-4969-b440-ad8cedd6ce63 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:25.363143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f9e30-66c9-4594-b39b-546060c4f699 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:25.407770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c191481-2861-4772-b70b-10293d609acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:25.408422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c191481-2861-4772-b70b-10293d609acc None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:25.408715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c191481-2861-4772-b70b-10293d609acc None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:25.408984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c191481-2861-4772-b70b-10293d609acc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:25.443582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff49f37-1fff-4969-b440-ad8cedd6ce63 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:25.445944 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:25.478039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dbd7a-ec07-4235-a298-0961739e5864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:25.478729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dbd7a-ec07-4235-a298-0961739e5864 None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:25.479018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dbd7a-ec07-4235-a298-0961739e5864 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:25.479298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2dbd7a-ec07-4235-a298-0961739e5864 None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:25.480018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dbd7a-ec07-4235-a298-0961739e5864 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:25.481391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2dbd7a-ec07-4235-a298-0961739e5864 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:25.481564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c191481-2861-4772-b70b-10293d609acc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:25.483038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c191481-2861-4772-b70b-10293d609acc None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:25.520146 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:25.546479 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 492/982] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 19 13:52:25 2022] POST /identity/v3/services => generated 242 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:52:25.547283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dbd7a-ec07-4235-a298-0961739e5864 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:25.584792 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 491/983] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:52:25 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 13:52:25.591605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c191481-2861-4772-b70b-10293d609acc None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:25.690313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2dbd7a-ec07-4235-a298-0961739e5864 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:25.705962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c191481-2861-4772-b70b-10293d609acc None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:25.731500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bfc58-f21c-41d6-b5f1-481309742a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:25.732180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bfc58-f21c-41d6-b5f1-481309742a2d None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:25.732457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bfc58-f21c-41d6-b5f1-481309742a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:25.732738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bfc58-f21c-41d6-b5f1-481309742a2d None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:25.733432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1bfc58-f21c-41d6-b5f1-481309742a2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:25.734830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1bfc58-f21c-41d6-b5f1-481309742a2d None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:25.741976 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 493/984] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jul 19 13:52:25 2022] GET /identity/v3/services => generated 1727 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 13:52:25.744293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1132b-dcc3-4cb9-9b32-c757a423f86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:25.745166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1132b-dcc3-4cb9-9b32-c757a423f86c None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:25.745448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1132b-dcc3-4cb9-9b32-c757a423f86c None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:25.745761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1132b-dcc3-4cb9-9b32-c757a423f86c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:25.753775 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:25.758705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1132b-dcc3-4cb9-9b32-c757a423f86c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:25.760626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1132b-dcc3-4cb9-9b32-c757a423f86c None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:25.780659 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-f2f1132b-dcc3-4cb9-9b32-c757a423f86c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:25.780659 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:25.780659 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:25.780659 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:25.780659 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:25.780659 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:25.780659 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:25.780659 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:25.780659 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:25.780659 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:25.780659 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:25.780659 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:25.780659 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:25.780659 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:25.780659 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:25.781817 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:25.781817 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:25.781817 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:25.781817 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:25.781817 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:25.781817 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:25.781817 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:25.781817 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:25.781817 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:25.781817 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:25.781817 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:25.781817 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:25.781817 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:25.781817 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:25.781817 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:25.781817 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:25.781817 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:25.782823 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:25.782823 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:25.782823 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:25.782823 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:25.785226 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 492/985] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:25.788898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bfc58-f21c-41d6-b5f1-481309742a2d None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:25.818582 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:25.903603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bfc58-f21c-41d6-b5f1-481309742a2d None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:25.940697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cce71-ec6a-4c3a-8d7f-ee8e2f6a394c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:25.941370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cce71-ec6a-4c3a-8d7f-ee8e2f6a394c None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:25.941654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cce71-ec6a-4c3a-8d7f-ee8e2f6a394c None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:25.941931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cce71-ec6a-4c3a-8d7f-ee8e2f6a394c None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:25.942695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cce71-ec6a-4c3a-8d7f-ee8e2f6a394c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:25.943003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cce71-ec6a-4c3a-8d7f-ee8e2f6a394c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:25.944381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cce71-ec6a-4c3a-8d7f-ee8e2f6a394c None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:25.956301 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 494/986] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:25.962046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1132b-dcc3-4cb9-9b32-c757a423f86c None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:26.064812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1132b-dcc3-4cb9-9b32-c757a423f86c None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:26.099070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e13904-9a58-45be-885d-261cdc0a6f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:26.100609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e13904-9a58-45be-885d-261cdc0a6f6f None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:26.100609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e13904-9a58-45be-885d-261cdc0a6f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:26.100609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e13904-9a58-45be-885d-261cdc0a6f6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:26.108398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e13904-9a58-45be-885d-261cdc0a6f6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:26.109847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e13904-9a58-45be-885d-261cdc0a6f6f None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:26.125006 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-11e13904-9a58-45be-885d-261cdc0a6f6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:26.125006 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:26.125006 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:26.125006 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:26.125006 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:26.125006 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:26.125006 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:26.125006 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:26.125006 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:26.125006 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:26.125006 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:26.125006 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:26.125006 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:52:26.125006 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:52:26.125006 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:52:26.125948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:52:26.125948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:26.125948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:26.125948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:26.125948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:26.125948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:26.125948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:26.125948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:26.125948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:26.125948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:26.125948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:26.125948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:26.125948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:26.125948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:26.125948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:26.125948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:26.125948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:26.127485 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:52:26.127485 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:52:26.127485 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:52:26.127485 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:52:26.127485 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:52:26.127485 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:52:26.127485 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:26.127485 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:26.130170 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 493/987] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:52:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:26.132047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cce71-ec6a-4c3a-8d7f-ee8e2f6a394c None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:26.230256 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:26.245796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cce71-ec6a-4c3a-8d7f-ee8e2f6a394c None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:26.281149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751592c4-fdda-4e67-877f-80b7bc421a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:26.281814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751592c4-fdda-4e67-877f-80b7bc421a47 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:26.282114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751592c4-fdda-4e67-877f-80b7bc421a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:26.282393 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751592c4-fdda-4e67-877f-80b7bc421a47 None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:26.283182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751592c4-fdda-4e67-877f-80b7bc421a47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:26.283489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751592c4-fdda-4e67-877f-80b7bc421a47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:26.284914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751592c4-fdda-4e67-877f-80b7bc421a47 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:26.302336 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 495/988] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:52:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:26.303406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e13904-9a58-45be-885d-261cdc0a6f6f None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:26.354642 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:26.405708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e13904-9a58-45be-885d-261cdc0a6f6f None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:26.438970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121db758-47a7-446b-9a04-3d4a109eafce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:26.440000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121db758-47a7-446b-9a04-3d4a109eafce None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:26.440386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121db758-47a7-446b-9a04-3d4a109eafce None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:26.440779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121db758-47a7-446b-9a04-3d4a109eafce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:26.441707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121db758-47a7-446b-9a04-3d4a109eafce None admin] RBAC: Adding query filter params (role.id=3841e5d49ee04bf08c66d1134dc3b552, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=ec07a12b28934ef9b04325404fd3c950) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:26.442164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121db758-47a7-446b-9a04-3d4a109eafce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:26.443683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121db758-47a7-446b-9a04-3d4a109eafce None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:26.450453 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 494/989] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:52:26 2022] GET /identity/v3/role_assignments?user.id=ec07a12b28934ef9b04325404fd3c950&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=3841e5d49ee04bf08c66d1134dc3b552 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:27.613671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a91c-16cf-4872-b79d-eb69f120ec05 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:27.614211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a91c-16cf-4872-b79d-eb69f120ec05 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:27.614480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5a91c-16cf-4872-b79d-eb69f120ec05 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:27.615761 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 496/990] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:27.621184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80540e0-2630-47d6-85c4-be6909308407 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:27.621599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80540e0-2630-47d6-85c4-be6909308407 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:27.621786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80540e0-2630-47d6-85c4-be6909308407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:27.638291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d80540e0-2630-47d6-85c4-be6909308407 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:27.639464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d80540e0-2630-47d6-85c4-be6909308407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:27.708852 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 495/991] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:27.731966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5a91c-16cf-4872-b79d-eb69f120ec05 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:27.803670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557968d-dc52-479b-a92b-3b5bc182d639 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:27.804012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557968d-dc52-479b-a92b-3b5bc182d639 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:27.804248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4557968d-dc52-479b-a92b-3b5bc182d639 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:27.806516 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 496/992] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:52:27.811413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe5ba9-0267-491e-b682-5417694670e2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:27.811701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe5ba9-0267-491e-b682-5417694670e2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:27.811979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe5ba9-0267-491e-b682-5417694670e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:27.829752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-09fe5ba9-0267-491e-b682-5417694670e2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:27.830952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-09fe5ba9-0267-491e-b682-5417694670e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:27.838963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5a91c-16cf-4872-b79d-eb69f120ec05 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:27.873354 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:27.876981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1621ba-0e44-4efc-9354-f7281e7c1790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:27.877952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1621ba-0e44-4efc-9354-f7281e7c1790 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:27.878274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1621ba-0e44-4efc-9354-f7281e7c1790 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:27.878544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1621ba-0e44-4efc-9354-f7281e7c1790 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:27.879204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1621ba-0e44-4efc-9354-f7281e7c1790 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:27.880559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1621ba-0e44-4efc-9354-f7281e7c1790 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:27.892764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-8a1621ba-0e44-4efc-9354-f7281e7c1790 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 13:52:27.892764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:27.892764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:52:27.892764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:52:27.892764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:52:27.892764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:52:27.892764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:52:27.892764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:27.892764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 13:52:27.892764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:27.892764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:27.892764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:27.892764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:27.892764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:27.892764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:27.892764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:27.892764 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:27.895913 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:27.895913 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:27.895913 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:27.895913 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:27.895913 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:27.895913 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:27.895913 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:52:27.895913 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:52:27.895913 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:52:27.895913 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:52:27.895913 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:27.895913 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:27.895913 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:27.895913 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:27.895913 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:27.895913 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:27.896763 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:27.896763 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:27.896763 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:27.896763 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:27.896763 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:27.896763 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:27.896763 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:27.896763 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:27.896763 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:27.896763 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:27.896763 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:52:27.896763 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:27.896763 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 13:52:27.896763 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:27.896763 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 497/993] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:52:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:27.899946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1621ba-0e44-4efc-9354-f7281e7c1790 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:27.903992 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 497/994] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:27 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 13:52:27.910957 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:27.926367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe5ba9-0267-491e-b682-5417694670e2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:28.008399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1621ba-0e44-4efc-9354-f7281e7c1790 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:28.034245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe5ba9-0267-491e-b682-5417694670e2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:28.043530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3bd27-909a-4bd7-aae6-539e779c302e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:28.044199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3bd27-909a-4bd7-aae6-539e779c302e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:28.044485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3bd27-909a-4bd7-aae6-539e779c302e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:28.044758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff3bd27-909a-4bd7-aae6-539e779c302e None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:28.045465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3bd27-909a-4bd7-aae6-539e779c302e None admin] RBAC: Adding query filter params (name=compute) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:28.045776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3bd27-909a-4bd7-aae6-539e779c302e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:28.047173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff3bd27-909a-4bd7-aae6-539e779c302e None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:28.052444 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 498/995] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 19 13:52:27 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:28.058499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3bd27-909a-4bd7-aae6-539e779c302e None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:28.073336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06969d6-ebb3-4f82-8bec-c503751b15b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:28.074216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06969d6-ebb3-4f82-8bec-c503751b15b1 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:28.074502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06969d6-ebb3-4f82-8bec-c503751b15b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:28.074781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06969d6-ebb3-4f82-8bec-c503751b15b1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:28.075427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06969d6-ebb3-4f82-8bec-c503751b15b1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:28.076784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06969d6-ebb3-4f82-8bec-c503751b15b1 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:28.089598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-c06969d6-ebb3-4f82-8bec-c503751b15b1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 13:52:28.089598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:28.089598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:52:28.089598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:52:28.089598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:52:28.089598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:52:28.089598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:52:28.089598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:28.089598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 13:52:28.089598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:28.089598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:28.089598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:28.089598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:28.089598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:28.089598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:28.089598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:28.089598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:28.090661 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:28.090661 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:28.090661 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:28.090661 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:28.090661 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:28.090661 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:28.090661 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:52:28.090661 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:52:28.090661 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:52:28.090661 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:52:28.090661 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:28.090661 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:28.090661 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:28.090661 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:28.090661 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:28.090661 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:28.091523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:28.091523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:28.091523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:28.091523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:28.091523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:28.091523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:28.091523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:28.091523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:28.091523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:28.091523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:28.091523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:52:28.091523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:28.091523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 13:52:28.091523 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:28.091523 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 498/996] 10.222.0.43 () {56 vars in 1126 bytes} [Tue Jul 19 13:52:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:28.096557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06969d6-ebb3-4f82-8bec-c503751b15b1 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:28.134639 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:28.144593 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:28.167137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff3bd27-909a-4bd7-aae6-539e779c302e None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:28.203820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1072d-8d14-47d7-a8ef-d75041254ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:28.204490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1072d-8d14-47d7-a8ef-d75041254ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:28.204771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1072d-8d14-47d7-a8ef-d75041254ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:28.205047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1072d-8d14-47d7-a8ef-d75041254ab4 None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:28.207287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1072d-8d14-47d7-a8ef-d75041254ab4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:28.207287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1072d-8d14-47d7-a8ef-d75041254ab4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:28.207461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1072d-8d14-47d7-a8ef-d75041254ab4 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:28.214298 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 499/997] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 19 13:52:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:28.219138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06969d6-ebb3-4f82-8bec-c503751b15b1 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:28.220934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1072d-8d14-47d7-a8ef-d75041254ab4 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:28.255984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005e5ba-1c27-43e3-8777-669a738a15d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:28.256656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005e5ba-1c27-43e3-8777-669a738a15d0 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:28.256942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005e5ba-1c27-43e3-8777-669a738a15d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:28.257218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005e5ba-1c27-43e3-8777-669a738a15d0 None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:28.257925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005e5ba-1c27-43e3-8777-669a738a15d0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:28.258288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005e5ba-1c27-43e3-8777-669a738a15d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:28.259644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005e5ba-1c27-43e3-8777-669a738a15d0 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:28.268896 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 499/998] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jul 19 13:52:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:28.275696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005e5ba-1c27-43e3-8777-669a738a15d0 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:28.331833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1072d-8d14-47d7-a8ef-d75041254ab4 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:28.368053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7401e-4de3-4027-8b93-c8e1477dfea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:28.368765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7401e-4de3-4027-8b93-c8e1477dfea9 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:28.369049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7401e-4de3-4027-8b93-c8e1477dfea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:28.369600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7401e-4de3-4027-8b93-c8e1477dfea9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:28.370145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7401e-4de3-4027-8b93-c8e1477dfea9 None admin] RBAC: Adding query filter params (interface=public, service_id=3aaa0eba52014091b6d83e5cb895b242, region_id=RegionOne) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:28.370463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7401e-4de3-4027-8b93-c8e1477dfea9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:28.371826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7401e-4de3-4027-8b93-c8e1477dfea9 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:28.374631 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:28.378521 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 500/999] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jul 19 13:52:28 2022] GET /identity/v3/endpoints?service_id=3aaa0eba52014091b6d83e5cb895b242&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:28.382498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005e5ba-1c27-43e3-8777-669a738a15d0 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:28.384258 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:28.389917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7401e-4de3-4027-8b93-c8e1477dfea9 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:28.420098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a947a8-24d8-4b71-a17d-b74793732840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:28.420767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a947a8-24d8-4b71-a17d-b74793732840 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:28.421051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a947a8-24d8-4b71-a17d-b74793732840 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:28.421327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a947a8-24d8-4b71-a17d-b74793732840 None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:28.422038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a947a8-24d8-4b71-a17d-b74793732840 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:28.422373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a947a8-24d8-4b71-a17d-b74793732840 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:28.423725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a947a8-24d8-4b71-a17d-b74793732840 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:28.428760 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 500/1000] 10.222.0.43 () {56 vars in 1122 bytes} [Tue Jul 19 13:52:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:28.434960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a947a8-24d8-4b71-a17d-b74793732840 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:28.492844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7401e-4de3-4027-8b93-c8e1477dfea9 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:28.527834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1d6e5-6b2a-4c26-b139-0c2997fcbb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:28.528501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1d6e5-6b2a-4c26-b139-0c2997fcbb76 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:28.528787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1d6e5-6b2a-4c26-b139-0c2997fcbb76 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:28.529072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1d6e5-6b2a-4c26-b139-0c2997fcbb76 None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:28.529747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1d6e5-6b2a-4c26-b139-0c2997fcbb76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:28.531161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1d6e5-6b2a-4c26-b139-0c2997fcbb76 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:28.537611 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 501/1001] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jul 19 13:52:28 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 13:52:28.538988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969c004-d91a-4f3d-8157-f25f8d7b4fa6 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:28.539320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969c004-d91a-4f3d-8157-f25f8d7b4fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:28.539608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969c004-d91a-4f3d-8157-f25f8d7b4fa6 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:28.541192 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 502/1002] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:28.547654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781f7a6-f091-44ee-9a00-9e38cfb170df None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:28.547946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781f7a6-f091-44ee-9a00-9e38cfb170df None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:28.548229 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781f7a6-f091-44ee-9a00-9e38cfb170df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:28.550839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a947a8-24d8-4b71-a17d-b74793732840 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:28.568127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d781f7a6-f091-44ee-9a00-9e38cfb170df None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:28.569363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d781f7a6-f091-44ee-9a00-9e38cfb170df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:28.596990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3022ede-38ba-4664-bd0a-29b3a3ccbbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:28.597674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3022ede-38ba-4664-bd0a-29b3a3ccbbe4 None admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:28.597981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3022ede-38ba-4664-bd0a-29b3a3ccbbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:28.598285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3022ede-38ba-4664-bd0a-29b3a3ccbbe4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:28.599052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3022ede-38ba-4664-bd0a-29b3a3ccbbe4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:28.600439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3022ede-38ba-4664-bd0a-29b3a3ccbbe4 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:28.639247 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:28.653087 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 503/1003] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:28 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:28.672068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781f7a6-f091-44ee-9a00-9e38cfb170df None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:28.679857 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 501/1004] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jul 19 13:52:28 2022] POST /identity/v3/endpoints => generated 325 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 13:52:28.788555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781f7a6-f091-44ee-9a00-9e38cfb170df None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:28.832359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aaf485-beb8-45e3-89b6-17c8796823c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:28.833163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaf485-beb8-45e3-89b6-17c8796823c8 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:28.833446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaf485-beb8-45e3-89b6-17c8796823c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:28.833721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaf485-beb8-45e3-89b6-17c8796823c8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:28.834402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aaf485-beb8-45e3-89b6-17c8796823c8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:28.835776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aaf485-beb8-45e3-89b6-17c8796823c8 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:28.847938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-11aaf485-beb8-45e3-89b6-17c8796823c8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 13:52:28.847938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:28.847938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:52:28.847938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:52:28.847938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:52:28.847938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:52:28.847938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:52:28.847938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:28.847938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 13:52:28.847938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:28.847938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:28.847938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:28.847938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:28.847938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:28.847938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:28.847938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:28.847938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:28.849175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:28.849175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:28.849175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:28.849175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:28.849175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:28.849175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:28.849175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:52:28.849175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:52:28.849175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:52:28.849175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:52:28.849175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:28.849175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:28.849175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:28.849175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:28.849175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:28.849175 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:28.850314 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:28.850314 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:28.850314 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:28.850314 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:28.850314 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:28.850314 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:28.850314 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:28.850314 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:28.850314 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:28.850314 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:28.850314 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:52:28.850314 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:28.850314 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 13:52:28.850314 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:28.850314 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 504/1005] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Jul 19 13:52:28 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:28.856290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3022ede-38ba-4664-bd0a-29b3a3ccbbe4 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:28.888001 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:28.964449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3022ede-38ba-4664-bd0a-29b3a3ccbbe4 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:29.001110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec33d6da-10e7-4744-b160-5bdc9aa03230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:29.001782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33d6da-10e7-4744-b160-5bdc9aa03230 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:29.002065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33d6da-10e7-4744-b160-5bdc9aa03230 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:29.002368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec33d6da-10e7-4744-b160-5bdc9aa03230 None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:29.003076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33d6da-10e7-4744-b160-5bdc9aa03230 None admin] RBAC: Adding query filter params (name=image) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:29.003377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33d6da-10e7-4744-b160-5bdc9aa03230 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:29.004740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec33d6da-10e7-4744-b160-5bdc9aa03230 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:29.010527 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 502/1006] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:29.016317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aaf485-beb8-45e3-89b6-17c8796823c8 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:29.076867 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:29.122958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aaf485-beb8-45e3-89b6-17c8796823c8 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:29.158191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae37aa4-0907-4172-b358-974e7a9d04a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:29.158854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae37aa4-0907-4172-b358-974e7a9d04a9 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:29.159134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae37aa4-0907-4172-b358-974e7a9d04a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:29.159405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae37aa4-0907-4172-b358-974e7a9d04a9 None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:29.160112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae37aa4-0907-4172-b358-974e7a9d04a9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:29.160415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae37aa4-0907-4172-b358-974e7a9d04a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:29.161768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae37aa4-0907-4172-b358-974e7a9d04a9 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:29.166947 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 505/1007] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:29 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:30.604167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ab8c6-ec28-4195-bad9-45ea6bac8602 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:30.604659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ab8c6-ec28-4195-bad9-45ea6bac8602 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:30.604659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ab8c6-ec28-4195-bad9-45ea6bac8602 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:30.606010 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 503/1008] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:30.611047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d97f0-e8cf-45cc-a301-570196447c11 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:30.611435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d97f0-e8cf-45cc-a301-570196447c11 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:30.611597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d97f0-e8cf-45cc-a301-570196447c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:30.629048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-273d97f0-e8cf-45cc-a301-570196447c11 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:30.630263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-273d97f0-e8cf-45cc-a301-570196447c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:30.702795 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 506/1009] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:30 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:30.725621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ab8c6-ec28-4195-bad9-45ea6bac8602 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:30.767316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7ebac-117b-47d4-89ba-e4dd6085e86d None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:30.767621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7ebac-117b-47d4-89ba-e4dd6085e86d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:30.767890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed7ebac-117b-47d4-89ba-e4dd6085e86d None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:30.769413 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 507/1010] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:52:30.774773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30f9b4-b5e9-4f37-812b-6e9c737582eb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:30.775160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30f9b4-b5e9-4f37-812b-6e9c737582eb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:30.775449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30f9b4-b5e9-4f37-812b-6e9c737582eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:30.792343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-fc30f9b4-b5e9-4f37-812b-6e9c737582eb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:30.793534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fc30f9b4-b5e9-4f37-812b-6e9c737582eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:30.824605 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:30.835809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ab8c6-ec28-4195-bad9-45ea6bac8602 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:30.839857 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:30.864534 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 508/1011] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:30 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 13:52:30.874064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0d0a1-57aa-4cd7-a9ac-3bc1fe7a7b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:30.874904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0d0a1-57aa-4cd7-a9ac-3bc1fe7a7b77 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:30.875187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0d0a1-57aa-4cd7-a9ac-3bc1fe7a7b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:30.875461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0d0a1-57aa-4cd7-a9ac-3bc1fe7a7b77 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:30.876147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0d0a1-57aa-4cd7-a9ac-3bc1fe7a7b77 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:30.877543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0d0a1-57aa-4cd7-a9ac-3bc1fe7a7b77 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:30.889275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30f9b4-b5e9-4f37-812b-6e9c737582eb None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:30.889431 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-e1d0d0a1-57aa-4cd7-a9ac-3bc1fe7a7b77 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 13:52:30.889431 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:30.889431 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:52:30.889431 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:52:30.889431 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:52:30.889431 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:52:30.889431 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:52:30.889431 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:30.889431 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 13:52:30.889431 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:30.889431 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:30.889431 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:30.889431 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:30.889431 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:30.889431 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:30.889431 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:30.889431 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:30.890645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:30.890645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:30.890645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:30.890645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:30.890645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:30.890645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:30.890645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:52:30.890645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:52:30.890645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:52:30.890645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:52:30.890645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:30.890645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:30.890645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:30.890645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:30.890645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:30.890645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:30.891709 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:30.891709 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:30.891709 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:30.891709 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:30.891709 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:30.891709 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:30.891709 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:30.891709 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:30.891709 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:30.891709 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:30.891709 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:52:30.891709 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:30.891709 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 13:52:30.891709 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:30.892887 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 504/1012] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:52:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:30.896058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0d0a1-57aa-4cd7-a9ac-3bc1fe7a7b77 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:30.996505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30f9b4-b5e9-4f37-812b-6e9c737582eb None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:31.004478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0d0a1-57aa-4cd7-a9ac-3bc1fe7a7b77 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:31.032047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37324d6-e1d6-4b62-a820-b5f49f65794a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:31.032844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37324d6-e1d6-4b62-a820-b5f49f65794a None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:31.033133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37324d6-e1d6-4b62-a820-b5f49f65794a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:31.033413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37324d6-e1d6-4b62-a820-b5f49f65794a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:31.034619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37324d6-e1d6-4b62-a820-b5f49f65794a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:31.036095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37324d6-e1d6-4b62-a820-b5f49f65794a None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:31.037843 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 509/1013] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:31.040437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48251d29-c79a-4498-b75a-d6eff66e05b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:31.041112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48251d29-c79a-4498-b75a-d6eff66e05b8 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:31.041397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48251d29-c79a-4498-b75a-d6eff66e05b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:31.041675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48251d29-c79a-4498-b75a-d6eff66e05b8 None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:31.042418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48251d29-c79a-4498-b75a-d6eff66e05b8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:31.042997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48251d29-c79a-4498-b75a-d6eff66e05b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:31.043770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37324d6-e1d6-4b62-a820-b5f49f65794a None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:31.044171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48251d29-c79a-4498-b75a-d6eff66e05b8 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:31.053511 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 505/1014] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 19 13:52:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:31.054875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48251d29-c79a-4498-b75a-d6eff66e05b8 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:31.074454 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:31.096320 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:31.155823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37324d6-e1d6-4b62-a820-b5f49f65794a None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:31.163789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48251d29-c79a-4498-b75a-d6eff66e05b8 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:31.193024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da959978-e6aa-4823-a38f-dea88ac3768a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:31.193685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da959978-e6aa-4823-a38f-dea88ac3768a None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:31.193971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da959978-e6aa-4823-a38f-dea88ac3768a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:31.194280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da959978-e6aa-4823-a38f-dea88ac3768a None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:31.194994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da959978-e6aa-4823-a38f-dea88ac3768a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:31.196668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da959978-e6aa-4823-a38f-dea88ac3768a None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:31.201127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc389946-4d42-4e97-8131-39ede7465f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:31.201797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc389946-4d42-4e97-8131-39ede7465f8b None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:31.202085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc389946-4d42-4e97-8131-39ede7465f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:31.202390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc389946-4d42-4e97-8131-39ede7465f8b None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:31.203103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc389946-4d42-4e97-8131-39ede7465f8b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:31.203411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc389946-4d42-4e97-8131-39ede7465f8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:31.205348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc389946-4d42-4e97-8131-39ede7465f8b None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:31.213780 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 506/1015] 10.222.0.43 () {56 vars in 1112 bytes} [Tue Jul 19 13:52:31 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:31.219439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc389946-4d42-4e97-8131-39ede7465f8b None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:31.300076 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:31.308140 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 510/1016] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 19 13:52:31 2022] POST /identity/v3/projects => generated 311 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 13:52:31.309820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef637a47-6a19-47c9-afda-80f81d8274ef None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:31.310139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef637a47-6a19-47c9-afda-80f81d8274ef None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:31.310447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef637a47-6a19-47c9-afda-80f81d8274ef None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:31.312426 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 511/1017] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:31.318659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ef14a-5ab4-4df1-aa33-19226d5c29a2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:31.318945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ef14a-5ab4-4df1-aa33-19226d5c29a2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:31.319216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ef14a-5ab4-4df1-aa33-19226d5c29a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:31.324811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc389946-4d42-4e97-8131-39ede7465f8b None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:31.339114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2f3ef14a-5ab4-4df1-aa33-19226d5c29a2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:31.340624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2f3ef14a-5ab4-4df1-aa33-19226d5c29a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:31.363264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409747c6-d199-4ad7-9588-1b693e8047ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:31.363956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409747c6-d199-4ad7-9588-1b693e8047ce None admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:31.364244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409747c6-d199-4ad7-9588-1b693e8047ce None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:31.364525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409747c6-d199-4ad7-9588-1b693e8047ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:31.365315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409747c6-d199-4ad7-9588-1b693e8047ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:31.366776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409747c6-d199-4ad7-9588-1b693e8047ce None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:31.416903 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 512/1018] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:31 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 13:52:31.440302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ef14a-5ab4-4df1-aa33-19226d5c29a2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:31.452390 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 507/1019] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jul 19 13:52:31 2022] POST /identity/v3/endpoints => generated 334 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:52:31.474156 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:31.559680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ef14a-5ab4-4df1-aa33-19226d5c29a2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:31.605009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537da8c2-58cb-41a9-84ec-6dae6230e4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:31.605677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537da8c2-58cb-41a9-84ec-6dae6230e4df None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:31.605956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537da8c2-58cb-41a9-84ec-6dae6230e4df None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:31.606263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537da8c2-58cb-41a9-84ec-6dae6230e4df None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:31.606976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537da8c2-58cb-41a9-84ec-6dae6230e4df None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:31.608335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537da8c2-58cb-41a9-84ec-6dae6230e4df None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:31.684655 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 513/1020] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 19 13:52:31 2022] POST /identity/v3/services => generated 242 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 13:52:33.422864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e6046-a85d-4e45-b70e-1d8d423763bd None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:33.423380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e6046-a85d-4e45-b70e-1d8d423763bd None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:33.423460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936e6046-a85d-4e45-b70e-1d8d423763bd None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:33.424826 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 508/1021] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:33.431059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6cde6-34bf-4008-b3bb-fe178e44372e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:33.431059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6cde6-34bf-4008-b3bb-fe178e44372e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:33.431627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6cde6-34bf-4008-b3bb-fe178e44372e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:33.448383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ebf6cde6-34bf-4008-b3bb-fe178e44372e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:33.449566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ebf6cde6-34bf-4008-b3bb-fe178e44372e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:33.522959 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 514/1022] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:33.547722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e6046-a85d-4e45-b70e-1d8d423763bd None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:33.610311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56548c-2cde-48ae-8f57-aa8b923e8596 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:33.610630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56548c-2cde-48ae-8f57-aa8b923e8596 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:33.610875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56548c-2cde-48ae-8f57-aa8b923e8596 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:33.612251 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 515/1023] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:33.617239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d007049-3bcc-49b6-9ae2-249fe8a0c034 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:33.618029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d007049-3bcc-49b6-9ae2-249fe8a0c034 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:33.618927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d007049-3bcc-49b6-9ae2-249fe8a0c034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:33.636738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6d007049-3bcc-49b6-9ae2-249fe8a0c034 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:33.637666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6d007049-3bcc-49b6-9ae2-249fe8a0c034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:33.641100 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:33.657935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936e6046-a85d-4e45-b70e-1d8d423763bd None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:33.696649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7cbbf-ebe1-494c-8430-e8af1822d403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:33.697724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7cbbf-ebe1-494c-8430-e8af1822d403 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:33.698013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7cbbf-ebe1-494c-8430-e8af1822d403 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:33.698305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7cbbf-ebe1-494c-8430-e8af1822d403 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:33.699478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7cbbf-ebe1-494c-8430-e8af1822d403 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:33.700975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7cbbf-ebe1-494c-8430-e8af1822d403 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:33.702632 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 509/1024] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:33.708965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7cbbf-ebe1-494c-8430-e8af1822d403 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:33.709167 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 516/1025] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 13:52:33.718584 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:33.733312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d007049-3bcc-49b6-9ae2-249fe8a0c034 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:33.814887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7cbbf-ebe1-494c-8430-e8af1822d403 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:33.833748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d007049-3bcc-49b6-9ae2-249fe8a0c034 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:33.847700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6b8fa-411a-4cbe-a256-53a47c7a258a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:33.848368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6b8fa-411a-4cbe-a256-53a47c7a258a None admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:33.848652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6b8fa-411a-4cbe-a256-53a47c7a258a None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:33.848928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6b8fa-411a-4cbe-a256-53a47c7a258a None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:33.849626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6b8fa-411a-4cbe-a256-53a47c7a258a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:33.851061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6b8fa-411a-4cbe-a256-53a47c7a258a None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:33.868870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45276fce-6f62-40b5-a74a-5528de8f970a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:33.869708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45276fce-6f62-40b5-a74a-5528de8f970a None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:33.869995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45276fce-6f62-40b5-a74a-5528de8f970a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:33.870306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45276fce-6f62-40b5-a74a-5528de8f970a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:33.878149 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:33.881021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45276fce-6f62-40b5-a74a-5528de8f970a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:52:33.889489 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-45276fce-6f62-40b5-a74a-5528de8f970a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 13:52:33.889489 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:33.889489 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:33.889489 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:33.889489 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:33.889489 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:33.889489 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:33.889489 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:33.889489 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:33.889489 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:33.889489 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:33.889489 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:33.889489 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:52:33.889489 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:52:33.889489 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:52:33.889489 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:52:33.890645 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:52:33.890645 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:52:33.890645 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:52:33.890645 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:52:33.890645 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:33.890645 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:33.890645 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:33.890645 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:33.890645 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:33.890645 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:33.890645 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:33.890645 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:33.890645 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:33.890645 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:33.890645 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:33.890645 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:33.891678 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:33.891678 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:33.891678 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:33.891678 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:33.891678 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:52:33.891678 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:52:33.891678 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:52:33.891678 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:52:33.891678 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:52:33.891678 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:52:33.891678 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 13:52:33.891678 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:33.891678 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 517/1026] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Jul 19 13:52:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:33.892380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953a075-c481-425d-bb53-83f8777ec91d None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:33.892380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953a075-c481-425d-bb53-83f8777ec91d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:33.892512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953a075-c481-425d-bb53-83f8777ec91d None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:33.893722 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 518/1027] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:33.896501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953a075-c481-425d-bb53-83f8777ec91d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:33.931409 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 510/1028] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 19 13:52:33 2022] POST /identity/v3/users => generated 285 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 13:52:33.931409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61635e45-f48a-43d7-ad9a-4a34fda43d14 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:33.931409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61635e45-f48a-43d7-ad9a-4a34fda43d14 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:33.931409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61635e45-f48a-43d7-ad9a-4a34fda43d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:33.945045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-61635e45-f48a-43d7-ad9a-4a34fda43d14 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:33.946334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-61635e45-f48a-43d7-ad9a-4a34fda43d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:34.009452 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:34.020103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953a075-c481-425d-bb53-83f8777ec91d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:34.021291 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 511/1029] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:34.045434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61635e45-f48a-43d7-ad9a-4a34fda43d14 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:34.063799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa392a7-bd16-40a4-96c1-0935f76634b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:34.064744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa392a7-bd16-40a4-96c1-0935f76634b3 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:34.065086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa392a7-bd16-40a4-96c1-0935f76634b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:34.065305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa392a7-bd16-40a4-96c1-0935f76634b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:34.066082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa392a7-bd16-40a4-96c1-0935f76634b3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:34.066420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa392a7-bd16-40a4-96c1-0935f76634b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:34.067807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa392a7-bd16-40a4-96c1-0935f76634b3 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:34.077793 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 519/1030] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Jul 19 13:52:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:34.082813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa392a7-bd16-40a4-96c1-0935f76634b3 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:34.157667 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:34.167956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61635e45-f48a-43d7-ad9a-4a34fda43d14 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:34.204205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa392a7-bd16-40a4-96c1-0935f76634b3 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:34.204415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020403d-4e76-492e-b62d-03d621e824a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:34.205122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020403d-4e76-492e-b62d-03d621e824a8 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:34.205408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020403d-4e76-492e-b62d-03d621e824a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:34.205689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020403d-4e76-492e-b62d-03d621e824a8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:34.206395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020403d-4e76-492e-b62d-03d621e824a8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:34.207769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020403d-4e76-492e-b62d-03d621e824a8 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:34.223679 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-d020403d-4e76-492e-b62d-03d621e824a8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 13:52:34.223679 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:34.223679 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:52:34.223679 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:52:34.223679 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:52:34.223679 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:52:34.223679 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:52:34.223679 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:34.223679 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 13:52:34.223679 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:34.223679 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:34.223679 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:34.223679 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:34.223679 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:34.223679 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:34.223679 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:34.223679 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:34.227598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:34.227598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:34.227598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:34.227598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:34.227598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:34.227598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:34.227598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:52:34.227598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:52:34.227598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:52:34.227598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:52:34.227598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:34.227598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:34.227598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:34.227598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:34.227598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:34.227598 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:34.228464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:34.228464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:34.228464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:34.228464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:34.228464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:34.228464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:34.228464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:34.228464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:34.228464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:34.228464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:34.228464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:52:34.228464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:34.228464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 13:52:34.228464 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:34.228464 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 512/1031] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Jul 19 13:52:34 2022] GET /identity/v3/services/image => generated 86 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:34.229945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020403d-4e76-492e-b62d-03d621e824a8 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:34.253472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5c6f7-57cb-4276-b250-8a19a89a60ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:34.254837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5c6f7-57cb-4276-b250-8a19a89a60ec None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:34.255281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5c6f7-57cb-4276-b250-8a19a89a60ec None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:34.255678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5c6f7-57cb-4276-b250-8a19a89a60ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:34.269150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5c6f7-57cb-4276-b250-8a19a89a60ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:34.270719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5c6f7-57cb-4276-b250-8a19a89a60ec None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:34.288661 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-85d5c6f7-57cb-4276-b250-8a19a89a60ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:34.288661 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:34.288661 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:34.288661 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:34.288661 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:34.288661 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:34.288661 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:34.288661 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:34.288661 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:34.288661 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:34.288661 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:34.288661 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:34.288661 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:34.288661 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:34.288661 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:34.293382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:34.293382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:34.293382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:34.293382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:34.293382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:34.293382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:34.293382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:34.293382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:34.293382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:34.293382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:34.293382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:34.293382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:34.293382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:34.293382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:34.293382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:34.293382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:34.293382 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:34.294505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:34.294505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:34.294505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:34.294505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:34.294505 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 520/1032] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:34.294815 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:34.295860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5c6f7-57cb-4276-b250-8a19a89a60ec None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:34.341742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020403d-4e76-492e-b62d-03d621e824a8 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:34.377203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089ae33-d8b4-47bf-b123-101f7d3989ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:34.377883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089ae33-d8b4-47bf-b123-101f7d3989ff None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:34.378269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089ae33-d8b4-47bf-b123-101f7d3989ff None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:34.378581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089ae33-d8b4-47bf-b123-101f7d3989ff None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:34.379301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089ae33-d8b4-47bf-b123-101f7d3989ff None admin] RBAC: Adding query filter params (name=image) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:34.379614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089ae33-d8b4-47bf-b123-101f7d3989ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:34.380978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1089ae33-d8b4-47bf-b123-101f7d3989ff None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:34.386317 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 513/1033] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:34.392006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089ae33-d8b4-47bf-b123-101f7d3989ff None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:34.405866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5c6f7-57cb-4276-b250-8a19a89a60ec None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:34.422160 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:34.448709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c993c-e729-4e1f-84ce-85acd9a11f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:34.449570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c993c-e729-4e1f-84ce-85acd9a11f47 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:34.449679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c993c-e729-4e1f-84ce-85acd9a11f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:34.449970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c993c-e729-4e1f-84ce-85acd9a11f47 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:34.450718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c993c-e729-4e1f-84ce-85acd9a11f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:34.451089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c993c-e729-4e1f-84ce-85acd9a11f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:34.452394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c993c-e729-4e1f-84ce-85acd9a11f47 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:34.465160 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 521/1034] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:34.470475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c993c-e729-4e1f-84ce-85acd9a11f47 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:34.501049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089ae33-d8b4-47bf-b123-101f7d3989ff None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:34.523925 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:34.538322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c8095-47c0-4345-b953-e177c35fd4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:34.539361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c8095-47c0-4345-b953-e177c35fd4cf None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:34.539885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c8095-47c0-4345-b953-e177c35fd4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:34.540352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c8095-47c0-4345-b953-e177c35fd4cf None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:34.541156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c8095-47c0-4345-b953-e177c35fd4cf None admin] RBAC: Adding query filter params (type=image) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:34.541382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c8095-47c0-4345-b953-e177c35fd4cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:34.542855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c8095-47c0-4345-b953-e177c35fd4cf None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:34.553600 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 514/1035] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:34.554482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c8095-47c0-4345-b953-e177c35fd4cf None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:34.582087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c993c-e729-4e1f-84ce-85acd9a11f47 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:34.618866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e4f8e-93f0-4f51-8843-739bcc52cc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:34.619626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e4f8e-93f0-4f51-8843-739bcc52cc24 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:34.619907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e4f8e-93f0-4f51-8843-739bcc52cc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:34.620187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e4f8e-93f0-4f51-8843-739bcc52cc24 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:34.627488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e4f8e-93f0-4f51-8843-739bcc52cc24 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:34.628952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e4f8e-93f0-4f51-8843-739bcc52cc24 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:34.644324 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-a64e4f8e-93f0-4f51-8843-739bcc52cc24 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 13:52:34.644324 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:34.644324 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:34.644324 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:34.644324 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:34.644324 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:34.644324 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:34.644324 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:34.644324 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:34.644324 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:34.644324 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:34.644324 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:34.644324 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:52:34.644324 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:52:34.644324 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:52:34.644324 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:52:34.645491 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:34.645491 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:34.645491 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:52:34.645491 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:34.645491 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:52:34.645491 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:34.645491 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:34.645491 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:34.645491 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:34.645491 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:34.645491 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:34.645491 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:34.645491 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:34.645491 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:34.645491 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:34.645491 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:34.645491 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:34.645491 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:34.646732 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:34.646732 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:34.646732 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:52:34.646732 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:52:34.646732 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:52:34.646732 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:52:34.646732 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:52:34.646732 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:52:34.646732 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 13:52:34.646732 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:34.650724 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 522/1036] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jul 19 13:52:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:34.651599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e4f8e-93f0-4f51-8843-739bcc52cc24 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:34.672786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c8095-47c0-4345-b953-e177c35fd4cf None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:34.690759 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:34.707556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d078b7-2373-4094-be03-af292268d367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:34.708223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d078b7-2373-4094-be03-af292268d367 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:34.708507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d078b7-2373-4094-be03-af292268d367 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:34.708781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d078b7-2373-4094-be03-af292268d367 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:34.709580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d078b7-2373-4094-be03-af292268d367 None admin] RBAC: Adding query filter params (interface=public, service_id=5ffcfa1790624f7b820788c4385becb8, region_id=RegionOne) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:34.709890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d078b7-2373-4094-be03-af292268d367 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:34.711421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d078b7-2373-4094-be03-af292268d367 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:34.721289 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 515/1037] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jul 19 13:52:34 2022] GET /identity/v3/endpoints?service_id=5ffcfa1790624f7b820788c4385becb8&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:34.722290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d078b7-2373-4094-be03-af292268d367 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:34.769141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e4f8e-93f0-4f51-8843-739bcc52cc24 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:34.776396 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:34.805042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfa1e1-4859-486d-a596-120e996f7289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:34.805952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfa1e1-4859-486d-a596-120e996f7289 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:34.806263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfa1e1-4859-486d-a596-120e996f7289 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:34.806539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfa1e1-4859-486d-a596-120e996f7289 None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:34.807380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfa1e1-4859-486d-a596-120e996f7289 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:34.807688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfa1e1-4859-486d-a596-120e996f7289 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:34.809115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cfa1e1-4859-486d-a596-120e996f7289 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:34.827371 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 523/1038] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jul 19 13:52:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:34.832807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfa1e1-4859-486d-a596-120e996f7289 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:34.838370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d078b7-2373-4094-be03-af292268d367 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:34.872641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f491395-610c-47de-8d03-2b6728d538b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:34.873238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f491395-610c-47de-8d03-2b6728d538b5 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:34.873523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f491395-610c-47de-8d03-2b6728d538b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:34.873801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f491395-610c-47de-8d03-2b6728d538b5 None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:34.874516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f491395-610c-47de-8d03-2b6728d538b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:34.875873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f491395-610c-47de-8d03-2b6728d538b5 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:34.882358 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 516/1039] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jul 19 13:52:34 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 13:52:34.940599 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:34.950191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cfa1e1-4859-486d-a596-120e996f7289 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:34.989727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b00e2-f4f6-446a-92b6-4eb65d1ef770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:34.990436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b00e2-f4f6-446a-92b6-4eb65d1ef770 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:34.990721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b00e2-f4f6-446a-92b6-4eb65d1ef770 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:34.990998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b00e2-f4f6-446a-92b6-4eb65d1ef770 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:35.069465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b00e2-f4f6-446a-92b6-4eb65d1ef770 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:35.071025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9b00e2-f4f6-446a-92b6-4eb65d1ef770 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:35.166179 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:35.180991 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 524/1040] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:52:34 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 13:52:35.182345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f491395-610c-47de-8d03-2b6728d538b5 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:35.291896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f491395-610c-47de-8d03-2b6728d538b5 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:35.304599 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:35.328282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d16f0-47d7-48cb-8d78-f4a08f171174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:35.329112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d16f0-47d7-48cb-8d78-f4a08f171174 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:35.329386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d16f0-47d7-48cb-8d78-f4a08f171174 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:35.329681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9d16f0-47d7-48cb-8d78-f4a08f171174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:35.340709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d16f0-47d7-48cb-8d78-f4a08f171174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:35.342187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9d16f0-47d7-48cb-8d78-f4a08f171174 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:35.361549 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-ce9d16f0-47d7-48cb-8d78-f4a08f171174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:35.361549 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:35.361549 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:35.361549 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:35.361549 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:35.361549 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:35.361549 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:35.361549 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:35.361549 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:35.361549 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:35.361549 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:35.361549 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:35.361549 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:35.361549 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:35.361549 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:35.362785 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:35.362785 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:35.362785 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:35.362785 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:35.362785 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:35.362785 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:35.362785 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:35.362785 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:35.362785 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:35.362785 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:35.362785 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:35.362785 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:35.362785 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:35.362785 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:35.362785 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:35.362785 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:35.362785 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:35.363704 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:35.363704 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:35.363704 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:35.363704 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:35.366186 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 517/1041] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:35.369062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b00e2-f4f6-446a-92b6-4eb65d1ef770 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:35.471869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b00e2-f4f6-446a-92b6-4eb65d1ef770 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:35.509782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9e8fb-ffa8-4e2b-8ab4-5f88bb790c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:35.510478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9e8fb-ffa8-4e2b-8ab4-5f88bb790c54 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:35.510764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9e8fb-ffa8-4e2b-8ab4-5f88bb790c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:35.511038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9e8fb-ffa8-4e2b-8ab4-5f88bb790c54 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:35.511766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9e8fb-ffa8-4e2b-8ab4-5f88bb790c54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:35.512074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9e8fb-ffa8-4e2b-8ab4-5f88bb790c54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:35.513434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9e8fb-ffa8-4e2b-8ab4-5f88bb790c54 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:35.530152 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 525/1042] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:35.532156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d16f0-47d7-48cb-8d78-f4a08f171174 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:35.656858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9d16f0-47d7-48cb-8d78-f4a08f171174 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:35.698687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d0454-9dd7-4c8f-b65e-a46026e3377c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:35.699861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d0454-9dd7-4c8f-b65e-a46026e3377c None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:35.700157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d0454-9dd7-4c8f-b65e-a46026e3377c None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:35.700436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d0454-9dd7-4c8f-b65e-a46026e3377c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:35.707562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d0454-9dd7-4c8f-b65e-a46026e3377c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:35.709012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d0454-9dd7-4c8f-b65e-a46026e3377c None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:35.724935 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-786d0454-9dd7-4c8f-b65e-a46026e3377c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:35.724935 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:35.724935 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:35.724935 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:35.724935 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:35.724935 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:35.724935 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:35.724935 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:35.724935 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:35.724935 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:35.724935 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:35.724935 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:35.724935 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:52:35.724935 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:52:35.724935 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:52:35.725876 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:52:35.725876 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:35.725876 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:35.725876 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:35.725876 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:35.725876 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:35.725876 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:35.725876 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:35.725876 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:35.725876 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:35.725876 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:35.725876 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:35.725876 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:35.725876 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:35.725876 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:35.725876 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:35.725876 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:35.727668 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:52:35.727668 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:52:35.727668 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:52:35.727668 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:52:35.727668 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:52:35.727668 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:52:35.727668 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:35.727668 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:35.730465 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 518/1043] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:52:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:35.734395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9e8fb-ffa8-4e2b-8ab4-5f88bb790c54 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:35.795001 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:35.849949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9e8fb-ffa8-4e2b-8ab4-5f88bb790c54 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:35.885368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13f3779-7107-47d8-8deb-e25a80812a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:35.886042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f3779-7107-47d8-8deb-e25a80812a80 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:35.886360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f3779-7107-47d8-8deb-e25a80812a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:35.886643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f3779-7107-47d8-8deb-e25a80812a80 None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:35.887441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f3779-7107-47d8-8deb-e25a80812a80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:35.887752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f3779-7107-47d8-8deb-e25a80812a80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:35.889193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13f3779-7107-47d8-8deb-e25a80812a80 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:35.904460 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 526/1044] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:52:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:35.910807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d0454-9dd7-4c8f-b65e-a46026e3377c None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:35.947733 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:36.029571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d0454-9dd7-4c8f-b65e-a46026e3377c None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:36.067762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb18c5-e196-4f47-8779-e05c80bba59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:36.068436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb18c5-e196-4f47-8779-e05c80bba59c None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:36.068716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb18c5-e196-4f47-8779-e05c80bba59c None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:36.068991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb18c5-e196-4f47-8779-e05c80bba59c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:36.069901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb18c5-e196-4f47-8779-e05c80bba59c None admin] RBAC: Adding query filter params (role.id=3841e5d49ee04bf08c66d1134dc3b552, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=dfe9762955004354ab4f1fe02f05a427) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:36.070265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb18c5-e196-4f47-8779-e05c80bba59c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:36.071948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb18c5-e196-4f47-8779-e05c80bba59c None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:36.086633 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 519/1045] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:52:35 2022] GET /identity/v3/role_assignments?user.id=dfe9762955004354ab4f1fe02f05a427&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=3841e5d49ee04bf08c66d1134dc3b552 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:36.218653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fca01-b66d-4e38-97ae-96b53a1bf624 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:36.218930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fca01-b66d-4e38-97ae-96b53a1bf624 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:36.219203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fca01-b66d-4e38-97ae-96b53a1bf624 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:36.220913 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 527/1046] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:36.226969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0a2ca-e032-47d3-92c8-933a0af7214b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:36.227430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0a2ca-e032-47d3-92c8-933a0af7214b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:36.227598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c0a2ca-e032-47d3-92c8-933a0af7214b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:36.246143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-52c0a2ca-e032-47d3-92c8-933a0af7214b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:36.246906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-52c0a2ca-e032-47d3-92c8-933a0af7214b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:36.313877 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 520/1047] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:36.338496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fca01-b66d-4e38-97ae-96b53a1bf624 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:36.443375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fca01-b66d-4e38-97ae-96b53a1bf624 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:36.457675 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:36.479238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f81ef-3425-4aaf-9556-d54ce62b41d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:36.480035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f81ef-3425-4aaf-9556-d54ce62b41d6 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:36.480320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f81ef-3425-4aaf-9556-d54ce62b41d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:36.480595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f81ef-3425-4aaf-9556-d54ce62b41d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:36.490651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f81ef-3425-4aaf-9556-d54ce62b41d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:52:36.498413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-620f81ef-3425-4aaf-9556-d54ce62b41d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:52:36.498413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:36.498413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:36.498413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:36.498413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:36.498413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:36.498413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:36.498413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:36.498413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:36.498413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:36.498413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:36.498413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:36.498413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:52:36.498413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:52:36.498413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:52:36.498413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:52:36.499581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:52:36.499581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:52:36.499581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:52:36.499581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:52:36.499581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:36.499581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:36.499581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:36.499581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:36.499581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:36.499581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:36.499581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:36.499581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:36.499581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:36.499581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:36.499581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:36.499581 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:36.500431 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:36.500431 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:36.500431 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:36.500431 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:36.500431 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:52:36.500431 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:52:36.500431 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:52:36.500431 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:52:36.500431 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:52:36.500431 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:52:36.500431 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:52:36.500431 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:36.502735 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 528/1048] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:52:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:36.505819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0a2ca-e032-47d3-92c8-933a0af7214b None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:36.525827 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:36.612814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c0a2ca-e032-47d3-92c8-933a0af7214b None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:36.647082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24a42b-79d7-4b1d-8c45-5244beb2b706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:36.647755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24a42b-79d7-4b1d-8c45-5244beb2b706 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:36.648038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24a42b-79d7-4b1d-8c45-5244beb2b706 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:36.648314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e24a42b-79d7-4b1d-8c45-5244beb2b706 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:36.649786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24a42b-79d7-4b1d-8c45-5244beb2b706 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:36.650088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24a42b-79d7-4b1d-8c45-5244beb2b706 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:36.651497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e24a42b-79d7-4b1d-8c45-5244beb2b706 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:36.665421 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 521/1049] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:52:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:36.666394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f81ef-3425-4aaf-9556-d54ce62b41d6 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:36.766921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f81ef-3425-4aaf-9556-d54ce62b41d6 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:36.801502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3449cc-5c27-49f1-b051-5fbf8dd20620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:36.802403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3449cc-5c27-49f1-b051-5fbf8dd20620 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:36.802692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3449cc-5c27-49f1-b051-5fbf8dd20620 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:36.802967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3449cc-5c27-49f1-b051-5fbf8dd20620 None admin] PATH_INFO: `/v3/users/2a34beb79a6d47b6a9927cca23e6df4a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:36.817802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3449cc-5c27-49f1-b051-5fbf8dd20620 None admin] RBAC: Authorizing `identity:get_user(user_id=2a34beb79a6d47b6a9927cca23e6df4a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:36.819275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3449cc-5c27-49f1-b051-5fbf8dd20620 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:36.821194 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 529/1050] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:52:36 2022] GET /identity/v3/users/2a34beb79a6d47b6a9927cca23e6df4a => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:36.826731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24a42b-79d7-4b1d-8c45-5244beb2b706 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:36.908993 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:36.928358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e24a42b-79d7-4b1d-8c45-5244beb2b706 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:36.965202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15e525-0c79-406b-b449-e97db150561c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:36.965856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15e525-0c79-406b-b449-e97db150561c None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:36.966164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15e525-0c79-406b-b449-e97db150561c None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:36.966442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d15e525-0c79-406b-b449-e97db150561c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:36.979941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bca26-9217-4c4a-b1ca-3f1803b1b9d1 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:36.980231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bca26-9217-4c4a-b1ca-3f1803b1b9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:36.980507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bca26-9217-4c4a-b1ca-3f1803b1b9d1 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:36.982017 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 530/1051] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:52:36.986638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826b641-0c1b-4fdb-98f4-19911497a302 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:36.986927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826b641-0c1b-4fdb-98f4-19911497a302 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:36.987210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826b641-0c1b-4fdb-98f4-19911497a302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:37.004813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9826b641-0c1b-4fdb-98f4-19911497a302 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:37.005995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9826b641-0c1b-4fdb-98f4-19911497a302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:37.032191 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:37.038363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15e525-0c79-406b-b449-e97db150561c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:37.039842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d15e525-0c79-406b-b449-e97db150561c None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:37.084282 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 531/1052] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:36 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 13:52:37.107221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826b641-0c1b-4fdb-98f4-19911497a302 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:37.127304 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:37.147333 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 522/1053] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:52:36 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 13:52:37.153520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15e525-0c79-406b-b449-e97db150561c None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:37.223657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826b641-0c1b-4fdb-98f4-19911497a302 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:37.265489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222f49c-839f-4b88-9c9c-29748ccf19e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:37.266306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222f49c-839f-4b88-9c9c-29748ccf19e7 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:37.266583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222f49c-839f-4b88-9c9c-29748ccf19e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:37.266857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222f49c-839f-4b88-9c9c-29748ccf19e7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:37.267508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222f49c-839f-4b88-9c9c-29748ccf19e7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:37.268861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222f49c-839f-4b88-9c9c-29748ccf19e7 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:37.275972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d15e525-0c79-406b-b449-e97db150561c None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:37.282329 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-f222f49c-839f-4b88-9c9c-29748ccf19e7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 13:52:37.282329 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:37.282329 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:52:37.282329 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:52:37.282329 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:52:37.282329 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:52:37.282329 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:52:37.282329 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:37.282329 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 13:52:37.282329 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:37.282329 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:52:37.282329 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:37.282329 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:37.282329 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:37.282329 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:37.282329 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:37.282329 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:37.283322 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:37.283322 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:37.283322 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:37.283322 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:37.283322 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:37.283322 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:37.283322 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:52:37.283322 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:52:37.283322 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:52:37.283322 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:52:37.283322 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:37.283322 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:37.283322 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:37.283322 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:37.283322 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:37.283322 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:37.284386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:37.284386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:37.284386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:37.284386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:37.284386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:37.284386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:37.284386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:37.284386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:37.284386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:37.284386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:37.284386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:52:37.284386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:52:37.284386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 13:52:37.284386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:37.284386 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 532/1054] 10.222.0.43 () {56 vars in 1105 bytes} [Tue Jul 19 13:52:37 2022] GET /identity/v3/services/image => generated 86 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:37.289876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222f49c-839f-4b88-9c9c-29748ccf19e7 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:37.314142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16263f64-89d5-4109-a75d-148f98eedf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:37.315258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16263f64-89d5-4109-a75d-148f98eedf1c None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:37.315541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16263f64-89d5-4109-a75d-148f98eedf1c None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:37.315816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16263f64-89d5-4109-a75d-148f98eedf1c None admin] PATH_INFO: `/v3/projects/bc3f0eaef84544129b699d25c56600fa` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:37.316986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16263f64-89d5-4109-a75d-148f98eedf1c None admin] RBAC: Authorizing `identity:get_project(project_id=bc3f0eaef84544129b699d25c56600fa)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:37.318446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16263f64-89d5-4109-a75d-148f98eedf1c None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:37.319398 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:37.325713 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 523/1055] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:52:37 2022] GET /identity/v3/projects/bc3f0eaef84544129b699d25c56600fa => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:37.327178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16263f64-89d5-4109-a75d-148f98eedf1c None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:37.379956 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:37.407858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222f49c-839f-4b88-9c9c-29748ccf19e7 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:37.432686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16263f64-89d5-4109-a75d-148f98eedf1c None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:37.452437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385296b-7c83-4d02-9e79-ab94b7f760c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:37.453108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385296b-7c83-4d02-9e79-ab94b7f760c0 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:37.453390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385296b-7c83-4d02-9e79-ab94b7f760c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:37.453894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385296b-7c83-4d02-9e79-ab94b7f760c0 None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:37.454403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385296b-7c83-4d02-9e79-ab94b7f760c0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:37.454710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385296b-7c83-4d02-9e79-ab94b7f760c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:37.456097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385296b-7c83-4d02-9e79-ab94b7f760c0 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:37.462263 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 533/1056] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:37 2022] GET /identity/v3/services?name=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:37.467403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385296b-7c83-4d02-9e79-ab94b7f760c0 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:37.473680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7531d5a-d09c-4150-a933-00efcaff9fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:37.474306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7531d5a-d09c-4150-a933-00efcaff9fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:37.474591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7531d5a-d09c-4150-a933-00efcaff9fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:37.474864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7531d5a-d09c-4150-a933-00efcaff9fb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:37.476078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7531d5a-d09c-4150-a933-00efcaff9fb8 None admin] RBAC: Adding query filter params (role.id=bc315edf089d43b18acf9790031f3fcb, scope.project.id=bc3f0eaef84544129b699d25c56600fa, user.id=2a34beb79a6d47b6a9927cca23e6df4a) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:37.476408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7531d5a-d09c-4150-a933-00efcaff9fb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:37.478853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7531d5a-d09c-4150-a933-00efcaff9fb8 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:37.494128 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 524/1057] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:52:37 2022] GET /identity/v3/role_assignments?user.id=2a34beb79a6d47b6a9927cca23e6df4a&scope.project.id=bc3f0eaef84544129b699d25c56600fa&role.id=bc315edf089d43b18acf9790031f3fcb => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:37.569108 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:37.581744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385296b-7c83-4d02-9e79-ab94b7f760c0 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:37.621946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f81c0d-3056-4f24-b394-b9c658b808a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:37.622656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f81c0d-3056-4f24-b394-b9c658b808a0 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:37.622941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f81c0d-3056-4f24-b394-b9c658b808a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:37.623217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f81c0d-3056-4f24-b394-b9c658b808a0 None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:37.623939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f81c0d-3056-4f24-b394-b9c658b808a0 None admin] RBAC: Adding query filter params (type=image) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:37.624247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f81c0d-3056-4f24-b394-b9c658b808a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:37.625632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f81c0d-3056-4f24-b394-b9c658b808a0 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:37.636575 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 534/1058] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:37 2022] GET /identity/v3/services?type=image => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:37.638235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7531d5a-d09c-4150-a933-00efcaff9fb8 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:37.741390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7531d5a-d09c-4150-a933-00efcaff9fb8 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:37.754719 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:37.776926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f181d9-fabf-42a8-bcc6-a30351dca28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:37.777634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f181d9-fabf-42a8-bcc6-a30351dca28b None admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:37.777917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f181d9-fabf-42a8-bcc6-a30351dca28b None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:37.778218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f181d9-fabf-42a8-bcc6-a30351dca28b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:37.778973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f181d9-fabf-42a8-bcc6-a30351dca28b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:37.780335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f181d9-fabf-42a8-bcc6-a30351dca28b None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:37.845247 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 525/1059] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jul 19 13:52:37 2022] POST /identity/v3/endpoints => generated 327 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 13:52:38.141657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b31054-1f66-4c14-84ec-29c71948fd0d None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:38.141878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b31054-1f66-4c14-84ec-29c71948fd0d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:38.142185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b31054-1f66-4c14-84ec-29c71948fd0d None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:38.143585 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 535/1060] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:38.149271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d24823-92dc-4c28-8e6d-c002d7c7ccf8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:38.149699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d24823-92dc-4c28-8e6d-c002d7c7ccf8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:38.149983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d24823-92dc-4c28-8e6d-c002d7c7ccf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:38.166701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b9d24823-92dc-4c28-8e6d-c002d7c7ccf8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:38.167879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b9d24823-92dc-4c28-8e6d-c002d7c7ccf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:38.247912 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 526/1061] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:38.269929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b31054-1f66-4c14-84ec-29c71948fd0d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:38.374522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b31054-1f66-4c14-84ec-29c71948fd0d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:38.408664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c481c2-8eaf-4d3b-a551-e192333a7ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:38.409396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c481c2-8eaf-4d3b-a551-e192333a7ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:38.409680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c481c2-8eaf-4d3b-a551-e192333a7ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:38.409955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c481c2-8eaf-4d3b-a551-e192333a7ae1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:38.420790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c481c2-8eaf-4d3b-a551-e192333a7ae1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:52:38.428981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-07c481c2-8eaf-4d3b-a551-e192333a7ae1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 13:52:38.428981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:38.428981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:38.428981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:38.428981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:38.428981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:38.428981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:38.428981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:38.428981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:38.428981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:38.428981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:38.428981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:38.428981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:52:38.428981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:52:38.428981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:52:38.428981 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:52:38.429947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:52:38.429947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:52:38.429947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:52:38.429947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:52:38.429947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:38.429947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:38.429947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:38.429947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:38.429947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:38.429947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:38.429947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:38.429947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:38.429947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:38.429947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:38.429947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:38.429947 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:38.431458 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:38.431458 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:38.431458 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:38.431458 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:38.431458 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:52:38.431458 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:52:38.431458 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:52:38.431458 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:52:38.431458 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:52:38.431458 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:52:38.431458 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 13:52:38.431458 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:38.431458 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 536/1062] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Jul 19 13:52:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:38.436394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d24823-92dc-4c28-8e6d-c002d7c7ccf8 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:38.529650 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:38.536832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d24823-92dc-4c28-8e6d-c002d7c7ccf8 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:38.572097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a2bf1-0b07-4855-96b8-c158fb660dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:38.572097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a2bf1-0b07-4855-96b8-c158fb660dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:38.572097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a2bf1-0b07-4855-96b8-c158fb660dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:38.572097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597a2bf1-0b07-4855-96b8-c158fb660dd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:38.572769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a2bf1-0b07-4855-96b8-c158fb660dd7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:38.573168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a2bf1-0b07-4855-96b8-c158fb660dd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:38.574397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597a2bf1-0b07-4855-96b8-c158fb660dd7 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:38.588315 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 527/1063] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Jul 19 13:52:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:38.591900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c481c2-8eaf-4d3b-a551-e192333a7ae1 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:38.607897 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:38.702733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c481c2-8eaf-4d3b-a551-e192333a7ae1 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:38.736691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7290ac-148b-4015-bdf1-c17bc0e8b91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:38.737484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7290ac-148b-4015-bdf1-c17bc0e8b91d None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:38.737767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7290ac-148b-4015-bdf1-c17bc0e8b91d None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:38.738044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7290ac-148b-4015-bdf1-c17bc0e8b91d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:38.748665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7290ac-148b-4015-bdf1-c17bc0e8b91d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:38.750122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7290ac-148b-4015-bdf1-c17bc0e8b91d None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:38.767654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-7a7290ac-148b-4015-bdf1-c17bc0e8b91d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:38.767654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:38.767654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:38.767654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:38.767654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:38.767654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:38.767654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:38.767654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:38.767654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:38.767654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:38.767654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:38.767654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:38.767654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:38.767654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:38.767654 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:38.768561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:38.768561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:38.768561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:38.768561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:38.768561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:38.768561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:38.768561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:38.768561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:38.768561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:38.768561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:38.768561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:38.768561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:38.768561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:38.768561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:38.768561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:38.768561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:38.768561 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:38.769459 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:38.769459 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:38.769459 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:38.769459 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:38.769459 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 537/1064] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:38.775870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a2bf1-0b07-4855-96b8-c158fb660dd7 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:38.874878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597a2bf1-0b07-4855-96b8-c158fb660dd7 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:38.908736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd55e11-5f5a-4704-a54e-54dfcb23c7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:38.909398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd55e11-5f5a-4704-a54e-54dfcb23c7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:38.909682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd55e11-5f5a-4704-a54e-54dfcb23c7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:38.909958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd55e11-5f5a-4704-a54e-54dfcb23c7a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:38.910713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd55e11-5f5a-4704-a54e-54dfcb23c7a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:38.911020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd55e11-5f5a-4704-a54e-54dfcb23c7a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:38.912379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd55e11-5f5a-4704-a54e-54dfcb23c7a1 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:38.924675 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 528/1065] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:38.930904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7290ac-148b-4015-bdf1-c17bc0e8b91d None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:38.998892 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:39.037745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7290ac-148b-4015-bdf1-c17bc0e8b91d None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:39.072962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229d736-84c3-41a3-8e70-2629a6190434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:39.073754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229d736-84c3-41a3-8e70-2629a6190434 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:39.074037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229d736-84c3-41a3-8e70-2629a6190434 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:39.074348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229d736-84c3-41a3-8e70-2629a6190434 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:39.081873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229d736-84c3-41a3-8e70-2629a6190434 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:39.083330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229d736-84c3-41a3-8e70-2629a6190434 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:39.097411 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-f229d736-84c3-41a3-8e70-2629a6190434 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 13:52:39.097411 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:39.097411 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:39.097411 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:39.097411 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:39.097411 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:39.097411 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:39.097411 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:39.097411 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:39.097411 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:39.097411 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:39.097411 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:39.097411 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:52:39.097411 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:52:39.097411 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:52:39.097411 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:52:39.098386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:39.098386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:39.098386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:52:39.098386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:39.098386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:52:39.098386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:39.098386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:39.098386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:39.098386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:39.098386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:39.098386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:39.098386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:39.098386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:39.098386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:39.098386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:39.098386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:39.098386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:39.098386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:39.099417 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:39.099417 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:39.099417 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:52:39.099417 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:52:39.099417 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:52:39.099417 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:52:39.099417 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:52:39.099417 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:52:39.099417 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 13:52:39.099417 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:39.099417 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 538/1066] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jul 19 13:52:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:39.106956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd55e11-5f5a-4704-a54e-54dfcb23c7a1 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:39.126584 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:39.215398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd55e11-5f5a-4704-a54e-54dfcb23c7a1 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:39.253770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90dee9-c07a-4180-88ae-71f75b78c7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:39.254404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90dee9-c07a-4180-88ae-71f75b78c7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:39.254693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90dee9-c07a-4180-88ae-71f75b78c7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:39.254974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd90dee9-c07a-4180-88ae-71f75b78c7f1 None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:39.255813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90dee9-c07a-4180-88ae-71f75b78c7f1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:39.256127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90dee9-c07a-4180-88ae-71f75b78c7f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:39.257540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd90dee9-c07a-4180-88ae-71f75b78c7f1 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:39.275377 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 529/1067] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jul 19 13:52:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:39.280723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229d736-84c3-41a3-8e70-2629a6190434 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:39.382722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229d736-84c3-41a3-8e70-2629a6190434 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:39.406623 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:39.417626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b4649-4ef9-49ef-ab30-f339c054f762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:39.418449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b4649-4ef9-49ef-ab30-f339c054f762 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:39.418731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b4649-4ef9-49ef-ab30-f339c054f762 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:39.424775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b4649-4ef9-49ef-ab30-f339c054f762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:39.429378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b4649-4ef9-49ef-ab30-f339c054f762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:39.431192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b4649-4ef9-49ef-ab30-f339c054f762 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:39.449998 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-819b4649-4ef9-49ef-ab30-f339c054f762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:39.449998 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:39.449998 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:39.449998 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:39.449998 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:39.449998 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:39.449998 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:39.449998 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:39.449998 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:39.449998 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:39.449998 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:39.449998 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:39.449998 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:39.449998 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:39.449998 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:39.451100 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:39.451100 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:39.451100 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:39.451100 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:39.451100 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:39.451100 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:39.451100 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:39.451100 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:39.451100 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:39.451100 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:39.451100 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:39.451100 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:39.451100 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:39.451100 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:39.451100 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:39.451100 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:39.451100 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:39.452004 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:39.452004 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:39.452004 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:39.452004 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:39.452004 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 539/1068] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:39.457929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90dee9-c07a-4180-88ae-71f75b78c7f1 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:39.533509 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:39.543578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ade978-a2df-4723-b326-ca205065c1f8 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:39.543866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ade978-a2df-4723-b326-ca205065c1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:39.545877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ade978-a2df-4723-b326-ca205065c1f8 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:39.545877 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 540/1069] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:52:39.552127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be4567-73f4-4f19-8bd5-9dfa51565c53 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:39.552477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be4567-73f4-4f19-8bd5-9dfa51565c53 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:39.552823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be4567-73f4-4f19-8bd5-9dfa51565c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:39.560817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd90dee9-c07a-4180-88ae-71f75b78c7f1 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:39.571226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e2be4567-73f4-4f19-8bd5-9dfa51565c53 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:39.572405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e2be4567-73f4-4f19-8bd5-9dfa51565c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:39.598648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54850e-ff7c-4808-a58b-e077a233bf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:39.599312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54850e-ff7c-4808-a58b-e077a233bf8c None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:39.599593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54850e-ff7c-4808-a58b-e077a233bf8c None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:39.599866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b54850e-ff7c-4808-a58b-e077a233bf8c None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:39.600587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54850e-ff7c-4808-a58b-e077a233bf8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:39.600897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54850e-ff7c-4808-a58b-e077a233bf8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:39.602316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b54850e-ff7c-4808-a58b-e077a233bf8c None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:39.619505 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 530/1070] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:39.620518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54850e-ff7c-4808-a58b-e077a233bf8c None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:39.650079 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 541/1071] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 13:52:39.672254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be4567-73f4-4f19-8bd5-9dfa51565c53 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:39.738870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b54850e-ff7c-4808-a58b-e077a233bf8c None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:39.775363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535f641-3331-4a2a-9c39-69ae9fed4522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:39.776153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535f641-3331-4a2a-9c39-69ae9fed4522 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:39.776681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535f641-3331-4a2a-9c39-69ae9fed4522 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:39.776681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5535f641-3331-4a2a-9c39-69ae9fed4522 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:39.778757 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:39.779909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be4567-73f4-4f19-8bd5-9dfa51565c53 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:39.784055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535f641-3331-4a2a-9c39-69ae9fed4522 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:39.785439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5535f641-3331-4a2a-9c39-69ae9fed4522 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:39.788291 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:39.800031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-5535f641-3331-4a2a-9c39-69ae9fed4522 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:39.800031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:39.800031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:39.800031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:39.800031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:39.800031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:39.800031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:39.800031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:39.800031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:39.800031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:39.800031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:39.800031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:39.800031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:52:39.800031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:52:39.800031 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:52:39.801024 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:52:39.801024 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:39.801024 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:39.801024 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:39.801024 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:39.801024 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:39.801024 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:39.801024 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:39.801024 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:39.801024 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:39.801024 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:39.801024 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:39.801024 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:39.801024 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:39.801024 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:39.801024 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:39.801024 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:39.807818 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:52:39.807818 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:52:39.807818 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:52:39.807818 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:52:39.807818 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:52:39.807818 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:52:39.807818 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:39.807818 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:39.807818 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 531/1072] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:52:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:39.807818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535f641-3331-4a2a-9c39-69ae9fed4522 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:39.824119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88779c7-b096-4741-a474-5eb50f83b644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:39.824992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88779c7-b096-4741-a474-5eb50f83b644 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:39.825410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88779c7-b096-4741-a474-5eb50f83b644 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:39.825692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88779c7-b096-4741-a474-5eb50f83b644 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:39.836096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88779c7-b096-4741-a474-5eb50f83b644 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:52:39.844076 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-b88779c7-b096-4741-a474-5eb50f83b644 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:52:39.844076 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:39.844076 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:39.844076 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:39.844076 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:39.844076 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:39.844076 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:39.844076 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:39.844076 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:39.844076 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:39.844076 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:39.844076 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:39.844076 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:52:39.844076 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:52:39.844076 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:52:39.844076 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:52:39.845019 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:52:39.845019 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:52:39.845019 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:52:39.845019 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:52:39.845019 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:39.845019 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:39.845019 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:39.845019 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:39.845019 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:39.845019 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:39.845019 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:39.845019 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:39.845019 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:39.845019 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:39.845019 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:39.845019 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:39.845880 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:39.845880 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:39.845880 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:39.845880 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:39.845880 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:52:39.845880 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:52:39.845880 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:52:39.845880 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:52:39.845880 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:52:39.845880 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:52:39.845880 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:52:39.845880 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:39.854532 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 542/1073] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:52:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:39.855335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88779c7-b096-4741-a474-5eb50f83b644 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:39.919711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5535f641-3331-4a2a-9c39-69ae9fed4522 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:39.955530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a48fd8-2a22-47f2-b883-6cac1beb6aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:39.956193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a48fd8-2a22-47f2-b883-6cac1beb6aab None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:39.956481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a48fd8-2a22-47f2-b883-6cac1beb6aab None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:39.956755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a48fd8-2a22-47f2-b883-6cac1beb6aab None admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:39.957529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a48fd8-2a22-47f2-b883-6cac1beb6aab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:39.957836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a48fd8-2a22-47f2-b883-6cac1beb6aab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:39.959280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a48fd8-2a22-47f2-b883-6cac1beb6aab None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:39.960332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88779c7-b096-4741-a474-5eb50f83b644 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:39.971422 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 532/1074] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:52:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:39.972817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609187a-2c00-49fc-8b4e-ad3151b7b11d None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:39.973105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609187a-2c00-49fc-8b4e-ad3151b7b11d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:39.973380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609187a-2c00-49fc-8b4e-ad3151b7b11d None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:39.974613 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 533/1075] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:39.977236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609187a-2c00-49fc-8b4e-ad3151b7b11d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:40.001711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4f531-6ecf-44cd-959a-752c68404395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:40.002407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4f531-6ecf-44cd-959a-752c68404395 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:40.002686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4f531-6ecf-44cd-959a-752c68404395 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:40.002956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4f531-6ecf-44cd-959a-752c68404395 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:40.003704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4f531-6ecf-44cd-959a-752c68404395 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:40.004006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4f531-6ecf-44cd-959a-752c68404395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:40.005363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4f531-6ecf-44cd-959a-752c68404395 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:40.013681 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 543/1076] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:52:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:40.014864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecef5fb-2399-4d46-8d36-7d7de856a8b1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:40.015150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecef5fb-2399-4d46-8d36-7d7de856a8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:40.015426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecef5fb-2399-4d46-8d36-7d7de856a8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:40.031638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-aecef5fb-2399-4d46-8d36-7d7de856a8b1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:40.032806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-aecef5fb-2399-4d46-8d36-7d7de856a8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:40.034554 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:40.055446 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:40.079933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609187a-2c00-49fc-8b4e-ad3151b7b11d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:40.099076 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 544/1077] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:40.100192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecef5fb-2399-4d46-8d36-7d7de856a8b1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:40.123842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07c071-3da0-4e69-8bb9-fa02b430fa16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:40.124740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07c071-3da0-4e69-8bb9-fa02b430fa16 None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:40.125030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07c071-3da0-4e69-8bb9-fa02b430fa16 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:40.125310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce07c071-3da0-4e69-8bb9-fa02b430fa16 None admin] PATH_INFO: `/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/dfe9762955004354ab4f1fe02f05a427/roles/3841e5d49ee04bf08c66d1134dc3b552` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:40.127680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07c071-3da0-4e69-8bb9-fa02b430fa16 None admin] RBAC: Authorizing `identity:create_grant(project_id=dfcbe281a77242bbb3774c4aacef50d4, user_id=dfe9762955004354ab4f1fe02f05a427, role_id=3841e5d49ee04bf08c66d1134dc3b552)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:40.129109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce07c071-3da0-4e69-8bb9-fa02b430fa16 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:40.198188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecef5fb-2399-4d46-8d36-7d7de856a8b1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:40.232464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0383e-e559-4a9c-8f59-b0d399f2c50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:40.233339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0383e-e559-4a9c-8f59-b0d399f2c50a None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:40.233620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0383e-e559-4a9c-8f59-b0d399f2c50a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:40.233897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0383e-e559-4a9c-8f59-b0d399f2c50a None admin] PATH_INFO: `/v3/users/2a34beb79a6d47b6a9927cca23e6df4a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:40.235129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0383e-e559-4a9c-8f59-b0d399f2c50a None admin] RBAC: Authorizing `identity:get_user(user_id=2a34beb79a6d47b6a9927cca23e6df4a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:40.236567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d0383e-e559-4a9c-8f59-b0d399f2c50a None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:40.238235 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 545/1078] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:52:40 2022] GET /identity/v3/users/2a34beb79a6d47b6a9927cca23e6df4a => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:40.238981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0383e-e559-4a9c-8f59-b0d399f2c50a None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:40.248681 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 534/1079] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:52:39 2022] PUT /identity/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/dfe9762955004354ab4f1fe02f05a427/roles/3841e5d49ee04bf08c66d1134dc3b552 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 13:52:40.249311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07c071-3da0-4e69-8bb9-fa02b430fa16 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:40.285534 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:40.361665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce07c071-3da0-4e69-8bb9-fa02b430fa16 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:40.379123 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:40.385074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0383e-e559-4a9c-8f59-b0d399f2c50a None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:40.402558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17175d64-ca45-4f60-bd02-63cef20e61bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:40.403899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17175d64-ca45-4f60-bd02-63cef20e61bd None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:40.404770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17175d64-ca45-4f60-bd02-63cef20e61bd None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:40.404770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17175d64-ca45-4f60-bd02-63cef20e61bd None admin] PATH_INFO: `/v3/projects/bc3f0eaef84544129b699d25c56600fa` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:40.405758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17175d64-ca45-4f60-bd02-63cef20e61bd None admin] RBAC: Authorizing `identity:get_project(project_id=bc3f0eaef84544129b699d25c56600fa)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:40.407869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17175d64-ca45-4f60-bd02-63cef20e61bd None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:40.410211 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 535/1080] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:52:40 2022] GET /identity/v3/projects/bc3f0eaef84544129b699d25c56600fa => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:40.418674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17175d64-ca45-4f60-bd02-63cef20e61bd None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:40.431245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b10295-a8b7-48f0-a593-3dd342a97a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:40.432166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b10295-a8b7-48f0-a593-3dd342a97a14 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:40.432450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b10295-a8b7-48f0-a593-3dd342a97a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:40.432729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b10295-a8b7-48f0-a593-3dd342a97a14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:40.510528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b10295-a8b7-48f0-a593-3dd342a97a14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:40.512120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b10295-a8b7-48f0-a593-3dd342a97a14 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:40.528886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17175d64-ca45-4f60-bd02-63cef20e61bd None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:40.541006 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:40.565623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce96bb-9c3a-4616-9a29-560e6adb1e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:40.566560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce96bb-9c3a-4616-9a29-560e6adb1e52 None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:40.566845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce96bb-9c3a-4616-9a29-560e6adb1e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:40.567166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce96bb-9c3a-4616-9a29-560e6adb1e52 None admin] PATH_INFO: `/v3/projects/bc3f0eaef84544129b699d25c56600fa/users/2a34beb79a6d47b6a9927cca23e6df4a/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:40.569279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce96bb-9c3a-4616-9a29-560e6adb1e52 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc3f0eaef84544129b699d25c56600fa, user_id=2a34beb79a6d47b6a9927cca23e6df4a, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:40.570814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce96bb-9c3a-4616-9a29-560e6adb1e52 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:40.618650 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 546/1081] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:52:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 13:52:40.624398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b10295-a8b7-48f0-a593-3dd342a97a14 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:40.638279 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 536/1082] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:52:40 2022] PUT /identity/v3/projects/bc3f0eaef84544129b699d25c56600fa/users/2a34beb79a6d47b6a9927cca23e6df4a/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 13:52:40.743515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b10295-a8b7-48f0-a593-3dd342a97a14 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:40.771382 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:40.781626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ac916-9ffc-412e-ba50-45faf34cab83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:40.782474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ac916-9ffc-412e-ba50-45faf34cab83 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:40.782758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ac916-9ffc-412e-ba50-45faf34cab83 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:40.783038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ac916-9ffc-412e-ba50-45faf34cab83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:40.798680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ac916-9ffc-412e-ba50-45faf34cab83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:40.800078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ac916-9ffc-412e-ba50-45faf34cab83 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:40.819487 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-2b7ac916-9ffc-412e-ba50-45faf34cab83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:40.819487 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:40.819487 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:40.819487 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:40.819487 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:40.819487 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:40.819487 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:40.819487 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:40.819487 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:40.819487 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:40.819487 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:40.819487 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:40.819487 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:40.819487 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:40.819487 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:40.820413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:40.820413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:40.820413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:40.820413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:40.820413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:40.820413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:40.820413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:40.820413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:40.820413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:40.820413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:40.820413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:40.820413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:40.820413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:40.820413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:40.820413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:40.820413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:40.820413 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:40.822235 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:40.822235 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:40.822235 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:40.822235 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:40.822235 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 547/1083] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:40.828921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce96bb-9c3a-4616-9a29-560e6adb1e52 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:40.874880 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:40.932391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce96bb-9c3a-4616-9a29-560e6adb1e52 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:40.967698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ed2f1-e1e2-45d8-aacd-eb2794767f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:40.968373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ed2f1-e1e2-45d8-aacd-eb2794767f6b None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:40.968661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ed2f1-e1e2-45d8-aacd-eb2794767f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:40.968946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ed2f1-e1e2-45d8-aacd-eb2794767f6b None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:40.969680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ed2f1-e1e2-45d8-aacd-eb2794767f6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:40.969990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ed2f1-e1e2-45d8-aacd-eb2794767f6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:40.971389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ed2f1-e1e2-45d8-aacd-eb2794767f6b None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:40.990145 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 537/1084] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:42.306680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac30c96-447d-424b-aebd-3345af439d95 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:42.307203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac30c96-447d-424b-aebd-3345af439d95 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:42.307316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac30c96-447d-424b-aebd-3345af439d95 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:42.308614 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 548/1085] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:42.313864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b41ca-abbe-4395-aac6-23160f96f714 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:42.314889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b41ca-abbe-4395-aac6-23160f96f714 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:42.315173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2b41ca-abbe-4395-aac6-23160f96f714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:42.331836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4d2b41ca-abbe-4395-aac6-23160f96f714 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:42.333009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4d2b41ca-abbe-4395-aac6-23160f96f714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:42.400035 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 538/1086] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:42.423509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac30c96-447d-424b-aebd-3345af439d95 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:42.524439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac30c96-447d-424b-aebd-3345af439d95 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:42.557967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b1ab1e-0400-4e81-bd6d-ae550c2a541f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:42.558801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1ab1e-0400-4e81-bd6d-ae550c2a541f None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:42.559085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1ab1e-0400-4e81-bd6d-ae550c2a541f None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:42.559359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b1ab1e-0400-4e81-bd6d-ae550c2a541f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:42.569514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b1ab1e-0400-4e81-bd6d-ae550c2a541f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:52:42.577919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-36b1ab1e-0400-4e81-bd6d-ae550c2a541f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 13:52:42.577919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:42.577919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:42.577919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:42.577919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:42.577919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:42.577919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:42.577919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:42.577919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:42.577919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:42.577919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:42.577919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:42.577919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:52:42.577919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:52:42.577919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:52:42.577919 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:52:42.579042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:52:42.579042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:52:42.579042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:52:42.579042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:52:42.579042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:42.579042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:42.579042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:42.579042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:42.579042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:42.579042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:42.579042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:42.579042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:42.579042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:42.579042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:42.579042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:42.579042 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:42.579929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:42.579929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:42.579929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:42.579929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:42.579929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:52:42.579929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:52:42.579929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:52:42.579929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:52:42.579929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:52:42.579929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:52:42.579929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 13:52:42.579929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:42.582245 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 549/1087] 10.222.0.43 () {56 vars in 1120 bytes} [Tue Jul 19 13:52:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:42.585014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b41ca-abbe-4395-aac6-23160f96f714 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:42.617138 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:42.684931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2b41ca-abbe-4395-aac6-23160f96f714 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:42.693190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3b871-a636-4b84-b224-94b6ed3483e7 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:42.693476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3b871-a636-4b84-b224-94b6ed3483e7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:42.693750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be3b871-a636-4b84-b224-94b6ed3483e7 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:42.695141 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 550/1088] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 13:52:42.700009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27358d-aea1-48a9-9c26-02a31c17b074 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:42.700300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27358d-aea1-48a9-9c26-02a31c17b074 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:42.700584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27358d-aea1-48a9-9c26-02a31c17b074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:42.718036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7c27358d-aea1-48a9-9c26-02a31c17b074 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:42.719237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7c27358d-aea1-48a9-9c26-02a31c17b074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:42.720037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dbd37-f4f0-483f-87cf-7fec7e0a1f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:42.720708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dbd37-f4f0-483f-87cf-7fec7e0a1f23 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:42.720998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dbd37-f4f0-483f-87cf-7fec7e0a1f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:42.721272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4dbd37-f4f0-483f-87cf-7fec7e0a1f23 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:42.722024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dbd37-f4f0-483f-87cf-7fec7e0a1f23 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:42.722369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dbd37-f4f0-483f-87cf-7fec7e0a1f23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:42.723730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4dbd37-f4f0-483f-87cf-7fec7e0a1f23 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:42.732398 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 539/1089] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Jul 19 13:52:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:42.737807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dbd37-f4f0-483f-87cf-7fec7e0a1f23 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:42.749817 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:42.787783 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 551/1090] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 13:52:42.811789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27358d-aea1-48a9-9c26-02a31c17b074 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:42.830949 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:42.837500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4dbd37-f4f0-483f-87cf-7fec7e0a1f23 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:42.871995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1eccb-b94b-43db-9b77-ae078c6e7c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:42.872786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1eccb-b94b-43db-9b77-ae078c6e7c3c None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:42.873073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1eccb-b94b-43db-9b77-ae078c6e7c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:42.873349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1eccb-b94b-43db-9b77-ae078c6e7c3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:42.883286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1eccb-b94b-43db-9b77-ae078c6e7c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:42.884720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1eccb-b94b-43db-9b77-ae078c6e7c3c None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:42.902080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-bdb1eccb-b94b-43db-9b77-ae078c6e7c3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:42.902080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:42.902080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:42.902080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:42.902080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:42.902080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:42.902080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:42.902080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:42.902080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:42.902080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:42.902080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:42.902080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:42.902080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:42.902080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:42.902080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:42.903190 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:42.903190 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:42.903190 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:42.903190 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:42.903190 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:42.903190 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:42.903190 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:42.903190 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:42.903190 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:42.903190 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:42.903190 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:42.903190 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:42.903190 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:42.903190 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:42.903190 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:42.903190 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:42.903190 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:42.904109 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:42.904109 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:42.904109 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:42.904109 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:42.904109 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 540/1091] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:42.908882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1eccb-b94b-43db-9b77-ae078c6e7c3c None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:42.913035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c27358d-aea1-48a9-9c26-02a31c17b074 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:42.947604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b76472-4fce-4d45-b1f3-e5eee2059371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:42.948398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b76472-4fce-4d45-b1f3-e5eee2059371 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:42.948686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b76472-4fce-4d45-b1f3-e5eee2059371 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:42.948965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b76472-4fce-4d45-b1f3-e5eee2059371 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:42.958956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b76472-4fce-4d45-b1f3-e5eee2059371 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:52:42.966792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-f1b76472-4fce-4d45-b1f3-e5eee2059371 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:52:42.966792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:42.966792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:42.966792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:42.966792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:42.966792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:42.966792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:42.966792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:42.966792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:42.966792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:42.966792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:42.966792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:42.966792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:52:42.966792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:52:42.966792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:52:42.966792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:52:42.967782 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:52:42.967782 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:52:42.967782 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:52:42.967782 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:52:42.967782 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:42.967782 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:42.967782 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:42.967782 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:42.967782 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:42.967782 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:42.967782 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:42.967782 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:42.967782 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:42.967782 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:42.967782 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:42.967782 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:42.968615 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:42.968615 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:42.968615 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:42.968615 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:42.968615 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:52:42.968615 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:52:42.968615 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:52:42.968615 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:52:42.968615 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:52:42.968615 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:52:42.968615 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:52:42.968615 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:42.968615 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 552/1092] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:52:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:42.973947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b76472-4fce-4d45-b1f3-e5eee2059371 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:43.003914 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:43.009375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1eccb-b94b-43db-9b77-ae078c6e7c3c None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:43.043256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71199ea9-b277-496b-ae42-816119ad70a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:43.043853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71199ea9-b277-496b-ae42-816119ad70a1 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:43.044138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71199ea9-b277-496b-ae42-816119ad70a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:43.044416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71199ea9-b277-496b-ae42-816119ad70a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:43.045141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71199ea9-b277-496b-ae42-816119ad70a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:43.045449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71199ea9-b277-496b-ae42-816119ad70a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:43.046832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71199ea9-b277-496b-ae42-816119ad70a1 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:43.058585 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 541/1093] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:43.064124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71199ea9-b277-496b-ae42-816119ad70a1 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:43.073279 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:43.076729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b76472-4fce-4d45-b1f3-e5eee2059371 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:43.111310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dca444-6c55-4bed-923c-ca4ebe114c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:43.111970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dca444-6c55-4bed-923c-ca4ebe114c7a None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:43.112251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dca444-6c55-4bed-923c-ca4ebe114c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:43.112524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dca444-6c55-4bed-923c-ca4ebe114c7a None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:43.113264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dca444-6c55-4bed-923c-ca4ebe114c7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:43.113565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dca444-6c55-4bed-923c-ca4ebe114c7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:43.114957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dca444-6c55-4bed-923c-ca4ebe114c7a None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:43.124122 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 553/1094] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:52:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:43.129821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dca444-6c55-4bed-923c-ca4ebe114c7a None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:43.163063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71199ea9-b277-496b-ae42-816119ad70a1 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:43.198303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103ab48-38ee-4b2f-83fe-87d6e0754d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:43.199153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103ab48-38ee-4b2f-83fe-87d6e0754d87 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:43.199436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103ab48-38ee-4b2f-83fe-87d6e0754d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:43.199714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103ab48-38ee-4b2f-83fe-87d6e0754d87 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:43.207564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103ab48-38ee-4b2f-83fe-87d6e0754d87 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:43.209007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103ab48-38ee-4b2f-83fe-87d6e0754d87 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:43.221666 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:43.223324 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-3103ab48-38ee-4b2f-83fe-87d6e0754d87 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 13:52:43.223324 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:43.223324 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:43.223324 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:43.223324 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:43.223324 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:43.223324 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:43.223324 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:43.223324 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:43.223324 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:43.223324 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:43.223324 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:43.223324 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:52:43.223324 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:52:43.223324 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:52:43.223324 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:52:43.224251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:43.224251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:43.224251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:52:43.224251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:43.224251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:52:43.224251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:52:43.224251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:43.224251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:43.224251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:43.224251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:43.224251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:43.224251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:43.224251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:43.224251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:43.224251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:43.224251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:43.224251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:43.224251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:43.225205 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:43.225205 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:43.225205 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:52:43.225205 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:52:43.225205 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:52:43.225205 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:52:43.225205 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:52:43.225205 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:52:43.225205 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 13:52:43.225205 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:43.225205 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 542/1095] 10.222.0.43 () {56 vars in 1093 bytes} [Tue Jul 19 13:52:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:43.230957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103ab48-38ee-4b2f-83fe-87d6e0754d87 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:43.232582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dca444-6c55-4bed-923c-ca4ebe114c7a None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:43.267114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadba7a-ba95-4655-80a0-d0d4bca46576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:43.267983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadba7a-ba95-4655-80a0-d0d4bca46576 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:43.268262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadba7a-ba95-4655-80a0-d0d4bca46576 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:43.268533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadba7a-ba95-4655-80a0-d0d4bca46576 None admin] PATH_INFO: `/v3/users/2a34beb79a6d47b6a9927cca23e6df4a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:43.269712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dadba7a-ba95-4655-80a0-d0d4bca46576 None admin] RBAC: Authorizing `identity:get_user(user_id=2a34beb79a6d47b6a9927cca23e6df4a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:43.271206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dadba7a-ba95-4655-80a0-d0d4bca46576 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:43.272833 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 554/1096] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:52:43 2022] GET /identity/v3/users/2a34beb79a6d47b6a9927cca23e6df4a => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:43.279099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadba7a-ba95-4655-80a0-d0d4bca46576 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:43.297550 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:43.331616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103ab48-38ee-4b2f-83fe-87d6e0754d87 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:43.369455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861ea94-30d9-43c3-875b-afd7c7b481cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:43.370152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861ea94-30d9-43c3-875b-afd7c7b481cd None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:43.370445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861ea94-30d9-43c3-875b-afd7c7b481cd None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:43.370725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861ea94-30d9-43c3-875b-afd7c7b481cd None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:43.371572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861ea94-30d9-43c3-875b-afd7c7b481cd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:43.371882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861ea94-30d9-43c3-875b-afd7c7b481cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:43.373300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861ea94-30d9-43c3-875b-afd7c7b481cd None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:43.379048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadba7a-ba95-4655-80a0-d0d4bca46576 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:43.390638 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 543/1097] 10.222.0.43 () {56 vars in 1133 bytes} [Tue Jul 19 13:52:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:43.396138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861ea94-30d9-43c3-875b-afd7c7b481cd None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:43.413639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46381b21-39d4-40fc-8061-4d6f8f937ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:43.414984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46381b21-39d4-40fc-8061-4d6f8f937ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:43.415274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46381b21-39d4-40fc-8061-4d6f8f937ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:43.415550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46381b21-39d4-40fc-8061-4d6f8f937ff0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:43.442119 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:43.484155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46381b21-39d4-40fc-8061-4d6f8f937ff0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:43.485608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46381b21-39d4-40fc-8061-4d6f8f937ff0 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:43.493745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861ea94-30d9-43c3-875b-afd7c7b481cd None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:43.517494 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:43.528337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d2bd6-0026-4aee-bcd1-60f9b92c939d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:43.528989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d2bd6-0026-4aee-bcd1-60f9b92c939d None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:43.529279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d2bd6-0026-4aee-bcd1-60f9b92c939d None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:43.529557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d2bd6-0026-4aee-bcd1-60f9b92c939d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:43.583600 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 555/1098] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:52:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 13:52:43.589631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46381b21-39d4-40fc-8061-4d6f8f937ff0 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:43.596419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d2bd6-0026-4aee-bcd1-60f9b92c939d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:43.597859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d2bd6-0026-4aee-bcd1-60f9b92c939d None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:43.650709 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:43.692445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46381b21-39d4-40fc-8061-4d6f8f937ff0 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:43.696449 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 544/1099] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:52:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 13:52:43.702105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d2bd6-0026-4aee-bcd1-60f9b92c939d None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:43.725777 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:43.727283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144491f0-32c4-4c40-83cc-e4c6c03b812e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:43.728145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144491f0-32c4-4c40-83cc-e4c6c03b812e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:43.728428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144491f0-32c4-4c40-83cc-e4c6c03b812e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:43.728702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144491f0-32c4-4c40-83cc-e4c6c03b812e None admin] PATH_INFO: `/v3/projects/bc3f0eaef84544129b699d25c56600fa` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:43.729888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144491f0-32c4-4c40-83cc-e4c6c03b812e None admin] RBAC: Authorizing `identity:get_project(project_id=bc3f0eaef84544129b699d25c56600fa)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:43.731356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144491f0-32c4-4c40-83cc-e4c6c03b812e None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:43.733076 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 556/1100] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:52:43 2022] GET /identity/v3/projects/bc3f0eaef84544129b699d25c56600fa => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:43.738981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144491f0-32c4-4c40-83cc-e4c6c03b812e None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:43.800050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d2bd6-0026-4aee-bcd1-60f9b92c939d None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:43.833950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1196972-0e05-419e-a832-1809870628d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:43.834700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1196972-0e05-419e-a832-1809870628d6 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:43.834983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1196972-0e05-419e-a832-1809870628d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:43.835262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1196972-0e05-419e-a832-1809870628d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:43.838486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144491f0-32c4-4c40-83cc-e4c6c03b812e None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:43.845653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1196972-0e05-419e-a832-1809870628d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:43.847131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1196972-0e05-419e-a832-1809870628d6 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:43.862792 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:43.864820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-b1196972-0e05-419e-a832-1809870628d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:43.864820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:43.864820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:43.864820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:43.864820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:43.864820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:43.864820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:43.864820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:43.864820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:43.864820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:43.864820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:43.864820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:43.864820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:52:43.864820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:52:43.864820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:52:43.865832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:52:43.865832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:43.865832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:43.865832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:43.865832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:43.865832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:43.865832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:43.865832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:43.865832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:43.865832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:43.865832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:43.865832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:43.865832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:43.865832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:43.865832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:43.865832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:43.865832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:43.866900 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:52:43.866900 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:52:43.866900 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:52:43.866900 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:52:43.866900 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 545/1101] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:52:43.872026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce011471-2e77-4246-b822-fbda03156d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:43.872320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1196972-0e05-419e-a832-1809870628d6 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:43.874785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce011471-2e77-4246-b822-fbda03156d7c None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:43.874785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce011471-2e77-4246-b822-fbda03156d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:43.874785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce011471-2e77-4246-b822-fbda03156d7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:43.874785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce011471-2e77-4246-b822-fbda03156d7c None admin] RBAC: Adding query filter params (role.id=bc315edf089d43b18acf9790031f3fcb, scope.project.id=bc3f0eaef84544129b699d25c56600fa, user.id=2a34beb79a6d47b6a9927cca23e6df4a) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:43.874785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce011471-2e77-4246-b822-fbda03156d7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:43.876852 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce011471-2e77-4246-b822-fbda03156d7c None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:43.884175 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 557/1102] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:52:43 2022] GET /identity/v3/role_assignments?user.id=2a34beb79a6d47b6a9927cca23e6df4a&scope.project.id=bc3f0eaef84544129b699d25c56600fa&role.id=bc315edf089d43b18acf9790031f3fcb => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:43.957102 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:43.982991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1196972-0e05-419e-a832-1809870628d6 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:44.019833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd04592-3ed5-4738-b068-5800c0c7d234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:44.020509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd04592-3ed5-4738-b068-5800c0c7d234 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:44.020792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd04592-3ed5-4738-b068-5800c0c7d234 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:44.021067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd04592-3ed5-4738-b068-5800c0c7d234 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:44.021799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd04592-3ed5-4738-b068-5800c0c7d234 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:44.022114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd04592-3ed5-4738-b068-5800c0c7d234 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:44.024092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd04592-3ed5-4738-b068-5800c0c7d234 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:44.037978 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 546/1103] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:52:44.070262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce011471-2e77-4246-b822-fbda03156d7c None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:44.146465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce011471-2e77-4246-b822-fbda03156d7c None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:44.178660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce06f3c-3791-4b6c-8a54-3ada9c5dbe8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:44.179440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce06f3c-3791-4b6c-8a54-3ada9c5dbe8f None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:44.179721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce06f3c-3791-4b6c-8a54-3ada9c5dbe8f None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:44.180518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce06f3c-3791-4b6c-8a54-3ada9c5dbe8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:44.187120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce06f3c-3791-4b6c-8a54-3ada9c5dbe8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:44.188544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce06f3c-3791-4b6c-8a54-3ada9c5dbe8f None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:44.202858 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-0ce06f3c-3791-4b6c-8a54-3ada9c5dbe8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:44.202858 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:52:44.202858 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:52:44.202858 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:52:44.202858 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:52:44.202858 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:52:44.202858 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:52:44.202858 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:52:44.202858 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:52:44.202858 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:52:44.202858 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:52:44.202858 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:52:44.202858 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:52:44.202858 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:52:44.202858 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:52:44.203906 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:52:44.203906 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:52:44.203906 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:52:44.203906 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:52:44.203906 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:52:44.203906 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:52:44.203906 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:52:44.203906 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:52:44.203906 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:52:44.203906 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:52:44.203906 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:52:44.203906 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:52:44.203906 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:52:44.203906 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:52:44.203906 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:52:44.203906 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:52:44.203906 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:52:44.204856 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:52:44.204856 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:52:44.204856 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:52:44.204856 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:52:44.204856 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:52:44.204856 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:52:44.204856 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:52:44.204856 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:52:44.204856 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 558/1104] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:52:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:52:44.209780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd04592-3ed5-4738-b068-5800c0c7d234 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:44.311073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd04592-3ed5-4738-b068-5800c0c7d234 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:44.344203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c3755-bba0-44ca-a01e-4c0baaf29245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:44.344869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c3755-bba0-44ca-a01e-4c0baaf29245 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:44.345150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c3755-bba0-44ca-a01e-4c0baaf29245 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:44.345423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c3755-bba0-44ca-a01e-4c0baaf29245 None admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:44.346232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c3755-bba0-44ca-a01e-4c0baaf29245 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:44.346541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c3755-bba0-44ca-a01e-4c0baaf29245 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:44.347948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c3755-bba0-44ca-a01e-4c0baaf29245 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:44.350466 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:44.361170 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 547/1105] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:52:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:44.367247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce06f3c-3791-4b6c-8a54-3ada9c5dbe8f None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:44.418879 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:44.469044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce06f3c-3791-4b6c-8a54-3ada9c5dbe8f None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:44.501988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652292e-1bff-4c1a-ab78-98be18965b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:44.502662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652292e-1bff-4c1a-ab78-98be18965b1b None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:44.502947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652292e-1bff-4c1a-ab78-98be18965b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:44.503222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652292e-1bff-4c1a-ab78-98be18965b1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:44.504049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652292e-1bff-4c1a-ab78-98be18965b1b None admin] RBAC: Adding query filter params (role.id=3841e5d49ee04bf08c66d1134dc3b552, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=dfe9762955004354ab4f1fe02f05a427) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:44.504367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652292e-1bff-4c1a-ab78-98be18965b1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:44.505783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652292e-1bff-4c1a-ab78-98be18965b1b None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:44.512092 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 559/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:52:44 2022] GET /identity/v3/role_assignments?user.id=dfe9762955004354ab4f1fe02f05a427&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=3841e5d49ee04bf08c66d1134dc3b552 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:45.960679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7c3e-630b-4089-ba14-fef3abff392d None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:45.961347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7c3e-630b-4089-ba14-fef3abff392d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:45.961347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc7c3e-630b-4089-ba14-fef3abff392d None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:45.962960 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 548/1107] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:45.968183 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccd403-2316-4310-8aa2-44e186c7534c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:45.968625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccd403-2316-4310-8aa2-44e186c7534c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:45.968719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccd403-2316-4310-8aa2-44e186c7534c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:45.985542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-43ccd403-2316-4310-8aa2-44e186c7534c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:45.986736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-43ccd403-2316-4310-8aa2-44e186c7534c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:46.051900 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 560/1108] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:46.077472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc7c3e-630b-4089-ba14-fef3abff392d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:46.176909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc7c3e-630b-4089-ba14-fef3abff392d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:46.209873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db42e55-fef3-472f-964b-07cbd2d13082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:46.210732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db42e55-fef3-472f-964b-07cbd2d13082 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:46.210971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db42e55-fef3-472f-964b-07cbd2d13082 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:46.211284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db42e55-fef3-472f-964b-07cbd2d13082 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:46.212449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db42e55-fef3-472f-964b-07cbd2d13082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:46.213890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db42e55-fef3-472f-964b-07cbd2d13082 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:46.215541 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 549/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:46.221586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccd403-2316-4310-8aa2-44e186c7534c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:46.266417 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:46.318719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccd403-2316-4310-8aa2-44e186c7534c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:46.351620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d1ffc-b02f-4140-b9cc-47049e8ed59d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:46.352913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d1ffc-b02f-4140-b9cc-47049e8ed59d None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:46.353197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d1ffc-b02f-4140-b9cc-47049e8ed59d None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:46.353470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d1ffc-b02f-4140-b9cc-47049e8ed59d None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:46.354200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d1ffc-b02f-4140-b9cc-47049e8ed59d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:46.355623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d1ffc-b02f-4140-b9cc-47049e8ed59d None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:46.431273 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 561/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 19 13:52:46 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:52:48.504631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f4385-a686-4153-8b41-12231dbfb450 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:48.505132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f4385-a686-4153-8b41-12231dbfb450 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:48.505132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f4385-a686-4153-8b41-12231dbfb450 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:48.506498 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 550/1111] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:48.511725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f29df-0c5c-495e-ac03-8a0d19112036 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:48.512134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f29df-0c5c-495e-ac03-8a0d19112036 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:48.512287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365f29df-0c5c-495e-ac03-8a0d19112036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:48.529673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-365f29df-0c5c-495e-ac03-8a0d19112036 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:48.530877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-365f29df-0c5c-495e-ac03-8a0d19112036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:48.605053 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 562/1112] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:48.628473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f4385-a686-4153-8b41-12231dbfb450 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:48.692373 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:48.731778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f4385-a686-4153-8b41-12231dbfb450 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:48.764405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0e0fa-e263-421c-9918-dbeefbdc3b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:48.765188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0e0fa-e263-421c-9918-dbeefbdc3b0e None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:48.765471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0e0fa-e263-421c-9918-dbeefbdc3b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:48.765747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0e0fa-e263-421c-9918-dbeefbdc3b0e None admin] PATH_INFO: `/v3/roles/b73e411ed06b463fb578c06789886960` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:48.767217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0e0fa-e263-421c-9918-dbeefbdc3b0e None admin] RBAC: Authorizing `identity:get_role(role_id=b73e411ed06b463fb578c06789886960)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:48.768594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0e0fa-e263-421c-9918-dbeefbdc3b0e None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:48.769938 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 551/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:52:48 2022] GET /identity/v3/roles/b73e411ed06b463fb578c06789886960 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:48.776296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f29df-0c5c-495e-ac03-8a0d19112036 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:48.805857 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:48.874547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365f29df-0c5c-495e-ac03-8a0d19112036 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:48.908371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c5300-015c-4da7-99d8-52c6eb62b3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:48.909235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c5300-015c-4da7-99d8-52c6eb62b3ff None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:48.909518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c5300-015c-4da7-99d8-52c6eb62b3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:48.909789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c5300-015c-4da7-99d8-52c6eb62b3ff None admin] PATH_INFO: `/v3/users/b5d48b177d4645929a28085e2a83d7a2` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:48.922620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c5300-015c-4da7-99d8-52c6eb62b3ff None admin] RBAC: Authorizing `identity:get_user(user_id=b5d48b177d4645929a28085e2a83d7a2)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:48.924057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c5300-015c-4da7-99d8-52c6eb62b3ff None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:48.925694 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 563/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:52:48 2022] GET /identity/v3/users/b5d48b177d4645929a28085e2a83d7a2 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:48.931527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0e0fa-e263-421c-9918-dbeefbdc3b0e None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:49.028100 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0e0fa-e263-421c-9918-dbeefbdc3b0e None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:49.055539 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:49.060091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cee63-b6d9-4f98-a3f4-c5ca9929ed28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:49.060728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cee63-b6d9-4f98-a3f4-c5ca9929ed28 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:49.061012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cee63-b6d9-4f98-a3f4-c5ca9929ed28 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:49.061290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224cee63-b6d9-4f98-a3f4-c5ca9929ed28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:49.127115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cee63-b6d9-4f98-a3f4-c5ca9929ed28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:49.128548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224cee63-b6d9-4f98-a3f4-c5ca9929ed28 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:49.230789 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 552/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:52:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 13:52:49.236786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c5300-015c-4da7-99d8-52c6eb62b3ff None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:49.324086 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:49.335362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c5300-015c-4da7-99d8-52c6eb62b3ff None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:49.369790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e747a-c7a8-4805-8725-89c885cd496a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:49.370663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e747a-c7a8-4805-8725-89c885cd496a None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:49.370947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e747a-c7a8-4805-8725-89c885cd496a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:49.371223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e747a-c7a8-4805-8725-89c885cd496a None admin] PATH_INFO: `/v3/projects/bc3f0eaef84544129b699d25c56600fa` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:49.372385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e747a-c7a8-4805-8725-89c885cd496a None admin] RBAC: Authorizing `identity:get_project(project_id=bc3f0eaef84544129b699d25c56600fa)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:49.373813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e747a-c7a8-4805-8725-89c885cd496a None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:49.375537 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 564/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:52:49 2022] GET /identity/v3/projects/bc3f0eaef84544129b699d25c56600fa => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:49.381572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cee63-b6d9-4f98-a3f4-c5ca9929ed28 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:49.411645 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:49.486302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224cee63-b6d9-4f98-a3f4-c5ca9929ed28 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:49.519874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d945214f-be89-4b1f-9d4d-1f83152b8059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:49.520520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945214f-be89-4b1f-9d4d-1f83152b8059 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:49.520800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945214f-be89-4b1f-9d4d-1f83152b8059 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:49.521074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d945214f-be89-4b1f-9d4d-1f83152b8059 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:49.521902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945214f-be89-4b1f-9d4d-1f83152b8059 None admin] RBAC: Adding query filter params (role.id=b73e411ed06b463fb578c06789886960, scope.project.id=bc3f0eaef84544129b699d25c56600fa, user.id=b5d48b177d4645929a28085e2a83d7a2) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:49.522244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945214f-be89-4b1f-9d4d-1f83152b8059 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:49.523691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d945214f-be89-4b1f-9d4d-1f83152b8059 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:49.529021 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 553/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:52:49 2022] GET /identity/v3/role_assignments?user.id=b5d48b177d4645929a28085e2a83d7a2&scope.project.id=bc3f0eaef84544129b699d25c56600fa&role.id=b73e411ed06b463fb578c06789886960 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:51.530483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9528d-449a-4707-ad8d-066d8b0062eb None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:51.531010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9528d-449a-4707-ad8d-066d8b0062eb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:51.531010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9528d-449a-4707-ad8d-066d8b0062eb None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:51.532351 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 565/1118] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:51.537555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca75c4a-5acf-4da6-a833-2f73ec833be4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:51.537975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca75c4a-5acf-4da6-a833-2f73ec833be4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:51.538156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca75c4a-5acf-4da6-a833-2f73ec833be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:51.555171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-dca75c4a-5acf-4da6-a833-2f73ec833be4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:51.556459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-dca75c4a-5acf-4da6-a833-2f73ec833be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:51.621464 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 554/1119] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:51.644037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9528d-449a-4707-ad8d-066d8b0062eb None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:51.743095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9528d-449a-4707-ad8d-066d8b0062eb None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:51.775790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade88f9-4f7b-4b19-a55d-407c63981cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:51.776629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade88f9-4f7b-4b19-a55d-407c63981cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:51.776913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade88f9-4f7b-4b19-a55d-407c63981cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:51.777190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade88f9-4f7b-4b19-a55d-407c63981cd5 None admin] PATH_INFO: `/v3/roles/b73e411ed06b463fb578c06789886960` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:51.778682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade88f9-4f7b-4b19-a55d-407c63981cd5 None admin] RBAC: Authorizing `identity:get_role(role_id=b73e411ed06b463fb578c06789886960)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:51.780034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade88f9-4f7b-4b19-a55d-407c63981cd5 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:51.781421 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 566/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:52:51 2022] GET /identity/v3/roles/b73e411ed06b463fb578c06789886960 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:51.787119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca75c4a-5acf-4da6-a833-2f73ec833be4 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:51.813510 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:51.882444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca75c4a-5acf-4da6-a833-2f73ec833be4 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:51.917205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574eae64-fd6e-4c9a-8dc9-3e7553e838da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:51.918070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574eae64-fd6e-4c9a-8dc9-3e7553e838da None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:51.918396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574eae64-fd6e-4c9a-8dc9-3e7553e838da None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:51.918678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574eae64-fd6e-4c9a-8dc9-3e7553e838da None admin] PATH_INFO: `/v3/users/b5d48b177d4645929a28085e2a83d7a2` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:51.919861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574eae64-fd6e-4c9a-8dc9-3e7553e838da None admin] RBAC: Authorizing `identity:get_user(user_id=b5d48b177d4645929a28085e2a83d7a2)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:51.921278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574eae64-fd6e-4c9a-8dc9-3e7553e838da None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:51.922944 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 555/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:52:51 2022] GET /identity/v3/users/b5d48b177d4645929a28085e2a83d7a2 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:51.928693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade88f9-4f7b-4b19-a55d-407c63981cd5 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:51.954134 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:52.026338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade88f9-4f7b-4b19-a55d-407c63981cd5 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:52.058542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c015ee32-5bca-4538-abd3-5849ed2f60d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:52.059325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015ee32-5bca-4538-abd3-5849ed2f60d3 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:52.059609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015ee32-5bca-4538-abd3-5849ed2f60d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:52.059885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c015ee32-5bca-4538-abd3-5849ed2f60d3 None admin] PATH_INFO: `/v3/projects/bc3f0eaef84544129b699d25c56600fa` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:52.061049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015ee32-5bca-4538-abd3-5849ed2f60d3 None admin] RBAC: Authorizing `identity:get_project(project_id=bc3f0eaef84544129b699d25c56600fa)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:52.062502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c015ee32-5bca-4538-abd3-5849ed2f60d3 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:52.064184 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 567/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:52:51 2022] GET /identity/v3/projects/bc3f0eaef84544129b699d25c56600fa => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:52.071168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574eae64-fd6e-4c9a-8dc9-3e7553e838da None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:52.160460 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:52.167160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574eae64-fd6e-4c9a-8dc9-3e7553e838da None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:52.200641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecf0b8-8e69-4ec9-9f4a-d7e269956e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:52.201510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecf0b8-8e69-4ec9-9f4a-d7e269956e8a None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:52.201789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecf0b8-8e69-4ec9-9f4a-d7e269956e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:52.202062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecf0b8-8e69-4ec9-9f4a-d7e269956e8a None admin] PATH_INFO: `/v3/projects/bc3f0eaef84544129b699d25c56600fa/users/b5d48b177d4645929a28085e2a83d7a2/roles/b73e411ed06b463fb578c06789886960` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:52.204219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ecf0b8-8e69-4ec9-9f4a-d7e269956e8a None admin] RBAC: Authorizing `identity:create_grant(project_id=bc3f0eaef84544129b699d25c56600fa, user_id=b5d48b177d4645929a28085e2a83d7a2, role_id=b73e411ed06b463fb578c06789886960)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:52.205657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ecf0b8-8e69-4ec9-9f4a-d7e269956e8a None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:52.254112 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 556/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:52:52 2022] PUT /identity/v3/projects/bc3f0eaef84544129b699d25c56600fa/users/b5d48b177d4645929a28085e2a83d7a2/roles/b73e411ed06b463fb578c06789886960 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 13:52:54.262532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038159e-feaf-4802-bf10-9b1ec46255cb None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:54.263013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038159e-feaf-4802-bf10-9b1ec46255cb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:54.263105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038159e-feaf-4802-bf10-9b1ec46255cb None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:54.264445 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 568/1124] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:54.269661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ee8df-ceee-4b84-a22f-091d08e50835 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:54.270141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ee8df-ceee-4b84-a22f-091d08e50835 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:54.270250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ee8df-ceee-4b84-a22f-091d08e50835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:54.286854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b44ee8df-ceee-4b84-a22f-091d08e50835 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:54.288012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b44ee8df-ceee-4b84-a22f-091d08e50835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:54.353411 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 557/1125] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:54.377455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038159e-feaf-4802-bf10-9b1ec46255cb None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:54.466179 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:54.477382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038159e-feaf-4802-bf10-9b1ec46255cb None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:54.509683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2f37e-a6d1-4db3-9fbb-93d36843cc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:54.510553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2f37e-a6d1-4db3-9fbb-93d36843cc77 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:54.510839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2f37e-a6d1-4db3-9fbb-93d36843cc77 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:54.511115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2f37e-a6d1-4db3-9fbb-93d36843cc77 None admin] PATH_INFO: `/v3/roles/b73e411ed06b463fb578c06789886960` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:54.512570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2f37e-a6d1-4db3-9fbb-93d36843cc77 None admin] RBAC: Authorizing `identity:get_role(role_id=b73e411ed06b463fb578c06789886960)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:54.513928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2f37e-a6d1-4db3-9fbb-93d36843cc77 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:54.515297 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 569/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:52:54 2022] GET /identity/v3/roles/b73e411ed06b463fb578c06789886960 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:54.521061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ee8df-ceee-4b84-a22f-091d08e50835 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:54.602459 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:54.617878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ee8df-ceee-4b84-a22f-091d08e50835 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:54.651834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc1a2b-9b42-4688-b0f4-6ac4a50cd767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:54.652710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc1a2b-9b42-4688-b0f4-6ac4a50cd767 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:54.652995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc1a2b-9b42-4688-b0f4-6ac4a50cd767 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:54.653275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdc1a2b-9b42-4688-b0f4-6ac4a50cd767 None admin] PATH_INFO: `/v3/users/b5d48b177d4645929a28085e2a83d7a2` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:54.654490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc1a2b-9b42-4688-b0f4-6ac4a50cd767 None admin] RBAC: Authorizing `identity:get_user(user_id=b5d48b177d4645929a28085e2a83d7a2)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:54.655917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdc1a2b-9b42-4688-b0f4-6ac4a50cd767 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:54.657555 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 558/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:52:54 2022] GET /identity/v3/users/b5d48b177d4645929a28085e2a83d7a2 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:54.663199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2f37e-a6d1-4db3-9fbb-93d36843cc77 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:54.761493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2f37e-a6d1-4db3-9fbb-93d36843cc77 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:54.793719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ce585-3040-40f4-b196-b75dd5ec741a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:54.794381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ce585-3040-40f4-b196-b75dd5ec741a None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:54.794667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ce585-3040-40f4-b196-b75dd5ec741a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:54.794944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ce585-3040-40f4-b196-b75dd5ec741a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:54.821874 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:54.861570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ce585-3040-40f4-b196-b75dd5ec741a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:54.863043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ce585-3040-40f4-b196-b75dd5ec741a None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:54.958274 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 570/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:52:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 13:52:54.964610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc1a2b-9b42-4688-b0f4-6ac4a50cd767 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:55.061595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdc1a2b-9b42-4688-b0f4-6ac4a50cd767 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:55.093653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b9aa4-daaa-4bb5-a0f0-c6415a0e7318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:55.094521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b9aa4-daaa-4bb5-a0f0-c6415a0e7318 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:55.094806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b9aa4-daaa-4bb5-a0f0-c6415a0e7318 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:55.095084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b9aa4-daaa-4bb5-a0f0-c6415a0e7318 None admin] PATH_INFO: `/v3/projects/bc3f0eaef84544129b699d25c56600fa` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:55.096254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b9aa4-daaa-4bb5-a0f0-c6415a0e7318 None admin] RBAC: Authorizing `identity:get_project(project_id=bc3f0eaef84544129b699d25c56600fa)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:55.097669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b9aa4-daaa-4bb5-a0f0-c6415a0e7318 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:55.099381 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 559/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:52:54 2022] GET /identity/v3/projects/bc3f0eaef84544129b699d25c56600fa => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:55.105961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ce585-3040-40f4-b196-b75dd5ec741a None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:55.162581 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:55.202860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ce585-3040-40f4-b196-b75dd5ec741a None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:55.235903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e657695-c123-448a-a0cf-d742f33b81e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:55.236555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e657695-c123-448a-a0cf-d742f33b81e7 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:55.236845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e657695-c123-448a-a0cf-d742f33b81e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:55.237128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e657695-c123-448a-a0cf-d742f33b81e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:55.237958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e657695-c123-448a-a0cf-d742f33b81e7 None admin] RBAC: Adding query filter params (role.id=b73e411ed06b463fb578c06789886960, scope.project.id=bc3f0eaef84544129b699d25c56600fa, user.id=b5d48b177d4645929a28085e2a83d7a2) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:52:55.238307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e657695-c123-448a-a0cf-d742f33b81e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:55.239729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e657695-c123-448a-a0cf-d742f33b81e7 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:55.246080 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 571/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:52:55 2022] GET /identity/v3/role_assignments?user.id=b5d48b177d4645929a28085e2a83d7a2&scope.project.id=bc3f0eaef84544129b699d25c56600fa&role.id=b73e411ed06b463fb578c06789886960 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:57.282072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e1ee7-ea0a-4762-b1ec-b9f91be6747d None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:57.282603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e1ee7-ea0a-4762-b1ec-b9f91be6747d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:57.282704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e1ee7-ea0a-4762-b1ec-b9f91be6747d None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:57.284029 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 560/1131] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:57.289732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5867e-9eca-4fa2-b991-62dd6c3dce7b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:57.290488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5867e-9eca-4fa2-b991-62dd6c3dce7b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:57.290772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5867e-9eca-4fa2-b991-62dd6c3dce7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:57.307997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a4a5867e-9eca-4fa2-b991-62dd6c3dce7b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:57.309184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a4a5867e-9eca-4fa2-b991-62dd6c3dce7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:57.374819 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 572/1132] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:57.398197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e1ee7-ea0a-4762-b1ec-b9f91be6747d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:57.420308 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:57.499959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025e1ee7-ea0a-4762-b1ec-b9f91be6747d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:57.533813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fde837-9d0e-40bc-a37c-34bf81be6905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:57.534642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fde837-9d0e-40bc-a37c-34bf81be6905 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:57.534932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fde837-9d0e-40bc-a37c-34bf81be6905 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:57.535214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fde837-9d0e-40bc-a37c-34bf81be6905 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:57.536374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fde837-9d0e-40bc-a37c-34bf81be6905 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:57.537793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fde837-9d0e-40bc-a37c-34bf81be6905 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:57.540181 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 561/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:52:57.545968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5867e-9eca-4fa2-b991-62dd6c3dce7b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:52:57.599236 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:52:57.642451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5867e-9eca-4fa2-b991-62dd6c3dce7b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:52:57.676355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bee0cb-9888-4a05-b41a-2b10477395b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:52:57.677001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bee0cb-9888-4a05-b41a-2b10477395b0 None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:57.677284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bee0cb-9888-4a05-b41a-2b10477395b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:57.677558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bee0cb-9888-4a05-b41a-2b10477395b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:57.678286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bee0cb-9888-4a05-b41a-2b10477395b0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:52:57.679718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bee0cb-9888-4a05-b41a-2b10477395b0 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:52:57.752190 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 573/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 19 13:52:57 2022] POST /identity/v3/projects => generated 311 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:52:59.839789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dec04-fe54-49d0-9f7b-680e51933243 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:59.840336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dec04-fe54-49d0-9f7b-680e51933243 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:59.840336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123dec04-fe54-49d0-9f7b-680e51933243 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:59.841691 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 562/1135] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:52:59.846897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df39ed-dcb5-4405-990b-7d4f5c9bcd17 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:52:59.847302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df39ed-dcb5-4405-990b-7d4f5c9bcd17 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:52:59.847547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df39ed-dcb5-4405-990b-7d4f5c9bcd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:52:59.864812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-16df39ed-dcb5-4405-990b-7d4f5c9bcd17 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:52:59.870202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-16df39ed-dcb5-4405-990b-7d4f5c9bcd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:52:59.934586 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 574/1136] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:52:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:52:59.959574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dec04-fe54-49d0-9f7b-680e51933243 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:00.047895 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:00.060508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123dec04-fe54-49d0-9f7b-680e51933243 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:00.095044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af16f48d-4060-4174-8bcc-c79be57d59f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:00.095801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16f48d-4060-4174-8bcc-c79be57d59f1 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:00.096082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16f48d-4060-4174-8bcc-c79be57d59f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:00.096355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af16f48d-4060-4174-8bcc-c79be57d59f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:00.097502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16f48d-4060-4174-8bcc-c79be57d59f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:00.098938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af16f48d-4060-4174-8bcc-c79be57d59f1 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:00.100530 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 563/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:52:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:00.106956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df39ed-dcb5-4405-990b-7d4f5c9bcd17 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:00.140383 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:00.203365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df39ed-dcb5-4405-990b-7d4f5c9bcd17 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:00.238430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182339d0-f581-43b1-81dc-88cd622c3b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:00.239096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182339d0-f581-43b1-81dc-88cd622c3b02 None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:00.239379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182339d0-f581-43b1-81dc-88cd622c3b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:00.239653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182339d0-f581-43b1-81dc-88cd622c3b02 None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:00.240370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182339d0-f581-43b1-81dc-88cd622c3b02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:00.241794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182339d0-f581-43b1-81dc-88cd622c3b02 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:00.351348 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 575/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 19 13:53:00 2022] POST /identity/v3/users => generated 286 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:53:02.425220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb7ea5-641b-4413-8d88-a1ae80b6db05 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:02.425761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb7ea5-641b-4413-8d88-a1ae80b6db05 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:02.425761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb7ea5-641b-4413-8d88-a1ae80b6db05 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:02.427184 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 564/1139] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:53:02.433012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be729488-0046-4991-9f78-e6265e079ff1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:02.433423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be729488-0046-4991-9f78-e6265e079ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:02.433568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be729488-0046-4991-9f78-e6265e079ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:02.450569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-be729488-0046-4991-9f78-e6265e079ff1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:53:02.451739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-be729488-0046-4991-9f78-e6265e079ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:53:02.516937 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 576/1140] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:53:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:53:02.540853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb7ea5-641b-4413-8d88-a1ae80b6db05 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:02.640585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb7ea5-641b-4413-8d88-a1ae80b6db05 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:02.673792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbdd25-25cf-446b-abfa-e714ff966da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:02.674603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbdd25-25cf-446b-abfa-e714ff966da9 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:02.674891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbdd25-25cf-446b-abfa-e714ff966da9 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:02.675170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbdd25-25cf-446b-abfa-e714ff966da9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:02.685734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbdd25-25cf-446b-abfa-e714ff966da9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:53:02.693594 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-a0bbdd25-25cf-446b-abfa-e714ff966da9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:53:02.693594 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:53:02.693594 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:53:02.693594 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:53:02.693594 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:53:02.693594 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:53:02.693594 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:53:02.693594 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:53:02.693594 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:53:02.693594 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:53:02.693594 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:53:02.693594 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:53:02.693594 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:53:02.693594 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:53:02.693594 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:53:02.693594 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:53:02.694796 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:53:02.694796 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:53:02.694796 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:53:02.694796 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:53:02.694796 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:53:02.694796 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:53:02.694796 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:53:02.694796 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:53:02.694796 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:53:02.694796 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:53:02.694796 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:53:02.694796 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:53:02.694796 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:53:02.694796 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:53:02.694796 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:53:02.694796 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:53:02.695774 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:53:02.695774 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:53:02.695774 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:53:02.695774 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:53:02.695774 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:53:02.695774 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:53:02.695774 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:53:02.695774 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:53:02.695774 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:53:02.695774 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:53:02.695774 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:53:02.695774 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:53:02.695774 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 565/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:53:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:53:02.700862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be729488-0046-4991-9f78-e6265e079ff1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:02.723894 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:02.797810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be729488-0046-4991-9f78-e6265e079ff1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:02.830847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0f064-d7de-4adf-8022-4c675cc8813a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:02.831503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0f064-d7de-4adf-8022-4c675cc8813a None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:02.831788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0f064-d7de-4adf-8022-4c675cc8813a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:02.832066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0f064-d7de-4adf-8022-4c675cc8813a None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:02.832809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0f064-d7de-4adf-8022-4c675cc8813a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:53:02.833117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0f064-d7de-4adf-8022-4c675cc8813a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:02.834512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0f064-d7de-4adf-8022-4c675cc8813a None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:02.842848 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 577/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:53:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:02.848542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbdd25-25cf-446b-abfa-e714ff966da9 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:02.867403 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:02.947953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbdd25-25cf-446b-abfa-e714ff966da9 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:02.981084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db25ed-6f04-4a57-b711-4ade651fe736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:02.981954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db25ed-6f04-4a57-b711-4ade651fe736 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:02.982273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db25ed-6f04-4a57-b711-4ade651fe736 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:02.982556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db25ed-6f04-4a57-b711-4ade651fe736 None admin] PATH_INFO: `/v3/users/4c81937063434784a33f2e72fcc2cf62` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:02.995236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db25ed-6f04-4a57-b711-4ade651fe736 None admin] RBAC: Authorizing `identity:get_user(user_id=4c81937063434784a33f2e72fcc2cf62)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:02.996671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db25ed-6f04-4a57-b711-4ade651fe736 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:02.998357 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 566/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:53:02 2022] GET /identity/v3/users/4c81937063434784a33f2e72fcc2cf62 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:03.004130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0f064-d7de-4adf-8022-4c675cc8813a None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:03.086882 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:03.102775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0f064-d7de-4adf-8022-4c675cc8813a None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:03.136984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f03bb0-9409-437a-82ce-697251934541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:03.137620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f03bb0-9409-437a-82ce-697251934541 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:03.137905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f03bb0-9409-437a-82ce-697251934541 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:03.138217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f03bb0-9409-437a-82ce-697251934541 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:03.204706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f03bb0-9409-437a-82ce-697251934541 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:03.206379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f03bb0-9409-437a-82ce-697251934541 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:03.293408 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:03.308769 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 578/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:53:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 13:53:03.314856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db25ed-6f04-4a57-b711-4ade651fe736 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:03.389978 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:03.414830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db25ed-6f04-4a57-b711-4ade651fe736 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:03.448254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fe872-c06c-4875-b2fa-7c531cba5a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:03.449100 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fe872-c06c-4875-b2fa-7c531cba5a6d None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:03.449382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fe872-c06c-4875-b2fa-7c531cba5a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:03.449656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fe872-c06c-4875-b2fa-7c531cba5a6d None admin] PATH_INFO: `/v3/projects/dd413e5a62144aebaa9111a3eadbfa33` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:03.450831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fe872-c06c-4875-b2fa-7c531cba5a6d None admin] RBAC: Authorizing `identity:get_project(project_id=dd413e5a62144aebaa9111a3eadbfa33)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:03.452242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fe872-c06c-4875-b2fa-7c531cba5a6d None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:03.453906 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 567/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:53:03 2022] GET /identity/v3/projects/dd413e5a62144aebaa9111a3eadbfa33 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:03.459970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f03bb0-9409-437a-82ce-697251934541 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:03.563002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f03bb0-9409-437a-82ce-697251934541 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:03.595946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a0b984-17a9-4860-bde5-207d608642f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:03.596590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0b984-17a9-4860-bde5-207d608642f0 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:03.596874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0b984-17a9-4860-bde5-207d608642f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:03.597151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a0b984-17a9-4860-bde5-207d608642f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:03.597977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0b984-17a9-4860-bde5-207d608642f0 None admin] RBAC: Adding query filter params (role.id=bc315edf089d43b18acf9790031f3fcb, scope.project.id=dd413e5a62144aebaa9111a3eadbfa33, user.id=4c81937063434784a33f2e72fcc2cf62) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:53:03.598317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0b984-17a9-4860-bde5-207d608642f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:03.599733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a0b984-17a9-4860-bde5-207d608642f0 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:03.605855 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 579/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:53:03 2022] GET /identity/v3/role_assignments?user.id=4c81937063434784a33f2e72fcc2cf62&scope.project.id=dd413e5a62144aebaa9111a3eadbfa33&role.id=bc315edf089d43b18acf9790031f3fcb => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:05.589725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103b63e-4dce-4f94-b112-770a6c53f9de None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:05.590263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103b63e-4dce-4f94-b112-770a6c53f9de None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:05.590263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103b63e-4dce-4f94-b112-770a6c53f9de None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:05.591602 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 568/1147] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:53:05.596820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd2d94-1568-4428-bfbf-fa8bd9b2ede7 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:05.597252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd2d94-1568-4428-bfbf-fa8bd9b2ede7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:05.597375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdd2d94-1568-4428-bfbf-fa8bd9b2ede7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:05.614346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2fdd2d94-1568-4428-bfbf-fa8bd9b2ede7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:53:05.615507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2fdd2d94-1568-4428-bfbf-fa8bd9b2ede7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:53:05.657666 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:05.679302 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 580/1148] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:53:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:53:05.702686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103b63e-4dce-4f94-b112-770a6c53f9de None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:05.802052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103b63e-4dce-4f94-b112-770a6c53f9de None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:05.835719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e1cbd-3cf8-42cc-aa87-443464d46c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:05.836592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e1cbd-3cf8-42cc-aa87-443464d46c39 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:05.836894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e1cbd-3cf8-42cc-aa87-443464d46c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:05.837175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e1cbd-3cf8-42cc-aa87-443464d46c39 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:05.847087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e1cbd-3cf8-42cc-aa87-443464d46c39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:53:05.854726 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-4a1e1cbd-3cf8-42cc-aa87-443464d46c39 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:53:05.854726 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:53:05.854726 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:53:05.854726 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:53:05.854726 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:53:05.854726 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:53:05.854726 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:53:05.854726 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:53:05.854726 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:53:05.854726 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:53:05.854726 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:53:05.854726 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:53:05.854726 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:53:05.854726 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:53:05.854726 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:53:05.854726 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:53:05.855831 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:53:05.855831 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:53:05.855831 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:53:05.855831 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:53:05.855831 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:53:05.855831 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:53:05.855831 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:53:05.855831 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:53:05.855831 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:53:05.855831 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:53:05.855831 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:53:05.855831 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:53:05.855831 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:53:05.855831 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:53:05.855831 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:53:05.855831 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:53:05.856844 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:53:05.856844 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:53:05.856844 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:53:05.856844 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:53:05.856844 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:53:05.856844 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:53:05.856844 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:53:05.856844 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:53:05.856844 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:53:05.856844 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:53:05.856844 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:53:05.856844 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:53:05.856844 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 569/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:53:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:53:05.861750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd2d94-1568-4428-bfbf-fa8bd9b2ede7 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:05.956521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdd2d94-1568-4428-bfbf-fa8bd9b2ede7 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:05.988597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93710d0d-37a8-48ba-b2d9-4347d2ca2223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:05.989248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93710d0d-37a8-48ba-b2d9-4347d2ca2223 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:05.989528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93710d0d-37a8-48ba-b2d9-4347d2ca2223 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:05.989804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93710d0d-37a8-48ba-b2d9-4347d2ca2223 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:05.990573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93710d0d-37a8-48ba-b2d9-4347d2ca2223 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:53:05.990878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93710d0d-37a8-48ba-b2d9-4347d2ca2223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:05.992727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93710d0d-37a8-48ba-b2d9-4347d2ca2223 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:06.001006 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 581/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:53:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:06.006656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e1cbd-3cf8-42cc-aa87-443464d46c39 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:06.010046 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:06.106164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e1cbd-3cf8-42cc-aa87-443464d46c39 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:06.139518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0137518-ce4b-4435-bcad-258d87f0cb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:06.140373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0137518-ce4b-4435-bcad-258d87f0cb93 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:06.140655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0137518-ce4b-4435-bcad-258d87f0cb93 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:06.140929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0137518-ce4b-4435-bcad-258d87f0cb93 None admin] PATH_INFO: `/v3/users/4c81937063434784a33f2e72fcc2cf62` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:06.142122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0137518-ce4b-4435-bcad-258d87f0cb93 None admin] RBAC: Authorizing `identity:get_user(user_id=4c81937063434784a33f2e72fcc2cf62)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:06.143543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0137518-ce4b-4435-bcad-258d87f0cb93 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:06.145225 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 570/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:53:06 2022] GET /identity/v3/users/4c81937063434784a33f2e72fcc2cf62 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:06.151149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93710d0d-37a8-48ba-b2d9-4347d2ca2223 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:06.192896 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:06.250938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93710d0d-37a8-48ba-b2d9-4347d2ca2223 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:06.282307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286fa0f1-c996-4f11-808f-b09e0e6f5d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:06.283145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fa0f1-c996-4f11-808f-b09e0e6f5d69 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:06.283422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fa0f1-c996-4f11-808f-b09e0e6f5d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:06.283691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286fa0f1-c996-4f11-808f-b09e0e6f5d69 None admin] PATH_INFO: `/v3/projects/dd413e5a62144aebaa9111a3eadbfa33` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:06.284841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fa0f1-c996-4f11-808f-b09e0e6f5d69 None admin] RBAC: Authorizing `identity:get_project(project_id=dd413e5a62144aebaa9111a3eadbfa33)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:06.286285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286fa0f1-c996-4f11-808f-b09e0e6f5d69 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:06.287965 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 582/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:53:06 2022] GET /identity/v3/projects/dd413e5a62144aebaa9111a3eadbfa33 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:53:06.294450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0137518-ce4b-4435-bcad-258d87f0cb93 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:06.361495 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:06.390546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0137518-ce4b-4435-bcad-258d87f0cb93 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:06.423828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ae790-1339-437c-b73a-adefdddd0b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:06.424713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ae790-1339-437c-b73a-adefdddd0b2c None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:06.424999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ae790-1339-437c-b73a-adefdddd0b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:06.425278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ae790-1339-437c-b73a-adefdddd0b2c None admin] PATH_INFO: `/v3/projects/dd413e5a62144aebaa9111a3eadbfa33/users/4c81937063434784a33f2e72fcc2cf62/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:06.427235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ae790-1339-437c-b73a-adefdddd0b2c None admin] RBAC: Authorizing `identity:create_grant(project_id=dd413e5a62144aebaa9111a3eadbfa33, user_id=4c81937063434784a33f2e72fcc2cf62, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:06.428647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ae790-1339-437c-b73a-adefdddd0b2c None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:06.562778 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 571/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:53:06 2022] PUT /identity/v3/projects/dd413e5a62144aebaa9111a3eadbfa33/users/4c81937063434784a33f2e72fcc2cf62/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:53:08.565131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55940a87-8646-438b-834e-84123e7ed76c None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:08.565907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55940a87-8646-438b-834e-84123e7ed76c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:08.565907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55940a87-8646-438b-834e-84123e7ed76c None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:08.567274 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 583/1154] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:53:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:53:08.573034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580d495-0e5a-43ca-8e5a-006124801391 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:08.573433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580d495-0e5a-43ca-8e5a-006124801391 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:08.573596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d580d495-0e5a-43ca-8e5a-006124801391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:08.590458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d580d495-0e5a-43ca-8e5a-006124801391 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:53:08.591641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d580d495-0e5a-43ca-8e5a-006124801391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:53:08.655414 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 572/1155] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:53:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:53:08.678725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55940a87-8646-438b-834e-84123e7ed76c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:08.779685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55940a87-8646-438b-834e-84123e7ed76c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:08.788400 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:08.813151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7d9fd-8680-4a84-b383-2304501c06ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:08.813962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7d9fd-8680-4a84-b383-2304501c06ae None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:08.814272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7d9fd-8680-4a84-b383-2304501c06ae None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:08.814548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7d9fd-8680-4a84-b383-2304501c06ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:08.825166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7d9fd-8680-4a84-b383-2304501c06ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:53:08.832996 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-2fe7d9fd-8680-4a84-b383-2304501c06ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:53:08.832996 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:53:08.832996 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:53:08.832996 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:53:08.832996 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:53:08.832996 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:53:08.832996 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:53:08.832996 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:53:08.832996 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:53:08.832996 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:53:08.832996 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:53:08.832996 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:53:08.832996 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:53:08.832996 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:53:08.832996 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:53:08.832996 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:53:08.834155 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:53:08.834155 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:53:08.834155 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:53:08.834155 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:53:08.834155 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:53:08.834155 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:53:08.834155 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:53:08.834155 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:53:08.834155 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:53:08.834155 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:53:08.834155 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:53:08.834155 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:53:08.834155 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:53:08.834155 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:53:08.834155 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:53:08.834155 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:53:08.835054 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:53:08.835054 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:53:08.835054 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:53:08.835054 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:53:08.835054 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:53:08.835054 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:53:08.835054 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:53:08.835054 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:53:08.835054 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:53:08.835054 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:53:08.835054 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:53:08.835054 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:53:08.835054 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 584/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:53:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:53:08.840379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580d495-0e5a-43ca-8e5a-006124801391 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:08.896703 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:08.937085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d580d495-0e5a-43ca-8e5a-006124801391 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:08.970340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b851532-c712-4057-871a-8fe4e57205b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:08.970999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b851532-c712-4057-871a-8fe4e57205b0 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:08.971285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b851532-c712-4057-871a-8fe4e57205b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:08.971566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b851532-c712-4057-871a-8fe4e57205b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:08.972319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b851532-c712-4057-871a-8fe4e57205b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:53:08.972626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b851532-c712-4057-871a-8fe4e57205b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:08.973976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b851532-c712-4057-871a-8fe4e57205b0 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:08.982539 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 573/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:53:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:08.988221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7d9fd-8680-4a84-b383-2304501c06ae None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:09.085841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7d9fd-8680-4a84-b383-2304501c06ae None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:09.119354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d725124-dbdc-4654-a659-154ad93fd525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:09.120207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d725124-dbdc-4654-a659-154ad93fd525 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:09.120491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d725124-dbdc-4654-a659-154ad93fd525 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:09.120766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d725124-dbdc-4654-a659-154ad93fd525 None admin] PATH_INFO: `/v3/users/4c81937063434784a33f2e72fcc2cf62` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:09.121918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d725124-dbdc-4654-a659-154ad93fd525 None admin] RBAC: Authorizing `identity:get_user(user_id=4c81937063434784a33f2e72fcc2cf62)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:09.123362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d725124-dbdc-4654-a659-154ad93fd525 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:09.124953 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 585/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:53:08 2022] GET /identity/v3/users/4c81937063434784a33f2e72fcc2cf62 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:09.130697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b851532-c712-4057-871a-8fe4e57205b0 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:09.229850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b851532-c712-4057-871a-8fe4e57205b0 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:09.251238 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:09.262586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cc0a0-4ed1-4f08-a894-41e3375d9b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:09.263231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cc0a0-4ed1-4f08-a894-41e3375d9b48 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:09.263514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cc0a0-4ed1-4f08-a894-41e3375d9b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:09.263792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cc0a0-4ed1-4f08-a894-41e3375d9b48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:09.329477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cc0a0-4ed1-4f08-a894-41e3375d9b48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:09.330934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cc0a0-4ed1-4f08-a894-41e3375d9b48 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:09.425096 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 574/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:53:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 13:53:09.431256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d725124-dbdc-4654-a659-154ad93fd525 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:09.466384 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:09.528552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d725124-dbdc-4654-a659-154ad93fd525 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:09.561048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2456b17-9c99-46bf-9eff-65ff08e0c1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:09.561892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2456b17-9c99-46bf-9eff-65ff08e0c1be None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:09.562197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2456b17-9c99-46bf-9eff-65ff08e0c1be None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:09.562472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2456b17-9c99-46bf-9eff-65ff08e0c1be None admin] PATH_INFO: `/v3/projects/dd413e5a62144aebaa9111a3eadbfa33` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:09.563627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2456b17-9c99-46bf-9eff-65ff08e0c1be None admin] RBAC: Authorizing `identity:get_project(project_id=dd413e5a62144aebaa9111a3eadbfa33)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:09.565037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2456b17-9c99-46bf-9eff-65ff08e0c1be None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:09.566991 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 586/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:53:09 2022] GET /identity/v3/projects/dd413e5a62144aebaa9111a3eadbfa33 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:09.573754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cc0a0-4ed1-4f08-a894-41e3375d9b48 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:09.596632 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:09.670316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cc0a0-4ed1-4f08-a894-41e3375d9b48 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:09.703973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f38eea4-9af6-4aad-b070-e599cdcb1bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:09.704563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38eea4-9af6-4aad-b070-e599cdcb1bcb None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:09.704854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38eea4-9af6-4aad-b070-e599cdcb1bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:09.705133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38eea4-9af6-4aad-b070-e599cdcb1bcb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:09.705958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f38eea4-9af6-4aad-b070-e599cdcb1bcb None admin] RBAC: Adding query filter params (role.id=bc315edf089d43b18acf9790031f3fcb, scope.project.id=dd413e5a62144aebaa9111a3eadbfa33, user.id=4c81937063434784a33f2e72fcc2cf62) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:53:09.706303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f38eea4-9af6-4aad-b070-e599cdcb1bcb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:09.707719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f38eea4-9af6-4aad-b070-e599cdcb1bcb None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:09.713558 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 575/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:53:09 2022] GET /identity/v3/role_assignments?user.id=4c81937063434784a33f2e72fcc2cf62&scope.project.id=dd413e5a62144aebaa9111a3eadbfa33&role.id=bc315edf089d43b18acf9790031f3fcb => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:11.734991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e242ad-55e3-491c-b18a-30124dde60e6 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:11.735507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e242ad-55e3-491c-b18a-30124dde60e6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:11.735627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e242ad-55e3-491c-b18a-30124dde60e6 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:11.736897 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 587/1162] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:53:11.741982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31603d-732b-4f48-845f-c373405edd98 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:11.743141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31603d-732b-4f48-845f-c373405edd98 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:11.743255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31603d-732b-4f48-845f-c373405edd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:11.759589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7c31603d-732b-4f48-845f-c373405edd98 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:53:11.760773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7c31603d-732b-4f48-845f-c373405edd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:53:11.825437 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 576/1163] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:53:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:53:11.848102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e242ad-55e3-491c-b18a-30124dde60e6 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:11.947114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e242ad-55e3-491c-b18a-30124dde60e6 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:11.949347 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:11.979077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfc837-056c-4ef8-b947-f22b75ba38f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:11.979725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfc837-056c-4ef8-b947-f22b75ba38f2 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:11.980008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfc837-056c-4ef8-b947-f22b75ba38f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:11.980283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdfc837-056c-4ef8-b947-f22b75ba38f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:12.045399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfc837-056c-4ef8-b947-f22b75ba38f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:12.046808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdfc837-056c-4ef8-b947-f22b75ba38f2 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:12.142198 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 588/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:53:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 13:53:12.148101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31603d-732b-4f48-845f-c373405edd98 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:12.165654 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:12.247859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31603d-732b-4f48-845f-c373405edd98 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:12.280342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa54adb-2d7f-4110-8ffc-c24bb8e2fb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:12.281135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa54adb-2d7f-4110-8ffc-c24bb8e2fb81 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:12.281419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa54adb-2d7f-4110-8ffc-c24bb8e2fb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:12.281692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa54adb-2d7f-4110-8ffc-c24bb8e2fb81 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:12.288204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa54adb-2d7f-4110-8ffc-c24bb8e2fb81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:12.290709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa54adb-2d7f-4110-8ffc-c24bb8e2fb81 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:12.304389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-dfa54adb-2d7f-4110-8ffc-c24bb8e2fb81 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 19 13:53:12.304389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:53:12.304389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 13:53:12.304389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 13:53:12.304389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:53:12.304389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:53:12.304389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:53:12.304389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:53:12.304389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 19 13:53:12.304389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:53:12.304389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:53:12.304389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:53:12.304389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:53:12.304389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:53:12.304389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:53:12.304389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:53:12.304389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:53:12.306266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:53:12.306266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:53:12.306266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:53:12.306266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:53:12.306266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:53:12.306266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:53:12.306266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:53:12.306266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:53:12.306266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:53:12.306266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:53:12.306266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:53:12.306266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:53:12.306266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:53:12.306266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:53:12.306266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:53:12.306266 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:53:12.307358 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:53:12.307358 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:53:12.307358 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:53:12.307358 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:53:12.307358 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:53:12.307358 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:53:12.307358 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:53:12.307358 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:53:12.307358 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:53:12.307358 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:53:12.307358 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 13:53:12.307358 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:53:12.307358 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 19 13:53:12.307358 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:53:12.307358 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 577/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jul 19 13:53:12 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:53:12.312365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfc837-056c-4ef8-b947-f22b75ba38f2 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:12.315509 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:12.409719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdfc837-056c-4ef8-b947-f22b75ba38f2 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:12.441339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06652e21-63c5-425c-8c2e-58be254ba1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:12.441983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06652e21-63c5-425c-8c2e-58be254ba1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:12.442292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06652e21-63c5-425c-8c2e-58be254ba1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:12.442570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06652e21-63c5-425c-8c2e-58be254ba1a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:12.443280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06652e21-63c5-425c-8c2e-58be254ba1a2 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:53:12.443579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06652e21-63c5-425c-8c2e-58be254ba1a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:12.444919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06652e21-63c5-425c-8c2e-58be254ba1a2 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:12.452457 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 589/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Tue Jul 19 13:53:12 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:14.503888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db0d5b-a3ea-4489-95c1-2905a401fad5 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:14.504384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db0d5b-a3ea-4489-95c1-2905a401fad5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:14.504384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db0d5b-a3ea-4489-95c1-2905a401fad5 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:14.505731 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 578/1167] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:53:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:53:14.511268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42916f-3a93-4b08-9146-9f303a16758d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:14.511649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42916f-3a93-4b08-9146-9f303a16758d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:14.511833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42916f-3a93-4b08-9146-9f303a16758d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:14.528738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6b42916f-3a93-4b08-9146-9f303a16758d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:53:14.529898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6b42916f-3a93-4b08-9146-9f303a16758d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:53:14.590662 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:14.595711 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 590/1168] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:53:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:53:14.620445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db0d5b-a3ea-4489-95c1-2905a401fad5 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:14.696970 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:14.720230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db0d5b-a3ea-4489-95c1-2905a401fad5 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:14.753024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47f6cf-3420-4bcd-b4b3-77ed228a13e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:14.753675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47f6cf-3420-4bcd-b4b3-77ed228a13e5 None admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:14.754012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47f6cf-3420-4bcd-b4b3-77ed228a13e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:14.754275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47f6cf-3420-4bcd-b4b3-77ed228a13e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:14.755026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47f6cf-3420-4bcd-b4b3-77ed228a13e5 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:14.756383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47f6cf-3420-4bcd-b4b3-77ed228a13e5 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:14.803595 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 579/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Tue Jul 19 13:53:14 2022] POST /identity/v3/domains => generated 267 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:53:16.864262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcb0c3-4046-4950-8e5f-20353c0ab90b None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:16.864790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcb0c3-4046-4950-8e5f-20353c0ab90b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:16.864790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fcb0c3-4046-4950-8e5f-20353c0ab90b None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:16.866199 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 591/1170] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:53:16.872098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547faed-c6d2-4832-a295-5d2eaa9c2fc9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:16.872494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547faed-c6d2-4832-a295-5d2eaa9c2fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:16.872653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c547faed-c6d2-4832-a295-5d2eaa9c2fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:16.889642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c547faed-c6d2-4832-a295-5d2eaa9c2fc9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:53:16.890844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c547faed-c6d2-4832-a295-5d2eaa9c2fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:53:16.955838 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 580/1171] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:53:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:53:16.979584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcb0c3-4046-4950-8e5f-20353c0ab90b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:17.077172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fcb0c3-4046-4950-8e5f-20353c0ab90b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:17.109717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e93651-cd1c-4b43-b8a7-f9c67a6d18d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:17.110586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e93651-cd1c-4b43-b8a7-f9c67a6d18d4 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:17.110868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e93651-cd1c-4b43-b8a7-f9c67a6d18d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:17.111140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e93651-cd1c-4b43-b8a7-f9c67a6d18d4 None admin] PATH_INFO: `/v3/domains/1ee3e13ab8c8454fbb10ede487223d7e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:17.121861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e93651-cd1c-4b43-b8a7-f9c67a6d18d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1ee3e13ab8c8454fbb10ede487223d7e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:17.123299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e93651-cd1c-4b43-b8a7-f9c67a6d18d4 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:17.124910 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 592/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Tue Jul 19 13:53:16 2022] GET /identity/v3/domains/1ee3e13ab8c8454fbb10ede487223d7e => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:17.130712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547faed-c6d2-4832-a295-5d2eaa9c2fc9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:17.194224 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:17.229377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c547faed-c6d2-4832-a295-5d2eaa9c2fc9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:17.262464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95e618-8701-4422-a265-fd0cd579d0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:17.263125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95e618-8701-4422-a265-fd0cd579d0cc None admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:17.263414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95e618-8701-4422-a265-fd0cd579d0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:17.263692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95e618-8701-4422-a265-fd0cd579d0cc None admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:17.264407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95e618-8701-4422-a265-fd0cd579d0cc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:17.265821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95e618-8701-4422-a265-fd0cd579d0cc None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:17.328351 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 581/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 19 13:53:17 2022] POST /identity/v3/projects => generated 361 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:53:19.390644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e61b94-7b1e-4c6c-8782-58f2dad38435 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:19.391189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e61b94-7b1e-4c6c-8782-58f2dad38435 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:19.391189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e61b94-7b1e-4c6c-8782-58f2dad38435 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:19.392544 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 593/1174] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:53:19.397631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e90015-03bf-413b-b89f-0d9aaadf736c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:19.398009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e90015-03bf-413b-b89f-0d9aaadf736c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:19.398218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e90015-03bf-413b-b89f-0d9aaadf736c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:19.415858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-30e90015-03bf-413b-b89f-0d9aaadf736c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:53:19.417043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-30e90015-03bf-413b-b89f-0d9aaadf736c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:53:19.483035 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 582/1175] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:53:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 13:53:19.507200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e61b94-7b1e-4c6c-8782-58f2dad38435 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:19.565554 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:19.607542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e61b94-7b1e-4c6c-8782-58f2dad38435 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:19.639561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a13324-afb8-4ffd-905b-0cbfd67b43a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:19.640407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a13324-afb8-4ffd-905b-0cbfd67b43a3 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:19.640709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a13324-afb8-4ffd-905b-0cbfd67b43a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:19.640968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a13324-afb8-4ffd-905b-0cbfd67b43a3 None admin] PATH_INFO: `/v3/domains/1ee3e13ab8c8454fbb10ede487223d7e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:19.642156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a13324-afb8-4ffd-905b-0cbfd67b43a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1ee3e13ab8c8454fbb10ede487223d7e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:19.643583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a13324-afb8-4ffd-905b-0cbfd67b43a3 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:19.645187 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 594/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Tue Jul 19 13:53:19 2022] GET /identity/v3/domains/1ee3e13ab8c8454fbb10ede487223d7e => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:19.651585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e90015-03bf-413b-b89f-0d9aaadf736c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:19.698876 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:19.748122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e90015-03bf-413b-b89f-0d9aaadf736c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:19.781905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5a3fa7-f994-40a4-a74a-3c0980ffb442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:19.782599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a3fa7-f994-40a4-a74a-3c0980ffb442 None admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:19.782889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a3fa7-f994-40a4-a74a-3c0980ffb442 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:19.783170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5a3fa7-f994-40a4-a74a-3c0980ffb442 None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:19.783880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a3fa7-f994-40a4-a74a-3c0980ffb442 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:19.785298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5a3fa7-f994-40a4-a74a-3c0980ffb442 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:19.864899 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 583/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 19 13:53:19 2022] POST /identity/v3/users => generated 311 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:53:21.938933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001ddd9-128a-420d-bb1f-af8699255969 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:21.939530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001ddd9-128a-420d-bb1f-af8699255969 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:21.939530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3001ddd9-128a-420d-bb1f-af8699255969 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:21.940860 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 595/1178] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:53:21.946825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb1850-ad95-41be-8653-c5e18bf8b7ab None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:21.947222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb1850-ad95-41be-8653-c5e18bf8b7ab None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:21.947388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb1850-ad95-41be-8653-c5e18bf8b7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:21.964341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b5bb1850-ad95-41be-8653-c5e18bf8b7ab None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:53:21.965515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b5bb1850-ad95-41be-8653-c5e18bf8b7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:53:22.029950 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 584/1179] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:53:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:53:22.053067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001ddd9-128a-420d-bb1f-af8699255969 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:22.153054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3001ddd9-128a-420d-bb1f-af8699255969 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:22.177953 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:22.186872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f0661-c803-4480-8d92-87588a891e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:22.187655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f0661-c803-4480-8d92-87588a891e1c None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:22.187939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f0661-c803-4480-8d92-87588a891e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:22.188215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f0661-c803-4480-8d92-87588a891e1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:22.198545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7f0661-c803-4480-8d92-87588a891e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:53:22.206292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-fb7f0661-c803-4480-8d92-87588a891e1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:53:22.206292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:53:22.206292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:53:22.206292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:53:22.206292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:53:22.206292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:53:22.206292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:53:22.206292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:53:22.206292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:53:22.206292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:53:22.206292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:53:22.206292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:53:22.206292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:53:22.206292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:53:22.206292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:53:22.206292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:53:22.207519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:53:22.207519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:53:22.207519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:53:22.207519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:53:22.207519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:53:22.207519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:53:22.207519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:53:22.207519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:53:22.207519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:53:22.207519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:53:22.207519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:53:22.207519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:53:22.207519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:53:22.207519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:53:22.207519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:53:22.207519 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:53:22.208516 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:53:22.208516 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:53:22.208516 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:53:22.208516 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:53:22.208516 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:53:22.208516 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:53:22.208516 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:53:22.208516 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:53:22.208516 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:53:22.208516 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:53:22.208516 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:53:22.208516 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:53:22.208516 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 596/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:53:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:53:22.213759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb1850-ad95-41be-8653-c5e18bf8b7ab None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:22.247718 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:22.311410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb1850-ad95-41be-8653-c5e18bf8b7ab None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:22.345131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e8ea0-a050-49df-b8b6-2a85b47e64be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:22.345794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e8ea0-a050-49df-b8b6-2a85b47e64be None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:22.346081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e8ea0-a050-49df-b8b6-2a85b47e64be None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:22.346455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e8ea0-a050-49df-b8b6-2a85b47e64be None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:22.347211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e8ea0-a050-49df-b8b6-2a85b47e64be None admin] RBAC: Adding query filter params (name=admin) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:53:22.347519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e8ea0-a050-49df-b8b6-2a85b47e64be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:22.348872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e8ea0-a050-49df-b8b6-2a85b47e64be None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:22.357047 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 585/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:53:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:22.362843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f0661-c803-4480-8d92-87588a891e1c None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:22.461318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f0661-c803-4480-8d92-87588a891e1c None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:22.493685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f36615-5687-4dea-a163-3b34c1de1d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:22.494564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f36615-5687-4dea-a163-3b34c1de1d58 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:22.494852 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f36615-5687-4dea-a163-3b34c1de1d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:22.495131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f36615-5687-4dea-a163-3b34c1de1d58 None admin] PATH_INFO: `/v3/users/42c54aa1b42f4ffe8db06aa86d2c8dac` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:22.507694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f36615-5687-4dea-a163-3b34c1de1d58 None admin] RBAC: Authorizing `identity:get_user(user_id=42c54aa1b42f4ffe8db06aa86d2c8dac)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:22.509808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f36615-5687-4dea-a163-3b34c1de1d58 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:22.511480 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 597/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:53:22 2022] GET /identity/v3/users/42c54aa1b42f4ffe8db06aa86d2c8dac => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:22.517241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e8ea0-a050-49df-b8b6-2a85b47e64be None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:22.608838 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:22.614422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e8ea0-a050-49df-b8b6-2a85b47e64be None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:22.647269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7836de2-cfe7-467d-b0c4-d345fb044ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:22.647906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7836de2-cfe7-467d-b0c4-d345fb044ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:22.648192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7836de2-cfe7-467d-b0c4-d345fb044ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:22.648519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7836de2-cfe7-467d-b0c4-d345fb044ff4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:22.713893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7836de2-cfe7-467d-b0c4-d345fb044ff4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:22.715302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7836de2-cfe7-467d-b0c4-d345fb044ff4 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:22.802517 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:22.808646 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 586/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:53:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 13:53:22.814525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f36615-5687-4dea-a163-3b34c1de1d58 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:22.859789 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:22.912117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f36615-5687-4dea-a163-3b34c1de1d58 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:22.946483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fdd9d-d7ed-40d1-8e47-b5f4004b153e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:22.947325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fdd9d-d7ed-40d1-8e47-b5f4004b153e None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:22.947604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fdd9d-d7ed-40d1-8e47-b5f4004b153e None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:22.947881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fdd9d-d7ed-40d1-8e47-b5f4004b153e None admin] PATH_INFO: `/v3/projects/32bb71085bb1482f8438ac863662d7e0` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:22.949050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fdd9d-d7ed-40d1-8e47-b5f4004b153e None admin] RBAC: Authorizing `identity:get_project(project_id=32bb71085bb1482f8438ac863662d7e0)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:22.950500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fdd9d-d7ed-40d1-8e47-b5f4004b153e None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:22.952184 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 598/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:53:22 2022] GET /identity/v3/projects/32bb71085bb1482f8438ac863662d7e0 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:22.958285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7836de2-cfe7-467d-b0c4-d345fb044ff4 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:23.053117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7836de2-cfe7-467d-b0c4-d345fb044ff4 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:23.086782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b8db53-d13f-4cb3-b1b5-c1fd5c8afe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:23.087413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8db53-d13f-4cb3-b1b5-c1fd5c8afe7c None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:23.087694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8db53-d13f-4cb3-b1b5-c1fd5c8afe7c None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:23.087970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b8db53-d13f-4cb3-b1b5-c1fd5c8afe7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:23.088785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8db53-d13f-4cb3-b1b5-c1fd5c8afe7c None admin] RBAC: Adding query filter params (role.id=bc315edf089d43b18acf9790031f3fcb, scope.project.id=32bb71085bb1482f8438ac863662d7e0, user.id=42c54aa1b42f4ffe8db06aa86d2c8dac) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:53:23.089097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8db53-d13f-4cb3-b1b5-c1fd5c8afe7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:23.090531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b8db53-d13f-4cb3-b1b5-c1fd5c8afe7c None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:23.095762 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 587/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:53:22 2022] GET /identity/v3/role_assignments?user.id=42c54aa1b42f4ffe8db06aa86d2c8dac&scope.project.id=32bb71085bb1482f8438ac863662d7e0&role.id=bc315edf089d43b18acf9790031f3fcb => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:53:25.077959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df27148-88ee-418d-b126-88ba16fb7eaf None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:25.078545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df27148-88ee-418d-b126-88ba16fb7eaf None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:25.078545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df27148-88ee-418d-b126-88ba16fb7eaf None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:25.079914 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 599/1186] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:53:25.085104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45463438-0cf8-4b68-8b81-166d588a5477 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:25.085521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45463438-0cf8-4b68-8b81-166d588a5477 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:25.085655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45463438-0cf8-4b68-8b81-166d588a5477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:25.102519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-45463438-0cf8-4b68-8b81-166d588a5477 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:53:25.103670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-45463438-0cf8-4b68-8b81-166d588a5477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:53:25.157484 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:25.168813 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 588/1187] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:53:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 13:53:25.192582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df27148-88ee-418d-b126-88ba16fb7eaf None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:25.293060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df27148-88ee-418d-b126-88ba16fb7eaf None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:25.305893 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:25.326077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc740dd-0ed6-47c2-bfce-4caba535eb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:25.326887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc740dd-0ed6-47c2-bfce-4caba535eb4f None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:25.327173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc740dd-0ed6-47c2-bfce-4caba535eb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:25.327450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc740dd-0ed6-47c2-bfce-4caba535eb4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:25.337948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc740dd-0ed6-47c2-bfce-4caba535eb4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:53:25.346208 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-9bc740dd-0ed6-47c2-bfce-4caba535eb4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:53:25.346208 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:53:25.346208 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:53:25.346208 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:53:25.346208 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:53:25.346208 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:53:25.346208 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:53:25.346208 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:53:25.346208 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:53:25.346208 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:53:25.346208 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:53:25.346208 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:53:25.346208 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:53:25.346208 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:53:25.346208 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:53:25.346208 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:53:25.347280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:53:25.347280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:53:25.347280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:53:25.347280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:53:25.347280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:53:25.347280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:53:25.347280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:53:25.347280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:53:25.347280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:53:25.347280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:53:25.347280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:53:25.347280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:53:25.347280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:53:25.347280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:53:25.347280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:53:25.347280 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:53:25.348157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:53:25.348157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:53:25.348157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:53:25.348157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:53:25.348157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:53:25.348157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:53:25.348157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:53:25.348157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:53:25.348157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:53:25.348157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:53:25.348157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:53:25.348157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:53:25.348157 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 600/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:53:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:53:25.354061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45463438-0cf8-4b68-8b81-166d588a5477 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:25.450164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45463438-0cf8-4b68-8b81-166d588a5477 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:25.483950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739eb0ce-d7d3-4260-be2b-71a60bb58a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:25.484609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eb0ce-d7d3-4260-be2b-71a60bb58a38 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:25.484897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eb0ce-d7d3-4260-be2b-71a60bb58a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:25.485178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739eb0ce-d7d3-4260-be2b-71a60bb58a38 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:25.485926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739eb0ce-d7d3-4260-be2b-71a60bb58a38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:53:25.486264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739eb0ce-d7d3-4260-be2b-71a60bb58a38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:25.487623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739eb0ce-d7d3-4260-be2b-71a60bb58a38 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:25.495901 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 589/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:53:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:25.501474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc740dd-0ed6-47c2-bfce-4caba535eb4f None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:25.599495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc740dd-0ed6-47c2-bfce-4caba535eb4f None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:25.632153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16335452-6863-49e0-ad4d-0d2c6aab3880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:25.633065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16335452-6863-49e0-ad4d-0d2c6aab3880 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:25.633427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16335452-6863-49e0-ad4d-0d2c6aab3880 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:25.633633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16335452-6863-49e0-ad4d-0d2c6aab3880 None admin] PATH_INFO: `/v3/users/42c54aa1b42f4ffe8db06aa86d2c8dac` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:25.634801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16335452-6863-49e0-ad4d-0d2c6aab3880 None admin] RBAC: Authorizing `identity:get_user(user_id=42c54aa1b42f4ffe8db06aa86d2c8dac)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:25.636221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16335452-6863-49e0-ad4d-0d2c6aab3880 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:25.637819 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 601/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:53:25 2022] GET /identity/v3/users/42c54aa1b42f4ffe8db06aa86d2c8dac => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:25.643622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739eb0ce-d7d3-4260-be2b-71a60bb58a38 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:25.696647 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:25.741848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739eb0ce-d7d3-4260-be2b-71a60bb58a38 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:25.776340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c336b05-6c8b-4768-8fd1-f4888ba02806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:25.777217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c336b05-6c8b-4768-8fd1-f4888ba02806 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:25.777500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c336b05-6c8b-4768-8fd1-f4888ba02806 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:25.777775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c336b05-6c8b-4768-8fd1-f4888ba02806 None admin] PATH_INFO: `/v3/projects/32bb71085bb1482f8438ac863662d7e0` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:25.778970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c336b05-6c8b-4768-8fd1-f4888ba02806 None admin] RBAC: Authorizing `identity:get_project(project_id=32bb71085bb1482f8438ac863662d7e0)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:25.780379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c336b05-6c8b-4768-8fd1-f4888ba02806 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:25.782068 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 590/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:53:25 2022] GET /identity/v3/projects/32bb71085bb1482f8438ac863662d7e0 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:25.787902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16335452-6863-49e0-ad4d-0d2c6aab3880 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:25.830166 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:25.890594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16335452-6863-49e0-ad4d-0d2c6aab3880 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:25.923104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca90a01-ed5b-474b-b408-6903c1f7bf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:25.923981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca90a01-ed5b-474b-b408-6903c1f7bf1a None admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:25.924261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca90a01-ed5b-474b-b408-6903c1f7bf1a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:25.924532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca90a01-ed5b-474b-b408-6903c1f7bf1a None admin] PATH_INFO: `/v3/projects/32bb71085bb1482f8438ac863662d7e0/users/42c54aa1b42f4ffe8db06aa86d2c8dac/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:25.926494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca90a01-ed5b-474b-b408-6903c1f7bf1a None admin] RBAC: Authorizing `identity:create_grant(project_id=32bb71085bb1482f8438ac863662d7e0, user_id=42c54aa1b42f4ffe8db06aa86d2c8dac, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:25.927913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca90a01-ed5b-474b-b408-6903c1f7bf1a None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:26.031306 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 602/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:53:25 2022] PUT /identity/v3/projects/32bb71085bb1482f8438ac863662d7e0/users/42c54aa1b42f4ffe8db06aa86d2c8dac/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:53:28.031026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012195c-b4e7-4b5f-8376-43e3e20e120c None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:28.031591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012195c-b4e7-4b5f-8376-43e3e20e120c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:28.031591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012195c-b4e7-4b5f-8376-43e3e20e120c None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:28.032928 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 591/1193] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:53:28.037972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e3cdc-cdd3-4aee-80aa-a8b1c90a3b03 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:28.038434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e3cdc-cdd3-4aee-80aa-a8b1c90a3b03 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:28.038573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e3cdc-cdd3-4aee-80aa-a8b1c90a3b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:28.056292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e06e3cdc-cdd3-4aee-80aa-a8b1c90a3b03 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:53:28.057477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e06e3cdc-cdd3-4aee-80aa-a8b1c90a3b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:53:28.123992 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 603/1194] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:53:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:53:28.147692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012195c-b4e7-4b5f-8376-43e3e20e120c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:28.246498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012195c-b4e7-4b5f-8376-43e3e20e120c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:28.265313 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:28.278922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc966ffb-5943-40a5-a622-2981169713c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:28.279750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc966ffb-5943-40a5-a622-2981169713c7 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:28.280032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc966ffb-5943-40a5-a622-2981169713c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:28.280303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc966ffb-5943-40a5-a622-2981169713c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:28.290985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc966ffb-5943-40a5-a622-2981169713c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:53:28.298571 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-fc966ffb-5943-40a5-a622-2981169713c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:53:28.298571 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:53:28.298571 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:53:28.298571 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:53:28.298571 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:53:28.298571 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:53:28.298571 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:53:28.298571 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:53:28.298571 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:53:28.298571 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:53:28.298571 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:53:28.298571 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:53:28.298571 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:53:28.298571 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:53:28.298571 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:53:28.298571 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:53:28.299689 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:53:28.299689 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:53:28.299689 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:53:28.299689 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:53:28.299689 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:53:28.299689 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:53:28.299689 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:53:28.299689 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:53:28.299689 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:53:28.299689 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:53:28.299689 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:53:28.299689 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:53:28.299689 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:53:28.299689 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:53:28.299689 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:53:28.299689 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:53:28.300912 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:53:28.300912 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:53:28.300912 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:53:28.300912 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:53:28.300912 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:53:28.300912 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:53:28.300912 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:53:28.300912 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:53:28.300912 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:53:28.300912 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:53:28.300912 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:53:28.300912 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:53:28.300912 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 592/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:53:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:53:28.306085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e3cdc-cdd3-4aee-80aa-a8b1c90a3b03 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:28.335380 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:28.403170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e3cdc-cdd3-4aee-80aa-a8b1c90a3b03 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:28.436045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a1ef4-f039-4d2b-8ddb-c22c53f95d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:28.436700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a1ef4-f039-4d2b-8ddb-c22c53f95d9b None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:28.436985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a1ef4-f039-4d2b-8ddb-c22c53f95d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:28.437260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a1ef4-f039-4d2b-8ddb-c22c53f95d9b None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:28.438000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a1ef4-f039-4d2b-8ddb-c22c53f95d9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:53:28.438336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a1ef4-f039-4d2b-8ddb-c22c53f95d9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:28.439703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707a1ef4-f039-4d2b-8ddb-c22c53f95d9b None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:28.448000 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 604/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:53:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:53:28.453711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc966ffb-5943-40a5-a622-2981169713c7 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:28.551928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc966ffb-5943-40a5-a622-2981169713c7 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:28.584222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb21066-5a7d-4083-9ce8-0f53afcb40bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:28.585073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb21066-5a7d-4083-9ce8-0f53afcb40bf None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:28.585355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb21066-5a7d-4083-9ce8-0f53afcb40bf None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:28.585631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb21066-5a7d-4083-9ce8-0f53afcb40bf None admin] PATH_INFO: `/v3/users/42c54aa1b42f4ffe8db06aa86d2c8dac` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:28.587860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb21066-5a7d-4083-9ce8-0f53afcb40bf None admin] RBAC: Authorizing `identity:get_user(user_id=42c54aa1b42f4ffe8db06aa86d2c8dac)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:28.589266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb21066-5a7d-4083-9ce8-0f53afcb40bf None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:28.590885 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 593/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Tue Jul 19 13:53:28 2022] GET /identity/v3/users/42c54aa1b42f4ffe8db06aa86d2c8dac => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:28.596410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a1ef4-f039-4d2b-8ddb-c22c53f95d9b None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:28.686196 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:28.694691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a1ef4-f039-4d2b-8ddb-c22c53f95d9b None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:28.729306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337b1b7-2cba-48e0-90a7-3afab001bf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:28.729941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337b1b7-2cba-48e0-90a7-3afab001bf45 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:28.730250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337b1b7-2cba-48e0-90a7-3afab001bf45 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:28.730522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337b1b7-2cba-48e0-90a7-3afab001bf45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:28.795712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337b1b7-2cba-48e0-90a7-3afab001bf45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:28.797143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337b1b7-2cba-48e0-90a7-3afab001bf45 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:28.881832 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:28.891158 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 605/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:53:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 13:53:28.897006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb21066-5a7d-4083-9ce8-0f53afcb40bf None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:28.945169 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:28.995971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb21066-5a7d-4083-9ce8-0f53afcb40bf None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:29.029363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af5e09-ee2b-4bc3-81ec-99fd41517f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:29.030229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af5e09-ee2b-4bc3-81ec-99fd41517f92 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:29.030515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af5e09-ee2b-4bc3-81ec-99fd41517f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:29.030790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af5e09-ee2b-4bc3-81ec-99fd41517f92 None admin] PATH_INFO: `/v3/projects/32bb71085bb1482f8438ac863662d7e0` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:29.031936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af5e09-ee2b-4bc3-81ec-99fd41517f92 None admin] RBAC: Authorizing `identity:get_project(project_id=32bb71085bb1482f8438ac863662d7e0)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:29.033346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af5e09-ee2b-4bc3-81ec-99fd41517f92 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:29.035045 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 594/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Tue Jul 19 13:53:28 2022] GET /identity/v3/projects/32bb71085bb1482f8438ac863662d7e0 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:29.041694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337b1b7-2cba-48e0-90a7-3afab001bf45 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:53:29.139375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337b1b7-2cba-48e0-90a7-3afab001bf45 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:53:29.173624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626433f-d7b0-454d-9149-f3a32753273c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:53:29.174288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626433f-d7b0-454d-9149-f3a32753273c None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:53:29.174570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626433f-d7b0-454d-9149-f3a32753273c None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:53:29.174841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626433f-d7b0-454d-9149-f3a32753273c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:53:29.175659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626433f-d7b0-454d-9149-f3a32753273c None admin] RBAC: Adding query filter params (role.id=bc315edf089d43b18acf9790031f3fcb, scope.project.id=32bb71085bb1482f8438ac863662d7e0, user.id=42c54aa1b42f4ffe8db06aa86d2c8dac) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:53:29.175966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626433f-d7b0-454d-9149-f3a32753273c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:53:29.177370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626433f-d7b0-454d-9149-f3a32753273c None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:53:29.183532 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 606/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:53:29 2022] GET /identity/v3/role_assignments?user.id=42c54aa1b42f4ffe8db06aa86d2c8dac&scope.project.id=32bb71085bb1482f8438ac863662d7e0&role.id=bc315edf089d43b18acf9790031f3fcb => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:53:39.023698 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=42 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:53:39.180874 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=72 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:41.168246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e77bf6-618c-4ec0-a55e-6738ec34962d None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:41.168901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e77bf6-618c-4ec0-a55e-6738ec34962d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:41.168901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e77bf6-618c-4ec0-a55e-6738ec34962d None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:41.170478 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 595/1201] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:54:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:54:41.176031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d866071-7035-406b-8ffd-0dd33fefcf73 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:41.176471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d866071-7035-406b-8ffd-0dd33fefcf73 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:41.176573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d866071-7035-406b-8ffd-0dd33fefcf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:41.193519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5d866071-7035-406b-8ffd-0dd33fefcf73 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:54:41.194997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5d866071-7035-406b-8ffd-0dd33fefcf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:54:41.262457 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 607/1202] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:54:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:54:41.286964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e77bf6-618c-4ec0-a55e-6738ec34962d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:41.390883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e77bf6-618c-4ec0-a55e-6738ec34962d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:41.424164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90733a1-a106-441e-89f7-5e73ef877684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:41.424885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90733a1-a106-441e-89f7-5e73ef877684 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:41.425170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90733a1-a106-441e-89f7-5e73ef877684 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:41.425451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90733a1-a106-441e-89f7-5e73ef877684 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:41.435335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90733a1-a106-441e-89f7-5e73ef877684 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:41.438043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90733a1-a106-441e-89f7-5e73ef877684 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:41.457232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-c90733a1-a106-441e-89f7-5e73ef877684 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:54:41.457232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:54:41.457232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:54:41.457232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:54:41.457232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:54:41.457232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:54:41.457232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:54:41.457232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:54:41.457232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:54:41.457232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:54:41.457232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:54:41.457232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:54:41.457232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:54:41.457232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:54:41.457232 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:54:41.462030 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:54:41.462030 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:54:41.462030 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:54:41.462030 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:54:41.462030 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:54:41.462030 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:54:41.462030 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:54:41.462030 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:54:41.462030 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:54:41.462030 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:54:41.462030 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:54:41.462030 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:54:41.462030 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:54:41.462030 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:54:41.462030 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:54:41.462030 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:54:41.462030 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:54:41.465461 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:54:41.465461 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:54:41.465461 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:54:41.465461 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:54:41.465461 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 596/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:54:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:54:41.465840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d866071-7035-406b-8ffd-0dd33fefcf73 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:41.563288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d866071-7035-406b-8ffd-0dd33fefcf73 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:41.591071 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:41.597267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43eb64-a5c8-4e6a-9cf4-c58bd5c1a5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:41.597970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43eb64-a5c8-4e6a-9cf4-c58bd5c1a5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:41.598281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43eb64-a5c8-4e6a-9cf4-c58bd5c1a5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:41.598559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43eb64-a5c8-4e6a-9cf4-c58bd5c1a5a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:41.599272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43eb64-a5c8-4e6a-9cf4-c58bd5c1a5a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:41.599573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43eb64-a5c8-4e6a-9cf4-c58bd5c1a5a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:41.600918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb43eb64-a5c8-4e6a-9cf4-c58bd5c1a5a9 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:41.613269 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 608/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:54:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:54:41.617857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90733a1-a106-441e-89f7-5e73ef877684 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:41.671100 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:41.716188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90733a1-a106-441e-89f7-5e73ef877684 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:41.749075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5d9bc2-8d37-46c8-b9d6-b4cafaf243c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:41.749728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d9bc2-8d37-46c8-b9d6-b4cafaf243c8 None admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:41.750014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d9bc2-8d37-46c8-b9d6-b4cafaf243c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:41.750321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5d9bc2-8d37-46c8-b9d6-b4cafaf243c8 None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:41.751023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d9bc2-8d37-46c8-b9d6-b4cafaf243c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:41.752436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5d9bc2-8d37-46c8-b9d6-b4cafaf243c8 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:41.832963 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 597/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Tue Jul 19 13:54:41 2022] POST /identity/v3/users => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:54:43.908404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7a07c-8b47-405a-a4a7-9bbc04150e12 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:43.908959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7a07c-8b47-405a-a4a7-9bbc04150e12 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:43.909097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7a07c-8b47-405a-a4a7-9bbc04150e12 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:43.910394 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 609/1206] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:54:43.915561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78abdb-b4fb-49bc-ba72-bdcd9c1f0af4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:43.915932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78abdb-b4fb-49bc-ba72-bdcd9c1f0af4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:43.916126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78abdb-b4fb-49bc-ba72-bdcd9c1f0af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:43.933122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1a78abdb-b4fb-49bc-ba72-bdcd9c1f0af4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:54:43.934416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1a78abdb-b4fb-49bc-ba72-bdcd9c1f0af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:54:44.000541 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 598/1207] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:54:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:54:44.023686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7a07c-8b47-405a-a4a7-9bbc04150e12 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:44.128252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7a07c-8b47-405a-a4a7-9bbc04150e12 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:44.163025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1509fc-a127-4b89-8cc3-1614635364a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:44.163025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1509fc-a127-4b89-8cc3-1614635364a8 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:44.163025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1509fc-a127-4b89-8cc3-1614635364a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:44.163025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1509fc-a127-4b89-8cc3-1614635364a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:44.173457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1509fc-a127-4b89-8cc3-1614635364a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:54:44.181339 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-6d1509fc-a127-4b89-8cc3-1614635364a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:54:44.181339 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:54:44.181339 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:54:44.181339 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:54:44.181339 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:54:44.181339 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:54:44.181339 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:54:44.181339 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:54:44.181339 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:54:44.181339 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:54:44.181339 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:54:44.181339 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:54:44.181339 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:54:44.181339 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:54:44.181339 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:54:44.181339 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:54:44.182333 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:54:44.182333 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:54:44.182333 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:54:44.182333 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:54:44.182333 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:54:44.182333 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:54:44.182333 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:54:44.182333 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:54:44.182333 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:54:44.182333 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:54:44.182333 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:54:44.182333 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:54:44.182333 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:54:44.182333 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:54:44.182333 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:54:44.182333 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:54:44.183236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:54:44.183236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:54:44.183236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:54:44.183236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:54:44.183236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:54:44.183236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:54:44.183236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:54:44.183236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:54:44.183236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:54:44.183236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:54:44.183236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:54:44.183236 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:54:44.183236 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 610/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:54:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:54:44.188907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78abdb-b4fb-49bc-ba72-bdcd9c1f0af4 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:44.229201 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:44.286776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78abdb-b4fb-49bc-ba72-bdcd9c1f0af4 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:44.319761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02d43f-3ced-4f41-b4d2-e396a80a5e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:44.320424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02d43f-3ced-4f41-b4d2-e396a80a5e79 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:44.320708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02d43f-3ced-4f41-b4d2-e396a80a5e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:44.320984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02d43f-3ced-4f41-b4d2-e396a80a5e79 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:44.321728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02d43f-3ced-4f41-b4d2-e396a80a5e79 None admin] RBAC: Adding query filter params (name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:44.322037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02d43f-3ced-4f41-b4d2-e396a80a5e79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:44.323410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02d43f-3ced-4f41-b4d2-e396a80a5e79 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:44.331711 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 599/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 19 13:54:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:54:44.337511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1509fc-a127-4b89-8cc3-1614635364a8 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:44.387346 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:44.435638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1509fc-a127-4b89-8cc3-1614635364a8 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:44.469883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bbb09-a14c-4ef3-b694-50858666e0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:44.470696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bbb09-a14c-4ef3-b694-50858666e0ce None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:44.471012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bbb09-a14c-4ef3-b694-50858666e0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:44.471309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bbb09-a14c-4ef3-b694-50858666e0ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:44.481525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bbb09-a14c-4ef3-b694-50858666e0ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:44.483935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bbb09-a14c-4ef3-b694-50858666e0ce None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:44.501520 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-0f4bbb09-a14c-4ef3-b694-50858666e0ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:54:44.501520 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:54:44.501520 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:54:44.501520 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:54:44.501520 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:54:44.501520 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:54:44.501520 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:54:44.501520 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:54:44.501520 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:54:44.501520 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:54:44.501520 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:54:44.501520 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:54:44.501520 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:54:44.501520 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:54:44.501520 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:54:44.502632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:54:44.502632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:54:44.502632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:54:44.502632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:54:44.502632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:54:44.502632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:54:44.502632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:54:44.502632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:54:44.502632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:54:44.502632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:54:44.502632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:54:44.502632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:54:44.502632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:54:44.502632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:54:44.502632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:54:44.502632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:54:44.502632 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:54:44.503740 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:54:44.503740 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:54:44.503740 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:54:44.503740 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:54:44.503740 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 611/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:54:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:54:44.508610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02d43f-3ced-4f41-b4d2-e396a80a5e79 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:44.607832 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:44.611138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02d43f-3ced-4f41-b4d2-e396a80a5e79 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:44.643361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f3e48-9a54-4531-bed8-097b1ab851f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:44.644021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f3e48-9a54-4531-bed8-097b1ab851f5 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:44.644308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f3e48-9a54-4531-bed8-097b1ab851f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:44.644583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f3e48-9a54-4531-bed8-097b1ab851f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:44.645307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f3e48-9a54-4531-bed8-097b1ab851f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:44.645615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f3e48-9a54-4531-bed8-097b1ab851f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:44.647003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f3e48-9a54-4531-bed8-097b1ab851f5 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:44.658789 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 600/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:54:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:54:44.664602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bbb09-a14c-4ef3-b694-50858666e0ce None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:44.763601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bbb09-a14c-4ef3-b694-50858666e0ce None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:44.765101 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:44.798570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b01f1f-da9e-4b1c-a44f-ff2f6974f461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:44.799369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b01f1f-da9e-4b1c-a44f-ff2f6974f461 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:44.799648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b01f1f-da9e-4b1c-a44f-ff2f6974f461 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:44.799939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b01f1f-da9e-4b1c-a44f-ff2f6974f461 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:44.806983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b01f1f-da9e-4b1c-a44f-ff2f6974f461 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:44.808404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b01f1f-da9e-4b1c-a44f-ff2f6974f461 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:44.824396 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-54b01f1f-da9e-4b1c-a44f-ff2f6974f461 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 13:54:44.824396 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:54:44.824396 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:54:44.824396 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:54:44.824396 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:54:44.824396 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:54:44.824396 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:54:44.824396 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:54:44.824396 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:54:44.824396 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:54:44.824396 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:54:44.824396 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:54:44.824396 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:54:44.824396 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:54:44.824396 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:54:44.824396 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:54:44.825634 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:54:44.825634 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:54:44.825634 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:54:44.825634 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:54:44.825634 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:54:44.825634 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:54:44.825634 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:54:44.825634 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:54:44.825634 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:54:44.825634 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:54:44.825634 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:54:44.825634 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:54:44.825634 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:54:44.825634 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:54:44.825634 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:54:44.825634 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:54:44.825634 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:54:44.825634 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:54:44.827031 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:54:44.827031 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:54:44.827031 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:54:44.827031 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:54:44.827031 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:54:44.827031 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:54:44.827031 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:54:44.827031 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:54:44.827031 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 13:54:44.827031 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:54:44.827031 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 612/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:54:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:54:44.831579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f3e48-9a54-4531-bed8-097b1ab851f5 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:44.931374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f3e48-9a54-4531-bed8-097b1ab851f5 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:44.965366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1f6f6-b23e-49d5-8df0-5a58ce3d8ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:44.966028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1f6f6-b23e-49d5-8df0-5a58ce3d8ecb None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:44.966351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1f6f6-b23e-49d5-8df0-5a58ce3d8ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:44.966627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1f6f6-b23e-49d5-8df0-5a58ce3d8ecb None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:44.968554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1f6f6-b23e-49d5-8df0-5a58ce3d8ecb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:44.968950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1f6f6-b23e-49d5-8df0-5a58ce3d8ecb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:44.970598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1f6f6-b23e-49d5-8df0-5a58ce3d8ecb None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:44.989054 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 601/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Jul 19 13:54:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:54:44.994788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b01f1f-da9e-4b1c-a44f-ff2f6974f461 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:45.096066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b01f1f-da9e-4b1c-a44f-ff2f6974f461 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:45.129396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e3a58-0a2a-413a-8e20-6c7f1feda17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:45.130049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e3a58-0a2a-413a-8e20-6c7f1feda17a None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:45.130364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e3a58-0a2a-413a-8e20-6c7f1feda17a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:45.130643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e3a58-0a2a-413a-8e20-6c7f1feda17a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:45.160838 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:45.197460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e3a58-0a2a-413a-8e20-6c7f1feda17a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:45.198944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e3a58-0a2a-413a-8e20-6c7f1feda17a None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:45.296861 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 613/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:54:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 13:54:45.302764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1f6f6-b23e-49d5-8df0-5a58ce3d8ecb None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:45.321644 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:45.404612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1f6f6-b23e-49d5-8df0-5a58ce3d8ecb None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:45.437840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68380e-77fb-4059-b504-cb2f3fcfaa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:45.438646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68380e-77fb-4059-b504-cb2f3fcfaa09 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:45.438935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68380e-77fb-4059-b504-cb2f3fcfaa09 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:45.439212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68380e-77fb-4059-b504-cb2f3fcfaa09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:45.449135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68380e-77fb-4059-b504-cb2f3fcfaa09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:45.450588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68380e-77fb-4059-b504-cb2f3fcfaa09 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:45.468559 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-8f68380e-77fb-4059-b504-cb2f3fcfaa09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:54:45.468559 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:54:45.468559 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:54:45.468559 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:54:45.468559 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:54:45.468559 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:54:45.468559 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:54:45.468559 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:54:45.468559 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:54:45.468559 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:54:45.468559 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:54:45.468559 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:54:45.468559 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:54:45.468559 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:54:45.468559 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:54:45.469625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:54:45.469625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:54:45.469625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:54:45.469625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:54:45.469625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:54:45.469625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:54:45.469625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:54:45.469625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:54:45.469625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:54:45.469625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:54:45.469625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:54:45.469625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:54:45.469625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:54:45.469625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:54:45.469625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:54:45.469625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:54:45.469625 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:54:45.470789 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:54:45.470789 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:54:45.470789 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:54:45.470789 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:54:45.470789 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 602/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:54:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:54:45.475461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e3a58-0a2a-413a-8e20-6c7f1feda17a None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:45.536376 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:45.573472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e3a58-0a2a-413a-8e20-6c7f1feda17a None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:45.608948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861000e5-ecc0-41d5-a18c-bc4900392563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:45.609609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861000e5-ecc0-41d5-a18c-bc4900392563 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:45.609888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861000e5-ecc0-41d5-a18c-bc4900392563 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:45.610187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861000e5-ecc0-41d5-a18c-bc4900392563 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:45.610903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861000e5-ecc0-41d5-a18c-bc4900392563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:45.611209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861000e5-ecc0-41d5-a18c-bc4900392563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:45.612558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861000e5-ecc0-41d5-a18c-bc4900392563 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:45.624572 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 614/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:54:45.630280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68380e-77fb-4059-b504-cb2f3fcfaa09 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:45.698995 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:45.730081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68380e-77fb-4059-b504-cb2f3fcfaa09 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:45.762659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec0a98-2227-40ee-a7b8-b6883e333cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:45.763533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec0a98-2227-40ee-a7b8-b6883e333cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:45.763816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec0a98-2227-40ee-a7b8-b6883e333cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:45.764601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec0a98-2227-40ee-a7b8-b6883e333cc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:45.771167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec0a98-2227-40ee-a7b8-b6883e333cc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:45.772589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec0a98-2227-40ee-a7b8-b6883e333cc6 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:45.787389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-15ec0a98-2227-40ee-a7b8-b6883e333cc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:54:45.787389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:54:45.787389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:54:45.787389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:54:45.787389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:54:45.787389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:54:45.787389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:54:45.787389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:54:45.787389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:54:45.787389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:54:45.787389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:54:45.787389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:54:45.787389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:54:45.787389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:54:45.787389 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:54:45.788479 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:54:45.788479 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:54:45.788479 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:54:45.788479 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:54:45.788479 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:54:45.788479 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:54:45.788479 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:54:45.788479 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:54:45.788479 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:54:45.788479 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:54:45.788479 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:54:45.788479 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:54:45.788479 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:54:45.788479 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:54:45.788479 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:54:45.788479 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:54:45.788479 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:54:45.789718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:54:45.789718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:54:45.789718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:54:45.789718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:54:45.789718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:54:45.789718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:54:45.789718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:54:45.789718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:54:45.789718 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 603/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:54:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:54:45.794788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861000e5-ecc0-41d5-a18c-bc4900392563 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:45.896036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861000e5-ecc0-41d5-a18c-bc4900392563 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:45.919335 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:45.930750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4730f9b1-544e-4418-bfec-4060b4f970aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:45.931408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730f9b1-544e-4418-bfec-4060b4f970aa None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:45.931692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730f9b1-544e-4418-bfec-4060b4f970aa None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:45.931967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4730f9b1-544e-4418-bfec-4060b4f970aa None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:45.932748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730f9b1-544e-4418-bfec-4060b4f970aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:45.933054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730f9b1-544e-4418-bfec-4060b4f970aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:45.934617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4730f9b1-544e-4418-bfec-4060b4f970aa None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:45.946651 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 615/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:54:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:54:45.953539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec0a98-2227-40ee-a7b8-b6883e333cc6 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:46.051297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec0a98-2227-40ee-a7b8-b6883e333cc6 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:46.079095 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:46.084603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a5816-2f90-4c47-b578-8d81ad083c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:46.085242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a5816-2f90-4c47-b578-8d81ad083c58 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:46.085523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a5816-2f90-4c47-b578-8d81ad083c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:46.085795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a5816-2f90-4c47-b578-8d81ad083c58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:46.086648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a5816-2f90-4c47-b578-8d81ad083c58 None admin] RBAC: Adding query filter params (role.id=56d47830104f4dc09f1076c75acf3ffd, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=55426ff3ba7b45d7b270b5374539a461) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:46.086959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a5816-2f90-4c47-b578-8d81ad083c58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:46.088392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a5816-2f90-4c47-b578-8d81ad083c58 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:46.094887 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 604/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:54:45 2022] GET /identity/v3/role_assignments?user.id=55426ff3ba7b45d7b270b5374539a461&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=56d47830104f4dc09f1076c75acf3ffd => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:54:48.135342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83847f-d734-4a9e-ab17-d1bb51da039e None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:48.135916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83847f-d734-4a9e-ab17-d1bb51da039e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:48.135916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83847f-d734-4a9e-ab17-d1bb51da039e None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:48.137246 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 616/1220] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:54:48.142603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1451dcf-6d4f-45f1-9f23-f09c46ecb3c5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:48.143007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1451dcf-6d4f-45f1-9f23-f09c46ecb3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:48.143172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1451dcf-6d4f-45f1-9f23-f09c46ecb3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:48.159844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e1451dcf-6d4f-45f1-9f23-f09c46ecb3c5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:54:48.161017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e1451dcf-6d4f-45f1-9f23-f09c46ecb3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:54:48.227868 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 605/1221] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:54:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:54:48.252417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83847f-d734-4a9e-ab17-d1bb51da039e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:48.354402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83847f-d734-4a9e-ab17-d1bb51da039e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:48.388185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975257f-229a-4bb8-a3e1-50dedae8c646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:48.388909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975257f-229a-4bb8-a3e1-50dedae8c646 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:48.389663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975257f-229a-4bb8-a3e1-50dedae8c646 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:48.389984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975257f-229a-4bb8-a3e1-50dedae8c646 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:48.399909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975257f-229a-4bb8-a3e1-50dedae8c646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:54:48.408665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-a975257f-229a-4bb8-a3e1-50dedae8c646 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:54:48.408665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:54:48.408665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:54:48.408665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:54:48.408665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:54:48.408665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:54:48.408665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:54:48.408665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:54:48.408665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:54:48.408665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:54:48.408665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:54:48.408665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:54:48.408665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:54:48.408665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:54:48.408665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:54:48.408665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:54:48.409786 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:54:48.409786 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:54:48.409786 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:54:48.409786 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:54:48.409786 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:54:48.409786 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:54:48.409786 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:54:48.409786 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:54:48.409786 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:54:48.409786 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:54:48.409786 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:54:48.409786 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:54:48.409786 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:54:48.409786 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:54:48.409786 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:54:48.409786 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:54:48.410754 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:54:48.410754 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:54:48.410754 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:54:48.410754 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:54:48.410754 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:54:48.410754 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:54:48.410754 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:54:48.410754 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:54:48.410754 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:54:48.410754 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:54:48.410754 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:54:48.410754 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:54:48.410754 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 617/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:54:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:54:48.416094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1451dcf-6d4f-45f1-9f23-f09c46ecb3c5 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:48.514968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1451dcf-6d4f-45f1-9f23-f09c46ecb3c5 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:48.538781 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:48.549652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203097e-79a8-4a6e-b620-b159c33232b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:48.550350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203097e-79a8-4a6e-b620-b159c33232b8 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:48.554385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203097e-79a8-4a6e-b620-b159c33232b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:48.554385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203097e-79a8-4a6e-b620-b159c33232b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:48.554385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203097e-79a8-4a6e-b620-b159c33232b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:48.554385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203097e-79a8-4a6e-b620-b159c33232b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:48.554385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203097e-79a8-4a6e-b620-b159c33232b8 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:48.561290 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 606/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 19 13:54:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:54:48.566854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975257f-229a-4bb8-a3e1-50dedae8c646 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:48.611678 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:48.666532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975257f-229a-4bb8-a3e1-50dedae8c646 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:48.700703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb031f1-d6c3-48d0-8c37-5a1004c67cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:48.701569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb031f1-d6c3-48d0-8c37-5a1004c67cdf None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:48.701986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb031f1-d6c3-48d0-8c37-5a1004c67cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:48.702302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb031f1-d6c3-48d0-8c37-5a1004c67cdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:48.712520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb031f1-d6c3-48d0-8c37-5a1004c67cdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:48.715489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb031f1-d6c3-48d0-8c37-5a1004c67cdf None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:48.731164 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-9bb031f1-d6c3-48d0-8c37-5a1004c67cdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:54:48.731164 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:54:48.731164 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:54:48.731164 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:54:48.731164 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:54:48.731164 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:54:48.731164 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:54:48.731164 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:54:48.731164 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:54:48.731164 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:54:48.731164 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:54:48.731164 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:54:48.731164 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:54:48.731164 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:54:48.731164 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:54:48.732263 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:54:48.732263 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:54:48.732263 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:54:48.732263 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:54:48.732263 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:54:48.732263 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:54:48.732263 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:54:48.732263 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:54:48.732263 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:54:48.732263 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:54:48.732263 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:54:48.732263 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:54:48.732263 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:54:48.732263 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:54:48.732263 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:54:48.732263 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:54:48.732263 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:54:48.733901 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:54:48.733901 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:54:48.733901 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:54:48.733901 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:54:48.733901 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 618/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:54:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:54:48.740314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203097e-79a8-4a6e-b620-b159c33232b8 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:48.840533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203097e-79a8-4a6e-b620-b159c33232b8 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:48.875277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb194f-23f7-43c9-8d2a-1f87fa463f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:48.875935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb194f-23f7-43c9-8d2a-1f87fa463f47 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:48.876216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb194f-23f7-43c9-8d2a-1f87fa463f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:48.876489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcb194f-23f7-43c9-8d2a-1f87fa463f47 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:48.877247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb194f-23f7-43c9-8d2a-1f87fa463f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:48.877552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb194f-23f7-43c9-8d2a-1f87fa463f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:48.878933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcb194f-23f7-43c9-8d2a-1f87fa463f47 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:48.891351 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 607/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:54:48.897388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb031f1-d6c3-48d0-8c37-5a1004c67cdf None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:48.991744 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:48.999107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb031f1-d6c3-48d0-8c37-5a1004c67cdf None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:49.031874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335459c8-6d2d-4892-a6cf-ae93f866486a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:49.032653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335459c8-6d2d-4892-a6cf-ae93f866486a None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:49.032939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335459c8-6d2d-4892-a6cf-ae93f866486a None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:49.033218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335459c8-6d2d-4892-a6cf-ae93f866486a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:49.040211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335459c8-6d2d-4892-a6cf-ae93f866486a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:49.041646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335459c8-6d2d-4892-a6cf-ae93f866486a None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:49.057292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-335459c8-6d2d-4892-a6cf-ae93f866486a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 13:54:49.057292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:54:49.057292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:54:49.057292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:54:49.057292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:54:49.057292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:54:49.057292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:54:49.057292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:54:49.057292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:54:49.057292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:54:49.057292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:54:49.057292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:54:49.057292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:54:49.057292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:54:49.057292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:54:49.057292 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:54:49.063081 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:54:49.063081 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:54:49.063081 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:54:49.063081 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:54:49.063081 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:54:49.063081 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:54:49.063081 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:54:49.063081 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:54:49.063081 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:54:49.063081 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:54:49.063081 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:54:49.063081 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:54:49.063081 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:54:49.063081 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:54:49.063081 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:54:49.063081 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:54:49.063081 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:54:49.063081 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:54:49.064318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:54:49.064318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:54:49.064318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:54:49.064318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:54:49.064318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:54:49.064318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:54:49.064318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:54:49.064318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:54:49.064318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 13:54:49.064318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:54:49.064318 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 619/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:54:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:54:49.065338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb194f-23f7-43c9-8d2a-1f87fa463f47 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:49.111260 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:49.163393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcb194f-23f7-43c9-8d2a-1f87fa463f47 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:49.196353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a334a-b07b-4e89-9b8a-f783e6ee77bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:49.197022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a334a-b07b-4e89-9b8a-f783e6ee77bd None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:49.197332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a334a-b07b-4e89-9b8a-f783e6ee77bd None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:49.197611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a334a-b07b-4e89-9b8a-f783e6ee77bd None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:49.198480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a334a-b07b-4e89-9b8a-f783e6ee77bd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:49.203160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a334a-b07b-4e89-9b8a-f783e6ee77bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:49.203160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a334a-b07b-4e89-9b8a-f783e6ee77bd None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:49.217601 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 608/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Jul 19 13:54:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:54:49.223494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335459c8-6d2d-4892-a6cf-ae93f866486a None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:49.322844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335459c8-6d2d-4892-a6cf-ae93f866486a None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:49.356770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5a9fd-5a42-4e03-9f4d-f8e096b723e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:49.357586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5a9fd-5a42-4e03-9f4d-f8e096b723e7 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:49.358551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5a9fd-5a42-4e03-9f4d-f8e096b723e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:49.358841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff5a9fd-5a42-4e03-9f4d-f8e096b723e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:49.368849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5a9fd-5a42-4e03-9f4d-f8e096b723e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:49.370385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff5a9fd-5a42-4e03-9f4d-f8e096b723e7 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:49.387549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-bff5a9fd-5a42-4e03-9f4d-f8e096b723e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:54:49.387549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:54:49.387549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:54:49.387549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:54:49.387549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:54:49.387549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:54:49.387549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:54:49.387549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:54:49.387549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:54:49.387549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:54:49.387549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:54:49.387549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:54:49.387549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:54:49.387549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:54:49.387549 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:54:49.388635 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:54:49.388635 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:54:49.388635 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:54:49.388635 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:54:49.388635 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:54:49.388635 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:54:49.388635 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:54:49.388635 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:54:49.388635 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:54:49.388635 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:54:49.388635 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:54:49.388635 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:54:49.388635 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:54:49.388635 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:54:49.388635 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:54:49.388635 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:54:49.388635 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:54:49.389660 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:54:49.389660 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:54:49.389660 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:54:49.389660 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:54:49.389660 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 620/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:54:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:54:49.394764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a334a-b07b-4e89-9b8a-f783e6ee77bd None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:49.494728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a334a-b07b-4e89-9b8a-f783e6ee77bd None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:49.497002 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:49.527726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd996292-b6e7-464e-a28b-494fede25659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:49.528377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd996292-b6e7-464e-a28b-494fede25659 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:49.528658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd996292-b6e7-464e-a28b-494fede25659 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:49.528932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd996292-b6e7-464e-a28b-494fede25659 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:49.530691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd996292-b6e7-464e-a28b-494fede25659 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:49.531007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd996292-b6e7-464e-a28b-494fede25659 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:49.532361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd996292-b6e7-464e-a28b-494fede25659 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:49.543167 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 609/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:54:49.549097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5a9fd-5a42-4e03-9f4d-f8e096b723e7 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:49.557870 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:49.648170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff5a9fd-5a42-4e03-9f4d-f8e096b723e7 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:49.681143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d474b3-fa9d-4661-b481-347832f1997d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:49.681930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d474b3-fa9d-4661-b481-347832f1997d None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:49.682238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d474b3-fa9d-4661-b481-347832f1997d None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:49.682514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d474b3-fa9d-4661-b481-347832f1997d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:49.689290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d474b3-fa9d-4661-b481-347832f1997d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:49.690744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d474b3-fa9d-4661-b481-347832f1997d None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:49.705505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-e7d474b3-fa9d-4661-b481-347832f1997d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:54:49.705505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:54:49.705505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:54:49.705505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:54:49.705505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:54:49.705505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:54:49.705505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:54:49.705505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:54:49.705505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:54:49.705505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:54:49.705505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:54:49.705505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:54:49.705505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:54:49.705505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:54:49.705505 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:54:49.706609 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:54:49.706609 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:54:49.706609 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:54:49.706609 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:54:49.706609 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:54:49.706609 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:54:49.706609 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:54:49.706609 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:54:49.706609 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:54:49.706609 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:54:49.706609 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:54:49.706609 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:54:49.706609 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:54:49.706609 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:54:49.706609 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:54:49.706609 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:54:49.706609 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:54:49.707845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:54:49.707845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:54:49.707845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:54:49.707845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:54:49.707845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:54:49.707845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:54:49.707845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:54:49.707845 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:54:49.707845 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 621/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:54:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:54:49.712530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd996292-b6e7-464e-a28b-494fede25659 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:49.813340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd996292-b6e7-464e-a28b-494fede25659 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:49.846880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bed12c-da97-4dac-aea7-009d16c54be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:49.847571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bed12c-da97-4dac-aea7-009d16c54be5 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:49.847860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bed12c-da97-4dac-aea7-009d16c54be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:49.848138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bed12c-da97-4dac-aea7-009d16c54be5 None admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:49.848924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bed12c-da97-4dac-aea7-009d16c54be5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:49.850623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bed12c-da97-4dac-aea7-009d16c54be5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:49.850714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bed12c-da97-4dac-aea7-009d16c54be5 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:49.862489 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 610/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:54:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:54:49.868629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d474b3-fa9d-4661-b481-347832f1997d None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:49.934345 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:49.969502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d474b3-fa9d-4661-b481-347832f1997d None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:50.002138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bff57dc-c224-4cd4-9fdc-6fffff9ccfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:50.003021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff57dc-c224-4cd4-9fdc-6fffff9ccfdb None admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:50.003303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff57dc-c224-4cd4-9fdc-6fffff9ccfdb None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:50.003574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bff57dc-c224-4cd4-9fdc-6fffff9ccfdb None admin] PATH_INFO: `/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/55426ff3ba7b45d7b270b5374539a461/roles/56d47830104f4dc09f1076c75acf3ffd` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:50.019524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff57dc-c224-4cd4-9fdc-6fffff9ccfdb None admin] RBAC: Authorizing `identity:create_grant(project_id=dfcbe281a77242bbb3774c4aacef50d4, user_id=55426ff3ba7b45d7b270b5374539a461, role_id=56d47830104f4dc09f1076c75acf3ffd)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:50.021009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bff57dc-c224-4cd4-9fdc-6fffff9ccfdb None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:50.119170 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 622/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:54:49 2022] PUT /identity/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/55426ff3ba7b45d7b270b5374539a461/roles/56d47830104f4dc09f1076c75acf3ffd => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 13:54:52.178915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f259c-08d5-4519-ba56-09fc7740d8b9 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:52.179466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f259c-08d5-4519-ba56-09fc7740d8b9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:52.179560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f259c-08d5-4519-ba56-09fc7740d8b9 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:52.181051 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 611/1233] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:54:52.187008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a04c45-183a-4bd8-8e1f-54e8784f3d0b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:52.187502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a04c45-183a-4bd8-8e1f-54e8784f3d0b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:52.187634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a04c45-183a-4bd8-8e1f-54e8784f3d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:52.204881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d7a04c45-183a-4bd8-8e1f-54e8784f3d0b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:54:52.206176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d7a04c45-183a-4bd8-8e1f-54e8784f3d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:54:52.274430 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 623/1234] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:54:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:54:52.298956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f259c-08d5-4519-ba56-09fc7740d8b9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:52.329682 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:52.415021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f259c-08d5-4519-ba56-09fc7740d8b9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:52.448763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948f039-5234-46f8-8199-37ab3c9c572f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:52.449550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948f039-5234-46f8-8199-37ab3c9c572f None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:52.449949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948f039-5234-46f8-8199-37ab3c9c572f None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:52.450265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948f039-5234-46f8-8199-37ab3c9c572f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:52.460713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948f039-5234-46f8-8199-37ab3c9c572f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:54:52.469262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-b948f039-5234-46f8-8199-37ab3c9c572f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:54:52.469262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:54:52.469262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:54:52.469262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:54:52.469262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:54:52.469262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:54:52.469262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:54:52.469262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:54:52.469262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:54:52.469262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:54:52.469262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:54:52.469262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:54:52.469262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:54:52.469262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:54:52.469262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:54:52.469262 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:54:52.470535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:54:52.470535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:54:52.470535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:54:52.470535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:54:52.470535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:54:52.470535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:54:52.470535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:54:52.470535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:54:52.470535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:54:52.470535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:54:52.470535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:54:52.470535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:54:52.470535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:54:52.470535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:54:52.470535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:54:52.470535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:54:52.471586 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:54:52.471586 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:54:52.471586 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:54:52.471586 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:54:52.471586 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:54:52.471586 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:54:52.471586 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:54:52.471586 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:54:52.471586 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:54:52.471586 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:54:52.471586 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 13:54:52.471586 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:54:52.471586 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 612/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Tue Jul 19 13:54:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:54:52.478464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a04c45-183a-4bd8-8e1f-54e8784f3d0b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:52.524112 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:52.577605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a04c45-183a-4bd8-8e1f-54e8784f3d0b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:52.612188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3b2fc-769e-4def-bd80-6098a3664b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:52.612852 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3b2fc-769e-4def-bd80-6098a3664b62 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:52.613140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3b2fc-769e-4def-bd80-6098a3664b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:52.613456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d3b2fc-769e-4def-bd80-6098a3664b62 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:52.614192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3b2fc-769e-4def-bd80-6098a3664b62 None admin] RBAC: Adding query filter params (name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:52.614518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3b2fc-769e-4def-bd80-6098a3664b62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:52.615863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d3b2fc-769e-4def-bd80-6098a3664b62 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:52.623598 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 624/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Tue Jul 19 13:54:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:54:52.629811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948f039-5234-46f8-8199-37ab3c9c572f None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:52.713593 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:52.729352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948f039-5234-46f8-8199-37ab3c9c572f None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:52.761210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a95a41-fe6a-4926-af6b-f30dbc346168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:52.761995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a95a41-fe6a-4926-af6b-f30dbc346168 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:52.762305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a95a41-fe6a-4926-af6b-f30dbc346168 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:52.762583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a95a41-fe6a-4926-af6b-f30dbc346168 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:52.772812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a95a41-fe6a-4926-af6b-f30dbc346168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:52.774279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a95a41-fe6a-4926-af6b-f30dbc346168 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:52.792201 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-39a95a41-fe6a-4926-af6b-f30dbc346168 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:54:52.792201 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:54:52.792201 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:54:52.792201 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:54:52.792201 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:54:52.792201 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:54:52.792201 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:54:52.792201 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:54:52.792201 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:54:52.792201 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:54:52.792201 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:54:52.792201 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:54:52.792201 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:54:52.792201 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:54:52.792201 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:54:52.793318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:54:52.793318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:54:52.793318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:54:52.793318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:54:52.793318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:54:52.793318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:54:52.793318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:54:52.793318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:54:52.793318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:54:52.793318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:54:52.793318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:54:52.793318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:54:52.793318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:54:52.793318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:54:52.793318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:54:52.793318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:54:52.793318 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:54:52.794617 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:54:52.794617 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:54:52.794617 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:54:52.794617 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:54:52.794617 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 613/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:54:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:54:52.799372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3b2fc-769e-4def-bd80-6098a3664b62 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:52.899194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d3b2fc-769e-4def-bd80-6098a3664b62 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:52.907875 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:52.931456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896a679-2c46-4da8-a278-13607ad3ac81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:52.932113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896a679-2c46-4da8-a278-13607ad3ac81 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:52.932393 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896a679-2c46-4da8-a278-13607ad3ac81 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:52.932668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e896a679-2c46-4da8-a278-13607ad3ac81 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:52.933386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896a679-2c46-4da8-a278-13607ad3ac81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:52.933693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896a679-2c46-4da8-a278-13607ad3ac81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:52.935087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e896a679-2c46-4da8-a278-13607ad3ac81 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:52.947279 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 625/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:54:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:54:52.954160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a95a41-fe6a-4926-af6b-f30dbc346168 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:53.054360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a95a41-fe6a-4926-af6b-f30dbc346168 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:53.088125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d74afe-241d-4ba6-9c76-7c81b76fe7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:53.088950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d74afe-241d-4ba6-9c76-7c81b76fe7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:53.089236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d74afe-241d-4ba6-9c76-7c81b76fe7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:53.089508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d74afe-241d-4ba6-9c76-7c81b76fe7f8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:53.092704 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:53.097367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d74afe-241d-4ba6-9c76-7c81b76fe7f8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:53.098902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d74afe-241d-4ba6-9c76-7c81b76fe7f8 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:53.113917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-77d74afe-241d-4ba6-9c76-7c81b76fe7f8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 13:54:53.113917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:54:53.113917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:54:53.113917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:54:53.113917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:54:53.113917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:54:53.113917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:54:53.113917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:54:53.113917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:54:53.113917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:54:53.113917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:54:53.113917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:54:53.113917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:54:53.113917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:54:53.113917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:54:53.113917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:54:53.115251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:54:53.115251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:54:53.115251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:54:53.115251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:54:53.115251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:54:53.115251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:54:53.115251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:54:53.115251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:54:53.115251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:54:53.115251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:54:53.115251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:54:53.115251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:54:53.115251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:54:53.115251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:54:53.115251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:54:53.115251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:54:53.115251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:54:53.115251 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:54:53.116706 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:54:53.116706 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:54:53.116706 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:54:53.116706 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:54:53.116706 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:54:53.116706 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:54:53.116706 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:54:53.116706 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:54:53.116706 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 13:54:53.116706 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:54:53.116706 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 614/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:54:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:54:53.120922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896a679-2c46-4da8-a278-13607ad3ac81 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:53.218466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e896a679-2c46-4da8-a278-13607ad3ac81 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:53.254070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830218a-28ab-4d89-a866-34c3c221c49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:53.254859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830218a-28ab-4d89-a866-34c3c221c49d None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:53.255140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830218a-28ab-4d89-a866-34c3c221c49d None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:53.255416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830218a-28ab-4d89-a866-34c3c221c49d None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:53.256250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830218a-28ab-4d89-a866-34c3c221c49d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:53.256556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830218a-28ab-4d89-a866-34c3c221c49d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:53.257994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c830218a-28ab-4d89-a866-34c3c221c49d None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:53.274845 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 626/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Jul 19 13:54:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:54:53.280874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d74afe-241d-4ba6-9c76-7c81b76fe7f8 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:53.379598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d74afe-241d-4ba6-9c76-7c81b76fe7f8 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:53.412739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816b63d-60f2-4eb5-b9da-3b812b2d53fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:53.413482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816b63d-60f2-4eb5-b9da-3b812b2d53fc None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:53.413831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816b63d-60f2-4eb5-b9da-3b812b2d53fc None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:53.414136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816b63d-60f2-4eb5-b9da-3b812b2d53fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:53.473989 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:53.480475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816b63d-60f2-4eb5-b9da-3b812b2d53fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:53.481925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a816b63d-60f2-4eb5-b9da-3b812b2d53fc None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:53.581341 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 615/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:54:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 13:54:53.587153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830218a-28ab-4d89-a866-34c3c221c49d None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:53.615277 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:53.687610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830218a-28ab-4d89-a866-34c3c221c49d None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:53.721923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6eeb43-735b-46f0-b56b-7c70ed4cefef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:53.722734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6eeb43-735b-46f0-b56b-7c70ed4cefef None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:53.723016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6eeb43-735b-46f0-b56b-7c70ed4cefef None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:53.723288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6eeb43-735b-46f0-b56b-7c70ed4cefef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:53.733493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6eeb43-735b-46f0-b56b-7c70ed4cefef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:53.734961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6eeb43-735b-46f0-b56b-7c70ed4cefef None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:53.751887 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-7e6eeb43-735b-46f0-b56b-7c70ed4cefef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:54:53.751887 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:54:53.751887 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:54:53.751887 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:54:53.751887 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:54:53.751887 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:54:53.751887 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:54:53.751887 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:54:53.751887 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:54:53.751887 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:54:53.751887 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:54:53.751887 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:54:53.751887 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:54:53.751887 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:54:53.751887 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:54:53.758026 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:54:53.758026 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:54:53.758026 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:54:53.758026 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:54:53.758026 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:54:53.758026 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:54:53.758026 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:54:53.758026 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:54:53.758026 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:54:53.758026 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:54:53.758026 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:54:53.758026 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:54:53.758026 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:54:53.758026 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:54:53.758026 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:54:53.758026 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:54:53.758026 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:54:53.759187 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:54:53.759187 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:54:53.759187 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:54:53.759187 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:54:53.759187 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 627/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:54:53.759534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816b63d-60f2-4eb5-b9da-3b812b2d53fc None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:53.852816 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:53.859013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816b63d-60f2-4eb5-b9da-3b812b2d53fc None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:53.890866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66819f-a4e5-4cb9-81e8-b8ee2f498c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:53.891516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66819f-a4e5-4cb9-81e8-b8ee2f498c96 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:53.891802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66819f-a4e5-4cb9-81e8-b8ee2f498c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:53.892080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66819f-a4e5-4cb9-81e8-b8ee2f498c96 None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:53.892796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66819f-a4e5-4cb9-81e8-b8ee2f498c96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:53.893103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66819f-a4e5-4cb9-81e8-b8ee2f498c96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:53.894482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66819f-a4e5-4cb9-81e8-b8ee2f498c96 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:53.906012 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 616/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:54:53.911851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6eeb43-735b-46f0-b56b-7c70ed4cefef None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:53.994377 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:54.015957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6eeb43-735b-46f0-b56b-7c70ed4cefef None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:54.048804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b9e9f-9292-49cc-951f-495132f288f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:54.049597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b9e9f-9292-49cc-951f-495132f288f9 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:54.049856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b9e9f-9292-49cc-951f-495132f288f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:54.050152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b9e9f-9292-49cc-951f-495132f288f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:54.056572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b9e9f-9292-49cc-951f-495132f288f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:54.057995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b9e9f-9292-49cc-951f-495132f288f9 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:54.071979 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-b90b9e9f-9292-49cc-951f-495132f288f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:54:54.071979 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:54:54.071979 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:54:54.071979 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:54:54.071979 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:54:54.071979 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:54:54.071979 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:54:54.071979 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:54:54.071979 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:54:54.071979 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:54:54.071979 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:54:54.071979 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:54:54.071979 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:54:54.071979 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:54:54.071979 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:54:54.073053 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:54:54.073053 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:54:54.073053 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:54:54.073053 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:54:54.073053 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:54:54.073053 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:54:54.073053 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:54:54.073053 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:54:54.073053 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:54:54.073053 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:54:54.073053 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:54:54.073053 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:54:54.073053 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:54:54.073053 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:54:54.073053 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:54:54.073053 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:54:54.073053 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:54:54.074067 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:54:54.074067 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:54:54.074067 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:54:54.074067 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:54:54.074067 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:54:54.074067 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:54:54.074067 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:54:54.074067 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:54:54.074067 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 628/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:54:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:54:54.080173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66819f-a4e5-4cb9-81e8-b8ee2f498c96 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:54.180303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66819f-a4e5-4cb9-81e8-b8ee2f498c96 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:54.213690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574dc114-1886-48dc-8bc8-6aed9d58d5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:54.214383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dc114-1886-48dc-8bc8-6aed9d58d5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:54.214663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dc114-1886-48dc-8bc8-6aed9d58d5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:54.214935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dc114-1886-48dc-8bc8-6aed9d58d5f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:54.215719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574dc114-1886-48dc-8bc8-6aed9d58d5f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:54.216026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574dc114-1886-48dc-8bc8-6aed9d58d5f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:54.218109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574dc114-1886-48dc-8bc8-6aed9d58d5f4 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:54.230081 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 617/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:54:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:54:54.236379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b9e9f-9292-49cc-951f-495132f288f9 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:54.337307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b9e9f-9292-49cc-951f-495132f288f9 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:54.373240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b3403-d0cd-46e6-8e92-b50ec446d384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:54.373995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b3403-d0cd-46e6-8e92-b50ec446d384 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:54.374304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b3403-d0cd-46e6-8e92-b50ec446d384 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:54.374587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b3403-d0cd-46e6-8e92-b50ec446d384 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:54.375494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b3403-d0cd-46e6-8e92-b50ec446d384 None admin] RBAC: Adding query filter params (role.id=56d47830104f4dc09f1076c75acf3ffd, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=55426ff3ba7b45d7b270b5374539a461) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:54.375852 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b3403-d0cd-46e6-8e92-b50ec446d384 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:54.377270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b3403-d0cd-46e6-8e92-b50ec446d384 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:54.383382 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 629/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:54:54 2022] GET /identity/v3/role_assignments?user.id=55426ff3ba7b45d7b270b5374539a461&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=56d47830104f4dc09f1076c75acf3ffd => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:54:56.450913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5ddc9-d67a-4cf9-ae77-13accf61186f None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:56.451964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5ddc9-d67a-4cf9-ae77-13accf61186f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:56.452067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5ddc9-d67a-4cf9-ae77-13accf61186f None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:56.453460 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 618/1247] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:54:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:54:56.458719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27b797-f7c0-4734-86fd-65536ab19997 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:56.461040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27b797-f7c0-4734-86fd-65536ab19997 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:56.461040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27b797-f7c0-4734-86fd-65536ab19997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:56.464265 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:56.477368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3d27b797-f7c0-4734-86fd-65536ab19997 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:54:56.478512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3d27b797-f7c0-4734-86fd-65536ab19997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:54:56.546271 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 630/1248] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:54:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:54:56.570230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5ddc9-d67a-4cf9-ae77-13accf61186f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:56.588608 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:56.669955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5ddc9-d67a-4cf9-ae77-13accf61186f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:56.705393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23d70d-f5fb-4986-8789-e8d08b8ac603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:56.706208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23d70d-f5fb-4986-8789-e8d08b8ac603 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:56.706494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23d70d-f5fb-4986-8789-e8d08b8ac603 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:56.706772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23d70d-f5fb-4986-8789-e8d08b8ac603 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:56.716546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e23d70d-f5fb-4986-8789-e8d08b8ac603 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:54:56.724186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-8e23d70d-f5fb-4986-8789-e8d08b8ac603 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:54:56.724186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:54:56.724186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:54:56.724186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:54:56.724186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:54:56.724186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:54:56.724186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:54:56.724186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:54:56.724186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:54:56.724186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:54:56.724186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:54:56.724186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:54:56.724186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:54:56.724186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:54:56.724186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:54:56.724186 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:54:56.725320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:54:56.725320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:54:56.725320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:54:56.725320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:54:56.725320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:54:56.725320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:54:56.725320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:54:56.725320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:54:56.725320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:54:56.725320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:54:56.725320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:54:56.725320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:54:56.725320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:54:56.725320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:54:56.725320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:54:56.725320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:54:56.731956 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:54:56.731956 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:54:56.731956 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:54:56.731956 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:54:56.731956 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:54:56.731956 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:54:56.731956 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:54:56.731956 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:54:56.731956 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:54:56.731956 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:54:56.731956 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:54:56.731956 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:54:56.731956 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 619/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:54:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:54:56.732855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27b797-f7c0-4734-86fd-65536ab19997 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:56.828391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27b797-f7c0-4734-86fd-65536ab19997 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:56.857038 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:56.862291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15202e-95cd-40cd-ab24-d22fe9eda3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:56.862957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15202e-95cd-40cd-ab24-d22fe9eda3fb None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:56.863238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15202e-95cd-40cd-ab24-d22fe9eda3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:56.863517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15202e-95cd-40cd-ab24-d22fe9eda3fb None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:56.864310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15202e-95cd-40cd-ab24-d22fe9eda3fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:56.864660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15202e-95cd-40cd-ab24-d22fe9eda3fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:56.866020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15202e-95cd-40cd-ab24-d22fe9eda3fb None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:56.874844 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 631/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:54:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:54:56.880653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23d70d-f5fb-4986-8789-e8d08b8ac603 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:56.957920 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:56.980089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e23d70d-f5fb-4986-8789-e8d08b8ac603 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:57.015730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd2fe1-21d4-46bc-92e3-175633a10fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:57.015730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd2fe1-21d4-46bc-92e3-175633a10fa8 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:57.015730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd2fe1-21d4-46bc-92e3-175633a10fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:57.015730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd2fe1-21d4-46bc-92e3-175633a10fa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:57.024744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd2fe1-21d4-46bc-92e3-175633a10fa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:57.026227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd2fe1-21d4-46bc-92e3-175633a10fa8 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:57.042948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-c4cd2fe1-21d4-46bc-92e3-175633a10fa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:54:57.042948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:54:57.042948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:54:57.042948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:54:57.042948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:54:57.042948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:54:57.042948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:54:57.042948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:54:57.042948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:54:57.042948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:54:57.042948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:54:57.042948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:54:57.042948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:54:57.042948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:54:57.042948 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:54:57.044104 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:54:57.044104 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:54:57.044104 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:54:57.044104 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:54:57.044104 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:54:57.044104 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:54:57.044104 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:54:57.044104 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:54:57.044104 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:54:57.044104 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:54:57.044104 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:54:57.044104 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:54:57.044104 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:54:57.044104 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:54:57.044104 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:54:57.044104 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:54:57.044104 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:54:57.045091 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:54:57.045091 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:54:57.045091 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:54:57.045091 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:54:57.047149 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 620/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:54:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:54:57.052230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15202e-95cd-40cd-ab24-d22fe9eda3fb None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:57.150147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15202e-95cd-40cd-ab24-d22fe9eda3fb None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:57.184022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d965e-22ce-4a34-932c-7d0a30932718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:57.184672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d965e-22ce-4a34-932c-7d0a30932718 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:57.184956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d965e-22ce-4a34-932c-7d0a30932718 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:57.185235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d965e-22ce-4a34-932c-7d0a30932718 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:57.187303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d965e-22ce-4a34-932c-7d0a30932718 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:57.187616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d965e-22ce-4a34-932c-7d0a30932718 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:57.188984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d965e-22ce-4a34-932c-7d0a30932718 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:57.200861 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 632/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:54:57.206839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd2fe1-21d4-46bc-92e3-175633a10fa8 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:57.308113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd2fe1-21d4-46bc-92e3-175633a10fa8 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:57.334176 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:57.341538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c2969-e717-4918-bdae-4dc0383659cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:57.343052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c2969-e717-4918-bdae-4dc0383659cf None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:57.343549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c2969-e717-4918-bdae-4dc0383659cf None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:57.344050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c2969-e717-4918-bdae-4dc0383659cf None admin] PATH_INFO: `/v3/users/placement` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:57.351757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c2969-e717-4918-bdae-4dc0383659cf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:57.353191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c2969-e717-4918-bdae-4dc0383659cf None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:57.367603 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-367c2969-e717-4918-bdae-4dc0383659cf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 13:54:57.367603 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:54:57.367603 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:54:57.367603 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:54:57.367603 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:54:57.367603 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:54:57.367603 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:54:57.367603 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:54:57.367603 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:54:57.367603 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:54:57.367603 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:54:57.367603 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:54:57.367603 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:54:57.367603 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:54:57.367603 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:54:57.367603 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:54:57.368733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:54:57.368733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:54:57.368733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:54:57.368733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:54:57.368733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:54:57.368733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:54:57.368733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:54:57.368733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:54:57.368733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:54:57.368733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:54:57.368733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:54:57.368733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:54:57.368733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:54:57.368733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:54:57.368733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:54:57.368733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:54:57.368733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:54:57.368733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:54:57.369832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:54:57.369832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:54:57.369832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:54:57.369832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:54:57.369832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:54:57.369832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:54:57.369832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:54:57.369832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:54:57.369832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 13:54:57.369832 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:54:57.369832 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 621/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:54:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:54:57.374648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d965e-22ce-4a34-932c-7d0a30932718 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:57.429026 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:57.473871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d965e-22ce-4a34-932c-7d0a30932718 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:57.510916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585fa41-94ad-4b6e-b7da-dc11e45c788d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:57.511586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585fa41-94ad-4b6e-b7da-dc11e45c788d None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:57.511871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585fa41-94ad-4b6e-b7da-dc11e45c788d None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:57.512146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585fa41-94ad-4b6e-b7da-dc11e45c788d None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:57.512979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585fa41-94ad-4b6e-b7da-dc11e45c788d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:57.513287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585fa41-94ad-4b6e-b7da-dc11e45c788d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:57.514888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4585fa41-94ad-4b6e-b7da-dc11e45c788d None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:57.532361 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 633/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Jul 19 13:54:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 13:54:57.538174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c2969-e717-4918-bdae-4dc0383659cf None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:57.638311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c2969-e717-4918-bdae-4dc0383659cf None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:57.673667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadba22-77de-442e-8d75-b56c359f64bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:57.674403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadba22-77de-442e-8d75-b56c359f64bd None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:57.674778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadba22-77de-442e-8d75-b56c359f64bd None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:57.676176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dadba22-77de-442e-8d75-b56c359f64bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:57.733488 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:57.745453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dadba22-77de-442e-8d75-b56c359f64bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:57.746915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dadba22-77de-442e-8d75-b56c359f64bd None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:57.844304 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 622/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:54:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 13:54:57.850042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585fa41-94ad-4b6e-b7da-dc11e45c788d None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:57.948471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4585fa41-94ad-4b6e-b7da-dc11e45c788d None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:57.962179 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:57.983152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763566c8-86fe-400a-b6ec-586fffbdee39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:57.984113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763566c8-86fe-400a-b6ec-586fffbdee39 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:57.984388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763566c8-86fe-400a-b6ec-586fffbdee39 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:57.984661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763566c8-86fe-400a-b6ec-586fffbdee39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:57.994637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763566c8-86fe-400a-b6ec-586fffbdee39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:57.996091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763566c8-86fe-400a-b6ec-586fffbdee39 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:58.014242 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-763566c8-86fe-400a-b6ec-586fffbdee39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:54:58.014242 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:54:58.014242 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:54:58.014242 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:54:58.014242 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:54:58.014242 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:54:58.014242 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:54:58.014242 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:54:58.014242 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:54:58.014242 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:54:58.014242 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:54:58.014242 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:54:58.014242 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:54:58.014242 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:54:58.014242 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:54:58.015703 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:54:58.015703 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:54:58.015703 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:54:58.015703 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:54:58.015703 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:54:58.015703 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:54:58.015703 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:54:58.015703 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:54:58.015703 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:54:58.015703 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:54:58.015703 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:54:58.015703 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:54:58.015703 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:54:58.015703 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:54:58.015703 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:54:58.015703 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:54:58.015703 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:54:58.016905 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:54:58.016905 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:54:58.016905 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:54:58.016905 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:54:58.016905 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 634/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:54:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:54:58.021261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadba22-77de-442e-8d75-b56c359f64bd None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:58.109430 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:58.121053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dadba22-77de-442e-8d75-b56c359f64bd None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:58.153841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cecb81-a917-4b2d-bd61-21cf30dd397a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:58.155045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cecb81-a917-4b2d-bd61-21cf30dd397a None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:58.155388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cecb81-a917-4b2d-bd61-21cf30dd397a None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:58.155718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cecb81-a917-4b2d-bd61-21cf30dd397a None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:58.156396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cecb81-a917-4b2d-bd61-21cf30dd397a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:58.156706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cecb81-a917-4b2d-bd61-21cf30dd397a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:58.158058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cecb81-a917-4b2d-bd61-21cf30dd397a None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:58.169159 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 623/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:54:58.175537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763566c8-86fe-400a-b6ec-586fffbdee39 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:58.274689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763566c8-86fe-400a-b6ec-586fffbdee39 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:58.309090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27693627-93ba-41f7-a780-d1bde1e5d795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:58.309959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27693627-93ba-41f7-a780-d1bde1e5d795 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:58.310274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27693627-93ba-41f7-a780-d1bde1e5d795 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:58.310551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27693627-93ba-41f7-a780-d1bde1e5d795 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:58.317366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27693627-93ba-41f7-a780-d1bde1e5d795 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:58.318826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27693627-93ba-41f7-a780-d1bde1e5d795 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:58.333285 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-27693627-93ba-41f7-a780-d1bde1e5d795 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:54:58.333285 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:54:58.333285 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:54:58.333285 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:54:58.333285 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:54:58.333285 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:54:58.333285 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:54:58.333285 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:54:58.333285 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:54:58.333285 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:54:58.333285 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:54:58.333285 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:54:58.333285 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:54:58.333285 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:54:58.333285 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:54:58.334392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:54:58.334392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:54:58.334392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:54:58.334392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:54:58.334392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:54:58.334392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:54:58.334392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:54:58.334392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:54:58.334392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:54:58.334392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:54:58.334392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:54:58.334392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:54:58.334392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:54:58.334392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:54:58.334392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:54:58.334392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:54:58.334392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:54:58.339170 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:54:58.339170 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:54:58.339170 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:54:58.339170 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:54:58.339170 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:54:58.339170 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:54:58.339170 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:54:58.339170 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:54:58.339170 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 635/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:54:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:54:58.340429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cecb81-a917-4b2d-bd61-21cf30dd397a None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:58.443567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cecb81-a917-4b2d-bd61-21cf30dd397a None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:58.477007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381180af-8c64-4f97-a9f2-f944c73c8ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:58.477659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381180af-8c64-4f97-a9f2-f944c73c8ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:58.477951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381180af-8c64-4f97-a9f2-f944c73c8ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:58.478262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381180af-8c64-4f97-a9f2-f944c73c8ca3 None admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:58.481501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381180af-8c64-4f97-a9f2-f944c73c8ca3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:58.481501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381180af-8c64-4f97-a9f2-f944c73c8ca3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:58.481501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381180af-8c64-4f97-a9f2-f944c73c8ca3 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:58.493843 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 624/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:54:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:54:58.501045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27693627-93ba-41f7-a780-d1bde1e5d795 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:54:58.526612 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:54:58.600325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27693627-93ba-41f7-a780-d1bde1e5d795 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:54:58.634741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d91e34-be6c-4f25-8eaa-52971773a121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:54:58.635385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d91e34-be6c-4f25-8eaa-52971773a121 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:54:58.635668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d91e34-be6c-4f25-8eaa-52971773a121 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:54:58.635945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d91e34-be6c-4f25-8eaa-52971773a121 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:54:58.636773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d91e34-be6c-4f25-8eaa-52971773a121 None admin] RBAC: Adding query filter params (role.id=bc315edf089d43b18acf9790031f3fcb, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=55426ff3ba7b45d7b270b5374539a461) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:54:58.637109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d91e34-be6c-4f25-8eaa-52971773a121 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:54:58.638565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d91e34-be6c-4f25-8eaa-52971773a121 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:54:58.644106 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 636/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:54:58 2022] GET /identity/v3/role_assignments?user.id=55426ff3ba7b45d7b270b5374539a461&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=bc315edf089d43b18acf9790031f3fcb => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:55:00.705139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d8a58-64dc-4c67-8e97-8445a39ad6d9 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:00.705728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d8a58-64dc-4c67-8e97-8445a39ad6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:00.705728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d8a58-64dc-4c67-8e97-8445a39ad6d9 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:00.707044 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 625/1261] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:55:00.712321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8b084-474d-4b54-acab-e12a6207f083 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:00.712782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8b084-474d-4b54-acab-e12a6207f083 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:00.712895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8b084-474d-4b54-acab-e12a6207f083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:00.730001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3fc8b084-474d-4b54-acab-e12a6207f083 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:55:00.731200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3fc8b084-474d-4b54-acab-e12a6207f083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:55:00.799825 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 637/1262] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:55:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:55:00.822907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d8a58-64dc-4c67-8e97-8445a39ad6d9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:00.834315 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:00.925363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d8a58-64dc-4c67-8e97-8445a39ad6d9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:00.960547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97015fe-312b-4b99-bb03-96e798bfd400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:00.961297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97015fe-312b-4b99-bb03-96e798bfd400 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:00.961585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97015fe-312b-4b99-bb03-96e798bfd400 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:00.961868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97015fe-312b-4b99-bb03-96e798bfd400 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:00.972279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97015fe-312b-4b99-bb03-96e798bfd400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:55:00.980121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-a97015fe-312b-4b99-bb03-96e798bfd400 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:55:00.980121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:55:00.980121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:55:00.980121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:55:00.980121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:55:00.980121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:55:00.980121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:55:00.980121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:55:00.980121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:55:00.980121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:55:00.980121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:55:00.980121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:55:00.980121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:55:00.980121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:55:00.980121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:55:00.980121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:55:00.981139 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:55:00.981139 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:55:00.981139 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:55:00.981139 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:55:00.981139 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:55:00.981139 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:55:00.981139 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:55:00.981139 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:55:00.981139 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:55:00.981139 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:55:00.981139 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:55:00.981139 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:55:00.981139 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:55:00.981139 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:55:00.981139 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:55:00.981139 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:55:00.981998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:55:00.981998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:55:00.981998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:55:00.981998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:55:00.981998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:55:00.981998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:55:00.981998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:55:00.981998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:55:00.981998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:55:00.981998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:55:00.981998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:55:00.981998 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:55:00.981998 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 626/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:55:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:55:00.988202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8b084-474d-4b54-acab-e12a6207f083 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:01.007646 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:01.085826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8b084-474d-4b54-acab-e12a6207f083 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:01.120504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d818c-b4e3-448f-93b2-faafbfc031e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:01.121178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d818c-b4e3-448f-93b2-faafbfc031e5 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:01.121465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d818c-b4e3-448f-93b2-faafbfc031e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:01.121744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d818c-b4e3-448f-93b2-faafbfc031e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:01.122534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d818c-b4e3-448f-93b2-faafbfc031e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:55:01.122877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d818c-b4e3-448f-93b2-faafbfc031e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:01.124251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6d818c-b4e3-448f-93b2-faafbfc031e5 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:01.132331 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 638/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:55:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:55:01.138019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97015fe-312b-4b99-bb03-96e798bfd400 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:01.203650 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:01.237701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97015fe-312b-4b99-bb03-96e798bfd400 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:01.269497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb256dd-3989-415c-bbd8-4a9a93ab3de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:01.270308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb256dd-3989-415c-bbd8-4a9a93ab3de0 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:01.270597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb256dd-3989-415c-bbd8-4a9a93ab3de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:01.270878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb256dd-3989-415c-bbd8-4a9a93ab3de0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:01.281684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb256dd-3989-415c-bbd8-4a9a93ab3de0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:01.283171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb256dd-3989-415c-bbd8-4a9a93ab3de0 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:01.301315 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-6cb256dd-3989-415c-bbd8-4a9a93ab3de0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:55:01.301315 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:55:01.301315 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:55:01.301315 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:55:01.301315 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:55:01.301315 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:55:01.301315 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:55:01.301315 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:55:01.301315 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:55:01.301315 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:55:01.301315 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:55:01.301315 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:55:01.301315 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:55:01.301315 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:55:01.301315 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:55:01.302533 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:55:01.302533 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:55:01.302533 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:55:01.302533 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:55:01.302533 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:55:01.302533 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:55:01.302533 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:55:01.302533 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:55:01.302533 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:55:01.302533 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:55:01.302533 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:55:01.302533 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:55:01.302533 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:55:01.302533 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:55:01.302533 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:55:01.302533 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:55:01.302533 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:55:01.303804 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:55:01.303804 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:55:01.303804 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:55:01.303804 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:55:01.303804 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 627/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:55:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:55:01.308585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d818c-b4e3-448f-93b2-faafbfc031e5 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:01.390164 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:01.408926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d818c-b4e3-448f-93b2-faafbfc031e5 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:01.441738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8495d9-7f64-4971-847e-dca81103c259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:01.442433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8495d9-7f64-4971-847e-dca81103c259 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:01.442713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8495d9-7f64-4971-847e-dca81103c259 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:01.442987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8495d9-7f64-4971-847e-dca81103c259 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:01.443740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8495d9-7f64-4971-847e-dca81103c259 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:55:01.444044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8495d9-7f64-4971-847e-dca81103c259 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:01.445672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8495d9-7f64-4971-847e-dca81103c259 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:01.457073 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 639/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:55:01.462905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb256dd-3989-415c-bbd8-4a9a93ab3de0 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:01.568528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb256dd-3989-415c-bbd8-4a9a93ab3de0 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:01.587690 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:01.600971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df9e1d-fd2d-4859-a002-dc7b1b718f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:01.601764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df9e1d-fd2d-4859-a002-dc7b1b718f58 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:01.602050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df9e1d-fd2d-4859-a002-dc7b1b718f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:01.602357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df9e1d-fd2d-4859-a002-dc7b1b718f58 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:01.610075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df9e1d-fd2d-4859-a002-dc7b1b718f58 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:01.611526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df9e1d-fd2d-4859-a002-dc7b1b718f58 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:01.626142 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-77df9e1d-fd2d-4859-a002-dc7b1b718f58 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 13:55:01.626142 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:55:01.626142 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:55:01.626142 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:55:01.626142 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:55:01.626142 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:55:01.626142 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:55:01.626142 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:55:01.626142 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:55:01.626142 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:55:01.626142 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:55:01.626142 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:55:01.626142 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:55:01.626142 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:55:01.626142 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:55:01.626142 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:55:01.627270 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:55:01.627270 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:55:01.627270 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:55:01.627270 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:55:01.627270 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:55:01.627270 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:55:01.627270 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:55:01.627270 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:55:01.627270 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:55:01.627270 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:55:01.627270 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:55:01.627270 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:55:01.627270 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:55:01.627270 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:55:01.627270 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:55:01.627270 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:55:01.627270 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:55:01.627270 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:55:01.628678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:55:01.628678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:55:01.628678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:55:01.628678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:55:01.628678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:55:01.628678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:55:01.628678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:55:01.628678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:55:01.628678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 13:55:01.628678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:55:01.628678 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 628/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:55:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:55:01.633159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8495d9-7f64-4971-847e-dca81103c259 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:01.735660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8495d9-7f64-4971-847e-dca81103c259 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:01.769667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296d48e-b3da-487f-8107-e58dc5183bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:01.770352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296d48e-b3da-487f-8107-e58dc5183bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:01.770634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296d48e-b3da-487f-8107-e58dc5183bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:01.770908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6296d48e-b3da-487f-8107-e58dc5183bf0 None admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:01.771740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296d48e-b3da-487f-8107-e58dc5183bf0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:55:01.772045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296d48e-b3da-487f-8107-e58dc5183bf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:01.773489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6296d48e-b3da-487f-8107-e58dc5183bf0 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:01.782708 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:01.790467 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 640/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Jul 19 13:55:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:55:01.796715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df9e1d-fd2d-4859-a002-dc7b1b718f58 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:01.897674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df9e1d-fd2d-4859-a002-dc7b1b718f58 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:01.931755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742822c-abe2-4a21-b20b-a801ce80b253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:01.932541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742822c-abe2-4a21-b20b-a801ce80b253 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:01.932824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742822c-abe2-4a21-b20b-a801ce80b253 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:01.933096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2742822c-abe2-4a21-b20b-a801ce80b253 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:01.943440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742822c-abe2-4a21-b20b-a801ce80b253 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:01.945120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2742822c-abe2-4a21-b20b-a801ce80b253 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:01.961864 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-2742822c-abe2-4a21-b20b-a801ce80b253 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:55:01.961864 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:55:01.961864 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:55:01.961864 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:55:01.961864 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:55:01.961864 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:55:01.961864 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:55:01.961864 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:55:01.961864 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:55:01.961864 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:55:01.961864 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:55:01.961864 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:55:01.961864 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:55:01.961864 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:55:01.961864 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:55:01.963083 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:55:01.963083 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:55:01.963083 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:55:01.963083 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:55:01.963083 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:55:01.963083 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:55:01.963083 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:55:01.963083 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:55:01.963083 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:55:01.963083 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:55:01.963083 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:55:01.963083 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:55:01.963083 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:55:01.963083 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:55:01.963083 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:55:01.963083 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:55:01.963083 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:55:01.964270 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:55:01.964270 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:55:01.964270 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:55:01.964270 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:55:01.964270 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 629/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:55:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:55:01.969318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296d48e-b3da-487f-8107-e58dc5183bf0 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:02.068687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6296d48e-b3da-487f-8107-e58dc5183bf0 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:02.102436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73091ff6-0ace-4f8f-85c9-72b094a10808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:02.103092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73091ff6-0ace-4f8f-85c9-72b094a10808 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:02.103379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73091ff6-0ace-4f8f-85c9-72b094a10808 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:02.103653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73091ff6-0ace-4f8f-85c9-72b094a10808 None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:02.104372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73091ff6-0ace-4f8f-85c9-72b094a10808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:55:02.104677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73091ff6-0ace-4f8f-85c9-72b094a10808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:02.106079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73091ff6-0ace-4f8f-85c9-72b094a10808 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:02.117867 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 641/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:55:02.124079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742822c-abe2-4a21-b20b-a801ce80b253 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:02.156302 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:02.222504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2742822c-abe2-4a21-b20b-a801ce80b253 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:02.255552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddb363-56c5-4a0c-ae74-7413ee7cd605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:02.256339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddb363-56c5-4a0c-ae74-7413ee7cd605 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:02.256625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddb363-56c5-4a0c-ae74-7413ee7cd605 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:02.256900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eddb363-56c5-4a0c-ae74-7413ee7cd605 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:02.263304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddb363-56c5-4a0c-ae74-7413ee7cd605 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:02.265224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eddb363-56c5-4a0c-ae74-7413ee7cd605 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:02.278416 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-7eddb363-56c5-4a0c-ae74-7413ee7cd605 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:55:02.278416 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:55:02.278416 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:55:02.278416 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:55:02.278416 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:55:02.278416 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:55:02.278416 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:55:02.278416 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:55:02.278416 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:55:02.278416 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:55:02.278416 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:55:02.278416 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:55:02.278416 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:55:02.278416 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:55:02.278416 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:55:02.279496 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:55:02.279496 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:55:02.279496 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:55:02.279496 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:55:02.279496 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:55:02.279496 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:55:02.279496 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:55:02.279496 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:55:02.279496 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:55:02.279496 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:55:02.279496 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:55:02.279496 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:55:02.279496 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:55:02.279496 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:55:02.279496 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:55:02.279496 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:55:02.279496 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:55:02.281070 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:55:02.281070 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:55:02.281070 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:55:02.281070 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:55:02.281070 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:55:02.281070 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:55:02.281070 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:55:02.281070 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:55:02.281070 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 630/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:55:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:55:02.286289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73091ff6-0ace-4f8f-85c9-72b094a10808 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:02.345749 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:02.385987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73091ff6-0ace-4f8f-85c9-72b094a10808 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:02.420723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a27cb87-840e-49cb-8cbe-88360c8d0e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:02.421388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27cb87-840e-49cb-8cbe-88360c8d0e82 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:02.421678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27cb87-840e-49cb-8cbe-88360c8d0e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:02.421961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a27cb87-840e-49cb-8cbe-88360c8d0e82 None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:02.422785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27cb87-840e-49cb-8cbe-88360c8d0e82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:55:02.423100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27cb87-840e-49cb-8cbe-88360c8d0e82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:02.424530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a27cb87-840e-49cb-8cbe-88360c8d0e82 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:02.436664 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 642/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:55:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:55:02.442726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddb363-56c5-4a0c-ae74-7413ee7cd605 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:02.535202 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:02.543600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eddb363-56c5-4a0c-ae74-7413ee7cd605 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:02.576165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c07ba-306b-442c-bf80-1461d135c80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:02.577787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c07ba-306b-442c-bf80-1461d135c80d None admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:02.578074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c07ba-306b-442c-bf80-1461d135c80d None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:02.578382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c07ba-306b-442c-bf80-1461d135c80d None admin] PATH_INFO: `/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/55426ff3ba7b45d7b270b5374539a461/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:02.580342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c07ba-306b-442c-bf80-1461d135c80d None admin] RBAC: Authorizing `identity:create_grant(project_id=dfcbe281a77242bbb3774c4aacef50d4, user_id=55426ff3ba7b45d7b270b5374539a461, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:02.581761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c07ba-306b-442c-bf80-1461d135c80d None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:02.655762 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 631/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Tue Jul 19 13:55:02 2022] PUT /identity/v3/projects/dfcbe281a77242bbb3774c4aacef50d4/users/55426ff3ba7b45d7b270b5374539a461/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 13:55:04.666888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88273950-8de8-4873-b8e9-8a90fa44a899 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:04.667424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88273950-8de8-4873-b8e9-8a90fa44a899 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:04.667424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88273950-8de8-4873-b8e9-8a90fa44a899 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:04.668790 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 643/1274] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:55:04.674245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bbfac-a380-48b5-b18e-c4ad06cb0949 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:04.674647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bbfac-a380-48b5-b18e-c4ad06cb0949 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:04.674812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bbfac-a380-48b5-b18e-c4ad06cb0949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:04.691387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a39bbfac-a380-48b5-b18e-c4ad06cb0949 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:55:04.692549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a39bbfac-a380-48b5-b18e-c4ad06cb0949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:55:04.759354 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 632/1275] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:55:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:55:04.784444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88273950-8de8-4873-b8e9-8a90fa44a899 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:04.885475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88273950-8de8-4873-b8e9-8a90fa44a899 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:04.903021 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:04.919519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4d83c-ac3e-4283-b00f-01e15bb54bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:04.920357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4d83c-ac3e-4283-b00f-01e15bb54bef None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:04.920659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4d83c-ac3e-4283-b00f-01e15bb54bef None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:04.920941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd4d83c-ac3e-4283-b00f-01e15bb54bef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:04.931011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd4d83c-ac3e-4283-b00f-01e15bb54bef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 13:55:04.939126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-0cd4d83c-ac3e-4283-b00f-01e15bb54bef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:55:04.939126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:55:04.939126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:55:04.939126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:55:04.939126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:55:04.939126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:55:04.939126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:55:04.939126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:55:04.939126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:55:04.939126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:55:04.939126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:55:04.939126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:55:04.939126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 13:55:04.939126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 13:55:04.939126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 13:55:04.939126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 13:55:04.940254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 13:55:04.940254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 13:55:04.940254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 13:55:04.940254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 13:55:04.940254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:55:04.940254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:55:04.940254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:55:04.940254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:55:04.940254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:55:04.940254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:55:04.940254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:55:04.940254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:55:04.940254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:55:04.940254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:55:04.940254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:55:04.940254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:55:04.941142 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:55:04.941142 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:55:04.941142 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:55:04.941142 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:55:04.941142 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 13:55:04.941142 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 13:55:04.941142 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 13:55:04.941142 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 13:55:04.941142 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 13:55:04.941142 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 13:55:04.941142 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 13:55:04.941142 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:55:04.941142 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 644/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Tue Jul 19 13:55:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:55:04.946784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bbfac-a380-48b5-b18e-c4ad06cb0949 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:05.028266 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:05.046568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39bbfac-a380-48b5-b18e-c4ad06cb0949 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:05.082058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc616e8-d52c-406d-aaf9-2e528c31356b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:05.082759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc616e8-d52c-406d-aaf9-2e528c31356b None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:05.083045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc616e8-d52c-406d-aaf9-2e528c31356b None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:05.083328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc616e8-d52c-406d-aaf9-2e528c31356b None admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:05.084137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc616e8-d52c-406d-aaf9-2e528c31356b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:55:05.084452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc616e8-d52c-406d-aaf9-2e528c31356b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:05.085817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc616e8-d52c-406d-aaf9-2e528c31356b None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:05.094945 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 633/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Tue Jul 19 13:55:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:55:05.100756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4d83c-ac3e-4283-b00f-01e15bb54bef None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:05.201103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd4d83c-ac3e-4283-b00f-01e15bb54bef None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:05.235524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d503ba5-846f-4781-80fb-d70af93f8ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:05.236328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d503ba5-846f-4781-80fb-d70af93f8ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:05.236608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d503ba5-846f-4781-80fb-d70af93f8ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:05.236878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d503ba5-846f-4781-80fb-d70af93f8ef2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:05.247117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d503ba5-846f-4781-80fb-d70af93f8ef2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:05.249206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d503ba5-846f-4781-80fb-d70af93f8ef2 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:05.265756 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-6d503ba5-846f-4781-80fb-d70af93f8ef2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:55:05.265756 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:55:05.265756 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:55:05.265756 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:55:05.265756 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:55:05.265756 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:55:05.265756 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:55:05.265756 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:55:05.265756 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:55:05.265756 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:55:05.265756 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:55:05.265756 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:55:05.265756 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:55:05.265756 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:55:05.265756 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:55:05.266892 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:55:05.266892 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:55:05.266892 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:55:05.266892 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:55:05.266892 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:55:05.266892 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:55:05.266892 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:55:05.266892 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:55:05.266892 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:55:05.266892 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:55:05.266892 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:55:05.266892 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:55:05.266892 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:55:05.266892 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:55:05.266892 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:55:05.266892 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:55:05.266892 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:55:05.268056 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:55:05.268056 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:55:05.268056 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:55:05.268056 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:55:05.268056 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 645/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:55:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:55:05.272927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc616e8-d52c-406d-aaf9-2e528c31356b None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:05.370440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc616e8-d52c-406d-aaf9-2e528c31356b None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:05.403270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79d2a3-5c34-48b5-adb8-e06ff962828a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:05.403930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79d2a3-5c34-48b5-adb8-e06ff962828a None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:05.404218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79d2a3-5c34-48b5-adb8-e06ff962828a None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:05.404497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c79d2a3-5c34-48b5-adb8-e06ff962828a None admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:05.405748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79d2a3-5c34-48b5-adb8-e06ff962828a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:55:05.406188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79d2a3-5c34-48b5-adb8-e06ff962828a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:05.407559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c79d2a3-5c34-48b5-adb8-e06ff962828a None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:05.419925 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 634/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:55:05.426365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d503ba5-846f-4781-80fb-d70af93f8ef2 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:05.458510 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:05.525825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d503ba5-846f-4781-80fb-d70af93f8ef2 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:05.558584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfe9dd-e56e-4f6b-ad8b-7be6f17faa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:05.559369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfe9dd-e56e-4f6b-ad8b-7be6f17faa9b None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:05.559650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfe9dd-e56e-4f6b-ad8b-7be6f17faa9b None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:05.559924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdfe9dd-e56e-4f6b-ad8b-7be6f17faa9b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:05.567264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfe9dd-e56e-4f6b-ad8b-7be6f17faa9b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:05.568686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdfe9dd-e56e-4f6b-ad8b-7be6f17faa9b None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:05.583695 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-ffdfe9dd-e56e-4f6b-ad8b-7be6f17faa9b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 13:55:05.583695 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:55:05.583695 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:55:05.583695 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:55:05.583695 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:55:05.583695 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:55:05.583695 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:55:05.583695 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:55:05.583695 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:55:05.583695 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:55:05.583695 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:55:05.583695 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:55:05.583695 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 13:55:05.583695 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 13:55:05.583695 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 13:55:05.583695 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 13:55:05.586898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:55:05.586898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:55:05.586898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 13:55:05.586898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:55:05.586898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 13:55:05.586898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 13:55:05.586898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:55:05.586898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:55:05.586898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:55:05.586898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:55:05.586898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:55:05.586898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:55:05.586898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:55:05.586898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:55:05.586898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:55:05.586898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:55:05.586898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:55:05.586898 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:55:05.588085 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:55:05.588085 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:55:05.588085 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 13:55:05.588085 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 13:55:05.588085 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 13:55:05.588085 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 13:55:05.588085 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 13:55:05.588085 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 13:55:05.588085 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 13:55:05.588085 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:55:05.588085 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 646/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:55:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:55:05.590998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79d2a3-5c34-48b5-adb8-e06ff962828a None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:05.595560 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:05.688988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c79d2a3-5c34-48b5-adb8-e06ff962828a None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:05.723733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235a375-007e-47b7-8e38-67d7dc998990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:05.724333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235a375-007e-47b7-8e38-67d7dc998990 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:05.724623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235a375-007e-47b7-8e38-67d7dc998990 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:05.724908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235a375-007e-47b7-8e38-67d7dc998990 None admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:05.725751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235a375-007e-47b7-8e38-67d7dc998990 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:55:05.726065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235a375-007e-47b7-8e38-67d7dc998990 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:05.727510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235a375-007e-47b7-8e38-67d7dc998990 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:05.746127 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 635/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Tue Jul 19 13:55:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:55:05.752299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfe9dd-e56e-4f6b-ad8b-7be6f17faa9b None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:05.843795 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:05.853296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdfe9dd-e56e-4f6b-ad8b-7be6f17faa9b None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:05.887296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cbe1e-77a6-47aa-b873-d3ec54d01350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:05.887946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cbe1e-77a6-47aa-b873-d3ec54d01350 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:05.888231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cbe1e-77a6-47aa-b873-d3ec54d01350 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:05.888509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cbe1e-77a6-47aa-b873-d3ec54d01350 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:05.961515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cbe1e-77a6-47aa-b873-d3ec54d01350 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:05.963043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cbe1e-77a6-47aa-b873-d3ec54d01350 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:06.064450 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:06.076241 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 647/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Tue Jul 19 13:55:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 13:55:06.082874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235a375-007e-47b7-8e38-67d7dc998990 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:06.150797 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:06.191821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235a375-007e-47b7-8e38-67d7dc998990 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:06.232209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b7f77-1237-4245-ba7b-1f4c81c95013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:06.233019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b7f77-1237-4245-ba7b-1f4c81c95013 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:06.233301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b7f77-1237-4245-ba7b-1f4c81c95013 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:06.233575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b7f77-1237-4245-ba7b-1f4c81c95013 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:06.246032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b7f77-1237-4245-ba7b-1f4c81c95013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:06.247515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7b7f77-1237-4245-ba7b-1f4c81c95013 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:06.266968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-db7b7f77-1237-4245-ba7b-1f4c81c95013 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:55:06.266968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:55:06.266968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:55:06.266968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:55:06.266968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:55:06.266968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:55:06.266968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:55:06.266968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:55:06.266968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:55:06.266968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:55:06.266968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:55:06.266968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:55:06.266968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 13:55:06.266968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 13:55:06.266968 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 13:55:06.268053 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 13:55:06.268053 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:55:06.268053 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:55:06.268053 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:55:06.268053 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:55:06.268053 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:55:06.268053 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:55:06.268053 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:55:06.268053 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:55:06.268053 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:55:06.268053 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:55:06.268053 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:55:06.268053 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:55:06.268053 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:55:06.268053 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:55:06.268053 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:55:06.268053 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:55:06.268991 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 13:55:06.268991 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 13:55:06.268991 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 13:55:06.268991 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:55:06.268991 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 636/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 13:55:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:55:06.274316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cbe1e-77a6-47aa-b873-d3ec54d01350 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:06.384638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cbe1e-77a6-47aa-b873-d3ec54d01350 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:06.422453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b1385-4ade-484a-8f78-89b8e7a86d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:06.422661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b1385-4ade-484a-8f78-89b8e7a86d0c None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:06.422897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b1385-4ade-484a-8f78-89b8e7a86d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:06.423170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b1385-4ade-484a-8f78-89b8e7a86d0c None admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:06.423896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b1385-4ade-484a-8f78-89b8e7a86d0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:55:06.424202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b1385-4ade-484a-8f78-89b8e7a86d0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:06.425561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b1385-4ade-484a-8f78-89b8e7a86d0c None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:06.437999 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 648/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Tue Jul 19 13:55:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:55:06.444062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b7f77-1237-4245-ba7b-1f4c81c95013 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:06.545507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b7f77-1237-4245-ba7b-1f4c81c95013 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:06.560227 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:06.581228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724d27e-50f3-4b34-acdc-32c1a33de049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:06.582043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724d27e-50f3-4b34-acdc-32c1a33de049 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:06.582381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724d27e-50f3-4b34-acdc-32c1a33de049 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:06.582663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724d27e-50f3-4b34-acdc-32c1a33de049 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:06.589577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7724d27e-50f3-4b34-acdc-32c1a33de049 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:06.591065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7724d27e-50f3-4b34-acdc-32c1a33de049 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:06.606152 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-7724d27e-50f3-4b34-acdc-32c1a33de049 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:55:06.606152 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:55:06.606152 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:55:06.606152 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:55:06.606152 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:55:06.606152 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:55:06.606152 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:55:06.606152 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:55:06.606152 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:55:06.606152 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:55:06.606152 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:55:06.606152 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:55:06.606152 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 13:55:06.606152 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 13:55:06.606152 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 13:55:06.607269 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 13:55:06.607269 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:55:06.607269 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:55:06.607269 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:55:06.607269 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:55:06.607269 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:55:06.607269 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:55:06.607269 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:55:06.607269 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 13:55:06.607269 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:55:06.607269 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:55:06.607269 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:55:06.607269 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:55:06.607269 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:55:06.607269 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:55:06.607269 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:55:06.607269 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:55:06.608732 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 13:55:06.608732 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 13:55:06.608732 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 13:55:06.608732 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 13:55:06.608732 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 13:55:06.608732 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 13:55:06.608732 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 13:55:06.608732 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 13:55:06.608732 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 637/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Tue Jul 19 13:55:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 13:55:06.616533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b1385-4ade-484a-8f78-89b8e7a86d0c None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:06.668191 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:06.737200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b1385-4ade-484a-8f78-89b8e7a86d0c None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:06.772042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e61b13-324d-49c7-b978-48a56a2ecbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:06.772745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e61b13-324d-49c7-b978-48a56a2ecbbb None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:06.776487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e61b13-324d-49c7-b978-48a56a2ecbbb None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:06.776487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e61b13-324d-49c7-b978-48a56a2ecbbb None admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:06.776487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e61b13-324d-49c7-b978-48a56a2ecbbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:55:06.776487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e61b13-324d-49c7-b978-48a56a2ecbbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:06.776487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e61b13-324d-49c7-b978-48a56a2ecbbb None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:06.789043 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 649/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Tue Jul 19 13:55:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:55:06.799515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724d27e-50f3-4b34-acdc-32c1a33de049 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:06.894731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724d27e-50f3-4b34-acdc-32c1a33de049 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:06.929870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf28e8-a4a6-43c1-940a-1f5047c12083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:06.930494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf28e8-a4a6-43c1-940a-1f5047c12083 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:06.930779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf28e8-a4a6-43c1-940a-1f5047c12083 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:06.931060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf28e8-a4a6-43c1-940a-1f5047c12083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:06.931892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf28e8-a4a6-43c1-940a-1f5047c12083 None admin] RBAC: Adding query filter params (role.id=bc315edf089d43b18acf9790031f3fcb, scope.project.id=dfcbe281a77242bbb3774c4aacef50d4, user.id=55426ff3ba7b45d7b270b5374539a461) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:55:06.932198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf28e8-a4a6-43c1-940a-1f5047c12083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:06.933621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf28e8-a4a6-43c1-940a-1f5047c12083 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:06.940655 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 638/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Tue Jul 19 13:55:06 2022] GET /identity/v3/role_assignments?user.id=55426ff3ba7b45d7b270b5374539a461&scope.project.id=dfcbe281a77242bbb3774c4aacef50d4&role.id=bc315edf089d43b18acf9790031f3fcb => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:55:09.061245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31f4b9-63ff-4971-a631-6ed6c52e2fe8 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:09.061865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31f4b9-63ff-4971-a631-6ed6c52e2fe8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:09.061865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31f4b9-63ff-4971-a631-6ed6c52e2fe8 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:09.064040 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 650/1288] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:55:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:55:09.069132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b38850-2aa1-4172-8664-bf9878f823e5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:09.069568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b38850-2aa1-4172-8664-bf9878f823e5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:09.069989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b38850-2aa1-4172-8664-bf9878f823e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:09.087505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-57b38850-2aa1-4172-8664-bf9878f823e5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:55:09.088666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-57b38850-2aa1-4172-8664-bf9878f823e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:55:09.117426 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:09.154220 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 639/1289] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:55:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:55:09.177753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31f4b9-63ff-4971-a631-6ed6c52e2fe8 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:09.279520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31f4b9-63ff-4971-a631-6ed6c52e2fe8 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:09.290757 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:09.313829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70eca7-8d06-4d5f-9bc3-7d19853e6be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:09.314599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70eca7-8d06-4d5f-9bc3-7d19853e6be3 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:09.314882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70eca7-8d06-4d5f-9bc3-7d19853e6be3 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:09.315165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f70eca7-8d06-4d5f-9bc3-7d19853e6be3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:09.315815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70eca7-8d06-4d5f-9bc3-7d19853e6be3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:09.317171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f70eca7-8d06-4d5f-9bc3-7d19853e6be3 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:09.329705 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-9f70eca7-8d06-4d5f-9bc3-7d19853e6be3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 13:55:09.329705 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:55:09.329705 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:55:09.329705 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:55:09.329705 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:55:09.329705 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:55:09.329705 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:55:09.329705 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:55:09.329705 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 13:55:09.329705 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:55:09.329705 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:55:09.329705 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:55:09.329705 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:55:09.329705 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:55:09.329705 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:55:09.329705 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:55:09.329705 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:55:09.335997 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:55:09.335997 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:55:09.335997 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:55:09.335997 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:55:09.335997 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:55:09.335997 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:55:09.335997 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:55:09.335997 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:55:09.335997 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:55:09.335997 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:55:09.335997 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:55:09.335997 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:55:09.335997 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:55:09.335997 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:55:09.335997 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:55:09.335997 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:55:09.337080 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:55:09.337080 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:55:09.337080 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:55:09.337080 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:55:09.337080 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:55:09.337080 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:55:09.337080 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:55:09.337080 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:55:09.337080 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:55:09.337080 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:55:09.337080 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:55:09.337080 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:55:09.337080 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 13:55:09.337080 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:55:09.337080 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 651/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jul 19 13:55:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:55:09.338121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b38850-2aa1-4172-8664-bf9878f823e5 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:09.432814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b38850-2aa1-4172-8664-bf9878f823e5 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:09.466654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4183a-2930-4b7c-8563-b58b9ca0a5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:09.467314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4183a-2930-4b7c-8563-b58b9ca0a5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:09.467600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4183a-2930-4b7c-8563-b58b9ca0a5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:09.467903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4183a-2930-4b7c-8563-b58b9ca0a5c1 None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:09.468635 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4183a-2930-4b7c-8563-b58b9ca0a5c1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:55:09.468938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4183a-2930-4b7c-8563-b58b9ca0a5c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:09.470312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4183a-2930-4b7c-8563-b58b9ca0a5c1 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:09.475182 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 640/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Jul 19 13:55:09 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:55:09.480957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70eca7-8d06-4d5f-9bc3-7d19853e6be3 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:09.580578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f70eca7-8d06-4d5f-9bc3-7d19853e6be3 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:09.613035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e54ef3-8e9b-4cb9-840e-2891eaf20503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:09.613683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e54ef3-8e9b-4cb9-840e-2891eaf20503 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:09.613973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e54ef3-8e9b-4cb9-840e-2891eaf20503 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:09.614277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e54ef3-8e9b-4cb9-840e-2891eaf20503 None admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:09.614970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e54ef3-8e9b-4cb9-840e-2891eaf20503 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:55:09.615274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e54ef3-8e9b-4cb9-840e-2891eaf20503 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:09.616618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e54ef3-8e9b-4cb9-840e-2891eaf20503 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:09.621001 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 652/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Jul 19 13:55:09 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:55:11.657332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c17dc-618e-4fc1-bbc6-c3964d034a54 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:11.657834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c17dc-618e-4fc1-bbc6-c3964d034a54 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:11.657834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c17dc-618e-4fc1-bbc6-c3964d034a54 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:11.659221 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 641/1293] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:55:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:55:11.664454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cd871-7b11-4ba8-9094-6acdfcc80da4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:11.664853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cd871-7b11-4ba8-9094-6acdfcc80da4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:11.665006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cd871-7b11-4ba8-9094-6acdfcc80da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:11.682065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-182cd871-7b11-4ba8-9094-6acdfcc80da4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:55:11.683271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-182cd871-7b11-4ba8-9094-6acdfcc80da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:55:11.712053 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:11.748434 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 653/1294] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:55:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:55:11.770887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c17dc-618e-4fc1-bbc6-c3964d034a54 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:11.806033 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:11.875976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c17dc-618e-4fc1-bbc6-c3964d034a54 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:11.909188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5461d0c1-25cf-4769-8a56-bbcab63d39c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:11.909783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461d0c1-25cf-4769-8a56-bbcab63d39c4 None admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:11.910065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461d0c1-25cf-4769-8a56-bbcab63d39c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:11.910370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5461d0c1-25cf-4769-8a56-bbcab63d39c4 None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:11.911092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461d0c1-25cf-4769-8a56-bbcab63d39c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:11.912472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5461d0c1-25cf-4769-8a56-bbcab63d39c4 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:12.102131 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 642/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Tue Jul 19 13:55:11 2022] POST /identity/v3/services => generated 246 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 13:55:14.151359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a24996-da84-4cb1-bd19-3bf6e1152816 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:14.151894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a24996-da84-4cb1-bd19-3bf6e1152816 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:14.151894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a24996-da84-4cb1-bd19-3bf6e1152816 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:14.153280 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 654/1296] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:55:14.159558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c9c12-8101-4067-8fa2-4ee388e48ca1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:14.161742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c9c12-8101-4067-8fa2-4ee388e48ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:14.161742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c9c12-8101-4067-8fa2-4ee388e48ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:14.177427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e85c9c12-8101-4067-8fa2-4ee388e48ca1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:55:14.180654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e85c9c12-8101-4067-8fa2-4ee388e48ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:55:14.251658 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 643/1297] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:55:14 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:55:14.274725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a24996-da84-4cb1-bd19-3bf6e1152816 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:14.376454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a24996-da84-4cb1-bd19-3bf6e1152816 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:14.416297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46536d87-2621-4e56-b541-8099793c556d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:14.417101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46536d87-2621-4e56-b541-8099793c556d None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:14.417383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46536d87-2621-4e56-b541-8099793c556d None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:14.417657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46536d87-2621-4e56-b541-8099793c556d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:14.418339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46536d87-2621-4e56-b541-8099793c556d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:14.419695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46536d87-2621-4e56-b541-8099793c556d None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:14.432218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-46536d87-2621-4e56-b541-8099793c556d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 13:55:14.432218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:55:14.432218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:55:14.432218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:55:14.432218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:55:14.432218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:55:14.432218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:55:14.432218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:55:14.432218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 13:55:14.432218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:55:14.432218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:55:14.432218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:55:14.432218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:55:14.432218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:55:14.432218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:55:14.432218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:55:14.432218 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:55:14.433394 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:55:14.433394 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:55:14.433394 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:55:14.433394 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:55:14.433394 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:55:14.433394 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:55:14.433394 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:55:14.433394 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:55:14.433394 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:55:14.433394 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:55:14.433394 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:55:14.433394 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:55:14.433394 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:55:14.433394 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:55:14.433394 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:55:14.433394 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:55:14.434456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:55:14.434456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:55:14.434456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:55:14.434456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:55:14.434456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:55:14.434456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:55:14.434456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:55:14.434456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:55:14.434456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:55:14.434456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:55:14.434456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:55:14.434456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:55:14.434456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 13:55:14.434456 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:55:14.434456 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 655/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jul 19 13:55:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:55:14.440021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c9c12-8101-4067-8fa2-4ee388e48ca1 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:14.459635 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:14.539246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c9c12-8101-4067-8fa2-4ee388e48ca1 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:14.572809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb8475-6e9f-4dfc-aba6-ee17c80155c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:14.573471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb8475-6e9f-4dfc-aba6-ee17c80155c9 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:14.573755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb8475-6e9f-4dfc-aba6-ee17c80155c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:14.574035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb8475-6e9f-4dfc-aba6-ee17c80155c9 None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:14.574772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb8475-6e9f-4dfc-aba6-ee17c80155c9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:55:14.575079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb8475-6e9f-4dfc-aba6-ee17c80155c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:14.576437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb8475-6e9f-4dfc-aba6-ee17c80155c9 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:14.582717 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 644/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Jul 19 13:55:14 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:55:14.588231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46536d87-2621-4e56-b541-8099793c556d None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:14.619410 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:14.689713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46536d87-2621-4e56-b541-8099793c556d None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:14.724702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abc173-9eea-4507-8c22-e93ec8daafe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:14.725430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abc173-9eea-4507-8c22-e93ec8daafe4 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:14.725790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abc173-9eea-4507-8c22-e93ec8daafe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:14.726083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abc173-9eea-4507-8c22-e93ec8daafe4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:14.726919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abc173-9eea-4507-8c22-e93ec8daafe4 None admin] RBAC: Adding query filter params (interface=public, service_id=ba1363d6430b43319ea7ae5a63261d01, region_id=RegionOne) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:55:14.727288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abc173-9eea-4507-8c22-e93ec8daafe4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:14.728653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abc173-9eea-4507-8c22-e93ec8daafe4 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:14.733826 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 656/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Tue Jul 19 13:55:14 2022] GET /identity/v3/endpoints?service_id=ba1363d6430b43319ea7ae5a63261d01&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:55:14.739659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb8475-6e9f-4dfc-aba6-ee17c80155c9 None admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:14.820800 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:14.838519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb8475-6e9f-4dfc-aba6-ee17c80155c9 None admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:14.871824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ad6f53-7d53-4796-8bad-91d2b5b1a535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:14.872483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad6f53-7d53-4796-8bad-91d2b5b1a535 None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:14.872771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad6f53-7d53-4796-8bad-91d2b5b1a535 None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:14.873051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ad6f53-7d53-4796-8bad-91d2b5b1a535 None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:14.873734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad6f53-7d53-4796-8bad-91d2b5b1a535 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:14.875818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ad6f53-7d53-4796-8bad-91d2b5b1a535 None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:14.882774 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 645/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Tue Jul 19 13:55:14 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 13:55:16.910364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00294f4-bdc7-45b0-9268-591f49e7b94c None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:16.910896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00294f4-bdc7-45b0-9268-591f49e7b94c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:16.910896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00294f4-bdc7-45b0-9268-591f49e7b94c None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:16.912322 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 657/1302] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 13:55:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 13:55:16.917509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646896e2-8236-4e44-875c-15a0b66da4cb None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:16.917915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646896e2-8236-4e44-875c-15a0b66da4cb None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:16.918091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646896e2-8236-4e44-875c-15a0b66da4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:16.934759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-646896e2-8236-4e44-875c-15a0b66da4cb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 13:55:16.935923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-646896e2-8236-4e44-875c-15a0b66da4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 13:55:17.002617 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 646/1303] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 13:55:16 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 13:55:17.026580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00294f4-bdc7-45b0-9268-591f49e7b94c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:17.118392 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:17.125416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00294f4-bdc7-45b0-9268-591f49e7b94c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:17.158762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9b679-0330-47ae-8815-9c66a2b96ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:17.159564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9b679-0330-47ae-8815-9c66a2b96ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:17.159848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9b679-0330-47ae-8815-9c66a2b96ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:17.160125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c9b679-0330-47ae-8815-9c66a2b96ba4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:17.160855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9b679-0330-47ae-8815-9c66a2b96ba4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:17.162162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c9b679-0330-47ae-8815-9c66a2b96ba4 None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:17.174158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-09c9b679-0330-47ae-8815-9c66a2b96ba4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 13:55:17.174158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:55:17.174158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 13:55:17.174158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 13:55:17.174158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 13:55:17.174158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 13:55:17.174158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 13:55:17.174158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:55:17.174158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 13:55:17.174158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:55:17.174158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 13:55:17.174158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:55:17.174158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 13:55:17.174158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 13:55:17.174158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 13:55:17.174158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 13:55:17.174158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 13:55:17.179877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 13:55:17.179877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 13:55:17.179877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 13:55:17.179877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 13:55:17.179877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 13:55:17.179877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 13:55:17.179877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 13:55:17.179877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 13:55:17.179877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 13:55:17.179877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 13:55:17.179877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 13:55:17.179877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 13:55:17.179877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 13:55:17.179877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 13:55:17.179877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 13:55:17.179877 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 13:55:17.180792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 13:55:17.180792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 13:55:17.180792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 13:55:17.180792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 13:55:17.180792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 13:55:17.180792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 13:55:17.180792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 13:55:17.180792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 13:55:17.180792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 13:55:17.180792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 13:55:17.180792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 13:55:17.180792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 13:55:17.180792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 13:55:17.180792 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 13:55:17.180792 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 658/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Tue Jul 19 13:55:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 13:55:17.182000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646896e2-8236-4e44-875c-15a0b66da4cb None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:17.258722 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:17.280503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646896e2-8236-4e44-875c-15a0b66da4cb None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:17.314153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260db90d-285d-4354-b34b-37e00978dd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:17.314817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260db90d-285d-4354-b34b-37e00978dd3f None admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:17.315102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260db90d-285d-4354-b34b-37e00978dd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:17.315417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260db90d-285d-4354-b34b-37e00978dd3f None admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:17.316122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260db90d-285d-4354-b34b-37e00978dd3f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 13:55:17.316427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260db90d-285d-4354-b34b-37e00978dd3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:17.317818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260db90d-285d-4354-b34b-37e00978dd3f None admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:17.323123 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 647/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Tue Jul 19 13:55:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 13:55:17.329324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9b679-0330-47ae-8815-9c66a2b96ba4 None admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 13:55:17.427696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c9b679-0330-47ae-8815-9c66a2b96ba4 None admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 13:55:17.460313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f1f45-2284-4605-97e2-6aa1f8cba57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 13:55:17.460959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f1f45-2284-4605-97e2-6aa1f8cba57b None admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 13:55:17.461242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f1f45-2284-4605-97e2-6aa1f8cba57b None admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 13:55:17.461514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f1f45-2284-4605-97e2-6aa1f8cba57b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 13:55:17.462292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f1f45-2284-4605-97e2-6aa1f8cba57b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 13:55:17.463633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f1f45-2284-4605-97e2-6aa1f8cba57b None admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 13:55:17.548187 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 659/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Tue Jul 19 13:55:17 2022] POST /identity/v3/endpoints => generated 331 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 13:55:27.328422 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=30 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 13:55:27.543221 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:08.685038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0125654-72a1-4870-b050-f7209595e28c None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:08.686598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0125654-72a1-4870-b050-f7209595e28c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:08.687758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0125654-72a1-4870-b050-f7209595e28c None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:08.699705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a3290-0747-445b-bc5a-f145f8b00784 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:08.700168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a3290-0747-445b-bc5a-f145f8b00784 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:08.700462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a3290-0747-445b-bc5a-f145f8b00784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:08.703878 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 648/1307] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:01:08 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:01:08.793734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-065a3290-0747-445b-bc5a-f145f8b00784 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:01:08.795386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-065a3290-0747-445b-bc5a-f145f8b00784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:08.933199 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 660/1308] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:01:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:01:09.002567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a02ba9-1089-4985-9385-1726099451f9 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:09.006227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a02ba9-1089-4985-9385-1726099451f9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:09.006227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a02ba9-1089-4985-9385-1726099451f9 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:09.006227 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 649/1309] 10.222.0.43 () {54 vars in 965 bytes} [Tue Jul 19 14:01:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:01:09.012526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b032d-7677-4ed6-a3c7-81605a1f1c35 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:09.012891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b032d-7677-4ed6-a3c7-81605a1f1c35 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:09.013236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b032d-7677-4ed6-a3c7-81605a1f1c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:09.105291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-599b032d-7677-4ed6-a3c7-81605a1f1c35 None None] MFA Rules not processed for user `e997b70d7158446daa1dfa225eb7afca`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:01:09.106872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-599b032d-7677-4ed6-a3c7-81605a1f1c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:09.131202 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:09.198082 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 661/1310] 10.222.0.43 () {58 vars in 1062 bytes} [Tue Jul 19 14:01:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:01:09.208724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a02ba9-1089-4985-9385-1726099451f9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:01:09.211029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b4a02ba9-1089-4985-9385-1726099451f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:09.349061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a02ba9-1089-4985-9385-1726099451f9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:01:09.436154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825a49d-7beb-4e7b-b11b-05f3171c1951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:01:09.437134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825a49d-7beb-4e7b-b11b-05f3171c1951 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:09.437633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825a49d-7beb-4e7b-b11b-05f3171c1951 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:09.438124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825a49d-7beb-4e7b-b11b-05f3171c1951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:09.440267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0825a49d-7beb-4e7b-b11b-05f3171c1951 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:09.503645 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:09.568207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825a49d-7beb-4e7b-b11b-05f3171c1951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:01:09.570071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825a49d-7beb-4e7b-b11b-05f3171c1951 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:01:09.594700 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 650/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:01:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:01:12.009085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd594e1d-d9eb-4a31-b7d4-7322f72ab5f2 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:12.009670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd594e1d-d9eb-4a31-b7d4-7322f72ab5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:12.009670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd594e1d-d9eb-4a31-b7d4-7322f72ab5f2 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:12.011063 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 662/1312] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:01:12.016218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8749f-a056-4691-86ce-2afe2f515d97 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:12.017200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8749f-a056-4691-86ce-2afe2f515d97 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:12.017871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8749f-a056-4691-86ce-2afe2f515d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:12.100229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-eef8749f-a056-4691-86ce-2afe2f515d97 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:01:12.101736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eef8749f-a056-4691-86ce-2afe2f515d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:12.200920 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 651/1313] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:01:12.241838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd594e1d-d9eb-4a31-b7d4-7322f72ab5f2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:01:12.243423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fd594e1d-d9eb-4a31-b7d4-7322f72ab5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:12.355188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd594e1d-d9eb-4a31-b7d4-7322f72ab5f2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:01:12.433248 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:12.436262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e16e4-58d1-4b87-be97-2fc83a42e39f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:01:12.436927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e16e4-58d1-4b87-be97-2fc83a42e39f service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:12.437210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e16e4-58d1-4b87-be97-2fc83a42e39f service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:12.437484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e16e4-58d1-4b87-be97-2fc83a42e39f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:12.439320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e18e16e4-58d1-4b87-be97-2fc83a42e39f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:12.560550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e16e4-58d1-4b87-be97-2fc83a42e39f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:01:12.561986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e16e4-58d1-4b87-be97-2fc83a42e39f service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:01:12.582542 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 663/1314] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:01:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:01:15.093047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab931058-0307-4d5d-8f4b-c52f9cb8c72a None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:15.093582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab931058-0307-4d5d-8f4b-c52f9cb8c72a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:15.093582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab931058-0307-4d5d-8f4b-c52f9cb8c72a None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:15.095140 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 652/1315] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:01:15.100345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45830b9c-997c-44b9-9991-62c5a2f83746 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:15.100766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45830b9c-997c-44b9-9991-62c5a2f83746 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:15.100899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45830b9c-997c-44b9-9991-62c5a2f83746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:15.165052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-45830b9c-997c-44b9-9991-62c5a2f83746 None None] MFA Rules not processed for user `66c3af913fab4b349ffa0c81a1cd84a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:01:15.166288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-45830b9c-997c-44b9-9991-62c5a2f83746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:15.218348 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:15.263381 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 664/1316] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:01:15 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:01:15.304270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab931058-0307-4d5d-8f4b-c52f9cb8c72a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:01:15.305794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ab931058-0307-4d5d-8f4b-c52f9cb8c72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:15.315682 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:15.409638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab931058-0307-4d5d-8f4b-c52f9cb8c72a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:01:15.482894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f4540-61e3-4bb1-9cb6-1d585e3d3c76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:01:15.483542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f4540-61e3-4bb1-9cb6-1d585e3d3c76 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:15.483830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f4540-61e3-4bb1-9cb6-1d585e3d3c76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:15.484109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f4540-61e3-4bb1-9cb6-1d585e3d3c76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:15.486482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-797f4540-61e3-4bb1-9cb6-1d585e3d3c76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:15.548714 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:15.595564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f4540-61e3-4bb1-9cb6-1d585e3d3c76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:01:15.597184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f4540-61e3-4bb1-9cb6-1d585e3d3c76 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:01:15.615535 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 653/1317] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:01:15 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:01:18.472783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eab797-55af-42ba-b377-75388ecb38b9 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:18.473320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eab797-55af-42ba-b377-75388ecb38b9 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:18.473320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eab797-55af-42ba-b377-75388ecb38b9 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:18.474709 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 665/1318] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:01:18.479871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8eb44-cb05-48a0-8b5e-08b8d585fbd1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:18.480296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8eb44-cb05-48a0-8b5e-08b8d585fbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:18.480438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8eb44-cb05-48a0-8b5e-08b8d585fbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:18.543340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a4e8eb44-cb05-48a0-8b5e-08b8d585fbd1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:01:18.544535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a4e8eb44-cb05-48a0-8b5e-08b8d585fbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:18.637050 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 654/1319] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:01:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:01:18.678215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eab797-55af-42ba-b377-75388ecb38b9 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:01:18.679746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e4eab797-55af-42ba-b377-75388ecb38b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:18.781578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eab797-55af-42ba-b377-75388ecb38b9 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:01:18.853471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256ae2c-c79f-422a-982e-f6316613f255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:01:18.854129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256ae2c-c79f-422a-982e-f6316613f255 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:18.854421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256ae2c-c79f-422a-982e-f6316613f255 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:18.854697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256ae2c-c79f-422a-982e-f6316613f255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:18.856325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9256ae2c-c79f-422a-982e-f6316613f255 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:18.863773 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:18.963923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256ae2c-c79f-422a-982e-f6316613f255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:01:18.965352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9256ae2c-c79f-422a-982e-f6316613f255 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:01:18.983937 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 666/1320] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:01:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:01:21.926468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a67222-6ba7-45ab-901a-0f16bfbd3179 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:21.927052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a67222-6ba7-45ab-901a-0f16bfbd3179 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:21.927052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a67222-6ba7-45ab-901a-0f16bfbd3179 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:21.928412 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 655/1321] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:01:21.933618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc6423-c31e-43af-95e9-7a68a006f4c6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:21.934048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc6423-c31e-43af-95e9-7a68a006f4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:21.934360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc6423-c31e-43af-95e9-7a68a006f4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:21.999837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1edc6423-c31e-43af-95e9-7a68a006f4c6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:01:22.001655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1edc6423-c31e-43af-95e9-7a68a006f4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:22.058556 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:22.098714 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 667/1322] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:01:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:01:22.134407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a67222-6ba7-45ab-901a-0f16bfbd3179 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:01:22.135921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a5a67222-6ba7-45ab-901a-0f16bfbd3179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:22.155372 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:22.247887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a67222-6ba7-45ab-901a-0f16bfbd3179 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:01:22.328638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6f40b-76da-4252-81ba-70d817fc77b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:01:22.329843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6f40b-76da-4252-81ba-70d817fc77b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:22.330144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6f40b-76da-4252-81ba-70d817fc77b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:22.330425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6f40b-76da-4252-81ba-70d817fc77b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:22.332128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-94e6f40b-76da-4252-81ba-70d817fc77b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:22.407490 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:22.447112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6f40b-76da-4252-81ba-70d817fc77b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:01:22.448559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6f40b-76da-4252-81ba-70d817fc77b3 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:01:22.468165 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 656/1323] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:01:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:01:24.577369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c4d76-b700-42e7-8c23-6bbf59f9766b None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:24.577890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c4d76-b700-42e7-8c23-6bbf59f9766b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:24.577890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c4d76-b700-42e7-8c23-6bbf59f9766b None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:24.579539 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 668/1324] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:01:24.584861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4b825-6506-42ca-b9d4-f905293aacb6 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:24.585288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4b825-6506-42ca-b9d4-f905293aacb6 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:24.585414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4b825-6506-42ca-b9d4-f905293aacb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:24.648348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b6d4b825-6506-42ca-b9d4-f905293aacb6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:01:24.649531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b6d4b825-6506-42ca-b9d4-f905293aacb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:24.746618 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 657/1325] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:01:24.783165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c4d76-b700-42e7-8c23-6bbf59f9766b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:01:24.784829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ab3c4d76-b700-42e7-8c23-6bbf59f9766b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:24.888552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c4d76-b700-42e7-8c23-6bbf59f9766b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:01:24.963380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a3320-d935-4e48-abf6-958bb2988b50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:01:24.964030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a3320-d935-4e48-abf6-958bb2988b50 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:24.964317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a3320-d935-4e48-abf6-958bb2988b50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:24.964623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a3320-d935-4e48-abf6-958bb2988b50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:24.966301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5a6a3320-d935-4e48-abf6-958bb2988b50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:24.983989 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:25.077803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a3320-d935-4e48-abf6-958bb2988b50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:01:25.079350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6a3320-d935-4e48-abf6-958bb2988b50 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:01:25.100422 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 669/1326] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:01:27.246145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575bb29-e9a7-4ad4-9f64-3b4de9fd5502 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:27.246709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575bb29-e9a7-4ad4-9f64-3b4de9fd5502 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:27.246709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575bb29-e9a7-4ad4-9f64-3b4de9fd5502 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:27.248278 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 658/1327] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:01:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:01:27.255292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc4d28-ad5d-4c7e-8523-232baae9526c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:27.255848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc4d28-ad5d-4c7e-8523-232baae9526c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:27.255848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bc4d28-ad5d-4c7e-8523-232baae9526c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:27.322979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-78bc4d28-ad5d-4c7e-8523-232baae9526c None None] MFA Rules not processed for user `66c3af913fab4b349ffa0c81a1cd84a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:01:27.324177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-78bc4d28-ad5d-4c7e-8523-232baae9526c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:27.389481 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:27.421193 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 670/1328] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:01:27 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:01:27.460176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575bb29-e9a7-4ad4-9f64-3b4de9fd5502 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:01:27.461686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3575bb29-e9a7-4ad4-9f64-3b4de9fd5502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:27.494292 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:27.572146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575bb29-e9a7-4ad4-9f64-3b4de9fd5502 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:01:27.645853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78a601-6e62-4dd6-84a9-3ac1d18fcd69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:01:27.646544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78a601-6e62-4dd6-84a9-3ac1d18fcd69 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:27.646830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78a601-6e62-4dd6-84a9-3ac1d18fcd69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:27.647109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78a601-6e62-4dd6-84a9-3ac1d18fcd69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:27.648735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6d78a601-6e62-4dd6-84a9-3ac1d18fcd69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:27.727469 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:27.760765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78a601-6e62-4dd6-84a9-3ac1d18fcd69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:01:27.762686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d78a601-6e62-4dd6-84a9-3ac1d18fcd69 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:01:27.782861 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 659/1329] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:01:27 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:01:30.302817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fe864-80c5-4317-a447-3932a73b1ea6 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:30.303362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fe864-80c5-4317-a447-3932a73b1ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:30.303362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fe864-80c5-4317-a447-3932a73b1ea6 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:30.304758 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 671/1330] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:01:30.310008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723b34f-4d36-44c6-aa7b-f1eb38808b32 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:30.310410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723b34f-4d36-44c6-aa7b-f1eb38808b32 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:30.310603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723b34f-4d36-44c6-aa7b-f1eb38808b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:30.375840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8723b34f-4d36-44c6-aa7b-f1eb38808b32 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:01:30.377633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8723b34f-4d36-44c6-aa7b-f1eb38808b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:30.475409 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 660/1331] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:01:30.512043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fe864-80c5-4317-a447-3932a73b1ea6 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:01:30.513579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-889fe864-80c5-4317-a447-3932a73b1ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:30.615760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fe864-80c5-4317-a447-3932a73b1ea6 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:01:30.686608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34dcb44-e408-4eea-a14b-deb3dbaf2fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:01:30.687257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dcb44-e408-4eea-a14b-deb3dbaf2fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:30.687542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dcb44-e408-4eea-a14b-deb3dbaf2fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:30.687820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34dcb44-e408-4eea-a14b-deb3dbaf2fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:30.690200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e34dcb44-e408-4eea-a14b-deb3dbaf2fd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:30.717384 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:30.817695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34dcb44-e408-4eea-a14b-deb3dbaf2fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:01:30.819174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34dcb44-e408-4eea-a14b-deb3dbaf2fd9 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:01:30.838803 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 672/1332] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:01:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:01:32.928210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe72fc6-8e02-49d1-8d6a-0b09c1e9464f None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:32.928796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe72fc6-8e02-49d1-8d6a-0b09c1e9464f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:32.928796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe72fc6-8e02-49d1-8d6a-0b09c1e9464f None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:32.930168 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 661/1333] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:01:32.935282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14db44-bf2d-4975-9e6a-330b87387152 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:32.935683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14db44-bf2d-4975-9e6a-330b87387152 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:32.935838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14db44-bf2d-4975-9e6a-330b87387152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:33.001754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5d14db44-bf2d-4975-9e6a-330b87387152 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:01:33.002928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5d14db44-bf2d-4975-9e6a-330b87387152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:33.077727 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:33.100773 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 673/1334] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:01:33.142312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe72fc6-8e02-49d1-8d6a-0b09c1e9464f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:01:33.144140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-efe72fc6-8e02-49d1-8d6a-0b09c1e9464f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:33.185781 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:33.253772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe72fc6-8e02-49d1-8d6a-0b09c1e9464f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:01:33.326425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8180c0f5-6b66-4667-a78f-f78606edc5c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:01:33.327068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180c0f5-6b66-4667-a78f-f78606edc5c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:33.327350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180c0f5-6b66-4667-a78f-f78606edc5c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:33.327623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8180c0f5-6b66-4667-a78f-f78606edc5c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:33.329905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8180c0f5-6b66-4667-a78f-f78606edc5c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:33.414634 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:33.440910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180c0f5-6b66-4667-a78f-f78606edc5c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:01:33.442389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8180c0f5-6b66-4667-a78f-f78606edc5c5 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:01:33.460767 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 662/1335] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:01:35.997253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d715d-cb29-41b5-a81f-8bdf4d0690bf None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:35.997838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d715d-cb29-41b5-a81f-8bdf4d0690bf None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:35.997838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d715d-cb29-41b5-a81f-8bdf4d0690bf None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:35.999221 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 674/1336] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:01:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:01:36.004608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e38a23-7d00-42e5-898e-829664fb3b03 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:36.005030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e38a23-7d00-42e5-898e-829664fb3b03 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:36.005206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e38a23-7d00-42e5-898e-829664fb3b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:36.081151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f1e38a23-7d00-42e5-898e-829664fb3b03 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:01:36.082372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f1e38a23-7d00-42e5-898e-829664fb3b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:36.178966 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 663/1337] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:01:36 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:01:36.216068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d715d-cb29-41b5-a81f-8bdf4d0690bf None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:01:36.217612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1c6d715d-cb29-41b5-a81f-8bdf4d0690bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:36.322048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d715d-cb29-41b5-a81f-8bdf4d0690bf None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:01:36.397120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95036fb3-4981-4d36-95d9-cfa56b5083ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:01:36.397761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95036fb3-4981-4d36-95d9-cfa56b5083ee service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:36.398043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95036fb3-4981-4d36-95d9-cfa56b5083ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:36.398348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95036fb3-4981-4d36-95d9-cfa56b5083ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:36.400081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-95036fb3-4981-4d36-95d9-cfa56b5083ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:36.434790 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:36.507259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95036fb3-4981-4d36-95d9-cfa56b5083ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:01:36.508748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95036fb3-4981-4d36-95d9-cfa56b5083ee service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:01:36.531584 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 675/1338] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:01:36 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:01:40.724621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb263cd4-d57c-4f6b-9994-9a7dda8262f3 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:40.724621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb263cd4-d57c-4f6b-9994-9a7dda8262f3 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:40.724621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb263cd4-d57c-4f6b-9994-9a7dda8262f3 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:40.726071 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 664/1339] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:01:40.731769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5c0f9-5510-44bf-aec1-f0673d27c32a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:40.732254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5c0f9-5510-44bf-aec1-f0673d27c32a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:40.732446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5c0f9-5510-44bf-aec1-f0673d27c32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:40.811863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-dba5c0f9-5510-44bf-aec1-f0673d27c32a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:01:40.813067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dba5c0f9-5510-44bf-aec1-f0673d27c32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:40.904109 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:40.916136 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 676/1340] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:01:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:01:40.955942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb263cd4-d57c-4f6b-9994-9a7dda8262f3 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:01:40.957452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cb263cd4-d57c-4f6b-9994-9a7dda8262f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:41.006607 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:41.062755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb263cd4-d57c-4f6b-9994-9a7dda8262f3 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:01:41.139994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9642bb4d-d749-41a6-aa10-eecde3120180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:01:41.140649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642bb4d-d749-41a6-aa10-eecde3120180 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:41.140935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642bb4d-d749-41a6-aa10-eecde3120180 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:41.141210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642bb4d-d749-41a6-aa10-eecde3120180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:41.143482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9642bb4d-d749-41a6-aa10-eecde3120180 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:41.246683 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:41.263602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642bb4d-d749-41a6-aa10-eecde3120180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:01:41.265248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9642bb4d-d749-41a6-aa10-eecde3120180 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:01:41.288219 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 665/1341] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:01:44.399935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00245b9a-2151-4f4a-bd9b-7508a1a4ff4b None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:44.400515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00245b9a-2151-4f4a-bd9b-7508a1a4ff4b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:44.400515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00245b9a-2151-4f4a-bd9b-7508a1a4ff4b None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:44.401921 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 677/1342] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:01:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:01:44.408044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62529b-ad69-48ba-9521-a4ac96afc3e8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:44.408476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62529b-ad69-48ba-9521-a4ac96afc3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:44.408737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62529b-ad69-48ba-9521-a4ac96afc3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:44.474670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0a62529b-ad69-48ba-9521-a4ac96afc3e8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:01:44.475783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0a62529b-ad69-48ba-9521-a4ac96afc3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:44.572886 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 666/1343] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:01:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:01:44.611668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00245b9a-2151-4f4a-bd9b-7508a1a4ff4b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:01:44.613192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-00245b9a-2151-4f4a-bd9b-7508a1a4ff4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:44.716699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00245b9a-2151-4f4a-bd9b-7508a1a4ff4b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:01:44.792187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96992275-1b16-4f50-ba63-3b8721e23269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:01:44.792836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96992275-1b16-4f50-ba63-3b8721e23269 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:44.793119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96992275-1b16-4f50-ba63-3b8721e23269 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:44.793394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96992275-1b16-4f50-ba63-3b8721e23269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:44.795051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-96992275-1b16-4f50-ba63-3b8721e23269 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:44.837791 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:44.905736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96992275-1b16-4f50-ba63-3b8721e23269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:01:44.908966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96992275-1b16-4f50-ba63-3b8721e23269 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:01:44.929084 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 678/1344] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:01:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:01:49.179935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e08228-c4ce-4de1-b01d-337de4468fb8 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:49.180512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e08228-c4ce-4de1-b01d-337de4468fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:49.180512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e08228-c4ce-4de1-b01d-337de4468fb8 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:49.181892 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 667/1345] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:01:49.187629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324302b9-e704-4e38-b49f-0838fa60f805 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:49.188175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324302b9-e704-4e38-b49f-0838fa60f805 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:49.188316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324302b9-e704-4e38-b49f-0838fa60f805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:49.260935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-324302b9-e704-4e38-b49f-0838fa60f805 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:01:49.262191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-324302b9-e704-4e38-b49f-0838fa60f805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:49.363491 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:49.370231 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 679/1346] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:01:49.405649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e08228-c4ce-4de1-b01d-337de4468fb8 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:01:49.408043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a6e08228-c4ce-4de1-b01d-337de4468fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:49.468678 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:49.518739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e08228-c4ce-4de1-b01d-337de4468fb8 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:01:49.596087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4bb8e-354a-421c-a87f-2d57174ae21c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:01:49.596676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4bb8e-354a-421c-a87f-2d57174ae21c service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:49.596960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4bb8e-354a-421c-a87f-2d57174ae21c service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:49.597261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4bb8e-354a-421c-a87f-2d57174ae21c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:49.598941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2fa4bb8e-354a-421c-a87f-2d57174ae21c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:49.708316 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:49.711606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4bb8e-354a-421c-a87f-2d57174ae21c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:01:49.713048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4bb8e-354a-421c-a87f-2d57174ae21c service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:01:49.734401 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 668/1347] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:01:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:01:54.686079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d57803-9cf7-45c4-b992-ccf21a591839 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:54.686599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d57803-9cf7-45c4-b992-ccf21a591839 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:54.686707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d57803-9cf7-45c4-b992-ccf21a591839 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:54.688193 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 680/1348] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:01:54.694785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619938b9-61f3-4279-a21d-6cbeb956f226 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:54.694785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619938b9-61f3-4279-a21d-6cbeb956f226 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:54.694785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619938b9-61f3-4279-a21d-6cbeb956f226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:54.832912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-619938b9-61f3-4279-a21d-6cbeb956f226 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:01:54.834529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-619938b9-61f3-4279-a21d-6cbeb956f226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:54.955675 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 669/1349] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:01:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:01:59.001705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ed6f1-62f4-4e1d-a01e-afc6d64206e2 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:59.002432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ed6f1-62f4-4e1d-a01e-afc6d64206e2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:59.002432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ed6f1-62f4-4e1d-a01e-afc6d64206e2 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:59.003555 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 681/1350] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:01:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:01:59.008657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40dfaf-f9e2-4e23-9fba-292a2fcc6a2e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:01:59.009094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40dfaf-f9e2-4e23-9fba-292a2fcc6a2e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:01:59.009256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f40dfaf-f9e2-4e23-9fba-292a2fcc6a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:01:59.065196 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:01:59.090917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2f40dfaf-f9e2-4e23-9fba-292a2fcc6a2e None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:01:59.092114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2f40dfaf-f9e2-4e23-9fba-292a2fcc6a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:01:59.207793 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 670/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:01:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:02:00.744520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242aabd-fbe0-404a-919a-1d5b9f7a60df None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:00.744986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242aabd-fbe0-404a-919a-1d5b9f7a60df None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:00.745079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242aabd-fbe0-404a-919a-1d5b9f7a60df None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:00.746464 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 682/1352] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:02:00.752055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d871b-c06a-4aae-afee-23ef311c69de None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:00.752509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d871b-c06a-4aae-afee-23ef311c69de None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:00.752674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d871b-c06a-4aae-afee-23ef311c69de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:00.828417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-dd2d871b-c06a-4aae-afee-23ef311c69de None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:02:00.830689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-dd2d871b-c06a-4aae-afee-23ef311c69de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:00.873425 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:00.943557 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 671/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:02:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:02:04.324085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7eedd-13fc-444d-9598-3a93dd22f546 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:04.324653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7eedd-13fc-444d-9598-3a93dd22f546 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:04.324653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7eedd-13fc-444d-9598-3a93dd22f546 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:04.327407 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 683/1354] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:02:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:02:04.334725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f1a43-39f5-493a-a5b0-ca000f0c2f39 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:04.335639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f1a43-39f5-493a-a5b0-ca000f0c2f39 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:04.336009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f1a43-39f5-493a-a5b0-ca000f0c2f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:04.416768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d13f1a43-39f5-493a-a5b0-ca000f0c2f39 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:02:04.418248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d13f1a43-39f5-493a-a5b0-ca000f0c2f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:04.526232 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 672/1355] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:02:04.581638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dfec9-9911-4b20-be19-6860bbca226c None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:04.581927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dfec9-9911-4b20-be19-6860bbca226c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:04.582426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dfec9-9911-4b20-be19-6860bbca226c None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:04.583791 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 684/1356] 10.222.0.43 () {54 vars in 962 bytes} [Tue Jul 19 14:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:02:04.590181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97dd34-955f-48c1-b50f-d5a9ea0b6c4e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:04.590639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97dd34-955f-48c1-b50f-d5a9ea0b6c4e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:04.591096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97dd34-955f-48c1-b50f-d5a9ea0b6c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:04.609254 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:04.679046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5c97dd34-955f-48c1-b50f-d5a9ea0b6c4e None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:02:04.680382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5c97dd34-955f-48c1-b50f-d5a9ea0b6c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:04.808308 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 673/1357] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Jul 19 14:02:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:02:04.817682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dfec9-9911-4b20-be19-6860bbca226c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:02:04.819507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3c3dfec9-9911-4b20-be19-6860bbca226c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:04.977904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3dfec9-9911-4b20-be19-6860bbca226c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:02:05.054249 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:05.097193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438960f9-30aa-4e9b-9ec2-0fb409bca196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:02:05.097771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438960f9-30aa-4e9b-9ec2-0fb409bca196 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:05.098061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438960f9-30aa-4e9b-9ec2-0fb409bca196 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:05.098373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438960f9-30aa-4e9b-9ec2-0fb409bca196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:05.100040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-438960f9-30aa-4e9b-9ec2-0fb409bca196 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:05.194442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438960f9-30aa-4e9b-9ec2-0fb409bca196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:02:05.196051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438960f9-30aa-4e9b-9ec2-0fb409bca196 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:02:05.226296 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 685/1358] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:02:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:02:07.479258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2ce2d-c5ac-4066-b7ec-090cbb350711 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:07.479787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2ce2d-c5ac-4066-b7ec-090cbb350711 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:07.479787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b2ce2d-c5ac-4066-b7ec-090cbb350711 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:07.481249 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 674/1359] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:02:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:02:07.486793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502fc67-b612-4f49-89dc-0fbdfa6d69bf None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:07.487204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502fc67-b612-4f49-89dc-0fbdfa6d69bf None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:07.487327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502fc67-b612-4f49-89dc-0fbdfa6d69bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:07.560819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f502fc67-b612-4f49-89dc-0fbdfa6d69bf None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:02:07.562497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f502fc67-b612-4f49-89dc-0fbdfa6d69bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:07.602241 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:07.663633 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 686/1360] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:02:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:02:07.708416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2ce2d-c5ac-4066-b7ec-090cbb350711 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:02:07.709932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-79b2ce2d-c5ac-4066-b7ec-090cbb350711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:07.784598 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:07.874430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b2ce2d-c5ac-4066-b7ec-090cbb350711 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:02:08.019328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2c1c4-59af-4e22-94b6-222294836a20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:02:08.019328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2c1c4-59af-4e22-94b6-222294836a20 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:08.019328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2c1c4-59af-4e22-94b6-222294836a20 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:08.019328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2c1c4-59af-4e22-94b6-222294836a20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:08.019811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-88e2c1c4-59af-4e22-94b6-222294836a20 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:08.044535 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:08.136824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2c1c4-59af-4e22-94b6-222294836a20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:02:08.136824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2c1c4-59af-4e22-94b6-222294836a20 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:02:08.161327 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 675/1361] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:02:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:02:10.662386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2de559-9781-4155-aef5-4fef864d660c None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:10.662850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2de559-9781-4155-aef5-4fef864d660c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:10.662936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2de559-9781-4155-aef5-4fef864d660c None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:10.664409 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 687/1362] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:02:10.669748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c085b7-6788-4b15-9cd6-265e87361f8b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:10.670337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c085b7-6788-4b15-9cd6-265e87361f8b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:10.670337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c085b7-6788-4b15-9cd6-265e87361f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:10.749013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a6c085b7-6788-4b15-9cd6-265e87361f8b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:02:10.750378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a6c085b7-6788-4b15-9cd6-265e87361f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:10.870796 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:10.873429 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 676/1363] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:02:10.921424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5aa2b-24a2-40ea-9fb4-4cbf5031d826 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:10.921717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5aa2b-24a2-40ea-9fb4-4cbf5031d826 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:10.922154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b5aa2b-24a2-40ea-9fb4-4cbf5031d826 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:10.925648 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 688/1364] 10.222.0.43 () {54 vars in 962 bytes} [Tue Jul 19 14:02:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:02:10.931912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d47d9-868d-49eb-9c65-f1e284bee45b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:10.932356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d47d9-868d-49eb-9c65-f1e284bee45b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:10.932642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d47d9-868d-49eb-9c65-f1e284bee45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:11.021856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a08d47d9-868d-49eb-9c65-f1e284bee45b None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:02:11.023091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a08d47d9-868d-49eb-9c65-f1e284bee45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:11.178279 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 677/1365] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Jul 19 14:02:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:02:11.182157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5aa2b-24a2-40ea-9fb4-4cbf5031d826 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:02:11.183746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f3b5aa2b-24a2-40ea-9fb4-4cbf5031d826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:11.429234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b5aa2b-24a2-40ea-9fb4-4cbf5031d826 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:02:11.451127 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:11.553785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d8054-51b8-4c94-86c2-23b6896a7d9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:02:11.554591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d8054-51b8-4c94-86c2-23b6896a7d9b service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:11.554949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d8054-51b8-4c94-86c2-23b6896a7d9b service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:11.555303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d8054-51b8-4c94-86c2-23b6896a7d9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:11.557029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c56d8054-51b8-4c94-86c2-23b6896a7d9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:11.671403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d8054-51b8-4c94-86c2-23b6896a7d9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:02:11.672866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d8054-51b8-4c94-86c2-23b6896a7d9b service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:02:11.693976 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 689/1366] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:02:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:02:14.129367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea60e95-8289-45ab-a01a-2679d9ef0b28 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:14.129923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea60e95-8289-45ab-a01a-2679d9ef0b28 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:14.129923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea60e95-8289-45ab-a01a-2679d9ef0b28 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:14.132713 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 678/1367] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:02:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:02:14.139159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18063b6f-86f9-4c34-b296-a0558d65c738 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:14.147430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18063b6f-86f9-4c34-b296-a0558d65c738 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:14.147430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18063b6f-86f9-4c34-b296-a0558d65c738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:14.185392 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:14.240888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-18063b6f-86f9-4c34-b296-a0558d65c738 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:02:14.242083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-18063b6f-86f9-4c34-b296-a0558d65c738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:14.380136 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 690/1368] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:02:14.456725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea60e95-8289-45ab-a01a-2679d9ef0b28 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:02:14.458264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eea60e95-8289-45ab-a01a-2679d9ef0b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:14.526262 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:14.682980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea60e95-8289-45ab-a01a-2679d9ef0b28 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:02:14.865096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efb7e1-16c0-4ed6-b87d-c97aab4601f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:02:14.866644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efb7e1-16c0-4ed6-b87d-c97aab4601f6 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:14.867158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efb7e1-16c0-4ed6-b87d-c97aab4601f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:14.867658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efb7e1-16c0-4ed6-b87d-c97aab4601f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:14.869667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-77efb7e1-16c0-4ed6-b87d-c97aab4601f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:14.894021 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:14.990149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77efb7e1-16c0-4ed6-b87d-c97aab4601f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:02:14.992623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77efb7e1-16c0-4ed6-b87d-c97aab4601f6 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:02:15.014792 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 679/1369] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:02:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:02:16.145676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e281f5-ca52-4a1c-b9a7-88c392dfa239 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:16.146991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e281f5-ca52-4a1c-b9a7-88c392dfa239 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:16.147497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e281f5-ca52-4a1c-b9a7-88c392dfa239 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:16.155948 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 691/1370] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:02:16 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:02:16.156310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00df43-692f-48b3-b680-061bc12e6ed3 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:16.156727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00df43-692f-48b3-b680-061bc12e6ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:16.157595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00df43-692f-48b3-b680-061bc12e6ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:16.258634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5c00df43-692f-48b3-b680-061bc12e6ed3 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:02:16.259831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5c00df43-692f-48b3-b680-061bc12e6ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:16.349439 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:16.378916 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 680/1371] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:02:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:02:16.742240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab8783-2ed1-4dd1-8ed6-c4677d226fd2 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:16.742240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab8783-2ed1-4dd1-8ed6-c4677d226fd2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:16.742240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab8783-2ed1-4dd1-8ed6-c4677d226fd2 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:16.742240 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 692/1372] 10.222.0.43 () {54 vars in 964 bytes} [Tue Jul 19 14:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:02:16.745191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa305315-f970-4a0e-ac5c-a0632f92661c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:16.745191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa305315-f970-4a0e-ac5c-a0632f92661c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:16.745191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa305315-f970-4a0e-ac5c-a0632f92661c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:16.832422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-aa305315-f970-4a0e-ac5c-a0632f92661c None None] MFA Rules not processed for user `ef77d9ec7712434287347d959dcf1cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:02:16.833554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aa305315-f970-4a0e-ac5c-a0632f92661c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:16.912261 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 681/1373] 10.222.0.43 () {58 vars in 1061 bytes} [Tue Jul 19 14:02:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:02:16.919754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab8783-2ed1-4dd1-8ed6-c4677d226fd2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:02:16.921266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c0ab8783-2ed1-4dd1-8ed6-c4677d226fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:17.034829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab8783-2ed1-4dd1-8ed6-c4677d226fd2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:02:17.039211 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:17.123261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314be93a-0f55-49b5-b1fc-9e139ab143f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:02:17.123830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314be93a-0f55-49b5-b1fc-9e139ab143f8 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:17.124120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314be93a-0f55-49b5-b1fc-9e139ab143f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:17.124397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314be93a-0f55-49b5-b1fc-9e139ab143f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:17.126356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-314be93a-0f55-49b5-b1fc-9e139ab143f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:17.242431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314be93a-0f55-49b5-b1fc-9e139ab143f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:02:17.243885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314be93a-0f55-49b5-b1fc-9e139ab143f8 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:02:17.263181 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 693/1374] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:02:17.347906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80b810-9c39-4137-8b8b-35b6d20641e2 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:17.348432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80b810-9c39-4137-8b8b-35b6d20641e2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:17.348546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80b810-9c39-4137-8b8b-35b6d20641e2 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:17.350443 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 682/1375] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:02:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:02:17.355792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6973f3-b729-4655-8e26-49b235649325 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:17.356089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6973f3-b729-4655-8e26-49b235649325 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:17.356373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6973f3-b729-4655-8e26-49b235649325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:17.401749 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:17.423719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1e6973f3-b729-4655-8e26-49b235649325 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:02:17.424934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1e6973f3-b729-4655-8e26-49b235649325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:17.529949 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 694/1376] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:02:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:02:17.575629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80b810-9c39-4137-8b8b-35b6d20641e2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:02:17.577374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fb80b810-9c39-4137-8b8b-35b6d20641e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:17.663610 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:17.735829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80b810-9c39-4137-8b8b-35b6d20641e2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:02:17.872354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b63b5b-4402-49a2-909e-93475781c5b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:02:17.873004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b63b5b-4402-49a2-909e-93475781c5b6 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:17.873369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b63b5b-4402-49a2-909e-93475781c5b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:17.873631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b63b5b-4402-49a2-909e-93475781c5b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:17.875354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d8b63b5b-4402-49a2-909e-93475781c5b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:17.927937 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:17.979781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b63b5b-4402-49a2-909e-93475781c5b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:02:17.981425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b63b5b-4402-49a2-909e-93475781c5b6 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:02:17.999964 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 683/1377] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:02:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:02:20.370891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b9572-9ab5-46e5-aad2-5917efe9daf9 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:20.371416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b9572-9ab5-46e5-aad2-5917efe9daf9 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:20.371522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b9572-9ab5-46e5-aad2-5917efe9daf9 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:20.372826 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 695/1378] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:02:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:02:20.379090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67b949-e836-45f7-9aeb-0872d6fd18b9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:20.379516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67b949-e836-45f7-9aeb-0872d6fd18b9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:20.379653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67b949-e836-45f7-9aeb-0872d6fd18b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:20.592242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0a67b949-e836-45f7-9aeb-0872d6fd18b9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:02:20.594040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0a67b949-e836-45f7-9aeb-0872d6fd18b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:20.714558 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 684/1379] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:02:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:02:20.759279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b9572-9ab5-46e5-aad2-5917efe9daf9 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:02:20.760882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0d9b9572-9ab5-46e5-aad2-5917efe9daf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:20.884471 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:20.923339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b9572-9ab5-46e5-aad2-5917efe9daf9 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:02:21.085670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfedfe-35f4-45d3-a0cb-4b3e4e92bb12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:02:21.087412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfedfe-35f4-45d3-a0cb-4b3e4e92bb12 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:21.087860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfedfe-35f4-45d3-a0cb-4b3e4e92bb12 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:21.088282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfedfe-35f4-45d3-a0cb-4b3e4e92bb12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:21.090164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-96cfedfe-35f4-45d3-a0cb-4b3e4e92bb12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:21.239329 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:21.260637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfedfe-35f4-45d3-a0cb-4b3e4e92bb12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:02:21.262872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfedfe-35f4-45d3-a0cb-4b3e4e92bb12 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:02:21.291281 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 696/1380] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:02:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:02:23.597964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac37c36-5d94-4d83-a1bd-70db306ae781 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:23.598462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac37c36-5d94-4d83-a1bd-70db306ae781 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:23.598569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac37c36-5d94-4d83-a1bd-70db306ae781 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:23.604000 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 685/1381] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:02:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:02:23.605369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda8d4-d7f9-4c48-913e-0ab7024e6bd3 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:23.605805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda8d4-d7f9-4c48-913e-0ab7024e6bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:23.605975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda8d4-d7f9-4c48-913e-0ab7024e6bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:23.696757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d4fda8d4-d7f9-4c48-913e-0ab7024e6bd3 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:02:23.698218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d4fda8d4-d7f9-4c48-913e-0ab7024e6bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:23.809384 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 697/1382] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:02:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:02:23.851976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac37c36-5d94-4d83-a1bd-70db306ae781 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:02:23.853497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cac37c36-5d94-4d83-a1bd-70db306ae781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:23.873643 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:24.026024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac37c36-5d94-4d83-a1bd-70db306ae781 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:02:24.139065 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:24.166298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87d78d6-fa25-46f5-9692-5a4069ece18a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:02:24.166954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d78d6-fa25-46f5-9692-5a4069ece18a service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:24.167239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d78d6-fa25-46f5-9692-5a4069ece18a service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:24.167520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87d78d6-fa25-46f5-9692-5a4069ece18a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:24.169158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a87d78d6-fa25-46f5-9692-5a4069ece18a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:24.275229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d78d6-fa25-46f5-9692-5a4069ece18a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:02:24.276739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87d78d6-fa25-46f5-9692-5a4069ece18a service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:02:24.298679 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 686/1383] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:02:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:02:26.603567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8386b7-132b-4cbf-bdda-ab24b8214457 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:26.604076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8386b7-132b-4cbf-bdda-ab24b8214457 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:26.604076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8386b7-132b-4cbf-bdda-ab24b8214457 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:26.605447 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 698/1384] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:02:26.611921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129f9e5-0f2b-4a59-925c-246539489ceb None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:26.612439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129f9e5-0f2b-4a59-925c-246539489ceb None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:26.612614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7129f9e5-0f2b-4a59-925c-246539489ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:26.680070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7129f9e5-0f2b-4a59-925c-246539489ceb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:02:26.681226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7129f9e5-0f2b-4a59-925c-246539489ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:26.739228 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:26.788063 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 687/1385] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:02:26.835584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8386b7-132b-4cbf-bdda-ab24b8214457 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:02:26.837170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8c8386b7-132b-4cbf-bdda-ab24b8214457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:26.896621 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:26.992318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8386b7-132b-4cbf-bdda-ab24b8214457 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:02:27.120176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f684b2c1-d70c-43bb-8b9f-fd9ca82695a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:02:27.120984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684b2c1-d70c-43bb-8b9f-fd9ca82695a0 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:27.121338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684b2c1-d70c-43bb-8b9f-fd9ca82695a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:27.121690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f684b2c1-d70c-43bb-8b9f-fd9ca82695a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:27.123931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f684b2c1-d70c-43bb-8b9f-fd9ca82695a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:27.139071 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:27.223786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684b2c1-d70c-43bb-8b9f-fd9ca82695a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:02:27.225410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f684b2c1-d70c-43bb-8b9f-fd9ca82695a0 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:02:27.246600 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 699/1386] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:02:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:02:29.531358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570306b-9651-42d5-9039-3e8c6e768f5e None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:29.532376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570306b-9651-42d5-9039-3e8c6e768f5e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:29.532483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570306b-9651-42d5-9039-3e8c6e768f5e None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:29.534145 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 688/1387] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:02:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:02:29.539907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985b445-3715-49b0-bedb-b420f7752649 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:29.540343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985b445-3715-49b0-bedb-b420f7752649 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:29.540923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d985b445-3715-49b0-bedb-b420f7752649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:29.611687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d985b445-3715-49b0-bedb-b420f7752649 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:02:29.612897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d985b445-3715-49b0-bedb-b420f7752649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:29.702762 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:29.717403 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 700/1388] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:02:29.764558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570306b-9651-42d5-9039-3e8c6e768f5e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:02:29.766770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2570306b-9651-42d5-9039-3e8c6e768f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:29.935452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570306b-9651-42d5-9039-3e8c6e768f5e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:02:29.984272 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:30.068452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a16a8-37be-48d5-985a-48b9eaa0932b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:02:30.069082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a16a8-37be-48d5-985a-48b9eaa0932b service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:30.069365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a16a8-37be-48d5-985a-48b9eaa0932b service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:30.069643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a16a8-37be-48d5-985a-48b9eaa0932b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:30.071365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9a7a16a8-37be-48d5-985a-48b9eaa0932b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:30.161885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a16a8-37be-48d5-985a-48b9eaa0932b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:02:30.163544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a16a8-37be-48d5-985a-48b9eaa0932b service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:02:30.182783 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 689/1389] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:02:32.446617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1807e-0538-4035-8adf-1e1159707617 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:32.447213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1807e-0538-4035-8adf-1e1159707617 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:32.447318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1807e-0538-4035-8adf-1e1159707617 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:32.448654 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 701/1390] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:02:32.454740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2afac-4ba0-4be1-b51b-045c90881c81 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:32.455153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2afac-4ba0-4be1-b51b-045c90881c81 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:32.455296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2afac-4ba0-4be1-b51b-045c90881c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:32.511303 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:32.527529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f1e2afac-4ba0-4be1-b51b-045c90881c81 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:02:32.528760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f1e2afac-4ba0-4be1-b51b-045c90881c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:32.633931 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 690/1391] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:02:32.679631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1807e-0538-4035-8adf-1e1159707617 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:02:32.681391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-53a1807e-0538-4035-8adf-1e1159707617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:32.846467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1807e-0538-4035-8adf-1e1159707617 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:02:32.910286 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:32.961133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e86b5-60b3-4fd6-828f-759c83c77bd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:02:32.961786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e86b5-60b3-4fd6-828f-759c83c77bd0 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:32.962076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e86b5-60b3-4fd6-828f-759c83c77bd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:32.962391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e86b5-60b3-4fd6-828f-759c83c77bd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:32.964069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-605e86b5-60b3-4fd6-828f-759c83c77bd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:33.145750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8c9fa-dcd9-475c-8b74-175829954c76 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:33.145957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8c9fa-dcd9-475c-8b74-175829954c76 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:33.146240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c8c9fa-dcd9-475c-8b74-175829954c76 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:33.147640 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 691/1392] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:02:33.152656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74971fb-ab16-492b-85c7-2ebaedd3f0b3 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:33.152946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74971fb-ab16-492b-85c7-2ebaedd3f0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:33.153227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74971fb-ab16-492b-85c7-2ebaedd3f0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:33.175108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e86b5-60b3-4fd6-828f-759c83c77bd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:02:33.176725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e86b5-60b3-4fd6-828f-759c83c77bd0 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:02:33.194832 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 702/1393] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:02:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:02:33.227386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e74971fb-ab16-492b-85c7-2ebaedd3f0b3 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:02:33.228592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e74971fb-ab16-492b-85c7-2ebaedd3f0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:33.307426 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:33.340003 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 692/1394] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:02:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:02:33.402692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7d87e-fafc-40a1-bc7f-8c961680ecd4 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:33.402899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7d87e-fafc-40a1-bc7f-8c961680ecd4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:33.403155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7d87e-fafc-40a1-bc7f-8c961680ecd4 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:33.404566 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 703/1395] 10.222.0.43 () {54 vars in 961 bytes} [Tue Jul 19 14:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:02:33.410241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f570bf-bd26-4c7b-9b85-8e2f5411408b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:33.410533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f570bf-bd26-4c7b-9b85-8e2f5411408b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:33.410812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f570bf-bd26-4c7b-9b85-8e2f5411408b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:33.496205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e6f570bf-bd26-4c7b-9b85-8e2f5411408b None None] MFA Rules not processed for user `75efea22b2484c1ea79a74e6793050f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:02:33.497530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e6f570bf-bd26-4c7b-9b85-8e2f5411408b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:33.576979 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 693/1396] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Jul 19 14:02:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:02:33.585377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7d87e-fafc-40a1-bc7f-8c961680ecd4 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:02:33.586902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f8b7d87e-fafc-40a1-bc7f-8c961680ecd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:33.665943 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:33.692831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7d87e-fafc-40a1-bc7f-8c961680ecd4 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:02:33.768006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22752436-1d82-42f8-ae71-eb20bd712f87 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:02:33.768959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22752436-1d82-42f8-ae71-eb20bd712f87 service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:33.769246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22752436-1d82-42f8-ae71-eb20bd712f87 service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:33.769552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22752436-1d82-42f8-ae71-eb20bd712f87 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:33.771594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-22752436-1d82-42f8-ae71-eb20bd712f87 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:33.884086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22752436-1d82-42f8-ae71-eb20bd712f87 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:02:33.885549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22752436-1d82-42f8-ae71-eb20bd712f87 service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:02:33.904231 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 704/1397] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:02:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:02:34.745365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c61e3-081a-4dbf-9bb8-4b6176e9a2a8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:34.745867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c61e3-081a-4dbf-9bb8-4b6176e9a2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:34.745967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c61e3-081a-4dbf-9bb8-4b6176e9a2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:34.816332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-641c61e3-081a-4dbf-9bb8-4b6176e9a2a8 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:02:34.820689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-641c61e3-081a-4dbf-9bb8-4b6176e9a2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:34.838790 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:34.912102 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 694/1398] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:02:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:02:34.961827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5c133-059c-455a-bbb1-7105f7590518 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:34.962369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5c133-059c-455a-bbb1-7105f7590518 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:34.962576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5c133-059c-455a-bbb1-7105f7590518 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:34.964037 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 705/1399] 10.222.0.43 () {54 vars in 943 bytes} [Tue Jul 19 14:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:02:34.970920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836f8c1-9710-4b84-a449-42c80c34fbd0 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:34.971217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836f8c1-9710-4b84-a449-42c80c34fbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:34.971504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836f8c1-9710-4b84-a449-42c80c34fbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:35.046996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4836f8c1-9710-4b84-a449-42c80c34fbd0 None None] MFA Rules not processed for user `0789b4be9dae4c05bb3ec4a5e0f1f308`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:02:35.048230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4836f8c1-9710-4b84-a449-42c80c34fbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:35.147905 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:35.159658 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 695/1400] 10.222.0.43 () {58 vars in 1040 bytes} [Tue Jul 19 14:02:34 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:02:35.176654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5c133-059c-455a-bbb1-7105f7590518 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:02:35.176654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-08d5c133-059c-455a-bbb1-7105f7590518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:35.180148 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:35.313454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d5c133-059c-455a-bbb1-7105f7590518 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:02:35.407938 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:35.422849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2aed1-2103-49e3-b473-11bfafdcc907 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:02:35.422849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2aed1-2103-49e3-b473-11bfafdcc907 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:35.422849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2aed1-2103-49e3-b473-11bfafdcc907 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:35.422849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2aed1-2103-49e3-b473-11bfafdcc907 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:35.423293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f5c2aed1-2103-49e3-b473-11bfafdcc907 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:35.427555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d2960-4ea7-4bf5-8a02-a0c69fe0fef1 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:35.427850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d2960-4ea7-4bf5-8a02-a0c69fe0fef1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:35.428136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d2960-4ea7-4bf5-8a02-a0c69fe0fef1 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:35.429674 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 696/1401] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:02:35.434515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fc683-dcb0-4e33-a993-ce4f3a345cc9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:35.434804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fc683-dcb0-4e33-a993-ce4f3a345cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:35.435086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fc683-dcb0-4e33-a993-ce4f3a345cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:35.502084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-118fc683-dcb0-4e33-a993-ce4f3a345cc9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:02:35.503312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-118fc683-dcb0-4e33-a993-ce4f3a345cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:35.511984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2aed1-2103-49e3-b473-11bfafdcc907 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:02:35.513559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2aed1-2103-49e3-b473-11bfafdcc907 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:02:35.522387 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 706/1402] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:02:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:02:35.605181 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 697/1403] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:02:35.650937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2aed1-2103-49e3-b473-11bfafdcc907 service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:02:35.652138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f5c2aed1-2103-49e3-b473-11bfafdcc907 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:35.742010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2aed1-2103-49e3-b473-11bfafdcc907 service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:02:35.783676 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:35.869590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad9b33-553b-4b67-8a28-833098ef20f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:02:35.886614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad9b33-553b-4b67-8a28-833098ef20f4 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:35.886614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad9b33-553b-4b67-8a28-833098ef20f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:35.886614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad9b33-553b-4b67-8a28-833098ef20f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:35.886614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-81ad9b33-553b-4b67-8a28-833098ef20f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:35.973701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad9b33-553b-4b67-8a28-833098ef20f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:02:35.975318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad9b33-553b-4b67-8a28-833098ef20f4 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:02:35.996467 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 707/1404] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:02:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:02:39.177766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e1348-b8e8-4f33-b6ff-70de1f78d185 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:39.178327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e1348-b8e8-4f33-b6ff-70de1f78d185 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:39.183159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3e1348-b8e8-4f33-b6ff-70de1f78d185 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:39.184925 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 698/1405] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:02:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:02:39.191386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c197f1f-2c4d-4ada-ac1c-323e9895f58e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:39.191968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c197f1f-2c4d-4ada-ac1c-323e9895f58e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:39.191968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c197f1f-2c4d-4ada-ac1c-323e9895f58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:39.254867 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:39.264497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5c197f1f-2c4d-4ada-ac1c-323e9895f58e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:02:39.265708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5c197f1f-2c4d-4ada-ac1c-323e9895f58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:39.386203 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 708/1406] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:02:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:02:39.422080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e1348-b8e8-4f33-b6ff-70de1f78d185 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:02:39.424087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-dc3e1348-b8e8-4f33-b6ff-70de1f78d185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:39.506206 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:39.589689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3e1348-b8e8-4f33-b6ff-70de1f78d185 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:02:39.717902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a07838-3048-4114-b490-45a517c06c44 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:02:39.718710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a07838-3048-4114-b490-45a517c06c44 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:02:39.719082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a07838-3048-4114-b490-45a517c06c44 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:02:39.719435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a07838-3048-4114-b490-45a517c06c44 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:02:39.721675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-94a07838-3048-4114-b490-45a517c06c44 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:02:39.761861 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:39.822819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a07838-3048-4114-b490-45a517c06c44 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:02:39.824430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a07838-3048-4114-b490-45a517c06c44 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:02:39.846143 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 699/1407] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:02:49.373159 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=44 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:02:49.842852 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=31 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:00.365415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7926d5d-6914-41bd-b3cb-8c13f8aef0a5 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:00.365991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7926d5d-6914-41bd-b3cb-8c13f8aef0a5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:00.365991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7926d5d-6914-41bd-b3cb-8c13f8aef0a5 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:00.367399 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 709/1408] 10.222.0.43 () {54 vars in 918 bytes} [Tue Jul 19 14:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:03:00.372539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f329e0f-70cc-44bc-bdfb-9e23272047b5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:00.372978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f329e0f-70cc-44bc-bdfb-9e23272047b5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:00.373088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f329e0f-70cc-44bc-bdfb-9e23272047b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:00.450280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2f329e0f-70cc-44bc-bdfb-9e23272047b5 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:03:00.451482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2f329e0f-70cc-44bc-bdfb-9e23272047b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:00.555790 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 700/1409] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Jul 19 14:03:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:03:00.570084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214731b2-917c-48ec-bacd-32d55e914d15 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:00.570400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214731b2-917c-48ec-bacd-32d55e914d15 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:00.570674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214731b2-917c-48ec-bacd-32d55e914d15 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:00.572094 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 710/1410] 10.222.0.43 () {54 vars in 918 bytes} [Tue Jul 19 14:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:03:00.576512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4052f4-f495-4abe-bb66-f5a63615d5ca None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:00.576800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4052f4-f495-4abe-bb66-f5a63615d5ca None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:00.577326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4052f4-f495-4abe-bb66-f5a63615d5ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:00.649090 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:00.651624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4e4052f4-f495-4abe-bb66-f5a63615d5ca None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:03:00.652823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4e4052f4-f495-4abe-bb66-f5a63615d5ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:00.771738 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 701/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Tue Jul 19 14:03:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:03:03.281571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9523e9-8510-4043-8f96-68a2edc2fe20 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:03.282084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9523e9-8510-4043-8f96-68a2edc2fe20 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:03.282230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9523e9-8510-4043-8f96-68a2edc2fe20 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:03.283536 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 711/1412] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 14:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:03:03.288920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00279673-7818-467b-a91e-f57b10e3d546 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:03.289330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00279673-7818-467b-a91e-f57b10e3d546 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:03.289485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00279673-7818-467b-a91e-f57b10e3d546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:03.354654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-00279673-7818-467b-a91e-f57b10e3d546 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:03:03.355860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-00279673-7818-467b-a91e-f57b10e3d546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:03.411523 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:03.453098 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 702/1413] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 14:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:03:03.496398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9523e9-8510-4043-8f96-68a2edc2fe20 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:03:03.497912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ad9523e9-8510-4043-8f96-68a2edc2fe20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:03.642600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9523e9-8510-4043-8f96-68a2edc2fe20 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:03:03.715774 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:03.755886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349069be-5c1f-41e4-97c9-b1c24085a5a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:03:03.756461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349069be-5c1f-41e4-97c9-b1c24085a5a6 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:03.756742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349069be-5c1f-41e4-97c9-b1c24085a5a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:03.757015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349069be-5c1f-41e4-97c9-b1c24085a5a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:03.758672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-349069be-5c1f-41e4-97c9-b1c24085a5a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:03.850057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349069be-5c1f-41e4-97c9-b1c24085a5a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:03:03.851686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349069be-5c1f-41e4-97c9-b1c24085a5a6 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:03:03.869663 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 712/1414] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:03:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:03:04.769571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3616a-b3f0-42fc-8b96-a24c7f84d692 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:04.770160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3616a-b3f0-42fc-8b96-a24c7f84d692 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:04.770160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3616a-b3f0-42fc-8b96-a24c7f84d692 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:04.771583 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 703/1415] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 14:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:03:04.777077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee88ed-0323-45fb-9a79-9c1a2ac432bb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:04.777494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee88ed-0323-45fb-9a79-9c1a2ac432bb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:04.777633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ee88ed-0323-45fb-9a79-9c1a2ac432bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:04.853217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e7ee88ed-0323-45fb-9a79-9c1a2ac432bb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:03:04.854449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e7ee88ed-0323-45fb-9a79-9c1a2ac432bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:04.881463 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:04.950713 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 713/1416] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 14:03:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:03:05.114382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3616a-b3f0-42fc-8b96-a24c7f84d692 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:03:05.115795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b5a3616a-b3f0-42fc-8b96-a24c7f84d692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:05.260877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3616a-b3f0-42fc-8b96-a24c7f84d692 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:03:05.301347 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:05.373741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ca717c-0884-4cf8-8a2b-b54c34627c49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:03:05.374340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca717c-0884-4cf8-8a2b-b54c34627c49 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:05.374624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca717c-0884-4cf8-8a2b-b54c34627c49 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:05.374903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ca717c-0884-4cf8-8a2b-b54c34627c49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:05.376536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-54ca717c-0884-4cf8-8a2b-b54c34627c49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:05.465297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca717c-0884-4cf8-8a2b-b54c34627c49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:03:05.466904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ca717c-0884-4cf8-8a2b-b54c34627c49 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:03:05.484636 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 704/1417] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:03:06.386697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488dcee-ce02-4608-b33b-a6dad7769b3f None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:06.387252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488dcee-ce02-4608-b33b-a6dad7769b3f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:06.387252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488dcee-ce02-4608-b33b-a6dad7769b3f None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:06.388851 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 714/1418] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 14:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:03:06.395230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03e4a4-ed25-4c49-b6c1-51596fe13e51 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:06.401692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03e4a4-ed25-4c49-b6c1-51596fe13e51 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:06.401692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03e4a4-ed25-4c49-b6c1-51596fe13e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:06.448922 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:06.471196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4f03e4a4-ed25-4c49-b6c1-51596fe13e51 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:03:06.472712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4f03e4a4-ed25-4c49-b6c1-51596fe13e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:06.569968 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 705/1419] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 14:03:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:03:06.719814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488dcee-ce02-4608-b33b-a6dad7769b3f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:03:06.721333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3488dcee-ce02-4608-b33b-a6dad7769b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:06.868136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488dcee-ce02-4608-b33b-a6dad7769b3f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:03:06.880681 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:06.979701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c46e6-fb41-41b2-9dea-30f64079fbe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:03:06.980342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c46e6-fb41-41b2-9dea-30f64079fbe1 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:06.980652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c46e6-fb41-41b2-9dea-30f64079fbe1 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:06.980925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c46e6-fb41-41b2-9dea-30f64079fbe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:06.982598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-099c46e6-fb41-41b2-9dea-30f64079fbe1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:07.071184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c46e6-fb41-41b2-9dea-30f64079fbe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:03:07.072728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c46e6-fb41-41b2-9dea-30f64079fbe1 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:03:07.091438 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 715/1420] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:03:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:03:07.965787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a773447-e2cc-45b0-9082-ae037cddcdad None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:07.971165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a773447-e2cc-45b0-9082-ae037cddcdad None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:07.971165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a773447-e2cc-45b0-9082-ae037cddcdad None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:07.971165 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 706/1421] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 14:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:03:07.973203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8226d-79cc-4362-9aba-3c171dbf1056 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:07.973616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8226d-79cc-4362-9aba-3c171dbf1056 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:07.973746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8226d-79cc-4362-9aba-3c171dbf1056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:07.992666 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:08.049791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-10a8226d-79cc-4362-9aba-3c171dbf1056 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:03:08.051068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-10a8226d-79cc-4362-9aba-3c171dbf1056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:08.147666 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 716/1422] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 14:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:03:08.300999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a773447-e2cc-45b0-9082-ae037cddcdad None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:03:08.302536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8a773447-e2cc-45b0-9082-ae037cddcdad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:08.411718 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:08.447285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a773447-e2cc-45b0-9082-ae037cddcdad None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:03:08.558024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963d66b-492b-42b1-9303-db30228b592f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:03:08.558626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963d66b-492b-42b1-9303-db30228b592f service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:08.558914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963d66b-492b-42b1-9303-db30228b592f service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:08.559188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963d66b-492b-42b1-9303-db30228b592f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:08.560818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5963d66b-492b-42b1-9303-db30228b592f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:08.635832 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:08.649680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963d66b-492b-42b1-9303-db30228b592f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:03:08.651291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963d66b-492b-42b1-9303-db30228b592f service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:03:08.669889 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 707/1423] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:03:09.532576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a484c-a5a3-4fff-9ff8-c6a9b02ad681 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:09.533146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a484c-a5a3-4fff-9ff8-c6a9b02ad681 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:09.533146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a484c-a5a3-4fff-9ff8-c6a9b02ad681 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:09.534587 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 717/1424] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 14:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:03:09.539530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60511018-0550-4fa6-ac9d-1a5f15fc3f16 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:09.539955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60511018-0550-4fa6-ac9d-1a5f15fc3f16 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:09.540072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60511018-0550-4fa6-ac9d-1a5f15fc3f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:09.616190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-60511018-0550-4fa6-ac9d-1a5f15fc3f16 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:03:09.617400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-60511018-0550-4fa6-ac9d-1a5f15fc3f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:09.714177 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 708/1425] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 14:03:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:03:09.866920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a484c-a5a3-4fff-9ff8-c6a9b02ad681 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:03:09.868320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-007a484c-a5a3-4fff-9ff8-c6a9b02ad681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:09.952803 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:10.014663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a484c-a5a3-4fff-9ff8-c6a9b02ad681 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:03:10.126944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877fe6c-e595-42be-991d-c08ef15dc6d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:03:10.127520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877fe6c-e595-42be-991d-c08ef15dc6d8 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:10.127806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877fe6c-e595-42be-991d-c08ef15dc6d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:10.128084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877fe6c-e595-42be-991d-c08ef15dc6d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:10.129768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b877fe6c-e595-42be-991d-c08ef15dc6d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:10.179022 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:10.220882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877fe6c-e595-42be-991d-c08ef15dc6d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:03:10.223527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877fe6c-e595-42be-991d-c08ef15dc6d8 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:03:10.242375 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 718/1426] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:03:11.127226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bb4f9-1fc4-41af-91c8-f76226f37d44 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:11.127727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bb4f9-1fc4-41af-91c8-f76226f37d44 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:11.127853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3bb4f9-1fc4-41af-91c8-f76226f37d44 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:11.129762 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 709/1427] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 14:03:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:03:11.134724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f993f11-1a96-4168-965f-bb7ff82bb851 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:11.135141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f993f11-1a96-4168-965f-bb7ff82bb851 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:11.135378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f993f11-1a96-4168-965f-bb7ff82bb851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:11.211096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5f993f11-1a96-4168-965f-bb7ff82bb851 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:03:11.212311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5f993f11-1a96-4168-965f-bb7ff82bb851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:11.310072 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 719/1428] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 14:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:03:11.460260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bb4f9-1fc4-41af-91c8-f76226f37d44 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:03:11.461787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4a3bb4f9-1fc4-41af-91c8-f76226f37d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:11.510861 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:11.608460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3bb4f9-1fc4-41af-91c8-f76226f37d44 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:03:11.720066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951a6d1-5010-4728-b3fd-f3ec4f36a3b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:03:11.720641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951a6d1-5010-4728-b3fd-f3ec4f36a3b3 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:11.720928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951a6d1-5010-4728-b3fd-f3ec4f36a3b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:11.721205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951a6d1-5010-4728-b3fd-f3ec4f36a3b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:11.723462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4951a6d1-5010-4728-b3fd-f3ec4f36a3b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:11.730432 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:11.813101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951a6d1-5010-4728-b3fd-f3ec4f36a3b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:03:11.814723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951a6d1-5010-4728-b3fd-f3ec4f36a3b3 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:03:11.833027 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 710/1429] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:03:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:03:12.711751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0752ed-ec94-42e3-b6bf-ef0cc0165c91 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:12.712305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0752ed-ec94-42e3-b6bf-ef0cc0165c91 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:12.712305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0752ed-ec94-42e3-b6bf-ef0cc0165c91 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:12.713998 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 720/1430] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 14:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:03:12.718815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be5d90-78a8-469f-81f3-aa1c26ba5d41 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:12.719228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be5d90-78a8-469f-81f3-aa1c26ba5d41 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:12.719365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34be5d90-78a8-469f-81f3-aa1c26ba5d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:12.794148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-34be5d90-78a8-469f-81f3-aa1c26ba5d41 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:03:12.795352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-34be5d90-78a8-469f-81f3-aa1c26ba5d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:12.862624 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:12.890521 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 711/1431] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 14:03:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:03:13.041203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0752ed-ec94-42e3-b6bf-ef0cc0165c91 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:03:13.042712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0c0752ed-ec94-42e3-b6bf-ef0cc0165c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:13.060897 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:13.189923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0752ed-ec94-42e3-b6bf-ef0cc0165c91 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:03:13.278548 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:13.305783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb98891-8ab5-4ad4-a4e5-9668564f0cac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:03:13.306390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb98891-8ab5-4ad4-a4e5-9668564f0cac service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:13.306674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb98891-8ab5-4ad4-a4e5-9668564f0cac service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:13.306950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb98891-8ab5-4ad4-a4e5-9668564f0cac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:13.309267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5fb98891-8ab5-4ad4-a4e5-9668564f0cac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:13.398775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb98891-8ab5-4ad4-a4e5-9668564f0cac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:03:13.400365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb98891-8ab5-4ad4-a4e5-9668564f0cac service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:03:13.418946 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 721/1432] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:03:14.272744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190f5d1-90a0-47f9-90af-90d7ac7e7044 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:14.273299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190f5d1-90a0-47f9-90af-90d7ac7e7044 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:14.273299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6190f5d1-90a0-47f9-90af-90d7ac7e7044 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:14.274728 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 712/1433] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 14:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:03:14.279750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca48ee-18cb-44f4-a04c-f4d4c883ef97 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:14.280181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca48ee-18cb-44f4-a04c-f4d4c883ef97 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:14.280370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca48ee-18cb-44f4-a04c-f4d4c883ef97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:14.356417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2dca48ee-18cb-44f4-a04c-f4d4c883ef97 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:03:14.357648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2dca48ee-18cb-44f4-a04c-f4d4c883ef97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:14.400312 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:14.459342 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 722/1434] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 14:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:03:14.609178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190f5d1-90a0-47f9-90af-90d7ac7e7044 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:03:14.610646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6190f5d1-90a0-47f9-90af-90d7ac7e7044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:14.755246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6190f5d1-90a0-47f9-90af-90d7ac7e7044 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:03:14.808761 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:14.868587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278c89f-7e5f-4040-801c-666f873a121e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:03:14.869183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278c89f-7e5f-4040-801c-666f873a121e service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:14.869473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278c89f-7e5f-4040-801c-666f873a121e service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:14.869763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278c89f-7e5f-4040-801c-666f873a121e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:14.871495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5278c89f-7e5f-4040-801c-666f873a121e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:14.961806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278c89f-7e5f-4040-801c-666f873a121e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:03:14.963438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278c89f-7e5f-4040-801c-666f873a121e service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:03:14.981267 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 713/1435] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:03:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:03:15.848413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9541ae0-36d5-4ca7-bbf8-993f062b4d2a None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:15.849003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9541ae0-36d5-4ca7-bbf8-993f062b4d2a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:15.849003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9541ae0-36d5-4ca7-bbf8-993f062b4d2a None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:15.850378 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 723/1436] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 14:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:03:15.855277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3c03c-5cfa-4cb6-9e83-1c25c3a70eec None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:15.855726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3c03c-5cfa-4cb6-9e83-1c25c3a70eec None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:15.855871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3c03c-5cfa-4cb6-9e83-1c25c3a70eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:15.929346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e2b3c03c-5cfa-4cb6-9e83-1c25c3a70eec None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:03:15.930571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e2b3c03c-5cfa-4cb6-9e83-1c25c3a70eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:15.932585 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:16.028423 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 714/1437] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 14:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:03:16.177572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9541ae0-36d5-4ca7-bbf8-993f062b4d2a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:03:16.179153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c9541ae0-36d5-4ca7-bbf8-993f062b4d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:16.325930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9541ae0-36d5-4ca7-bbf8-993f062b4d2a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:03:16.352767 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:16.443392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef030b0d-60f2-499b-a1b6-d9ed6bc08dfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:03:16.444047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef030b0d-60f2-499b-a1b6-d9ed6bc08dfc service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:16.444331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef030b0d-60f2-499b-a1b6-d9ed6bc08dfc service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:16.444608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef030b0d-60f2-499b-a1b6-d9ed6bc08dfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:16.446336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ef030b0d-60f2-499b-a1b6-d9ed6bc08dfc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:16.536149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef030b0d-60f2-499b-a1b6-d9ed6bc08dfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:03:16.537731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef030b0d-60f2-499b-a1b6-d9ed6bc08dfc service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:03:16.556292 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 724/1438] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:03:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:03:18.484613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7469f-722b-46e3-aea6-14be98b54706 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:18.485191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7469f-722b-46e3-aea6-14be98b54706 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:18.485308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a7469f-722b-46e3-aea6-14be98b54706 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:18.486659 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 715/1439] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 14:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:03:18.492685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b91d0e-7171-4bb4-b814-e09454a9f358 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:18.493133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b91d0e-7171-4bb4-b814-e09454a9f358 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:18.493245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b91d0e-7171-4bb4-b814-e09454a9f358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:18.533192 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:18.557708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-47b91d0e-7171-4bb4-b814-e09454a9f358 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:03:18.558932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-47b91d0e-7171-4bb4-b814-e09454a9f358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:18.654486 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 725/1440] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 14:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:03:18.695376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7469f-722b-46e3-aea6-14be98b54706 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:03:18.696924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a5a7469f-722b-46e3-aea6-14be98b54706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:18.800214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a7469f-722b-46e3-aea6-14be98b54706 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:03:18.832584 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:18.872933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ffd18-2075-4fa6-b0ba-abebb08cbf98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:03:18.873615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ffd18-2075-4fa6-b0ba-abebb08cbf98 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:18.873918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ffd18-2075-4fa6-b0ba-abebb08cbf98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:18.874231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ffd18-2075-4fa6-b0ba-abebb08cbf98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:18.875862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-216ffd18-2075-4fa6-b0ba-abebb08cbf98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:18.984010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ffd18-2075-4fa6-b0ba-abebb08cbf98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:03:18.985440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ffd18-2075-4fa6-b0ba-abebb08cbf98 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:03:19.004716 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 716/1441] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:03:21.186686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264365b-e49d-4f34-b967-c74528ac38c7 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:21.187246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264365b-e49d-4f34-b967-c74528ac38c7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:21.187246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9264365b-e49d-4f34-b967-c74528ac38c7 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:21.188630 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 726/1442] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 14:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:03:21.194441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a915aa-07b3-468a-a7c4-0f14e1333762 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:21.194915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a915aa-07b3-468a-a7c4-0f14e1333762 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:21.195024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a915aa-07b3-468a-a7c4-0f14e1333762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:21.260316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e6a915aa-07b3-468a-a7c4-0f14e1333762 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:03:21.261513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e6a915aa-07b3-468a-a7c4-0f14e1333762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:21.274232 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:21.358654 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 717/1443] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 14:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:03:21.398607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264365b-e49d-4f34-b967-c74528ac38c7 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:03:21.400465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9264365b-e49d-4f34-b967-c74528ac38c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:21.503449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9264365b-e49d-4f34-b967-c74528ac38c7 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:03:21.515417 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:21.579985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e82d73-a151-4b08-ab7c-fd0b59fcf8ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:03:21.580636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e82d73-a151-4b08-ab7c-fd0b59fcf8ff service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:21.580923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e82d73-a151-4b08-ab7c-fd0b59fcf8ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:21.581204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e82d73-a151-4b08-ab7c-fd0b59fcf8ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:21.582983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-63e82d73-a151-4b08-ab7c-fd0b59fcf8ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:21.695762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e82d73-a151-4b08-ab7c-fd0b59fcf8ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:03:21.697220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e82d73-a151-4b08-ab7c-fd0b59fcf8ff service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:03:21.716113 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 727/1444] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:03:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:03:24.142004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10658d0-150e-48a3-8bb6-57bac7dfb183 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:24.142645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10658d0-150e-48a3-8bb6-57bac7dfb183 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:24.142645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10658d0-150e-48a3-8bb6-57bac7dfb183 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:24.144583 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 718/1445] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 14:03:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:03:24.150172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7724519-f323-495c-800a-b1684eb6bbe5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:24.150595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7724519-f323-495c-800a-b1684eb6bbe5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:24.150738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7724519-f323-495c-800a-b1684eb6bbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:24.197830 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:24.216791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e7724519-f323-495c-800a-b1684eb6bbe5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:03:24.218001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e7724519-f323-495c-800a-b1684eb6bbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:24.313247 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 728/1446] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 14:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:03:24.353112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10658d0-150e-48a3-8bb6-57bac7dfb183 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:03:24.354726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e10658d0-150e-48a3-8bb6-57bac7dfb183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:24.457529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10658d0-150e-48a3-8bb6-57bac7dfb183 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:03:24.496885 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:24.531274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6bbddf-fd25-4e7e-ac25-456bf66bce27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:03:24.531921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bbddf-fd25-4e7e-ac25-456bf66bce27 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:24.532207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bbddf-fd25-4e7e-ac25-456bf66bce27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:24.532484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6bbddf-fd25-4e7e-ac25-456bf66bce27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:24.534126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2a6bbddf-fd25-4e7e-ac25-456bf66bce27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:24.640573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bbddf-fd25-4e7e-ac25-456bf66bce27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:03:24.641999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6bbddf-fd25-4e7e-ac25-456bf66bce27 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:03:24.660423 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 719/1447] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:03:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:03:26.869890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913b847-bb23-437c-b984-d1b88d660123 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:26.870428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913b847-bb23-437c-b984-d1b88d660123 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:26.870562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913b847-bb23-437c-b984-d1b88d660123 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:26.871958 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 729/1448] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 14:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:03:26.877348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5d862-0cbc-4fe4-bcf9-9cce09563a38 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:26.877799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5d862-0cbc-4fe4-bcf9-9cce09563a38 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:26.877901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed5d862-0cbc-4fe4-bcf9-9cce09563a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:26.943664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-bed5d862-0cbc-4fe4-bcf9-9cce09563a38 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:03:26.944936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bed5d862-0cbc-4fe4-bcf9-9cce09563a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:26.966389 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:27.042696 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 720/1449] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 14:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:03:27.080920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913b847-bb23-437c-b984-d1b88d660123 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:03:27.083482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b913b847-bb23-437c-b984-d1b88d660123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:27.185835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913b847-bb23-437c-b984-d1b88d660123 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:03:27.205995 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:27.260806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c05fd-dbaf-4e01-a496-4151b0f39015 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:03:27.261355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c05fd-dbaf-4e01-a496-4151b0f39015 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:27.261641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c05fd-dbaf-4e01-a496-4151b0f39015 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:27.261920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c05fd-dbaf-4e01-a496-4151b0f39015 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:27.263596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b00c05fd-dbaf-4e01-a496-4151b0f39015 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:27.373672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c05fd-dbaf-4e01-a496-4151b0f39015 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:03:27.375138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c05fd-dbaf-4e01-a496-4151b0f39015 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:03:27.400777 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 730/1450] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:03:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:03:29.608389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a777c3-c124-4fa5-bb4a-4a8261938257 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:29.608927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a777c3-c124-4fa5-bb4a-4a8261938257 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:29.608927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a777c3-c124-4fa5-bb4a-4a8261938257 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:29.610258 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 721/1451] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 14:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:03:29.616306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32552a2c-008f-40b4-a825-552f7554c429 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:29.616740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32552a2c-008f-40b4-a825-552f7554c429 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:29.616854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32552a2c-008f-40b4-a825-552f7554c429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:29.679030 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:29.682119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-32552a2c-008f-40b4-a825-552f7554c429 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:03:29.683335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-32552a2c-008f-40b4-a825-552f7554c429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:29.779033 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 731/1452] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 14:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:03:29.833877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1780e-fbdf-40a5-be31-73be736280b2 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:29.834207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1780e-fbdf-40a5-be31-73be736280b2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:29.834494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b1780e-fbdf-40a5-be31-73be736280b2 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:29.835917 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 722/1453] 10.222.0.43 () {54 vars in 965 bytes} [Tue Jul 19 14:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:03:29.841721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7006b3-e264-48e5-b3c6-57e6e75feb41 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:29.842041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7006b3-e264-48e5-b3c6-57e6e75feb41 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:29.842346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7006b3-e264-48e5-b3c6-57e6e75feb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:29.917443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-db7006b3-e264-48e5-b3c6-57e6e75feb41 None None] MFA Rules not processed for user `e997b70d7158446daa1dfa225eb7afca`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:03:29.918666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-db7006b3-e264-48e5-b3c6-57e6e75feb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:29.988272 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:29.994288 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 732/1454] 10.222.0.43 () {58 vars in 1062 bytes} [Tue Jul 19 14:03:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:03:30.003371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1780e-fbdf-40a5-be31-73be736280b2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:03:30.004945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c5b1780e-fbdf-40a5-be31-73be736280b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:30.109346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b1780e-fbdf-40a5-be31-73be736280b2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:03:30.158091 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:30.182976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd8eef0-8549-4f15-a5d2-12f584bdd5dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:03:30.183558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8eef0-8549-4f15-a5d2-12f584bdd5dd service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:30.183846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8eef0-8549-4f15-a5d2-12f584bdd5dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:30.184122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd8eef0-8549-4f15-a5d2-12f584bdd5dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:30.185759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-dbd8eef0-8549-4f15-a5d2-12f584bdd5dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:30.294882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8eef0-8549-4f15-a5d2-12f584bdd5dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:03:30.296325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd8eef0-8549-4f15-a5d2-12f584bdd5dd service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:03:30.315395 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 723/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:03:32.870561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86a63e-009c-425d-9e07-03cedc715bf3 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:32.871058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86a63e-009c-425d-9e07-03cedc715bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:32.871058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de86a63e-009c-425d-9e07-03cedc715bf3 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:32.872490 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 14:03:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:03:32.878138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c73f09-195c-4b82-9064-47f7547e3e89 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:32.879054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c73f09-195c-4b82-9064-47f7547e3e89 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:32.879054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c73f09-195c-4b82-9064-47f7547e3e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:32.942154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-18c73f09-195c-4b82-9064-47f7547e3e89 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:03:32.943364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-18c73f09-195c-4b82-9064-47f7547e3e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:32.973305 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:33.041370 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 14:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:03:33.084117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86a63e-009c-425d-9e07-03cedc715bf3 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:03:33.085680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-de86a63e-009c-425d-9e07-03cedc715bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:33.189985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de86a63e-009c-425d-9e07-03cedc715bf3 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:03:33.265209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef01a393-72cb-49ef-ba8b-0e539bc3e47d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:03:33.265890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01a393-72cb-49ef-ba8b-0e539bc3e47d service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:33.266203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01a393-72cb-49ef-ba8b-0e539bc3e47d service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:33.266482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef01a393-72cb-49ef-ba8b-0e539bc3e47d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:33.268136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ef01a393-72cb-49ef-ba8b-0e539bc3e47d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:33.316722 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:33.379202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01a393-72cb-49ef-ba8b-0e539bc3e47d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:03:33.380503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef01a393-72cb-49ef-ba8b-0e539bc3e47d service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:03:33.399984 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 734/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:03:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:03:35.489090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124ad6c-2ec0-4a79-85c2-989860888714 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:35.489599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124ad6c-2ec0-4a79-85c2-989860888714 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:35.489599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124ad6c-2ec0-4a79-85c2-989860888714 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:35.490955 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 14:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 14:03:35.496127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58d0bc-7acc-4aaf-bf4a-861c4980e09f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:35.496578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58d0bc-7acc-4aaf-bf4a-861c4980e09f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:35.496688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58d0bc-7acc-4aaf-bf4a-861c4980e09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:35.560115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7f58d0bc-7acc-4aaf-bf4a-861c4980e09f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:03:35.561311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7f58d0bc-7acc-4aaf-bf4a-861c4980e09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:35.662768 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 14:03:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:03:35.700989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124ad6c-2ec0-4a79-85c2-989860888714 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:03:35.702547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1124ad6c-2ec0-4a79-85c2-989860888714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:35.806728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1124ad6c-2ec0-4a79-85c2-989860888714 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:03:35.861769 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:35.880965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbbcd2f-db61-457b-ab59-e6470cc16c8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:03:35.881621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbcd2f-db61-457b-ab59-e6470cc16c8f service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:35.881906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbcd2f-db61-457b-ab59-e6470cc16c8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:35.882213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbbcd2f-db61-457b-ab59-e6470cc16c8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:35.883842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4dbbcd2f-db61-457b-ab59-e6470cc16c8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:35.992507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbcd2f-db61-457b-ab59-e6470cc16c8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:03:35.993927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbbcd2f-db61-457b-ab59-e6470cc16c8f service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:03:36.012158 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 726/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:03:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:03:38.123643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57d497-3cad-4eb0-a6c1-5ae9bc3ff36a None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:38.124212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57d497-3cad-4eb0-a6c1-5ae9bc3ff36a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:38.124212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57d497-3cad-4eb0-a6c1-5ae9bc3ff36a None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:38.125604 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 14:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:03:38.131423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd02fa2-45ad-4460-a1a9-83a567d35517 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:38.131852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd02fa2-45ad-4460-a1a9-83a567d35517 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:38.131981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd02fa2-45ad-4460-a1a9-83a567d35517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:38.196798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ccd02fa2-45ad-4460-a1a9-83a567d35517 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:03:38.197981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ccd02fa2-45ad-4460-a1a9-83a567d35517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:38.237964 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:38.295805 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 14:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:03:38.334550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57d497-3cad-4eb0-a6c1-5ae9bc3ff36a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:03:38.336099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0b57d497-3cad-4eb0-a6c1-5ae9bc3ff36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:38.340029 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:38.438635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57d497-3cad-4eb0-a6c1-5ae9bc3ff36a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:03:38.513528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc92497-fd9b-4f9a-b7bd-26ec0d6dd264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:03:38.514204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc92497-fd9b-4f9a-b7bd-26ec0d6dd264 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:38.514488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc92497-fd9b-4f9a-b7bd-26ec0d6dd264 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:38.514762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc92497-fd9b-4f9a-b7bd-26ec0d6dd264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:38.516383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6dc92497-fd9b-4f9a-b7bd-26ec0d6dd264 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:38.573516 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:38.623092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc92497-fd9b-4f9a-b7bd-26ec0d6dd264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:03:38.624881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc92497-fd9b-4f9a-b7bd-26ec0d6dd264 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:03:38.643403 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 737/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:03:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:03:40.701624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0ae65-a58a-4495-81b8-7d8e4c5fc662 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:40.702226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0ae65-a58a-4495-81b8-7d8e4c5fc662 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:40.702226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0ae65-a58a-4495-81b8-7d8e4c5fc662 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:40.703881 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 14:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:03:40.709913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a3233-3307-4ca9-9340-541f34fda46c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:40.710393 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a3233-3307-4ca9-9340-541f34fda46c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:40.710564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5a3233-3307-4ca9-9340-541f34fda46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:40.774785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ea5a3233-3307-4ca9-9340-541f34fda46c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:03:40.775991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ea5a3233-3307-4ca9-9340-541f34fda46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:40.871253 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 14:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:03:40.909063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0ae65-a58a-4495-81b8-7d8e4c5fc662 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:03:40.910661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8ab0ae65-a58a-4495-81b8-7d8e4c5fc662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:41.013865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0ae65-a58a-4495-81b8-7d8e4c5fc662 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:03:41.083510 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:41.090030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f048f01-f60a-428e-b054-cb210a15d8c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:03:41.090714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f048f01-f60a-428e-b054-cb210a15d8c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:41.090994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f048f01-f60a-428e-b054-cb210a15d8c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:41.091268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f048f01-f60a-428e-b054-cb210a15d8c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:41.092886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3f048f01-f60a-428e-b054-cb210a15d8c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:41.202803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f048f01-f60a-428e-b054-cb210a15d8c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:03:41.204526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f048f01-f60a-428e-b054-cb210a15d8c0 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:03:41.225500 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 729/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:03:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:03:43.448956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036beeb3-34d5-4105-b30a-3e6688280152 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:43.449554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036beeb3-34d5-4105-b30a-3e6688280152 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:43.449554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036beeb3-34d5-4105-b30a-3e6688280152 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:43.450915 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 14:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:03:43.460115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e8cf7-7c99-4ddf-a6af-b8c1de452845 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:43.460552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e8cf7-7c99-4ddf-a6af-b8c1de452845 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:43.460673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639e8cf7-7c99-4ddf-a6af-b8c1de452845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:43.525907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-639e8cf7-7c99-4ddf-a6af-b8c1de452845 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:03:43.527047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-639e8cf7-7c99-4ddf-a6af-b8c1de452845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:43.574324 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:43.622302 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 14:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:03:43.661355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036beeb3-34d5-4105-b30a-3e6688280152 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:03:43.662964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-036beeb3-34d5-4105-b30a-3e6688280152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:43.676905 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:43.767105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036beeb3-34d5-4105-b30a-3e6688280152 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:03:43.841258 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c8bea-1572-45e9-bf27-9ee0e2aa482b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:03:43.841832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c8bea-1572-45e9-bf27-9ee0e2aa482b service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:03:43.842128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c8bea-1572-45e9-bf27-9ee0e2aa482b service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:03:43.842409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c8bea-1572-45e9-bf27-9ee0e2aa482b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:03:43.844036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f61c8bea-1572-45e9-bf27-9ee0e2aa482b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:03:43.914195 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:43.955606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c8bea-1572-45e9-bf27-9ee0e2aa482b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:03:43.957574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c8bea-1572-45e9-bf27-9ee0e2aa482b service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:03:43.976153 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 740/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:03:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:03:53.620570 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=22 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:03:54.029628 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=25 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:04:03.998459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7d144-9287-4fe9-8747-cb03ef7b33a8 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:03.999062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7d144-9287-4fe9-8747-cb03ef7b33a8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:03.999062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb7d144-9287-4fe9-8747-cb03ef7b33a8 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:04.000450 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 731/1471] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:04:04.006657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45fe2b-b72f-4245-a77b-7abb7614425d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:04.007106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45fe2b-b72f-4245-a77b-7abb7614425d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:04.007213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b45fe2b-b72f-4245-a77b-7abb7614425d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:04.072411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5b45fe2b-b72f-4245-a77b-7abb7614425d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:04:04.073616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5b45fe2b-b72f-4245-a77b-7abb7614425d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:04:04.169874 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 741/1472] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:04:04.255768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87811a93-bbbb-456f-93e7-17f4259c60e3 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:04.256059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87811a93-bbbb-456f-93e7-17f4259c60e3 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:04.256338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87811a93-bbbb-456f-93e7-17f4259c60e3 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:04.257694 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 732/1473] 10.222.0.43 () {54 vars in 961 bytes} [Tue Jul 19 14:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:04:04.262486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb1702-3783-45dd-baa1-0960a9eba81d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:04.262786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb1702-3783-45dd-baa1-0960a9eba81d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:04.263072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbb1702-3783-45dd-baa1-0960a9eba81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:04.337345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9cbb1702-3783-45dd-baa1-0960a9eba81d None None] MFA Rules not processed for user `75efea22b2484c1ea79a74e6793050f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:04:04.338590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9cbb1702-3783-45dd-baa1-0960a9eba81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:04:04.359030 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:04:04.414724 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 742/1474] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Jul 19 14:04:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:04:04.421994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87811a93-bbbb-456f-93e7-17f4259c60e3 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:04:04.423509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-87811a93-bbbb-456f-93e7-17f4259c60e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:04:04.526123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87811a93-bbbb-456f-93e7-17f4259c60e3 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:04:04.598802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76464c98-30c7-4a4d-8335-02f13c6f887d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:04:04.599453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76464c98-30c7-4a4d-8335-02f13c6f887d service glance] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:04.599742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76464c98-30c7-4a4d-8335-02f13c6f887d service glance] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:04.600021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76464c98-30c7-4a4d-8335-02f13c6f887d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:04.601637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-76464c98-30c7-4a4d-8335-02f13c6f887d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:04:04.656898 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:04:04.715058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76464c98-30c7-4a4d-8335-02f13c6f887d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:04:04.716486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76464c98-30c7-4a4d-8335-02f13c6f887d service glance] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:04:04.735102 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 733/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:04:06.880058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12500afb-d330-4c18-adcd-538f14642836 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:06.880610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12500afb-d330-4c18-adcd-538f14642836 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:06.880610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12500afb-d330-4c18-adcd-538f14642836 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:06.882064 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 743/1476] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:04:06.887407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50465a2a-fd55-4995-88a3-a211490cf639 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:06.887828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50465a2a-fd55-4995-88a3-a211490cf639 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:06.887979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50465a2a-fd55-4995-88a3-a211490cf639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:06.952663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-50465a2a-fd55-4995-88a3-a211490cf639 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:04:06.954138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-50465a2a-fd55-4995-88a3-a211490cf639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:04:07.055922 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 734/1477] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:04:07.080606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12500afb-d330-4c18-adcd-538f14642836 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:04:07.083013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-12500afb-d330-4c18-adcd-538f14642836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:04:07.208510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12500afb-d330-4c18-adcd-538f14642836 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:04:07.258367 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:04:07.304712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f64490-888b-453d-96c3-0b9be0413546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:04:07.305301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f64490-888b-453d-96c3-0b9be0413546 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:07.305581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f64490-888b-453d-96c3-0b9be0413546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:07.305859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f64490-888b-453d-96c3-0b9be0413546 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:07.306626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f64490-888b-453d-96c3-0b9be0413546 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:04:07.308384 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-f5f64490-888b-453d-96c3-0b9be0413546 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:04:07.308384 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:04:07.308384 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:04:07.309500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f64490-888b-453d-96c3-0b9be0413546 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:04:07.329211 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 744/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Tue Jul 19 14:04:07 2022] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:04:09.379717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d266b0b-0090-4cb0-ab0f-3538a9127e7d None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:09.380286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d266b0b-0090-4cb0-ab0f-3538a9127e7d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:09.380286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d266b0b-0090-4cb0-ab0f-3538a9127e7d None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:09.381649 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 735/1479] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:04:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:04:09.387031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d83cb-5df3-4bdc-9b22-bbf4efde1ffb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:09.387462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d83cb-5df3-4bdc-9b22-bbf4efde1ffb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:09.387581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d83cb-5df3-4bdc-9b22-bbf4efde1ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:09.452237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c28d83cb-5df3-4bdc-9b22-bbf4efde1ffb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:04:09.453446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c28d83cb-5df3-4bdc-9b22-bbf4efde1ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:04:09.550514 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 745/1480] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:04:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:04:09.593737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d266b0b-0090-4cb0-ab0f-3538a9127e7d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:04:09.595284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2d266b0b-0090-4cb0-ab0f-3538a9127e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:04:09.605110 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:04:09.740516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d266b0b-0090-4cb0-ab0f-3538a9127e7d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:04:09.821657 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:04:09.853796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4964836-0a93-4527-b596-51b0a7fc69d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:04:09.854490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4964836-0a93-4527-b596-51b0a7fc69d3 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:09.854777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4964836-0a93-4527-b596-51b0a7fc69d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:09.855056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4964836-0a93-4527-b596-51b0a7fc69d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:09.856693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d4964836-0a93-4527-b596-51b0a7fc69d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:04:09.945059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4964836-0a93-4527-b596-51b0a7fc69d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:04:09.946683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4964836-0a93-4527-b596-51b0a7fc69d3 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:04:09.964525 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 736/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:04:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:04:12.183525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe6007-e914-40ce-9292-87d853a4c51a None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:12.184092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe6007-e914-40ce-9292-87d853a4c51a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:12.184092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afe6007-e914-40ce-9292-87d853a4c51a None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:12.185460 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 746/1482] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:04:12.191804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3635abc-1a97-444c-9af0-ef5e305bfe6b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:12.192201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3635abc-1a97-444c-9af0-ef5e305bfe6b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:12.192359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3635abc-1a97-444c-9af0-ef5e305bfe6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:12.257289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f3635abc-1a97-444c-9af0-ef5e305bfe6b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:04:12.258504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f3635abc-1a97-444c-9af0-ef5e305bfe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:04:12.304621 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:04:12.353459 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 737/1483] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:04:12.390639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe6007-e914-40ce-9292-87d853a4c51a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:04:12.392181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0afe6007-e914-40ce-9292-87d853a4c51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:04:12.415967 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:04:12.494879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afe6007-e914-40ce-9292-87d853a4c51a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:04:12.568630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060d9ab-c1eb-48bd-be1e-17f764e93fa8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:04:12.569274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060d9ab-c1eb-48bd-be1e-17f764e93fa8 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:12.569555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060d9ab-c1eb-48bd-be1e-17f764e93fa8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:12.569829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060d9ab-c1eb-48bd-be1e-17f764e93fa8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:12.571511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f060d9ab-c1eb-48bd-be1e-17f764e93fa8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:04:12.643618 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:04:12.677867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060d9ab-c1eb-48bd-be1e-17f764e93fa8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:04:12.679605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060d9ab-c1eb-48bd-be1e-17f764e93fa8 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:04:12.699003 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 747/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:04:14.793336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd46b3d-a14b-472e-802b-4e2c463c5cc7 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:14.793833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd46b3d-a14b-472e-802b-4e2c463c5cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:14.793934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd46b3d-a14b-472e-802b-4e2c463c5cc7 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:14.795291 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 738/1485] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:04:14.800966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff454a9-7190-402c-bb4e-4493016a248e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:14.801394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff454a9-7190-402c-bb4e-4493016a248e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:14.801525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff454a9-7190-402c-bb4e-4493016a248e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:14.867968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1ff454a9-7190-402c-bb4e-4493016a248e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:04:14.869178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1ff454a9-7190-402c-bb4e-4493016a248e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:04:14.967320 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 748/1486] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:04:15.006237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd46b3d-a14b-472e-802b-4e2c463c5cc7 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:04:15.007786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0bd46b3d-a14b-472e-802b-4e2c463c5cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:04:15.110709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd46b3d-a14b-472e-802b-4e2c463c5cc7 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:04:15.182797 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:04:15.184584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc70e1-17f3-4af4-9d75-d7952bac1304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:04:15.185231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc70e1-17f3-4af4-9d75-d7952bac1304 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:15.185513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc70e1-17f3-4af4-9d75-d7952bac1304 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:15.185789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc70e1-17f3-4af4-9d75-d7952bac1304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:15.187444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-32dc70e1-17f3-4af4-9d75-d7952bac1304 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:04:15.297830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc70e1-17f3-4af4-9d75-d7952bac1304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:04:15.299282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc70e1-17f3-4af4-9d75-d7952bac1304 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:04:15.318056 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 739/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:04:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:04:17.439899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad11f0e-edb4-4ca6-beaf-64d633bc36e3 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:17.440975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad11f0e-edb4-4ca6-beaf-64d633bc36e3 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:17.441086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad11f0e-edb4-4ca6-beaf-64d633bc36e3 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:17.442502 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 749/1488] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:04:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:04:17.447973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c70c44-f8b1-4715-802d-e745e1e3f9d2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:17.448363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c70c44-f8b1-4715-802d-e745e1e3f9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:17.448523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c70c44-f8b1-4715-802d-e745e1e3f9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:17.514023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-53c70c44-f8b1-4715-802d-e745e1e3f9d2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:04:17.515251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-53c70c44-f8b1-4715-802d-e745e1e3f9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:04:17.567964 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:04:17.612824 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 740/1489] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:04:17.654266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad11f0e-edb4-4ca6-beaf-64d633bc36e3 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:04:17.655809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cad11f0e-edb4-4ca6-beaf-64d633bc36e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:04:17.692887 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:04:17.762010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad11f0e-edb4-4ca6-beaf-64d633bc36e3 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:04:17.837330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a692d6b-db72-4d87-9914-745d036c8ea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:04:17.837898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a692d6b-db72-4d87-9914-745d036c8ea1 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:17.838206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a692d6b-db72-4d87-9914-745d036c8ea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:17.838483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a692d6b-db72-4d87-9914-745d036c8ea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:17.840111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4a692d6b-db72-4d87-9914-745d036c8ea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:04:17.919731 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:04:17.947513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a692d6b-db72-4d87-9914-745d036c8ea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:04:17.948942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a692d6b-db72-4d87-9914-745d036c8ea1 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:04:17.968150 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 750/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:04:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:04:20.340087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe912eba-4c65-43db-a4cf-980c11c9aef1 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:20.340699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe912eba-4c65-43db-a4cf-980c11c9aef1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:20.340699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe912eba-4c65-43db-a4cf-980c11c9aef1 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:20.342039 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 741/1491] 10.222.0.43 () {54 vars in 926 bytes} [Tue Jul 19 14:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:04:20.348006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8d7b3-2193-4801-b13a-142a1778281c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:20.348474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8d7b3-2193-4801-b13a-142a1778281c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:20.348581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8d7b3-2193-4801-b13a-142a1778281c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:20.412612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-59c8d7b3-2193-4801-b13a-142a1778281c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:04:20.413836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-59c8d7b3-2193-4801-b13a-142a1778281c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:04:20.510144 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 751/1492] 10.222.0.43 () {58 vars in 1023 bytes} [Tue Jul 19 14:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:04:20.549071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe912eba-4c65-43db-a4cf-980c11c9aef1 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:04:20.550845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fe912eba-4c65-43db-a4cf-980c11c9aef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:04:20.654655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe912eba-4c65-43db-a4cf-980c11c9aef1 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:04:20.728570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5d9eb-22c7-4462-bae9-5c4929ca7905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:04:20.729222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5d9eb-22c7-4462-bae9-5c4929ca7905 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:04:20.729511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5d9eb-22c7-4462-bae9-5c4929ca7905 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:04:20.729790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5d9eb-22c7-4462-bae9-5c4929ca7905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:04:20.731457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-09e5d9eb-22c7-4462-bae9-5c4929ca7905 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:04:20.740615 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:04:20.841239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5d9eb-22c7-4462-bae9-5c4929ca7905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:04:20.842707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5d9eb-22c7-4462-bae9-5c4929ca7905 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:04:20.860491 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 742/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:04:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:04:30.508315 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=82 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:04:30.858084 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=50 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:05:55.699933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80701779-49fd-40bd-abe7-7e7a9676c2c6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:05:55.700517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80701779-49fd-40bd-abe7-7e7a9676c2c6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:05:55.700517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80701779-49fd-40bd-abe7-7e7a9676c2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:05:55.776213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-80701779-49fd-40bd-abe7-7e7a9676c2c6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:05:55.777403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-80701779-49fd-40bd-abe7-7e7a9676c2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:05:55.874671 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 752/1494] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:05:55.883937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2756425-f6dc-4f32-9bb9-4dcb529360dd None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:05:55.884426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2756425-f6dc-4f32-9bb9-4dcb529360dd None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:05:55.884542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2756425-f6dc-4f32-9bb9-4dcb529360dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:05:55.960583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f2756425-f6dc-4f32-9bb9-4dcb529360dd None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:05:55.961721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f2756425-f6dc-4f32-9bb9-4dcb529360dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:05:56.058585 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 743/1495] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:05:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:05:56.063260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80701779-49fd-40bd-abe7-7e7a9676c2c6 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:05:56.064649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-80701779-49fd-40bd-abe7-7e7a9676c2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:05:56.076305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80701779-49fd-40bd-abe7-7e7a9676c2c6 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:05:56.138222 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:05:56.170845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad9b2f-18c6-4f6f-8862-ebc741c0e257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:05:56.171557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad9b2f-18c6-4f6f-8862-ebc741c0e257 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:05:56.171839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad9b2f-18c6-4f6f-8862-ebc741c0e257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:05:56.172116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad9b2f-18c6-4f6f-8862-ebc741c0e257 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:05:56.172839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad9b2f-18c6-4f6f-8862-ebc741c0e257 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:05:56.173151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad9b2f-18c6-4f6f-8862-ebc741c0e257 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:05:56.174259 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-f6ad9b2f-18c6-4f6f-8862-ebc741c0e257 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:05:56.174259 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:05:56.174259 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:05:56.175137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad9b2f-18c6-4f6f-8862-ebc741c0e257 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:05:56.187744 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 753/1496] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:05:56.196068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2756425-f6dc-4f32-9bb9-4dcb529360dd None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:05:56.205121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2756425-f6dc-4f32-9bb9-4dcb529360dd None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:05:56.267334 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:05:56.300206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169285de-6f9a-4fe6-9c19-897fab71ec02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:05:56.300866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169285de-6f9a-4fe6-9c19-897fab71ec02 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:05:56.301148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169285de-6f9a-4fe6-9c19-897fab71ec02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:05:56.301474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169285de-6f9a-4fe6-9c19-897fab71ec02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:05:56.302734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169285de-6f9a-4fe6-9c19-897fab71ec02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:05:56.304473 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-169285de-6f9a-4fe6-9c19-897fab71ec02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:05:56.304473 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:05:56.304473 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:05:56.305643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169285de-6f9a-4fe6-9c19-897fab71ec02 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:05:56.442798 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 744/1497] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:05:56 2022] POST /identity/v3/projects => generated 377 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:05:56.447145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad9b2f-18c6-4f6f-8862-ebc741c0e257 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:05:56.448699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f6ad9b2f-18c6-4f6f-8862-ebc741c0e257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:05:56.483620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad9b2f-18c6-4f6f-8862-ebc741c0e257 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:05:56.577301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96f885-7290-4226-8312-40602eaf132c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:05:56.577975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96f885-7290-4226-8312-40602eaf132c admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:05:56.578291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96f885-7290-4226-8312-40602eaf132c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:05:56.578569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a96f885-7290-4226-8312-40602eaf132c admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:05:56.579247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96f885-7290-4226-8312-40602eaf132c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:05:56.580256 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-1a96f885-7290-4226-8312-40602eaf132c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:05:56.580256 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:05:56.580256 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:05:56.581450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a96f885-7290-4226-8312-40602eaf132c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:05:56.813115 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 754/1498] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:05:56 2022] POST /identity/v3/users => generated 289 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:05:56.817045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169285de-6f9a-4fe6-9c19-897fab71ec02 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:05:56.819344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-169285de-6f9a-4fe6-9c19-897fab71ec02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:05:56.883771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169285de-6f9a-4fe6-9c19-897fab71ec02 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:05:56.967056 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:05:56.977935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824fdca-5de4-4cb5-b878-777a39227b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:05:56.978638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824fdca-5de4-4cb5-b878-777a39227b1f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:05:56.978924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824fdca-5de4-4cb5-b878-777a39227b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:05:56.979203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824fdca-5de4-4cb5-b878-777a39227b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:05:56.979927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824fdca-5de4-4cb5-b878-777a39227b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:05:56.980971 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-f824fdca-5de4-4cb5-b878-777a39227b1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:05:56.980971 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:05:56.980971 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:05:56.981845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f824fdca-5de4-4cb5-b878-777a39227b1f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:05:56.996702 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 745/1499] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:05:57.000824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96f885-7290-4226-8312-40602eaf132c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:05:57.002367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1a96f885-7290-4226-8312-40602eaf132c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:05:57.014306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a96f885-7290-4226-8312-40602eaf132c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:05:57.039634 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:05:57.108473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb91d87-d157-4b34-9fea-3c86614cd00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:05:57.109066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb91d87-d157-4b34-9fea-3c86614cd00a admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:05:57.109346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb91d87-d157-4b34-9fea-3c86614cd00a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:05:57.109619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb91d87-d157-4b34-9fea-3c86614cd00a admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:05:57.110395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb91d87-d157-4b34-9fea-3c86614cd00a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:05:57.111428 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-5fb91d87-d157-4b34-9fea-3c86614cd00a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:05:57.111428 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:05:57.111428 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:05:57.112306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb91d87-d157-4b34-9fea-3c86614cd00a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:05:57.125768 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 755/1500] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:05:56 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:05:57.129551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824fdca-5de4-4cb5-b878-777a39227b1f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:05:57.131354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f824fdca-5de4-4cb5-b878-777a39227b1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:05:57.165547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824fdca-5de4-4cb5-b878-777a39227b1f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:05:57.260002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d0dd8-38d8-40b9-80cb-3d7d9e356245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:05:57.260889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d0dd8-38d8-40b9-80cb-3d7d9e356245 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:05:57.261175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d0dd8-38d8-40b9-80cb-3d7d9e356245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:05:57.261445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d0dd8-38d8-40b9-80cb-3d7d9e356245 admin admin] PATH_INFO: `/v3/projects/7d80ff7a0270454480a4d9596a57ff08/users/dd558d1a278c4571812363e8c63c1806/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:05:57.283733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d0dd8-38d8-40b9-80cb-3d7d9e356245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d80ff7a0270454480a4d9596a57ff08, user_id=dd558d1a278c4571812363e8c63c1806, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:05:57.284760 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-ec7d0dd8-38d8-40b9-80cb-3d7d9e356245 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:05:57.284760 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:05:57.284760 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:05:57.287736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d0dd8-38d8-40b9-80cb-3d7d9e356245 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:05:57.381227 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 746/1501] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:05:57 2022] PUT /identity/v3/projects/7d80ff7a0270454480a4d9596a57ff08/users/dd558d1a278c4571812363e8c63c1806/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:05:57.393427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d17fc-7c82-4a9d-80d9-517570a49420 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:05:57.393717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d17fc-7c82-4a9d-80d9-517570a49420 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:05:57.393996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d17fc-7c82-4a9d-80d9-517570a49420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:05:57.449339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-611d17fc-7c82-4a9d-80d9-517570a49420 None None] MFA Rules not processed for user `dd558d1a278c4571812363e8c63c1806`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:05:57.450568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-611d17fc-7c82-4a9d-80d9-517570a49420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:05:57.528529 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 756/1502] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:05:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:05:57.541899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d1a14-30b1-41df-9846-74c4273bf88c None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:05:57.542227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d1a14-30b1-41df-9846-74c4273bf88c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:05:57.542509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d1a14-30b1-41df-9846-74c4273bf88c None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:05:57.543875 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 747/1503] 10.222.0.43 () {54 vars in 964 bytes} [Tue Jul 19 14:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:05:57.548815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c748e-5ad4-46eb-a9cb-278cec8ca40f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:05:57.549107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c748e-5ad4-46eb-a9cb-278cec8ca40f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:05:57.549390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c748e-5ad4-46eb-a9cb-278cec8ca40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:05:57.579086 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:05:57.622997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-182c748e-5ad4-46eb-a9cb-278cec8ca40f None None] MFA Rules not processed for user `ef77d9ec7712434287347d959dcf1cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:05:57.624569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-182c748e-5ad4-46eb-a9cb-278cec8ca40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:05:57.699662 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 757/1504] 10.222.0.43 () {58 vars in 1061 bytes} [Tue Jul 19 14:05:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:05:57.707468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d1a14-30b1-41df-9846-74c4273bf88c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:05:57.709188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1c4d1a14-30b1-41df-9846-74c4273bf88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:05:57.758659 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:05:57.811293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d1a14-30b1-41df-9846-74c4273bf88c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:05:57.883798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce2800-d4d3-43a2-a87b-cb6a3e862ff0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:05:57.884443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce2800-d4d3-43a2-a87b-cb6a3e862ff0 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:05:57.884724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce2800-d4d3-43a2-a87b-cb6a3e862ff0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:05:57.884999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce2800-d4d3-43a2-a87b-cb6a3e862ff0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:05:57.886657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b9ce2800-d4d3-43a2-a87b-cb6a3e862ff0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:05:57.984517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce2800-d4d3-43a2-a87b-cb6a3e862ff0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:05:57.985867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce2800-d4d3-43a2-a87b-cb6a3e862ff0 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:05:57.989663 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:05:58.004039 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 748/1505] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:05:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:05:58.046510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff928a9-0d39-49f1-882e-86ab633425d1 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:05:58.046939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff928a9-0d39-49f1-882e-86ab633425d1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:05:58.047063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff928a9-0d39-49f1-882e-86ab633425d1 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:05:58.048367 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 758/1506] 10.222.0.43 () {52 vars in 829 bytes} [Tue Jul 19 14:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:05:58.051911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce2800-d4d3-43a2-a87b-cb6a3e862ff0 service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:05:58.053116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b9ce2800-d4d3-43a2-a87b-cb6a3e862ff0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:05:58.151603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce2800-d4d3-43a2-a87b-cb6a3e862ff0 service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:05:58.246672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e204e-012a-455c-b5e4-99091238cbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:05:58.247489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e204e-012a-455c-b5e4-99091238cbe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:05:58.247777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e204e-012a-455c-b5e4-99091238cbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:05:58.248058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14e204e-012a-455c-b5e4-99091238cbe3 admin admin] PATH_INFO: `/v3/users/dd558d1a278c4571812363e8c63c1806` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:05:58.261010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e204e-012a-455c-b5e4-99091238cbe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd558d1a278c4571812363e8c63c1806)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:05:58.262036 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-f14e204e-012a-455c-b5e4-99091238cbe3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:05:58.262036 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:05:58.262036 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:05:58.263263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14e204e-012a-455c-b5e4-99091238cbe3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:05:58.274085 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:05:58.420642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f14e204e-012a-455c-b5e4-99091238cbe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd558d1a278c4571812363e8c63c1806'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:05:58.439038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f14e204e-012a-455c-b5e4-99091238cbe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd558d1a278c4571812363e8c63c1806'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:05:58.439480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f14e204e-012a-455c-b5e4-99091238cbe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd558d1a278c4571812363e8c63c1806'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:05:58.439996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f14e204e-012a-455c-b5e4-99091238cbe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd558d1a278c4571812363e8c63c1806'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:05:58.452895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f14e204e-012a-455c-b5e4-99091238cbe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd558d1a278c4571812363e8c63c1806'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:05:58.523349 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 749/1507] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:05:58 2022] DELETE /identity/v3/users/dd558d1a278c4571812363e8c63c1806 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:05:58.527693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e325e-816f-4223-89da-4e72873abda1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:05:58.527980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e325e-816f-4223-89da-4e72873abda1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:05:58.528260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e325e-816f-4223-89da-4e72873abda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:05:58.584227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-271e325e-816f-4223-89da-4e72873abda1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:05:58.585436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-271e325e-816f-4223-89da-4e72873abda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:05:58.658228 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:05:58.671041 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 759/1508] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:05:58.681162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e204e-012a-455c-b5e4-99091238cbe3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:05:58.682471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f14e204e-012a-455c-b5e4-99091238cbe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:05:58.781536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14e204e-012a-455c-b5e4-99091238cbe3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:05:58.838794 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:05:58.857471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3a0dc-f269-4a7d-85fa-96c2d4f65351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:05:58.858149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3a0dc-f269-4a7d-85fa-96c2d4f65351 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:05:58.858438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3a0dc-f269-4a7d-85fa-96c2d4f65351 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:05:58.858717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3a0dc-f269-4a7d-85fa-96c2d4f65351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:05:58.860341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b4f3a0dc-f269-4a7d-85fa-96c2d4f65351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:05:58.970302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3a0dc-f269-4a7d-85fa-96c2d4f65351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:05:58.971737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3a0dc-f269-4a7d-85fa-96c2d4f65351 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:05:58.990510 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 750/1509] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:05:59.480263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e325e-816f-4223-89da-4e72873abda1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:05:59.481540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-271e325e-816f-4223-89da-4e72873abda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:05:59.494195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e325e-816f-4223-89da-4e72873abda1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:05:59.598445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2d6fa-1db3-483b-8b8a-19f4b4de1371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:05:59.599382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2d6fa-1db3-483b-8b8a-19f4b4de1371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:05:59.599664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2d6fa-1db3-483b-8b8a-19f4b4de1371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:05:59.599936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2d6fa-1db3-483b-8b8a-19f4b4de1371 admin admin] PATH_INFO: `/v3/projects/7d80ff7a0270454480a4d9596a57ff08` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:05:59.611046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2d6fa-1db3-483b-8b8a-19f4b4de1371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d80ff7a0270454480a4d9596a57ff08)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:05:59.612079 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-40a2d6fa-1db3-483b-8b8a-19f4b4de1371 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:05:59.612079 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:05:59.612079 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:05:59.613250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2d6fa-1db3-483b-8b8a-19f4b4de1371 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:05:59.731478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-40a2d6fa-1db3-483b-8b8a-19f4b4de1371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d80ff7a0270454480a4d9596a57ff08', 'request_id': 'req-40a2d6fa-1db3-483b-8b8a-19f4b4de1371'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:05:59.737427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-40a2d6fa-1db3-483b-8b8a-19f4b4de1371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d80ff7a0270454480a4d9596a57ff08', 'request_id': 'req-40a2d6fa-1db3-483b-8b8a-19f4b4de1371'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:05:59.751000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-40a2d6fa-1db3-483b-8b8a-19f4b4de1371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d80ff7a0270454480a4d9596a57ff08', 'request_id': 'req-40a2d6fa-1db3-483b-8b8a-19f4b4de1371'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:05:59.852744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-40a2d6fa-1db3-483b-8b8a-19f4b4de1371 admin admin] The token cache is being invalidate because project 7d80ff7a0270454480a4d9596a57ff08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:05:59.853029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-40a2d6fa-1db3-483b-8b8a-19f4b4de1371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:05:59.853576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-40a2d6fa-1db3-483b-8b8a-19f4b4de1371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:05:59.855052 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 760/1510] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:05:59 2022] DELETE /identity/v3/projects/7d80ff7a0270454480a4d9596a57ff08 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:06:08.988160 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=62 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:06:09.850482 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:09:03.693398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc62cc-49cf-4e97-b55f-9f29bf21ae32 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:09:03.694017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc62cc-49cf-4e97-b55f-9f29bf21ae32 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:09:03.694017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcc62cc-49cf-4e97-b55f-9f29bf21ae32 None None] PATH_INFO: `/v3` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:09:03.695299 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 751/1511] 10.222.0.39 () {54 vars in 925 bytes} [Tue Jul 19 14:09:03 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:09:03.701963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159aed94-cc8b-4496-a958-2b2b7df4f739 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:09:03.702398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159aed94-cc8b-4496-a958-2b2b7df4f739 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:09:03.702555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159aed94-cc8b-4496-a958-2b2b7df4f739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:09:03.779916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-159aed94-cc8b-4496-a958-2b2b7df4f739 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:09:03.781098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-159aed94-cc8b-4496-a958-2b2b7df4f739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:09:03.893719 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 761/1512] 10.222.0.39 () {58 vars in 1015 bytes} [Tue Jul 19 14:09:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:09:04.205355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7874993-a550-4798-bde2-83abaedefbc5 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:09:04.205648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7874993-a550-4798-bde2-83abaedefbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:09:04.205927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7874993-a550-4798-bde2-83abaedefbc5 None None] PATH_INFO: `/v3` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:09:04.207404 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 752/1513] 10.222.0.52 () {54 vars in 925 bytes} [Tue Jul 19 14:09:04 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:09:04.214308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c8dc1-3a5f-4e36-838b-b5d26f042b63 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:09:04.214600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c8dc1-3a5f-4e36-838b-b5d26f042b63 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:09:04.214879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c8dc1-3a5f-4e36-838b-b5d26f042b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:09:04.233639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d96c8dc1-3a5f-4e36-838b-b5d26f042b63 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:09:04.235953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d96c8dc1-3a5f-4e36-838b-b5d26f042b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:09:04.244574 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 762/1514] 10.222.0.52 () {58 vars in 1015 bytes} [Tue Jul 19 14:09:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:09:07.997145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f697bc-b640-47e8-b415-472ae5fe1c5a None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:09:07.997746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f697bc-b640-47e8-b415-472ae5fe1c5a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:09:07.997746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f697bc-b640-47e8-b415-472ae5fe1c5a None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:09:07.999069 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 753/1515] 10.222.0.43 () {54 vars in 961 bytes} [Tue Jul 19 14:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:09:08.004043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9c8d6-cbf7-4de6-92a9-af6ef323214b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:09:08.004492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9c8d6-cbf7-4de6-92a9-af6ef323214b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:09:08.004595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9c8d6-cbf7-4de6-92a9-af6ef323214b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:09:08.024562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b1a9c8d6-cbf7-4de6-92a9-af6ef323214b None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:09:08.029378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b1a9c8d6-cbf7-4de6-92a9-af6ef323214b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:09:08.035638 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 763/1516] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Jul 19 14:09:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:09:08.036534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4e3a1-a49e-46bb-81de-a9cb4f0568d5 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:09:08.036907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4e3a1-a49e-46bb-81de-a9cb4f0568d5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:09:08.037213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4e3a1-a49e-46bb-81de-a9cb4f0568d5 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:09:08.038590 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 754/1517] 10.222.0.43 () {54 vars in 961 bytes} [Tue Jul 19 14:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 14:09:08.043089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9c8d6-cbf7-4de6-92a9-af6ef323214b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:09:08.043610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a87e7-1132-4d50-ae46-d9b738969e4e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:09:08.043897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a87e7-1132-4d50-ae46-d9b738969e4e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:09:08.044170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5a87e7-1132-4d50-ae46-d9b738969e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:09:08.053283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a9c8d6-cbf7-4de6-92a9-af6ef323214b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:09:08.058465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb76662-ffe4-4cfd-8044-3ed504cdc7a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:09:08.059114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb76662-ffe4-4cfd-8044-3ed504cdc7a9 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:09:08.059398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb76662-ffe4-4cfd-8044-3ed504cdc7a9 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:09:08.059676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb76662-ffe4-4cfd-8044-3ed504cdc7a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:09:08.062355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-fa5a87e7-1132-4d50-ae46-d9b738969e4e None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:09:08.063590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fa5a87e7-1132-4d50-ae46-d9b738969e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:09:08.068528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb76662-ffe4-4cfd-8044-3ed504cdc7a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:09:08.070195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb76662-ffe4-4cfd-8044-3ed504cdc7a9 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:09:08.072702 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 755/1518] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Jul 19 14:09:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:09:08.080357 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 764/1519] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:09:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:09:08.080846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a87e7-1132-4d50-ae46-d9b738969e4e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:09:08.091657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5a87e7-1132-4d50-ae46-d9b738969e4e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:09:08.097777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e7271e-9e04-43b7-ab45-1ab89a6eac41 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:09:08.098571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7271e-9e04-43b7-ab45-1ab89a6eac41 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:09:08.098854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7271e-9e04-43b7-ab45-1ab89a6eac41 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:09:08.099134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7271e-9e04-43b7-ab45-1ab89a6eac41 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:09:08.108024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7271e-9e04-43b7-ab45-1ab89a6eac41 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:09:08.109717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e7271e-9e04-43b7-ab45-1ab89a6eac41 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:09:08.119900 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 756/1520] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:09:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:09:18.075743 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:09:18.115790 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=9 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:09:39.159834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b7768-9288-4412-aea6-d6d604381cce None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:09:39.160408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b7768-9288-4412-aea6-d6d604381cce None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:09:39.160408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532b7768-9288-4412-aea6-d6d604381cce None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:09:39.161751 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 765/1521] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 14:09:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:09:39.166905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84e3f1-c3df-4ec0-a1fb-105b4a294270 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:09:39.167357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84e3f1-c3df-4ec0-a1fb-105b4a294270 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:09:39.167457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84e3f1-c3df-4ec0-a1fb-105b4a294270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:09:39.225381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1a84e3f1-c3df-4ec0-a1fb-105b4a294270 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:09:39.226622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1a84e3f1-c3df-4ec0-a1fb-105b4a294270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:09:39.303397 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 757/1522] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 14:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:09:39.454595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b7768-9288-4412-aea6-d6d604381cce None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:09:39.456893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-532b7768-9288-4412-aea6-d6d604381cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:09:39.557980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532b7768-9288-4412-aea6-d6d604381cce None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:09:39.563435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5cc55-cb17-4407-b5a1-a55e1853638e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:09:39.564083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5cc55-cb17-4407-b5a1-a55e1853638e service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:09:39.564440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5cc55-cb17-4407-b5a1-a55e1853638e service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:09:39.564767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5cc55-cb17-4407-b5a1-a55e1853638e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:09:39.572802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5cc55-cb17-4407-b5a1-a55e1853638e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:09:39.574425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5cc55-cb17-4407-b5a1-a55e1853638e service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:09:39.584350 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 766/1523] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:09:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:09:40.419116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cc30b-596d-41db-a238-9515422582fc None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:09:40.419707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cc30b-596d-41db-a238-9515422582fc None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:09:40.419707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cc30b-596d-41db-a238-9515422582fc None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:09:40.421043 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 758/1524] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 14:09:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:09:40.426532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05a415-091e-48b5-8b2c-d2bd1d61be16 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:09:40.426972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05a415-091e-48b5-8b2c-d2bd1d61be16 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:09:40.427096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb05a415-091e-48b5-8b2c-d2bd1d61be16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:09:40.445998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-cb05a415-091e-48b5-8b2c-d2bd1d61be16 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:09:40.447294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cb05a415-091e-48b5-8b2c-d2bd1d61be16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:09:40.457583 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 767/1525] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 14:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:09:40.606588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cc30b-596d-41db-a238-9515422582fc None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:09:40.621922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320cc30b-596d-41db-a238-9515422582fc None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:09:40.627968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9dc60-2337-4c4a-a8a9-e7a649bf3b4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:09:40.628605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9dc60-2337-4c4a-a8a9-e7a649bf3b4d service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:09:40.628886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9dc60-2337-4c4a-a8a9-e7a649bf3b4d service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:09:40.629170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9dc60-2337-4c4a-a8a9-e7a649bf3b4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:09:40.637691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9dc60-2337-4c4a-a8a9-e7a649bf3b4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:09:40.639294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9dc60-2337-4c4a-a8a9-e7a649bf3b4d service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:09:40.649277 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 759/1526] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:09:44.463949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e041d7a-483a-48ac-a669-cac3f4d903e9 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:09:44.464515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e041d7a-483a-48ac-a669-cac3f4d903e9 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:09:44.464515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e041d7a-483a-48ac-a669-cac3f4d903e9 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:09:44.465890 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 768/1527] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 14:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:09:44.471066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70807f-3f79-40f1-a7ee-a6de3a2ce0c1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:09:44.471514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70807f-3f79-40f1-a7ee-a6de3a2ce0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:09:44.471768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70807f-3f79-40f1-a7ee-a6de3a2ce0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:09:44.490241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5c70807f-3f79-40f1-a7ee-a6de3a2ce0c1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:09:44.491349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5c70807f-3f79-40f1-a7ee-a6de3a2ce0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:09:44.499025 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 760/1528] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 14:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:09:44.573512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e041d7a-483a-48ac-a669-cac3f4d903e9 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:09:44.575243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5e041d7a-483a-48ac-a669-cac3f4d903e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:09:44.651874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e041d7a-483a-48ac-a669-cac3f4d903e9 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:09:44.655426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2eebd6-cdd6-4391-a9a5-6d4fa9b338a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:09:44.656066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2eebd6-cdd6-4391-a9a5-6d4fa9b338a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:09:44.656351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2eebd6-cdd6-4391-a9a5-6d4fa9b338a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:09:44.656627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2eebd6-cdd6-4391-a9a5-6d4fa9b338a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:09:44.666090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2eebd6-cdd6-4391-a9a5-6d4fa9b338a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:09:44.667566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2eebd6-cdd6-4391-a9a5-6d4fa9b338a7 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:09:44.677514 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 769/1529] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:09:46.713476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8acff-6ebe-43ed-a9cf-f5e920a36779 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:09:46.714523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8acff-6ebe-43ed-a9cf-f5e920a36779 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:09:46.714930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe8acff-6ebe-43ed-a9cf-f5e920a36779 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:09:46.716398 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 761/1530] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 14:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:09:46.721762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af875c85-d825-4bb4-b04e-8e18004dcd92 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:09:46.722235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af875c85-d825-4bb4-b04e-8e18004dcd92 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:09:46.722335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af875c85-d825-4bb4-b04e-8e18004dcd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:09:46.741456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-af875c85-d825-4bb4-b04e-8e18004dcd92 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:09:46.742737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-af875c85-d825-4bb4-b04e-8e18004dcd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:09:46.750639 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 770/1531] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 14:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:09:46.787858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8acff-6ebe-43ed-a9cf-f5e920a36779 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:09:46.798520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe8acff-6ebe-43ed-a9cf-f5e920a36779 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:09:46.802163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8b0558-314d-4a8c-ad24-63b447750582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:09:46.802805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b0558-314d-4a8c-ad24-63b447750582 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:09:46.803087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b0558-314d-4a8c-ad24-63b447750582 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:09:46.803362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8b0558-314d-4a8c-ad24-63b447750582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:09:46.812419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b0558-314d-4a8c-ad24-63b447750582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:09:46.821561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8b0558-314d-4a8c-ad24-63b447750582 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:09:46.823425 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 762/1532] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:09:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:09:56.736320 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:09:56.819197 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=65 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:10:37.048059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce5125-116d-4749-aba5-66052ccd2ee6 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:10:37.048059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce5125-116d-4749-aba5-66052ccd2ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:10:37.048059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce5125-116d-4749-aba5-66052ccd2ee6 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:10:37.048782 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 771/1533] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:10:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:10:37.053640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e031eb-0655-432f-b444-866bf9bbd9ee None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:10:37.054031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e031eb-0655-432f-b444-866bf9bbd9ee None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:10:37.054236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e031eb-0655-432f-b444-866bf9bbd9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:10:37.072939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-46e031eb-0655-432f-b444-866bf9bbd9ee None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:10:37.074298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-46e031eb-0655-432f-b444-866bf9bbd9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:10:37.083308 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 763/1534] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:10:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:10:47.067819 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:13.771511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cebde4-1e7b-48ff-90b2-4491f3384020 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:13.772104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cebde4-1e7b-48ff-90b2-4491f3384020 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:13.772104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cebde4-1e7b-48ff-90b2-4491f3384020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:13.795702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c1cebde4-1e7b-48ff-90b2-4491f3384020 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:13.797282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c1cebde4-1e7b-48ff-90b2-4491f3384020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:13.809625 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 772/1535] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:13.819413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b940cb5-697f-42cf-ab31-60f315575109 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:13.819933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b940cb5-697f-42cf-ab31-60f315575109 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:13.820021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b940cb5-697f-42cf-ab31-60f315575109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:13.843767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2b940cb5-697f-42cf-ab31-60f315575109 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:13.845114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2b940cb5-697f-42cf-ab31-60f315575109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:13.858255 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 764/1536] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:13.863016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cebde4-1e7b-48ff-90b2-4491f3384020 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:13.877747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cebde4-1e7b-48ff-90b2-4491f3384020 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:13.889731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5412d8-456d-4d4b-9da9-cc5f9bec3cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:13.890793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5412d8-456d-4d4b-9da9-cc5f9bec3cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:13.891291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5412d8-456d-4d4b-9da9-cc5f9bec3cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:13.891830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5412d8-456d-4d4b-9da9-cc5f9bec3cf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:13.892776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5412d8-456d-4d4b-9da9-cc5f9bec3cf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:11:13.893251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5412d8-456d-4d4b-9da9-cc5f9bec3cf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:13.895525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5412d8-456d-4d4b-9da9-cc5f9bec3cf2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:13.910546 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 773/1537] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:13.919951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b940cb5-697f-42cf-ab31-60f315575109 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:13.935275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b940cb5-697f-42cf-ab31-60f315575109 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:13.946561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef295d2b-2731-4aa6-8d0c-5e49f84cec7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:13.947262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef295d2b-2731-4aa6-8d0c-5e49f84cec7e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:13.947538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef295d2b-2731-4aa6-8d0c-5e49f84cec7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:13.947822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef295d2b-2731-4aa6-8d0c-5e49f84cec7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:13.948530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef295d2b-2731-4aa6-8d0c-5e49f84cec7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:13.951330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef295d2b-2731-4aa6-8d0c-5e49f84cec7e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:14.098066 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 765/1538] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:13 2022] POST /identity/v3/projects => generated 381 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:14.103190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5412d8-456d-4d4b-9da9-cc5f9bec3cf2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:14.118864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5412d8-456d-4d4b-9da9-cc5f9bec3cf2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:14.199925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfa9a2-5925-4b94-9448-1332a4c0e38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:14.201002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfa9a2-5925-4b94-9448-1332a4c0e38d admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:14.201644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfa9a2-5925-4b94-9448-1332a4c0e38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:14.202150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfa9a2-5925-4b94-9448-1332a4c0e38d admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:14.203116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfa9a2-5925-4b94-9448-1332a4c0e38d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:14.205263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfa9a2-5925-4b94-9448-1332a4c0e38d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:14.240915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fc372-2a0e-4f82-9713-8e4f19b2448f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:14.244925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fc372-2a0e-4f82-9713-8e4f19b2448f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:14.244925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fc372-2a0e-4f82-9713-8e4f19b2448f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:14.273087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d60fc372-2a0e-4f82-9713-8e4f19b2448f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:14.274864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d60fc372-2a0e-4f82-9713-8e4f19b2448f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:14.290825 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 766/1539] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:11:14.300360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad12252-b1e6-4412-ba19-6a9443c4785a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:14.300902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad12252-b1e6-4412-ba19-6a9443c4785a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:14.301365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad12252-b1e6-4412-ba19-6a9443c4785a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:14.324491 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 774/1540] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:14 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:14.328627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfa9a2-5925-4b94-9448-1332a4c0e38d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:14.335111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2ad12252-b1e6-4412-ba19-6a9443c4785a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:14.336726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2ad12252-b1e6-4412-ba19-6a9443c4785a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:14.343891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfa9a2-5925-4b94-9448-1332a4c0e38d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:14.352240 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 767/1541] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:11:14.354976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40808a87-8f6f-4954-92ca-f964f2e0cfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:14.357368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad12252-b1e6-4412-ba19-6a9443c4785a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:14.359612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40808a87-8f6f-4954-92ca-f964f2e0cfb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:14.359921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40808a87-8f6f-4954-92ca-f964f2e0cfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:14.360211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40808a87-8f6f-4954-92ca-f964f2e0cfb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:14.361538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40808a87-8f6f-4954-92ca-f964f2e0cfb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:14.366138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40808a87-8f6f-4954-92ca-f964f2e0cfb6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:14.377850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad12252-b1e6-4412-ba19-6a9443c4785a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:14.384218 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 775/1542] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:11:14.388180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40808a87-8f6f-4954-92ca-f964f2e0cfb6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:14.391145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0a40f-1955-4bf5-98c3-2e1fbfc23dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:14.392076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0a40f-1955-4bf5-98c3-2e1fbfc23dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:14.392573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0a40f-1955-4bf5-98c3-2e1fbfc23dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:14.393054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0a40f-1955-4bf5-98c3-2e1fbfc23dfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:14.394022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0a40f-1955-4bf5-98c3-2e1fbfc23dfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:11:14.394570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0a40f-1955-4bf5-98c3-2e1fbfc23dfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:14.395796 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-01c0a40f-1955-4bf5-98c3-2e1fbfc23dfe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:11:14.395796 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:11:14.395796 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:11:14.397022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0a40f-1955-4bf5-98c3-2e1fbfc23dfe admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:14.406121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40808a87-8f6f-4954-92ca-f964f2e0cfb6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:14.411338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b904fb8-14c3-4844-b400-10e365b50c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:14.412081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b904fb8-14c3-4844-b400-10e365b50c52 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:14.412376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b904fb8-14c3-4844-b400-10e365b50c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:14.412655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b904fb8-14c3-4844-b400-10e365b50c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:14.413388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b904fb8-14c3-4844-b400-10e365b50c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:14.416882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b904fb8-14c3-4844-b400-10e365b50c52 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:14.430355 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 768/1543] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:11:14.439407 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 776/1544] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:11:14.440144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0a40f-1955-4bf5-98c3-2e1fbfc23dfe admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:14.453673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0a40f-1955-4bf5-98c3-2e1fbfc23dfe admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:14.455502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b904fb8-14c3-4844-b400-10e365b50c52 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:14.470412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b904fb8-14c3-4844-b400-10e365b50c52 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:14.474622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b047a48-9e41-4bc4-b6be-5732bc79720e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:14.475314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b047a48-9e41-4bc4-b6be-5732bc79720e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:14.475611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b047a48-9e41-4bc4-b6be-5732bc79720e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:14.475891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b047a48-9e41-4bc4-b6be-5732bc79720e admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:14.476840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b047a48-9e41-4bc4-b6be-5732bc79720e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:14.477973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b77246-4975-4222-958d-c307f1b467ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:14.479210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b77246-4975-4222-958d-c307f1b467ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:14.479505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b77246-4975-4222-958d-c307f1b467ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:14.479785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b77246-4975-4222-958d-c307f1b467ba admin admin] PATH_INFO: `/v3/projects/b214946191a2499a84ba38a2d02ec29d/users/1b772e890d074ec5b58a167cf7007ba3/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:14.483934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b047a48-9e41-4bc4-b6be-5732bc79720e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:14.508370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b77246-4975-4222-958d-c307f1b467ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b214946191a2499a84ba38a2d02ec29d, user_id=1b772e890d074ec5b58a167cf7007ba3, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:14.509429 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-48b77246-4975-4222-958d-c307f1b467ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:11:14.509429 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:11:14.509429 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:11:14.512019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b77246-4975-4222-958d-c307f1b467ba admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:14.612820 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 769/1545] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:14 2022] POST /identity/v3/projects => generated 401 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:14.614285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb808b3-1b0c-47ed-90cd-5aa489b06f6a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:14.614581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb808b3-1b0c-47ed-90cd-5aa489b06f6a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:14.614864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb808b3-1b0c-47ed-90cd-5aa489b06f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:14.636534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-cfb808b3-1b0c-47ed-90cd-5aa489b06f6a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:14.637900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cfb808b3-1b0c-47ed-90cd-5aa489b06f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:14.664680 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 777/1546] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:14 2022] PUT /identity/v3/projects/b214946191a2499a84ba38a2d02ec29d/users/1b772e890d074ec5b58a167cf7007ba3/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:11:14.667716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0f04e-c625-40fb-b5e8-c00579eed849 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:14.667948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0f04e-c625-40fb-b5e8-c00579eed849 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:14.668435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0f04e-c625-40fb-b5e8-c00579eed849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:14.698665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-00c0f04e-c625-40fb-b5e8-c00579eed849 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:14.700310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-00c0f04e-c625-40fb-b5e8-c00579eed849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:14.707709 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 770/1547] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:14.709020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba5cdf-a2cd-42ad-b9cc-5548b325e29c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:14.709313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba5cdf-a2cd-42ad-b9cc-5548b325e29c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:14.709591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba5cdf-a2cd-42ad-b9cc-5548b325e29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:14.737513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3fba5cdf-a2cd-42ad-b9cc-5548b325e29c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:14.738746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3fba5cdf-a2cd-42ad-b9cc-5548b325e29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:14.768019 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 778/1548] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:14.768981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0f04e-c625-40fb-b5e8-c00579eed849 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:14.784202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0f04e-c625-40fb-b5e8-c00579eed849 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:14.790077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb64b7-76e3-4403-ac2d-6564060033c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:14.791018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb64b7-76e3-4403-ac2d-6564060033c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:14.791132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb64b7-76e3-4403-ac2d-6564060033c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:14.791354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb64b7-76e3-4403-ac2d-6564060033c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:14.792047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb64b7-76e3-4403-ac2d-6564060033c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:14.793966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb64b7-76e3-4403-ac2d-6564060033c1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:14.809277 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 771/1549] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:14.810610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaee310-9f2c-4608-9ccf-f865e2be64e3 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:14.810998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaee310-9f2c-4608-9ccf-f865e2be64e3 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:14.811282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaee310-9f2c-4608-9ccf-f865e2be64e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:14.835952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9aaee310-9f2c-4608-9ccf-f865e2be64e3 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:14.837605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9aaee310-9f2c-4608-9ccf-f865e2be64e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:14.848764 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 772/1550] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:14.855671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a9deb-509c-41fe-aac8-0e1f1368abd3 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:14.855671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a9deb-509c-41fe-aac8-0e1f1368abd3 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:14.855671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6a9deb-509c-41fe-aac8-0e1f1368abd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:14.872999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-dc6a9deb-509c-41fe-aac8-0e1f1368abd3 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:14.872999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-dc6a9deb-509c-41fe-aac8-0e1f1368abd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:14.873516 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 779/1551] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:14 2022] POST /identity/v3/users => generated 301 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:14.874664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8e377-b88f-4ca3-92ce-4e7bb3b02e40 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:14.875001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8e377-b88f-4ca3-92ce-4e7bb3b02e40 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:14.875367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8e377-b88f-4ca3-92ce-4e7bb3b02e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:14.884127 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 773/1552] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:14.885773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946843b3-55ed-4084-be35-17792299b7d8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:14.886068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946843b3-55ed-4084-be35-17792299b7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:14.890304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946843b3-55ed-4084-be35-17792299b7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:14.890911 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:14.893744 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:14.905814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-946843b3-55ed-4084-be35-17792299b7d8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:14.907781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c2f8e377-b88f-4ca3-92ce-4e7bb3b02e40 None None] MFA Rules not processed for user `1b772e890d074ec5b58a167cf7007ba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:14.907895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-946843b3-55ed-4084-be35-17792299b7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:14.907981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c2f8e377-b88f-4ca3-92ce-4e7bb3b02e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:14.915907 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 774/1553] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:14.917313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b808b-3ad3-43ca-8aa2-c5e34ea7bb92 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:14.917506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b808b-3ad3-43ca-8aa2-c5e34ea7bb92 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:14.917767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b808b-3ad3-43ca-8aa2-c5e34ea7bb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:14.936284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c39b808b-3ad3-43ca-8aa2-c5e34ea7bb92 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:14.937478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c39b808b-3ad3-43ca-8aa2-c5e34ea7bb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:14.949136 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 775/1554] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:14.949136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895fddd-4fcb-4f77-926a-c933833ee536 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:14.949136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895fddd-4fcb-4f77-926a-c933833ee536 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:14.949136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895fddd-4fcb-4f77-926a-c933833ee536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:14.966964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4895fddd-4fcb-4f77-926a-c933833ee536 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:14.968226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4895fddd-4fcb-4f77-926a-c933833ee536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:14.976194 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 776/1555] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:14.978216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a02b7-a0c0-4d5d-98b1-58d63b07ecfc None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:14.978502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a02b7-a0c0-4d5d-98b1-58d63b07ecfc None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:14.978788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a02b7-a0c0-4d5d-98b1-58d63b07ecfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:14.979897 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 780/1556] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:14.981330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c10dc-0287-4aa0-8936-12f134f8da50 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:14.981691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c10dc-0287-4aa0-8936-12f134f8da50 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:14.981915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c10dc-0287-4aa0-8936-12f134f8da50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:14.998208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-793a02b7-a0c0-4d5d-98b1-58d63b07ecfc None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:14.999426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-793a02b7-a0c0-4d5d-98b1-58d63b07ecfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:14.999540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-db0c10dc-0287-4aa0-8936-12f134f8da50 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:15.000679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-db0c10dc-0287-4aa0-8936-12f134f8da50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:15.011769 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 777/1557] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:15.011769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a02b7-a0c0-4d5d-98b1-58d63b07ecfc None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:15.011990 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 781/1558] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:15.014628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e8e44-4bd8-416c-83e2-e44cedc6128d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:15.014922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e8e44-4bd8-416c-83e2-e44cedc6128d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:15.015205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e8e44-4bd8-416c-83e2-e44cedc6128d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:15.019604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a02b7-a0c0-4d5d-98b1-58d63b07ecfc None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:15.024334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8a21c-18b9-44ad-9640-8549a73c2a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:15.025028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8a21c-18b9-44ad-9640-8549a73c2a5e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:15.025312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8a21c-18b9-44ad-9640-8549a73c2a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:15.025615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8a21c-18b9-44ad-9640-8549a73c2a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:15.026376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8a21c-18b9-44ad-9640-8549a73c2a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:15.027993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8a21c-18b9-44ad-9640-8549a73c2a5e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:15.033275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e97e8e44-4bd8-416c-83e2-e44cedc6128d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:15.034541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e97e8e44-4bd8-416c-83e2-e44cedc6128d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:15.038185 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 778/1559] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:15.041806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8a21c-18b9-44ad-9640-8549a73c2a5e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:15.046335 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 782/1560] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:15.047177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e8e44-4bd8-416c-83e2-e44cedc6128d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:15.049456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8a21c-18b9-44ad-9640-8549a73c2a5e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:15.054388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18973302-1ef7-44d2-b3d7-5f94ae430227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:15.055105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18973302-1ef7-44d2-b3d7-5f94ae430227 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:15.055391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18973302-1ef7-44d2-b3d7-5f94ae430227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:15.055670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18973302-1ef7-44d2-b3d7-5f94ae430227 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:15.056397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18973302-1ef7-44d2-b3d7-5f94ae430227 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:11:15.056705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18973302-1ef7-44d2-b3d7-5f94ae430227 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:15.058339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18973302-1ef7-44d2-b3d7-5f94ae430227 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:15.059583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e8e44-4bd8-416c-83e2-e44cedc6128d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:15.064334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c8e3e-f88e-42bb-aa5e-2dc878d891cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:15.065802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c8e3e-f88e-42bb-aa5e-2dc878d891cf admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:15.065802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c8e3e-f88e-42bb-aa5e-2dc878d891cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:15.065963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c8e3e-f88e-42bb-aa5e-2dc878d891cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:15.066646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c8e3e-f88e-42bb-aa5e-2dc878d891cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:11:15.066957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c8e3e-f88e-42bb-aa5e-2dc878d891cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:15.068543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34c8e3e-f88e-42bb-aa5e-2dc878d891cf admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:15.071632 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 779/1561] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:15.078821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18973302-1ef7-44d2-b3d7-5f94ae430227 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:15.082614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18973302-1ef7-44d2-b3d7-5f94ae430227 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:15.083043 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 783/1562] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:15.084204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34c6a0-9ce4-46fe-85d6-d4dd5864596b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:15.084545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34c6a0-9ce4-46fe-85d6-d4dd5864596b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:15.084774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf34c6a0-9ce4-46fe-85d6-d4dd5864596b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:15.087774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5ff7d-31ba-41e9-b173-eb0d354b4250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:15.088439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5ff7d-31ba-41e9-b173-eb0d354b4250 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:15.088726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5ff7d-31ba-41e9-b173-eb0d354b4250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:15.089010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5ff7d-31ba-41e9-b173-eb0d354b4250 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:15.089795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5ff7d-31ba-41e9-b173-eb0d354b4250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:15.092000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5ff7d-31ba-41e9-b173-eb0d354b4250 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:15.104871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-cf34c6a0-9ce4-46fe-85d6-d4dd5864596b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:15.106068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cf34c6a0-9ce4-46fe-85d6-d4dd5864596b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:15.114285 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 784/1563] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:15.117725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34c6a0-9ce4-46fe-85d6-d4dd5864596b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:15.124932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf34c6a0-9ce4-46fe-85d6-d4dd5864596b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:15.129457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab04203-3f45-4b18-b2ee-65b8c489145a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:15.130090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab04203-3f45-4b18-b2ee-65b8c489145a admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:15.130405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab04203-3f45-4b18-b2ee-65b8c489145a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:15.130704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab04203-3f45-4b18-b2ee-65b8c489145a admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:15.131407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab04203-3f45-4b18-b2ee-65b8c489145a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:11:15.131716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab04203-3f45-4b18-b2ee-65b8c489145a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:15.133962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab04203-3f45-4b18-b2ee-65b8c489145a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:15.145240 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 785/1564] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:15.145995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab04203-3f45-4b18-b2ee-65b8c489145a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:15.155380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab04203-3f45-4b18-b2ee-65b8c489145a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:15.160038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce9faa-4873-480e-85fa-be915ab30551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:15.160678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce9faa-4873-480e-85fa-be915ab30551 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:15.160967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce9faa-4873-480e-85fa-be915ab30551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:15.161243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce9faa-4873-480e-85fa-be915ab30551 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:15.161960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce9faa-4873-480e-85fa-be915ab30551 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:11:15.162323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce9faa-4873-480e-85fa-be915ab30551 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:15.163890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce9faa-4873-480e-85fa-be915ab30551 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:15.166218 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 780/1565] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:15 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:15.169075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5ff7d-31ba-41e9-b173-eb0d354b4250 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:15.185845 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 786/1566] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:15.185845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce9faa-4873-480e-85fa-be915ab30551 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:15.188919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce9faa-4873-480e-85fa-be915ab30551 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:15.245739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5ff7d-31ba-41e9-b173-eb0d354b4250 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:15.250405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499dd46-b619-47b1-a916-7241d02e30da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:15.250546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89150201-5a96-48a2-bf71-d0f6bbe9f677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:15.251083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89150201-5a96-48a2-bf71-d0f6bbe9f677 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:15.251177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499dd46-b619-47b1-a916-7241d02e30da admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:15.251370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499dd46-b619-47b1-a916-7241d02e30da admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:15.251454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89150201-5a96-48a2-bf71-d0f6bbe9f677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:15.251651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5499dd46-b619-47b1-a916-7241d02e30da admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:15.251747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89150201-5a96-48a2-bf71-d0f6bbe9f677 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:15.252381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499dd46-b619-47b1-a916-7241d02e30da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:11:15.252470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89150201-5a96-48a2-bf71-d0f6bbe9f677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:15.252711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499dd46-b619-47b1-a916-7241d02e30da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:15.253983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89150201-5a96-48a2-bf71-d0f6bbe9f677 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:15.254340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5499dd46-b619-47b1-a916-7241d02e30da admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:15.265243 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 781/1567] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:15.266289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89150201-5a96-48a2-bf71-d0f6bbe9f677 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:15.266392 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 787/1568] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:15.267041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499dd46-b619-47b1-a916-7241d02e30da admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:15.280886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5499dd46-b619-47b1-a916-7241d02e30da admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:15.284536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89150201-5a96-48a2-bf71-d0f6bbe9f677 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:15.285682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ac789-93a9-4fc3-bdd8-8c0e597ea7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:15.286367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ac789-93a9-4fc3-bdd8-8c0e597ea7d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:15.286660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ac789-93a9-4fc3-bdd8-8c0e597ea7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:15.286942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46ac789-93a9-4fc3-bdd8-8c0e597ea7d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:15.287637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ac789-93a9-4fc3-bdd8-8c0e597ea7d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:15.288654 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-b46ac789-93a9-4fc3-bdd8-8c0e597ea7d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:11:15.288654 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:11:15.288654 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:11:15.289783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421118ce-b7de-4e3a-abe1-028604c70fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:15.289917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46ac789-93a9-4fc3-bdd8-8c0e597ea7d8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:15.290481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421118ce-b7de-4e3a-abe1-028604c70fc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:15.290765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421118ce-b7de-4e3a-abe1-028604c70fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:15.291037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421118ce-b7de-4e3a-abe1-028604c70fc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:15.291718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421118ce-b7de-4e3a-abe1-028604c70fc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:15.293643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421118ce-b7de-4e3a-abe1-028604c70fc3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:15.410503 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 788/1569] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:15 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:15.415413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ac789-93a9-4fc3-bdd8-8c0e597ea7d8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:15.421236 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:15.442955 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 782/1570] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:15 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:15.442955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421118ce-b7de-4e3a-abe1-028604c70fc3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:15.477594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46ac789-93a9-4fc3-bdd8-8c0e597ea7d8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:15.509355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421118ce-b7de-4e3a-abe1-028604c70fc3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:15.514277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9c4ea-b6e4-4fae-8977-a08823021ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:15.514949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9c4ea-b6e4-4fae-8977-a08823021ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:15.515239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9c4ea-b6e4-4fae-8977-a08823021ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:15.515519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef9c4ea-b6e4-4fae-8977-a08823021ab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:15.516215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9c4ea-b6e4-4fae-8977-a08823021ab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:15.518138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef9c4ea-b6e4-4fae-8977-a08823021ab7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:15.526842 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:15.537706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ddc36-b375-484e-b78b-d6a86ab3ea34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:15.538472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ddc36-b375-484e-b78b-d6a86ab3ea34 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:15.538761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ddc36-b375-484e-b78b-d6a86ab3ea34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:15.539663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ddc36-b375-484e-b78b-d6a86ab3ea34 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:15.540429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ddc36-b375-484e-b78b-d6a86ab3ea34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:11:15.540741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ddc36-b375-484e-b78b-d6a86ab3ea34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:15.542385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ddc36-b375-484e-b78b-d6a86ab3ea34 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:15.553707 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 789/1571] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:15.555280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ddc36-b375-484e-b78b-d6a86ab3ea34 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:15.564991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ddc36-b375-484e-b78b-d6a86ab3ea34 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:15.569716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f3344-5496-4a81-8845-ff0b8ebee762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:15.570416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f3344-5496-4a81-8845-ff0b8ebee762 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:15.570706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f3344-5496-4a81-8845-ff0b8ebee762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:15.571075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f3344-5496-4a81-8845-ff0b8ebee762 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:15.571649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f3344-5496-4a81-8845-ff0b8ebee762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:15.573587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f3344-5496-4a81-8845-ff0b8ebee762 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:15.645227 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 783/1572] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:15 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:15.646030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9c4ea-b6e4-4fae-8977-a08823021ab7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:15.680682 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 790/1573] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:15 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:15.680682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f3344-5496-4a81-8845-ff0b8ebee762 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:15.688862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f3344-5496-4a81-8845-ff0b8ebee762 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:15.710686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef9c4ea-b6e4-4fae-8977-a08823021ab7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:15.716263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167bc4b-b78e-4eee-92da-e3a3c40f6847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:15.717228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167bc4b-b78e-4eee-92da-e3a3c40f6847 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:15.717638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167bc4b-b78e-4eee-92da-e3a3c40f6847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:15.717792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167bc4b-b78e-4eee-92da-e3a3c40f6847 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:15.718526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167bc4b-b78e-4eee-92da-e3a3c40f6847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:15.720518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167bc4b-b78e-4eee-92da-e3a3c40f6847 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:15.747591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e83449-296f-4989-8a8a-a53536375455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:15.748678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e83449-296f-4989-8a8a-a53536375455 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:15.748778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e83449-296f-4989-8a8a-a53536375455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:15.749013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e83449-296f-4989-8a8a-a53536375455 admin admin] PATH_INFO: `/v3/projects/78019b9af5224635add689b1db3af86c/users/c4a929fee10e45c8a072b778b7944ef8/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:15.763010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e83449-296f-4989-8a8a-a53536375455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78019b9af5224635add689b1db3af86c, user_id=c4a929fee10e45c8a072b778b7944ef8, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:15.766300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e83449-296f-4989-8a8a-a53536375455 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:15.808731 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 784/1574] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:15 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:15.808731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167bc4b-b78e-4eee-92da-e3a3c40f6847 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:15.867345 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 791/1575] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:15 2022] PUT /identity/v3/projects/78019b9af5224635add689b1db3af86c/users/c4a929fee10e45c8a072b778b7944ef8/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:15.868197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e83449-296f-4989-8a8a-a53536375455 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:15.869606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167bc4b-b78e-4eee-92da-e3a3c40f6847 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:15.886308 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:15.927242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624085e-84ed-4907-b206-ffa70fd4c24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:15.927936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624085e-84ed-4907-b206-ffa70fd4c24f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:15.928205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624085e-84ed-4907-b206-ffa70fd4c24f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:15.928488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624085e-84ed-4907-b206-ffa70fd4c24f admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:15.929188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624085e-84ed-4907-b206-ffa70fd4c24f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:15.931403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4624085e-84ed-4907-b206-ffa70fd4c24f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:15.932983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e83449-296f-4989-8a8a-a53536375455 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:15.937719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ad7cf-ae77-4ca4-909b-cdd2d21a4b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:15.939910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ad7cf-ae77-4ca4-909b-cdd2d21a4b68 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:15.939910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ad7cf-ae77-4ca4-909b-cdd2d21a4b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:15.939910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ad7cf-ae77-4ca4-909b-cdd2d21a4b68 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:15.939910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ad7cf-ae77-4ca4-909b-cdd2d21a4b68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:15.941552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1ad7cf-ae77-4ca4-909b-cdd2d21a4b68 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:16.050844 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 785/1576] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:15 2022] POST /identity/v3/projects => generated 385 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:16.051850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624085e-84ed-4907-b206-ffa70fd4c24f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:16.060766 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 792/1577] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:15 2022] POST /identity/v3/users => generated 294 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:16.061080 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:16.061731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ad7cf-ae77-4ca4-909b-cdd2d21a4b68 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:16.072804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1ad7cf-ae77-4ca4-909b-cdd2d21a4b68 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:16.119534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4624085e-84ed-4907-b206-ffa70fd4c24f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:16.127617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d76e7-3a93-44d5-ae37-3fb92764d871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:16.129416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d76e7-3a93-44d5-ae37-3fb92764d871 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.129968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d76e7-3a93-44d5-ae37-3fb92764d871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.130283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d76e7-3a93-44d5-ae37-3fb92764d871 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.134492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d76e7-3a93-44d5-ae37-3fb92764d871 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:16.135757 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-4d8d76e7-3a93-44d5-ae37-3fb92764d871 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:11:16.135757 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:11:16.135757 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:11:16.139006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d76e7-3a93-44d5-ae37-3fb92764d871 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:16.141889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d22c1a-ee9f-48c9-83f1-18e83ce827e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:16.142910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d22c1a-ee9f-48c9-83f1-18e83ce827e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.143391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d22c1a-ee9f-48c9-83f1-18e83ce827e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.143817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d22c1a-ee9f-48c9-83f1-18e83ce827e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.144650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d22c1a-ee9f-48c9-83f1-18e83ce827e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:16.147151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d22c1a-ee9f-48c9-83f1-18e83ce827e0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:16.229926 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 786/1578] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:16 2022] POST /identity/v3/users => generated 292 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:16.230985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d76e7-3a93-44d5-ae37-3fb92764d871 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:16.238783 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 793/1579] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:16 2022] POST /identity/v3/projects => generated 399 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:16.240167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d22c1a-ee9f-48c9-83f1-18e83ce827e0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:16.245167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d76e7-3a93-44d5-ae37-3fb92764d871 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:16.305144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d22c1a-ee9f-48c9-83f1-18e83ce827e0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:16.308682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97facc6-1dae-4332-81a3-fbe82eadfeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:16.309369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97facc6-1dae-4332-81a3-fbe82eadfeac admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.309657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97facc6-1dae-4332-81a3-fbe82eadfeac admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.309895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8bf07-31ed-4f2d-8e3c-eb9aa54e2205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:16.310003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97facc6-1dae-4332-81a3-fbe82eadfeac admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.310600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8bf07-31ed-4f2d-8e3c-eb9aa54e2205 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.310712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97facc6-1dae-4332-81a3-fbe82eadfeac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:16.310956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8bf07-31ed-4f2d-8e3c-eb9aa54e2205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.311162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8bf07-31ed-4f2d-8e3c-eb9aa54e2205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.311929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa8bf07-31ed-4f2d-8e3c-eb9aa54e2205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:16.312686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97facc6-1dae-4332-81a3-fbe82eadfeac admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:16.313524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa8bf07-31ed-4f2d-8e3c-eb9aa54e2205 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:16.325161 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 794/1580] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:16.326091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8bf07-31ed-4f2d-8e3c-eb9aa54e2205 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:16.340138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8bf07-31ed-4f2d-8e3c-eb9aa54e2205 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:16.345030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d93195-1043-45ed-ab59-476d835b2940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:16.345739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d93195-1043-45ed-ab59-476d835b2940 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.346024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d93195-1043-45ed-ab59-476d835b2940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.346332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d93195-1043-45ed-ab59-476d835b2940 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.347021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d93195-1043-45ed-ab59-476d835b2940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:16.348938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d93195-1043-45ed-ab59-476d835b2940 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:16.403489 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 787/1581] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:16 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:16.404774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535371c-f290-4fc0-b51c-bf06153c29c2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.405066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535371c-f290-4fc0-b51c-bf06153c29c2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.405346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3535371c-f290-4fc0-b51c-bf06153c29c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.422351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3535371c-f290-4fc0-b51c-bf06153c29c2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:16.423550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3535371c-f290-4fc0-b51c-bf06153c29c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:16.431557 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 788/1582] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:16.432138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535371c-f290-4fc0-b51c-bf06153c29c2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:16.441908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3535371c-f290-4fc0-b51c-bf06153c29c2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:16.445108 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 795/1583] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:16 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:16.445108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d93195-1043-45ed-ab59-476d835b2940 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:16.447779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f742dce-dddc-43fb-8400-a57e364bc87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:16.448453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f742dce-dddc-43fb-8400-a57e364bc87d admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.448735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f742dce-dddc-43fb-8400-a57e364bc87d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.449009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f742dce-dddc-43fb-8400-a57e364bc87d admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.449705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f742dce-dddc-43fb-8400-a57e364bc87d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:16.451761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f742dce-dddc-43fb-8400-a57e364bc87d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:16.454871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d93195-1043-45ed-ab59-476d835b2940 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:16.460139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c5ff3-c21e-4090-9f85-8d1c9b967767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:16.461946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c5ff3-c21e-4090-9f85-8d1c9b967767 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.462292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c5ff3-c21e-4090-9f85-8d1c9b967767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.462576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c5ff3-c21e-4090-9f85-8d1c9b967767 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.463337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c5ff3-c21e-4090-9f85-8d1c9b967767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:16.464942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c5ff3-c21e-4090-9f85-8d1c9b967767 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:16.467608 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:16.477641 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 796/1584] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:16.478688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c5ff3-c21e-4090-9f85-8d1c9b967767 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:16.489581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c5ff3-c21e-4090-9f85-8d1c9b967767 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:16.494925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b801b8-b95b-4b34-9fa4-ff8f083f4734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:16.500202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b801b8-b95b-4b34-9fa4-ff8f083f4734 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.500202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b801b8-b95b-4b34-9fa4-ff8f083f4734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.500202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b801b8-b95b-4b34-9fa4-ff8f083f4734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.500202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b801b8-b95b-4b34-9fa4-ff8f083f4734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:16.500202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b801b8-b95b-4b34-9fa4-ff8f083f4734 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:16.509177 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 797/1585] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:16.509926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b801b8-b95b-4b34-9fa4-ff8f083f4734 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:16.519099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b801b8-b95b-4b34-9fa4-ff8f083f4734 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:16.524370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bf164-2cb2-41c9-86a7-d4d18513d15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:16.526409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bf164-2cb2-41c9-86a7-d4d18513d15e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.526409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bf164-2cb2-41c9-86a7-d4d18513d15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.526409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600bf164-2cb2-41c9-86a7-d4d18513d15e admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.526409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600bf164-2cb2-41c9-86a7-d4d18513d15e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:16.528136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600bf164-2cb2-41c9-86a7-d4d18513d15e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:16.551518 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 789/1586] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:16 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:16.552341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f742dce-dddc-43fb-8400-a57e364bc87d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:16.562511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f742dce-dddc-43fb-8400-a57e364bc87d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:16.567137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37661952-0638-44b6-8f6a-f1a3740eca21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:16.568022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37661952-0638-44b6-8f6a-f1a3740eca21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.568300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37661952-0638-44b6-8f6a-f1a3740eca21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.568570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37661952-0638-44b6-8f6a-f1a3740eca21 admin admin] PATH_INFO: `/v3/projects/0c22b7f78279443fb69651b907e48f06/users/1ebe6cb0ca324e639593b52095c473db/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.584622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37661952-0638-44b6-8f6a-f1a3740eca21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c22b7f78279443fb69651b907e48f06, user_id=1ebe6cb0ca324e639593b52095c473db, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:16.588125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37661952-0638-44b6-8f6a-f1a3740eca21 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:16.638720 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 798/1587] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:16 2022] POST /identity/v3/users => generated 300 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:16.639550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bf164-2cb2-41c9-86a7-d4d18513d15e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:16.649331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600bf164-2cb2-41c9-86a7-d4d18513d15e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:16.654727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d4ed3-0d3d-436f-9a76-88b2aa5d65d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:16.659234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d4ed3-0d3d-436f-9a76-88b2aa5d65d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.659234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d4ed3-0d3d-436f-9a76-88b2aa5d65d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.659234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d4ed3-0d3d-436f-9a76-88b2aa5d65d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.659234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d4ed3-0d3d-436f-9a76-88b2aa5d65d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:16.659234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d4ed3-0d3d-436f-9a76-88b2aa5d65d4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:16.661909 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 790/1588] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:16 2022] PUT /identity/v3/projects/0c22b7f78279443fb69651b907e48f06/users/1ebe6cb0ca324e639593b52095c473db/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:16.662927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37661952-0638-44b6-8f6a-f1a3740eca21 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:16.670570 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 799/1589] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:16.671488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d4ed3-0d3d-436f-9a76-88b2aa5d65d4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:16.682630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d4ed3-0d3d-436f-9a76-88b2aa5d65d4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:16.706375 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:16.721112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37661952-0638-44b6-8f6a-f1a3740eca21 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:16.725279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737f42b-9015-4e25-a5a2-240abe1270eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:16.725940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737f42b-9015-4e25-a5a2-240abe1270eb service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.726260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737f42b-9015-4e25-a5a2-240abe1270eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.726549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737f42b-9015-4e25-a5a2-240abe1270eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.741722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2dec0-7f59-42d6-89f1-dd5413bb302e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:16.741722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2dec0-7f59-42d6-89f1-dd5413bb302e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.741722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2dec0-7f59-42d6-89f1-dd5413bb302e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.741722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2dec0-7f59-42d6-89f1-dd5413bb302e admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.742659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2dec0-7f59-42d6-89f1-dd5413bb302e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:16.744901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e2dec0-7f59-42d6-89f1-dd5413bb302e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:16.759592 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 800/1590] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:16.759592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2dec0-7f59-42d6-89f1-dd5413bb302e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:16.767638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2dec0-7f59-42d6-89f1-dd5413bb302e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:16.772952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876a3eb-0586-4619-91af-da4b51cf5f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:16.774681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876a3eb-0586-4619-91af-da4b51cf5f53 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.774970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876a3eb-0586-4619-91af-da4b51cf5f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.775247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876a3eb-0586-4619-91af-da4b51cf5f53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.775975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876a3eb-0586-4619-91af-da4b51cf5f53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:16.777569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876a3eb-0586-4619-91af-da4b51cf5f53 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:16.788763 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 801/1591] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:16.791063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876a3eb-0586-4619-91af-da4b51cf5f53 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:16.796939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737f42b-9015-4e25-a5a2-240abe1270eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:16.798511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737f42b-9015-4e25-a5a2-240abe1270eb service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:16.801036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876a3eb-0586-4619-91af-da4b51cf5f53 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:16.805930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797fa65-472e-4f6f-94be-d0b9b218c573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:16.806609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797fa65-472e-4f6f-94be-d0b9b218c573 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.806895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797fa65-472e-4f6f-94be-d0b9b218c573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.807172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797fa65-472e-4f6f-94be-d0b9b218c573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.807898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797fa65-472e-4f6f-94be-d0b9b218c573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:16.809503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797fa65-472e-4f6f-94be-d0b9b218c573 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:16.809975 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 791/1592] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:16.810824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737f42b-9015-4e25-a5a2-240abe1270eb service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:16.820606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737f42b-9015-4e25-a5a2-240abe1270eb service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:16.821533 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 802/1593] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:16.822563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797fa65-472e-4f6f-94be-d0b9b218c573 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:16.827521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23376abb-0b96-4ea2-9150-28840660aa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:16.828207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23376abb-0b96-4ea2-9150-28840660aa36 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.828495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23376abb-0b96-4ea2-9150-28840660aa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.828776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23376abb-0b96-4ea2-9150-28840660aa36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.830394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23376abb-0b96-4ea2-9150-28840660aa36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:16.832039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23376abb-0b96-4ea2-9150-28840660aa36 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:16.834909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797fa65-472e-4f6f-94be-d0b9b218c573 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:16.840727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3357850-2374-4909-8177-6980bd817793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:16.841407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3357850-2374-4909-8177-6980bd817793 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.848494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3357850-2374-4909-8177-6980bd817793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.848494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3357850-2374-4909-8177-6980bd817793 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.848494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3357850-2374-4909-8177-6980bd817793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:16.848732 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 792/1594] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:16.848802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3357850-2374-4909-8177-6980bd817793 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:16.848879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23376abb-0b96-4ea2-9150-28840660aa36 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:16.855705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23376abb-0b96-4ea2-9150-28840660aa36 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:16.858848 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 803/1595] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:16.859668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3357850-2374-4909-8177-6980bd817793 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:16.862132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bccfb-efc1-4d8b-abd9-5419dde8f718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:16.862809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bccfb-efc1-4d8b-abd9-5419dde8f718 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.863142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bccfb-efc1-4d8b-abd9-5419dde8f718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.863397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9bccfb-efc1-4d8b-abd9-5419dde8f718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.864157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9bccfb-efc1-4d8b-abd9-5419dde8f718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:16.865776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9bccfb-efc1-4d8b-abd9-5419dde8f718 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:16.870144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3357850-2374-4909-8177-6980bd817793 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:16.875243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bfc55-509e-48a5-9468-5ef3c8bb6c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:16.875816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bfc55-509e-48a5-9468-5ef3c8bb6c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.876105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bfc55-509e-48a5-9468-5ef3c8bb6c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.876205 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 793/1596] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:16.876590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bfc55-509e-48a5-9468-5ef3c8bb6c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.876937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bccfb-efc1-4d8b-abd9-5419dde8f718 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:16.877187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11bfc55-509e-48a5-9468-5ef3c8bb6c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:16.878899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11bfc55-509e-48a5-9468-5ef3c8bb6c93 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:16.888260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9bccfb-efc1-4d8b-abd9-5419dde8f718 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:16.889596 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 804/1597] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:16.890535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bfc55-509e-48a5-9468-5ef3c8bb6c93 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:16.893073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194e535-4777-4228-a53e-5d0914f8222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:16.893778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194e535-4777-4228-a53e-5d0914f8222a admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.894057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194e535-4777-4228-a53e-5d0914f8222a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.894367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194e535-4777-4228-a53e-5d0914f8222a admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.895085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194e535-4777-4228-a53e-5d0914f8222a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:16.896650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6194e535-4777-4228-a53e-5d0914f8222a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:16.901001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bfc55-509e-48a5-9468-5ef3c8bb6c93 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:16.906081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937644a-144d-4e35-9562-b569e9fcc4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:16.911515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937644a-144d-4e35-9562-b569e9fcc4d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.911515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937644a-144d-4e35-9562-b569e9fcc4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.911515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937644a-144d-4e35-9562-b569e9fcc4d9 admin admin] PATH_INFO: `/v3/projects/8458823a16a14038a81ad24acada2435/users/49bc75c5d2784446975e15dffe9d43a3/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.911787 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 794/1598] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:16.911787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194e535-4777-4228-a53e-5d0914f8222a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:16.918672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6194e535-4777-4228-a53e-5d0914f8222a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:16.923404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3378200-ee45-4db6-a5a5-94b50831d7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:16.924048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937644a-144d-4e35-9562-b569e9fcc4d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8458823a16a14038a81ad24acada2435, user_id=49bc75c5d2784446975e15dffe9d43a3, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:16.924512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3378200-ee45-4db6-a5a5-94b50831d7a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:16.924805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3378200-ee45-4db6-a5a5-94b50831d7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:16.925088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3378200-ee45-4db6-a5a5-94b50831d7a6 admin admin] PATH_INFO: `/v3/projects/70e00097efaf4465b4cd07b01354bff6/users/fd55de8387514ce897de2e20dea17db8/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:16.926728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937644a-144d-4e35-9562-b569e9fcc4d9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:16.941287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3378200-ee45-4db6-a5a5-94b50831d7a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e00097efaf4465b4cd07b01354bff6, user_id=fd55de8387514ce897de2e20dea17db8, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:16.944014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3378200-ee45-4db6-a5a5-94b50831d7a6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:17.021734 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 805/1599] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:16 2022] PUT /identity/v3/projects/8458823a16a14038a81ad24acada2435/users/49bc75c5d2784446975e15dffe9d43a3/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:17.022897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937644a-144d-4e35-9562-b569e9fcc4d9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:17.078878 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 795/1600] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:16 2022] PUT /identity/v3/projects/70e00097efaf4465b4cd07b01354bff6/users/fd55de8387514ce897de2e20dea17db8/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:17.084182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3378200-ee45-4db6-a5a5-94b50831d7a6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:17.084290 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:17.103945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937644a-144d-4e35-9562-b569e9fcc4d9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:17.160532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3378200-ee45-4db6-a5a5-94b50831d7a6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:17.169077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cc220-b217-474b-89ef-9f3f83dc4b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:17.169077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cc220-b217-474b-89ef-9f3f83dc4b09 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:17.169077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cc220-b217-474b-89ef-9f3f83dc4b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:17.169077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cc220-b217-474b-89ef-9f3f83dc4b09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:17.169439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cc220-b217-474b-89ef-9f3f83dc4b09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:17.172112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cc220-b217-474b-89ef-9f3f83dc4b09 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:17.186849 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 796/1601] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:17.188131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cc220-b217-474b-89ef-9f3f83dc4b09 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:17.194484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530774b-da05-4188-89e9-0ec0ba91cbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:17.196541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530774b-da05-4188-89e9-0ec0ba91cbea admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:17.197246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530774b-da05-4188-89e9-0ec0ba91cbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:17.197246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530774b-da05-4188-89e9-0ec0ba91cbea admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:17.198225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530774b-da05-4188-89e9-0ec0ba91cbea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:17.199857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530774b-da05-4188-89e9-0ec0ba91cbea admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:17.200825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cc220-b217-474b-89ef-9f3f83dc4b09 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:17.207284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe87f8-21e7-43aa-8017-c02f2427668e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:17.208467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe87f8-21e7-43aa-8017-c02f2427668e admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:17.208840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe87f8-21e7-43aa-8017-c02f2427668e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:17.209073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe87f8-21e7-43aa-8017-c02f2427668e admin admin] PATH_INFO: `/v3/projects/0c22b7f78279443fb69651b907e48f06/users/1ebe6cb0ca324e639593b52095c473db/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:17.211751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe87f8-21e7-43aa-8017-c02f2427668e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c22b7f78279443fb69651b907e48f06, user_id=1ebe6cb0ca324e639593b52095c473db, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:17.216812 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 806/1602] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:17.216971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe87f8-21e7-43aa-8017-c02f2427668e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:17.217059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530774b-da05-4188-89e9-0ec0ba91cbea admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:17.227242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530774b-da05-4188-89e9-0ec0ba91cbea admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:17.228401 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 797/1603] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:17 2022] PUT /identity/v3/projects/0c22b7f78279443fb69651b907e48f06/users/1ebe6cb0ca324e639593b52095c473db/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:17.234953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe87f8-21e7-43aa-8017-c02f2427668e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:17.253706 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:17.292159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258870cf-32d1-4098-82b7-aa707a3a9f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:17.293012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258870cf-32d1-4098-82b7-aa707a3a9f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:17.293294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258870cf-32d1-4098-82b7-aa707a3a9f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:17.293621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258870cf-32d1-4098-82b7-aa707a3a9f20 admin admin] PATH_INFO: `/v3/projects/8b5870cfe962401b82813a02a7bbca3f/users/3332dd100e1e461e9ad8d18471e691ee/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:17.307093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe87f8-21e7-43aa-8017-c02f2427668e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:17.312208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258870cf-32d1-4098-82b7-aa707a3a9f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5870cfe962401b82813a02a7bbca3f, user_id=3332dd100e1e461e9ad8d18471e691ee, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:17.312321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37f1f6f-f6b7-4dc7-98f7-8ef66a5e5481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:17.312441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258870cf-32d1-4098-82b7-aa707a3a9f20 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:17.312941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f1f6f-f6b7-4dc7-98f7-8ef66a5e5481 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:17.313296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f1f6f-f6b7-4dc7-98f7-8ef66a5e5481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:17.313643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37f1f6f-f6b7-4dc7-98f7-8ef66a5e5481 admin admin] PATH_INFO: `/v3/projects/0aeecac624684f049b9a3c53fa35d336/users/a47f5670b6a649abb7e0547933922575/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:17.328264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f1f6f-f6b7-4dc7-98f7-8ef66a5e5481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aeecac624684f049b9a3c53fa35d336, user_id=a47f5670b6a649abb7e0547933922575, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:17.330914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37f1f6f-f6b7-4dc7-98f7-8ef66a5e5481 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:17.398874 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 807/1604] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:17 2022] PUT /identity/v3/projects/8b5870cfe962401b82813a02a7bbca3f/users/3332dd100e1e461e9ad8d18471e691ee/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:17.404205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969813f-fbc9-44d2-aed6-60bad913553d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:17.404205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969813f-fbc9-44d2-aed6-60bad913553d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:17.404205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8969813f-fbc9-44d2-aed6-60bad913553d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:17.434197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8969813f-fbc9-44d2-aed6-60bad913553d None None] MFA Rules not processed for user `49bc75c5d2784446975e15dffe9d43a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:17.435424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8969813f-fbc9-44d2-aed6-60bad913553d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:17.449341 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 798/1605] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:17 2022] PUT /identity/v3/projects/0aeecac624684f049b9a3c53fa35d336/users/a47f5670b6a649abb7e0547933922575/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:17.450994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44053b9-3d9f-4f38-a485-2125bc73c6e3 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:17.451287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44053b9-3d9f-4f38-a485-2125bc73c6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:17.452260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44053b9-3d9f-4f38-a485-2125bc73c6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:17.496255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a44053b9-3d9f-4f38-a485-2125bc73c6e3 None None] MFA Rules not processed for user `fd55de8387514ce897de2e20dea17db8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:17.498139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a44053b9-3d9f-4f38-a485-2125bc73c6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:17.529402 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 808/1606] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:17.530123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969813f-fbc9-44d2-aed6-60bad913553d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:17.536730 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:17.581054 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 799/1607] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:17.585303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44053b9-3d9f-4f38-a485-2125bc73c6e3 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:17.603991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8969813f-fbc9-44d2-aed6-60bad913553d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:17.658299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44053b9-3d9f-4f38-a485-2125bc73c6e3 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:17.663373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f65a4e-18aa-42ce-a912-8c0e12932d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:17.665264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f65a4e-18aa-42ce-a912-8c0e12932d59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:17.665413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f65a4e-18aa-42ce-a912-8c0e12932d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:17.665719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f65a4e-18aa-42ce-a912-8c0e12932d59 admin admin] PATH_INFO: `/v3/projects/e57047eb4c784ce39ab918f81b260506/users/9bd94615a21d46bb8cca32211915996e/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:17.667031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e03ca1-58e4-4346-a8e0-fa03e135cfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:17.668038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e03ca1-58e4-4346-a8e0-fa03e135cfca admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:17.668420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e03ca1-58e4-4346-a8e0-fa03e135cfca admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:17.668798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e03ca1-58e4-4346-a8e0-fa03e135cfca admin admin] PATH_INFO: `/v3/projects/2e58dc52f520463da9b5757bee5f5281/users/0d71ff1b9e0e46cca3aec4415230a7f0/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:17.683366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f65a4e-18aa-42ce-a912-8c0e12932d59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e57047eb4c784ce39ab918f81b260506, user_id=9bd94615a21d46bb8cca32211915996e, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:17.686017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e03ca1-58e4-4346-a8e0-fa03e135cfca admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e58dc52f520463da9b5757bee5f5281, user_id=0d71ff1b9e0e46cca3aec4415230a7f0, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:17.686993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f65a4e-18aa-42ce-a912-8c0e12932d59 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:17.688906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e03ca1-58e4-4346-a8e0-fa03e135cfca admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:17.766676 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 800/1608] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:17 2022] PUT /identity/v3/projects/e57047eb4c784ce39ab918f81b260506/users/9bd94615a21d46bb8cca32211915996e/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:17.768381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea88ca-e3e5-469e-af06-b1b991b4aae0 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:17.768667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea88ca-e3e5-469e-af06-b1b991b4aae0 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:17.768939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea88ca-e3e5-469e-af06-b1b991b4aae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:17.785815 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 809/1609] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:17 2022] PUT /identity/v3/projects/2e58dc52f520463da9b5757bee5f5281/users/0d71ff1b9e0e46cca3aec4415230a7f0/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:17.787142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a0c1f-76e2-4afe-8525-4cac855ba212 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:17.787439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a0c1f-76e2-4afe-8525-4cac855ba212 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:17.787719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3a0c1f-76e2-4afe-8525-4cac855ba212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:17.790041 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:17.801040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1aea88ca-e3e5-469e-af06-b1b991b4aae0 None None] MFA Rules not processed for user `1ebe6cb0ca324e639593b52095c473db`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:17.802548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1aea88ca-e3e5-469e-af06-b1b991b4aae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:17.818270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ac3a0c1f-76e2-4afe-8525-4cac855ba212 None None] MFA Rules not processed for user `3332dd100e1e461e9ad8d18471e691ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:17.819354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ac3a0c1f-76e2-4afe-8525-4cac855ba212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:17.876187 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 801/1610] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:17.879822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79330e4c-953f-4790-89bc-825ab8f3fd1a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:17.880267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79330e4c-953f-4790-89bc-825ab8f3fd1a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:17.880811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79330e4c-953f-4790-89bc-825ab8f3fd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:17.894985 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 810/1611] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:17.896902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a0c1f-76e2-4afe-8525-4cac855ba212 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:17.923007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-79330e4c-953f-4790-89bc-825ab8f3fd1a None None] MFA Rules not processed for user `a47f5670b6a649abb7e0547933922575`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:17.924239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-79330e4c-953f-4790-89bc-825ab8f3fd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:17.928057 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:17.975538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3a0c1f-76e2-4afe-8525-4cac855ba212 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:17.981968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df2a7b4-e28a-4b52-aa70-5f6bba17bbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:17.982777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2a7b4-e28a-4b52-aa70-5f6bba17bbe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:17.983064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2a7b4-e28a-4b52-aa70-5f6bba17bbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:17.983349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2a7b4-e28a-4b52-aa70-5f6bba17bbe6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:17.984103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df2a7b4-e28a-4b52-aa70-5f6bba17bbe6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:17.986053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df2a7b4-e28a-4b52-aa70-5f6bba17bbe6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:18.003095 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 802/1612] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:18.003946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79330e4c-953f-4790-89bc-825ab8f3fd1a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:18.057504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79330e4c-953f-4790-89bc-825ab8f3fd1a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:18.061414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234c129-1112-4ce1-b9f3-07f63dcf4679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:18.062132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234c129-1112-4ce1-b9f3-07f63dcf4679 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:18.062426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234c129-1112-4ce1-b9f3-07f63dcf4679 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:18.062711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234c129-1112-4ce1-b9f3-07f63dcf4679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:18.082895 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 811/1613] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:17 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:18.082895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbcb35-259b-4c79-b5e3-3a69a3673ba6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:18.082895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbcb35-259b-4c79-b5e3-3a69a3673ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:18.082895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dbcb35-259b-4c79-b5e3-3a69a3673ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:18.112146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-81dbcb35-259b-4c79-b5e3-3a69a3673ba6 None None] MFA Rules not processed for user `9bd94615a21d46bb8cca32211915996e`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:18.112644 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:18.113346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-81dbcb35-259b-4c79-b5e3-3a69a3673ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:18.131994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234c129-1112-4ce1-b9f3-07f63dcf4679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:18.133990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234c129-1112-4ce1-b9f3-07f63dcf4679 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:18.142995 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 803/1614] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:18.144251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c7085-a6c1-4d32-a942-50b0318b2962 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:18.144545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c7085-a6c1-4d32-a942-50b0318b2962 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:18.144826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307c7085-a6c1-4d32-a942-50b0318b2962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:18.172627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-307c7085-a6c1-4d32-a942-50b0318b2962 None None] MFA Rules not processed for user `0d71ff1b9e0e46cca3aec4415230a7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:18.173852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-307c7085-a6c1-4d32-a942-50b0318b2962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:18.230541 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 812/1615] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:18.231705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbcb35-259b-4c79-b5e3-3a69a3673ba6 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:18.267241 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 804/1616] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:18.269069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f24cc0-5a8b-4ff2-ad2a-3b2dc3e6e9d0 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:18.269392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f24cc0-5a8b-4ff2-ad2a-3b2dc3e6e9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:18.270405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f24cc0-5a8b-4ff2-ad2a-3b2dc3e6e9d0 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:18.271672 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 805/1617] 10.222.0.43 () {54 vars in 962 bytes} [Tue Jul 19 14:11:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:11:18.286828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f24cc0-5a8b-4ff2-ad2a-3b2dc3e6e9d0 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:18.315401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dbcb35-259b-4c79-b5e3-3a69a3673ba6 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:18.315401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b011d-0326-42da-9c20-40bd975badcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:18.316406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b011d-0326-42da-9c20-40bd975badcf admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:18.316711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b011d-0326-42da-9c20-40bd975badcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:18.316993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0b011d-0326-42da-9c20-40bd975badcf admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:18.317708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b011d-0326-42da-9c20-40bd975badcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:18.319814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0b011d-0326-42da-9c20-40bd975badcf admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:18.427984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f24cc0-5a8b-4ff2-ad2a-3b2dc3e6e9d0 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:18.432957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2309421-dd2e-48dd-a978-ca0a8bd308c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:18.433860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2309421-dd2e-48dd-a978-ca0a8bd308c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:18.434308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2309421-dd2e-48dd-a978-ca0a8bd308c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:18.434687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2309421-dd2e-48dd-a978-ca0a8bd308c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:18.435487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2309421-dd2e-48dd-a978-ca0a8bd308c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:18.437504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2309421-dd2e-48dd-a978-ca0a8bd308c1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:18.452830 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 813/1618] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:18 2022] POST /identity/v3/projects => generated 383 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:18.453611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b011d-0326-42da-9c20-40bd975badcf admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:18.488294 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:18.531443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0b011d-0326-42da-9c20-40bd975badcf admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:18.536437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfa014-d92b-46cb-908c-b0114268fb3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:18.537221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfa014-d92b-46cb-908c-b0114268fb3d admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:18.537607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfa014-d92b-46cb-908c-b0114268fb3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:18.538032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cfa014-d92b-46cb-908c-b0114268fb3d admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:18.538849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfa014-d92b-46cb-908c-b0114268fb3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:18.541536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cfa014-d92b-46cb-908c-b0114268fb3d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:18.559238 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 806/1619] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:18 2022] POST /identity/v3/projects => generated 373 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:18.561297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2309421-dd2e-48dd-a978-ca0a8bd308c1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:18.630831 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:18.634414 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 814/1620] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:18 2022] POST /identity/v3/users => generated 299 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:18.635228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfa014-d92b-46cb-908c-b0114268fb3d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:18.645752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cfa014-d92b-46cb-908c-b0114268fb3d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:18.646378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2309421-dd2e-48dd-a978-ca0a8bd308c1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:18.650490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211dd3c-d0d6-4308-b333-80126c77026e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:18.651222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211dd3c-d0d6-4308-b333-80126c77026e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:18.651575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211dd3c-d0d6-4308-b333-80126c77026e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:18.651677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265effd-2634-40a1-8c83-129045262e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:18.651982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211dd3c-d0d6-4308-b333-80126c77026e admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:18.652518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265effd-2634-40a1-8c83-129045262e58 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:18.652768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265effd-2634-40a1-8c83-129045262e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:18.652970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211dd3c-d0d6-4308-b333-80126c77026e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:18.653211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4265effd-2634-40a1-8c83-129045262e58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:18.653986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265effd-2634-40a1-8c83-129045262e58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:18.655091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211dd3c-d0d6-4308-b333-80126c77026e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:18.656033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4265effd-2634-40a1-8c83-129045262e58 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:18.759154 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 815/1621] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:18 2022] POST /identity/v3/projects => generated 399 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:18.760467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9fd98-f4dd-45ee-b8a0-3eda759f8dbe None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:18.760769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9fd98-f4dd-45ee-b8a0-3eda759f8dbe None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:18.761048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef9fd98-f4dd-45ee-b8a0-3eda759f8dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:18.765845 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 807/1622] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:18 2022] POST /identity/v3/projects => generated 383 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:18.770135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265effd-2634-40a1-8c83-129045262e58 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:18.816313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7ef9fd98-f4dd-45ee-b8a0-3eda759f8dbe None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:18.818015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7ef9fd98-f4dd-45ee-b8a0-3eda759f8dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:18.866709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4265effd-2634-40a1-8c83-129045262e58 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:18.874257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92695d0f-358e-449d-9cd6-74645db53f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:18.875413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92695d0f-358e-449d-9cd6-74645db53f31 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:18.875706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92695d0f-358e-449d-9cd6-74645db53f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:18.875994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92695d0f-358e-449d-9cd6-74645db53f31 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:18.876870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92695d0f-358e-449d-9cd6-74645db53f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:18.878989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92695d0f-358e-449d-9cd6-74645db53f31 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:18.902253 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 816/1623] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Jul 19 14:11:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:18.908862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9fd98-f4dd-45ee-b8a0-3eda759f8dbe None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:18.915324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef9fd98-f4dd-45ee-b8a0-3eda759f8dbe None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:18.920066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65cdcdf-119d-417d-847f-e7d01c4eac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:18.920773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65cdcdf-119d-417d-847f-e7d01c4eac70 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:18.921060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65cdcdf-119d-417d-847f-e7d01c4eac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:18.921340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65cdcdf-119d-417d-847f-e7d01c4eac70 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:18.922070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65cdcdf-119d-417d-847f-e7d01c4eac70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:18.924055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65cdcdf-119d-417d-847f-e7d01c4eac70 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:18.964039 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 808/1624] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:18 2022] POST /identity/v3/users => generated 298 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:18.964854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92695d0f-358e-449d-9cd6-74645db53f31 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:18.974844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92695d0f-358e-449d-9cd6-74645db53f31 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:18.979618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bdd1c-2057-4ac3-ae96-6aa3e034402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:18.980473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bdd1c-2057-4ac3-ae96-6aa3e034402b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:18.980869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bdd1c-2057-4ac3-ae96-6aa3e034402b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:18.981155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bdd1c-2057-4ac3-ae96-6aa3e034402b admin admin] PATH_INFO: `/v3/users/fd55de8387514ce897de2e20dea17db8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:18.982424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bdd1c-2057-4ac3-ae96-6aa3e034402b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd55de8387514ce897de2e20dea17db8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:18.984310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bdd1c-2057-4ac3-ae96-6aa3e034402b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:19.038997 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 817/1625] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:18 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:19.040115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65cdcdf-119d-417d-847f-e7d01c4eac70 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:19.051641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65cdcdf-119d-417d-847f-e7d01c4eac70 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:19.058202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0b7b8-5f4b-4221-b4b4-44209c53504f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:19.059160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0b7b8-5f4b-4221-b4b4-44209c53504f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:19.059519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0b7b8-5f4b-4221-b4b4-44209c53504f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:19.059869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0b7b8-5f4b-4221-b4b4-44209c53504f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:19.060613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0b7b8-5f4b-4221-b4b4-44209c53504f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:19.062253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a0b7b8-5f4b-4221-b4b4-44209c53504f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:19.077672 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 818/1626] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:19.078520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0b7b8-5f4b-4221-b4b4-44209c53504f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:19.095131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0b7b8-5f4b-4221-b4b4-44209c53504f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:19.101041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb4106-101a-4751-9607-7ce98925f4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:19.101971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb4106-101a-4751-9607-7ce98925f4ea admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:19.102350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb4106-101a-4751-9607-7ce98925f4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:19.102641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb4106-101a-4751-9607-7ce98925f4ea admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:19.103359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb4106-101a-4751-9607-7ce98925f4ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:19.107145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb4106-101a-4751-9607-7ce98925f4ea admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:19.179446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a92bdd1c-2057-4ac3-ae96-6aa3e034402b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd55de8387514ce897de2e20dea17db8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:19.195085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a92bdd1c-2057-4ac3-ae96-6aa3e034402b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd55de8387514ce897de2e20dea17db8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:19.196904 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 819/1627] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:19 2022] POST /identity/v3/users => generated 306 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:19.197034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a92bdd1c-2057-4ac3-ae96-6aa3e034402b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd55de8387514ce897de2e20dea17db8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:19.197797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a92bdd1c-2057-4ac3-ae96-6aa3e034402b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd55de8387514ce897de2e20dea17db8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:19.198323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb4106-101a-4751-9607-7ce98925f4ea admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:19.200317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-abbb4106-101a-4751-9607-7ce98925f4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:19.207758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a92bdd1c-2057-4ac3-ae96-6aa3e034402b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd55de8387514ce897de2e20dea17db8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:19.227394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb4106-101a-4751-9607-7ce98925f4ea admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:19.233032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa0918-28f1-4ca1-aa58-2d9011f5e4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:19.234031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa0918-28f1-4ca1-aa58-2d9011f5e4ff admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:19.235190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa0918-28f1-4ca1-aa58-2d9011f5e4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:19.235190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa0918-28f1-4ca1-aa58-2d9011f5e4ff admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:19.237435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa0918-28f1-4ca1-aa58-2d9011f5e4ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:19.238330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa0918-28f1-4ca1-aa58-2d9011f5e4ff admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:19.299624 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 809/1628] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:18 2022] DELETE /identity/v3/users/fd55de8387514ce897de2e20dea17db8 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:19.301012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bdd1c-2057-4ac3-ae96-6aa3e034402b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:19.302587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a92bdd1c-2057-4ac3-ae96-6aa3e034402b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:19.358409 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:19.398738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bdd1c-2057-4ac3-ae96-6aa3e034402b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:19.405129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a152f2c-2368-408e-956f-26d9709936bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:19.405889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a152f2c-2368-408e-956f-26d9709936bf service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:19.406228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a152f2c-2368-408e-956f-26d9709936bf service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:19.406511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a152f2c-2368-408e-956f-26d9709936bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:19.408374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9a152f2c-2368-408e-956f-26d9709936bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:19.413554 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 820/1629] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:19 2022] POST /identity/v3/users => generated 298 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:19.415573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa0918-28f1-4ca1-aa58-2d9011f5e4ff admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:19.417182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-72fa0918-28f1-4ca1-aa58-2d9011f5e4ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:19.427458 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:19.436774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa0918-28f1-4ca1-aa58-2d9011f5e4ff admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:19.475091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a152f2c-2368-408e-956f-26d9709936bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:19.477348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a152f2c-2368-408e-956f-26d9709936bf service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:19.487456 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 810/1630] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:19.488719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a152f2c-2368-408e-956f-26d9709936bf service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:19.490596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9a152f2c-2368-408e-956f-26d9709936bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:19.503373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91923c14-2e6f-4f9a-9450-8866eff903d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:19.504079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91923c14-2e6f-4f9a-9450-8866eff903d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:19.504437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91923c14-2e6f-4f9a-9450-8866eff903d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:19.504803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91923c14-2e6f-4f9a-9450-8866eff903d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:19.505619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91923c14-2e6f-4f9a-9450-8866eff903d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:19.508664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91923c14-2e6f-4f9a-9450-8866eff903d2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:19.521590 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 821/1631] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:19.522735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91923c14-2e6f-4f9a-9450-8866eff903d2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:19.526211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-91923c14-2e6f-4f9a-9450-8866eff903d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:19.542412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91923c14-2e6f-4f9a-9450-8866eff903d2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:19.549000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad17eb-828d-415f-a282-14e4dc0f6f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:19.549907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad17eb-828d-415f-a282-14e4dc0f6f20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:19.550248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad17eb-828d-415f-a282-14e4dc0f6f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:19.550569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad17eb-828d-415f-a282-14e4dc0f6f20 admin admin] PATH_INFO: `/v3/projects/15fffc5de382473aa3373dbd9e5c28f2/users/8a4975e9e58c44428a4caf775e4f0e15/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:19.564662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a152f2c-2368-408e-956f-26d9709936bf service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:19.568733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad17eb-828d-415f-a282-14e4dc0f6f20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15fffc5de382473aa3373dbd9e5c28f2, user_id=8a4975e9e58c44428a4caf775e4f0e15, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:19.569864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d61dc-6929-447e-b04c-45e3909921f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:19.571585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d61dc-6929-447e-b04c-45e3909921f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:19.572376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d61dc-6929-447e-b04c-45e3909921f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:19.572859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d61dc-6929-447e-b04c-45e3909921f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:19.574157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad17eb-828d-415f-a282-14e4dc0f6f20 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:19.576797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d61dc-6929-447e-b04c-45e3909921f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:19.578689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d61dc-6929-447e-b04c-45e3909921f9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:19.592261 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 811/1632] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:19.593307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d61dc-6929-447e-b04c-45e3909921f9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:19.595189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c80d61dc-6929-447e-b04c-45e3909921f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:19.612210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d61dc-6929-447e-b04c-45e3909921f9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:19.622211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23570020-dd70-469f-ad89-dcc2de26f963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:19.622979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23570020-dd70-469f-ad89-dcc2de26f963 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:19.623272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23570020-dd70-469f-ad89-dcc2de26f963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:19.623551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23570020-dd70-469f-ad89-dcc2de26f963 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:19.626291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23570020-dd70-469f-ad89-dcc2de26f963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:19.626291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23570020-dd70-469f-ad89-dcc2de26f963 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:19.640783 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 812/1633] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:19.640783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1d457-d695-4a58-8e68-baa42b1ff836 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:19.640783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1d457-d695-4a58-8e68-baa42b1ff836 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:19.640783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec1d457-d695-4a58-8e68-baa42b1ff836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:19.658427 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 822/1634] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:19 2022] PUT /identity/v3/projects/15fffc5de382473aa3373dbd9e5c28f2/users/8a4975e9e58c44428a4caf775e4f0e15/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:19.658427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad17eb-828d-415f-a282-14e4dc0f6f20 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:19.663835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9ec1d457-d695-4a58-8e68-baa42b1ff836 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:19.665939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9ec1d457-d695-4a58-8e68-baa42b1ff836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:19.734420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad17eb-828d-415f-a282-14e4dc0f6f20 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:19.751618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e3bf7-1608-49b9-97cc-d9d52ae2aedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:19.751618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e3bf7-1608-49b9-97cc-d9d52ae2aedb admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:19.751618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e3bf7-1608-49b9-97cc-d9d52ae2aedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:19.753064 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 813/1635] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:19.754187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e3bf7-1608-49b9-97cc-d9d52ae2aedb admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:19.754187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e3bf7-1608-49b9-97cc-d9d52ae2aedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:19.754187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e3bf7-1608-49b9-97cc-d9d52ae2aedb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:19.757529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1d457-d695-4a58-8e68-baa42b1ff836 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:19.762871 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:19.763009 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 823/1636] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:19.763713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e3bf7-1608-49b9-97cc-d9d52ae2aedb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:19.768824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec1d457-d695-4a58-8e68-baa42b1ff836 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:19.775444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f14a9-68d6-432f-91fd-14590651e057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:19.776447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f14a9-68d6-432f-91fd-14590651e057 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:19.776731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f14a9-68d6-432f-91fd-14590651e057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:19.777007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f14a9-68d6-432f-91fd-14590651e057 admin admin] PATH_INFO: `/v3/projects/36e02b9a41af4253b2d95ef88f65ba6d/users/0d78903fdd6e450e80249fa9c2f310f8/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:19.779027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e3bf7-1608-49b9-97cc-d9d52ae2aedb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:19.784399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999f9e5-4224-4611-a38b-ca5b5ec50a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:19.785550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999f9e5-4224-4611-a38b-ca5b5ec50a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:19.787256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999f9e5-4224-4611-a38b-ca5b5ec50a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:19.787256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999f9e5-4224-4611-a38b-ca5b5ec50a4d admin admin] PATH_INFO: `/v3/projects/92bdfbe398ea474b802d0f4f0a321bec/users/407b6c53d3194cb6ba52ec6166db89ff/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:19.796433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f14a9-68d6-432f-91fd-14590651e057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e02b9a41af4253b2d95ef88f65ba6d, user_id=0d78903fdd6e450e80249fa9c2f310f8, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:19.799634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f14a9-68d6-432f-91fd-14590651e057 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:19.803800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999f9e5-4224-4611-a38b-ca5b5ec50a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=92bdfbe398ea474b802d0f4f0a321bec, user_id=407b6c53d3194cb6ba52ec6166db89ff, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:19.807511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999f9e5-4224-4611-a38b-ca5b5ec50a4d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:19.903692 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 824/1637] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:19 2022] PUT /identity/v3/projects/92bdfbe398ea474b802d0f4f0a321bec/users/407b6c53d3194cb6ba52ec6166db89ff/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:19.904584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999f9e5-4224-4611-a38b-ca5b5ec50a4d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:19.907360 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 814/1638] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:19 2022] PUT /identity/v3/projects/36e02b9a41af4253b2d95ef88f65ba6d/users/0d78903fdd6e450e80249fa9c2f310f8/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:19.909007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f14a9-68d6-432f-91fd-14590651e057 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:19.966952 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:19.983186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999f9e5-4224-4611-a38b-ca5b5ec50a4d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:20.001713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f14a9-68d6-432f-91fd-14590651e057 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:20.011111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1ce94-2fa5-4de6-a0e7-73300a65ce22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:20.011111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1ce94-2fa5-4de6-a0e7-73300a65ce22 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:20.011111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1ce94-2fa5-4de6-a0e7-73300a65ce22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:20.011111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1ce94-2fa5-4de6-a0e7-73300a65ce22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:20.011776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1ce94-2fa5-4de6-a0e7-73300a65ce22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:20.013412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1ce94-2fa5-4de6-a0e7-73300a65ce22 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:20.033149 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 815/1639] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:19 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:20.034381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1ce94-2fa5-4de6-a0e7-73300a65ce22 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:20.040934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-70f1ce94-2fa5-4de6-a0e7-73300a65ce22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:20.056430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72009eab-8cf6-477b-b96b-b723059fd34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:20.057321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72009eab-8cf6-477b-b96b-b723059fd34e admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:20.057683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72009eab-8cf6-477b-b96b-b723059fd34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:20.058272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72009eab-8cf6-477b-b96b-b723059fd34e admin admin] PATH_INFO: `/v3/projects/39ebb8105ac649a09bd2cd2cd34b605e/users/6e5a5bcb8c61408dbcc23d6bf0c73c46/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:20.077670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72009eab-8cf6-477b-b96b-b723059fd34e admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ebb8105ac649a09bd2cd2cd34b605e, user_id=6e5a5bcb8c61408dbcc23d6bf0c73c46, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:20.080407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72009eab-8cf6-477b-b96b-b723059fd34e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:20.108447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1ce94-2fa5-4de6-a0e7-73300a65ce22 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:20.112663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8b2d6-6ebf-4b4d-9dcf-dec78e5d87dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:20.113319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8b2d6-6ebf-4b4d-9dcf-dec78e5d87dc service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:20.113608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8b2d6-6ebf-4b4d-9dcf-dec78e5d87dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:20.113902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8b2d6-6ebf-4b4d-9dcf-dec78e5d87dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:20.123995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8b2d6-6ebf-4b4d-9dcf-dec78e5d87dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:20.125509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8b2d6-6ebf-4b4d-9dcf-dec78e5d87dc service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:20.136703 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 816/1640] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:20.138755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8b2d6-6ebf-4b4d-9dcf-dec78e5d87dc service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:20.143898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a3d8b2d6-6ebf-4b4d-9dcf-dec78e5d87dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:20.163238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8b2d6-6ebf-4b4d-9dcf-dec78e5d87dc service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:20.169721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47f1a0-81f4-4329-969f-1cd23fbef345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:20.171560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47f1a0-81f4-4329-969f-1cd23fbef345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:20.171560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47f1a0-81f4-4329-969f-1cd23fbef345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:20.171788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47f1a0-81f4-4329-969f-1cd23fbef345 admin admin] PATH_INFO: `/v3/users/1b772e890d074ec5b58a167cf7007ba3` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:20.173844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47f1a0-81f4-4329-969f-1cd23fbef345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b772e890d074ec5b58a167cf7007ba3)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:20.176347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47f1a0-81f4-4329-969f-1cd23fbef345 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:20.189031 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 825/1641] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:19 2022] PUT /identity/v3/projects/39ebb8105ac649a09bd2cd2cd34b605e/users/6e5a5bcb8c61408dbcc23d6bf0c73c46/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:20.190115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72009eab-8cf6-477b-b96b-b723059fd34e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:20.296595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72009eab-8cf6-477b-b96b-b723059fd34e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:20.304511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec164a1-4f50-4fcd-bfe7-dce9848e0dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:20.309108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec164a1-4f50-4fcd-bfe7-dce9848e0dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:20.309108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec164a1-4f50-4fcd-bfe7-dce9848e0dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:20.309108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec164a1-4f50-4fcd-bfe7-dce9848e0dbb admin admin] PATH_INFO: `/v3/projects/0c6f08f0c92a44688d483d5f51b8eba9/users/ea8f328c46cd473f9291abad9e28e052/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:20.324899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec164a1-4f50-4fcd-bfe7-dce9848e0dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c6f08f0c92a44688d483d5f51b8eba9, user_id=ea8f328c46cd473f9291abad9e28e052, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:20.327624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec164a1-4f50-4fcd-bfe7-dce9848e0dbb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:20.466053 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 826/1642] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:20 2022] PUT /identity/v3/projects/0c6f08f0c92a44688d483d5f51b8eba9/users/ea8f328c46cd473f9291abad9e28e052/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:20.468320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec164a1-4f50-4fcd-bfe7-dce9848e0dbb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:20.484992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3f47f1a0-81f4-4329-969f-1cd23fbef345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b772e890d074ec5b58a167cf7007ba3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:20.520117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3f47f1a0-81f4-4329-969f-1cd23fbef345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b772e890d074ec5b58a167cf7007ba3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:20.522194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3f47f1a0-81f4-4329-969f-1cd23fbef345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b772e890d074ec5b58a167cf7007ba3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:20.524879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3f47f1a0-81f4-4329-969f-1cd23fbef345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b772e890d074ec5b58a167cf7007ba3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:20.535220 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:20.541848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3f47f1a0-81f4-4329-969f-1cd23fbef345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b772e890d074ec5b58a167cf7007ba3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:20.579277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec164a1-4f50-4fcd-bfe7-dce9848e0dbb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:20.585026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652899b-3503-4d21-91b8-8f5517093e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:20.585831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652899b-3503-4d21-91b8-8f5517093e51 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:20.586819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652899b-3503-4d21-91b8-8f5517093e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:20.587183 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8652899b-3503-4d21-91b8-8f5517093e51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:20.587992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652899b-3503-4d21-91b8-8f5517093e51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:20.590083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8652899b-3503-4d21-91b8-8f5517093e51 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:20.592750 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:20.605760 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 827/1643] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:20.605760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652899b-3503-4d21-91b8-8f5517093e51 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:20.607971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8652899b-3503-4d21-91b8-8f5517093e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:20.627920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8652899b-3503-4d21-91b8-8f5517093e51 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:20.634549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0eaf1-fdb9-4723-9c66-78e38da5182b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:20.635495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0eaf1-fdb9-4723-9c66-78e38da5182b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:20.635765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0eaf1-fdb9-4723-9c66-78e38da5182b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:20.637423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0eaf1-fdb9-4723-9c66-78e38da5182b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:20.637423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0eaf1-fdb9-4723-9c66-78e38da5182b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:20.638697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0eaf1-fdb9-4723-9c66-78e38da5182b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:20.651548 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 828/1644] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:20.651548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0eaf1-fdb9-4723-9c66-78e38da5182b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:20.654757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-32f0eaf1-fdb9-4723-9c66-78e38da5182b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:20.658342 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 817/1645] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:20 2022] DELETE /identity/v3/users/1b772e890d074ec5b58a167cf7007ba3 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:20.659516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47f1a0-81f4-4329-969f-1cd23fbef345 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:20.661412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3f47f1a0-81f4-4329-969f-1cd23fbef345 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:20.669568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0eaf1-fdb9-4723-9c66-78e38da5182b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:20.747866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e88dc-0991-431a-9c17-f8685d76ab16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:20.748950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e88dc-0991-431a-9c17-f8685d76ab16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:20.749241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e88dc-0991-431a-9c17-f8685d76ab16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:20.749669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e88dc-0991-431a-9c17-f8685d76ab16 admin admin] PATH_INFO: `/v3/projects/15fffc5de382473aa3373dbd9e5c28f2/users/8a4975e9e58c44428a4caf775e4f0e15/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:20.751570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e88dc-0991-431a-9c17-f8685d76ab16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15fffc5de382473aa3373dbd9e5c28f2, user_id=8a4975e9e58c44428a4caf775e4f0e15, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:20.754448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47f1a0-81f4-4329-969f-1cd23fbef345 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:20.754601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3e88dc-0991-431a-9c17-f8685d76ab16 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:20.767106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fac355-50d4-4806-9ff5-6b3270e7c01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:20.767878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fac355-50d4-4806-9ff5-6b3270e7c01f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:20.768158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fac355-50d4-4806-9ff5-6b3270e7c01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:20.768450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fac355-50d4-4806-9ff5-6b3270e7c01f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:20.768964 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 829/1646] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:20 2022] PUT /identity/v3/projects/15fffc5de382473aa3373dbd9e5c28f2/users/8a4975e9e58c44428a4caf775e4f0e15/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:20.769356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fac355-50d4-4806-9ff5-6b3270e7c01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:20.770005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e88dc-0991-431a-9c17-f8685d76ab16 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:20.771726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fac355-50d4-4806-9ff5-6b3270e7c01f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:20.771836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2a3e88dc-0991-431a-9c17-f8685d76ab16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:20.792879 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 818/1647] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:20.794396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fac355-50d4-4806-9ff5-6b3270e7c01f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:20.805974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-29fac355-50d4-4806-9ff5-6b3270e7c01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:20.820771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fac355-50d4-4806-9ff5-6b3270e7c01f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:20.843075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e88dc-0991-431a-9c17-f8685d76ab16 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:20.847890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade72f9-9212-4742-af3a-a12ae2c35708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:20.848553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade72f9-9212-4742-af3a-a12ae2c35708 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:20.848841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade72f9-9212-4742-af3a-a12ae2c35708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:20.849115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade72f9-9212-4742-af3a-a12ae2c35708 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:20.849845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade72f9-9212-4742-af3a-a12ae2c35708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:20.851520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade72f9-9212-4742-af3a-a12ae2c35708 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:20.862756 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 830/1648] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:20.866124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade72f9-9212-4742-af3a-a12ae2c35708 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:20.873943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade72f9-9212-4742-af3a-a12ae2c35708 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:20.878948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc66eac-3f07-489a-9de0-c2797065edd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:20.879955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc66eac-3f07-489a-9de0-c2797065edd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:20.880223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc66eac-3f07-489a-9de0-c2797065edd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:20.880458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc66eac-3f07-489a-9de0-c2797065edd6 admin admin] PATH_INFO: `/v3/projects/36e02b9a41af4253b2d95ef88f65ba6d/users/0d78903fdd6e450e80249fa9c2f310f8/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:20.883325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc66eac-3f07-489a-9de0-c2797065edd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36e02b9a41af4253b2d95ef88f65ba6d, user_id=0d78903fdd6e450e80249fa9c2f310f8, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:20.885596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4420ad-0361-4a74-9210-2ee672feec07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:20.885720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc66eac-3f07-489a-9de0-c2797065edd6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:20.886659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4420ad-0361-4a74-9210-2ee672feec07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:20.886947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4420ad-0361-4a74-9210-2ee672feec07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:20.887229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4420ad-0361-4a74-9210-2ee672feec07 admin admin] PATH_INFO: `/v3/projects/92bdfbe398ea474b802d0f4f0a321bec/users/407b6c53d3194cb6ba52ec6166db89ff/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:20.889297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4420ad-0361-4a74-9210-2ee672feec07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92bdfbe398ea474b802d0f4f0a321bec, user_id=407b6c53d3194cb6ba52ec6166db89ff, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:20.891937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4420ad-0361-4a74-9210-2ee672feec07 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:20.897960 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 831/1649] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:20 2022] PUT /identity/v3/projects/36e02b9a41af4253b2d95ef88f65ba6d/users/0d78903fdd6e450e80249fa9c2f310f8/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:20.903123 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 819/1650] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:20 2022] PUT /identity/v3/projects/92bdfbe398ea474b802d0f4f0a321bec/users/407b6c53d3194cb6ba52ec6166db89ff/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:20.903833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f37b7-0c8a-465e-9c50-c409d6bd1abf None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:20.904270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4420ad-0361-4a74-9210-2ee672feec07 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:20.905070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f37b7-0c8a-465e-9c50-c409d6bd1abf None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:20.905455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f37b7-0c8a-465e-9c50-c409d6bd1abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:20.912820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2e4420ad-0361-4a74-9210-2ee672feec07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:20.926609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7b2f37b7-0c8a-465e-9c50-c409d6bd1abf None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:20.927828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7b2f37b7-0c8a-465e-9c50-c409d6bd1abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:20.988475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4420ad-0361-4a74-9210-2ee672feec07 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:20.999340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5f897-60ee-4418-af52-187028564baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:21.000436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5f897-60ee-4418-af52-187028564baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:21.000871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5f897-60ee-4418-af52-187028564baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:21.001312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a5f897-60ee-4418-af52-187028564baf admin admin] PATH_INFO: `/v3/projects/70e00097efaf4465b4cd07b01354bff6` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:21.002770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5f897-60ee-4418-af52-187028564baf admin admin] RBAC: Authorizing `identity:delete_project(project_id=70e00097efaf4465b4cd07b01354bff6)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:21.003983 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-f5a5f897-60ee-4418-af52-187028564baf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:11:21.003983 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:11:21.003983 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:11:21.007871 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 832/1651] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:21.008096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a5f897-60ee-4418-af52-187028564baf admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:21.008186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22240223-99b5-4d7d-b7c2-19d273fa4fc4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:21.008186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22240223-99b5-4d7d-b7c2-19d273fa4fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:21.008465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22240223-99b5-4d7d-b7c2-19d273fa4fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:21.020406 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:21.032735 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:21.046856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-22240223-99b5-4d7d-b7c2-19d273fa4fc4 None None] MFA Rules not processed for user `8a4975e9e58c44428a4caf775e4f0e15`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:21.048305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-22240223-99b5-4d7d-b7c2-19d273fa4fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:21.156506 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 833/1652] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:21.157352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22240223-99b5-4d7d-b7c2-19d273fa4fc4 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:21.161774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f5a5f897-60ee-4418-af52-187028564baf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70e00097efaf4465b4cd07b01354bff6', 'request_id': 'req-f5a5f897-60ee-4418-af52-187028564baf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:21.184480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22240223-99b5-4d7d-b7c2-19d273fa4fc4 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:21.250404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f5a5f897-60ee-4418-af52-187028564baf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70e00097efaf4465b4cd07b01354bff6', 'request_id': 'req-f5a5f897-60ee-4418-af52-187028564baf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:21.269553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f5a5f897-60ee-4418-af52-187028564baf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70e00097efaf4465b4cd07b01354bff6', 'request_id': 'req-f5a5f897-60ee-4418-af52-187028564baf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:21.280741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf6495-f387-4a80-827a-0fdd325a35d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:21.281650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf6495-f387-4a80-827a-0fdd325a35d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:21.282190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf6495-f387-4a80-827a-0fdd325a35d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:21.282283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf6495-f387-4a80-827a-0fdd325a35d2 admin admin] PATH_INFO: `/v3/projects/39ebb8105ac649a09bd2cd2cd34b605e/users/6e5a5bcb8c61408dbcc23d6bf0c73c46/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:21.285770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf6495-f387-4a80-827a-0fdd325a35d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ebb8105ac649a09bd2cd2cd34b605e, user_id=6e5a5bcb8c61408dbcc23d6bf0c73c46, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:21.286393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f5a5f897-60ee-4418-af52-187028564baf admin admin] The token cache is being invalidate because project 70e00097efaf4465b4cd07b01354bff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:21.286931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f5a5f897-60ee-4418-af52-187028564baf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:21.287895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f5a5f897-60ee-4418-af52-187028564baf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:21.288518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf6495-f387-4a80-827a-0fdd325a35d2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:21.290272 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 820/1653] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:20 2022] DELETE /identity/v3/projects/70e00097efaf4465b4cd07b01354bff6 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:21.291268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5f897-60ee-4418-af52-187028564baf admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:21.293136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f5a5f897-60ee-4418-af52-187028564baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:21.308522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a5f897-60ee-4418-af52-187028564baf admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:21.318193 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 834/1654] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:21 2022] PUT /identity/v3/projects/39ebb8105ac649a09bd2cd2cd34b605e/users/6e5a5bcb8c61408dbcc23d6bf0c73c46/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:21.320823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da0bc9-3d8b-4916-9415-5fc02b0c6a9c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:21.321245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da0bc9-3d8b-4916-9415-5fc02b0c6a9c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:21.321693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72da0bc9-3d8b-4916-9415-5fc02b0c6a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:21.371908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-72da0bc9-3d8b-4916-9415-5fc02b0c6a9c None None] MFA Rules not processed for user `0d78903fdd6e450e80249fa9c2f310f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:21.373804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-72da0bc9-3d8b-4916-9415-5fc02b0c6a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:21.410415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b21cb-4235-4d19-8092-6488eb777129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:21.411524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b21cb-4235-4d19-8092-6488eb777129 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:21.411836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b21cb-4235-4d19-8092-6488eb777129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:21.412131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b21cb-4235-4d19-8092-6488eb777129 admin admin] PATH_INFO: `/v3/projects/0c6f08f0c92a44688d483d5f51b8eba9/users/ea8f328c46cd473f9291abad9e28e052/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:21.415590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b21cb-4235-4d19-8092-6488eb777129 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c6f08f0c92a44688d483d5f51b8eba9, user_id=ea8f328c46cd473f9291abad9e28e052, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:21.418886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b21cb-4235-4d19-8092-6488eb777129 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:21.432493 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 821/1655] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:21 2022] PUT /identity/v3/projects/0c6f08f0c92a44688d483d5f51b8eba9/users/ea8f328c46cd473f9291abad9e28e052/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:21.433809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256e25-6998-460f-96c5-6cc0df6007aa None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:21.434118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256e25-6998-460f-96c5-6cc0df6007aa None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:21.434402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b256e25-6998-460f-96c5-6cc0df6007aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:21.477381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2b256e25-6998-460f-96c5-6cc0df6007aa None None] MFA Rules not processed for user `407b6c53d3194cb6ba52ec6166db89ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:21.479591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2b256e25-6998-460f-96c5-6cc0df6007aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:21.487630 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 835/1656] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:21.488717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da0bc9-3d8b-4916-9415-5fc02b0c6a9c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:21.494862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-72da0bc9-3d8b-4916-9415-5fc02b0c6a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:21.559603 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:21.565717 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 822/1657] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:21 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:21.566670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72da0bc9-3d8b-4916-9415-5fc02b0c6a9c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:21.567491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76882dd4-b460-49ad-973c-abe55ff85c81 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:21.567801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76882dd4-b460-49ad-973c-abe55ff85c81 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:21.568279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76882dd4-b460-49ad-973c-abe55ff85c81 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:21.569669 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 823/1658] 10.222.0.43 () {54 vars in 962 bytes} [Tue Jul 19 14:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:11:21.571416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea2234-16a0-4a1b-9ad5-3b2cbd162930 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:21.571712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea2234-16a0-4a1b-9ad5-3b2cbd162930 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:21.571997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cea2234-16a0-4a1b-9ad5-3b2cbd162930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:21.603906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6cea2234-16a0-4a1b-9ad5-3b2cbd162930 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:21.606702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6cea2234-16a0-4a1b-9ad5-3b2cbd162930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:21.644307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb46e34-b730-4924-8573-6aa6799e1888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:21.645058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb46e34-b730-4924-8573-6aa6799e1888 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:21.645446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb46e34-b730-4924-8573-6aa6799e1888 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:21.645913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb46e34-b730-4924-8573-6aa6799e1888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:21.649315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-edb46e34-b730-4924-8573-6aa6799e1888 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:21.673200 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:21.693952 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 824/1659] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:21.696607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e44e4-ff43-47c0-8d1b-b4a271cf402a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:21.696903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e44e4-ff43-47c0-8d1b-b4a271cf402a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:21.697612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e44e4-ff43-47c0-8d1b-b4a271cf402a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:21.737929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b17e44e4-ff43-47c0-8d1b-b4a271cf402a None None] MFA Rules not processed for user `6e5a5bcb8c61408dbcc23d6bf0c73c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:21.739341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b17e44e4-ff43-47c0-8d1b-b4a271cf402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:21.743640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb46e34-b730-4924-8573-6aa6799e1888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:21.745581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb46e34-b730-4924-8573-6aa6799e1888 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:21.766876 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 836/1660] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:21.768439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bd4de-9338-48b0-b772-89e0349501bb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:21.768939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bd4de-9338-48b0-b772-89e0349501bb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:21.769296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bd4de-9338-48b0-b772-89e0349501bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:21.808011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-731bd4de-9338-48b0-b772-89e0349501bb None None] MFA Rules not processed for user `ea8f328c46cd473f9291abad9e28e052`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:21.809351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-731bd4de-9338-48b0-b772-89e0349501bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:21.876763 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 825/1661] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:21 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:21.876763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e44e4-ff43-47c0-8d1b-b4a271cf402a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:21.878907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b17e44e4-ff43-47c0-8d1b-b4a271cf402a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:21.912610 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:21.924876 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 837/1662] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:21 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:21.926738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e29f0-e0b8-41de-9e14-b61e36f42729 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:21.927202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e29f0-e0b8-41de-9e14-b61e36f42729 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:21.930386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e29f0-e0b8-41de-9e14-b61e36f42729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:21.963065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ff4e29f0-e0b8-41de-9e14-b61e36f42729 None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:21.964932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ff4e29f0-e0b8-41de-9e14-b61e36f42729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:22.056930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e44e4-ff43-47c0-8d1b-b4a271cf402a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:22.068095 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 838/1663] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Jul 19 14:11:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:22.069795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef406a-f4e2-4657-a8f2-261ec276c88c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:22.070809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef406a-f4e2-4657-a8f2-261ec276c88c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:22.070809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef406a-f4e2-4657-a8f2-261ec276c88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:22.072532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597caf16-ae5a-4790-99b3-4076c37af25a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:22.073220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597caf16-ae5a-4790-99b3-4076c37af25a service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:22.073500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597caf16-ae5a-4790-99b3-4076c37af25a service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:22.073775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597caf16-ae5a-4790-99b3-4076c37af25a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:22.108786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a0ef406a-f4e2-4657-a8f2-261ec276c88c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:22.110303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a0ef406a-f4e2-4657-a8f2-261ec276c88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:22.120465 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 839/1664] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:22.121253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef406a-f4e2-4657-a8f2-261ec276c88c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:22.137922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef406a-f4e2-4657-a8f2-261ec276c88c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:22.144263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8af982-8352-4eca-aef7-bec63a87273d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:22.145866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8af982-8352-4eca-aef7-bec63a87273d service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:22.146435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8af982-8352-4eca-aef7-bec63a87273d service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:22.146711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8af982-8352-4eca-aef7-bec63a87273d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:22.149342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4d8af982-8352-4eca-aef7-bec63a87273d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:22.163701 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:22.183723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597caf16-ae5a-4790-99b3-4076c37af25a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:22.185807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597caf16-ae5a-4790-99b3-4076c37af25a service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:22.224278 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 826/1665] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:22.225744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597caf16-ae5a-4790-99b3-4076c37af25a service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:22.254918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597caf16-ae5a-4790-99b3-4076c37af25a service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:22.268872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee67a65-44f9-47e1-8dab-3515ef0129ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:22.270338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee67a65-44f9-47e1-8dab-3515ef0129ec admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:22.270622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee67a65-44f9-47e1-8dab-3515ef0129ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:22.270896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee67a65-44f9-47e1-8dab-3515ef0129ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:22.271939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee67a65-44f9-47e1-8dab-3515ef0129ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:11:22.272234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee67a65-44f9-47e1-8dab-3515ef0129ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:22.272675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8af982-8352-4eca-aef7-bec63a87273d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:22.275541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee67a65-44f9-47e1-8dab-3515ef0129ec admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:22.291105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8af982-8352-4eca-aef7-bec63a87273d service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:22.291299 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 827/1666] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:11:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:22.295694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee67a65-44f9-47e1-8dab-3515ef0129ec admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:22.307504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee67a65-44f9-47e1-8dab-3515ef0129ec admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:22.309304 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 840/1667] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:22.312491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3e74a-128f-432e-ad78-29e8aa01b0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:22.313392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3e74a-128f-432e-ad78-29e8aa01b0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:22.313523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3e74a-128f-432e-ad78-29e8aa01b0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:22.313782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3e74a-128f-432e-ad78-29e8aa01b0e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:22.315022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3e74a-128f-432e-ad78-29e8aa01b0e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:22.316669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c3e74a-128f-432e-ad78-29e8aa01b0e6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:22.366930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8af982-8352-4eca-aef7-bec63a87273d service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:22.378888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8af982-8352-4eca-aef7-bec63a87273d service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:22.386732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b8ba3-bec4-44d0-aacd-de179bba6374 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:22.387591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b8ba3-bec4-44d0-aacd-de179bba6374 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:22.388023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b8ba3-bec4-44d0-aacd-de179bba6374 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:22.388443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b8ba3-bec4-44d0-aacd-de179bba6374 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:22.402551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b8ba3-bec4-44d0-aacd-de179bba6374 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:22.404410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b8ba3-bec4-44d0-aacd-de179bba6374 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:22.406080 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 828/1668] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:22 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:22.407161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3e74a-128f-432e-ad78-29e8aa01b0e6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:22.431775 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 841/1669] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:11:22.510186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3e74a-128f-432e-ad78-29e8aa01b0e6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:22.516722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90074cc-59d5-462a-80e8-889ae7e2c9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:22.517614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90074cc-59d5-462a-80e8-889ae7e2c9fa admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:22.518147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90074cc-59d5-462a-80e8-889ae7e2c9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:22.518530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90074cc-59d5-462a-80e8-889ae7e2c9fa admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:22.519805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90074cc-59d5-462a-80e8-889ae7e2c9fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:22.528108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90074cc-59d5-462a-80e8-889ae7e2c9fa admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:22.607363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b8ba3-bec4-44d0-aacd-de179bba6374 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:22.609011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f89b8ba3-bec4-44d0-aacd-de179bba6374 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:22.618282 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 829/1670] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:22 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:22.623013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90074cc-59d5-462a-80e8-889ae7e2c9fa admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:22.640557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b8ba3-bec4-44d0-aacd-de179bba6374 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:22.659317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90074cc-59d5-462a-80e8-889ae7e2c9fa admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:22.661098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea458d2-b9d3-43aa-87e7-9e94f5976f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:22.662019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea458d2-b9d3-43aa-87e7-9e94f5976f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:22.662335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea458d2-b9d3-43aa-87e7-9e94f5976f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:22.662617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea458d2-b9d3-43aa-87e7-9e94f5976f52 admin admin] PATH_INFO: `/v3/projects/b214946191a2499a84ba38a2d02ec29d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:22.665180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea458d2-b9d3-43aa-87e7-9e94f5976f52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b214946191a2499a84ba38a2d02ec29d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:22.669755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea458d2-b9d3-43aa-87e7-9e94f5976f52 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:22.678895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f619c8-ade1-4dfa-a82f-6942e1ea06fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:22.681641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f619c8-ade1-4dfa-a82f-6942e1ea06fc admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:22.682322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f619c8-ade1-4dfa-a82f-6942e1ea06fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:22.683384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f619c8-ade1-4dfa-a82f-6942e1ea06fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:22.686206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f619c8-ade1-4dfa-a82f-6942e1ea06fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:22.688891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f619c8-ade1-4dfa-a82f-6942e1ea06fc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:22.722661 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 830/1671] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:22.724033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f619c8-ade1-4dfa-a82f-6942e1ea06fc admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:22.823518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7ea458d2-b9d3-43aa-87e7-9e94f5976f52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b214946191a2499a84ba38a2d02ec29d', 'request_id': 'req-7ea458d2-b9d3-43aa-87e7-9e94f5976f52'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:22.830812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7ea458d2-b9d3-43aa-87e7-9e94f5976f52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b214946191a2499a84ba38a2d02ec29d', 'request_id': 'req-7ea458d2-b9d3-43aa-87e7-9e94f5976f52'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:22.833642 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:22.839035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f619c8-ade1-4dfa-a82f-6942e1ea06fc admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:22.839170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7ea458d2-b9d3-43aa-87e7-9e94f5976f52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b214946191a2499a84ba38a2d02ec29d', 'request_id': 'req-7ea458d2-b9d3-43aa-87e7-9e94f5976f52'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:22.872216 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:22.907192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7ea458d2-b9d3-43aa-87e7-9e94f5976f52 admin admin] The token cache is being invalidate because project b214946191a2499a84ba38a2d02ec29d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:22.907617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7ea458d2-b9d3-43aa-87e7-9e94f5976f52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:22.908339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7ea458d2-b9d3-43aa-87e7-9e94f5976f52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:22.911178 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 842/1672] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:22 2022] DELETE /identity/v3/projects/b214946191a2499a84ba38a2d02ec29d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:22.912254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea458d2-b9d3-43aa-87e7-9e94f5976f52 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:22.915632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7ea458d2-b9d3-43aa-87e7-9e94f5976f52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:22.919265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1aa79-c38b-4383-9d97-4900f8e8d351 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:22.920195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1aa79-c38b-4383-9d97-4900f8e8d351 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:22.920492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1aa79-c38b-4383-9d97-4900f8e8d351 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:22.920776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1aa79-c38b-4383-9d97-4900f8e8d351 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:22.922772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-acd1aa79-c38b-4383-9d97-4900f8e8d351 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:23.016209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea458d2-b9d3-43aa-87e7-9e94f5976f52 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:23.021523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489101e-5c94-4350-bf7f-3ed162b96d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:23.025910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489101e-5c94-4350-bf7f-3ed162b96d50 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:23.025910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489101e-5c94-4350-bf7f-3ed162b96d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:23.025910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8489101e-5c94-4350-bf7f-3ed162b96d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:23.028291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489101e-5c94-4350-bf7f-3ed162b96d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:23.031966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8489101e-5c94-4350-bf7f-3ed162b96d50 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:23.042561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1aa79-c38b-4383-9d97-4900f8e8d351 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:23.044205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1aa79-c38b-4383-9d97-4900f8e8d351 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:23.046184 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 843/1673] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:23.047405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489101e-5c94-4350-bf7f-3ed162b96d50 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:23.051553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8489101e-5c94-4350-bf7f-3ed162b96d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:23.057762 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 831/1674] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:22 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:23.058810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1aa79-c38b-4383-9d97-4900f8e8d351 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:23.060122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-acd1aa79-c38b-4383-9d97-4900f8e8d351 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:23.074009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8489101e-5c94-4350-bf7f-3ed162b96d50 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:23.081181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72886410-0438-4930-bf57-ae8bd6ac156b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:23.082580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72886410-0438-4930-bf57-ae8bd6ac156b service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:23.083032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72886410-0438-4930-bf57-ae8bd6ac156b service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:23.083506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72886410-0438-4930-bf57-ae8bd6ac156b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:23.085539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-72886410-0438-4930-bf57-ae8bd6ac156b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:23.102331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1aa79-c38b-4383-9d97-4900f8e8d351 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:23.122626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e7b402-c6f4-4ae4-a735-31b72cf85d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:23.123823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7b402-c6f4-4ae4-a735-31b72cf85d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:23.124787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7b402-c6f4-4ae4-a735-31b72cf85d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:23.125221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e7b402-c6f4-4ae4-a735-31b72cf85d8a admin admin] PATH_INFO: `/v3/users/1ebe6cb0ca324e639593b52095c473db` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:23.126950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7b402-c6f4-4ae4-a735-31b72cf85d8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ebe6cb0ca324e639593b52095c473db)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:23.135080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e7b402-c6f4-4ae4-a735-31b72cf85d8a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:23.212013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72886410-0438-4930-bf57-ae8bd6ac156b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:23.215147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72886410-0438-4930-bf57-ae8bd6ac156b service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:23.234816 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 844/1675] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:23.235726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72886410-0438-4930-bf57-ae8bd6ac156b service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:23.266668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72886410-0438-4930-bf57-ae8bd6ac156b service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:23.283668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9ae56-2136-43f8-8dfd-fadda23832f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:23.284842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9ae56-2136-43f8-8dfd-fadda23832f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:23.285129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9ae56-2136-43f8-8dfd-fadda23832f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:23.285410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9ae56-2136-43f8-8dfd-fadda23832f0 admin admin] PATH_INFO: `/v3/projects/2c89192c8d1649218323c804c2bacb68/users/6ac8064ee64f4a2b99aa1158714b171e/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:23.305251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9ae56-2136-43f8-8dfd-fadda23832f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c89192c8d1649218323c804c2bacb68, user_id=6ac8064ee64f4a2b99aa1158714b171e, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:23.308134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9ae56-2136-43f8-8dfd-fadda23832f0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:23.397672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-84e7b402-c6f4-4ae4-a735-31b72cf85d8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ebe6cb0ca324e639593b52095c473db'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:23.410808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-84e7b402-c6f4-4ae4-a735-31b72cf85d8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ebe6cb0ca324e639593b52095c473db'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:23.411549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-84e7b402-c6f4-4ae4-a735-31b72cf85d8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ebe6cb0ca324e639593b52095c473db'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:23.412251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-84e7b402-c6f4-4ae4-a735-31b72cf85d8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ebe6cb0ca324e639593b52095c473db'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:23.420994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-84e7b402-c6f4-4ae4-a735-31b72cf85d8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ebe6cb0ca324e639593b52095c473db'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:23.444906 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 845/1676] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:23 2022] PUT /identity/v3/projects/2c89192c8d1649218323c804c2bacb68/users/6ac8064ee64f4a2b99aa1158714b171e/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:23.445851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9ae56-2136-43f8-8dfd-fadda23832f0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:23.447518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-99d9ae56-2136-43f8-8dfd-fadda23832f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:23.502628 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 832/1677] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:23 2022] DELETE /identity/v3/users/1ebe6cb0ca324e639593b52095c473db => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:23.502628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac65bf-6b0c-4230-8ab3-6844614a4138 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:23.502628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac65bf-6b0c-4230-8ab3-6844614a4138 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:23.502628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ac65bf-6b0c-4230-8ab3-6844614a4138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:23.551422 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:23.571281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e1ac65bf-6b0c-4230-8ab3-6844614a4138 None None] MFA Rules not processed for user `6ac8064ee64f4a2b99aa1158714b171e`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:23.573086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e1ac65bf-6b0c-4230-8ab3-6844614a4138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:23.604210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9ae56-2136-43f8-8dfd-fadda23832f0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:23.641093 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:23.766848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acadfd-5b55-43c6-9bfc-237f9f6d6155 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:23.767523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acadfd-5b55-43c6-9bfc-237f9f6d6155 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:23.767917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acadfd-5b55-43c6-9bfc-237f9f6d6155 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:23.768193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06acadfd-5b55-43c6-9bfc-237f9f6d6155 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:23.771939 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 833/1678] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:23.773391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-06acadfd-5b55-43c6-9bfc-237f9f6d6155 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:23.777399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac65bf-6b0c-4230-8ab3-6844614a4138 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:23.779079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e1ac65bf-6b0c-4230-8ab3-6844614a4138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:23.890576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ac65bf-6b0c-4230-8ab3-6844614a4138 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:23.899727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafa810-0693-44b1-8d66-785ad62d1423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:23.900763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafa810-0693-44b1-8d66-785ad62d1423 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:23.901228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafa810-0693-44b1-8d66-785ad62d1423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:23.901671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eafa810-0693-44b1-8d66-785ad62d1423 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:23.904790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafa810-0693-44b1-8d66-785ad62d1423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:23.905056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eafa810-0693-44b1-8d66-785ad62d1423 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:23.909131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acadfd-5b55-43c6-9bfc-237f9f6d6155 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:23.913042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06acadfd-5b55-43c6-9bfc-237f9f6d6155 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:23.949095 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 846/1679] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:24.019330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acadfd-5b55-43c6-9bfc-237f9f6d6155 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:24.034494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06acadfd-5b55-43c6-9bfc-237f9f6d6155 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:24.041647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b84fbb-50e6-4710-9682-3c677cf48b7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:24.042736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b84fbb-50e6-4710-9682-3c677cf48b7c service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:24.042856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b84fbb-50e6-4710-9682-3c677cf48b7c service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:24.046717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b84fbb-50e6-4710-9682-3c677cf48b7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:24.058652 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 834/1680] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:23 2022] POST /identity/v3/projects => generated 385 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:24.059141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-72b84fbb-50e6-4710-9682-3c677cf48b7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:24.060241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafa810-0693-44b1-8d66-785ad62d1423 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:24.141610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eafa810-0693-44b1-8d66-785ad62d1423 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:24.147226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceaf976-2343-47b8-85c8-2e97af8717d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:24.147909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaf976-2343-47b8-85c8-2e97af8717d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:24.148038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b84fbb-50e6-4710-9682-3c677cf48b7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:24.148197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaf976-2343-47b8-85c8-2e97af8717d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:24.149196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceaf976-2343-47b8-85c8-2e97af8717d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:24.150022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b84fbb-50e6-4710-9682-3c677cf48b7c service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:24.150163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceaf976-2343-47b8-85c8-2e97af8717d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:24.151997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceaf976-2343-47b8-85c8-2e97af8717d3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:24.159072 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 847/1681] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:11:24.160479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deba077-993a-4831-84d5-94a8ace96d93 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:24.160838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deba077-993a-4831-84d5-94a8ace96d93 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:24.161038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deba077-993a-4831-84d5-94a8ace96d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:24.192181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1deba077-993a-4831-84d5-94a8ace96d93 None None] MFA Rules not processed for user `c4a929fee10e45c8a072b778b7944ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:24.192181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1deba077-993a-4831-84d5-94a8ace96d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:24.217505 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:24.270606 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 848/1682] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:24.271463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deba077-993a-4831-84d5-94a8ace96d93 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:24.282360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1deba077-993a-4831-84d5-94a8ace96d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:24.282496 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 835/1683] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:24 2022] POST /identity/v3/users => generated 299 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:24.284071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceaf976-2343-47b8-85c8-2e97af8717d3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:24.285757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4ceaf976-2343-47b8-85c8-2e97af8717d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:24.287133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deba077-993a-4831-84d5-94a8ace96d93 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:24.292450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc34b26-a08c-475e-98e0-bfb0a9e32417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:24.293348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc34b26-a08c-475e-98e0-bfb0a9e32417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:24.293634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc34b26-a08c-475e-98e0-bfb0a9e32417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:24.293915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc34b26-a08c-475e-98e0-bfb0a9e32417 admin admin] PATH_INFO: `/v3/projects/0c22b7f78279443fb69651b907e48f06` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:24.295142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc34b26-a08c-475e-98e0-bfb0a9e32417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c22b7f78279443fb69651b907e48f06)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:24.297060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc34b26-a08c-475e-98e0-bfb0a9e32417 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:24.299033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceaf976-2343-47b8-85c8-2e97af8717d3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:24.311232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd47f1-a2a3-4556-9461-cda846afe8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:24.312520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd47f1-a2a3-4556-9461-cda846afe8ae admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:24.312520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd47f1-a2a3-4556-9461-cda846afe8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:24.312697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd47f1-a2a3-4556-9461-cda846afe8ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:24.313981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd47f1-a2a3-4556-9461-cda846afe8ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:24.317900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdd47f1-a2a3-4556-9461-cda846afe8ae admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:24.423588 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 836/1684] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:24 2022] POST /identity/v3/projects => generated 399 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:24.427324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd47f1-a2a3-4556-9461-cda846afe8ae admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:24.434759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4bc34b26-a08c-475e-98e0-bfb0a9e32417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c22b7f78279443fb69651b907e48f06', 'request_id': 'req-4bc34b26-a08c-475e-98e0-bfb0a9e32417'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:24.441070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4bc34b26-a08c-475e-98e0-bfb0a9e32417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c22b7f78279443fb69651b907e48f06', 'request_id': 'req-4bc34b26-a08c-475e-98e0-bfb0a9e32417'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:24.444918 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:24.448674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4bc34b26-a08c-475e-98e0-bfb0a9e32417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c22b7f78279443fb69651b907e48f06', 'request_id': 'req-4bc34b26-a08c-475e-98e0-bfb0a9e32417'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:24.501210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdd47f1-a2a3-4556-9461-cda846afe8ae admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:24.506335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d054be6-e628-4386-902b-ecf0d5120d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:24.507056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d054be6-e628-4386-902b-ecf0d5120d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:24.507357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d054be6-e628-4386-902b-ecf0d5120d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:24.507629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d054be6-e628-4386-902b-ecf0d5120d86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:24.509818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d054be6-e628-4386-902b-ecf0d5120d86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:24.511369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d054be6-e628-4386-902b-ecf0d5120d86 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:24.523997 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 837/1685] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:24.523997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d054be6-e628-4386-902b-ecf0d5120d86 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:24.537004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d054be6-e628-4386-902b-ecf0d5120d86 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:24.544045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45019952-9555-409f-a1de-7fa67b92b2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:24.544737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45019952-9555-409f-a1de-7fa67b92b2c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:24.545363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45019952-9555-409f-a1de-7fa67b92b2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:24.545494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45019952-9555-409f-a1de-7fa67b92b2c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:24.546570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45019952-9555-409f-a1de-7fa67b92b2c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:24.549924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45019952-9555-409f-a1de-7fa67b92b2c8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:24.553779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4bc34b26-a08c-475e-98e0-bfb0a9e32417 admin admin] The token cache is being invalidate because project 0c22b7f78279443fb69651b907e48f06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:24.558468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4bc34b26-a08c-475e-98e0-bfb0a9e32417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:24.558468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4bc34b26-a08c-475e-98e0-bfb0a9e32417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:24.558468 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 849/1686] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:24 2022] DELETE /identity/v3/projects/0c22b7f78279443fb69651b907e48f06 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:24.559415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b1f44-16f0-40f3-b590-2833dbf69960 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:24.560854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b1f44-16f0-40f3-b590-2833dbf69960 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:24.561830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b1f44-16f0-40f3-b590-2833dbf69960 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:24.564579 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 850/1687] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:11:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:11:24.565807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b1f44-16f0-40f3-b590-2833dbf69960 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:24.567626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e86b1f44-16f0-40f3-b590-2833dbf69960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:24.586979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b1f44-16f0-40f3-b590-2833dbf69960 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:24.591688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c250d-d42c-40d8-af64-a116b9a40dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:24.592855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c250d-d42c-40d8-af64-a116b9a40dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:24.593140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c250d-d42c-40d8-af64-a116b9a40dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:24.593418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c250d-d42c-40d8-af64-a116b9a40dfc admin admin] PATH_INFO: `/v3/projects/b81122c94b9b43ba94f6a26107b77036/users/3ec00a5981424a3e8587294bda79830a/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:24.616303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c250d-d42c-40d8-af64-a116b9a40dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81122c94b9b43ba94f6a26107b77036, user_id=3ec00a5981424a3e8587294bda79830a, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:24.616303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c250d-d42c-40d8-af64-a116b9a40dfc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:24.641301 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 838/1688] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:24 2022] POST /identity/v3/users => generated 306 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:24.641853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd77d53-9557-4ada-8787-617db6f97a5d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:24.643723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd77d53-9557-4ada-8787-617db6f97a5d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:24.643723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd77d53-9557-4ada-8787-617db6f97a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:24.663991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5fd77d53-9557-4ada-8787-617db6f97a5d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:24.665725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5fd77d53-9557-4ada-8787-617db6f97a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:24.674475 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 839/1689] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:24.680681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cb157-a590-4896-b3e9-4f55b399803f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:24.680681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cb157-a590-4896-b3e9-4f55b399803f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:24.680681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215cb157-a590-4896-b3e9-4f55b399803f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:24.695012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-215cb157-a590-4896-b3e9-4f55b399803f None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:24.696419 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 851/1690] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:24 2022] PUT /identity/v3/projects/b81122c94b9b43ba94f6a26107b77036/users/3ec00a5981424a3e8587294bda79830a/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:24.697038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-215cb157-a590-4896-b3e9-4f55b399803f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:24.697372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c250d-d42c-40d8-af64-a116b9a40dfc admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:24.698969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ab4c250d-d42c-40d8-af64-a116b9a40dfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:24.770159 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 840/1691] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:11:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:24.771513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c06b5-9405-4c9b-80ac-9a2f9d63fe3d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:24.771905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c06b5-9405-4c9b-80ac-9a2f9d63fe3d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:24.772289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c06b5-9405-4c9b-80ac-9a2f9d63fe3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:24.786838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c250d-d42c-40d8-af64-a116b9a40dfc admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:24.794003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-df0c06b5-9405-4c9b-80ac-9a2f9d63fe3d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:24.794644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfea1d-9521-4b72-8061-cd9e2796486a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:24.795238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-df0c06b5-9405-4c9b-80ac-9a2f9d63fe3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:24.795459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfea1d-9521-4b72-8061-cd9e2796486a admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:24.795788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfea1d-9521-4b72-8061-cd9e2796486a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:24.796082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bfea1d-9521-4b72-8061-cd9e2796486a admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:24.797032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfea1d-9521-4b72-8061-cd9e2796486a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:24.798737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bfea1d-9521-4b72-8061-cd9e2796486a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:24.804122 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 841/1692] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:24.805391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c06b5-9405-4c9b-80ac-9a2f9d63fe3d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:24.811200 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 852/1693] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:24.813147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfea1d-9521-4b72-8061-cd9e2796486a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:24.815267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-14bfea1d-9521-4b72-8061-cd9e2796486a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:24.819349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c06b5-9405-4c9b-80ac-9a2f9d63fe3d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:24.825230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba095a-316c-4a08-a9c3-996943fe72e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:24.826310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba095a-316c-4a08-a9c3-996943fe72e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:24.826746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba095a-316c-4a08-a9c3-996943fe72e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:24.827393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba095a-316c-4a08-a9c3-996943fe72e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:24.828638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba095a-316c-4a08-a9c3-996943fe72e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:24.830295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba095a-316c-4a08-a9c3-996943fe72e9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:24.842338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bfea1d-9521-4b72-8061-cd9e2796486a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:24.845968 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 842/1694] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:24.845968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba095a-316c-4a08-a9c3-996943fe72e9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:24.850554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b13c5e-11e3-4521-b221-9091b1da09df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:24.851213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b13c5e-11e3-4521-b221-9091b1da09df service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:24.851536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b13c5e-11e3-4521-b221-9091b1da09df service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:24.851821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b13c5e-11e3-4521-b221-9091b1da09df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:24.856167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba095a-316c-4a08-a9c3-996943fe72e9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:24.862335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8ee22-6d8d-46d9-a575-ae83d0603534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:24.862987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b13c5e-11e3-4521-b221-9091b1da09df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:24.863116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8ee22-6d8d-46d9-a575-ae83d0603534 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:24.863277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8ee22-6d8d-46d9-a575-ae83d0603534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:24.863563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a8ee22-6d8d-46d9-a575-ae83d0603534 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:24.864298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8ee22-6d8d-46d9-a575-ae83d0603534 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:11:24.864676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8ee22-6d8d-46d9-a575-ae83d0603534 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:24.866318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b13c5e-11e3-4521-b221-9091b1da09df service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:24.866434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a8ee22-6d8d-46d9-a575-ae83d0603534 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:24.876510 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:24.882546 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 843/1695] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:24.890229 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 853/1696] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:24.890361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8ee22-6d8d-46d9-a575-ae83d0603534 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:24.890438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b13c5e-11e3-4521-b221-9091b1da09df service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:24.904828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a8ee22-6d8d-46d9-a575-ae83d0603534 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:24.907040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b13c5e-11e3-4521-b221-9091b1da09df service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:24.916488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8186a-ead9-45b9-90f4-c7ac1fac2189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:24.917398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8186a-ead9-45b9-90f4-c7ac1fac2189 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:24.917681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8186a-ead9-45b9-90f4-c7ac1fac2189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:24.917774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef25ad-8763-4c01-ba2a-fd8d9f29fd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:24.917956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a8186a-ead9-45b9-90f4-c7ac1fac2189 admin admin] PATH_INFO: `/v3/projects/b81122c94b9b43ba94f6a26107b77036/users/3ec00a5981424a3e8587294bda79830a/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:24.918743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef25ad-8763-4c01-ba2a-fd8d9f29fd96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:24.922204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef25ad-8763-4c01-ba2a-fd8d9f29fd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:24.922204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef25ad-8763-4c01-ba2a-fd8d9f29fd96 admin admin] PATH_INFO: `/v3/projects/06224650fd414b5181ea9fc4738daa2e/users/f72faf2a7b364a849d7c8f26c8e84c2e/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:24.922405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8186a-ead9-45b9-90f4-c7ac1fac2189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81122c94b9b43ba94f6a26107b77036, user_id=3ec00a5981424a3e8587294bda79830a, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:24.922864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a8186a-ead9-45b9-90f4-c7ac1fac2189 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:24.935366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef25ad-8763-4c01-ba2a-fd8d9f29fd96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06224650fd414b5181ea9fc4738daa2e, user_id=f72faf2a7b364a849d7c8f26c8e84c2e, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:24.936823 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 854/1697] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:24 2022] PUT /identity/v3/projects/b81122c94b9b43ba94f6a26107b77036/users/3ec00a5981424a3e8587294bda79830a/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:24.937644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8186a-ead9-45b9-90f4-c7ac1fac2189 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:24.944984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef25ad-8763-4c01-ba2a-fd8d9f29fd96 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:25.009512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a8186a-ead9-45b9-90f4-c7ac1fac2189 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:25.014106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaead4e3-53b3-477e-9720-68d101205437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:25.014825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaead4e3-53b3-477e-9720-68d101205437 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:25.015113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaead4e3-53b3-477e-9720-68d101205437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:25.015390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaead4e3-53b3-477e-9720-68d101205437 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:25.016099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaead4e3-53b3-477e-9720-68d101205437 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:25.018001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaead4e3-53b3-477e-9720-68d101205437 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:25.063480 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 844/1698] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:24 2022] PUT /identity/v3/projects/06224650fd414b5181ea9fc4738daa2e/users/f72faf2a7b364a849d7c8f26c8e84c2e/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:25.065018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55262bad-d87a-4968-9cf4-dc7535a9d818 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:25.065314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55262bad-d87a-4968-9cf4-dc7535a9d818 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:25.065766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55262bad-d87a-4968-9cf4-dc7535a9d818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:25.100079 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 855/1699] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:24 2022] POST /identity/v3/projects => generated 379 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:25.101285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaead4e3-53b3-477e-9720-68d101205437 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:25.121717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-55262bad-d87a-4968-9cf4-dc7535a9d818 None None] MFA Rules not processed for user `3ec00a5981424a3e8587294bda79830a`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:25.123024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-55262bad-d87a-4968-9cf4-dc7535a9d818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:25.179874 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:25.212241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaead4e3-53b3-477e-9720-68d101205437 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:25.218676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527fe856-9890-4dfb-a32a-ed3aeb3f07c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:25.219525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fe856-9890-4dfb-a32a-ed3aeb3f07c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:25.219790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fe856-9890-4dfb-a32a-ed3aeb3f07c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:25.220189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527fe856-9890-4dfb-a32a-ed3aeb3f07c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:25.221003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527fe856-9890-4dfb-a32a-ed3aeb3f07c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:25.222732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527fe856-9890-4dfb-a32a-ed3aeb3f07c9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:25.235465 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 856/1700] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:25.237052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da709de7-62ce-4320-b52b-485b95b68c44 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:25.237346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da709de7-62ce-4320-b52b-485b95b68c44 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:25.250239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da709de7-62ce-4320-b52b-485b95b68c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:25.250474 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 845/1701] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:25.250474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55262bad-d87a-4968-9cf4-dc7535a9d818 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:25.260236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-da709de7-62ce-4320-b52b-485b95b68c44 None None] MFA Rules not processed for user `3332dd100e1e461e9ad8d18471e691ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:25.261172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55262bad-d87a-4968-9cf4-dc7535a9d818 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:25.261590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-da709de7-62ce-4320-b52b-485b95b68c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:25.266323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd7222-f658-49cb-8d2e-bcd5f7575759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:25.267738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd7222-f658-49cb-8d2e-bcd5f7575759 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:25.274515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd7222-f658-49cb-8d2e-bcd5f7575759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:25.274515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd7222-f658-49cb-8d2e-bcd5f7575759 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:25.274515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd7222-f658-49cb-8d2e-bcd5f7575759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:25.274515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd7222-f658-49cb-8d2e-bcd5f7575759 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:25.334694 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 857/1702] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:25.335523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da709de7-62ce-4320-b52b-485b95b68c44 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:25.347340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da709de7-62ce-4320-b52b-485b95b68c44 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:25.352557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c052593-acca-449e-aaa6-3234ca1e1189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:25.359085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c052593-acca-449e-aaa6-3234ca1e1189 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:25.359085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c052593-acca-449e-aaa6-3234ca1e1189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:25.359085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c052593-acca-449e-aaa6-3234ca1e1189 admin admin] PATH_INFO: `/v3/projects/06224650fd414b5181ea9fc4738daa2e/users/f72faf2a7b364a849d7c8f26c8e84c2e/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:25.360696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c052593-acca-449e-aaa6-3234ca1e1189 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06224650fd414b5181ea9fc4738daa2e, user_id=f72faf2a7b364a849d7c8f26c8e84c2e, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:25.363470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c052593-acca-449e-aaa6-3234ca1e1189 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:25.370866 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:25.385038 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 858/1703] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:25 2022] PUT /identity/v3/projects/06224650fd414b5181ea9fc4738daa2e/users/f72faf2a7b364a849d7c8f26c8e84c2e/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:25.385038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c052593-acca-449e-aaa6-3234ca1e1189 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:25.385318 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 846/1704] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:25 2022] POST /identity/v3/users => generated 290 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:25.385318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd7222-f658-49cb-8d2e-bcd5f7575759 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:25.388454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1c052593-acca-449e-aaa6-3234ca1e1189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:25.389507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-02fd7222-f658-49cb-8d2e-bcd5f7575759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:25.410173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd7222-f658-49cb-8d2e-bcd5f7575759 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:25.479766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c052593-acca-449e-aaa6-3234ca1e1189 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:25.487404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013a82a-a19e-4187-9779-3a8fe46176da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:25.487584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c3472-9d59-4f9d-8cb0-ae7ca8e28e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:25.488245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013a82a-a19e-4187-9779-3a8fe46176da service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:25.488368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c3472-9d59-4f9d-8cb0-ae7ca8e28e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:25.488645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013a82a-a19e-4187-9779-3a8fe46176da service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:25.488754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c3472-9d59-4f9d-8cb0-ae7ca8e28e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:25.489049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c3472-9d59-4f9d-8cb0-ae7ca8e28e97 admin admin] PATH_INFO: `/v3/users/9bd94615a21d46bb8cca32211915996e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:25.489167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1013a82a-a19e-4187-9779-3a8fe46176da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:25.490362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c3472-9d59-4f9d-8cb0-ae7ca8e28e97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bd94615a21d46bb8cca32211915996e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:25.492449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c3472-9d59-4f9d-8cb0-ae7ca8e28e97 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:25.583741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013a82a-a19e-4187-9779-3a8fe46176da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:25.585512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1013a82a-a19e-4187-9779-3a8fe46176da service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:25.597380 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 859/1705] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:25.598347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013a82a-a19e-4187-9779-3a8fe46176da service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:25.609712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1013a82a-a19e-4187-9779-3a8fe46176da service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:25.615191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d589c8-686f-40dc-8735-3530049e34c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:25.615974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d589c8-686f-40dc-8735-3530049e34c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:25.616321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d589c8-686f-40dc-8735-3530049e34c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:25.616661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d589c8-686f-40dc-8735-3530049e34c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:25.618871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d589c8-686f-40dc-8735-3530049e34c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:25.620601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d589c8-686f-40dc-8735-3530049e34c6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:25.631201 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 860/1706] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:25.632174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d589c8-686f-40dc-8735-3530049e34c6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:25.637505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-01d589c8-686f-40dc-8735-3530049e34c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:25.648049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d589c8-686f-40dc-8735-3530049e34c6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:25.652835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731dcd3-3d42-4384-93c5-db7646d41374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:25.653787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731dcd3-3d42-4384-93c5-db7646d41374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:25.654071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731dcd3-3d42-4384-93c5-db7646d41374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:25.654416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731dcd3-3d42-4384-93c5-db7646d41374 admin admin] PATH_INFO: `/v3/users/a47f5670b6a649abb7e0547933922575` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:25.655718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731dcd3-3d42-4384-93c5-db7646d41374 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a47f5670b6a649abb7e0547933922575)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:25.656752 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-a731dcd3-3d42-4384-93c5-db7646d41374 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:11:25.656752 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:11:25.656752 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:11:25.657936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731dcd3-3d42-4384-93c5-db7646d41374 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:25.717896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-109c3472-9d59-4f9d-8cb0-ae7ca8e28e97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bd94615a21d46bb8cca32211915996e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:25.743673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-109c3472-9d59-4f9d-8cb0-ae7ca8e28e97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bd94615a21d46bb8cca32211915996e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:25.747389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-109c3472-9d59-4f9d-8cb0-ae7ca8e28e97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bd94615a21d46bb8cca32211915996e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:25.747389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-109c3472-9d59-4f9d-8cb0-ae7ca8e28e97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bd94615a21d46bb8cca32211915996e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:25.755244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-109c3472-9d59-4f9d-8cb0-ae7ca8e28e97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bd94615a21d46bb8cca32211915996e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:25.857255 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 847/1707] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:25 2022] DELETE /identity/v3/users/9bd94615a21d46bb8cca32211915996e => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:25.858038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c3472-9d59-4f9d-8cb0-ae7ca8e28e97 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:25.859706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-109c3472-9d59-4f9d-8cb0-ae7ca8e28e97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:25.902693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a731dcd3-3d42-4384-93c5-db7646d41374 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a47f5670b6a649abb7e0547933922575'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:25.906214 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:25.928874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a731dcd3-3d42-4384-93c5-db7646d41374 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a47f5670b6a649abb7e0547933922575'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:25.944287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a731dcd3-3d42-4384-93c5-db7646d41374 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a47f5670b6a649abb7e0547933922575'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:25.946273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a731dcd3-3d42-4384-93c5-db7646d41374 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a47f5670b6a649abb7e0547933922575'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:25.954498 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:25.981857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c3472-9d59-4f9d-8cb0-ae7ca8e28e97 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:25.992989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d48cb-2bdd-4453-a87a-48a2eb39871f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:25.994326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d48cb-2bdd-4453-a87a-48a2eb39871f service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:25.994845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d48cb-2bdd-4453-a87a-48a2eb39871f service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:25.995216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d48cb-2bdd-4453-a87a-48a2eb39871f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:25.997876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9c4d48cb-2bdd-4453-a87a-48a2eb39871f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:26.054126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a731dcd3-3d42-4384-93c5-db7646d41374 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a47f5670b6a649abb7e0547933922575'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:26.062206 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 861/1708] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:25 2022] DELETE /identity/v3/users/a47f5670b6a649abb7e0547933922575 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:26.063285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731dcd3-3d42-4384-93c5-db7646d41374 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:26.064732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a731dcd3-3d42-4384-93c5-db7646d41374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:26.082465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d48cb-2bdd-4453-a87a-48a2eb39871f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:26.084146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d48cb-2bdd-4453-a87a-48a2eb39871f service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:26.094993 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 848/1709] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:26.096493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d0927-702f-4aa2-8e53-e73570acbed7 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:26.096843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d0927-702f-4aa2-8e53-e73570acbed7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:26.097195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d0927-702f-4aa2-8e53-e73570acbed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:26.116900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ee2d0927-702f-4aa2-8e53-e73570acbed7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:26.118652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ee2d0927-702f-4aa2-8e53-e73570acbed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:26.169249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731dcd3-3d42-4384-93c5-db7646d41374 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:26.184207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36c126-bc10-493e-8c26-89168cccd7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:26.186381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36c126-bc10-493e-8c26-89168cccd7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:26.186749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36c126-bc10-493e-8c26-89168cccd7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:26.190403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36c126-bc10-493e-8c26-89168cccd7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:26.191544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36c126-bc10-493e-8c26-89168cccd7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:26.194259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36c126-bc10-493e-8c26-89168cccd7b2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:26.221626 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 862/1710] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:26.225895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3422a1-5b32-4708-b5ce-86b0ef22b38b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:26.227861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3422a1-5b32-4708-b5ce-86b0ef22b38b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:26.233737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3422a1-5b32-4708-b5ce-86b0ef22b38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:26.244052 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 849/1711] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:26.245617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d0927-702f-4aa2-8e53-e73570acbed7 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:26.278069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d0927-702f-4aa2-8e53-e73570acbed7 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:26.279027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6c3422a1-5b32-4708-b5ce-86b0ef22b38b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:26.280400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6c3422a1-5b32-4708-b5ce-86b0ef22b38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:26.294623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2adc416-c6e8-426d-883a-68a9b86e6158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:26.295541 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 863/1712] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:26.296503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3422a1-5b32-4708-b5ce-86b0ef22b38b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:26.300218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc416-c6e8-426d-883a-68a9b86e6158 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:26.300218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc416-c6e8-426d-883a-68a9b86e6158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:26.300218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2adc416-c6e8-426d-883a-68a9b86e6158 admin admin] PATH_INFO: `/v3/projects/e46eb21223cf4c65a2eb0ad8da282ff4/users/17b720945e1a4d28bb91c44ebdd0c195/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:26.300480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6c3422a1-5b32-4708-b5ce-86b0ef22b38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:26.333198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2adc416-c6e8-426d-883a-68a9b86e6158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e46eb21223cf4c65a2eb0ad8da282ff4, user_id=17b720945e1a4d28bb91c44ebdd0c195, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:26.336168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2adc416-c6e8-426d-883a-68a9b86e6158 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:26.387826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3422a1-5b32-4708-b5ce-86b0ef22b38b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:26.393362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd5ca9-864a-4d79-916d-d49db6cd28ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:26.394347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd5ca9-864a-4d79-916d-d49db6cd28ce service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:26.394953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd5ca9-864a-4d79-916d-d49db6cd28ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:26.395933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd5ca9-864a-4d79-916d-d49db6cd28ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:26.410929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd5ca9-864a-4d79-916d-d49db6cd28ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:26.414429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd5ca9-864a-4d79-916d-d49db6cd28ce service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:26.426636 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 864/1713] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:26.428174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240b609-f0e0-4bf8-a174-6542a77a9801 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:26.429059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240b609-f0e0-4bf8-a174-6542a77a9801 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:26.429482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8240b609-f0e0-4bf8-a174-6542a77a9801 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:26.432171 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 865/1714] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:11:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:11:26.433105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240b609-f0e0-4bf8-a174-6542a77a9801 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:26.445448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8240b609-f0e0-4bf8-a174-6542a77a9801 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:26.449688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d03bc3c-c226-4d40-8a07-7160010c55a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:26.450376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03bc3c-c226-4d40-8a07-7160010c55a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:26.451023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03bc3c-c226-4d40-8a07-7160010c55a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:26.451128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d03bc3c-c226-4d40-8a07-7160010c55a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:26.462394 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 850/1715] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:26 2022] PUT /identity/v3/projects/e46eb21223cf4c65a2eb0ad8da282ff4/users/17b720945e1a4d28bb91c44ebdd0c195/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:26.473815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e619cf1-a97e-487f-99be-cae0032e8f94 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:26.474237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03bc3c-c226-4d40-8a07-7160010c55a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:26.474375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e619cf1-a97e-487f-99be-cae0032e8f94 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:26.474474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e619cf1-a97e-487f-99be-cae0032e8f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:26.475928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d03bc3c-c226-4d40-8a07-7160010c55a7 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:26.491590 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 866/1716] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:26.494305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0936d-5e82-449d-a1b2-94c815959721 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:26.495779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0936d-5e82-449d-a1b2-94c815959721 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:26.496173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea0936d-5e82-449d-a1b2-94c815959721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:26.515466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3e619cf1-a97e-487f-99be-cae0032e8f94 None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:26.516756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3e619cf1-a97e-487f-99be-cae0032e8f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:26.535313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-cea0936d-5e82-449d-a1b2-94c815959721 None None] MFA Rules not processed for user `17b720945e1a4d28bb91c44ebdd0c195`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:26.541609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cea0936d-5e82-449d-a1b2-94c815959721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:26.634181 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 851/1717] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:11:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:26.636057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e619cf1-a97e-487f-99be-cae0032e8f94 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:26.637541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3e619cf1-a97e-487f-99be-cae0032e8f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:26.649578 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 867/1718] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:26.651830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0936d-5e82-449d-a1b2-94c815959721 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:26.654886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cea0936d-5e82-449d-a1b2-94c815959721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:26.785978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e619cf1-a97e-487f-99be-cae0032e8f94 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:26.792066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d8248-fa5f-4825-8ffb-62f1f61fd001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:26.792842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d8248-fa5f-4825-8ffb-62f1f61fd001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:26.793121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d8248-fa5f-4825-8ffb-62f1f61fd001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:26.794230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d8248-fa5f-4825-8ffb-62f1f61fd001 admin admin] PATH_INFO: `/v3/users/6ac8064ee64f4a2b99aa1158714b171e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:26.795068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d8248-fa5f-4825-8ffb-62f1f61fd001 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ac8064ee64f4a2b99aa1158714b171e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:26.797283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18d8248-fa5f-4825-8ffb-62f1f61fd001 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:26.855129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea0936d-5e82-449d-a1b2-94c815959721 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:26.863584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325b2ba-fff1-4b45-ba7a-2cc3d1c5a3ae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:26.863584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325b2ba-fff1-4b45-ba7a-2cc3d1c5a3ae service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:26.866233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325b2ba-fff1-4b45-ba7a-2cc3d1c5a3ae service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:26.866579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325b2ba-fff1-4b45-ba7a-2cc3d1c5a3ae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:26.893120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325b2ba-fff1-4b45-ba7a-2cc3d1c5a3ae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:26.897693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325b2ba-fff1-4b45-ba7a-2cc3d1c5a3ae service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:26.912795 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:26.924295 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 868/1719] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:26.925065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325b2ba-fff1-4b45-ba7a-2cc3d1c5a3ae service glance] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:26.948799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325b2ba-fff1-4b45-ba7a-2cc3d1c5a3ae service glance] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:26.957004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d259e6-2cf8-435c-93b6-e04741435a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:26.957295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d259e6-2cf8-435c-93b6-e04741435a24 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:26.957652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d259e6-2cf8-435c-93b6-e04741435a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:26.958004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d259e6-2cf8-435c-93b6-e04741435a24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:26.959144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d259e6-2cf8-435c-93b6-e04741435a24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:26.962563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d259e6-2cf8-435c-93b6-e04741435a24 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:27.085665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e18d8248-fa5f-4825-8ffb-62f1f61fd001 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ac8064ee64f4a2b99aa1158714b171e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:27.103134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e18d8248-fa5f-4825-8ffb-62f1f61fd001 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ac8064ee64f4a2b99aa1158714b171e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:27.103923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e18d8248-fa5f-4825-8ffb-62f1f61fd001 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ac8064ee64f4a2b99aa1158714b171e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:27.104505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e18d8248-fa5f-4825-8ffb-62f1f61fd001 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ac8064ee64f4a2b99aa1158714b171e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:27.112842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e18d8248-fa5f-4825-8ffb-62f1f61fd001 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ac8064ee64f4a2b99aa1158714b171e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:27.119231 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 869/1720] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:26 2022] POST /identity/v3/projects => generated 375 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:27.119231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d259e6-2cf8-435c-93b6-e04741435a24 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:27.119231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-22d259e6-2cf8-435c-93b6-e04741435a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:27.204821 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 852/1721] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:26 2022] DELETE /identity/v3/users/6ac8064ee64f4a2b99aa1158714b171e => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:27.205446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d8248-fa5f-4825-8ffb-62f1f61fd001 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:27.216250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e18d8248-fa5f-4825-8ffb-62f1f61fd001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:27.295674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d259e6-2cf8-435c-93b6-e04741435a24 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:27.310977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18d8248-fa5f-4825-8ffb-62f1f61fd001 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:27.316780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77875d4c-6f5f-4e87-a69c-c92f31bd6a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:27.317664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77875d4c-6f5f-4e87-a69c-c92f31bd6a19 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:27.317951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77875d4c-6f5f-4e87-a69c-c92f31bd6a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:27.318265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77875d4c-6f5f-4e87-a69c-c92f31bd6a19 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:27.318976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77875d4c-6f5f-4e87-a69c-c92f31bd6a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:27.321550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77875d4c-6f5f-4e87-a69c-c92f31bd6a19 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:27.372910 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:27.423108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf12eb-2e45-4f18-92ad-baedfae4ba5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:27.425184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf12eb-2e45-4f18-92ad-baedfae4ba5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:27.425549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf12eb-2e45-4f18-92ad-baedfae4ba5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:27.425837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf12eb-2e45-4f18-92ad-baedfae4ba5e admin admin] PATH_INFO: `/v3/users/49bc75c5d2784446975e15dffe9d43a3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:27.429443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf12eb-2e45-4f18-92ad-baedfae4ba5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=49bc75c5d2784446975e15dffe9d43a3)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:27.437431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf12eb-2e45-4f18-92ad-baedfae4ba5e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:27.462894 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 853/1722] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:27 2022] POST /identity/v3/users => generated 294 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:27.467549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbb090-89a1-41c6-9658-bea5f2d2cbce None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:27.467549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbb090-89a1-41c6-9658-bea5f2d2cbce None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:27.467549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dbb090-89a1-41c6-9658-bea5f2d2cbce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:27.515035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-83dbb090-89a1-41c6-9658-bea5f2d2cbce None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:27.516295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-83dbb090-89a1-41c6-9658-bea5f2d2cbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:27.536504 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 854/1723] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:27.537335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbb090-89a1-41c6-9658-bea5f2d2cbce None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:27.544714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-83dbb090-89a1-41c6-9658-bea5f2d2cbce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:27.569294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dbb090-89a1-41c6-9658-bea5f2d2cbce None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:27.576878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d19f29-f5c5-4ba9-af88-33bd2f9ce2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:27.578424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d19f29-f5c5-4ba9-af88-33bd2f9ce2a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:27.578719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d19f29-f5c5-4ba9-af88-33bd2f9ce2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:27.579007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d19f29-f5c5-4ba9-af88-33bd2f9ce2a7 admin admin] PATH_INFO: `/v3/projects/e57047eb4c784ce39ab918f81b260506` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:27.580382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d19f29-f5c5-4ba9-af88-33bd2f9ce2a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e57047eb4c784ce39ab918f81b260506)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:27.582586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d19f29-f5c5-4ba9-af88-33bd2f9ce2a7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:27.730176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0aaf12eb-2e45-4f18-92ad-baedfae4ba5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49bc75c5d2784446975e15dffe9d43a3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:27.775620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-75d19f29-f5c5-4ba9-af88-33bd2f9ce2a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e57047eb4c784ce39ab918f81b260506', 'request_id': 'req-75d19f29-f5c5-4ba9-af88-33bd2f9ce2a7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:27.782908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0aaf12eb-2e45-4f18-92ad-baedfae4ba5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49bc75c5d2784446975e15dffe9d43a3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:27.794885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0aaf12eb-2e45-4f18-92ad-baedfae4ba5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49bc75c5d2784446975e15dffe9d43a3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:27.796198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0aaf12eb-2e45-4f18-92ad-baedfae4ba5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49bc75c5d2784446975e15dffe9d43a3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:27.860076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-75d19f29-f5c5-4ba9-af88-33bd2f9ce2a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e57047eb4c784ce39ab918f81b260506', 'request_id': 'req-75d19f29-f5c5-4ba9-af88-33bd2f9ce2a7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:27.868241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-75d19f29-f5c5-4ba9-af88-33bd2f9ce2a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e57047eb4c784ce39ab918f81b260506', 'request_id': 'req-75d19f29-f5c5-4ba9-af88-33bd2f9ce2a7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:27.887769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-75d19f29-f5c5-4ba9-af88-33bd2f9ce2a7 admin admin] The token cache is being invalidate because project e57047eb4c784ce39ab918f81b260506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:27.888383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-75d19f29-f5c5-4ba9-af88-33bd2f9ce2a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:27.889569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-75d19f29-f5c5-4ba9-af88-33bd2f9ce2a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:27.894356 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 855/1724] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:27 2022] DELETE /identity/v3/projects/e57047eb4c784ce39ab918f81b260506 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:27.894356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d19f29-f5c5-4ba9-af88-33bd2f9ce2a7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:27.897047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-75d19f29-f5c5-4ba9-af88-33bd2f9ce2a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:27.964099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0aaf12eb-2e45-4f18-92ad-baedfae4ba5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49bc75c5d2784446975e15dffe9d43a3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:27.986159 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 870/1725] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:27 2022] DELETE /identity/v3/users/49bc75c5d2784446975e15dffe9d43a3 => generated 0 bytes in 870 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:27.990410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf12eb-2e45-4f18-92ad-baedfae4ba5e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:27.991117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d19f29-f5c5-4ba9-af88-33bd2f9ce2a7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:27.991893 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:27.998842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0aaf12eb-2e45-4f18-92ad-baedfae4ba5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:28.073081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065bacc-9fce-47c9-a8e4-fc27c0a06b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:28.073801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065bacc-9fce-47c9-a8e4-fc27c0a06b34 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:28.074252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065bacc-9fce-47c9-a8e4-fc27c0a06b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:28.074608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065bacc-9fce-47c9-a8e4-fc27c0a06b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:28.075798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065bacc-9fce-47c9-a8e4-fc27c0a06b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:28.082539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1065bacc-9fce-47c9-a8e4-fc27c0a06b34 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:28.099991 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 856/1726] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:28.101175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065bacc-9fce-47c9-a8e4-fc27c0a06b34 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:28.103877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1065bacc-9fce-47c9-a8e4-fc27c0a06b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:28.110761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf12eb-2e45-4f18-92ad-baedfae4ba5e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:28.130520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61294ff-067f-44d0-8e79-38a0f7dd9107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:28.131289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61294ff-067f-44d0-8e79-38a0f7dd9107 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:28.131579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61294ff-067f-44d0-8e79-38a0f7dd9107 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:28.131865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61294ff-067f-44d0-8e79-38a0f7dd9107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:28.135478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1065bacc-9fce-47c9-a8e4-fc27c0a06b34 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:28.139651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e61294ff-067f-44d0-8e79-38a0f7dd9107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:28.140889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361353e9-e4ee-4d77-bba1-74ad0302054f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:28.142287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361353e9-e4ee-4d77-bba1-74ad0302054f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:28.142584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361353e9-e4ee-4d77-bba1-74ad0302054f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:28.142872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361353e9-e4ee-4d77-bba1-74ad0302054f admin admin] PATH_INFO: `/v3/users/ea8f328c46cd473f9291abad9e28e052` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:28.144867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361353e9-e4ee-4d77-bba1-74ad0302054f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea8f328c46cd473f9291abad9e28e052)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:28.148784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361353e9-e4ee-4d77-bba1-74ad0302054f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:28.161161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61294ff-067f-44d0-8e79-38a0f7dd9107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:28.163104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61294ff-067f-44d0-8e79-38a0f7dd9107 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:28.191814 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 871/1727] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:28.192702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61294ff-067f-44d0-8e79-38a0f7dd9107 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:28.202401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e61294ff-067f-44d0-8e79-38a0f7dd9107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:28.225724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61294ff-067f-44d0-8e79-38a0f7dd9107 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:28.235340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c0d246-2220-4f53-8c9d-18c9d8d4dd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:28.236242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0d246-2220-4f53-8c9d-18c9d8d4dd24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:28.236526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0d246-2220-4f53-8c9d-18c9d8d4dd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:28.236802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c0d246-2220-4f53-8c9d-18c9d8d4dd24 admin admin] PATH_INFO: `/v3/projects/0aeecac624684f049b9a3c53fa35d336` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:28.238665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c0d246-2220-4f53-8c9d-18c9d8d4dd24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aeecac624684f049b9a3c53fa35d336)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:28.244746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c0d246-2220-4f53-8c9d-18c9d8d4dd24 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:28.255010 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:28.451063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-05c0d246-2220-4f53-8c9d-18c9d8d4dd24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aeecac624684f049b9a3c53fa35d336', 'request_id': 'req-05c0d246-2220-4f53-8c9d-18c9d8d4dd24'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:28.454276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-361353e9-e4ee-4d77-bba1-74ad0302054f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea8f328c46cd473f9291abad9e28e052'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:28.466392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-05c0d246-2220-4f53-8c9d-18c9d8d4dd24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aeecac624684f049b9a3c53fa35d336', 'request_id': 'req-05c0d246-2220-4f53-8c9d-18c9d8d4dd24'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:28.480732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-05c0d246-2220-4f53-8c9d-18c9d8d4dd24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aeecac624684f049b9a3c53fa35d336', 'request_id': 'req-05c0d246-2220-4f53-8c9d-18c9d8d4dd24'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:28.500252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-361353e9-e4ee-4d77-bba1-74ad0302054f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea8f328c46cd473f9291abad9e28e052'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:28.502476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-361353e9-e4ee-4d77-bba1-74ad0302054f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea8f328c46cd473f9291abad9e28e052'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:28.503124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-361353e9-e4ee-4d77-bba1-74ad0302054f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea8f328c46cd473f9291abad9e28e052'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:28.525448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-361353e9-e4ee-4d77-bba1-74ad0302054f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea8f328c46cd473f9291abad9e28e052'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:28.582767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-05c0d246-2220-4f53-8c9d-18c9d8d4dd24 admin admin] The token cache is being invalidate because project 0aeecac624684f049b9a3c53fa35d336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:28.583423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-05c0d246-2220-4f53-8c9d-18c9d8d4dd24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:28.584243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-05c0d246-2220-4f53-8c9d-18c9d8d4dd24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:28.590564 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 872/1728] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:28 2022] DELETE /identity/v3/projects/0aeecac624684f049b9a3c53fa35d336 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:28.593081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c01331-667b-46e8-9b78-ec47798c83f1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:28.594218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c01331-667b-46e8-9b78-ec47798c83f1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:28.594741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c01331-667b-46e8-9b78-ec47798c83f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:28.623654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-67c01331-667b-46e8-9b78-ec47798c83f1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:28.625254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-67c01331-667b-46e8-9b78-ec47798c83f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:28.655799 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 857/1729] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:28 2022] DELETE /identity/v3/users/ea8f328c46cd473f9291abad9e28e052 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:28.663759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361353e9-e4ee-4d77-bba1-74ad0302054f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:28.663759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-361353e9-e4ee-4d77-bba1-74ad0302054f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:28.733842 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 873/1730] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:28.735857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3941e-fd67-44db-8c97-84604fbfa704 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:28.736341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3941e-fd67-44db-8c97-84604fbfa704 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:28.737129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3941e-fd67-44db-8c97-84604fbfa704 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:28.745309 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 874/1731] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:11:28 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:11:28.748273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3941e-fd67-44db-8c97-84604fbfa704 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:28.748860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c0a3941e-fd67-44db-8c97-84604fbfa704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:28.829091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361353e9-e4ee-4d77-bba1-74ad0302054f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:28.834732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca3ca0-e3a0-4ab5-aa17-333a70a781b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:28.835723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca3ca0-e3a0-4ab5-aa17-333a70a781b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:28.836770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca3ca0-e3a0-4ab5-aa17-333a70a781b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:28.836770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aca3ca0-e3a0-4ab5-aa17-333a70a781b9 admin admin] PATH_INFO: `/v3/projects/4ca5e336e623490f8bed74e820e03198/users/9e64785bae574af6a473a72fbedd6d9f/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:28.870667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca3ca0-e3a0-4ab5-aa17-333a70a781b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ca5e336e623490f8bed74e820e03198, user_id=9e64785bae574af6a473a72fbedd6d9f, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:28.874145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aca3ca0-e3a0-4ab5-aa17-333a70a781b9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:28.935345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3941e-fd67-44db-8c97-84604fbfa704 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:28.940849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139bee6-b672-4b7e-9777-6c111fa27eff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:28.941612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139bee6-b672-4b7e-9777-6c111fa27eff service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:28.942369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139bee6-b672-4b7e-9777-6c111fa27eff service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:28.942515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139bee6-b672-4b7e-9777-6c111fa27eff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:28.948251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6139bee6-b672-4b7e-9777-6c111fa27eff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:28.978223 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 858/1732] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:28 2022] PUT /identity/v3/projects/4ca5e336e623490f8bed74e820e03198/users/9e64785bae574af6a473a72fbedd6d9f/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:28.979598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca3ca0-e3a0-4ab5-aa17-333a70a781b9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:28.987564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139bee6-b672-4b7e-9777-6c111fa27eff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:28.989193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6139bee6-b672-4b7e-9777-6c111fa27eff service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:28.990723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9aca3ca0-e3a0-4ab5-aa17-333a70a781b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:29.021222 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 875/1733] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:29.022629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4a995-7f4e-4612-8139-46b3e76d0adc None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:29.026319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4a995-7f4e-4612-8139-46b3e76d0adc None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:29.026319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4a995-7f4e-4612-8139-46b3e76d0adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:29.043828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a8c4a995-7f4e-4612-8139-46b3e76d0adc None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:29.045183 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a8c4a995-7f4e-4612-8139-46b3e76d0adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:29.131574 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 876/1734] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:11:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:29.132574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4a995-7f4e-4612-8139-46b3e76d0adc None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:29.137948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a8c4a995-7f4e-4612-8139-46b3e76d0adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:29.151602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aca3ca0-e3a0-4ab5-aa17-333a70a781b9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:29.158823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320ee58-2086-49ec-b06b-3770e0a89fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:29.160027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320ee58-2086-49ec-b06b-3770e0a89fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:29.160498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320ee58-2086-49ec-b06b-3770e0a89fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:29.177880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320ee58-2086-49ec-b06b-3770e0a89fce admin admin] PATH_INFO: `/v3/users/407b6c53d3194cb6ba52ec6166db89ff` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:29.181023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320ee58-2086-49ec-b06b-3770e0a89fce admin admin] RBAC: Authorizing `identity:delete_user(user_id=407b6c53d3194cb6ba52ec6166db89ff)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:29.186957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320ee58-2086-49ec-b06b-3770e0a89fce admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:29.252868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4a995-7f4e-4612-8139-46b3e76d0adc None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:29.257391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f6c14-34dd-44e7-b63e-3f8062f349ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:29.258736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f6c14-34dd-44e7-b63e-3f8062f349ea service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:29.259318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f6c14-34dd-44e7-b63e-3f8062f349ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:29.259318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f6c14-34dd-44e7-b63e-3f8062f349ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:29.285289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f6c14-34dd-44e7-b63e-3f8062f349ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:29.287220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710f6c14-34dd-44e7-b63e-3f8062f349ea service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:29.301765 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 877/1735] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:29.304807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f6c14-34dd-44e7-b63e-3f8062f349ea service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:29.305368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-710f6c14-34dd-44e7-b63e-3f8062f349ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:29.325713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710f6c14-34dd-44e7-b63e-3f8062f349ea service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:29.332502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debbc9b-d8f0-46b9-a611-40e54f2b7050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:29.333718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debbc9b-d8f0-46b9-a611-40e54f2b7050 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:29.334014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debbc9b-d8f0-46b9-a611-40e54f2b7050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:29.334342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debbc9b-d8f0-46b9-a611-40e54f2b7050 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:29.335225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debbc9b-d8f0-46b9-a611-40e54f2b7050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:29.337102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debbc9b-d8f0-46b9-a611-40e54f2b7050 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:29.358168 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 878/1736] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:29.358168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debbc9b-d8f0-46b9-a611-40e54f2b7050 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:29.359030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6debbc9b-d8f0-46b9-a611-40e54f2b7050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:29.382380 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:29.385778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debbc9b-d8f0-46b9-a611-40e54f2b7050 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:29.399380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177683cd-03a8-4fb8-a4a2-177ec53b9cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:29.402511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177683cd-03a8-4fb8-a4a2-177ec53b9cce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:29.402960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7320ee58-2086-49ec-b06b-3770e0a89fce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '407b6c53d3194cb6ba52ec6166db89ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:29.403237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177683cd-03a8-4fb8-a4a2-177ec53b9cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:29.403327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177683cd-03a8-4fb8-a4a2-177ec53b9cce admin admin] PATH_INFO: `/v3/projects/2c89192c8d1649218323c804c2bacb68` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:29.407852 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177683cd-03a8-4fb8-a4a2-177ec53b9cce admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c89192c8d1649218323c804c2bacb68)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:29.410923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177683cd-03a8-4fb8-a4a2-177ec53b9cce admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:29.425966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7320ee58-2086-49ec-b06b-3770e0a89fce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '407b6c53d3194cb6ba52ec6166db89ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:29.426917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7320ee58-2086-49ec-b06b-3770e0a89fce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '407b6c53d3194cb6ba52ec6166db89ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:29.427552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7320ee58-2086-49ec-b06b-3770e0a89fce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '407b6c53d3194cb6ba52ec6166db89ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:29.437906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7320ee58-2086-49ec-b06b-3770e0a89fce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '407b6c53d3194cb6ba52ec6166db89ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:29.514548 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 859/1737] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:28 2022] DELETE /identity/v3/users/407b6c53d3194cb6ba52ec6166db89ff => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:29.515209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320ee58-2086-49ec-b06b-3770e0a89fce admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:29.519308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7320ee58-2086-49ec-b06b-3770e0a89fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:29.603534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-177683cd-03a8-4fb8-a4a2-177ec53b9cce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c89192c8d1649218323c804c2bacb68', 'request_id': 'req-177683cd-03a8-4fb8-a4a2-177ec53b9cce'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:29.624315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-177683cd-03a8-4fb8-a4a2-177ec53b9cce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c89192c8d1649218323c804c2bacb68', 'request_id': 'req-177683cd-03a8-4fb8-a4a2-177ec53b9cce'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:29.637955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-177683cd-03a8-4fb8-a4a2-177ec53b9cce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c89192c8d1649218323c804c2bacb68', 'request_id': 'req-177683cd-03a8-4fb8-a4a2-177ec53b9cce'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:29.653247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320ee58-2086-49ec-b06b-3770e0a89fce admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:29.684520 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:29.725042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-177683cd-03a8-4fb8-a4a2-177ec53b9cce admin admin] The token cache is being invalidate because project 2c89192c8d1649218323c804c2bacb68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:29.725948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-177683cd-03a8-4fb8-a4a2-177ec53b9cce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:29.729888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-177683cd-03a8-4fb8-a4a2-177ec53b9cce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:29.735029 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 879/1738] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:29 2022] DELETE /identity/v3/projects/2c89192c8d1649218323c804c2bacb68 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:29.741557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177683cd-03a8-4fb8-a4a2-177ec53b9cce admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:29.747400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-177683cd-03a8-4fb8-a4a2-177ec53b9cce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:29.757085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359719c7-cc8a-4534-b098-4a94b428de80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:29.758177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359719c7-cc8a-4534-b098-4a94b428de80 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:29.758657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359719c7-cc8a-4534-b098-4a94b428de80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:29.759085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359719c7-cc8a-4534-b098-4a94b428de80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:29.762957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-359719c7-cc8a-4534-b098-4a94b428de80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:29.855853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177683cd-03a8-4fb8-a4a2-177ec53b9cce admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:29.865663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db1c0a-5f79-4317-beeb-398668125b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:29.869051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db1c0a-5f79-4317-beeb-398668125b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:29.869348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db1c0a-5f79-4317-beeb-398668125b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:29.869666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db1c0a-5f79-4317-beeb-398668125b97 admin admin] PATH_INFO: `/v3/projects/0c6f08f0c92a44688d483d5f51b8eba9` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:29.871664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db1c0a-5f79-4317-beeb-398668125b97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c6f08f0c92a44688d483d5f51b8eba9)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:29.873513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359719c7-cc8a-4534-b098-4a94b428de80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:29.874162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db1c0a-5f79-4317-beeb-398668125b97 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:29.875579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359719c7-cc8a-4534-b098-4a94b428de80 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:29.924485 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 860/1739] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:29.925509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359719c7-cc8a-4534-b098-4a94b428de80 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:29.930454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-359719c7-cc8a-4534-b098-4a94b428de80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:29.953029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359719c7-cc8a-4534-b098-4a94b428de80 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:29.959268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6c6df-fe07-4c6a-858d-b2fd4ac8aa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:29.961784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6c6df-fe07-4c6a-858d-b2fd4ac8aa20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:29.962373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6c6df-fe07-4c6a-858d-b2fd4ac8aa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:29.962710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef6c6df-fe07-4c6a-858d-b2fd4ac8aa20 admin admin] PATH_INFO: `/v3/projects/4ca5e336e623490f8bed74e820e03198/users/9e64785bae574af6a473a72fbedd6d9f/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:29.964893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6c6df-fe07-4c6a-858d-b2fd4ac8aa20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ca5e336e623490f8bed74e820e03198, user_id=9e64785bae574af6a473a72fbedd6d9f, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:29.968437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef6c6df-fe07-4c6a-858d-b2fd4ac8aa20 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:29.984225 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 861/1740] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:29 2022] PUT /identity/v3/projects/4ca5e336e623490f8bed74e820e03198/users/9e64785bae574af6a473a72fbedd6d9f/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:29.984992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6c6df-fe07-4c6a-858d-b2fd4ac8aa20 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:29.990657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fef6c6df-fe07-4c6a-858d-b2fd4ac8aa20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:30.020877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-16db1c0a-5f79-4317-beeb-398668125b97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c6f08f0c92a44688d483d5f51b8eba9', 'request_id': 'req-16db1c0a-5f79-4317-beeb-398668125b97'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:30.026924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-16db1c0a-5f79-4317-beeb-398668125b97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c6f08f0c92a44688d483d5f51b8eba9', 'request_id': 'req-16db1c0a-5f79-4317-beeb-398668125b97'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:30.034602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-16db1c0a-5f79-4317-beeb-398668125b97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c6f08f0c92a44688d483d5f51b8eba9', 'request_id': 'req-16db1c0a-5f79-4317-beeb-398668125b97'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:30.081661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef6c6df-fe07-4c6a-858d-b2fd4ac8aa20 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:30.112356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-16db1c0a-5f79-4317-beeb-398668125b97 admin admin] The token cache is being invalidate because project 0c6f08f0c92a44688d483d5f51b8eba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:30.112841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-16db1c0a-5f79-4317-beeb-398668125b97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:30.116738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-16db1c0a-5f79-4317-beeb-398668125b97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:30.119168 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 880/1741] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:29 2022] DELETE /identity/v3/projects/0c6f08f0c92a44688d483d5f51b8eba9 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:30.124189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc154cd1-d312-4977-8236-01b1585e3901 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:30.124484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc154cd1-d312-4977-8236-01b1585e3901 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:30.124849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc154cd1-d312-4977-8236-01b1585e3901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:30.161656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-dc154cd1-d312-4977-8236-01b1585e3901 None None] MFA Rules not processed for user `9e64785bae574af6a473a72fbedd6d9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:30.164186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dc154cd1-d312-4977-8236-01b1585e3901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:30.196099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ff191-3049-434b-aa55-5eb7b68d343b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:30.197152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ff191-3049-434b-aa55-5eb7b68d343b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:30.197506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ff191-3049-434b-aa55-5eb7b68d343b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:30.198015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ff191-3049-434b-aa55-5eb7b68d343b admin admin] PATH_INFO: `/v3/users/3ec00a5981424a3e8587294bda79830a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:30.199422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ff191-3049-434b-aa55-5eb7b68d343b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ec00a5981424a3e8587294bda79830a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:30.201878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ff191-3049-434b-aa55-5eb7b68d343b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:30.266450 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 881/1742] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:30.267899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf271f7-ac16-4708-88aa-69f3e6c65679 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:30.268196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf271f7-ac16-4708-88aa-69f3e6c65679 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:30.268479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf271f7-ac16-4708-88aa-69f3e6c65679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:30.298832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7bf271f7-ac16-4708-88aa-69f3e6c65679 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:30.299978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7bf271f7-ac16-4708-88aa-69f3e6c65679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:30.324440 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 882/1743] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:30.324440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf271f7-ac16-4708-88aa-69f3e6c65679 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:30.324440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7bf271f7-ac16-4708-88aa-69f3e6c65679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:30.329446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf271f7-ac16-4708-88aa-69f3e6c65679 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:30.335195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fd652-e887-480d-aebd-c8867b0c8c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:30.336948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fd652-e887-480d-aebd-c8867b0c8c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:30.337242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fd652-e887-480d-aebd-c8867b0c8c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:30.337520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4fd652-e887-480d-aebd-c8867b0c8c18 admin admin] PATH_INFO: `/v3/projects/92bdfbe398ea474b802d0f4f0a321bec` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:30.338871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4fd652-e887-480d-aebd-c8867b0c8c18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92bdfbe398ea474b802d0f4f0a321bec)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:30.340797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4fd652-e887-480d-aebd-c8867b0c8c18 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:30.444934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-398ff191-3049-434b-aa55-5eb7b68d343b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ec00a5981424a3e8587294bda79830a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:30.479731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-398ff191-3049-434b-aa55-5eb7b68d343b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ec00a5981424a3e8587294bda79830a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:30.480482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-398ff191-3049-434b-aa55-5eb7b68d343b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ec00a5981424a3e8587294bda79830a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:30.492433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-398ff191-3049-434b-aa55-5eb7b68d343b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ec00a5981424a3e8587294bda79830a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:30.500174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ed4fd652-e887-480d-aebd-c8867b0c8c18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92bdfbe398ea474b802d0f4f0a321bec', 'request_id': 'req-ed4fd652-e887-480d-aebd-c8867b0c8c18'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:30.514502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ed4fd652-e887-480d-aebd-c8867b0c8c18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92bdfbe398ea474b802d0f4f0a321bec', 'request_id': 'req-ed4fd652-e887-480d-aebd-c8867b0c8c18'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:30.525081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-398ff191-3049-434b-aa55-5eb7b68d343b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ec00a5981424a3e8587294bda79830a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:30.525697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ed4fd652-e887-480d-aebd-c8867b0c8c18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92bdfbe398ea474b802d0f4f0a321bec', 'request_id': 'req-ed4fd652-e887-480d-aebd-c8867b0c8c18'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:30.608307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ed4fd652-e887-480d-aebd-c8867b0c8c18 admin admin] The token cache is being invalidate because project 92bdfbe398ea474b802d0f4f0a321bec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:30.608605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ed4fd652-e887-480d-aebd-c8867b0c8c18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:30.609285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ed4fd652-e887-480d-aebd-c8867b0c8c18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:30.611747 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 883/1744] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:30 2022] DELETE /identity/v3/projects/92bdfbe398ea474b802d0f4f0a321bec => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:30.613587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fd652-e887-480d-aebd-c8867b0c8c18 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:30.616117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ed4fd652-e887-480d-aebd-c8867b0c8c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:30.697090 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 862/1745] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:29 2022] DELETE /identity/v3/users/3ec00a5981424a3e8587294bda79830a => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:30.702038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd66f25-e555-48c3-8c32-0f8dbc1eb969 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:30.702038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd66f25-e555-48c3-8c32-0f8dbc1eb969 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:30.702038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd66f25-e555-48c3-8c32-0f8dbc1eb969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:30.729415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4fd652-e887-480d-aebd-c8867b0c8c18 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:30.747159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1dd66f25-e555-48c3-8c32-0f8dbc1eb969 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:30.748417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1dd66f25-e555-48c3-8c32-0f8dbc1eb969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:30.832940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814329b-8909-4b64-9040-336ca0f70eb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:30.833688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814329b-8909-4b64-9040-336ca0f70eb9 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:30.833978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814329b-8909-4b64-9040-336ca0f70eb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:30.834321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814329b-8909-4b64-9040-336ca0f70eb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:30.840093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c814329b-8909-4b64-9040-336ca0f70eb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:30.878426 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 863/1746] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:30.878991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd66f25-e555-48c3-8c32-0f8dbc1eb969 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:30.891255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1dd66f25-e555-48c3-8c32-0f8dbc1eb969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:30.906315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd66f25-e555-48c3-8c32-0f8dbc1eb969 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:30.921183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd90e1e-c2f5-458c-b013-7936801184f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:30.922151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd90e1e-c2f5-458c-b013-7936801184f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:30.922448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd90e1e-c2f5-458c-b013-7936801184f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:30.922727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd90e1e-c2f5-458c-b013-7936801184f0 admin admin] PATH_INFO: `/v3/projects/8458823a16a14038a81ad24acada2435` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:30.925465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd90e1e-c2f5-458c-b013-7936801184f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8458823a16a14038a81ad24acada2435)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:30.927414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd90e1e-c2f5-458c-b013-7936801184f0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:30.937821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814329b-8909-4b64-9040-336ca0f70eb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:30.939572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c814329b-8909-4b64-9040-336ca0f70eb9 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:30.954147 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 884/1747] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:30 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:30.955616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf43724-98ab-4030-af95-ab917f67f7be None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:30.955980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf43724-98ab-4030-af95-ab917f67f7be None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:30.956411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf43724-98ab-4030-af95-ab917f67f7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:31.010217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-fcf43724-98ab-4030-af95-ab917f67f7be None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:31.010751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fcf43724-98ab-4030-af95-ab917f67f7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:31.028768 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 885/1748] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:31.030237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf43724-98ab-4030-af95-ab917f67f7be None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:31.042871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf43724-98ab-4030-af95-ab917f67f7be None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:31.049206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e1d5a-9261-4ddc-9207-1bd9d833be47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:31.050387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e1d5a-9261-4ddc-9207-1bd9d833be47 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:31.050874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e1d5a-9261-4ddc-9207-1bd9d833be47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:31.052631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e1d5a-9261-4ddc-9207-1bd9d833be47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:31.056288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e1d5a-9261-4ddc-9207-1bd9d833be47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:11:31.056723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e1d5a-9261-4ddc-9207-1bd9d833be47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:31.056815 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:31.058401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e1d5a-9261-4ddc-9207-1bd9d833be47 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:31.074289 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 886/1749] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:31.075823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9f413-62c9-46ab-b1df-2c7ce0ab6f96 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:31.076130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9f413-62c9-46ab-b1df-2c7ce0ab6f96 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:31.076407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d9f413-62c9-46ab-b1df-2c7ce0ab6f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:31.135067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a3d9f413-62c9-46ab-b1df-2c7ce0ab6f96 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:31.136535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a3d9f413-62c9-46ab-b1df-2c7ce0ab6f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:31.152260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4bd90e1e-c2f5-458c-b013-7936801184f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8458823a16a14038a81ad24acada2435', 'request_id': 'req-4bd90e1e-c2f5-458c-b013-7936801184f0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:31.260532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4bd90e1e-c2f5-458c-b013-7936801184f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8458823a16a14038a81ad24acada2435', 'request_id': 'req-4bd90e1e-c2f5-458c-b013-7936801184f0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:31.261344 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 887/1750] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:31.262697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9f413-62c9-46ab-b1df-2c7ce0ab6f96 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:31.272855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4bd90e1e-c2f5-458c-b013-7936801184f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8458823a16a14038a81ad24acada2435', 'request_id': 'req-4bd90e1e-c2f5-458c-b013-7936801184f0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:31.274208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d9f413-62c9-46ab-b1df-2c7ce0ab6f96 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:31.280038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80031146-1e50-4887-8ff0-cddf5edfefba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:31.280905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80031146-1e50-4887-8ff0-cddf5edfefba admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:31.281339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80031146-1e50-4887-8ff0-cddf5edfefba admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:31.281788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80031146-1e50-4887-8ff0-cddf5edfefba admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:31.283102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80031146-1e50-4887-8ff0-cddf5edfefba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:31.285965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80031146-1e50-4887-8ff0-cddf5edfefba admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:31.294467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4bd90e1e-c2f5-458c-b013-7936801184f0 admin admin] The token cache is being invalidate because project 8458823a16a14038a81ad24acada2435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:31.298934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4bd90e1e-c2f5-458c-b013-7936801184f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:31.300231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4bd90e1e-c2f5-458c-b013-7936801184f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:31.309711 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 864/1751] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:30 2022] DELETE /identity/v3/projects/8458823a16a14038a81ad24acada2435 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:31.312211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee40540-84f3-4a54-a5ad-be9234ce3fe7 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:31.312607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee40540-84f3-4a54-a5ad-be9234ce3fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:31.312985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee40540-84f3-4a54-a5ad-be9234ce3fe7 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:31.315280 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 865/1752] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:11:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:11:31.315780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee40540-84f3-4a54-a5ad-be9234ce3fe7 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:31.318369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6ee40540-84f3-4a54-a5ad-be9234ce3fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:31.339412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee40540-84f3-4a54-a5ad-be9234ce3fe7 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:31.345234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565332f4-1ac3-4991-961d-1c07c07ecb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:31.347012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565332f4-1ac3-4991-961d-1c07c07ecb19 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:31.347012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565332f4-1ac3-4991-961d-1c07c07ecb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:31.347012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565332f4-1ac3-4991-961d-1c07c07ecb19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:31.347764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565332f4-1ac3-4991-961d-1c07c07ecb19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:11:31.352030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565332f4-1ac3-4991-961d-1c07c07ecb19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:31.352030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565332f4-1ac3-4991-961d-1c07c07ecb19 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:31.370001 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 866/1753] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:11:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:31.371277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565332f4-1ac3-4991-961d-1c07c07ecb19 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:31.373216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-565332f4-1ac3-4991-961d-1c07c07ecb19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:31.386802 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 888/1754] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:31 2022] POST /identity/v3/projects => generated 393 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:31.387882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80031146-1e50-4887-8ff0-cddf5edfefba admin admin] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:11:31.391029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-80031146-1e50-4887-8ff0-cddf5edfefba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:31.396467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565332f4-1ac3-4991-961d-1c07c07ecb19 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:31.439204 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:31.493212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4ef02-f8cc-487c-bde5-f1e35add1acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:31.495356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4ef02-f8cc-487c-bde5-f1e35add1acd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:31.499859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4ef02-f8cc-487c-bde5-f1e35add1acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:31.499859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4ef02-f8cc-487c-bde5-f1e35add1acd admin admin] PATH_INFO: `/v3/users/8a4975e9e58c44428a4caf775e4f0e15` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:31.501868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4ef02-f8cc-487c-bde5-f1e35add1acd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a4975e9e58c44428a4caf775e4f0e15)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:31.505390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4ef02-f8cc-487c-bde5-f1e35add1acd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:31.567995 n-d-master-1 devstack@keystone.service[80680]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-80031146-1e50-4887-8ff0-cddf5edfefba admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jul 19 14:11:31.568668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80031146-1e50-4887-8ff0-cddf5edfefba admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:31.570567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-80031146-1e50-4887-8ff0-cddf5edfefba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:31.660955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80031146-1e50-4887-8ff0-cddf5edfefba admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:31.669549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4132d7-a682-4933-83e4-e2504e57dcfc tempest-FlavorsAccessTestJSON-53820917 tempest-FlavorsAccessTestJSON-53820917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e64785bae574af6a473a72fbedd6d9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ca5e336e623490f8bed74e820e03198', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:31.671239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4132d7-a682-4933-83e4-e2504e57dcfc tempest-FlavorsAccessTestJSON-53820917 tempest-FlavorsAccessTestJSON-53820917-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:31.671673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4132d7-a682-4933-83e4-e2504e57dcfc tempest-FlavorsAccessTestJSON-53820917 tempest-FlavorsAccessTestJSON-53820917-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:31.672093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4132d7-a682-4933-83e4-e2504e57dcfc tempest-FlavorsAccessTestJSON-53820917 tempest-FlavorsAccessTestJSON-53820917-project-admin] PATH_INFO: `/v3/projects/e46eb21223cf4c65a2eb0ad8da282ff4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:31.673527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4132d7-a682-4933-83e4-e2504e57dcfc tempest-FlavorsAccessTestJSON-53820917 tempest-FlavorsAccessTestJSON-53820917-project-admin] RBAC: Authorizing `identity:get_project(project_id=e46eb21223cf4c65a2eb0ad8da282ff4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:31.677498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4132d7-a682-4933-83e4-e2504e57dcfc tempest-FlavorsAccessTestJSON-53820917 tempest-FlavorsAccessTestJSON-53820917-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:31.682817 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 889/1755] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:11:31 2022] GET /identity/v3/projects/e46eb21223cf4c65a2eb0ad8da282ff4 => generated 379 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:31.684072 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:31.685367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4132d7-a682-4933-83e4-e2504e57dcfc tempest-FlavorsAccessTestJSON-53820917 tempest-FlavorsAccessTestJSON-53820917-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:31.687725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cc4132d7-a682-4933-83e4-e2504e57dcfc tempest-FlavorsAccessTestJSON-53820917 tempest-FlavorsAccessTestJSON-53820917-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:31.723935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4132d7-a682-4933-83e4-e2504e57dcfc tempest-FlavorsAccessTestJSON-53820917 tempest-FlavorsAccessTestJSON-53820917-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:31.724696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6ad4ef02-f8cc-487c-bde5-f1e35add1acd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a4975e9e58c44428a4caf775e4f0e15'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:31.730863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8362c-1926-4518-99c0-70d46c42663b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:31.731785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8362c-1926-4518-99c0-70d46c42663b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:31.732073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8362c-1926-4518-99c0-70d46c42663b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:31.732349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8362c-1926-4518-99c0-70d46c42663b admin admin] PATH_INFO: `/v3/projects/b81122c94b9b43ba94f6a26107b77036` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:31.733653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8362c-1926-4518-99c0-70d46c42663b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b81122c94b9b43ba94f6a26107b77036)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:31.738145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc8362c-1926-4518-99c0-70d46c42663b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:31.739682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6ad4ef02-f8cc-487c-bde5-f1e35add1acd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a4975e9e58c44428a4caf775e4f0e15'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:31.740466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6ad4ef02-f8cc-487c-bde5-f1e35add1acd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a4975e9e58c44428a4caf775e4f0e15'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:31.741376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6ad4ef02-f8cc-487c-bde5-f1e35add1acd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a4975e9e58c44428a4caf775e4f0e15'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:31.751378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6ad4ef02-f8cc-487c-bde5-f1e35add1acd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a4975e9e58c44428a4caf775e4f0e15'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:31.839285 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 867/1756] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:31 2022] DELETE /identity/v3/users/8a4975e9e58c44428a4caf775e4f0e15 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:31.839285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4ef02-f8cc-487c-bde5-f1e35add1acd admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:31.839285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6ad4ef02-f8cc-487c-bde5-f1e35add1acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:31.893636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-efc8362c-1926-4518-99c0-70d46c42663b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b81122c94b9b43ba94f6a26107b77036', 'request_id': 'req-efc8362c-1926-4518-99c0-70d46c42663b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:31.907847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-efc8362c-1926-4518-99c0-70d46c42663b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b81122c94b9b43ba94f6a26107b77036', 'request_id': 'req-efc8362c-1926-4518-99c0-70d46c42663b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:31.919116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-efc8362c-1926-4518-99c0-70d46c42663b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b81122c94b9b43ba94f6a26107b77036', 'request_id': 'req-efc8362c-1926-4518-99c0-70d46c42663b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:31.955212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4ef02-f8cc-487c-bde5-f1e35add1acd admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:32.013972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-efc8362c-1926-4518-99c0-70d46c42663b admin admin] The token cache is being invalidate because project b81122c94b9b43ba94f6a26107b77036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:32.014303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-efc8362c-1926-4518-99c0-70d46c42663b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:32.019936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-efc8362c-1926-4518-99c0-70d46c42663b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:32.025953 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 890/1757] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:31 2022] DELETE /identity/v3/projects/b81122c94b9b43ba94f6a26107b77036 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:32.025953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8362c-1926-4518-99c0-70d46c42663b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:32.027469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-efc8362c-1926-4518-99c0-70d46c42663b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:32.062029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948bb60-3fef-45f5-93c6-b7a0393e1ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:32.064262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948bb60-3fef-45f5-93c6-b7a0393e1ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:32.065151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948bb60-3fef-45f5-93c6-b7a0393e1ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:32.066364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948bb60-3fef-45f5-93c6-b7a0393e1ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:32.068039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948bb60-3fef-45f5-93c6-b7a0393e1ff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:32.073423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948bb60-3fef-45f5-93c6-b7a0393e1ff6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:32.134758 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:32.140770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8362c-1926-4518-99c0-70d46c42663b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:32.146976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ccaf08-bfcf-4458-8b51-65017e34d1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:32.147672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccaf08-bfcf-4458-8b51-65017e34d1f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:32.147960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccaf08-bfcf-4458-8b51-65017e34d1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:32.148353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ccaf08-bfcf-4458-8b51-65017e34d1f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:32.149709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ccaf08-bfcf-4458-8b51-65017e34d1f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:32.151986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ccaf08-bfcf-4458-8b51-65017e34d1f4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:32.257071 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 868/1758] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:31 2022] POST /identity/v3/projects => generated 391 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:32.257071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948bb60-3fef-45f5-93c6-b7a0393e1ff6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:32.258468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c948bb60-3fef-45f5-93c6-b7a0393e1ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:32.291606 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 891/1759] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:32 2022] POST /identity/v3/users => generated 297 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:32.293441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6918d3d-f68d-4771-9438-fef931a54a03 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:32.294325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6918d3d-f68d-4771-9438-fef931a54a03 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:32.294325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6918d3d-f68d-4771-9438-fef931a54a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:32.349185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b6918d3d-f68d-4771-9438-fef931a54a03 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:32.354645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b6918d3d-f68d-4771-9438-fef931a54a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:32.412334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948bb60-3fef-45f5-93c6-b7a0393e1ff6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:32.430416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f10fcb-7f89-4762-ad4e-a9734d6e9850 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:32.431101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f10fcb-7f89-4762-ad4e-a9734d6e9850 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:32.431394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f10fcb-7f89-4762-ad4e-a9734d6e9850 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:32.431675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f10fcb-7f89-4762-ad4e-a9734d6e9850 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:32.439957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-98f10fcb-7f89-4762-ad4e-a9734d6e9850 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:32.475018 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 892/1760] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:32.476138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6918d3d-f68d-4771-9438-fef931a54a03 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:32.479874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b6918d3d-f68d-4771-9438-fef931a54a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:32.498181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6918d3d-f68d-4771-9438-fef931a54a03 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:32.503415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aeb665-e2bb-4178-aca6-0e4903a60825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:32.504294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aeb665-e2bb-4178-aca6-0e4903a60825 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:32.504727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aeb665-e2bb-4178-aca6-0e4903a60825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:32.505272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aeb665-e2bb-4178-aca6-0e4903a60825 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:32.506191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aeb665-e2bb-4178-aca6-0e4903a60825 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:32.508848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aeb665-e2bb-4178-aca6-0e4903a60825 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:32.569864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f10fcb-7f89-4762-ad4e-a9734d6e9850 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:32.572267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f10fcb-7f89-4762-ad4e-a9734d6e9850 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:32.589304 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 869/1761] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:32 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:32.590447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f10fcb-7f89-4762-ad4e-a9734d6e9850 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:32.608364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f10fcb-7f89-4762-ad4e-a9734d6e9850 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:32.609738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336444a3-def6-410e-a18d-ddbda33047e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:32.610567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336444a3-def6-410e-a18d-ddbda33047e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:32.610973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336444a3-def6-410e-a18d-ddbda33047e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:32.611341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336444a3-def6-410e-a18d-ddbda33047e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:32.612154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336444a3-def6-410e-a18d-ddbda33047e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:32.614190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336444a3-def6-410e-a18d-ddbda33047e0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:32.629104 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 870/1762] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:32.629104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0d01b-0ae4-4722-bd69-db3bb0bc1786 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:32.629104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0d01b-0ae4-4722-bd69-db3bb0bc1786 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:32.629442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0d01b-0ae4-4722-bd69-db3bb0bc1786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:32.636945 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 893/1763] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:32 2022] POST /identity/v3/users => generated 296 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:32.636945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aeb665-e2bb-4178-aca6-0e4903a60825 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:32.641680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c8aeb665-e2bb-4178-aca6-0e4903a60825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:32.667310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aeb665-e2bb-4178-aca6-0e4903a60825 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:32.668946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-92b0d01b-0ae4-4722-bd69-db3bb0bc1786 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:32.670621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-92b0d01b-0ae4-4722-bd69-db3bb0bc1786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:32.678775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c59da-08f3-46d2-a2da-3c22ec5ac26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:32.679858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c59da-08f3-46d2-a2da-3c22ec5ac26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:32.680124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c59da-08f3-46d2-a2da-3c22ec5ac26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:32.680381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c59da-08f3-46d2-a2da-3c22ec5ac26b admin admin] PATH_INFO: `/v3/projects/15fffc5de382473aa3373dbd9e5c28f2` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:32.681814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c59da-08f3-46d2-a2da-3c22ec5ac26b admin admin] RBAC: Authorizing `identity:delete_project(project_id=15fffc5de382473aa3373dbd9e5c28f2)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:32.687940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c59da-08f3-46d2-a2da-3c22ec5ac26b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:32.691522 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 871/1764] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:32.693033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0d01b-0ae4-4722-bd69-db3bb0bc1786 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:32.708067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0d01b-0ae4-4722-bd69-db3bb0bc1786 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:32.718827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037ba36-eac8-4888-99cc-6221b1da10fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:32.719521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037ba36-eac8-4888-99cc-6221b1da10fd admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:32.719815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037ba36-eac8-4888-99cc-6221b1da10fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:32.720095 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1037ba36-eac8-4888-99cc-6221b1da10fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:32.720937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037ba36-eac8-4888-99cc-6221b1da10fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:32.722472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1037ba36-eac8-4888-99cc-6221b1da10fd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:32.742941 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 872/1765] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:32.742941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037ba36-eac8-4888-99cc-6221b1da10fd admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:32.760818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1037ba36-eac8-4888-99cc-6221b1da10fd admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:32.764082 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:32.766429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d5280-87d6-421b-80b7-4098e410ba52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:32.767395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d5280-87d6-421b-80b7-4098e410ba52 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:32.772446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d5280-87d6-421b-80b7-4098e410ba52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:32.772446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d5280-87d6-421b-80b7-4098e410ba52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:32.772446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d5280-87d6-421b-80b7-4098e410ba52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:32.772446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d5280-87d6-421b-80b7-4098e410ba52 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:32.783074 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 873/1766] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:32.783931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d5280-87d6-421b-80b7-4098e410ba52 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:32.800970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d5280-87d6-421b-80b7-4098e410ba52 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:32.806878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5757b59-9dba-4362-ab23-00a5a78bd425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:32.807563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5757b59-9dba-4362-ab23-00a5a78bd425 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:32.808612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5757b59-9dba-4362-ab23-00a5a78bd425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:32.808972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5757b59-9dba-4362-ab23-00a5a78bd425 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:32.809869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5757b59-9dba-4362-ab23-00a5a78bd425 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:11:32.810350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5757b59-9dba-4362-ab23-00a5a78bd425 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:32.812636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5757b59-9dba-4362-ab23-00a5a78bd425 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:32.830265 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 874/1767] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:32.831216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87044d84-f66e-4c26-815c-96b873661b67 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:32.831521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87044d84-f66e-4c26-815c-96b873661b67 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:32.831806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87044d84-f66e-4c26-815c-96b873661b67 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:32.833596 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 875/1768] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:11:32.834520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87044d84-f66e-4c26-815c-96b873661b67 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:32.851219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7c2c59da-08f3-46d2-a2da-3c22ec5ac26b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15fffc5de382473aa3373dbd9e5c28f2', 'request_id': 'req-7c2c59da-08f3-46d2-a2da-3c22ec5ac26b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:32.858552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7c2c59da-08f3-46d2-a2da-3c22ec5ac26b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15fffc5de382473aa3373dbd9e5c28f2', 'request_id': 'req-7c2c59da-08f3-46d2-a2da-3c22ec5ac26b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:32.866025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7c2c59da-08f3-46d2-a2da-3c22ec5ac26b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15fffc5de382473aa3373dbd9e5c28f2', 'request_id': 'req-7c2c59da-08f3-46d2-a2da-3c22ec5ac26b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:32.923417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87044d84-f66e-4c26-815c-96b873661b67 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:32.934664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b09e6-3084-4a9a-a01f-fb090322e054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:32.936042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b09e6-3084-4a9a-a01f-fb090322e054 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:32.936336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b09e6-3084-4a9a-a01f-fb090322e054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:32.936620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b09e6-3084-4a9a-a01f-fb090322e054 admin admin] PATH_INFO: `/v3/projects/b87b86879289468cacc4a8dcb6764fc7/users/4893403562c542fbb9fad5c5b37501f2/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:32.958933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7c2c59da-08f3-46d2-a2da-3c22ec5ac26b admin admin] The token cache is being invalidate because project 15fffc5de382473aa3373dbd9e5c28f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:32.959192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7c2c59da-08f3-46d2-a2da-3c22ec5ac26b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:32.959866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7c2c59da-08f3-46d2-a2da-3c22ec5ac26b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:32.962064 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 894/1769] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:32 2022] DELETE /identity/v3/projects/15fffc5de382473aa3373dbd9e5c28f2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:32.962961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c59da-08f3-46d2-a2da-3c22ec5ac26b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:32.967605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7c2c59da-08f3-46d2-a2da-3c22ec5ac26b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:32.974089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b09e6-3084-4a9a-a01f-fb090322e054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b87b86879289468cacc4a8dcb6764fc7, user_id=4893403562c542fbb9fad5c5b37501f2, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:32.989352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b09e6-3084-4a9a-a01f-fb090322e054 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:33.012689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c59da-08f3-46d2-a2da-3c22ec5ac26b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:33.018263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab283739-d030-485b-9e84-020a96975f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:33.018996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab283739-d030-485b-9e84-020a96975f07 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:33.019292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab283739-d030-485b-9e84-020a96975f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:33.019617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab283739-d030-485b-9e84-020a96975f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:33.020329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab283739-d030-485b-9e84-020a96975f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:33.022864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab283739-d030-485b-9e84-020a96975f07 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:33.063402 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 895/1770] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:33.064414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab283739-d030-485b-9e84-020a96975f07 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:33.068459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ab283739-d030-485b-9e84-020a96975f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:33.088647 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 876/1771] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:32 2022] PUT /identity/v3/projects/b87b86879289468cacc4a8dcb6764fc7/users/4893403562c542fbb9fad5c5b37501f2/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:33.107221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b09e6-3084-4a9a-a01f-fb090322e054 admin admin] Authenticating service token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:11:33.117968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-446b09e6-3084-4a9a-a01f-fb090322e054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:33.135032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab283739-d030-485b-9e84-020a96975f07 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:33.187806 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:33.249192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63627160-de69-48c6-ad89-bf39dac67d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:33.255842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63627160-de69-48c6-ad89-bf39dac67d5e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:33.256144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63627160-de69-48c6-ad89-bf39dac67d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:33.258354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63627160-de69-48c6-ad89-bf39dac67d5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:33.267961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63627160-de69-48c6-ad89-bf39dac67d5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:33.272314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63627160-de69-48c6-ad89-bf39dac67d5e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:33.309145 n-d-master-1 devstack@keystone.service[80679]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-446b09e6-3084-4a9a-a01f-fb090322e054 admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jul 19 14:11:33.309459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b09e6-3084-4a9a-a01f-fb090322e054 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:33.315107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-446b09e6-3084-4a9a-a01f-fb090322e054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:33.432122 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 896/1772] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:33 2022] POST /identity/v3/projects => generated 389 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:33.435763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f89e2a-ac76-4f68-a550-6995be557d80 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:33.436265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f89e2a-ac76-4f68-a550-6995be557d80 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:33.437150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f89e2a-ac76-4f68-a550-6995be557d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:33.471317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b09e6-3084-4a9a-a01f-fb090322e054 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:33.473162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-41f89e2a-ac76-4f68-a550-6995be557d80 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:33.474424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-41f89e2a-ac76-4f68-a550-6995be557d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:33.537266 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:33.606975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a2765-03b6-486a-aac5-a1fe4b2edbda tempest-FlavorsAccessTestJSON-53820917 tempest-FlavorsAccessTestJSON-53820917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9e64785bae574af6a473a72fbedd6d9f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4ca5e336e623490f8bed74e820e03198', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:33.608368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a2765-03b6-486a-aac5-a1fe4b2edbda tempest-FlavorsAccessTestJSON-53820917 tempest-FlavorsAccessTestJSON-53820917-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:33.608778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a2765-03b6-486a-aac5-a1fe4b2edbda tempest-FlavorsAccessTestJSON-53820917 tempest-FlavorsAccessTestJSON-53820917-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:33.609373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5a2765-03b6-486a-aac5-a1fe4b2edbda tempest-FlavorsAccessTestJSON-53820917 tempest-FlavorsAccessTestJSON-53820917-project-admin] PATH_INFO: `/v3/projects/e46eb21223cf4c65a2eb0ad8da282ff4` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:33.610712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a2765-03b6-486a-aac5-a1fe4b2edbda tempest-FlavorsAccessTestJSON-53820917 tempest-FlavorsAccessTestJSON-53820917-project-admin] RBAC: Authorizing `identity:get_project(project_id=e46eb21223cf4c65a2eb0ad8da282ff4)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:33.614534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5a2765-03b6-486a-aac5-a1fe4b2edbda tempest-FlavorsAccessTestJSON-53820917 tempest-FlavorsAccessTestJSON-53820917-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:33.617588 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 877/1773] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:11:33 2022] GET /identity/v3/projects/e46eb21223cf4c65a2eb0ad8da282ff4 => generated 379 bytes in 528 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:33.618539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a2765-03b6-486a-aac5-a1fe4b2edbda tempest-FlavorsAccessTestJSON-53820917 tempest-FlavorsAccessTestJSON-53820917-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:33.624604 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 897/1774] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:33.626511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccaebb-92de-4f4a-a2d7-f553c5679764 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:33.626934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccaebb-92de-4f4a-a2d7-f553c5679764 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:33.627345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccaebb-92de-4f4a-a2d7-f553c5679764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:33.647669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5a2765-03b6-486a-aac5-a1fe4b2edbda tempest-FlavorsAccessTestJSON-53820917 tempest-FlavorsAccessTestJSON-53820917-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:33.655668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e8cfc-7258-4dd8-933e-8c447d6014d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:33.656584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e8cfc-7258-4dd8-933e-8c447d6014d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:33.656874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e8cfc-7258-4dd8-933e-8c447d6014d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:33.657155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e8cfc-7258-4dd8-933e-8c447d6014d5 admin admin] PATH_INFO: `/v3/projects/b7871440e2744ce1875634afcd573fe5/users/cf0b965a43664e32a0e9b174e391b4df/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:33.677948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e8cfc-7258-4dd8-933e-8c447d6014d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7871440e2744ce1875634afcd573fe5, user_id=cf0b965a43664e32a0e9b174e391b4df, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:33.681256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e8cfc-7258-4dd8-933e-8c447d6014d5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:33.687219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-45ccaebb-92de-4f4a-a2d7-f553c5679764 None None] MFA Rules not processed for user `4893403562c542fbb9fad5c5b37501f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:33.688674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-45ccaebb-92de-4f4a-a2d7-f553c5679764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:33.806450 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:33.809016 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 878/1775] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:33 2022] PUT /identity/v3/projects/b7871440e2744ce1875634afcd573fe5/users/cf0b965a43664e32a0e9b174e391b4df/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:33.810793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b4ab9-0023-4ed6-b5b9-1a4b150c2df6 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:33.811085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b4ab9-0023-4ed6-b5b9-1a4b150c2df6 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:33.811364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b4ab9-0023-4ed6-b5b9-1a4b150c2df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:33.857130 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 898/1776] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:33.857991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccaebb-92de-4f4a-a2d7-f553c5679764 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:33.880675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ccaebb-92de-4f4a-a2d7-f553c5679764 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:33.915067 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:33.943223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-927b4ab9-0023-4ed6-b5b9-1a4b150c2df6 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:33.944461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-927b4ab9-0023-4ed6-b5b9-1a4b150c2df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:34.026143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac3cd9b-eaab-455f-ba65-14a5cc75e054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:34.026843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3cd9b-eaab-455f-ba65-14a5cc75e054 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:34.027137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3cd9b-eaab-455f-ba65-14a5cc75e054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:34.043420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac3cd9b-eaab-455f-ba65-14a5cc75e054 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:34.043420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3cd9b-eaab-455f-ba65-14a5cc75e054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:34.057393 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 879/1777] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:11:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:34.058456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac3cd9b-eaab-455f-ba65-14a5cc75e054 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:34.058599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f222ea7-fa6e-4e97-ac93-e01a0c654558 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:34.058599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f222ea7-fa6e-4e97-ac93-e01a0c654558 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:34.058599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f222ea7-fa6e-4e97-ac93-e01a0c654558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:34.093318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4f222ea7-fa6e-4e97-ac93-e01a0c654558 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:34.094573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4f222ea7-fa6e-4e97-ac93-e01a0c654558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:34.105245 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 880/1778] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:34.108929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9e2bf-39d9-495f-8c13-ba06ee19646c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:34.109242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9e2bf-39d9-495f-8c13-ba06ee19646c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:34.109522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9e2bf-39d9-495f-8c13-ba06ee19646c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:34.138773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2dd9e2bf-39d9-495f-8c13-ba06ee19646c None None] MFA Rules not processed for user `f72faf2a7b364a849d7c8f26c8e84c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:34.140027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2dd9e2bf-39d9-495f-8c13-ba06ee19646c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:34.177023 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 899/1779] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:33 2022] POST /identity/v3/users => generated 295 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:34.178658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f922d5-1f20-4f5a-a3ec-34b9c92c8caa None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:34.178951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f922d5-1f20-4f5a-a3ec-34b9c92c8caa None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:34.179242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f922d5-1f20-4f5a-a3ec-34b9c92c8caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:34.222988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-02f922d5-1f20-4f5a-a3ec-34b9c92c8caa None None] MFA Rules not processed for user `cf0b965a43664e32a0e9b174e391b4df`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:34.224870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-02f922d5-1f20-4f5a-a3ec-34b9c92c8caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:34.234441 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 881/1780] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:34 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:34.236847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9e2bf-39d9-495f-8c13-ba06ee19646c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:34.238684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2dd9e2bf-39d9-495f-8c13-ba06ee19646c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:34.260403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9e2bf-39d9-495f-8c13-ba06ee19646c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:34.266667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa22d3b-9c7b-49ab-9261-a8566c910e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:34.267661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa22d3b-9c7b-49ab-9261-a8566c910e8a admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:34.268188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa22d3b-9c7b-49ab-9261-a8566c910e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:34.268465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa22d3b-9c7b-49ab-9261-a8566c910e8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:34.269192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa22d3b-9c7b-49ab-9261-a8566c910e8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:34.271310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa22d3b-9c7b-49ab-9261-a8566c910e8a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:34.307864 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 900/1781] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:34 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:34.309084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f922d5-1f20-4f5a-a3ec-34b9c92c8caa None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:34.319772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f922d5-1f20-4f5a-a3ec-34b9c92c8caa None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:34.325837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4650599-9e52-45f0-9296-f530c5140ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:34.326527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4650599-9e52-45f0-9296-f530c5140ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:34.326807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4650599-9e52-45f0-9296-f530c5140ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:34.327081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4650599-9e52-45f0-9296-f530c5140ed3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:34.327810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4650599-9e52-45f0-9296-f530c5140ed3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:11:34.328111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4650599-9e52-45f0-9296-f530c5140ed3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:34.329835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4650599-9e52-45f0-9296-f530c5140ed3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:34.345418 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 901/1782] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:34.346546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4650599-9e52-45f0-9296-f530c5140ed3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:34.358551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4650599-9e52-45f0-9296-f530c5140ed3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:34.364259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97524320-4fc9-401f-a974-077657f1e402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:34.365041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97524320-4fc9-401f-a974-077657f1e402 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:34.365447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97524320-4fc9-401f-a974-077657f1e402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:34.365864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97524320-4fc9-401f-a974-077657f1e402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:34.366835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97524320-4fc9-401f-a974-077657f1e402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:34.368972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97524320-4fc9-401f-a974-077657f1e402 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:34.381531 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 902/1783] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:34.383206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97524320-4fc9-401f-a974-077657f1e402 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:34.387569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-97524320-4fc9-401f-a974-077657f1e402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:34.393704 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 882/1784] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:34 2022] POST /identity/v3/projects => generated 393 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:34.394722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa22d3b-9c7b-49ab-9261-a8566c910e8a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:34.465835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa22d3b-9c7b-49ab-9261-a8566c910e8a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:34.466050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97524320-4fc9-401f-a974-077657f1e402 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:34.471020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec9b06-9b5e-4a1d-9ebd-12a46f92fb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:34.471694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec9b06-9b5e-4a1d-9ebd-12a46f92fb34 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:34.472169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec9b06-9b5e-4a1d-9ebd-12a46f92fb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:34.472265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bec9b06-9b5e-4a1d-9ebd-12a46f92fb34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:34.472936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec9b06-9b5e-4a1d-9ebd-12a46f92fb34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:34.474868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bec9b06-9b5e-4a1d-9ebd-12a46f92fb34 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:34.533342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198501c5-2328-4770-9560-eee7bd6bb9bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:34.534057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198501c5-2328-4770-9560-eee7bd6bb9bf service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:34.534442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198501c5-2328-4770-9560-eee7bd6bb9bf service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:34.534717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198501c5-2328-4770-9560-eee7bd6bb9bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:34.536479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-198501c5-2328-4770-9560-eee7bd6bb9bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:34.552043 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 883/1785] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:34 2022] POST /identity/v3/projects => generated 389 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:34.553200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec9b06-9b5e-4a1d-9ebd-12a46f92fb34 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:34.637397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198501c5-2328-4770-9560-eee7bd6bb9bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:34.639396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198501c5-2328-4770-9560-eee7bd6bb9bf service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:34.645804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bec9b06-9b5e-4a1d-9ebd-12a46f92fb34 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:34.651432 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 903/1786] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:34 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:34.651887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657b489-2c79-459f-9b1d-a36785255e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:34.652130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198501c5-2328-4770-9560-eee7bd6bb9bf service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:34.655182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-198501c5-2328-4770-9560-eee7bd6bb9bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:34.655296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657b489-2c79-459f-9b1d-a36785255e5d admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:34.655296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657b489-2c79-459f-9b1d-a36785255e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:34.655500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657b489-2c79-459f-9b1d-a36785255e5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:34.656404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657b489-2c79-459f-9b1d-a36785255e5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:34.658488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9657b489-2c79-459f-9b1d-a36785255e5d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:34.672708 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=7,keystone:SELECT=87,keystone:INSERT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:34.679147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198501c5-2328-4770-9560-eee7bd6bb9bf service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:34.693715 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:34.700892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f34757-40b7-491f-8ea9-ae86988b09bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:34.700892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f34757-40b7-491f-8ea9-ae86988b09bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:34.700892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f34757-40b7-491f-8ea9-ae86988b09bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:34.700892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f34757-40b7-491f-8ea9-ae86988b09bd admin admin] PATH_INFO: `/v3/users/17b720945e1a4d28bb91c44ebdd0c195` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:34.702236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f34757-40b7-491f-8ea9-ae86988b09bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b720945e1a4d28bb91c44ebdd0c195)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:34.704167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f34757-40b7-491f-8ea9-ae86988b09bd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:34.774794 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 884/1787] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:34 2022] POST /identity/v3/projects => generated 383 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:34.775878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657b489-2c79-459f-9b1d-a36785255e5d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:34.852492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9657b489-2c79-459f-9b1d-a36785255e5d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:34.857216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63bc89-8ba5-4a14-8042-b9a7c042fc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:34.857921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63bc89-8ba5-4a14-8042-b9a7c042fc94 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:34.858272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63bc89-8ba5-4a14-8042-b9a7c042fc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:34.858555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a63bc89-8ba5-4a14-8042-b9a7c042fc94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:34.859293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63bc89-8ba5-4a14-8042-b9a7c042fc94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:34.860901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a63bc89-8ba5-4a14-8042-b9a7c042fc94 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:34.872145 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 885/1788] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:34.872994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63bc89-8ba5-4a14-8042-b9a7c042fc94 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:34.875479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77f34757-40b7-491f-8ea9-ae86988b09bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b720945e1a4d28bb91c44ebdd0c195'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:34.884472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a63bc89-8ba5-4a14-8042-b9a7c042fc94 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:34.890660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f22026-1bb5-44f1-ba02-14d41bb8cbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:34.891534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f22026-1bb5-44f1-ba02-14d41bb8cbcd admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:34.891825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f22026-1bb5-44f1-ba02-14d41bb8cbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:34.892097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f22026-1bb5-44f1-ba02-14d41bb8cbcd admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:34.892599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77f34757-40b7-491f-8ea9-ae86988b09bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b720945e1a4d28bb91c44ebdd0c195'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:34.892797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f22026-1bb5-44f1-ba02-14d41bb8cbcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:34.895063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f22026-1bb5-44f1-ba02-14d41bb8cbcd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:34.902141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77f34757-40b7-491f-8ea9-ae86988b09bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b720945e1a4d28bb91c44ebdd0c195'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:34.902993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77f34757-40b7-491f-8ea9-ae86988b09bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b720945e1a4d28bb91c44ebdd0c195'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:34.963548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77f34757-40b7-491f-8ea9-ae86988b09bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b720945e1a4d28bb91c44ebdd0c195'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:34.970984 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 904/1789] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:34 2022] DELETE /identity/v3/users/17b720945e1a4d28bb91c44ebdd0c195 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:34.974046 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 886/1790] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:34 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:34.974201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f34757-40b7-491f-8ea9-ae86988b09bd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:34.974331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f22026-1bb5-44f1-ba02-14d41bb8cbcd admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:34.974950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-77f34757-40b7-491f-8ea9-ae86988b09bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:34.975060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-54f22026-1bb5-44f1-ba02-14d41bb8cbcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:34.988977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f22026-1bb5-44f1-ba02-14d41bb8cbcd admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:35.056255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14040c7c-7f27-450b-b2e9-858ecb58b4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:35.057874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14040c7c-7f27-450b-b2e9-858ecb58b4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:35.058380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14040c7c-7f27-450b-b2e9-858ecb58b4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:35.058846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14040c7c-7f27-450b-b2e9-858ecb58b4b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:35.060334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14040c7c-7f27-450b-b2e9-858ecb58b4b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:35.062510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14040c7c-7f27-450b-b2e9-858ecb58b4b6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:35.067213 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:35.077916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f34757-40b7-491f-8ea9-ae86988b09bd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:35.083736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de899e-9cf2-49e4-93f7-aad0065d1740 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:35.084478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de899e-9cf2-49e4-93f7-aad0065d1740 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:35.084766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de899e-9cf2-49e4-93f7-aad0065d1740 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:35.085048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de899e-9cf2-49e4-93f7-aad0065d1740 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:35.087051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a6de899e-9cf2-49e4-93f7-aad0065d1740 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:35.159436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de899e-9cf2-49e4-93f7-aad0065d1740 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:35.162038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de899e-9cf2-49e4-93f7-aad0065d1740 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:35.178059 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 887/1791] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:34 2022] POST /identity/v3/users => generated 301 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:35.179161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14040c7c-7f27-450b-b2e9-858ecb58b4b6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:35.180353 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 905/1792] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:11:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:11:35.181315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de899e-9cf2-49e4-93f7-aad0065d1740 service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:35.183088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a6de899e-9cf2-49e4-93f7-aad0065d1740 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:35.184630 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:35.188005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-14040c7c-7f27-450b-b2e9-858ecb58b4b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:35.198719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de899e-9cf2-49e4-93f7-aad0065d1740 service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:35.205408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211371a-a009-4a8d-9d5e-c88cef655d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:35.205966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211371a-a009-4a8d-9d5e-c88cef655d6e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:35.206303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211371a-a009-4a8d-9d5e-c88cef655d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:35.206588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211371a-a009-4a8d-9d5e-c88cef655d6e admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:35.207379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211371a-a009-4a8d-9d5e-c88cef655d6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:35.225725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211371a-a009-4a8d-9d5e-c88cef655d6e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:35.271453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14040c7c-7f27-450b-b2e9-858ecb58b4b6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:35.281443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ee480-cf46-44fd-ac2d-74c7e65310df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:35.282240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ee480-cf46-44fd-ac2d-74c7e65310df service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:35.282520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ee480-cf46-44fd-ac2d-74c7e65310df service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:35.282805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ee480-cf46-44fd-ac2d-74c7e65310df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:35.295970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ad0ee480-cf46-44fd-ac2d-74c7e65310df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:35.361742 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 906/1793] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:35 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:35.363406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40fd8c-60a8-4ab0-b503-d519fe3553c8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:35.363693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40fd8c-60a8-4ab0-b503-d519fe3553c8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:35.363966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40fd8c-60a8-4ab0-b503-d519fe3553c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:35.427203 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:35.429763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ee480-cf46-44fd-ac2d-74c7e65310df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:35.434718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ee480-cf46-44fd-ac2d-74c7e65310df service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:35.471609 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 888/1794] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:35 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:35.474427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ee480-cf46-44fd-ac2d-74c7e65310df service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:35.480537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ad0ee480-cf46-44fd-ac2d-74c7e65310df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:35.501049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2e40fd8c-60a8-4ab0-b503-d519fe3553c8 None None] MFA Rules not processed for user `e997b70d7158446daa1dfa225eb7afca`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:35.501662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ee480-cf46-44fd-ac2d-74c7e65310df service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:35.502221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2e40fd8c-60a8-4ab0-b503-d519fe3553c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:35.507761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f427b7-e1cd-4f86-a661-19a7b804b751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:35.508724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f427b7-e1cd-4f86-a661-19a7b804b751 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:35.509099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f427b7-e1cd-4f86-a661-19a7b804b751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:35.509381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f427b7-e1cd-4f86-a661-19a7b804b751 admin admin] PATH_INFO: `/v3/projects/b72d0b3424de45c2a20069951b0e742e/users/4b0ed05d4daf4d2a93f8fe5b03ab5873/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:35.547718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f427b7-e1cd-4f86-a661-19a7b804b751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b72d0b3424de45c2a20069951b0e742e, user_id=4b0ed05d4daf4d2a93f8fe5b03ab5873, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:35.561195 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:35.573203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f427b7-e1cd-4f86-a661-19a7b804b751 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:35.608881 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:35.640421 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 889/1796] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:35 2022] PUT /identity/v3/projects/b72d0b3424de45c2a20069951b0e742e/users/4b0ed05d4daf4d2a93f8fe5b03ab5873/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:35.640946 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 907/1796] 10.222.0.39 () {58 vars in 1015 bytes} [Tue Jul 19 14:11:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:35.641976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f427b7-e1cd-4f86-a661-19a7b804b751 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:35.643078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bae997-1a11-4f22-b7b9-674cdb5fff9b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:35.643635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bae997-1a11-4f22-b7b9-674cdb5fff9b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:35.644161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bae997-1a11-4f22-b7b9-674cdb5fff9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:35.653802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-22f427b7-e1cd-4f86-a661-19a7b804b751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:35.680105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-58bae997-1a11-4f22-b7b9-674cdb5fff9b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:35.682213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-58bae997-1a11-4f22-b7b9-674cdb5fff9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:35.783193 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 908/1797] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:35.783193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bae997-1a11-4f22-b7b9-674cdb5fff9b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:35.809888 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:35.817967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bae997-1a11-4f22-b7b9-674cdb5fff9b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:35.827769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfd4a8-992c-48e6-9ed5-26508cac4985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:35.828927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfd4a8-992c-48e6-9ed5-26508cac4985 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:35.829120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfd4a8-992c-48e6-9ed5-26508cac4985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:35.829533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfd4a8-992c-48e6-9ed5-26508cac4985 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:35.831555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfd4a8-992c-48e6-9ed5-26508cac4985 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:35.833220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f427b7-e1cd-4f86-a661-19a7b804b751 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:35.833345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfd4a8-992c-48e6-9ed5-26508cac4985 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:35.848811 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 909/1798] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:35.848811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfd4a8-992c-48e6-9ed5-26508cac4985 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:35.855005 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:35.856926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ca42f-31de-477e-a140-167d09a82f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:35.858171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ca42f-31de-477e-a140-167d09a82f89 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:35.858498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ca42f-31de-477e-a140-167d09a82f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:35.858757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ca42f-31de-477e-a140-167d09a82f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:35.859529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ca42f-31de-477e-a140-167d09a82f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:35.862924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ca42f-31de-477e-a140-167d09a82f89 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:35.871702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfd4a8-992c-48e6-9ed5-26508cac4985 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:35.877474 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 890/1799] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:35.879014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d109125-eef4-4b6f-890a-9de02502fa41 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:35.879232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d109125-eef4-4b6f-890a-9de02502fa41 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:35.879518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d109125-eef4-4b6f-890a-9de02502fa41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:35.880830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3f303-0d19-4771-8b60-169dd7497300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:35.881834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3f303-0d19-4771-8b60-169dd7497300 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:35.882232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3f303-0d19-4771-8b60-169dd7497300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:35.894065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3f303-0d19-4771-8b60-169dd7497300 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:35.895041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3f303-0d19-4771-8b60-169dd7497300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:35.897090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3f303-0d19-4771-8b60-169dd7497300 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:35.912031 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 910/1800] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:35.913032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3f303-0d19-4771-8b60-169dd7497300 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:35.915669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a5c3f303-0d19-4771-8b60-169dd7497300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:35.959863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7d109125-eef4-4b6f-890a-9de02502fa41 None None] MFA Rules not processed for user `4b0ed05d4daf4d2a93f8fe5b03ab5873`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:35.964940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7d109125-eef4-4b6f-890a-9de02502fa41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:36.003452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3f303-0d19-4771-8b60-169dd7497300 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:36.009316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca278b69-9716-497f-bd9a-5de16b5fcfa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:36.010837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca278b69-9716-497f-bd9a-5de16b5fcfa7 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:36.011665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca278b69-9716-497f-bd9a-5de16b5fcfa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:36.014419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca278b69-9716-497f-bd9a-5de16b5fcfa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:36.025642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca278b69-9716-497f-bd9a-5de16b5fcfa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:36.027679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca278b69-9716-497f-bd9a-5de16b5fcfa7 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:36.041583 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 911/1801] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:36.043718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca278b69-9716-497f-bd9a-5de16b5fcfa7 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:36.059692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca278b69-9716-497f-bd9a-5de16b5fcfa7 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:36.064841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8abd6-af5c-40fe-822e-95c63e381252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:36.065612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8abd6-af5c-40fe-822e-95c63e381252 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:36.066448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8abd6-af5c-40fe-822e-95c63e381252 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:36.066749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8abd6-af5c-40fe-822e-95c63e381252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:36.070669 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:36.080632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8abd6-af5c-40fe-822e-95c63e381252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:36.082160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8abd6-af5c-40fe-822e-95c63e381252 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:36.094971 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 912/1802] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:36.095800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8abd6-af5c-40fe-822e-95c63e381252 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:36.107081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8abd6-af5c-40fe-822e-95c63e381252 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:36.112329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8f41e-f025-4604-b59c-8ed06d09664b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:36.113267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8f41e-f025-4604-b59c-8ed06d09664b admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:36.113532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8f41e-f025-4604-b59c-8ed06d09664b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:36.113822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8f41e-f025-4604-b59c-8ed06d09664b admin admin] PATH_INFO: `/v3/projects/5efd8e69843149baafb970ead6c1ce25/users/c8ea4d8dba9b4ebc96a9fccfbca30353/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:36.120458 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:36.140320 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 891/1803] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:36.141825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d109125-eef4-4b6f-890a-9de02502fa41 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:36.146298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8f41e-f025-4604-b59c-8ed06d09664b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5efd8e69843149baafb970ead6c1ce25, user_id=c8ea4d8dba9b4ebc96a9fccfbca30353, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:36.153474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8f41e-f025-4604-b59c-8ed06d09664b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:36.162040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d109125-eef4-4b6f-890a-9de02502fa41 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:36.162040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdac7b-e9df-4173-8207-cc4224d14454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:36.162278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdac7b-e9df-4173-8207-cc4224d14454 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:36.162483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdac7b-e9df-4173-8207-cc4224d14454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:36.162766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdac7b-e9df-4173-8207-cc4224d14454 admin admin] PATH_INFO: `/v3/projects/cc8bea3ca33f4e29b2c1bb42b156b094/users/1e24fd23b5e146d9a4b50e9b6dcd3562/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:36.182091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdac7b-e9df-4173-8207-cc4224d14454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8bea3ca33f4e29b2c1bb42b156b094, user_id=1e24fd23b5e146d9a4b50e9b6dcd3562, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:36.185894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdac7b-e9df-4173-8207-cc4224d14454 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:36.259835 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 913/1804] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:36 2022] PUT /identity/v3/projects/5efd8e69843149baafb970ead6c1ce25/users/c8ea4d8dba9b4ebc96a9fccfbca30353/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:36.260910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8f41e-f025-4604-b59c-8ed06d09664b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:36.310368 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 892/1805] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:36 2022] PUT /identity/v3/projects/cc8bea3ca33f4e29b2c1bb42b156b094/users/1e24fd23b5e146d9a4b50e9b6dcd3562/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:36.312743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdac7b-e9df-4173-8207-cc4224d14454 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:36.393082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8f41e-f025-4604-b59c-8ed06d09664b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:36.541108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d641fd6-4a16-4191-8d7e-1c3f8c8cc917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:36.541108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d641fd6-4a16-4191-8d7e-1c3f8c8cc917 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:36.541108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d641fd6-4a16-4191-8d7e-1c3f8c8cc917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:36.541108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d641fd6-4a16-4191-8d7e-1c3f8c8cc917 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:36.542005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d641fd6-4a16-4191-8d7e-1c3f8c8cc917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:36.542005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d641fd6-4a16-4191-8d7e-1c3f8c8cc917 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:36.542176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdac7b-e9df-4173-8207-cc4224d14454 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:36.542555 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 914/1806] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:36.542555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d641fd6-4a16-4191-8d7e-1c3f8c8cc917 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:36.542690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f86c7-29a9-4639-8749-20820056cc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:36.542690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f86c7-29a9-4639-8749-20820056cc2e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:36.542690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f86c7-29a9-4639-8749-20820056cc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:36.542690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f86c7-29a9-4639-8749-20820056cc2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:36.542955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f86c7-29a9-4639-8749-20820056cc2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:36.542955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f86c7-29a9-4639-8749-20820056cc2e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:36.542955 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:36.543171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d641fd6-4a16-4191-8d7e-1c3f8c8cc917 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:36.543171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2197f-a05f-411a-90df-05c28d3f8b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:36.543171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2197f-a05f-411a-90df-05c28d3f8b15 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:36.543171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2197f-a05f-411a-90df-05c28d3f8b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:36.543432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f2197f-a05f-411a-90df-05c28d3f8b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:36.543432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2197f-a05f-411a-90df-05c28d3f8b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:36.543432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f2197f-a05f-411a-90df-05c28d3f8b15 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:36.596846 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 915/1807] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:36.596846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2197f-a05f-411a-90df-05c28d3f8b15 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:36.596846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f2197f-a05f-411a-90df-05c28d3f8b15 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:36.596846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e3558-ef5f-472a-98eb-dbef30790cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:36.597144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e3558-ef5f-472a-98eb-dbef30790cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:36.597144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e3558-ef5f-472a-98eb-dbef30790cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:36.597144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e3558-ef5f-472a-98eb-dbef30790cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:36.597144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e3558-ef5f-472a-98eb-dbef30790cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:36.599205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70e3558-ef5f-472a-98eb-dbef30790cb1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:36.655150 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 916/1808] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:36.656787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e3558-ef5f-472a-98eb-dbef30790cb1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:36.681101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e3558-ef5f-472a-98eb-dbef30790cb1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:36.692961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63569d5-cb3b-4fb8-8057-6a6f0fa4b325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:36.693925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63569d5-cb3b-4fb8-8057-6a6f0fa4b325 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:36.694281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63569d5-cb3b-4fb8-8057-6a6f0fa4b325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:36.694588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63569d5-cb3b-4fb8-8057-6a6f0fa4b325 admin admin] PATH_INFO: `/v3/projects/438eb708f4a544119669755db2cdba90/users/36069205be03434d84c287145b69dd1a/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:36.733809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63569d5-cb3b-4fb8-8057-6a6f0fa4b325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=438eb708f4a544119669755db2cdba90, user_id=36069205be03434d84c287145b69dd1a, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:36.733809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63569d5-cb3b-4fb8-8057-6a6f0fa4b325 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:36.869682 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:36.893516 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 893/1809] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:36 2022] POST /identity/v3/projects => generated 391 bytes in 582 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:36.894595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f86c7-29a9-4639-8749-20820056cc2e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:36.941182 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 917/1810] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:36 2022] PUT /identity/v3/projects/438eb708f4a544119669755db2cdba90/users/36069205be03434d84c287145b69dd1a/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:36.941182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63569d5-cb3b-4fb8-8057-6a6f0fa4b325 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:37.040377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f86c7-29a9-4639-8749-20820056cc2e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:37.135510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63569d5-cb3b-4fb8-8057-6a6f0fa4b325 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:37.149448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22edcc-03a3-4c12-b08d-33e16083156d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:37.150859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22edcc-03a3-4c12-b08d-33e16083156d admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:37.151223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22edcc-03a3-4c12-b08d-33e16083156d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:37.151648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22edcc-03a3-4c12-b08d-33e16083156d admin admin] PATH_INFO: `/v3/projects/5efd8e69843149baafb970ead6c1ce25/users/c8ea4d8dba9b4ebc96a9fccfbca30353/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:37.154676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22edcc-03a3-4c12-b08d-33e16083156d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5efd8e69843149baafb970ead6c1ce25, user_id=c8ea4d8dba9b4ebc96a9fccfbca30353, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:37.155134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2075e6c-9538-4209-858c-db9f1ff3113b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:37.156077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2075e6c-9538-4209-858c-db9f1ff3113b admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:37.156526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2075e6c-9538-4209-858c-db9f1ff3113b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:37.156817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2075e6c-9538-4209-858c-db9f1ff3113b admin admin] PATH_INFO: `/v3/projects/cc8bea3ca33f4e29b2c1bb42b156b094/users/1e24fd23b5e146d9a4b50e9b6dcd3562/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:37.157590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d22edcc-03a3-4c12-b08d-33e16083156d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:37.165806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2075e6c-9538-4209-858c-db9f1ff3113b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc8bea3ca33f4e29b2c1bb42b156b094, user_id=1e24fd23b5e146d9a4b50e9b6dcd3562, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:37.168541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2075e6c-9538-4209-858c-db9f1ff3113b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:37.172304 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 894/1811] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:36 2022] PUT /identity/v3/projects/5efd8e69843149baafb970ead6c1ce25/users/c8ea4d8dba9b4ebc96a9fccfbca30353/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:37.173678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22edcc-03a3-4c12-b08d-33e16083156d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:37.204227 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 918/1812] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:36 2022] PUT /identity/v3/projects/cc8bea3ca33f4e29b2c1bb42b156b094/users/1e24fd23b5e146d9a4b50e9b6dcd3562/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:37.214073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0387e-ec5e-4c43-8eb9-41adbedfbbf0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:37.214398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0387e-ec5e-4c43-8eb9-41adbedfbbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:37.217786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0387e-ec5e-4c43-8eb9-41adbedfbbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:37.311014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-bdf0387e-ec5e-4c43-8eb9-41adbedfbbf0 None None] MFA Rules not processed for user `36069205be03434d84c287145b69dd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:37.313386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bdf0387e-ec5e-4c43-8eb9-41adbedfbbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:37.367907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d22edcc-03a3-4c12-b08d-33e16083156d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:37.381382 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:37.506803 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:37.563022 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 919/1813] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:37.564471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e8b24-316c-4caf-81ad-60a86dc00d32 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:37.564765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e8b24-316c-4caf-81ad-60a86dc00d32 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:37.565051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e8b24-316c-4caf-81ad-60a86dc00d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:37.578132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca60cbd-59c1-4163-98ca-bf3339f256ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:37.578132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca60cbd-59c1-4163-98ca-bf3339f256ae admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:37.578132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca60cbd-59c1-4163-98ca-bf3339f256ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:37.578132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca60cbd-59c1-4163-98ca-bf3339f256ae admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:37.579181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca60cbd-59c1-4163-98ca-bf3339f256ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:37.582465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca60cbd-59c1-4163-98ca-bf3339f256ae admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:37.665469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-195e8b24-316c-4caf-81ad-60a86dc00d32 None None] MFA Rules not processed for user `c8ea4d8dba9b4ebc96a9fccfbca30353`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:37.666756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-195e8b24-316c-4caf-81ad-60a86dc00d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:37.702780 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 895/1814] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:37 2022] POST /identity/v3/users => generated 302 bytes in 527 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:37.702780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b0542-9e02-43b4-8f4c-ba9a923fbac3 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:37.702780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b0542-9e02-43b4-8f4c-ba9a923fbac3 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:37.703277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b0542-9e02-43b4-8f4c-ba9a923fbac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:37.817247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-da6b0542-9e02-43b4-8f4c-ba9a923fbac3 None None] MFA Rules not processed for user `1e24fd23b5e146d9a4b50e9b6dcd3562`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:37.819125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-da6b0542-9e02-43b4-8f4c-ba9a923fbac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:37.831954 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 920/1815] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:37 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:37.833203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e8b24-316c-4caf-81ad-60a86dc00d32 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:37.848890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e8b24-316c-4caf-81ad-60a86dc00d32 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:37.862156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8875e-bbd7-4f0a-b54a-c205554328a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:37.864518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8875e-bbd7-4f0a-b54a-c205554328a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:37.864518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8875e-bbd7-4f0a-b54a-c205554328a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:37.864518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8875e-bbd7-4f0a-b54a-c205554328a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:37.869651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8875e-bbd7-4f0a-b54a-c205554328a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:37.876756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8875e-bbd7-4f0a-b54a-c205554328a1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:38.015404 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 921/1816] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:37 2022] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:38.016637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8875e-bbd7-4f0a-b54a-c205554328a1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:38.021938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-47c8875e-bbd7-4f0a-b54a-c205554328a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:38.074140 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 896/1817] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:38.074140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b0542-9e02-43b4-8f4c-ba9a923fbac3 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:38.099969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b0542-9e02-43b4-8f4c-ba9a923fbac3 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:38.187279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b727f3-30c5-401a-b55d-9a44b749798c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:38.188704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b727f3-30c5-401a-b55d-9a44b749798c admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:38.189006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b727f3-30c5-401a-b55d-9a44b749798c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:38.189294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b727f3-30c5-401a-b55d-9a44b749798c admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:38.190228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b727f3-30c5-401a-b55d-9a44b749798c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:38.196719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b727f3-30c5-401a-b55d-9a44b749798c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:38.213385 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 897/1818] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:38.214651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b727f3-30c5-401a-b55d-9a44b749798c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:38.226089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b727f3-30c5-401a-b55d-9a44b749798c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:38.240561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045c6bd-7f28-473a-9b27-7b4f2c25e8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:38.240561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045c6bd-7f28-473a-9b27-7b4f2c25e8ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:38.240561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045c6bd-7f28-473a-9b27-7b4f2c25e8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:38.240561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045c6bd-7f28-473a-9b27-7b4f2c25e8ba admin admin] PATH_INFO: `/v3/users/cf0b965a43664e32a0e9b174e391b4df` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:38.241089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045c6bd-7f28-473a-9b27-7b4f2c25e8ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf0b965a43664e32a0e9b174e391b4df)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:38.243358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045c6bd-7f28-473a-9b27-7b4f2c25e8ba admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:38.263490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8875e-bbd7-4f0a-b54a-c205554328a1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:38.270622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94a1ff-3707-4292-a87b-56b865a40b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:38.271541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94a1ff-3707-4292-a87b-56b865a40b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:38.271830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94a1ff-3707-4292-a87b-56b865a40b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:38.272295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94a1ff-3707-4292-a87b-56b865a40b18 admin admin] PATH_INFO: `/v3/projects/e46eb21223cf4c65a2eb0ad8da282ff4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:38.274894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94a1ff-3707-4292-a87b-56b865a40b18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e46eb21223cf4c65a2eb0ad8da282ff4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:38.276853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94a1ff-3707-4292-a87b-56b865a40b18 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:38.434652 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:38.572216 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:38.573015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dc94a1ff-3707-4292-a87b-56b865a40b18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e46eb21223cf4c65a2eb0ad8da282ff4', 'request_id': 'req-dc94a1ff-3707-4292-a87b-56b865a40b18'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:38.581330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dc94a1ff-3707-4292-a87b-56b865a40b18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e46eb21223cf4c65a2eb0ad8da282ff4', 'request_id': 'req-dc94a1ff-3707-4292-a87b-56b865a40b18'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:38.581940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0045c6bd-7f28-473a-9b27-7b4f2c25e8ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf0b965a43664e32a0e9b174e391b4df'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:38.589800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dc94a1ff-3707-4292-a87b-56b865a40b18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e46eb21223cf4c65a2eb0ad8da282ff4', 'request_id': 'req-dc94a1ff-3707-4292-a87b-56b865a40b18'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:38.611941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0045c6bd-7f28-473a-9b27-7b4f2c25e8ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf0b965a43664e32a0e9b174e391b4df'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:38.613082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0045c6bd-7f28-473a-9b27-7b4f2c25e8ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf0b965a43664e32a0e9b174e391b4df'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:38.613667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0045c6bd-7f28-473a-9b27-7b4f2c25e8ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf0b965a43664e32a0e9b174e391b4df'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:38.688834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dc94a1ff-3707-4292-a87b-56b865a40b18 admin admin] The token cache is being invalidate because project e46eb21223cf4c65a2eb0ad8da282ff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:38.689270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dc94a1ff-3707-4292-a87b-56b865a40b18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:38.690010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dc94a1ff-3707-4292-a87b-56b865a40b18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:38.692772 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 922/1819] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:38 2022] DELETE /identity/v3/projects/e46eb21223cf4c65a2eb0ad8da282ff4 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:38.695034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f621fa5-e8c4-45ae-a658-3eb93b5deda2 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:38.695671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f621fa5-e8c4-45ae-a658-3eb93b5deda2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:38.696186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f621fa5-e8c4-45ae-a658-3eb93b5deda2 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:38.696696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0045c6bd-7f28-473a-9b27-7b4f2c25e8ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf0b965a43664e32a0e9b174e391b4df'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:38.697689 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 923/1820] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:11:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:11:38.710925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f621fa5-e8c4-45ae-a658-3eb93b5deda2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:38.713018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2f621fa5-e8c4-45ae-a658-3eb93b5deda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:38.811389 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 898/1821] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:38 2022] DELETE /identity/v3/users/cf0b965a43664e32a0e9b174e391b4df => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:38.816225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa84e0-4967-4862-a1df-a44dd6c1f8f8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:38.817427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa84e0-4967-4862-a1df-a44dd6c1f8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:38.818007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fa84e0-4967-4862-a1df-a44dd6c1f8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:38.843416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f621fa5-e8c4-45ae-a658-3eb93b5deda2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:38.874301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e1fa84e0-4967-4862-a1df-a44dd6c1f8f8 None None] MFA Rules not processed for user `4893403562c542fbb9fad5c5b37501f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:38.878006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e1fa84e0-4967-4862-a1df-a44dd6c1f8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:38.994792 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 899/1822] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:39.007322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa84e0-4967-4862-a1df-a44dd6c1f8f8 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:39.013242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e1fa84e0-4967-4862-a1df-a44dd6c1f8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:39.038662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94afbf-8741-48cd-a451-a66186c1c517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:39.039919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94afbf-8741-48cd-a451-a66186c1c517 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:39.040489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94afbf-8741-48cd-a451-a66186c1c517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:39.040630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94afbf-8741-48cd-a451-a66186c1c517 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:39.041337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94afbf-8741-48cd-a451-a66186c1c517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:39.043412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94afbf-8741-48cd-a451-a66186c1c517 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:39.178491 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 924/1823] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:38 2022] POST /identity/v3/users => generated 297 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:39.181584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94afbf-8741-48cd-a451-a66186c1c517 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:39.196923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8e94afbf-8741-48cd-a451-a66186c1c517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:39.216725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94afbf-8741-48cd-a451-a66186c1c517 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:39.222759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab15db-dad1-4bb1-8626-6f1824c53e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:39.224381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab15db-dad1-4bb1-8626-6f1824c53e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:39.224381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab15db-dad1-4bb1-8626-6f1824c53e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:39.225123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fa84e0-4967-4862-a1df-a44dd6c1f8f8 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:39.225592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab15db-dad1-4bb1-8626-6f1824c53e91 admin admin] PATH_INFO: `/v3/users/9e64785bae574af6a473a72fbedd6d9f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:39.227850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab15db-dad1-4bb1-8626-6f1824c53e91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e64785bae574af6a473a72fbedd6d9f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:39.230044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ab15db-dad1-4bb1-8626-6f1824c53e91 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:39.251690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebf1808-da01-400b-909f-3d9b56c2f705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:39.252620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf1808-da01-400b-909f-3d9b56c2f705 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:39.252903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf1808-da01-400b-909f-3d9b56c2f705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:39.253184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebf1808-da01-400b-909f-3d9b56c2f705 admin admin] PATH_INFO: `/v3/projects/40cba74222cf4e84b957e2d152039649/users/942065a418744c7d8ff3a8f5a7676920/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:39.289979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf1808-da01-400b-909f-3d9b56c2f705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40cba74222cf4e84b957e2d152039649, user_id=942065a418744c7d8ff3a8f5a7676920, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:39.292772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebf1808-da01-400b-909f-3d9b56c2f705 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:39.393966 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 900/1824] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:38 2022] PUT /identity/v3/projects/40cba74222cf4e84b957e2d152039649/users/942065a418744c7d8ff3a8f5a7676920/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:39.395725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9e55f-5159-4130-863b-aa52a49d4678 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:39.396276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9e55f-5159-4130-863b-aa52a49d4678 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:39.397016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9e55f-5159-4130-863b-aa52a49d4678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:39.431190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d2e9e55f-5159-4130-863b-aa52a49d4678 None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:39.442804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d2e9e55f-5159-4130-863b-aa52a49d4678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:39.455626 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=13,keystone:SELECT=83,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:39.459300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-37ab15db-dad1-4bb1-8626-6f1824c53e91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e64785bae574af6a473a72fbedd6d9f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:39.481232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-37ab15db-dad1-4bb1-8626-6f1824c53e91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e64785bae574af6a473a72fbedd6d9f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:39.499284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-37ab15db-dad1-4bb1-8626-6f1824c53e91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e64785bae574af6a473a72fbedd6d9f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:39.506407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-37ab15db-dad1-4bb1-8626-6f1824c53e91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e64785bae574af6a473a72fbedd6d9f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:39.552510 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:39.604268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-37ab15db-dad1-4bb1-8626-6f1824c53e91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e64785bae574af6a473a72fbedd6d9f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:39.611767 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 901/1825] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:11:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:39.613327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a1a57-c83b-43bc-aff5-227801ec9622 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:39.614048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a1a57-c83b-43bc-aff5-227801ec9622 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:39.615366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a1a57-c83b-43bc-aff5-227801ec9622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:39.619921 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 925/1826] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:39 2022] DELETE /identity/v3/users/9e64785bae574af6a473a72fbedd6d9f => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:39.621264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab15db-dad1-4bb1-8626-6f1824c53e91 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:39.628631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-37ab15db-dad1-4bb1-8626-6f1824c53e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:39.657847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6d6a1a57-c83b-43bc-aff5-227801ec9622 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:39.657847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6d6a1a57-c83b-43bc-aff5-227801ec9622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:39.805895 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 902/1827] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:39.812530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a1a57-c83b-43bc-aff5-227801ec9622 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:39.816371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6d6a1a57-c83b-43bc-aff5-227801ec9622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:39.820315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab15db-dad1-4bb1-8626-6f1824c53e91 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:39.827528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4279d03-5d2a-45a4-807a-a103a74e66d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:39.833853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4279d03-5d2a-45a4-807a-a103a74e66d1 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:39.834559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4279d03-5d2a-45a4-807a-a103a74e66d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:39.835133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4279d03-5d2a-45a4-807a-a103a74e66d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:39.839602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a4279d03-5d2a-45a4-807a-a103a74e66d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:39.846903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a1a57-c83b-43bc-aff5-227801ec9622 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:39.865953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26292fc-08d5-4202-8e7c-f199231f79b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:39.866810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26292fc-08d5-4202-8e7c-f199231f79b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:39.867700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26292fc-08d5-4202-8e7c-f199231f79b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:39.868045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26292fc-08d5-4202-8e7c-f199231f79b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:39.871246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26292fc-08d5-4202-8e7c-f199231f79b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:39.874341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26292fc-08d5-4202-8e7c-f199231f79b7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:39.900318 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 903/1828] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:39.902331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26292fc-08d5-4202-8e7c-f199231f79b7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:39.913137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e26292fc-08d5-4202-8e7c-f199231f79b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:39.963883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26292fc-08d5-4202-8e7c-f199231f79b7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:39.993205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d67d8-11f1-4f04-ab26-fd093aa24c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:39.993903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d67d8-11f1-4f04-ab26-fd093aa24c1e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:39.994217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d67d8-11f1-4f04-ab26-fd093aa24c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:39.994608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228d67d8-11f1-4f04-ab26-fd093aa24c1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:40.000001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4279d03-5d2a-45a4-807a-a103a74e66d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:40.001670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d67d8-11f1-4f04-ab26-fd093aa24c1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:40.003383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228d67d8-11f1-4f04-ab26-fd093aa24c1e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:40.008252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4279d03-5d2a-45a4-807a-a103a74e66d1 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:40.037988 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 926/1829] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:39 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:40.037988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4279d03-5d2a-45a4-807a-a103a74e66d1 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:40.039068 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 904/1830] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:40.039480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d67d8-11f1-4f04-ab26-fd093aa24c1e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:40.042483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a4279d03-5d2a-45a4-807a-a103a74e66d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:40.068131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228d67d8-11f1-4f04-ab26-fd093aa24c1e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:40.099707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be573bd1-2a87-492c-a1ed-f6d025a4eb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:40.100631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be573bd1-2a87-492c-a1ed-f6d025a4eb47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:40.100915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be573bd1-2a87-492c-a1ed-f6d025a4eb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:40.101196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be573bd1-2a87-492c-a1ed-f6d025a4eb47 admin admin] PATH_INFO: `/v3/projects/11eef167e20b45ffb004762082d7640d/users/b68648ac641c477999e3b2134f2ce5c6/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:40.176022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be573bd1-2a87-492c-a1ed-f6d025a4eb47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11eef167e20b45ffb004762082d7640d, user_id=b68648ac641c477999e3b2134f2ce5c6, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:40.179205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be573bd1-2a87-492c-a1ed-f6d025a4eb47 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:40.184080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4279d03-5d2a-45a4-807a-a103a74e66d1 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:40.198522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7554f-6dbc-4251-b786-6b19a020c91f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:40.201769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7554f-6dbc-4251-b786-6b19a020c91f service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:40.201769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7554f-6dbc-4251-b786-6b19a020c91f service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:40.201769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7554f-6dbc-4251-b786-6b19a020c91f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:40.219597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7554f-6dbc-4251-b786-6b19a020c91f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:40.219597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7554f-6dbc-4251-b786-6b19a020c91f service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:40.233821 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 927/1831] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:40.245166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7554f-6dbc-4251-b786-6b19a020c91f service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:40.245166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-21e7554f-6dbc-4251-b786-6b19a020c91f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:40.277745 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:40.283087 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 905/1832] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:40 2022] PUT /identity/v3/projects/11eef167e20b45ffb004762082d7640d/users/b68648ac641c477999e3b2134f2ce5c6/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:40.283087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be573bd1-2a87-492c-a1ed-f6d025a4eb47 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:40.295796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7554f-6dbc-4251-b786-6b19a020c91f service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:40.435753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc27c17-80e3-4fb2-8e1e-ef27319545d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:40.436744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc27c17-80e3-4fb2-8e1e-ef27319545d2 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:40.443254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be573bd1-2a87-492c-a1ed-f6d025a4eb47 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:40.443383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc27c17-80e3-4fb2-8e1e-ef27319545d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:40.443383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc27c17-80e3-4fb2-8e1e-ef27319545d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:40.443383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4cc27c17-80e3-4fb2-8e1e-ef27319545d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:40.443595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8f193-00c8-4593-9ab5-bad63a34f377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:40.444331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8f193-00c8-4593-9ab5-bad63a34f377 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:40.444721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8f193-00c8-4593-9ab5-bad63a34f377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:40.446300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8f193-00c8-4593-9ab5-bad63a34f377 admin admin] PATH_INFO: `/v3/projects/40cba74222cf4e84b957e2d152039649/users/942065a418744c7d8ff3a8f5a7676920/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:40.448705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8f193-00c8-4593-9ab5-bad63a34f377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40cba74222cf4e84b957e2d152039649, user_id=942065a418744c7d8ff3a8f5a7676920, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:40.451977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8f193-00c8-4593-9ab5-bad63a34f377 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:40.469976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc27c17-80e3-4fb2-8e1e-ef27319545d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:40.471628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc27c17-80e3-4fb2-8e1e-ef27319545d2 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:40.481731 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 906/1833] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:40 2022] PUT /identity/v3/projects/40cba74222cf4e84b957e2d152039649/users/942065a418744c7d8ff3a8f5a7676920/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:40.482985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8f193-00c8-4593-9ab5-bad63a34f377 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:40.505874 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 928/1834] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:40.507806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ea0ae-41cb-4dd0-85ce-2f243a007e85 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:40.508292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ea0ae-41cb-4dd0-85ce-2f243a007e85 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:40.519499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ea0ae-41cb-4dd0-85ce-2f243a007e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:40.538395 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:40.585242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d23ea0ae-41cb-4dd0-85ce-2f243a007e85 None None] MFA Rules not processed for user `942065a418744c7d8ff3a8f5a7676920`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:40.588835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d23ea0ae-41cb-4dd0-85ce-2f243a007e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:40.756977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8f193-00c8-4593-9ab5-bad63a34f377 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:40.771538 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 929/1835] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:40 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:40.786362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ea0ae-41cb-4dd0-85ce-2f243a007e85 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:40.798211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170edfb-7eb5-44d3-a951-ca84dc17fc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:40.799143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170edfb-7eb5-44d3-a951-ca84dc17fc52 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:40.799592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170edfb-7eb5-44d3-a951-ca84dc17fc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:40.800158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170edfb-7eb5-44d3-a951-ca84dc17fc52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:40.801175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170edfb-7eb5-44d3-a951-ca84dc17fc52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:40.803109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2170edfb-7eb5-44d3-a951-ca84dc17fc52 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:40.833918 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 907/1836] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:40.836372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6e7e6-2da0-42fc-9664-521e07892b76 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:40.842990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6e7e6-2da0-42fc-9664-521e07892b76 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:40.842990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca6e7e6-2da0-42fc-9664-521e07892b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:40.894933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7ca6e7e6-2da0-42fc-9664-521e07892b76 None None] MFA Rules not processed for user `c4a929fee10e45c8a072b778b7944ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:40.898147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7ca6e7e6-2da0-42fc-9664-521e07892b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:40.950288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ea0ae-41cb-4dd0-85ce-2f243a007e85 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:40.970822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aaac7c-b2b6-42eb-abee-40eaaa0f581e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:40.971498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aaac7c-b2b6-42eb-abee-40eaaa0f581e service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:40.971801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aaac7c-b2b6-42eb-abee-40eaaa0f581e service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:40.972059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aaac7c-b2b6-42eb-abee-40eaaa0f581e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:40.988328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aaac7c-b2b6-42eb-abee-40eaaa0f581e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:40.990183 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aaac7c-b2b6-42eb-abee-40eaaa0f581e service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:40.997736 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:41.011532 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 930/1837] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:40 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:41.012465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aaac7c-b2b6-42eb-abee-40eaaa0f581e service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:41.033965 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 908/1838] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:41.033965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6e7e6-2da0-42fc-9664-521e07892b76 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:41.033965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7ca6e7e6-2da0-42fc-9664-521e07892b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:41.044743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aaac7c-b2b6-42eb-abee-40eaaa0f581e service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:41.068145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f398b2f-907e-4a3a-a2e5-dba8650afdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:41.069301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f398b2f-907e-4a3a-a2e5-dba8650afdbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:41.069589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f398b2f-907e-4a3a-a2e5-dba8650afdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:41.069867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f398b2f-907e-4a3a-a2e5-dba8650afdbd admin admin] PATH_INFO: `/v3/projects/11eef167e20b45ffb004762082d7640d/users/b68648ac641c477999e3b2134f2ce5c6/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:41.077125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f398b2f-907e-4a3a-a2e5-dba8650afdbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=11eef167e20b45ffb004762082d7640d, user_id=b68648ac641c477999e3b2134f2ce5c6, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:41.077855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca6e7e6-2da0-42fc-9664-521e07892b76 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:41.084162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f398b2f-907e-4a3a-a2e5-dba8650afdbd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:41.131591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb76b4-d087-4b1f-ab39-232021d7a409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:41.132548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb76b4-d087-4b1f-ab39-232021d7a409 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:41.133613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb76b4-d087-4b1f-ab39-232021d7a409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:41.133878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb76b4-d087-4b1f-ab39-232021d7a409 admin admin] PATH_INFO: `/v3/projects/4ca5e336e623490f8bed74e820e03198` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:41.143880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb76b4-d087-4b1f-ab39-232021d7a409 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ca5e336e623490f8bed74e820e03198)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:41.152402 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 931/1839] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:41 2022] PUT /identity/v3/projects/11eef167e20b45ffb004762082d7640d/users/b68648ac641c477999e3b2134f2ce5c6/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:41.153704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb76b4-d087-4b1f-ab39-232021d7a409 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:41.170555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5ea07-f20b-4ee5-aec7-1758e33cbea3 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:41.171419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5ea07-f20b-4ee5-aec7-1758e33cbea3 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:41.173822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5ea07-f20b-4ee5-aec7-1758e33cbea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:41.274171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-bad5ea07-f20b-4ee5-aec7-1758e33cbea3 None None] MFA Rules not processed for user `b68648ac641c477999e3b2134f2ce5c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:41.287122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bad5ea07-f20b-4ee5-aec7-1758e33cbea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:41.359648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cddb76b4-d087-4b1f-ab39-232021d7a409 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ca5e336e623490f8bed74e820e03198', 'request_id': 'req-cddb76b4-d087-4b1f-ab39-232021d7a409'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:41.472296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cddb76b4-d087-4b1f-ab39-232021d7a409 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ca5e336e623490f8bed74e820e03198', 'request_id': 'req-cddb76b4-d087-4b1f-ab39-232021d7a409'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:41.481859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cddb76b4-d087-4b1f-ab39-232021d7a409 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ca5e336e623490f8bed74e820e03198', 'request_id': 'req-cddb76b4-d087-4b1f-ab39-232021d7a409'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:41.487940 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 932/1840] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:41.509234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cddb76b4-d087-4b1f-ab39-232021d7a409 admin admin] The token cache is being invalidate because project 4ca5e336e623490f8bed74e820e03198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:41.509534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cddb76b4-d087-4b1f-ab39-232021d7a409 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:41.510371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cddb76b4-d087-4b1f-ab39-232021d7a409 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:41.515124 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 909/1841] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:41 2022] DELETE /identity/v3/projects/4ca5e336e623490f8bed74e820e03198 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:41.523037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59086c08-1ff7-4e7a-8209-8ad39533cde9 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:41.524244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59086c08-1ff7-4e7a-8209-8ad39533cde9 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:41.524764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59086c08-1ff7-4e7a-8209-8ad39533cde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:41.550220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-59086c08-1ff7-4e7a-8209-8ad39533cde9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:41.552324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-59086c08-1ff7-4e7a-8209-8ad39533cde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:41.680578 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 933/1842] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:41.689855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5a40a-73d6-489a-a956-88a216218aa6 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:41.690402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5a40a-73d6-489a-a956-88a216218aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:41.690740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5a40a-73d6-489a-a956-88a216218aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:41.718224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-81c5a40a-73d6-489a-a956-88a216218aa6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:41.719782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-81c5a40a-73d6-489a-a956-88a216218aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:41.740861 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 910/1843] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:41.745506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59086c08-1ff7-4e7a-8209-8ad39533cde9 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:41.758373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59086c08-1ff7-4e7a-8209-8ad39533cde9 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:41.765094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20dd7e-38f8-4599-b5da-f83f577ca7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:41.765905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20dd7e-38f8-4599-b5da-f83f577ca7bd admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:41.766423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20dd7e-38f8-4599-b5da-f83f577ca7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:41.766736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20dd7e-38f8-4599-b5da-f83f577ca7bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:41.767581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20dd7e-38f8-4599-b5da-f83f577ca7bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:11:41.768116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20dd7e-38f8-4599-b5da-f83f577ca7bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:41.769916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20dd7e-38f8-4599-b5da-f83f577ca7bd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:41.806133 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 934/1844] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:11:41.810841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5a40a-73d6-489a-a956-88a216218aa6 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:41.835123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5a40a-73d6-489a-a956-88a216218aa6 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:41.850918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ed53e-0fc8-490a-a168-adc0c8b280af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:41.853581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ed53e-0fc8-490a-a168-adc0c8b280af admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:41.853986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ed53e-0fc8-490a-a168-adc0c8b280af admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:41.857900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ed53e-0fc8-490a-a168-adc0c8b280af admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:41.858800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ed53e-0fc8-490a-a168-adc0c8b280af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:41.868130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ed53e-0fc8-490a-a168-adc0c8b280af admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:42.002943 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 911/1845] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:41 2022] POST /identity/v3/projects => generated 393 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:42.006803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20dd7e-38f8-4599-b5da-f83f577ca7bd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:42.031969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ed53e-0fc8-490a-a168-adc0c8b280af admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:42.034300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e43ed53e-0fc8-490a-a168-adc0c8b280af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:42.038353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20dd7e-38f8-4599-b5da-f83f577ca7bd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:42.120961 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:42.132418 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:42.144358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a50a2-d144-49ab-b526-a188b7148116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:42.145071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a50a2-d144-49ab-b526-a188b7148116 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:42.145361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a50a2-d144-49ab-b526-a188b7148116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:42.146175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a50a2-d144-49ab-b526-a188b7148116 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:42.146914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a50a2-d144-49ab-b526-a188b7148116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:42.152531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48a50a2-d144-49ab-b526-a188b7148116 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:42.238621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ed53e-0fc8-490a-a168-adc0c8b280af admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:42.244051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65482bfc-6e0e-4169-85c5-0950698fa0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:42.245814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65482bfc-6e0e-4169-85c5-0950698fa0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:42.245814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65482bfc-6e0e-4169-85c5-0950698fa0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:42.245814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65482bfc-6e0e-4169-85c5-0950698fa0eb admin admin] PATH_INFO: `/v3/projects/b7871440e2744ce1875634afcd573fe5` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:42.246999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65482bfc-6e0e-4169-85c5-0950698fa0eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7871440e2744ce1875634afcd573fe5)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:42.248923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65482bfc-6e0e-4169-85c5-0950698fa0eb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:42.280509 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 935/1846] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:42 2022] POST /identity/v3/users => generated 297 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:42.281881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1ab5b-cdcc-47e5-ae75-b6e68ef83f71 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:42.283297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1ab5b-cdcc-47e5-ae75-b6e68ef83f71 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:42.283297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1ab5b-cdcc-47e5-ae75-b6e68ef83f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:42.330791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-21e1ab5b-cdcc-47e5-ae75-b6e68ef83f71 None None] MFA Rules not processed for user `e997b70d7158446daa1dfa225eb7afca`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:42.332669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-21e1ab5b-cdcc-47e5-ae75-b6e68ef83f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:42.406033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-65482bfc-6e0e-4169-85c5-0950698fa0eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7871440e2744ce1875634afcd573fe5', 'request_id': 'req-65482bfc-6e0e-4169-85c5-0950698fa0eb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:42.409138 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 936/1847] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:11:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:42.410143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1ab5b-cdcc-47e5-ae75-b6e68ef83f71 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:42.411569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-21e1ab5b-cdcc-47e5-ae75-b6e68ef83f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:42.519674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-65482bfc-6e0e-4169-85c5-0950698fa0eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7871440e2744ce1875634afcd573fe5', 'request_id': 'req-65482bfc-6e0e-4169-85c5-0950698fa0eb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:42.539493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-65482bfc-6e0e-4169-85c5-0950698fa0eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7871440e2744ce1875634afcd573fe5', 'request_id': 'req-65482bfc-6e0e-4169-85c5-0950698fa0eb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:42.558802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-65482bfc-6e0e-4169-85c5-0950698fa0eb admin admin] The token cache is being invalidate because project b7871440e2744ce1875634afcd573fe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:42.559094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-65482bfc-6e0e-4169-85c5-0950698fa0eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:42.559764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-65482bfc-6e0e-4169-85c5-0950698fa0eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:42.561691 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 912/1848] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:42 2022] DELETE /identity/v3/projects/b7871440e2744ce1875634afcd573fe5 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:42.565156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65482bfc-6e0e-4169-85c5-0950698fa0eb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:42.565885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1ab5b-cdcc-47e5-ae75-b6e68ef83f71 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:42.566599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-65482bfc-6e0e-4169-85c5-0950698fa0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:42.660537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65482bfc-6e0e-4169-85c5-0950698fa0eb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:42.669713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3231d-5506-4081-8c9b-c28bf273dbac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:42.670414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3231d-5506-4081-8c9b-c28bf273dbac service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:42.670603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3231d-5506-4081-8c9b-c28bf273dbac service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:42.670897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3231d-5506-4081-8c9b-c28bf273dbac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:42.672934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-81a3231d-5506-4081-8c9b-c28bf273dbac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:42.677918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7716786-59b5-4fb4-8ef0-e2441ec120aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:42.678674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7716786-59b5-4fb4-8ef0-e2441ec120aa admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:42.678964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7716786-59b5-4fb4-8ef0-e2441ec120aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:42.679249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7716786-59b5-4fb4-8ef0-e2441ec120aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:42.680040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7716786-59b5-4fb4-8ef0-e2441ec120aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:42.681830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7716786-59b5-4fb4-8ef0-e2441ec120aa admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:42.695992 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 913/1849] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:42.695992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7716786-59b5-4fb4-8ef0-e2441ec120aa admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:42.698480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a7716786-59b5-4fb4-8ef0-e2441ec120aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:42.752418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3231d-5506-4081-8c9b-c28bf273dbac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:42.755238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a3231d-5506-4081-8c9b-c28bf273dbac service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:42.761802 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:42.771998 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 937/1850] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:42.773562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3231d-5506-4081-8c9b-c28bf273dbac service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:42.775746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-81a3231d-5506-4081-8c9b-c28bf273dbac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:42.785405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7716786-59b5-4fb4-8ef0-e2441ec120aa admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:42.792862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3231d-5506-4081-8c9b-c28bf273dbac service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:42.796404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5315839-0441-49aa-8e0b-6cb6f7589dd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:42.797097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5315839-0441-49aa-8e0b-6cb6f7589dd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:42.797452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5315839-0441-49aa-8e0b-6cb6f7589dd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:42.797735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5315839-0441-49aa-8e0b-6cb6f7589dd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:42.798061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ab25b-f984-4e87-827f-843432a99388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:42.799066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ab25b-f984-4e87-827f-843432a99388 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:42.799385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ab25b-f984-4e87-827f-843432a99388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:42.799667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ab25b-f984-4e87-827f-843432a99388 admin admin] PATH_INFO: `/v3/users/c8ea4d8dba9b4ebc96a9fccfbca30353` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:42.801275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ab25b-f984-4e87-827f-843432a99388 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ea4d8dba9b4ebc96a9fccfbca30353)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:42.803379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ab25b-f984-4e87-827f-843432a99388 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:42.805153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c5315839-0441-49aa-8e0b-6cb6f7589dd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:42.818430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5315839-0441-49aa-8e0b-6cb6f7589dd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:42.826784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5315839-0441-49aa-8e0b-6cb6f7589dd7 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:42.850963 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 914/1851] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:42.852300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5315839-0441-49aa-8e0b-6cb6f7589dd7 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:42.864892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5315839-0441-49aa-8e0b-6cb6f7589dd7 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:42.870547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142fe56-0aa0-4d7f-a2ab-a3e3cb589b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:42.871278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142fe56-0aa0-4d7f-a2ab-a3e3cb589b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:42.871622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142fe56-0aa0-4d7f-a2ab-a3e3cb589b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:42.871910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142fe56-0aa0-4d7f-a2ab-a3e3cb589b63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:42.872842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142fe56-0aa0-4d7f-a2ab-a3e3cb589b63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:42.874649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142fe56-0aa0-4d7f-a2ab-a3e3cb589b63 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:42.888617 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 915/1852] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:42.893218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142fe56-0aa0-4d7f-a2ab-a3e3cb589b63 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:42.906524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142fe56-0aa0-4d7f-a2ab-a3e3cb589b63 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:42.921961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9655d-bd5a-4ad0-88b8-0637a18282fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:42.922708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9655d-bd5a-4ad0-88b8-0637a18282fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:42.923056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9655d-bd5a-4ad0-88b8-0637a18282fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:42.923344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9655d-bd5a-4ad0-88b8-0637a18282fd admin admin] PATH_INFO: `/v3/projects/b767cc23f21c4fc29c82b36fd1fe71e6/users/5e2f0fe975724ef48437acd0cd5780d7/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:42.951841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9655d-bd5a-4ad0-88b8-0637a18282fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b767cc23f21c4fc29c82b36fd1fe71e6, user_id=5e2f0fe975724ef48437acd0cd5780d7, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:42.954647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9655d-bd5a-4ad0-88b8-0637a18282fd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:43.045333 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 916/1853] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:42 2022] PUT /identity/v3/projects/b767cc23f21c4fc29c82b36fd1fe71e6/users/5e2f0fe975724ef48437acd0cd5780d7/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:11:43.046242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9655d-bd5a-4ad0-88b8-0637a18282fd admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:43.047182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c84ab25b-f984-4e87-827f-843432a99388 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ea4d8dba9b4ebc96a9fccfbca30353'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:43.052406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-33e9655d-bd5a-4ad0-88b8-0637a18282fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:43.068862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c84ab25b-f984-4e87-827f-843432a99388 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ea4d8dba9b4ebc96a9fccfbca30353'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:43.095356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c84ab25b-f984-4e87-827f-843432a99388 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ea4d8dba9b4ebc96a9fccfbca30353'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:43.096575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c84ab25b-f984-4e87-827f-843432a99388 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ea4d8dba9b4ebc96a9fccfbca30353'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:43.204719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c84ab25b-f984-4e87-827f-843432a99388 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ea4d8dba9b4ebc96a9fccfbca30353'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:43.218184 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 938/1854] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:42 2022] DELETE /identity/v3/users/c8ea4d8dba9b4ebc96a9fccfbca30353 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:43.219707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d855f-3579-4215-a98f-c04aaa763a4d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:43.220004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d855f-3579-4215-a98f-c04aaa763a4d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:43.220285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d855f-3579-4215-a98f-c04aaa763a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:43.223172 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:43.258192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9655d-bd5a-4ad0-88b8-0637a18282fd admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:43.285608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-774d855f-3579-4215-a98f-c04aaa763a4d None None] MFA Rules not processed for user `5e2f0fe975724ef48437acd0cd5780d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:43.290632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-774d855f-3579-4215-a98f-c04aaa763a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:43.407343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e07b6-18bd-4e03-8bb6-bfbaf69b75f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:43.408336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e07b6-18bd-4e03-8bb6-bfbaf69b75f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:43.409783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e07b6-18bd-4e03-8bb6-bfbaf69b75f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:43.410303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e07b6-18bd-4e03-8bb6-bfbaf69b75f2 admin admin] PATH_INFO: `/v3/users/4b0ed05d4daf4d2a93f8fe5b03ab5873` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:43.411777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e07b6-18bd-4e03-8bb6-bfbaf69b75f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b0ed05d4daf4d2a93f8fe5b03ab5873)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:43.415566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e07b6-18bd-4e03-8bb6-bfbaf69b75f2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:43.431433 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 939/1855] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:43.436983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d855f-3579-4215-a98f-c04aaa763a4d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:43.440673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-774d855f-3579-4215-a98f-c04aaa763a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:43.545162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d855f-3579-4215-a98f-c04aaa763a4d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:43.558851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e7c0d-be96-4205-bf85-dea8b6a51aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:43.559615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e7c0d-be96-4205-bf85-dea8b6a51aba admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:43.559908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e7c0d-be96-4205-bf85-dea8b6a51aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:43.560191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99e7c0d-be96-4205-bf85-dea8b6a51aba admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:43.563094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e7c0d-be96-4205-bf85-dea8b6a51aba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:43.581046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99e7c0d-be96-4205-bf85-dea8b6a51aba admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:43.641610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e54e07b6-18bd-4e03-8bb6-bfbaf69b75f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b0ed05d4daf4d2a93f8fe5b03ab5873'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:43.677654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e54e07b6-18bd-4e03-8bb6-bfbaf69b75f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b0ed05d4daf4d2a93f8fe5b03ab5873'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:43.678847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e54e07b6-18bd-4e03-8bb6-bfbaf69b75f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b0ed05d4daf4d2a93f8fe5b03ab5873'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:43.682653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e54e07b6-18bd-4e03-8bb6-bfbaf69b75f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b0ed05d4daf4d2a93f8fe5b03ab5873'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:43.712001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e54e07b6-18bd-4e03-8bb6-bfbaf69b75f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b0ed05d4daf4d2a93f8fe5b03ab5873'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:43.723128 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 940/1856] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:43 2022] POST /identity/v3/projects => generated 393 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:43.736839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e7c0d-be96-4205-bf85-dea8b6a51aba admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:43.741301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d99e7c0d-be96-4205-bf85-dea8b6a51aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:43.762623 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:43.807127 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 917/1857] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:43 2022] DELETE /identity/v3/users/4b0ed05d4daf4d2a93f8fe5b03ab5873 => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:43.808327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1a6ab-8f94-4f72-bb34-cd407b9ec340 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:43.810669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1a6ab-8f94-4f72-bb34-cd407b9ec340 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:43.810891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e1a6ab-8f94-4f72-bb34-cd407b9ec340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:43.848942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99e7c0d-be96-4205-bf85-dea8b6a51aba admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:43.869734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-24e1a6ab-8f94-4f72-bb34-cd407b9ec340 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:43.873005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-24e1a6ab-8f94-4f72-bb34-cd407b9ec340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:43.944850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa76fb-49b2-46b0-bb22-b05dbb3a606a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:43.956445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa76fb-49b2-46b0-bb22-b05dbb3a606a admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:43.956713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa76fb-49b2-46b0-bb22-b05dbb3a606a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:43.958029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aa76fb-49b2-46b0-bb22-b05dbb3a606a admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:43.958833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa76fb-49b2-46b0-bb22-b05dbb3a606a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:43.962313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aa76fb-49b2-46b0-bb22-b05dbb3a606a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:44.041389 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 918/1858] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:44.054948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1a6ab-8f94-4f72-bb34-cd407b9ec340 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:44.057370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-24e1a6ab-8f94-4f72-bb34-cd407b9ec340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:44.086257 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 941/1859] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:43 2022] POST /identity/v3/users => generated 303 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:44.087465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa76fb-49b2-46b0-bb22-b05dbb3a606a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:44.091079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-37aa76fb-49b2-46b0-bb22-b05dbb3a606a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:44.102049 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:44.132424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aa76fb-49b2-46b0-bb22-b05dbb3a606a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:44.150963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb5c76-3a80-4eee-90d6-2e8692a51480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:44.151864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb5c76-3a80-4eee-90d6-2e8692a51480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:44.152154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb5c76-3a80-4eee-90d6-2e8692a51480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:44.152434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb5c76-3a80-4eee-90d6-2e8692a51480 admin admin] PATH_INFO: `/v3/projects/5efd8e69843149baafb970ead6c1ce25` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:44.162679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb5c76-3a80-4eee-90d6-2e8692a51480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5efd8e69843149baafb970ead6c1ce25)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:44.166353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb5c76-3a80-4eee-90d6-2e8692a51480 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:44.200004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e1a6ab-8f94-4f72-bb34-cd407b9ec340 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:44.212334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640d4ba-99f3-4135-951e-e536a461c855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:44.213389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640d4ba-99f3-4135-951e-e536a461c855 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:44.214151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640d4ba-99f3-4135-951e-e536a461c855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:44.214292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640d4ba-99f3-4135-951e-e536a461c855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:44.228390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640d4ba-99f3-4135-951e-e536a461c855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:44.230035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640d4ba-99f3-4135-951e-e536a461c855 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:44.242052 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 919/1860] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:44.243565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640d4ba-99f3-4135-951e-e536a461c855 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:44.256930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640d4ba-99f3-4135-951e-e536a461c855 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:44.263908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46404a30-8911-4fa5-9932-b67e5dfca50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:44.264486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46404a30-8911-4fa5-9932-b67e5dfca50f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:44.264868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46404a30-8911-4fa5-9932-b67e5dfca50f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:44.265157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46404a30-8911-4fa5-9932-b67e5dfca50f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:44.266896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46404a30-8911-4fa5-9932-b67e5dfca50f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:44.269504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46404a30-8911-4fa5-9932-b67e5dfca50f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:44.286240 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 920/1861] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:44.286240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46404a30-8911-4fa5-9932-b67e5dfca50f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:44.286895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-46404a30-8911-4fa5-9932-b67e5dfca50f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:44.332435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46404a30-8911-4fa5-9932-b67e5dfca50f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:44.348287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ccfb5c76-3a80-4eee-90d6-2e8692a51480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5efd8e69843149baafb970ead6c1ce25', 'request_id': 'req-ccfb5c76-3a80-4eee-90d6-2e8692a51480'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:44.362727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ccfb5c76-3a80-4eee-90d6-2e8692a51480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5efd8e69843149baafb970ead6c1ce25', 'request_id': 'req-ccfb5c76-3a80-4eee-90d6-2e8692a51480'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:44.383362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ccfb5c76-3a80-4eee-90d6-2e8692a51480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5efd8e69843149baafb970ead6c1ce25', 'request_id': 'req-ccfb5c76-3a80-4eee-90d6-2e8692a51480'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:44.425227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f7250-dfe2-4103-b4c8-89611685263a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:44.426230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f7250-dfe2-4103-b4c8-89611685263a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:44.426519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f7250-dfe2-4103-b4c8-89611685263a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:44.426926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f7250-dfe2-4103-b4c8-89611685263a admin admin] PATH_INFO: `/v3/users/36069205be03434d84c287145b69dd1a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:44.428159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f7250-dfe2-4103-b4c8-89611685263a admin admin] RBAC: Authorizing `identity:delete_user(user_id=36069205be03434d84c287145b69dd1a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:44.430697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289f7250-dfe2-4103-b4c8-89611685263a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:44.521862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ccfb5c76-3a80-4eee-90d6-2e8692a51480 admin admin] The token cache is being invalidate because project 5efd8e69843149baafb970ead6c1ce25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:44.524047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ccfb5c76-3a80-4eee-90d6-2e8692a51480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:44.527114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ccfb5c76-3a80-4eee-90d6-2e8692a51480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:44.533646 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 942/1862] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:44 2022] DELETE /identity/v3/projects/5efd8e69843149baafb970ead6c1ce25 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:44.540270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb5c76-3a80-4eee-90d6-2e8692a51480 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:44.559145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ccfb5c76-3a80-4eee-90d6-2e8692a51480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:44.587155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb5c76-3a80-4eee-90d6-2e8692a51480 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:44.593392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ca4e2-be2d-4994-962c-183ea26360c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:44.594375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ca4e2-be2d-4994-962c-183ea26360c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:44.594804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ca4e2-be2d-4994-962c-183ea26360c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:44.595190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ca4e2-be2d-4994-962c-183ea26360c1 admin admin] PATH_INFO: `/v3/projects/6c36ff897dd64324818ffe555d366b17/users/9a33451759db406e96f5db1d8b9adba3/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:44.616034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ca4e2-be2d-4994-962c-183ea26360c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c36ff897dd64324818ffe555d366b17, user_id=9a33451759db406e96f5db1d8b9adba3, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:44.620741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ca4e2-be2d-4994-962c-183ea26360c1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:44.722393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-289f7250-dfe2-4103-b4c8-89611685263a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36069205be03434d84c287145b69dd1a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:44.726827 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 943/1863] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:44 2022] PUT /identity/v3/projects/6c36ff897dd64324818ffe555d366b17/users/9a33451759db406e96f5db1d8b9adba3/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:44.727683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dd7f9-3f70-4c1e-aa85-801eeb2663b8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:44.727997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dd7f9-3f70-4c1e-aa85-801eeb2663b8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:44.728244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414dd7f9-3f70-4c1e-aa85-801eeb2663b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:44.736874 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:44.741252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-289f7250-dfe2-4103-b4c8-89611685263a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36069205be03434d84c287145b69dd1a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:44.743026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-289f7250-dfe2-4103-b4c8-89611685263a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36069205be03434d84c287145b69dd1a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:44.750028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-289f7250-dfe2-4103-b4c8-89611685263a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36069205be03434d84c287145b69dd1a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:44.759840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-289f7250-dfe2-4103-b4c8-89611685263a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36069205be03434d84c287145b69dd1a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:44.761394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-414dd7f9-3f70-4c1e-aa85-801eeb2663b8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:44.762728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-414dd7f9-3f70-4c1e-aa85-801eeb2663b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:44.851081 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 921/1864] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:44 2022] DELETE /identity/v3/users/36069205be03434d84c287145b69dd1a => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:44.851081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f7250-dfe2-4103-b4c8-89611685263a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:44.851081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-289f7250-dfe2-4103-b4c8-89611685263a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:44.892105 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 944/1865] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:44.893722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514d439-dfb4-4840-a2d6-3e667713a5a0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:44.894082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514d439-dfb4-4840-a2d6-3e667713a5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:44.894453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514d439-dfb4-4840-a2d6-3e667713a5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:44.915300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9514d439-dfb4-4840-a2d6-3e667713a5a0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:44.916858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9514d439-dfb4-4840-a2d6-3e667713a5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:44.946776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f7250-dfe2-4103-b4c8-89611685263a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:44.956379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad6a93-7e59-44f9-aafc-8fdff677957c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:44.957646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad6a93-7e59-44f9-aafc-8fdff677957c admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:44.957944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad6a93-7e59-44f9-aafc-8fdff677957c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:44.958238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad6a93-7e59-44f9-aafc-8fdff677957c admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:44.959220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad6a93-7e59-44f9-aafc-8fdff677957c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:44.961730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad6a93-7e59-44f9-aafc-8fdff677957c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:44.976241 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 922/1866] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:44.978766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc57c97-31c5-40cd-aae1-b4efde4febcb None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:44.979490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc57c97-31c5-40cd-aae1-b4efde4febcb None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:44.980934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc57c97-31c5-40cd-aae1-b4efde4febcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:45.042662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-adc57c97-31c5-40cd-aae1-b4efde4febcb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:45.046344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-adc57c97-31c5-40cd-aae1-b4efde4febcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:45.067603 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 923/1867] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:45.069659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc57c97-31c5-40cd-aae1-b4efde4febcb None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:45.072486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-adc57c97-31c5-40cd-aae1-b4efde4febcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:45.087077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc57c97-31c5-40cd-aae1-b4efde4febcb None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:45.099293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8c925-3f60-4df7-8c5f-2325bf31ebda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:45.100681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8c925-3f60-4df7-8c5f-2325bf31ebda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:45.101190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8c925-3f60-4df7-8c5f-2325bf31ebda admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:45.101747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8c925-3f60-4df7-8c5f-2325bf31ebda admin admin] PATH_INFO: `/v3/projects/b72d0b3424de45c2a20069951b0e742e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:45.103640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8c925-3f60-4df7-8c5f-2325bf31ebda admin admin] RBAC: Authorizing `identity:delete_project(project_id=b72d0b3424de45c2a20069951b0e742e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:45.106162 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 945/1868] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:45.107082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514d439-dfb4-4840-a2d6-3e667713a5a0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:45.107488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f8c925-3f60-4df7-8c5f-2325bf31ebda admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:45.149587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514d439-dfb4-4840-a2d6-3e667713a5a0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:45.165826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ab99c-ac19-41b4-b0d8-80cfd292aab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:45.167716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ab99c-ac19-41b4-b0d8-80cfd292aab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:45.168454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ab99c-ac19-41b4-b0d8-80cfd292aab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:45.169101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ab99c-ac19-41b4-b0d8-80cfd292aab8 admin admin] PATH_INFO: `/v3/projects/6c36ff897dd64324818ffe555d366b17/users/9a33451759db406e96f5db1d8b9adba3/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:45.172241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ab99c-ac19-41b4-b0d8-80cfd292aab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c36ff897dd64324818ffe555d366b17, user_id=9a33451759db406e96f5db1d8b9adba3, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:45.176484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ab99c-ac19-41b4-b0d8-80cfd292aab8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:45.199186 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 946/1869] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:45 2022] PUT /identity/v3/projects/6c36ff897dd64324818ffe555d366b17/users/9a33451759db406e96f5db1d8b9adba3/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:45.200892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ab99c-ac19-41b4-b0d8-80cfd292aab8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:45.243592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-20f8c925-3f60-4df7-8c5f-2325bf31ebda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b72d0b3424de45c2a20069951b0e742e', 'request_id': 'req-20f8c925-3f60-4df7-8c5f-2325bf31ebda'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:45.311363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-20f8c925-3f60-4df7-8c5f-2325bf31ebda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b72d0b3424de45c2a20069951b0e742e', 'request_id': 'req-20f8c925-3f60-4df7-8c5f-2325bf31ebda'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:45.319600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-20f8c925-3f60-4df7-8c5f-2325bf31ebda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b72d0b3424de45c2a20069951b0e742e', 'request_id': 'req-20f8c925-3f60-4df7-8c5f-2325bf31ebda'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:45.332874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-20f8c925-3f60-4df7-8c5f-2325bf31ebda admin admin] The token cache is being invalidate because project b72d0b3424de45c2a20069951b0e742e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:45.333292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-20f8c925-3f60-4df7-8c5f-2325bf31ebda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:45.343056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-20f8c925-3f60-4df7-8c5f-2325bf31ebda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:45.343191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ab99c-ac19-41b4-b0d8-80cfd292aab8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:45.343308 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 924/1870] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:45 2022] DELETE /identity/v3/projects/b72d0b3424de45c2a20069951b0e742e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:45.343308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8c925-3f60-4df7-8c5f-2325bf31ebda admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:45.343308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-20f8c925-3f60-4df7-8c5f-2325bf31ebda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:45.392033 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:45.412796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503b40a-cf4f-431f-869b-13746b281278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:45.413868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503b40a-cf4f-431f-869b-13746b281278 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:45.415617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503b40a-cf4f-431f-869b-13746b281278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:45.416038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503b40a-cf4f-431f-869b-13746b281278 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:45.417131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503b40a-cf4f-431f-869b-13746b281278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:11:45.417731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503b40a-cf4f-431f-869b-13746b281278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:45.420982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503b40a-cf4f-431f-869b-13746b281278 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:45.426223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8c925-3f60-4df7-8c5f-2325bf31ebda admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:45.430915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f805fdb6-1375-4cc2-a6a0-7f96e2cf0341 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:45.431065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805fdb6-1375-4cc2-a6a0-7f96e2cf0341 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:45.431350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805fdb6-1375-4cc2-a6a0-7f96e2cf0341 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:45.431635 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f805fdb6-1375-4cc2-a6a0-7f96e2cf0341 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:45.433651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f805fdb6-1375-4cc2-a6a0-7f96e2cf0341 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:45.458077 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 947/1871] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:45.458077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36667f-8dc0-4a06-a7fb-19dc5049f977 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:45.458077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36667f-8dc0-4a06-a7fb-19dc5049f977 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:45.458077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36667f-8dc0-4a06-a7fb-19dc5049f977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:45.460026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805fdb6-1375-4cc2-a6a0-7f96e2cf0341 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:45.461944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f805fdb6-1375-4cc2-a6a0-7f96e2cf0341 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:45.482967 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 925/1872] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:45.488955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55535534-6057-45a7-b587-207a2df63c63 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:45.488955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55535534-6057-45a7-b587-207a2df63c63 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:45.488955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55535534-6057-45a7-b587-207a2df63c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:45.498711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3a36667f-8dc0-4a06-a7fb-19dc5049f977 None None] MFA Rules not processed for user `9a33451759db406e96f5db1d8b9adba3`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:45.500482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3a36667f-8dc0-4a06-a7fb-19dc5049f977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:45.536840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-55535534-6057-45a7-b587-207a2df63c63 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:45.538376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-55535534-6057-45a7-b587-207a2df63c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:45.667749 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 948/1873] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:45.668804 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 926/1874] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:11:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:45.669774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55535534-6057-45a7-b587-207a2df63c63 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:45.672215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-55535534-6057-45a7-b587-207a2df63c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:45.676477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36667f-8dc0-4a06-a7fb-19dc5049f977 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:45.678023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3a36667f-8dc0-4a06-a7fb-19dc5049f977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:45.700137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36667f-8dc0-4a06-a7fb-19dc5049f977 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:45.701082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55535534-6057-45a7-b587-207a2df63c63 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:45.705700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ae0b4-f4a3-4e3b-9c29-8ed4da4588df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:45.706819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ae0b4-f4a3-4e3b-9c29-8ed4da4588df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:45.707205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ae0b4-f4a3-4e3b-9c29-8ed4da4588df admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:45.707998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938ae0b4-f4a3-4e3b-9c29-8ed4da4588df admin admin] PATH_INFO: `/v3/users/942065a418744c7d8ff3a8f5a7676920` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:45.714450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f11aa6-3797-4c01-815d-cc839601f2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:45.715225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f11aa6-3797-4c01-815d-cc839601f2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:45.715498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f11aa6-3797-4c01-815d-cc839601f2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:45.715640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ae0b4-f4a3-4e3b-9c29-8ed4da4588df admin admin] RBAC: Authorizing `identity:delete_user(user_id=942065a418744c7d8ff3a8f5a7676920)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:45.718262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938ae0b4-f4a3-4e3b-9c29-8ed4da4588df admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:45.720556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f11aa6-3797-4c01-815d-cc839601f2a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:45.720556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f11aa6-3797-4c01-815d-cc839601f2a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:45.725993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f11aa6-3797-4c01-815d-cc839601f2a3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:45.861050 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 927/1875] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:45 2022] POST /identity/v3/projects => generated 411 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:45.862021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f11aa6-3797-4c01-815d-cc839601f2a3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:45.867628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-79f11aa6-3797-4c01-815d-cc839601f2a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:46.002840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-938ae0b4-f4a3-4e3b-9c29-8ed4da4588df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '942065a418744c7d8ff3a8f5a7676920'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:46.025958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f11aa6-3797-4c01-815d-cc839601f2a3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:46.031409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-938ae0b4-f4a3-4e3b-9c29-8ed4da4588df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '942065a418744c7d8ff3a8f5a7676920'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:46.042930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-938ae0b4-f4a3-4e3b-9c29-8ed4da4588df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '942065a418744c7d8ff3a8f5a7676920'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:46.045303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-938ae0b4-f4a3-4e3b-9c29-8ed4da4588df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '942065a418744c7d8ff3a8f5a7676920'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:46.045600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04159af1-6885-401e-ae42-d89745a63f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:46.045951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04159af1-6885-401e-ae42-d89745a63f5f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:46.046297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04159af1-6885-401e-ae42-d89745a63f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:46.047039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04159af1-6885-401e-ae42-d89745a63f5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:46.047765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04159af1-6885-401e-ae42-d89745a63f5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:46.049891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04159af1-6885-401e-ae42-d89745a63f5f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:46.187950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-938ae0b4-f4a3-4e3b-9c29-8ed4da4588df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '942065a418744c7d8ff3a8f5a7676920'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:46.200307 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 949/1876] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:45 2022] DELETE /identity/v3/users/942065a418744c7d8ff3a8f5a7676920 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:46.202136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ae0b4-f4a3-4e3b-9c29-8ed4da4588df admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:46.204305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-938ae0b4-f4a3-4e3b-9c29-8ed4da4588df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:46.216690 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 928/1877] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:45 2022] POST /identity/v3/projects => generated 393 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:46.225120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04159af1-6885-401e-ae42-d89745a63f5f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:46.229634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-04159af1-6885-401e-ae42-d89745a63f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:46.244824 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:46.343625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938ae0b4-f4a3-4e3b-9c29-8ed4da4588df admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:46.354053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04159af1-6885-401e-ae42-d89745a63f5f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:46.361275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c040a2e-b59a-4d33-9826-b679982801c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:46.362620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c040a2e-b59a-4d33-9826-b679982801c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:46.363108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c040a2e-b59a-4d33-9826-b679982801c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:46.363531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c040a2e-b59a-4d33-9826-b679982801c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:46.364379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c040a2e-b59a-4d33-9826-b679982801c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:46.366589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c040a2e-b59a-4d33-9826-b679982801c8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:46.451559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd30b5-5b8e-43d1-9339-e4d42e0cf72c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:46.452730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd30b5-5b8e-43d1-9339-e4d42e0cf72c service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:46.453163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd30b5-5b8e-43d1-9339-e4d42e0cf72c service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:46.453594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd30b5-5b8e-43d1-9339-e4d42e0cf72c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:46.455749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0afd30b5-5b8e-43d1-9339-e4d42e0cf72c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:46.510085 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 929/1878] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:46 2022] POST /identity/v3/users => generated 306 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:46.512508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c040a2e-b59a-4d33-9826-b679982801c8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:46.516704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4c040a2e-b59a-4d33-9826-b679982801c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:46.532960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c040a2e-b59a-4d33-9826-b679982801c8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:46.540441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ac205-71ff-4352-9c96-89d4407dcfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:46.542471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ac205-71ff-4352-9c96-89d4407dcfbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:46.542869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ac205-71ff-4352-9c96-89d4407dcfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:46.543257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726ac205-71ff-4352-9c96-89d4407dcfbf admin admin] PATH_INFO: `/v3/projects/438eb708f4a544119669755db2cdba90` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:46.544713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ac205-71ff-4352-9c96-89d4407dcfbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=438eb708f4a544119669755db2cdba90)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:46.548633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726ac205-71ff-4352-9c96-89d4407dcfbf admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:46.562377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd30b5-5b8e-43d1-9339-e4d42e0cf72c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:46.564479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd30b5-5b8e-43d1-9339-e4d42e0cf72c service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:46.584511 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 950/1879] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:11:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:11:46.586239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd30b5-5b8e-43d1-9339-e4d42e0cf72c service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:46.590548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0afd30b5-5b8e-43d1-9339-e4d42e0cf72c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:46.644491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd30b5-5b8e-43d1-9339-e4d42e0cf72c service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:46.655052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e889f13-0721-4962-937d-0ee752aee405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:46.657803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e889f13-0721-4962-937d-0ee752aee405 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:46.658594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e889f13-0721-4962-937d-0ee752aee405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:46.659161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e889f13-0721-4962-937d-0ee752aee405 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:46.660873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e889f13-0721-4962-937d-0ee752aee405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:46.665708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e889f13-0721-4962-937d-0ee752aee405 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:46.671112 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:46.715708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-726ac205-71ff-4352-9c96-89d4407dcfbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '438eb708f4a544119669755db2cdba90', 'request_id': 'req-726ac205-71ff-4352-9c96-89d4407dcfbf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:46.783745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-726ac205-71ff-4352-9c96-89d4407dcfbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '438eb708f4a544119669755db2cdba90', 'request_id': 'req-726ac205-71ff-4352-9c96-89d4407dcfbf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:46.794440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-726ac205-71ff-4352-9c96-89d4407dcfbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '438eb708f4a544119669755db2cdba90', 'request_id': 'req-726ac205-71ff-4352-9c96-89d4407dcfbf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:46.794709 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 951/1880] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:46 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:46.798961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e889f13-0721-4962-937d-0ee752aee405 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:46.830885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-726ac205-71ff-4352-9c96-89d4407dcfbf admin admin] The token cache is being invalidate because project 438eb708f4a544119669755db2cdba90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:46.831186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-726ac205-71ff-4352-9c96-89d4407dcfbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:46.832839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-726ac205-71ff-4352-9c96-89d4407dcfbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:46.835208 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 930/1881] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:46 2022] DELETE /identity/v3/projects/438eb708f4a544119669755db2cdba90 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:46.844706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ac205-71ff-4352-9c96-89d4407dcfbf admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:46.847634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-726ac205-71ff-4352-9c96-89d4407dcfbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:46.853415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e889f13-0721-4962-937d-0ee752aee405 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:46.936994 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:47.074034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726ac205-71ff-4352-9c96-89d4407dcfbf admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:47.083029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01a9bc-a905-4775-a870-7f70b538563d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:47.083732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01a9bc-a905-4775-a870-7f70b538563d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:47.084021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01a9bc-a905-4775-a870-7f70b538563d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:47.084303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01a9bc-a905-4775-a870-7f70b538563d admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:47.085055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01a9bc-a905-4775-a870-7f70b538563d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:47.087093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e01a9bc-a905-4775-a870-7f70b538563d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:47.092691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6a9cf-6f80-4076-8f7a-f2e4a3360fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:47.092691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6a9cf-6f80-4076-8f7a-f2e4a3360fea admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:47.092691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6a9cf-6f80-4076-8f7a-f2e4a3360fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:47.092691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6a9cf-6f80-4076-8f7a-f2e4a3360fea admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:47.096719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6a9cf-6f80-4076-8f7a-f2e4a3360fea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:47.099671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6a9cf-6f80-4076-8f7a-f2e4a3360fea admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:47.106921 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 952/1882] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:47.108002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01a9bc-a905-4775-a870-7f70b538563d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:47.113847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6e01a9bc-a905-4775-a870-7f70b538563d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:47.136385 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 931/1883] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:47.137571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6a9cf-6f80-4076-8f7a-f2e4a3360fea admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:47.143016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-63a6a9cf-6f80-4076-8f7a-f2e4a3360fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:47.173000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01a9bc-a905-4775-a870-7f70b538563d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:47.202570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6a9cf-6f80-4076-8f7a-f2e4a3360fea admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:47.202983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe9c68-a0e9-4c3d-94e2-df391ad391d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:47.203813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe9c68-a0e9-4c3d-94e2-df391ad391d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:47.204206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe9c68-a0e9-4c3d-94e2-df391ad391d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:47.204537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fe9c68-a0e9-4c3d-94e2-df391ad391d2 admin admin] PATH_INFO: `/v3/users/b68648ac641c477999e3b2134f2ce5c6` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:47.206140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe9c68-a0e9-4c3d-94e2-df391ad391d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b68648ac641c477999e3b2134f2ce5c6)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:47.208935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fe9c68-a0e9-4c3d-94e2-df391ad391d2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:47.226236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead8eac-816f-4c25-9d31-bb6ce9b0f618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:47.226236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead8eac-816f-4c25-9d31-bb6ce9b0f618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:47.233533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead8eac-816f-4c25-9d31-bb6ce9b0f618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:47.233875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aead8eac-816f-4c25-9d31-bb6ce9b0f618 admin admin] PATH_INFO: `/v3/projects/40cba74222cf4e84b957e2d152039649` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:47.241443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead8eac-816f-4c25-9d31-bb6ce9b0f618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40cba74222cf4e84b957e2d152039649)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:47.249784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aead8eac-816f-4c25-9d31-bb6ce9b0f618 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:47.456219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-aead8eac-816f-4c25-9d31-bb6ce9b0f618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40cba74222cf4e84b957e2d152039649', 'request_id': 'req-aead8eac-816f-4c25-9d31-bb6ce9b0f618'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:47.470036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f6fe9c68-a0e9-4c3d-94e2-df391ad391d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b68648ac641c477999e3b2134f2ce5c6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:47.488650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f6fe9c68-a0e9-4c3d-94e2-df391ad391d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b68648ac641c477999e3b2134f2ce5c6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:47.500438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f6fe9c68-a0e9-4c3d-94e2-df391ad391d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b68648ac641c477999e3b2134f2ce5c6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:47.501544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f6fe9c68-a0e9-4c3d-94e2-df391ad391d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b68648ac641c477999e3b2134f2ce5c6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:47.548646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-aead8eac-816f-4c25-9d31-bb6ce9b0f618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40cba74222cf4e84b957e2d152039649', 'request_id': 'req-aead8eac-816f-4c25-9d31-bb6ce9b0f618'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:47.561794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-aead8eac-816f-4c25-9d31-bb6ce9b0f618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40cba74222cf4e84b957e2d152039649', 'request_id': 'req-aead8eac-816f-4c25-9d31-bb6ce9b0f618'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:47.575505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-aead8eac-816f-4c25-9d31-bb6ce9b0f618 admin admin] The token cache is being invalidate because project 40cba74222cf4e84b957e2d152039649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:47.575832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-aead8eac-816f-4c25-9d31-bb6ce9b0f618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:47.576706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-aead8eac-816f-4c25-9d31-bb6ce9b0f618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:47.582495 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 932/1884] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:47 2022] DELETE /identity/v3/projects/40cba74222cf4e84b957e2d152039649 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:47.582495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead8eac-816f-4c25-9d31-bb6ce9b0f618 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:47.582495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aead8eac-816f-4c25-9d31-bb6ce9b0f618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:47.649752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f6fe9c68-a0e9-4c3d-94e2-df391ad391d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b68648ac641c477999e3b2134f2ce5c6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:47.658457 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 953/1885] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:47 2022] DELETE /identity/v3/users/b68648ac641c477999e3b2134f2ce5c6 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:47.659311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe9c68-a0e9-4c3d-94e2-df391ad391d2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:47.661524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f6fe9c68-a0e9-4c3d-94e2-df391ad391d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:47.662684 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:47.704894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aead8eac-816f-4c25-9d31-bb6ce9b0f618 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:47.784834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fe9c68-a0e9-4c3d-94e2-df391ad391d2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:47.793606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ce718-9df8-45f9-b19b-2c6ffca9ac73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:47.794641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ce718-9df8-45f9-b19b-2c6ffca9ac73 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:47.794824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023913c4-977e-4d2a-9b68-411c9eb93105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:47.795170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ce718-9df8-45f9-b19b-2c6ffca9ac73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:47.795526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023913c4-977e-4d2a-9b68-411c9eb93105 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:47.795631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ce718-9df8-45f9-b19b-2c6ffca9ac73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:47.795860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023913c4-977e-4d2a-9b68-411c9eb93105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:47.796145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023913c4-977e-4d2a-9b68-411c9eb93105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:47.796645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ce718-9df8-45f9-b19b-2c6ffca9ac73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:47.797284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023913c4-977e-4d2a-9b68-411c9eb93105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:47.798935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ce718-9df8-45f9-b19b-2c6ffca9ac73 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:47.799212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023913c4-977e-4d2a-9b68-411c9eb93105 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:47.814055 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 954/1886] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:47.820891 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 933/1887] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:47.821085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7ca94-cf65-4316-ab9d-ae09acaedd90 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:47.821423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7ca94-cf65-4316-ab9d-ae09acaedd90 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:47.821745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7ca94-cf65-4316-ab9d-ae09acaedd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:47.822990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ce718-9df8-45f9-b19b-2c6ffca9ac73 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:47.825822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-065ce718-9df8-45f9-b19b-2c6ffca9ac73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:47.841929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ce718-9df8-45f9-b19b-2c6ffca9ac73 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:47.848245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940db19-1521-43d1-bc73-c2498bc81010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:47.848510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-96d7ca94-cf65-4316-ab9d-ae09acaedd90 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:47.849550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940db19-1521-43d1-bc73-c2498bc81010 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:47.849881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-96d7ca94-cf65-4316-ab9d-ae09acaedd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:47.850060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940db19-1521-43d1-bc73-c2498bc81010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:47.850525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940db19-1521-43d1-bc73-c2498bc81010 admin admin] PATH_INFO: `/v3/projects/34836ece2308405999a05660d1257a72/users/764e9d4dfcc243f9909511a41f39b74d/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:47.856902 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:47.870956 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 955/1888] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:47.871966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7ca94-cf65-4316-ab9d-ae09acaedd90 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:47.883373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7ca94-cf65-4316-ab9d-ae09acaedd90 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:47.886873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940db19-1521-43d1-bc73-c2498bc81010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34836ece2308405999a05660d1257a72, user_id=764e9d4dfcc243f9909511a41f39b74d, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:47.889736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b169b3c-d16a-41ef-be97-c936a7b4dcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:47.890807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940db19-1521-43d1-bc73-c2498bc81010 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:47.890957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b169b3c-d16a-41ef-be97-c936a7b4dcee admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:47.891152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b169b3c-d16a-41ef-be97-c936a7b4dcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:47.891488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b169b3c-d16a-41ef-be97-c936a7b4dcee admin admin] PATH_INFO: `/v3/projects/1cc443417b7a44a196ee01dd6af62a39/users/d64b8be958ec478fa923f7146288b0ae/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:47.915927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b169b3c-d16a-41ef-be97-c936a7b4dcee admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc443417b7a44a196ee01dd6af62a39, user_id=d64b8be958ec478fa923f7146288b0ae, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:47.918716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b169b3c-d16a-41ef-be97-c936a7b4dcee admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:47.972802 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 934/1889] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:47 2022] PUT /identity/v3/projects/34836ece2308405999a05660d1257a72/users/764e9d4dfcc243f9909511a41f39b74d/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:47.987924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d60a9-529b-45e4-ab0b-d6bb151d8597 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:47.987924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d60a9-529b-45e4-ab0b-d6bb151d8597 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:47.987924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d60a9-529b-45e4-ab0b-d6bb151d8597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:48.005721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-aa7d60a9-529b-45e4-ab0b-d6bb151d8597 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:48.007518 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 956/1890] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:47 2022] PUT /identity/v3/projects/1cc443417b7a44a196ee01dd6af62a39/users/d64b8be958ec478fa923f7146288b0ae/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:48.009546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d30ca6-8623-437b-8f1a-c1457f425ae8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:48.009838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d30ca6-8623-437b-8f1a-c1457f425ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:48.010132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d30ca6-8623-437b-8f1a-c1457f425ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:48.020515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aa7d60a9-529b-45e4-ab0b-d6bb151d8597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:48.055394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f9d30ca6-8623-437b-8f1a-c1457f425ae8 None None] MFA Rules not processed for user `764e9d4dfcc243f9909511a41f39b74d`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:48.056690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f9d30ca6-8623-437b-8f1a-c1457f425ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:48.122477 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:48.143911 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 935/1891] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:48.145329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75270a-fde5-467d-aaff-909c59ee55d8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:48.145629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75270a-fde5-467d-aaff-909c59ee55d8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:48.146011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d75270a-fde5-467d-aaff-909c59ee55d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:48.162294 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:48.169215 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 957/1892] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:48 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:48.170222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d30ca6-8623-437b-8f1a-c1457f425ae8 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:48.187240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2d75270a-fde5-467d-aaff-909c59ee55d8 None None] MFA Rules not processed for user `d64b8be958ec478fa923f7146288b0ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:48.188464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2d75270a-fde5-467d-aaff-909c59ee55d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:48.190199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d30ca6-8623-437b-8f1a-c1457f425ae8 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:48.195892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fb7be-8fe0-4fff-a517-a9268c107661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:48.196677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fb7be-8fe0-4fff-a517-a9268c107661 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:48.196945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fb7be-8fe0-4fff-a517-a9268c107661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:48.197231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fb7be-8fe0-4fff-a517-a9268c107661 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:48.198340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fb7be-8fe0-4fff-a517-a9268c107661 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:11:48.198768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fb7be-8fe0-4fff-a517-a9268c107661 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:48.201974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fb7be-8fe0-4fff-a517-a9268c107661 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:48.221199 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 958/1893] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:48.221199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fb7be-8fe0-4fff-a517-a9268c107661 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:48.238190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fb7be-8fe0-4fff-a517-a9268c107661 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:48.251727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc594f90-8728-465a-a624-57c9b19fc39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:48.252815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc594f90-8728-465a-a624-57c9b19fc39d admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:48.266071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc594f90-8728-465a-a624-57c9b19fc39d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:48.266826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc594f90-8728-465a-a624-57c9b19fc39d admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:48.269778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc594f90-8728-465a-a624-57c9b19fc39d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:48.274704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc594f90-8728-465a-a624-57c9b19fc39d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:48.296439 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 936/1894] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:48.298976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75270a-fde5-467d-aaff-909c59ee55d8 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:48.320752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d75270a-fde5-467d-aaff-909c59ee55d8 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:48.328588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a28bd-aded-4797-865c-608e2afd2739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:48.328588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a28bd-aded-4797-865c-608e2afd2739 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:48.328588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a28bd-aded-4797-865c-608e2afd2739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:48.328588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a28bd-aded-4797-865c-608e2afd2739 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:48.328921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a28bd-aded-4797-865c-608e2afd2739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:48.329519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a28bd-aded-4797-865c-608e2afd2739 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:48.389106 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 959/1895] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:48 2022] POST /identity/v3/projects => generated 411 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:48.389106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc594f90-8728-465a-a624-57c9b19fc39d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:48.389106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dc594f90-8728-465a-a624-57c9b19fc39d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:48.464275 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 937/1896] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:48 2022] POST /identity/v3/projects => generated 399 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:48.468038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a28bd-aded-4797-865c-608e2afd2739 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:48.469972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-290a28bd-aded-4797-865c-608e2afd2739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:48.502458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc594f90-8728-465a-a624-57c9b19fc39d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:48.529926 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:48.613296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a28bd-aded-4797-865c-608e2afd2739 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:48.623648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc65c2-8140-421f-9cc6-470bb685210b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:48.625545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc65c2-8140-421f-9cc6-470bb685210b service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:48.625545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc65c2-8140-421f-9cc6-470bb685210b service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:48.625545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc65c2-8140-421f-9cc6-470bb685210b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:48.627716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bcdc65c2-8140-421f-9cc6-470bb685210b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:48.630646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7df515-8fa7-4698-a44f-3713bca19096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:48.635437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7df515-8fa7-4698-a44f-3713bca19096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:48.635889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7df515-8fa7-4698-a44f-3713bca19096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:48.636582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7df515-8fa7-4698-a44f-3713bca19096 admin admin] PATH_INFO: `/v3/projects/11eef167e20b45ffb004762082d7640d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:48.639591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7df515-8fa7-4698-a44f-3713bca19096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11eef167e20b45ffb004762082d7640d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:48.641752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7df515-8fa7-4698-a44f-3713bca19096 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:48.753460 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:48.775367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc65c2-8140-421f-9cc6-470bb685210b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:48.784861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdc65c2-8140-421f-9cc6-470bb685210b service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:48.802826 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:48.814396 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 938/1897] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:48.818797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc65c2-8140-421f-9cc6-470bb685210b service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:48.823738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6f7df515-8fa7-4698-a44f-3713bca19096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11eef167e20b45ffb004762082d7640d', 'request_id': 'req-6f7df515-8fa7-4698-a44f-3713bca19096'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:48.832103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6f7df515-8fa7-4698-a44f-3713bca19096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11eef167e20b45ffb004762082d7640d', 'request_id': 'req-6f7df515-8fa7-4698-a44f-3713bca19096'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:48.843478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6f7df515-8fa7-4698-a44f-3713bca19096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11eef167e20b45ffb004762082d7640d', 'request_id': 'req-6f7df515-8fa7-4698-a44f-3713bca19096'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:48.859110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc65c2-8140-421f-9cc6-470bb685210b service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:49.026090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc0485-4314-45e0-9e89-b1264fb1f27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:49.026090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc0485-4314-45e0-9e89-b1264fb1f27d admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:49.026090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc0485-4314-45e0-9e89-b1264fb1f27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:49.026090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc0485-4314-45e0-9e89-b1264fb1f27d admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:49.026894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc0485-4314-45e0-9e89-b1264fb1f27d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:49.026894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc0485-4314-45e0-9e89-b1264fb1f27d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:49.107069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6f7df515-8fa7-4698-a44f-3713bca19096 admin admin] The token cache is being invalidate because project 11eef167e20b45ffb004762082d7640d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:49.107941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6f7df515-8fa7-4698-a44f-3713bca19096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:49.108758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6f7df515-8fa7-4698-a44f-3713bca19096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:49.110931 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 960/1898] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:48 2022] DELETE /identity/v3/projects/11eef167e20b45ffb004762082d7640d => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:49.111836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7df515-8fa7-4698-a44f-3713bca19096 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:49.113266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6f7df515-8fa7-4698-a44f-3713bca19096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:49.131892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7df515-8fa7-4698-a44f-3713bca19096 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:49.139535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f285d6d-c5f0-4671-8aa8-30de472331da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:49.140390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f285d6d-c5f0-4671-8aa8-30de472331da admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:49.140747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f285d6d-c5f0-4671-8aa8-30de472331da admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:49.141432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f285d6d-c5f0-4671-8aa8-30de472331da admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:49.142545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f285d6d-c5f0-4671-8aa8-30de472331da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:49.145745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f285d6d-c5f0-4671-8aa8-30de472331da admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:49.422831 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 939/1899] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:48 2022] POST /identity/v3/users => generated 312 bytes in 608 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:49.424238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fce80-4fc9-4fd4-b275-722af74db722 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:49.424563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fce80-4fc9-4fd4-b275-722af74db722 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:49.424844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fce80-4fc9-4fd4-b275-722af74db722 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:49.426082 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 940/1900] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:11:49.427127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cca4b6-949d-4856-a9a5-f22cf9c8d334 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:49.427469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cca4b6-949d-4856-a9a5-f22cf9c8d334 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:49.427754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cca4b6-949d-4856-a9a5-f22cf9c8d334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:49.447096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-33cca4b6-949d-4856-a9a5-f22cf9c8d334 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:49.448364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-33cca4b6-949d-4856-a9a5-f22cf9c8d334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:49.466797 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 941/1901] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:49.466797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cca4b6-949d-4856-a9a5-f22cf9c8d334 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:49.466797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-33cca4b6-949d-4856-a9a5-f22cf9c8d334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:49.479129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cca4b6-949d-4856-a9a5-f22cf9c8d334 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:49.484209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f5c4b-fd2f-452e-81e9-ed921b6504cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:49.484928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f5c4b-fd2f-452e-81e9-ed921b6504cf admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:49.485214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f5c4b-fd2f-452e-81e9-ed921b6504cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:49.485493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f5c4b-fd2f-452e-81e9-ed921b6504cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:49.486274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f5c4b-fd2f-452e-81e9-ed921b6504cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:49.487900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f5c4b-fd2f-452e-81e9-ed921b6504cf admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:49.501906 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 942/1902] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:49.501906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f5c4b-fd2f-452e-81e9-ed921b6504cf admin admin] Authenticating service token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:11:49.503927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d23f5c4b-fd2f-452e-81e9-ed921b6504cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:49.533053 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 961/1903] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:49 2022] POST /identity/v3/users => generated 300 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:49.539685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ae13c-4057-4bbe-acbe-6e3043f0dd27 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:49.539685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ae13c-4057-4bbe-acbe-6e3043f0dd27 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:49.539685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ae13c-4057-4bbe-acbe-6e3043f0dd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:49.571556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ca9ae13c-4057-4bbe-acbe-6e3043f0dd27 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:49.573032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ca9ae13c-4057-4bbe-acbe-6e3043f0dd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:49.581468 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 962/1904] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:49.588176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ae13c-4057-4bbe-acbe-6e3043f0dd27 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:49.599435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ae13c-4057-4bbe-acbe-6e3043f0dd27 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:49.600564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f5c4b-fd2f-452e-81e9-ed921b6504cf admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:49.602737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d23f5c4b-fd2f-452e-81e9-ed921b6504cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:49.606002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2e3d4-682f-4937-95d9-cf5a61baef7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:49.607107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2e3d4-682f-4937-95d9-cf5a61baef7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:49.607527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2e3d4-682f-4937-95d9-cf5a61baef7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:49.607819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2e3d4-682f-4937-95d9-cf5a61baef7a admin admin] PATH_INFO: `/v3/projects/7626a387d58e43859a808ce88b8e63df/users/eebd4e8e30e241deb6c1ce00cba06638/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:49.627157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2e3d4-682f-4937-95d9-cf5a61baef7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7626a387d58e43859a808ce88b8e63df, user_id=eebd4e8e30e241deb6c1ce00cba06638, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:49.630189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2e3d4-682f-4937-95d9-cf5a61baef7a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:49.656004 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:49.687667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f5c4b-fd2f-452e-81e9-ed921b6504cf admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:49.692522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04daf58-f095-4b6f-ab54-3eabeb721248 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a33451759db406e96f5db1d8b9adba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c36ff897dd64324818ffe555d366b17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:49.694182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04daf58-f095-4b6f-ab54-3eabeb721248 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:49.694182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04daf58-f095-4b6f-ab54-3eabeb721248 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:49.694182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04daf58-f095-4b6f-ab54-3eabeb721248 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] PATH_INFO: `/v3/projects/b767cc23f21c4fc29c82b36fd1fe71e6` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:49.697324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04daf58-f095-4b6f-ab54-3eabeb721248 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] RBAC: Authorizing `identity:get_project(project_id=b767cc23f21c4fc29c82b36fd1fe71e6)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:49.699612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04daf58-f095-4b6f-ab54-3eabeb721248 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:49.701420 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 943/1905] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:11:49 2022] GET /identity/v3/projects/b767cc23f21c4fc29c82b36fd1fe71e6 => generated 393 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:49.702231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04daf58-f095-4b6f-ab54-3eabeb721248 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:49.714247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04daf58-f095-4b6f-ab54-3eabeb721248 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:49.726936 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 963/1906] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:49 2022] PUT /identity/v3/projects/7626a387d58e43859a808ce88b8e63df/users/eebd4e8e30e241deb6c1ce00cba06638/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:49.734824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2e3d4-682f-4937-95d9-cf5a61baef7a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:49.792320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a25fe-0b93-4eed-9040-e8129bfdcb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:49.793013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a25fe-0b93-4eed-9040-e8129bfdcb29 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:49.799428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a25fe-0b93-4eed-9040-e8129bfdcb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:49.799770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040a25fe-0b93-4eed-9040-e8129bfdcb29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:49.800583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a25fe-0b93-4eed-9040-e8129bfdcb29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:49.805926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040a25fe-0b93-4eed-9040-e8129bfdcb29 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:49.841999 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 944/1907] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:49.843340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a25fe-0b93-4eed-9040-e8129bfdcb29 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:49.860102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040a25fe-0b93-4eed-9040-e8129bfdcb29 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:49.869492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2e3d4-682f-4937-95d9-cf5a61baef7a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:49.870530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1f20c-dab9-4634-b054-0805ce5ff338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:49.871455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1f20c-dab9-4634-b054-0805ce5ff338 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:49.871752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1f20c-dab9-4634-b054-0805ce5ff338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:49.872120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1f20c-dab9-4634-b054-0805ce5ff338 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:49.873106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1f20c-dab9-4634-b054-0805ce5ff338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:49.874956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1f20c-dab9-4634-b054-0805ce5ff338 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:49.881271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818a517-664b-4a43-8a4c-744922baeed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:49.882254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818a517-664b-4a43-8a4c-744922baeed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:49.883237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818a517-664b-4a43-8a4c-744922baeed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:49.884441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818a517-664b-4a43-8a4c-744922baeed5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:49.885363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818a517-664b-4a43-8a4c-744922baeed5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:11:49.885981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818a517-664b-4a43-8a4c-744922baeed5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:49.887795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818a517-664b-4a43-8a4c-744922baeed5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:49.906587 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 945/1908] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:49.906913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00334005-e537-458c-b8f5-fe1b63828ffc None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:49.907274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00334005-e537-458c-b8f5-fe1b63828ffc None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:49.907424 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 964/1909] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:49.907680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00334005-e537-458c-b8f5-fe1b63828ffc None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:49.908809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818a517-664b-4a43-8a4c-744922baeed5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:49.909196 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 946/1910] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:11:49.909970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00334005-e537-458c-b8f5-fe1b63828ffc None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:49.921757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818a517-664b-4a43-8a4c-744922baeed5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:49.927011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00334005-e537-458c-b8f5-fe1b63828ffc None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:49.927550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d988e4-ef2d-4f49-9c7a-b469ec422ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:49.928308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d988e4-ef2d-4f49-9c7a-b469ec422ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:49.928634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d988e4-ef2d-4f49-9c7a-b469ec422ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:49.928975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d988e4-ef2d-4f49-9c7a-b469ec422ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:49.930452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d988e4-ef2d-4f49-9c7a-b469ec422ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:49.932991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d988e4-ef2d-4f49-9c7a-b469ec422ce2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:49.934732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc294ae-97ab-446b-9af6-5d62f312fa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:49.935443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc294ae-97ab-446b-9af6-5d62f312fa28 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:49.935797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc294ae-97ab-446b-9af6-5d62f312fa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:49.936079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc294ae-97ab-446b-9af6-5d62f312fa28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:49.936801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc294ae-97ab-446b-9af6-5d62f312fa28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:49.938775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc294ae-97ab-446b-9af6-5d62f312fa28 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:49.949336 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 965/1911] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:49.949336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d988e4-ef2d-4f49-9c7a-b469ec422ce2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:49.964197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d988e4-ef2d-4f49-9c7a-b469ec422ce2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:49.972586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f50b1-2de2-425f-99f4-9daf7298d716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:49.973543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f50b1-2de2-425f-99f4-9daf7298d716 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:49.973868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f50b1-2de2-425f-99f4-9daf7298d716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:49.974211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f50b1-2de2-425f-99f4-9daf7298d716 admin admin] PATH_INFO: `/v3/projects/7626a387d58e43859a808ce88b8e63df/users/eebd4e8e30e241deb6c1ce00cba06638/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:49.976131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f50b1-2de2-425f-99f4-9daf7298d716 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7626a387d58e43859a808ce88b8e63df, user_id=eebd4e8e30e241deb6c1ce00cba06638, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:49.979632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f50b1-2de2-425f-99f4-9daf7298d716 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:49.993034 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 966/1912] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:49 2022] PUT /identity/v3/projects/7626a387d58e43859a808ce88b8e63df/users/eebd4e8e30e241deb6c1ce00cba06638/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:49.993920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f50b1-2de2-425f-99f4-9daf7298d716 admin admin] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:11:50.018505 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 947/1913] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:49 2022] POST /identity/v3/projects => generated 409 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:50.019631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc294ae-97ab-446b-9af6-5d62f312fa28 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:50.079478 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=5,keystone:INSERT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:50.095892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc294ae-97ab-446b-9af6-5d62f312fa28 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:50.100676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d16ec-f5fc-4f79-ad85-3b931de1cebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:50.102180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d16ec-f5fc-4f79-ad85-3b931de1cebf admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:50.102471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d16ec-f5fc-4f79-ad85-3b931de1cebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:50.102754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d16ec-f5fc-4f79-ad85-3b931de1cebf admin admin] PATH_INFO: `/v3/projects/96acf9c5dfb944478442387b79e54d51/users/647b301c1da945d7836d8f0a58c4983e/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:50.115600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f50b1-2de2-425f-99f4-9daf7298d716 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:50.120828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d16ec-f5fc-4f79-ad85-3b931de1cebf admin admin] RBAC: Authorizing `identity:create_grant(project_id=96acf9c5dfb944478442387b79e54d51, user_id=647b301c1da945d7836d8f0a58c4983e, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:50.123616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d16ec-f5fc-4f79-ad85-3b931de1cebf admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:50.181946 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 948/1914] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:50 2022] PUT /identity/v3/projects/96acf9c5dfb944478442387b79e54d51/users/647b301c1da945d7836d8f0a58c4983e/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:50.183387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c63d3-a9ba-4fff-a308-cc3f4b9d830c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:50.183627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c63d3-a9ba-4fff-a308-cc3f4b9d830c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:50.183911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c63d3-a9ba-4fff-a308-cc3f4b9d830c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:50.191486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f50b1-2de2-425f-99f4-9daf7298d716 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:50.230520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-267c63d3-a9ba-4fff-a308-cc3f4b9d830c None None] MFA Rules not processed for user `eebd4e8e30e241deb6c1ce00cba06638`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:50.232568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-267c63d3-a9ba-4fff-a308-cc3f4b9d830c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:50.243579 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:50.260080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4fe9c-54d9-42cf-8184-2c8784195c4c tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a33451759db406e96f5db1d8b9adba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c36ff897dd64324818ffe555d366b17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:50.260955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4fe9c-54d9-42cf-8184-2c8784195c4c tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:50.261246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4fe9c-54d9-42cf-8184-2c8784195c4c tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:50.261532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4fe9c-54d9-42cf-8184-2c8784195c4c tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] PATH_INFO: `/v3/projects/b767cc23f21c4fc29c82b36fd1fe71e6` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:50.262825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4fe9c-54d9-42cf-8184-2c8784195c4c tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] RBAC: Authorizing `identity:get_project(project_id=b767cc23f21c4fc29c82b36fd1fe71e6)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:50.264883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4fe9c-54d9-42cf-8184-2c8784195c4c tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:50.266721 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 967/1915] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:11:49 2022] GET /identity/v3/projects/b767cc23f21c4fc29c82b36fd1fe71e6 => generated 393 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:50.267472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4fe9c-54d9-42cf-8184-2c8784195c4c tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:50.311778 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 949/1916] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:50 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:50.313734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566163de-4da6-4ddd-bf4f-14b047309858 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:50.314041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566163de-4da6-4ddd-bf4f-14b047309858 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:50.314476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566163de-4da6-4ddd-bf4f-14b047309858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:50.356946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-566163de-4da6-4ddd-bf4f-14b047309858 None None] MFA Rules not processed for user `647b301c1da945d7836d8f0a58c4983e`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:50.356946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-566163de-4da6-4ddd-bf4f-14b047309858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:50.370799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4fe9c-54d9-42cf-8184-2c8784195c4c tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:50.376173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c5c8e-e93a-489d-a99a-a7b283f284d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:50.377038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c5c8e-e93a-489d-a99a-a7b283f284d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:50.377400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c5c8e-e93a-489d-a99a-a7b283f284d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:50.377757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c5c8e-e93a-489d-a99a-a7b283f284d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:50.378577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c5c8e-e93a-489d-a99a-a7b283f284d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:50.380609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c5c8e-e93a-489d-a99a-a7b283f284d0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:50.446398 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 950/1917] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:50.447325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566163de-4da6-4ddd-bf4f-14b047309858 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:50.448745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-566163de-4da6-4ddd-bf4f-14b047309858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:50.472475 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 968/1918] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:50 2022] POST /identity/v3/users => generated 305 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:50.476335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be085fc-6f92-431d-9f7b-c64e7f4935d5 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:50.476335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be085fc-6f92-431d-9f7b-c64e7f4935d5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:50.476335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be085fc-6f92-431d-9f7b-c64e7f4935d5 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:50.476335 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 969/1919] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:11:50.476335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be085fc-6f92-431d-9f7b-c64e7f4935d5 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:50.488395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be085fc-6f92-431d-9f7b-c64e7f4935d5 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:50.494301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5014e3-0057-4b19-88e9-5a0fb7d6851c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:50.494977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5014e3-0057-4b19-88e9-5a0fb7d6851c admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:50.495271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5014e3-0057-4b19-88e9-5a0fb7d6851c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:50.495549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5014e3-0057-4b19-88e9-5a0fb7d6851c admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:50.496246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5014e3-0057-4b19-88e9-5a0fb7d6851c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:50.498190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5014e3-0057-4b19-88e9-5a0fb7d6851c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:50.520270 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:50.536113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566163de-4da6-4ddd-bf4f-14b047309858 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:50.542052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7e15d-398c-4aa1-af02-328ba1cdcaa8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:50.542733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7e15d-398c-4aa1-af02-328ba1cdcaa8 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:50.543017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7e15d-398c-4aa1-af02-328ba1cdcaa8 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:50.543295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7e15d-398c-4aa1-af02-328ba1cdcaa8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:50.551855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7e15d-398c-4aa1-af02-328ba1cdcaa8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:50.553493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7e15d-398c-4aa1-af02-328ba1cdcaa8 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:50.565518 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 951/1920] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:50 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:50.566403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7e15d-398c-4aa1-af02-328ba1cdcaa8 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:50.578609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7e15d-398c-4aa1-af02-328ba1cdcaa8 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:50.583550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e04839-303b-40a7-85e8-a07f0688b826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:50.584232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e04839-303b-40a7-85e8-a07f0688b826 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:50.584517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e04839-303b-40a7-85e8-a07f0688b826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:50.584795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e04839-303b-40a7-85e8-a07f0688b826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:50.585545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e04839-303b-40a7-85e8-a07f0688b826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:50.587892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e04839-303b-40a7-85e8-a07f0688b826 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:50.607653 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 952/1921] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:50.607653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e04839-303b-40a7-85e8-a07f0688b826 admin admin] Authenticating service token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:11:50.615753 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 970/1922] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:50 2022] POST /identity/v3/projects => generated 397 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:50.616759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5014e3-0057-4b19-88e9-5a0fb7d6851c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:50.623529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e04839-303b-40a7-85e8-a07f0688b826 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:50.635453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e04839-303b-40a7-85e8-a07f0688b826 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:50.639294 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:50.690991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5014e3-0057-4b19-88e9-5a0fb7d6851c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:50.698266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96453a4-8896-4044-991e-c4ec9abe7dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:50.698712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96453a4-8896-4044-991e-c4ec9abe7dfb admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:50.698997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96453a4-8896-4044-991e-c4ec9abe7dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:50.699273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96453a4-8896-4044-991e-c4ec9abe7dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:50.700020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96453a4-8896-4044-991e-c4ec9abe7dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:50.701814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96453a4-8896-4044-991e-c4ec9abe7dfb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:50.713429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b29474-88dd-459d-bb38-00876d035c6a tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a33451759db406e96f5db1d8b9adba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c36ff897dd64324818ffe555d366b17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:50.714760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b29474-88dd-459d-bb38-00876d035c6a tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:50.715091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b29474-88dd-459d-bb38-00876d035c6a tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:50.715465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b29474-88dd-459d-bb38-00876d035c6a tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] PATH_INFO: `/v3/projects/b767cc23f21c4fc29c82b36fd1fe71e6` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:50.716880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b29474-88dd-459d-bb38-00876d035c6a tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] RBAC: Authorizing `identity:get_project(project_id=b767cc23f21c4fc29c82b36fd1fe71e6)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:50.719038 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 971/1923] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:50.722814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b29474-88dd-459d-bb38-00876d035c6a tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:50.724988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96453a4-8896-4044-991e-c4ec9abe7dfb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:50.727310 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 953/1924] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:11:50 2022] GET /identity/v3/projects/b767cc23f21c4fc29c82b36fd1fe71e6 => generated 393 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:50.730830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b29474-88dd-459d-bb38-00876d035c6a tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:50.734671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96453a4-8896-4044-991e-c4ec9abe7dfb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:50.739416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8a802-eb8c-41d3-984f-1b94a8224c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:50.740110 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8a802-eb8c-41d3-984f-1b94a8224c2d admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:50.740395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8a802-eb8c-41d3-984f-1b94a8224c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:50.742905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b8a802-eb8c-41d3-984f-1b94a8224c2d admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:50.742905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8a802-eb8c-41d3-984f-1b94a8224c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:50.744297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b8a802-eb8c-41d3-984f-1b94a8224c2d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:50.822858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b29474-88dd-459d-bb38-00876d035c6a tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:50.828873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876f021-5527-4a34-873d-aac4e317d431 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:50.829936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876f021-5527-4a34-873d-aac4e317d431 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:50.830316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876f021-5527-4a34-873d-aac4e317d431 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:50.830614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876f021-5527-4a34-873d-aac4e317d431 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:50.832692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6876f021-5527-4a34-873d-aac4e317d431 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:50.852062 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 972/1925] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:50 2022] POST /identity/v3/users => generated 305 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:50.853797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8a802-eb8c-41d3-984f-1b94a8224c2d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:50.865647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b8a802-eb8c-41d3-984f-1b94a8224c2d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:50.876171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13badb65-885f-4e9b-a54e-46e802236971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:50.878888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13badb65-885f-4e9b-a54e-46e802236971 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:50.878888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13badb65-885f-4e9b-a54e-46e802236971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:50.878888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13badb65-885f-4e9b-a54e-46e802236971 admin admin] PATH_INFO: `/v3/projects/c921977042c74bb1a58ef9d92e8b1d51/users/d3f01fcebf5c48d39e7ec0e4a15764ab/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:50.908769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13badb65-885f-4e9b-a54e-46e802236971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c921977042c74bb1a58ef9d92e8b1d51, user_id=d3f01fcebf5c48d39e7ec0e4a15764ab, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:50.912114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13badb65-885f-4e9b-a54e-46e802236971 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:50.938470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876f021-5527-4a34-873d-aac4e317d431 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:50.940314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876f021-5527-4a34-873d-aac4e317d431 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:50.954901 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 954/1926] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:50 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:50.956042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876f021-5527-4a34-873d-aac4e317d431 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:50.970445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876f021-5527-4a34-873d-aac4e317d431 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:50.987008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891469f-d7ec-4ec6-8e2e-a227be9b1890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:50.996826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891469f-d7ec-4ec6-8e2e-a227be9b1890 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:50.997131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891469f-d7ec-4ec6-8e2e-a227be9b1890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:50.997421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891469f-d7ec-4ec6-8e2e-a227be9b1890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:50.998388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891469f-d7ec-4ec6-8e2e-a227be9b1890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:51.001242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891469f-d7ec-4ec6-8e2e-a227be9b1890 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:51.005796 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 973/1927] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:50 2022] PUT /identity/v3/projects/c921977042c74bb1a58ef9d92e8b1d51/users/d3f01fcebf5c48d39e7ec0e4a15764ab/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:51.019019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267aa4a5-628d-44c5-9179-54e44d99ee1f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:51.019166 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 955/1928] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:51.019364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267aa4a5-628d-44c5-9179-54e44d99ee1f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:51.019847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267aa4a5-628d-44c5-9179-54e44d99ee1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:51.020513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891469f-d7ec-4ec6-8e2e-a227be9b1890 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:51.031922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891469f-d7ec-4ec6-8e2e-a227be9b1890 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:51.065005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-267aa4a5-628d-44c5-9179-54e44d99ee1f None None] MFA Rules not processed for user `d3f01fcebf5c48d39e7ec0e4a15764ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:51.066324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-267aa4a5-628d-44c5-9179-54e44d99ee1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:51.077340 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:51.131661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801fb84-4724-46f2-86c8-a6a8a123dafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:51.133847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801fb84-4724-46f2-86c8-a6a8a123dafb admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:51.134590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801fb84-4724-46f2-86c8-a6a8a123dafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:51.135137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801fb84-4724-46f2-86c8-a6a8a123dafb admin admin] PATH_INFO: `/v3/projects/1866e714fd1b4da9a2fcdbba28104da0/users/d6df13c0313f490bb921ba23160fcb8d/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:51.158406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801fb84-4724-46f2-86c8-a6a8a123dafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1866e714fd1b4da9a2fcdbba28104da0, user_id=d6df13c0313f490bb921ba23160fcb8d, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:51.162834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801fb84-4724-46f2-86c8-a6a8a123dafb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:51.207864 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 974/1929] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:51 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:51.208806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267aa4a5-628d-44c5-9179-54e44d99ee1f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:51.222373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267aa4a5-628d-44c5-9179-54e44d99ee1f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:51.238530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5f6c1-c9e1-4cb8-bcc8-3829ce6d108a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:51.239508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5f6c1-c9e1-4cb8-bcc8-3829ce6d108a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:51.239883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5f6c1-c9e1-4cb8-bcc8-3829ce6d108a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:51.240230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5f6c1-c9e1-4cb8-bcc8-3829ce6d108a admin admin] PATH_INFO: `/v3/users/764e9d4dfcc243f9909511a41f39b74d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:51.241581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5f6c1-c9e1-4cb8-bcc8-3829ce6d108a admin admin] RBAC: Authorizing `identity:delete_user(user_id=764e9d4dfcc243f9909511a41f39b74d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:51.244373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5f6c1-c9e1-4cb8-bcc8-3829ce6d108a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:51.261024 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 956/1930] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:51 2022] PUT /identity/v3/projects/1866e714fd1b4da9a2fcdbba28104da0/users/d6df13c0313f490bb921ba23160fcb8d/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:51.273790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801fb84-4724-46f2-86c8-a6a8a123dafb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:51.368713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801fb84-4724-46f2-86c8-a6a8a123dafb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:51.373493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda0c7f-d8b1-47a1-8bb6-39a4c5b94ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:51.374291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda0c7f-d8b1-47a1-8bb6-39a4c5b94ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:51.374585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda0c7f-d8b1-47a1-8bb6-39a4c5b94ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:51.374866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda0c7f-d8b1-47a1-8bb6-39a4c5b94ed6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:51.375562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda0c7f-d8b1-47a1-8bb6-39a4c5b94ed6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:51.377455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda0c7f-d8b1-47a1-8bb6-39a4c5b94ed6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:51.480377 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 957/1931] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:51 2022] POST /identity/v3/projects => generated 409 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:51.481196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda0c7f-d8b1-47a1-8bb6-39a4c5b94ed6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:51.561586 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:INSERT=5,keystone:SELECT=90,keystone:DELETE=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:51.565094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda0c7f-d8b1-47a1-8bb6-39a4c5b94ed6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:51.570471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354fa9f-5d88-4c0a-bb0d-73ff8e0e5b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:51.571083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354fa9f-5d88-4c0a-bb0d-73ff8e0e5b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:51.571378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354fa9f-5d88-4c0a-bb0d-73ff8e0e5b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:51.571649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b354fa9f-5d88-4c0a-bb0d-73ff8e0e5b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:51.572396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354fa9f-5d88-4c0a-bb0d-73ff8e0e5b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:51.574384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b354fa9f-5d88-4c0a-bb0d-73ff8e0e5b6e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:51.598304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-19a5f6c1-c9e1-4cb8-bcc8-3829ce6d108a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '764e9d4dfcc243f9909511a41f39b74d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:51.600960 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 958/1932] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:51.603099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354fa9f-5d88-4c0a-bb0d-73ff8e0e5b6e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:51.615422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-19a5f6c1-c9e1-4cb8-bcc8-3829ce6d108a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '764e9d4dfcc243f9909511a41f39b74d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:51.626275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-19a5f6c1-c9e1-4cb8-bcc8-3829ce6d108a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '764e9d4dfcc243f9909511a41f39b74d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:51.631483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-19a5f6c1-c9e1-4cb8-bcc8-3829ce6d108a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '764e9d4dfcc243f9909511a41f39b74d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:51.639720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b354fa9f-5d88-4c0a-bb0d-73ff8e0e5b6e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:51.644858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707fa5c-3c30-4912-9786-897723f539d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:51.645546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707fa5c-3c30-4912-9786-897723f539d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:51.648290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707fa5c-3c30-4912-9786-897723f539d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:51.648290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707fa5c-3c30-4912-9786-897723f539d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:51.648290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707fa5c-3c30-4912-9786-897723f539d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:51.650087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707fa5c-3c30-4912-9786-897723f539d5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:51.730245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-19a5f6c1-c9e1-4cb8-bcc8-3829ce6d108a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '764e9d4dfcc243f9909511a41f39b74d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:51.739488 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 959/1933] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:51 2022] POST /identity/v3/users => generated 311 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:51.747359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707fa5c-3c30-4912-9786-897723f539d5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:51.749229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d707fa5c-3c30-4912-9786-897723f539d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:51.757696 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 975/1934] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:51 2022] DELETE /identity/v3/users/764e9d4dfcc243f9909511a41f39b74d => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:51.763082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5f6c1-c9e1-4cb8-bcc8-3829ce6d108a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:51.763082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-19a5f6c1-c9e1-4cb8-bcc8-3829ce6d108a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:51.763269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707fa5c-3c30-4912-9786-897723f539d5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:51.785976 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:51.860812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec809c-e2e1-4bdb-82c8-8e9029a6bad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:51.861765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec809c-e2e1-4bdb-82c8-8e9029a6bad1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:51.862058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec809c-e2e1-4bdb-82c8-8e9029a6bad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:51.862378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec809c-e2e1-4bdb-82c8-8e9029a6bad1 admin admin] PATH_INFO: `/v3/projects/1866e714fd1b4da9a2fcdbba28104da0/users/d6df13c0313f490bb921ba23160fcb8d/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:51.864611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec809c-e2e1-4bdb-82c8-8e9029a6bad1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1866e714fd1b4da9a2fcdbba28104da0, user_id=d6df13c0313f490bb921ba23160fcb8d, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:51.867094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5f6c1-c9e1-4cb8-bcc8-3829ce6d108a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:51.868167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec809c-e2e1-4bdb-82c8-8e9029a6bad1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:51.878655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb58612-5712-42ff-adf6-65644adf017e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:51.879325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb58612-5712-42ff-adf6-65644adf017e service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:51.879614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb58612-5712-42ff-adf6-65644adf017e service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:51.882738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb58612-5712-42ff-adf6-65644adf017e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:51.882738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ceb58612-5712-42ff-adf6-65644adf017e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:51.882904 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 960/1935] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:51 2022] PUT /identity/v3/projects/1866e714fd1b4da9a2fcdbba28104da0/users/d6df13c0313f490bb921ba23160fcb8d/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:51.882904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec809c-e2e1-4bdb-82c8-8e9029a6bad1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:51.884311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e4ec809c-e2e1-4bdb-82c8-8e9029a6bad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:51.977454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec809c-e2e1-4bdb-82c8-8e9029a6bad1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:51.984565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95e8c9-5a9f-4fbb-97a6-d19aee29e5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:51.985369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95e8c9-5a9f-4fbb-97a6-d19aee29e5ec admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:51.985659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95e8c9-5a9f-4fbb-97a6-d19aee29e5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:51.986181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb58612-5712-42ff-adf6-65644adf017e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:51.986320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95e8c9-5a9f-4fbb-97a6-d19aee29e5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:51.987611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95e8c9-5a9f-4fbb-97a6-d19aee29e5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:51.987817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb58612-5712-42ff-adf6-65644adf017e service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:51.990597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95e8c9-5a9f-4fbb-97a6-d19aee29e5ec admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:52.021139 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 961/1936] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:52.022682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731315a-ec31-41cc-85ad-e55efb6b1e20 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:52.023043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731315a-ec31-41cc-85ad-e55efb6b1e20 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:52.024205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e731315a-ec31-41cc-85ad-e55efb6b1e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:52.030547 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 976/1937] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:52.030828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16734320-94c3-461a-9dce-52eca815ccd8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:52.031759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16734320-94c3-461a-9dce-52eca815ccd8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:52.031759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16734320-94c3-461a-9dce-52eca815ccd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:52.070442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e731315a-ec31-41cc-85ad-e55efb6b1e20 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:52.071819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e731315a-ec31-41cc-85ad-e55efb6b1e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:52.084542 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 962/1938] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:52.084542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731315a-ec31-41cc-85ad-e55efb6b1e20 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:52.091740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-16734320-94c3-461a-9dce-52eca815ccd8 None None] MFA Rules not processed for user `d6df13c0313f490bb921ba23160fcb8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:52.093357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-16734320-94c3-461a-9dce-52eca815ccd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:52.098515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e731315a-ec31-41cc-85ad-e55efb6b1e20 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:52.109043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b7eac-786f-423a-98b7-6d255e43d45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:52.110305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b7eac-786f-423a-98b7-6d255e43d45b admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:52.110305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b7eac-786f-423a-98b7-6d255e43d45b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:52.110594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b7eac-786f-423a-98b7-6d255e43d45b admin admin] PATH_INFO: `/v3/projects/0cab290a04db4df48168d6cb27e8cf3d/users/100f182672a2445db612508a3e543fa0/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:52.145927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b7eac-786f-423a-98b7-6d255e43d45b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cab290a04db4df48168d6cb27e8cf3d, user_id=100f182672a2445db612508a3e543fa0, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:52.149681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b7eac-786f-423a-98b7-6d255e43d45b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:52.186907 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:52.211415 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 963/1939] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:52 2022] PUT /identity/v3/projects/0cab290a04db4df48168d6cb27e8cf3d/users/100f182672a2445db612508a3e543fa0/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:52.211415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b7eac-786f-423a-98b7-6d255e43d45b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:52.211415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-255b7eac-786f-423a-98b7-6d255e43d45b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:52.280362 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 977/1940] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:52.280362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16734320-94c3-461a-9dce-52eca815ccd8 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:52.280362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16734320-94c3-461a-9dce-52eca815ccd8 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:52.314954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b7eac-786f-423a-98b7-6d255e43d45b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:52.321567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198fcbd-5d73-4b8c-80c1-4f1ef40036d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:52.322620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198fcbd-5d73-4b8c-80c1-4f1ef40036d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:52.322822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198fcbd-5d73-4b8c-80c1-4f1ef40036d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:52.323110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198fcbd-5d73-4b8c-80c1-4f1ef40036d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:52.383696 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:52.388812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bd94b-a64f-4f24-bb35-1a81836c4f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:52.389547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bd94b-a64f-4f24-bb35-1a81836c4f46 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:52.389924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bd94b-a64f-4f24-bb35-1a81836c4f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:52.390193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bd94b-a64f-4f24-bb35-1a81836c4f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:52.391026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894bd94b-a64f-4f24-bb35-1a81836c4f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:52.402964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894bd94b-a64f-4f24-bb35-1a81836c4f46 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:52.415334 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 978/1941] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:52.416724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c1e1d-f030-4c6f-b891-3c4c4fcaec49 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:52.417018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c1e1d-f030-4c6f-b891-3c4c4fcaec49 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:52.417305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c1e1d-f030-4c6f-b891-3c4c4fcaec49 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:52.422772 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 979/1942] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:11:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:11:52.423773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c1e1d-f030-4c6f-b891-3c4c4fcaec49 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:52.427974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198fcbd-5d73-4b8c-80c1-4f1ef40036d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:52.430526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198fcbd-5d73-4b8c-80c1-4f1ef40036d0 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:52.443979 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 964/1943] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:52.444955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198fcbd-5d73-4b8c-80c1-4f1ef40036d0 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:52.456312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198fcbd-5d73-4b8c-80c1-4f1ef40036d0 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:52.461634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d5475-d58b-4cbc-af04-307d24da0623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:52.462805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d5475-d58b-4cbc-af04-307d24da0623 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:52.463023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d5475-d58b-4cbc-af04-307d24da0623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:52.463462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d5475-d58b-4cbc-af04-307d24da0623 admin admin] PATH_INFO: `/v3/projects/0cab290a04db4df48168d6cb27e8cf3d/users/100f182672a2445db612508a3e543fa0/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:52.465429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d5475-d58b-4cbc-af04-307d24da0623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cab290a04db4df48168d6cb27e8cf3d, user_id=100f182672a2445db612508a3e543fa0, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:52.468737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d5475-d58b-4cbc-af04-307d24da0623 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:52.486713 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 965/1944] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:52 2022] PUT /identity/v3/projects/0cab290a04db4df48168d6cb27e8cf3d/users/100f182672a2445db612508a3e543fa0/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:52.487534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d5475-d58b-4cbc-af04-307d24da0623 admin admin] Authenticating service token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:11:52.497888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b94d5475-d58b-4cbc-af04-307d24da0623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:52.557954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c1e1d-f030-4c6f-b891-3c4c4fcaec49 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:52.629927 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:52.634976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d5475-d58b-4cbc-af04-307d24da0623 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:52.636617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b94d5475-d58b-4cbc-af04-307d24da0623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:52.639576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2444673d-2e28-4eb8-86ea-a13e23be0396 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:52.640450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444673d-2e28-4eb8-86ea-a13e23be0396 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:52.640901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444673d-2e28-4eb8-86ea-a13e23be0396 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:52.641494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2444673d-2e28-4eb8-86ea-a13e23be0396 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:52.643721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2444673d-2e28-4eb8-86ea-a13e23be0396 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:52.733173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d5475-d58b-4cbc-af04-307d24da0623 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:52.739289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd1306-f49f-471e-afd1-7acd469adab4 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a33451759db406e96f5db1d8b9adba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c36ff897dd64324818ffe555d366b17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:52.739736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444673d-2e28-4eb8-86ea-a13e23be0396 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:52.740335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd1306-f49f-471e-afd1-7acd469adab4 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:52.740693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd1306-f49f-471e-afd1-7acd469adab4 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:52.741513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd1306-f49f-471e-afd1-7acd469adab4 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] PATH_INFO: `/v3/projects/b767cc23f21c4fc29c82b36fd1fe71e6` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:52.741622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2444673d-2e28-4eb8-86ea-a13e23be0396 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:52.742729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd1306-f49f-471e-afd1-7acd469adab4 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] RBAC: Authorizing `identity:get_project(project_id=b767cc23f21c4fc29c82b36fd1fe71e6)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:52.744942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd1306-f49f-471e-afd1-7acd469adab4 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:52.747212 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 966/1945] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:11:52 2022] GET /identity/v3/projects/b767cc23f21c4fc29c82b36fd1fe71e6 => generated 393 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:52.748561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf2e2d-78b2-46f6-ab26-88862bc94202 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:52.748852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf2e2d-78b2-46f6-ab26-88862bc94202 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:52.750327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decf2e2d-78b2-46f6-ab26-88862bc94202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:52.752602 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 980/1946] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:52.803111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-decf2e2d-78b2-46f6-ab26-88862bc94202 None None] MFA Rules not processed for user `100f182672a2445db612508a3e543fa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:52.804140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-decf2e2d-78b2-46f6-ab26-88862bc94202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:52.908429 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:52.944715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e3d8c-0850-4873-9aa1-823a4a52f4cd None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:52.945739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e3d8c-0850-4873-9aa1-823a4a52f4cd None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:52.945838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e3d8c-0850-4873-9aa1-823a4a52f4cd None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:52.947387 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 981/1947] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:11:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 14:11:52.952189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e3d8c-0850-4873-9aa1-823a4a52f4cd None None] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:11:52.993120 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 967/1948] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:52 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:52.995250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e3d8c-0850-4873-9aa1-823a4a52f4cd None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:53.014457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e3d8c-0850-4873-9aa1-823a4a52f4cd None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:53.021829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb792e1-7110-4ed1-92cc-2aa564cedbe1 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a33451759db406e96f5db1d8b9adba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c36ff897dd64324818ffe555d366b17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:53.030334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb792e1-7110-4ed1-92cc-2aa564cedbe1 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:53.030334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb792e1-7110-4ed1-92cc-2aa564cedbe1 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:53.030334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb792e1-7110-4ed1-92cc-2aa564cedbe1 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] PATH_INFO: `/v3/projects/b767cc23f21c4fc29c82b36fd1fe71e6` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:53.035660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb792e1-7110-4ed1-92cc-2aa564cedbe1 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] RBAC: Authorizing `identity:get_project(project_id=b767cc23f21c4fc29c82b36fd1fe71e6)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:53.038625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf2e2d-78b2-46f6-ab26-88862bc94202 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:53.041613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb792e1-7110-4ed1-92cc-2aa564cedbe1 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:53.046864 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 982/1949] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:11:52 2022] GET /identity/v3/projects/b767cc23f21c4fc29c82b36fd1fe71e6 => generated 393 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:11:53.054651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decf2e2d-78b2-46f6-ab26-88862bc94202 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:53.061794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3d27b-d1a8-4c5f-ab52-2787dac64fb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:53.062945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3d27b-d1a8-4c5f-ab52-2787dac64fb8 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:53.063239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3d27b-d1a8-4c5f-ab52-2787dac64fb8 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:53.063520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3d27b-d1a8-4c5f-ab52-2787dac64fb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:53.131170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3d27b-d1a8-4c5f-ab52-2787dac64fb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:53.136269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb792e1-7110-4ed1-92cc-2aa564cedbe1 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:53.138039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4eb792e1-7110-4ed1-92cc-2aa564cedbe1 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:53.151531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3d27b-d1a8-4c5f-ab52-2787dac64fb8 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:53.174341 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 968/1950] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:11:53.175362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3d27b-d1a8-4c5f-ab52-2787dac64fb8 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:53.213624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3d27b-d1a8-4c5f-ab52-2787dac64fb8 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:53.225590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae54b3-8848-4d59-9d92-74c0b1cc47f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:53.226360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae54b3-8848-4d59-9d92-74c0b1cc47f0 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:53.226647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae54b3-8848-4d59-9d92-74c0b1cc47f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:53.226924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdae54b3-8848-4d59-9d92-74c0b1cc47f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:53.236974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae54b3-8848-4d59-9d92-74c0b1cc47f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:53.239217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdae54b3-8848-4d59-9d92-74c0b1cc47f0 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:53.266248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb792e1-7110-4ed1-92cc-2aa564cedbe1 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:53.269276 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 969/1951] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:53 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:53.271274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4619330-baa8-46ad-8008-2fd9f29f7e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:53.272367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4619330-baa8-46ad-8008-2fd9f29f7e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:53.272823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4619330-baa8-46ad-8008-2fd9f29f7e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:53.273097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4619330-baa8-46ad-8008-2fd9f29f7e1a admin admin] PATH_INFO: `/v3/projects/34836ece2308405999a05660d1257a72` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:53.274994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4619330-baa8-46ad-8008-2fd9f29f7e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=34836ece2308405999a05660d1257a72)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:53.277124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4619330-baa8-46ad-8008-2fd9f29f7e1a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:53.356389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae54b3-8848-4d59-9d92-74c0b1cc47f0 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:53.383942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdae54b3-8848-4d59-9d92-74c0b1cc47f0 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:53.391298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb601d8-8928-4a62-83bc-dd40366b7a17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:53.392026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb601d8-8928-4a62-83bc-dd40366b7a17 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:53.392533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb601d8-8928-4a62-83bc-dd40366b7a17 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:53.392944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb601d8-8928-4a62-83bc-dd40366b7a17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:53.408550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8eb601d8-8928-4a62-83bc-dd40366b7a17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:53.427996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a4619330-baa8-46ad-8008-2fd9f29f7e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34836ece2308405999a05660d1257a72', 'request_id': 'req-a4619330-baa8-46ad-8008-2fd9f29f7e1a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:53.434420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a4619330-baa8-46ad-8008-2fd9f29f7e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34836ece2308405999a05660d1257a72', 'request_id': 'req-a4619330-baa8-46ad-8008-2fd9f29f7e1a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:53.443451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a4619330-baa8-46ad-8008-2fd9f29f7e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34836ece2308405999a05660d1257a72', 'request_id': 'req-a4619330-baa8-46ad-8008-2fd9f29f7e1a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:53.492556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb601d8-8928-4a62-83bc-dd40366b7a17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:53.494822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb601d8-8928-4a62-83bc-dd40366b7a17 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:53.504698 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 970/1952] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:53 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:11:53.544949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a4619330-baa8-46ad-8008-2fd9f29f7e1a admin admin] The token cache is being invalidate because project 34836ece2308405999a05660d1257a72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:53.549784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a4619330-baa8-46ad-8008-2fd9f29f7e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:53.555569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a4619330-baa8-46ad-8008-2fd9f29f7e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:53.555569 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 983/1953] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:53 2022] DELETE /identity/v3/projects/34836ece2308405999a05660d1257a72 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:53.562533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb601d8-8928-4a62-83bc-dd40366b7a17 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:53.575665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb601d8-8928-4a62-83bc-dd40366b7a17 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:53.676344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26ebd35-59dc-45a9-af34-f79e12463a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:53.677281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ebd35-59dc-45a9-af34-f79e12463a71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:53.677633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ebd35-59dc-45a9-af34-f79e12463a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:53.677977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26ebd35-59dc-45a9-af34-f79e12463a71 admin admin] PATH_INFO: `/v3/users/eebd4e8e30e241deb6c1ce00cba06638` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:53.681872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ebd35-59dc-45a9-af34-f79e12463a71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eebd4e8e30e241deb6c1ce00cba06638)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:53.681872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26ebd35-59dc-45a9-af34-f79e12463a71 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:53.683808 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:53.765837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4619330-baa8-46ad-8008-2fd9f29f7e1a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:53.771190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a4619330-baa8-46ad-8008-2fd9f29f7e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:53.804540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4619330-baa8-46ad-8008-2fd9f29f7e1a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:53.812094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c909510-82e0-4e80-9e87-4b142a9bd983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:53.812998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c909510-82e0-4e80-9e87-4b142a9bd983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:53.813292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c909510-82e0-4e80-9e87-4b142a9bd983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:53.813576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c909510-82e0-4e80-9e87-4b142a9bd983 admin admin] PATH_INFO: `/v3/users/647b301c1da945d7836d8f0a58c4983e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:53.814805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c909510-82e0-4e80-9e87-4b142a9bd983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=647b301c1da945d7836d8f0a58c4983e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:53.816818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c909510-82e0-4e80-9e87-4b142a9bd983 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:53.844280 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:53.862330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f26ebd35-59dc-45a9-af34-f79e12463a71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eebd4e8e30e241deb6c1ce00cba06638'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:53.877079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f26ebd35-59dc-45a9-af34-f79e12463a71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eebd4e8e30e241deb6c1ce00cba06638'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:53.878854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f26ebd35-59dc-45a9-af34-f79e12463a71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eebd4e8e30e241deb6c1ce00cba06638'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:53.878854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f26ebd35-59dc-45a9-af34-f79e12463a71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eebd4e8e30e241deb6c1ce00cba06638'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:53.886696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f26ebd35-59dc-45a9-af34-f79e12463a71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eebd4e8e30e241deb6c1ce00cba06638'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:54.027651 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 971/1954] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:53 2022] DELETE /identity/v3/users/eebd4e8e30e241deb6c1ce00cba06638 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:54.029110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739309f-8e64-4c1e-9101-e1cccfcffa00 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:54.029432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739309f-8e64-4c1e-9101-e1cccfcffa00 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:54.029739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739309f-8e64-4c1e-9101-e1cccfcffa00 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:54.057356 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 972/1955] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:11:54 2022] GET /identity => generated 270 bytes in 29 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:11:54.058651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739309f-8e64-4c1e-9101-e1cccfcffa00 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:54.062623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e739309f-8e64-4c1e-9101-e1cccfcffa00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:54.065502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3c909510-82e0-4e80-9e87-4b142a9bd983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '647b301c1da945d7836d8f0a58c4983e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:54.095408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3c909510-82e0-4e80-9e87-4b142a9bd983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '647b301c1da945d7836d8f0a58c4983e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:54.113530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3c909510-82e0-4e80-9e87-4b142a9bd983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '647b301c1da945d7836d8f0a58c4983e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:54.119208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3c909510-82e0-4e80-9e87-4b142a9bd983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '647b301c1da945d7836d8f0a58c4983e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:54.199571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739309f-8e64-4c1e-9101-e1cccfcffa00 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:54.204147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3c909510-82e0-4e80-9e87-4b142a9bd983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '647b301c1da945d7836d8f0a58c4983e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:54.205050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8769a0ea-3944-44c9-87fb-a5709d7bec06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:54.205958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769a0ea-3944-44c9-87fb-a5709d7bec06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:54.206299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769a0ea-3944-44c9-87fb-a5709d7bec06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:54.207379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769a0ea-3944-44c9-87fb-a5709d7bec06 admin admin] PATH_INFO: `/v3/users/d3f01fcebf5c48d39e7ec0e4a15764ab` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:54.211665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769a0ea-3944-44c9-87fb-a5709d7bec06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f01fcebf5c48d39e7ec0e4a15764ab)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:54.215193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8769a0ea-3944-44c9-87fb-a5709d7bec06 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:54.228112 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 984/1956] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:53 2022] DELETE /identity/v3/users/647b301c1da945d7836d8f0a58c4983e => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:54.238999 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c909510-82e0-4e80-9e87-4b142a9bd983 admin admin] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:11:54.238999 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3c909510-82e0-4e80-9e87-4b142a9bd983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:54.352532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c909510-82e0-4e80-9e87-4b142a9bd983 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:54.353792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3c909510-82e0-4e80-9e87-4b142a9bd983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:54.425127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c909510-82e0-4e80-9e87-4b142a9bd983 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:54.431272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a285e7-78df-46af-8b78-e2b297501067 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a33451759db406e96f5db1d8b9adba3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c36ff897dd64324818ffe555d366b17', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:54.432425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a285e7-78df-46af-8b78-e2b297501067 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:54.468459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a285e7-78df-46af-8b78-e2b297501067 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:54.468459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a285e7-78df-46af-8b78-e2b297501067 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] PATH_INFO: `/v3/projects/1cc443417b7a44a196ee01dd6af62a39` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:54.468459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a285e7-78df-46af-8b78-e2b297501067 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] RBAC: Authorizing `identity:get_project(project_id=1cc443417b7a44a196ee01dd6af62a39)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:54.468459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a285e7-78df-46af-8b78-e2b297501067 tempest-FlavorsAccessNegativeTestJSON-803285623 tempest-FlavorsAccessNegativeTestJSON-803285623-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:54.468459 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 985/1957] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:11:54 2022] GET /identity/v3/projects/1cc443417b7a44a196ee01dd6af62a39 => generated 393 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:54.470407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ece19-98bf-4fe1-9783-bab71f8af688 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:54.470407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ece19-98bf-4fe1-9783-bab71f8af688 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:54.470407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ece19-98bf-4fe1-9783-bab71f8af688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:54.470407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-873ece19-98bf-4fe1-9783-bab71f8af688 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:54.470407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-873ece19-98bf-4fe1-9783-bab71f8af688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:54.536456 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 986/1958] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:54.546762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ece19-98bf-4fe1-9783-bab71f8af688 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:54.548161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-873ece19-98bf-4fe1-9783-bab71f8af688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:54.631940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ece19-98bf-4fe1-9783-bab71f8af688 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:54.635751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca37648-6499-497c-a7cd-49f0c5ed1ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:54.636419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca37648-6499-497c-a7cd-49f0c5ed1ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:54.636705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca37648-6499-497c-a7cd-49f0c5ed1ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:54.636985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca37648-6499-497c-a7cd-49f0c5ed1ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:54.649627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca37648-6499-497c-a7cd-49f0c5ed1ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:54.650824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca37648-6499-497c-a7cd-49f0c5ed1ed7 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:54.670018 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 987/1959] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:11:55.191557 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:55.234766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca37648-6499-497c-a7cd-49f0c5ed1ed7 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:55.237194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7ca37648-6499-497c-a7cd-49f0c5ed1ed7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:55.252358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca37648-6499-497c-a7cd-49f0c5ed1ed7 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:55.256095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7f0d1-c597-4008-9c36-96119472e95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:55.256997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7f0d1-c597-4008-9c36-96119472e95a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:55.257287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7f0d1-c597-4008-9c36-96119472e95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:55.257569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed7f0d1-c597-4008-9c36-96119472e95a admin admin] PATH_INFO: `/v3/users/5e2f0fe975724ef48437acd0cd5780d7` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:55.259524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7f0d1-c597-4008-9c36-96119472e95a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e2f0fe975724ef48437acd0cd5780d7)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:55.261444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed7f0d1-c597-4008-9c36-96119472e95a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:55.312853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8769a0ea-3944-44c9-87fb-a5709d7bec06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f01fcebf5c48d39e7ec0e4a15764ab'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:55.339607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8769a0ea-3944-44c9-87fb-a5709d7bec06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f01fcebf5c48d39e7ec0e4a15764ab'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:55.340366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8769a0ea-3944-44c9-87fb-a5709d7bec06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f01fcebf5c48d39e7ec0e4a15764ab'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:55.340981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8769a0ea-3944-44c9-87fb-a5709d7bec06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f01fcebf5c48d39e7ec0e4a15764ab'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:55.348860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8769a0ea-3944-44c9-87fb-a5709d7bec06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f01fcebf5c48d39e7ec0e4a15764ab'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:55.432394 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:55.438584 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 973/1960] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:54 2022] DELETE /identity/v3/users/d3f01fcebf5c48d39e7ec0e4a15764ab => generated 0 bytes in 1380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:55.443660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3308d31-9a7c-47f6-81e8-b65e2c00ad19 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:55.444146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3308d31-9a7c-47f6-81e8-b65e2c00ad19 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:55.444573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3308d31-9a7c-47f6-81e8-b65e2c00ad19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:55.466491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f3308d31-9a7c-47f6-81e8-b65e2c00ad19 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:55.466491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f3308d31-9a7c-47f6-81e8-b65e2c00ad19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:55.507770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1ed7f0d1-c597-4008-9c36-96119472e95a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e2f0fe975724ef48437acd0cd5780d7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:55.535000 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 974/1961] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:55.536660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538fe63-b55c-483d-b40d-e6f8f1f5c8ee None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:55.537059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538fe63-b55c-483d-b40d-e6f8f1f5c8ee None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:55.537547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f538fe63-b55c-483d-b40d-e6f8f1f5c8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:55.541599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1ed7f0d1-c597-4008-9c36-96119472e95a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e2f0fe975724ef48437acd0cd5780d7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:55.550717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1ed7f0d1-c597-4008-9c36-96119472e95a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e2f0fe975724ef48437acd0cd5780d7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:55.558716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1ed7f0d1-c597-4008-9c36-96119472e95a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e2f0fe975724ef48437acd0cd5780d7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:55.562291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f538fe63-b55c-483d-b40d-e6f8f1f5c8ee None None] MFA Rules not processed for user `e997b70d7158446daa1dfa225eb7afca`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:55.563955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f538fe63-b55c-483d-b40d-e6f8f1f5c8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:55.631599 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 975/1962] 10.222.0.52 () {58 vars in 1015 bytes} [Tue Jul 19 14:11:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:55.632851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538fe63-b55c-483d-b40d-e6f8f1f5c8ee None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:55.634984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f538fe63-b55c-483d-b40d-e6f8f1f5c8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:55.643928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1ed7f0d1-c597-4008-9c36-96119472e95a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e2f0fe975724ef48437acd0cd5780d7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:55.651221 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 988/1963] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:55 2022] DELETE /identity/v3/users/5e2f0fe975724ef48437acd0cd5780d7 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:11:55.658697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7f0d1-c597-4008-9c36-96119472e95a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:55.658697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1ed7f0d1-c597-4008-9c36-96119472e95a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:55.658972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f538fe63-b55c-483d-b40d-e6f8f1f5c8ee None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:55.715292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed7f0d1-c597-4008-9c36-96119472e95a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:55.715489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde66b3-bfe8-4003-879d-27461329716e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:55.716197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde66b3-bfe8-4003-879d-27461329716e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:55.716536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde66b3-bfe8-4003-879d-27461329716e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:55.716820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde66b3-bfe8-4003-879d-27461329716e admin admin] PATH_INFO: `/v3/projects/7626a387d58e43859a808ce88b8e63df` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:55.718318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde66b3-bfe8-4003-879d-27461329716e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7626a387d58e43859a808ce88b8e63df)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:55.719225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40c93d-f16d-47dd-90e4-d7a1b25720f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:55.719874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40c93d-f16d-47dd-90e4-d7a1b25720f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:55.720162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40c93d-f16d-47dd-90e4-d7a1b25720f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:55.720264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde66b3-bfe8-4003-879d-27461329716e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:55.720440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40c93d-f16d-47dd-90e4-d7a1b25720f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:55.722322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ed40c93d-f16d-47dd-90e4-d7a1b25720f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:55.735401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40c93d-f16d-47dd-90e4-d7a1b25720f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:55.737899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40c93d-f16d-47dd-90e4-d7a1b25720f1 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:55.748966 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 989/1964] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:55.749802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40c93d-f16d-47dd-90e4-d7a1b25720f1 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:55.751194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ed40c93d-f16d-47dd-90e4-d7a1b25720f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:55.763497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40c93d-f16d-47dd-90e4-d7a1b25720f1 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:55.768238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5c7e2-8cf9-4759-84b0-9ea3b2a0c289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:55.769100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5c7e2-8cf9-4759-84b0-9ea3b2a0c289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:55.769392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5c7e2-8cf9-4759-84b0-9ea3b2a0c289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:55.769672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5c7e2-8cf9-4759-84b0-9ea3b2a0c289 admin admin] PATH_INFO: `/v3/projects/96acf9c5dfb944478442387b79e54d51` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:55.770908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5c7e2-8cf9-4759-84b0-9ea3b2a0c289 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96acf9c5dfb944478442387b79e54d51)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:55.772820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5c7e2-8cf9-4759-84b0-9ea3b2a0c289 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:55.902757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8bde66b3-bfe8-4003-879d-27461329716e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7626a387d58e43859a808ce88b8e63df', 'request_id': 'req-8bde66b3-bfe8-4003-879d-27461329716e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:55.907718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bee5c7e2-8cf9-4759-84b0-9ea3b2a0c289 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96acf9c5dfb944478442387b79e54d51', 'request_id': 'req-bee5c7e2-8cf9-4759-84b0-9ea3b2a0c289'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:55.914415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bee5c7e2-8cf9-4759-84b0-9ea3b2a0c289 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96acf9c5dfb944478442387b79e54d51', 'request_id': 'req-bee5c7e2-8cf9-4759-84b0-9ea3b2a0c289'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:55.921662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bee5c7e2-8cf9-4759-84b0-9ea3b2a0c289 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96acf9c5dfb944478442387b79e54d51', 'request_id': 'req-bee5c7e2-8cf9-4759-84b0-9ea3b2a0c289'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:56.015745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8bde66b3-bfe8-4003-879d-27461329716e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7626a387d58e43859a808ce88b8e63df', 'request_id': 'req-8bde66b3-bfe8-4003-879d-27461329716e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:56.023764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8bde66b3-bfe8-4003-879d-27461329716e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7626a387d58e43859a808ce88b8e63df', 'request_id': 'req-8bde66b3-bfe8-4003-879d-27461329716e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:56.035102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8bde66b3-bfe8-4003-879d-27461329716e admin admin] The token cache is being invalidate because project 7626a387d58e43859a808ce88b8e63df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:56.035454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8bde66b3-bfe8-4003-879d-27461329716e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:56.036547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8bde66b3-bfe8-4003-879d-27461329716e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:56.038170 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 976/1965] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:55 2022] DELETE /identity/v3/projects/7626a387d58e43859a808ce88b8e63df => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:56.039067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde66b3-bfe8-4003-879d-27461329716e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:56.040950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8bde66b3-bfe8-4003-879d-27461329716e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:56.100046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bee5c7e2-8cf9-4759-84b0-9ea3b2a0c289 admin admin] The token cache is being invalidate because project 96acf9c5dfb944478442387b79e54d51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:56.100046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bee5c7e2-8cf9-4759-84b0-9ea3b2a0c289 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:56.100749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bee5c7e2-8cf9-4759-84b0-9ea3b2a0c289 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:56.103188 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 990/1966] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:55 2022] DELETE /identity/v3/projects/96acf9c5dfb944478442387b79e54d51 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:56.104456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f1e31-8d54-4f32-abde-c470a5ce6165 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:56.104781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f1e31-8d54-4f32-abde-c470a5ce6165 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:56.105066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f1e31-8d54-4f32-abde-c470a5ce6165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:56.124729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-cd3f1e31-8d54-4f32-abde-c470a5ce6165 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:56.126737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cd3f1e31-8d54-4f32-abde-c470a5ce6165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:56.131393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde66b3-bfe8-4003-879d-27461329716e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:56.190124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8348b3-a74f-4e54-bf49-1945f6069d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:56.191082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8348b3-a74f-4e54-bf49-1945f6069d4f service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:56.192611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8348b3-a74f-4e54-bf49-1945f6069d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:56.192611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8348b3-a74f-4e54-bf49-1945f6069d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:56.194015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1e8348b3-a74f-4e54-bf49-1945f6069d4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:56.195640 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 991/1967] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:56.197360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30a094-2960-4458-ab59-8f944df2c99e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:56.197647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30a094-2960-4458-ab59-8f944df2c99e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:56.197929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30a094-2960-4458-ab59-8f944df2c99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:56.208104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8348b3-a74f-4e54-bf49-1945f6069d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:56.209576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8348b3-a74f-4e54-bf49-1945f6069d4f service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:56.229260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9b30a094-2960-4458-ab59-8f944df2c99e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:56.230632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9b30a094-2960-4458-ab59-8f944df2c99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:56.240181 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 992/1968] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:56.240980 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 977/1969] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:56.242700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096e212-b9aa-4694-9581-f9d0a50fcc0a None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:56.244556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096e212-b9aa-4694-9581-f9d0a50fcc0a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:56.244852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7096e212-b9aa-4694-9581-f9d0a50fcc0a None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:56.248372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30a094-2960-4458-ab59-8f944df2c99e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:56.250256 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 978/1970] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:11:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:11:56.250710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9b30a094-2960-4458-ab59-8f944df2c99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:56.251825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096e212-b9aa-4694-9581-f9d0a50fcc0a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:56.254049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7096e212-b9aa-4694-9581-f9d0a50fcc0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:56.266224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30a094-2960-4458-ab59-8f944df2c99e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:56.272383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7096e212-b9aa-4694-9581-f9d0a50fcc0a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:56.276472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0bc14-2d75-4b6a-8e7e-0d30caf8511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:56.278043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fc416-e0ce-412c-9c4d-13fd51cc1e69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:56.278768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fc416-e0ce-412c-9c4d-13fd51cc1e69 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:56.279073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fc416-e0ce-412c-9c4d-13fd51cc1e69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:56.279482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fc416-e0ce-412c-9c4d-13fd51cc1e69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:56.282075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0bc14-2d75-4b6a-8e7e-0d30caf8511e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:56.282409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0bc14-2d75-4b6a-8e7e-0d30caf8511e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:56.283795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0bc14-2d75-4b6a-8e7e-0d30caf8511e admin admin] PATH_INFO: `/v3/users/d6df13c0313f490bb921ba23160fcb8d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:56.285086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0bc14-2d75-4b6a-8e7e-0d30caf8511e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6df13c0313f490bb921ba23160fcb8d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:56.287366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0bc14-2d75-4b6a-8e7e-0d30caf8511e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:56.292345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fc416-e0ce-412c-9c4d-13fd51cc1e69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:56.296345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80fc416-e0ce-412c-9c4d-13fd51cc1e69 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:56.307651 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 979/1971] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:56.308959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51c966-fede-43bf-8a4e-4e0865d64731 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:56.309253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51c966-fede-43bf-8a4e-4e0865d64731 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:56.309627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51c966-fede-43bf-8a4e-4e0865d64731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:56.329347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-dc51c966-fede-43bf-8a4e-4e0865d64731 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:56.330659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-dc51c966-fede-43bf-8a4e-4e0865d64731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:56.339969 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 980/1972] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:56.341257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08339c-623b-4bdb-9251-6dffbeaad381 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:56.341548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08339c-623b-4bdb-9251-6dffbeaad381 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:56.341828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08339c-623b-4bdb-9251-6dffbeaad381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:56.364426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ab08339c-623b-4bdb-9251-6dffbeaad381 None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:56.368412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ab08339c-623b-4bdb-9251-6dffbeaad381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:56.466646 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 981/1973] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:11:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:56.467678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08339c-623b-4bdb-9251-6dffbeaad381 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:56.481048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08339c-623b-4bdb-9251-6dffbeaad381 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:56.494415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00731f02-53c7-43a5-8a46-4da68e557ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:56.495932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00731f02-53c7-43a5-8a46-4da68e557ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:56.497566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00731f02-53c7-43a5-8a46-4da68e557ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:56.498445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00731f02-53c7-43a5-8a46-4da68e557ea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:56.500434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00731f02-53c7-43a5-8a46-4da68e557ea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:11:56.502441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00731f02-53c7-43a5-8a46-4da68e557ea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:56.505106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00731f02-53c7-43a5-8a46-4da68e557ea2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:56.519741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0be0bc14-2d75-4b6a-8e7e-0d30caf8511e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6df13c0313f490bb921ba23160fcb8d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:56.521923 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 982/1974] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:56.522778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00731f02-53c7-43a5-8a46-4da68e557ea2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:56.536231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-00731f02-53c7-43a5-8a46-4da68e557ea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:56.546203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0be0bc14-2d75-4b6a-8e7e-0d30caf8511e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6df13c0313f490bb921ba23160fcb8d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:56.562081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0be0bc14-2d75-4b6a-8e7e-0d30caf8511e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6df13c0313f490bb921ba23160fcb8d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:56.562737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00731f02-53c7-43a5-8a46-4da68e557ea2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:56.562879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0be0bc14-2d75-4b6a-8e7e-0d30caf8511e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6df13c0313f490bb921ba23160fcb8d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:56.569780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b463ed-3755-4cf5-85b1-c7837928c653 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:56.570672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b463ed-3755-4cf5-85b1-c7837928c653 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:56.574575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b463ed-3755-4cf5-85b1-c7837928c653 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:56.574575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b463ed-3755-4cf5-85b1-c7837928c653 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:56.585986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b463ed-3755-4cf5-85b1-c7837928c653 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:56.588375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b463ed-3755-4cf5-85b1-c7837928c653 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:56.623449 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 983/1975] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:56.624563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b463ed-3755-4cf5-85b1-c7837928c653 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:56.649513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0be0bc14-2d75-4b6a-8e7e-0d30caf8511e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6df13c0313f490bb921ba23160fcb8d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:56.660608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b463ed-3755-4cf5-85b1-c7837928c653 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:56.660721 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 993/1976] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:56 2022] DELETE /identity/v3/users/d6df13c0313f490bb921ba23160fcb8d => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:56.745528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052d225-47a6-4ff7-a692-79a78a223ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:56.746492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052d225-47a6-4ff7-a692-79a78a223ece admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:56.746861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052d225-47a6-4ff7-a692-79a78a223ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:56.747218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052d225-47a6-4ff7-a692-79a78a223ece admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:56.748413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052d225-47a6-4ff7-a692-79a78a223ece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:56.750902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b052d225-47a6-4ff7-a692-79a78a223ece admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:56.771429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0bc14-2d75-4b6a-8e7e-0d30caf8511e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:56.772928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0be0bc14-2d75-4b6a-8e7e-0d30caf8511e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:56.796299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0bc14-2d75-4b6a-8e7e-0d30caf8511e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:56.808036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97737b3e-4db9-4209-9aa8-207ebe66bd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:56.809484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97737b3e-4db9-4209-9aa8-207ebe66bd48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:56.818414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97737b3e-4db9-4209-9aa8-207ebe66bd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:56.819272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97737b3e-4db9-4209-9aa8-207ebe66bd48 admin admin] PATH_INFO: `/v3/projects/c921977042c74bb1a58ef9d92e8b1d51` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:56.822844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97737b3e-4db9-4209-9aa8-207ebe66bd48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c921977042c74bb1a58ef9d92e8b1d51)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:56.826601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97737b3e-4db9-4209-9aa8-207ebe66bd48 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:56.879761 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 984/1977] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:56 2022] POST /identity/v3/projects => generated 385 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:56.885697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052d225-47a6-4ff7-a692-79a78a223ece admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:56.887467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b052d225-47a6-4ff7-a692-79a78a223ece admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:56.976346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b052d225-47a6-4ff7-a692-79a78a223ece admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:56.984167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-97737b3e-4db9-4209-9aa8-207ebe66bd48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c921977042c74bb1a58ef9d92e8b1d51', 'request_id': 'req-97737b3e-4db9-4209-9aa8-207ebe66bd48'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:56.995249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-97737b3e-4db9-4209-9aa8-207ebe66bd48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c921977042c74bb1a58ef9d92e8b1d51', 'request_id': 'req-97737b3e-4db9-4209-9aa8-207ebe66bd48'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:57.005855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-97737b3e-4db9-4209-9aa8-207ebe66bd48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c921977042c74bb1a58ef9d92e8b1d51', 'request_id': 'req-97737b3e-4db9-4209-9aa8-207ebe66bd48'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:57.081819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1f55e-fdab-4e5d-a1ad-d56a46f4ae60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:57.082854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1f55e-fdab-4e5d-a1ad-d56a46f4ae60 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:57.083249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1f55e-fdab-4e5d-a1ad-d56a46f4ae60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:57.083650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1f55e-fdab-4e5d-a1ad-d56a46f4ae60 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:57.084408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1f55e-fdab-4e5d-a1ad-d56a46f4ae60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:57.086937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c1f55e-fdab-4e5d-a1ad-d56a46f4ae60 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:57.134608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-97737b3e-4db9-4209-9aa8-207ebe66bd48 admin admin] The token cache is being invalidate because project c921977042c74bb1a58ef9d92e8b1d51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:57.134968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-97737b3e-4db9-4209-9aa8-207ebe66bd48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:57.138876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-97737b3e-4db9-4209-9aa8-207ebe66bd48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:57.141503 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 994/1978] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:56 2022] DELETE /identity/v3/projects/c921977042c74bb1a58ef9d92e8b1d51 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:57.145198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97737b3e-4db9-4209-9aa8-207ebe66bd48 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:57.147081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-97737b3e-4db9-4209-9aa8-207ebe66bd48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:57.162383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97737b3e-4db9-4209-9aa8-207ebe66bd48 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:57.168777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5368a34-0de0-4870-9fb0-78c3cfdbf4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:57.169690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5368a34-0de0-4870-9fb0-78c3cfdbf4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:57.170420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5368a34-0de0-4870-9fb0-78c3cfdbf4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:57.170716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5368a34-0de0-4870-9fb0-78c3cfdbf4ca admin admin] PATH_INFO: `/v3/users/100f182672a2445db612508a3e543fa0` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:57.171984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5368a34-0de0-4870-9fb0-78c3cfdbf4ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=100f182672a2445db612508a3e543fa0)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:57.174066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5368a34-0de0-4870-9fb0-78c3cfdbf4ca admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:57.197729 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 985/1979] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:56 2022] POST /identity/v3/users => generated 293 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:11:57.201413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1f55e-fdab-4e5d-a1ad-d56a46f4ae60 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:57.210190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-72c1f55e-fdab-4e5d-a1ad-d56a46f4ae60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:57.229669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1f55e-fdab-4e5d-a1ad-d56a46f4ae60 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:57.234789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796aee2f-3f3a-4826-a72c-63c148e76652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:57.235528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aee2f-3f3a-4826-a72c-63c148e76652 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:57.235831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aee2f-3f3a-4826-a72c-63c148e76652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:57.236635 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aee2f-3f3a-4826-a72c-63c148e76652 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:57.237034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796aee2f-3f3a-4826-a72c-63c148e76652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:57.239108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796aee2f-3f3a-4826-a72c-63c148e76652 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:57.253718 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 986/1980] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:11:57.257749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796aee2f-3f3a-4826-a72c-63c148e76652 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:57.270225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796aee2f-3f3a-4826-a72c-63c148e76652 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:57.277697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec12f2f-87d1-46f9-b1da-a2a490d06977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:57.278684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec12f2f-87d1-46f9-b1da-a2a490d06977 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:57.279012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec12f2f-87d1-46f9-b1da-a2a490d06977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:57.279301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec12f2f-87d1-46f9-b1da-a2a490d06977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:57.280047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec12f2f-87d1-46f9-b1da-a2a490d06977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:57.281701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec12f2f-87d1-46f9-b1da-a2a490d06977 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:57.294031 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 987/1981] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:11:57.302646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec12f2f-87d1-46f9-b1da-a2a490d06977 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:57.313715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec12f2f-87d1-46f9-b1da-a2a490d06977 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:57.319018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba39a0-c487-423c-94c9-2e149f75adc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:57.320061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba39a0-c487-423c-94c9-2e149f75adc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:57.320437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba39a0-c487-423c-94c9-2e149f75adc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:57.321024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba39a0-c487-423c-94c9-2e149f75adc1 admin admin] PATH_INFO: `/v3/projects/42ae6454290d47d295bf0b0833de9a52/users/ce5e1a5541ff4454b5c37b8a57d5e0d5/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:57.338434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba39a0-c487-423c-94c9-2e149f75adc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42ae6454290d47d295bf0b0833de9a52, user_id=ce5e1a5541ff4454b5c37b8a57d5e0d5, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:57.341079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba39a0-c487-423c-94c9-2e149f75adc1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:57.397217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b5368a34-0de0-4870-9fb0-78c3cfdbf4ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '100f182672a2445db612508a3e543fa0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:57.413279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b5368a34-0de0-4870-9fb0-78c3cfdbf4ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '100f182672a2445db612508a3e543fa0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:57.422744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b5368a34-0de0-4870-9fb0-78c3cfdbf4ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '100f182672a2445db612508a3e543fa0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:57.424355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b5368a34-0de0-4870-9fb0-78c3cfdbf4ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '100f182672a2445db612508a3e543fa0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:57.460885 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 988/1982] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:57 2022] PUT /identity/v3/projects/42ae6454290d47d295bf0b0833de9a52/users/ce5e1a5541ff4454b5c37b8a57d5e0d5/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:11:57.462015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba39a0-c487-423c-94c9-2e149f75adc1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:57.464220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-09ba39a0-c487-423c-94c9-2e149f75adc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:57.539213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba39a0-c487-423c-94c9-2e149f75adc1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:57.549745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f6e34-a55b-46b6-9536-55b332c403a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:57.549745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f6e34-a55b-46b6-9536-55b332c403a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:57.549745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f6e34-a55b-46b6-9536-55b332c403a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:57.549745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f6e34-a55b-46b6-9536-55b332c403a7 admin admin] PATH_INFO: `/v3/projects/b767cc23f21c4fc29c82b36fd1fe71e6` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:57.550840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f6e34-a55b-46b6-9536-55b332c403a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b767cc23f21c4fc29c82b36fd1fe71e6)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:57.553552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f6e34-a55b-46b6-9536-55b332c403a7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:57.574677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b5368a34-0de0-4870-9fb0-78c3cfdbf4ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '100f182672a2445db612508a3e543fa0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:57.605024 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 995/1983] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:57 2022] DELETE /identity/v3/users/100f182672a2445db612508a3e543fa0 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:57.608982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d89858-1525-467c-a6fe-d1ea96e852c9 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:57.609920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d89858-1525-467c-a6fe-d1ea96e852c9 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:57.610398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d89858-1525-467c-a6fe-d1ea96e852c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:57.663171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d8d89858-1525-467c-a6fe-d1ea96e852c9 None None] MFA Rules not processed for user `ce5e1a5541ff4454b5c37b8a57d5e0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:57.665740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d8d89858-1525-467c-a6fe-d1ea96e852c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:57.723736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-769f6e34-a55b-46b6-9536-55b332c403a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b767cc23f21c4fc29c82b36fd1fe71e6', 'request_id': 'req-769f6e34-a55b-46b6-9536-55b332c403a7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:57.759593 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 996/1984] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:57.761413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d89858-1525-467c-a6fe-d1ea96e852c9 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:57.763111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d8d89858-1525-467c-a6fe-d1ea96e852c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:57.788774 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:57.815508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-769f6e34-a55b-46b6-9536-55b332c403a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b767cc23f21c4fc29c82b36fd1fe71e6', 'request_id': 'req-769f6e34-a55b-46b6-9536-55b332c403a7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:57.823107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-769f6e34-a55b-46b6-9536-55b332c403a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b767cc23f21c4fc29c82b36fd1fe71e6', 'request_id': 'req-769f6e34-a55b-46b6-9536-55b332c403a7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:57.838125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-769f6e34-a55b-46b6-9536-55b332c403a7 admin admin] The token cache is being invalidate because project b767cc23f21c4fc29c82b36fd1fe71e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:57.838447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-769f6e34-a55b-46b6-9536-55b332c403a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:57.839263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-769f6e34-a55b-46b6-9536-55b332c403a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:57.844145 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 989/1985] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:57 2022] DELETE /identity/v3/projects/b767cc23f21c4fc29c82b36fd1fe71e6 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:57.847217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f6e34-a55b-46b6-9536-55b332c403a7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:57.849356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-769f6e34-a55b-46b6-9536-55b332c403a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:57.860060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d89858-1525-467c-a6fe-d1ea96e852c9 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:57.907959 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:57.956008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229d426-3e38-4986-9060-f0e462e10a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:57.956742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229d426-3e38-4986-9060-f0e462e10a61 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:57.957235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229d426-3e38-4986-9060-f0e462e10a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:57.957706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229d426-3e38-4986-9060-f0e462e10a61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:57.958541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229d426-3e38-4986-9060-f0e462e10a61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:57.961165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229d426-3e38-4986-9060-f0e462e10a61 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:57.963670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f6e34-a55b-46b6-9536-55b332c403a7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:57.970888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cace30e-05db-4685-b0ae-d50715a969d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:57.971858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cace30e-05db-4685-b0ae-d50715a969d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:57.972147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cace30e-05db-4685-b0ae-d50715a969d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:57.972916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cace30e-05db-4685-b0ae-d50715a969d8 admin admin] PATH_INFO: `/v3/users/9a33451759db406e96f5db1d8b9adba3` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:57.974541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cace30e-05db-4685-b0ae-d50715a969d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a33451759db406e96f5db1d8b9adba3)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:57.980307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cace30e-05db-4685-b0ae-d50715a969d8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:58.098141 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 997/1986] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:57 2022] POST /identity/v3/projects => generated 385 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:11:58.100365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229d426-3e38-4986-9060-f0e462e10a61 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:58.105976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a229d426-3e38-4986-9060-f0e462e10a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:58.207740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229d426-3e38-4986-9060-f0e462e10a61 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:58.214739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf143345-258f-44d4-84b0-410556b4e9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:58.215859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf143345-258f-44d4-84b0-410556b4e9bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:58.216149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf143345-258f-44d4-84b0-410556b4e9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:58.216431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf143345-258f-44d4-84b0-410556b4e9bc admin admin] PATH_INFO: `/v3/projects/1866e714fd1b4da9a2fcdbba28104da0` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:58.218016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf143345-258f-44d4-84b0-410556b4e9bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1866e714fd1b4da9a2fcdbba28104da0)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:58.220746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf143345-258f-44d4-84b0-410556b4e9bc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:58.222370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0cace30e-05db-4685-b0ae-d50715a969d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a33451759db406e96f5db1d8b9adba3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:58.249035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0cace30e-05db-4685-b0ae-d50715a969d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a33451759db406e96f5db1d8b9adba3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:58.250356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0cace30e-05db-4685-b0ae-d50715a969d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a33451759db406e96f5db1d8b9adba3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:58.253633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0cace30e-05db-4685-b0ae-d50715a969d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a33451759db406e96f5db1d8b9adba3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:58.263286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0cace30e-05db-4685-b0ae-d50715a969d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a33451759db406e96f5db1d8b9adba3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:58.350520 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 990/1987] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:57 2022] DELETE /identity/v3/users/9a33451759db406e96f5db1d8b9adba3 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:58.351804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cace30e-05db-4685-b0ae-d50715a969d8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:58.361985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bf143345-258f-44d4-84b0-410556b4e9bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1866e714fd1b4da9a2fcdbba28104da0', 'request_id': 'req-bf143345-258f-44d4-84b0-410556b4e9bc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:58.362191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0cace30e-05db-4685-b0ae-d50715a969d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:58.369390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bf143345-258f-44d4-84b0-410556b4e9bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1866e714fd1b4da9a2fcdbba28104da0', 'request_id': 'req-bf143345-258f-44d4-84b0-410556b4e9bc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:58.377276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bf143345-258f-44d4-84b0-410556b4e9bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1866e714fd1b4da9a2fcdbba28104da0', 'request_id': 'req-bf143345-258f-44d4-84b0-410556b4e9bc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:58.491469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bf143345-258f-44d4-84b0-410556b4e9bc admin admin] The token cache is being invalidate because project 1866e714fd1b4da9a2fcdbba28104da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:58.492112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bf143345-258f-44d4-84b0-410556b4e9bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:58.493687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bf143345-258f-44d4-84b0-410556b4e9bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:58.495650 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 998/1988] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:58 2022] DELETE /identity/v3/projects/1866e714fd1b4da9a2fcdbba28104da0 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:58.498386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58b13c-3f23-4b4a-b785-320ce859dcac None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:58.499025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58b13c-3f23-4b4a-b785-320ce859dcac None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:58.499387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58b13c-3f23-4b4a-b785-320ce859dcac None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:58.506627 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 999/1989] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:11:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:11:58.508665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd8aff-3ebd-44c7-a7b2-2a9fbd73c0b7 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:58.509029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd8aff-3ebd-44c7-a7b2-2a9fbd73c0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:58.509414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd8aff-3ebd-44c7-a7b2-2a9fbd73c0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:58.525905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cace30e-05db-4685-b0ae-d50715a969d8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:58.544707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96047d-88f5-45eb-bcee-ce57e2d39da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:58.544707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96047d-88f5-45eb-bcee-ce57e2d39da0 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:58.544707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96047d-88f5-45eb-bcee-ce57e2d39da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:58.545047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96047d-88f5-45eb-bcee-ce57e2d39da0 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:58.547737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96047d-88f5-45eb-bcee-ce57e2d39da0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:58.554195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96047d-88f5-45eb-bcee-ce57e2d39da0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:58.555677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-eedd8aff-3ebd-44c7-a7b2-2a9fbd73c0b7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:58.557191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-eedd8aff-3ebd-44c7-a7b2-2a9fbd73c0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:58.593406 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1000/1990] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:58.594983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462fa55-6818-4297-b2e0-0cb7ca797590 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:58.595278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462fa55-6818-4297-b2e0-0cb7ca797590 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:58.596315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c462fa55-6818-4297-b2e0-0cb7ca797590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:58.655840 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 991/1991] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:58 2022] POST /identity/v3/users => generated 299 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:58.655840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96047d-88f5-45eb-bcee-ce57e2d39da0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:58.660400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2b96047d-88f5-45eb-bcee-ce57e2d39da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:58.678925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c462fa55-6818-4297-b2e0-0cb7ca797590 None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:58.680440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c462fa55-6818-4297-b2e0-0cb7ca797590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:58.689052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96047d-88f5-45eb-bcee-ce57e2d39da0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:58.704270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e639e2-3667-4024-b3ba-7d073042008f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:58.705477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e639e2-3667-4024-b3ba-7d073042008f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:58.705578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e639e2-3667-4024-b3ba-7d073042008f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:58.705837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e639e2-3667-4024-b3ba-7d073042008f admin admin] PATH_INFO: `/v3/projects/0cab290a04db4df48168d6cb27e8cf3d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:58.707684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e639e2-3667-4024-b3ba-7d073042008f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cab290a04db4df48168d6cb27e8cf3d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:58.709629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e639e2-3667-4024-b3ba-7d073042008f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:58.809003 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1001/1992] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:11:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:58.810371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb99509-0585-4d1e-851b-50b5aef8b006 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:58.810662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb99509-0585-4d1e-851b-50b5aef8b006 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:58.810940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb99509-0585-4d1e-851b-50b5aef8b006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:58.828723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-afb99509-0585-4d1e-851b-50b5aef8b006 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:58.829932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-afb99509-0585-4d1e-851b-50b5aef8b006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:58.838913 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1002/1993] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:58.839947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb99509-0585-4d1e-851b-50b5aef8b006 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:58.842021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-afb99509-0585-4d1e-851b-50b5aef8b006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:58.872403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb99509-0585-4d1e-851b-50b5aef8b006 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:58.883550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c2e639e2-3667-4024-b3ba-7d073042008f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cab290a04db4df48168d6cb27e8cf3d', 'request_id': 'req-c2e639e2-3667-4024-b3ba-7d073042008f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:58.947060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdc8a9-c69e-47f8-b47d-6727a5bff180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:58.947919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdc8a9-c69e-47f8-b47d-6727a5bff180 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:58.948094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdc8a9-c69e-47f8-b47d-6727a5bff180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:58.948361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdc8a9-c69e-47f8-b47d-6727a5bff180 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:58.949111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdc8a9-c69e-47f8-b47d-6727a5bff180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:58.950997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fdc8a9-c69e-47f8-b47d-6727a5bff180 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:58.966970 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1003/1994] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:58.968322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdc8a9-c69e-47f8-b47d-6727a5bff180 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:58.981702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fdc8a9-c69e-47f8-b47d-6727a5bff180 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:58.988745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c83af-4212-4d0f-bad4-ed9f366e932e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:58.989501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c83af-4212-4d0f-bad4-ed9f366e932e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:58.991895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c2e639e2-3667-4024-b3ba-7d073042008f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cab290a04db4df48168d6cb27e8cf3d', 'request_id': 'req-c2e639e2-3667-4024-b3ba-7d073042008f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:58.994061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c83af-4212-4d0f-bad4-ed9f366e932e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:58.994468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c83af-4212-4d0f-bad4-ed9f366e932e admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:58.995360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c83af-4212-4d0f-bad4-ed9f366e932e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:11:58.995739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c83af-4212-4d0f-bad4-ed9f366e932e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:58.997549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c83af-4212-4d0f-bad4-ed9f366e932e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:59.007033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c2e639e2-3667-4024-b3ba-7d073042008f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cab290a04db4df48168d6cb27e8cf3d', 'request_id': 'req-c2e639e2-3667-4024-b3ba-7d073042008f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:59.025470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c2e639e2-3667-4024-b3ba-7d073042008f admin admin] The token cache is being invalidate because project 0cab290a04db4df48168d6cb27e8cf3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:59.025470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c2e639e2-3667-4024-b3ba-7d073042008f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:59.026323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c2e639e2-3667-4024-b3ba-7d073042008f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:59.030435 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 992/1995] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:58 2022] DELETE /identity/v3/projects/0cab290a04db4df48168d6cb27e8cf3d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:59.030435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e639e2-3667-4024-b3ba-7d073042008f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:59.031520 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1004/1996] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:59.032893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c83af-4212-4d0f-bad4-ed9f366e932e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:59.033528 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:59.035100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7a5c83af-4212-4d0f-bad4-ed9f366e932e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:59.035303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c2e639e2-3667-4024-b3ba-7d073042008f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:59.050804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c83af-4212-4d0f-bad4-ed9f366e932e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:59.060573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fbb61-b701-4152-ba30-7a7d270d47c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:59.062614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fbb61-b701-4152-ba30-7a7d270d47c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:59.063127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fbb61-b701-4152-ba30-7a7d270d47c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:59.063641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fbb61-b701-4152-ba30-7a7d270d47c0 admin admin] PATH_INFO: `/v3/projects/4dbda44d0f6d46e5a9dfa163b9b5250f/users/e0eeb70015f241229c7eae5dbcecbd2c/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:59.083093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fbb61-b701-4152-ba30-7a7d270d47c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dbda44d0f6d46e5a9dfa163b9b5250f, user_id=e0eeb70015f241229c7eae5dbcecbd2c, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:59.085756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fbb61-b701-4152-ba30-7a7d270d47c0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:59.123500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e639e2-3667-4024-b3ba-7d073042008f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:59.129322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4b1db-4d51-4ae1-9b0a-27bd5077f11f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:59.130067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4b1db-4d51-4ae1-9b0a-27bd5077f11f service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:59.130396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4b1db-4d51-4ae1-9b0a-27bd5077f11f service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:59.130681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4b1db-4d51-4ae1-9b0a-27bd5077f11f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:59.132557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-91b4b1db-4d51-4ae1-9b0a-27bd5077f11f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:59.146185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4b1db-4d51-4ae1-9b0a-27bd5077f11f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:59.148236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4b1db-4d51-4ae1-9b0a-27bd5077f11f service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:59.159462 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 993/1997] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:11:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:11:59.160266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4b1db-4d51-4ae1-9b0a-27bd5077f11f service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:59.161843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-91b4b1db-4d51-4ae1-9b0a-27bd5077f11f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:59.175526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4b1db-4d51-4ae1-9b0a-27bd5077f11f service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:59.180877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a13f9-a63b-4055-897a-c8c27ca47971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:59.184565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a13f9-a63b-4055-897a-c8c27ca47971 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:59.184565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a13f9-a63b-4055-897a-c8c27ca47971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:59.184565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a13f9-a63b-4055-897a-c8c27ca47971 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:59.184565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a13f9-a63b-4055-897a-c8c27ca47971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:59.186056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a13f9-a63b-4055-897a-c8c27ca47971 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:59.193102 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1005/1998] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:59 2022] PUT /identity/v3/projects/4dbda44d0f6d46e5a9dfa163b9b5250f/users/e0eeb70015f241229c7eae5dbcecbd2c/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:59.197530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde38627-3bbe-4fd4-ad0a-766d7d47719f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:59.198045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde38627-3bbe-4fd4-ad0a-766d7d47719f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:59.198540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde38627-3bbe-4fd4-ad0a-766d7d47719f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:59.245493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-bde38627-3bbe-4fd4-ad0a-766d7d47719f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:59.246771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bde38627-3bbe-4fd4-ad0a-766d7d47719f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:59.281506 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 994/1999] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:59 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:59.285219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a13f9-a63b-4055-897a-c8c27ca47971 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:59.286913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f65a13f9-a63b-4055-897a-c8c27ca47971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:59.301718 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:11:59.328648 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1006/2000] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:59.329481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde38627-3bbe-4fd4-ad0a-766d7d47719f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:59.348554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde38627-3bbe-4fd4-ad0a-766d7d47719f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:59.362457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a13f9-a63b-4055-897a-c8c27ca47971 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:59.367418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed9f61-243a-498b-82cb-69dfd36bdce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:59.368399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed9f61-243a-498b-82cb-69dfd36bdce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:59.368691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed9f61-243a-498b-82cb-69dfd36bdce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:59.368981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed9f61-243a-498b-82cb-69dfd36bdce8 admin admin] PATH_INFO: `/v3/projects/6c36ff897dd64324818ffe555d366b17` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:59.370247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed9f61-243a-498b-82cb-69dfd36bdce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c36ff897dd64324818ffe555d366b17)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:59.373156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed9f61-243a-498b-82cb-69dfd36bdce8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:59.416122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df49f6-d509-43cd-b0f6-4f232c93c4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:59.416849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df49f6-d509-43cd-b0f6-4f232c93c4fe admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:59.417187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df49f6-d509-43cd-b0f6-4f232c93c4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:59.417469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df49f6-d509-43cd-b0f6-4f232c93c4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:59.418377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df49f6-d509-43cd-b0f6-4f232c93c4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:59.420366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df49f6-d509-43cd-b0f6-4f232c93c4fe admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:59.431109 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1007/2001] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:59.432625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df49f6-d509-43cd-b0f6-4f232c93c4fe admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:59.442833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df49f6-d509-43cd-b0f6-4f232c93c4fe admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:59.448751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66080d-bec8-4107-afc7-34c5d87b5d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:59.449103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66080d-bec8-4107-afc7-34c5d87b5d75 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:59.449395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66080d-bec8-4107-afc7-34c5d87b5d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:59.449681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66080d-bec8-4107-afc7-34c5d87b5d75 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:59.450414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66080d-bec8-4107-afc7-34c5d87b5d75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:59.452399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66080d-bec8-4107-afc7-34c5d87b5d75 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:59.498304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-75ed9f61-243a-498b-82cb-69dfd36bdce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c36ff897dd64324818ffe555d366b17', 'request_id': 'req-75ed9f61-243a-498b-82cb-69dfd36bdce8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:59.539220 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1008/2002] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:11:59 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:11:59.541471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986a850-f6d9-4282-a770-8bb465485299 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:59.541976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986a850-f6d9-4282-a770-8bb465485299 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:59.542469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986a850-f6d9-4282-a770-8bb465485299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:59.561894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0986a850-f6d9-4282-a770-8bb465485299 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:59.563141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0986a850-f6d9-4282-a770-8bb465485299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:59.615462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-75ed9f61-243a-498b-82cb-69dfd36bdce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c36ff897dd64324818ffe555d366b17', 'request_id': 'req-75ed9f61-243a-498b-82cb-69dfd36bdce8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:59.624622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-75ed9f61-243a-498b-82cb-69dfd36bdce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c36ff897dd64324818ffe555d366b17', 'request_id': 'req-75ed9f61-243a-498b-82cb-69dfd36bdce8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:59.636833 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1009/2003] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:59.637789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986a850-f6d9-4282-a770-8bb465485299 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:59.651053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986a850-f6d9-4282-a770-8bb465485299 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:59.656461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d535173-9038-49f3-93f9-1abc317ca2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:59.657369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d535173-9038-49f3-93f9-1abc317ca2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:59.657654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d535173-9038-49f3-93f9-1abc317ca2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:59.657982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d535173-9038-49f3-93f9-1abc317ca2a0 admin admin] PATH_INFO: `/v3/projects/4dbda44d0f6d46e5a9dfa163b9b5250f/users/e0eeb70015f241229c7eae5dbcecbd2c/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:59.660091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d535173-9038-49f3-93f9-1abc317ca2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dbda44d0f6d46e5a9dfa163b9b5250f, user_id=e0eeb70015f241229c7eae5dbcecbd2c, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:59.660530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-75ed9f61-243a-498b-82cb-69dfd36bdce8 admin admin] The token cache is being invalidate because project 6c36ff897dd64324818ffe555d366b17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:11:59.660831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-75ed9f61-243a-498b-82cb-69dfd36bdce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:59.661568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-75ed9f61-243a-498b-82cb-69dfd36bdce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:59.662897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d535173-9038-49f3-93f9-1abc317ca2a0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:59.664449 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 995/2004] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:11:59 2022] DELETE /identity/v3/projects/6c36ff897dd64324818ffe555d366b17 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:59.664449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed9f61-243a-498b-82cb-69dfd36bdce8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:59.665385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-75ed9f61-243a-498b-82cb-69dfd36bdce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:59.673985 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1010/2005] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:11:59 2022] PUT /identity/v3/projects/4dbda44d0f6d46e5a9dfa163b9b5250f/users/e0eeb70015f241229c7eae5dbcecbd2c/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:11:59.674859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d535173-9038-49f3-93f9-1abc317ca2a0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:59.676437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1d535173-9038-49f3-93f9-1abc317ca2a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:59.678358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed9f61-243a-498b-82cb-69dfd36bdce8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:59.741897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc724ed8-67cd-4ef9-b520-53056da4bf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:59.742748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc724ed8-67cd-4ef9-b520-53056da4bf0a admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:59.743051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc724ed8-67cd-4ef9-b520-53056da4bf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:59.743336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc724ed8-67cd-4ef9-b520-53056da4bf0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:59.744203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc724ed8-67cd-4ef9-b520-53056da4bf0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:59.745942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc724ed8-67cd-4ef9-b520-53056da4bf0a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:59.748437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d535173-9038-49f3-93f9-1abc317ca2a0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:59.753468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a141b5-947f-4f8b-ab4e-ca6c5ef2aa67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:59.754189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a141b5-947f-4f8b-ab4e-ca6c5ef2aa67 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:59.754482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a141b5-947f-4f8b-ab4e-ca6c5ef2aa67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:59.754765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a141b5-947f-4f8b-ab4e-ca6c5ef2aa67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:59.755561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a141b5-947f-4f8b-ab4e-ca6c5ef2aa67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:11:59.755873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a141b5-947f-4f8b-ab4e-ca6c5ef2aa67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:59.760448 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 996/2006] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:59.760597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a141b5-947f-4f8b-ab4e-ca6c5ef2aa67 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:59.760710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc724ed8-67cd-4ef9-b520-53056da4bf0a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:59.762478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cc724ed8-67cd-4ef9-b520-53056da4bf0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:59.773582 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1011/2007] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:11:59.773582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1367b2-57fe-4f9d-a1ce-c81cb39bbbbf None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:59.773582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1367b2-57fe-4f9d-a1ce-c81cb39bbbbf None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:59.773582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1367b2-57fe-4f9d-a1ce-c81cb39bbbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:59.776403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc724ed8-67cd-4ef9-b520-53056da4bf0a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:59.781236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4c6bd-541d-41f0-9ed1-829bf46b5f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:59.782142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4c6bd-541d-41f0-9ed1-829bf46b5f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:59.782436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4c6bd-541d-41f0-9ed1-829bf46b5f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:59.782717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4c6bd-541d-41f0-9ed1-829bf46b5f38 admin admin] PATH_INFO: `/v3/users/d64b8be958ec478fa923f7146288b0ae` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:59.784039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4c6bd-541d-41f0-9ed1-829bf46b5f38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d64b8be958ec478fa923f7146288b0ae)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:59.785952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4c6bd-541d-41f0-9ed1-829bf46b5f38 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:59.801427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-dd1367b2-57fe-4f9d-a1ce-c81cb39bbbbf None None] MFA Rules not processed for user `e0eeb70015f241229c7eae5dbcecbd2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:11:59.802652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dd1367b2-57fe-4f9d-a1ce-c81cb39bbbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:11:59.874686 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1012/2008] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:11:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:11:59.875917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1367b2-57fe-4f9d-a1ce-c81cb39bbbbf None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:59.887081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1367b2-57fe-4f9d-a1ce-c81cb39bbbbf None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:59.892316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856a418-7e04-49d2-8ac9-39e502bf969f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:59.893111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856a418-7e04-49d2-8ac9-39e502bf969f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:59.893404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856a418-7e04-49d2-8ac9-39e502bf969f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:59.893727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856a418-7e04-49d2-8ac9-39e502bf969f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:59.894452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856a418-7e04-49d2-8ac9-39e502bf969f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:59.896054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856a418-7e04-49d2-8ac9-39e502bf969f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:59.906808 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1013/2009] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:11:59.907618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856a418-7e04-49d2-8ac9-39e502bf969f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:11:59.919571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856a418-7e04-49d2-8ac9-39e502bf969f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:11:59.925234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cde13-9215-4760-9f28-e93704b6981d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:11:59.925518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cde13-9215-4760-9f28-e93704b6981d admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:11:59.925805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cde13-9215-4760-9f28-e93704b6981d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:11:59.926081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cde13-9215-4760-9f28-e93704b6981d admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:11:59.926800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cde13-9215-4760-9f28-e93704b6981d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:11:59.928699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361cde13-9215-4760-9f28-e93704b6981d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:11:59.986787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-72e4c6bd-541d-41f0-9ed1-829bf46b5f38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd64b8be958ec478fa923f7146288b0ae'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:59.998257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-72e4c6bd-541d-41f0-9ed1-829bf46b5f38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd64b8be958ec478fa923f7146288b0ae'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:59.998932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-72e4c6bd-541d-41f0-9ed1-829bf46b5f38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd64b8be958ec478fa923f7146288b0ae'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:11:59.999554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-72e4c6bd-541d-41f0-9ed1-829bf46b5f38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd64b8be958ec478fa923f7146288b0ae'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:00.003425 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:00.009433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-72e4c6bd-541d-41f0-9ed1-829bf46b5f38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd64b8be958ec478fa923f7146288b0ae'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:00.022940 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1014/2010] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:11:59 2022] POST /identity/v3/projects => generated 393 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:00.025046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddf0ad-2ef2-423b-955c-3f94234db3e1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:00.025568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddf0ad-2ef2-423b-955c-3f94234db3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:00.025854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddf0ad-2ef2-423b-955c-3f94234db3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:00.043681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-96ddf0ad-2ef2-423b-955c-3f94234db3e1 None None] MFA Rules not processed for user `ce5e1a5541ff4454b5c37b8a57d5e0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:00.044881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-96ddf0ad-2ef2-423b-955c-3f94234db3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:00.078560 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 997/2011] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:11:59 2022] DELETE /identity/v3/users/d64b8be958ec478fa923f7146288b0ae => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:00.079499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4c6bd-541d-41f0-9ed1-829bf46b5f38 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:00.081017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-72e4c6bd-541d-41f0-9ed1-829bf46b5f38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:00.109590 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1015/2012] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:00.110129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddf0ad-2ef2-423b-955c-3f94234db3e1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:00.111656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-96ddf0ad-2ef2-423b-955c-3f94234db3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:00.202546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4c6bd-541d-41f0-9ed1-829bf46b5f38 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:00.202685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddf0ad-2ef2-423b-955c-3f94234db3e1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:00.207912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6531ab-9205-4487-8b4e-bcd029089cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:00.208821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6531ab-9205-4487-8b4e-bcd029089cda admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:00.209105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6531ab-9205-4487-8b4e-bcd029089cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:00.209383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6531ab-9205-4487-8b4e-bcd029089cda admin admin] PATH_INFO: `/v3/projects/865186bd56854ed987845ceb4b62aa2d/users/a6fc909d2c0843b8a29eb1d47a755db9/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:00.218831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971d3a7-312d-4ac8-b3be-cbdb2f948bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:00.219831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971d3a7-312d-4ac8-b3be-cbdb2f948bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:00.221780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971d3a7-312d-4ac8-b3be-cbdb2f948bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:00.221780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971d3a7-312d-4ac8-b3be-cbdb2f948bb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:00.222530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971d3a7-312d-4ac8-b3be-cbdb2f948bb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:00.224821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971d3a7-312d-4ac8-b3be-cbdb2f948bb2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:00.229791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6531ab-9205-4487-8b4e-bcd029089cda admin admin] RBAC: Authorizing `identity:create_grant(project_id=865186bd56854ed987845ceb4b62aa2d, user_id=a6fc909d2c0843b8a29eb1d47a755db9, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:00.232924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6531ab-9205-4487-8b4e-bcd029089cda admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:00.306479 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=79,keystone:INSERT=3,keystone:DELETE=18 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:00.343198 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1016/2013] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:00 2022] POST /identity/v3/users => generated 297 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:00.344070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971d3a7-312d-4ac8-b3be-cbdb2f948bb2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:00.345839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5971d3a7-312d-4ac8-b3be-cbdb2f948bb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:00.371103 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 998/2014] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:00 2022] PUT /identity/v3/projects/865186bd56854ed987845ceb4b62aa2d/users/a6fc909d2c0843b8a29eb1d47a755db9/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:00.381993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6531ab-9205-4487-8b4e-bcd029089cda admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:00.436915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971d3a7-312d-4ac8-b3be-cbdb2f948bb2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:00.474609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6531ab-9205-4487-8b4e-bcd029089cda admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:00.480564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad32af9-45cc-410b-805b-cb2e2e7e9d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:00.481252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad32af9-45cc-410b-805b-cb2e2e7e9d6e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:00.481568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad32af9-45cc-410b-805b-cb2e2e7e9d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:00.481852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad32af9-45cc-410b-805b-cb2e2e7e9d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:00.482806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad32af9-45cc-410b-805b-cb2e2e7e9d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:00.484563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad32af9-45cc-410b-805b-cb2e2e7e9d6e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:00.496299 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 999/2015] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:00.497558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd7aaf-14cd-4270-89ca-e3fcf60954e9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:00.497855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd7aaf-14cd-4270-89ca-e3fcf60954e9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:00.498154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd7aaf-14cd-4270-89ca-e3fcf60954e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:00.504337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f050ad-0de1-4f04-a7ad-8599b1405a74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:00.504996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f050ad-0de1-4f04-a7ad-8599b1405a74 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:00.505283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f050ad-0de1-4f04-a7ad-8599b1405a74 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:00.505576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f050ad-0de1-4f04-a7ad-8599b1405a74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:00.507434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-65f050ad-0de1-4f04-a7ad-8599b1405a74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:00.526343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-eccd7aaf-14cd-4270-89ca-e3fcf60954e9 None None] MFA Rules not processed for user `a6fc909d2c0843b8a29eb1d47a755db9`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:00.527539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eccd7aaf-14cd-4270-89ca-e3fcf60954e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:00.566734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f050ad-0de1-4f04-a7ad-8599b1405a74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:00.571863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f050ad-0de1-4f04-a7ad-8599b1405a74 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:00.590058 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1017/2016] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:00.590058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f050ad-0de1-4f04-a7ad-8599b1405a74 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:00.595526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f050ad-0de1-4f04-a7ad-8599b1405a74 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:00.600898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a67c9-09a4-4632-8b3d-983e0d4d9e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:00.601743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a67c9-09a4-4632-8b3d-983e0d4d9e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:00.602118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a67c9-09a4-4632-8b3d-983e0d4d9e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:00.602611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a67c9-09a4-4632-8b3d-983e0d4d9e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:00.603464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a67c9-09a4-4632-8b3d-983e0d4d9e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:00.606136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a67c9-09a4-4632-8b3d-983e0d4d9e1a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:00.620495 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1018/2017] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:00.620495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a67c9-09a4-4632-8b3d-983e0d4d9e1a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:00.623692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-933a67c9-09a4-4632-8b3d-983e0d4d9e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:00.640270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a67c9-09a4-4632-8b3d-983e0d4d9e1a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:00.650163 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1000/2018] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:00.650163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd7aaf-14cd-4270-89ca-e3fcf60954e9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:00.665606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a10827-dfb5-486c-9959-3476d53e17f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:00.669976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd7aaf-14cd-4270-89ca-e3fcf60954e9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:00.670405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a10827-dfb5-486c-9959-3476d53e17f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:00.670405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a10827-dfb5-486c-9959-3476d53e17f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:00.670405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a10827-dfb5-486c-9959-3476d53e17f7 admin admin] PATH_INFO: `/v3/projects/1cc443417b7a44a196ee01dd6af62a39` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:00.670405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a10827-dfb5-486c-9959-3476d53e17f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc443417b7a44a196ee01dd6af62a39)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:00.672765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316187b-3e3f-4ba4-b606-b0fce4b8d425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:00.673893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316187b-3e3f-4ba4-b606-b0fce4b8d425 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:00.674280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316187b-3e3f-4ba4-b606-b0fce4b8d425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:00.674636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316187b-3e3f-4ba4-b606-b0fce4b8d425 admin admin] PATH_INFO: `/v3/projects/01322d2c8e434ffb8a8e0f4e2965f41d/users/641a6e6fe0cb4fa7a578591187d930d4/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:00.676898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a10827-dfb5-486c-9959-3476d53e17f7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:00.693843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316187b-3e3f-4ba4-b606-b0fce4b8d425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01322d2c8e434ffb8a8e0f4e2965f41d, user_id=641a6e6fe0cb4fa7a578591187d930d4, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:00.698493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316187b-3e3f-4ba4-b606-b0fce4b8d425 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:00.782530 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1001/2019] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:00 2022] PUT /identity/v3/projects/01322d2c8e434ffb8a8e0f4e2965f41d/users/641a6e6fe0cb4fa7a578591187d930d4/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:00.783132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316187b-3e3f-4ba4-b606-b0fce4b8d425 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:00.851458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-07a10827-dfb5-486c-9959-3476d53e17f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc443417b7a44a196ee01dd6af62a39', 'request_id': 'req-07a10827-dfb5-486c-9959-3476d53e17f7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:00.860202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-07a10827-dfb5-486c-9959-3476d53e17f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc443417b7a44a196ee01dd6af62a39', 'request_id': 'req-07a10827-dfb5-486c-9959-3476d53e17f7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:00.860818 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:00.874542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-07a10827-dfb5-486c-9959-3476d53e17f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc443417b7a44a196ee01dd6af62a39', 'request_id': 'req-07a10827-dfb5-486c-9959-3476d53e17f7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:00.881571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316187b-3e3f-4ba4-b606-b0fce4b8d425 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:00.933488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-07a10827-dfb5-486c-9959-3476d53e17f7 admin admin] The token cache is being invalidate because project 1cc443417b7a44a196ee01dd6af62a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:00.933781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-07a10827-dfb5-486c-9959-3476d53e17f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:00.936529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-07a10827-dfb5-486c-9959-3476d53e17f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:00.938139 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1019/2020] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:00 2022] DELETE /identity/v3/projects/1cc443417b7a44a196ee01dd6af62a39 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:00.939443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a99313-dfa2-4998-ad60-bad0e273984d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:00.939843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a99313-dfa2-4998-ad60-bad0e273984d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:00.940040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a99313-dfa2-4998-ad60-bad0e273984d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:00.950469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7054f1c-93d8-441d-aa26-2f7347c463c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:00.951151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7054f1c-93d8-441d-aa26-2f7347c463c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:00.951444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7054f1c-93d8-441d-aa26-2f7347c463c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:00.951726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7054f1c-93d8-441d-aa26-2f7347c463c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:00.952429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7054f1c-93d8-441d-aa26-2f7347c463c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:00.954716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7054f1c-93d8-441d-aa26-2f7347c463c7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:00.981076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a8a99313-dfa2-4998-ad60-bad0e273984d None None] MFA Rules not processed for user `641a6e6fe0cb4fa7a578591187d930d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:00.982335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a8a99313-dfa2-4998-ad60-bad0e273984d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:01.050355 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1020/2021] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:01.051767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bd563-e0e0-4f79-ae18-c60d1465b6c2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:01.052125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bd563-e0e0-4f79-ae18-c60d1465b6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:01.052499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bd563-e0e0-4f79-ae18-c60d1465b6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:01.055890 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1002/2022] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:00 2022] POST /identity/v3/projects => generated 375 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:01.056710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7054f1c-93d8-441d-aa26-2f7347c463c7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:01.058518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d7054f1c-93d8-441d-aa26-2f7347c463c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:01.072622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-007bd563-e0e0-4f79-ae18-c60d1465b6c2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:01.073796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-007bd563-e0e0-4f79-ae18-c60d1465b6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:01.135502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7054f1c-93d8-441d-aa26-2f7347c463c7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:01.142477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95236e7-923e-435a-8ff1-75cca2183f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:01.143222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95236e7-923e-435a-8ff1-75cca2183f1f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:01.143506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95236e7-923e-435a-8ff1-75cca2183f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:01.143782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95236e7-923e-435a-8ff1-75cca2183f1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:01.144481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95236e7-923e-435a-8ff1-75cca2183f1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:01.146578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95236e7-923e-435a-8ff1-75cca2183f1f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:01.188672 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1021/2023] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:01.189881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bd563-e0e0-4f79-ae18-c60d1465b6c2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:01.196890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-007bd563-e0e0-4f79-ae18-c60d1465b6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:01.211014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007bd563-e0e0-4f79-ae18-c60d1465b6c2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:01.216830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb56f4-393c-4efa-b4de-c867655e7f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:01.217627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb56f4-393c-4efa-b4de-c867655e7f9b admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:01.218261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb56f4-393c-4efa-b4de-c867655e7f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:01.218613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb56f4-393c-4efa-b4de-c867655e7f9b admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:01.219425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb56f4-393c-4efa-b4de-c867655e7f9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:01.221444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb56f4-393c-4efa-b4de-c867655e7f9b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:01.273162 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1003/2024] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:01 2022] POST /identity/v3/projects => generated 395 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:01.275596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347f77d-e3c4-493b-8de2-0b6f0ea0cfa6 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:01.275943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347f77d-e3c4-493b-8de2-0b6f0ea0cfa6 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:01.276468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347f77d-e3c4-493b-8de2-0b6f0ea0cfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:01.301283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8347f77d-e3c4-493b-8de2-0b6f0ea0cfa6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:01.306216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8347f77d-e3c4-493b-8de2-0b6f0ea0cfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:01.331026 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1022/2025] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:01 2022] POST /identity/v3/users => generated 294 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:01.332138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb56f4-393c-4efa-b4de-c867655e7f9b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:01.348480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb56f4-393c-4efa-b4de-c867655e7f9b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:01.373114 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1004/2026] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:01.374125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347f77d-e3c4-493b-8de2-0b6f0ea0cfa6 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:01.387417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347f77d-e3c4-493b-8de2-0b6f0ea0cfa6 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:01.393231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540aa61-7f53-4fb6-bb09-1b018459090e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:01.393916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540aa61-7f53-4fb6-bb09-1b018459090e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:01.394242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540aa61-7f53-4fb6-bb09-1b018459090e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:01.394523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540aa61-7f53-4fb6-bb09-1b018459090e admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:01.395289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540aa61-7f53-4fb6-bb09-1b018459090e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:01.396987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f540aa61-7f53-4fb6-bb09-1b018459090e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:01.407722 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1005/2027] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:01.408473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540aa61-7f53-4fb6-bb09-1b018459090e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:01.415550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54080ce5-c139-4d27-af8f-14d7773baeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:01.416238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54080ce5-c139-4d27-af8f-14d7773baeab admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:01.416520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54080ce5-c139-4d27-af8f-14d7773baeab admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:01.416809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54080ce5-c139-4d27-af8f-14d7773baeab admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:01.417494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54080ce5-c139-4d27-af8f-14d7773baeab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:01.419439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54080ce5-c139-4d27-af8f-14d7773baeab admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:01.419554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540aa61-7f53-4fb6-bb09-1b018459090e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:01.425902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067687a-ea4e-4a29-9d75-7c319bb7aa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:01.426623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067687a-ea4e-4a29-9d75-7c319bb7aa03 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:01.426914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067687a-ea4e-4a29-9d75-7c319bb7aa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:01.427200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6067687a-ea4e-4a29-9d75-7c319bb7aa03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:01.428375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067687a-ea4e-4a29-9d75-7c319bb7aa03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:12:01.428375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067687a-ea4e-4a29-9d75-7c319bb7aa03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:01.432592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6067687a-ea4e-4a29-9d75-7c319bb7aa03 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:01.444130 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1006/2028] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:12:01.445199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067687a-ea4e-4a29-9d75-7c319bb7aa03 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:01.456639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6067687a-ea4e-4a29-9d75-7c319bb7aa03 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:01.461325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1649f08-653c-4f44-ae72-1315e08cc70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:01.462898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1649f08-653c-4f44-ae72-1315e08cc70f admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:01.463185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1649f08-653c-4f44-ae72-1315e08cc70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:01.463467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1649f08-653c-4f44-ae72-1315e08cc70f admin admin] PATH_INFO: `/v3/projects/7cc867be397d45e1b04a568c2895eaeb/users/0925723b4edc4068933e573902109105/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:01.478424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1649f08-653c-4f44-ae72-1315e08cc70f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc867be397d45e1b04a568c2895eaeb, user_id=0925723b4edc4068933e573902109105, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:01.481098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1649f08-653c-4f44-ae72-1315e08cc70f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:01.543594 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1023/2029] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:01 2022] POST /identity/v3/users => generated 304 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:01.544528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54080ce5-c139-4d27-af8f-14d7773baeab admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:01.553931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54080ce5-c139-4d27-af8f-14d7773baeab admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:01.559175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99158d68-451e-460c-8c64-c37c45fe248e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:01.559803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99158d68-451e-460c-8c64-c37c45fe248e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:01.560085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99158d68-451e-460c-8c64-c37c45fe248e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:01.560359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99158d68-451e-460c-8c64-c37c45fe248e admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:01.561034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99158d68-451e-460c-8c64-c37c45fe248e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:01.562977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99158d68-451e-460c-8c64-c37c45fe248e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:01.594736 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1007/2030] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:01 2022] PUT /identity/v3/projects/7cc867be397d45e1b04a568c2895eaeb/users/0925723b4edc4068933e573902109105/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:01.595738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1649f08-653c-4f44-ae72-1315e08cc70f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:01.610190 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:01.660748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1649f08-653c-4f44-ae72-1315e08cc70f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:01.666165 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1024/2031] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:01 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:01.666165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99158d68-451e-460c-8c64-c37c45fe248e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:01.668892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb44a8-90d9-4961-adea-970e9820a629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:01.669641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb44a8-90d9-4961-adea-970e9820a629 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:01.669935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb44a8-90d9-4961-adea-970e9820a629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:01.670276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb44a8-90d9-4961-adea-970e9820a629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:01.671025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb44a8-90d9-4961-adea-970e9820a629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:01.672727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb44a8-90d9-4961-adea-970e9820a629 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:01.687620 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1008/2032] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:01.687825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb44a8-90d9-4961-adea-970e9820a629 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:01.699472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb44a8-90d9-4961-adea-970e9820a629 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:01.766659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbbbc8-163f-440f-b91d-32921936491a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:01.767357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbbbc8-163f-440f-b91d-32921936491a admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:01.767649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbbbc8-163f-440f-b91d-32921936491a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:01.767936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbbbbc8-163f-440f-b91d-32921936491a admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:01.768643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbbbc8-163f-440f-b91d-32921936491a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:01.770595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbbbbc8-163f-440f-b91d-32921936491a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:01.784158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99158d68-451e-460c-8c64-c37c45fe248e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:01.789684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bda343-54b8-4a5c-b9bd-d30530534f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:01.790515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bda343-54b8-4a5c-b9bd-d30530534f8d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:01.790890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bda343-54b8-4a5c-b9bd-d30530534f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:01.797637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bda343-54b8-4a5c-b9bd-d30530534f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:01.797637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bda343-54b8-4a5c-b9bd-d30530534f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:01.797637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bda343-54b8-4a5c-b9bd-d30530534f8d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:01.808472 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1025/2033] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:01.808472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bda343-54b8-4a5c-b9bd-d30530534f8d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:01.819364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bda343-54b8-4a5c-b9bd-d30530534f8d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:01.824700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4838cb06-1c9c-40fc-a750-089c8808ae6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:01.825676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838cb06-1c9c-40fc-a750-089c8808ae6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:01.825962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838cb06-1c9c-40fc-a750-089c8808ae6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:01.826310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4838cb06-1c9c-40fc-a750-089c8808ae6f admin admin] PATH_INFO: `/v3/projects/6b1a7199c8c14e9c8714d524e240cce2/users/d9f5b99c269d4eecbde1d58e37ef1090/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:01.844285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838cb06-1c9c-40fc-a750-089c8808ae6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1a7199c8c14e9c8714d524e240cce2, user_id=d9f5b99c269d4eecbde1d58e37ef1090, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:01.847058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4838cb06-1c9c-40fc-a750-089c8808ae6f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:01.874255 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1009/2034] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:01 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:01.875422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbbbc8-163f-440f-b91d-32921936491a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:01.888497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbbbbc8-163f-440f-b91d-32921936491a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:01.893594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4512b7-9767-4ff3-a936-889e8a4031b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:01.894670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4512b7-9767-4ff3-a936-889e8a4031b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:01.894956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4512b7-9767-4ff3-a936-889e8a4031b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:01.895474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4512b7-9767-4ff3-a936-889e8a4031b0 admin admin] PATH_INFO: `/v3/projects/7cc867be397d45e1b04a568c2895eaeb/users/0925723b4edc4068933e573902109105/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:01.897543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4512b7-9767-4ff3-a936-889e8a4031b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cc867be397d45e1b04a568c2895eaeb, user_id=0925723b4edc4068933e573902109105, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:01.900528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4512b7-9767-4ff3-a936-889e8a4031b0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:01.918297 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1010/2035] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:01 2022] PUT /identity/v3/projects/7cc867be397d45e1b04a568c2895eaeb/users/0925723b4edc4068933e573902109105/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:01.918297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4512b7-9767-4ff3-a936-889e8a4031b0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:01.951351 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1026/2036] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:01 2022] PUT /identity/v3/projects/6b1a7199c8c14e9c8714d524e240cce2/users/d9f5b99c269d4eecbde1d58e37ef1090/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:01.952855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13b0f3-d63e-48c5-9239-24c141b3bcd6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:01.953252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13b0f3-d63e-48c5-9239-24c141b3bcd6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:01.953594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb13b0f3-d63e-48c5-9239-24c141b3bcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:01.990941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-eb13b0f3-d63e-48c5-9239-24c141b3bcd6 None None] MFA Rules not processed for user `0925723b4edc4068933e573902109105`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:01.992312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-eb13b0f3-d63e-48c5-9239-24c141b3bcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:01.994486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4512b7-9767-4ff3-a936-889e8a4031b0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:02.045392 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:02.079171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963bd53-016d-4bcc-bef5-255a389cf6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:02.079461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963bd53-016d-4bcc-bef5-255a389cf6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:02.079834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963bd53-016d-4bcc-bef5-255a389cf6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:02.080142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963bd53-016d-4bcc-bef5-255a389cf6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:02.084649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963bd53-016d-4bcc-bef5-255a389cf6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:02.084649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f963bd53-016d-4bcc-bef5-255a389cf6b1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:02.095284 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1011/2037] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:01 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:02.096650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963bd53-016d-4bcc-bef5-255a389cf6b1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:02.100577 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1027/2038] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:02.103051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13b0f3-d63e-48c5-9239-24c141b3bcd6 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:02.106992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963bd53-016d-4bcc-bef5-255a389cf6b1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:02.114168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119d97a1-eacf-4041-aec4-502fb88dfa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:02.114857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d97a1-eacf-4041-aec4-502fb88dfa92 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:02.115411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d97a1-eacf-4041-aec4-502fb88dfa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:02.115411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119d97a1-eacf-4041-aec4-502fb88dfa92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:02.116139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d97a1-eacf-4041-aec4-502fb88dfa92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:02.117768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb13b0f3-d63e-48c5-9239-24c141b3bcd6 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:02.117992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119d97a1-eacf-4041-aec4-502fb88dfa92 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:02.123570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84a3a2-47ed-4b4a-86d7-dfe048e0cfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:02.124371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84a3a2-47ed-4b4a-86d7-dfe048e0cfc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:02.124695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84a3a2-47ed-4b4a-86d7-dfe048e0cfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:02.125074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84a3a2-47ed-4b4a-86d7-dfe048e0cfc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:02.126695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84a3a2-47ed-4b4a-86d7-dfe048e0cfc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:02.128786 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1012/2039] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:02.128939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa84a3a2-47ed-4b4a-86d7-dfe048e0cfc5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:02.133022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae0c77-43d6-4324-94b5-bbaabef78e4b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:02.133853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae0c77-43d6-4324-94b5-bbaabef78e4b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:02.134229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae0c77-43d6-4324-94b5-bbaabef78e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:02.141471 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1028/2040] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:02.146113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84a3a2-47ed-4b4a-86d7-dfe048e0cfc5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:02.154116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa84a3a2-47ed-4b4a-86d7-dfe048e0cfc5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:02.154385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-62ae0c77-43d6-4324-94b5-bbaabef78e4b None None] MFA Rules not processed for user `a6fc909d2c0843b8a29eb1d47a755db9`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:02.155677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-62ae0c77-43d6-4324-94b5-bbaabef78e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:02.159525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa2ce6-4a54-4f78-8960-f89f82d7bbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:02.160671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa2ce6-4a54-4f78-8960-f89f82d7bbfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:02.161054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa2ce6-4a54-4f78-8960-f89f82d7bbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:02.161400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa2ce6-4a54-4f78-8960-f89f82d7bbfe admin admin] PATH_INFO: `/v3/projects/6b1a7199c8c14e9c8714d524e240cce2/users/d9f5b99c269d4eecbde1d58e37ef1090/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:02.163486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa2ce6-4a54-4f78-8960-f89f82d7bbfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1a7199c8c14e9c8714d524e240cce2, user_id=d9f5b99c269d4eecbde1d58e37ef1090, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:02.167599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa2ce6-4a54-4f78-8960-f89f82d7bbfe admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:02.179609 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1029/2041] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:02 2022] PUT /identity/v3/projects/6b1a7199c8c14e9c8714d524e240cce2/users/d9f5b99c269d4eecbde1d58e37ef1090/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:02.181143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa2ce6-4a54-4f78-8960-f89f82d7bbfe admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:02.231611 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1013/2042] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:02.231611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f705dc4-1297-4268-b285-be5b0464fbc0 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:02.231611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f705dc4-1297-4268-b285-be5b0464fbc0 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:02.231611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f705dc4-1297-4268-b285-be5b0464fbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:02.267763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3f705dc4-1297-4268-b285-be5b0464fbc0 None None] MFA Rules not processed for user `d9f5b99c269d4eecbde1d58e37ef1090`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:02.269023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3f705dc4-1297-4268-b285-be5b0464fbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:02.280739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa2ce6-4a54-4f78-8960-f89f82d7bbfe admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:02.286055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ca925-a1f2-4b4e-aea5-994bd35094ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:02.287682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ca925-a1f2-4b4e-aea5-994bd35094ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:02.288522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ca925-a1f2-4b4e-aea5-994bd35094ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:02.288817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ca925-a1f2-4b4e-aea5-994bd35094ab admin admin] PATH_INFO: `/v3/projects/cc5f7b474a474e408ad187b8a35439ba/users/a5ae4eb5a400420d91b8b4ef929f1fab/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:02.305819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ca925-a1f2-4b4e-aea5-994bd35094ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5f7b474a474e408ad187b8a35439ba, user_id=a5ae4eb5a400420d91b8b4ef929f1fab, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:02.308970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ca925-a1f2-4b4e-aea5-994bd35094ab admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:02.348808 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1014/2043] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:02.349490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f705dc4-1297-4268-b285-be5b0464fbc0 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:02.350844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3f705dc4-1297-4268-b285-be5b0464fbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:02.429234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f705dc4-1297-4268-b285-be5b0464fbc0 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:02.436137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d636f-cf46-4191-833d-274ad099092e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:02.436982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d636f-cf46-4191-833d-274ad099092e service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:02.437274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d636f-cf46-4191-833d-274ad099092e service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:02.437563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d636f-cf46-4191-833d-274ad099092e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:02.439463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-685d636f-cf46-4191-833d-274ad099092e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:02.479998 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:02.487204 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1030/2044] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:02 2022] PUT /identity/v3/projects/cc5f7b474a474e408ad187b8a35439ba/users/a5ae4eb5a400420d91b8b4ef929f1fab/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:02.500433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2229d11-f3aa-4be3-a3f6-3e8f987a3263 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:02.500818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2229d11-f3aa-4be3-a3f6-3e8f987a3263 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:02.501495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2229d11-f3aa-4be3-a3f6-3e8f987a3263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:02.505537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d636f-cf46-4191-833d-274ad099092e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:02.507171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d636f-cf46-4191-833d-274ad099092e service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:02.518018 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1015/2045] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:02.548099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f2229d11-f3aa-4be3-a3f6-3e8f987a3263 None None] MFA Rules not processed for user `a5ae4eb5a400420d91b8b4ef929f1fab`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:02.549508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f2229d11-f3aa-4be3-a3f6-3e8f987a3263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:02.642265 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1031/2046] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:02.646757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d636f-cf46-4191-833d-274ad099092e service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:02.658936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d636f-cf46-4191-833d-274ad099092e service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:02.704779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2229d11-f3aa-4be3-a3f6-3e8f987a3263 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:02.706489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f2229d11-f3aa-4be3-a3f6-3e8f987a3263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:02.748366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8bc83-979e-4fcc-9e72-d9dafa5015e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:02.749587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8bc83-979e-4fcc-9e72-d9dafa5015e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:02.750074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8bc83-979e-4fcc-9e72-d9dafa5015e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:02.750675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8bc83-979e-4fcc-9e72-d9dafa5015e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:02.752583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8bc83-979e-4fcc-9e72-d9dafa5015e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:02.754972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8bc83-979e-4fcc-9e72-d9dafa5015e2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:02.834281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2229d11-f3aa-4be3-a3f6-3e8f987a3263 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:02.841440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445adefd-e213-4526-bf0b-88812b8881aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:02.841660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445adefd-e213-4526-bf0b-88812b8881aa service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:02.842309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445adefd-e213-4526-bf0b-88812b8881aa service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:02.842309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445adefd-e213-4526-bf0b-88812b8881aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:02.876481 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1016/2047] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:02 2022] POST /identity/v3/projects => generated 373 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:02.881725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8bc83-979e-4fcc-9e72-d9dafa5015e2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:02.980294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445adefd-e213-4526-bf0b-88812b8881aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:02.982217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445adefd-e213-4526-bf0b-88812b8881aa service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:03.015536 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1032/2048] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:02 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:12:03.044758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8bc83-979e-4fcc-9e72-d9dafa5015e2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:03.050615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e365ae-03b3-4921-a024-979496810293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:03.052158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e365ae-03b3-4921-a024-979496810293 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:03.052825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e365ae-03b3-4921-a024-979496810293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:03.053479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e365ae-03b3-4921-a024-979496810293 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:03.054593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e365ae-03b3-4921-a024-979496810293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:03.058845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e365ae-03b3-4921-a024-979496810293 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:03.168575 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1017/2049] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:02 2022] POST /identity/v3/users => generated 293 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:03.173143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445adefd-e213-4526-bf0b-88812b8881aa service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:03.207370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445adefd-e213-4526-bf0b-88812b8881aa service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:03.215058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692407ab-2f09-42f1-b5da-c8c8d89cff3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:03.215750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692407ab-2f09-42f1-b5da-c8c8d89cff3f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:03.216065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692407ab-2f09-42f1-b5da-c8c8d89cff3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:03.216369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692407ab-2f09-42f1-b5da-c8c8d89cff3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:03.219558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692407ab-2f09-42f1-b5da-c8c8d89cff3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:03.219558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692407ab-2f09-42f1-b5da-c8c8d89cff3f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:03.265000 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1033/2050] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:03.269026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e365ae-03b3-4921-a024-979496810293 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:03.282462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e365ae-03b3-4921-a024-979496810293 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:03.287483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ede724-67cd-4a7f-8254-9a266420b4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:03.288614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ede724-67cd-4a7f-8254-9a266420b4cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:03.289164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ede724-67cd-4a7f-8254-9a266420b4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:03.289754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ede724-67cd-4a7f-8254-9a266420b4cf admin admin] PATH_INFO: `/v3/projects/8a251de840f84362a17c55e30e3c81ca/users/38e7c54405234d278a428f9d1a97bff8/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:03.311840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ede724-67cd-4a7f-8254-9a266420b4cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a251de840f84362a17c55e30e3c81ca, user_id=38e7c54405234d278a428f9d1a97bff8, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:03.312384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692407ab-2f09-42f1-b5da-c8c8d89cff3f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:03.315406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ede724-67cd-4a7f-8254-9a266420b4cf admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:03.330631 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:03.332629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692407ab-2f09-42f1-b5da-c8c8d89cff3f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:03.342373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06527c97-7eb7-43a6-b3b7-f28f00d66904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:03.343897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06527c97-7eb7-43a6-b3b7-f28f00d66904 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:03.344329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06527c97-7eb7-43a6-b3b7-f28f00d66904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:03.344957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06527c97-7eb7-43a6-b3b7-f28f00d66904 admin admin] PATH_INFO: `/v3/users/641a6e6fe0cb4fa7a578591187d930d4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:03.346921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06527c97-7eb7-43a6-b3b7-f28f00d66904 admin admin] RBAC: Authorizing `identity:delete_user(user_id=641a6e6fe0cb4fa7a578591187d930d4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:03.351767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06527c97-7eb7-43a6-b3b7-f28f00d66904 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:03.447936 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1018/2051] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:03 2022] PUT /identity/v3/projects/8a251de840f84362a17c55e30e3c81ca/users/38e7c54405234d278a428f9d1a97bff8/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:03.451933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ede724-67cd-4a7f-8254-9a266420b4cf admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:03.561264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ede724-67cd-4a7f-8254-9a266420b4cf admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:03.568132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260468ac-0b2b-4d1e-9e78-4732d3159126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:03.568881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260468ac-0b2b-4d1e-9e78-4732d3159126 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:03.569221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260468ac-0b2b-4d1e-9e78-4732d3159126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:03.569511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260468ac-0b2b-4d1e-9e78-4732d3159126 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:03.570312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260468ac-0b2b-4d1e-9e78-4732d3159126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:03.573186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260468ac-0b2b-4d1e-9e78-4732d3159126 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:03.594506 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1019/2052] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:12:03.599855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260468ac-0b2b-4d1e-9e78-4732d3159126 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:03.613648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-06527c97-7eb7-43a6-b3b7-f28f00d66904 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '641a6e6fe0cb4fa7a578591187d930d4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:03.615272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260468ac-0b2b-4d1e-9e78-4732d3159126 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:03.629666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-06527c97-7eb7-43a6-b3b7-f28f00d66904 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '641a6e6fe0cb4fa7a578591187d930d4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:03.630663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831a0b9-ecc8-4d42-9811-6e7ec93f908b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:03.631858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831a0b9-ecc8-4d42-9811-6e7ec93f908b admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:03.632590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831a0b9-ecc8-4d42-9811-6e7ec93f908b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:03.632947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831a0b9-ecc8-4d42-9811-6e7ec93f908b admin admin] PATH_INFO: `/v3/projects/8a251de840f84362a17c55e30e3c81ca/users/38e7c54405234d278a428f9d1a97bff8/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:03.636243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831a0b9-ecc8-4d42-9811-6e7ec93f908b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a251de840f84362a17c55e30e3c81ca, user_id=38e7c54405234d278a428f9d1a97bff8, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:03.639340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-06527c97-7eb7-43a6-b3b7-f28f00d66904 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '641a6e6fe0cb4fa7a578591187d930d4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:03.640154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831a0b9-ecc8-4d42-9811-6e7ec93f908b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:03.640507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-06527c97-7eb7-43a6-b3b7-f28f00d66904 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '641a6e6fe0cb4fa7a578591187d930d4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:03.657652 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1020/2053] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:03 2022] PUT /identity/v3/projects/8a251de840f84362a17c55e30e3c81ca/users/38e7c54405234d278a428f9d1a97bff8/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:03.669332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783feca-fd2c-4b2d-9ba4-846fad073084 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:03.670026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783feca-fd2c-4b2d-9ba4-846fad073084 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:03.671017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783feca-fd2c-4b2d-9ba4-846fad073084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:03.713589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6783feca-fd2c-4b2d-9ba4-846fad073084 None None] MFA Rules not processed for user `38e7c54405234d278a428f9d1a97bff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:03.715156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6783feca-fd2c-4b2d-9ba4-846fad073084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:03.728917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-06527c97-7eb7-43a6-b3b7-f28f00d66904 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '641a6e6fe0cb4fa7a578591187d930d4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:03.745056 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1034/2054] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:03 2022] DELETE /identity/v3/users/641a6e6fe0cb4fa7a578591187d930d4 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:12:03.746667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759da87a-b636-4d39-825b-8ab6548c8ddf None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:03.746988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759da87a-b636-4d39-825b-8ab6548c8ddf None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:03.747268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759da87a-b636-4d39-825b-8ab6548c8ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:03.770994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-759da87a-b636-4d39-825b-8ab6548c8ddf None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:03.772246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-759da87a-b636-4d39-825b-8ab6548c8ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:03.832292 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1021/2055] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:03.844221 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:03.858945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783feca-fd2c-4b2d-9ba4-846fad073084 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:03.861058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6783feca-fd2c-4b2d-9ba4-846fad073084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:03.890391 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1035/2056] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:03.928757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759da87a-b636-4d39-825b-8ab6548c8ddf None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:03.930370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-759da87a-b636-4d39-825b-8ab6548c8ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:04.021877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783feca-fd2c-4b2d-9ba4-846fad073084 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:04.084361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759da87a-b636-4d39-825b-8ab6548c8ddf None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:04.097760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565d364-eb1e-4e89-9aac-cd38b4fbd53a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:04.100767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565d364-eb1e-4e89-9aac-cd38b4fbd53a service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:04.101143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565d364-eb1e-4e89-9aac-cd38b4fbd53a service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:04.101721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2565d364-eb1e-4e89-9aac-cd38b4fbd53a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:04.126368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565d364-eb1e-4e89-9aac-cd38b4fbd53a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:04.129152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2565d364-eb1e-4e89-9aac-cd38b4fbd53a service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:04.155966 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1036/2057] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:04.190141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fc37a-7e4d-4154-b0d0-90e5b01ff003 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:04.190946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fc37a-7e4d-4154-b0d0-90e5b01ff003 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:04.191364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fc37a-7e4d-4154-b0d0-90e5b01ff003 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:04.191712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fc37a-7e4d-4154-b0d0-90e5b01ff003 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:04.301685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5fc37a-7e4d-4154-b0d0-90e5b01ff003 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:04.318377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5fc37a-7e4d-4154-b0d0-90e5b01ff003 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:04.338877 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1022/2058] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:04.483996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565d364-eb1e-4e89-9aac-cd38b4fbd53a service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:04.501139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2565d364-eb1e-4e89-9aac-cd38b4fbd53a service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:04.518555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e6971-8b5b-4207-a8a8-5e765f63df2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:04.519226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e6971-8b5b-4207-a8a8-5e765f63df2d service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:04.519518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e6971-8b5b-4207-a8a8-5e765f63df2d service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:04.519798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332e6971-8b5b-4207-a8a8-5e765f63df2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:04.524963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-332e6971-8b5b-4207-a8a8-5e765f63df2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:04.594829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e6971-8b5b-4207-a8a8-5e765f63df2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:04.597075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332e6971-8b5b-4207-a8a8-5e765f63df2d service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:04.609084 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1037/2059] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:04.820886 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:04.936609 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:05.023064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fc37a-7e4d-4154-b0d0-90e5b01ff003 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:05.025125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fd5fc37a-7e4d-4154-b0d0-90e5b01ff003 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:05.055247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fc37a-7e4d-4154-b0d0-90e5b01ff003 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:05.065287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6640c5e-2a34-4fc4-bfab-608a2bcace59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:05.066929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6640c5e-2a34-4fc4-bfab-608a2bcace59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:05.067458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6640c5e-2a34-4fc4-bfab-608a2bcace59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:05.067963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6640c5e-2a34-4fc4-bfab-608a2bcace59 admin admin] PATH_INFO: `/v3/projects/01322d2c8e434ffb8a8e0f4e2965f41d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:05.070064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6640c5e-2a34-4fc4-bfab-608a2bcace59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01322d2c8e434ffb8a8e0f4e2965f41d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:05.076721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6640c5e-2a34-4fc4-bfab-608a2bcace59 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:05.076866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e6971-8b5b-4207-a8a8-5e765f63df2d service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:05.078089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-332e6971-8b5b-4207-a8a8-5e765f63df2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:05.109258 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332e6971-8b5b-4207-a8a8-5e765f63df2d service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:05.128872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61719e3-2d38-42cc-9233-23f1110f438a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:05.129704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61719e3-2d38-42cc-9233-23f1110f438a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:05.129988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61719e3-2d38-42cc-9233-23f1110f438a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:05.130309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61719e3-2d38-42cc-9233-23f1110f438a admin admin] PATH_INFO: `/v3/users/a5ae4eb5a400420d91b8b4ef929f1fab` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:05.134167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61719e3-2d38-42cc-9233-23f1110f438a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5ae4eb5a400420d91b8b4ef929f1fab)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:05.152070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61719e3-2d38-42cc-9233-23f1110f438a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:05.235912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e6640c5e-2a34-4fc4-bfab-608a2bcace59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01322d2c8e434ffb8a8e0f4e2965f41d', 'request_id': 'req-e6640c5e-2a34-4fc4-bfab-608a2bcace59'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:05.329598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e6640c5e-2a34-4fc4-bfab-608a2bcace59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01322d2c8e434ffb8a8e0f4e2965f41d', 'request_id': 'req-e6640c5e-2a34-4fc4-bfab-608a2bcace59'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:05.339430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e6640c5e-2a34-4fc4-bfab-608a2bcace59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01322d2c8e434ffb8a8e0f4e2965f41d', 'request_id': 'req-e6640c5e-2a34-4fc4-bfab-608a2bcace59'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:05.361259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e6640c5e-2a34-4fc4-bfab-608a2bcace59 admin admin] The token cache is being invalidate because project 01322d2c8e434ffb8a8e0f4e2965f41d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:05.361259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e6640c5e-2a34-4fc4-bfab-608a2bcace59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:05.361952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e6640c5e-2a34-4fc4-bfab-608a2bcace59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:05.368435 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1023/2060] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:05 2022] DELETE /identity/v3/projects/01322d2c8e434ffb8a8e0f4e2965f41d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:05.369368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6640c5e-2a34-4fc4-bfab-608a2bcace59 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:05.375321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e6640c5e-2a34-4fc4-bfab-608a2bcace59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:05.449509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d61719e3-2d38-42cc-9233-23f1110f438a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5ae4eb5a400420d91b8b4ef929f1fab'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:05.481270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d61719e3-2d38-42cc-9233-23f1110f438a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5ae4eb5a400420d91b8b4ef929f1fab'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:05.498139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d61719e3-2d38-42cc-9233-23f1110f438a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5ae4eb5a400420d91b8b4ef929f1fab'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:05.498973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d61719e3-2d38-42cc-9233-23f1110f438a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5ae4eb5a400420d91b8b4ef929f1fab'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:05.526790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6640c5e-2a34-4fc4-bfab-608a2bcace59 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:05.532348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a790c-cd43-4e0b-be62-2a122ad1461a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:05.533295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a790c-cd43-4e0b-be62-2a122ad1461a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:05.533547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a790c-cd43-4e0b-be62-2a122ad1461a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:05.533903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89a790c-cd43-4e0b-be62-2a122ad1461a admin admin] PATH_INFO: `/v3/users/d9f5b99c269d4eecbde1d58e37ef1090` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:05.535192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a790c-cd43-4e0b-be62-2a122ad1461a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f5b99c269d4eecbde1d58e37ef1090)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:05.537122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89a790c-cd43-4e0b-be62-2a122ad1461a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:05.580207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d61719e3-2d38-42cc-9233-23f1110f438a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5ae4eb5a400420d91b8b4ef929f1fab'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:05.591231 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1038/2061] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:05 2022] DELETE /identity/v3/users/a5ae4eb5a400420d91b8b4ef929f1fab => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:05.596268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e7d40-bbeb-4690-ae2b-0048716d4930 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:05.597299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e7d40-bbeb-4690-ae2b-0048716d4930 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:05.597742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004e7d40-bbeb-4690-ae2b-0048716d4930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:05.627819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-004e7d40-bbeb-4690-ae2b-0048716d4930 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:05.629338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-004e7d40-bbeb-4690-ae2b-0048716d4930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:05.746377 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1039/2062] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:12:05.755776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e7d40-bbeb-4690-ae2b-0048716d4930 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:05.757947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-004e7d40-bbeb-4690-ae2b-0048716d4930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:05.802220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f89a790c-cd43-4e0b-be62-2a122ad1461a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f5b99c269d4eecbde1d58e37ef1090'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:05.833163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f89a790c-cd43-4e0b-be62-2a122ad1461a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f5b99c269d4eecbde1d58e37ef1090'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:05.833505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f89a790c-cd43-4e0b-be62-2a122ad1461a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f5b99c269d4eecbde1d58e37ef1090'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:05.834168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f89a790c-cd43-4e0b-be62-2a122ad1461a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f5b99c269d4eecbde1d58e37ef1090'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:05.847738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004e7d40-bbeb-4690-ae2b-0048716d4930 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:05.849832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f89a790c-cd43-4e0b-be62-2a122ad1461a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f5b99c269d4eecbde1d58e37ef1090'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:05.855775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68c88b-9958-4bcd-938f-1ea3ecf7a766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:05.856643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68c88b-9958-4bcd-938f-1ea3ecf7a766 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:05.856988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68c88b-9958-4bcd-938f-1ea3ecf7a766 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:05.857377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68c88b-9958-4bcd-938f-1ea3ecf7a766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:05.859651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ab68c88b-9958-4bcd-938f-1ea3ecf7a766 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:05.878346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68c88b-9958-4bcd-938f-1ea3ecf7a766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:05.879883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68c88b-9958-4bcd-938f-1ea3ecf7a766 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:05.893208 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1040/2063] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:12:05.957669 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1024/2064] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:05 2022] DELETE /identity/v3/users/d9f5b99c269d4eecbde1d58e37ef1090 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:06.005411 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:06.746201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68c88b-9958-4bcd-938f-1ea3ecf7a766 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:06.747750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ab68c88b-9958-4bcd-938f-1ea3ecf7a766 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:06.771377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68c88b-9958-4bcd-938f-1ea3ecf7a766 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:06.890664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168cae2-1ca0-4d59-92f5-5c0b43fece5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:06.892302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168cae2-1ca0-4d59-92f5-5c0b43fece5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:06.892591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168cae2-1ca0-4d59-92f5-5c0b43fece5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:06.893025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2168cae2-1ca0-4d59-92f5-5c0b43fece5f admin admin] PATH_INFO: `/v3/projects/cc5f7b474a474e408ad187b8a35439ba` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:06.894378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168cae2-1ca0-4d59-92f5-5c0b43fece5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc5f7b474a474e408ad187b8a35439ba)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:06.897001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2168cae2-1ca0-4d59-92f5-5c0b43fece5f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:07.033502 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:07.048142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2168cae2-1ca0-4d59-92f5-5c0b43fece5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc5f7b474a474e408ad187b8a35439ba', 'request_id': 'req-2168cae2-1ca0-4d59-92f5-5c0b43fece5f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:07.056980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2168cae2-1ca0-4d59-92f5-5c0b43fece5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc5f7b474a474e408ad187b8a35439ba', 'request_id': 'req-2168cae2-1ca0-4d59-92f5-5c0b43fece5f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:07.067003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2168cae2-1ca0-4d59-92f5-5c0b43fece5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc5f7b474a474e408ad187b8a35439ba', 'request_id': 'req-2168cae2-1ca0-4d59-92f5-5c0b43fece5f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:07.162386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2168cae2-1ca0-4d59-92f5-5c0b43fece5f admin admin] The token cache is being invalidate because project cc5f7b474a474e408ad187b8a35439ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:07.162818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2168cae2-1ca0-4d59-92f5-5c0b43fece5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:07.165404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2168cae2-1ca0-4d59-92f5-5c0b43fece5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:07.172097 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1041/2065] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:06 2022] DELETE /identity/v3/projects/cc5f7b474a474e408ad187b8a35439ba => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:07.173922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a790c-cd43-4e0b-be62-2a122ad1461a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:07.204587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89a790c-cd43-4e0b-be62-2a122ad1461a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:07.360030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8c01e-03fa-4776-9759-535a4b3dfbb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:07.360943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8c01e-03fa-4776-9759-535a4b3dfbb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:07.361223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8c01e-03fa-4776-9759-535a4b3dfbb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:07.362228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8c01e-03fa-4776-9759-535a4b3dfbb6 admin admin] PATH_INFO: `/v3/users/38e7c54405234d278a428f9d1a97bff8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:07.363959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8c01e-03fa-4776-9759-535a4b3dfbb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38e7c54405234d278a428f9d1a97bff8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:07.365972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8c01e-03fa-4776-9759-535a4b3dfbb6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:07.398278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168cae2-1ca0-4d59-92f5-5c0b43fece5f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:07.400463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2168cae2-1ca0-4d59-92f5-5c0b43fece5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:07.404879 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:07.422434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2168cae2-1ca0-4d59-92f5-5c0b43fece5f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:07.434924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63453f8c-7597-4f1f-b57d-52caac159081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:07.435926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63453f8c-7597-4f1f-b57d-52caac159081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:07.436290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63453f8c-7597-4f1f-b57d-52caac159081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:07.436680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63453f8c-7597-4f1f-b57d-52caac159081 admin admin] PATH_INFO: `/v3/projects/6b1a7199c8c14e9c8714d524e240cce2` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:07.439213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63453f8c-7597-4f1f-b57d-52caac159081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b1a7199c8c14e9c8714d524e240cce2)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:07.443880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63453f8c-7597-4f1f-b57d-52caac159081 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:07.668670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-63453f8c-7597-4f1f-b57d-52caac159081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b1a7199c8c14e9c8714d524e240cce2', 'request_id': 'req-63453f8c-7597-4f1f-b57d-52caac159081'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:07.698142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-63453f8c-7597-4f1f-b57d-52caac159081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b1a7199c8c14e9c8714d524e240cce2', 'request_id': 'req-63453f8c-7597-4f1f-b57d-52caac159081'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:07.701045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-06d8c01e-03fa-4776-9759-535a4b3dfbb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38e7c54405234d278a428f9d1a97bff8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:07.721780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-63453f8c-7597-4f1f-b57d-52caac159081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b1a7199c8c14e9c8714d524e240cce2', 'request_id': 'req-63453f8c-7597-4f1f-b57d-52caac159081'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:07.740270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-06d8c01e-03fa-4776-9759-535a4b3dfbb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38e7c54405234d278a428f9d1a97bff8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:07.747540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-06d8c01e-03fa-4776-9759-535a4b3dfbb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38e7c54405234d278a428f9d1a97bff8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:07.748303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-06d8c01e-03fa-4776-9759-535a4b3dfbb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38e7c54405234d278a428f9d1a97bff8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:07.756785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-06d8c01e-03fa-4776-9759-535a4b3dfbb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38e7c54405234d278a428f9d1a97bff8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:07.823877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-63453f8c-7597-4f1f-b57d-52caac159081 admin admin] The token cache is being invalidate because project 6b1a7199c8c14e9c8714d524e240cce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:07.824691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-63453f8c-7597-4f1f-b57d-52caac159081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:07.825607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-63453f8c-7597-4f1f-b57d-52caac159081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:07.828605 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1042/2066] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:07 2022] DELETE /identity/v3/projects/6b1a7199c8c14e9c8714d524e240cce2 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:07.835566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad5321-db6d-4e1e-888f-b6d97c210be2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:07.836087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad5321-db6d-4e1e-888f-b6d97c210be2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:07.837082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad5321-db6d-4e1e-888f-b6d97c210be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:07.862735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-bbad5321-db6d-4e1e-888f-b6d97c210be2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:07.863973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bbad5321-db6d-4e1e-888f-b6d97c210be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:07.944982 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1025/2067] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:07 2022] DELETE /identity/v3/users/38e7c54405234d278a428f9d1a97bff8 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:08.028731 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1043/2068] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:12:08.036653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e439b-1bd4-4b49-82f3-9d9460dac7c9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:08.041025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e439b-1bd4-4b49-82f3-9d9460dac7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:08.041025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e439b-1bd4-4b49-82f3-9d9460dac7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:08.068083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d31e439b-1bd4-4b49-82f3-9d9460dac7c9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:08.097487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d31e439b-1bd4-4b49-82f3-9d9460dac7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:08.172794 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1026/2069] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:08.176446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad5321-db6d-4e1e-888f-b6d97c210be2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:08.191563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad5321-db6d-4e1e-888f-b6d97c210be2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:08.205439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb61c8-b58b-4f44-974f-c4dcb087e513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:08.206367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb61c8-b58b-4f44-974f-c4dcb087e513 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:08.206759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb61c8-b58b-4f44-974f-c4dcb087e513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:08.207137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb61c8-b58b-4f44-974f-c4dcb087e513 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:08.207998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb61c8-b58b-4f44-974f-c4dcb087e513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:12:08.208417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb61c8-b58b-4f44-974f-c4dcb087e513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:08.210228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb61c8-b58b-4f44-974f-c4dcb087e513 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:08.228590 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1044/2070] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:12:08.238683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e439b-1bd4-4b49-82f3-9d9460dac7c9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:08.249883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e439b-1bd4-4b49-82f3-9d9460dac7c9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:08.264082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed859b-1a61-49c0-ae5b-64e794c2a8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:08.265663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed859b-1a61-49c0-ae5b-64e794c2a8ca admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:08.266140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed859b-1a61-49c0-ae5b-64e794c2a8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:08.266571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed859b-1a61-49c0-ae5b-64e794c2a8ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:08.267499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed859b-1a61-49c0-ae5b-64e794c2a8ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:08.270234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed859b-1a61-49c0-ae5b-64e794c2a8ca admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:08.298611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916591e3-4b44-45d5-8e5d-72271c5b8226 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:08.299250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916591e3-4b44-45d5-8e5d-72271c5b8226 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:08.299726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916591e3-4b44-45d5-8e5d-72271c5b8226 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:08.301757 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1045/2071] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:12:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 14:12:08.308073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26472251-36de-4a5b-9afb-8f6aa466badb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:08.309278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26472251-36de-4a5b-9afb-8f6aa466badb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:08.309712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26472251-36de-4a5b-9afb-8f6aa466badb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:08.339297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-26472251-36de-4a5b-9afb-8f6aa466badb None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:08.340883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-26472251-36de-4a5b-9afb-8f6aa466badb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:08.408813 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1027/2072] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:08 2022] POST /identity/v3/projects => generated 395 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:08.410092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed859b-1a61-49c0-ae5b-64e794c2a8ca admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:08.416564 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1046/2073] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:12:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:08.445089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26472251-36de-4a5b-9afb-8f6aa466badb None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:08.447712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-26472251-36de-4a5b-9afb-8f6aa466badb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:08.463474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26472251-36de-4a5b-9afb-8f6aa466badb None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:08.507358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed859b-1a61-49c0-ae5b-64e794c2a8ca admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:08.513710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e318754-145a-46e9-88f3-818da35964ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:08.514595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e318754-145a-46e9-88f3-818da35964ce admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:08.515401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e318754-145a-46e9-88f3-818da35964ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:08.515802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e318754-145a-46e9-88f3-818da35964ce admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:08.519709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e318754-145a-46e9-88f3-818da35964ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:08.520274 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:08.522897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e318754-145a-46e9-88f3-818da35964ce admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:08.576117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a83688-db24-438e-b510-6c9f47293b82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:08.576796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a83688-db24-438e-b510-6c9f47293b82 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:08.577125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a83688-db24-438e-b510-6c9f47293b82 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:08.577409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a83688-db24-438e-b510-6c9f47293b82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:08.587812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a83688-db24-438e-b510-6c9f47293b82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:08.589533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a83688-db24-438e-b510-6c9f47293b82 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:08.601399 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1047/2074] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:12:08.624510 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1028/2075] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:08 2022] POST /identity/v3/users => generated 298 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:08.624874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a83688-db24-438e-b510-6c9f47293b82 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:08.655159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a83688-db24-438e-b510-6c9f47293b82 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:08.660738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceefeb2-8b7e-422f-a0d4-d66d8e4819c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:08.661486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceefeb2-8b7e-422f-a0d4-d66d8e4819c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:08.661785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceefeb2-8b7e-422f-a0d4-d66d8e4819c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:08.662069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceefeb2-8b7e-422f-a0d4-d66d8e4819c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:08.662899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceefeb2-8b7e-422f-a0d4-d66d8e4819c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:08.665756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceefeb2-8b7e-422f-a0d4-d66d8e4819c2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:08.691942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e318754-145a-46e9-88f3-818da35964ce admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:08.694518 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1048/2076] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:12:08.707753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e318754-145a-46e9-88f3-818da35964ce admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:08.721099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13040e03-cbe1-412a-84b4-0603c4674987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:08.721802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13040e03-cbe1-412a-84b4-0603c4674987 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:08.722087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13040e03-cbe1-412a-84b4-0603c4674987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:08.722405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13040e03-cbe1-412a-84b4-0603c4674987 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:08.723324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13040e03-cbe1-412a-84b4-0603c4674987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:08.724929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13040e03-cbe1-412a-84b4-0603c4674987 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:08.739522 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1029/2077] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:12:08.744014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceefeb2-8b7e-422f-a0d4-d66d8e4819c2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:08.756924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceefeb2-8b7e-422f-a0d4-d66d8e4819c2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:08.762668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067e94a-9816-426a-8c7d-20de00d333b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:08.763834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067e94a-9816-426a-8c7d-20de00d333b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:08.764071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067e94a-9816-426a-8c7d-20de00d333b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:08.764356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5067e94a-9816-426a-8c7d-20de00d333b6 admin admin] PATH_INFO: `/v3/projects/9d84f729c1414a42a73792d4093d5bda/users/6b13cdd4117640b49cf9f74cc12d16f4/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:08.787087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067e94a-9816-426a-8c7d-20de00d333b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d84f729c1414a42a73792d4093d5bda, user_id=6b13cdd4117640b49cf9f74cc12d16f4, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:08.791065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5067e94a-9816-426a-8c7d-20de00d333b6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:08.902802 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1049/2078] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:08 2022] PUT /identity/v3/projects/9d84f729c1414a42a73792d4093d5bda/users/6b13cdd4117640b49cf9f74cc12d16f4/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:08.908242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d51a57-caa3-439c-885c-98a2943823d6 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:08.908775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d51a57-caa3-439c-885c-98a2943823d6 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:08.909198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d51a57-caa3-439c-885c-98a2943823d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:08.940618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f2d51a57-caa3-439c-885c-98a2943823d6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:08.941774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f2d51a57-caa3-439c-885c-98a2943823d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:09.022080 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1030/2079] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:09.056080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067e94a-9816-426a-8c7d-20de00d333b6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:09.058224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5067e94a-9816-426a-8c7d-20de00d333b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:09.174399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5067e94a-9816-426a-8c7d-20de00d333b6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:09.181641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2096e7-33fa-4c72-b3ec-aee80922fcab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:09.181816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d51a57-caa3-439c-885c-98a2943823d6 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:09.182292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2096e7-33fa-4c72-b3ec-aee80922fcab service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:09.182679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2096e7-33fa-4c72-b3ec-aee80922fcab service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:09.182966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2096e7-33fa-4c72-b3ec-aee80922fcab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:09.183281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f2d51a57-caa3-439c-885c-98a2943823d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:09.196825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2096e7-33fa-4c72-b3ec-aee80922fcab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:09.198222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2096e7-33fa-4c72-b3ec-aee80922fcab service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:09.205672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d51a57-caa3-439c-885c-98a2943823d6 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:09.228940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c18fd1-8c69-47be-95ea-dcda39703dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:09.229301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c18fd1-8c69-47be-95ea-dcda39703dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:09.229554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c18fd1-8c69-47be-95ea-dcda39703dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:09.229828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c18fd1-8c69-47be-95ea-dcda39703dc7 admin admin] PATH_INFO: `/v3/projects/8a251de840f84362a17c55e30e3c81ca` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:09.231516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c18fd1-8c69-47be-95ea-dcda39703dc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a251de840f84362a17c55e30e3c81ca)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:09.233432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c18fd1-8c69-47be-95ea-dcda39703dc7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:09.241424 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1050/2080] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:09.242492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2096e7-33fa-4c72-b3ec-aee80922fcab service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:09.245247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ea2096e7-33fa-4c72-b3ec-aee80922fcab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:09.332878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2096e7-33fa-4c72-b3ec-aee80922fcab service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:09.340221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab7baff-56c3-4136-9145-15e46f893af3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:09.341100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7baff-56c3-4136-9145-15e46f893af3 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:09.344096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7baff-56c3-4136-9145-15e46f893af3 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:09.344096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab7baff-56c3-4136-9145-15e46f893af3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:09.344524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fab7baff-56c3-4136-9145-15e46f893af3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:09.425532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7baff-56c3-4136-9145-15e46f893af3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:09.428065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab7baff-56c3-4136-9145-15e46f893af3 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:09.453425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6c18fd1-8c69-47be-95ea-dcda39703dc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a251de840f84362a17c55e30e3c81ca', 'request_id': 'req-f6c18fd1-8c69-47be-95ea-dcda39703dc7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:09.459940 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1051/2081] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:09.503030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dd03a-1fc6-446b-aaee-b28dae0a94ad None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:09.504000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dd03a-1fc6-446b-aaee-b28dae0a94ad None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:09.504346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dd03a-1fc6-446b-aaee-b28dae0a94ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:09.530645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-417dd03a-1fc6-446b-aaee-b28dae0a94ad None None] MFA Rules not processed for user `4893403562c542fbb9fad5c5b37501f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:09.531886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-417dd03a-1fc6-446b-aaee-b28dae0a94ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:09.553735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6c18fd1-8c69-47be-95ea-dcda39703dc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a251de840f84362a17c55e30e3c81ca', 'request_id': 'req-f6c18fd1-8c69-47be-95ea-dcda39703dc7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:09.562639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6c18fd1-8c69-47be-95ea-dcda39703dc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a251de840f84362a17c55e30e3c81ca', 'request_id': 'req-f6c18fd1-8c69-47be-95ea-dcda39703dc7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:09.584403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6c18fd1-8c69-47be-95ea-dcda39703dc7 admin admin] The token cache is being invalidate because project 8a251de840f84362a17c55e30e3c81ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:09.587320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6c18fd1-8c69-47be-95ea-dcda39703dc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:09.590188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6c18fd1-8c69-47be-95ea-dcda39703dc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:09.594732 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1031/2082] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:09 2022] DELETE /identity/v3/projects/8a251de840f84362a17c55e30e3c81ca => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:12:09.599652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fc605-d141-4332-9e6e-585492a0e7a1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:09.599895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fc605-d141-4332-9e6e-585492a0e7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:09.600186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fc605-d141-4332-9e6e-585492a0e7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:09.620998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a14fc605-d141-4332-9e6e-585492a0e7a1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:09.622262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a14fc605-d141-4332-9e6e-585492a0e7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:09.628075 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1052/2083] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:09.668156 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:09.693003 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1032/2084] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:09.701513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0f8b1-cd80-44a0-b434-16f2dec6a9b2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:09.701807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0f8b1-cd80-44a0-b434-16f2dec6a9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:09.702119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0f8b1-cd80-44a0-b434-16f2dec6a9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:09.728317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-27a0f8b1-cd80-44a0-b434-16f2dec6a9b2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:09.729581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-27a0f8b1-cd80-44a0-b434-16f2dec6a9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:09.738812 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1053/2085] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:12:09.743582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fc605-d141-4332-9e6e-585492a0e7a1 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:09.754603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fc605-d141-4332-9e6e-585492a0e7a1 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:09.760230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d02422-859d-42ff-b3a2-d0d906d5b31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:09.761048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d02422-859d-42ff-b3a2-d0d906d5b31b admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:09.761502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d02422-859d-42ff-b3a2-d0d906d5b31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:09.761785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d02422-859d-42ff-b3a2-d0d906d5b31b admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:09.762687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d02422-859d-42ff-b3a2-d0d906d5b31b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:12:09.763117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d02422-859d-42ff-b3a2-d0d906d5b31b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:09.764760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d02422-859d-42ff-b3a2-d0d906d5b31b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:09.778598 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1033/2086] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:12:09.783248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0f8b1-cd80-44a0-b434-16f2dec6a9b2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:09.807819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0f8b1-cd80-44a0-b434-16f2dec6a9b2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:09.819167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0d032-b461-44aa-bfe4-da14d006c43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:09.820067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0d032-b461-44aa-bfe4-da14d006c43c admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:09.820556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0d032-b461-44aa-bfe4-da14d006c43c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:09.821147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0d032-b461-44aa-bfe4-da14d006c43c admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:09.848808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0d032-b461-44aa-bfe4-da14d006c43c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:09.848808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0d032-b461-44aa-bfe4-da14d006c43c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:10.002344 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1054/2087] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:09 2022] POST /identity/v3/projects => generated 371 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:10.006726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d02422-859d-42ff-b3a2-d0d906d5b31b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:10.027380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d02422-859d-42ff-b3a2-d0d906d5b31b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:10.092095 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:10.109995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50f9cc-8ee6-4584-a58f-4d8222703267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:10.110727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50f9cc-8ee6-4584-a58f-4d8222703267 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:10.111139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50f9cc-8ee6-4584-a58f-4d8222703267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:10.111431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50f9cc-8ee6-4584-a58f-4d8222703267 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:10.112231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50f9cc-8ee6-4584-a58f-4d8222703267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:10.115822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50f9cc-8ee6-4584-a58f-4d8222703267 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:10.268787 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1034/2088] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:10 2022] POST /identity/v3/users => generated 286 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:10.270703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0d032-b461-44aa-bfe4-da14d006c43c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:10.285778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0d032-b461-44aa-bfe4-da14d006c43c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:10.307602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c130e-6504-416c-8258-6ca8504bfc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:10.308664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c130e-6504-416c-8258-6ca8504bfc69 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:10.309104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c130e-6504-416c-8258-6ca8504bfc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:10.309529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c130e-6504-416c-8258-6ca8504bfc69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:10.310901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c130e-6504-416c-8258-6ca8504bfc69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:10.312874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c130e-6504-416c-8258-6ca8504bfc69 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:10.332741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50f9cc-8ee6-4584-a58f-4d8222703267 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:10.343560 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1055/2089] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:10.345973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50f9cc-8ee6-4584-a58f-4d8222703267 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:10.351292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9abe8-f3f0-4b93-afa0-d937555db630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:10.352775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9abe8-f3f0-4b93-afa0-d937555db630 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:10.353329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9abe8-f3f0-4b93-afa0-d937555db630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:10.353960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9abe8-f3f0-4b93-afa0-d937555db630 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:10.354946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9abe8-f3f0-4b93-afa0-d937555db630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:10.357657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9abe8-f3f0-4b93-afa0-d937555db630 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:10.375013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c130e-6504-416c-8258-6ca8504bfc69 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:10.381365 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1035/2090] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:10.389089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c130e-6504-416c-8258-6ca8504bfc69 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:10.403678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb123382-a53a-4db0-8d57-8e3c693961b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:10.405684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb123382-a53a-4db0-8d57-8e3c693961b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:10.406433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb123382-a53a-4db0-8d57-8e3c693961b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:10.407084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb123382-a53a-4db0-8d57-8e3c693961b4 admin admin] PATH_INFO: `/v3/projects/463b902c96174f3ea6b63176aa7c43ae/users/937950fa5ce642c5800728eb2106b0ff/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:10.434254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb123382-a53a-4db0-8d57-8e3c693961b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=463b902c96174f3ea6b63176aa7c43ae, user_id=937950fa5ce642c5800728eb2106b0ff, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:10.437796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb123382-a53a-4db0-8d57-8e3c693961b4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:10.571443 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1056/2091] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:10 2022] PUT /identity/v3/projects/463b902c96174f3ea6b63176aa7c43ae/users/937950fa5ce642c5800728eb2106b0ff/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:12:10.583162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcd022-35e4-4ffe-bab4-4e0d8cae2929 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:10.583723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcd022-35e4-4ffe-bab4-4e0d8cae2929 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:10.584115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bcd022-35e4-4ffe-bab4-4e0d8cae2929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:10.615885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-45bcd022-35e4-4ffe-bab4-4e0d8cae2929 None None] MFA Rules not processed for user `937950fa5ce642c5800728eb2106b0ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:10.618682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-45bcd022-35e4-4ffe-bab4-4e0d8cae2929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:10.786067 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1036/2092] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:10.790345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb123382-a53a-4db0-8d57-8e3c693961b4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:10.902771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb123382-a53a-4db0-8d57-8e3c693961b4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:10.908665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf6ec6-b95a-4ce0-995d-efb3bed35c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:10.909638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf6ec6-b95a-4ce0-995d-efb3bed35c77 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:10.910053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf6ec6-b95a-4ce0-995d-efb3bed35c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:10.910593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cf6ec6-b95a-4ce0-995d-efb3bed35c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:10.911698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf6ec6-b95a-4ce0-995d-efb3bed35c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:10.915033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cf6ec6-b95a-4ce0-995d-efb3bed35c77 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:10.959046 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:11.052416 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1057/2093] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:10 2022] POST /identity/v3/projects => generated 371 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:11.056745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcd022-35e4-4ffe-bab4-4e0d8cae2929 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:11.071291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bcd022-35e4-4ffe-bab4-4e0d8cae2929 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:11.151675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18557f-5f79-4379-8d13-a60d0cab305b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:11.152651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18557f-5f79-4379-8d13-a60d0cab305b admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:11.153046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18557f-5f79-4379-8d13-a60d0cab305b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:11.153449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18557f-5f79-4379-8d13-a60d0cab305b admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:11.154361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18557f-5f79-4379-8d13-a60d0cab305b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:11.156810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18557f-5f79-4379-8d13-a60d0cab305b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:11.282147 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1037/2094] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:11 2022] POST /identity/v3/users => generated 292 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:11.286088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf6ec6-b95a-4ce0-995d-efb3bed35c77 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:11.302329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cf6ec6-b95a-4ce0-995d-efb3bed35c77 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:11.309842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d879406-5568-4e10-8cb1-c9c611d067dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:11.311011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d879406-5568-4e10-8cb1-c9c611d067dc admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:11.311494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d879406-5568-4e10-8cb1-c9c611d067dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:11.312025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d879406-5568-4e10-8cb1-c9c611d067dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:11.313177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d879406-5568-4e10-8cb1-c9c611d067dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:11.315954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d879406-5568-4e10-8cb1-c9c611d067dc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:11.349003 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1058/2095] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:12:11.350895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18557f-5f79-4379-8d13-a60d0cab305b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:11.372930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18557f-5f79-4379-8d13-a60d0cab305b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:11.381471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bcff4-a266-4355-b099-be551f34eea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:11.382471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bcff4-a266-4355-b099-be551f34eea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:11.382761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bcff4-a266-4355-b099-be551f34eea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:11.383047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bcff4-a266-4355-b099-be551f34eea0 admin admin] PATH_INFO: `/v3/projects/8f6c81961bc64c50beb8b58593a68263/users/fbe6b31c165a4829a7130d9a72f6c77e/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:11.387834 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:11.415406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bcff4-a266-4355-b099-be551f34eea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6c81961bc64c50beb8b58593a68263, user_id=fbe6b31c165a4829a7130d9a72f6c77e, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:11.421029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bcff4-a266-4355-b099-be551f34eea0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:11.531878 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1038/2096] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:11 2022] PUT /identity/v3/projects/8f6c81961bc64c50beb8b58593a68263/users/fbe6b31c165a4829a7130d9a72f6c77e/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:11.535849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d879406-5568-4e10-8cb1-c9c611d067dc admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:11.547829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d879406-5568-4e10-8cb1-c9c611d067dc admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:11.622684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4199aac-59ae-45bb-94b0-9c587e16ce15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:11.623384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4199aac-59ae-45bb-94b0-9c587e16ce15 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:11.623672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4199aac-59ae-45bb-94b0-9c587e16ce15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:11.623993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4199aac-59ae-45bb-94b0-9c587e16ce15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:11.624944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4199aac-59ae-45bb-94b0-9c587e16ce15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:11.626565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4199aac-59ae-45bb-94b0-9c587e16ce15 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:11.637930 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1059/2097] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:11.642208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bcff4-a266-4355-b099-be551f34eea0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:11.653430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bcff4-a266-4355-b099-be551f34eea0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:11.658068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7694d3-725e-4ab9-84d0-63626292f54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:11.659008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7694d3-725e-4ab9-84d0-63626292f54f admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:11.659360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7694d3-725e-4ab9-84d0-63626292f54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:11.659643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7694d3-725e-4ab9-84d0-63626292f54f admin admin] PATH_INFO: `/v3/projects/8f6c81961bc64c50beb8b58593a68263/users/fbe6b31c165a4829a7130d9a72f6c77e/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:11.661672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7694d3-725e-4ab9-84d0-63626292f54f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6c81961bc64c50beb8b58593a68263, user_id=fbe6b31c165a4829a7130d9a72f6c77e, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:11.664357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7694d3-725e-4ab9-84d0-63626292f54f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:11.675893 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1039/2098] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:11 2022] PUT /identity/v3/projects/8f6c81961bc64c50beb8b58593a68263/users/fbe6b31c165a4829a7130d9a72f6c77e/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:11.687467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae222fc-5bda-47c5-9d97-500470688377 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:11.687953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae222fc-5bda-47c5-9d97-500470688377 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:11.688386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae222fc-5bda-47c5-9d97-500470688377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:11.747761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8ae222fc-5bda-47c5-9d97-500470688377 None None] MFA Rules not processed for user `fbe6b31c165a4829a7130d9a72f6c77e`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:11.749035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8ae222fc-5bda-47c5-9d97-500470688377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:11.859144 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1060/2099] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:11.872509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7694d3-725e-4ab9-84d0-63626292f54f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:11.875113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2e7694d3-725e-4ab9-84d0-63626292f54f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:11.959754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7694d3-725e-4ab9-84d0-63626292f54f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:11.966828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d939ec-0206-452e-82a0-d236a3cb149f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:11.967644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d939ec-0206-452e-82a0-d236a3cb149f service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:11.967965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d939ec-0206-452e-82a0-d236a3cb149f service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:11.968544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d939ec-0206-452e-82a0-d236a3cb149f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:11.980749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d939ec-0206-452e-82a0-d236a3cb149f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:11.982902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d939ec-0206-452e-82a0-d236a3cb149f service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:11.994163 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:11.999765 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1040/2100] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:12.295300 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:12.611710 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:12.845625 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:13.810370 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:14.327944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae222fc-5bda-47c5-9d97-500470688377 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:14.349062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae222fc-5bda-47c5-9d97-500470688377 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:14.367302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fe1e6-add2-4967-b60c-1614279542e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:14.368415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fe1e6-add2-4967-b60c-1614279542e8 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:14.368657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fe1e6-add2-4967-b60c-1614279542e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:14.373701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fe1e6-add2-4967-b60c-1614279542e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:14.378756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-aa5fe1e6-add2-4967-b60c-1614279542e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:14.471336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fe1e6-add2-4967-b60c-1614279542e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:14.472870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fe1e6-add2-4967-b60c-1614279542e8 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:14.484629 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1061/2101] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:14.528878 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:14.699046 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:15.321921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d939ec-0206-452e-82a0-d236a3cb149f service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:15.503881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d939ec-0206-452e-82a0-d236a3cb149f service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:15.509040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efa06b-9575-4080-9b1c-d5d4a579a10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:15.519231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efa06b-9575-4080-9b1c-d5d4a579a10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:15.519524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efa06b-9575-4080-9b1c-d5d4a579a10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:15.522743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efa06b-9575-4080-9b1c-d5d4a579a10c admin admin] PATH_INFO: `/v3/users/937950fa5ce642c5800728eb2106b0ff` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:15.527222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efa06b-9575-4080-9b1c-d5d4a579a10c admin admin] RBAC: Authorizing `identity:delete_user(user_id=937950fa5ce642c5800728eb2106b0ff)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:15.532752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efa06b-9575-4080-9b1c-d5d4a579a10c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:15.802750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-01efa06b-9575-4080-9b1c-d5d4a579a10c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '937950fa5ce642c5800728eb2106b0ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:15.838750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-01efa06b-9575-4080-9b1c-d5d4a579a10c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '937950fa5ce642c5800728eb2106b0ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:15.839508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-01efa06b-9575-4080-9b1c-d5d4a579a10c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '937950fa5ce642c5800728eb2106b0ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:15.844334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-01efa06b-9575-4080-9b1c-d5d4a579a10c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '937950fa5ce642c5800728eb2106b0ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:15.853442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-01efa06b-9575-4080-9b1c-d5d4a579a10c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '937950fa5ce642c5800728eb2106b0ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:15.963209 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1041/2102] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:15 2022] DELETE /identity/v3/users/937950fa5ce642c5800728eb2106b0ff => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:15.967758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17533b-4947-4701-8868-66f99ab18e4e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:15.968319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17533b-4947-4701-8868-66f99ab18e4e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:15.968958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17533b-4947-4701-8868-66f99ab18e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:15.990766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-db17533b-4947-4701-8868-66f99ab18e4e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:15.991921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-db17533b-4947-4701-8868-66f99ab18e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:16.088407 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1062/2103] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:12:16.099041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efa06b-9575-4080-9b1c-d5d4a579a10c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:16.100998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-01efa06b-9575-4080-9b1c-d5d4a579a10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:16.191728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efa06b-9575-4080-9b1c-d5d4a579a10c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:16.198552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5304c0-5284-460b-8ca4-8a8d21aa3140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:16.199463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5304c0-5284-460b-8ca4-8a8d21aa3140 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:16.199855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5304c0-5284-460b-8ca4-8a8d21aa3140 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:16.200235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5304c0-5284-460b-8ca4-8a8d21aa3140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:16.212341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5304c0-5284-460b-8ca4-8a8d21aa3140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:16.214220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5304c0-5284-460b-8ca4-8a8d21aa3140 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:16.230535 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1042/2104] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:16.542699 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:16.896417 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:17.116565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17533b-4947-4701-8868-66f99ab18e4e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:17.120498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-db17533b-4947-4701-8868-66f99ab18e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:17.145094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17533b-4947-4701-8868-66f99ab18e4e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:17.162308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70a5b2-43ce-4d5d-8c45-967d742a5863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:17.163211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70a5b2-43ce-4d5d-8c45-967d742a5863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:17.163535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70a5b2-43ce-4d5d-8c45-967d742a5863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:17.163746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee70a5b2-43ce-4d5d-8c45-967d742a5863 admin admin] PATH_INFO: `/v3/users/3332dd100e1e461e9ad8d18471e691ee` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:17.175984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70a5b2-43ce-4d5d-8c45-967d742a5863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3332dd100e1e461e9ad8d18471e691ee)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:17.179198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee70a5b2-43ce-4d5d-8c45-967d742a5863 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:17.480666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ee70a5b2-43ce-4d5d-8c45-967d742a5863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3332dd100e1e461e9ad8d18471e691ee'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:17.504024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ee70a5b2-43ce-4d5d-8c45-967d742a5863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3332dd100e1e461e9ad8d18471e691ee'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:17.512456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ee70a5b2-43ce-4d5d-8c45-967d742a5863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3332dd100e1e461e9ad8d18471e691ee'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:17.513315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ee70a5b2-43ce-4d5d-8c45-967d742a5863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3332dd100e1e461e9ad8d18471e691ee'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:17.718812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ee70a5b2-43ce-4d5d-8c45-967d742a5863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3332dd100e1e461e9ad8d18471e691ee'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:17.727500 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1063/2105] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:17 2022] DELETE /identity/v3/users/3332dd100e1e461e9ad8d18471e691ee => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:17.733884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e571aad-7275-47a3-adfe-0a257e9a0b32 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:17.735366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e571aad-7275-47a3-adfe-0a257e9a0b32 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:17.735839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e571aad-7275-47a3-adfe-0a257e9a0b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:17.757214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7e571aad-7275-47a3-adfe-0a257e9a0b32 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:17.758582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7e571aad-7275-47a3-adfe-0a257e9a0b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:17.783062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70a5b2-43ce-4d5d-8c45-967d742a5863 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:17.784883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ee70a5b2-43ce-4d5d-8c45-967d742a5863 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:17.991446 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1043/2106] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:12:17.996221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee70a5b2-43ce-4d5d-8c45-967d742a5863 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:18.001998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a652d-f1cd-4d03-b5ee-71e2f6f4600a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:18.002978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a652d-f1cd-4d03-b5ee-71e2f6f4600a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:18.003267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a652d-f1cd-4d03-b5ee-71e2f6f4600a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:18.003732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a652d-f1cd-4d03-b5ee-71e2f6f4600a admin admin] PATH_INFO: `/v3/projects/463b902c96174f3ea6b63176aa7c43ae` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:18.011075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a652d-f1cd-4d03-b5ee-71e2f6f4600a admin admin] RBAC: Authorizing `identity:delete_project(project_id=463b902c96174f3ea6b63176aa7c43ae)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:18.013214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a652d-f1cd-4d03-b5ee-71e2f6f4600a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:18.030628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e571aad-7275-47a3-adfe-0a257e9a0b32 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:18.032380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7e571aad-7275-47a3-adfe-0a257e9a0b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:18.175946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e571aad-7275-47a3-adfe-0a257e9a0b32 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:18.181122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237ba52-c017-4929-bdcc-6f8b5c36defe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:18.181792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237ba52-c017-4929-bdcc-6f8b5c36defe service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:18.182085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237ba52-c017-4929-bdcc-6f8b5c36defe service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:18.183893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237ba52-c017-4929-bdcc-6f8b5c36defe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:18.203339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237ba52-c017-4929-bdcc-6f8b5c36defe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:18.205318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237ba52-c017-4929-bdcc-6f8b5c36defe service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:18.229068 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1044/2107] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:18.260076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b25a652d-f1cd-4d03-b5ee-71e2f6f4600a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '463b902c96174f3ea6b63176aa7c43ae', 'request_id': 'req-b25a652d-f1cd-4d03-b5ee-71e2f6f4600a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:18.267964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b25a652d-f1cd-4d03-b5ee-71e2f6f4600a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '463b902c96174f3ea6b63176aa7c43ae', 'request_id': 'req-b25a652d-f1cd-4d03-b5ee-71e2f6f4600a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:18.295267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b25a652d-f1cd-4d03-b5ee-71e2f6f4600a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '463b902c96174f3ea6b63176aa7c43ae', 'request_id': 'req-b25a652d-f1cd-4d03-b5ee-71e2f6f4600a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:18.346301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237ba52-c017-4929-bdcc-6f8b5c36defe service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:18.346301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8237ba52-c017-4929-bdcc-6f8b5c36defe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:18.411386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b25a652d-f1cd-4d03-b5ee-71e2f6f4600a admin admin] The token cache is being invalidate because project 463b902c96174f3ea6b63176aa7c43ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:18.411683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b25a652d-f1cd-4d03-b5ee-71e2f6f4600a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:18.413707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b25a652d-f1cd-4d03-b5ee-71e2f6f4600a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:18.417845 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1064/2108] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:17 2022] DELETE /identity/v3/projects/463b902c96174f3ea6b63176aa7c43ae => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:12:18.422209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a652d-f1cd-4d03-b5ee-71e2f6f4600a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:18.425792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b25a652d-f1cd-4d03-b5ee-71e2f6f4600a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:18.543306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237ba52-c017-4929-bdcc-6f8b5c36defe service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:18.553446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a652d-f1cd-4d03-b5ee-71e2f6f4600a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:18.560988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0edbfb-1351-4f36-803e-d64d0cb7f07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:18.562565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0edbfb-1351-4f36-803e-d64d0cb7f07c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:18.563080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0edbfb-1351-4f36-803e-d64d0cb7f07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:18.566043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0edbfb-1351-4f36-803e-d64d0cb7f07c admin admin] PATH_INFO: `/v3/users/fbe6b31c165a4829a7130d9a72f6c77e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:18.566043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0edbfb-1351-4f36-803e-d64d0cb7f07c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbe6b31c165a4829a7130d9a72f6c77e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:18.567803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0edbfb-1351-4f36-803e-d64d0cb7f07c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:18.716818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bc842-eba1-417c-910a-16a2a4170642 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:18.718196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bc842-eba1-417c-910a-16a2a4170642 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:18.719422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bc842-eba1-417c-910a-16a2a4170642 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:18.719718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8bc842-eba1-417c-910a-16a2a4170642 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:18.721753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1f8bc842-eba1-417c-910a-16a2a4170642 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:18.796740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8bc842-eba1-417c-910a-16a2a4170642 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:18.800396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8bc842-eba1-417c-910a-16a2a4170642 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:18.812041 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1045/2109] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:18.813107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bc842-eba1-417c-910a-16a2a4170642 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:18.814799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1f8bc842-eba1-417c-910a-16a2a4170642 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:18.830684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8bc842-eba1-417c-910a-16a2a4170642 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:18.835589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4a0edbfb-1351-4f36-803e-d64d0cb7f07c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbe6b31c165a4829a7130d9a72f6c77e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:18.835916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127218a-08c1-46ba-8ab4-6c9c314cfbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:18.837492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127218a-08c1-46ba-8ab4-6c9c314cfbc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:18.837785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127218a-08c1-46ba-8ab4-6c9c314cfbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:18.838060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127218a-08c1-46ba-8ab4-6c9c314cfbc5 admin admin] PATH_INFO: `/v3/projects/8b5870cfe962401b82813a02a7bbca3f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:18.839692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127218a-08c1-46ba-8ab4-6c9c314cfbc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5870cfe962401b82813a02a7bbca3f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:18.841840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127218a-08c1-46ba-8ab4-6c9c314cfbc5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:18.852382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4a0edbfb-1351-4f36-803e-d64d0cb7f07c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbe6b31c165a4829a7130d9a72f6c77e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:18.868937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4a0edbfb-1351-4f36-803e-d64d0cb7f07c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbe6b31c165a4829a7130d9a72f6c77e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:18.869945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4a0edbfb-1351-4f36-803e-d64d0cb7f07c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbe6b31c165a4829a7130d9a72f6c77e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:18.935973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4a0edbfb-1351-4f36-803e-d64d0cb7f07c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbe6b31c165a4829a7130d9a72f6c77e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:18.943260 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1065/2110] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:18 2022] DELETE /identity/v3/users/fbe6b31c165a4829a7130d9a72f6c77e => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:18.944846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127325b-c6ad-4a4b-baea-f601831bcd58 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:18.945291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127325b-c6ad-4a4b-baea-f601831bcd58 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:18.945744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8127325b-c6ad-4a4b-baea-f601831bcd58 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:18.950863 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1066/2111] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:12:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:12:18.957650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ddb7b-13ef-4864-b085-d46d17211a2c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:18.958243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ddb7b-13ef-4864-b085-d46d17211a2c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:18.958673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ddb7b-13ef-4864-b085-d46d17211a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:18.982542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0a4ddb7b-13ef-4864-b085-d46d17211a2c None None] MFA Rules not processed for user `e997b70d7158446daa1dfa225eb7afca`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:18.984181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0a4ddb7b-13ef-4864-b085-d46d17211a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:19.012756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3127218a-08c1-46ba-8ab4-6c9c314cfbc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5870cfe962401b82813a02a7bbca3f', 'request_id': 'req-3127218a-08c1-46ba-8ab4-6c9c314cfbc5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:19.090421 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1067/2112] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:12:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:12:19.122583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ddb7b-13ef-4864-b085-d46d17211a2c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:19.126760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0a4ddb7b-13ef-4864-b085-d46d17211a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:19.129098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3127218a-08c1-46ba-8ab4-6c9c314cfbc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5870cfe962401b82813a02a7bbca3f', 'request_id': 'req-3127218a-08c1-46ba-8ab4-6c9c314cfbc5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:19.145762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3127218a-08c1-46ba-8ab4-6c9c314cfbc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5870cfe962401b82813a02a7bbca3f', 'request_id': 'req-3127218a-08c1-46ba-8ab4-6c9c314cfbc5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:19.148022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ddb7b-13ef-4864-b085-d46d17211a2c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:19.169176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dd65ec-e6b3-45f0-ac47-3029a8173c92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:19.169884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd65ec-e6b3-45f0-ac47-3029a8173c92 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:19.170217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd65ec-e6b3-45f0-ac47-3029a8173c92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:19.173138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd65ec-e6b3-45f0-ac47-3029a8173c92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:19.185944 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:19.190638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd65ec-e6b3-45f0-ac47-3029a8173c92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:19.191796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3127218a-08c1-46ba-8ab4-6c9c314cfbc5 admin admin] The token cache is being invalidate because project 8b5870cfe962401b82813a02a7bbca3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:19.192255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3127218a-08c1-46ba-8ab4-6c9c314cfbc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:19.192924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dd65ec-e6b3-45f0-ac47-3029a8173c92 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:19.193429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3127218a-08c1-46ba-8ab4-6c9c314cfbc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:19.197513 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1046/2113] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:18 2022] DELETE /identity/v3/projects/8b5870cfe962401b82813a02a7bbca3f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:19.202162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127218a-08c1-46ba-8ab4-6c9c314cfbc5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:19.222804 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1068/2114] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:12:19.235791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3127218a-08c1-46ba-8ab4-6c9c314cfbc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:19.416999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127218a-08c1-46ba-8ab4-6c9c314cfbc5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:19.432007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74c0c9-7010-4747-9f29-a0eb2a35ca47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:19.433150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74c0c9-7010-4747-9f29-a0eb2a35ca47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:19.433502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74c0c9-7010-4747-9f29-a0eb2a35ca47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:19.433845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a74c0c9-7010-4747-9f29-a0eb2a35ca47 admin admin] PATH_INFO: `/v3/users/0d78903fdd6e450e80249fa9c2f310f8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:19.441548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74c0c9-7010-4747-9f29-a0eb2a35ca47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d78903fdd6e450e80249fa9c2f310f8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:19.441548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a74c0c9-7010-4747-9f29-a0eb2a35ca47 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:19.626074 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:19.716587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6a74c0c9-7010-4747-9f29-a0eb2a35ca47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d78903fdd6e450e80249fa9c2f310f8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:19.747000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6a74c0c9-7010-4747-9f29-a0eb2a35ca47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d78903fdd6e450e80249fa9c2f310f8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:19.749728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6a74c0c9-7010-4747-9f29-a0eb2a35ca47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d78903fdd6e450e80249fa9c2f310f8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:19.749728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6a74c0c9-7010-4747-9f29-a0eb2a35ca47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d78903fdd6e450e80249fa9c2f310f8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:19.769511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6a74c0c9-7010-4747-9f29-a0eb2a35ca47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d78903fdd6e450e80249fa9c2f310f8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:19.860618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dbfb7-3b28-4adc-aed4-66d2e9d01c08 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:19.860906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dbfb7-3b28-4adc-aed4-66d2e9d01c08 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:19.861362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7dbfb7-3b28-4adc-aed4-66d2e9d01c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:19.893584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6b7dbfb7-3b28-4adc-aed4-66d2e9d01c08 None None] MFA Rules not processed for user `6b13cdd4117640b49cf9f74cc12d16f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:19.895127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6b7dbfb7-3b28-4adc-aed4-66d2e9d01c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:19.898134 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1047/2115] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:19 2022] DELETE /identity/v3/users/0d78903fdd6e450e80249fa9c2f310f8 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:12:19.939744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74c0c9-7010-4747-9f29-a0eb2a35ca47 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:19.942312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6a74c0c9-7010-4747-9f29-a0eb2a35ca47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:20.053124 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1069/2116] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:12:20.059753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dbfb7-3b28-4adc-aed4-66d2e9d01c08 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:20.081260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6b7dbfb7-3b28-4adc-aed4-66d2e9d01c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:20.093745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a74c0c9-7010-4747-9f29-a0eb2a35ca47 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:20.095192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7dbfb7-3b28-4adc-aed4-66d2e9d01c08 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:20.107272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822512b1-4069-4f92-b672-346ff6eaa726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:20.108093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5b493-8d7d-4e4f-9726-ced51062ab00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:20.109141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5b493-8d7d-4e4f-9726-ced51062ab00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:20.109979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822512b1-4069-4f92-b672-346ff6eaa726 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:20.112305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5b493-8d7d-4e4f-9726-ced51062ab00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:20.112597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c5b493-8d7d-4e4f-9726-ced51062ab00 admin admin] PATH_INFO: `/v3/projects/8f6c81961bc64c50beb8b58593a68263` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:20.113039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822512b1-4069-4f92-b672-346ff6eaa726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:20.113340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822512b1-4069-4f92-b672-346ff6eaa726 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:20.114166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822512b1-4069-4f92-b672-346ff6eaa726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:20.116024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822512b1-4069-4f92-b672-346ff6eaa726 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:20.119812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5b493-8d7d-4e4f-9726-ced51062ab00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f6c81961bc64c50beb8b58593a68263)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:20.121717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c5b493-8d7d-4e4f-9726-ced51062ab00 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:20.287139 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1070/2117] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:20 2022] POST /identity/v3/projects => generated 395 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:12:20.288895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f436b9-0821-4970-82f2-b6d9d88fb20f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:20.289194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f436b9-0821-4970-82f2-b6d9d88fb20f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:20.289958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f436b9-0821-4970-82f2-b6d9d88fb20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:20.307530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c5c5b493-8d7d-4e4f-9726-ced51062ab00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f6c81961bc64c50beb8b58593a68263', 'request_id': 'req-c5c5b493-8d7d-4e4f-9726-ced51062ab00'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:20.322090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e8f436b9-0821-4970-82f2-b6d9d88fb20f None None] MFA Rules not processed for user `ce5e1a5541ff4454b5c37b8a57d5e0d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:20.323550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e8f436b9-0821-4970-82f2-b6d9d88fb20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:20.385361 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1071/2118] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:20.399374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f436b9-0821-4970-82f2-b6d9d88fb20f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:20.399374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e8f436b9-0821-4970-82f2-b6d9d88fb20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:20.564000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f436b9-0821-4970-82f2-b6d9d88fb20f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:20.564000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d96bc-34cb-4ef1-a8d6-cc139d846fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:20.564000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d96bc-34cb-4ef1-a8d6-cc139d846fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:20.564000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d96bc-34cb-4ef1-a8d6-cc139d846fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:20.567428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d96bc-34cb-4ef1-a8d6-cc139d846fd2 admin admin] PATH_INFO: `/v3/users/0d71ff1b9e0e46cca3aec4415230a7f0` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:20.567428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d96bc-34cb-4ef1-a8d6-cc139d846fd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d71ff1b9e0e46cca3aec4415230a7f0)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:20.567428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d96bc-34cb-4ef1-a8d6-cc139d846fd2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:20.626245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c5c5b493-8d7d-4e4f-9726-ced51062ab00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f6c81961bc64c50beb8b58593a68263', 'request_id': 'req-c5c5b493-8d7d-4e4f-9726-ced51062ab00'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:20.628286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c5c5b493-8d7d-4e4f-9726-ced51062ab00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f6c81961bc64c50beb8b58593a68263', 'request_id': 'req-c5c5b493-8d7d-4e4f-9726-ced51062ab00'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:20.644121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c5c5b493-8d7d-4e4f-9726-ced51062ab00 admin admin] The token cache is being invalidate because project 8f6c81961bc64c50beb8b58593a68263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:20.644497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c5c5b493-8d7d-4e4f-9726-ced51062ab00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:20.645298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c5c5b493-8d7d-4e4f-9726-ced51062ab00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:20.650978 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1048/2119] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:19 2022] DELETE /identity/v3/projects/8f6c81961bc64c50beb8b58593a68263 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:20.650978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5b493-8d7d-4e4f-9726-ced51062ab00 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:20.651217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c5c5b493-8d7d-4e4f-9726-ced51062ab00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:20.764932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c5b493-8d7d-4e4f-9726-ced51062ab00 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:20.774410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4882b8-2c6b-4377-b942-b618776e1381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:20.780076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4882b8-2c6b-4377-b942-b618776e1381 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:20.780076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4882b8-2c6b-4377-b942-b618776e1381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:20.780076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4882b8-2c6b-4377-b942-b618776e1381 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:20.780076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4882b8-2c6b-4377-b942-b618776e1381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:20.780076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4882b8-2c6b-4377-b942-b618776e1381 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:20.851619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fb3d96bc-34cb-4ef1-a8d6-cc139d846fd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d71ff1b9e0e46cca3aec4415230a7f0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:20.867998 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1049/2120] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:20 2022] POST /identity/v3/users => generated 304 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:20.869495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4882b8-2c6b-4377-b942-b618776e1381 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:20.871595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fc4882b8-2c6b-4377-b942-b618776e1381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:20.883960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fb3d96bc-34cb-4ef1-a8d6-cc139d846fd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d71ff1b9e0e46cca3aec4415230a7f0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:20.892100 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4882b8-2c6b-4377-b942-b618776e1381 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:20.894731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fb3d96bc-34cb-4ef1-a8d6-cc139d846fd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d71ff1b9e0e46cca3aec4415230a7f0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:20.894731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fb3d96bc-34cb-4ef1-a8d6-cc139d846fd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d71ff1b9e0e46cca3aec4415230a7f0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:20.899244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7c941f-fbd5-4f57-b18e-d6deb4ae8eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:20.902266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c941f-fbd5-4f57-b18e-d6deb4ae8eed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:20.902266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c941f-fbd5-4f57-b18e-d6deb4ae8eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:20.902266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7c941f-fbd5-4f57-b18e-d6deb4ae8eed admin admin] PATH_INFO: `/v3/projects/36e02b9a41af4253b2d95ef88f65ba6d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:20.902266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c941f-fbd5-4f57-b18e-d6deb4ae8eed admin admin] RBAC: Authorizing `identity:delete_project(project_id=36e02b9a41af4253b2d95ef88f65ba6d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:20.904189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7c941f-fbd5-4f57-b18e-d6deb4ae8eed admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:20.964111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fb3d96bc-34cb-4ef1-a8d6-cc139d846fd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d71ff1b9e0e46cca3aec4415230a7f0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:20.972033 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1072/2121] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:20 2022] DELETE /identity/v3/users/0d71ff1b9e0e46cca3aec4415230a7f0 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:20.973707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568f748-74d3-486d-af8e-968b2a11fa9c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:20.974002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568f748-74d3-486d-af8e-968b2a11fa9c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:20.974356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568f748-74d3-486d-af8e-968b2a11fa9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:21.000068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b568f748-74d3-486d-af8e-968b2a11fa9c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:21.001991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b568f748-74d3-486d-af8e-968b2a11fa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:21.089053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8a7c941f-fbd5-4f57-b18e-d6deb4ae8eed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36e02b9a41af4253b2d95ef88f65ba6d', 'request_id': 'req-8a7c941f-fbd5-4f57-b18e-d6deb4ae8eed'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:21.113302 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1073/2122] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:21.114509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568f748-74d3-486d-af8e-968b2a11fa9c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:21.116645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b568f748-74d3-486d-af8e-968b2a11fa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:21.131164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568f748-74d3-486d-af8e-968b2a11fa9c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:21.190081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8a7c941f-fbd5-4f57-b18e-d6deb4ae8eed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36e02b9a41af4253b2d95ef88f65ba6d', 'request_id': 'req-8a7c941f-fbd5-4f57-b18e-d6deb4ae8eed'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:21.203115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8a7c941f-fbd5-4f57-b18e-d6deb4ae8eed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36e02b9a41af4253b2d95ef88f65ba6d', 'request_id': 'req-8a7c941f-fbd5-4f57-b18e-d6deb4ae8eed'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:21.227787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f0f46-0627-4af5-bc1f-c47a3f866fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:21.228859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f0f46-0627-4af5-bc1f-c47a3f866fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:21.229147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f0f46-0627-4af5-bc1f-c47a3f866fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:21.229427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f0f46-0627-4af5-bc1f-c47a3f866fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:21.230574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f0f46-0627-4af5-bc1f-c47a3f866fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:21.232377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f0f46-0627-4af5-bc1f-c47a3f866fa6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:21.232502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8a7c941f-fbd5-4f57-b18e-d6deb4ae8eed admin admin] The token cache is being invalidate because project 36e02b9a41af4253b2d95ef88f65ba6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:21.232696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8a7c941f-fbd5-4f57-b18e-d6deb4ae8eed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:21.235723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8a7c941f-fbd5-4f57-b18e-d6deb4ae8eed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:21.237901 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1050/2123] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:20 2022] DELETE /identity/v3/projects/36e02b9a41af4253b2d95ef88f65ba6d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:21.239346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04d21e-132d-446a-bbf0-9db9b50eee20 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:21.239784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04d21e-132d-446a-bbf0-9db9b50eee20 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:21.240233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa04d21e-132d-446a-bbf0-9db9b50eee20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:21.255450 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1074/2124] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:21.255450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8537b-a78e-46a4-9a39-a301dc473e71 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:21.255450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8537b-a78e-46a4-9a39-a301dc473e71 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:21.256103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8537b-a78e-46a4-9a39-a301dc473e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:21.264501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-aa04d21e-132d-446a-bbf0-9db9b50eee20 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:21.265952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aa04d21e-132d-446a-bbf0-9db9b50eee20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:21.276543 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1051/2125] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:21.277978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db375cfd-4993-4177-98e0-1b89917c7449 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:21.278297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db375cfd-4993-4177-98e0-1b89917c7449 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:21.285174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db375cfd-4993-4177-98e0-1b89917c7449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:21.285506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-07c8537b-a78e-46a4-9a39-a301dc473e71 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:21.293947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-07c8537b-a78e-46a4-9a39-a301dc473e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:21.306281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-db375cfd-4993-4177-98e0-1b89917c7449 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:21.313735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-db375cfd-4993-4177-98e0-1b89917c7449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:21.314530 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1075/2126] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:21.314530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8537b-a78e-46a4-9a39-a301dc473e71 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:21.314530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-07c8537b-a78e-46a4-9a39-a301dc473e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:21.323715 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1052/2127] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:21.324591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db375cfd-4993-4177-98e0-1b89917c7449 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:21.326052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-db375cfd-4993-4177-98e0-1b89917c7449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:21.338359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8537b-a78e-46a4-9a39-a301dc473e71 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:21.347194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdf30a-b5b0-487d-9e36-7c49f937ef37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:21.348300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdf30a-b5b0-487d-9e36-7c49f937ef37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:21.348679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdf30a-b5b0-487d-9e36-7c49f937ef37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:21.349137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fdf30a-b5b0-487d-9e36-7c49f937ef37 admin admin] PATH_INFO: `/v3/projects/2104b56eef7740d293b14b72f61f2de1/users/c56cc2a24db643d69308ceb1d8c06c50/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:21.388699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdf30a-b5b0-487d-9e36-7c49f937ef37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2104b56eef7740d293b14b72f61f2de1, user_id=c56cc2a24db643d69308ceb1d8c06c50, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:21.398571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fdf30a-b5b0-487d-9e36-7c49f937ef37 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:21.401457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db375cfd-4993-4177-98e0-1b89917c7449 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:21.406119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f537576-7429-45c6-9eba-b728c1e12b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:21.409231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f537576-7429-45c6-9eba-b728c1e12b75 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:21.409231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f537576-7429-45c6-9eba-b728c1e12b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:21.409231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f537576-7429-45c6-9eba-b728c1e12b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:21.418073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f537576-7429-45c6-9eba-b728c1e12b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:21.419575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f537576-7429-45c6-9eba-b728c1e12b75 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:21.433673 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1053/2128] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:21.435206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f537576-7429-45c6-9eba-b728c1e12b75 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:21.447105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f537576-7429-45c6-9eba-b728c1e12b75 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:21.456076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c858e7-4d5f-467e-9348-00333622abbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:21.457179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c858e7-4d5f-467e-9348-00333622abbc admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:21.457656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c858e7-4d5f-467e-9348-00333622abbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:21.458147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c858e7-4d5f-467e-9348-00333622abbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:21.460549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c858e7-4d5f-467e-9348-00333622abbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:12:21.461228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c858e7-4d5f-467e-9348-00333622abbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:21.466082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c858e7-4d5f-467e-9348-00333622abbc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:21.497818 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1054/2129] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:12:21.501889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0e627-6baa-4db1-97ec-48192044b69e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:21.502218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0e627-6baa-4db1-97ec-48192044b69e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:21.502663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d0e627-6baa-4db1-97ec-48192044b69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:21.510203 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1076/2130] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:21 2022] PUT /identity/v3/projects/2104b56eef7740d293b14b72f61f2de1/users/c56cc2a24db643d69308ceb1d8c06c50/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:21.514218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdf30a-b5b0-487d-9e36-7c49f937ef37 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:21.537294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a4d0e627-6baa-4db1-97ec-48192044b69e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:21.538558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a4d0e627-6baa-4db1-97ec-48192044b69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:21.615139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fdf30a-b5b0-487d-9e36-7c49f937ef37 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:21.620122 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1055/2131] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:21.620966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0e627-6baa-4db1-97ec-48192044b69e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:21.625918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32b07e-31f6-4922-8b58-9e06ae5379d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:21.626829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32b07e-31f6-4922-8b58-9e06ae5379d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:21.627983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32b07e-31f6-4922-8b58-9e06ae5379d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:21.628573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32b07e-31f6-4922-8b58-9e06ae5379d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:21.629590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32b07e-31f6-4922-8b58-9e06ae5379d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:21.630345 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:21.635462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32b07e-31f6-4922-8b58-9e06ae5379d4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:21.635620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d0e627-6baa-4db1-97ec-48192044b69e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:21.640175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a730b15-1c21-4b7a-bf52-c71cbac9a2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:21.640882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a730b15-1c21-4b7a-bf52-c71cbac9a2ee admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:21.641136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a730b15-1c21-4b7a-bf52-c71cbac9a2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:21.641411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a730b15-1c21-4b7a-bf52-c71cbac9a2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:21.642252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a730b15-1c21-4b7a-bf52-c71cbac9a2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:21.643829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a730b15-1c21-4b7a-bf52-c71cbac9a2ee admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:21.654397 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1056/2132] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:21.660528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a730b15-1c21-4b7a-bf52-c71cbac9a2ee admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:21.667475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a730b15-1c21-4b7a-bf52-c71cbac9a2ee admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:21.672502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdee6c-314a-4801-8db0-37693f06b3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:21.673255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdee6c-314a-4801-8db0-37693f06b3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:21.673990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdee6c-314a-4801-8db0-37693f06b3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:21.673990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdee6c-314a-4801-8db0-37693f06b3e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:21.674856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdee6c-314a-4801-8db0-37693f06b3e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:12:21.675285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdee6c-314a-4801-8db0-37693f06b3e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:21.677081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdee6c-314a-4801-8db0-37693f06b3e1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:21.697500 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1057/2133] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:12:21.698481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdee6c-314a-4801-8db0-37693f06b3e1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:21.704439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-74fdee6c-314a-4801-8db0-37693f06b3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:21.741375 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1077/2134] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:21 2022] POST /identity/v3/projects => generated 387 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:21.741375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32b07e-31f6-4922-8b58-9e06ae5379d4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:21.887597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32b07e-31f6-4922-8b58-9e06ae5379d4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:21.894249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdee6c-314a-4801-8db0-37693f06b3e1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:21.898578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35fcda-4341-46af-849c-58036d609d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:21.902461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35fcda-4341-46af-849c-58036d609d1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:21.902761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35fcda-4341-46af-849c-58036d609d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:21.903563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff35fcda-4341-46af-849c-58036d609d1e admin admin] PATH_INFO: `/v3/projects/2104b56eef7740d293b14b72f61f2de1/users/c56cc2a24db643d69308ceb1d8c06c50/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:21.907724 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:21.913840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35fcda-4341-46af-849c-58036d609d1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2104b56eef7740d293b14b72f61f2de1, user_id=c56cc2a24db643d69308ceb1d8c06c50, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:21.913840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff35fcda-4341-46af-849c-58036d609d1e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:21.937190 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1078/2135] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:21 2022] PUT /identity/v3/projects/2104b56eef7740d293b14b72f61f2de1/users/c56cc2a24db643d69308ceb1d8c06c50/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:21.937190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35fcda-4341-46af-849c-58036d609d1e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:22.004608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6c5ad-e520-4cec-b8af-bfd9a73d5218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:22.005497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6c5ad-e520-4cec-b8af-bfd9a73d5218 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:22.005854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6c5ad-e520-4cec-b8af-bfd9a73d5218 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:22.006222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6c5ad-e520-4cec-b8af-bfd9a73d5218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:22.008155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a6b6c5ad-e520-4cec-b8af-bfd9a73d5218 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:22.038912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff35fcda-4341-46af-849c-58036d609d1e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:22.045744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50417347-70aa-4c50-8144-15c955cd0dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:22.046764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50417347-70aa-4c50-8144-15c955cd0dab admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:22.048473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50417347-70aa-4c50-8144-15c955cd0dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:22.048473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50417347-70aa-4c50-8144-15c955cd0dab admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:22.048473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50417347-70aa-4c50-8144-15c955cd0dab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:22.050457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50417347-70aa-4c50-8144-15c955cd0dab admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:22.125653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6c5ad-e520-4cec-b8af-bfd9a73d5218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:22.128915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6c5ad-e520-4cec-b8af-bfd9a73d5218 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:22.145943 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1058/2136] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:22.146820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6c5ad-e520-4cec-b8af-bfd9a73d5218 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:22.163938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6c5ad-e520-4cec-b8af-bfd9a73d5218 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:22.177850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a1090-5a25-4ea9-af14-9553a9da8b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:22.178581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a1090-5a25-4ea9-af14-9553a9da8b93 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:22.178869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a1090-5a25-4ea9-af14-9553a9da8b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:22.179152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a1090-5a25-4ea9-af14-9553a9da8b93 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:22.188806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a1090-5a25-4ea9-af14-9553a9da8b93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:22.193624 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1079/2137] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:21 2022] POST /identity/v3/projects => generated 383 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:22.194592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50417347-70aa-4c50-8144-15c955cd0dab admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:22.197074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46a1090-5a25-4ea9-af14-9553a9da8b93 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:22.203290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-50417347-70aa-4c50-8144-15c955cd0dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:22.321236 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1059/2138] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:22 2022] POST /identity/v3/users => generated 294 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:22.325185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a1090-5a25-4ea9-af14-9553a9da8b93 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:22.347388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a1090-5a25-4ea9-af14-9553a9da8b93 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:22.397954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50417347-70aa-4c50-8144-15c955cd0dab admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:22.405657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003fd13-eb17-4a76-9537-73f941c3a1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:22.406310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003fd13-eb17-4a76-9537-73f941c3a1ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:22.407541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003fd13-eb17-4a76-9537-73f941c3a1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:22.408196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003fd13-eb17-4a76-9537-73f941c3a1ea admin admin] PATH_INFO: `/v3/projects/2e58dc52f520463da9b5757bee5f5281` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:22.412860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003fd13-eb17-4a76-9537-73f941c3a1ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e58dc52f520463da9b5757bee5f5281)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:22.417236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003fd13-eb17-4a76-9537-73f941c3a1ea admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:22.465682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1c385-326d-4a62-ab2d-b4d2508402ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:22.466468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1c385-326d-4a62-ab2d-b4d2508402ce admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:22.466752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1c385-326d-4a62-ab2d-b4d2508402ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:22.467032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1c385-326d-4a62-ab2d-b4d2508402ce admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:22.467739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1c385-326d-4a62-ab2d-b4d2508402ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:22.479639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1c385-326d-4a62-ab2d-b4d2508402ce admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:22.578640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2003fd13-eb17-4a76-9537-73f941c3a1ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e58dc52f520463da9b5757bee5f5281', 'request_id': 'req-2003fd13-eb17-4a76-9537-73f941c3a1ea'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:22.596175 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1060/2139] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:22 2022] POST /identity/v3/users => generated 292 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:22.597253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1c385-326d-4a62-ab2d-b4d2508402ce admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:22.607168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2003fd13-eb17-4a76-9537-73f941c3a1ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e58dc52f520463da9b5757bee5f5281', 'request_id': 'req-2003fd13-eb17-4a76-9537-73f941c3a1ea'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:22.623999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1c385-326d-4a62-ab2d-b4d2508402ce admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:22.624845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2003fd13-eb17-4a76-9537-73f941c3a1ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e58dc52f520463da9b5757bee5f5281', 'request_id': 'req-2003fd13-eb17-4a76-9537-73f941c3a1ea'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:22.704406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906030c1-cdfc-4a3b-af54-421851ae201a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:22.705585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906030c1-cdfc-4a3b-af54-421851ae201a admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:22.705820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906030c1-cdfc-4a3b-af54-421851ae201a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:22.706074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906030c1-cdfc-4a3b-af54-421851ae201a admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:22.707010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906030c1-cdfc-4a3b-af54-421851ae201a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:22.709279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906030c1-cdfc-4a3b-af54-421851ae201a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:22.721647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2003fd13-eb17-4a76-9537-73f941c3a1ea admin admin] The token cache is being invalidate because project 2e58dc52f520463da9b5757bee5f5281 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:22.724148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2003fd13-eb17-4a76-9537-73f941c3a1ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:22.724532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2003fd13-eb17-4a76-9537-73f941c3a1ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:22.729799 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1080/2140] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:22 2022] DELETE /identity/v3/projects/2e58dc52f520463da9b5757bee5f5281 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:22.731498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003fd13-eb17-4a76-9537-73f941c3a1ea admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:22.735410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2003fd13-eb17-4a76-9537-73f941c3a1ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:22.753700 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1061/2141] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:22.754722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906030c1-cdfc-4a3b-af54-421851ae201a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:22.756660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-906030c1-cdfc-4a3b-af54-421851ae201a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:22.771674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906030c1-cdfc-4a3b-af54-421851ae201a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:22.777638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6158f-0527-44c5-a036-3c587a72e2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:22.778589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6158f-0527-44c5-a036-3c587a72e2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:22.778883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6158f-0527-44c5-a036-3c587a72e2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:22.779221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6158f-0527-44c5-a036-3c587a72e2f8 admin admin] PATH_INFO: `/v3/users/6e5a5bcb8c61408dbcc23d6bf0c73c46` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:22.779501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003fd13-eb17-4a76-9537-73f941c3a1ea admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:22.781306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6158f-0527-44c5-a036-3c587a72e2f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e5a5bcb8c61408dbcc23d6bf0c73c46)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:22.783645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6158f-0527-44c5-a036-3c587a72e2f8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:22.804745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fced4-5d62-494e-8ef5-23056968498b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:22.806250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fced4-5d62-494e-8ef5-23056968498b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:22.806952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fced4-5d62-494e-8ef5-23056968498b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:22.807955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fced4-5d62-494e-8ef5-23056968498b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:22.810368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fced4-5d62-494e-8ef5-23056968498b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:22.814592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fced4-5d62-494e-8ef5-23056968498b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:22.855034 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1081/2142] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:22.856316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fced4-5d62-494e-8ef5-23056968498b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:22.859327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2b2fced4-5d62-494e-8ef5-23056968498b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:22.885880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fced4-5d62-494e-8ef5-23056968498b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:22.904377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e19f3f-955b-49e3-aa59-80374a6c62d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:22.906499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e19f3f-955b-49e3-aa59-80374a6c62d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:22.908383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e19f3f-955b-49e3-aa59-80374a6c62d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:22.908682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e19f3f-955b-49e3-aa59-80374a6c62d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:22.909448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e19f3f-955b-49e3-aa59-80374a6c62d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:22.911399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e19f3f-955b-49e3-aa59-80374a6c62d5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:22.928169 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1082/2143] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:22.932470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e19f3f-955b-49e3-aa59-80374a6c62d5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:22.946083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e19f3f-955b-49e3-aa59-80374a6c62d5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:22.954312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894d4bd-c40e-4f54-adeb-a22504afdb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:22.955133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894d4bd-c40e-4f54-adeb-a22504afdb79 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:22.955526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894d4bd-c40e-4f54-adeb-a22504afdb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:22.955985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894d4bd-c40e-4f54-adeb-a22504afdb79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:22.956931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894d4bd-c40e-4f54-adeb-a22504afdb79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:22.958843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894d4bd-c40e-4f54-adeb-a22504afdb79 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:22.992245 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1083/2144] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:22.994604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ace6158f-0527-44c5-a036-3c587a72e2f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e5a5bcb8c61408dbcc23d6bf0c73c46'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:22.994906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894d4bd-c40e-4f54-adeb-a22504afdb79 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:23.024524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894d4bd-c40e-4f54-adeb-a22504afdb79 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:23.027943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ace6158f-0527-44c5-a036-3c587a72e2f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e5a5bcb8c61408dbcc23d6bf0c73c46'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:23.029011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ace6158f-0527-44c5-a036-3c587a72e2f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e5a5bcb8c61408dbcc23d6bf0c73c46'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:23.029971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ace6158f-0527-44c5-a036-3c587a72e2f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e5a5bcb8c61408dbcc23d6bf0c73c46'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:23.036845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e2f6ea-8085-4c4e-8ac7-2e2d21894dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:23.037975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2f6ea-8085-4c4e-8ac7-2e2d21894dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:23.038265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2f6ea-8085-4c4e-8ac7-2e2d21894dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:23.038570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e2f6ea-8085-4c4e-8ac7-2e2d21894dd4 admin admin] PATH_INFO: `/v3/projects/dd78958e961d4db3bccc8825aa907cd5/users/c07ded16810a439382d330ce0249d87d/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:23.044511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ace6158f-0527-44c5-a036-3c587a72e2f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e5a5bcb8c61408dbcc23d6bf0c73c46'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:23.058569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2f6ea-8085-4c4e-8ac7-2e2d21894dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd78958e961d4db3bccc8825aa907cd5, user_id=c07ded16810a439382d330ce0249d87d, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:23.061606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e2f6ea-8085-4c4e-8ac7-2e2d21894dd4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:23.142087 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1062/2145] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:22 2022] DELETE /identity/v3/users/6e5a5bcb8c61408dbcc23d6bf0c73c46 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:23.144349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6158f-0527-44c5-a036-3c587a72e2f8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:23.161342 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1084/2146] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:22 2022] PUT /identity/v3/projects/dd78958e961d4db3bccc8825aa907cd5/users/c07ded16810a439382d330ce0249d87d/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:23.170578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f1263-1987-4462-af6e-6041d1f7bdde None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:23.171218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f1263-1987-4462-af6e-6041d1f7bdde None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:23.171218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f1263-1987-4462-af6e-6041d1f7bdde None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:23.172680 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1085/2147] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 14:12:23.174514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c9946-5860-4f49-bcec-ad254bff8e6b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:23.174514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c9946-5860-4f49-bcec-ad254bff8e6b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:23.175012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6c9946-5860-4f49-bcec-ad254bff8e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:23.175501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ace6158f-0527-44c5-a036-3c587a72e2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:23.185413 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:23.235074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ff6c9946-5860-4f49-bcec-ad254bff8e6b None None] MFA Rules not processed for user `c07ded16810a439382d330ce0249d87d`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:23.236897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ff6c9946-5860-4f49-bcec-ad254bff8e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:23.320597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6158f-0527-44c5-a036-3c587a72e2f8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:23.397055 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1086/2148] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:12:23.400066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b7a0f-46a6-4cf3-bdab-708210dc0b7f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:23.400706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b7a0f-46a6-4cf3-bdab-708210dc0b7f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:23.402965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b7a0f-46a6-4cf3-bdab-708210dc0b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:23.436470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a73b7a0f-46a6-4cf3-bdab-708210dc0b7f None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:23.436470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a73b7a0f-46a6-4cf3-bdab-708210dc0b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:23.455108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45937587-e726-4081-966f-5c126e01ebe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:23.460856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45937587-e726-4081-966f-5c126e01ebe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:23.460856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45937587-e726-4081-966f-5c126e01ebe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:23.460856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45937587-e726-4081-966f-5c126e01ebe6 admin admin] PATH_INFO: `/v3/projects/9ff1651efc784abfbac8f076d5841db1/users/6301e86578c648dca2d250d7e22c89ea/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:23.481764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45937587-e726-4081-966f-5c126e01ebe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ff1651efc784abfbac8f076d5841db1, user_id=6301e86578c648dca2d250d7e22c89ea, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:23.485195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45937587-e726-4081-966f-5c126e01ebe6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:23.580113 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1087/2149] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:12:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:23.580973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b7a0f-46a6-4cf3-bdab-708210dc0b7f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:23.582622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a73b7a0f-46a6-4cf3-bdab-708210dc0b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:23.588848 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:23.600205 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1063/2150] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:23 2022] PUT /identity/v3/projects/9ff1651efc784abfbac8f076d5841db1/users/6301e86578c648dca2d250d7e22c89ea/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:23.610768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1e41-435a-407c-8704-4336457e9d48 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:23.611091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1e41-435a-407c-8704-4336457e9d48 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:23.611496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1e41-435a-407c-8704-4336457e9d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:23.614776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b7a0f-46a6-4cf3-bdab-708210dc0b7f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:23.678655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e0cb1e41-435a-407c-8704-4336457e9d48 None None] MFA Rules not processed for user `6301e86578c648dca2d250d7e22c89ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:23.680747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e0cb1e41-435a-407c-8704-4336457e9d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:23.708384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608e246-feb7-425e-9b80-ec46a05ef2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:23.708884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608e246-feb7-425e-9b80-ec46a05ef2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:23.709247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608e246-feb7-425e-9b80-ec46a05ef2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:23.709863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608e246-feb7-425e-9b80-ec46a05ef2f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:23.710866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608e246-feb7-425e-9b80-ec46a05ef2f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:23.717053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608e246-feb7-425e-9b80-ec46a05ef2f3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:23.812706 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1064/2151] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:12:23.817068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb1e41-435a-407c-8704-4336457e9d48 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:23.824867 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1088/2152] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:23 2022] POST /identity/v3/projects => generated 387 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:23.824867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608e246-feb7-425e-9b80-ec46a05ef2f3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:23.827415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e0cb1e41-435a-407c-8704-4336457e9d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:23.943554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb1e41-435a-407c-8704-4336457e9d48 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:23.984445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608e246-feb7-425e-9b80-ec46a05ef2f3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:23.997986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6abd5-4ea6-4c76-a344-f558cf3f704f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:23.998715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6abd5-4ea6-4c76-a344-f558cf3f704f admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:23.999140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6abd5-4ea6-4c76-a344-f558cf3f704f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:23.999421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6abd5-4ea6-4c76-a344-f558cf3f704f admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:24.000132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6abd5-4ea6-4c76-a344-f558cf3f704f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:24.006261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6abd5-4ea6-4c76-a344-f558cf3f704f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:24.082647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fab0f-f0c0-48ed-8069-69721071b981 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:24.084043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fab0f-f0c0-48ed-8069-69721071b981 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:24.084722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fab0f-f0c0-48ed-8069-69721071b981 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:24.085754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fab0f-f0c0-48ed-8069-69721071b981 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:24.098063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fab0f-f0c0-48ed-8069-69721071b981 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:24.100090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445fab0f-f0c0-48ed-8069-69721071b981 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:24.119635 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1065/2153] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:24.121343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fab0f-f0c0-48ed-8069-69721071b981 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:24.133805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445fab0f-f0c0-48ed-8069-69721071b981 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:24.141091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe310480-9441-45a7-b057-242d868d21a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:24.142573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe310480-9441-45a7-b057-242d868d21a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:24.143066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe310480-9441-45a7-b057-242d868d21a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:24.143494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe310480-9441-45a7-b057-242d868d21a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:24.152858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe310480-9441-45a7-b057-242d868d21a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:24.163227 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1089/2154] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:23 2022] POST /identity/v3/projects => generated 383 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:24.165102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe310480-9441-45a7-b057-242d868d21a6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:24.167337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6abd5-4ea6-4c76-a344-f558cf3f704f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:24.290948 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1066/2155] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:24 2022] POST /identity/v3/users => generated 300 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:24.294676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe310480-9441-45a7-b057-242d868d21a6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:24.315849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe310480-9441-45a7-b057-242d868d21a6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:24.385699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6abd5-4ea6-4c76-a344-f558cf3f704f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:24.399843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772f19f-7c95-4f16-95b9-8005b017400e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:24.400882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772f19f-7c95-4f16-95b9-8005b017400e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:24.401177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772f19f-7c95-4f16-95b9-8005b017400e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:24.401462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2772f19f-7c95-4f16-95b9-8005b017400e admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:24.403172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772f19f-7c95-4f16-95b9-8005b017400e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:24.409614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2772f19f-7c95-4f16-95b9-8005b017400e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:24.467105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54676e58-6701-4a22-9164-31e824997022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:24.467743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54676e58-6701-4a22-9164-31e824997022 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:24.468033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54676e58-6701-4a22-9164-31e824997022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:24.468316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54676e58-6701-4a22-9164-31e824997022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:24.469329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54676e58-6701-4a22-9164-31e824997022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:24.471874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54676e58-6701-4a22-9164-31e824997022 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:24.498354 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1067/2156] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:24.505989 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1090/2157] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:24 2022] POST /identity/v3/users => generated 298 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:24.507418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54676e58-6701-4a22-9164-31e824997022 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:24.508098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772f19f-7c95-4f16-95b9-8005b017400e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:24.527498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54676e58-6701-4a22-9164-31e824997022 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:24.530674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2772f19f-7c95-4f16-95b9-8005b017400e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:24.533155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971ae08-104f-4803-9cba-19688476fe08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:24.534166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971ae08-104f-4803-9cba-19688476fe08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:24.534772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971ae08-104f-4803-9cba-19688476fe08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:24.535087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971ae08-104f-4803-9cba-19688476fe08 admin admin] PATH_INFO: `/v3/projects/0075c298fbe84867a6c0fa5b072ef70e/users/ac6d368c485c4ca2ba0cd98c0d9d1b74/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:24.537123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414971c8-122a-4a8a-a8e6-5eb2aca24d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:24.538058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414971c8-122a-4a8a-a8e6-5eb2aca24d18 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:24.538609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414971c8-122a-4a8a-a8e6-5eb2aca24d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:24.539108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414971c8-122a-4a8a-a8e6-5eb2aca24d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:24.541188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414971c8-122a-4a8a-a8e6-5eb2aca24d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:24.542793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414971c8-122a-4a8a-a8e6-5eb2aca24d18 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:24.566616 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1091/2158] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:12:24.566829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971ae08-104f-4803-9cba-19688476fe08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0075c298fbe84867a6c0fa5b072ef70e, user_id=ac6d368c485c4ca2ba0cd98c0d9d1b74, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:24.570424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971ae08-104f-4803-9cba-19688476fe08 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:24.571329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414971c8-122a-4a8a-a8e6-5eb2aca24d18 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:24.589288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414971c8-122a-4a8a-a8e6-5eb2aca24d18 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:24.598576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4dfd2-e8ca-4a3a-93f7-1fd37e215fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:24.600292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4dfd2-e8ca-4a3a-93f7-1fd37e215fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:24.600588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4dfd2-e8ca-4a3a-93f7-1fd37e215fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:24.600871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4dfd2-e8ca-4a3a-93f7-1fd37e215fd4 admin admin] PATH_INFO: `/v3/projects/cd0f6af6594f4d2ebba5690ef591c53d/users/bfd6bb6488514e579fbc08d0009dcbe9/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:24.621735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4dfd2-e8ca-4a3a-93f7-1fd37e215fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0f6af6594f4d2ebba5690ef591c53d, user_id=bfd6bb6488514e579fbc08d0009dcbe9, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:24.632399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4dfd2-e8ca-4a3a-93f7-1fd37e215fd4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:24.692152 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1068/2159] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:24 2022] PUT /identity/v3/projects/0075c298fbe84867a6c0fa5b072ef70e/users/ac6d368c485c4ca2ba0cd98c0d9d1b74/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:24.692385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971ae08-104f-4803-9cba-19688476fe08 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:24.699682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0971ae08-104f-4803-9cba-19688476fe08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:24.761254 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1092/2160] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:24 2022] PUT /identity/v3/projects/cd0f6af6594f4d2ebba5690ef591c53d/users/bfd6bb6488514e579fbc08d0009dcbe9/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:12:24.762060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4dfd2-e8ca-4a3a-93f7-1fd37e215fd4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:24.782073 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:24.933140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971ae08-104f-4803-9cba-19688476fe08 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:24.939643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d520ad6-c22b-4e71-be14-9312fb1bd8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:24.940504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4dfd2-e8ca-4a3a-93f7-1fd37e215fd4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:24.940636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d520ad6-c22b-4e71-be14-9312fb1bd8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:24.941002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d520ad6-c22b-4e71-be14-9312fb1bd8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:24.941288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d520ad6-c22b-4e71-be14-9312fb1bd8ca admin admin] PATH_INFO: `/v3/projects/39ebb8105ac649a09bd2cd2cd34b605e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:24.942673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d520ad6-c22b-4e71-be14-9312fb1bd8ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=39ebb8105ac649a09bd2cd2cd34b605e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:24.945214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d520ad6-c22b-4e71-be14-9312fb1bd8ca admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:24.952991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299c338-cf13-4304-83e5-1eebd9ec438f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:24.953700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299c338-cf13-4304-83e5-1eebd9ec438f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:24.957779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299c338-cf13-4304-83e5-1eebd9ec438f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:24.957779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b299c338-cf13-4304-83e5-1eebd9ec438f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:24.957779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299c338-cf13-4304-83e5-1eebd9ec438f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:24.957779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b299c338-cf13-4304-83e5-1eebd9ec438f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:24.981825 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1093/2161] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:24.986388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299c338-cf13-4304-83e5-1eebd9ec438f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:24.999048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b299c338-cf13-4304-83e5-1eebd9ec438f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:25.004670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0074d-5a35-4166-ae47-805e6c07ab30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:25.005477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0074d-5a35-4166-ae47-805e6c07ab30 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:25.005693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0074d-5a35-4166-ae47-805e6c07ab30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:25.005984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e0074d-5a35-4166-ae47-805e6c07ab30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:25.006768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0074d-5a35-4166-ae47-805e6c07ab30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:25.008775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e0074d-5a35-4166-ae47-805e6c07ab30 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:25.027496 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1094/2162] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:25.029070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0074d-5a35-4166-ae47-805e6c07ab30 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:25.056160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e0074d-5a35-4166-ae47-805e6c07ab30 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:25.068645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390b153-d061-4517-9c3a-a977bc24a5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:25.069824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390b153-d061-4517-9c3a-a977bc24a5b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:25.070135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390b153-d061-4517-9c3a-a977bc24a5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:25.070426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e390b153-d061-4517-9c3a-a977bc24a5b5 admin admin] PATH_INFO: `/v3/projects/0075c298fbe84867a6c0fa5b072ef70e/users/ac6d368c485c4ca2ba0cd98c0d9d1b74/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:25.075394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390b153-d061-4517-9c3a-a977bc24a5b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0075c298fbe84867a6c0fa5b072ef70e, user_id=ac6d368c485c4ca2ba0cd98c0d9d1b74, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:25.081139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e390b153-d061-4517-9c3a-a977bc24a5b5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:25.090680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5d520ad6-c22b-4e71-be14-9312fb1bd8ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39ebb8105ac649a09bd2cd2cd34b605e', 'request_id': 'req-5d520ad6-c22b-4e71-be14-9312fb1bd8ca'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:25.100460 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:25.142212 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1095/2163] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:25 2022] PUT /identity/v3/projects/0075c298fbe84867a6c0fa5b072ef70e/users/ac6d368c485c4ca2ba0cd98c0d9d1b74/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:25.142212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390b153-d061-4517-9c3a-a977bc24a5b5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:25.164201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5d520ad6-c22b-4e71-be14-9312fb1bd8ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39ebb8105ac649a09bd2cd2cd34b605e', 'request_id': 'req-5d520ad6-c22b-4e71-be14-9312fb1bd8ca'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:25.181888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5d520ad6-c22b-4e71-be14-9312fb1bd8ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39ebb8105ac649a09bd2cd2cd34b605e', 'request_id': 'req-5d520ad6-c22b-4e71-be14-9312fb1bd8ca'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:25.205008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5d520ad6-c22b-4e71-be14-9312fb1bd8ca admin admin] The token cache is being invalidate because project 39ebb8105ac649a09bd2cd2cd34b605e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:25.205465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5d520ad6-c22b-4e71-be14-9312fb1bd8ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:25.206667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5d520ad6-c22b-4e71-be14-9312fb1bd8ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:25.211944 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1069/2164] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:24 2022] DELETE /identity/v3/projects/39ebb8105ac649a09bd2cd2cd34b605e => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:25.211944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba36d5-1bd7-45c3-bdec-aa49464629b7 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:25.211944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba36d5-1bd7-45c3-bdec-aa49464629b7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:25.211944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba36d5-1bd7-45c3-bdec-aa49464629b7 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:25.219414 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1070/2165] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:12:25 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:12:25.221865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbe18a-c488-448f-b9b6-dfee53881130 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:25.221865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbe18a-c488-448f-b9b6-dfee53881130 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:25.222318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bbe18a-c488-448f-b9b6-dfee53881130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:25.277956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b0bbe18a-c488-448f-b9b6-dfee53881130 None None] MFA Rules not processed for user `ac6d368c485c4ca2ba0cd98c0d9d1b74`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:25.279934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b0bbe18a-c488-448f-b9b6-dfee53881130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:25.318925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e390b153-d061-4517-9c3a-a977bc24a5b5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:25.337969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcd407-03a0-473e-b464-83a131f407a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:25.342285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcd407-03a0-473e-b464-83a131f407a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:25.343222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcd407-03a0-473e-b464-83a131f407a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:25.344343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcd407-03a0-473e-b464-83a131f407a2 admin admin] PATH_INFO: `/v3/projects/cd0f6af6594f4d2ebba5690ef591c53d/users/bfd6bb6488514e579fbc08d0009dcbe9/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:25.352777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcd407-03a0-473e-b464-83a131f407a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0f6af6594f4d2ebba5690ef591c53d, user_id=bfd6bb6488514e579fbc08d0009dcbe9, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:25.360886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcd407-03a0-473e-b464-83a131f407a2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:25.402419 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1096/2166] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:25 2022] PUT /identity/v3/projects/cd0f6af6594f4d2ebba5690ef591c53d/users/bfd6bb6488514e579fbc08d0009dcbe9/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:25.402419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce31e7-d7a3-45c4-83d8-f3982284945b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:25.402419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce31e7-d7a3-45c4-83d8-f3982284945b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:25.402419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce31e7-d7a3-45c4-83d8-f3982284945b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:25.433564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e6ce31e7-d7a3-45c4-83d8-f3982284945b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:25.436052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e6ce31e7-d7a3-45c4-83d8-f3982284945b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:25.498806 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1071/2167] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:25 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:25.503038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54b510-2e08-46eb-9d94-d11e4befbbb5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:25.503536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54b510-2e08-46eb-9d94-d11e4befbbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:25.514650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54b510-2e08-46eb-9d94-d11e4befbbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:25.556225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-fc54b510-2e08-46eb-9d94-d11e4befbbb5 None None] MFA Rules not processed for user `e997b70d7158446daa1dfa225eb7afca`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:25.560696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fc54b510-2e08-46eb-9d94-d11e4befbbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:25.585666 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1097/2168] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:25.588832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f3e5a-9327-4d05-b56d-0a23dc460535 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:25.589181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f3e5a-9327-4d05-b56d-0a23dc460535 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:25.589694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f3e5a-9327-4d05-b56d-0a23dc460535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:25.662092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-785f3e5a-9327-4d05-b56d-0a23dc460535 None None] MFA Rules not processed for user `bfd6bb6488514e579fbc08d0009dcbe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:25.664031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-785f3e5a-9327-4d05-b56d-0a23dc460535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:25.668682 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1072/2169] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:12:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:25.671222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54b510-2e08-46eb-9d94-d11e4befbbb5 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:25.672725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fc54b510-2e08-46eb-9d94-d11e4befbbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:25.734340 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:25.794354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54b510-2e08-46eb-9d94-d11e4befbbb5 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:25.802378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307faf4-c3b3-470a-9726-2bc9666d8be3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:25.803098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307faf4-c3b3-470a-9726-2bc9666d8be3 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:25.803389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307faf4-c3b3-470a-9726-2bc9666d8be3 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:25.803665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307faf4-c3b3-470a-9726-2bc9666d8be3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:25.829686 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1098/2170] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:25.829686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59930c-5e70-48bd-8165-10e4485a9d7e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:25.829686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59930c-5e70-48bd-8165-10e4485a9d7e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:25.829686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb59930c-5e70-48bd-8165-10e4485a9d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:25.847734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-cb59930c-5e70-48bd-8165-10e4485a9d7e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:25.848982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cb59930c-5e70-48bd-8165-10e4485a9d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:25.858377 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1099/2171] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:25.863582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59930c-5e70-48bd-8165-10e4485a9d7e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:25.863582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cb59930c-5e70-48bd-8165-10e4485a9d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:25.873374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb59930c-5e70-48bd-8165-10e4485a9d7e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:25.877648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cc3bd-bf9c-40d5-abbc-cd43a079384d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:25.878398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cc3bd-bf9c-40d5-abbc-cd43a079384d service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:25.878681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cc3bd-bf9c-40d5-abbc-cd43a079384d service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:25.878962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726cc3bd-bf9c-40d5-abbc-cd43a079384d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:25.887213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726cc3bd-bf9c-40d5-abbc-cd43a079384d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:25.888687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726cc3bd-bf9c-40d5-abbc-cd43a079384d service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:25.897945 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1100/2172] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:25.899439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cc3bd-bf9c-40d5-abbc-cd43a079384d service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:25.900853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-726cc3bd-bf9c-40d5-abbc-cd43a079384d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:25.904303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307faf4-c3b3-470a-9726-2bc9666d8be3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:25.906435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307faf4-c3b3-470a-9726-2bc9666d8be3 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:25.920204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726cc3bd-bf9c-40d5-abbc-cd43a079384d service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:25.922303 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1073/2173] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:25.924444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307faf4-c3b3-470a-9726-2bc9666d8be3 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:25.928297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0565f11-d0ce-4888-aac1-c7ca7f035e58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:25.928794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0565f11-d0ce-4888-aac1-c7ca7f035e58 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:25.929083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0565f11-d0ce-4888-aac1-c7ca7f035e58 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:25.929364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0565f11-d0ce-4888-aac1-c7ca7f035e58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:25.939870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307faf4-c3b3-470a-9726-2bc9666d8be3 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:25.954408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0565f11-d0ce-4888-aac1-c7ca7f035e58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:25.956220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0565f11-d0ce-4888-aac1-c7ca7f035e58 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:25.959359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f916a4-6fa0-4b8d-acd9-b2a17871c0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:25.959687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f916a4-6fa0-4b8d-acd9-b2a17871c0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:25.960174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f916a4-6fa0-4b8d-acd9-b2a17871c0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:25.960524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f916a4-6fa0-4b8d-acd9-b2a17871c0a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:25.961375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f916a4-6fa0-4b8d-acd9-b2a17871c0a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:12:25.962715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f916a4-6fa0-4b8d-acd9-b2a17871c0a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:25.965603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f916a4-6fa0-4b8d-acd9-b2a17871c0a3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:25.981763 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1101/2174] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:25.992997 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1074/2175] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:12:26.002520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0565f11-d0ce-4888-aac1-c7ca7f035e58 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:26.026939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f916a4-6fa0-4b8d-acd9-b2a17871c0a3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:26.041829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0565f11-d0ce-4888-aac1-c7ca7f035e58 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:26.051996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f916a4-6fa0-4b8d-acd9-b2a17871c0a3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:26.053647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46623cbd-8097-4956-a53a-6402d2f83445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:26.054337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46623cbd-8097-4956-a53a-6402d2f83445 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:26.054646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46623cbd-8097-4956-a53a-6402d2f83445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:26.054936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46623cbd-8097-4956-a53a-6402d2f83445 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:26.056368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46623cbd-8097-4956-a53a-6402d2f83445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:26.058917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46623cbd-8097-4956-a53a-6402d2f83445 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:26.079334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c5137-93ac-43fd-825e-b254cb67aca8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:26.080441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c5137-93ac-43fd-825e-b254cb67aca8 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:26.080441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c5137-93ac-43fd-825e-b254cb67aca8 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:26.080747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c5137-93ac-43fd-825e-b254cb67aca8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:26.083760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ac2c5137-93ac-43fd-825e-b254cb67aca8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:26.176330 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1102/2176] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:26 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:26.180992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46623cbd-8097-4956-a53a-6402d2f83445 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:26.183977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c5137-93ac-43fd-825e-b254cb67aca8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:26.187128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c5137-93ac-43fd-825e-b254cb67aca8 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:26.200507 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1075/2177] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:26.327536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603b5e5-9c52-4347-803b-53e041d4f2fa None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:26.329187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603b5e5-9c52-4347-803b-53e041d4f2fa None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:26.329634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603b5e5-9c52-4347-803b-53e041d4f2fa None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:26.331897 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1076/2178] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:12:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 14:12:26.341154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5547a92-3407-4af2-938f-039b6de4c588 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:26.341607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5547a92-3407-4af2-938f-039b6de4c588 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:26.342172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5547a92-3407-4af2-938f-039b6de4c588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:26.402494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b5547a92-3407-4af2-938f-039b6de4c588 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:26.402613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b5547a92-3407-4af2-938f-039b6de4c588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:26.435413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46623cbd-8097-4956-a53a-6402d2f83445 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:26.456872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8261d59-ba9f-42fd-a62a-1ed7d47bd8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:26.457572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8261d59-ba9f-42fd-a62a-1ed7d47bd8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:26.457859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8261d59-ba9f-42fd-a62a-1ed7d47bd8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:26.458274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8261d59-ba9f-42fd-a62a-1ed7d47bd8f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:26.458991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8261d59-ba9f-42fd-a62a-1ed7d47bd8f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:26.460939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8261d59-ba9f-42fd-a62a-1ed7d47bd8f1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:26.607542 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1103/2179] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:26 2022] POST /identity/v3/users => generated 289 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:12:26.611612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8261d59-ba9f-42fd-a62a-1ed7d47bd8f1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:26.612371 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1077/2180] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:12:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:12:26.640213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8261d59-ba9f-42fd-a62a-1ed7d47bd8f1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:26.645312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5547a92-3407-4af2-938f-039b6de4c588 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:26.647784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b5547a92-3407-4af2-938f-039b6de4c588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:26.658636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37465baa-5b8a-4962-bbc1-b70e87195dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:26.662718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37465baa-5b8a-4962-bbc1-b70e87195dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:26.662718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37465baa-5b8a-4962-bbc1-b70e87195dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:26.662718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37465baa-5b8a-4962-bbc1-b70e87195dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:26.662718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37465baa-5b8a-4962-bbc1-b70e87195dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:26.662718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37465baa-5b8a-4962-bbc1-b70e87195dc2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:26.665371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5547a92-3407-4af2-938f-039b6de4c588 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:26.673988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981f1f7-559b-411e-84f9-6f7faf97a57f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:26.674865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981f1f7-559b-411e-84f9-6f7faf97a57f service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:26.675715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981f1f7-559b-411e-84f9-6f7faf97a57f service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:26.676001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6981f1f7-559b-411e-84f9-6f7faf97a57f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:26.688621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981f1f7-559b-411e-84f9-6f7faf97a57f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:26.690704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6981f1f7-559b-411e-84f9-6f7faf97a57f service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:26.692113 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1104/2181] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:26.695718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37465baa-5b8a-4962-bbc1-b70e87195dc2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:26.706961 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1078/2182] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:26.707158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37465baa-5b8a-4962-bbc1-b70e87195dc2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:26.723700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e147cd4-5260-4ed7-b7ba-2c032fefc59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:26.725423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e147cd4-5260-4ed7-b7ba-2c032fefc59c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:26.729226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e147cd4-5260-4ed7-b7ba-2c032fefc59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:26.729659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e147cd4-5260-4ed7-b7ba-2c032fefc59c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:26.730803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e147cd4-5260-4ed7-b7ba-2c032fefc59c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:26.733939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e147cd4-5260-4ed7-b7ba-2c032fefc59c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:26.741492 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:26.757654 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1105/2183] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:26.758154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981f1f7-559b-411e-84f9-6f7faf97a57f service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:26.769608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6981f1f7-559b-411e-84f9-6f7faf97a57f service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:26.776759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe36e8-6c8c-4315-8d11-a91c0fb5392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:26.780256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe36e8-6c8c-4315-8d11-a91c0fb5392a admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:26.780746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe36e8-6c8c-4315-8d11-a91c0fb5392a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:26.784763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fe36e8-6c8c-4315-8d11-a91c0fb5392a admin admin] PATH_INFO: `/v3/projects/1705e9cafaf143768b988fa6a39c45e0/users/e115ab03ba7a4e90bb57c46b10ccbb8b/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:26.840951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe36e8-6c8c-4315-8d11-a91c0fb5392a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1705e9cafaf143768b988fa6a39c45e0, user_id=e115ab03ba7a4e90bb57c46b10ccbb8b, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:26.845770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fe36e8-6c8c-4315-8d11-a91c0fb5392a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:26.945612 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1079/2184] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:26 2022] PUT /identity/v3/projects/1705e9cafaf143768b988fa6a39c45e0/users/e115ab03ba7a4e90bb57c46b10ccbb8b/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:26.960378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66c596-5488-4eae-9594-d5c723e73c4d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:26.960678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66c596-5488-4eae-9594-d5c723e73c4d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:26.960961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d66c596-5488-4eae-9594-d5c723e73c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:26.996377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2d66c596-5488-4eae-9594-d5c723e73c4d None None] MFA Rules not processed for user `e115ab03ba7a4e90bb57c46b10ccbb8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:26.997901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2d66c596-5488-4eae-9594-d5c723e73c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:27.197961 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1106/2185] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:27.203051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe36e8-6c8c-4315-8d11-a91c0fb5392a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:27.269859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f165c39-b8ad-49f8-aa08-5abe8c8fdfd0 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:27.270204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f165c39-b8ad-49f8-aa08-5abe8c8fdfd0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:27.270493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f165c39-b8ad-49f8-aa08-5abe8c8fdfd0 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:27.271907 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1107/2186] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 14:12:27.278434 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:27.287011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56213556-7812-4966-84ec-0b7895222e45 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:27.287557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56213556-7812-4966-84ec-0b7895222e45 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:27.288020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56213556-7812-4966-84ec-0b7895222e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:27.331293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fe36e8-6c8c-4315-8d11-a91c0fb5392a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:27.332965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-56213556-7812-4966-84ec-0b7895222e45 None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:27.336185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-56213556-7812-4966-84ec-0b7895222e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:27.346633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e70c85-5f8a-4619-8ba4-ffebc019b444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:27.347578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e70c85-5f8a-4619-8ba4-ffebc019b444 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:27.348017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e70c85-5f8a-4619-8ba4-ffebc019b444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:27.348458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e70c85-5f8a-4619-8ba4-ffebc019b444 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:27.349327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e70c85-5f8a-4619-8ba4-ffebc019b444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:27.351459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e70c85-5f8a-4619-8ba4-ffebc019b444 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:27.462883 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1108/2187] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:12:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:12:27.469350 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1080/2188] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:27 2022] POST /identity/v3/projects => generated 375 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:27.473494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56213556-7812-4966-84ec-0b7895222e45 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:27.486438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56213556-7812-4966-84ec-0b7895222e45 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:27.495691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e70c85-5f8a-4619-8ba4-ffebc019b444 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:27.497611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-61e70c85-5f8a-4619-8ba4-ffebc019b444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:27.609996 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:27.610215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e70c85-5f8a-4619-8ba4-ffebc019b444 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:27.616303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a053a2-97a9-41a5-a703-002a5881f9ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:27.619647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a053a2-97a9-41a5-a703-002a5881f9ad service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:27.620785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a053a2-97a9-41a5-a703-002a5881f9ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:27.621552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ad9c8-31be-4318-a09b-3da74d66a1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:27.622071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a053a2-97a9-41a5-a703-002a5881f9ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:27.622831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ad9c8-31be-4318-a09b-3da74d66a1d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:27.623783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ad9c8-31be-4318-a09b-3da74d66a1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:27.624452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ad9c8-31be-4318-a09b-3da74d66a1d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:27.626697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ad9c8-31be-4318-a09b-3da74d66a1d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:27.632211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ad9c8-31be-4318-a09b-3da74d66a1d3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:27.738795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a053a2-97a9-41a5-a703-002a5881f9ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:27.740821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a053a2-97a9-41a5-a703-002a5881f9ad service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:27.756150 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1081/2189] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:12:27.765687 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1109/2190] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:27 2022] POST /identity/v3/users => generated 294 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:27.769778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a053a2-97a9-41a5-a703-002a5881f9ad service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:27.784197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a053a2-97a9-41a5-a703-002a5881f9ad service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:27.790909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3f9fa-c8bd-470f-9231-4f040452e64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:27.792362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3f9fa-c8bd-470f-9231-4f040452e64f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:27.792988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3f9fa-c8bd-470f-9231-4f040452e64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:27.793370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3f9fa-c8bd-470f-9231-4f040452e64f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:27.797186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3f9fa-c8bd-470f-9231-4f040452e64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:27.800482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3f9fa-c8bd-470f-9231-4f040452e64f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:27.823341 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1082/2191] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:27.823558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ad9c8-31be-4318-a09b-3da74d66a1d3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:27.837368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ad9c8-31be-4318-a09b-3da74d66a1d3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:27.844725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd67af8-c733-40ff-93e0-60c96b34b6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:27.848189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd67af8-c733-40ff-93e0-60c96b34b6a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:27.848189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd67af8-c733-40ff-93e0-60c96b34b6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:27.848189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd67af8-c733-40ff-93e0-60c96b34b6a2 admin admin] PATH_INFO: `/v3/projects/6a32bf7367504d9ba8c40c296adade35/users/44c1260529fd4d87b0d94f18cf40b520/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:27.870983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd67af8-c733-40ff-93e0-60c96b34b6a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a32bf7367504d9ba8c40c296adade35, user_id=44c1260529fd4d87b0d94f18cf40b520, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:27.876707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd67af8-c733-40ff-93e0-60c96b34b6a2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:27.965659 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1110/2192] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:27 2022] PUT /identity/v3/projects/6a32bf7367504d9ba8c40c296adade35/users/44c1260529fd4d87b0d94f18cf40b520/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:27.965759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3f9fa-c8bd-470f-9231-4f040452e64f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:27.985678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3f9fa-c8bd-470f-9231-4f040452e64f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:28.153815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd67af8-c733-40ff-93e0-60c96b34b6a2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:28.156683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ffd67af8-c733-40ff-93e0-60c96b34b6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:28.159681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7536a1b-65ac-4ccd-8501-373dbd5abae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:28.164198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7536a1b-65ac-4ccd-8501-373dbd5abae3 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:28.164916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7536a1b-65ac-4ccd-8501-373dbd5abae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:28.166298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7536a1b-65ac-4ccd-8501-373dbd5abae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:28.169834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7536a1b-65ac-4ccd-8501-373dbd5abae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:28.175109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7536a1b-65ac-4ccd-8501-373dbd5abae3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:28.189854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd67af8-c733-40ff-93e0-60c96b34b6a2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:28.214966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0fd71c-b3d7-417d-860b-8d24926748fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:28.215882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fd71c-b3d7-417d-860b-8d24926748fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:28.216168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fd71c-b3d7-417d-860b-8d24926748fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:28.216445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fd71c-b3d7-417d-860b-8d24926748fb admin admin] PATH_INFO: `/v3/users/6301e86578c648dca2d250d7e22c89ea` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:28.230706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fd71c-b3d7-417d-860b-8d24926748fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6301e86578c648dca2d250d7e22c89ea)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:28.236958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0fd71c-b3d7-417d-860b-8d24926748fb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:28.237561 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1083/2193] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:28.239392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7536a1b-65ac-4ccd-8501-373dbd5abae3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:28.278008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7536a1b-65ac-4ccd-8501-373dbd5abae3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:28.301310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a35b18-3f28-4fbb-84e9-889918aa8292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:28.305829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a35b18-3f28-4fbb-84e9-889918aa8292 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:28.306713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a35b18-3f28-4fbb-84e9-889918aa8292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:28.307154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a35b18-3f28-4fbb-84e9-889918aa8292 admin admin] PATH_INFO: `/v3/projects/6a32bf7367504d9ba8c40c296adade35/users/44c1260529fd4d87b0d94f18cf40b520/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:28.311662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a35b18-3f28-4fbb-84e9-889918aa8292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a32bf7367504d9ba8c40c296adade35, user_id=44c1260529fd4d87b0d94f18cf40b520, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:28.318960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a35b18-3f28-4fbb-84e9-889918aa8292 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:28.372008 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1084/2194] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:28 2022] PUT /identity/v3/projects/6a32bf7367504d9ba8c40c296adade35/users/44c1260529fd4d87b0d94f18cf40b520/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:28.387668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0700283-362c-4427-b9a9-958848c3ed93 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:28.387668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0700283-362c-4427-b9a9-958848c3ed93 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:28.387668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0700283-362c-4427-b9a9-958848c3ed93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:28.432752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c0700283-362c-4427-b9a9-958848c3ed93 None None] MFA Rules not processed for user `44c1260529fd4d87b0d94f18cf40b520`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:28.438560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c0700283-362c-4427-b9a9-958848c3ed93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:28.514698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9d0fd71c-b3d7-417d-860b-8d24926748fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6301e86578c648dca2d250d7e22c89ea'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:28.547224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9d0fd71c-b3d7-417d-860b-8d24926748fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6301e86578c648dca2d250d7e22c89ea'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:28.565841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9d0fd71c-b3d7-417d-860b-8d24926748fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6301e86578c648dca2d250d7e22c89ea'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:28.566607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9d0fd71c-b3d7-417d-860b-8d24926748fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6301e86578c648dca2d250d7e22c89ea'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:28.606149 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1085/2195] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:28 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:28.638082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0700283-362c-4427-b9a9-958848c3ed93 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:28.655478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9d0fd71c-b3d7-417d-860b-8d24926748fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6301e86578c648dca2d250d7e22c89ea'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:28.666181 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1111/2196] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:28 2022] DELETE /identity/v3/users/6301e86578c648dca2d250d7e22c89ea => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:12:28.671093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4f51c-8dfe-4abf-94e3-e35ecc6ec09a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:28.671631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4f51c-8dfe-4abf-94e3-e35ecc6ec09a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:28.672065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b4f51c-8dfe-4abf-94e3-e35ecc6ec09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:28.712184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-80b4f51c-8dfe-4abf-94e3-e35ecc6ec09a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:28.717032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-80b4f51c-8dfe-4abf-94e3-e35ecc6ec09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:28.768894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0700283-362c-4427-b9a9-958848c3ed93 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:28.859880 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1112/2197] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:28.875518 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:28.893911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4f51c-8dfe-4abf-94e3-e35ecc6ec09a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:28.896428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-80b4f51c-8dfe-4abf-94e3-e35ecc6ec09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:28.908109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354b955-cfc4-4e01-a24c-e1ee5608f174 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:28.908977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354b955-cfc4-4e01-a24c-e1ee5608f174 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:28.910319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354b955-cfc4-4e01-a24c-e1ee5608f174 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:28.910716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e354b955-cfc4-4e01-a24c-e1ee5608f174 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:28.921466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e354b955-cfc4-4e01-a24c-e1ee5608f174 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:28.987681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b4f51c-8dfe-4abf-94e3-e35ecc6ec09a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:28.995523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d0e0b-7488-4e53-946a-b85ec515ad7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:28.997336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d0e0b-7488-4e53-946a-b85ec515ad7a service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:28.998388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d0e0b-7488-4e53-946a-b85ec515ad7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:28.998840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d0e0b-7488-4e53-946a-b85ec515ad7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:29.019831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d0e0b-7488-4e53-946a-b85ec515ad7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:29.022274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d0e0b-7488-4e53-946a-b85ec515ad7a service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:29.027456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354b955-cfc4-4e01-a24c-e1ee5608f174 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:29.033234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e354b955-cfc4-4e01-a24c-e1ee5608f174 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:29.035895 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1113/2198] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:12:29.062197 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1086/2199] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:29.473612 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:29.699980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d0e0b-7488-4e53-946a-b85ec515ad7a service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:29.706324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7f9d0e0b-7488-4e53-946a-b85ec515ad7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:29.722868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d0e0b-7488-4e53-946a-b85ec515ad7a service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:29.733257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fbb408-d58e-4e67-8540-33dea17a9b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:29.735089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbb408-d58e-4e67-8540-33dea17a9b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:29.735567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbb408-d58e-4e67-8540-33dea17a9b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:29.736000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbb408-d58e-4e67-8540-33dea17a9b9e admin admin] PATH_INFO: `/v3/users/c07ded16810a439382d330ce0249d87d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:29.739488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbb408-d58e-4e67-8540-33dea17a9b9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c07ded16810a439382d330ce0249d87d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:29.744710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fbb408-d58e-4e67-8540-33dea17a9b9e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:30.001594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-35fbb408-d58e-4e67-8540-33dea17a9b9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c07ded16810a439382d330ce0249d87d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:30.034129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-35fbb408-d58e-4e67-8540-33dea17a9b9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c07ded16810a439382d330ce0249d87d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:30.041845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-35fbb408-d58e-4e67-8540-33dea17a9b9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c07ded16810a439382d330ce0249d87d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:30.042620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-35fbb408-d58e-4e67-8540-33dea17a9b9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c07ded16810a439382d330ce0249d87d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:30.067068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354b955-cfc4-4e01-a24c-e1ee5608f174 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:30.070409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e354b955-cfc4-4e01-a24c-e1ee5608f174 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:30.095675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e354b955-cfc4-4e01-a24c-e1ee5608f174 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:30.103030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1af7d-44d5-422e-b48c-018e0a169998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:30.104320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1af7d-44d5-422e-b48c-018e0a169998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:30.121582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1af7d-44d5-422e-b48c-018e0a169998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:30.122158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1af7d-44d5-422e-b48c-018e0a169998 admin admin] PATH_INFO: `/v3/projects/9ff1651efc784abfbac8f076d5841db1` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:30.124902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-35fbb408-d58e-4e67-8540-33dea17a9b9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c07ded16810a439382d330ce0249d87d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:30.130450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1af7d-44d5-422e-b48c-018e0a169998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ff1651efc784abfbac8f076d5841db1)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:30.134803 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1114/2200] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:29 2022] DELETE /identity/v3/users/c07ded16810a439382d330ce0249d87d => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:12:30.137780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1af7d-44d5-422e-b48c-018e0a169998 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:30.139650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033e030-5af4-43cc-b221-98c0abf38aa1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:30.140081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033e030-5af4-43cc-b221-98c0abf38aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:30.140515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3033e030-5af4-43cc-b221-98c0abf38aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:30.177544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3033e030-5af4-43cc-b221-98c0abf38aa1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:30.197761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3033e030-5af4-43cc-b221-98c0abf38aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:30.312647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0cc1af7d-44d5-422e-b48c-018e0a169998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ff1651efc784abfbac8f076d5841db1', 'request_id': 'req-0cc1af7d-44d5-422e-b48c-018e0a169998'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:30.329124 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1115/2201] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:30.354015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033e030-5af4-43cc-b221-98c0abf38aa1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:30.359543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3033e030-5af4-43cc-b221-98c0abf38aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:30.396474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0cc1af7d-44d5-422e-b48c-018e0a169998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ff1651efc784abfbac8f076d5841db1', 'request_id': 'req-0cc1af7d-44d5-422e-b48c-018e0a169998'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:30.406666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0cc1af7d-44d5-422e-b48c-018e0a169998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ff1651efc784abfbac8f076d5841db1', 'request_id': 'req-0cc1af7d-44d5-422e-b48c-018e0a169998'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:30.440202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0cc1af7d-44d5-422e-b48c-018e0a169998 admin admin] The token cache is being invalidate because project 9ff1651efc784abfbac8f076d5841db1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:30.440510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0cc1af7d-44d5-422e-b48c-018e0a169998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:30.442134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0cc1af7d-44d5-422e-b48c-018e0a169998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:30.453998 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1087/2202] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:30 2022] DELETE /identity/v3/projects/9ff1651efc784abfbac8f076d5841db1 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:30.457884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1af7d-44d5-422e-b48c-018e0a169998 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:30.461204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0cc1af7d-44d5-422e-b48c-018e0a169998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:30.530480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3033e030-5af4-43cc-b221-98c0abf38aa1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:30.665209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d958c6f-0a15-4432-8281-7b2727ee67e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:30.665967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d958c6f-0a15-4432-8281-7b2727ee67e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:30.666661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d958c6f-0a15-4432-8281-7b2727ee67e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:30.666661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d958c6f-0a15-4432-8281-7b2727ee67e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:30.670707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8d958c6f-0a15-4432-8281-7b2727ee67e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:30.736469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1af7d-44d5-422e-b48c-018e0a169998 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:30.750334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7c137-4ce4-4148-8c69-bac56433e536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:30.752497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7c137-4ce4-4148-8c69-bac56433e536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:30.752983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7c137-4ce4-4148-8c69-bac56433e536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:30.753410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b7c137-4ce4-4148-8c69-bac56433e536 admin admin] PATH_INFO: `/v3/users/bfd6bb6488514e579fbc08d0009dcbe9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:30.755007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7c137-4ce4-4148-8c69-bac56433e536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfd6bb6488514e579fbc08d0009dcbe9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:30.757894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b7c137-4ce4-4148-8c69-bac56433e536 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:30.879922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d958c6f-0a15-4432-8281-7b2727ee67e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:30.881386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d958c6f-0a15-4432-8281-7b2727ee67e2 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:30.897526 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1116/2203] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:30.931342 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:30.995140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28937b-5b9c-4079-a958-0de404396569 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:30.996241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28937b-5b9c-4079-a958-0de404396569 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:30.996721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28937b-5b9c-4079-a958-0de404396569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:31.022702 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:31.045248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-97b7c137-4ce4-4148-8c69-bac56433e536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd6bb6488514e579fbc08d0009dcbe9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:31.046537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-bf28937b-5b9c-4079-a958-0de404396569 None None] MFA Rules not processed for user `c56cc2a24db643d69308ceb1d8c06c50`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:31.051616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bf28937b-5b9c-4079-a958-0de404396569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:31.075045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-97b7c137-4ce4-4148-8c69-bac56433e536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd6bb6488514e579fbc08d0009dcbe9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:31.077484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-97b7c137-4ce4-4148-8c69-bac56433e536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd6bb6488514e579fbc08d0009dcbe9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:31.078779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-97b7c137-4ce4-4148-8c69-bac56433e536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd6bb6488514e579fbc08d0009dcbe9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:31.090679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-97b7c137-4ce4-4148-8c69-bac56433e536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd6bb6488514e579fbc08d0009dcbe9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:31.176155 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1117/2204] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:30 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:31.191989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e1364-eaf4-43eb-86ca-67f615712d6a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:31.192215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e1364-eaf4-43eb-86ca-67f615712d6a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:31.192520 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1088/2205] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:30 2022] DELETE /identity/v3/users/bfd6bb6488514e579fbc08d0009dcbe9 => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:31.202083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e1364-eaf4-43eb-86ca-67f615712d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:31.248167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-114e1364-eaf4-43eb-86ca-67f615712d6a None None] MFA Rules not processed for user `6b13cdd4117640b49cf9f74cc12d16f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:31.249446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-114e1364-eaf4-43eb-86ca-67f615712d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:31.403828 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1118/2206] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:31.415130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7c137-4ce4-4148-8c69-bac56433e536 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:31.416584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-97b7c137-4ce4-4148-8c69-bac56433e536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:31.563129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b7c137-4ce4-4148-8c69-bac56433e536 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:31.570209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ab859-f873-411e-ac18-7a9a9f5c8248 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:31.571736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ab859-f873-411e-ac18-7a9a9f5c8248 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:31.572713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ab859-f873-411e-ac18-7a9a9f5c8248 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:31.573073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222ab859-f873-411e-ac18-7a9a9f5c8248 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:31.576016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-222ab859-f873-411e-ac18-7a9a9f5c8248 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:31.591945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ab859-f873-411e-ac18-7a9a9f5c8248 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:31.593724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222ab859-f873-411e-ac18-7a9a9f5c8248 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:31.609829 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1089/2207] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:31.813984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e1364-eaf4-43eb-86ca-67f615712d6a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:31.816085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-114e1364-eaf4-43eb-86ca-67f615712d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:31.925855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e1364-eaf4-43eb-86ca-67f615712d6a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:31.932292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9396f0-918b-4979-bc39-99566ca96c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:31.933187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9396f0-918b-4979-bc39-99566ca96c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:31.933453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9396f0-918b-4979-bc39-99566ca96c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:31.933724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9396f0-918b-4979-bc39-99566ca96c1c admin admin] PATH_INFO: `/v3/projects/dd78958e961d4db3bccc8825aa907cd5` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:31.936235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9396f0-918b-4979-bc39-99566ca96c1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd78958e961d4db3bccc8825aa907cd5)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:31.939261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9396f0-918b-4979-bc39-99566ca96c1c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:32.107636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3b9396f0-918b-4979-bc39-99566ca96c1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd78958e961d4db3bccc8825aa907cd5', 'request_id': 'req-3b9396f0-918b-4979-bc39-99566ca96c1c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:32.113949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3b9396f0-918b-4979-bc39-99566ca96c1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd78958e961d4db3bccc8825aa907cd5', 'request_id': 'req-3b9396f0-918b-4979-bc39-99566ca96c1c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:32.130125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3b9396f0-918b-4979-bc39-99566ca96c1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd78958e961d4db3bccc8825aa907cd5', 'request_id': 'req-3b9396f0-918b-4979-bc39-99566ca96c1c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:32.228487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ab859-f873-411e-ac18-7a9a9f5c8248 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:32.229877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-222ab859-f873-411e-ac18-7a9a9f5c8248 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:32.246774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3b9396f0-918b-4979-bc39-99566ca96c1c admin admin] The token cache is being invalidate because project dd78958e961d4db3bccc8825aa907cd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:32.248994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3b9396f0-918b-4979-bc39-99566ca96c1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:32.249741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3b9396f0-918b-4979-bc39-99566ca96c1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:32.251073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222ab859-f873-411e-ac18-7a9a9f5c8248 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:32.252948 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1119/2208] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:31 2022] DELETE /identity/v3/projects/dd78958e961d4db3bccc8825aa907cd5 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:32.256927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9396f0-918b-4979-bc39-99566ca96c1c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:32.260149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3b9396f0-918b-4979-bc39-99566ca96c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:32.376795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85717f85-4720-4c25-9b4c-69f109706057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:32.377682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85717f85-4720-4c25-9b4c-69f109706057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:32.378316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85717f85-4720-4c25-9b4c-69f109706057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:32.378590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85717f85-4720-4c25-9b4c-69f109706057 admin admin] PATH_INFO: `/v3/projects/cd0f6af6594f4d2ebba5690ef591c53d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:32.382599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85717f85-4720-4c25-9b4c-69f109706057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd0f6af6594f4d2ebba5690ef591c53d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:32.387369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85717f85-4720-4c25-9b4c-69f109706057 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:32.399874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9396f0-918b-4979-bc39-99566ca96c1c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:32.405903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abbee7-adad-4845-9e2f-10706c3f8170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:32.407417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abbee7-adad-4845-9e2f-10706c3f8170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:32.407801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abbee7-adad-4845-9e2f-10706c3f8170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:32.407993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abbee7-adad-4845-9e2f-10706c3f8170 admin admin] PATH_INFO: `/v3/users/ac6d368c485c4ca2ba0cd98c0d9d1b74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:32.410255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abbee7-adad-4845-9e2f-10706c3f8170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac6d368c485c4ca2ba0cd98c0d9d1b74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:32.412318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abbee7-adad-4845-9e2f-10706c3f8170 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:32.589788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-85717f85-4720-4c25-9b4c-69f109706057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd0f6af6594f4d2ebba5690ef591c53d', 'request_id': 'req-85717f85-4720-4c25-9b4c-69f109706057'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:32.673327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-85717f85-4720-4c25-9b4c-69f109706057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd0f6af6594f4d2ebba5690ef591c53d', 'request_id': 'req-85717f85-4720-4c25-9b4c-69f109706057'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:32.682879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-85717f85-4720-4c25-9b4c-69f109706057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd0f6af6594f4d2ebba5690ef591c53d', 'request_id': 'req-85717f85-4720-4c25-9b4c-69f109706057'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:32.694990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-85717f85-4720-4c25-9b4c-69f109706057 admin admin] The token cache is being invalidate because project cd0f6af6594f4d2ebba5690ef591c53d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:32.695509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-85717f85-4720-4c25-9b4c-69f109706057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:32.698076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-85717f85-4720-4c25-9b4c-69f109706057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:32.700194 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1090/2209] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:32 2022] DELETE /identity/v3/projects/cd0f6af6594f4d2ebba5690ef591c53d => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:32.701065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85717f85-4720-4c25-9b4c-69f109706057 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:32.702451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-85717f85-4720-4c25-9b4c-69f109706057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:32.722375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c8abbee7-adad-4845-9e2f-10706c3f8170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac6d368c485c4ca2ba0cd98c0d9d1b74'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:32.741096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c8abbee7-adad-4845-9e2f-10706c3f8170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac6d368c485c4ca2ba0cd98c0d9d1b74'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:32.755550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c8abbee7-adad-4845-9e2f-10706c3f8170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac6d368c485c4ca2ba0cd98c0d9d1b74'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:32.756686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c8abbee7-adad-4845-9e2f-10706c3f8170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac6d368c485c4ca2ba0cd98c0d9d1b74'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:32.810364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85717f85-4720-4c25-9b4c-69f109706057 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:32.822359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def25d20-6bf8-4f41-b228-90bcfe7fc885 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:32.826283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def25d20-6bf8-4f41-b228-90bcfe7fc885 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:32.826283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def25d20-6bf8-4f41-b228-90bcfe7fc885 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:32.826283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def25d20-6bf8-4f41-b228-90bcfe7fc885 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:32.826283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-def25d20-6bf8-4f41-b228-90bcfe7fc885 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:32.845726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c8abbee7-adad-4845-9e2f-10706c3f8170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac6d368c485c4ca2ba0cd98c0d9d1b74'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:32.856950 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1120/2210] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:32 2022] DELETE /identity/v3/users/ac6d368c485c4ca2ba0cd98c0d9d1b74 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:32.858649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63750a-b4d7-498e-954c-f7d0e3af4bde None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:32.859642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63750a-b4d7-498e-954c-f7d0e3af4bde None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:32.860981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a63750a-b4d7-498e-954c-f7d0e3af4bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:32.900831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9a63750a-b4d7-498e-954c-f7d0e3af4bde None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:32.905666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9a63750a-b4d7-498e-954c-f7d0e3af4bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:32.986717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def25d20-6bf8-4f41-b228-90bcfe7fc885 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:32.989113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def25d20-6bf8-4f41-b228-90bcfe7fc885 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:33.011665 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1091/2211] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:33.027385 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1121/2212] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:33.035178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71b5fc-3d67-4097-baad-bb3478d40032 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:33.035516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71b5fc-3d67-4097-baad-bb3478d40032 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:33.035801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb71b5fc-3d67-4097-baad-bb3478d40032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:33.059904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-cb71b5fc-3d67-4097-baad-bb3478d40032 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:33.063161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cb71b5fc-3d67-4097-baad-bb3478d40032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:33.071420 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1092/2213] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:33.075843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63750a-b4d7-498e-954c-f7d0e3af4bde None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:33.089516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a63750a-b4d7-498e-954c-f7d0e3af4bde None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:33.098027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e3af6-f562-4f75-9acb-b00ae7c46302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:33.098745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e3af6-f562-4f75-9acb-b00ae7c46302 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:33.099028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e3af6-f562-4f75-9acb-b00ae7c46302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:33.099302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7e3af6-f562-4f75-9acb-b00ae7c46302 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:33.100046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e3af6-f562-4f75-9acb-b00ae7c46302 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:12:33.100350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e3af6-f562-4f75-9acb-b00ae7c46302 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:33.104313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7e3af6-f562-4f75-9acb-b00ae7c46302 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:33.122979 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1122/2214] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:12:33.123234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71b5fc-3d67-4097-baad-bb3478d40032 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:33.134672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb71b5fc-3d67-4097-baad-bb3478d40032 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:33.143015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2835f-d79f-4da3-a0e4-150c60f821bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:33.143828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2835f-d79f-4da3-a0e4-150c60f821bf admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:33.144122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2835f-d79f-4da3-a0e4-150c60f821bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:33.144403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d2835f-d79f-4da3-a0e4-150c60f821bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:33.145185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2835f-d79f-4da3-a0e4-150c60f821bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:33.147312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d2835f-d79f-4da3-a0e4-150c60f821bf admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:33.299949 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1093/2215] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:33 2022] POST /identity/v3/projects => generated 371 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:12:33.310312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e3af6-f562-4f75-9acb-b00ae7c46302 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:33.328537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7e3af6-f562-4f75-9acb-b00ae7c46302 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:33.480656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251904d-cc4c-496d-a5c1-346fc368bb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:33.481124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251904d-cc4c-496d-a5c1-346fc368bb11 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:33.481467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251904d-cc4c-496d-a5c1-346fc368bb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:33.481803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1251904d-cc4c-496d-a5c1-346fc368bb11 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:33.482951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251904d-cc4c-496d-a5c1-346fc368bb11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:33.485275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1251904d-cc4c-496d-a5c1-346fc368bb11 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:33.505287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2835f-d79f-4da3-a0e4-150c60f821bf admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:33.509430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-01d2835f-d79f-4da3-a0e4-150c60f821bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:33.526710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d2835f-d79f-4da3-a0e4-150c60f821bf admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:33.542780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483f1f9d-11b6-420f-ae2d-b7d3724aaf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:33.542780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f1f9d-11b6-420f-ae2d-b7d3724aaf4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:33.542780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f1f9d-11b6-420f-ae2d-b7d3724aaf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:33.542780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483f1f9d-11b6-420f-ae2d-b7d3724aaf4f admin admin] PATH_INFO: `/v3/projects/0075c298fbe84867a6c0fa5b072ef70e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:33.543058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f1f9d-11b6-420f-ae2d-b7d3724aaf4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0075c298fbe84867a6c0fa5b072ef70e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:33.543058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483f1f9d-11b6-420f-ae2d-b7d3724aaf4f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:33.611878 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1123/2216] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:33 2022] POST /identity/v3/users => generated 286 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:33.613007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251904d-cc4c-496d-a5c1-346fc368bb11 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:33.667124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1251904d-cc4c-496d-a5c1-346fc368bb11 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:33.684882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-483f1f9d-11b6-420f-ae2d-b7d3724aaf4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0075c298fbe84867a6c0fa5b072ef70e', 'request_id': 'req-483f1f9d-11b6-420f-ae2d-b7d3724aaf4f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:33.795655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc81a0a-0ef3-41b4-aaf7-9f1f10bec285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:33.806861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc81a0a-0ef3-41b4-aaf7-9f1f10bec285 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:33.807239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc81a0a-0ef3-41b4-aaf7-9f1f10bec285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:33.807522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc81a0a-0ef3-41b4-aaf7-9f1f10bec285 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:33.808340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc81a0a-0ef3-41b4-aaf7-9f1f10bec285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:33.810522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-483f1f9d-11b6-420f-ae2d-b7d3724aaf4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0075c298fbe84867a6c0fa5b072ef70e', 'request_id': 'req-483f1f9d-11b6-420f-ae2d-b7d3724aaf4f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:33.820385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-483f1f9d-11b6-420f-ae2d-b7d3724aaf4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0075c298fbe84867a6c0fa5b072ef70e', 'request_id': 'req-483f1f9d-11b6-420f-ae2d-b7d3724aaf4f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:33.823175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc81a0a-0ef3-41b4-aaf7-9f1f10bec285 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:33.841600 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1124/2217] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:33.843173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc81a0a-0ef3-41b4-aaf7-9f1f10bec285 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:33.855831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-483f1f9d-11b6-420f-ae2d-b7d3724aaf4f admin admin] The token cache is being invalidate because project 0075c298fbe84867a6c0fa5b072ef70e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:33.856043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc81a0a-0ef3-41b4-aaf7-9f1f10bec285 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:33.856465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-483f1f9d-11b6-420f-ae2d-b7d3724aaf4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:33.856889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-483f1f9d-11b6-420f-ae2d-b7d3724aaf4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:33.858717 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1094/2218] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:33 2022] DELETE /identity/v3/projects/0075c298fbe84867a6c0fa5b072ef70e => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:12:33.861351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea235bac-01af-4202-9b21-79db6583620d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:33.862046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea235bac-01af-4202-9b21-79db6583620d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:33.862367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea235bac-01af-4202-9b21-79db6583620d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:33.862648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea235bac-01af-4202-9b21-79db6583620d admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:33.863459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea235bac-01af-4202-9b21-79db6583620d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:33.864296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395b273-d683-48c2-952d-c727e5663b21 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:33.864928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395b273-d683-48c2-952d-c727e5663b21 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:33.865166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea235bac-01af-4202-9b21-79db6583620d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:33.865713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4395b273-d683-48c2-952d-c727e5663b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:33.887643 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1125/2219] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:12:33.889537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4395b273-d683-48c2-952d-c727e5663b21 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:33.890976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4395b273-d683-48c2-952d-c727e5663b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:33.892123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea235bac-01af-4202-9b21-79db6583620d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:33.898683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ea235bac-01af-4202-9b21-79db6583620d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:33.908094 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1095/2220] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:12:33.910629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31291809-9a0d-4e5b-991e-f99fe5a620a0 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:33.911307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31291809-9a0d-4e5b-991e-f99fe5a620a0 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:33.911911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31291809-9a0d-4e5b-991e-f99fe5a620a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:33.941151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea235bac-01af-4202-9b21-79db6583620d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:33.942278 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:33.958954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3158716b-3013-4da5-89c3-eb515160d6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:33.960828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158716b-3013-4da5-89c3-eb515160d6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:33.960828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158716b-3013-4da5-89c3-eb515160d6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:33.961073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3158716b-3013-4da5-89c3-eb515160d6ea admin admin] PATH_INFO: `/v3/projects/a8403d5c668e4e6da327aba653914e5a/users/23b4bccd58dd4d34b9892f7d2bf7f276/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:33.964638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-31291809-9a0d-4e5b-991e-f99fe5a620a0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:33.967482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-31291809-9a0d-4e5b-991e-f99fe5a620a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:33.994297 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:33.997954 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1096/2221] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:34.008251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31291809-9a0d-4e5b-991e-f99fe5a620a0 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:34.032941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31291809-9a0d-4e5b-991e-f99fe5a620a0 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:34.040722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158716b-3013-4da5-89c3-eb515160d6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8403d5c668e4e6da327aba653914e5a, user_id=23b4bccd58dd4d34b9892f7d2bf7f276, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:34.044109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3158716b-3013-4da5-89c3-eb515160d6ea admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:34.054690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfbfa9-ccc5-4498-b129-08b112d82285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:34.058960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfbfa9-ccc5-4498-b129-08b112d82285 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:34.058960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfbfa9-ccc5-4498-b129-08b112d82285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:34.058960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accfbfa9-ccc5-4498-b129-08b112d82285 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:34.060315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfbfa9-ccc5-4498-b129-08b112d82285 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:12:34.061353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfbfa9-ccc5-4498-b129-08b112d82285 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:34.065687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accfbfa9-ccc5-4498-b129-08b112d82285 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:34.091519 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1097/2222] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:12:34.098328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfbfa9-ccc5-4498-b129-08b112d82285 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:34.113492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accfbfa9-ccc5-4498-b129-08b112d82285 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:34.123006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398e0dc-93e9-4aaf-b17f-b3df5a037b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:34.124055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398e0dc-93e9-4aaf-b17f-b3df5a037b3d admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:34.124514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398e0dc-93e9-4aaf-b17f-b3df5a037b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:34.124946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398e0dc-93e9-4aaf-b17f-b3df5a037b3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:34.126246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398e0dc-93e9-4aaf-b17f-b3df5a037b3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:34.128310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398e0dc-93e9-4aaf-b17f-b3df5a037b3d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:34.185385 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1126/2223] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:33 2022] PUT /identity/v3/projects/a8403d5c668e4e6da327aba653914e5a/users/23b4bccd58dd4d34b9892f7d2bf7f276/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:34.187053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd81c47-a634-4956-aff6-e5985f7f9c69 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:34.187388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd81c47-a634-4956-aff6-e5985f7f9c69 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:34.187746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd81c47-a634-4956-aff6-e5985f7f9c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:34.237520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-bdd81c47-a634-4956-aff6-e5985f7f9c69 None None] MFA Rules not processed for user `23b4bccd58dd4d34b9892f7d2bf7f276`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:34.238799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bdd81c47-a634-4956-aff6-e5985f7f9c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:34.278794 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1098/2224] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:34 2022] POST /identity/v3/projects => generated 391 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:34.282749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398e0dc-93e9-4aaf-b17f-b3df5a037b3d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:34.352794 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1127/2225] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:34.352794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd81c47-a634-4956-aff6-e5985f7f9c69 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:34.425070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398e0dc-93e9-4aaf-b17f-b3df5a037b3d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:34.439556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343c44d-6808-48a3-b461-913db36df42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:34.440731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343c44d-6808-48a3-b461-913db36df42c admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:34.441192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343c44d-6808-48a3-b461-913db36df42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:34.441735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343c44d-6808-48a3-b461-913db36df42c admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:34.442687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343c44d-6808-48a3-b461-913db36df42c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:34.445209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343c44d-6808-48a3-b461-913db36df42c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:34.464686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd81c47-a634-4956-aff6-e5985f7f9c69 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:34.473406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77abd0-629d-485a-a1ea-3edfceea2f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:34.474568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77abd0-629d-485a-a1ea-3edfceea2f6c admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:34.475005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77abd0-629d-485a-a1ea-3edfceea2f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:34.477542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77abd0-629d-485a-a1ea-3edfceea2f6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:34.477542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77abd0-629d-485a-a1ea-3edfceea2f6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:34.479429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77abd0-629d-485a-a1ea-3edfceea2f6c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:34.571521 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1099/2226] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:34 2022] POST /identity/v3/users => generated 296 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:12:34.575453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343c44d-6808-48a3-b461-913db36df42c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:34.587777 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1128/2227] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:34 2022] POST /identity/v3/projects => generated 365 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:34.590335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77abd0-629d-485a-a1ea-3edfceea2f6c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:34.606813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343c44d-6808-48a3-b461-913db36df42c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:34.815173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77abd0-629d-485a-a1ea-3edfceea2f6c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:34.849567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a81bb-7761-4b92-9622-0c05725b85fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:34.851549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a81bb-7761-4b92-9622-0c05725b85fb admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:34.854048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a81bb-7761-4b92-9622-0c05725b85fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:34.855033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08a81bb-7761-4b92-9622-0c05725b85fb admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:34.856691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a81bb-7761-4b92-9622-0c05725b85fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:34.862184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d17c35-39fa-4916-9946-fada8b21329e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:34.863881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d17c35-39fa-4916-9946-fada8b21329e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:34.869626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08a81bb-7761-4b92-9622-0c05725b85fb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:34.869840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d17c35-39fa-4916-9946-fada8b21329e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:34.870501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d17c35-39fa-4916-9946-fada8b21329e admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:34.871853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d17c35-39fa-4916-9946-fada8b21329e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:34.878413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d17c35-39fa-4916-9946-fada8b21329e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:34.947737 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1100/2228] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:34.949599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d17c35-39fa-4916-9946-fada8b21329e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:34.986856 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1129/2229] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:34 2022] POST /identity/v3/users => generated 289 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:12:34.989479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d17c35-39fa-4916-9946-fada8b21329e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:34.991125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a81bb-7761-4b92-9622-0c05725b85fb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:35.007941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419bce4-be04-49dd-962b-ee59934047ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:35.011186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419bce4-be04-49dd-962b-ee59934047ca admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:35.016552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419bce4-be04-49dd-962b-ee59934047ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:35.016552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419bce4-be04-49dd-962b-ee59934047ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:35.016552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419bce4-be04-49dd-962b-ee59934047ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:35.018593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08a81bb-7761-4b92-9622-0c05725b85fb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:35.019827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419bce4-be04-49dd-962b-ee59934047ca admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:35.045290 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1101/2230] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:35.047306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dbee9-28fa-4ecf-82d1-2533ba630e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:35.047627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419bce4-be04-49dd-962b-ee59934047ca admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:35.048413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dbee9-28fa-4ecf-82d1-2533ba630e1b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:35.048901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dbee9-28fa-4ecf-82d1-2533ba630e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:35.049382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0dbee9-28fa-4ecf-82d1-2533ba630e1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:35.057027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0dbee9-28fa-4ecf-82d1-2533ba630e1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:35.066889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0dbee9-28fa-4ecf-82d1-2533ba630e1b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:35.069500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419bce4-be04-49dd-962b-ee59934047ca admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:35.095731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8316c-7000-492f-8545-a695760bc2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:35.102856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8316c-7000-492f-8545-a695760bc2b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:35.102856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8316c-7000-492f-8545-a695760bc2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:35.102856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8316c-7000-492f-8545-a695760bc2b6 admin admin] PATH_INFO: `/v3/projects/471d006393e34bf1a013b026b7b9dc4b/users/c4c2f3f183d34d74bb7fd2fe70f378df/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:35.115092 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1130/2231] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:35.121508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dbee9-28fa-4ecf-82d1-2533ba630e1b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:35.132713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8316c-7000-492f-8545-a695760bc2b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=471d006393e34bf1a013b026b7b9dc4b, user_id=c4c2f3f183d34d74bb7fd2fe70f378df, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:35.142484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0dbee9-28fa-4ecf-82d1-2533ba630e1b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:35.142905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8316c-7000-492f-8545-a695760bc2b6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:35.169708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c307de-c8a9-452b-a51d-3b779ffae1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:35.175617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c307de-c8a9-452b-a51d-3b779ffae1eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:35.176180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c307de-c8a9-452b-a51d-3b779ffae1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:35.178823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c307de-c8a9-452b-a51d-3b779ffae1eb admin admin] PATH_INFO: `/v3/projects/5bdd29e066d34237b3323e76ef9e1ebd/users/ae13e09bf8ba4318851f1c4fdb35d077/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:35.228985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c307de-c8a9-452b-a51d-3b779ffae1eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bdd29e066d34237b3323e76ef9e1ebd, user_id=ae13e09bf8ba4318851f1c4fdb35d077, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:35.235022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c307de-c8a9-452b-a51d-3b779ffae1eb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:35.249482 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1102/2232] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:35 2022] PUT /identity/v3/projects/471d006393e34bf1a013b026b7b9dc4b/users/c4c2f3f183d34d74bb7fd2fe70f378df/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:35.272384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56901ab9-ac88-434e-aa43-6d49633b55e6 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:35.273192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56901ab9-ac88-434e-aa43-6d49633b55e6 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:35.274006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56901ab9-ac88-434e-aa43-6d49633b55e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:35.310377 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:35.356838 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1131/2233] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:35 2022] PUT /identity/v3/projects/5bdd29e066d34237b3323e76ef9e1ebd/users/ae13e09bf8ba4318851f1c4fdb35d077/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:35.362909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c307de-c8a9-452b-a51d-3b779ffae1eb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:35.374228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-56901ab9-ac88-434e-aa43-6d49633b55e6 None None] MFA Rules not processed for user `c4c2f3f183d34d74bb7fd2fe70f378df`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:35.376057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-56901ab9-ac88-434e-aa43-6d49633b55e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:35.504289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c307de-c8a9-452b-a51d-3b779ffae1eb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:35.519963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074fb3b-29e6-43b2-8a81-f0f7a4bbac2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:35.520250 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1103/2234] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:35.522501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074fb3b-29e6-43b2-8a81-f0f7a4bbac2c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:35.523182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074fb3b-29e6-43b2-8a81-f0f7a4bbac2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:35.523692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074fb3b-29e6-43b2-8a81-f0f7a4bbac2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:35.525294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56901ab9-ac88-434e-aa43-6d49633b55e6 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:35.526132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074fb3b-29e6-43b2-8a81-f0f7a4bbac2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:35.529998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074fb3b-29e6-43b2-8a81-f0f7a4bbac2c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:35.557116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56901ab9-ac88-434e-aa43-6d49633b55e6 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:35.564006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81782d3d-15f7-416f-9cc8-f7f54609d132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:35.565691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81782d3d-15f7-416f-9cc8-f7f54609d132 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:35.566385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81782d3d-15f7-416f-9cc8-f7f54609d132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:35.579155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81782d3d-15f7-416f-9cc8-f7f54609d132 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:35.580131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81782d3d-15f7-416f-9cc8-f7f54609d132 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:35.582594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81782d3d-15f7-416f-9cc8-f7f54609d132 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:35.595563 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1132/2235] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:35.600077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074fb3b-29e6-43b2-8a81-f0f7a4bbac2c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:35.640970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074fb3b-29e6-43b2-8a81-f0f7a4bbac2c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:35.650627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46aafb9-357e-4f34-b7dd-6d210e1b3d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:35.651836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46aafb9-357e-4f34-b7dd-6d210e1b3d88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:35.653748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46aafb9-357e-4f34-b7dd-6d210e1b3d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:35.654140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46aafb9-357e-4f34-b7dd-6d210e1b3d88 admin admin] PATH_INFO: `/v3/projects/5bdd29e066d34237b3323e76ef9e1ebd/users/ae13e09bf8ba4318851f1c4fdb35d077/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:35.657374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46aafb9-357e-4f34-b7dd-6d210e1b3d88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bdd29e066d34237b3323e76ef9e1ebd, user_id=ae13e09bf8ba4318851f1c4fdb35d077, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:35.660927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46aafb9-357e-4f34-b7dd-6d210e1b3d88 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:35.676023 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1133/2236] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:35 2022] PUT /identity/v3/projects/5bdd29e066d34237b3323e76ef9e1ebd/users/ae13e09bf8ba4318851f1c4fdb35d077/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:35.686632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744fa7a-5df1-433a-93f5-5b7c618a7aad None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:35.686920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744fa7a-5df1-433a-93f5-5b7c618a7aad None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:35.687197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744fa7a-5df1-433a-93f5-5b7c618a7aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:35.716813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e744fa7a-5df1-433a-93f5-5b7c618a7aad None None] MFA Rules not processed for user `ae13e09bf8ba4318851f1c4fdb35d077`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:35.718138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e744fa7a-5df1-433a-93f5-5b7c618a7aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:35.721435 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1104/2237] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:35 2022] POST /identity/v3/projects => generated 393 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:12:35.725666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81782d3d-15f7-416f-9cc8-f7f54609d132 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:35.842786 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1134/2238] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:12:35.884806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81782d3d-15f7-416f-9cc8-f7f54609d132 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:35.894785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f49fb-0159-4833-ad2d-0da83a6e5079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:35.896597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f49fb-0159-4833-ad2d-0da83a6e5079 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:35.896894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f49fb-0159-4833-ad2d-0da83a6e5079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:35.897708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f49fb-0159-4833-ad2d-0da83a6e5079 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:35.898429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f49fb-0159-4833-ad2d-0da83a6e5079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:35.903835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f49fb-0159-4833-ad2d-0da83a6e5079 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:35.955264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744fa7a-5df1-433a-93f5-5b7c618a7aad None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:35.956764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e744fa7a-5df1-433a-93f5-5b7c618a7aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:36.088114 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1105/2239] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:35 2022] POST /identity/v3/users => generated 303 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:36.089410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f49fb-0159-4833-ad2d-0da83a6e5079 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:36.107510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f49fb-0159-4833-ad2d-0da83a6e5079 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:36.123615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1a834-976f-4fda-b143-b7d521fb93f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:36.124500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1a834-976f-4fda-b143-b7d521fb93f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:36.124615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1a834-976f-4fda-b143-b7d521fb93f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:36.124899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1a834-976f-4fda-b143-b7d521fb93f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:36.125651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1a834-976f-4fda-b143-b7d521fb93f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:36.128814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1a834-976f-4fda-b143-b7d521fb93f8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:36.147162 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:36.147982 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1106/2240] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:36.152765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1a834-976f-4fda-b143-b7d521fb93f8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:36.164663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1a834-976f-4fda-b143-b7d521fb93f8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:36.170572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bd195-b469-4820-9af6-a3ea69210468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:36.171493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bd195-b469-4820-9af6-a3ea69210468 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:36.171780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bd195-b469-4820-9af6-a3ea69210468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:36.172061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115bd195-b469-4820-9af6-a3ea69210468 admin admin] PATH_INFO: `/v3/projects/3d653868e69d433890bc7b6271944e65/users/2a5991b2f40b47fda2c79a1c268e8b27/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:36.186038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744fa7a-5df1-433a-93f5-5b7c618a7aad None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:36.201261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bd195-b469-4820-9af6-a3ea69210468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d653868e69d433890bc7b6271944e65, user_id=2a5991b2f40b47fda2c79a1c268e8b27, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:36.203041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf3c12-f2cc-4459-8e2e-529972416cdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:36.203732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf3c12-f2cc-4459-8e2e-529972416cdc service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:36.205221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf3c12-f2cc-4459-8e2e-529972416cdc service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:36.205514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cf3c12-f2cc-4459-8e2e-529972416cdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:36.208590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115bd195-b469-4820-9af6-a3ea69210468 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:36.247886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf3c12-f2cc-4459-8e2e-529972416cdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:36.252996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cf3c12-f2cc-4459-8e2e-529972416cdc service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:36.291648 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1135/2241] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:35 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:36.310681 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1107/2242] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:36 2022] PUT /identity/v3/projects/3d653868e69d433890bc7b6271944e65/users/2a5991b2f40b47fda2c79a1c268e8b27/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:12:36.310901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf3c12-f2cc-4459-8e2e-529972416cdc service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:36.335974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cf3c12-f2cc-4459-8e2e-529972416cdc service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:36.378758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bd195-b469-4820-9af6-a3ea69210468 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:36.380744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-115bd195-b469-4820-9af6-a3ea69210468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:36.482924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115bd195-b469-4820-9af6-a3ea69210468 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:36.491603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9ba3c-bb1d-4ea8-98a2-308b4ce7794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:36.492925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9ba3c-bb1d-4ea8-98a2-308b4ce7794d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:36.495092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9ba3c-bb1d-4ea8-98a2-308b4ce7794d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:36.495549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae9ba3c-bb1d-4ea8-98a2-308b4ce7794d admin admin] PATH_INFO: `/v3/users/e115ab03ba7a4e90bb57c46b10ccbb8b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:36.499678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9ba3c-bb1d-4ea8-98a2-308b4ce7794d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e115ab03ba7a4e90bb57c46b10ccbb8b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:36.501614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae9ba3c-bb1d-4ea8-98a2-308b4ce7794d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:36.504475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26028695-9cd0-41fb-b598-f331a8eb5c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:36.505471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26028695-9cd0-41fb-b598-f331a8eb5c06 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:36.505980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26028695-9cd0-41fb-b598-f331a8eb5c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:36.507084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26028695-9cd0-41fb-b598-f331a8eb5c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:36.510221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26028695-9cd0-41fb-b598-f331a8eb5c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:36.513650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26028695-9cd0-41fb-b598-f331a8eb5c06 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:36.529881 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1136/2243] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:36.532638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26028695-9cd0-41fb-b598-f331a8eb5c06 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:36.549386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26028695-9cd0-41fb-b598-f331a8eb5c06 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:36.555131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c473dc-c6a2-41dd-9579-85720f4cf819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:36.556300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c473dc-c6a2-41dd-9579-85720f4cf819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:36.556584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c473dc-c6a2-41dd-9579-85720f4cf819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:36.556864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c473dc-c6a2-41dd-9579-85720f4cf819 admin admin] PATH_INFO: `/v3/users/23b4bccd58dd4d34b9892f7d2bf7f276` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:36.559415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c473dc-c6a2-41dd-9579-85720f4cf819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b4bccd58dd4d34b9892f7d2bf7f276)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:36.562618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c473dc-c6a2-41dd-9579-85720f4cf819 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:36.798609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2ae9ba3c-bb1d-4ea8-98a2-308b4ce7794d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e115ab03ba7a4e90bb57c46b10ccbb8b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:36.821347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2ae9ba3c-bb1d-4ea8-98a2-308b4ce7794d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e115ab03ba7a4e90bb57c46b10ccbb8b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:36.822353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2ae9ba3c-bb1d-4ea8-98a2-308b4ce7794d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e115ab03ba7a4e90bb57c46b10ccbb8b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:36.823034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2ae9ba3c-bb1d-4ea8-98a2-308b4ce7794d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e115ab03ba7a4e90bb57c46b10ccbb8b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:36.835815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2ae9ba3c-bb1d-4ea8-98a2-308b4ce7794d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e115ab03ba7a4e90bb57c46b10ccbb8b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:36.850637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-21c473dc-c6a2-41dd-9579-85720f4cf819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b4bccd58dd4d34b9892f7d2bf7f276'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:36.870700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-21c473dc-c6a2-41dd-9579-85720f4cf819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b4bccd58dd4d34b9892f7d2bf7f276'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:36.882706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-21c473dc-c6a2-41dd-9579-85720f4cf819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b4bccd58dd4d34b9892f7d2bf7f276'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:36.883899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-21c473dc-c6a2-41dd-9579-85720f4cf819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b4bccd58dd4d34b9892f7d2bf7f276'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:36.949548 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1108/2244] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:36 2022] DELETE /identity/v3/users/e115ab03ba7a4e90bb57c46b10ccbb8b => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:36.950943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9ba3c-bb1d-4ea8-98a2-308b4ce7794d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:36.953480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2ae9ba3c-bb1d-4ea8-98a2-308b4ce7794d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:37.028061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae9ba3c-bb1d-4ea8-98a2-308b4ce7794d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:37.036649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-21c473dc-c6a2-41dd-9579-85720f4cf819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b4bccd58dd4d34b9892f7d2bf7f276'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:37.037780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4a941-7946-4571-b0c8-1f581aed2587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:37.038959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4a941-7946-4571-b0c8-1f581aed2587 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:37.039252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4a941-7946-4571-b0c8-1f581aed2587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:37.039599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4a941-7946-4571-b0c8-1f581aed2587 admin admin] PATH_INFO: `/v3/projects/3d653868e69d433890bc7b6271944e65/users/2a5991b2f40b47fda2c79a1c268e8b27/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:37.042375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4a941-7946-4571-b0c8-1f581aed2587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d653868e69d433890bc7b6271944e65, user_id=2a5991b2f40b47fda2c79a1c268e8b27, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:37.044678 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1137/2245] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:36 2022] DELETE /identity/v3/users/23b4bccd58dd4d34b9892f7d2bf7f276 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:37.045961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd4a941-7946-4571-b0c8-1f581aed2587 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:37.046075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14552564-06fd-43ab-998c-c1e09ab27a39 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:37.046341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14552564-06fd-43ab-998c-c1e09ab27a39 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:37.046625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14552564-06fd-43ab-998c-c1e09ab27a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:37.074205 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1109/2246] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:36 2022] PUT /identity/v3/projects/3d653868e69d433890bc7b6271944e65/users/2a5991b2f40b47fda2c79a1c268e8b27/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:37.076462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e91966-649d-41a5-ba33-2baa7f1b4660 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:37.076925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e91966-649d-41a5-ba33-2baa7f1b4660 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:37.077335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e91966-649d-41a5-ba33-2baa7f1b4660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:37.081596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-14552564-06fd-43ab-998c-c1e09ab27a39 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:37.081596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-14552564-06fd-43ab-998c-c1e09ab27a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:37.114596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-72e91966-649d-41a5-ba33-2baa7f1b4660 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:37.115964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-72e91966-649d-41a5-ba33-2baa7f1b4660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:37.186696 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1138/2247] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:37.188508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fef69d-9242-49fb-8c23-fe0798bb9fec None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:37.188805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fef69d-9242-49fb-8c23-fe0798bb9fec None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:37.189166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fef69d-9242-49fb-8c23-fe0798bb9fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:37.244641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-02fef69d-9242-49fb-8c23-fe0798bb9fec None None] MFA Rules not processed for user `2a5991b2f40b47fda2c79a1c268e8b27`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:37.260991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-02fef69d-9242-49fb-8c23-fe0798bb9fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:37.280446 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1110/2248] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:37.280446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e91966-649d-41a5-ba33-2baa7f1b4660 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:37.282611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-72e91966-649d-41a5-ba33-2baa7f1b4660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:37.378594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e91966-649d-41a5-ba33-2baa7f1b4660 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:37.382823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b71f28-1519-4e80-92be-3e42193f4fbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:37.383893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b71f28-1519-4e80-92be-3e42193f4fbe service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:37.384214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b71f28-1519-4e80-92be-3e42193f4fbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:37.384555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b71f28-1519-4e80-92be-3e42193f4fbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:37.403499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b71f28-1519-4e80-92be-3e42193f4fbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:37.403499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b71f28-1519-4e80-92be-3e42193f4fbe service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:37.424704 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1111/2249] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:37.426018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b71f28-1519-4e80-92be-3e42193f4fbe service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:37.427221 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1139/2250] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:37.444723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fef69d-9242-49fb-8c23-fe0798bb9fec None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:37.446520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-02fef69d-9242-49fb-8c23-fe0798bb9fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:37.448507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b71f28-1519-4e80-92be-3e42193f4fbe service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:37.456972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8da8e-3167-4d2e-a858-d466b8c10543 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:37.457936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8da8e-3167-4d2e-a858-d466b8c10543 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:37.458434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8da8e-3167-4d2e-a858-d466b8c10543 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:37.458948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d8da8e-3167-4d2e-a858-d466b8c10543 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:37.488906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8da8e-3167-4d2e-a858-d466b8c10543 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:37.490998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d8da8e-3167-4d2e-a858-d466b8c10543 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:37.510950 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1112/2251] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:37.577910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fef69d-9242-49fb-8c23-fe0798bb9fec None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:37.590433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d07bc-30fb-41bb-b61e-5095004c2527 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:37.591167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d07bc-30fb-41bb-b61e-5095004c2527 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:37.591452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d07bc-30fb-41bb-b61e-5095004c2527 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:37.591729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d07bc-30fb-41bb-b61e-5095004c2527 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:37.608957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d07bc-30fb-41bb-b61e-5095004c2527 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:37.610341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d07bc-30fb-41bb-b61e-5095004c2527 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:37.641192 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1140/2252] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:37.981728 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:38.328381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8da8e-3167-4d2e-a858-d466b8c10543 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:38.329938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-45d8da8e-3167-4d2e-a858-d466b8c10543 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:38.344704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d8da8e-3167-4d2e-a858-d466b8c10543 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:38.349652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d07bc-30fb-41bb-b61e-5095004c2527 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:38.354349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ea1d07bc-30fb-41bb-b61e-5095004c2527 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:38.360938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52f5bb-255b-4bf6-82a9-ddea7d3fa087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:38.362177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52f5bb-255b-4bf6-82a9-ddea7d3fa087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:38.362598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52f5bb-255b-4bf6-82a9-ddea7d3fa087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:38.375460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d07bc-30fb-41bb-b61e-5095004c2527 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:38.381801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434fb39-cacc-4c6e-9ad4-985e6c83c578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:38.382858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434fb39-cacc-4c6e-9ad4-985e6c83c578 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:38.383167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434fb39-cacc-4c6e-9ad4-985e6c83c578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:38.384053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434fb39-cacc-4c6e-9ad4-985e6c83c578 admin admin] PATH_INFO: `/v3/projects/a8403d5c668e4e6da327aba653914e5a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:38.385242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434fb39-cacc-4c6e-9ad4-985e6c83c578 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8403d5c668e4e6da327aba653914e5a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:38.387403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434fb39-cacc-4c6e-9ad4-985e6c83c578 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:38.387693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52f5bb-255b-4bf6-82a9-ddea7d3fa087 admin admin] PATH_INFO: `/v3/users/c4c2f3f183d34d74bb7fd2fe70f378df` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:38.390254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52f5bb-255b-4bf6-82a9-ddea7d3fa087 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4c2f3f183d34d74bb7fd2fe70f378df)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:38.392569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52f5bb-255b-4bf6-82a9-ddea7d3fa087 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:38.513317 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:38.600112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0c52f5bb-255b-4bf6-82a9-ddea7d3fa087 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4c2f3f183d34d74bb7fd2fe70f378df'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:38.601340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3434fb39-cacc-4c6e-9ad4-985e6c83c578 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8403d5c668e4e6da327aba653914e5a', 'request_id': 'req-3434fb39-cacc-4c6e-9ad4-985e6c83c578'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:38.611342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3434fb39-cacc-4c6e-9ad4-985e6c83c578 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8403d5c668e4e6da327aba653914e5a', 'request_id': 'req-3434fb39-cacc-4c6e-9ad4-985e6c83c578'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:38.613592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0c52f5bb-255b-4bf6-82a9-ddea7d3fa087 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4c2f3f183d34d74bb7fd2fe70f378df'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:38.614384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0c52f5bb-255b-4bf6-82a9-ddea7d3fa087 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4c2f3f183d34d74bb7fd2fe70f378df'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:38.615156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0c52f5bb-255b-4bf6-82a9-ddea7d3fa087 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4c2f3f183d34d74bb7fd2fe70f378df'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:38.618963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3434fb39-cacc-4c6e-9ad4-985e6c83c578 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8403d5c668e4e6da327aba653914e5a', 'request_id': 'req-3434fb39-cacc-4c6e-9ad4-985e6c83c578'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:38.623548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0c52f5bb-255b-4bf6-82a9-ddea7d3fa087 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4c2f3f183d34d74bb7fd2fe70f378df'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:38.695151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3434fb39-cacc-4c6e-9ad4-985e6c83c578 admin admin] The token cache is being invalidate because project a8403d5c668e4e6da327aba653914e5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:38.695497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3434fb39-cacc-4c6e-9ad4-985e6c83c578 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:38.696739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3434fb39-cacc-4c6e-9ad4-985e6c83c578 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:38.699171 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1141/2253] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:38 2022] DELETE /identity/v3/projects/a8403d5c668e4e6da327aba653914e5a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:38.699298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434fb39-cacc-4c6e-9ad4-985e6c83c578 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:38.704628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3434fb39-cacc-4c6e-9ad4-985e6c83c578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:38.781567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434fb39-cacc-4c6e-9ad4-985e6c83c578 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:38.786583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21b804-471b-48f3-9b8f-cf81ed41fbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:38.787480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21b804-471b-48f3-9b8f-cf81ed41fbd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:38.787761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21b804-471b-48f3-9b8f-cf81ed41fbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:38.788043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21b804-471b-48f3-9b8f-cf81ed41fbd6 admin admin] PATH_INFO: `/v3/projects/1705e9cafaf143768b988fa6a39c45e0` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:38.789878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21b804-471b-48f3-9b8f-cf81ed41fbd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1705e9cafaf143768b988fa6a39c45e0)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:38.792188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21b804-471b-48f3-9b8f-cf81ed41fbd6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:38.866804 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1113/2254] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:38 2022] DELETE /identity/v3/users/c4c2f3f183d34d74bb7fd2fe70f378df => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:38.868161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52f5bb-255b-4bf6-82a9-ddea7d3fa087 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:38.869690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0c52f5bb-255b-4bf6-82a9-ddea7d3fa087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:38.943933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52f5bb-255b-4bf6-82a9-ddea7d3fa087 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:38.983399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5d21b804-471b-48f3-9b8f-cf81ed41fbd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1705e9cafaf143768b988fa6a39c45e0', 'request_id': 'req-5d21b804-471b-48f3-9b8f-cf81ed41fbd6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:38.994763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5d21b804-471b-48f3-9b8f-cf81ed41fbd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1705e9cafaf143768b988fa6a39c45e0', 'request_id': 'req-5d21b804-471b-48f3-9b8f-cf81ed41fbd6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:39.003379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5d21b804-471b-48f3-9b8f-cf81ed41fbd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1705e9cafaf143768b988fa6a39c45e0', 'request_id': 'req-5d21b804-471b-48f3-9b8f-cf81ed41fbd6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:39.010088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098e017-04fd-4890-8eed-94ea96b8d4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:39.013608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098e017-04fd-4890-8eed-94ea96b8d4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:39.013608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098e017-04fd-4890-8eed-94ea96b8d4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:39.013608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098e017-04fd-4890-8eed-94ea96b8d4e8 admin admin] PATH_INFO: `/v3/users/ae13e09bf8ba4318851f1c4fdb35d077` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:39.013608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098e017-04fd-4890-8eed-94ea96b8d4e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae13e09bf8ba4318851f1c4fdb35d077)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:39.014913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098e017-04fd-4890-8eed-94ea96b8d4e8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:39.068765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5d21b804-471b-48f3-9b8f-cf81ed41fbd6 admin admin] The token cache is being invalidate because project 1705e9cafaf143768b988fa6a39c45e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:39.069155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5d21b804-471b-48f3-9b8f-cf81ed41fbd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:39.069873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5d21b804-471b-48f3-9b8f-cf81ed41fbd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:39.071734 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1142/2255] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:38 2022] DELETE /identity/v3/projects/1705e9cafaf143768b988fa6a39c45e0 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:39.072956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf132616-ee68-4fc7-91d8-93ef50042def None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:39.073242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf132616-ee68-4fc7-91d8-93ef50042def None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:39.073548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf132616-ee68-4fc7-91d8-93ef50042def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:39.092841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-bf132616-ee68-4fc7-91d8-93ef50042def None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:39.094350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bf132616-ee68-4fc7-91d8-93ef50042def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:39.103307 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1143/2256] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:39.104623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf132616-ee68-4fc7-91d8-93ef50042def None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:39.106215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bf132616-ee68-4fc7-91d8-93ef50042def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:39.119023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf132616-ee68-4fc7-91d8-93ef50042def None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:39.123843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953433d-68f9-459c-ba7b-1b7fc0fc5ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:39.124828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953433d-68f9-459c-ba7b-1b7fc0fc5ba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:39.125353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953433d-68f9-459c-ba7b-1b7fc0fc5ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:39.125642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953433d-68f9-459c-ba7b-1b7fc0fc5ba2 admin admin] PATH_INFO: `/v3/users/44c1260529fd4d87b0d94f18cf40b520` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:39.126907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953433d-68f9-459c-ba7b-1b7fc0fc5ba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44c1260529fd4d87b0d94f18cf40b520)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:39.131907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a953433d-68f9-459c-ba7b-1b7fc0fc5ba2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:39.252562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9098e017-04fd-4890-8eed-94ea96b8d4e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae13e09bf8ba4318851f1c4fdb35d077'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:39.266203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9098e017-04fd-4890-8eed-94ea96b8d4e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae13e09bf8ba4318851f1c4fdb35d077'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:39.267771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9098e017-04fd-4890-8eed-94ea96b8d4e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae13e09bf8ba4318851f1c4fdb35d077'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:39.268432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9098e017-04fd-4890-8eed-94ea96b8d4e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae13e09bf8ba4318851f1c4fdb35d077'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:39.279544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9098e017-04fd-4890-8eed-94ea96b8d4e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae13e09bf8ba4318851f1c4fdb35d077'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:39.365183 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1114/2257] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:38 2022] DELETE /identity/v3/users/ae13e09bf8ba4318851f1c4fdb35d077 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:39.366942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098e017-04fd-4890-8eed-94ea96b8d4e8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:39.369774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9098e017-04fd-4890-8eed-94ea96b8d4e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:39.375846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a953433d-68f9-459c-ba7b-1b7fc0fc5ba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44c1260529fd4d87b0d94f18cf40b520'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:39.408402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a953433d-68f9-459c-ba7b-1b7fc0fc5ba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44c1260529fd4d87b0d94f18cf40b520'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:39.425228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a953433d-68f9-459c-ba7b-1b7fc0fc5ba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44c1260529fd4d87b0d94f18cf40b520'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:39.428193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a953433d-68f9-459c-ba7b-1b7fc0fc5ba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44c1260529fd4d87b0d94f18cf40b520'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:39.489650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098e017-04fd-4890-8eed-94ea96b8d4e8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:39.498316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37591aa-56a4-463c-b90b-925c82921c96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:39.499638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37591aa-56a4-463c-b90b-925c82921c96 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:39.500353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37591aa-56a4-463c-b90b-925c82921c96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:39.500785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37591aa-56a4-463c-b90b-925c82921c96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:39.503242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d37591aa-56a4-463c-b90b-925c82921c96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:39.507765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a953433d-68f9-459c-ba7b-1b7fc0fc5ba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44c1260529fd4d87b0d94f18cf40b520'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:39.517838 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1144/2258] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:39 2022] DELETE /identity/v3/users/44c1260529fd4d87b0d94f18cf40b520 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:39.586781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37591aa-56a4-463c-b90b-925c82921c96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:39.588259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37591aa-56a4-463c-b90b-925c82921c96 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:39.600618 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1115/2259] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:40.125006 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:40.137216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953433d-68f9-459c-ba7b-1b7fc0fc5ba2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:40.138798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a953433d-68f9-459c-ba7b-1b7fc0fc5ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:40.211443 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:40.291177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953433d-68f9-459c-ba7b-1b7fc0fc5ba2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:40.303787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a7b22-3f34-47b7-a464-80b3a00f1ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:40.307369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a7b22-3f34-47b7-a464-80b3a00f1ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:40.307905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a7b22-3f34-47b7-a464-80b3a00f1ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:40.310184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7a7b22-3f34-47b7-a464-80b3a00f1ca7 admin admin] PATH_INFO: `/v3/projects/5bdd29e066d34237b3323e76ef9e1ebd` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:40.313001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a7b22-3f34-47b7-a464-80b3a00f1ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bdd29e066d34237b3323e76ef9e1ebd)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:40.315934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7a7b22-3f34-47b7-a464-80b3a00f1ca7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:40.398173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37591aa-56a4-463c-b90b-925c82921c96 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:40.401696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d37591aa-56a4-463c-b90b-925c82921c96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:40.423914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37591aa-56a4-463c-b90b-925c82921c96 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:40.436031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b289a08d-cd83-45f8-9d92-ab2ae65d791c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:40.438674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289a08d-cd83-45f8-9d92-ab2ae65d791c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:40.439209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289a08d-cd83-45f8-9d92-ab2ae65d791c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:40.440331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b289a08d-cd83-45f8-9d92-ab2ae65d791c admin admin] PATH_INFO: `/v3/projects/471d006393e34bf1a013b026b7b9dc4b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:40.442404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289a08d-cd83-45f8-9d92-ab2ae65d791c admin admin] RBAC: Authorizing `identity:delete_project(project_id=471d006393e34bf1a013b026b7b9dc4b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:40.444474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b289a08d-cd83-45f8-9d92-ab2ae65d791c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:40.539482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8e7a7b22-3f34-47b7-a464-80b3a00f1ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bdd29e066d34237b3323e76ef9e1ebd', 'request_id': 'req-8e7a7b22-3f34-47b7-a464-80b3a00f1ca7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:40.550521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8e7a7b22-3f34-47b7-a464-80b3a00f1ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bdd29e066d34237b3323e76ef9e1ebd', 'request_id': 'req-8e7a7b22-3f34-47b7-a464-80b3a00f1ca7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:40.568009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8e7a7b22-3f34-47b7-a464-80b3a00f1ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bdd29e066d34237b3323e76ef9e1ebd', 'request_id': 'req-8e7a7b22-3f34-47b7-a464-80b3a00f1ca7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:40.632452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b289a08d-cd83-45f8-9d92-ab2ae65d791c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '471d006393e34bf1a013b026b7b9dc4b', 'request_id': 'req-b289a08d-cd83-45f8-9d92-ab2ae65d791c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:40.677066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8e7a7b22-3f34-47b7-a464-80b3a00f1ca7 admin admin] The token cache is being invalidate because project 5bdd29e066d34237b3323e76ef9e1ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:40.677724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8e7a7b22-3f34-47b7-a464-80b3a00f1ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:40.678613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8e7a7b22-3f34-47b7-a464-80b3a00f1ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:40.681299 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1145/2260] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:40 2022] DELETE /identity/v3/projects/5bdd29e066d34237b3323e76ef9e1ebd => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:40.685637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a7b22-3f34-47b7-a464-80b3a00f1ca7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:40.687331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8e7a7b22-3f34-47b7-a464-80b3a00f1ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:40.745202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b289a08d-cd83-45f8-9d92-ab2ae65d791c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '471d006393e34bf1a013b026b7b9dc4b', 'request_id': 'req-b289a08d-cd83-45f8-9d92-ab2ae65d791c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:40.752495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b289a08d-cd83-45f8-9d92-ab2ae65d791c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '471d006393e34bf1a013b026b7b9dc4b', 'request_id': 'req-b289a08d-cd83-45f8-9d92-ab2ae65d791c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:40.765318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b289a08d-cd83-45f8-9d92-ab2ae65d791c admin admin] The token cache is being invalidate because project 471d006393e34bf1a013b026b7b9dc4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:40.765661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b289a08d-cd83-45f8-9d92-ab2ae65d791c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:40.766414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b289a08d-cd83-45f8-9d92-ab2ae65d791c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:40.768312 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1116/2261] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:40 2022] DELETE /identity/v3/projects/471d006393e34bf1a013b026b7b9dc4b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:40.770439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381efce0-ff8b-4266-b58c-cc6bd9321e31 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:40.770799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381efce0-ff8b-4266-b58c-cc6bd9321e31 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:40.771178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381efce0-ff8b-4266-b58c-cc6bd9321e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:40.774214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7a7b22-3f34-47b7-a464-80b3a00f1ca7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:40.791813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-381efce0-ff8b-4266-b58c-cc6bd9321e31 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:40.793506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-381efce0-ff8b-4266-b58c-cc6bd9321e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:40.855854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de4af1-c883-4a3f-83f6-10ad3acb45bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:40.856726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de4af1-c883-4a3f-83f6-10ad3acb45bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:40.857183 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de4af1-c883-4a3f-83f6-10ad3acb45bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:40.857471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de4af1-c883-4a3f-83f6-10ad3acb45bf admin admin] PATH_INFO: `/v3/projects/6a32bf7367504d9ba8c40c296adade35` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:40.858710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de4af1-c883-4a3f-83f6-10ad3acb45bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a32bf7367504d9ba8c40c296adade35)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:40.860693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de4af1-c883-4a3f-83f6-10ad3acb45bf admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:40.880203 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1117/2262] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:40.881442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381efce0-ff8b-4266-b58c-cc6bd9321e31 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:40.890979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-381efce0-ff8b-4266-b58c-cc6bd9321e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:40.906534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381efce0-ff8b-4266-b58c-cc6bd9321e31 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:40.912084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a55bf-edf8-402d-b1b7-20b184ce1cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:40.913106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a55bf-edf8-402d-b1b7-20b184ce1cae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:40.913400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a55bf-edf8-402d-b1b7-20b184ce1cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:40.913682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a55bf-edf8-402d-b1b7-20b184ce1cae admin admin] PATH_INFO: `/v3/users/2a5991b2f40b47fda2c79a1c268e8b27` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:40.915048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a55bf-edf8-402d-b1b7-20b184ce1cae admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a5991b2f40b47fda2c79a1c268e8b27)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:40.917896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a55bf-edf8-402d-b1b7-20b184ce1cae admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:41.029269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-88de4af1-c883-4a3f-83f6-10ad3acb45bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a32bf7367504d9ba8c40c296adade35', 'request_id': 'req-88de4af1-c883-4a3f-83f6-10ad3acb45bf'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:41.035582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-88de4af1-c883-4a3f-83f6-10ad3acb45bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a32bf7367504d9ba8c40c296adade35', 'request_id': 'req-88de4af1-c883-4a3f-83f6-10ad3acb45bf'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:41.046840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-88de4af1-c883-4a3f-83f6-10ad3acb45bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a32bf7367504d9ba8c40c296adade35', 'request_id': 'req-88de4af1-c883-4a3f-83f6-10ad3acb45bf'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:41.179533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-88de4af1-c883-4a3f-83f6-10ad3acb45bf admin admin] The token cache is being invalidate because project 6a32bf7367504d9ba8c40c296adade35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:41.179956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-88de4af1-c883-4a3f-83f6-10ad3acb45bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:41.181416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-88de4af1-c883-4a3f-83f6-10ad3acb45bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:41.185405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-300a55bf-edf8-402d-b1b7-20b184ce1cae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a5991b2f40b47fda2c79a1c268e8b27'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:41.187020 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1146/2263] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:40 2022] DELETE /identity/v3/projects/6a32bf7367504d9ba8c40c296adade35 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:41.188622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303c198-b2c7-49b7-be56-779107f6f4fa None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:41.188997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303c198-b2c7-49b7-be56-779107f6f4fa None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:41.189330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0303c198-b2c7-49b7-be56-779107f6f4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:41.208944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0303c198-b2c7-49b7-be56-779107f6f4fa None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:41.210255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-300a55bf-edf8-402d-b1b7-20b184ce1cae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a5991b2f40b47fda2c79a1c268e8b27'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:41.210383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0303c198-b2c7-49b7-be56-779107f6f4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:41.211145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-300a55bf-edf8-402d-b1b7-20b184ce1cae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a5991b2f40b47fda2c79a1c268e8b27'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:41.212101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-300a55bf-edf8-402d-b1b7-20b184ce1cae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a5991b2f40b47fda2c79a1c268e8b27'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:41.229308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-300a55bf-edf8-402d-b1b7-20b184ce1cae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a5991b2f40b47fda2c79a1c268e8b27'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:41.277285 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1147/2264] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:41.278684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57866afc-6bc2-45c4-9845-bf8d2c3f291e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:41.278979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57866afc-6bc2-45c4-9845-bf8d2c3f291e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:41.279246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57866afc-6bc2-45c4-9845-bf8d2c3f291e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:41.299696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-57866afc-6bc2-45c4-9845-bf8d2c3f291e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:41.300800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-57866afc-6bc2-45c4-9845-bf8d2c3f291e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:41.303297 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1118/2265] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:40 2022] DELETE /identity/v3/users/2a5991b2f40b47fda2c79a1c268e8b27 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:41.305489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a55bf-edf8-402d-b1b7-20b184ce1cae admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:41.371284 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1148/2266] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:41.378975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4c6a5-f52e-42a6-a36e-d3eca6a6fa44 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:41.379257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4c6a5-f52e-42a6-a36e-d3eca6a6fa44 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:41.379712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed4c6a5-f52e-42a6-a36e-d3eca6a6fa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:41.400588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-bed4c6a5-f52e-42a6-a36e-d3eca6a6fa44 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:41.402003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a55bf-edf8-402d-b1b7-20b184ce1cae admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:41.402240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bed4c6a5-f52e-42a6-a36e-d3eca6a6fa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:41.407167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6adce-27ee-44e2-8a16-ea23323a70da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:41.407835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6adce-27ee-44e2-8a16-ea23323a70da admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:41.408306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6adce-27ee-44e2-8a16-ea23323a70da admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:41.408754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6adce-27ee-44e2-8a16-ea23323a70da admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:41.409644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6adce-27ee-44e2-8a16-ea23323a70da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:12:41.410150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6adce-27ee-44e2-8a16-ea23323a70da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:41.411896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6adce-27ee-44e2-8a16-ea23323a70da admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:41.415205 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1149/2267] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:41.416321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4c6a5-f52e-42a6-a36e-d3eca6a6fa44 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:41.425955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed4c6a5-f52e-42a6-a36e-d3eca6a6fa44 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:41.427083 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1119/2268] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:12:41.431828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6adce-27ee-44e2-8a16-ea23323a70da admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:41.434733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca15227-10fb-4039-aeeb-d442a63f1a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:41.435417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca15227-10fb-4039-aeeb-d442a63f1a4d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:41.435732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca15227-10fb-4039-aeeb-d442a63f1a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:41.435981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca15227-10fb-4039-aeeb-d442a63f1a4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:41.436752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca15227-10fb-4039-aeeb-d442a63f1a4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:12:41.437034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca15227-10fb-4039-aeeb-d442a63f1a4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:41.438803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca15227-10fb-4039-aeeb-d442a63f1a4d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:41.442685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6adce-27ee-44e2-8a16-ea23323a70da admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:41.448004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960a354-edc9-4c1f-9c82-c4b8a56aeba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:41.448784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960a354-edc9-4c1f-9c82-c4b8a56aeba8 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:41.449177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960a354-edc9-4c1f-9c82-c4b8a56aeba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:41.449554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960a354-edc9-4c1f-9c82-c4b8a56aeba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:41.450442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960a354-edc9-4c1f-9c82-c4b8a56aeba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:41.455138 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1150/2269] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:12:41.455279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960a354-edc9-4c1f-9c82-c4b8a56aeba8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:41.456674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca15227-10fb-4039-aeeb-d442a63f1a4d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:41.470520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca15227-10fb-4039-aeeb-d442a63f1a4d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:41.475919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e19de8-26bd-44d8-9a6c-9c2dd91e1ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:41.476651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e19de8-26bd-44d8-9a6c-9c2dd91e1ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:41.477526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e19de8-26bd-44d8-9a6c-9c2dd91e1ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:41.478042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e19de8-26bd-44d8-9a6c-9c2dd91e1ee9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:41.478866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e19de8-26bd-44d8-9a6c-9c2dd91e1ee9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:41.480876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e19de8-26bd-44d8-9a6c-9c2dd91e1ee9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:41.589939 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1120/2270] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:41 2022] POST /identity/v3/projects => generated 403 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:12:41.591394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960a354-edc9-4c1f-9c82-c4b8a56aeba8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:41.613367 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1151/2271] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:41 2022] POST /identity/v3/projects => generated 369 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:12:41.625573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e19de8-26bd-44d8-9a6c-9c2dd91e1ee9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:41.671432 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:41.744155 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:41.756679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960a354-edc9-4c1f-9c82-c4b8a56aeba8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:41.819649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e19de8-26bd-44d8-9a6c-9c2dd91e1ee9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:41.826140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733328c-ede1-46bb-b2f2-7da7a4fd5c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:41.826887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733328c-ede1-46bb-b2f2-7da7a4fd5c48 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:41.827272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733328c-ede1-46bb-b2f2-7da7a4fd5c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:41.827650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733328c-ede1-46bb-b2f2-7da7a4fd5c48 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:41.828545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733328c-ede1-46bb-b2f2-7da7a4fd5c48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:41.830703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8733328c-ede1-46bb-b2f2-7da7a4fd5c48 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:41.906642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da0fe0-1412-47c9-919a-2abe7394ac8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:41.907614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da0fe0-1412-47c9-919a-2abe7394ac8c admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:41.908759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da0fe0-1412-47c9-919a-2abe7394ac8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:41.909103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da0fe0-1412-47c9-919a-2abe7394ac8c admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:41.909911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da0fe0-1412-47c9-919a-2abe7394ac8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:41.912020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da0fe0-1412-47c9-919a-2abe7394ac8c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:41.941674 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1152/2272] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:41 2022] POST /identity/v3/users => generated 285 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:41.945480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733328c-ede1-46bb-b2f2-7da7a4fd5c48 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:41.989535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733328c-ede1-46bb-b2f2-7da7a4fd5c48 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:41.994500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be362789-0240-48f2-a03e-fd1cefe3bc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:41.995251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be362789-0240-48f2-a03e-fd1cefe3bc19 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:41.995845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be362789-0240-48f2-a03e-fd1cefe3bc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:41.996200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be362789-0240-48f2-a03e-fd1cefe3bc19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:41.997015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be362789-0240-48f2-a03e-fd1cefe3bc19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:41.999467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be362789-0240-48f2-a03e-fd1cefe3bc19 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:42.013159 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1153/2273] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:42.016189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be362789-0240-48f2-a03e-fd1cefe3bc19 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:42.028810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be362789-0240-48f2-a03e-fd1cefe3bc19 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:42.035357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f2cd5-ebd2-4d92-9b4f-11c0f3159c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:42.036025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f2cd5-ebd2-4d92-9b4f-11c0f3159c50 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:42.036438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f2cd5-ebd2-4d92-9b4f-11c0f3159c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:42.036879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f2cd5-ebd2-4d92-9b4f-11c0f3159c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:42.037610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f2cd5-ebd2-4d92-9b4f-11c0f3159c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:42.039244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f2cd5-ebd2-4d92-9b4f-11c0f3159c50 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:42.062648 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1121/2274] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:41 2022] POST /identity/v3/users => generated 302 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:42.062648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da0fe0-1412-47c9-919a-2abe7394ac8c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:42.064300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-69da0fe0-1412-47c9-919a-2abe7394ac8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:42.068202 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1154/2275] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:42.069092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f2cd5-ebd2-4d92-9b4f-11c0f3159c50 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:42.085178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f2cd5-ebd2-4d92-9b4f-11c0f3159c50 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:42.096226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d2c9a-ae5c-439e-9556-a439c118de9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:42.098814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d2c9a-ae5c-439e-9556-a439c118de9b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:42.099219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d2c9a-ae5c-439e-9556-a439c118de9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:42.099692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da0fe0-1412-47c9-919a-2abe7394ac8c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:42.100026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d2c9a-ae5c-439e-9556-a439c118de9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:42.101581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d2c9a-ae5c-439e-9556-a439c118de9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:42.104269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d2c9a-ae5c-439e-9556-a439c118de9b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:42.114762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab1154b-d56d-4398-a3b7-c1b9ef7d03aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:42.115651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1154b-d56d-4398-a3b7-c1b9ef7d03aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:42.115932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1154b-d56d-4398-a3b7-c1b9ef7d03aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:42.116210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab1154b-d56d-4398-a3b7-c1b9ef7d03aa admin admin] PATH_INFO: `/v3/projects/3d653868e69d433890bc7b6271944e65` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:42.119162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1154b-d56d-4398-a3b7-c1b9ef7d03aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d653868e69d433890bc7b6271944e65)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:42.121072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab1154b-d56d-4398-a3b7-c1b9ef7d03aa admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:42.137546 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1155/2276] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:42.138605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d2c9a-ae5c-439e-9556-a439c118de9b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:42.158312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d2c9a-ae5c-439e-9556-a439c118de9b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:42.170840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862762c-ef50-416c-a6c6-72029e302906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:42.171741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862762c-ef50-416c-a6c6-72029e302906 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:42.172022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862762c-ef50-416c-a6c6-72029e302906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:42.172296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862762c-ef50-416c-a6c6-72029e302906 admin admin] PATH_INFO: `/v3/projects/cca4d994dab34629b739d4870f887a84/users/865ff993f6a440d4a25b34daed8cd6ff/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:42.191816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862762c-ef50-416c-a6c6-72029e302906 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca4d994dab34629b739d4870f887a84, user_id=865ff993f6a440d4a25b34daed8cd6ff, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:42.194658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862762c-ef50-416c-a6c6-72029e302906 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:42.269561 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1156/2277] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:42 2022] PUT /identity/v3/projects/cca4d994dab34629b739d4870f887a84/users/865ff993f6a440d4a25b34daed8cd6ff/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:42.270437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862762c-ef50-416c-a6c6-72029e302906 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:42.280846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9ab1154b-d56d-4398-a3b7-c1b9ef7d03aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d653868e69d433890bc7b6271944e65', 'request_id': 'req-9ab1154b-d56d-4398-a3b7-c1b9ef7d03aa'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:42.340974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862762c-ef50-416c-a6c6-72029e302906 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:42.375752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9ab1154b-d56d-4398-a3b7-c1b9ef7d03aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d653868e69d433890bc7b6271944e65', 'request_id': 'req-9ab1154b-d56d-4398-a3b7-c1b9ef7d03aa'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:42.382974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9ab1154b-d56d-4398-a3b7-c1b9ef7d03aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d653868e69d433890bc7b6271944e65', 'request_id': 'req-9ab1154b-d56d-4398-a3b7-c1b9ef7d03aa'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:42.395537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9ab1154b-d56d-4398-a3b7-c1b9ef7d03aa admin admin] The token cache is being invalidate because project 3d653868e69d433890bc7b6271944e65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:42.395851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9ab1154b-d56d-4398-a3b7-c1b9ef7d03aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:42.396716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9ab1154b-d56d-4398-a3b7-c1b9ef7d03aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:42.398725 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1122/2278] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:42 2022] DELETE /identity/v3/projects/3d653868e69d433890bc7b6271944e65 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:42.404314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63eb9d-9945-4243-aee3-3f138a629f65 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:42.404314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63eb9d-9945-4243-aee3-3f138a629f65 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:42.404314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f63eb9d-9945-4243-aee3-3f138a629f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:42.404581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba18ba5-2f28-4a32-89b2-7bdf3752a4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:42.404756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18ba5-2f28-4a32-89b2-7bdf3752a4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:42.405164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18ba5-2f28-4a32-89b2-7bdf3752a4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:42.405605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba18ba5-2f28-4a32-89b2-7bdf3752a4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:42.406376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba18ba5-2f28-4a32-89b2-7bdf3752a4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:42.408902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba18ba5-2f28-4a32-89b2-7bdf3752a4a8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:42.420264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7f63eb9d-9945-4243-aee3-3f138a629f65 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:42.420450 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1157/2279] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:42.421519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7f63eb9d-9945-4243-aee3-3f138a629f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:42.422472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de0aa8-6985-403d-9b59-f1811e08ddf0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:42.422861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de0aa8-6985-403d-9b59-f1811e08ddf0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:42.423319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de0aa8-6985-403d-9b59-f1811e08ddf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:42.433375 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1123/2280] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:42.433375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63eb9d-9945-4243-aee3-3f138a629f65 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:42.436184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7f63eb9d-9945-4243-aee3-3f138a629f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:42.448383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-07de0aa8-6985-403d-9b59-f1811e08ddf0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:42.448878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f63eb9d-9945-4243-aee3-3f138a629f65 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:42.450044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-07de0aa8-6985-403d-9b59-f1811e08ddf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:42.454323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4300f5-3528-4430-9f7d-c9be914a1c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:42.455244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4300f5-3528-4430-9f7d-c9be914a1c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:42.455552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4300f5-3528-4430-9f7d-c9be914a1c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:42.455846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4300f5-3528-4430-9f7d-c9be914a1c87 admin admin] PATH_INFO: `/v3/projects/5baae2be9a9046f090a5d217902e2567/users/c1bf00babc344ac48ec97f1557b6a248/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:42.459550 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1158/2281] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:42.460279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de0aa8-6985-403d-9b59-f1811e08ddf0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:42.461952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-07de0aa8-6985-403d-9b59-f1811e08ddf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:42.482860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4300f5-3528-4430-9f7d-c9be914a1c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5baae2be9a9046f090a5d217902e2567, user_id=c1bf00babc344ac48ec97f1557b6a248, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:42.486301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4300f5-3528-4430-9f7d-c9be914a1c87 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:42.553152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de0aa8-6985-403d-9b59-f1811e08ddf0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:42.558137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683067e-80b1-470c-8702-278db3ba95eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:42.558890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683067e-80b1-470c-8702-278db3ba95eb service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:42.559172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683067e-80b1-470c-8702-278db3ba95eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:42.559841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683067e-80b1-470c-8702-278db3ba95eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:42.571027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683067e-80b1-470c-8702-278db3ba95eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:42.572874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683067e-80b1-470c-8702-278db3ba95eb service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:42.573855 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1124/2282] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:42 2022] PUT /identity/v3/projects/5baae2be9a9046f090a5d217902e2567/users/c1bf00babc344ac48ec97f1557b6a248/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:42.575590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2debb60-c3c6-4fac-b637-83d610e83af4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:42.576179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2debb60-c3c6-4fac-b637-83d610e83af4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:42.576671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2debb60-c3c6-4fac-b637-83d610e83af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:42.595987 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1159/2283] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:42.597525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429a27c-308c-46a1-8ea4-e80eddc5502c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:42.597680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429a27c-308c-46a1-8ea4-e80eddc5502c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:42.598151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429a27c-308c-46a1-8ea4-e80eddc5502c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:42.608050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c2debb60-c3c6-4fac-b637-83d610e83af4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:42.612568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c2debb60-c3c6-4fac-b637-83d610e83af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:42.637422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9429a27c-308c-46a1-8ea4-e80eddc5502c None None] MFA Rules not processed for user `c1bf00babc344ac48ec97f1557b6a248`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:42.638661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9429a27c-308c-46a1-8ea4-e80eddc5502c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:42.718921 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1125/2284] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:42.720010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2debb60-c3c6-4fac-b637-83d610e83af4 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:42.721651 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1160/2285] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:42.727976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429a27c-308c-46a1-8ea4-e80eddc5502c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:42.729623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9429a27c-308c-46a1-8ea4-e80eddc5502c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:42.734762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2debb60-c3c6-4fac-b637-83d610e83af4 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:42.747297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa940ae-cfff-41ac-88d4-9ca84b50577d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:42.747993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa940ae-cfff-41ac-88d4-9ca84b50577d admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:42.748275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa940ae-cfff-41ac-88d4-9ca84b50577d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:42.748550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa940ae-cfff-41ac-88d4-9ca84b50577d admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:42.749325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa940ae-cfff-41ac-88d4-9ca84b50577d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:12:42.749839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa940ae-cfff-41ac-88d4-9ca84b50577d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:42.751102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429a27c-308c-46a1-8ea4-e80eddc5502c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:42.751337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa940ae-cfff-41ac-88d4-9ca84b50577d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:42.756978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adbf48-5bcd-4950-89cb-e362c71a4436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:42.758707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adbf48-5bcd-4950-89cb-e362c71a4436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:42.759329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adbf48-5bcd-4950-89cb-e362c71a4436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:42.759776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44adbf48-5bcd-4950-89cb-e362c71a4436 admin admin] PATH_INFO: `/v3/users/4893403562c542fbb9fad5c5b37501f2` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:42.761039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44adbf48-5bcd-4950-89cb-e362c71a4436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4893403562c542fbb9fad5c5b37501f2)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:42.763504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44adbf48-5bcd-4950-89cb-e362c71a4436 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:42.765839 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1126/2286] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:12:42.770354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa940ae-cfff-41ac-88d4-9ca84b50577d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:42.781777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa940ae-cfff-41ac-88d4-9ca84b50577d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:42.787334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b680148-0b62-4092-8fbd-a42e93125e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:42.788002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b680148-0b62-4092-8fbd-a42e93125e1b admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:42.788293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b680148-0b62-4092-8fbd-a42e93125e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:42.788622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b680148-0b62-4092-8fbd-a42e93125e1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:42.789947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b680148-0b62-4092-8fbd-a42e93125e1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:42.792198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b680148-0b62-4092-8fbd-a42e93125e1b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:42.891749 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1127/2287] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:42 2022] POST /identity/v3/projects => generated 401 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:42.892605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b680148-0b62-4092-8fbd-a42e93125e1b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:42.925914 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:42.973695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-44adbf48-5bcd-4950-89cb-e362c71a4436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4893403562c542fbb9fad5c5b37501f2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:42.985644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b680148-0b62-4092-8fbd-a42e93125e1b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:43.004159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2eeb6-9524-443f-bcf4-3ee9b38de485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:43.006396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2eeb6-9524-443f-bcf4-3ee9b38de485 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:43.006928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2eeb6-9524-443f-bcf4-3ee9b38de485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:43.007309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2eeb6-9524-443f-bcf4-3ee9b38de485 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:43.008189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-44adbf48-5bcd-4950-89cb-e362c71a4436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4893403562c542fbb9fad5c5b37501f2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:43.008460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2eeb6-9524-443f-bcf4-3ee9b38de485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:43.011346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2eeb6-9524-443f-bcf4-3ee9b38de485 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:43.028421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-44adbf48-5bcd-4950-89cb-e362c71a4436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4893403562c542fbb9fad5c5b37501f2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:43.030169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-44adbf48-5bcd-4950-89cb-e362c71a4436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4893403562c542fbb9fad5c5b37501f2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:43.111089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-44adbf48-5bcd-4950-89cb-e362c71a4436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4893403562c542fbb9fad5c5b37501f2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:43.118621 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1161/2288] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:42 2022] DELETE /identity/v3/users/4893403562c542fbb9fad5c5b37501f2 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:43.119458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adbf48-5bcd-4950-89cb-e362c71a4436 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:43.122634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-44adbf48-5bcd-4950-89cb-e362c71a4436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:43.127735 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1128/2289] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:42 2022] POST /identity/v3/projects => generated 381 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:43.129052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19400111-d5d8-408e-a4df-f6dc3eb875ea None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:43.129373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19400111-d5d8-408e-a4df-f6dc3eb875ea None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:43.129689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19400111-d5d8-408e-a4df-f6dc3eb875ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:43.153170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-19400111-d5d8-408e-a4df-f6dc3eb875ea None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:43.154411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-19400111-d5d8-408e-a4df-f6dc3eb875ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:43.209308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44adbf48-5bcd-4950-89cb-e362c71a4436 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:43.238414 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1129/2290] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:43.238414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19400111-d5d8-408e-a4df-f6dc3eb875ea None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:43.239187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-19400111-d5d8-408e-a4df-f6dc3eb875ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:43.260767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19400111-d5d8-408e-a4df-f6dc3eb875ea None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:43.271216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3239ca-c2ff-41f9-931a-8da33867138e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:43.271916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3239ca-c2ff-41f9-931a-8da33867138e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:43.272199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3239ca-c2ff-41f9-931a-8da33867138e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:43.272477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3239ca-c2ff-41f9-931a-8da33867138e admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:43.273180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3239ca-c2ff-41f9-931a-8da33867138e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:43.276278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3239ca-c2ff-41f9-931a-8da33867138e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:43.295688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc6a61-8cf6-4aed-a0c5-2004a804a583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:43.296385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc6a61-8cf6-4aed-a0c5-2004a804a583 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:43.296672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc6a61-8cf6-4aed-a0c5-2004a804a583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:43.296950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc6a61-8cf6-4aed-a0c5-2004a804a583 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:43.297659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc6a61-8cf6-4aed-a0c5-2004a804a583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:43.299685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc6a61-8cf6-4aed-a0c5-2004a804a583 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:43.402878 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1130/2291] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:43 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:43.403793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3239ca-c2ff-41f9-931a-8da33867138e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:43.405390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aa3239ca-c2ff-41f9-931a-8da33867138e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:43.431685 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1162/2292] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:43 2022] POST /identity/v3/users => generated 307 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:43.431685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc6a61-8cf6-4aed-a0c5-2004a804a583 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:43.444128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc6a61-8cf6-4aed-a0c5-2004a804a583 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:43.449906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6071353-57a0-4f09-8f04-ded82b41f9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:43.450760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6071353-57a0-4f09-8f04-ded82b41f9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:43.451066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6071353-57a0-4f09-8f04-ded82b41f9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:43.451416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6071353-57a0-4f09-8f04-ded82b41f9b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:43.452217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6071353-57a0-4f09-8f04-ded82b41f9b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:43.453958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6071353-57a0-4f09-8f04-ded82b41f9b4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:43.465503 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1163/2293] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:43.468199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6071353-57a0-4f09-8f04-ded82b41f9b4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:43.468338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3239ca-c2ff-41f9-931a-8da33867138e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:43.473026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091e0b6-8910-47e0-8a86-cf93280460cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:43.473886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091e0b6-8910-47e0-8a86-cf93280460cc service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:43.474219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091e0b6-8910-47e0-8a86-cf93280460cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:43.474557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091e0b6-8910-47e0-8a86-cf93280460cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:43.477592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6071353-57a0-4f09-8f04-ded82b41f9b4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:43.482409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c320f6-99b8-4d1d-b24b-8a57010b688d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:43.483079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c320f6-99b8-4d1d-b24b-8a57010b688d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:43.483356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c320f6-99b8-4d1d-b24b-8a57010b688d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:43.483637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c320f6-99b8-4d1d-b24b-8a57010b688d admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:43.484372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c320f6-99b8-4d1d-b24b-8a57010b688d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:43.485316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091e0b6-8910-47e0-8a86-cf93280460cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:43.485962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c320f6-99b8-4d1d-b24b-8a57010b688d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:43.486875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091e0b6-8910-47e0-8a86-cf93280460cc service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:43.499409 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1164/2294] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:43.499561 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1131/2295] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:43.502653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c320f6-99b8-4d1d-b24b-8a57010b688d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:43.506276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091e0b6-8910-47e0-8a86-cf93280460cc service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:43.510722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c320f6-99b8-4d1d-b24b-8a57010b688d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:43.515775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb17be8-451c-424a-90ca-02d324739c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:43.516456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb17be8-451c-424a-90ca-02d324739c85 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:43.516742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb17be8-451c-424a-90ca-02d324739c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:43.517019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb17be8-451c-424a-90ca-02d324739c85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:43.517756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb17be8-451c-424a-90ca-02d324739c85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:43.519387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb17be8-451c-424a-90ca-02d324739c85 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:43.521353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091e0b6-8910-47e0-8a86-cf93280460cc service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:43.530975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c10cc9-d7b5-4e11-81a4-6408b9dac55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:43.532580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c10cc9-d7b5-4e11-81a4-6408b9dac55b admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:43.533961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c10cc9-d7b5-4e11-81a4-6408b9dac55b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:43.534612 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1165/2296] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:43.535120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c10cc9-d7b5-4e11-81a4-6408b9dac55b admin admin] PATH_INFO: `/v3/projects/c4f511c650a849808683f657d1361ef8/users/1c3488781ce7498c8012295e3382ce24/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:43.541346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb17be8-451c-424a-90ca-02d324739c85 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:43.552337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb17be8-451c-424a-90ca-02d324739c85 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:43.559998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c10cc9-d7b5-4e11-81a4-6408b9dac55b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f511c650a849808683f657d1361ef8, user_id=1c3488781ce7498c8012295e3382ce24, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:43.560686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57c103-99a4-473d-a28a-af5c04e2b750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:43.560686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57c103-99a4-473d-a28a-af5c04e2b750 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:43.560686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57c103-99a4-473d-a28a-af5c04e2b750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:43.560944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c10cc9-d7b5-4e11-81a4-6408b9dac55b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:43.561022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57c103-99a4-473d-a28a-af5c04e2b750 admin admin] PATH_INFO: `/v3/projects/b40105ba330b474a9f95987ea84249c7/users/937fa3a3d1d6438a9b9de5a4e8426b11/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:43.578075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57c103-99a4-473d-a28a-af5c04e2b750 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b40105ba330b474a9f95987ea84249c7, user_id=937fa3a3d1d6438a9b9de5a4e8426b11, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:43.581128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57c103-99a4-473d-a28a-af5c04e2b750 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:43.608052 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:43.639040 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1132/2297] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:43 2022] PUT /identity/v3/projects/c4f511c650a849808683f657d1361ef8/users/1c3488781ce7498c8012295e3382ce24/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:43.642936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c10cc9-d7b5-4e11-81a4-6408b9dac55b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:43.669702 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1166/2298] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:43 2022] PUT /identity/v3/projects/b40105ba330b474a9f95987ea84249c7/users/937fa3a3d1d6438a9b9de5a4e8426b11/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:43.681012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008acd02-59e3-4fa8-841d-92ad05a55e1e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:43.681808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008acd02-59e3-4fa8-841d-92ad05a55e1e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:43.682109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008acd02-59e3-4fa8-841d-92ad05a55e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:43.720916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c10cc9-d7b5-4e11-81a4-6408b9dac55b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:43.795086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d68b64-86bf-437f-a793-8d37f6224b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:43.795900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d68b64-86bf-437f-a793-8d37f6224b61 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:43.801456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d68b64-86bf-437f-a793-8d37f6224b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:43.801456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d68b64-86bf-437f-a793-8d37f6224b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:43.801456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d68b64-86bf-437f-a793-8d37f6224b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:43.801456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d68b64-86bf-437f-a793-8d37f6224b61 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:43.826469 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1133/2299] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:12:43.828890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d68b64-86bf-437f-a793-8d37f6224b61 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:43.835782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-008acd02-59e3-4fa8-841d-92ad05a55e1e None None] MFA Rules not processed for user `937fa3a3d1d6438a9b9de5a4e8426b11`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:43.837602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-008acd02-59e3-4fa8-841d-92ad05a55e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:43.841792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d68b64-86bf-437f-a793-8d37f6224b61 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:43.846912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb92f74-f15f-437b-ba4d-327b5dd42850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:43.847814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb92f74-f15f-437b-ba4d-327b5dd42850 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:43.848103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb92f74-f15f-437b-ba4d-327b5dd42850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:43.848384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb92f74-f15f-437b-ba4d-327b5dd42850 admin admin] PATH_INFO: `/v3/projects/c4f511c650a849808683f657d1361ef8/users/1c3488781ce7498c8012295e3382ce24/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:43.850424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb92f74-f15f-437b-ba4d-327b5dd42850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f511c650a849808683f657d1361ef8, user_id=1c3488781ce7498c8012295e3382ce24, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:43.853261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb92f74-f15f-437b-ba4d-327b5dd42850 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:43.864022 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1134/2300] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:43 2022] PUT /identity/v3/projects/c4f511c650a849808683f657d1361ef8/users/1c3488781ce7498c8012295e3382ce24/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:43.875193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f14d53-03fb-4bb1-a7e0-2e1d6013027e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:43.875488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f14d53-03fb-4bb1-a7e0-2e1d6013027e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:43.880332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f14d53-03fb-4bb1-a7e0-2e1d6013027e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:43.902929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-12f14d53-03fb-4bb1-a7e0-2e1d6013027e None None] MFA Rules not processed for user `1c3488781ce7498c8012295e3382ce24`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:43.906570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-12f14d53-03fb-4bb1-a7e0-2e1d6013027e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:43.908438 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1167/2301] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:12:43.909901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008acd02-59e3-4fa8-841d-92ad05a55e1e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:43.911585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-008acd02-59e3-4fa8-841d-92ad05a55e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:43.937425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008acd02-59e3-4fa8-841d-92ad05a55e1e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:43.990955 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1135/2302] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:43 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:12:43.991877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f14d53-03fb-4bb1-a7e0-2e1d6013027e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:43.997545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa787c-56a7-4757-9b4e-6e1d79333c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:43.998526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa787c-56a7-4757-9b4e-6e1d79333c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:43.998808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa787c-56a7-4757-9b4e-6e1d79333c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:43.999086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa787c-56a7-4757-9b4e-6e1d79333c6c admin admin] PATH_INFO: `/v3/projects/b87b86879289468cacc4a8dcb6764fc7` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:44.000268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa787c-56a7-4757-9b4e-6e1d79333c6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b87b86879289468cacc4a8dcb6764fc7)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:44.002301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa787c-56a7-4757-9b4e-6e1d79333c6c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:44.070690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f14d53-03fb-4bb1-a7e0-2e1d6013027e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:44.075727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633ec21-1bfc-4682-86bf-3dc12535a70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:44.076426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633ec21-1bfc-4682-86bf-3dc12535a70f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:44.076715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633ec21-1bfc-4682-86bf-3dc12535a70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:44.077089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633ec21-1bfc-4682-86bf-3dc12535a70f admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:44.077823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633ec21-1bfc-4682-86bf-3dc12535a70f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:44.079867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633ec21-1bfc-4682-86bf-3dc12535a70f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:44.089300 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:44.147552 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:44.160156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-67aa787c-56a7-4757-9b4e-6e1d79333c6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b87b86879289468cacc4a8dcb6764fc7', 'request_id': 'req-67aa787c-56a7-4757-9b4e-6e1d79333c6c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:44.166895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-67aa787c-56a7-4757-9b4e-6e1d79333c6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b87b86879289468cacc4a8dcb6764fc7', 'request_id': 'req-67aa787c-56a7-4757-9b4e-6e1d79333c6c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:44.176563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-67aa787c-56a7-4757-9b4e-6e1d79333c6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b87b86879289468cacc4a8dcb6764fc7', 'request_id': 'req-67aa787c-56a7-4757-9b4e-6e1d79333c6c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:44.216258 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1136/2303] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:43 2022] POST /identity/v3/projects => generated 381 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:44.216985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633ec21-1bfc-4682-86bf-3dc12535a70f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:44.224847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6633ec21-1bfc-4682-86bf-3dc12535a70f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:44.295533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-67aa787c-56a7-4757-9b4e-6e1d79333c6c admin admin] The token cache is being invalidate because project b87b86879289468cacc4a8dcb6764fc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:44.298256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-67aa787c-56a7-4757-9b4e-6e1d79333c6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:44.298256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-67aa787c-56a7-4757-9b4e-6e1d79333c6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:44.299777 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1168/2304] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:43 2022] DELETE /identity/v3/projects/b87b86879289468cacc4a8dcb6764fc7 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:44.303749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa787c-56a7-4757-9b4e-6e1d79333c6c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:44.307279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-67aa787c-56a7-4757-9b4e-6e1d79333c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:44.331698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633ec21-1bfc-4682-86bf-3dc12535a70f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:44.341221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754061d-40bb-46fc-b89d-48d02eefa802 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:44.342837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754061d-40bb-46fc-b89d-48d02eefa802 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:44.343657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754061d-40bb-46fc-b89d-48d02eefa802 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:44.344133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3754061d-40bb-46fc-b89d-48d02eefa802 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:44.347473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3754061d-40bb-46fc-b89d-48d02eefa802 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:44.423606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa787c-56a7-4757-9b4e-6e1d79333c6c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:44.468908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754061d-40bb-46fc-b89d-48d02eefa802 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:44.470941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3754061d-40bb-46fc-b89d-48d02eefa802 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:44.493497 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1137/2305] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:44 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:44.494468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754061d-40bb-46fc-b89d-48d02eefa802 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:44.499938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9db63a-a6f1-48a9-a5d6-b4177e1846b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:44.499938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9db63a-a6f1-48a9-a5d6-b4177e1846b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:44.500162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3754061d-40bb-46fc-b89d-48d02eefa802 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:44.500749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9db63a-a6f1-48a9-a5d6-b4177e1846b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:44.500749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9db63a-a6f1-48a9-a5d6-b4177e1846b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:44.500749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9db63a-a6f1-48a9-a5d6-b4177e1846b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:44.500749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9db63a-a6f1-48a9-a5d6-b4177e1846b1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:44.513214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3754061d-40bb-46fc-b89d-48d02eefa802 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:44.518666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f48b40-bd77-425f-a38f-d9f2e154248b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:44.520382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f48b40-bd77-425f-a38f-d9f2e154248b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:44.523461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f48b40-bd77-425f-a38f-d9f2e154248b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:44.523461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f48b40-bd77-425f-a38f-d9f2e154248b admin admin] PATH_INFO: `/v3/users/1e24fd23b5e146d9a4b50e9b6dcd3562` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:44.523461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f48b40-bd77-425f-a38f-d9f2e154248b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e24fd23b5e146d9a4b50e9b6dcd3562)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:44.524613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f48b40-bd77-425f-a38f-d9f2e154248b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:44.609105 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1169/2306] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:44 2022] POST /identity/v3/users => generated 297 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:44.610492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9db63a-a6f1-48a9-a5d6-b4177e1846b1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:44.622568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9db63a-a6f1-48a9-a5d6-b4177e1846b1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:44.628246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355505a7-f641-4d04-a196-bb6aed505d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:44.629664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355505a7-f641-4d04-a196-bb6aed505d7b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:44.630235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355505a7-f641-4d04-a196-bb6aed505d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:44.630726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355505a7-f641-4d04-a196-bb6aed505d7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:44.631697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355505a7-f641-4d04-a196-bb6aed505d7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:44.634304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355505a7-f641-4d04-a196-bb6aed505d7b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:44.648616 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1170/2307] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:44.652687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355505a7-f641-4d04-a196-bb6aed505d7b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:44.665603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355505a7-f641-4d04-a196-bb6aed505d7b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:44.672132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e83f4c-faa9-4025-8efc-456c8cdf7a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:44.674046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e83f4c-faa9-4025-8efc-456c8cdf7a38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:44.674524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e83f4c-faa9-4025-8efc-456c8cdf7a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:44.677924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e83f4c-faa9-4025-8efc-456c8cdf7a38 admin admin] PATH_INFO: `/v3/projects/9bc625e9153d4dc395984e3058b85ad3/users/78645c2852434e3fa799f4f18192a582/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:44.700654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e83f4c-faa9-4025-8efc-456c8cdf7a38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc625e9153d4dc395984e3058b85ad3, user_id=78645c2852434e3fa799f4f18192a582, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:44.703960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e83f4c-faa9-4025-8efc-456c8cdf7a38 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:44.792363 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1171/2308] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:44 2022] PUT /identity/v3/projects/9bc625e9153d4dc395984e3058b85ad3/users/78645c2852434e3fa799f4f18192a582/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:44.795400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-18f48b40-bd77-425f-a38f-d9f2e154248b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e24fd23b5e146d9a4b50e9b6dcd3562'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:44.796519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e83f4c-faa9-4025-8efc-456c8cdf7a38 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:44.816188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-18f48b40-bd77-425f-a38f-d9f2e154248b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e24fd23b5e146d9a4b50e9b6dcd3562'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:44.818626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-18f48b40-bd77-425f-a38f-d9f2e154248b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e24fd23b5e146d9a4b50e9b6dcd3562'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:44.819457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-18f48b40-bd77-425f-a38f-d9f2e154248b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e24fd23b5e146d9a4b50e9b6dcd3562'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:44.845617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-18f48b40-bd77-425f-a38f-d9f2e154248b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e24fd23b5e146d9a4b50e9b6dcd3562'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:44.941554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e83f4c-faa9-4025-8efc-456c8cdf7a38 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:44.947615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996950b-4844-4666-84c5-ffbf06273f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:44.948394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996950b-4844-4666-84c5-ffbf06273f07 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:44.955296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996950b-4844-4666-84c5-ffbf06273f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:44.955296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996950b-4844-4666-84c5-ffbf06273f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:44.955296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996950b-4844-4666-84c5-ffbf06273f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:44.955296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996950b-4844-4666-84c5-ffbf06273f07 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:44.963869 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1172/2309] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:44.964878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996950b-4844-4666-84c5-ffbf06273f07 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:44.967423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e996950b-4844-4666-84c5-ffbf06273f07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:45.003131 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1138/2310] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:44 2022] DELETE /identity/v3/users/1e24fd23b5e146d9a4b50e9b6dcd3562 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:45.003999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f48b40-bd77-425f-a38f-d9f2e154248b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:45.007648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-18f48b40-bd77-425f-a38f-d9f2e154248b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:45.065297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996950b-4844-4666-84c5-ffbf06273f07 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:45.148020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f48b40-bd77-425f-a38f-d9f2e154248b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:45.165844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8351f4-250d-40d4-87ed-2b3e1254ec32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:45.167314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8351f4-250d-40d4-87ed-2b3e1254ec32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:45.168361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8351f4-250d-40d4-87ed-2b3e1254ec32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:45.168669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8351f4-250d-40d4-87ed-2b3e1254ec32 admin admin] PATH_INFO: `/v3/projects/9bc625e9153d4dc395984e3058b85ad3/users/78645c2852434e3fa799f4f18192a582/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:45.171768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83d9e9-cd12-414e-9f63-d6d544d823c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:45.172565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83d9e9-cd12-414e-9f63-d6d544d823c1 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:45.172835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83d9e9-cd12-414e-9f63-d6d544d823c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:45.173112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83d9e9-cd12-414e-9f63-d6d544d823c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:45.177509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ab83d9e9-cd12-414e-9f63-d6d544d823c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:45.177708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8351f4-250d-40d4-87ed-2b3e1254ec32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc625e9153d4dc395984e3058b85ad3, user_id=78645c2852434e3fa799f4f18192a582, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:45.180190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8351f4-250d-40d4-87ed-2b3e1254ec32 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:45.199531 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1139/2311] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:45 2022] PUT /identity/v3/projects/9bc625e9153d4dc395984e3058b85ad3/users/78645c2852434e3fa799f4f18192a582/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:45.216029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8524b7-f301-4e5e-b21f-6363b436ee41 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:45.226077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8524b7-f301-4e5e-b21f-6363b436ee41 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:45.229192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8524b7-f301-4e5e-b21f-6363b436ee41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:45.262569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83d9e9-cd12-414e-9f63-d6d544d823c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:45.265601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83d9e9-cd12-414e-9f63-d6d544d823c1 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:45.277477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ec8524b7-f301-4e5e-b21f-6363b436ee41 None None] MFA Rules not processed for user `78645c2852434e3fa799f4f18192a582`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:45.278771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ec8524b7-f301-4e5e-b21f-6363b436ee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:45.280625 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1173/2312] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:44 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:45.429921 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1140/2313] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:45.498563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83d9e9-cd12-414e-9f63-d6d544d823c1 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:45.522973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83d9e9-cd12-414e-9f63-d6d544d823c1 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:45.730041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6a492-e701-440d-9386-e7e20a28944c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:45.730871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6a492-e701-440d-9386-e7e20a28944c service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:45.731237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6a492-e701-440d-9386-e7e20a28944c service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:45.731605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6a492-e701-440d-9386-e7e20a28944c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:45.744812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6a492-e701-440d-9386-e7e20a28944c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:45.747524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6a492-e701-440d-9386-e7e20a28944c service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:45.762735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8524b7-f301-4e5e-b21f-6363b436ee41 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:45.772548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ec8524b7-f301-4e5e-b21f-6363b436ee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:45.836807 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1174/2314] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:45.992909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6a492-e701-440d-9386-e7e20a28944c service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:45.994692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5df6a492-e701-440d-9386-e7e20a28944c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:46.116374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6a492-e701-440d-9386-e7e20a28944c service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:46.138411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ae6570-6567-41e3-951c-2f411f0eb530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:46.139327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae6570-6567-41e3-951c-2f411f0eb530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:46.141612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae6570-6567-41e3-951c-2f411f0eb530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:46.142961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ae6570-6567-41e3-951c-2f411f0eb530 admin admin] PATH_INFO: `/v3/users/c1bf00babc344ac48ec97f1557b6a248` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:46.152439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae6570-6567-41e3-951c-2f411f0eb530 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1bf00babc344ac48ec97f1557b6a248)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:46.154321 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:46.161747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ae6570-6567-41e3-951c-2f411f0eb530 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:46.241418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8524b7-f301-4e5e-b21f-6363b436ee41 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:46.249739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b97a1-9526-4256-ba5b-cfc034d76ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:46.251180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b97a1-9526-4256-ba5b-cfc034d76ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:46.251688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b97a1-9526-4256-ba5b-cfc034d76ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:46.252165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b97a1-9526-4256-ba5b-cfc034d76ffd admin admin] PATH_INFO: `/v3/projects/cc8bea3ca33f4e29b2c1bb42b156b094` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:46.253693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b97a1-9526-4256-ba5b-cfc034d76ffd admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc8bea3ca33f4e29b2c1bb42b156b094)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:46.256274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b97a1-9526-4256-ba5b-cfc034d76ffd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:46.419471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-956b97a1-9526-4256-ba5b-cfc034d76ffd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc8bea3ca33f4e29b2c1bb42b156b094', 'request_id': 'req-956b97a1-9526-4256-ba5b-cfc034d76ffd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:46.420634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d8ae6570-6567-41e3-951c-2f411f0eb530 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1bf00babc344ac48ec97f1557b6a248'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:46.433797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d8ae6570-6567-41e3-951c-2f411f0eb530 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1bf00babc344ac48ec97f1557b6a248'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:46.441145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d8ae6570-6567-41e3-951c-2f411f0eb530 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1bf00babc344ac48ec97f1557b6a248'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:46.441886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d8ae6570-6567-41e3-951c-2f411f0eb530 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1bf00babc344ac48ec97f1557b6a248'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:46.505787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-956b97a1-9526-4256-ba5b-cfc034d76ffd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc8bea3ca33f4e29b2c1bb42b156b094', 'request_id': 'req-956b97a1-9526-4256-ba5b-cfc034d76ffd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:46.513897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-956b97a1-9526-4256-ba5b-cfc034d76ffd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc8bea3ca33f4e29b2c1bb42b156b094', 'request_id': 'req-956b97a1-9526-4256-ba5b-cfc034d76ffd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:46.529774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-956b97a1-9526-4256-ba5b-cfc034d76ffd admin admin] The token cache is being invalidate because project cc8bea3ca33f4e29b2c1bb42b156b094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:46.530205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-956b97a1-9526-4256-ba5b-cfc034d76ffd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:46.530934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-956b97a1-9526-4256-ba5b-cfc034d76ffd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:46.532633 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1141/2315] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:45 2022] DELETE /identity/v3/projects/cc8bea3ca33f4e29b2c1bb42b156b094 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:46.533428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b97a1-9526-4256-ba5b-cfc034d76ffd admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:46.534819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-956b97a1-9526-4256-ba5b-cfc034d76ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:46.598967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d8ae6570-6567-41e3-951c-2f411f0eb530 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1bf00babc344ac48ec97f1557b6a248'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:46.611466 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1175/2316] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:45 2022] DELETE /identity/v3/users/c1bf00babc344ac48ec97f1557b6a248 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:46.611466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fafa22-78bf-4f8e-be42-6735a483bbfd None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:46.611466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fafa22-78bf-4f8e-be42-6735a483bbfd None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:46.611466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fafa22-78bf-4f8e-be42-6735a483bbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:46.629488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b97a1-9526-4256-ba5b-cfc034d76ffd admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:46.645007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-60fafa22-78bf-4f8e-be42-6735a483bbfd None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:46.645944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-60fafa22-78bf-4f8e-be42-6735a483bbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:46.698450 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:46.714545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b1494-d4c5-48ee-a78c-68830dbd256b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:46.716033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b1494-d4c5-48ee-a78c-68830dbd256b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:46.716650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b1494-d4c5-48ee-a78c-68830dbd256b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:46.720992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b1494-d4c5-48ee-a78c-68830dbd256b admin admin] PATH_INFO: `/v3/users/937fa3a3d1d6438a9b9de5a4e8426b11` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:46.722860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b1494-d4c5-48ee-a78c-68830dbd256b admin admin] RBAC: Authorizing `identity:delete_user(user_id=937fa3a3d1d6438a9b9de5a4e8426b11)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:46.725165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b1494-d4c5-48ee-a78c-68830dbd256b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:46.732245 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1176/2317] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:46.734471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78d57c-572d-4ed5-8c04-2c0238411db8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:46.734957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78d57c-572d-4ed5-8c04-2c0238411db8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:46.735386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78d57c-572d-4ed5-8c04-2c0238411db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:46.766576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4c78d57c-572d-4ed5-8c04-2c0238411db8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:46.772341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4c78d57c-572d-4ed5-8c04-2c0238411db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:46.796841 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1177/2318] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:46.798188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af9973-4203-4c0f-b02a-2ad7cfb18a29 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:46.799628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af9973-4203-4c0f-b02a-2ad7cfb18a29 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:46.799926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af9973-4203-4c0f-b02a-2ad7cfb18a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:46.841446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-44af9973-4203-4c0f-b02a-2ad7cfb18a29 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:46.842780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-44af9973-4203-4c0f-b02a-2ad7cfb18a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:46.857655 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1178/2319] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:46.858687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af9973-4203-4c0f-b02a-2ad7cfb18a29 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:46.862631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-44af9973-4203-4c0f-b02a-2ad7cfb18a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:46.948482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af9973-4203-4c0f-b02a-2ad7cfb18a29 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:46.952826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc64105-a1e3-45da-b8ff-c15e424d0089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:46.953543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc64105-a1e3-45da-b8ff-c15e424d0089 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:46.953833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc64105-a1e3-45da-b8ff-c15e424d0089 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:46.954137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc64105-a1e3-45da-b8ff-c15e424d0089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:46.965973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc64105-a1e3-45da-b8ff-c15e424d0089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:46.968503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc64105-a1e3-45da-b8ff-c15e424d0089 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:46.971873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1e5b1494-d4c5-48ee-a78c-68830dbd256b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '937fa3a3d1d6438a9b9de5a4e8426b11'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:46.988134 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1179/2320] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:46.989501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc64105-a1e3-45da-b8ff-c15e424d0089 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:46.995370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1e5b1494-d4c5-48ee-a78c-68830dbd256b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '937fa3a3d1d6438a9b9de5a4e8426b11'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:46.996377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1e5b1494-d4c5-48ee-a78c-68830dbd256b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '937fa3a3d1d6438a9b9de5a4e8426b11'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:46.997081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1e5b1494-d4c5-48ee-a78c-68830dbd256b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '937fa3a3d1d6438a9b9de5a4e8426b11'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:47.001551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc64105-a1e3-45da-b8ff-c15e424d0089 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:47.014407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63cb34-0942-48de-86b8-14c0a0b3e557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:47.014407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63cb34-0942-48de-86b8-14c0a0b3e557 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:47.015122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1e5b1494-d4c5-48ee-a78c-68830dbd256b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '937fa3a3d1d6438a9b9de5a4e8426b11'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:47.015223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63cb34-0942-48de-86b8-14c0a0b3e557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:47.015223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63cb34-0942-48de-86b8-14c0a0b3e557 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:47.015223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63cb34-0942-48de-86b8-14c0a0b3e557 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:12:47.015223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63cb34-0942-48de-86b8-14c0a0b3e557 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:47.015223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63cb34-0942-48de-86b8-14c0a0b3e557 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:47.026289 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1180/2321] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:12:47.029925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63cb34-0942-48de-86b8-14c0a0b3e557 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:47.031751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fd63cb34-0942-48de-86b8-14c0a0b3e557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:47.045321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63cb34-0942-48de-86b8-14c0a0b3e557 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:47.050310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acaf8b-1c3c-4de8-aeaa-5a588a1409d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:47.050921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acaf8b-1c3c-4de8-aeaa-5a588a1409d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:47.051246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acaf8b-1c3c-4de8-aeaa-5a588a1409d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:47.051522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35acaf8b-1c3c-4de8-aeaa-5a588a1409d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:47.052224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acaf8b-1c3c-4de8-aeaa-5a588a1409d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:47.054154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35acaf8b-1c3c-4de8-aeaa-5a588a1409d9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:47.091925 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1142/2322] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:46 2022] DELETE /identity/v3/users/937fa3a3d1d6438a9b9de5a4e8426b11 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:47.096313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dadc0a-4e5f-493c-af56-5cc5bbd05d48 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:47.096585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dadc0a-4e5f-493c-af56-5cc5bbd05d48 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:47.096880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dadc0a-4e5f-493c-af56-5cc5bbd05d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:47.117935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c9dadc0a-4e5f-493c-af56-5cc5bbd05d48 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:47.117935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c9dadc0a-4e5f-493c-af56-5cc5bbd05d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:47.163534 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1181/2323] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:47 2022] POST /identity/v3/projects => generated 365 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:12:47.166534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acaf8b-1c3c-4de8-aeaa-5a588a1409d9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:47.218124 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1143/2324] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:12:47.229546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dadc0a-4e5f-493c-af56-5cc5bbd05d48 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:47.231029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c9dadc0a-4e5f-493c-af56-5cc5bbd05d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:47.305172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35acaf8b-1c3c-4de8-aeaa-5a588a1409d9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:47.311265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b683c0-6b41-46e4-bc1c-189134c1cfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:47.311965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b683c0-6b41-46e4-bc1c-189134c1cfc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:47.312520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b683c0-6b41-46e4-bc1c-189134c1cfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:47.312866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b683c0-6b41-46e4-bc1c-189134c1cfc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:47.313583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b683c0-6b41-46e4-bc1c-189134c1cfc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:47.316251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b683c0-6b41-46e4-bc1c-189134c1cfc4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:47.333068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dadc0a-4e5f-493c-af56-5cc5bbd05d48 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:47.401420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baef12b-4149-43e9-ba6b-e466b49db5fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:47.402218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baef12b-4149-43e9-ba6b-e466b49db5fa service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:47.402808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baef12b-4149-43e9-ba6b-e466b49db5fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:47.409097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baef12b-4149-43e9-ba6b-e466b49db5fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:47.417629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baef12b-4149-43e9-ba6b-e466b49db5fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:47.419587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baef12b-4149-43e9-ba6b-e466b49db5fa service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:47.433349 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1144/2325] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:47.444078 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1182/2326] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:47 2022] POST /identity/v3/users => generated 283 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:12:47.449111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baef12b-4149-43e9-ba6b-e466b49db5fa service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:47.463031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baef12b-4149-43e9-ba6b-e466b49db5fa service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:47.471031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93a3d1-6302-4dd8-b5ec-82df88be99da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:47.472069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93a3d1-6302-4dd8-b5ec-82df88be99da admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:47.472667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93a3d1-6302-4dd8-b5ec-82df88be99da admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:47.473122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93a3d1-6302-4dd8-b5ec-82df88be99da admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:47.474190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93a3d1-6302-4dd8-b5ec-82df88be99da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:47.476264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93a3d1-6302-4dd8-b5ec-82df88be99da admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:47.494777 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1145/2327] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:47.498570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b683c0-6b41-46e4-bc1c-189134c1cfc4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:47.515891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b683c0-6b41-46e4-bc1c-189134c1cfc4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:47.526700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ffc26-3b2d-4909-a4b2-9eadbcbb228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:47.537210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ffc26-3b2d-4909-a4b2-9eadbcbb228c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:47.537642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ffc26-3b2d-4909-a4b2-9eadbcbb228c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:47.537926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ffc26-3b2d-4909-a4b2-9eadbcbb228c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:47.539413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ffc26-3b2d-4909-a4b2-9eadbcbb228c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:47.544458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ffc26-3b2d-4909-a4b2-9eadbcbb228c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:47.560424 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1183/2328] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:47.564301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93a3d1-6302-4dd8-b5ec-82df88be99da admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:47.594821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93a3d1-6302-4dd8-b5ec-82df88be99da admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:47.602942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e7ef8a-ff4e-48fb-bc6b-fb2c4d71c5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:47.605379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7ef8a-ff4e-48fb-bc6b-fb2c4d71c5ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:47.605596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7ef8a-ff4e-48fb-bc6b-fb2c4d71c5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:47.606134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e7ef8a-ff4e-48fb-bc6b-fb2c4d71c5ac admin admin] PATH_INFO: `/v3/projects/753af14218bd47c39874eaef6c42d25d/users/5c0882e092c644758966c19d52d86795/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:47.629093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7ef8a-ff4e-48fb-bc6b-fb2c4d71c5ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=753af14218bd47c39874eaef6c42d25d, user_id=5c0882e092c644758966c19d52d86795, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:47.634745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e7ef8a-ff4e-48fb-bc6b-fb2c4d71c5ac admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:47.716453 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1146/2329] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:47 2022] PUT /identity/v3/projects/753af14218bd47c39874eaef6c42d25d/users/5c0882e092c644758966c19d52d86795/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:47.721835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958cd72-b6e0-4ffa-a035-a2ed2645620a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:47.722231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958cd72-b6e0-4ffa-a035-a2ed2645620a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:47.722733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958cd72-b6e0-4ffa-a035-a2ed2645620a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:47.744627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0958cd72-b6e0-4ffa-a035-a2ed2645620a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:47.745913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0958cd72-b6e0-4ffa-a035-a2ed2645620a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:47.791588 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:47.799010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77e8ca-70aa-4c66-93bd-0af4c7475e4e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:47.799532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77e8ca-70aa-4c66-93bd-0af4c7475e4e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:47.799982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77e8ca-70aa-4c66-93bd-0af4c7475e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:47.828201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3b77e8ca-70aa-4c66-93bd-0af4c7475e4e None None] MFA Rules not processed for user `c4a929fee10e45c8a072b778b7944ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:47.830584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3b77e8ca-70aa-4c66-93bd-0af4c7475e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:47.875887 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1184/2330] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:47.892124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958cd72-b6e0-4ffa-a035-a2ed2645620a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:47.893947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0958cd72-b6e0-4ffa-a035-a2ed2645620a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:47.981905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958cd72-b6e0-4ffa-a035-a2ed2645620a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:47.991754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcc14d-8182-42a3-a516-660c80ec6edd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:47.994370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcc14d-8182-42a3-a516-660c80ec6edd service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:47.995177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcc14d-8182-42a3-a516-660c80ec6edd service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:47.995457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fcc14d-8182-42a3-a516-660c80ec6edd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:48.024779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcc14d-8182-42a3-a516-660c80ec6edd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:48.025024 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1147/2331] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:47 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:12:48.025647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fcc14d-8182-42a3-a516-660c80ec6edd service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:48.036252 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1185/2332] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:12:48.297393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77e8ca-70aa-4c66-93bd-0af4c7475e4e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:48.307813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3b77e8ca-70aa-4c66-93bd-0af4c7475e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:48.327349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77e8ca-70aa-4c66-93bd-0af4c7475e4e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:48.335363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d76e9-9ea8-4e6a-bcf6-f79fe9698474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:48.337068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d76e9-9ea8-4e6a-bcf6-f79fe9698474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:48.337435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d76e9-9ea8-4e6a-bcf6-f79fe9698474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:48.339117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d76e9-9ea8-4e6a-bcf6-f79fe9698474 admin admin] PATH_INFO: `/v3/projects/5baae2be9a9046f090a5d217902e2567` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:48.341283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d76e9-9ea8-4e6a-bcf6-f79fe9698474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5baae2be9a9046f090a5d217902e2567)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:48.342555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d76e9-9ea8-4e6a-bcf6-f79fe9698474 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:48.373097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcc14d-8182-42a3-a516-660c80ec6edd service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:48.375141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-24fcc14d-8182-42a3-a516-660c80ec6edd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:48.406633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fcc14d-8182-42a3-a516-660c80ec6edd service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:48.413474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ccf7e-08b0-436e-8165-9574f473cd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:48.415959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ccf7e-08b0-436e-8165-9574f473cd05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:48.416251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ccf7e-08b0-436e-8165-9574f473cd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:48.418311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ccf7e-08b0-436e-8165-9574f473cd05 admin admin] PATH_INFO: `/v3/projects/b40105ba330b474a9f95987ea84249c7` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:48.420815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ccf7e-08b0-436e-8165-9574f473cd05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b40105ba330b474a9f95987ea84249c7)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:48.425290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ccf7e-08b0-436e-8165-9574f473cd05 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:48.532033 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:48.567107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-613d76e9-9ea8-4e6a-bcf6-f79fe9698474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5baae2be9a9046f090a5d217902e2567', 'request_id': 'req-613d76e9-9ea8-4e6a-bcf6-f79fe9698474'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:48.618248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-834ccf7e-08b0-436e-8165-9574f473cd05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b40105ba330b474a9f95987ea84249c7', 'request_id': 'req-834ccf7e-08b0-436e-8165-9574f473cd05'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:48.631601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-834ccf7e-08b0-436e-8165-9574f473cd05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b40105ba330b474a9f95987ea84249c7', 'request_id': 'req-834ccf7e-08b0-436e-8165-9574f473cd05'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:48.646863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-834ccf7e-08b0-436e-8165-9574f473cd05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b40105ba330b474a9f95987ea84249c7', 'request_id': 'req-834ccf7e-08b0-436e-8165-9574f473cd05'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:48.673169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-613d76e9-9ea8-4e6a-bcf6-f79fe9698474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5baae2be9a9046f090a5d217902e2567', 'request_id': 'req-613d76e9-9ea8-4e6a-bcf6-f79fe9698474'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:48.683244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-613d76e9-9ea8-4e6a-bcf6-f79fe9698474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5baae2be9a9046f090a5d217902e2567', 'request_id': 'req-613d76e9-9ea8-4e6a-bcf6-f79fe9698474'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:48.698920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-613d76e9-9ea8-4e6a-bcf6-f79fe9698474 admin admin] The token cache is being invalidate because project 5baae2be9a9046f090a5d217902e2567 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:48.699606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-613d76e9-9ea8-4e6a-bcf6-f79fe9698474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:48.700911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-613d76e9-9ea8-4e6a-bcf6-f79fe9698474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:48.703265 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1148/2333] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:48 2022] DELETE /identity/v3/projects/5baae2be9a9046f090a5d217902e2567 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:48.707170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d76e9-9ea8-4e6a-bcf6-f79fe9698474 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:48.708896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-613d76e9-9ea8-4e6a-bcf6-f79fe9698474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:48.768689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-834ccf7e-08b0-436e-8165-9574f473cd05 admin admin] The token cache is being invalidate because project b40105ba330b474a9f95987ea84249c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:48.769633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-834ccf7e-08b0-436e-8165-9574f473cd05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:48.770448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-834ccf7e-08b0-436e-8165-9574f473cd05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:48.776184 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1186/2334] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:48 2022] DELETE /identity/v3/projects/b40105ba330b474a9f95987ea84249c7 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:48.777460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ccf7e-08b0-436e-8165-9574f473cd05 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:48.779707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-834ccf7e-08b0-436e-8165-9574f473cd05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:48.801570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d76e9-9ea8-4e6a-bcf6-f79fe9698474 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:48.881986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadddb45-6bc1-46f6-b243-c1713eb0d3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:48.883137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadddb45-6bc1-46f6-b243-c1713eb0d3c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:48.885556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadddb45-6bc1-46f6-b243-c1713eb0d3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:48.885556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadddb45-6bc1-46f6-b243-c1713eb0d3c3 admin admin] PATH_INFO: `/v3/users/1c3488781ce7498c8012295e3382ce24` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:48.886565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadddb45-6bc1-46f6-b243-c1713eb0d3c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c3488781ce7498c8012295e3382ce24)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:48.888786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadddb45-6bc1-46f6-b243-c1713eb0d3c3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:48.899830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ccf7e-08b0-436e-8165-9574f473cd05 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:48.908143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c98313-9eb2-4ed0-9868-ab0576553644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:48.909396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c98313-9eb2-4ed0-9868-ab0576553644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:48.910362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c98313-9eb2-4ed0-9868-ab0576553644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:48.911002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c98313-9eb2-4ed0-9868-ab0576553644 admin admin] PATH_INFO: `/v3/users/78645c2852434e3fa799f4f18192a582` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:48.914587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c98313-9eb2-4ed0-9868-ab0576553644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78645c2852434e3fa799f4f18192a582)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:48.920367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c98313-9eb2-4ed0-9868-ab0576553644 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:49.008124 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:49.100305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dadddb45-6bc1-46f6-b243-c1713eb0d3c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c3488781ce7498c8012295e3382ce24'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:49.134594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dadddb45-6bc1-46f6-b243-c1713eb0d3c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c3488781ce7498c8012295e3382ce24'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:49.135426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dadddb45-6bc1-46f6-b243-c1713eb0d3c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c3488781ce7498c8012295e3382ce24'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:49.135960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dadddb45-6bc1-46f6-b243-c1713eb0d3c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c3488781ce7498c8012295e3382ce24'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:49.149954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dadddb45-6bc1-46f6-b243-c1713eb0d3c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c3488781ce7498c8012295e3382ce24'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:49.166487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c0c98313-9eb2-4ed0-9868-ab0576553644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78645c2852434e3fa799f4f18192a582'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:49.186246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c0c98313-9eb2-4ed0-9868-ab0576553644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78645c2852434e3fa799f4f18192a582'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:49.196288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c0c98313-9eb2-4ed0-9868-ab0576553644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78645c2852434e3fa799f4f18192a582'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:49.198465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c0c98313-9eb2-4ed0-9868-ab0576553644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78645c2852434e3fa799f4f18192a582'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:49.249175 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1149/2335] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:48 2022] DELETE /identity/v3/users/1c3488781ce7498c8012295e3382ce24 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:12:49.294291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c0c98313-9eb2-4ed0-9868-ab0576553644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78645c2852434e3fa799f4f18192a582'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:49.305734 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1187/2336] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:48 2022] DELETE /identity/v3/users/78645c2852434e3fa799f4f18192a582 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:49.491145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadddb45-6bc1-46f6-b243-c1713eb0d3c3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:49.492758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-dadddb45-6bc1-46f6-b243-c1713eb0d3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:49.656819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadddb45-6bc1-46f6-b243-c1713eb0d3c3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:49.798168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1aa384-bf3a-4fd8-847c-2e2a378f5e02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:49.799109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1aa384-bf3a-4fd8-847c-2e2a378f5e02 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:49.799548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1aa384-bf3a-4fd8-847c-2e2a378f5e02 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:49.800582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1aa384-bf3a-4fd8-847c-2e2a378f5e02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:49.803352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5c1aa384-bf3a-4fd8-847c-2e2a378f5e02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:49.854064 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:49.913084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1aa384-bf3a-4fd8-847c-2e2a378f5e02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:49.915495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1aa384-bf3a-4fd8-847c-2e2a378f5e02 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:49.944063 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1150/2337] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:50.592225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c98313-9eb2-4ed0-9868-ab0576553644 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:50.594683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c0c98313-9eb2-4ed0-9868-ab0576553644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:50.670398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1aa384-bf3a-4fd8-847c-2e2a378f5e02 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:50.672497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5c1aa384-bf3a-4fd8-847c-2e2a378f5e02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:50.697343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c98313-9eb2-4ed0-9868-ab0576553644 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:50.704359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f1afcd-4e4f-47f1-9e0f-bd87d8f301df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:50.705606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1afcd-4e4f-47f1-9e0f-bd87d8f301df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:50.706801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1afcd-4e4f-47f1-9e0f-bd87d8f301df admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:50.706801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f1afcd-4e4f-47f1-9e0f-bd87d8f301df admin admin] PATH_INFO: `/v3/projects/c4f511c650a849808683f657d1361ef8` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:50.708199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1afcd-4e4f-47f1-9e0f-bd87d8f301df admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f511c650a849808683f657d1361ef8)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:50.710576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f1afcd-4e4f-47f1-9e0f-bd87d8f301df admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:50.757864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1aa384-bf3a-4fd8-847c-2e2a378f5e02 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:50.767340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5b572-5260-423d-b226-86fe2080d906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:50.768499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5b572-5260-423d-b226-86fe2080d906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:50.769079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5b572-5260-423d-b226-86fe2080d906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:50.769513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5b572-5260-423d-b226-86fe2080d906 admin admin] PATH_INFO: `/v3/projects/9bc625e9153d4dc395984e3058b85ad3` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:50.771813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5b572-5260-423d-b226-86fe2080d906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc625e9153d4dc395984e3058b85ad3)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:50.774494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5b572-5260-423d-b226-86fe2080d906 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:50.903675 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:50.921638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-91f1afcd-4e4f-47f1-9e0f-bd87d8f301df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f511c650a849808683f657d1361ef8', 'request_id': 'req-91f1afcd-4e4f-47f1-9e0f-bd87d8f301df'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:50.936255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a1e5b572-5260-423d-b226-86fe2080d906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc625e9153d4dc395984e3058b85ad3', 'request_id': 'req-a1e5b572-5260-423d-b226-86fe2080d906'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:50.954140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-91f1afcd-4e4f-47f1-9e0f-bd87d8f301df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f511c650a849808683f657d1361ef8', 'request_id': 'req-91f1afcd-4e4f-47f1-9e0f-bd87d8f301df'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:50.966799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-91f1afcd-4e4f-47f1-9e0f-bd87d8f301df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f511c650a849808683f657d1361ef8', 'request_id': 'req-91f1afcd-4e4f-47f1-9e0f-bd87d8f301df'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:51.013870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a1e5b572-5260-423d-b226-86fe2080d906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc625e9153d4dc395984e3058b85ad3', 'request_id': 'req-a1e5b572-5260-423d-b226-86fe2080d906'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:51.022631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a1e5b572-5260-423d-b226-86fe2080d906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc625e9153d4dc395984e3058b85ad3', 'request_id': 'req-a1e5b572-5260-423d-b226-86fe2080d906'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:51.050088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a1e5b572-5260-423d-b226-86fe2080d906 admin admin] The token cache is being invalidate because project 9bc625e9153d4dc395984e3058b85ad3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:51.050728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a1e5b572-5260-423d-b226-86fe2080d906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:51.052594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a1e5b572-5260-423d-b226-86fe2080d906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:51.055973 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1151/2338] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:50 2022] DELETE /identity/v3/projects/9bc625e9153d4dc395984e3058b85ad3 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:51.063872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12d94c-87f5-4a0d-af56-4443c07a0734 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:51.064240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12d94c-87f5-4a0d-af56-4443c07a0734 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:51.065020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12d94c-87f5-4a0d-af56-4443c07a0734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:51.099410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2c12d94c-87f5-4a0d-af56-4443c07a0734 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:51.102161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2c12d94c-87f5-4a0d-af56-4443c07a0734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:51.127538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-91f1afcd-4e4f-47f1-9e0f-bd87d8f301df admin admin] The token cache is being invalidate because project c4f511c650a849808683f657d1361ef8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:51.127847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-91f1afcd-4e4f-47f1-9e0f-bd87d8f301df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:51.128502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-91f1afcd-4e4f-47f1-9e0f-bd87d8f301df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:51.131643 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1188/2339] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:50 2022] DELETE /identity/v3/projects/c4f511c650a849808683f657d1361ef8 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:51.137201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b9e62-a80a-45d6-b5bd-cf5eaa4ee859 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:51.137493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b9e62-a80a-45d6-b5bd-cf5eaa4ee859 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:51.138038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b9e62-a80a-45d6-b5bd-cf5eaa4ee859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:51.214559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c76b9e62-a80a-45d6-b5bd-cf5eaa4ee859 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:51.220114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c76b9e62-a80a-45d6-b5bd-cf5eaa4ee859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:51.338679 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1152/2340] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:51.346510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093e364-fdc4-4ad7-94dc-c1727405d2dc None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:51.346802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093e364-fdc4-4ad7-94dc-c1727405d2dc None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:51.350413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093e364-fdc4-4ad7-94dc-c1727405d2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:51.411769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7093e364-fdc4-4ad7-94dc-c1727405d2dc None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:51.413023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7093e364-fdc4-4ad7-94dc-c1727405d2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:51.429519 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1189/2341] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:51.439598 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1153/2342] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:51.538971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b2550-c24c-4fd6-ba0e-2d4795c183f2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:51.538971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b2550-c24c-4fd6-ba0e-2d4795c183f2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:51.538971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b2550-c24c-4fd6-ba0e-2d4795c183f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:51.540649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093e364-fdc4-4ad7-94dc-c1727405d2dc None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:51.540649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093e364-fdc4-4ad7-94dc-c1727405d2dc None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:51.540649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe6b7e-3cba-4663-bc9a-33c1fb8b6a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:51.540649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe6b7e-3cba-4663-bc9a-33c1fb8b6a3c admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:51.541113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe6b7e-3cba-4663-bc9a-33c1fb8b6a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:51.541113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe6b7e-3cba-4663-bc9a-33c1fb8b6a3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:51.541113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe6b7e-3cba-4663-bc9a-33c1fb8b6a3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:12:51.541113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe6b7e-3cba-4663-bc9a-33c1fb8b6a3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:51.541113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe6b7e-3cba-4663-bc9a-33c1fb8b6a3c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:51.541454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4c5b2550-c24c-4fd6-ba0e-2d4795c183f2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:51.541454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4c5b2550-c24c-4fd6-ba0e-2d4795c183f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:51.541454 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1190/2343] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:12:51.541454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b2550-c24c-4fd6-ba0e-2d4795c183f2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:51.544731 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1154/2344] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:12:51.545907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe6b7e-3cba-4663-bc9a-33c1fb8b6a3c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:51.558304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b2550-c24c-4fd6-ba0e-2d4795c183f2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:51.569789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b8bfd-01fa-476c-9646-e2aae34c4d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:51.572488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b8bfd-01fa-476c-9646-e2aae34c4d47 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:51.573488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b8bfd-01fa-476c-9646-e2aae34c4d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:51.573862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5b8bfd-01fa-476c-9646-e2aae34c4d47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:51.574011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe6b7e-3cba-4663-bc9a-33c1fb8b6a3c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:51.575960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b8bfd-01fa-476c-9646-e2aae34c4d47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:12:51.577869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b8bfd-01fa-476c-9646-e2aae34c4d47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:51.581094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5b8bfd-01fa-476c-9646-e2aae34c4d47 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:52.062524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bddbe-8347-41e0-9e65-02ab03f3a87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:52.062524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bddbe-8347-41e0-9e65-02ab03f3a87e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:52.062524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bddbe-8347-41e0-9e65-02ab03f3a87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:52.062524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bddbe-8347-41e0-9e65-02ab03f3a87e admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:52.065756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bddbe-8347-41e0-9e65-02ab03f3a87e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:52.065756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bddbe-8347-41e0-9e65-02ab03f3a87e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:52.066052 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1191/2345] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:12:52.066052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b8bfd-01fa-476c-9646-e2aae34c4d47 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:52.066052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5b8bfd-01fa-476c-9646-e2aae34c4d47 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:52.083733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9d3bc-0879-4b3d-9130-ce6b26f39689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:52.083733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9d3bc-0879-4b3d-9130-ce6b26f39689 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:52.083733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9d3bc-0879-4b3d-9130-ce6b26f39689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:52.083733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9d3bc-0879-4b3d-9130-ce6b26f39689 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:52.085181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9d3bc-0879-4b3d-9130-ce6b26f39689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:52.085181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9d3bc-0879-4b3d-9130-ce6b26f39689 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:52.297646 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:52.319884 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1192/2346] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:52 2022] POST /identity/v3/projects => generated 385 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:52.327959 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1155/2347] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:51 2022] POST /identity/v3/projects => generated 403 bytes in 783 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:52.328178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9d3bc-0879-4b3d-9130-ce6b26f39689 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:52.334518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bddbe-8347-41e0-9e65-02ab03f3a87e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:52.560683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9d3bc-0879-4b3d-9130-ce6b26f39689 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:52.568370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4caf99-e8e0-4fd2-a809-58d878dbefb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:52.569182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4caf99-e8e0-4fd2-a809-58d878dbefb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:52.569755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4caf99-e8e0-4fd2-a809-58d878dbefb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:52.570044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4caf99-e8e0-4fd2-a809-58d878dbefb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:52.570344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bddbe-8347-41e0-9e65-02ab03f3a87e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:52.570888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4caf99-e8e0-4fd2-a809-58d878dbefb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:52.574152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4caf99-e8e0-4fd2-a809-58d878dbefb7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:52.579262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243aaa6-09de-4588-8450-bac6e9fc7ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:52.580069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243aaa6-09de-4588-8450-bac6e9fc7ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:52.580480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243aaa6-09de-4588-8450-bac6e9fc7ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:52.580863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243aaa6-09de-4588-8450-bac6e9fc7ad9 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:52.581756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243aaa6-09de-4588-8450-bac6e9fc7ad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:52.584189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243aaa6-09de-4588-8450-bac6e9fc7ad9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:52.676919 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1193/2348] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:52 2022] POST /identity/v3/users => generated 293 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:12:52.678400 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1156/2349] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:52 2022] POST /identity/v3/users => generated 302 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:52.694869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243aaa6-09de-4588-8450-bac6e9fc7ad9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:52.697241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4caf99-e8e0-4fd2-a809-58d878dbefb7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:52.718450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243aaa6-09de-4588-8450-bac6e9fc7ad9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:52.725579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa52757-cc94-44d1-bd2d-0a176e30b70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:52.727560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa52757-cc94-44d1-bd2d-0a176e30b70f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:52.727920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa52757-cc94-44d1-bd2d-0a176e30b70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:52.728415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa52757-cc94-44d1-bd2d-0a176e30b70f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:52.729099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa52757-cc94-44d1-bd2d-0a176e30b70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:52.731287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa52757-cc94-44d1-bd2d-0a176e30b70f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:52.744906 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1157/2350] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:52.750413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4caf99-e8e0-4fd2-a809-58d878dbefb7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:52.771141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa52757-cc94-44d1-bd2d-0a176e30b70f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:52.806541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb55193-e353-437d-af07-4cf5154f76b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:52.807500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa52757-cc94-44d1-bd2d-0a176e30b70f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:52.808968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb55193-e353-437d-af07-4cf5154f76b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:52.811680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb55193-e353-437d-af07-4cf5154f76b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:52.812821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb55193-e353-437d-af07-4cf5154f76b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:52.825023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb55193-e353-437d-af07-4cf5154f76b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:52.825023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb55193-e353-437d-af07-4cf5154f76b8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:52.832891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf679ee4-2324-410d-bbd3-e80add618686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:52.833580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf679ee4-2324-410d-bbd3-e80add618686 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:52.833866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf679ee4-2324-410d-bbd3-e80add618686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:52.834195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf679ee4-2324-410d-bbd3-e80add618686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:52.835143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf679ee4-2324-410d-bbd3-e80add618686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:52.837909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf679ee4-2324-410d-bbd3-e80add618686 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:52.853075 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1194/2351] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:52.855579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b5839-48c9-4605-a512-6589b2f56fd5 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:52.857178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b5839-48c9-4605-a512-6589b2f56fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:52.857888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b5839-48c9-4605-a512-6589b2f56fd5 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:52.859581 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1195/2352] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:12:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:12:52.860944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b5839-48c9-4605-a512-6589b2f56fd5 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:52.870525 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1158/2353] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:52.872157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e321b-e582-4f98-9dff-770c1d311542 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:52.872449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e321b-e582-4f98-9dff-770c1d311542 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:52.872766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e321b-e582-4f98-9dff-770c1d311542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:52.905768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b5839-48c9-4605-a512-6589b2f56fd5 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:52.912414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9f6cc-2204-446d-83ee-cead59df409e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:52.913110 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9f6cc-2204-446d-83ee-cead59df409e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:52.913410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9f6cc-2204-446d-83ee-cead59df409e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:52.913689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9f6cc-2204-446d-83ee-cead59df409e admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:52.915469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9f6cc-2204-446d-83ee-cead59df409e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:52.917354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9f6cc-2204-446d-83ee-cead59df409e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:52.935894 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1196/2354] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:52.935894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9f6cc-2204-446d-83ee-cead59df409e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:52.939472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3b8e321b-e582-4f98-9dff-770c1d311542 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:52.940709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3b8e321b-e582-4f98-9dff-770c1d311542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:52.958175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9f6cc-2204-446d-83ee-cead59df409e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:52.975354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a065e-859a-4524-8890-e5fdc4cc54f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:52.977386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a065e-859a-4524-8890-e5fdc4cc54f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:52.977882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a065e-859a-4524-8890-e5fdc4cc54f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:52.978530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a065e-859a-4524-8890-e5fdc4cc54f1 admin admin] PATH_INFO: `/v3/projects/6e8565151b8448fe999e41ae27e5c6e1/users/ae588eb37afa4e638714e97c1a42d395/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:53.028355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a065e-859a-4524-8890-e5fdc4cc54f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e8565151b8448fe999e41ae27e5c6e1, user_id=ae588eb37afa4e638714e97c1a42d395, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:53.032516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a065e-859a-4524-8890-e5fdc4cc54f1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:53.124353 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1197/2355] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:52 2022] PUT /identity/v3/projects/6e8565151b8448fe999e41ae27e5c6e1/users/ae588eb37afa4e638714e97c1a42d395/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:53.125199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a065e-859a-4524-8890-e5fdc4cc54f1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:53.139636 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1159/2356] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:12:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:53.141409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8540c-b293-4fa2-bad7-6a2630611823 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:53.141870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8540c-b293-4fa2-bad7-6a2630611823 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:53.142357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd8540c-b293-4fa2-bad7-6a2630611823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:53.193498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7dd8540c-b293-4fa2-bad7-6a2630611823 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:53.197644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7dd8540c-b293-4fa2-bad7-6a2630611823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:53.366191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a065e-859a-4524-8890-e5fdc4cc54f1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:53.371762 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1160/2357] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:53.372644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8540c-b293-4fa2-bad7-6a2630611823 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:53.378692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7dd8540c-b293-4fa2-bad7-6a2630611823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:53.410365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce8622-669d-40d5-92ab-7c9b252f4942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:53.412468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce8622-669d-40d5-92ab-7c9b252f4942 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:53.413678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce8622-669d-40d5-92ab-7c9b252f4942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:53.416309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce8622-669d-40d5-92ab-7c9b252f4942 admin admin] PATH_INFO: `/v3/projects/522c9817878c450283b4233e5a57652d/users/4004f1869cb549829f6eb58ace9ccf84/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:53.446727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce8622-669d-40d5-92ab-7c9b252f4942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=522c9817878c450283b4233e5a57652d, user_id=4004f1869cb549829f6eb58ace9ccf84, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:53.455188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce8622-669d-40d5-92ab-7c9b252f4942 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:53.552204 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1198/2358] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:53 2022] PUT /identity/v3/projects/522c9817878c450283b4233e5a57652d/users/4004f1869cb549829f6eb58ace9ccf84/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:53.562558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce8622-669d-40d5-92ab-7c9b252f4942 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:53.562558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7cce8622-669d-40d5-92ab-7c9b252f4942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:53.569187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd8540c-b293-4fa2-bad7-6a2630611823 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:53.688124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8a4e57-391f-4fca-a297-50e74005d46e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:53.689555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a4e57-391f-4fca-a297-50e74005d46e service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:53.689864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a4e57-391f-4fca-a297-50e74005d46e service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:53.690177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8a4e57-391f-4fca-a297-50e74005d46e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:53.701594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a4e57-391f-4fca-a297-50e74005d46e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:53.704937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8a4e57-391f-4fca-a297-50e74005d46e service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:53.732387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce8622-669d-40d5-92ab-7c9b252f4942 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:53.739048 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1161/2359] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:53.739905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047feecb-128a-4af8-b255-aa614c28eba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:53.740748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047feecb-128a-4af8-b255-aa614c28eba6 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:53.741209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047feecb-128a-4af8-b255-aa614c28eba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:53.741645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047feecb-128a-4af8-b255-aa614c28eba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:53.742650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9fd1a-655f-475d-a787-35e61da77895 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:53.742964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9fd1a-655f-475d-a787-35e61da77895 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:53.743242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9fd1a-655f-475d-a787-35e61da77895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:53.823657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-09f9fd1a-655f-475d-a787-35e61da77895 None None] MFA Rules not processed for user `4004f1869cb549829f6eb58ace9ccf84`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:53.825794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-09f9fd1a-655f-475d-a787-35e61da77895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:53.944142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047feecb-128a-4af8-b255-aa614c28eba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:53.946567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047feecb-128a-4af8-b255-aa614c28eba6 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:53.973503 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1199/2360] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:53.975069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e90f0-4a06-4058-b55e-4ba17c75c6eb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:53.975666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e90f0-4a06-4058-b55e-4ba17c75c6eb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:53.976127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e90f0-4a06-4058-b55e-4ba17c75c6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:54.006831 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1162/2361] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:54.011820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9fd1a-655f-475d-a787-35e61da77895 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:54.035757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9fd1a-655f-475d-a787-35e61da77895 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:54.036937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d64e90f0-4a06-4058-b55e-4ba17c75c6eb None None] MFA Rules not processed for user `865ff993f6a440d4a25b34daed8cd6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:54.038420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d64e90f0-4a06-4058-b55e-4ba17c75c6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:54.053503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385f412-394d-44af-bd56-7ae0d56cb7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:54.056418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385f412-394d-44af-bd56-7ae0d56cb7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:54.056739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385f412-394d-44af-bd56-7ae0d56cb7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:54.057022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385f412-394d-44af-bd56-7ae0d56cb7b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:54.057679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385f412-394d-44af-bd56-7ae0d56cb7b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:54.062128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2385f412-394d-44af-bd56-7ae0d56cb7b2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:54.182205 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1200/2362] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:54.183828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e90f0-4a06-4058-b55e-4ba17c75c6eb None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:54.185869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d64e90f0-4a06-4058-b55e-4ba17c75c6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:54.197998 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1163/2363] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:54 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:54.202221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385f412-394d-44af-bd56-7ae0d56cb7b2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:54.234843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e90f0-4a06-4058-b55e-4ba17c75c6eb None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:54.367317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1e489-b594-457c-82f9-9e0975f0a6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:54.371111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1e489-b594-457c-82f9-9e0975f0a6a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:54.372315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1e489-b594-457c-82f9-9e0975f0a6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:54.373200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1e489-b594-457c-82f9-9e0975f0a6a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:54.376021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1e489-b594-457c-82f9-9e0975f0a6a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:54.380303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1e489-b594-457c-82f9-9e0975f0a6a7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:54.431370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385f412-394d-44af-bd56-7ae0d56cb7b2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:54.445415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea9465-5aef-46d0-9b4a-18bcc48a8816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:54.447700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea9465-5aef-46d0-9b4a-18bcc48a8816 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:54.448040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea9465-5aef-46d0-9b4a-18bcc48a8816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:54.448325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea9465-5aef-46d0-9b4a-18bcc48a8816 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:54.451387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea9465-5aef-46d0-9b4a-18bcc48a8816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:54.457442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea9465-5aef-46d0-9b4a-18bcc48a8816 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:54.464355 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:54.514430 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1201/2364] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:12:54 2022] POST /identity/v3/projects => generated 371 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:54.518917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1e489-b594-457c-82f9-9e0975f0a6a7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:54.622765 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1164/2365] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:54 2022] POST /identity/v3/users => generated 300 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:12:54.622765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea9465-5aef-46d0-9b4a-18bcc48a8816 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:54.655389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1e489-b594-457c-82f9-9e0975f0a6a7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:54.661386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8fc30-98e0-485d-ab1f-4ff251441636 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:54.662057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8fc30-98e0-485d-ab1f-4ff251441636 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:54.662933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8fc30-98e0-485d-ab1f-4ff251441636 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:54.663215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8fc30-98e0-485d-ab1f-4ff251441636 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:54.670440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d9c8fc30-98e0-485d-ab1f-4ff251441636 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:54.675177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea9465-5aef-46d0-9b4a-18bcc48a8816 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:54.685063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8fc30-98e0-485d-ab1f-4ff251441636 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:54.687358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8fc30-98e0-485d-ab1f-4ff251441636 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:54.701088 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1202/2366] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:54.702176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8fc30-98e0-485d-ab1f-4ff251441636 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:54.795178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8fc30-98e0-485d-ab1f-4ff251441636 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:54.807135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ea299-487b-43d5-98f4-ccd98277cd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:54.807842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ea299-487b-43d5-98f4-ccd98277cd2f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:54.808388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ea299-487b-43d5-98f4-ccd98277cd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:54.808743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264ea299-487b-43d5-98f4-ccd98277cd2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:54.809626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ea299-487b-43d5-98f4-ccd98277cd2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:54.814651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264ea299-487b-43d5-98f4-ccd98277cd2f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:54.829653 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1203/2367] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:54.829653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ea299-487b-43d5-98f4-ccd98277cd2f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:54.829959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-264ea299-487b-43d5-98f4-ccd98277cd2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:54.830071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8d878-a225-4019-8ae1-18cb7f32692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:54.830799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8d878-a225-4019-8ae1-18cb7f32692c admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:54.831249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8d878-a225-4019-8ae1-18cb7f32692c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:54.831584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad8d878-a225-4019-8ae1-18cb7f32692c admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:54.836103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8d878-a225-4019-8ae1-18cb7f32692c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:54.843328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad8d878-a225-4019-8ae1-18cb7f32692c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:54.875224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264ea299-487b-43d5-98f4-ccd98277cd2f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:54.882018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea183e5-8d48-4330-9064-41c37b649c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:54.883562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea183e5-8d48-4330-9064-41c37b649c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:54.883914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea183e5-8d48-4330-9064-41c37b649c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:54.884200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea183e5-8d48-4330-9064-41c37b649c13 admin admin] PATH_INFO: `/v3/users/ce5e1a5541ff4454b5c37b8a57d5e0d5` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:54.885559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea183e5-8d48-4330-9064-41c37b649c13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce5e1a5541ff4454b5c37b8a57d5e0d5)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:54.887605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea183e5-8d48-4330-9064-41c37b649c13 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:54.942937 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1165/2368] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:12:54 2022] POST /identity/v3/users => generated 292 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:12:54.944413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8d878-a225-4019-8ae1-18cb7f32692c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:54.969811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad8d878-a225-4019-8ae1-18cb7f32692c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:54.981851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19561c-b884-4616-a689-c55389bd0d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:54.982921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19561c-b884-4616-a689-c55389bd0d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:54.983615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19561c-b884-4616-a689-c55389bd0d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:54.984348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e19561c-b884-4616-a689-c55389bd0d0f admin admin] PATH_INFO: `/v3/projects/2f4a5ba44a504430981182763ee97d4e/users/8a3836b1217543e1b5db978451e72aa7/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:55.005893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19561c-b884-4616-a689-c55389bd0d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f4a5ba44a504430981182763ee97d4e, user_id=8a3836b1217543e1b5db978451e72aa7, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:55.009294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e19561c-b884-4616-a689-c55389bd0d0f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:55.148467 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:55.159967 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1166/2369] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:54 2022] PUT /identity/v3/projects/2f4a5ba44a504430981182763ee97d4e/users/8a3836b1217543e1b5db978451e72aa7/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:55.160758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19561c-b884-4616-a689-c55389bd0d0f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:55.244882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6ea183e5-8d48-4330-9064-41c37b649c13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce5e1a5541ff4454b5c37b8a57d5e0d5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:55.315219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6ea183e5-8d48-4330-9064-41c37b649c13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce5e1a5541ff4454b5c37b8a57d5e0d5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:55.352753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6ea183e5-8d48-4330-9064-41c37b649c13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce5e1a5541ff4454b5c37b8a57d5e0d5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:55.353222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6ea183e5-8d48-4330-9064-41c37b649c13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce5e1a5541ff4454b5c37b8a57d5e0d5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:55.374888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e19561c-b884-4616-a689-c55389bd0d0f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:55.401780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ff42e-4712-4684-87d5-7f6ec4c5538d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:55.402764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ff42e-4712-4684-87d5-7f6ec4c5538d admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:55.405117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ff42e-4712-4684-87d5-7f6ec4c5538d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:55.412711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ff42e-4712-4684-87d5-7f6ec4c5538d admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:55.413620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ff42e-4712-4684-87d5-7f6ec4c5538d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:55.418049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ff42e-4712-4684-87d5-7f6ec4c5538d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:55.448154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6ea183e5-8d48-4330-9064-41c37b649c13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce5e1a5541ff4454b5c37b8a57d5e0d5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:55.452482 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1167/2370] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:55.460621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ff42e-4712-4684-87d5-7f6ec4c5538d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:55.467493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d15ff42e-4712-4684-87d5-7f6ec4c5538d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:55.471928 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1204/2371] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:54 2022] DELETE /identity/v3/users/ce5e1a5541ff4454b5c37b8a57d5e0d5 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:55.478924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea183e5-8d48-4330-9064-41c37b649c13 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:55.481389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6ea183e5-8d48-4330-9064-41c37b649c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:55.499789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ff42e-4712-4684-87d5-7f6ec4c5538d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:55.659563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670564e6-4701-47a0-aee5-203ca0927119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:55.661349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670564e6-4701-47a0-aee5-203ca0927119 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:55.661349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670564e6-4701-47a0-aee5-203ca0927119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:55.661349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670564e6-4701-47a0-aee5-203ca0927119 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:55.662298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670564e6-4701-47a0-aee5-203ca0927119 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:55.664113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670564e6-4701-47a0-aee5-203ca0927119 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:55.688767 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1168/2372] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:55.690528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01346c2c-af11-4ae1-815a-15c5e3fad180 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:55.693668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01346c2c-af11-4ae1-815a-15c5e3fad180 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:55.694280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01346c2c-af11-4ae1-815a-15c5e3fad180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:55.730563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea183e5-8d48-4330-9064-41c37b649c13 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:55.737124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1c0d4-cdcf-4a60-93a5-61e2b5a186cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:55.740227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1c0d4-cdcf-4a60-93a5-61e2b5a186cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:55.740227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1c0d4-cdcf-4a60-93a5-61e2b5a186cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:55.740479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1c0d4-cdcf-4a60-93a5-61e2b5a186cf admin admin] PATH_INFO: `/v3/projects/7c26eb8e51fe4d348cc3ef2f95249237/users/4a8d83c4076b4aa4bb1eb6d3f70e0fc8/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:55.753472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-01346c2c-af11-4ae1-815a-15c5e3fad180 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:55.755733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-01346c2c-af11-4ae1-815a-15c5e3fad180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:55.779038 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1169/2373] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:55.779629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01346c2c-af11-4ae1-815a-15c5e3fad180 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:55.799098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1c0d4-cdcf-4a60-93a5-61e2b5a186cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c26eb8e51fe4d348cc3ef2f95249237, user_id=4a8d83c4076b4aa4bb1eb6d3f70e0fc8, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:55.803566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1c0d4-cdcf-4a60-93a5-61e2b5a186cf admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:55.811540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01346c2c-af11-4ae1-815a-15c5e3fad180 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:55.822932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c181a-17a8-4360-926f-a66e5f78635d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:55.824212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c181a-17a8-4360-926f-a66e5f78635d admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:55.824557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c181a-17a8-4360-926f-a66e5f78635d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:55.824904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757c181a-17a8-4360-926f-a66e5f78635d admin admin] PATH_INFO: `/v3/projects/2f4a5ba44a504430981182763ee97d4e/users/8a3836b1217543e1b5db978451e72aa7/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:55.827534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c181a-17a8-4360-926f-a66e5f78635d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f4a5ba44a504430981182763ee97d4e, user_id=8a3836b1217543e1b5db978451e72aa7, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:55.830448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757c181a-17a8-4360-926f-a66e5f78635d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:55.845253 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1170/2374] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:55 2022] PUT /identity/v3/projects/2f4a5ba44a504430981182763ee97d4e/users/8a3836b1217543e1b5db978451e72aa7/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:55.845981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c181a-17a8-4360-926f-a66e5f78635d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:55.851271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-757c181a-17a8-4360-926f-a66e5f78635d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:55.916441 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1205/2375] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:55 2022] PUT /identity/v3/projects/7c26eb8e51fe4d348cc3ef2f95249237/users/4a8d83c4076b4aa4bb1eb6d3f70e0fc8/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:55.919667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11144c85-ec61-4a1d-8028-2a54d21140e9 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:55.920070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11144c85-ec61-4a1d-8028-2a54d21140e9 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:55.922890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11144c85-ec61-4a1d-8028-2a54d21140e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:55.995315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757c181a-17a8-4360-926f-a66e5f78635d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:56.015429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-11144c85-ec61-4a1d-8028-2a54d21140e9 None None] MFA Rules not processed for user `8a3836b1217543e1b5db978451e72aa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:56.019451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-11144c85-ec61-4a1d-8028-2a54d21140e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:56.136782 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1206/2376] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:12:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:56.141874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2255528-c50c-4eae-a8a8-a5b4d377c3b9 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:56.141874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2255528-c50c-4eae-a8a8-a5b4d377c3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:56.141874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2255528-c50c-4eae-a8a8-a5b4d377c3b9 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:56.148321 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1207/2377] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:12:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:12:56.148321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2255528-c50c-4eae-a8a8-a5b4d377c3b9 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:56.229179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94feee-55df-4c0e-b4ad-d4c0956c58d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:56.240246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94feee-55df-4c0e-b4ad-d4c0956c58d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:56.240569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94feee-55df-4c0e-b4ad-d4c0956c58d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:56.241138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94feee-55df-4c0e-b4ad-d4c0956c58d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:56.302745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2255528-c50c-4eae-a8a8-a5b4d377c3b9 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:56.321832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642b801c-e3d2-4b76-a3aa-799814b6b8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:56.321832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b801c-e3d2-4b76-a3aa-799814b6b8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:56.321832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b801c-e3d2-4b76-a3aa-799814b6b8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:56.321832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b801c-e3d2-4b76-a3aa-799814b6b8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:56.322224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b801c-e3d2-4b76-a3aa-799814b6b8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:56.322507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642b801c-e3d2-4b76-a3aa-799814b6b8c1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:56.350321 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1208/2378] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:12:56.350321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb4693-1d06-43ae-9bf1-6412f70d1ace None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:56.350321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb4693-1d06-43ae-9bf1-6412f70d1ace None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:56.350321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb4693-1d06-43ae-9bf1-6412f70d1ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:56.390548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94feee-55df-4c0e-b4ad-d4c0956c58d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:56.392738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-35eb4693-1d06-43ae-9bf1-6412f70d1ace None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:56.394073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-35eb4693-1d06-43ae-9bf1-6412f70d1ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:56.394869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e94feee-55df-4c0e-b4ad-d4c0956c58d9 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:56.418515 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1171/2379] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:56.419961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94feee-55df-4c0e-b4ad-d4c0956c58d9 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:56.422459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8e94feee-55df-4c0e-b4ad-d4c0956c58d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:56.561342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94feee-55df-4c0e-b4ad-d4c0956c58d9 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:56.561910 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1209/2380] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:12:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:56.563082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb4693-1d06-43ae-9bf1-6412f70d1ace None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:56.570299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22705221-47e1-402b-93e1-782ec2b1f030 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:56.571200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22705221-47e1-402b-93e1-782ec2b1f030 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:56.571586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22705221-47e1-402b-93e1-782ec2b1f030 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:56.572130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22705221-47e1-402b-93e1-782ec2b1f030 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:56.584356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22705221-47e1-402b-93e1-782ec2b1f030 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:56.587128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22705221-47e1-402b-93e1-782ec2b1f030 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:56.591298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb4693-1d06-43ae-9bf1-6412f70d1ace None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:56.599817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cafe6a-117e-44e0-a2fe-652e5ea26179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:56.600835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cafe6a-117e-44e0-a2fe-652e5ea26179 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:56.601123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cafe6a-117e-44e0-a2fe-652e5ea26179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:56.601399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cafe6a-117e-44e0-a2fe-652e5ea26179 admin admin] PATH_INFO: `/v3/projects/7c26eb8e51fe4d348cc3ef2f95249237/users/4a8d83c4076b4aa4bb1eb6d3f70e0fc8/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:56.605645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cafe6a-117e-44e0-a2fe-652e5ea26179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c26eb8e51fe4d348cc3ef2f95249237, user_id=4a8d83c4076b4aa4bb1eb6d3f70e0fc8, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:56.608352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cafe6a-117e-44e0-a2fe-652e5ea26179 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:56.613831 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1172/2381] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:56 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:56.615243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22705221-47e1-402b-93e1-782ec2b1f030 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:56.619654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-22705221-47e1-402b-93e1-782ec2b1f030 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:56.643478 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1210/2382] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:12:56 2022] PUT /identity/v3/projects/7c26eb8e51fe4d348cc3ef2f95249237/users/4a8d83c4076b4aa4bb1eb6d3f70e0fc8/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:56.661315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22705221-47e1-402b-93e1-782ec2b1f030 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:56.697448 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:56.728281 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:56.767027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d5f6c-13e5-4d2e-849d-ddf2b208860e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:56.767821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d5f6c-13e5-4d2e-849d-ddf2b208860e service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:56.768208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d5f6c-13e5-4d2e-849d-ddf2b208860e service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:56.768585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d5f6c-13e5-4d2e-849d-ddf2b208860e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:56.890260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d5f6c-13e5-4d2e-849d-ddf2b208860e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:56.891828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d5f6c-13e5-4d2e-849d-ddf2b208860e service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:56.907382 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1173/2383] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:56.948293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fa05c-ab71-40fd-9a2d-b01e561fef3c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:56.948604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fa05c-ab71-40fd-9a2d-b01e561fef3c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:56.948889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fa05c-ab71-40fd-9a2d-b01e561fef3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:56.979371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ed2fa05c-ab71-40fd-9a2d-b01e561fef3c None None] MFA Rules not processed for user `e997b70d7158446daa1dfa225eb7afca`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:12:56.981086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ed2fa05c-ab71-40fd-9a2d-b01e561fef3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:57.000086 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1211/2384] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:12:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:12:57.108271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d5f6c-13e5-4d2e-849d-ddf2b208860e service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:57.122481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d5f6c-13e5-4d2e-849d-ddf2b208860e service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:57.137061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cbba3-6792-4602-bd1f-8df3ce65fc1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:57.137963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cbba3-6792-4602-bd1f-8df3ce65fc1b service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:57.138380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cbba3-6792-4602-bd1f-8df3ce65fc1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:57.138832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6cbba3-6792-4602-bd1f-8df3ce65fc1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:57.155235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cbba3-6792-4602-bd1f-8df3ce65fc1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:57.167059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6cbba3-6792-4602-bd1f-8df3ce65fc1b service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:57.199426 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1174/2385] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:12:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:12:58.032931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fa05c-ab71-40fd-9a2d-b01e561fef3c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:58.034586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ed2fa05c-ab71-40fd-9a2d-b01e561fef3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:12:58.185186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fa05c-ab71-40fd-9a2d-b01e561fef3c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:58.192434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b53c0a-4ca0-4cd3-8710-28e859bb6314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:58.193369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b53c0a-4ca0-4cd3-8710-28e859bb6314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:58.193785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b53c0a-4ca0-4cd3-8710-28e859bb6314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:58.194074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b53c0a-4ca0-4cd3-8710-28e859bb6314 admin admin] PATH_INFO: `/v3/projects/42ae6454290d47d295bf0b0833de9a52` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:58.195371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b53c0a-4ca0-4cd3-8710-28e859bb6314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42ae6454290d47d295bf0b0833de9a52)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:58.199034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b53c0a-4ca0-4cd3-8710-28e859bb6314 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:58.202606 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:58.338974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f2b53c0a-4ca0-4cd3-8710-28e859bb6314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42ae6454290d47d295bf0b0833de9a52', 'request_id': 'req-f2b53c0a-4ca0-4cd3-8710-28e859bb6314'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:58.348908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f2b53c0a-4ca0-4cd3-8710-28e859bb6314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42ae6454290d47d295bf0b0833de9a52', 'request_id': 'req-f2b53c0a-4ca0-4cd3-8710-28e859bb6314'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:58.357134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f2b53c0a-4ca0-4cd3-8710-28e859bb6314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42ae6454290d47d295bf0b0833de9a52', 'request_id': 'req-f2b53c0a-4ca0-4cd3-8710-28e859bb6314'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:58.485332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f2b53c0a-4ca0-4cd3-8710-28e859bb6314 admin admin] The token cache is being invalidate because project 42ae6454290d47d295bf0b0833de9a52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:12:58.489182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f2b53c0a-4ca0-4cd3-8710-28e859bb6314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:58.497066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f2b53c0a-4ca0-4cd3-8710-28e859bb6314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:58.498492 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1212/2386] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:12:58 2022] DELETE /identity/v3/projects/42ae6454290d47d295bf0b0833de9a52 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:58.499013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cbba3-6792-4602-bd1f-8df3ce65fc1b service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:12:58.520203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6cbba3-6792-4602-bd1f-8df3ce65fc1b service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:12:58.634502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cdb94-851d-4bf6-81db-42bb8be1e72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:12:58.635729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cdb94-851d-4bf6-81db-42bb8be1e72a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:12:58.636164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cdb94-851d-4bf6-81db-42bb8be1e72a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:12:58.636625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918cdb94-851d-4bf6-81db-42bb8be1e72a admin admin] PATH_INFO: `/v3/users/e0eeb70015f241229c7eae5dbcecbd2c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:12:58.638373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cdb94-851d-4bf6-81db-42bb8be1e72a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0eeb70015f241229c7eae5dbcecbd2c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:12:58.640662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918cdb94-851d-4bf6-81db-42bb8be1e72a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:12:58.901294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-918cdb94-851d-4bf6-81db-42bb8be1e72a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0eeb70015f241229c7eae5dbcecbd2c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:58.917217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-918cdb94-851d-4bf6-81db-42bb8be1e72a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0eeb70015f241229c7eae5dbcecbd2c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:58.921427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-918cdb94-851d-4bf6-81db-42bb8be1e72a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0eeb70015f241229c7eae5dbcecbd2c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:58.921427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-918cdb94-851d-4bf6-81db-42bb8be1e72a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0eeb70015f241229c7eae5dbcecbd2c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:58.931148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-918cdb94-851d-4bf6-81db-42bb8be1e72a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0eeb70015f241229c7eae5dbcecbd2c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:12:59.007540 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1175/2387] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:12:58 2022] DELETE /identity/v3/users/e0eeb70015f241229c7eae5dbcecbd2c => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:12:59.171588 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:12:59.860246 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:00.613643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b53c0a-4ca0-4cd3-8710-28e859bb6314 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:00.618955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f2b53c0a-4ca0-4cd3-8710-28e859bb6314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:00.644205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b53c0a-4ca0-4cd3-8710-28e859bb6314 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:00.739617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cdb94-851d-4bf6-81db-42bb8be1e72a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:00.741067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-918cdb94-851d-4bf6-81db-42bb8be1e72a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:00.781680 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:00.830468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b5b51-34f6-49b9-927f-d4e5f50b7057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:00.832471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b5b51-34f6-49b9-927f-d4e5f50b7057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:00.833408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b5b51-34f6-49b9-927f-d4e5f50b7057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:00.834345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b5b51-34f6-49b9-927f-d4e5f50b7057 admin admin] PATH_INFO: `/v3/projects/4dbda44d0f6d46e5a9dfa163b9b5250f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:00.836726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b5b51-34f6-49b9-927f-d4e5f50b7057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dbda44d0f6d46e5a9dfa163b9b5250f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:00.839080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b5b51-34f6-49b9-927f-d4e5f50b7057 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:00.988201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918cdb94-851d-4bf6-81db-42bb8be1e72a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:01.012036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-173b5b51-34f6-49b9-927f-d4e5f50b7057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dbda44d0f6d46e5a9dfa163b9b5250f', 'request_id': 'req-173b5b51-34f6-49b9-927f-d4e5f50b7057'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:01.042996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-173b5b51-34f6-49b9-927f-d4e5f50b7057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dbda44d0f6d46e5a9dfa163b9b5250f', 'request_id': 'req-173b5b51-34f6-49b9-927f-d4e5f50b7057'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:01.071061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-173b5b51-34f6-49b9-927f-d4e5f50b7057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dbda44d0f6d46e5a9dfa163b9b5250f', 'request_id': 'req-173b5b51-34f6-49b9-927f-d4e5f50b7057'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:01.183284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-173b5b51-34f6-49b9-927f-d4e5f50b7057 admin admin] The token cache is being invalidate because project 4dbda44d0f6d46e5a9dfa163b9b5250f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:13:01.191590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-173b5b51-34f6-49b9-927f-d4e5f50b7057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:01.191590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-173b5b51-34f6-49b9-927f-d4e5f50b7057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:01.191590 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1213/2388] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:13:00 2022] DELETE /identity/v3/projects/4dbda44d0f6d46e5a9dfa163b9b5250f => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:01.196742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29b4fe-2ed4-4f56-ae0a-7a1859a2b986 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:01.197521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29b4fe-2ed4-4f56-ae0a-7a1859a2b986 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:01.198408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29b4fe-2ed4-4f56-ae0a-7a1859a2b986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:01.224704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758b1fe-8d53-4e04-9c4c-9076098206b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:01.234779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758b1fe-8d53-4e04-9c4c-9076098206b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:01.236849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758b1fe-8d53-4e04-9c4c-9076098206b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:01.238088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758b1fe-8d53-4e04-9c4c-9076098206b7 admin admin] PATH_INFO: `/v3/users/4004f1869cb549829f6eb58ace9ccf84` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:01.243462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758b1fe-8d53-4e04-9c4c-9076098206b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4004f1869cb549829f6eb58ace9ccf84)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:01.250378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8758b1fe-8d53-4e04-9c4c-9076098206b7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:01.281156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ae29b4fe-2ed4-4f56-ae0a-7a1859a2b986 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:01.290902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ae29b4fe-2ed4-4f56-ae0a-7a1859a2b986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:01.329239 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1214/2389] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:01.330785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df562a3d-693c-4023-97ec-63276131bd02 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:01.331071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df562a3d-693c-4023-97ec-63276131bd02 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:01.331353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df562a3d-693c-4023-97ec-63276131bd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:01.363129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-df562a3d-693c-4023-97ec-63276131bd02 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:01.364254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-df562a3d-693c-4023-97ec-63276131bd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:01.380287 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1215/2390] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:01.383875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df562a3d-693c-4023-97ec-63276131bd02 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:01.407060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df562a3d-693c-4023-97ec-63276131bd02 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:01.408591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c819afe-80d5-43f6-9e07-e290f3bdfe24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:01.409440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c819afe-80d5-43f6-9e07-e290f3bdfe24 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:01.409887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c819afe-80d5-43f6-9e07-e290f3bdfe24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:01.410359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c819afe-80d5-43f6-9e07-e290f3bdfe24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:01.411240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c819afe-80d5-43f6-9e07-e290f3bdfe24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:13:01.411698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c819afe-80d5-43f6-9e07-e290f3bdfe24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:01.413614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c819afe-80d5-43f6-9e07-e290f3bdfe24 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:01.435723 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1216/2391] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:13:01.448817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c819afe-80d5-43f6-9e07-e290f3bdfe24 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:01.470620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c819afe-80d5-43f6-9e07-e290f3bdfe24 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:01.484517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21432b-08ea-4277-b548-44edaa36b5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:01.485717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21432b-08ea-4277-b548-44edaa36b5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:01.486337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21432b-08ea-4277-b548-44edaa36b5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:01.486766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21432b-08ea-4277-b548-44edaa36b5e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:01.487830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21432b-08ea-4277-b548-44edaa36b5e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:01.489972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21432b-08ea-4277-b548-44edaa36b5e6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:01.608767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8758b1fe-8d53-4e04-9c4c-9076098206b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4004f1869cb549829f6eb58ace9ccf84'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:01.642914 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1217/2392] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:13:01 2022] POST /identity/v3/projects => generated 371 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:13:01.646965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21432b-08ea-4277-b548-44edaa36b5e6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:01.673154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8758b1fe-8d53-4e04-9c4c-9076098206b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4004f1869cb549829f6eb58ace9ccf84'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:01.674584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8758b1fe-8d53-4e04-9c4c-9076098206b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4004f1869cb549829f6eb58ace9ccf84'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:01.678130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8758b1fe-8d53-4e04-9c4c-9076098206b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4004f1869cb549829f6eb58ace9ccf84'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:01.702499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8758b1fe-8d53-4e04-9c4c-9076098206b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4004f1869cb549829f6eb58ace9ccf84'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:01.828377 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1176/2393] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:13:00 2022] DELETE /identity/v3/users/4004f1869cb549829f6eb58ace9ccf84 => generated 0 bytes in 1087 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:01.830254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a3294-66b4-4581-850d-5308557fbf39 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:01.830664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a3294-66b4-4581-850d-5308557fbf39 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:01.831017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a3294-66b4-4581-850d-5308557fbf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:01.903637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-555a3294-66b4-4581-850d-5308557fbf39 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:01.905160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21432b-08ea-4277-b548-44edaa36b5e6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:01.922877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-555a3294-66b4-4581-850d-5308557fbf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:02.092025 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1177/2394] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:02.103233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febeb85-fbe0-4915-9bd9-092ffefbcab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:02.104056 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febeb85-fbe0-4915-9bd9-092ffefbcab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:02.104440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febeb85-fbe0-4915-9bd9-092ffefbcab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:02.105048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4febeb85-fbe0-4915-9bd9-092ffefbcab0 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:02.106503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febeb85-fbe0-4915-9bd9-092ffefbcab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:02.108827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4febeb85-fbe0-4915-9bd9-092ffefbcab0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:02.196009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a3294-66b4-4581-850d-5308557fbf39 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:02.198718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-555a3294-66b4-4581-850d-5308557fbf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:02.235723 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1218/2395] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:13:01 2022] POST /identity/v3/users => generated 286 bytes in 589 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:13:02.253064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febeb85-fbe0-4915-9bd9-092ffefbcab0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:02.266628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4febeb85-fbe0-4915-9bd9-092ffefbcab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:02.332280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4febeb85-fbe0-4915-9bd9-092ffefbcab0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:02.359064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0929d-d6e4-45a4-9f54-b2028ddda57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:02.360648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0929d-d6e4-45a4-9f54-b2028ddda57f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:02.360648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0929d-d6e4-45a4-9f54-b2028ddda57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:02.361440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0929d-d6e4-45a4-9f54-b2028ddda57f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:02.362761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0929d-d6e4-45a4-9f54-b2028ddda57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:02.370177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0929d-d6e4-45a4-9f54-b2028ddda57f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:02.394892 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1219/2396] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:13:02.400877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0929d-d6e4-45a4-9f54-b2028ddda57f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:02.411629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a3294-66b4-4581-850d-5308557fbf39 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:02.419960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0929d-d6e4-45a4-9f54-b2028ddda57f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:02.423613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bd2a2-2089-4e2e-bdb4-cb62f9a21b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:02.424901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bd2a2-2089-4e2e-bdb4-cb62f9a21b44 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:02.425195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bd2a2-2089-4e2e-bdb4-cb62f9a21b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:02.425474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bd2a2-2089-4e2e-bdb4-cb62f9a21b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:02.437321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214d25f-3318-4757-8bce-c8483590e5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:02.438011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214d25f-3318-4757-8bce-c8483590e5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:02.438386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214d25f-3318-4757-8bce-c8483590e5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:02.438597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214d25f-3318-4757-8bce-c8483590e5e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:02.439382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214d25f-3318-4757-8bce-c8483590e5e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:02.447388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214d25f-3318-4757-8bce-c8483590e5e7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:02.447904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39bd2a2-2089-4e2e-bdb4-cb62f9a21b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:02.449335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39bd2a2-2089-4e2e-bdb4-cb62f9a21b44 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:02.452313 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:02.472469 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1220/2397] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:13:02.478038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214d25f-3318-4757-8bce-c8483590e5e7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:02.487622 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1178/2398] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:13:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:13:02.501209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214d25f-3318-4757-8bce-c8483590e5e7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:02.508016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27da6f-eb54-47d4-8b13-4476499bff74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:02.509465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27da6f-eb54-47d4-8b13-4476499bff74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:02.509967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27da6f-eb54-47d4-8b13-4476499bff74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:02.510457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27da6f-eb54-47d4-8b13-4476499bff74 admin admin] PATH_INFO: `/v3/projects/11a82861352344d88711f6ad4c6b9ae2/users/2116bccae1db480d88592885da9a43cd/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:02.534233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27da6f-eb54-47d4-8b13-4476499bff74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a82861352344d88711f6ad4c6b9ae2, user_id=2116bccae1db480d88592885da9a43cd, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:02.537397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27da6f-eb54-47d4-8b13-4476499bff74 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:02.619687 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1221/2399] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:13:02 2022] PUT /identity/v3/projects/11a82861352344d88711f6ad4c6b9ae2/users/2116bccae1db480d88592885da9a43cd/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:02.629841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c93c50-3021-4f2b-a111-52a52671c561 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:02.632276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c93c50-3021-4f2b-a111-52a52671c561 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:02.632594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c93c50-3021-4f2b-a111-52a52671c561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:02.707072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d7c93c50-3021-4f2b-a111-52a52671c561 None None] MFA Rules not processed for user `2116bccae1db480d88592885da9a43cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:02.722199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d7c93c50-3021-4f2b-a111-52a52671c561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:02.879958 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1179/2400] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:03.279552 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:03.644591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27da6f-eb54-47d4-8b13-4476499bff74 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:03.646560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4f27da6f-eb54-47d4-8b13-4476499bff74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:03.719017 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=81,keystone:INSERT=2,keystone:DELETE=17 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:03.796576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27da6f-eb54-47d4-8b13-4476499bff74 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:03.807347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a487a1b-3545-4996-97d1-88cce23b9985 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:03.808428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a487a1b-3545-4996-97d1-88cce23b9985 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:03.808951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a487a1b-3545-4996-97d1-88cce23b9985 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:03.811193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a487a1b-3545-4996-97d1-88cce23b9985 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:03.825258 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a487a1b-3545-4996-97d1-88cce23b9985 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:03.828661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a487a1b-3545-4996-97d1-88cce23b9985 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:03.846898 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1222/2401] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:13:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:13:04.532276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c93c50-3021-4f2b-a111-52a52671c561 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:04.533816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d7c93c50-3021-4f2b-a111-52a52671c561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:04.645112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c93c50-3021-4f2b-a111-52a52671c561 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:04.653808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec550134-ccc3-439f-9fcb-15ca38da35d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:04.654978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec550134-ccc3-439f-9fcb-15ca38da35d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:04.655430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec550134-ccc3-439f-9fcb-15ca38da35d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:04.656001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec550134-ccc3-439f-9fcb-15ca38da35d9 admin admin] PATH_INFO: `/v3/projects/522c9817878c450283b4233e5a57652d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:04.658130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec550134-ccc3-439f-9fcb-15ca38da35d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=522c9817878c450283b4233e5a57652d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:04.660839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec550134-ccc3-439f-9fcb-15ca38da35d9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:04.809313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec550134-ccc3-439f-9fcb-15ca38da35d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '522c9817878c450283b4233e5a57652d', 'request_id': 'req-ec550134-ccc3-439f-9fcb-15ca38da35d9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:04.851031 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:04.888512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec550134-ccc3-439f-9fcb-15ca38da35d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '522c9817878c450283b4233e5a57652d', 'request_id': 'req-ec550134-ccc3-439f-9fcb-15ca38da35d9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:04.923833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec550134-ccc3-439f-9fcb-15ca38da35d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '522c9817878c450283b4233e5a57652d', 'request_id': 'req-ec550134-ccc3-439f-9fcb-15ca38da35d9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:04.976967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec550134-ccc3-439f-9fcb-15ca38da35d9 admin admin] The token cache is being invalidate because project 522c9817878c450283b4233e5a57652d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:13:04.978136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec550134-ccc3-439f-9fcb-15ca38da35d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:04.979227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec550134-ccc3-439f-9fcb-15ca38da35d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:04.982902 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1180/2402] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:13:04 2022] DELETE /identity/v3/projects/522c9817878c450283b4233e5a57652d => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:04.994616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a487a1b-3545-4996-97d1-88cce23b9985 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:05.011971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a487a1b-3545-4996-97d1-88cce23b9985 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:05.157482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37950c-115c-4f47-8788-64c3050de3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:05.161347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37950c-115c-4f47-8788-64c3050de3bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:05.161808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37950c-115c-4f47-8788-64c3050de3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:05.162411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37950c-115c-4f47-8788-64c3050de3bb admin admin] PATH_INFO: `/v3/users/8a3836b1217543e1b5db978451e72aa7` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:05.169104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37950c-115c-4f47-8788-64c3050de3bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a3836b1217543e1b5db978451e72aa7)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:05.171696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37950c-115c-4f47-8788-64c3050de3bb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:05.183040 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:05.452996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ff37950c-115c-4f47-8788-64c3050de3bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a3836b1217543e1b5db978451e72aa7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:05.505321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ff37950c-115c-4f47-8788-64c3050de3bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a3836b1217543e1b5db978451e72aa7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:05.525720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ff37950c-115c-4f47-8788-64c3050de3bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a3836b1217543e1b5db978451e72aa7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:05.527612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ff37950c-115c-4f47-8788-64c3050de3bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a3836b1217543e1b5db978451e72aa7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:05.669655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ff37950c-115c-4f47-8788-64c3050de3bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a3836b1217543e1b5db978451e72aa7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:05.688934 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1223/2403] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:13:04 2022] DELETE /identity/v3/users/8a3836b1217543e1b5db978451e72aa7 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:05.829834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec550134-ccc3-439f-9fcb-15ca38da35d9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:05.831386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ec550134-ccc3-439f-9fcb-15ca38da35d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:05.853058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec550134-ccc3-439f-9fcb-15ca38da35d9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:05.936253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb39de-6d36-41fd-ae7e-998867ad8593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:05.937491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb39de-6d36-41fd-ae7e-998867ad8593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:05.937925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb39de-6d36-41fd-ae7e-998867ad8593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:05.938620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cb39de-6d36-41fd-ae7e-998867ad8593 admin admin] PATH_INFO: `/v3/users/2116bccae1db480d88592885da9a43cd` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:05.940342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb39de-6d36-41fd-ae7e-998867ad8593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2116bccae1db480d88592885da9a43cd)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:05.942827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cb39de-6d36-41fd-ae7e-998867ad8593 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:06.245974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f5cb39de-6d36-41fd-ae7e-998867ad8593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2116bccae1db480d88592885da9a43cd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:06.262158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f5cb39de-6d36-41fd-ae7e-998867ad8593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2116bccae1db480d88592885da9a43cd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:06.263398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f5cb39de-6d36-41fd-ae7e-998867ad8593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2116bccae1db480d88592885da9a43cd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:06.264188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f5cb39de-6d36-41fd-ae7e-998867ad8593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2116bccae1db480d88592885da9a43cd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:06.288928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f5cb39de-6d36-41fd-ae7e-998867ad8593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2116bccae1db480d88592885da9a43cd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:06.422338 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1181/2404] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:13:05 2022] DELETE /identity/v3/users/2116bccae1db480d88592885da9a43cd => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:06.426885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb78e1-06de-4899-a2c8-b89ab8482c51 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:06.427726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb78e1-06de-4899-a2c8-b89ab8482c51 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:06.428208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb78e1-06de-4899-a2c8-b89ab8482c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:06.460963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4acb78e1-06de-4899-a2c8-b89ab8482c51 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:06.462675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4acb78e1-06de-4899-a2c8-b89ab8482c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:06.608084 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1224/2405] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:06.632060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb39de-6d36-41fd-ae7e-998867ad8593 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:06.633664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f5cb39de-6d36-41fd-ae7e-998867ad8593 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:06.697224 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:06.730277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cb39de-6d36-41fd-ae7e-998867ad8593 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:06.744613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118a5753-a8e8-4dca-ae03-4632160302ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:06.745314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a5753-a8e8-4dca-ae03-4632160302ad service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:06.745602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a5753-a8e8-4dca-ae03-4632160302ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:06.745885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118a5753-a8e8-4dca-ae03-4632160302ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:06.775850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a5753-a8e8-4dca-ae03-4632160302ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:06.777314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118a5753-a8e8-4dca-ae03-4632160302ad service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:06.795799 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1182/2406] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:13:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:13:07.162605 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:07.298488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb78e1-06de-4899-a2c8-b89ab8482c51 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:07.300854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4acb78e1-06de-4899-a2c8-b89ab8482c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:07.323438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb78e1-06de-4899-a2c8-b89ab8482c51 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:07.341611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae33b36-c1b8-44af-b549-5258ccf70394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:07.346474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae33b36-c1b8-44af-b549-5258ccf70394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:07.360695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae33b36-c1b8-44af-b549-5258ccf70394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:07.367064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae33b36-c1b8-44af-b549-5258ccf70394 admin admin] PATH_INFO: `/v3/projects/2f4a5ba44a504430981182763ee97d4e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:07.377850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae33b36-c1b8-44af-b549-5258ccf70394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f4a5ba44a504430981182763ee97d4e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:07.386172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae33b36-c1b8-44af-b549-5258ccf70394 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:07.574818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9ae33b36-c1b8-44af-b549-5258ccf70394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f4a5ba44a504430981182763ee97d4e', 'request_id': 'req-9ae33b36-c1b8-44af-b549-5258ccf70394'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:07.588301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9ae33b36-c1b8-44af-b549-5258ccf70394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f4a5ba44a504430981182763ee97d4e', 'request_id': 'req-9ae33b36-c1b8-44af-b549-5258ccf70394'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:07.622006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9ae33b36-c1b8-44af-b549-5258ccf70394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f4a5ba44a504430981182763ee97d4e', 'request_id': 'req-9ae33b36-c1b8-44af-b549-5258ccf70394'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:07.705067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9ae33b36-c1b8-44af-b549-5258ccf70394 admin admin] The token cache is being invalidate because project 2f4a5ba44a504430981182763ee97d4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:13:07.705363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9ae33b36-c1b8-44af-b549-5258ccf70394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:07.707398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9ae33b36-c1b8-44af-b549-5258ccf70394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:07.713727 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1225/2407] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:13:07 2022] DELETE /identity/v3/projects/2f4a5ba44a504430981182763ee97d4e => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:07.715239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d80889-040b-49a9-9f69-a1eb2605afea None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:07.715691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d80889-040b-49a9-9f69-a1eb2605afea None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:07.715797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d80889-040b-49a9-9f69-a1eb2605afea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:07.754378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a8d80889-040b-49a9-9f69-a1eb2605afea None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:07.755592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a8d80889-040b-49a9-9f69-a1eb2605afea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:07.892376 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1183/2408] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:13:07.900885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c92a18-764a-4133-ad7e-3c991f18bbcb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:07.901173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c92a18-764a-4133-ad7e-3c991f18bbcb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:07.901452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c92a18-764a-4133-ad7e-3c991f18bbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:07.953851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-26c92a18-764a-4133-ad7e-3c991f18bbcb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:07.959485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-26c92a18-764a-4133-ad7e-3c991f18bbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:07.994556 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1226/2409] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:07.996261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d80889-040b-49a9-9f69-a1eb2605afea None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:08.006321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d80889-040b-49a9-9f69-a1eb2605afea None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:08.023578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c5b62-509c-4fa1-bbdd-f9a6911d8d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:08.024404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c5b62-509c-4fa1-bbdd-f9a6911d8d01 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:08.024902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c5b62-509c-4fa1-bbdd-f9a6911d8d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:08.025015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c5b62-509c-4fa1-bbdd-f9a6911d8d01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:08.025778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c5b62-509c-4fa1-bbdd-f9a6911d8d01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:13:08.026090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c5b62-509c-4fa1-bbdd-f9a6911d8d01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:08.027782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c5b62-509c-4fa1-bbdd-f9a6911d8d01 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:08.060445 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1184/2410] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:13:08.062638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c92a18-764a-4133-ad7e-3c991f18bbcb None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:08.074530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c92a18-764a-4133-ad7e-3c991f18bbcb None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:08.093579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895b280-6d72-4efe-b85f-c68057c00b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:08.094478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895b280-6d72-4efe-b85f-c68057c00b07 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:08.095211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895b280-6d72-4efe-b85f-c68057c00b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:08.095640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0895b280-6d72-4efe-b85f-c68057c00b07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:08.096516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895b280-6d72-4efe-b85f-c68057c00b07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:08.100041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0895b280-6d72-4efe-b85f-c68057c00b07 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:08.267674 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1227/2411] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:13:08 2022] POST /identity/v3/projects => generated 373 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:13:08.273093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c5b62-509c-4fa1-bbdd-f9a6911d8d01 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:08.293188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c5b62-509c-4fa1-bbdd-f9a6911d8d01 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:08.295800 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:08.368128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616ea1e-70b5-4c86-8bb8-e31ef6d771b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:08.368836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616ea1e-70b5-4c86-8bb8-e31ef6d771b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:08.369118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616ea1e-70b5-4c86-8bb8-e31ef6d771b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:08.369482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616ea1e-70b5-4c86-8bb8-e31ef6d771b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:08.371475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616ea1e-70b5-4c86-8bb8-e31ef6d771b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:08.377979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616ea1e-70b5-4c86-8bb8-e31ef6d771b4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:08.521508 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:08.534858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895b280-6d72-4efe-b85f-c68057c00b07 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:08.543649 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1185/2412] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:13:08 2022] POST /identity/v3/users => generated 287 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:13:08.546304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0895b280-6d72-4efe-b85f-c68057c00b07 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:08.556082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18ba15-f6b5-44c0-8b0b-36128b52ef66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:08.556222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18ba15-f6b5-44c0-8b0b-36128b52ef66 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:08.556392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18ba15-f6b5-44c0-8b0b-36128b52ef66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:08.556666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad18ba15-f6b5-44c0-8b0b-36128b52ef66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:08.557431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18ba15-f6b5-44c0-8b0b-36128b52ef66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:08.559082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad18ba15-f6b5-44c0-8b0b-36128b52ef66 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:08.595155 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1228/2413] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:13:08.600466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616ea1e-70b5-4c86-8bb8-e31ef6d771b4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:08.620195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616ea1e-70b5-4c86-8bb8-e31ef6d771b4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:08.637841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b802e3c-231d-406e-8594-3fdfe632f2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:08.638567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b802e3c-231d-406e-8594-3fdfe632f2fe admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:08.638855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b802e3c-231d-406e-8594-3fdfe632f2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:08.639137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b802e3c-231d-406e-8594-3fdfe632f2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:08.639886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b802e3c-231d-406e-8594-3fdfe632f2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:08.642500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b802e3c-231d-406e-8594-3fdfe632f2fe admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:08.677634 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1186/2414] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:13:08.677745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18ba15-f6b5-44c0-8b0b-36128b52ef66 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:08.691079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad18ba15-f6b5-44c0-8b0b-36128b52ef66 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:08.701845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b3c28-69a3-4333-a0a0-b104e48fe7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:08.705449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b3c28-69a3-4333-a0a0-b104e48fe7ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:08.707602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b3c28-69a3-4333-a0a0-b104e48fe7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:08.708071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b3c28-69a3-4333-a0a0-b104e48fe7ae admin admin] PATH_INFO: `/v3/projects/64f12cb399a34236b3cae4b3482d1942/users/2e9b9e62aa2f43d29581d5822599b5cf/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:08.760421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b3c28-69a3-4333-a0a0-b104e48fe7ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=64f12cb399a34236b3cae4b3482d1942, user_id=2e9b9e62aa2f43d29581d5822599b5cf, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:08.767988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b3c28-69a3-4333-a0a0-b104e48fe7ae admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:08.861220 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1229/2415] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:13:08 2022] PUT /identity/v3/projects/64f12cb399a34236b3cae4b3482d1942/users/2e9b9e62aa2f43d29581d5822599b5cf/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:08.873257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9591d-d6ec-44be-bc38-7ad3ee10fc8d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:08.873761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9591d-d6ec-44be-bc38-7ad3ee10fc8d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:08.873862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9591d-d6ec-44be-bc38-7ad3ee10fc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:08.945225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-35a9591d-d6ec-44be-bc38-7ad3ee10fc8d None None] MFA Rules not processed for user `2e9b9e62aa2f43d29581d5822599b5cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:08.947480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-35a9591d-d6ec-44be-bc38-7ad3ee10fc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:09.170831 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1187/2416] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:09.175018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b3c28-69a3-4333-a0a0-b104e48fe7ae admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:09.350242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b3c28-69a3-4333-a0a0-b104e48fe7ae admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:09.363688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63800e0a-c6b3-47c7-ae56-3a0cc835f211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:09.364163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63800e0a-c6b3-47c7-ae56-3a0cc835f211 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:09.366304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63800e0a-c6b3-47c7-ae56-3a0cc835f211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:09.366659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63800e0a-c6b3-47c7-ae56-3a0cc835f211 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:09.369492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63800e0a-c6b3-47c7-ae56-3a0cc835f211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:09.374307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63800e0a-c6b3-47c7-ae56-3a0cc835f211 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:09.474632 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1230/2417] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:13:09 2022] POST /identity/v3/projects => generated 373 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:13:09.475786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9591d-d6ec-44be-bc38-7ad3ee10fc8d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:09.499577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9591d-d6ec-44be-bc38-7ad3ee10fc8d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:09.531453 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:09.576973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd492fc2-f0c5-4611-9c33-12bd40be26d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:09.577716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd492fc2-f0c5-4611-9c33-12bd40be26d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:09.577977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd492fc2-f0c5-4611-9c33-12bd40be26d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:09.578299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd492fc2-f0c5-4611-9c33-12bd40be26d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:09.578999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd492fc2-f0c5-4611-9c33-12bd40be26d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:09.581391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd492fc2-f0c5-4611-9c33-12bd40be26d1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:09.720660 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1188/2418] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:13:09 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:13:09.724357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63800e0a-c6b3-47c7-ae56-3a0cc835f211 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:09.746184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63800e0a-c6b3-47c7-ae56-3a0cc835f211 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:09.758645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47d7ec-96c3-4369-a56f-68a512b6e965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:09.759616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47d7ec-96c3-4369-a56f-68a512b6e965 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:09.760062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47d7ec-96c3-4369-a56f-68a512b6e965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:09.760534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47d7ec-96c3-4369-a56f-68a512b6e965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:09.761518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47d7ec-96c3-4369-a56f-68a512b6e965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:09.764857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47d7ec-96c3-4369-a56f-68a512b6e965 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:09.785948 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1231/2419] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:13:09.791863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd492fc2-f0c5-4611-9c33-12bd40be26d1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:09.815760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd492fc2-f0c5-4611-9c33-12bd40be26d1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:09.831774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f524d-4249-4b62-b213-44aded787f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:09.834194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f524d-4249-4b62-b213-44aded787f44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:09.835327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f524d-4249-4b62-b213-44aded787f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:09.838856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f524d-4249-4b62-b213-44aded787f44 admin admin] PATH_INFO: `/v3/projects/104876b9b057407d862898659d93f7fb/users/6c8640fec67a4141a34c318733ecbb26/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:09.880147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f524d-4249-4b62-b213-44aded787f44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=104876b9b057407d862898659d93f7fb, user_id=6c8640fec67a4141a34c318733ecbb26, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:09.890721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f524d-4249-4b62-b213-44aded787f44 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:10.001177 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1189/2420] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:13:09 2022] PUT /identity/v3/projects/104876b9b057407d862898659d93f7fb/users/6c8640fec67a4141a34c318733ecbb26/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:10.005220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47d7ec-96c3-4369-a56f-68a512b6e965 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:10.030031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47d7ec-96c3-4369-a56f-68a512b6e965 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:10.042336 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:10.103915 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:10.144063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f524d-4249-4b62-b213-44aded787f44 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:10.156591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e55f524d-4249-4b62-b213-44aded787f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:10.235710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07241b66-9bbe-4643-b983-6837b29d9bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:10.236698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07241b66-9bbe-4643-b983-6837b29d9bdd admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:10.240986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07241b66-9bbe-4643-b983-6837b29d9bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:10.241558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07241b66-9bbe-4643-b983-6837b29d9bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:10.244468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07241b66-9bbe-4643-b983-6837b29d9bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:10.250223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07241b66-9bbe-4643-b983-6837b29d9bdd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:10.276682 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1232/2421] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:13:10.279126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07241b66-9bbe-4643-b983-6837b29d9bdd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:10.311066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07241b66-9bbe-4643-b983-6837b29d9bdd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:10.325296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2ed5e-8129-465e-9d82-8110f65ab5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:10.326854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2ed5e-8129-465e-9d82-8110f65ab5e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:10.328851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2ed5e-8129-465e-9d82-8110f65ab5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:10.331162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2ed5e-8129-465e-9d82-8110f65ab5e9 admin admin] PATH_INFO: `/v3/projects/104876b9b057407d862898659d93f7fb/users/6c8640fec67a4141a34c318733ecbb26/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:10.338363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2ed5e-8129-465e-9d82-8110f65ab5e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=104876b9b057407d862898659d93f7fb, user_id=6c8640fec67a4141a34c318733ecbb26, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:10.342249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f524d-4249-4b62-b213-44aded787f44 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:10.343448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2ed5e-8129-465e-9d82-8110f65ab5e9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:10.370026 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1233/2422] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:13:10 2022] PUT /identity/v3/projects/104876b9b057407d862898659d93f7fb/users/6c8640fec67a4141a34c318733ecbb26/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:10.372556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8fb7e-36ee-464b-b9dc-06045db6c1ca None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:10.372556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8fb7e-36ee-464b-b9dc-06045db6c1ca None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:10.372556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8fb7e-36ee-464b-b9dc-06045db6c1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:10.381111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe7672-cbe7-44d2-9e6e-45305324aa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:10.383894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe7672-cbe7-44d2-9e6e-45305324aa55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:10.384227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe7672-cbe7-44d2-9e6e-45305324aa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:10.384569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe7672-cbe7-44d2-9e6e-45305324aa55 admin admin] PATH_INFO: `/v3/projects/11a82861352344d88711f6ad4c6b9ae2` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:10.399996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe7672-cbe7-44d2-9e6e-45305324aa55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11a82861352344d88711f6ad4c6b9ae2)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:10.403875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fe7672-cbe7-44d2-9e6e-45305324aa55 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:10.429278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f5a8fb7e-36ee-464b-b9dc-06045db6c1ca None None] MFA Rules not processed for user `6c8640fec67a4141a34c318733ecbb26`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:10.431398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f5a8fb7e-36ee-464b-b9dc-06045db6c1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:10.552694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-40fe7672-cbe7-44d2-9e6e-45305324aa55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11a82861352344d88711f6ad4c6b9ae2', 'request_id': 'req-40fe7672-cbe7-44d2-9e6e-45305324aa55'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:10.636390 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1234/2423] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:10.642260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8fb7e-36ee-464b-b9dc-06045db6c1ca None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:10.651840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-40fe7672-cbe7-44d2-9e6e-45305324aa55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11a82861352344d88711f6ad4c6b9ae2', 'request_id': 'req-40fe7672-cbe7-44d2-9e6e-45305324aa55'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:10.666223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-40fe7672-cbe7-44d2-9e6e-45305324aa55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11a82861352344d88711f6ad4c6b9ae2', 'request_id': 'req-40fe7672-cbe7-44d2-9e6e-45305324aa55'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:10.697722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8fb7e-36ee-464b-b9dc-06045db6c1ca None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:10.735279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-40fe7672-cbe7-44d2-9e6e-45305324aa55 admin admin] The token cache is being invalidate because project 11a82861352344d88711f6ad4c6b9ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:13:10.735662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-40fe7672-cbe7-44d2-9e6e-45305324aa55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:10.746201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-40fe7672-cbe7-44d2-9e6e-45305324aa55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:10.749414 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1190/2424] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:13:10 2022] DELETE /identity/v3/projects/11a82861352344d88711f6ad4c6b9ae2 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:13:10.754521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc5e0f-e54d-4785-a029-4218af652ecc None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:10.755230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc5e0f-e54d-4785-a029-4218af652ecc None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:10.755580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc5e0f-e54d-4785-a029-4218af652ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:10.784835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a9bc5e0f-e54d-4785-a029-4218af652ecc None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:10.786429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a9bc5e0f-e54d-4785-a029-4218af652ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:10.887087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7046de0-24f5-4d17-9eaf-20b5b4715ebf tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8640fec67a4141a34c318733ecbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '104876b9b057407d862898659d93f7fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:10.888487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7046de0-24f5-4d17-9eaf-20b5b4715ebf tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:10.888487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7046de0-24f5-4d17-9eaf-20b5b4715ebf tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:10.888487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7046de0-24f5-4d17-9eaf-20b5b4715ebf tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:10.889371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7046de0-24f5-4d17-9eaf-20b5b4715ebf tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:13:10.889783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7046de0-24f5-4d17-9eaf-20b5b4715ebf tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:10.892098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7046de0-24f5-4d17-9eaf-20b5b4715ebf tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:10.931112 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1235/2425] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:13:10.933311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7046de0-24f5-4d17-9eaf-20b5b4715ebf tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:10.946958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b7046de0-24f5-4d17-9eaf-20b5b4715ebf tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:10.983431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7046de0-24f5-4d17-9eaf-20b5b4715ebf tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:10.997548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa699d0-7266-4f03-9723-c0a75e7f0112 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8640fec67a4141a34c318733ecbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '104876b9b057407d862898659d93f7fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:10.998556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa699d0-7266-4f03-9723-c0a75e7f0112 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:10.999052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa699d0-7266-4f03-9723-c0a75e7f0112 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:10.999444 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1191/2426] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:11.000981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa699d0-7266-4f03-9723-c0a75e7f0112 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:11.001816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa699d0-7266-4f03-9723-c0a75e7f0112 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:11.005734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa699d0-7266-4f03-9723-c0a75e7f0112 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:11.012355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc9968-6b68-4650-a681-a7dba5f0f0cf None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:11.012648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc9968-6b68-4650-a681-a7dba5f0f0cf None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:11.012983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc9968-6b68-4650-a681-a7dba5f0f0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:11.046672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-25dc9968-6b68-4650-a681-a7dba5f0f0cf None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:11.070833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-25dc9968-6b68-4650-a681-a7dba5f0f0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:11.111219 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1192/2427] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:11.116792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc9968-6b68-4650-a681-a7dba5f0f0cf None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:11.176409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc9968-6b68-4650-a681-a7dba5f0f0cf None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:11.183313 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1236/2428] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:13:10 2022] POST /identity/v3/projects => generated 369 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:13:11.185187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc340a-a7ea-4221-820a-c107565becb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:11.187087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa699d0-7266-4f03-9723-c0a75e7f0112 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:11.188052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc340a-a7ea-4221-820a-c107565becb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:11.188593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc340a-a7ea-4221-820a-c107565becb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:11.189044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc340a-a7ea-4221-820a-c107565becb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:11.190165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc340a-a7ea-4221-820a-c107565becb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:13:11.190630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc340a-a7ea-4221-820a-c107565becb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:11.192782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc340a-a7ea-4221-820a-c107565becb2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:11.225984 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1193/2429] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:13:11.230526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc340a-a7ea-4221-820a-c107565becb2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:11.246880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc340a-a7ea-4221-820a-c107565becb2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:11.384808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa699d0-7266-4f03-9723-c0a75e7f0112 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:11.401327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08ed0c-4774-437b-bb65-12b23539f1f9 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8640fec67a4141a34c318733ecbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '104876b9b057407d862898659d93f7fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:11.402204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08ed0c-4774-437b-bb65-12b23539f1f9 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:11.402561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08ed0c-4774-437b-bb65-12b23539f1f9 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:11.402898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08ed0c-4774-437b-bb65-12b23539f1f9 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:11.403752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08ed0c-4774-437b-bb65-12b23539f1f9 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:13:11.404112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08ed0c-4774-437b-bb65-12b23539f1f9 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:11.405804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08ed0c-4774-437b-bb65-12b23539f1f9 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:11.432311 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1237/2430] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:13:11.439878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7da6c-623d-4a98-944c-4d406e6fc87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:11.440584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7da6c-623d-4a98-944c-4d406e6fc87c admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:11.440874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7da6c-623d-4a98-944c-4d406e6fc87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:11.441181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7da6c-623d-4a98-944c-4d406e6fc87c admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:11.441876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7da6c-623d-4a98-944c-4d406e6fc87c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:11.447735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08ed0c-4774-437b-bb65-12b23539f1f9 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:11.450085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2a08ed0c-4774-437b-bb65-12b23539f1f9 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:11.450485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7da6c-623d-4a98-944c-4d406e6fc87c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:11.458209 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:11.496105 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:11.592450 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1194/2431] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:13:11 2022] POST /identity/v3/projects => generated 385 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:13:11.593458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7da6c-623d-4a98-944c-4d406e6fc87c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:11.632209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08ed0c-4774-437b-bb65-12b23539f1f9 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:11.765411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7da6c-623d-4a98-944c-4d406e6fc87c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:11.780321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a88374-e458-4a6e-8840-a99a12deca26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:11.784027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a88374-e458-4a6e-8840-a99a12deca26 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:11.784785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a88374-e458-4a6e-8840-a99a12deca26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:11.785081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a88374-e458-4a6e-8840-a99a12deca26 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:11.787107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a88374-e458-4a6e-8840-a99a12deca26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:11.792738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a88374-e458-4a6e-8840-a99a12deca26 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:11.807421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce9208-8a91-4042-ba2c-75b9123b5629 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:11.807891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce9208-8a91-4042-ba2c-75b9123b5629 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:11.809460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce9208-8a91-4042-ba2c-75b9123b5629 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:11.809731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce9208-8a91-4042-ba2c-75b9123b5629 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:11.900089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce9208-8a91-4042-ba2c-75b9123b5629 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:11.901862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce9208-8a91-4042-ba2c-75b9123b5629 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:11.918582 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1195/2432] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:13:11 2022] POST /identity/v3/users => generated 293 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:13:11.923902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab628160-95d7-463f-ba88-751c937a7c73 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:11.924439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab628160-95d7-463f-ba88-751c937a7c73 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:11.924990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab628160-95d7-463f-ba88-751c937a7c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:11.943081 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1238/2433] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:13:11 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:13:11.944318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce9208-8a91-4042-ba2c-75b9123b5629 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:11.971099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce9208-8a91-4042-ba2c-75b9123b5629 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:11.981346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ab628160-95d7-463f-ba88-751c937a7c73 None None] MFA Rules not processed for user `ae588eb37afa4e638714e97c1a42d395`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:11.982629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ab628160-95d7-463f-ba88-751c937a7c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:11.987634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead4764e-407b-4d4f-970e-8d57828a4bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:11.988624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4764e-407b-4d4f-970e-8d57828a4bdf admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:11.989259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4764e-407b-4d4f-970e-8d57828a4bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:11.989770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead4764e-407b-4d4f-970e-8d57828a4bdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:11.990758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4764e-407b-4d4f-970e-8d57828a4bdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:11.992960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead4764e-407b-4d4f-970e-8d57828a4bdf admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:12.005271 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1239/2434] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:13:12.007685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac64f58-862a-4680-96dd-24db62c7055b None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:12.007685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac64f58-862a-4680-96dd-24db62c7055b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:12.009127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac64f58-862a-4680-96dd-24db62c7055b None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:12.011057 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1240/2435] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:13:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:13:12.012115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac64f58-862a-4680-96dd-24db62c7055b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:12.027423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac64f58-862a-4680-96dd-24db62c7055b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:12.035160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacff3d-cc2e-4cb4-a6fa-a1c82d54300f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:12.036189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacff3d-cc2e-4cb4-a6fa-a1c82d54300f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:12.042661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacff3d-cc2e-4cb4-a6fa-a1c82d54300f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:12.042952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceacff3d-cc2e-4cb4-a6fa-a1c82d54300f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:12.043748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacff3d-cc2e-4cb4-a6fa-a1c82d54300f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:12.046020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceacff3d-cc2e-4cb4-a6fa-a1c82d54300f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:12.072175 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1241/2436] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:13:12.074005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacff3d-cc2e-4cb4-a6fa-a1c82d54300f admin admin] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:13:12.115543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacff3d-cc2e-4cb4-a6fa-a1c82d54300f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:12.140283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceacff3d-cc2e-4cb4-a6fa-a1c82d54300f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:12.145360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dee1e4-f674-4e78-9528-7bd1c55d2527 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8640fec67a4141a34c318733ecbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '104876b9b057407d862898659d93f7fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:12.146281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dee1e4-f674-4e78-9528-7bd1c55d2527 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:12.146568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dee1e4-f674-4e78-9528-7bd1c55d2527 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:12.146843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dee1e4-f674-4e78-9528-7bd1c55d2527 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] PATH_INFO: `/v3/projects/0272304eb14143d691fdc5bb9a7c4717` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:12.151010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dee1e4-f674-4e78-9528-7bd1c55d2527 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorizing `identity:get_project(project_id=0272304eb14143d691fdc5bb9a7c4717)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:12.153214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dee1e4-f674-4e78-9528-7bd1c55d2527 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:12.155113 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1242/2437] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:13:12 2022] GET /identity/v3/projects/0272304eb14143d691fdc5bb9a7c4717 => generated 369 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:13:12.155877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dee1e4-f674-4e78-9528-7bd1c55d2527 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:12.183422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dee1e4-f674-4e78-9528-7bd1c55d2527 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:12.201400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a424ca9-72ad-4745-ba06-259cc13eead9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:12.202375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a424ca9-72ad-4745-ba06-259cc13eead9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:12.202674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a424ca9-72ad-4745-ba06-259cc13eead9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:12.210310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a424ca9-72ad-4745-ba06-259cc13eead9 admin admin] PATH_INFO: `/v3/projects/72ceb4a1af0c438ca29f97d7c0308c3e/users/ea50661bf26447e98a1fd8b3603ea880/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:12.229775 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1196/2438] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:12.234715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab628160-95d7-463f-ba88-751c937a7c73 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:12.239097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ab628160-95d7-463f-ba88-751c937a7c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:12.245951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a424ca9-72ad-4745-ba06-259cc13eead9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72ceb4a1af0c438ca29f97d7c0308c3e, user_id=ea50661bf26447e98a1fd8b3603ea880, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:12.256221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a424ca9-72ad-4745-ba06-259cc13eead9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:12.289114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab628160-95d7-463f-ba88-751c937a7c73 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:12.305736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0855f-649b-4669-b9e7-7815bf6fa891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:12.308347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0855f-649b-4669-b9e7-7815bf6fa891 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:12.310380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0855f-649b-4669-b9e7-7815bf6fa891 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:12.313519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f0855f-649b-4669-b9e7-7815bf6fa891 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:12.316106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0855f-649b-4669-b9e7-7815bf6fa891 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:12.322004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f0855f-649b-4669-b9e7-7815bf6fa891 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:12.330013 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:12.359236 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1243/2439] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:13:12 2022] PUT /identity/v3/projects/72ceb4a1af0c438ca29f97d7c0308c3e/users/ea50661bf26447e98a1fd8b3603ea880/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:12.372320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5805ca4-536c-4494-85e5-e31a4c7a78bb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:12.373787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5805ca4-536c-4494-85e5-e31a4c7a78bb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:12.374323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5805ca4-536c-4494-85e5-e31a4c7a78bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:12.431637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b5805ca4-536c-4494-85e5-e31a4c7a78bb None None] MFA Rules not processed for user `ea50661bf26447e98a1fd8b3603ea880`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:12.432917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b5805ca4-536c-4494-85e5-e31a4c7a78bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:12.529250 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1244/2440] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:13:12.555829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5805ca4-536c-4494-85e5-e31a4c7a78bb None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:12.557807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b5805ca4-536c-4494-85e5-e31a4c7a78bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:12.569825 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1197/2441] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:13:12 2022] POST /identity/v3/projects => generated 405 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:13:12.571258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0855f-649b-4669-b9e7-7815bf6fa891 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:12.667241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5805ca4-536c-4494-85e5-e31a4c7a78bb None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:12.746877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9befb-00e0-47a8-a062-dc25ee61fe10 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:12.747178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9befb-00e0-47a8-a062-dc25ee61fe10 service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:12.747403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9befb-00e0-47a8-a062-dc25ee61fe10 service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:12.747691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9befb-00e0-47a8-a062-dc25ee61fe10 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:12.767306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f0855f-649b-4669-b9e7-7815bf6fa891 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:12.784153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7942e42-fd0e-43c6-b603-2213bdd30c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:12.785509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7942e42-fd0e-43c6-b603-2213bdd30c86 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:12.789706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7942e42-fd0e-43c6-b603-2213bdd30c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:12.792913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7942e42-fd0e-43c6-b603-2213bdd30c86 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:12.794188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7942e42-fd0e-43c6-b603-2213bdd30c86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:12.803667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7942e42-fd0e-43c6-b603-2213bdd30c86 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:12.824674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9befb-00e0-47a8-a062-dc25ee61fe10 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:12.826465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9befb-00e0-47a8-a062-dc25ee61fe10 service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:12.834950 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:12.844297 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1245/2442] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:13:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:13:12.929120 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1198/2443] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:13:12 2022] POST /identity/v3/users => generated 309 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:13:12.937447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9befb-00e0-47a8-a062-dc25ee61fe10 service glance] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:12.953249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c5a92-286b-4af6-8569-c121ed679b6e None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:12.953621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c5a92-286b-4af6-8569-c121ed679b6e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:12.953984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c5a92-286b-4af6-8569-c121ed679b6e None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:12.956035 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1199/2444] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:13:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 14:13:12.960672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c5a92-286b-4af6-8569-c121ed679b6e None None] Authenticating service token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:13:12.995424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9befb-00e0-47a8-a062-dc25ee61fe10 service glance] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:13.001641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015b13e-741b-4b00-8ce0-ccc329461b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:13.001797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015b13e-741b-4b00-8ce0-ccc329461b95 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:13.002118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015b13e-741b-4b00-8ce0-ccc329461b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:13.002405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015b13e-741b-4b00-8ce0-ccc329461b95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:13.003210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015b13e-741b-4b00-8ce0-ccc329461b95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:13.004827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015b13e-741b-4b00-8ce0-ccc329461b95 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:13.031574 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1246/2445] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:13:13.032493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015b13e-741b-4b00-8ce0-ccc329461b95 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:13.075274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015b13e-741b-4b00-8ce0-ccc329461b95 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:13.092856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f54f3-4e2e-4670-9055-9225bba4f954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:13.094408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f54f3-4e2e-4670-9055-9225bba4f954 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:13.095113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f54f3-4e2e-4670-9055-9225bba4f954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:13.097783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f54f3-4e2e-4670-9055-9225bba4f954 admin admin] PATH_INFO: `/v3/projects/5579fd0e2f6c45d1bf066c6109d58871/users/c88749201ee34311be9bf83ae5523020/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:13.128658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f54f3-4e2e-4670-9055-9225bba4f954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5579fd0e2f6c45d1bf066c6109d58871, user_id=c88749201ee34311be9bf83ae5523020, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:13.133599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f54f3-4e2e-4670-9055-9225bba4f954 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:13.171757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c5a92-286b-4af6-8569-c121ed679b6e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:13.282420 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1247/2446] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:13:13 2022] PUT /identity/v3/projects/5579fd0e2f6c45d1bf066c6109d58871/users/c88749201ee34311be9bf83ae5523020/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:13.288349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efbca7-ab11-4f35-9190-4d05836afaae None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:13.288642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efbca7-ab11-4f35-9190-4d05836afaae None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:13.288925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efbca7-ab11-4f35-9190-4d05836afaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:13.339117 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:13.372995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c5a92-286b-4af6-8569-c121ed679b6e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:13.380579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-04efbca7-ab11-4f35-9190-4d05836afaae None None] MFA Rules not processed for user `5c0882e092c644758966c19d52d86795`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:13.381734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-04efbca7-ab11-4f35-9190-4d05836afaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:13.548034 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1248/2447] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:13.549713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efbca7-ab11-4f35-9190-4d05836afaae None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:13.594843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3918f3-0fb5-46a6-b954-d1e71af95bb0 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8640fec67a4141a34c318733ecbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '104876b9b057407d862898659d93f7fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:13.596007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3918f3-0fb5-46a6-b954-d1e71af95bb0 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:13.596278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3918f3-0fb5-46a6-b954-d1e71af95bb0 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:13.596556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3918f3-0fb5-46a6-b954-d1e71af95bb0 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] PATH_INFO: `/v3/projects/0272304eb14143d691fdc5bb9a7c4717` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:13.597805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3918f3-0fb5-46a6-b954-d1e71af95bb0 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorizing `identity:get_project(project_id=0272304eb14143d691fdc5bb9a7c4717)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:13.599892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3918f3-0fb5-46a6-b954-d1e71af95bb0 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:13.604066 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1200/2448] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:13:12 2022] GET /identity/v3/projects/0272304eb14143d691fdc5bb9a7c4717 => generated 369 bytes in 644 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:13:13.606715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33ecc3-ca4b-46c9-97b3-e458c8a72447 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:13.608208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33ecc3-ca4b-46c9-97b3-e458c8a72447 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:13.608208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb33ecc3-ca4b-46c9-97b3-e458c8a72447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:13.678422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-eb33ecc3-ca4b-46c9-97b3-e458c8a72447 None None] MFA Rules not processed for user `4a8d83c4076b4aa4bb1eb6d3f70e0fc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:13.680104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eb33ecc3-ca4b-46c9-97b3-e458c8a72447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:13.692256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efbca7-ab11-4f35-9190-4d05836afaae None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:13.719502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcbd78a-0dbe-41b0-ad42-3962cbe44f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:13.720731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbd78a-0dbe-41b0-ad42-3962cbe44f54 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:13.721532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbd78a-0dbe-41b0-ad42-3962cbe44f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:13.721532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcbd78a-0dbe-41b0-ad42-3962cbe44f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:13.722140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbd78a-0dbe-41b0-ad42-3962cbe44f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:13.723784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcbd78a-0dbe-41b0-ad42-3962cbe44f54 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:13.764550 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1249/2449] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:13:13.767213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b39e1-33f7-43be-9687-95820b8e7c27 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:13.768067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b39e1-33f7-43be-9687-95820b8e7c27 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:13.768067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b39e1-33f7-43be-9687-95820b8e7c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:13.813584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f27b39e1-33f7-43be-9687-95820b8e7c27 None None] MFA Rules not processed for user `5c0882e092c644758966c19d52d86795`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:13.814849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f27b39e1-33f7-43be-9687-95820b8e7c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:13.835805 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1250/2450] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:13 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:13.839215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b39e1-33f7-43be-9687-95820b8e7c27 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:13.860122 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1201/2451] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:13 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:13.861667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33ecc3-ca4b-46c9-97b3-e458c8a72447 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:13.862733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b39e1-33f7-43be-9687-95820b8e7c27 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:13.884186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa78ad9-8541-41b0-ac80-5fb4c1c5a703 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8640fec67a4141a34c318733ecbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '104876b9b057407d862898659d93f7fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:13.884186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa78ad9-8541-41b0-ac80-5fb4c1c5a703 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:13.884438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa78ad9-8541-41b0-ac80-5fb4c1c5a703 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:13.884707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa78ad9-8541-41b0-ac80-5fb4c1c5a703 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:13.885442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa78ad9-8541-41b0-ac80-5fb4c1c5a703 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:13:13.886625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa78ad9-8541-41b0-ac80-5fb4c1c5a703 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:13.889026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa78ad9-8541-41b0-ac80-5fb4c1c5a703 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:13.894687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb33ecc3-ca4b-46c9-97b3-e458c8a72447 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:13.919092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e54e85-143b-441b-a348-5c109ad1116c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:13.919092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e54e85-143b-441b-a348-5c109ad1116c admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:13.919092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e54e85-143b-441b-a348-5c109ad1116c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:13.919092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e54e85-143b-441b-a348-5c109ad1116c admin admin] PATH_INFO: `/v3/projects/5579fd0e2f6c45d1bf066c6109d58871/users/c88749201ee34311be9bf83ae5523020/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:13.930080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e54e85-143b-441b-a348-5c109ad1116c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5579fd0e2f6c45d1bf066c6109d58871, user_id=c88749201ee34311be9bf83ae5523020, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:13.932447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e54e85-143b-441b-a348-5c109ad1116c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:13.937172 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1251/2452] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:13:13.938130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa78ad9-8541-41b0-ac80-5fb4c1c5a703 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:13.940811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4fa78ad9-8541-41b0-ac80-5fb4c1c5a703 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:13.969618 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1202/2453] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:13:13 2022] PUT /identity/v3/projects/5579fd0e2f6c45d1bf066c6109d58871/users/c88749201ee34311be9bf83ae5523020/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:13.972092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399a204-dc95-49f8-8988-fbdc21798a91 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:13.972381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399a204-dc95-49f8-8988-fbdc21798a91 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:13.972675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1399a204-dc95-49f8-8988-fbdc21798a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:14.012353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1399a204-dc95-49f8-8988-fbdc21798a91 None None] MFA Rules not processed for user `865ff993f6a440d4a25b34daed8cd6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:14.017859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1399a204-dc95-49f8-8988-fbdc21798a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:14.132463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa78ad9-8541-41b0-ac80-5fb4c1c5a703 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:14.158663 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:14.179043 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1203/2454] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:14.180113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399a204-dc95-49f8-8988-fbdc21798a91 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:14.301669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d845ef4-416a-44f5-87fd-39e045c79741 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:14.303282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d845ef4-416a-44f5-87fd-39e045c79741 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:14.303282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d845ef4-416a-44f5-87fd-39e045c79741 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:14.303282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d845ef4-416a-44f5-87fd-39e045c79741 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:14.308289 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:14.322995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1399a204-dc95-49f8-8988-fbdc21798a91 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:14.330084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d5390-3b20-4aa0-a71f-5397271516ca tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8640fec67a4141a34c318733ecbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '104876b9b057407d862898659d93f7fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:14.330931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d5390-3b20-4aa0-a71f-5397271516ca tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:14.331450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d5390-3b20-4aa0-a71f-5397271516ca tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:14.331778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d5390-3b20-4aa0-a71f-5397271516ca tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:14.332599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d5390-3b20-4aa0-a71f-5397271516ca tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:14.334712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9d5390-3b20-4aa0-a71f-5397271516ca tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:14.433736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d845ef4-416a-44f5-87fd-39e045c79741 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:14.436951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d845ef4-416a-44f5-87fd-39e045c79741 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:14.456746 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1252/2455] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:13:13 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:13:14.458435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b816375-ba2d-41d1-a140-3b7d0f497c98 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:14.458435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b816375-ba2d-41d1-a140-3b7d0f497c98 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:14.458684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b816375-ba2d-41d1-a140-3b7d0f497c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:14.495291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3b816375-ba2d-41d1-a140-3b7d0f497c98 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:14.500567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3b816375-ba2d-41d1-a140-3b7d0f497c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:14.529031 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1204/2456] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:13:14 2022] POST /identity/v3/users => generated 383 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:13:14.530143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d5390-3b20-4aa0-a71f-5397271516ca tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:14.564787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d5390-3b20-4aa0-a71f-5397271516ca tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:14.576831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e164cd-331c-4ae7-8e01-5372c1584fe1 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8640fec67a4141a34c318733ecbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '104876b9b057407d862898659d93f7fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:14.577603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e164cd-331c-4ae7-8e01-5372c1584fe1 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:14.577967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e164cd-331c-4ae7-8e01-5372c1584fe1 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:14.578341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e164cd-331c-4ae7-8e01-5372c1584fe1 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:14.579170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e164cd-331c-4ae7-8e01-5372c1584fe1 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:13:14.579562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e164cd-331c-4ae7-8e01-5372c1584fe1 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:14.581584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e164cd-331c-4ae7-8e01-5372c1584fe1 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:14.616184 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1205/2457] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:13:14.634263 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1253/2458] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:13:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:14.670672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e164cd-331c-4ae7-8e01-5372c1584fe1 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:14.671781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-17e164cd-331c-4ae7-8e01-5372c1584fe1 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:14.692848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b816375-ba2d-41d1-a140-3b7d0f497c98 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:14.710137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b816375-ba2d-41d1-a140-3b7d0f497c98 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:14.716608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c523d-7fa3-4213-af60-ce85af98bd37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:14.717272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c523d-7fa3-4213-af60-ce85af98bd37 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:14.717722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c523d-7fa3-4213-af60-ce85af98bd37 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:14.718378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c523d-7fa3-4213-af60-ce85af98bd37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:14.720694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b57c523d-7fa3-4213-af60-ce85af98bd37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:14.739488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c523d-7fa3-4213-af60-ce85af98bd37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:14.749314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c523d-7fa3-4213-af60-ce85af98bd37 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:14.760596 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1254/2459] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:13:14 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:13:14.785913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e164cd-331c-4ae7-8e01-5372c1584fe1 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:14.814834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875813c-76c8-431f-a729-163f7e75d769 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:14.818002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875813c-76c8-431f-a729-163f7e75d769 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:14.819023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875813c-76c8-431f-a729-163f7e75d769 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:14.819321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875813c-76c8-431f-a729-163f7e75d769 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:14.854412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875813c-76c8-431f-a729-163f7e75d769 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:14.856103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875813c-76c8-431f-a729-163f7e75d769 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:14.924389 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1206/2460] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:13:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:13:15.055336 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:15.816449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6553b5-a08f-498e-bd85-b1f63d912502 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:15.816736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6553b5-a08f-498e-bd85-b1f63d912502 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:15.817012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6553b5-a08f-498e-bd85-b1f63d912502 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:15.818445 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1255/2461] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:13:15.828317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875813c-76c8-431f-a729-163f7e75d769 service swift] Authenticating service token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:13:15.848979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875813c-76c8-431f-a729-163f7e75d769 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:15.869265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875813c-76c8-431f-a729-163f7e75d769 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:15.879326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc9d27-9fe9-43cf-8a67-e1b6fd682dbf tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8640fec67a4141a34c318733ecbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '104876b9b057407d862898659d93f7fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:15.880581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc9d27-9fe9-43cf-8a67-e1b6fd682dbf tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:15.881179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc9d27-9fe9-43cf-8a67-e1b6fd682dbf tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:15.881928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc9d27-9fe9-43cf-8a67-e1b6fd682dbf tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] PATH_INFO: `/v3/projects/0272304eb14143d691fdc5bb9a7c4717` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:15.884578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc9d27-9fe9-43cf-8a67-e1b6fd682dbf tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorizing `identity:get_project(project_id=0272304eb14143d691fdc5bb9a7c4717)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:15.888392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc9d27-9fe9-43cf-8a67-e1b6fd682dbf tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:15.904926 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1207/2462] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:13:15 2022] GET /identity/v3/projects/0272304eb14143d691fdc5bb9a7c4717 => generated 369 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:13:16.654188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2734abc-1cab-4824-8124-47903e88382f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:16.654669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2734abc-1cab-4824-8124-47903e88382f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:16.654752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2734abc-1cab-4824-8124-47903e88382f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:16.684556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d2734abc-1cab-4824-8124-47903e88382f None None] MFA Rules not processed for user `a6fc909d2c0843b8a29eb1d47a755db9`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:16.685775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d2734abc-1cab-4824-8124-47903e88382f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:16.815035 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1256/2463] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:16.952826 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:17.357986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ffa35-658e-463c-aee7-90a073dad914 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:17.358300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ffa35-658e-463c-aee7-90a073dad914 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:17.367508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ffa35-658e-463c-aee7-90a073dad914 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:17.369238 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1208/2464] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:13:17 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:13:17.375638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2734abc-1cab-4824-8124-47903e88382f None None] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:13:17.398996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2734abc-1cab-4824-8124-47903e88382f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:17.448248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2734abc-1cab-4824-8124-47903e88382f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:17.465079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c8597-5c06-433c-a8b0-e178feabf1ff tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8640fec67a4141a34c318733ecbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '104876b9b057407d862898659d93f7fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:17.466423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c8597-5c06-433c-a8b0-e178feabf1ff tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:17.466986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c8597-5c06-433c-a8b0-e178feabf1ff tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:17.467474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c8597-5c06-433c-a8b0-e178feabf1ff tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] PATH_INFO: `/v3/projects/0272304eb14143d691fdc5bb9a7c4717` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:17.469011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c8597-5c06-433c-a8b0-e178feabf1ff tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorizing `identity:get_project(project_id=0272304eb14143d691fdc5bb9a7c4717)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:17.471933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c8597-5c06-433c-a8b0-e178feabf1ff tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:17.477051 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1257/2465] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:13:17 2022] GET /identity/v3/projects/0272304eb14143d691fdc5bb9a7c4717 => generated 369 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:13:17.529815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ffa35-658e-463c-aee7-90a073dad914 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:17.566443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ffa35-658e-463c-aee7-90a073dad914 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:17.576897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10475d9e-9239-4d7c-8a14-b71a8c51fb68 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8640fec67a4141a34c318733ecbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '104876b9b057407d862898659d93f7fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:17.577785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10475d9e-9239-4d7c-8a14-b71a8c51fb68 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:17.580583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10475d9e-9239-4d7c-8a14-b71a8c51fb68 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:17.581073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10475d9e-9239-4d7c-8a14-b71a8c51fb68 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] PATH_INFO: `/v3/users/a9b2119e14c241009c9f7cf2b53f070c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:17.619858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10475d9e-9239-4d7c-8a14-b71a8c51fb68 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a9b2119e14c241009c9f7cf2b53f070c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:17.622753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10475d9e-9239-4d7c-8a14-b71a8c51fb68 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:17.823417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-10475d9e-9239-4d7c-8a14-b71a8c51fb68 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9b2119e14c241009c9f7cf2b53f070c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:17.828473 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:17.870858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-10475d9e-9239-4d7c-8a14-b71a8c51fb68 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9b2119e14c241009c9f7cf2b53f070c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:17.872429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-10475d9e-9239-4d7c-8a14-b71a8c51fb68 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9b2119e14c241009c9f7cf2b53f070c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:17.873314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-10475d9e-9239-4d7c-8a14-b71a8c51fb68 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9b2119e14c241009c9f7cf2b53f070c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:17.891045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-10475d9e-9239-4d7c-8a14-b71a8c51fb68 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9b2119e14c241009c9f7cf2b53f070c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:17.999442 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1209/2466] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:13:17 2022] DELETE /identity/v3/users/a9b2119e14c241009c9f7cf2b53f070c => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:18.003760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c8597-5c06-433c-a8b0-e178feabf1ff tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:18.008306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-889c8597-5c06-433c-a8b0-e178feabf1ff tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:18.025893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c8597-5c06-433c-a8b0-e178feabf1ff tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:18.132388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8960f-ad33-4946-b548-99a3bba349c9 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c8640fec67a4141a34c318733ecbb26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '104876b9b057407d862898659d93f7fb', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:18.133633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8960f-ad33-4946-b548-99a3bba349c9 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:18.134125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8960f-ad33-4946-b548-99a3bba349c9 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:18.134553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8960f-ad33-4946-b548-99a3bba349c9 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] PATH_INFO: `/v3/projects/0272304eb14143d691fdc5bb9a7c4717` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:18.136234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8960f-ad33-4946-b548-99a3bba349c9 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0272304eb14143d691fdc5bb9a7c4717)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:18.138718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8960f-ad33-4946-b548-99a3bba349c9 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:18.330133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-69a8960f-ad33-4946-b548-99a3bba349c9 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0272304eb14143d691fdc5bb9a7c4717', 'request_id': 'req-69a8960f-ad33-4946-b548-99a3bba349c9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:18.364302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-69a8960f-ad33-4946-b548-99a3bba349c9 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0272304eb14143d691fdc5bb9a7c4717', 'request_id': 'req-69a8960f-ad33-4946-b548-99a3bba349c9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:18.379739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-69a8960f-ad33-4946-b548-99a3bba349c9 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0272304eb14143d691fdc5bb9a7c4717', 'request_id': 'req-69a8960f-ad33-4946-b548-99a3bba349c9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:18.510649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-69a8960f-ad33-4946-b548-99a3bba349c9 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] The token cache is being invalidate because project 0272304eb14143d691fdc5bb9a7c4717 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:13:18.511963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-69a8960f-ad33-4946-b548-99a3bba349c9 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:18.513105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-69a8960f-ad33-4946-b548-99a3bba349c9 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:18.524409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10475d9e-9239-4d7c-8a14-b71a8c51fb68 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:18.525034 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1258/2467] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:13:18 2022] DELETE /identity/v3/projects/0272304eb14143d691fdc5bb9a7c4717 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:18.528543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-10475d9e-9239-4d7c-8a14-b71a8c51fb68 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:18.669530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10475d9e-9239-4d7c-8a14-b71a8c51fb68 tempest-QuotasAdminTestV257-934031762 tempest-QuotasAdminTestV257-934031762-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:18.886298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bf1e6-4586-48cb-9d07-a4f80f059cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:18.888402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bf1e6-4586-48cb-9d07-a4f80f059cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:18.888917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bf1e6-4586-48cb-9d07-a4f80f059cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:18.889422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bf1e6-4586-48cb-9d07-a4f80f059cbd admin admin] PATH_INFO: `/v3/users/2e9b9e62aa2f43d29581d5822599b5cf` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:18.891389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bf1e6-4586-48cb-9d07-a4f80f059cbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e9b9e62aa2f43d29581d5822599b5cf)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:18.897821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bf1e6-4586-48cb-9d07-a4f80f059cbd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:19.120317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc04319-760b-4c1a-b61c-8f4266e7f15c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:19.120823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc04319-760b-4c1a-b61c-8f4266e7f15c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:19.120906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc04319-760b-4c1a-b61c-8f4266e7f15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:19.153328 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:19.205105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-afc04319-760b-4c1a-b61c-8f4266e7f15c None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:19.206980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-afc04319-760b-4c1a-b61c-8f4266e7f15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:19.217828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a46bf1e6-4586-48cb-9d07-a4f80f059cbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e9b9e62aa2f43d29581d5822599b5cf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:19.261666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a46bf1e6-4586-48cb-9d07-a4f80f059cbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e9b9e62aa2f43d29581d5822599b5cf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:19.263722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a46bf1e6-4586-48cb-9d07-a4f80f059cbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e9b9e62aa2f43d29581d5822599b5cf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:19.266483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a46bf1e6-4586-48cb-9d07-a4f80f059cbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e9b9e62aa2f43d29581d5822599b5cf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:19.283324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a46bf1e6-4586-48cb-9d07-a4f80f059cbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e9b9e62aa2f43d29581d5822599b5cf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:19.329984 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1259/2468] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:13:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:13:19.345546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc04319-760b-4c1a-b61c-8f4266e7f15c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:19.348114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-afc04319-760b-4c1a-b61c-8f4266e7f15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:19.379187 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:19.387588 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1210/2469] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:13:18 2022] DELETE /identity/v3/users/2e9b9e62aa2f43d29581d5822599b5cf => generated 0 bytes in 865 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:19.392242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095214e-751c-42c6-ab78-d52e05139079 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:19.392734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095214e-751c-42c6-ab78-d52e05139079 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:19.393127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a095214e-751c-42c6-ab78-d52e05139079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:19.455400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a095214e-751c-42c6-ab78-d52e05139079 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:19.460304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a095214e-751c-42c6-ab78-d52e05139079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:19.629891 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1211/2470] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:13:19.675807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc04319-760b-4c1a-b61c-8f4266e7f15c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:19.729153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095214e-751c-42c6-ab78-d52e05139079 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:19.731277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a095214e-751c-42c6-ab78-d52e05139079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:19.779622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b5332-a393-4133-82a3-b38b75fb1a75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:19.780643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b5332-a393-4133-82a3-b38b75fb1a75 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:19.780764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b5332-a393-4133-82a3-b38b75fb1a75 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:19.781002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b5332-a393-4133-82a3-b38b75fb1a75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:19.878554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a095214e-751c-42c6-ab78-d52e05139079 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:19.890987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd8414-de7a-4f11-8986-4caa74b7f026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:19.891652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd8414-de7a-4f11-8986-4caa74b7f026 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:19.891938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd8414-de7a-4f11-8986-4caa74b7f026 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:19.892218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd8414-de7a-4f11-8986-4caa74b7f026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:19.903847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b5332-a393-4133-82a3-b38b75fb1a75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:19.905794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b5332-a393-4133-82a3-b38b75fb1a75 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:19.911246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd8414-de7a-4f11-8986-4caa74b7f026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:19.912056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd8414-de7a-4f11-8986-4caa74b7f026 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:19.918418 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1260/2471] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:13:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:13:19.939581 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1212/2472] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:13:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:13:20.993803 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:21.223979 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:22.047020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b5332-a393-4133-82a3-b38b75fb1a75 service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:22.049327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-861b5332-a393-4133-82a3-b38b75fb1a75 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:22.091894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b5332-a393-4133-82a3-b38b75fb1a75 service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:22.108612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49d624-022e-40a5-bb2e-496cdfac8f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:22.109810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49d624-022e-40a5-bb2e-496cdfac8f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:22.110421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49d624-022e-40a5-bb2e-496cdfac8f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:22.111659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49d624-022e-40a5-bb2e-496cdfac8f30 admin admin] PATH_INFO: `/v3/projects/64f12cb399a34236b3cae4b3482d1942` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:22.113636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49d624-022e-40a5-bb2e-496cdfac8f30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64f12cb399a34236b3cae4b3482d1942)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:22.117527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49d624-022e-40a5-bb2e-496cdfac8f30 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:22.386675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2d49d624-022e-40a5-bb2e-496cdfac8f30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64f12cb399a34236b3cae4b3482d1942', 'request_id': 'req-2d49d624-022e-40a5-bb2e-496cdfac8f30'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:22.408263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2d49d624-022e-40a5-bb2e-496cdfac8f30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64f12cb399a34236b3cae4b3482d1942', 'request_id': 'req-2d49d624-022e-40a5-bb2e-496cdfac8f30'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:22.421356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2d49d624-022e-40a5-bb2e-496cdfac8f30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64f12cb399a34236b3cae4b3482d1942', 'request_id': 'req-2d49d624-022e-40a5-bb2e-496cdfac8f30'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:22.491424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2d49d624-022e-40a5-bb2e-496cdfac8f30 admin admin] The token cache is being invalidate because project 64f12cb399a34236b3cae4b3482d1942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:13:22.493898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2d49d624-022e-40a5-bb2e-496cdfac8f30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:22.494074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2d49d624-022e-40a5-bb2e-496cdfac8f30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:22.496057 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1261/2473] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:13:22 2022] DELETE /identity/v3/projects/64f12cb399a34236b3cae4b3482d1942 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:22.499939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd8414-de7a-4f11-8986-4caa74b7f026 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:22.518577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd8414-de7a-4f11-8986-4caa74b7f026 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:22.630495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9f39d-8db5-4068-9723-a0725c1abca9 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:22.630784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9f39d-8db5-4068-9723-a0725c1abca9 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:22.631785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef9f39d-8db5-4068-9723-a0725c1abca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:22.674440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1ef9f39d-8db5-4068-9723-a0725c1abca9 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:22.678605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1ef9f39d-8db5-4068-9723-a0725c1abca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:22.695192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b14784-08ab-4e37-93ff-1c2fad4990c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:22.696105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b14784-08ab-4e37-93ff-1c2fad4990c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:22.696588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b14784-08ab-4e37-93ff-1c2fad4990c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:22.697054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b14784-08ab-4e37-93ff-1c2fad4990c5 admin admin] PATH_INFO: `/v3/users/6c8640fec67a4141a34c318733ecbb26` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:22.705525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b14784-08ab-4e37-93ff-1c2fad4990c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c8640fec67a4141a34c318733ecbb26)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:22.707757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b14784-08ab-4e37-93ff-1c2fad4990c5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:22.816479 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1262/2474] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:13:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:22.835335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9f39d-8db5-4068-9723-a0725c1abca9 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:22.837005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1ef9f39d-8db5-4068-9723-a0725c1abca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:23.098958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef9f39d-8db5-4068-9723-a0725c1abca9 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:23.098958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569319ab-93d4-4f14-a13b-db67fffff482 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:23.098958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569319ab-93d4-4f14-a13b-db67fffff482 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:23.098958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569319ab-93d4-4f14-a13b-db67fffff482 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:23.100364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569319ab-93d4-4f14-a13b-db67fffff482 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:23.100364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569319ab-93d4-4f14-a13b-db67fffff482 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:23.100364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569319ab-93d4-4f14-a13b-db67fffff482 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:23.100364 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1263/2475] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:13:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 14:13:23.243641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-42b14784-08ab-4e37-93ff-1c2fad4990c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c8640fec67a4141a34c318733ecbb26'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:23.267255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-42b14784-08ab-4e37-93ff-1c2fad4990c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c8640fec67a4141a34c318733ecbb26'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:23.268996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-42b14784-08ab-4e37-93ff-1c2fad4990c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c8640fec67a4141a34c318733ecbb26'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:23.269681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-42b14784-08ab-4e37-93ff-1c2fad4990c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c8640fec67a4141a34c318733ecbb26'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:23.293892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-42b14784-08ab-4e37-93ff-1c2fad4990c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c8640fec67a4141a34c318733ecbb26'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:23.433644 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1213/2476] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:13:22 2022] DELETE /identity/v3/users/6c8640fec67a4141a34c318733ecbb26 => generated 0 bytes in 934 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:23.450656 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:23.742538 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:24.339907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb1259-97cf-493b-98b3-6d6cdbcfcd8b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:24.340213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb1259-97cf-493b-98b3-6d6cdbcfcd8b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:24.340586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb1259-97cf-493b-98b3-6d6cdbcfcd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:24.372133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-34bb1259-97cf-493b-98b3-6d6cdbcfcd8b None None] MFA Rules not processed for user `ea50661bf26447e98a1fd8b3603ea880`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:24.373759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-34bb1259-97cf-493b-98b3-6d6cdbcfcd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:24.487325 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1264/2477] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:24.619351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f970916-bc1c-442a-b74d-ccc7c825e1e9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:24.620223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f970916-bc1c-442a-b74d-ccc7c825e1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:24.620746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f970916-bc1c-442a-b74d-ccc7c825e1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:24.651645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5f970916-bc1c-442a-b74d-ccc7c825e1e9 None None] MFA Rules not processed for user `6b13cdd4117640b49cf9f74cc12d16f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:24.653067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5f970916-bc1c-442a-b74d-ccc7c825e1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:24.787661 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1214/2478] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:13:25.587997 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:25.722129 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:25.962573 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:26.153325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb1259-97cf-493b-98b3-6d6cdbcfcd8b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:26.157928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-34bb1259-97cf-493b-98b3-6d6cdbcfcd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:26.337277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb1259-97cf-493b-98b3-6d6cdbcfcd8b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:26.342063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746973b1-94e2-41ed-8a02-92677f86530f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:26.343260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746973b1-94e2-41ed-8a02-92677f86530f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:26.343711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746973b1-94e2-41ed-8a02-92677f86530f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:26.344159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746973b1-94e2-41ed-8a02-92677f86530f admin admin] PATH_INFO: `/v3/projects/104876b9b057407d862898659d93f7fb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:26.345889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746973b1-94e2-41ed-8a02-92677f86530f admin admin] RBAC: Authorizing `identity:delete_project(project_id=104876b9b057407d862898659d93f7fb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:26.348067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746973b1-94e2-41ed-8a02-92677f86530f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:26.498304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-746973b1-94e2-41ed-8a02-92677f86530f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '104876b9b057407d862898659d93f7fb', 'request_id': 'req-746973b1-94e2-41ed-8a02-92677f86530f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:26.505526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-746973b1-94e2-41ed-8a02-92677f86530f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '104876b9b057407d862898659d93f7fb', 'request_id': 'req-746973b1-94e2-41ed-8a02-92677f86530f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:26.513925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-746973b1-94e2-41ed-8a02-92677f86530f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '104876b9b057407d862898659d93f7fb', 'request_id': 'req-746973b1-94e2-41ed-8a02-92677f86530f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:26.589206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-746973b1-94e2-41ed-8a02-92677f86530f admin admin] The token cache is being invalidate because project 104876b9b057407d862898659d93f7fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:13:26.589845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-746973b1-94e2-41ed-8a02-92677f86530f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:26.590924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-746973b1-94e2-41ed-8a02-92677f86530f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:26.592808 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1265/2479] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:13:26 2022] DELETE /identity/v3/projects/104876b9b057407d862898659d93f7fb => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:26.599376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08ceb1-144f-4d2a-9a6e-7a96af953421 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:26.599682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08ceb1-144f-4d2a-9a6e-7a96af953421 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:26.600177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08ceb1-144f-4d2a-9a6e-7a96af953421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:26.631741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-de08ceb1-144f-4d2a-9a6e-7a96af953421 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:26.633250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-de08ceb1-144f-4d2a-9a6e-7a96af953421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:26.777246 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1215/2480] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:26.787226 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:26.789763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b588c55-9685-45d9-9776-7eaa628d8706 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:26.790056 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b588c55-9685-45d9-9776-7eaa628d8706 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:26.790377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b588c55-9685-45d9-9776-7eaa628d8706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:26.825278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4b588c55-9685-45d9-9776-7eaa628d8706 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:26.827691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4b588c55-9685-45d9-9776-7eaa628d8706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:26.841483 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1266/2481] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:26.843931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08ceb1-144f-4d2a-9a6e-7a96af953421 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:26.857892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08ceb1-144f-4d2a-9a6e-7a96af953421 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:26.864036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c806be2f-70c5-436f-a773-fa148f26ebd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:26.865070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806be2f-70c5-436f-a773-fa148f26ebd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:26.865767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806be2f-70c5-436f-a773-fa148f26ebd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:26.866410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c806be2f-70c5-436f-a773-fa148f26ebd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:26.867634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806be2f-70c5-436f-a773-fa148f26ebd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:13:26.868108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806be2f-70c5-436f-a773-fa148f26ebd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:26.869956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c806be2f-70c5-436f-a773-fa148f26ebd6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:26.892968 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1216/2482] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:13:26.897308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b588c55-9685-45d9-9776-7eaa628d8706 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:26.911591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea6daa-afe5-4c22-a641-8fad67f08a3f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:26.914746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b588c55-9685-45d9-9776-7eaa628d8706 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:26.915145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea6daa-afe5-4c22-a641-8fad67f08a3f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:26.941479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea6daa-afe5-4c22-a641-8fad67f08a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:26.967027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85552fef-09d9-4d25-93b6-c5e359ff69ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:26.971447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85552fef-09d9-4d25-93b6-c5e359ff69ed admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:26.971447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85552fef-09d9-4d25-93b6-c5e359ff69ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:26.971447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85552fef-09d9-4d25-93b6-c5e359ff69ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:26.971447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85552fef-09d9-4d25-93b6-c5e359ff69ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:26.975730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85552fef-09d9-4d25-93b6-c5e359ff69ed admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:27.003999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f0ea6daa-afe5-4c22-a641-8fad67f08a3f None None] MFA Rules not processed for user `ea50661bf26447e98a1fd8b3603ea880`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:27.010914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f0ea6daa-afe5-4c22-a641-8fad67f08a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:27.126620 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1267/2483] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:13:26 2022] POST /identity/v3/projects => generated 375 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:13:27.127309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85552fef-09d9-4d25-93b6-c5e359ff69ed admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:27.183577 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1217/2484] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:27.391275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85552fef-09d9-4d25-93b6-c5e359ff69ed admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:27.399363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f55d8-720b-40fd-bbe2-c99fbb3d7826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:27.400374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f55d8-720b-40fd-bbe2-c99fbb3d7826 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:27.400758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f55d8-720b-40fd-bbe2-c99fbb3d7826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:27.401530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f55d8-720b-40fd-bbe2-c99fbb3d7826 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:27.408296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f55d8-720b-40fd-bbe2-c99fbb3d7826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:27.410869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f55d8-720b-40fd-bbe2-c99fbb3d7826 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:27.524327 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1268/2485] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:13:27 2022] POST /identity/v3/users => generated 288 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:13:27.525684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea6daa-afe5-4c22-a641-8fad67f08a3f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:27.540642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea6daa-afe5-4c22-a641-8fad67f08a3f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:27.548263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869598b-26da-4eec-876c-1705f454058b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:27.549423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869598b-26da-4eec-876c-1705f454058b admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:27.549778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869598b-26da-4eec-876c-1705f454058b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:27.550066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3869598b-26da-4eec-876c-1705f454058b admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:27.553333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869598b-26da-4eec-876c-1705f454058b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:27.559472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3869598b-26da-4eec-876c-1705f454058b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:27.585206 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1218/2486] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:13:27.589530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f55d8-720b-40fd-bbe2-c99fbb3d7826 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:27.621639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f55d8-720b-40fd-bbe2-c99fbb3d7826 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:27.627592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e4708-84e2-4196-9802-d7a6d41722db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:27.628672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e4708-84e2-4196-9802-d7a6d41722db admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:27.629275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e4708-84e2-4196-9802-d7a6d41722db admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:27.629704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e4708-84e2-4196-9802-d7a6d41722db admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:27.631549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e4708-84e2-4196-9802-d7a6d41722db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:27.635109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e4708-84e2-4196-9802-d7a6d41722db admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:27.657483 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1269/2487] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:13:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:13:27.662549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869598b-26da-4eec-876c-1705f454058b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:27.686969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3869598b-26da-4eec-876c-1705f454058b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:27.704013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b064f-9a01-46eb-96e5-01834e458950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:27.704935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b064f-9a01-46eb-96e5-01834e458950 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:27.705224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b064f-9a01-46eb-96e5-01834e458950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:27.705575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b064f-9a01-46eb-96e5-01834e458950 admin admin] PATH_INFO: `/v3/projects/77eacd6cd9d341cab26276a99b04bff8/users/f5d432ce84114386bcb507b4e5777f67/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:27.753379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b064f-9a01-46eb-96e5-01834e458950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77eacd6cd9d341cab26276a99b04bff8, user_id=f5d432ce84114386bcb507b4e5777f67, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:27.756482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b064f-9a01-46eb-96e5-01834e458950 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:27.793382 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:27.869399 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1219/2488] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:13:27 2022] PUT /identity/v3/projects/77eacd6cd9d341cab26276a99b04bff8/users/f5d432ce84114386bcb507b4e5777f67/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:13:27.882819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf3c8c-ad10-425c-8c28-0558a15e03ae None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:27.888281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf3c8c-ad10-425c-8c28-0558a15e03ae None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:27.888281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baf3c8c-ad10-425c-8c28-0558a15e03ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:27.950926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0baf3c8c-ad10-425c-8c28-0558a15e03ae None None] MFA Rules not processed for user `f5d432ce84114386bcb507b4e5777f67`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:27.952550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0baf3c8c-ad10-425c-8c28-0558a15e03ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:28.111439 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1270/2489] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:28.116163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b064f-9a01-46eb-96e5-01834e458950 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:28.169899 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:28.258911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b064f-9a01-46eb-96e5-01834e458950 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:28.264127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f46df-9e4c-4397-a49b-03d5c2b8126a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:28.265097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f46df-9e4c-4397-a49b-03d5c2b8126a admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:28.265562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f46df-9e4c-4397-a49b-03d5c2b8126a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:28.266008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8f46df-9e4c-4397-a49b-03d5c2b8126a admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:28.267138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f46df-9e4c-4397-a49b-03d5c2b8126a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:28.269684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8f46df-9e4c-4397-a49b-03d5c2b8126a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:28.419318 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1220/2490] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:13:28 2022] POST /identity/v3/projects => generated 375 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:13:28.423629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf3c8c-ad10-425c-8c28-0558a15e03ae None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:28.449414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baf3c8c-ad10-425c-8c28-0558a15e03ae None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:28.599193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93685ce-33ee-49e7-8afa-703fd69d88df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:28.600250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93685ce-33ee-49e7-8afa-703fd69d88df admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:28.604195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93685ce-33ee-49e7-8afa-703fd69d88df admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:28.604195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93685ce-33ee-49e7-8afa-703fd69d88df admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:28.604195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93685ce-33ee-49e7-8afa-703fd69d88df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:28.605481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93685ce-33ee-49e7-8afa-703fd69d88df admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:28.736498 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1271/2491] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:13:28 2022] POST /identity/v3/users => generated 294 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:13:28.746459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f46df-9e4c-4397-a49b-03d5c2b8126a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:28.768011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8f46df-9e4c-4397-a49b-03d5c2b8126a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:28.777300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c55670-7781-4cf3-b797-1a605a0ad324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:28.778070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c55670-7781-4cf3-b797-1a605a0ad324 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:28.778606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c55670-7781-4cf3-b797-1a605a0ad324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:28.778985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c55670-7781-4cf3-b797-1a605a0ad324 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:28.779880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c55670-7781-4cf3-b797-1a605a0ad324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:28.781597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c55670-7781-4cf3-b797-1a605a0ad324 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:28.797219 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1221/2492] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:13:28.801012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93685ce-33ee-49e7-8afa-703fd69d88df admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:28.817922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93685ce-33ee-49e7-8afa-703fd69d88df admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:28.828640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5de98-1276-4c40-b997-872167acc6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:28.829665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5de98-1276-4c40-b997-872167acc6f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:28.829950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5de98-1276-4c40-b997-872167acc6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:28.830262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa5de98-1276-4c40-b997-872167acc6f7 admin admin] PATH_INFO: `/v3/projects/a555a2634e1d45b0a4bd831f72f247df/users/b557e8c17a82497caa32b51102b8e373/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:28.857613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5de98-1276-4c40-b997-872167acc6f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a555a2634e1d45b0a4bd831f72f247df, user_id=b557e8c17a82497caa32b51102b8e373, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:28.861770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa5de98-1276-4c40-b997-872167acc6f7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:28.998579 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1272/2493] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:13:28 2022] PUT /identity/v3/projects/a555a2634e1d45b0a4bd831f72f247df/users/b557e8c17a82497caa32b51102b8e373/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:29.002391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c55670-7781-4cf3-b797-1a605a0ad324 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:29.018408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c55670-7781-4cf3-b797-1a605a0ad324 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:29.158578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813e815-d148-46e3-9eb6-111c12df3b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:29.159264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813e815-d148-46e3-9eb6-111c12df3b69 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:29.159553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813e815-d148-46e3-9eb6-111c12df3b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:29.160230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813e815-d148-46e3-9eb6-111c12df3b69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:29.161710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813e815-d148-46e3-9eb6-111c12df3b69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:29.164375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813e815-d148-46e3-9eb6-111c12df3b69 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:29.182937 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1222/2494] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:13:29.184175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5de98-1276-4c40-b997-872167acc6f7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:29.195903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa5de98-1276-4c40-b997-872167acc6f7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:29.201927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d62e67-71af-46c9-8f15-659efe238c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:29.203447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d62e67-71af-46c9-8f15-659efe238c1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:29.203911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d62e67-71af-46c9-8f15-659efe238c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:29.204188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d62e67-71af-46c9-8f15-659efe238c1d admin admin] PATH_INFO: `/v3/projects/a555a2634e1d45b0a4bd831f72f247df/users/b557e8c17a82497caa32b51102b8e373/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:29.218668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d62e67-71af-46c9-8f15-659efe238c1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a555a2634e1d45b0a4bd831f72f247df, user_id=b557e8c17a82497caa32b51102b8e373, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:29.223843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d62e67-71af-46c9-8f15-659efe238c1d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:29.233307 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:29.247265 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1273/2495] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:13:29 2022] PUT /identity/v3/projects/a555a2634e1d45b0a4bd831f72f247df/users/b557e8c17a82497caa32b51102b8e373/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:29.252496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c579c-5654-4fc1-9625-307a47ec412f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:29.253538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c579c-5654-4fc1-9625-307a47ec412f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:29.253831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c579c-5654-4fc1-9625-307a47ec412f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:29.283507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-900c579c-5654-4fc1-9625-307a47ec412f None None] MFA Rules not processed for user `b557e8c17a82497caa32b51102b8e373`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:29.284710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-900c579c-5654-4fc1-9625-307a47ec412f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:29.382474 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1223/2496] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:29.454134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dab7d-079a-48f6-95e6-0df7da0af86d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:29.454627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dab7d-079a-48f6-95e6-0df7da0af86d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:29.454911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09dab7d-079a-48f6-95e6-0df7da0af86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:29.483591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c09dab7d-079a-48f6-95e6-0df7da0af86d None None] MFA Rules not processed for user `f5d432ce84114386bcb507b4e5777f67`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:29.484916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c09dab7d-079a-48f6-95e6-0df7da0af86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:29.620738 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1274/2497] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:29.634481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c579c-5654-4fc1-9625-307a47ec412f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:29.647342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-900c579c-5654-4fc1-9625-307a47ec412f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:29.792772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c579c-5654-4fc1-9625-307a47ec412f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:29.809388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a52798-0c38-4315-a566-c9a1890965fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:29.810365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a52798-0c38-4315-a566-c9a1890965fb service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:29.810656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a52798-0c38-4315-a566-c9a1890965fb service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:29.810938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a52798-0c38-4315-a566-c9a1890965fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:29.827294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a52798-0c38-4315-a566-c9a1890965fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:29.829180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a52798-0c38-4315-a566-c9a1890965fb service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:29.843549 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1224/2498] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:13:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:13:30.033060 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:30.245163 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:31.175803 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:31.481035 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:32.635795 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:32.841399 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:32.948916 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:33.498746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac955d4a-31df-4d51-8745-0522e3d10b11 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:33.499476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac955d4a-31df-4d51-8745-0522e3d10b11 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:33.500141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac955d4a-31df-4d51-8745-0522e3d10b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:33.557205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ac955d4a-31df-4d51-8745-0522e3d10b11 None None] MFA Rules not processed for user `c88749201ee34311be9bf83ae5523020`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:33.565547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ac955d4a-31df-4d51-8745-0522e3d10b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:33.676443 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1275/2499] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:33 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:34.607435 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:35.064789 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:36.419223 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:36.634872 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:37.527097 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:37.733613 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:38.259864 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:39.466429 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:39.631288 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:40.839542 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:41.098840 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:41.324516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924b899-d5b6-48c1-95e8-2324b04c6066 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:41.324744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924b899-d5b6-48c1-95e8-2324b04c6066 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:41.325033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4924b899-d5b6-48c1-95e8-2324b04c6066 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:41.326594 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1225/2500] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:13:41.337618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e0ac4-c9e0-4239-99b7-f92e12e768d8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:41.338297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e0ac4-c9e0-4239-99b7-f92e12e768d8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:41.338904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26e0ac4-c9e0-4239-99b7-f92e12e768d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:41.368660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f26e0ac4-c9e0-4239-99b7-f92e12e768d8 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:41.370674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f26e0ac4-c9e0-4239-99b7-f92e12e768d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:41.452719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21da4e-7ae8-4f8e-ba4e-6fab4df745ef None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:41.452928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21da4e-7ae8-4f8e-ba4e-6fab4df745ef None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:41.453807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21da4e-7ae8-4f8e-ba4e-6fab4df745ef None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:41.455648 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1226/2501] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:13:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:13:41.488662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c68f9f-da42-4722-b62e-62da03dc05ad None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:41.489282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c68f9f-da42-4722-b62e-62da03dc05ad None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:41.489837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c68f9f-da42-4722-b62e-62da03dc05ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:41.506785 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1276/2502] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:13:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:41.528284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-69c68f9f-da42-4722-b62e-62da03dc05ad None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:41.531305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-69c68f9f-da42-4722-b62e-62da03dc05ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:41.552006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e0ac4-c9e0-4239-99b7-f92e12e768d8 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:41.556046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f26e0ac4-c9e0-4239-99b7-f92e12e768d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:41.565610 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1227/2503] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:13:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:13:41.596771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26e0ac4-c9e0-4239-99b7-f92e12e768d8 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:41.609087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c68f9f-da42-4722-b62e-62da03dc05ad None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:41.610886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-69c68f9f-da42-4722-b62e-62da03dc05ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:41.617354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930aef4-a485-4620-b87b-10d85b55c19e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:41.618821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930aef4-a485-4620-b87b-10d85b55c19e service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:41.619118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930aef4-a485-4620-b87b-10d85b55c19e service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:41.619402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3930aef4-a485-4620-b87b-10d85b55c19e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:41.629718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c68f9f-da42-4722-b62e-62da03dc05ad None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:41.636731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fdae36-957e-4c7e-90ae-53c5ff7950d8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:41.637727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdae36-957e-4c7e-90ae-53c5ff7950d8 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:41.638246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdae36-957e-4c7e-90ae-53c5ff7950d8 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:41.638851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fdae36-957e-4c7e-90ae-53c5ff7950d8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:41.640048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930aef4-a485-4620-b87b-10d85b55c19e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:41.641879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3930aef4-a485-4620-b87b-10d85b55c19e service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:41.663032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdae36-957e-4c7e-90ae-53c5ff7950d8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:41.667196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fdae36-957e-4c7e-90ae-53c5ff7950d8 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:41.671344 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1277/2504] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:13:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:13:41.727528 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1228/2505] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:13:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:13:41.801731 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:42.940716 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:43.187326 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:44.064634 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:44.626750 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:44.900037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930aef4-a485-4620-b87b-10d85b55c19e service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:44.917313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3930aef4-a485-4620-b87b-10d85b55c19e service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:44.923567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77981d-b591-43c1-8210-7a3ca6c7b7a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:44.924288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77981d-b591-43c1-8210-7a3ca6c7b7a7 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:44.924647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77981d-b591-43c1-8210-7a3ca6c7b7a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:44.924994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77981d-b591-43c1-8210-7a3ca6c7b7a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:44.927158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4d77981d-b591-43c1-8210-7a3ca6c7b7a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:45.008304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77981d-b591-43c1-8210-7a3ca6c7b7a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:45.009930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77981d-b591-43c1-8210-7a3ca6c7b7a7 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:45.020236 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1278/2506] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:13:44 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:13:45.793518 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:45.938700 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:46.372636 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:46.801104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a835a82-712a-43c6-939e-f3c24459b652 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:46.801541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a835a82-712a-43c6-939e-f3c24459b652 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:46.801676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a835a82-712a-43c6-939e-f3c24459b652 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:46.804228 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1229/2507] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:13:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:13:46.809241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1437b17-80e6-4dd0-aa30-9da710489006 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:46.809534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1437b17-80e6-4dd0-aa30-9da710489006 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:46.809814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1437b17-80e6-4dd0-aa30-9da710489006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:46.843064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f1437b17-80e6-4dd0-aa30-9da710489006 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:46.844290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f1437b17-80e6-4dd0-aa30-9da710489006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:46.854967 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1279/2508] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:13:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:46.879634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a835a82-712a-43c6-939e-f3c24459b652 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:46.884118 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:46.897727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a835a82-712a-43c6-939e-f3c24459b652 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:46.903260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba09e5-e435-4e55-aca1-49f15200c854 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:46.903919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba09e5-e435-4e55-aca1-49f15200c854 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:46.904204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba09e5-e435-4e55-aca1-49f15200c854 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:46.904558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba09e5-e435-4e55-aca1-49f15200c854 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:46.913760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba09e5-e435-4e55-aca1-49f15200c854 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:46.915218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba09e5-e435-4e55-aca1-49f15200c854 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:46.925197 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1230/2509] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:13:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:13:47.917599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023650ee-f7f6-4608-9959-c5c44d57e63c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:47.919307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023650ee-f7f6-4608-9959-c5c44d57e63c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:47.919721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023650ee-f7f6-4608-9959-c5c44d57e63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:47.962371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-023650ee-f7f6-4608-9959-c5c44d57e63c None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:47.963887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-023650ee-f7f6-4608-9959-c5c44d57e63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:48.043339 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1280/2510] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:13:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:48.051577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba09e5-e435-4e55-aca1-49f15200c854 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:48.055336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-18ba09e5-e435-4e55-aca1-49f15200c854 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:48.128207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023650ee-f7f6-4608-9959-c5c44d57e63c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:48.130581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-023650ee-f7f6-4608-9959-c5c44d57e63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:48.160155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba09e5-e435-4e55-aca1-49f15200c854 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:48.166699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def92bd-e061-4c1b-857a-10a99c7b2fec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:48.167470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def92bd-e061-4c1b-857a-10a99c7b2fec service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:48.167816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def92bd-e061-4c1b-857a-10a99c7b2fec service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:48.168159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def92bd-e061-4c1b-857a-10a99c7b2fec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:48.177306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def92bd-e061-4c1b-857a-10a99c7b2fec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:48.182229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def92bd-e061-4c1b-857a-10a99c7b2fec service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:48.188081 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1231/2511] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:13:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:13:48.236077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023650ee-f7f6-4608-9959-c5c44d57e63c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:48.240948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c373485-d664-47cd-8cb1-8c8e11c5a739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:48.242578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c373485-d664-47cd-8cb1-8c8e11c5a739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:48.242961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c373485-d664-47cd-8cb1-8c8e11c5a739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:48.243331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c373485-d664-47cd-8cb1-8c8e11c5a739 admin admin] PATH_INFO: `/v3/users/ae588eb37afa4e638714e97c1a42d395` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:48.244824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c373485-d664-47cd-8cb1-8c8e11c5a739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae588eb37afa4e638714e97c1a42d395)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:48.246893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c373485-d664-47cd-8cb1-8c8e11c5a739 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:48.461850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9c373485-d664-47cd-8cb1-8c8e11c5a739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae588eb37afa4e638714e97c1a42d395'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:48.481972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9c373485-d664-47cd-8cb1-8c8e11c5a739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae588eb37afa4e638714e97c1a42d395'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:48.494828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9c373485-d664-47cd-8cb1-8c8e11c5a739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae588eb37afa4e638714e97c1a42d395'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:48.495649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9c373485-d664-47cd-8cb1-8c8e11c5a739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae588eb37afa4e638714e97c1a42d395'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:48.570199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9c373485-d664-47cd-8cb1-8c8e11c5a739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae588eb37afa4e638714e97c1a42d395'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:48.577524 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1281/2512] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:13:48 2022] DELETE /identity/v3/users/ae588eb37afa4e638714e97c1a42d395 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:48.661927 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:49.000603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def92bd-e061-4c1b-857a-10a99c7b2fec service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:49.015327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def92bd-e061-4c1b-857a-10a99c7b2fec service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:49.111324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b84bb-ef7e-464e-a564-bfe29502e4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:49.112402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b84bb-ef7e-464e-a564-bfe29502e4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:49.112924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b84bb-ef7e-464e-a564-bfe29502e4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:49.113454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b84bb-ef7e-464e-a564-bfe29502e4e2 admin admin] PATH_INFO: `/v3/projects/6e8565151b8448fe999e41ae27e5c6e1` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:49.119714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b84bb-ef7e-464e-a564-bfe29502e4e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e8565151b8448fe999e41ae27e5c6e1)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:49.133543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b84bb-ef7e-464e-a564-bfe29502e4e2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:49.269739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-983b84bb-ef7e-464e-a564-bfe29502e4e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e8565151b8448fe999e41ae27e5c6e1', 'request_id': 'req-983b84bb-ef7e-464e-a564-bfe29502e4e2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:49.419400 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:49.421914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-983b84bb-ef7e-464e-a564-bfe29502e4e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e8565151b8448fe999e41ae27e5c6e1', 'request_id': 'req-983b84bb-ef7e-464e-a564-bfe29502e4e2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:49.430566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-983b84bb-ef7e-464e-a564-bfe29502e4e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e8565151b8448fe999e41ae27e5c6e1', 'request_id': 'req-983b84bb-ef7e-464e-a564-bfe29502e4e2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:49.445377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-983b84bb-ef7e-464e-a564-bfe29502e4e2 admin admin] The token cache is being invalidate because project 6e8565151b8448fe999e41ae27e5c6e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:13:49.446052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-983b84bb-ef7e-464e-a564-bfe29502e4e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:49.446861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-983b84bb-ef7e-464e-a564-bfe29502e4e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:49.448882 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1232/2513] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:13:48 2022] DELETE /identity/v3/projects/6e8565151b8448fe999e41ae27e5c6e1 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:49.452844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c373485-d664-47cd-8cb1-8c8e11c5a739 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:49.454454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9c373485-d664-47cd-8cb1-8c8e11c5a739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:49.474043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c373485-d664-47cd-8cb1-8c8e11c5a739 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:49.574863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10390d-3ac1-4c26-aa3d-413f72853619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:49.576850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10390d-3ac1-4c26-aa3d-413f72853619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:49.576850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10390d-3ac1-4c26-aa3d-413f72853619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:49.576850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10390d-3ac1-4c26-aa3d-413f72853619 admin admin] PATH_INFO: `/v3/users/c88749201ee34311be9bf83ae5523020` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:49.577466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10390d-3ac1-4c26-aa3d-413f72853619 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c88749201ee34311be9bf83ae5523020)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:49.580028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e10390d-3ac1-4c26-aa3d-413f72853619 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:49.794130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2e10390d-3ac1-4c26-aa3d-413f72853619 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c88749201ee34311be9bf83ae5523020'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:49.815159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2e10390d-3ac1-4c26-aa3d-413f72853619 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c88749201ee34311be9bf83ae5523020'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:49.826053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2e10390d-3ac1-4c26-aa3d-413f72853619 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c88749201ee34311be9bf83ae5523020'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:49.826955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2e10390d-3ac1-4c26-aa3d-413f72853619 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c88749201ee34311be9bf83ae5523020'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:49.940729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d5ce6-5118-4413-bae2-7a0d9d6cde3d None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:49.941024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d5ce6-5118-4413-bae2-7a0d9d6cde3d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:49.941373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d5ce6-5118-4413-bae2-7a0d9d6cde3d None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:49.943164 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1233/2514] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:13:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:13:49.948928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c44de-97e1-47ea-9821-6f0ab15e1913 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:49.957207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c44de-97e1-47ea-9821-6f0ab15e1913 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:49.957207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c44de-97e1-47ea-9821-6f0ab15e1913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:49.975153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ba5c44de-97e1-47ea-9821-6f0ab15e1913 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:49.977681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ba5c44de-97e1-47ea-9821-6f0ab15e1913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:49.979135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2e10390d-3ac1-4c26-aa3d-413f72853619 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c88749201ee34311be9bf83ae5523020'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:49.995513 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1282/2515] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:13:49 2022] DELETE /identity/v3/users/c88749201ee34311be9bf83ae5523020 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:50.049451 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1234/2516] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:13:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:50.076581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10390d-3ac1-4c26-aa3d-413f72853619 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:50.078791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2e10390d-3ac1-4c26-aa3d-413f72853619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:50.221882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10390d-3ac1-4c26-aa3d-413f72853619 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:50.234060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456502b0-3cc1-4639-b6e4-fcdd30c68bb4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:50.238215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456502b0-3cc1-4639-b6e4-fcdd30c68bb4 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:50.238215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456502b0-3cc1-4639-b6e4-fcdd30c68bb4 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:50.238215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456502b0-3cc1-4639-b6e4-fcdd30c68bb4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:50.266146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456502b0-3cc1-4639-b6e4-fcdd30c68bb4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:50.267958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456502b0-3cc1-4639-b6e4-fcdd30c68bb4 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:50.298736 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1283/2517] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:13:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:13:50.532785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c44de-97e1-47ea-9821-6f0ab15e1913 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:50.532785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ba5c44de-97e1-47ea-9821-6f0ab15e1913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:50.552352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c44de-97e1-47ea-9821-6f0ab15e1913 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:50.681079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14e5ce-6307-4540-b96b-bea61b1cf2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:50.681968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14e5ce-6307-4540-b96b-bea61b1cf2aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:50.682284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14e5ce-6307-4540-b96b-bea61b1cf2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:50.682569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14e5ce-6307-4540-b96b-bea61b1cf2aa admin admin] PATH_INFO: `/v3/projects/5579fd0e2f6c45d1bf066c6109d58871` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:50.688082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14e5ce-6307-4540-b96b-bea61b1cf2aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=5579fd0e2f6c45d1bf066c6109d58871)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:50.695557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14e5ce-6307-4540-b96b-bea61b1cf2aa admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:50.856847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4e14e5ce-6307-4540-b96b-bea61b1cf2aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5579fd0e2f6c45d1bf066c6109d58871', 'request_id': 'req-4e14e5ce-6307-4540-b96b-bea61b1cf2aa'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:50.932601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4e14e5ce-6307-4540-b96b-bea61b1cf2aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5579fd0e2f6c45d1bf066c6109d58871', 'request_id': 'req-4e14e5ce-6307-4540-b96b-bea61b1cf2aa'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:50.941366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4e14e5ce-6307-4540-b96b-bea61b1cf2aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5579fd0e2f6c45d1bf066c6109d58871', 'request_id': 'req-4e14e5ce-6307-4540-b96b-bea61b1cf2aa'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:50.962512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4e14e5ce-6307-4540-b96b-bea61b1cf2aa admin admin] The token cache is being invalidate because project 5579fd0e2f6c45d1bf066c6109d58871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:13:50.963404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4e14e5ce-6307-4540-b96b-bea61b1cf2aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:50.966506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4e14e5ce-6307-4540-b96b-bea61b1cf2aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:13:50.968478 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1235/2518] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:13:50 2022] DELETE /identity/v3/projects/5579fd0e2f6c45d1bf066c6109d58871 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:50.974333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90e59a-27af-41d1-b39e-4875a7b28c14 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:50.974860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90e59a-27af-41d1-b39e-4875a7b28c14 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:50.975129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90e59a-27af-41d1-b39e-4875a7b28c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:51.008691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3b90e59a-27af-41d1-b39e-4875a7b28c14 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:51.009913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3b90e59a-27af-41d1-b39e-4875a7b28c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:51.123009 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:51.174908 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1284/2519] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:51.177711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ba04d-8b32-44fe-b9f2-1fd4ae7f42c3 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:51.178310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ba04d-8b32-44fe-b9f2-1fd4ae7f42c3 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:51.179271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ba04d-8b32-44fe-b9f2-1fd4ae7f42c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:51.230637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b64ba04d-8b32-44fe-b9f2-1fd4ae7f42c3 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:51.232663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b64ba04d-8b32-44fe-b9f2-1fd4ae7f42c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:51.247512 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1236/2520] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:51.248456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90e59a-27af-41d1-b39e-4875a7b28c14 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:51.277691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90e59a-27af-41d1-b39e-4875a7b28c14 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:51.291973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b089b-98c6-4d9a-9c28-f9a30570086f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:51.293060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b089b-98c6-4d9a-9c28-f9a30570086f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:51.293620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b089b-98c6-4d9a-9c28-f9a30570086f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:51.294083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b089b-98c6-4d9a-9c28-f9a30570086f admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:51.295866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b089b-98c6-4d9a-9c28-f9a30570086f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:13:51.296342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b089b-98c6-4d9a-9c28-f9a30570086f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:51.298418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b089b-98c6-4d9a-9c28-f9a30570086f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:51.320829 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1285/2521] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:13:51.324880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ba04d-8b32-44fe-b9f2-1fd4ae7f42c3 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:51.361105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ba04d-8b32-44fe-b9f2-1fd4ae7f42c3 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:51.382348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e845f4-8267-4e44-aa35-a4a06d0bffc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:51.385056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e845f4-8267-4e44-aa35-a4a06d0bffc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:51.387623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e845f4-8267-4e44-aa35-a4a06d0bffc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:51.388133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e845f4-8267-4e44-aa35-a4a06d0bffc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:51.389095 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e845f4-8267-4e44-aa35-a4a06d0bffc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:51.392077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e845f4-8267-4e44-aa35-a4a06d0bffc0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:51.507444 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1237/2522] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:13:51 2022] POST /identity/v3/projects => generated 391 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:13:51.510079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b089b-98c6-4d9a-9c28-f9a30570086f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:51.523356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b089b-98c6-4d9a-9c28-f9a30570086f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:51.633933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d861353-cf9d-4f38-892b-cf6f50426363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:51.634708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d861353-cf9d-4f38-892b-cf6f50426363 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:51.635033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d861353-cf9d-4f38-892b-cf6f50426363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:51.635325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d861353-cf9d-4f38-892b-cf6f50426363 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:51.636012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d861353-cf9d-4f38-892b-cf6f50426363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:51.637964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d861353-cf9d-4f38-892b-cf6f50426363 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:51.728840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197172de-2322-4a8b-b874-d625a4ba7a0f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:51.729402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197172de-2322-4a8b-b874-d625a4ba7a0f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:51.729402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197172de-2322-4a8b-b874-d625a4ba7a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:51.752440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-197172de-2322-4a8b-b874-d625a4ba7a0f None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:51.754503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-197172de-2322-4a8b-b874-d625a4ba7a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:51.780465 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1286/2523] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:13:51 2022] POST /identity/v3/users => generated 296 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:13:51.787470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d861353-cf9d-4f38-892b-cf6f50426363 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:51.836569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d861353-cf9d-4f38-892b-cf6f50426363 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:51.851346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773982d-c75e-4c22-b30a-f218521a6a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:51.853943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773982d-c75e-4c22-b30a-f218521a6a9b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:51.856247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773982d-c75e-4c22-b30a-f218521a6a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:51.857349 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:51.857816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5773982d-c75e-4c22-b30a-f218521a6a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:51.860664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773982d-c75e-4c22-b30a-f218521a6a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:51.866511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5773982d-c75e-4c22-b30a-f218521a6a9b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:51.882704 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1238/2524] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:13:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:13:51.896364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197172de-2322-4a8b-b874-d625a4ba7a0f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:51.901126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-197172de-2322-4a8b-b874-d625a4ba7a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:51.923762 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1287/2525] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:13:51.926472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773982d-c75e-4c22-b30a-f218521a6a9b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:51.963807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5773982d-c75e-4c22-b30a-f218521a6a9b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:51.974824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccea23-95f5-460c-956c-bb4eeb383957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:51.976090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccea23-95f5-460c-956c-bb4eeb383957 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:51.977244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccea23-95f5-460c-956c-bb4eeb383957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:51.980139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feccea23-95f5-460c-956c-bb4eeb383957 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:51.981881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feccea23-95f5-460c-956c-bb4eeb383957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:51.983398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feccea23-95f5-460c-956c-bb4eeb383957 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:52.006428 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1288/2526] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:13:52.017850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccea23-95f5-460c-956c-bb4eeb383957 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:52.036899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feccea23-95f5-460c-956c-bb4eeb383957 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:52.042951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f555229-c7fd-4cac-9956-c5fc1b50035a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:52.044178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f555229-c7fd-4cac-9956-c5fc1b50035a admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:52.044622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f555229-c7fd-4cac-9956-c5fc1b50035a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:52.045033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f555229-c7fd-4cac-9956-c5fc1b50035a admin admin] PATH_INFO: `/v3/projects/1ce224a2f151475daa4d765eed8e17e5/users/de5538109cd34b11b6b626ca047a6dd4/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:52.046916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197172de-2322-4a8b-b874-d625a4ba7a0f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:52.050916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ee9a0-bb41-46b6-892b-15d011f7fb27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:52.052408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ee9a0-bb41-46b6-892b-15d011f7fb27 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:52.052760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ee9a0-bb41-46b6-892b-15d011f7fb27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:52.052988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ee9a0-bb41-46b6-892b-15d011f7fb27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:52.074598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f555229-c7fd-4cac-9956-c5fc1b50035a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ce224a2f151475daa4d765eed8e17e5, user_id=de5538109cd34b11b6b626ca047a6dd4, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:52.078900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f555229-c7fd-4cac-9956-c5fc1b50035a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:52.117073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ee9a0-bb41-46b6-892b-15d011f7fb27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:52.118854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ee9a0-bb41-46b6-892b-15d011f7fb27 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:52.133890 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1239/2527] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:13:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:13:52.190925 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1289/2528] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:13:52 2022] PUT /identity/v3/projects/1ce224a2f151475daa4d765eed8e17e5/users/de5538109cd34b11b6b626ca047a6dd4/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:52.212669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd3626-f46a-4a8b-8b71-867a1aac0733 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:52.213060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd3626-f46a-4a8b-8b71-867a1aac0733 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:52.213408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd3626-f46a-4a8b-8b71-867a1aac0733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:52.266412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1ccd3626-f46a-4a8b-8b71-867a1aac0733 None None] MFA Rules not processed for user `de5538109cd34b11b6b626ca047a6dd4`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:52.270171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1ccd3626-f46a-4a8b-8b71-867a1aac0733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:52.461547 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1240/2529] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:52.462708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f555229-c7fd-4cac-9956-c5fc1b50035a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:52.539491 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:52.589488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f555229-c7fd-4cac-9956-c5fc1b50035a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:52.596207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde4af0-1c99-4b72-8666-24718558a1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:52.596987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde4af0-1c99-4b72-8666-24718558a1ee admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:52.597458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde4af0-1c99-4b72-8666-24718558a1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:52.597861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde4af0-1c99-4b72-8666-24718558a1ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:52.598884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde4af0-1c99-4b72-8666-24718558a1ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:52.602528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde4af0-1c99-4b72-8666-24718558a1ee admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:53.004850 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1290/2530] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:13:52 2022] POST /identity/v3/projects => generated 391 bytes in 544 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:13:53.009688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd3626-f46a-4a8b-8b71-867a1aac0733 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:53.023275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd3626-f46a-4a8b-8b71-867a1aac0733 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:53.103530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249d376-f776-4877-80a2-facfb39503e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:53.104662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249d376-f776-4877-80a2-facfb39503e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:53.105116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249d376-f776-4877-80a2-facfb39503e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:53.105562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4249d376-f776-4877-80a2-facfb39503e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:53.106678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249d376-f776-4877-80a2-facfb39503e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:53.122968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4249d376-f776-4877-80a2-facfb39503e7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:53.252743 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1241/2531] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:13:53 2022] POST /identity/v3/users => generated 302 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:13:53.256363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde4af0-1c99-4b72-8666-24718558a1ee admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:53.271612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde4af0-1c99-4b72-8666-24718558a1ee admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:53.281351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ac2c2-e961-4dd4-9ee0-c0b893b2126d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:53.282299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ac2c2-e961-4dd4-9ee0-c0b893b2126d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:53.282741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ac2c2-e961-4dd4-9ee0-c0b893b2126d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:53.283204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45ac2c2-e961-4dd4-9ee0-c0b893b2126d admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:53.284290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ac2c2-e961-4dd4-9ee0-c0b893b2126d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:53.286088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45ac2c2-e961-4dd4-9ee0-c0b893b2126d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:53.309847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249d376-f776-4877-80a2-facfb39503e7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:53.317375 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1291/2532] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:13:53.326014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4249d376-f776-4877-80a2-facfb39503e7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:53.335963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9853fc-0f4e-41c9-ab6a-6907d0c3461a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:53.337493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9853fc-0f4e-41c9-ab6a-6907d0c3461a admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:53.337856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9853fc-0f4e-41c9-ab6a-6907d0c3461a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:53.338262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9853fc-0f4e-41c9-ab6a-6907d0c3461a admin admin] PATH_INFO: `/v3/projects/6b5eda71225e455a8e4f93ef31687439/users/169e765a6b7f43deafbbf0527cf2f75a/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:53.361326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9853fc-0f4e-41c9-ab6a-6907d0c3461a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b5eda71225e455a8e4f93ef31687439, user_id=169e765a6b7f43deafbbf0527cf2f75a, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:53.364368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9853fc-0f4e-41c9-ab6a-6907d0c3461a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:53.490490 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1242/2533] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:13:53 2022] PUT /identity/v3/projects/6b5eda71225e455a8e4f93ef31687439/users/169e765a6b7f43deafbbf0527cf2f75a/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:53.495015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ac2c2-e961-4dd4-9ee0-c0b893b2126d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:53.543015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45ac2c2-e961-4dd4-9ee0-c0b893b2126d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:53.546777 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:53.738859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566b7b6-6a22-4059-88c5-0e897f2efc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:53.743372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566b7b6-6a22-4059-88c5-0e897f2efc19 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:53.743372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566b7b6-6a22-4059-88c5-0e897f2efc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:53.743372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566b7b6-6a22-4059-88c5-0e897f2efc19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:53.743372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566b7b6-6a22-4059-88c5-0e897f2efc19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:53.749261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566b7b6-6a22-4059-88c5-0e897f2efc19 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:53.779298 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1292/2534] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:13:53.791816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9853fc-0f4e-41c9-ab6a-6907d0c3461a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:53.806391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9853fc-0f4e-41c9-ab6a-6907d0c3461a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:53.812056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e06508-f79a-4520-811e-2170778bb507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:53.816708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e06508-f79a-4520-811e-2170778bb507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:53.816708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e06508-f79a-4520-811e-2170778bb507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:53.817473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e06508-f79a-4520-811e-2170778bb507 admin admin] PATH_INFO: `/v3/projects/6b5eda71225e455a8e4f93ef31687439/users/169e765a6b7f43deafbbf0527cf2f75a/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:53.823122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e06508-f79a-4520-811e-2170778bb507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b5eda71225e455a8e4f93ef31687439, user_id=169e765a6b7f43deafbbf0527cf2f75a, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:53.825935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e06508-f79a-4520-811e-2170778bb507 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:53.843030 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1243/2535] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:13:53 2022] PUT /identity/v3/projects/6b5eda71225e455a8e4f93ef31687439/users/169e765a6b7f43deafbbf0527cf2f75a/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:13:53.855962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2b02f-4b9b-4f4f-bfd0-5f5c1fda6cc5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:53.856301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2b02f-4b9b-4f4f-bfd0-5f5c1fda6cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:53.856513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2b02f-4b9b-4f4f-bfd0-5f5c1fda6cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:53.878716 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:53.903480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-87b2b02f-4b9b-4f4f-bfd0-5f5c1fda6cc5 None None] MFA Rules not processed for user `169e765a6b7f43deafbbf0527cf2f75a`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:53.904743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-87b2b02f-4b9b-4f4f-bfd0-5f5c1fda6cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:54.077144 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1293/2536] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:13:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:54.189937 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:54.232802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e06508-f79a-4520-811e-2170778bb507 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:54.235048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d0e06508-f79a-4520-811e-2170778bb507 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:54.432222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e06508-f79a-4520-811e-2170778bb507 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:54.447217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e610b9-1a4d-4b27-8f22-4284628b2756 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:54.447217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e610b9-1a4d-4b27-8f22-4284628b2756 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:54.447217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e610b9-1a4d-4b27-8f22-4284628b2756 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:54.447217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e610b9-1a4d-4b27-8f22-4284628b2756 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:54.534321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e610b9-1a4d-4b27-8f22-4284628b2756 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:54.536119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e610b9-1a4d-4b27-8f22-4284628b2756 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:54.548038 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1244/2537] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:13:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:13:54.664370 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:54.893086 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:55.075801 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:55.521146 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:56.215273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba25b1-0fd4-445f-b656-746e3b87cdfc None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:56.215849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba25b1-0fd4-445f-b656-746e3b87cdfc None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:56.215937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba25b1-0fd4-445f-b656-746e3b87cdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:56.225124 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:56.246897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b5ba25b1-0fd4-445f-b656-746e3b87cdfc None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:13:56.246897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b5ba25b1-0fd4-445f-b656-746e3b87cdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:56.333449 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1294/2538] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:13:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:13:56.348416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e610b9-1a4d-4b27-8f22-4284628b2756 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:13:56.350232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-06e610b9-1a4d-4b27-8f22-4284628b2756 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:13:56.469106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e610b9-1a4d-4b27-8f22-4284628b2756 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:13:56.483737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82df87-3c88-47ba-86bd-356349370748 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:13:56.484521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82df87-3c88-47ba-86bd-356349370748 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:13:56.485051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82df87-3c88-47ba-86bd-356349370748 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:13:56.485555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82df87-3c88-47ba-86bd-356349370748 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:13:56.508022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82df87-3c88-47ba-86bd-356349370748 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:13:56.512180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82df87-3c88-47ba-86bd-356349370748 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:13:56.535884 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1245/2539] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:13:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:13:57.389155 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:13:58.341744 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:14:02.491203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba25b1-0fd4-445f-b656-746e3b87cdfc None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:02.494202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b5ba25b1-0fd4-445f-b656-746e3b87cdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:02.529374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba25b1-0fd4-445f-b656-746e3b87cdfc None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:02.543975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549151b-f259-4dbe-96c2-47bdd25b001f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:02.545052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549151b-f259-4dbe-96c2-47bdd25b001f service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:02.545557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549151b-f259-4dbe-96c2-47bdd25b001f service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:02.546050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549151b-f259-4dbe-96c2-47bdd25b001f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:02.573889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549151b-f259-4dbe-96c2-47bdd25b001f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:02.576182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549151b-f259-4dbe-96c2-47bdd25b001f service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:02.624507 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1295/2540] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:14:02 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:14:04.047730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda9305-2811-480e-9cea-44cdc1ccc6a5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:04.054862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda9305-2811-480e-9cea-44cdc1ccc6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:04.054862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda9305-2811-480e-9cea-44cdc1ccc6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:04.073744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1bda9305-2811-480e-9cea-44cdc1ccc6a5 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:04.080632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1bda9305-2811-480e-9cea-44cdc1ccc6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:04.094737 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1246/2541] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:14:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:14:04.112299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549151b-f259-4dbe-96c2-47bdd25b001f service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:04.222466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549151b-f259-4dbe-96c2-47bdd25b001f service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:04.222466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47844355-7de7-4de6-b54a-031cf12e4b7d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:04.222466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47844355-7de7-4de6-b54a-031cf12e4b7d service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:04.222466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47844355-7de7-4de6-b54a-031cf12e4b7d service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:04.223121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47844355-7de7-4de6-b54a-031cf12e4b7d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:04.223121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47844355-7de7-4de6-b54a-031cf12e4b7d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:04.223121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47844355-7de7-4de6-b54a-031cf12e4b7d service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:04.223121 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1296/2542] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:14:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:14:04.625973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afada1-90e1-47f1-9b0e-f336b5f07211 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:04.629076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afada1-90e1-47f1-9b0e-f336b5f07211 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:04.629278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afada1-90e1-47f1-9b0e-f336b5f07211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:04.648053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a9afada1-90e1-47f1-9b0e-f336b5f07211 None None] MFA Rules not processed for user `865ff993f6a440d4a25b34daed8cd6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:04.649265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a9afada1-90e1-47f1-9b0e-f336b5f07211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:04.655317 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:14:04.737486 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1247/2543] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:14:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:14:06.612656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47844355-7de7-4de6-b54a-031cf12e4b7d service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:06.618294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-47844355-7de7-4de6-b54a-031cf12e4b7d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:06.795899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47844355-7de7-4de6-b54a-031cf12e4b7d service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:06.826700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853e44a-293c-46a1-860d-8d7242960402 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:06.827738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853e44a-293c-46a1-860d-8d7242960402 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:06.827738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853e44a-293c-46a1-860d-8d7242960402 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:06.827947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853e44a-293c-46a1-860d-8d7242960402 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:06.837583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9853e44a-293c-46a1-860d-8d7242960402 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:06.877554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853e44a-293c-46a1-860d-8d7242960402 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:06.879237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853e44a-293c-46a1-860d-8d7242960402 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:06.935162 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1297/2544] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:14:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:14:08.668171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44efd11-6d2d-4d28-be25-7fd5126ee8f4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:08.668720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44efd11-6d2d-4d28-be25-7fd5126ee8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:08.668720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44efd11-6d2d-4d28-be25-7fd5126ee8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:08.718413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e44efd11-6d2d-4d28-be25-7fd5126ee8f4 None None] MFA Rules not processed for user `5c0882e092c644758966c19d52d86795`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:08.721616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e44efd11-6d2d-4d28-be25-7fd5126ee8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:08.899755 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1248/2545] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:14:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:14:11.844330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853e44a-293c-46a1-860d-8d7242960402 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:11.846701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9853e44a-293c-46a1-860d-8d7242960402 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:11.869272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853e44a-293c-46a1-860d-8d7242960402 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:11.875201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cadae26-5a87-40ac-afba-b685a0ebff1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:11.876417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadae26-5a87-40ac-afba-b685a0ebff1e service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:11.876713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadae26-5a87-40ac-afba-b685a0ebff1e service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:11.876992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cadae26-5a87-40ac-afba-b685a0ebff1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:11.878938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7cadae26-5a87-40ac-afba-b685a0ebff1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:11.895437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadae26-5a87-40ac-afba-b685a0ebff1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:11.897667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cadae26-5a87-40ac-afba-b685a0ebff1e service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:11.935445 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1298/2546] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:14:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:14:12.973790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44efd11-6d2d-4d28-be25-7fd5126ee8f4 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:13.194274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44efd11-6d2d-4d28-be25-7fd5126ee8f4 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:13.242201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca728a15-c807-4478-a317-d8719b0d196d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:13.243029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca728a15-c807-4478-a317-d8719b0d196d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:13.243312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca728a15-c807-4478-a317-d8719b0d196d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:13.243590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca728a15-c807-4478-a317-d8719b0d196d admin admin] PATH_INFO: `/v3/users/de5538109cd34b11b6b626ca047a6dd4` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:13.246036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca728a15-c807-4478-a317-d8719b0d196d admin admin] RBAC: Authorizing `identity:delete_user(user_id=de5538109cd34b11b6b626ca047a6dd4)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:13.248011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca728a15-c807-4478-a317-d8719b0d196d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:13.532514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ca728a15-c807-4478-a317-d8719b0d196d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de5538109cd34b11b6b626ca047a6dd4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:13.587642 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:14:13.591000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ca728a15-c807-4478-a317-d8719b0d196d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de5538109cd34b11b6b626ca047a6dd4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:13.593480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ca728a15-c807-4478-a317-d8719b0d196d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de5538109cd34b11b6b626ca047a6dd4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:13.594313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ca728a15-c807-4478-a317-d8719b0d196d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de5538109cd34b11b6b626ca047a6dd4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:13.613567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ca728a15-c807-4478-a317-d8719b0d196d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de5538109cd34b11b6b626ca047a6dd4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:13.705198 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1249/2547] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:14:12 2022] DELETE /identity/v3/users/de5538109cd34b11b6b626ca047a6dd4 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:14:13.711220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea78e0c-0cbc-4c53-8d61-2339d2fa4cc1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:13.711865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea78e0c-0cbc-4c53-8d61-2339d2fa4cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:13.712246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea78e0c-0cbc-4c53-8d61-2339d2fa4cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:13.758029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-dea78e0c-0cbc-4c53-8d61-2339d2fa4cc1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:13.760180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dea78e0c-0cbc-4c53-8d61-2339d2fa4cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:13.820984 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:14:13.830204 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1299/2548] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:14:13.846553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca728a15-c807-4478-a317-d8719b0d196d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:13.849098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ca728a15-c807-4478-a317-d8719b0d196d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:13.952996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca728a15-c807-4478-a317-d8719b0d196d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:13.958721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dd490-9abb-4fca-9480-e25c4186927f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:13.959549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dd490-9abb-4fca-9480-e25c4186927f service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:13.959842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dd490-9abb-4fca-9480-e25c4186927f service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:13.960924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dd490-9abb-4fca-9480-e25c4186927f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:13.990260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691dd490-9abb-4fca-9480-e25c4186927f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:13.993191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691dd490-9abb-4fca-9480-e25c4186927f service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:14.012140 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1250/2549] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:14:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:14:14.796950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea78e0c-0cbc-4c53-8d61-2339d2fa4cc1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:14.799346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dea78e0c-0cbc-4c53-8d61-2339d2fa4cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:14.816636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea78e0c-0cbc-4c53-8d61-2339d2fa4cc1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:14.824557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fefc4-772d-4dd1-8cd9-924e1e33b177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:14.826334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fefc4-772d-4dd1-8cd9-924e1e33b177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:14.827978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fefc4-772d-4dd1-8cd9-924e1e33b177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:14.830079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60fefc4-772d-4dd1-8cd9-924e1e33b177 admin admin] PATH_INFO: `/v3/projects/1ce224a2f151475daa4d765eed8e17e5` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:14.832459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60fefc4-772d-4dd1-8cd9-924e1e33b177 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ce224a2f151475daa4d765eed8e17e5)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:14.835917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60fefc4-772d-4dd1-8cd9-924e1e33b177 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:15.053815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e60fefc4-772d-4dd1-8cd9-924e1e33b177 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ce224a2f151475daa4d765eed8e17e5', 'request_id': 'req-e60fefc4-772d-4dd1-8cd9-924e1e33b177'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:15.067483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e60fefc4-772d-4dd1-8cd9-924e1e33b177 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ce224a2f151475daa4d765eed8e17e5', 'request_id': 'req-e60fefc4-772d-4dd1-8cd9-924e1e33b177'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:15.075600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e60fefc4-772d-4dd1-8cd9-924e1e33b177 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ce224a2f151475daa4d765eed8e17e5', 'request_id': 'req-e60fefc4-772d-4dd1-8cd9-924e1e33b177'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:15.230915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e60fefc4-772d-4dd1-8cd9-924e1e33b177 admin admin] The token cache is being invalidate because project 1ce224a2f151475daa4d765eed8e17e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:14:15.231434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e60fefc4-772d-4dd1-8cd9-924e1e33b177 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:15.243080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e60fefc4-772d-4dd1-8cd9-924e1e33b177 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:15.247668 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1300/2550] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:14:14 2022] DELETE /identity/v3/projects/1ce224a2f151475daa4d765eed8e17e5 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:14:15.249284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dd490-9abb-4fca-9480-e25c4186927f service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:15.276420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dd490-9abb-4fca-9480-e25c4186927f service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:15.405090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f65724-93ad-436a-b164-74a81a4de345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:15.409850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f65724-93ad-436a-b164-74a81a4de345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:15.410271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f65724-93ad-436a-b164-74a81a4de345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:15.410497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f65724-93ad-436a-b164-74a81a4de345 admin admin] PATH_INFO: `/v3/users/169e765a6b7f43deafbbf0527cf2f75a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:15.413368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f65724-93ad-436a-b164-74a81a4de345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=169e765a6b7f43deafbbf0527cf2f75a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:15.415853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f65724-93ad-436a-b164-74a81a4de345 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:15.578755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fefc4-772d-4dd1-8cd9-924e1e33b177 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:15.581352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e60fefc4-772d-4dd1-8cd9-924e1e33b177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:15.664763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60fefc4-772d-4dd1-8cd9-924e1e33b177 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:15.670763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d68219-cb22-41c6-b443-2034cfb40c5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:15.671420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d68219-cb22-41c6-b443-2034cfb40c5c service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:15.671709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d68219-cb22-41c6-b443-2034cfb40c5c service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:15.671993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d68219-cb22-41c6-b443-2034cfb40c5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:15.673860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f6d68219-cb22-41c6-b443-2034cfb40c5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:15.760772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d68219-cb22-41c6-b443-2034cfb40c5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:15.762431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d68219-cb22-41c6-b443-2034cfb40c5c service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:15.776313 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1301/2551] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:14:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:14:15.778169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0f9ac-3a22-41c4-acff-951745bc0a9f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:15.778475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0f9ac-3a22-41c4-acff-951745bc0a9f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:15.778758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0f9ac-3a22-41c4-acff-951745bc0a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:15.800097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4bf0f9ac-3a22-41c4-acff-951745bc0a9f None None] MFA Rules not processed for user `6b13cdd4117640b49cf9f74cc12d16f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:15.801320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4bf0f9ac-3a22-41c4-acff-951745bc0a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:15.815830 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:14:15.825397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-73f65724-93ad-436a-b164-74a81a4de345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '169e765a6b7f43deafbbf0527cf2f75a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:15.839571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-73f65724-93ad-436a-b164-74a81a4de345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '169e765a6b7f43deafbbf0527cf2f75a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:15.840563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-73f65724-93ad-436a-b164-74a81a4de345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '169e765a6b7f43deafbbf0527cf2f75a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:15.841389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-73f65724-93ad-436a-b164-74a81a4de345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '169e765a6b7f43deafbbf0527cf2f75a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:15.879374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-73f65724-93ad-436a-b164-74a81a4de345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '169e765a6b7f43deafbbf0527cf2f75a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:15.880276 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1302/2552] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:14:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:14:15.971123 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1251/2553] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:14:15 2022] DELETE /identity/v3/users/169e765a6b7f43deafbbf0527cf2f75a => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:14:16.261489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0f9ac-3a22-41c4-acff-951745bc0a9f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:16.263043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4bf0f9ac-3a22-41c4-acff-951745bc0a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:16.278564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0f9ac-3a22-41c4-acff-951745bc0a9f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:16.397519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6b8cf0-55fa-437a-9d86-92d56551580b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:16.399216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b8cf0-55fa-437a-9d86-92d56551580b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:16.399525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b8cf0-55fa-437a-9d86-92d56551580b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:16.399794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6b8cf0-55fa-437a-9d86-92d56551580b admin admin] PATH_INFO: `/v3/projects/6b5eda71225e455a8e4f93ef31687439` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:16.402013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b8cf0-55fa-437a-9d86-92d56551580b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b5eda71225e455a8e4f93ef31687439)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:16.404033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6b8cf0-55fa-437a-9d86-92d56551580b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:16.527896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3f6b8cf0-55fa-437a-9d86-92d56551580b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b5eda71225e455a8e4f93ef31687439', 'request_id': 'req-3f6b8cf0-55fa-437a-9d86-92d56551580b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:16.541784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3f6b8cf0-55fa-437a-9d86-92d56551580b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b5eda71225e455a8e4f93ef31687439', 'request_id': 'req-3f6b8cf0-55fa-437a-9d86-92d56551580b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:16.546533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3f6b8cf0-55fa-437a-9d86-92d56551580b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b5eda71225e455a8e4f93ef31687439', 'request_id': 'req-3f6b8cf0-55fa-437a-9d86-92d56551580b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:16.643598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3f6b8cf0-55fa-437a-9d86-92d56551580b admin admin] The token cache is being invalidate because project 6b5eda71225e455a8e4f93ef31687439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:14:16.644148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3f6b8cf0-55fa-437a-9d86-92d56551580b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:16.645704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3f6b8cf0-55fa-437a-9d86-92d56551580b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:16.654086 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1303/2554] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:14:16 2022] DELETE /identity/v3/projects/6b5eda71225e455a8e4f93ef31687439 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:14:16.656790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d8e90-4086-4516-b4e8-be2da0fa3378 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:16.657280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d8e90-4086-4516-b4e8-be2da0fa3378 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:16.657698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d8e90-4086-4516-b4e8-be2da0fa3378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:16.668385 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:14:16.687866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d48d8e90-4086-4516-b4e8-be2da0fa3378 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:16.689566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d48d8e90-4086-4516-b4e8-be2da0fa3378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:16.793224 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1252/2555] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:14:16.801143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7306fac-c7d2-4978-805c-5cabc2c341e0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:16.802004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7306fac-c7d2-4978-805c-5cabc2c341e0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:16.802481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7306fac-c7d2-4978-805c-5cabc2c341e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:16.829034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d7306fac-c7d2-4978-805c-5cabc2c341e0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:16.830294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d7306fac-c7d2-4978-805c-5cabc2c341e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:16.846958 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1304/2556] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:14:16.848383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d8e90-4086-4516-b4e8-be2da0fa3378 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:16.859792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48d8e90-4086-4516-b4e8-be2da0fa3378 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:16.865134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54685044-1990-4bd2-b93e-b140b2774a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:16.866571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54685044-1990-4bd2-b93e-b140b2774a5f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:16.867140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54685044-1990-4bd2-b93e-b140b2774a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:16.867425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54685044-1990-4bd2-b93e-b140b2774a5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:16.868173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54685044-1990-4bd2-b93e-b140b2774a5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:14:16.868484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54685044-1990-4bd2-b93e-b140b2774a5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:16.870085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54685044-1990-4bd2-b93e-b140b2774a5f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:16.883475 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1253/2557] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:14:16.887946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7306fac-c7d2-4978-805c-5cabc2c341e0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:16.898613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7306fac-c7d2-4978-805c-5cabc2c341e0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:16.903411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5a692-8263-4d41-8bb5-5bd0bb0b4010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:16.904106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5a692-8263-4d41-8bb5-5bd0bb0b4010 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:16.904389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5a692-8263-4d41-8bb5-5bd0bb0b4010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:16.904663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5a692-8263-4d41-8bb5-5bd0bb0b4010 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:16.905354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5a692-8263-4d41-8bb5-5bd0bb0b4010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:16.908122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5a692-8263-4d41-8bb5-5bd0bb0b4010 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:17.005966 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1305/2558] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:14:16 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:14:17.007869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54685044-1990-4bd2-b93e-b140b2774a5f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:17.033379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54685044-1990-4bd2-b93e-b140b2774a5f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:17.146742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d7ad8-a56e-4b56-8c0a-30ddb4f0dd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:17.147616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d7ad8-a56e-4b56-8c0a-30ddb4f0dd49 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:17.148110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d7ad8-a56e-4b56-8c0a-30ddb4f0dd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:17.148560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d7ad8-a56e-4b56-8c0a-30ddb4f0dd49 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:17.149556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d7ad8-a56e-4b56-8c0a-30ddb4f0dd49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:17.151735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d7ad8-a56e-4b56-8c0a-30ddb4f0dd49 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:17.289990 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1254/2559] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:14:17 2022] POST /identity/v3/users => generated 289 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:14:17.291638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5a692-8263-4d41-8bb5-5bd0bb0b4010 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:17.309557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5a692-8263-4d41-8bb5-5bd0bb0b4010 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:17.316904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bdb9a-e39e-4d33-a2ce-90d4db2ae109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:17.320391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bdb9a-e39e-4d33-a2ce-90d4db2ae109 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:17.320579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bdb9a-e39e-4d33-a2ce-90d4db2ae109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:17.321260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1bdb9a-e39e-4d33-a2ce-90d4db2ae109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:17.321943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1bdb9a-e39e-4d33-a2ce-90d4db2ae109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:17.326521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1bdb9a-e39e-4d33-a2ce-90d4db2ae109 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:17.346759 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1306/2560] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:14:17.347291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d7ad8-a56e-4b56-8c0a-30ddb4f0dd49 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:17.366072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d7ad8-a56e-4b56-8c0a-30ddb4f0dd49 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:17.373828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e0158-f497-4e07-968d-cc328d3f78bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:17.374917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e0158-f497-4e07-968d-cc328d3f78bf admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:17.375598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e0158-f497-4e07-968d-cc328d3f78bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:17.375888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e0158-f497-4e07-968d-cc328d3f78bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:17.382420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e0158-f497-4e07-968d-cc328d3f78bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:17.382420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e0158-f497-4e07-968d-cc328d3f78bf admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:17.400486 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1255/2561] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:14:17.401246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bdb9a-e39e-4d33-a2ce-90d4db2ae109 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:17.414841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1bdb9a-e39e-4d33-a2ce-90d4db2ae109 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:17.419993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532246e-1312-4870-85f5-1030d0cbe6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:17.422868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532246e-1312-4870-85f5-1030d0cbe6d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:17.422868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532246e-1312-4870-85f5-1030d0cbe6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:17.422868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532246e-1312-4870-85f5-1030d0cbe6d6 admin admin] PATH_INFO: `/v3/projects/6ebe78f1d6ed42db805439b9e4f27007/users/22d7d5a3152541a6859f21d01fd969d8/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:17.448721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532246e-1312-4870-85f5-1030d0cbe6d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ebe78f1d6ed42db805439b9e4f27007, user_id=22d7d5a3152541a6859f21d01fd969d8, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:17.451603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532246e-1312-4870-85f5-1030d0cbe6d6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:17.582978 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1307/2562] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:14:17 2022] PUT /identity/v3/projects/6ebe78f1d6ed42db805439b9e4f27007/users/22d7d5a3152541a6859f21d01fd969d8/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:14:17.587727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e0e8b-6d2f-4d39-aa92-a4fac0f68f40 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:17.588019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e0e8b-6d2f-4d39-aa92-a4fac0f68f40 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:17.588291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e0e8b-6d2f-4d39-aa92-a4fac0f68f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:17.642926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-494e0e8b-6d2f-4d39-aa92-a4fac0f68f40 None None] MFA Rules not processed for user `22d7d5a3152541a6859f21d01fd969d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:17.644379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-494e0e8b-6d2f-4d39-aa92-a4fac0f68f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:17.682496 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:14:17.799227 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1256/2563] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:14:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:14:17.805082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532246e-1312-4870-85f5-1030d0cbe6d6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:17.954826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532246e-1312-4870-85f5-1030d0cbe6d6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:17.968492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d499ba2-ca28-4723-9992-e21d262b5aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:17.969267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d499ba2-ca28-4723-9992-e21d262b5aaf admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:17.969650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d499ba2-ca28-4723-9992-e21d262b5aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:17.969976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d499ba2-ca28-4723-9992-e21d262b5aaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:17.971149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d499ba2-ca28-4723-9992-e21d262b5aaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:17.977908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d499ba2-ca28-4723-9992-e21d262b5aaf admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:18.102641 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1308/2564] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:14:17 2022] POST /identity/v3/projects => generated 375 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:14:18.107629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e0e8b-6d2f-4d39-aa92-a4fac0f68f40 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:18.125143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e0e8b-6d2f-4d39-aa92-a4fac0f68f40 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:18.249514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ac18e-fc09-4041-9967-379ef101c759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:18.250650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ac18e-fc09-4041-9967-379ef101c759 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:18.256985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ac18e-fc09-4041-9967-379ef101c759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:18.256985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760ac18e-fc09-4041-9967-379ef101c759 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:18.256985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ac18e-fc09-4041-9967-379ef101c759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:18.256985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760ac18e-fc09-4041-9967-379ef101c759 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:18.427580 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1257/2565] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:14:18 2022] POST /identity/v3/users => generated 294 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:14:18.432777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d499ba2-ca28-4723-9992-e21d262b5aaf admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:18.447285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d499ba2-ca28-4723-9992-e21d262b5aaf admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:18.453997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddce8c4-c1a8-43d3-9a1d-1c353f3a30a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:18.454891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddce8c4-c1a8-43d3-9a1d-1c353f3a30a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:18.455402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddce8c4-c1a8-43d3-9a1d-1c353f3a30a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:18.455854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddce8c4-c1a8-43d3-9a1d-1c353f3a30a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:18.456758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddce8c4-c1a8-43d3-9a1d-1c353f3a30a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:18.458590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddce8c4-c1a8-43d3-9a1d-1c353f3a30a5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:18.483943 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1309/2566] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:14:18.488249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ac18e-fc09-4041-9967-379ef101c759 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:18.501648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760ac18e-fc09-4041-9967-379ef101c759 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:18.507570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a86738-eef5-42ef-af69-0c5e7fc01593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:18.508840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a86738-eef5-42ef-af69-0c5e7fc01593 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:18.509281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a86738-eef5-42ef-af69-0c5e7fc01593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:18.509705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a86738-eef5-42ef-af69-0c5e7fc01593 admin admin] PATH_INFO: `/v3/projects/cb63ed4357af4f5dae8ef03b12ba2419/users/d9079e83d8a54344a2fb3a417455d55a/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:18.526619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a86738-eef5-42ef-af69-0c5e7fc01593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb63ed4357af4f5dae8ef03b12ba2419, user_id=d9079e83d8a54344a2fb3a417455d55a, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:18.529875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a86738-eef5-42ef-af69-0c5e7fc01593 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:18.560784 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:14:18.680622 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1258/2567] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:14:18 2022] PUT /identity/v3/projects/cb63ed4357af4f5dae8ef03b12ba2419/users/d9079e83d8a54344a2fb3a417455d55a/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:14:18.686033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddce8c4-c1a8-43d3-9a1d-1c353f3a30a5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:18.704078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddce8c4-c1a8-43d3-9a1d-1c353f3a30a5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:18.802172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0362862-8412-4b62-a2a3-e9ded4ccfcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:18.803984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0362862-8412-4b62-a2a3-e9ded4ccfcab admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:18.804289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0362862-8412-4b62-a2a3-e9ded4ccfcab admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:18.804573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0362862-8412-4b62-a2a3-e9ded4ccfcab admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:18.806524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0362862-8412-4b62-a2a3-e9ded4ccfcab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:18.811697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0362862-8412-4b62-a2a3-e9ded4ccfcab admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:18.827022 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1310/2568] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:14:18.831292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a86738-eef5-42ef-af69-0c5e7fc01593 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:18.849948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a86738-eef5-42ef-af69-0c5e7fc01593 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:18.856471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eefab90-59d8-4dfd-86b5-3fad1492535d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:18.857689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefab90-59d8-4dfd-86b5-3fad1492535d admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:18.858222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefab90-59d8-4dfd-86b5-3fad1492535d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:18.858651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eefab90-59d8-4dfd-86b5-3fad1492535d admin admin] PATH_INFO: `/v3/projects/cb63ed4357af4f5dae8ef03b12ba2419/users/d9079e83d8a54344a2fb3a417455d55a/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:18.862951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefab90-59d8-4dfd-86b5-3fad1492535d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb63ed4357af4f5dae8ef03b12ba2419, user_id=d9079e83d8a54344a2fb3a417455d55a, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:18.868048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eefab90-59d8-4dfd-86b5-3fad1492535d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:18.885406 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1259/2569] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:14:18 2022] PUT /identity/v3/projects/cb63ed4357af4f5dae8ef03b12ba2419/users/d9079e83d8a54344a2fb3a417455d55a/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:14:18.898744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69362b-4323-45c0-8c68-537f5d640132 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:18.900079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69362b-4323-45c0-8c68-537f5d640132 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:18.900370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69362b-4323-45c0-8c68-537f5d640132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:18.936661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2a69362b-4323-45c0-8c68-537f5d640132 None None] MFA Rules not processed for user `d9079e83d8a54344a2fb3a417455d55a`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:18.938208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2a69362b-4323-45c0-8c68-537f5d640132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:19.040634 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1311/2570] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:14:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:14:19.057373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdf465-d578-49f9-b398-286dd58fa969 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:19.057712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdf465-d578-49f9-b398-286dd58fa969 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:19.057944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdf465-d578-49f9-b398-286dd58fa969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:19.089176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5bbdf465-d578-49f9-b398-286dd58fa969 None None] MFA Rules not processed for user `22d7d5a3152541a6859f21d01fd969d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:19.091915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5bbdf465-d578-49f9-b398-286dd58fa969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:19.234740 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1260/2571] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:14:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:14:19.291132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69362b-4323-45c0-8c68-537f5d640132 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:19.292895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2a69362b-4323-45c0-8c68-537f5d640132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:19.420923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69362b-4323-45c0-8c68-537f5d640132 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:19.431313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc4004-7188-487a-87c4-a7be36a6f9eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:19.434360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc4004-7188-487a-87c4-a7be36a6f9eb service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:19.434360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc4004-7188-487a-87c4-a7be36a6f9eb service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:19.434360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc4004-7188-487a-87c4-a7be36a6f9eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:19.448082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc4004-7188-487a-87c4-a7be36a6f9eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:19.450961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abc4004-7188-487a-87c4-a7be36a6f9eb service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:19.483796 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1312/2572] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:14:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:14:19.710053 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:14:19.766331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6665e-ec9a-41cd-b2b2-2012e043bf71 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:19.766614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6665e-ec9a-41cd-b2b2-2012e043bf71 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:19.767104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6665e-ec9a-41cd-b2b2-2012e043bf71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:19.804884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7aa6665e-ec9a-41cd-b2b2-2012e043bf71 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:19.810510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7aa6665e-ec9a-41cd-b2b2-2012e043bf71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:19.924194 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:14:19.932253 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1261/2573] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:14:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:14:19.957024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc4004-7188-487a-87c4-a7be36a6f9eb service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:19.959827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7abc4004-7188-487a-87c4-a7be36a6f9eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:20.102596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc4004-7188-487a-87c4-a7be36a6f9eb service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:20.116891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c06577-c1c7-40a3-a6b5-acc87fa80b6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:20.117931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c06577-c1c7-40a3-a6b5-acc87fa80b6c service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:20.118397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c06577-c1c7-40a3-a6b5-acc87fa80b6c service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:20.118965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c06577-c1c7-40a3-a6b5-acc87fa80b6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:20.132037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c06577-c1c7-40a3-a6b5-acc87fa80b6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:20.134750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c06577-c1c7-40a3-a6b5-acc87fa80b6c service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:20.144722 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1313/2574] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:14:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:14:24.492970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10140cc9-46d0-4e56-ac6c-6bf3deaef3b0 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:24.492970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10140cc9-46d0-4e56-ac6c-6bf3deaef3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:24.493581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10140cc9-46d0-4e56-ac6c-6bf3deaef3b0 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:24.494632 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1262/2575] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:14:24.570869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275af770-8bdb-4917-9254-7feb7dddaf6a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:24.571761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275af770-8bdb-4917-9254-7feb7dddaf6a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:24.572245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275af770-8bdb-4917-9254-7feb7dddaf6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:24.602622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-275af770-8bdb-4917-9254-7feb7dddaf6a None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:24.603882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-275af770-8bdb-4917-9254-7feb7dddaf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:24.721711 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:14:24.751932 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1314/2576] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:14:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:14:24.790404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10140cc9-46d0-4e56-ac6c-6bf3deaef3b0 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:24.793393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-10140cc9-46d0-4e56-ac6c-6bf3deaef3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:24.948789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10140cc9-46d0-4e56-ac6c-6bf3deaef3b0 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:24.948789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc77436-b44e-4187-9c1e-c082d1a47ac2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:24.948789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc77436-b44e-4187-9c1e-c082d1a47ac2 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:24.948789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc77436-b44e-4187-9c1e-c082d1a47ac2 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:24.949227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc77436-b44e-4187-9c1e-c082d1a47ac2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:24.949227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc77436-b44e-4187-9c1e-c082d1a47ac2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:24.949227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc77436-b44e-4187-9c1e-c082d1a47ac2 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:24.965900 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1263/2577] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:14:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:14:31.547005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52199e57-3092-418f-a3bc-bdfedeccd029 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:31.547920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52199e57-3092-418f-a3bc-bdfedeccd029 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:31.548434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52199e57-3092-418f-a3bc-bdfedeccd029 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:31.550644 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1315/2578] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:14:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:14:31.570020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f62b9-0d8e-4980-9192-5df31d9b1f06 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:31.571103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f62b9-0d8e-4980-9192-5df31d9b1f06 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:31.571755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f62b9-0d8e-4980-9192-5df31d9b1f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:31.606324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-be6f62b9-0d8e-4980-9192-5df31d9b1f06 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:31.611127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-be6f62b9-0d8e-4980-9192-5df31d9b1f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:31.621574 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1264/2579] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:14:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:14:31.648849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52199e57-3092-418f-a3bc-bdfedeccd029 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:31.679380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52199e57-3092-418f-a3bc-bdfedeccd029 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:31.687671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bb946-c062-4ee3-a104-f88fa28054f6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:31.688733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bb946-c062-4ee3-a104-f88fa28054f6 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:31.689128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bb946-c062-4ee3-a104-f88fa28054f6 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:31.690024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5bb946-c062-4ee3-a104-f88fa28054f6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:31.712697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5bb946-c062-4ee3-a104-f88fa28054f6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:31.714469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5bb946-c062-4ee3-a104-f88fa28054f6 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:31.758919 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1316/2580] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:14:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:14:34.625151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f62b9-0d8e-4980-9192-5df31d9b1f06 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:34.627867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-be6f62b9-0d8e-4980-9192-5df31d9b1f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:34.757090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f62b9-0d8e-4980-9192-5df31d9b1f06 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:34.771881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413434c-6e0b-4c0f-ab77-75d42b099241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:34.773038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413434c-6e0b-4c0f-ab77-75d42b099241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:34.773402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413434c-6e0b-4c0f-ab77-75d42b099241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:34.773753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413434c-6e0b-4c0f-ab77-75d42b099241 admin admin] PATH_INFO: `/v3/users/c4a929fee10e45c8a072b778b7944ef8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:34.775122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413434c-6e0b-4c0f-ab77-75d42b099241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4a929fee10e45c8a072b778b7944ef8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:34.777269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413434c-6e0b-4c0f-ab77-75d42b099241 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:35.072253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1413434c-6e0b-4c0f-ab77-75d42b099241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4a929fee10e45c8a072b778b7944ef8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:35.110641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1413434c-6e0b-4c0f-ab77-75d42b099241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4a929fee10e45c8a072b778b7944ef8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:35.111394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1413434c-6e0b-4c0f-ab77-75d42b099241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4a929fee10e45c8a072b778b7944ef8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:35.112200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1413434c-6e0b-4c0f-ab77-75d42b099241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4a929fee10e45c8a072b778b7944ef8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:35.127854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1413434c-6e0b-4c0f-ab77-75d42b099241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4a929fee10e45c8a072b778b7944ef8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:35.279231 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1265/2581] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:14:34 2022] DELETE /identity/v3/users/c4a929fee10e45c8a072b778b7944ef8 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:14:36.050268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bb946-c062-4ee3-a104-f88fa28054f6 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:36.061879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5bb946-c062-4ee3-a104-f88fa28054f6 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:36.205683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed2835-b37f-423a-acbd-d6e81a1aa5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:36.206716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed2835-b37f-423a-acbd-d6e81a1aa5c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:36.210245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed2835-b37f-423a-acbd-d6e81a1aa5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:36.210245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed2835-b37f-423a-acbd-d6e81a1aa5c8 admin admin] PATH_INFO: `/v3/projects/78019b9af5224635add689b1db3af86c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:36.210245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed2835-b37f-423a-acbd-d6e81a1aa5c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78019b9af5224635add689b1db3af86c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:36.211667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed2835-b37f-423a-acbd-d6e81a1aa5c8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:36.364750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2aed2835-b37f-423a-acbd-d6e81a1aa5c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78019b9af5224635add689b1db3af86c', 'request_id': 'req-2aed2835-b37f-423a-acbd-d6e81a1aa5c8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:36.397469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2aed2835-b37f-423a-acbd-d6e81a1aa5c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78019b9af5224635add689b1db3af86c', 'request_id': 'req-2aed2835-b37f-423a-acbd-d6e81a1aa5c8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:36.411204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2aed2835-b37f-423a-acbd-d6e81a1aa5c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78019b9af5224635add689b1db3af86c', 'request_id': 'req-2aed2835-b37f-423a-acbd-d6e81a1aa5c8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:36.538128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2aed2835-b37f-423a-acbd-d6e81a1aa5c8 admin admin] The token cache is being invalidate because project 78019b9af5224635add689b1db3af86c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:14:36.538668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2aed2835-b37f-423a-acbd-d6e81a1aa5c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:36.539416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2aed2835-b37f-423a-acbd-d6e81a1aa5c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:36.542334 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1317/2582] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:14:36 2022] DELETE /identity/v3/projects/78019b9af5224635add689b1db3af86c => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:14:36.546226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413434c-6e0b-4c0f-ab77-75d42b099241 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:36.547902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1413434c-6e0b-4c0f-ab77-75d42b099241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:36.564829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413434c-6e0b-4c0f-ab77-75d42b099241 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:36.636695 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5e854-d8dc-430a-8cdd-4b8222d637e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:36.637400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5e854-d8dc-430a-8cdd-4b8222d637e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:36.637808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5e854-d8dc-430a-8cdd-4b8222d637e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:36.638214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5e854-d8dc-430a-8cdd-4b8222d637e3 admin admin] PATH_INFO: `/v3/users/f72faf2a7b364a849d7c8f26c8e84c2e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:36.640097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5e854-d8dc-430a-8cdd-4b8222d637e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f72faf2a7b364a849d7c8f26c8e84c2e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:36.641818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5e854-d8dc-430a-8cdd-4b8222d637e3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:36.643771 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:14:37.249343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b5c5e854-d8dc-430a-8cdd-4b8222d637e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f72faf2a7b364a849d7c8f26c8e84c2e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:37.268659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b5c5e854-d8dc-430a-8cdd-4b8222d637e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f72faf2a7b364a849d7c8f26c8e84c2e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:37.269699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b5c5e854-d8dc-430a-8cdd-4b8222d637e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f72faf2a7b364a849d7c8f26c8e84c2e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:37.270428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b5c5e854-d8dc-430a-8cdd-4b8222d637e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f72faf2a7b364a849d7c8f26c8e84c2e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:37.279960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b5c5e854-d8dc-430a-8cdd-4b8222d637e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f72faf2a7b364a849d7c8f26c8e84c2e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:37.384466 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1266/2583] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:14:36 2022] DELETE /identity/v3/users/f72faf2a7b364a849d7c8f26c8e84c2e => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:14:38.085142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed2835-b37f-423a-acbd-d6e81a1aa5c8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:38.087394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2aed2835-b37f-423a-acbd-d6e81a1aa5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:38.104866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed2835-b37f-423a-acbd-d6e81a1aa5c8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:38.218732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edca166-c76e-4010-a512-318e350cafb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:38.221139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edca166-c76e-4010-a512-318e350cafb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:38.221534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edca166-c76e-4010-a512-318e350cafb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:38.221816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edca166-c76e-4010-a512-318e350cafb2 admin admin] PATH_INFO: `/v3/projects/06224650fd414b5181ea9fc4738daa2e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:38.223315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edca166-c76e-4010-a512-318e350cafb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06224650fd414b5181ea9fc4738daa2e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:38.228805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edca166-c76e-4010-a512-318e350cafb2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:38.245897 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:14:38.416522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9edca166-c76e-4010-a512-318e350cafb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06224650fd414b5181ea9fc4738daa2e', 'request_id': 'req-9edca166-c76e-4010-a512-318e350cafb2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:38.429994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9edca166-c76e-4010-a512-318e350cafb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06224650fd414b5181ea9fc4738daa2e', 'request_id': 'req-9edca166-c76e-4010-a512-318e350cafb2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:38.448098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9edca166-c76e-4010-a512-318e350cafb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06224650fd414b5181ea9fc4738daa2e', 'request_id': 'req-9edca166-c76e-4010-a512-318e350cafb2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:38.577209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9edca166-c76e-4010-a512-318e350cafb2 admin admin] The token cache is being invalidate because project 06224650fd414b5181ea9fc4738daa2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:14:38.577720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9edca166-c76e-4010-a512-318e350cafb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:38.579059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9edca166-c76e-4010-a512-318e350cafb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:38.582140 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1318/2584] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:14:38 2022] DELETE /identity/v3/projects/06224650fd414b5181ea9fc4738daa2e => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:14:38.587898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424a5d8-e5bd-4aec-94aa-730c69dd73c9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:38.588428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424a5d8-e5bd-4aec-94aa-730c69dd73c9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:38.603807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424a5d8-e5bd-4aec-94aa-730c69dd73c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:38.612503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5424a5d8-e5bd-4aec-94aa-730c69dd73c9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:38.613777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5424a5d8-e5bd-4aec-94aa-730c69dd73c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:38.734366 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1267/2585] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:14:38.743120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac8c65-f07b-49b0-abcf-2f5e80aa8e85 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:38.743670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac8c65-f07b-49b0-abcf-2f5e80aa8e85 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:38.744011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac8c65-f07b-49b0-abcf-2f5e80aa8e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:38.772825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-59ac8c65-f07b-49b0-abcf-2f5e80aa8e85 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:38.774283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-59ac8c65-f07b-49b0-abcf-2f5e80aa8e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:38.784324 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1319/2586] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:14:38.789720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424a5d8-e5bd-4aec-94aa-730c69dd73c9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:38.801596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424a5d8-e5bd-4aec-94aa-730c69dd73c9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:38.812629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fc226-d27c-4a8a-bc38-61f0722288ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:38.814314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fc226-d27c-4a8a-bc38-61f0722288ea admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:38.815261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fc226-d27c-4a8a-bc38-61f0722288ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:38.815657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6fc226-d27c-4a8a-bc38-61f0722288ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:38.817027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fc226-d27c-4a8a-bc38-61f0722288ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:14:38.817749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fc226-d27c-4a8a-bc38-61f0722288ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:38.821636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6fc226-d27c-4a8a-bc38-61f0722288ea admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:38.847306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac8c65-f07b-49b0-abcf-2f5e80aa8e85 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:38.854837 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1268/2587] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:14:38.859477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac8c65-f07b-49b0-abcf-2f5e80aa8e85 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:38.864797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4001ff8-f3bc-4131-aeac-64b91dd260c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:38.865628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4001ff8-f3bc-4131-aeac-64b91dd260c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:38.865858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4001ff8-f3bc-4131-aeac-64b91dd260c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:38.866220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4001ff8-f3bc-4131-aeac-64b91dd260c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:38.870065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4001ff8-f3bc-4131-aeac-64b91dd260c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:38.870065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4001ff8-f3bc-4131-aeac-64b91dd260c4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:39.021668 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1320/2588] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:14:38 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:14:39.021774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fc226-d27c-4a8a-bc38-61f0722288ea admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:39.040678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6fc226-d27c-4a8a-bc38-61f0722288ea admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:39.130786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edbd2f-8479-4a5a-8fb5-f1b7ce3027ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:39.131509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edbd2f-8479-4a5a-8fb5-f1b7ce3027ac admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:39.132077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edbd2f-8479-4a5a-8fb5-f1b7ce3027ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:39.132370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edbd2f-8479-4a5a-8fb5-f1b7ce3027ac admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:39.133846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26edbd2f-8479-4a5a-8fb5-f1b7ce3027ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:39.136805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26edbd2f-8479-4a5a-8fb5-f1b7ce3027ac admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:39.149181 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:14:39.249160 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1269/2589] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:14:39 2022] POST /identity/v3/users => generated 294 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:14:39.254063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4001ff8-f3bc-4131-aeac-64b91dd260c4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:39.266428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4001ff8-f3bc-4131-aeac-64b91dd260c4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:39.275025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fed96-2007-41ab-bc29-3fce93371427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:39.276491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fed96-2007-41ab-bc29-3fce93371427 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:39.276858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fed96-2007-41ab-bc29-3fce93371427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:39.281013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fed96-2007-41ab-bc29-3fce93371427 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:39.281013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fed96-2007-41ab-bc29-3fce93371427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:39.281013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4fed96-2007-41ab-bc29-3fce93371427 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:39.296557 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1321/2590] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:14:39.300440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edbd2f-8479-4a5a-8fb5-f1b7ce3027ac admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:39.316050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edbd2f-8479-4a5a-8fb5-f1b7ce3027ac admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:39.328835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f80363-8c50-4875-aaaf-6dffe5ad4ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:39.332822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f80363-8c50-4875-aaaf-6dffe5ad4ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:39.332822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f80363-8c50-4875-aaaf-6dffe5ad4ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:39.332822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f80363-8c50-4875-aaaf-6dffe5ad4ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:39.332822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f80363-8c50-4875-aaaf-6dffe5ad4ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:39.334607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f80363-8c50-4875-aaaf-6dffe5ad4ce2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:39.364190 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1270/2591] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:14:39.366456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fed96-2007-41ab-bc29-3fce93371427 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:39.391259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fed96-2007-41ab-bc29-3fce93371427 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:39.392247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad28c5-e517-4662-b977-e6505b906b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:39.393161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad28c5-e517-4662-b977-e6505b906b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:39.393502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad28c5-e517-4662-b977-e6505b906b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:39.393786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fad28c5-e517-4662-b977-e6505b906b04 admin admin] PATH_INFO: `/v3/projects/b9d1daa11da543d7a8088edb5f48e7e1/users/9ec89b63f3eb421fbb2eb2494016f258/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:39.410266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad28c5-e517-4662-b977-e6505b906b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9d1daa11da543d7a8088edb5f48e7e1, user_id=9ec89b63f3eb421fbb2eb2494016f258, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:39.413071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fad28c5-e517-4662-b977-e6505b906b04 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:39.486829 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1322/2592] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:14:39 2022] PUT /identity/v3/projects/b9d1daa11da543d7a8088edb5f48e7e1/users/9ec89b63f3eb421fbb2eb2494016f258/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:14:39.497790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c6d61-58cc-43f4-9d40-d178d795e7ed None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:39.498077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c6d61-58cc-43f4-9d40-d178d795e7ed None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:39.498724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c6d61-58cc-43f4-9d40-d178d795e7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:39.529253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b34c6d61-58cc-43f4-9d40-d178d795e7ed None None] MFA Rules not processed for user `9ec89b63f3eb421fbb2eb2494016f258`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:39.533568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b34c6d61-58cc-43f4-9d40-d178d795e7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:39.663592 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1271/2593] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:14:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:14:39.665324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad28c5-e517-4662-b977-e6505b906b04 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:39.752012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fad28c5-e517-4662-b977-e6505b906b04 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:39.787192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a386d-6e13-4f29-89ec-fc9f9ecd5386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:39.787192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a386d-6e13-4f29-89ec-fc9f9ecd5386 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:39.787192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a386d-6e13-4f29-89ec-fc9f9ecd5386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:39.787192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a386d-6e13-4f29-89ec-fc9f9ecd5386 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:39.788195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a386d-6e13-4f29-89ec-fc9f9ecd5386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:39.788195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1a386d-6e13-4f29-89ec-fc9f9ecd5386 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:39.918207 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1323/2594] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:14:39 2022] POST /identity/v3/projects => generated 387 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:14:39.918771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c6d61-58cc-43f4-9d40-d178d795e7ed None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:39.930545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c6d61-58cc-43f4-9d40-d178d795e7ed None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:39.947476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebbfbc-919f-4c2c-997f-12d38205fc29 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:39.947771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebbfbc-919f-4c2c-997f-12d38205fc29 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:39.948059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebbfbc-919f-4c2c-997f-12d38205fc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:39.971936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5cebbfbc-919f-4c2c-997f-12d38205fc29 None None] MFA Rules not processed for user `a6fc909d2c0843b8a29eb1d47a755db9`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:39.973067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5cebbfbc-919f-4c2c-997f-12d38205fc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:39.993786 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:14:40.001054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e300f-a03a-42e6-84cf-295b6b408dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:40.001789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e300f-a03a-42e6-84cf-295b6b408dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:40.002772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e300f-a03a-42e6-84cf-295b6b408dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:40.003179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e300f-a03a-42e6-84cf-295b6b408dc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:40.003967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e300f-a03a-42e6-84cf-295b6b408dc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:40.006475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e300f-a03a-42e6-84cf-295b6b408dc6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:40.062046 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1324/2595] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:14:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:14:40.101282 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1272/2596] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:14:39 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:14:40.105985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebbfbc-919f-4c2c-997f-12d38205fc29 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:40.119467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebbfbc-919f-4c2c-997f-12d38205fc29 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:40.127037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09125e2a-e6c3-4492-bb4a-417dbc86cc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:40.127773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09125e2a-e6c3-4492-bb4a-417dbc86cc94 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:40.128111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09125e2a-e6c3-4492-bb4a-417dbc86cc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:40.131721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09125e2a-e6c3-4492-bb4a-417dbc86cc94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:40.131721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09125e2a-e6c3-4492-bb4a-417dbc86cc94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:40.132645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09125e2a-e6c3-4492-bb4a-417dbc86cc94 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:40.149102 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1325/2597] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:14:40.150215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e300f-a03a-42e6-84cf-295b6b408dc6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:40.161234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e300f-a03a-42e6-84cf-295b6b408dc6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:40.166070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b3d82-b32a-45a5-88d3-8f3c681f1495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:40.167134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b3d82-b32a-45a5-88d3-8f3c681f1495 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:40.167330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b3d82-b32a-45a5-88d3-8f3c681f1495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:40.167584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5b3d82-b32a-45a5-88d3-8f3c681f1495 admin admin] PATH_INFO: `/v3/projects/de3e544a771a4dc694f513f7375b7092/users/4b94d9650df44e349e8a9ef2ffd41b3a/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:40.185692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b3d82-b32a-45a5-88d3-8f3c681f1495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de3e544a771a4dc694f513f7375b7092, user_id=4b94d9650df44e349e8a9ef2ffd41b3a, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:40.187857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5b3d82-b32a-45a5-88d3-8f3c681f1495 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:40.279338 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1273/2598] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:14:40 2022] PUT /identity/v3/projects/de3e544a771a4dc694f513f7375b7092/users/4b94d9650df44e349e8a9ef2ffd41b3a/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:14:40.283522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09125e2a-e6c3-4492-bb4a-417dbc86cc94 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:40.296629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09125e2a-e6c3-4492-bb4a-417dbc86cc94 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:40.378442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181f034-770c-487c-85f1-856954bf3b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:40.379327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181f034-770c-487c-85f1-856954bf3b5b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:40.379681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181f034-770c-487c-85f1-856954bf3b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:40.379908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181f034-770c-487c-85f1-856954bf3b5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:40.381233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181f034-770c-487c-85f1-856954bf3b5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:40.382815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181f034-770c-487c-85f1-856954bf3b5b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:40.396961 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1326/2599] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:14:40.402002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b3d82-b32a-45a5-88d3-8f3c681f1495 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:40.418758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5b3d82-b32a-45a5-88d3-8f3c681f1495 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:40.424326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e78f16-fe67-4768-be00-face749f5dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:40.425334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e78f16-fe67-4768-be00-face749f5dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:40.425686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e78f16-fe67-4768-be00-face749f5dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:40.426197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e78f16-fe67-4768-be00-face749f5dfe admin admin] PATH_INFO: `/v3/projects/de3e544a771a4dc694f513f7375b7092/users/4b94d9650df44e349e8a9ef2ffd41b3a/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:40.429642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e78f16-fe67-4768-be00-face749f5dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=de3e544a771a4dc694f513f7375b7092, user_id=4b94d9650df44e349e8a9ef2ffd41b3a, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:40.432246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e78f16-fe67-4768-be00-face749f5dfe admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:40.445265 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1274/2600] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:14:40 2022] PUT /identity/v3/projects/de3e544a771a4dc694f513f7375b7092/users/4b94d9650df44e349e8a9ef2ffd41b3a/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:14:40.455524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242db1dd-3737-4133-8ad1-1a148daf0d39 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:40.455810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242db1dd-3737-4133-8ad1-1a148daf0d39 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:40.456264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242db1dd-3737-4133-8ad1-1a148daf0d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:40.490604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-242db1dd-3737-4133-8ad1-1a148daf0d39 None None] MFA Rules not processed for user `4b94d9650df44e349e8a9ef2ffd41b3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:40.491952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-242db1dd-3737-4133-8ad1-1a148daf0d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:40.578205 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1327/2601] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:14:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:14:40.592163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd376ed1-001a-4eee-a8ef-0456767e0b1b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:40.592501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd376ed1-001a-4eee-a8ef-0456767e0b1b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:40.600379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd376ed1-001a-4eee-a8ef-0456767e0b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:40.647111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-dd376ed1-001a-4eee-a8ef-0456767e0b1b None None] MFA Rules not processed for user `9ec89b63f3eb421fbb2eb2494016f258`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:40.659368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-dd376ed1-001a-4eee-a8ef-0456767e0b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:40.708237 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:14:40.789227 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1275/2602] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:14:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:14:41.415532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242db1dd-3737-4133-8ad1-1a148daf0d39 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:41.418390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-242db1dd-3737-4133-8ad1-1a148daf0d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:41.467310 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:14:41.504892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242db1dd-3737-4133-8ad1-1a148daf0d39 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:41.510630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d4798-cf84-40e9-947d-d5c5e9c0cf94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:41.511357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d4798-cf84-40e9-947d-d5c5e9c0cf94 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:41.511710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d4798-cf84-40e9-947d-d5c5e9c0cf94 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:41.512058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d4798-cf84-40e9-947d-d5c5e9c0cf94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:41.520145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d4798-cf84-40e9-947d-d5c5e9c0cf94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:41.522365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d4798-cf84-40e9-947d-d5c5e9c0cf94 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:41.547332 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1328/2603] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:14:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:14:43.793116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd376ed1-001a-4eee-a8ef-0456767e0b1b None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:43.794776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-dd376ed1-001a-4eee-a8ef-0456767e0b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:43.815636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd376ed1-001a-4eee-a8ef-0456767e0b1b None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:43.828905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c215450-fa38-4fef-b2b0-d820443d13fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:43.829320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c215450-fa38-4fef-b2b0-d820443d13fb service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:43.829702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c215450-fa38-4fef-b2b0-d820443d13fb service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:43.830060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c215450-fa38-4fef-b2b0-d820443d13fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:43.832252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0c215450-fa38-4fef-b2b0-d820443d13fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:43.911581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c215450-fa38-4fef-b2b0-d820443d13fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:43.913345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c215450-fa38-4fef-b2b0-d820443d13fb service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:43.925083 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1276/2604] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:14:43 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:14:47.128385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22963ad1-e5b1-4aee-b050-f3ff1dc913e1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:47.128854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22963ad1-e5b1-4aee-b050-f3ff1dc913e1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:47.129034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22963ad1-e5b1-4aee-b050-f3ff1dc913e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:47.156075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-22963ad1-e5b1-4aee-b050-f3ff1dc913e1 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:47.157596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-22963ad1-e5b1-4aee-b050-f3ff1dc913e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:47.234990 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1329/2605] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:14:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:14:47.251289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c215450-fa38-4fef-b2b0-d820443d13fb service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:47.260041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0c215450-fa38-4fef-b2b0-d820443d13fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:47.352671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c215450-fa38-4fef-b2b0-d820443d13fb service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:47.361546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bb6f95-feed-43f2-94f3-b5d6120325dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:47.361546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb6f95-feed-43f2-94f3-b5d6120325dd service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:47.361546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb6f95-feed-43f2-94f3-b5d6120325dd service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:47.361546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bb6f95-feed-43f2-94f3-b5d6120325dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:47.374393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb6f95-feed-43f2-94f3-b5d6120325dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:47.376242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bb6f95-feed-43f2-94f3-b5d6120325dd service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:47.389524 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1277/2606] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:14:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:14:50.167843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22963ad1-e5b1-4aee-b050-f3ff1dc913e1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:50.169234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-22963ad1-e5b1-4aee-b050-f3ff1dc913e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:50.284405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22963ad1-e5b1-4aee-b050-f3ff1dc913e1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:50.295573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc4e03-b296-4de3-96ad-0ba383c2acde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:50.296789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc4e03-b296-4de3-96ad-0ba383c2acde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:50.297217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc4e03-b296-4de3-96ad-0ba383c2acde admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:50.297871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc4e03-b296-4de3-96ad-0ba383c2acde admin admin] PATH_INFO: `/v3/users/22d7d5a3152541a6859f21d01fd969d8` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:50.299382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc4e03-b296-4de3-96ad-0ba383c2acde admin admin] RBAC: Authorizing `identity:delete_user(user_id=22d7d5a3152541a6859f21d01fd969d8)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:50.301350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc4e03-b296-4de3-96ad-0ba383c2acde admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:50.548368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-10dc4e03-b296-4de3-96ad-0ba383c2acde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d7d5a3152541a6859f21d01fd969d8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:50.564437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-10dc4e03-b296-4de3-96ad-0ba383c2acde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d7d5a3152541a6859f21d01fd969d8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:50.570820 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:14:50.575218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-10dc4e03-b296-4de3-96ad-0ba383c2acde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d7d5a3152541a6859f21d01fd969d8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:50.576614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-10dc4e03-b296-4de3-96ad-0ba383c2acde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d7d5a3152541a6859f21d01fd969d8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:50.646200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-10dc4e03-b296-4de3-96ad-0ba383c2acde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d7d5a3152541a6859f21d01fd969d8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:50.657403 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1330/2607] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:14:50 2022] DELETE /identity/v3/users/22d7d5a3152541a6859f21d01fd969d8 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:14:50.662874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7c2e4-3dfc-4b8a-bdcb-bba9f565eb79 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:50.663939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7c2e4-3dfc-4b8a-bdcb-bba9f565eb79 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:50.664387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7c2e4-3dfc-4b8a-bdcb-bba9f565eb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:50.712244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-89a7c2e4-3dfc-4b8a-bdcb-bba9f565eb79 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:50.715038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-89a7c2e4-3dfc-4b8a-bdcb-bba9f565eb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:50.786029 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:14:50.803151 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1278/2608] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:14:50.815694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc4e03-b296-4de3-96ad-0ba383c2acde admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:50.818510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-10dc4e03-b296-4de3-96ad-0ba383c2acde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:50.898871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc4e03-b296-4de3-96ad-0ba383c2acde admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:50.906030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346701a3-568c-47ba-97c7-a5621d79e37a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:50.906888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346701a3-568c-47ba-97c7-a5621d79e37a service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:50.907181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346701a3-568c-47ba-97c7-a5621d79e37a service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:50.907467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346701a3-568c-47ba-97c7-a5621d79e37a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:50.945249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346701a3-568c-47ba-97c7-a5621d79e37a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:50.948051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346701a3-568c-47ba-97c7-a5621d79e37a service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:50.978922 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1331/2609] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:14:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:14:52.246744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7c2e4-3dfc-4b8a-bdcb-bba9f565eb79 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:52.249824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-89a7c2e4-3dfc-4b8a-bdcb-bba9f565eb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:52.267995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7c2e4-3dfc-4b8a-bdcb-bba9f565eb79 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:52.279868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8069232-f00d-4ed2-9a45-545a6fe55d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:52.282646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8069232-f00d-4ed2-9a45-545a6fe55d0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:52.283461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8069232-f00d-4ed2-9a45-545a6fe55d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:52.284027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8069232-f00d-4ed2-9a45-545a6fe55d0b admin admin] PATH_INFO: `/v3/projects/6ebe78f1d6ed42db805439b9e4f27007` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:52.285510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8069232-f00d-4ed2-9a45-545a6fe55d0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ebe78f1d6ed42db805439b9e4f27007)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:52.288475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8069232-f00d-4ed2-9a45-545a6fe55d0b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:52.441749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c8069232-f00d-4ed2-9a45-545a6fe55d0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ebe78f1d6ed42db805439b9e4f27007', 'request_id': 'req-c8069232-f00d-4ed2-9a45-545a6fe55d0b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:52.519294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c8069232-f00d-4ed2-9a45-545a6fe55d0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ebe78f1d6ed42db805439b9e4f27007', 'request_id': 'req-c8069232-f00d-4ed2-9a45-545a6fe55d0b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:52.528922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c8069232-f00d-4ed2-9a45-545a6fe55d0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ebe78f1d6ed42db805439b9e4f27007', 'request_id': 'req-c8069232-f00d-4ed2-9a45-545a6fe55d0b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:52.544335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c8069232-f00d-4ed2-9a45-545a6fe55d0b admin admin] The token cache is being invalidate because project 6ebe78f1d6ed42db805439b9e4f27007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:14:52.544984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c8069232-f00d-4ed2-9a45-545a6fe55d0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:52.545865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c8069232-f00d-4ed2-9a45-545a6fe55d0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:52.547830 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1279/2610] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:14:52 2022] DELETE /identity/v3/projects/6ebe78f1d6ed42db805439b9e4f27007 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:14:52.551979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346701a3-568c-47ba-97c7-a5621d79e37a service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:52.563330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346701a3-568c-47ba-97c7-a5621d79e37a service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:52.663380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b2ab1-19fb-413c-b8df-ca65c72c82e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:52.664888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b2ab1-19fb-413c-b8df-ca65c72c82e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:52.665184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b2ab1-19fb-413c-b8df-ca65c72c82e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:52.665466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b2ab1-19fb-413c-b8df-ca65c72c82e0 admin admin] PATH_INFO: `/v3/users/d9079e83d8a54344a2fb3a417455d55a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:52.667644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b2ab1-19fb-413c-b8df-ca65c72c82e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9079e83d8a54344a2fb3a417455d55a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:52.670647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b2ab1-19fb-413c-b8df-ca65c72c82e0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:52.831967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f4377-5741-43d6-a9d1-719bef4f69e2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:52.832296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f4377-5741-43d6-a9d1-719bef4f69e2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:52.832753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4f4377-5741-43d6-a9d1-719bef4f69e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:52.859335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7f4f4377-5741-43d6-a9d1-719bef4f69e2 None None] MFA Rules not processed for user `865ff993f6a440d4a25b34daed8cd6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:52.860721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7f4f4377-5741-43d6-a9d1-719bef4f69e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:52.900570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d01b2ab1-19fb-413c-b8df-ca65c72c82e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9079e83d8a54344a2fb3a417455d55a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:52.920986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d01b2ab1-19fb-413c-b8df-ca65c72c82e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9079e83d8a54344a2fb3a417455d55a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:52.943206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d01b2ab1-19fb-413c-b8df-ca65c72c82e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9079e83d8a54344a2fb3a417455d55a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:52.944618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d01b2ab1-19fb-413c-b8df-ca65c72c82e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9079e83d8a54344a2fb3a417455d55a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:52.963345 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1280/2611] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:14:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:14:53.067830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d01b2ab1-19fb-413c-b8df-ca65c72c82e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9079e83d8a54344a2fb3a417455d55a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:53.081477 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1332/2612] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:14:52 2022] DELETE /identity/v3/users/d9079e83d8a54344a2fb3a417455d55a => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:14:53.974904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f4377-5741-43d6-a9d1-719bef4f69e2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:53.978208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7f4f4377-5741-43d6-a9d1-719bef4f69e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:53.995753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4f4377-5741-43d6-a9d1-719bef4f69e2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:54.133194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99199d22-7f44-446e-a59a-558e323b4803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:54.134085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99199d22-7f44-446e-a59a-558e323b4803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:54.134429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99199d22-7f44-446e-a59a-558e323b4803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:54.134708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99199d22-7f44-446e-a59a-558e323b4803 admin admin] PATH_INFO: `/v3/projects/cb63ed4357af4f5dae8ef03b12ba2419` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:54.137261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99199d22-7f44-446e-a59a-558e323b4803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb63ed4357af4f5dae8ef03b12ba2419)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:54.139397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99199d22-7f44-446e-a59a-558e323b4803 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:54.302024 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:14:54.355492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-99199d22-7f44-446e-a59a-558e323b4803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb63ed4357af4f5dae8ef03b12ba2419', 'request_id': 'req-99199d22-7f44-446e-a59a-558e323b4803'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:54.437159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-99199d22-7f44-446e-a59a-558e323b4803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb63ed4357af4f5dae8ef03b12ba2419', 'request_id': 'req-99199d22-7f44-446e-a59a-558e323b4803'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:54.447150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-99199d22-7f44-446e-a59a-558e323b4803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb63ed4357af4f5dae8ef03b12ba2419', 'request_id': 'req-99199d22-7f44-446e-a59a-558e323b4803'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:54.476012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-99199d22-7f44-446e-a59a-558e323b4803 admin admin] The token cache is being invalidate because project cb63ed4357af4f5dae8ef03b12ba2419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:14:54.477729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-99199d22-7f44-446e-a59a-558e323b4803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:54.477729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-99199d22-7f44-446e-a59a-558e323b4803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:14:54.486959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c23de6-00cf-48c4-ae24-b8ab22814b2c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:54.487492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c23de6-00cf-48c4-ae24-b8ab22814b2c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:54.488753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c23de6-00cf-48c4-ae24-b8ab22814b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:54.489751 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1281/2613] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:14:53 2022] DELETE /identity/v3/projects/cb63ed4357af4f5dae8ef03b12ba2419 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:14:54.532902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-61c23de6-00cf-48c4-ae24-b8ab22814b2c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:54.540965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-61c23de6-00cf-48c4-ae24-b8ab22814b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:54.555173 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:14:54.753474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1c503-ec54-4e01-9e9f-7444586c0f4b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:54.753774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1c503-ec54-4e01-9e9f-7444586c0f4b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:54.754059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc1c503-ec54-4e01-9e9f-7444586c0f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:54.756535 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1333/2614] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:14:54.779278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1fc1c503-ec54-4e01-9e9f-7444586c0f4b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:54.780668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1fc1c503-ec54-4e01-9e9f-7444586c0f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:54.793211 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1282/2615] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:14:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:14:54.795056 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c23de6-00cf-48c4-ae24-b8ab22814b2c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:54.812577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c23de6-00cf-48c4-ae24-b8ab22814b2c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:54.819745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b674f-8650-4396-8c9b-8491c9d7f84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:54.820588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b674f-8650-4396-8c9b-8491c9d7f84a admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:54.820878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b674f-8650-4396-8c9b-8491c9d7f84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:54.821156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569b674f-8650-4396-8c9b-8491c9d7f84a admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:54.821949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b674f-8650-4396-8c9b-8491c9d7f84a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:14:54.822289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b674f-8650-4396-8c9b-8491c9d7f84a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:54.824830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569b674f-8650-4396-8c9b-8491c9d7f84a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:54.848746 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1334/2616] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:14:54.853702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1c503-ec54-4e01-9e9f-7444586c0f4b None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:54.885326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc1c503-ec54-4e01-9e9f-7444586c0f4b None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:54.895355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b691f1-4f42-4008-ab20-8a28c808d3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:54.896086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b691f1-4f42-4008-ab20-8a28c808d3dd admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:54.896403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b691f1-4f42-4008-ab20-8a28c808d3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:54.898340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b691f1-4f42-4008-ab20-8a28c808d3dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:54.899092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b691f1-4f42-4008-ab20-8a28c808d3dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:54.901023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b691f1-4f42-4008-ab20-8a28c808d3dd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:55.040218 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1283/2617] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:14:54 2022] POST /identity/v3/projects => generated 411 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:14:55.044586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b674f-8650-4396-8c9b-8491c9d7f84a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:55.059763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569b674f-8650-4396-8c9b-8491c9d7f84a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:55.149659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a97a2f-0a55-4c8c-85a2-59d392c8710e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:55.152989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a97a2f-0a55-4c8c-85a2-59d392c8710e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:55.153461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a97a2f-0a55-4c8c-85a2-59d392c8710e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:55.153909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a97a2f-0a55-4c8c-85a2-59d392c8710e admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:55.155115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a97a2f-0a55-4c8c-85a2-59d392c8710e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:55.157514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a97a2f-0a55-4c8c-85a2-59d392c8710e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:55.356395 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1335/2618] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:14:55 2022] POST /identity/v3/users => generated 306 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:14:55.359023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b691f1-4f42-4008-ab20-8a28c808d3dd admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:55.372928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b691f1-4f42-4008-ab20-8a28c808d3dd admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:55.379927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27f5e6-0d09-4561-afa9-06be62760681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:55.380841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27f5e6-0d09-4561-afa9-06be62760681 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:55.384902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27f5e6-0d09-4561-afa9-06be62760681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:55.384902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27f5e6-0d09-4561-afa9-06be62760681 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:55.384902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27f5e6-0d09-4561-afa9-06be62760681 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:55.384902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27f5e6-0d09-4561-afa9-06be62760681 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:55.407921 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1284/2619] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:14:55.408134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a97a2f-0a55-4c8c-85a2-59d392c8710e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:55.426602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a97a2f-0a55-4c8c-85a2-59d392c8710e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:55.447108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdf6da-89fd-4527-a597-a48779ebbeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:55.452172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdf6da-89fd-4527-a597-a48779ebbeed admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:55.452172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdf6da-89fd-4527-a597-a48779ebbeed admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:55.452172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdf6da-89fd-4527-a597-a48779ebbeed admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:55.452172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdf6da-89fd-4527-a597-a48779ebbeed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:55.452172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdf6da-89fd-4527-a597-a48779ebbeed admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:55.465211 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1336/2620] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:14:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:14:55.480871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27f5e6-0d09-4561-afa9-06be62760681 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:55.506255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27f5e6-0d09-4561-afa9-06be62760681 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:55.517622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae6f39-bcfb-4a89-a8a6-6fe5297532e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:55.517622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae6f39-bcfb-4a89-a8a6-6fe5297532e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:55.517622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae6f39-bcfb-4a89-a8a6-6fe5297532e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:55.517622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae6f39-bcfb-4a89-a8a6-6fe5297532e8 admin admin] PATH_INFO: `/v3/projects/d6523ca4178b4c7781d9342a3978756c/users/a85d57341b9f47b780e8986bee1245fc/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:55.560783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae6f39-bcfb-4a89-a8a6-6fe5297532e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6523ca4178b4c7781d9342a3978756c, user_id=a85d57341b9f47b780e8986bee1245fc, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:55.564814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae6f39-bcfb-4a89-a8a6-6fe5297532e8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:55.694772 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1285/2621] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:14:55 2022] PUT /identity/v3/projects/d6523ca4178b4c7781d9342a3978756c/users/a85d57341b9f47b780e8986bee1245fc/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:14:55.701029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6976400-e276-4c1b-b990-d8d693edabb2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:55.701913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6976400-e276-4c1b-b990-d8d693edabb2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:55.702367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6976400-e276-4c1b-b990-d8d693edabb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:55.727988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a6976400-e276-4c1b-b990-d8d693edabb2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:14:55.729564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a6976400-e276-4c1b-b990-d8d693edabb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:55.832188 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1337/2622] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:14:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:14:55.841445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae6f39-bcfb-4a89-a8a6-6fe5297532e8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:14:55.851168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-afae6f39-bcfb-4a89-a8a6-6fe5297532e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:14:55.989299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae6f39-bcfb-4a89-a8a6-6fe5297532e8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:14:56.016833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234e6fd1-8464-4b25-8849-890a2e8a8bc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:14:56.016833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e6fd1-8464-4b25-8849-890a2e8a8bc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:14:56.016833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e6fd1-8464-4b25-8849-890a2e8a8bc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:14:56.016833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234e6fd1-8464-4b25-8849-890a2e8a8bc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:14:56.023306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e6fd1-8464-4b25-8849-890a2e8a8bc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:14:56.025441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234e6fd1-8464-4b25-8849-890a2e8a8bc9 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:14:56.065420 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1286/2623] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:14:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:15:00.154606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6976400-e276-4c1b-b990-d8d693edabb2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:00.155903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a6976400-e276-4c1b-b990-d8d693edabb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:00.184122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6976400-e276-4c1b-b990-d8d693edabb2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:00.191036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc29cf-a399-479d-bf20-79d332223d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:00.195654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc29cf-a399-479d-bf20-79d332223d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:00.196383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc29cf-a399-479d-bf20-79d332223d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:00.197464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc29cf-a399-479d-bf20-79d332223d54 admin admin] PATH_INFO: `/v3/users/f5d432ce84114386bcb507b4e5777f67` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:00.199143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc29cf-a399-479d-bf20-79d332223d54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d432ce84114386bcb507b4e5777f67)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:00.201479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc29cf-a399-479d-bf20-79d332223d54 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:00.217177 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:00.530712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a8cc29cf-a399-479d-bf20-79d332223d54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d432ce84114386bcb507b4e5777f67'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:00.596992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a8cc29cf-a399-479d-bf20-79d332223d54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d432ce84114386bcb507b4e5777f67'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:00.613488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a0bf6-7391-4a10-958e-5dcf0a488c37 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:00.614483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a0bf6-7391-4a10-958e-5dcf0a488c37 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:00.614936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a0bf6-7391-4a10-958e-5dcf0a488c37 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:00.617086 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1287/2624] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:15:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 14:15:00.634652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a8cc29cf-a399-479d-bf20-79d332223d54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d432ce84114386bcb507b4e5777f67'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:00.635515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a8cc29cf-a399-479d-bf20-79d332223d54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d432ce84114386bcb507b4e5777f67'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:00.663598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885606f6-103f-4f15-98e3-2dce805b5d58 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:00.663598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885606f6-103f-4f15-98e3-2dce805b5d58 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:00.663598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885606f6-103f-4f15-98e3-2dce805b5d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:00.711655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a8cc29cf-a399-479d-bf20-79d332223d54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d432ce84114386bcb507b4e5777f67'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:00.715428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-885606f6-103f-4f15-98e3-2dce805b5d58 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:00.717223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-885606f6-103f-4f15-98e3-2dce805b5d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:00.727411 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1338/2625] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:15:00 2022] DELETE /identity/v3/users/f5d432ce84114386bcb507b4e5777f67 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:15:00.735135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226487f-17fb-4f61-b3f3-6783cd88e031 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:00.738076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226487f-17fb-4f61-b3f3-6783cd88e031 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:00.738502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226487f-17fb-4f61-b3f3-6783cd88e031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:00.794758 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:00.841339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7226487f-17fb-4f61-b3f3-6783cd88e031 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:00.843109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7226487f-17fb-4f61-b3f3-6783cd88e031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:00.849394 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1288/2626] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:15:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:00.877925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885606f6-103f-4f15-98e3-2dce805b5d58 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:00.879605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-885606f6-103f-4f15-98e3-2dce805b5d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:00.896807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885606f6-103f-4f15-98e3-2dce805b5d58 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:00.903162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984cb9b-7bbd-4c46-b61c-c9c4f7c9bbe0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:00.904505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984cb9b-7bbd-4c46-b61c-c9c4f7c9bbe0 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:00.905164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984cb9b-7bbd-4c46-b61c-c9c4f7c9bbe0 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:00.905686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984cb9b-7bbd-4c46-b61c-c9c4f7c9bbe0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:00.916229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984cb9b-7bbd-4c46-b61c-c9c4f7c9bbe0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:00.918480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c984cb9b-7bbd-4c46-b61c-c9c4f7c9bbe0 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:00.945186 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1289/2627] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:15:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:15:01.020714 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1339/2628] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:01.049217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984cb9b-7bbd-4c46-b61c-c9c4f7c9bbe0 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:01.055334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c984cb9b-7bbd-4c46-b61c-c9c4f7c9bbe0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:01.172051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c984cb9b-7bbd-4c46-b61c-c9c4f7c9bbe0 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:01.179424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdd5ab-1a6d-4a90-a6e2-cb3860457666 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:01.181696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdd5ab-1a6d-4a90-a6e2-cb3860457666 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:01.184597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdd5ab-1a6d-4a90-a6e2-cb3860457666 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:01.189925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bdd5ab-1a6d-4a90-a6e2-cb3860457666 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:01.235978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bdd5ab-1a6d-4a90-a6e2-cb3860457666 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:01.235978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bdd5ab-1a6d-4a90-a6e2-cb3860457666 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:01.263708 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1290/2629] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:15:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:15:02.919581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226487f-17fb-4f61-b3f3-6783cd88e031 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:02.925615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7226487f-17fb-4f61-b3f3-6783cd88e031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:02.999348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdd5ab-1a6d-4a90-a6e2-cb3860457666 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:03.001502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-65bdd5ab-1a6d-4a90-a6e2-cb3860457666 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:03.026347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bdd5ab-1a6d-4a90-a6e2-cb3860457666 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:03.033796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8aba4-5798-4412-a223-27af58997a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:03.034997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8aba4-5798-4412-a223-27af58997a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:03.035933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8aba4-5798-4412-a223-27af58997a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:03.036675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8aba4-5798-4412-a223-27af58997a78 admin admin] PATH_INFO: `/v3/projects/77eacd6cd9d341cab26276a99b04bff8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:03.038400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8aba4-5798-4412-a223-27af58997a78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77eacd6cd9d341cab26276a99b04bff8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:03.056187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8aba4-5798-4412-a223-27af58997a78 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:03.071355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226487f-17fb-4f61-b3f3-6783cd88e031 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:03.091068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c75d2-1793-43f4-9500-0c190e1a1093 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:03.091756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c75d2-1793-43f4-9500-0c190e1a1093 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:03.092082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c75d2-1793-43f4-9500-0c190e1a1093 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:03.092387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c75d2-1793-43f4-9500-0c190e1a1093 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:03.098216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-884c75d2-1793-43f4-9500-0c190e1a1093 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:03.167822 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:03.253190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-04f8aba4-5798-4412-a223-27af58997a78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77eacd6cd9d341cab26276a99b04bff8', 'request_id': 'req-04f8aba4-5798-4412-a223-27af58997a78'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:03.254166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c75d2-1793-43f4-9500-0c190e1a1093 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:03.262561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c75d2-1793-43f4-9500-0c190e1a1093 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:03.290517 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1340/2630] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:15:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:15:03.383691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-04f8aba4-5798-4412-a223-27af58997a78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77eacd6cd9d341cab26276a99b04bff8', 'request_id': 'req-04f8aba4-5798-4412-a223-27af58997a78'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:03.393036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-04f8aba4-5798-4412-a223-27af58997a78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77eacd6cd9d341cab26276a99b04bff8', 'request_id': 'req-04f8aba4-5798-4412-a223-27af58997a78'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:03.430163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-04f8aba4-5798-4412-a223-27af58997a78 admin admin] The token cache is being invalidate because project 77eacd6cd9d341cab26276a99b04bff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:15:03.430163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-04f8aba4-5798-4412-a223-27af58997a78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:03.434461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-04f8aba4-5798-4412-a223-27af58997a78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:03.438455 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1291/2631] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:15:02 2022] DELETE /identity/v3/projects/77eacd6cd9d341cab26276a99b04bff8 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:15:03.481372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c75d2-1793-43f4-9500-0c190e1a1093 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:03.506725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c75d2-1793-43f4-9500-0c190e1a1093 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:03.619932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e6536-1e30-44ae-a7b7-18811567108f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:03.621364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e6536-1e30-44ae-a7b7-18811567108f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:03.621658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e6536-1e30-44ae-a7b7-18811567108f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:03.621929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e6536-1e30-44ae-a7b7-18811567108f admin admin] PATH_INFO: `/v3/users/b557e8c17a82497caa32b51102b8e373` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:03.623473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e6536-1e30-44ae-a7b7-18811567108f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b557e8c17a82497caa32b51102b8e373)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:03.627195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e6536-1e30-44ae-a7b7-18811567108f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:04.001158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d83e6536-1e30-44ae-a7b7-18811567108f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b557e8c17a82497caa32b51102b8e373'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:04.031814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d83e6536-1e30-44ae-a7b7-18811567108f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b557e8c17a82497caa32b51102b8e373'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:04.049004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d83e6536-1e30-44ae-a7b7-18811567108f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b557e8c17a82497caa32b51102b8e373'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:04.050288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d83e6536-1e30-44ae-a7b7-18811567108f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b557e8c17a82497caa32b51102b8e373'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:04.133575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d83e6536-1e30-44ae-a7b7-18811567108f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b557e8c17a82497caa32b51102b8e373'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:04.150864 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1341/2632] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:15:03 2022] DELETE /identity/v3/users/b557e8c17a82497caa32b51102b8e373 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:15:04.974152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8aba4-5798-4412-a223-27af58997a78 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:04.975775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-04f8aba4-5798-4412-a223-27af58997a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:05.006698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8aba4-5798-4412-a223-27af58997a78 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:05.095416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f48481-1251-4369-b4e1-e4cbbc37256f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:05.097189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f48481-1251-4369-b4e1-e4cbbc37256f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:05.097584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f48481-1251-4369-b4e1-e4cbbc37256f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:05.097874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f48481-1251-4369-b4e1-e4cbbc37256f admin admin] PATH_INFO: `/v3/projects/a555a2634e1d45b0a4bd831f72f247df` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:05.100204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f48481-1251-4369-b4e1-e4cbbc37256f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a555a2634e1d45b0a4bd831f72f247df)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:05.102169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f48481-1251-4369-b4e1-e4cbbc37256f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:05.104832 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:05.392761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-24f48481-1251-4369-b4e1-e4cbbc37256f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a555a2634e1d45b0a4bd831f72f247df', 'request_id': 'req-24f48481-1251-4369-b4e1-e4cbbc37256f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:05.516153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-24f48481-1251-4369-b4e1-e4cbbc37256f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a555a2634e1d45b0a4bd831f72f247df', 'request_id': 'req-24f48481-1251-4369-b4e1-e4cbbc37256f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:05.529154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-24f48481-1251-4369-b4e1-e4cbbc37256f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a555a2634e1d45b0a4bd831f72f247df', 'request_id': 'req-24f48481-1251-4369-b4e1-e4cbbc37256f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:05.546398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-24f48481-1251-4369-b4e1-e4cbbc37256f admin admin] The token cache is being invalidate because project a555a2634e1d45b0a4bd831f72f247df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:15:05.546771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-24f48481-1251-4369-b4e1-e4cbbc37256f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:05.547404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-24f48481-1251-4369-b4e1-e4cbbc37256f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:05.549262 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1292/2633] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:15:04 2022] DELETE /identity/v3/projects/a555a2634e1d45b0a4bd831f72f247df => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:15:05.556626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c696eb8-3948-48fd-8097-ea10ca0ab6c0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:05.557610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c696eb8-3948-48fd-8097-ea10ca0ab6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:05.557610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c696eb8-3948-48fd-8097-ea10ca0ab6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:05.636676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8c696eb8-3948-48fd-8097-ea10ca0ab6c0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:05.642947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8c696eb8-3948-48fd-8097-ea10ca0ab6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:05.792980 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:05.856570 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1342/2634] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:05.859214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f96707-6c01-4388-924b-41197d4040bb None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:05.859505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f96707-6c01-4388-924b-41197d4040bb None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:05.859952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f96707-6c01-4388-924b-41197d4040bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:05.903235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c6f96707-6c01-4388-924b-41197d4040bb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:05.907337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c6f96707-6c01-4388-924b-41197d4040bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:05.940551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c696eb8-3948-48fd-8097-ea10ca0ab6c0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:05.941181 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1293/2635] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:05.951923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c696eb8-3948-48fd-8097-ea10ca0ab6c0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:05.959365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86600ffb-84ad-4a93-b43c-9e2c31606b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:05.960459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86600ffb-84ad-4a93-b43c-9e2c31606b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:05.960995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86600ffb-84ad-4a93-b43c-9e2c31606b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:05.961512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86600ffb-84ad-4a93-b43c-9e2c31606b6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:05.962821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86600ffb-84ad-4a93-b43c-9e2c31606b6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:15:05.963376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86600ffb-84ad-4a93-b43c-9e2c31606b6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:05.965520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86600ffb-84ad-4a93-b43c-9e2c31606b6e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:06.021749 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1343/2636] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:15:06.022507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f96707-6c01-4388-924b-41197d4040bb None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:06.038835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f96707-6c01-4388-924b-41197d4040bb None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:06.058352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ba6ea-7348-4df1-8c56-626dc044b800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:06.059394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ba6ea-7348-4df1-8c56-626dc044b800 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:06.059865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ba6ea-7348-4df1-8c56-626dc044b800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:06.060322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ba6ea-7348-4df1-8c56-626dc044b800 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:06.061218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ba6ea-7348-4df1-8c56-626dc044b800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:06.063406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ba6ea-7348-4df1-8c56-626dc044b800 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:06.200513 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1294/2637] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:15:06 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:15:06.204421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86600ffb-84ad-4a93-b43c-9e2c31606b6e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:06.227417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86600ffb-84ad-4a93-b43c-9e2c31606b6e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:06.441614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442e485-f2af-480d-9191-037e2cede102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:06.442923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442e485-f2af-480d-9191-037e2cede102 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:06.451320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442e485-f2af-480d-9191-037e2cede102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:06.451320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8442e485-f2af-480d-9191-037e2cede102 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:06.451320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442e485-f2af-480d-9191-037e2cede102 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:06.458629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8442e485-f2af-480d-9191-037e2cede102 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:06.576683 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1344/2638] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:15:06 2022] POST /identity/v3/users => generated 292 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:15:06.580598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ba6ea-7348-4df1-8c56-626dc044b800 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:06.609537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ba6ea-7348-4df1-8c56-626dc044b800 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:06.631798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92180d2a-f4b7-4a7a-a660-de9176a3fd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:06.632880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92180d2a-f4b7-4a7a-a660-de9176a3fd38 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:06.633419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92180d2a-f4b7-4a7a-a660-de9176a3fd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:06.633925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92180d2a-f4b7-4a7a-a660-de9176a3fd38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:06.634953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92180d2a-f4b7-4a7a-a660-de9176a3fd38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:06.636855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92180d2a-f4b7-4a7a-a660-de9176a3fd38 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:06.709208 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1295/2639] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:15:06.709328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442e485-f2af-480d-9191-037e2cede102 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:06.718979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8442e485-f2af-480d-9191-037e2cede102 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:06.726805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90593b-f992-4058-8be4-f9af013395d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:06.727745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90593b-f992-4058-8be4-f9af013395d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:06.728196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90593b-f992-4058-8be4-f9af013395d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:06.728629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90593b-f992-4058-8be4-f9af013395d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:06.729541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90593b-f992-4058-8be4-f9af013395d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:06.731474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90593b-f992-4058-8be4-f9af013395d9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:06.768497 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1345/2640] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:15:06.769622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92180d2a-f4b7-4a7a-a660-de9176a3fd38 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:06.781003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92180d2a-f4b7-4a7a-a660-de9176a3fd38 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:06.796623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c730fdd-6732-43c4-a247-5f40271f4962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:06.797567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c730fdd-6732-43c4-a247-5f40271f4962 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:06.797892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c730fdd-6732-43c4-a247-5f40271f4962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:06.798080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c730fdd-6732-43c4-a247-5f40271f4962 admin admin] PATH_INFO: `/v3/projects/11c8fff81ce3494b9567aafd67b2e31d/users/5d2572c3904f40c6b26ce92425f655f6/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:06.819885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c730fdd-6732-43c4-a247-5f40271f4962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11c8fff81ce3494b9567aafd67b2e31d, user_id=5d2572c3904f40c6b26ce92425f655f6, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:06.825119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c730fdd-6732-43c4-a247-5f40271f4962 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:06.940843 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1296/2641] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:15:06 2022] PUT /identity/v3/projects/11c8fff81ce3494b9567aafd67b2e31d/users/5d2572c3904f40c6b26ce92425f655f6/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:15:06.955206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4a2fc-c4b1-48e8-b05e-5fabd4a7641c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:06.955888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4a2fc-c4b1-48e8-b05e-5fabd4a7641c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:06.956417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4a2fc-c4b1-48e8-b05e-5fabd4a7641c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:07.023478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-62f4a2fc-c4b1-48e8-b05e-5fabd4a7641c None None] MFA Rules not processed for user `5d2572c3904f40c6b26ce92425f655f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:07.025130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-62f4a2fc-c4b1-48e8-b05e-5fabd4a7641c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:07.127190 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1346/2642] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:07.132676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c730fdd-6732-43c4-a247-5f40271f4962 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:07.277197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c730fdd-6732-43c4-a247-5f40271f4962 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:07.284651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3960fd-6d64-4c89-90cf-fe3d637b021f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:07.285661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3960fd-6d64-4c89-90cf-fe3d637b021f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:07.288914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3960fd-6d64-4c89-90cf-fe3d637b021f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:07.288914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3960fd-6d64-4c89-90cf-fe3d637b021f admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:07.288914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3960fd-6d64-4c89-90cf-fe3d637b021f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:07.291944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3960fd-6d64-4c89-90cf-fe3d637b021f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:07.450517 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1297/2643] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:15:07 2022] POST /identity/v3/projects => generated 381 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:15:07.454533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4a2fc-c4b1-48e8-b05e-5fabd4a7641c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:07.482769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4a2fc-c4b1-48e8-b05e-5fabd4a7641c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:07.522366 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:07.557973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38787497-7afe-4b37-be75-113a8e4ae013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:07.558721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38787497-7afe-4b37-be75-113a8e4ae013 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:07.559368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38787497-7afe-4b37-be75-113a8e4ae013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:07.559481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38787497-7afe-4b37-be75-113a8e4ae013 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:07.560194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38787497-7afe-4b37-be75-113a8e4ae013 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:07.562472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38787497-7afe-4b37-be75-113a8e4ae013 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:07.683841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3960fd-6d64-4c89-90cf-fe3d637b021f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:07.698049 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1347/2644] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:15:07 2022] POST /identity/v3/users => generated 297 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:15:07.703048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3960fd-6d64-4c89-90cf-fe3d637b021f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:07.709925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef11b66-5333-4c7b-a224-cdd4c469fe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:07.711066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef11b66-5333-4c7b-a224-cdd4c469fe30 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:07.711803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef11b66-5333-4c7b-a224-cdd4c469fe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:07.712660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef11b66-5333-4c7b-a224-cdd4c469fe30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:07.713719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef11b66-5333-4c7b-a224-cdd4c469fe30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:07.715692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef11b66-5333-4c7b-a224-cdd4c469fe30 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:07.746893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38787497-7afe-4b37-be75-113a8e4ae013 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:07.748504 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1298/2645] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:15:07.760453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38787497-7afe-4b37-be75-113a8e4ae013 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:07.769534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236d35f-caf3-4afc-a0a7-4bcf2a0b54ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:07.771597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236d35f-caf3-4afc-a0a7-4bcf2a0b54ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:07.772108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236d35f-caf3-4afc-a0a7-4bcf2a0b54ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:07.772575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236d35f-caf3-4afc-a0a7-4bcf2a0b54ea admin admin] PATH_INFO: `/v3/projects/6468b350591d4fb4826f86222dc53abc/users/06077ae6adb84fc8b979d88d34267c0c/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:07.824972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236d35f-caf3-4afc-a0a7-4bcf2a0b54ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=6468b350591d4fb4826f86222dc53abc, user_id=06077ae6adb84fc8b979d88d34267c0c, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:07.828604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3236d35f-caf3-4afc-a0a7-4bcf2a0b54ea admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:07.913478 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1348/2646] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:15:07 2022] PUT /identity/v3/projects/6468b350591d4fb4826f86222dc53abc/users/06077ae6adb84fc8b979d88d34267c0c/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:15:07.917873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef11b66-5333-4c7b-a224-cdd4c469fe30 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:07.928028 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:07.933821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef11b66-5333-4c7b-a224-cdd4c469fe30 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:08.080697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c17602-c77b-4dbb-a354-6011563318e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:08.081406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c17602-c77b-4dbb-a354-6011563318e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:08.081738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c17602-c77b-4dbb-a354-6011563318e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:08.084826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c17602-c77b-4dbb-a354-6011563318e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:08.084826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c17602-c77b-4dbb-a354-6011563318e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:08.096327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c17602-c77b-4dbb-a354-6011563318e0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:08.115152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236d35f-caf3-4afc-a0a7-4bcf2a0b54ea admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:08.122014 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1299/2647] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:15:08.130987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236d35f-caf3-4afc-a0a7-4bcf2a0b54ea admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:08.151535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf275a-0d5e-42aa-8690-1f02c4387c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:08.152460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf275a-0d5e-42aa-8690-1f02c4387c14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:08.152792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf275a-0d5e-42aa-8690-1f02c4387c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:08.153074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf275a-0d5e-42aa-8690-1f02c4387c14 admin admin] PATH_INFO: `/v3/projects/6468b350591d4fb4826f86222dc53abc/users/06077ae6adb84fc8b979d88d34267c0c/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:08.159129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf275a-0d5e-42aa-8690-1f02c4387c14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6468b350591d4fb4826f86222dc53abc, user_id=06077ae6adb84fc8b979d88d34267c0c, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:08.167219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf275a-0d5e-42aa-8690-1f02c4387c14 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:08.195312 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1349/2648] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:15:08 2022] PUT /identity/v3/projects/6468b350591d4fb4826f86222dc53abc/users/06077ae6adb84fc8b979d88d34267c0c/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:15:08.205436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0ac04-ce2c-41c3-81da-590ec6a18639 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:08.206044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0ac04-ce2c-41c3-81da-590ec6a18639 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:08.206343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca0ac04-ce2c-41c3-81da-590ec6a18639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:08.259672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2ca0ac04-ce2c-41c3-81da-590ec6a18639 None None] MFA Rules not processed for user `06077ae6adb84fc8b979d88d34267c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:08.261680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2ca0ac04-ce2c-41c3-81da-590ec6a18639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:08.418452 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1300/2649] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:08.427579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd193f8-3475-4247-9121-a5a8ef2e7738 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:08.427880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd193f8-3475-4247-9121-a5a8ef2e7738 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:08.428156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd193f8-3475-4247-9121-a5a8ef2e7738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:08.474659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1bd193f8-3475-4247-9121-a5a8ef2e7738 None None] MFA Rules not processed for user `5d2572c3904f40c6b26ce92425f655f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:08.476896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1bd193f8-3475-4247-9121-a5a8ef2e7738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:08.642753 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1350/2650] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:08.689348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0ac04-ce2c-41c3-81da-590ec6a18639 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:08.691530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2ca0ac04-ce2c-41c3-81da-590ec6a18639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:08.818729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca0ac04-ce2c-41c3-81da-590ec6a18639 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:08.826086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc24e7d-fb16-41c9-8fd9-0c04e49d6df7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:08.827118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc24e7d-fb16-41c9-8fd9-0c04e49d6df7 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:08.827583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc24e7d-fb16-41c9-8fd9-0c04e49d6df7 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:08.828667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc24e7d-fb16-41c9-8fd9-0c04e49d6df7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:08.847186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc24e7d-fb16-41c9-8fd9-0c04e49d6df7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:08.854135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc24e7d-fb16-41c9-8fd9-0c04e49d6df7 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:08.870638 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1301/2651] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:15:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:15:09.205704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad149a3f-ac7a-4b11-bb0b-174977e2394b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:09.206209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad149a3f-ac7a-4b11-bb0b-174977e2394b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:09.206475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad149a3f-ac7a-4b11-bb0b-174977e2394b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:09.249287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ad149a3f-ac7a-4b11-bb0b-174977e2394b None None] MFA Rules not processed for user `a85d57341b9f47b780e8986bee1245fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:09.250758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ad149a3f-ac7a-4b11-bb0b-174977e2394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:09.340046 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1351/2652] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:09 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:09.352268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23ef2e-7c1a-4f5c-8e36-7be4881e5502 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:09.366157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23ef2e-7c1a-4f5c-8e36-7be4881e5502 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:09.366157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23ef2e-7c1a-4f5c-8e36-7be4881e5502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:09.388320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0a23ef2e-7c1a-4f5c-8e36-7be4881e5502 None None] MFA Rules not processed for user `a85d57341b9f47b780e8986bee1245fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:09.390063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0a23ef2e-7c1a-4f5c-8e36-7be4881e5502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:09.403281 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1302/2653] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:09 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:09.786452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad149a3f-ac7a-4b11-bb0b-174977e2394b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:09.801491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad149a3f-ac7a-4b11-bb0b-174977e2394b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:09.809370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88401b2e-ac2b-47f6-9fe7-5a8ed2451709 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:09.810032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88401b2e-ac2b-47f6-9fe7-5a8ed2451709 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:09.810351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88401b2e-ac2b-47f6-9fe7-5a8ed2451709 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:09.810630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88401b2e-ac2b-47f6-9fe7-5a8ed2451709 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:09.828929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88401b2e-ac2b-47f6-9fe7-5a8ed2451709 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:09.833916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88401b2e-ac2b-47f6-9fe7-5a8ed2451709 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:09.852902 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1352/2654] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:15:09 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:15:10.099690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6473f9b-e12d-4dd8-8f80-0e7b4c55e12d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:10.100097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6473f9b-e12d-4dd8-8f80-0e7b4c55e12d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:10.100381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6473f9b-e12d-4dd8-8f80-0e7b4c55e12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:10.117933 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:10.144296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e6473f9b-e12d-4dd8-8f80-0e7b4c55e12d None None] MFA Rules not processed for user `9ec89b63f3eb421fbb2eb2494016f258`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:10.147722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e6473f9b-e12d-4dd8-8f80-0e7b4c55e12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:10.252477 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1303/2655] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:10.411127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ee2e5-a83a-4e94-9d18-b7e0cabae045 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:10.411127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ee2e5-a83a-4e94-9d18-b7e0cabae045 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:10.411127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ee2e5-a83a-4e94-9d18-b7e0cabae045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:10.436091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b34ee2e5-a83a-4e94-9d18-b7e0cabae045 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:10.437709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b34ee2e5-a83a-4e94-9d18-b7e0cabae045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:10.446354 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:10.586282 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1353/2656] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:15:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:10.601667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6473f9b-e12d-4dd8-8f80-0e7b4c55e12d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:10.604354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e6473f9b-e12d-4dd8-8f80-0e7b4c55e12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:10.756086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6473f9b-e12d-4dd8-8f80-0e7b4c55e12d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:10.771982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630f53d-8ad7-4271-8b57-09643d4e7afb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:10.771982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630f53d-8ad7-4271-8b57-09643d4e7afb service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:10.771982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630f53d-8ad7-4271-8b57-09643d4e7afb service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:10.772393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1630f53d-8ad7-4271-8b57-09643d4e7afb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:10.794693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630f53d-8ad7-4271-8b57-09643d4e7afb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:10.798174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1630f53d-8ad7-4271-8b57-09643d4e7afb service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:10.819694 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1304/2657] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:15:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:15:11.072786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77bbcf-c023-4ad2-95f3-eb947be8986e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:11.073440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77bbcf-c023-4ad2-95f3-eb947be8986e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:11.074459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77bbcf-c023-4ad2-95f3-eb947be8986e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:11.099043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-fc77bbcf-c023-4ad2-95f3-eb947be8986e None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:11.101153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fc77bbcf-c023-4ad2-95f3-eb947be8986e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:11.113375 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1354/2658] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:15:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:11.126730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630f53d-8ad7-4271-8b57-09643d4e7afb service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:11.138342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1630f53d-8ad7-4271-8b57-09643d4e7afb service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:11.148207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c7206-a17d-45b9-9dce-b5f42ce17453 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:11.148878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c7206-a17d-45b9-9dce-b5f42ce17453 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:11.149439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c7206-a17d-45b9-9dce-b5f42ce17453 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:11.149601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c7206-a17d-45b9-9dce-b5f42ce17453 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:11.160241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c7206-a17d-45b9-9dce-b5f42ce17453 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:11.162586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c7206-a17d-45b9-9dce-b5f42ce17453 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:11.175392 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1305/2659] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:15:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:15:13.564201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e7273-30e3-4190-991d-6368ab407868 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:13.564676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e7273-30e3-4190-991d-6368ab407868 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:13.567936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e7273-30e3-4190-991d-6368ab407868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:13.643104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-884e7273-30e3-4190-991d-6368ab407868 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:13.644338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-884e7273-30e3-4190-991d-6368ab407868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:13.677172 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1355/2660] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:15:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:15:13.695225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c7206-a17d-45b9-9dce-b5f42ce17453 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:13.710617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c7206-a17d-45b9-9dce-b5f42ce17453 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:13.728341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f9717-8346-456e-a72d-4c4cdc729162 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:13.729069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f9717-8346-456e-a72d-4c4cdc729162 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:13.729597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f9717-8346-456e-a72d-4c4cdc729162 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:13.729597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f9717-8346-456e-a72d-4c4cdc729162 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:13.746671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f9717-8346-456e-a72d-4c4cdc729162 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:13.748917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f9717-8346-456e-a72d-4c4cdc729162 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:13.760122 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1306/2661] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:15:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:15:17.031158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3190a9-87df-4b04-b2d8-8ae3139c3855 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:17.031776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3190a9-87df-4b04-b2d8-8ae3139c3855 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:17.031776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3190a9-87df-4b04-b2d8-8ae3139c3855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:17.090468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7b3190a9-87df-4b04-b2d8-8ae3139c3855 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:17.091642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7b3190a9-87df-4b04-b2d8-8ae3139c3855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:17.125740 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1356/2662] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:15:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:17.167303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f9717-8346-456e-a72d-4c4cdc729162 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:17.184342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f9717-8346-456e-a72d-4c4cdc729162 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:17.203398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754060a-2eb3-4241-868b-76b5314ad227 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:17.211083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754060a-2eb3-4241-868b-76b5314ad227 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:17.211788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754060a-2eb3-4241-868b-76b5314ad227 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:17.212304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754060a-2eb3-4241-868b-76b5314ad227 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:17.233752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754060a-2eb3-4241-868b-76b5314ad227 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:17.250142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754060a-2eb3-4241-868b-76b5314ad227 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:17.277602 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1307/2663] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:15:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:15:27.059701 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=30 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:27.258329 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=74 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:27.910833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9ef96-0a1a-4254-adae-d57267d2dd75 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:27.911122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9ef96-0a1a-4254-adae-d57267d2dd75 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:27.911420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9ef96-0a1a-4254-adae-d57267d2dd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:27.931433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-33c9ef96-0a1a-4254-adae-d57267d2dd75 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:27.932726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-33c9ef96-0a1a-4254-adae-d57267d2dd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:27.948138 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1357/2664] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:15:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:15:27.956950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754060a-2eb3-4241-868b-76b5314ad227 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:27.968199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754060a-2eb3-4241-868b-76b5314ad227 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:27.974777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43a5c2-0f9a-4083-aae6-2f465c1f473d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:27.975832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43a5c2-0f9a-4083-aae6-2f465c1f473d service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:27.976130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43a5c2-0f9a-4083-aae6-2f465c1f473d service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:27.976443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43a5c2-0f9a-4083-aae6-2f465c1f473d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:27.986459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43a5c2-0f9a-4083-aae6-2f465c1f473d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:27.988047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43a5c2-0f9a-4083-aae6-2f465c1f473d service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:27.999738 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1308/2665] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:15:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:15:29.574868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55b0d2-7401-4321-ab4a-57de17ec9be5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:29.575313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55b0d2-7401-4321-ab4a-57de17ec9be5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:29.575420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55b0d2-7401-4321-ab4a-57de17ec9be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:29.593762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9b55b0d2-7401-4321-ab4a-57de17ec9be5 None None] MFA Rules not processed for user `5c0882e092c644758966c19d52d86795`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:29.595096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9b55b0d2-7401-4321-ab4a-57de17ec9be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:29.697010 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1358/2666] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:33.755560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43a5c2-0f9a-4083-aae6-2f465c1f473d service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:33.768815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43a5c2-0f9a-4083-aae6-2f465c1f473d service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:33.778702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1938dc04-0339-4563-b079-85dd35f6aaf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:33.783233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938dc04-0339-4563-b079-85dd35f6aaf3 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:33.783233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938dc04-0339-4563-b079-85dd35f6aaf3 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:33.783233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1938dc04-0339-4563-b079-85dd35f6aaf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:33.791585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938dc04-0339-4563-b079-85dd35f6aaf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:33.793417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1938dc04-0339-4563-b079-85dd35f6aaf3 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:33.805205 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1309/2667] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:15:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:15:34.795171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d86567-18c9-449b-88d9-9add6320609b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:34.796413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d86567-18c9-449b-88d9-9add6320609b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:34.797246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d86567-18c9-449b-88d9-9add6320609b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:34.820337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-95d86567-18c9-449b-88d9-9add6320609b None None] MFA Rules not processed for user `5d2572c3904f40c6b26ce92425f655f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:34.821695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-95d86567-18c9-449b-88d9-9add6320609b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:34.833999 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1359/2668] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:37.447972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05572609-1494-46d0-a7a6-1f082f309e51 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:37.448595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05572609-1494-46d0-a7a6-1f082f309e51 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:37.448595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05572609-1494-46d0-a7a6-1f082f309e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:37.467097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-05572609-1494-46d0-a7a6-1f082f309e51 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:37.468483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-05572609-1494-46d0-a7a6-1f082f309e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:37.480832 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1310/2669] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:15:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:37.499477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d86567-18c9-449b-88d9-9add6320609b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:37.514019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d86567-18c9-449b-88d9-9add6320609b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:37.522862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ec388-c485-4229-8ebb-cef355332f6b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:37.523517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ec388-c485-4229-8ebb-cef355332f6b service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:37.523801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ec388-c485-4229-8ebb-cef355332f6b service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:37.524085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597ec388-c485-4229-8ebb-cef355332f6b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:37.533265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ec388-c485-4229-8ebb-cef355332f6b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:37.535543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597ec388-c485-4229-8ebb-cef355332f6b service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:37.550445 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1360/2670] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:15:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:15:38.583094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5abff-a9ee-4a37-b416-9f3a8a363628 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:38.583668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5abff-a9ee-4a37-b416-9f3a8a363628 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:38.583668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5abff-a9ee-4a37-b416-9f3a8a363628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:38.603076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a8e5abff-a9ee-4a37-b416-9f3a8a363628 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:38.604297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a8e5abff-a9ee-4a37-b416-9f3a8a363628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:38.612499 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1311/2671] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:15:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:38.625791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ec388-c485-4229-8ebb-cef355332f6b service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:38.638055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597ec388-c485-4229-8ebb-cef355332f6b service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:38.643998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebdc97-d7da-4894-b737-ff8c6b962abe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:38.645087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebdc97-d7da-4894-b737-ff8c6b962abe service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:38.645496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebdc97-d7da-4894-b737-ff8c6b962abe service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:38.645903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebdc97-d7da-4894-b737-ff8c6b962abe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:38.655645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebdc97-d7da-4894-b737-ff8c6b962abe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:38.657362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebdc97-d7da-4894-b737-ff8c6b962abe service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:38.668000 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1361/2672] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:15:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:15:39.713082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bdde6-7ba8-4b5d-af4b-eca518cde2d4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:39.713598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bdde6-7ba8-4b5d-af4b-eca518cde2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:39.713857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bdde6-7ba8-4b5d-af4b-eca518cde2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:39.733430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e51bdde6-7ba8-4b5d-af4b-eca518cde2d4 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:39.734681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e51bdde6-7ba8-4b5d-af4b-eca518cde2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:39.746473 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1312/2673] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:15:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:39.757538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebdc97-d7da-4894-b737-ff8c6b962abe service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:39.768182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebdc97-d7da-4894-b737-ff8c6b962abe service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:39.774203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb668a0-b6e8-4506-a2c2-30d83df96f78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:39.775089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb668a0-b6e8-4506-a2c2-30d83df96f78 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:39.775539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb668a0-b6e8-4506-a2c2-30d83df96f78 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:39.775814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb668a0-b6e8-4506-a2c2-30d83df96f78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:39.785894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb668a0-b6e8-4506-a2c2-30d83df96f78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:39.787739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb668a0-b6e8-4506-a2c2-30d83df96f78 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:39.796921 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1362/2674] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:15:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:15:40.278431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bdde6-7ba8-4b5d-af4b-eca518cde2d4 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:40.280157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e51bdde6-7ba8-4b5d-af4b-eca518cde2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:40.380793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bdde6-7ba8-4b5d-af4b-eca518cde2d4 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:40.386210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca455f31-7bc8-4420-b57d-b41a7b889b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:40.387094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca455f31-7bc8-4420-b57d-b41a7b889b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:40.387379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca455f31-7bc8-4420-b57d-b41a7b889b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:40.387659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca455f31-7bc8-4420-b57d-b41a7b889b66 admin admin] PATH_INFO: `/v3/users/ea50661bf26447e98a1fd8b3603ea880` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:40.388882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca455f31-7bc8-4420-b57d-b41a7b889b66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea50661bf26447e98a1fd8b3603ea880)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:40.390949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca455f31-7bc8-4420-b57d-b41a7b889b66 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:40.609814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ca455f31-7bc8-4420-b57d-b41a7b889b66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea50661bf26447e98a1fd8b3603ea880'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:40.623169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ca455f31-7bc8-4420-b57d-b41a7b889b66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea50661bf26447e98a1fd8b3603ea880'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:40.623901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ca455f31-7bc8-4420-b57d-b41a7b889b66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea50661bf26447e98a1fd8b3603ea880'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:40.624506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ca455f31-7bc8-4420-b57d-b41a7b889b66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea50661bf26447e98a1fd8b3603ea880'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:40.631961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ca455f31-7bc8-4420-b57d-b41a7b889b66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea50661bf26447e98a1fd8b3603ea880'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:40.768726 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1313/2675] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:15:40 2022] DELETE /identity/v3/users/ea50661bf26447e98a1fd8b3603ea880 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:15:40.773882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ff5f5-4f6d-427a-bae2-930b370f6a61 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:40.774378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ff5f5-4f6d-427a-bae2-930b370f6a61 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:40.774515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ff5f5-4f6d-427a-bae2-930b370f6a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:40.797841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4e1ff5f5-4f6d-427a-bae2-930b370f6a61 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:40.799257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4e1ff5f5-4f6d-427a-bae2-930b370f6a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:40.872619 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1363/2676] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:40.897470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca455f31-7bc8-4420-b57d-b41a7b889b66 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:40.903621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ca455f31-7bc8-4420-b57d-b41a7b889b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:40.964788 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:40.990022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca455f31-7bc8-4420-b57d-b41a7b889b66 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:40.994758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91000d04-2f23-4c03-b85b-d641e2607533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:40.999438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91000d04-2f23-4c03-b85b-d641e2607533 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:40.999438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91000d04-2f23-4c03-b85b-d641e2607533 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:40.999438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91000d04-2f23-4c03-b85b-d641e2607533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:41.019700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91000d04-2f23-4c03-b85b-d641e2607533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:41.021482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91000d04-2f23-4c03-b85b-d641e2607533 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:41.037541 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1314/2677] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:15:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:15:41.748116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ff5f5-4f6d-427a-bae2-930b370f6a61 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:41.750530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4e1ff5f5-4f6d-427a-bae2-930b370f6a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:41.763679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ff5f5-4f6d-427a-bae2-930b370f6a61 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:41.768985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4005ee39-a303-42df-a4ed-6bb60f31c94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:41.770512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005ee39-a303-42df-a4ed-6bb60f31c94c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:41.770970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005ee39-a303-42df-a4ed-6bb60f31c94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:41.771474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005ee39-a303-42df-a4ed-6bb60f31c94c admin admin] PATH_INFO: `/v3/projects/72ceb4a1af0c438ca29f97d7c0308c3e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:41.773920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005ee39-a303-42df-a4ed-6bb60f31c94c admin admin] RBAC: Authorizing `identity:delete_project(project_id=72ceb4a1af0c438ca29f97d7c0308c3e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:41.776043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4005ee39-a303-42df-a4ed-6bb60f31c94c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:41.961005 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:41.962183 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4005ee39-a303-42df-a4ed-6bb60f31c94c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72ceb4a1af0c438ca29f97d7c0308c3e', 'request_id': 'req-4005ee39-a303-42df-a4ed-6bb60f31c94c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:41.976273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4005ee39-a303-42df-a4ed-6bb60f31c94c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72ceb4a1af0c438ca29f97d7c0308c3e', 'request_id': 'req-4005ee39-a303-42df-a4ed-6bb60f31c94c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:41.990605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4005ee39-a303-42df-a4ed-6bb60f31c94c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72ceb4a1af0c438ca29f97d7c0308c3e', 'request_id': 'req-4005ee39-a303-42df-a4ed-6bb60f31c94c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:42.066854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4005ee39-a303-42df-a4ed-6bb60f31c94c admin admin] The token cache is being invalidate because project 72ceb4a1af0c438ca29f97d7c0308c3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:15:42.067148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4005ee39-a303-42df-a4ed-6bb60f31c94c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:42.067836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4005ee39-a303-42df-a4ed-6bb60f31c94c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:42.071918 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1364/2678] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:15:41 2022] DELETE /identity/v3/projects/72ceb4a1af0c438ca29f97d7c0308c3e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:15:42.077851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad284a67-3ac9-4c58-9d2b-f62e38665623 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:42.077851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad284a67-3ac9-4c58-9d2b-f62e38665623 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:42.077851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad284a67-3ac9-4c58-9d2b-f62e38665623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:42.105018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ad284a67-3ac9-4c58-9d2b-f62e38665623 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:42.106672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ad284a67-3ac9-4c58-9d2b-f62e38665623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:42.213010 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1315/2679] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:42.221264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978b3a2-290d-434a-bac1-634729bd7b98 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:42.221515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978b3a2-290d-434a-bac1-634729bd7b98 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:42.221823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978b3a2-290d-434a-bac1-634729bd7b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:42.262981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4978b3a2-290d-434a-bac1-634729bd7b98 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:42.264729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4978b3a2-290d-434a-bac1-634729bd7b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:42.289137 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1365/2680] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:42.293350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad284a67-3ac9-4c58-9d2b-f62e38665623 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:42.312178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad284a67-3ac9-4c58-9d2b-f62e38665623 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:42.327205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af258a-2939-4708-a899-3fb2e7bf2e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:42.328404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af258a-2939-4708-a899-3fb2e7bf2e43 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:42.328921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af258a-2939-4708-a899-3fb2e7bf2e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:42.329415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af258a-2939-4708-a899-3fb2e7bf2e43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:42.331578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af258a-2939-4708-a899-3fb2e7bf2e43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:15:42.332389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af258a-2939-4708-a899-3fb2e7bf2e43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:42.334545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af258a-2939-4708-a899-3fb2e7bf2e43 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:42.351588 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1316/2681] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:15:42.355767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978b3a2-290d-434a-bac1-634729bd7b98 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:42.370940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978b3a2-290d-434a-bac1-634729bd7b98 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:42.383580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8472e-1e52-41d4-943f-32e2cdf87364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:42.384578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8472e-1e52-41d4-943f-32e2cdf87364 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:42.386012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8472e-1e52-41d4-943f-32e2cdf87364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:42.390306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8472e-1e52-41d4-943f-32e2cdf87364 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:42.391394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8472e-1e52-41d4-943f-32e2cdf87364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:42.393581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab8472e-1e52-41d4-943f-32e2cdf87364 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:42.566679 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1366/2682] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:15:42 2022] POST /identity/v3/projects => generated 373 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:15:42.571016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af258a-2939-4708-a899-3fb2e7bf2e43 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:42.591887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af258a-2939-4708-a899-3fb2e7bf2e43 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:42.699265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926bc65-1192-422e-bdcf-38497add95ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:42.700263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926bc65-1192-422e-bdcf-38497add95ef admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:42.700766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926bc65-1192-422e-bdcf-38497add95ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:42.701420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926bc65-1192-422e-bdcf-38497add95ef admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:42.702371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926bc65-1192-422e-bdcf-38497add95ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:42.705785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926bc65-1192-422e-bdcf-38497add95ef admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:42.836129 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1317/2683] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:15:42 2022] POST /identity/v3/users => generated 287 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:15:42.840485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8472e-1e52-41d4-943f-32e2cdf87364 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:42.853105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8472e-1e52-41d4-943f-32e2cdf87364 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:42.858841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bf0cf-e293-4c5b-88b1-8afe5fed1870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:42.859536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bf0cf-e293-4c5b-88b1-8afe5fed1870 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:42.860106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bf0cf-e293-4c5b-88b1-8afe5fed1870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:42.860481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7bf0cf-e293-4c5b-88b1-8afe5fed1870 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:42.861233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bf0cf-e293-4c5b-88b1-8afe5fed1870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:42.871866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7bf0cf-e293-4c5b-88b1-8afe5fed1870 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:42.886234 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1367/2684] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:15:42.890385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926bc65-1192-422e-bdcf-38497add95ef admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:42.904747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926bc65-1192-422e-bdcf-38497add95ef admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:42.913692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926839b5-68ad-4a63-9a85-82ae328f7874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:42.914759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926839b5-68ad-4a63-9a85-82ae328f7874 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:42.915560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926839b5-68ad-4a63-9a85-82ae328f7874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:42.915690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926839b5-68ad-4a63-9a85-82ae328f7874 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:42.916778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926839b5-68ad-4a63-9a85-82ae328f7874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:42.918557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926839b5-68ad-4a63-9a85-82ae328f7874 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:42.934159 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1318/2685] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:15:42.936119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bf0cf-e293-4c5b-88b1-8afe5fed1870 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:42.947066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7bf0cf-e293-4c5b-88b1-8afe5fed1870 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:42.952869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6416f-788d-4939-a263-a3b3ea042915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:42.953822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6416f-788d-4939-a263-a3b3ea042915 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:42.954353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6416f-788d-4939-a263-a3b3ea042915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:42.954792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6416f-788d-4939-a263-a3b3ea042915 admin admin] PATH_INFO: `/v3/projects/71f55974417340e08b234ea13955b950/users/8432c709a59c417498b77878897969b4/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:42.976437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6416f-788d-4939-a263-a3b3ea042915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71f55974417340e08b234ea13955b950, user_id=8432c709a59c417498b77878897969b4, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:42.981190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6416f-788d-4939-a263-a3b3ea042915 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:43.101935 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1368/2686] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:15:42 2022] PUT /identity/v3/projects/71f55974417340e08b234ea13955b950/users/8432c709a59c417498b77878897969b4/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:15:43.104092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018d1e0-f78a-49bc-bdeb-5c57fedeed3d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:43.104475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018d1e0-f78a-49bc-bdeb-5c57fedeed3d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:43.104475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1018d1e0-f78a-49bc-bdeb-5c57fedeed3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:43.139162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1018d1e0-f78a-49bc-bdeb-5c57fedeed3d None None] MFA Rules not processed for user `8432c709a59c417498b77878897969b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:43.140431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1018d1e0-f78a-49bc-bdeb-5c57fedeed3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:43.180445 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:43.249930 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1319/2687] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:15:43.501595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6416f-788d-4939-a263-a3b3ea042915 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:43.509413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d9d6416f-788d-4939-a263-a3b3ea042915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:43.617630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6416f-788d-4939-a263-a3b3ea042915 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:43.623932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b861c67-38ab-4c18-b888-beab2b746c12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:43.624610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b861c67-38ab-4c18-b888-beab2b746c12 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:43.625109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b861c67-38ab-4c18-b888-beab2b746c12 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:43.625389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b861c67-38ab-4c18-b888-beab2b746c12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:43.634235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b861c67-38ab-4c18-b888-beab2b746c12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:43.636033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b861c67-38ab-4c18-b888-beab2b746c12 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:43.646353 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1369/2688] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:15:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:15:44.079770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa4961-bf38-4dcd-b2da-eb2413e509ee None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:44.080067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa4961-bf38-4dcd-b2da-eb2413e509ee None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:44.080421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa4961-bf38-4dcd-b2da-eb2413e509ee None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:44.082924 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1320/2689] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:15:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:15:44.106546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc94164-ea25-4aa1-a835-7e94ac406dee None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:44.107077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc94164-ea25-4aa1-a835-7e94ac406dee None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:44.107162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc94164-ea25-4aa1-a835-7e94ac406dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:44.146026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9bc94164-ea25-4aa1-a835-7e94ac406dee None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:44.147785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9bc94164-ea25-4aa1-a835-7e94ac406dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:44.261114 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:44.290437 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1370/2690] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:15:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:44.314213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa4961-bf38-4dcd-b2da-eb2413e509ee None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:44.316308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b0fa4961-bf38-4dcd-b2da-eb2413e509ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:44.347347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa4961-bf38-4dcd-b2da-eb2413e509ee None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:44.364594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383cc0e-ab8b-4d98-80ec-9c54f637d5b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:44.365025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383cc0e-ab8b-4d98-80ec-9c54f637d5b6 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:44.365618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383cc0e-ab8b-4d98-80ec-9c54f637d5b6 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:44.366249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383cc0e-ab8b-4d98-80ec-9c54f637d5b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:44.384830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383cc0e-ab8b-4d98-80ec-9c54f637d5b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:44.386593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383cc0e-ab8b-4d98-80ec-9c54f637d5b6 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:44.400655 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1321/2691] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:15:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:15:46.787036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc94164-ea25-4aa1-a835-7e94ac406dee None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:46.904285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc94164-ea25-4aa1-a835-7e94ac406dee None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:46.912704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a514b2-21fd-4b66-9da6-b7ea1742e922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:46.914182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a514b2-21fd-4b66-9da6-b7ea1742e922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:46.914639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a514b2-21fd-4b66-9da6-b7ea1742e922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:46.915102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a514b2-21fd-4b66-9da6-b7ea1742e922 admin admin] PATH_INFO: `/v3/users/8432c709a59c417498b77878897969b4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:46.917574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a514b2-21fd-4b66-9da6-b7ea1742e922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8432c709a59c417498b77878897969b4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:46.920076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a514b2-21fd-4b66-9da6-b7ea1742e922 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:47.124328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b3a514b2-21fd-4b66-9da6-b7ea1742e922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8432c709a59c417498b77878897969b4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:47.153910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b3a514b2-21fd-4b66-9da6-b7ea1742e922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8432c709a59c417498b77878897969b4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:47.163643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b3a514b2-21fd-4b66-9da6-b7ea1742e922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8432c709a59c417498b77878897969b4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:47.164525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b3a514b2-21fd-4b66-9da6-b7ea1742e922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8432c709a59c417498b77878897969b4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:47.233078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b3a514b2-21fd-4b66-9da6-b7ea1742e922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8432c709a59c417498b77878897969b4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:47.240316 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1371/2692] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:15:46 2022] DELETE /identity/v3/users/8432c709a59c417498b77878897969b4 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:15:47.244908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee9864-caa4-4b85-b33f-c9dcebd489b5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:47.245746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee9864-caa4-4b85-b33f-c9dcebd489b5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:47.246035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee9864-caa4-4b85-b33f-c9dcebd489b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:47.266699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-30ee9864-caa4-4b85-b33f-c9dcebd489b5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:47.268061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-30ee9864-caa4-4b85-b33f-c9dcebd489b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:47.345473 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1322/2693] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:47.355818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a514b2-21fd-4b66-9da6-b7ea1742e922 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:47.358001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b3a514b2-21fd-4b66-9da6-b7ea1742e922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:47.419531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a514b2-21fd-4b66-9da6-b7ea1742e922 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:47.423181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01426d5-7e8d-4d8b-a34b-0f9c9acec3bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:47.423902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01426d5-7e8d-4d8b-a34b-0f9c9acec3bc service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:47.424183 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01426d5-7e8d-4d8b-a34b-0f9c9acec3bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:47.424459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01426d5-7e8d-4d8b-a34b-0f9c9acec3bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:47.434697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01426d5-7e8d-4d8b-a34b-0f9c9acec3bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:47.436236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01426d5-7e8d-4d8b-a34b-0f9c9acec3bc service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:47.447190 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1372/2694] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:15:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:15:47.817490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee9864-caa4-4b85-b33f-c9dcebd489b5 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:47.817490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-30ee9864-caa4-4b85-b33f-c9dcebd489b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:47.840093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee9864-caa4-4b85-b33f-c9dcebd489b5 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:47.851092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86fe60-d8c7-4644-8f4c-2106f456a488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:47.852008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86fe60-d8c7-4644-8f4c-2106f456a488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:47.852299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86fe60-d8c7-4644-8f4c-2106f456a488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:47.852586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86fe60-d8c7-4644-8f4c-2106f456a488 admin admin] PATH_INFO: `/v3/users/9ec89b63f3eb421fbb2eb2494016f258` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:47.854087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86fe60-d8c7-4644-8f4c-2106f456a488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ec89b63f3eb421fbb2eb2494016f258)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:47.857526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86fe60-d8c7-4644-8f4c-2106f456a488 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:48.115057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01426d5-7e8d-4d8b-a34b-0f9c9acec3bc service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:48.116611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d01426d5-7e8d-4d8b-a34b-0f9c9acec3bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:48.132364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01426d5-7e8d-4d8b-a34b-0f9c9acec3bc service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:48.138655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5b86fe60-d8c7-4644-8f4c-2106f456a488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ec89b63f3eb421fbb2eb2494016f258'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:48.148872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db9ec8-3cc0-4390-a65b-3c6d50dbd00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:48.151332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db9ec8-3cc0-4390-a65b-3c6d50dbd00d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:48.152219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db9ec8-3cc0-4390-a65b-3c6d50dbd00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:48.153686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db9ec8-3cc0-4390-a65b-3c6d50dbd00d admin admin] PATH_INFO: `/v3/projects/71f55974417340e08b234ea13955b950` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:48.156170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db9ec8-3cc0-4390-a65b-3c6d50dbd00d admin admin] RBAC: Authorizing `identity:delete_project(project_id=71f55974417340e08b234ea13955b950)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:48.161058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db9ec8-3cc0-4390-a65b-3c6d50dbd00d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:48.166139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5b86fe60-d8c7-4644-8f4c-2106f456a488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ec89b63f3eb421fbb2eb2494016f258'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:48.167920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5b86fe60-d8c7-4644-8f4c-2106f456a488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ec89b63f3eb421fbb2eb2494016f258'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:48.170672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5b86fe60-d8c7-4644-8f4c-2106f456a488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ec89b63f3eb421fbb2eb2494016f258'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:48.186963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5b86fe60-d8c7-4644-8f4c-2106f456a488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ec89b63f3eb421fbb2eb2494016f258'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:48.190517 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:48.285294 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1323/2695] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:15:47 2022] DELETE /identity/v3/users/9ec89b63f3eb421fbb2eb2494016f258 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:15:48.292586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41df36-ddb9-43e7-97e0-aa7138bac90f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:48.293113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41df36-ddb9-43e7-97e0-aa7138bac90f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:48.294432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41df36-ddb9-43e7-97e0-aa7138bac90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:48.302563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-34db9ec8-3cc0-4390-a65b-3c6d50dbd00d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71f55974417340e08b234ea13955b950', 'request_id': 'req-34db9ec8-3cc0-4390-a65b-3c6d50dbd00d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:48.308774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-34db9ec8-3cc0-4390-a65b-3c6d50dbd00d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71f55974417340e08b234ea13955b950', 'request_id': 'req-34db9ec8-3cc0-4390-a65b-3c6d50dbd00d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:48.317436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-34db9ec8-3cc0-4390-a65b-3c6d50dbd00d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71f55974417340e08b234ea13955b950', 'request_id': 'req-34db9ec8-3cc0-4390-a65b-3c6d50dbd00d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:48.318404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7e41df36-ddb9-43e7-97e0-aa7138bac90f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:48.320598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7e41df36-ddb9-43e7-97e0-aa7138bac90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:48.365517 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:48.413721 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1324/2696] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:48.428315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-34db9ec8-3cc0-4390-a65b-3c6d50dbd00d admin admin] The token cache is being invalidate because project 71f55974417340e08b234ea13955b950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:15:48.428694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-34db9ec8-3cc0-4390-a65b-3c6d50dbd00d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:48.429563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-34db9ec8-3cc0-4390-a65b-3c6d50dbd00d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:48.431426 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1373/2697] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:15:48 2022] DELETE /identity/v3/projects/71f55974417340e08b234ea13955b950 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:15:48.437444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60edfc-2c54-49b1-9f38-2c33e9e382c1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:48.437845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60edfc-2c54-49b1-9f38-2c33e9e382c1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:48.438362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60edfc-2c54-49b1-9f38-2c33e9e382c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:48.462978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db9ec8-3cc0-4390-a65b-3c6d50dbd00d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:48.463859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1f60edfc-2c54-49b1-9f38-2c33e9e382c1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:48.465630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1f60edfc-2c54-49b1-9f38-2c33e9e382c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:48.466216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-34db9ec8-3cc0-4390-a65b-3c6d50dbd00d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:48.490003 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1325/2698] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:48.560696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e9826-6d49-4f6e-9578-1a92bd78e547 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:48.560696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e9826-6d49-4f6e-9578-1a92bd78e547 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:48.560696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e9826-6d49-4f6e-9578-1a92bd78e547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:48.592109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db9ec8-3cc0-4390-a65b-3c6d50dbd00d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:48.608803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d92e9826-6d49-4f6e-9578-1a92bd78e547 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:48.610036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d92e9826-6d49-4f6e-9578-1a92bd78e547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:48.623897 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1326/2699] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:15:48.628179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e9826-6d49-4f6e-9578-1a92bd78e547 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:48.642590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e9826-6d49-4f6e-9578-1a92bd78e547 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:48.654377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf23eb1-bfc2-4678-9a54-17dacf50d658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:48.655129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf23eb1-bfc2-4678-9a54-17dacf50d658 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:48.655426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf23eb1-bfc2-4678-9a54-17dacf50d658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:48.655701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf23eb1-bfc2-4678-9a54-17dacf50d658 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:48.656775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf23eb1-bfc2-4678-9a54-17dacf50d658 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:15:48.657274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf23eb1-bfc2-4678-9a54-17dacf50d658 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:48.660613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf23eb1-bfc2-4678-9a54-17dacf50d658 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:48.671040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406432f-4d3f-49e1-9bac-421a969cec54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:48.674396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406432f-4d3f-49e1-9bac-421a969cec54 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:48.676996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406432f-4d3f-49e1-9bac-421a969cec54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:48.677353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406432f-4d3f-49e1-9bac-421a969cec54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:48.680724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3406432f-4d3f-49e1-9bac-421a969cec54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:48.693094 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1327/2700] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:15:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:15:48.695086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf23eb1-bfc2-4678-9a54-17dacf50d658 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:48.699946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406432f-4d3f-49e1-9bac-421a969cec54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:48.701534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406432f-4d3f-49e1-9bac-421a969cec54 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:48.709447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf23eb1-bfc2-4678-9a54-17dacf50d658 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:48.717723 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1374/2701] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:15:48.720102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fd633-1a26-4c77-b582-07220d15320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:48.720877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fd633-1a26-4c77-b582-07220d15320e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:48.721506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fd633-1a26-4c77-b582-07220d15320e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:48.721876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fd633-1a26-4c77-b582-07220d15320e admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:48.724205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fd633-1a26-4c77-b582-07220d15320e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:48.726263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fd633-1a26-4c77-b582-07220d15320e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:48.851885 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1328/2702] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:15:48 2022] POST /identity/v3/projects => generated 387 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:15:48.857681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406432f-4d3f-49e1-9bac-421a969cec54 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:48.870464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406432f-4d3f-49e1-9bac-421a969cec54 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:48.950907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a52c2a-9998-4bde-843b-33a9707cb617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:48.952088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a52c2a-9998-4bde-843b-33a9707cb617 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:48.952499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a52c2a-9998-4bde-843b-33a9707cb617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:48.953119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a52c2a-9998-4bde-843b-33a9707cb617 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:48.953826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a52c2a-9998-4bde-843b-33a9707cb617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:48.956090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a52c2a-9998-4bde-843b-33a9707cb617 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:49.068569 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1375/2703] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:15:48 2022] POST /identity/v3/users => generated 294 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:15:49.069237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fd633-1a26-4c77-b582-07220d15320e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:49.080087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fd633-1a26-4c77-b582-07220d15320e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:49.086473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02dee4-d405-4030-afac-78c140f598fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:49.087170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02dee4-d405-4030-afac-78c140f598fc admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:49.087711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02dee4-d405-4030-afac-78c140f598fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:49.087808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02dee4-d405-4030-afac-78c140f598fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:49.088592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02dee4-d405-4030-afac-78c140f598fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:49.090406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02dee4-d405-4030-afac-78c140f598fc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:49.102017 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1329/2704] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:15:49.105653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a52c2a-9998-4bde-843b-33a9707cb617 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:49.119485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a52c2a-9998-4bde-843b-33a9707cb617 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:49.129369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e936258-6e7d-44da-b626-a5b675aad746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:49.133434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e936258-6e7d-44da-b626-a5b675aad746 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:49.133434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e936258-6e7d-44da-b626-a5b675aad746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:49.133434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e936258-6e7d-44da-b626-a5b675aad746 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:49.133434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e936258-6e7d-44da-b626-a5b675aad746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:49.133434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e936258-6e7d-44da-b626-a5b675aad746 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:49.145264 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1376/2705] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:15:49.149415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02dee4-d405-4030-afac-78c140f598fc admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:49.163055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02dee4-d405-4030-afac-78c140f598fc admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:49.169176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36145ccb-310a-4745-a388-e360ece4fdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:49.170454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36145ccb-310a-4745-a388-e360ece4fdaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:49.174772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36145ccb-310a-4745-a388-e360ece4fdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:49.174772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36145ccb-310a-4745-a388-e360ece4fdaa admin admin] PATH_INFO: `/v3/projects/80eb9bf754d6426096bc6cde25fd404b/users/f33dfa6cef9545f68fc53f885a772af4/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:49.191920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36145ccb-310a-4745-a388-e360ece4fdaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=80eb9bf754d6426096bc6cde25fd404b, user_id=f33dfa6cef9545f68fc53f885a772af4, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:49.197848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36145ccb-310a-4745-a388-e360ece4fdaa admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:49.248579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e936258-6e7d-44da-b626-a5b675aad746 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:49.251161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7e936258-6e7d-44da-b626-a5b675aad746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:49.265735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e936258-6e7d-44da-b626-a5b675aad746 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:49.272480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c9b94-157b-44b6-b744-dd6b55c4e80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:49.273870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c9b94-157b-44b6-b744-dd6b55c4e80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:49.274435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c9b94-157b-44b6-b744-dd6b55c4e80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:49.274918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c9b94-157b-44b6-b744-dd6b55c4e80e admin admin] PATH_INFO: `/v3/projects/b9d1daa11da543d7a8088edb5f48e7e1` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:49.280097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c9b94-157b-44b6-b744-dd6b55c4e80e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9d1daa11da543d7a8088edb5f48e7e1)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:49.281122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c9b94-157b-44b6-b744-dd6b55c4e80e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:49.307979 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1330/2706] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:15:49 2022] PUT /identity/v3/projects/80eb9bf754d6426096bc6cde25fd404b/users/f33dfa6cef9545f68fc53f885a772af4/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:15:49.312376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ee204-3e31-4340-8a3e-7e3dedacc852 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:49.312908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ee204-3e31-4340-8a3e-7e3dedacc852 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:49.313847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ee204-3e31-4340-8a3e-7e3dedacc852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:49.341103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-069ee204-3e31-4340-8a3e-7e3dedacc852 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:49.342575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-069ee204-3e31-4340-8a3e-7e3dedacc852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:49.465690 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1331/2707] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:49.467549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-320c9b94-157b-44b6-b744-dd6b55c4e80e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9d1daa11da543d7a8088edb5f48e7e1', 'request_id': 'req-320c9b94-157b-44b6-b744-dd6b55c4e80e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:49.478462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ee204-3e31-4340-8a3e-7e3dedacc852 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:49.481281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-069ee204-3e31-4340-8a3e-7e3dedacc852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:49.510334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-320c9b94-157b-44b6-b744-dd6b55c4e80e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9d1daa11da543d7a8088edb5f48e7e1', 'request_id': 'req-320c9b94-157b-44b6-b744-dd6b55c4e80e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:49.529484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-320c9b94-157b-44b6-b744-dd6b55c4e80e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9d1daa11da543d7a8088edb5f48e7e1', 'request_id': 'req-320c9b94-157b-44b6-b744-dd6b55c4e80e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:49.557602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ee204-3e31-4340-8a3e-7e3dedacc852 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:49.645983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-320c9b94-157b-44b6-b744-dd6b55c4e80e admin admin] The token cache is being invalidate because project b9d1daa11da543d7a8088edb5f48e7e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:15:49.646315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-320c9b94-157b-44b6-b744-dd6b55c4e80e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:49.648104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-320c9b94-157b-44b6-b744-dd6b55c4e80e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:49.650546 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1377/2708] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:15:49 2022] DELETE /identity/v3/projects/b9d1daa11da543d7a8088edb5f48e7e1 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:15:49.656191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c9b94-157b-44b6-b744-dd6b55c4e80e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:49.660714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-320c9b94-157b-44b6-b744-dd6b55c4e80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:49.683742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee81974-877b-40f8-acff-d74a8a36661c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:49.685102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee81974-877b-40f8-acff-d74a8a36661c service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:49.685597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee81974-877b-40f8-acff-d74a8a36661c service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:49.686088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee81974-877b-40f8-acff-d74a8a36661c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:49.688394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9ee81974-877b-40f8-acff-d74a8a36661c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:49.759503 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:49.806519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee81974-877b-40f8-acff-d74a8a36661c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:49.813772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee81974-877b-40f8-acff-d74a8a36661c service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:49.827242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c9b94-157b-44b6-b744-dd6b55c4e80e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:49.836869 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1332/2709] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:15:49.841841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd47c52-bf3e-45b5-81bf-2399af465b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:49.843225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd47c52-bf3e-45b5-81bf-2399af465b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:49.843753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd47c52-bf3e-45b5-81bf-2399af465b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:49.844079 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:49.844555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd47c52-bf3e-45b5-81bf-2399af465b40 admin admin] PATH_INFO: `/v3/users/4b94d9650df44e349e8a9ef2ffd41b3a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:49.847132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd47c52-bf3e-45b5-81bf-2399af465b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b94d9650df44e349e8a9ef2ffd41b3a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:49.854382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd47c52-bf3e-45b5-81bf-2399af465b40 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:50.109078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0dd47c52-bf3e-45b5-81bf-2399af465b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b94d9650df44e349e8a9ef2ffd41b3a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:50.129234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0dd47c52-bf3e-45b5-81bf-2399af465b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b94d9650df44e349e8a9ef2ffd41b3a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:50.141531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0dd47c52-bf3e-45b5-81bf-2399af465b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b94d9650df44e349e8a9ef2ffd41b3a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:50.143028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0dd47c52-bf3e-45b5-81bf-2399af465b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b94d9650df44e349e8a9ef2ffd41b3a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:50.254513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0dd47c52-bf3e-45b5-81bf-2399af465b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b94d9650df44e349e8a9ef2ffd41b3a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:50.264552 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1378/2710] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:15:49 2022] DELETE /identity/v3/users/4b94d9650df44e349e8a9ef2ffd41b3a => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:15:51.107037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee81974-877b-40f8-acff-d74a8a36661c service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:51.126932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee81974-877b-40f8-acff-d74a8a36661c service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:51.282498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773b004-e9c1-4b0c-83df-e5e3aa71ff8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:51.283394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773b004-e9c1-4b0c-83df-e5e3aa71ff8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:51.286136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773b004-e9c1-4b0c-83df-e5e3aa71ff8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:51.286524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773b004-e9c1-4b0c-83df-e5e3aa71ff8e admin admin] PATH_INFO: `/v3/projects/de3e544a771a4dc694f513f7375b7092` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:51.289889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773b004-e9c1-4b0c-83df-e5e3aa71ff8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=de3e544a771a4dc694f513f7375b7092)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:51.293682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773b004-e9c1-4b0c-83df-e5e3aa71ff8e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:51.520495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4773b004-e9c1-4b0c-83df-e5e3aa71ff8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de3e544a771a4dc694f513f7375b7092', 'request_id': 'req-4773b004-e9c1-4b0c-83df-e5e3aa71ff8e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:51.610267 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=81,keystone:INSERT=4,keystone:DELETE=15 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:51.611017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4773b004-e9c1-4b0c-83df-e5e3aa71ff8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de3e544a771a4dc694f513f7375b7092', 'request_id': 'req-4773b004-e9c1-4b0c-83df-e5e3aa71ff8e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:51.612859 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:51.623875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4773b004-e9c1-4b0c-83df-e5e3aa71ff8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de3e544a771a4dc694f513f7375b7092', 'request_id': 'req-4773b004-e9c1-4b0c-83df-e5e3aa71ff8e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:51.653293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4773b004-e9c1-4b0c-83df-e5e3aa71ff8e admin admin] The token cache is being invalidate because project de3e544a771a4dc694f513f7375b7092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:15:51.653589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4773b004-e9c1-4b0c-83df-e5e3aa71ff8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:51.657248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4773b004-e9c1-4b0c-83df-e5e3aa71ff8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:51.659300 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1333/2711] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:15:51 2022] DELETE /identity/v3/projects/de3e544a771a4dc694f513f7375b7092 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:15:51.665736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6d5ad-8b70-4e9c-a589-81c01fb2440e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:51.666399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6d5ad-8b70-4e9c-a589-81c01fb2440e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:51.666897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6d5ad-8b70-4e9c-a589-81c01fb2440e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:51.740403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c4a6d5ad-8b70-4e9c-a589-81c01fb2440e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:51.744136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c4a6d5ad-8b70-4e9c-a589-81c01fb2440e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:51.864370 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1379/2712] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:51.866628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec5cbc-dc49-42fc-ad96-6fa1c933ea53 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:51.866922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec5cbc-dc49-42fc-ad96-6fa1c933ea53 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:51.867203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec5cbc-dc49-42fc-ad96-6fa1c933ea53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:51.899247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-35ec5cbc-dc49-42fc-ad96-6fa1c933ea53 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:51.900506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-35ec5cbc-dc49-42fc-ad96-6fa1c933ea53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:51.929593 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1334/2713] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:51.931284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6d5ad-8b70-4e9c-a589-81c01fb2440e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:51.948492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6d5ad-8b70-4e9c-a589-81c01fb2440e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:51.989475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56410e-e045-4c5f-b075-e58f54f29166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:51.993057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56410e-e045-4c5f-b075-e58f54f29166 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:51.993057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56410e-e045-4c5f-b075-e58f54f29166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:51.993057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56410e-e045-4c5f-b075-e58f54f29166 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:52.006658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56410e-e045-4c5f-b075-e58f54f29166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:15:52.009299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56410e-e045-4c5f-b075-e58f54f29166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:52.027395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56410e-e045-4c5f-b075-e58f54f29166 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:52.063888 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1380/2714] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:15:52.065107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec5cbc-dc49-42fc-ad96-6fa1c933ea53 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:52.093593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec5cbc-dc49-42fc-ad96-6fa1c933ea53 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:52.115938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b543b-f6c2-48ac-98f7-8cc1d9afe64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:52.122201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b543b-f6c2-48ac-98f7-8cc1d9afe64c admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:52.123929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b543b-f6c2-48ac-98f7-8cc1d9afe64c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:52.124440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b543b-f6c2-48ac-98f7-8cc1d9afe64c admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:52.129317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b543b-f6c2-48ac-98f7-8cc1d9afe64c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:52.134788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b543b-f6c2-48ac-98f7-8cc1d9afe64c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:52.267739 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1335/2715] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:15:52 2022] POST /identity/v3/projects => generated 377 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:15:52.269714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56410e-e045-4c5f-b075-e58f54f29166 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:52.286729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56410e-e045-4c5f-b075-e58f54f29166 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:52.461344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8dbad3-5c3a-4392-81b9-03eda7450f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:52.462054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dbad3-5c3a-4392-81b9-03eda7450f65 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:52.462369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dbad3-5c3a-4392-81b9-03eda7450f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:52.466051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8dbad3-5c3a-4392-81b9-03eda7450f65 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:52.466844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8dbad3-5c3a-4392-81b9-03eda7450f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:52.475260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8dbad3-5c3a-4392-81b9-03eda7450f65 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:52.600561 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1381/2716] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:15:52 2022] POST /identity/v3/users => generated 289 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:15:52.606133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b543b-f6c2-48ac-98f7-8cc1d9afe64c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:52.622803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b543b-f6c2-48ac-98f7-8cc1d9afe64c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:52.638532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be38f2-1b2b-4fc6-b2ce-d280eaa13bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:52.639396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be38f2-1b2b-4fc6-b2ce-d280eaa13bab admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:52.639847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be38f2-1b2b-4fc6-b2ce-d280eaa13bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:52.640229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be38f2-1b2b-4fc6-b2ce-d280eaa13bab admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:52.641090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be38f2-1b2b-4fc6-b2ce-d280eaa13bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:52.642845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be38f2-1b2b-4fc6-b2ce-d280eaa13bab admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:52.665227 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1336/2717] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:15:52.668928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8dbad3-5c3a-4392-81b9-03eda7450f65 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:52.681362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8dbad3-5c3a-4392-81b9-03eda7450f65 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:52.687797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e7b9e-a5c1-4872-b2a2-5d8e297ec315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:52.688761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e7b9e-a5c1-4872-b2a2-5d8e297ec315 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:52.689251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e7b9e-a5c1-4872-b2a2-5d8e297ec315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:52.689827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e7b9e-a5c1-4872-b2a2-5d8e297ec315 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:52.690817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e7b9e-a5c1-4872-b2a2-5d8e297ec315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:52.694003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e7b9e-a5c1-4872-b2a2-5d8e297ec315 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:52.718179 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1382/2718] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:15:52.722222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be38f2-1b2b-4fc6-b2ce-d280eaa13bab admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:52.733232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be38f2-1b2b-4fc6-b2ce-d280eaa13bab admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:52.738929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe472c9-10a5-45dd-bd1a-67ac41898b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:52.740142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe472c9-10a5-45dd-bd1a-67ac41898b82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:52.740605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe472c9-10a5-45dd-bd1a-67ac41898b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:52.742940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe472c9-10a5-45dd-bd1a-67ac41898b82 admin admin] PATH_INFO: `/v3/projects/898227783ee246c089b1a428fe4ed00a/users/aef9ee24f2374c1787b4d60764488048/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:52.760541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe472c9-10a5-45dd-bd1a-67ac41898b82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=898227783ee246c089b1a428fe4ed00a, user_id=aef9ee24f2374c1787b4d60764488048, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:52.765519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe472c9-10a5-45dd-bd1a-67ac41898b82 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:52.877915 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1337/2719] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:15:52 2022] PUT /identity/v3/projects/898227783ee246c089b1a428fe4ed00a/users/aef9ee24f2374c1787b4d60764488048/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:15:52.890426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d86718-3af7-421c-a988-025022032ac0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:52.890871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d86718-3af7-421c-a988-025022032ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:52.891374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d86718-3af7-421c-a988-025022032ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:52.954942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-58d86718-3af7-421c-a988-025022032ac0 None None] MFA Rules not processed for user `aef9ee24f2374c1787b4d60764488048`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:52.957408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-58d86718-3af7-421c-a988-025022032ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:53.027988 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:53.079206 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1383/2720] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:53.084588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe472c9-10a5-45dd-bd1a-67ac41898b82 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:53.208957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe472c9-10a5-45dd-bd1a-67ac41898b82 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:53.217950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a22b33-6d62-4eae-afa5-0662ed69d326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:53.218936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a22b33-6d62-4eae-afa5-0662ed69d326 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:53.219373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a22b33-6d62-4eae-afa5-0662ed69d326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:53.219810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a22b33-6d62-4eae-afa5-0662ed69d326 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:53.225515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a22b33-6d62-4eae-afa5-0662ed69d326 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:53.228254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a22b33-6d62-4eae-afa5-0662ed69d326 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:53.374118 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1338/2721] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:15:53 2022] POST /identity/v3/projects => generated 375 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:15:53.378649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d86718-3af7-421c-a988-025022032ac0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:53.398070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d86718-3af7-421c-a988-025022032ac0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:53.506534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a1a7b-79f6-4a7b-b4cd-6d7d73b747ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:53.507222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a1a7b-79f6-4a7b-b4cd-6d7d73b747ac admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:53.507508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a1a7b-79f6-4a7b-b4cd-6d7d73b747ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:53.507823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a1a7b-79f6-4a7b-b4cd-6d7d73b747ac admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:53.511204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a1a7b-79f6-4a7b-b4cd-6d7d73b747ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:53.511204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a1a7b-79f6-4a7b-b4cd-6d7d73b747ac admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:53.622413 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1384/2722] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:15:53 2022] POST /identity/v3/users => generated 294 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:15:53.626386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a22b33-6d62-4eae-afa5-0662ed69d326 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:53.638302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a22b33-6d62-4eae-afa5-0662ed69d326 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:53.647262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da940ec-3a3b-4940-931b-d072e53e0165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:53.649392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da940ec-3a3b-4940-931b-d072e53e0165 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:53.650060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da940ec-3a3b-4940-931b-d072e53e0165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:53.650583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da940ec-3a3b-4940-931b-d072e53e0165 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:53.651342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da940ec-3a3b-4940-931b-d072e53e0165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:53.656075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da940ec-3a3b-4940-931b-d072e53e0165 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:53.671831 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1339/2723] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:15:53.676080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a1a7b-79f6-4a7b-b4cd-6d7d73b747ac admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:53.686715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a1a7b-79f6-4a7b-b4cd-6d7d73b747ac admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:53.703971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e07e9d-1b53-42c4-a63b-501756cc7ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:53.704882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e07e9d-1b53-42c4-a63b-501756cc7ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:53.705167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e07e9d-1b53-42c4-a63b-501756cc7ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:53.705448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e07e9d-1b53-42c4-a63b-501756cc7ea5 admin admin] PATH_INFO: `/v3/projects/cf1f3f5507594b938a10e630ea612a57/users/dbb35a49c87f446b8519491ab2d1c496/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:53.726056 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e07e9d-1b53-42c4-a63b-501756cc7ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf1f3f5507594b938a10e630ea612a57, user_id=dbb35a49c87f446b8519491ab2d1c496, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:53.729047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e07e9d-1b53-42c4-a63b-501756cc7ea5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:53.813930 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1385/2724] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:15:53 2022] PUT /identity/v3/projects/cf1f3f5507594b938a10e630ea612a57/users/dbb35a49c87f446b8519491ab2d1c496/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:15:53.819218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da940ec-3a3b-4940-931b-d072e53e0165 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:53.851831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da940ec-3a3b-4940-931b-d072e53e0165 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:54.086856 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:54.114011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b021bf97-fecd-421f-965e-24194adfa9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:54.114746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021bf97-fecd-421f-965e-24194adfa9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:54.115042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021bf97-fecd-421f-965e-24194adfa9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:54.115312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b021bf97-fecd-421f-965e-24194adfa9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:54.136884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021bf97-fecd-421f-965e-24194adfa9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:54.141178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b021bf97-fecd-421f-965e-24194adfa9c6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:54.181642 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1340/2725] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:15:54.186828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e07e9d-1b53-42c4-a63b-501756cc7ea5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:54.202573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e07e9d-1b53-42c4-a63b-501756cc7ea5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:54.231189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3da283-b3eb-4f7a-9f60-3876ea076e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:54.232317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3da283-b3eb-4f7a-9f60-3876ea076e3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:54.236709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3da283-b3eb-4f7a-9f60-3876ea076e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:54.237240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3da283-b3eb-4f7a-9f60-3876ea076e3b admin admin] PATH_INFO: `/v3/projects/cf1f3f5507594b938a10e630ea612a57/users/dbb35a49c87f446b8519491ab2d1c496/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:54.242435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3da283-b3eb-4f7a-9f60-3876ea076e3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf1f3f5507594b938a10e630ea612a57, user_id=dbb35a49c87f446b8519491ab2d1c496, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:54.245314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3da283-b3eb-4f7a-9f60-3876ea076e3b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:54.317236 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1386/2726] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:15:54 2022] PUT /identity/v3/projects/cf1f3f5507594b938a10e630ea612a57/users/dbb35a49c87f446b8519491ab2d1c496/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:15:54.328505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311689b6-c523-4c4f-8b37-2dd71f583378 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:54.329067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311689b6-c523-4c4f-8b37-2dd71f583378 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:54.329169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311689b6-c523-4c4f-8b37-2dd71f583378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:54.388720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-311689b6-c523-4c4f-8b37-2dd71f583378 None None] MFA Rules not processed for user `dbb35a49c87f446b8519491ab2d1c496`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:54.390568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-311689b6-c523-4c4f-8b37-2dd71f583378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:54.527887 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1341/2727] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:54 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:54.718720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3da283-b3eb-4f7a-9f60-3876ea076e3b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:54.720600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-af3da283-b3eb-4f7a-9f60-3876ea076e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:54.829484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3da283-b3eb-4f7a-9f60-3876ea076e3b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:54.839789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7751aec-e628-4682-b157-debe8bfa620b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:54.840734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7751aec-e628-4682-b157-debe8bfa620b service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:54.841178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7751aec-e628-4682-b157-debe8bfa620b service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:54.841607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7751aec-e628-4682-b157-debe8bfa620b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:54.854593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7751aec-e628-4682-b157-debe8bfa620b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:54.859371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7751aec-e628-4682-b157-debe8bfa620b service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:54.877192 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1387/2728] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:15:54 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:15:55.833939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81a849-81ca-4eb7-aebc-b0d8aa6d7f14 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:55.834480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81a849-81ca-4eb7-aebc-b0d8aa6d7f14 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:55.834667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b81a849-81ca-4eb7-aebc-b0d8aa6d7f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:55.869594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0b81a849-81ca-4eb7-aebc-b0d8aa6d7f14 None None] MFA Rules not processed for user `a6fc909d2c0843b8a29eb1d47a755db9`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:55.871856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0b81a849-81ca-4eb7-aebc-b0d8aa6d7f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:55.985183 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1342/2729] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:56.078613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98164b-fda8-4d3d-b8fc-e9c5723381ff None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:56.079137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98164b-fda8-4d3d-b8fc-e9c5723381ff None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:56.079264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc98164b-fda8-4d3d-b8fc-e9c5723381ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:56.124578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-cc98164b-fda8-4d3d-b8fc-e9c5723381ff None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:56.125809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cc98164b-fda8-4d3d-b8fc-e9c5723381ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:56.145152 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:56.285609 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1388/2730] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:15:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:56.292832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81a849-81ca-4eb7-aebc-b0d8aa6d7f14 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:56.294456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0b81a849-81ca-4eb7-aebc-b0d8aa6d7f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:56.553072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b81a849-81ca-4eb7-aebc-b0d8aa6d7f14 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:56.569382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfd8a8-5c0d-443f-b148-06dd49e3cd6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:56.570403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfd8a8-5c0d-443f-b148-06dd49e3cd6f service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:56.570885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfd8a8-5c0d-443f-b148-06dd49e3cd6f service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:56.571360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfd8a8-5c0d-443f-b148-06dd49e3cd6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:56.609159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfd8a8-5c0d-443f-b148-06dd49e3cd6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:56.609159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfd8a8-5c0d-443f-b148-06dd49e3cd6f service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:56.642512 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1343/2731] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:15:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:15:58.288320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98164b-fda8-4d3d-b8fc-e9c5723381ff None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:58.504727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc98164b-fda8-4d3d-b8fc-e9c5723381ff None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:58.518086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69af6ee-2a27-4a78-badb-31fa83582d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:58.519985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69af6ee-2a27-4a78-badb-31fa83582d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:58.520433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69af6ee-2a27-4a78-badb-31fa83582d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:58.520875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69af6ee-2a27-4a78-badb-31fa83582d49 admin admin] PATH_INFO: `/v3/users/aef9ee24f2374c1787b4d60764488048` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:58.523504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69af6ee-2a27-4a78-badb-31fa83582d49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aef9ee24f2374c1787b4d60764488048)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:58.528513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69af6ee-2a27-4a78-badb-31fa83582d49 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:58.838060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c69af6ee-2a27-4a78-badb-31fa83582d49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aef9ee24f2374c1787b4d60764488048'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:58.893617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c69af6ee-2a27-4a78-badb-31fa83582d49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aef9ee24f2374c1787b4d60764488048'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:58.912170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c69af6ee-2a27-4a78-badb-31fa83582d49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aef9ee24f2374c1787b4d60764488048'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:58.915002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c69af6ee-2a27-4a78-badb-31fa83582d49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aef9ee24f2374c1787b4d60764488048'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:59.020760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c69af6ee-2a27-4a78-badb-31fa83582d49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aef9ee24f2374c1787b4d60764488048'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:15:59.031187 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1389/2732] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:15:58 2022] DELETE /identity/v3/users/aef9ee24f2374c1787b4d60764488048 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:15:59.032552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa297ca-62d8-4920-8c6e-b45c3503e147 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:59.032973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa297ca-62d8-4920-8c6e-b45c3503e147 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:59.033109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa297ca-62d8-4920-8c6e-b45c3503e147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:59.087742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ffa297ca-62d8-4920-8c6e-b45c3503e147 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:15:59.096384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ffa297ca-62d8-4920-8c6e-b45c3503e147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:59.118602 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:59.261223 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1344/2733] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:15:59.278380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69af6ee-2a27-4a78-badb-31fa83582d49 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:15:59.279642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c69af6ee-2a27-4a78-badb-31fa83582d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:15:59.417400 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:15:59.465879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69af6ee-2a27-4a78-badb-31fa83582d49 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:15:59.493328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0084485-823e-47cd-8243-28815993703d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:15:59.494414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0084485-823e-47cd-8243-28815993703d service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:15:59.495783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0084485-823e-47cd-8243-28815993703d service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:15:59.496382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0084485-823e-47cd-8243-28815993703d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:15:59.541755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0084485-823e-47cd-8243-28815993703d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:15:59.544707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0084485-823e-47cd-8243-28815993703d service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:15:59.575176 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1390/2734] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:15:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:16:00.828930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa297ca-62d8-4920-8c6e-b45c3503e147 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:00.830459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ffa297ca-62d8-4920-8c6e-b45c3503e147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:00.867369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa297ca-62d8-4920-8c6e-b45c3503e147 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:00.895883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679226f-a400-4649-bca0-678673ba241b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:00.897689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679226f-a400-4649-bca0-678673ba241b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:00.899170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679226f-a400-4649-bca0-678673ba241b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:00.899818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679226f-a400-4649-bca0-678673ba241b admin admin] PATH_INFO: `/v3/projects/898227783ee246c089b1a428fe4ed00a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:00.902864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679226f-a400-4649-bca0-678673ba241b admin admin] RBAC: Authorizing `identity:delete_project(project_id=898227783ee246c089b1a428fe4ed00a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:00.913210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679226f-a400-4649-bca0-678673ba241b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:01.187082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3679226f-a400-4649-bca0-678673ba241b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '898227783ee246c089b1a428fe4ed00a', 'request_id': 'req-3679226f-a400-4649-bca0-678673ba241b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:01.294562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3679226f-a400-4649-bca0-678673ba241b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '898227783ee246c089b1a428fe4ed00a', 'request_id': 'req-3679226f-a400-4649-bca0-678673ba241b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:01.309419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3679226f-a400-4649-bca0-678673ba241b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '898227783ee246c089b1a428fe4ed00a', 'request_id': 'req-3679226f-a400-4649-bca0-678673ba241b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:01.343881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3679226f-a400-4649-bca0-678673ba241b admin admin] The token cache is being invalidate because project 898227783ee246c089b1a428fe4ed00a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:16:01.345701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3679226f-a400-4649-bca0-678673ba241b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:01.348974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3679226f-a400-4649-bca0-678673ba241b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:01.354379 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1345/2735] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:16:00 2022] DELETE /identity/v3/projects/898227783ee246c089b1a428fe4ed00a => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:16:01.362143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0084485-823e-47cd-8243-28815993703d service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:01.376951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0084485-823e-47cd-8243-28815993703d service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:01.513850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab276ad-4c3e-4df2-8224-67b6990e9f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:01.515207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab276ad-4c3e-4df2-8224-67b6990e9f30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:01.516215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab276ad-4c3e-4df2-8224-67b6990e9f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:01.516567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab276ad-4c3e-4df2-8224-67b6990e9f30 admin admin] PATH_INFO: `/v3/users/dbb35a49c87f446b8519491ab2d1c496` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:01.521261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab276ad-4c3e-4df2-8224-67b6990e9f30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbb35a49c87f446b8519491ab2d1c496)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:01.524421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab276ad-4c3e-4df2-8224-67b6990e9f30 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:01.810505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9ab276ad-4c3e-4df2-8224-67b6990e9f30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbb35a49c87f446b8519491ab2d1c496'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:01.827503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9ab276ad-4c3e-4df2-8224-67b6990e9f30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbb35a49c87f446b8519491ab2d1c496'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:01.877180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9ab276ad-4c3e-4df2-8224-67b6990e9f30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbb35a49c87f446b8519491ab2d1c496'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:01.881670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9ab276ad-4c3e-4df2-8224-67b6990e9f30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbb35a49c87f446b8519491ab2d1c496'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:02.010600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9ab276ad-4c3e-4df2-8224-67b6990e9f30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbb35a49c87f446b8519491ab2d1c496'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:02.023430 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1391/2736] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:16:01 2022] DELETE /identity/v3/users/dbb35a49c87f446b8519491ab2d1c496 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:16:03.630591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679226f-a400-4649-bca0-678673ba241b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:03.630591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3679226f-a400-4649-bca0-678673ba241b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:03.674817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679226f-a400-4649-bca0-678673ba241b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:03.891966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fefe5-17a8-47df-b9e0-64bfc5824027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:03.893107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fefe5-17a8-47df-b9e0-64bfc5824027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:03.894639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fefe5-17a8-47df-b9e0-64bfc5824027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:03.895151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fefe5-17a8-47df-b9e0-64bfc5824027 admin admin] PATH_INFO: `/v3/projects/cf1f3f5507594b938a10e630ea612a57` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:03.897498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fefe5-17a8-47df-b9e0-64bfc5824027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf1f3f5507594b938a10e630ea612a57)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:03.900189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fefe5-17a8-47df-b9e0-64bfc5824027 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:04.073217 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:04.111134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-018fefe5-17a8-47df-b9e0-64bfc5824027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf1f3f5507594b938a10e630ea612a57', 'request_id': 'req-018fefe5-17a8-47df-b9e0-64bfc5824027'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:04.192948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-018fefe5-17a8-47df-b9e0-64bfc5824027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf1f3f5507594b938a10e630ea612a57', 'request_id': 'req-018fefe5-17a8-47df-b9e0-64bfc5824027'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:04.201873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-018fefe5-17a8-47df-b9e0-64bfc5824027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf1f3f5507594b938a10e630ea612a57', 'request_id': 'req-018fefe5-17a8-47df-b9e0-64bfc5824027'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:04.252128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-018fefe5-17a8-47df-b9e0-64bfc5824027 admin admin] The token cache is being invalidate because project cf1f3f5507594b938a10e630ea612a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:16:04.252616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-018fefe5-17a8-47df-b9e0-64bfc5824027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:04.258915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-018fefe5-17a8-47df-b9e0-64bfc5824027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:04.270699 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1346/2737] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:16:03 2022] DELETE /identity/v3/projects/cf1f3f5507594b938a10e630ea612a57 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:16:04.276099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593adadb-a58a-4d6d-b50a-1b59f8a85640 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:04.277416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593adadb-a58a-4d6d-b50a-1b59f8a85640 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:04.277876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593adadb-a58a-4d6d-b50a-1b59f8a85640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:04.322342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-593adadb-a58a-4d6d-b50a-1b59f8a85640 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:04.325479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-593adadb-a58a-4d6d-b50a-1b59f8a85640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:04.598308 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:04.657387 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1392/2738] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:04.667249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8451a-8b13-47f1-b65f-83518286e708 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:04.667843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8451a-8b13-47f1-b65f-83518286e708 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:04.668041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8451a-8b13-47f1-b65f-83518286e708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:04.724288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-09d8451a-8b13-47f1-b65f-83518286e708 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:04.725854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-09d8451a-8b13-47f1-b65f-83518286e708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:04.749696 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1347/2739] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:04.755107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593adadb-a58a-4d6d-b50a-1b59f8a85640 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:04.768931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593adadb-a58a-4d6d-b50a-1b59f8a85640 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:04.786741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f828e-65b0-43d9-8c9f-c0a2a61829d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:04.787577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f828e-65b0-43d9-8c9f-c0a2a61829d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:04.787983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f828e-65b0-43d9-8c9f-c0a2a61829d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:04.788363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f828e-65b0-43d9-8c9f-c0a2a61829d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:04.789206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f828e-65b0-43d9-8c9f-c0a2a61829d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:16:04.789613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f828e-65b0-43d9-8c9f-c0a2a61829d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:04.793609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f828e-65b0-43d9-8c9f-c0a2a61829d9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:04.840543 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1393/2740] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:16:04.843573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8451a-8b13-47f1-b65f-83518286e708 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:04.861149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8451a-8b13-47f1-b65f-83518286e708 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:04.872799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f539a1-deea-408e-8290-54ee23c5cc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:04.881978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f539a1-deea-408e-8290-54ee23c5cc5b admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:04.883986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f539a1-deea-408e-8290-54ee23c5cc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:04.884300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f539a1-deea-408e-8290-54ee23c5cc5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:04.885600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f539a1-deea-408e-8290-54ee23c5cc5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:04.887049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f539a1-deea-408e-8290-54ee23c5cc5b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:05.042887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f828e-65b0-43d9-8c9f-c0a2a61829d9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:05.051416 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1348/2741] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:16:04 2022] POST /identity/v3/projects => generated 395 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:16:05.057020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f828e-65b0-43d9-8c9f-c0a2a61829d9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:05.075217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b9a5d-db43-4552-9cc6-27a1dadb2508 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:05.075626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b9a5d-db43-4552-9cc6-27a1dadb2508 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:05.075941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b9a5d-db43-4552-9cc6-27a1dadb2508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:05.177236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9c4b9a5d-db43-4552-9cc6-27a1dadb2508 None None] MFA Rules not processed for user `5d2572c3904f40c6b26ce92425f655f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:05.181385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9c4b9a5d-db43-4552-9cc6-27a1dadb2508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:05.379804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74063b9-4ff8-49b4-85ee-37c9df1f3fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:05.379804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74063b9-4ff8-49b4-85ee-37c9df1f3fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:05.379804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74063b9-4ff8-49b4-85ee-37c9df1f3fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:05.379804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74063b9-4ff8-49b4-85ee-37c9df1f3fb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:05.389724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74063b9-4ff8-49b4-85ee-37c9df1f3fb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:05.403090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74063b9-4ff8-49b4-85ee-37c9df1f3fb4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:05.468121 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1349/2742] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:05.469481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fa430-4f6e-4899-aa2c-ea3440217bf7 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:05.469775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fa430-4f6e-4899-aa2c-ea3440217bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:05.470048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fa430-4f6e-4899-aa2c-ea3440217bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:05.575480 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1394/2743] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:16:05 2022] POST /identity/v3/users => generated 298 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:16:05.576570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74063b9-4ff8-49b4-85ee-37c9df1f3fb4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:05.578756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-265fa430-4f6e-4899-aa2c-ea3440217bf7 None None] MFA Rules not processed for user `f33dfa6cef9545f68fc53f885a772af4`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:05.584085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-265fa430-4f6e-4899-aa2c-ea3440217bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:05.616445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74063b9-4ff8-49b4-85ee-37c9df1f3fb4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:05.644561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b30d17-e583-4e23-9695-62fcb7f69969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:05.645342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b30d17-e583-4e23-9695-62fcb7f69969 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:05.645630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b30d17-e583-4e23-9695-62fcb7f69969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:05.654674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b30d17-e583-4e23-9695-62fcb7f69969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:05.655558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b30d17-e583-4e23-9695-62fcb7f69969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:05.657188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b30d17-e583-4e23-9695-62fcb7f69969 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:05.687599 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1395/2744] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:16:05.695315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b30d17-e583-4e23-9695-62fcb7f69969 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:05.712299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b30d17-e583-4e23-9695-62fcb7f69969 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:05.724154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151fad9-dbae-44e1-878b-04930dc4d9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:05.725084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151fad9-dbae-44e1-878b-04930dc4d9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:05.725902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151fad9-dbae-44e1-878b-04930dc4d9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:05.726665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151fad9-dbae-44e1-878b-04930dc4d9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:05.729891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151fad9-dbae-44e1-878b-04930dc4d9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:05.731914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151fad9-dbae-44e1-878b-04930dc4d9d0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:05.758907 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1396/2745] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:16:05.760196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151fad9-dbae-44e1-878b-04930dc4d9d0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:05.777137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151fad9-dbae-44e1-878b-04930dc4d9d0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:05.787395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13467b97-5d0f-4c3d-8b6f-741a4274c5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:05.788629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13467b97-5d0f-4c3d-8b6f-741a4274c5e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:05.789321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13467b97-5d0f-4c3d-8b6f-741a4274c5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:05.789902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13467b97-5d0f-4c3d-8b6f-741a4274c5e4 admin admin] PATH_INFO: `/v3/projects/c996db49675c40debc779c00cbf03ce4/users/f81f9be8cdb145b4a7b4d4aacb2ad66c/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:05.934412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13467b97-5d0f-4c3d-8b6f-741a4274c5e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c996db49675c40debc779c00cbf03ce4, user_id=f81f9be8cdb145b4a7b4d4aacb2ad66c, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:05.934412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13467b97-5d0f-4c3d-8b6f-741a4274c5e4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:05.935869 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1350/2746] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:05.955695 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fa430-4f6e-4899-aa2c-ea3440217bf7 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:05.958330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-265fa430-4f6e-4899-aa2c-ea3440217bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:06.022947 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1397/2747] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:16:05 2022] PUT /identity/v3/projects/c996db49675c40debc779c00cbf03ce4/users/f81f9be8cdb145b4a7b4d4aacb2ad66c/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:16:06.039740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58addfca-3ed3-4827-bc74-525d33c1d2f3 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:06.040080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58addfca-3ed3-4827-bc74-525d33c1d2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:06.040368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58addfca-3ed3-4827-bc74-525d33c1d2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:06.067359 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:06.135859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-58addfca-3ed3-4827-bc74-525d33c1d2f3 None None] MFA Rules not processed for user `f81f9be8cdb145b4a7b4d4aacb2ad66c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:06.137136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-58addfca-3ed3-4827-bc74-525d33c1d2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:06.171559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265fa430-4f6e-4899-aa2c-ea3440217bf7 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:06.351222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a462f-78bf-43a1-8095-2dfdee4b1be7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:06.351914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a462f-78bf-43a1-8095-2dfdee4b1be7 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:06.352199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a462f-78bf-43a1-8095-2dfdee4b1be7 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:06.352484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369a462f-78bf-43a1-8095-2dfdee4b1be7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:06.463472 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1398/2748] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:06.465009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58addfca-3ed3-4827-bc74-525d33c1d2f3 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:06.520495 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:06.614768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a462f-78bf-43a1-8095-2dfdee4b1be7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:06.617662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369a462f-78bf-43a1-8095-2dfdee4b1be7 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:06.664417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58addfca-3ed3-4827-bc74-525d33c1d2f3 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:06.671164 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1351/2749] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:16:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 716 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:16:06.685799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5797af-986a-4cb6-a775-a977f842e63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:06.686585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5797af-986a-4cb6-a775-a977f842e63b admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:06.687337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5797af-986a-4cb6-a775-a977f842e63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:06.687584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5797af-986a-4cb6-a775-a977f842e63b admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:06.688681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5797af-986a-4cb6-a775-a977f842e63b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:06.696274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5797af-986a-4cb6-a775-a977f842e63b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:06.846451 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1399/2750] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:16:06 2022] POST /identity/v3/projects => generated 393 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:16:06.851766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a462f-78bf-43a1-8095-2dfdee4b1be7 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:06.867128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369a462f-78bf-43a1-8095-2dfdee4b1be7 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:07.134477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21292f0b-cfea-4ceb-8ce6-128453daeb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:07.135179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21292f0b-cfea-4ceb-8ce6-128453daeb52 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:07.135457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21292f0b-cfea-4ceb-8ce6-128453daeb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:07.135736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21292f0b-cfea-4ceb-8ce6-128453daeb52 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:07.136445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21292f0b-cfea-4ceb-8ce6-128453daeb52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:07.147522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21292f0b-cfea-4ceb-8ce6-128453daeb52 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:07.179274 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:07.271093 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1352/2751] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:16:06 2022] POST /identity/v3/users => generated 303 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:16:07.275257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5797af-986a-4cb6-a775-a977f842e63b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:07.297466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5797af-986a-4cb6-a775-a977f842e63b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:07.312963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d0653-18fa-4cb0-ac89-71ba15749ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:07.314372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d0653-18fa-4cb0-ac89-71ba15749ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:07.314790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d0653-18fa-4cb0-ac89-71ba15749ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:07.315142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d0653-18fa-4cb0-ac89-71ba15749ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:07.317292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d0653-18fa-4cb0-ac89-71ba15749ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:07.320843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d0653-18fa-4cb0-ac89-71ba15749ec6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:07.343015 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1400/2752] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:16:07.346071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21292f0b-cfea-4ceb-8ce6-128453daeb52 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:07.364518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21292f0b-cfea-4ceb-8ce6-128453daeb52 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:07.380502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1cc05-2c58-4bed-b36b-90e277605325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:07.381865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1cc05-2c58-4bed-b36b-90e277605325 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:07.382701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1cc05-2c58-4bed-b36b-90e277605325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:07.383188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db1cc05-2c58-4bed-b36b-90e277605325 admin admin] PATH_INFO: `/v3/projects/0eb02e490e2a48c48c0f909f5b14e1c2/users/5d0d197dcc894bc2a5a004d01bcad221/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:07.424033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1cc05-2c58-4bed-b36b-90e277605325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eb02e490e2a48c48c0f909f5b14e1c2, user_id=5d0d197dcc894bc2a5a004d01bcad221, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:07.427723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db1cc05-2c58-4bed-b36b-90e277605325 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:07.583705 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1353/2753] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:16:07 2022] PUT /identity/v3/projects/0eb02e490e2a48c48c0f909f5b14e1c2/users/5d0d197dcc894bc2a5a004d01bcad221/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:16:07.583837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d0653-18fa-4cb0-ac89-71ba15749ec6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:07.595461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d0653-18fa-4cb0-ac89-71ba15749ec6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:07.798025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f1362e-f99e-4ade-9156-8a1ee6f82e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:07.798845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1362e-f99e-4ade-9156-8a1ee6f82e8c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:07.799197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1362e-f99e-4ade-9156-8a1ee6f82e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:07.799539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f1362e-f99e-4ade-9156-8a1ee6f82e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:07.800739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1362e-f99e-4ade-9156-8a1ee6f82e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:07.806639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f1362e-f99e-4ade-9156-8a1ee6f82e8c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:07.825525 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1401/2754] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:16:07 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:16:07.829783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1cc05-2c58-4bed-b36b-90e277605325 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:07.847441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db1cc05-2c58-4bed-b36b-90e277605325 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:07.853220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09047f1a-df07-4084-a839-4c5c27f22257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:07.856879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09047f1a-df07-4084-a839-4c5c27f22257 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:07.856879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09047f1a-df07-4084-a839-4c5c27f22257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:07.856879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09047f1a-df07-4084-a839-4c5c27f22257 admin admin] PATH_INFO: `/v3/projects/0eb02e490e2a48c48c0f909f5b14e1c2/users/5d0d197dcc894bc2a5a004d01bcad221/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:07.857522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09047f1a-df07-4084-a839-4c5c27f22257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eb02e490e2a48c48c0f909f5b14e1c2, user_id=5d0d197dcc894bc2a5a004d01bcad221, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:07.861492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09047f1a-df07-4084-a839-4c5c27f22257 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:07.912374 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1354/2755] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:16:07 2022] PUT /identity/v3/projects/0eb02e490e2a48c48c0f909f5b14e1c2/users/5d0d197dcc894bc2a5a004d01bcad221/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:16:07.916081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349778f-281e-454a-a62b-8251b0655289 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:07.916381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349778f-281e-454a-a62b-8251b0655289 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:07.916668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349778f-281e-454a-a62b-8251b0655289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:08.022039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f349778f-281e-454a-a62b-8251b0655289 None None] MFA Rules not processed for user `5d0d197dcc894bc2a5a004d01bcad221`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:08.025577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f349778f-281e-454a-a62b-8251b0655289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:08.367325 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1402/2756] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:08.375709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfea8c-ecc7-4441-b697-3233a5d02338 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:08.376192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfea8c-ecc7-4441-b697-3233a5d02338 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:08.376310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfea8c-ecc7-4441-b697-3233a5d02338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:08.434600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-73dfea8c-ecc7-4441-b697-3233a5d02338 None None] MFA Rules not processed for user `f81f9be8cdb145b4a7b4d4aacb2ad66c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:08.436049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-73dfea8c-ecc7-4441-b697-3233a5d02338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:08.622786 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1355/2757] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:09.540963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349778f-281e-454a-a62b-8251b0655289 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:09.543032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f349778f-281e-454a-a62b-8251b0655289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:09.578693 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:09.749689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349778f-281e-454a-a62b-8251b0655289 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:09.764781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c009d-3bfc-40f0-ba88-7a053e673ad7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:09.765737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c009d-3bfc-40f0-ba88-7a053e673ad7 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:09.766089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c009d-3bfc-40f0-ba88-7a053e673ad7 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:09.766399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c009d-3bfc-40f0-ba88-7a053e673ad7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:09.785672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c009d-3bfc-40f0-ba88-7a053e673ad7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:09.791068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c009d-3bfc-40f0-ba88-7a053e673ad7 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:09.814394 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1403/2758] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:16:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:16:18.607357 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=42,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:19.855044 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=28 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:20.384825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfea8c-ecc7-4441-b697-3233a5d02338 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:20.386958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-73dfea8c-ecc7-4441-b697-3233a5d02338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:20.625464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfea8c-ecc7-4441-b697-3233a5d02338 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:20.639187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec725a53-4fda-4335-966c-173630908565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:20.640270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec725a53-4fda-4335-966c-173630908565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:20.640665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec725a53-4fda-4335-966c-173630908565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:20.641065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec725a53-4fda-4335-966c-173630908565 admin admin] PATH_INFO: `/v3/users/a85d57341b9f47b780e8986bee1245fc` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:20.642838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec725a53-4fda-4335-966c-173630908565 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a85d57341b9f47b780e8986bee1245fc)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:20.647020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec725a53-4fda-4335-966c-173630908565 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:20.897222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec725a53-4fda-4335-966c-173630908565 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a85d57341b9f47b780e8986bee1245fc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:20.917700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec725a53-4fda-4335-966c-173630908565 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a85d57341b9f47b780e8986bee1245fc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:20.918559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec725a53-4fda-4335-966c-173630908565 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a85d57341b9f47b780e8986bee1245fc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:20.919263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec725a53-4fda-4335-966c-173630908565 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a85d57341b9f47b780e8986bee1245fc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:20.936415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec725a53-4fda-4335-966c-173630908565 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a85d57341b9f47b780e8986bee1245fc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:21.007915 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1356/2759] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:16:20 2022] DELETE /identity/v3/users/a85d57341b9f47b780e8986bee1245fc => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:16:21.551381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c009d-3bfc-40f0-ba88-7a053e673ad7 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:21.574906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c009d-3bfc-40f0-ba88-7a053e673ad7 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:21.888498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709df775-c31e-4571-b5c2-088c26fdc5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:21.889818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709df775-c31e-4571-b5c2-088c26fdc5a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:21.890319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709df775-c31e-4571-b5c2-088c26fdc5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:21.890751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709df775-c31e-4571-b5c2-088c26fdc5a5 admin admin] PATH_INFO: `/v3/projects/d6523ca4178b4c7781d9342a3978756c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:21.907265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709df775-c31e-4571-b5c2-088c26fdc5a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6523ca4178b4c7781d9342a3978756c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:21.909737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709df775-c31e-4571-b5c2-088c26fdc5a5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:22.088319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-709df775-c31e-4571-b5c2-088c26fdc5a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6523ca4178b4c7781d9342a3978756c', 'request_id': 'req-709df775-c31e-4571-b5c2-088c26fdc5a5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:22.100721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-709df775-c31e-4571-b5c2-088c26fdc5a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6523ca4178b4c7781d9342a3978756c', 'request_id': 'req-709df775-c31e-4571-b5c2-088c26fdc5a5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:22.110423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-709df775-c31e-4571-b5c2-088c26fdc5a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6523ca4178b4c7781d9342a3978756c', 'request_id': 'req-709df775-c31e-4571-b5c2-088c26fdc5a5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:22.215470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-709df775-c31e-4571-b5c2-088c26fdc5a5 admin admin] The token cache is being invalidate because project d6523ca4178b4c7781d9342a3978756c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:16:22.215794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-709df775-c31e-4571-b5c2-088c26fdc5a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:22.225107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-709df775-c31e-4571-b5c2-088c26fdc5a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:22.225107 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1404/2760] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:16:21 2022] DELETE /identity/v3/projects/d6523ca4178b4c7781d9342a3978756c => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:16:22.230892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab3b9c-a8e5-4841-9755-bdae4501d62c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:22.231819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab3b9c-a8e5-4841-9755-bdae4501d62c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:22.232321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab3b9c-a8e5-4841-9755-bdae4501d62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:22.330056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-eeab3b9c-a8e5-4841-9755-bdae4501d62c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:22.336761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eeab3b9c-a8e5-4841-9755-bdae4501d62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:22.521843 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1357/2761] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:22.527590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dc40c-04dd-44c8-a0b4-0f21a874e2cd None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:22.527881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dc40c-04dd-44c8-a0b4-0f21a874e2cd None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:22.528166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dc40c-04dd-44c8-a0b4-0f21a874e2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:22.559823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a75dc40c-04dd-44c8-a0b4-0f21a874e2cd None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:22.561862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a75dc40c-04dd-44c8-a0b4-0f21a874e2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:22.575389 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1405/2762] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:22.578608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab3b9c-a8e5-4841-9755-bdae4501d62c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:22.600119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeab3b9c-a8e5-4841-9755-bdae4501d62c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:22.611457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb842db-8c57-4896-bf1b-a8a400ec31e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:22.612653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb842db-8c57-4896-bf1b-a8a400ec31e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:22.612937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb842db-8c57-4896-bf1b-a8a400ec31e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:22.614464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb842db-8c57-4896-bf1b-a8a400ec31e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:22.615661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb842db-8c57-4896-bf1b-a8a400ec31e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:16:22.616214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb842db-8c57-4896-bf1b-a8a400ec31e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:22.618183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb842db-8c57-4896-bf1b-a8a400ec31e7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:22.633954 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1358/2763] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:16:22.638206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75dc40c-04dd-44c8-a0b4-0f21a874e2cd None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:22.652043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75dc40c-04dd-44c8-a0b4-0f21a874e2cd None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:22.668006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8ce31-5dbe-4aa2-8839-747bbdc35b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:22.668818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8ce31-5dbe-4aa2-8839-747bbdc35b37 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:22.670923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8ce31-5dbe-4aa2-8839-747bbdc35b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:22.670923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8ce31-5dbe-4aa2-8839-747bbdc35b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:22.670923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8ce31-5dbe-4aa2-8839-747bbdc35b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:22.673384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8ce31-5dbe-4aa2-8839-747bbdc35b37 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:22.769819 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1406/2764] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:16:22 2022] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:16:22.774195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb842db-8c57-4896-bf1b-a8a400ec31e7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:22.791137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb842db-8c57-4896-bf1b-a8a400ec31e7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:22.798278 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:23.044293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771d5e4-31e4-42cf-a043-1d07d6d37b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:23.046535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771d5e4-31e4-42cf-a043-1d07d6d37b18 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:23.047075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771d5e4-31e4-42cf-a043-1d07d6d37b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:23.047529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771d5e4-31e4-42cf-a043-1d07d6d37b18 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:23.048415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771d5e4-31e4-42cf-a043-1d07d6d37b18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:23.052989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4771d5e4-31e4-42cf-a043-1d07d6d37b18 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:23.224265 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1359/2765] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:16:22 2022] POST /identity/v3/users => generated 294 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:16:23.225334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8ce31-5dbe-4aa2-8839-747bbdc35b37 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:23.243666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8ce31-5dbe-4aa2-8839-747bbdc35b37 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:23.253592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0539754-667f-46df-a899-9d59dcaf81cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:23.254678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0539754-667f-46df-a899-9d59dcaf81cc admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:23.255198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0539754-667f-46df-a899-9d59dcaf81cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:23.255813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0539754-667f-46df-a899-9d59dcaf81cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:23.257283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0539754-667f-46df-a899-9d59dcaf81cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:23.259876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0539754-667f-46df-a899-9d59dcaf81cc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:23.281989 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1407/2766] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:16:23.284852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771d5e4-31e4-42cf-a043-1d07d6d37b18 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:23.297997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771d5e4-31e4-42cf-a043-1d07d6d37b18 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:23.311068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59879e9-17e0-4293-a63b-4452d5470c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:23.316971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59879e9-17e0-4293-a63b-4452d5470c65 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:23.316971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59879e9-17e0-4293-a63b-4452d5470c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:23.316971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59879e9-17e0-4293-a63b-4452d5470c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:23.316971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59879e9-17e0-4293-a63b-4452d5470c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:23.318356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59879e9-17e0-4293-a63b-4452d5470c65 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:23.331179 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1360/2767] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:16:23.335227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0539754-667f-46df-a899-9d59dcaf81cc admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:23.350070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0539754-667f-46df-a899-9d59dcaf81cc admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:23.360461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cd961-a489-4206-a54c-6bdbe09c95d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:23.361583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cd961-a489-4206-a54c-6bdbe09c95d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:23.362058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cd961-a489-4206-a54c-6bdbe09c95d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:23.362608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cd961-a489-4206-a54c-6bdbe09c95d7 admin admin] PATH_INFO: `/v3/projects/4ec85319ae8e45279a55eff890daab1a/users/3dfe3b60fca6438a8ab3242838e311c4/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:23.411602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cd961-a489-4206-a54c-6bdbe09c95d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec85319ae8e45279a55eff890daab1a, user_id=3dfe3b60fca6438a8ab3242838e311c4, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:23.416593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cd961-a489-4206-a54c-6bdbe09c95d7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:23.498083 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1408/2768] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:16:23 2022] PUT /identity/v3/projects/4ec85319ae8e45279a55eff890daab1a/users/3dfe3b60fca6438a8ab3242838e311c4/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:16:23.503748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49616011-6109-4ec9-96ce-4b2f3f2456ea None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:23.504405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49616011-6109-4ec9-96ce-4b2f3f2456ea None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:23.504909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49616011-6109-4ec9-96ce-4b2f3f2456ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:23.539826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-49616011-6109-4ec9-96ce-4b2f3f2456ea None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:23.541659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-49616011-6109-4ec9-96ce-4b2f3f2456ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:23.689039 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1361/2769] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:23.748007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cd961-a489-4206-a54c-6bdbe09c95d7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:23.755199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ad2cd961-a489-4206-a54c-6bdbe09c95d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:23.833672 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:23.890456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cd961-a489-4206-a54c-6bdbe09c95d7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:23.902760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b903ef-a0d8-4bde-b374-c2c63f8dffee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:23.903432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b903ef-a0d8-4bde-b374-c2c63f8dffee service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:23.903916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b903ef-a0d8-4bde-b374-c2c63f8dffee service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:23.904365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b903ef-a0d8-4bde-b374-c2c63f8dffee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:23.941338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b903ef-a0d8-4bde-b374-c2c63f8dffee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:24.231631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b903ef-a0d8-4bde-b374-c2c63f8dffee service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:24.231631 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1409/2770] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:16:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:16:24.900308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800e257-963e-458b-8dc1-e60b0279a0a3 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:24.900837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800e257-963e-458b-8dc1-e60b0279a0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:24.901144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800e257-963e-458b-8dc1-e60b0279a0a3 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:24.903060 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1362/2771] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:16:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:16:24.910921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3668a-3f63-40b1-a242-fda21a9bfc87 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:24.918731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3668a-3f63-40b1-a242-fda21a9bfc87 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:24.918731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc3668a-3f63-40b1-a242-fda21a9bfc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:24.944577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5cc3668a-3f63-40b1-a242-fda21a9bfc87 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:24.946109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5cc3668a-3f63-40b1-a242-fda21a9bfc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:25.043482 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1410/2772] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:16:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:25.069953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800e257-963e-458b-8dc1-e60b0279a0a3 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:25.071781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9800e257-963e-458b-8dc1-e60b0279a0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:25.161902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800e257-963e-458b-8dc1-e60b0279a0a3 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:25.192894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b422e721-7dfc-402c-8e1a-2cf238c16eb7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:25.192894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422e721-7dfc-402c-8e1a-2cf238c16eb7 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:25.192894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422e721-7dfc-402c-8e1a-2cf238c16eb7 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:25.192894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b422e721-7dfc-402c-8e1a-2cf238c16eb7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:25.193300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422e721-7dfc-402c-8e1a-2cf238c16eb7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:25.193300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b422e721-7dfc-402c-8e1a-2cf238c16eb7 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:25.200375 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1363/2773] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:16:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:16:28.212462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3668a-3f63-40b1-a242-fda21a9bfc87 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:28.224210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5cc3668a-3f63-40b1-a242-fda21a9bfc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:28.317020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc3668a-3f63-40b1-a242-fda21a9bfc87 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:28.322224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa0388f-ea23-4f8e-8521-e17c94147f9e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:28.322786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0388f-ea23-4f8e-8521-e17c94147f9e service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:28.323077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0388f-ea23-4f8e-8521-e17c94147f9e service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:28.323357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa0388f-ea23-4f8e-8521-e17c94147f9e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:28.325316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6fa0388f-ea23-4f8e-8521-e17c94147f9e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:28.452438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0388f-ea23-4f8e-8521-e17c94147f9e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:28.452922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa0388f-ea23-4f8e-8521-e17c94147f9e service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:28.469210 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1411/2774] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:16:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:16:29.450912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92a20b-2316-4443-b53e-21b7e18f1384 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:29.450912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92a20b-2316-4443-b53e-21b7e18f1384 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:29.450912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92a20b-2316-4443-b53e-21b7e18f1384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:29.506192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ce92a20b-2316-4443-b53e-21b7e18f1384 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:29.511244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ce92a20b-2316-4443-b53e-21b7e18f1384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:29.530159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ebbe2-edbf-4434-a172-cc600f20bbc7 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:29.530743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ebbe2-edbf-4434-a172-cc600f20bbc7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:29.530743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ebbe2-edbf-4434-a172-cc600f20bbc7 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:29.532400 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1412/2775] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:16:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:16:29.540980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab335e8-5ba4-42d8-b273-8e24df6ddb73 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:29.541350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab335e8-5ba4-42d8-b273-8e24df6ddb73 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:29.541873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab335e8-5ba4-42d8-b273-8e24df6ddb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:29.561230 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:29.572670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-eab335e8-5ba4-42d8-b273-8e24df6ddb73 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:29.575887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-eab335e8-5ba4-42d8-b273-8e24df6ddb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:29.598699 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1413/2776] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:16:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:16:29.619508 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1364/2777] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:16:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:29.634729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab335e8-5ba4-42d8-b273-8e24df6ddb73 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:29.636221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-eab335e8-5ba4-42d8-b273-8e24df6ddb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:29.653571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92a20b-2316-4443-b53e-21b7e18f1384 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:29.655071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ce92a20b-2316-4443-b53e-21b7e18f1384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:29.681465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92a20b-2316-4443-b53e-21b7e18f1384 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:29.694438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e15ab59-29a8-4168-8a32-7652afc676f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:29.695411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15ab59-29a8-4168-8a32-7652afc676f3 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:29.695922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15ab59-29a8-4168-8a32-7652afc676f3 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:29.696731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e15ab59-29a8-4168-8a32-7652afc676f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:29.718184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15ab59-29a8-4168-8a32-7652afc676f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:29.720016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e15ab59-29a8-4168-8a32-7652afc676f3 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:29.748045 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1365/2778] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:16:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:16:29.772272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab335e8-5ba4-42d8-b273-8e24df6ddb73 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:29.783560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceed93f-045c-4151-b77a-11cde0cb9679 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:29.785277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceed93f-045c-4151-b77a-11cde0cb9679 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:29.785840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceed93f-045c-4151-b77a-11cde0cb9679 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:29.786793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceed93f-045c-4151-b77a-11cde0cb9679 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:29.799345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceed93f-045c-4151-b77a-11cde0cb9679 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:29.801958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ceed93f-045c-4151-b77a-11cde0cb9679 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:29.812354 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1414/2779] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:16:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:16:30.728444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2ffce-3a02-44ca-9b68-c7422fb0c350 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:30.729014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2ffce-3a02-44ca-9b68-c7422fb0c350 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:30.729014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a2ffce-3a02-44ca-9b68-c7422fb0c350 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:30.730681 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1366/2780] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:16:30.746201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520a6cd-1dd1-4d12-9992-ac3e5a017de4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:30.746777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520a6cd-1dd1-4d12-9992-ac3e5a017de4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:30.746777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520a6cd-1dd1-4d12-9992-ac3e5a017de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:30.795407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9520a6cd-1dd1-4d12-9992-ac3e5a017de4 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:30.796667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9520a6cd-1dd1-4d12-9992-ac3e5a017de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:30.865718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2ffce-3a02-44ca-9b68-c7422fb0c350 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:30.876648 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1415/2781] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:16:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:16:30.877751 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:30.889687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a2ffce-3a02-44ca-9b68-c7422fb0c350 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:30.909657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615505c-aaab-4564-940b-b5a9e80d1544 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:30.913241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615505c-aaab-4564-940b-b5a9e80d1544 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:30.913241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615505c-aaab-4564-940b-b5a9e80d1544 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:30.916102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615505c-aaab-4564-940b-b5a9e80d1544 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:30.934540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615505c-aaab-4564-940b-b5a9e80d1544 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:30.936395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615505c-aaab-4564-940b-b5a9e80d1544 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:30.953240 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1367/2782] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:16:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:16:31.395927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520a6cd-1dd1-4d12-9992-ac3e5a017de4 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:31.397607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9520a6cd-1dd1-4d12-9992-ac3e5a017de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:31.402623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd233cf0-4aaf-442e-88be-03e07cb321a5 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:31.403188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd233cf0-4aaf-442e-88be-03e07cb321a5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:31.403680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd233cf0-4aaf-442e-88be-03e07cb321a5 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:31.406182 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1368/2783] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:16:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:16:31.416756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520a6cd-1dd1-4d12-9992-ac3e5a017de4 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:31.418592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209db32e-047e-408c-8b4e-7eb2d2b3d883 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:31.419605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209db32e-047e-408c-8b4e-7eb2d2b3d883 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:31.420136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209db32e-047e-408c-8b4e-7eb2d2b3d883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:31.426258 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f14ac-fccb-4515-8b87-d54cbe229a3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:31.430492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f14ac-fccb-4515-8b87-d54cbe229a3b service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:31.430805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f14ac-fccb-4515-8b87-d54cbe229a3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:31.431100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f14ac-fccb-4515-8b87-d54cbe229a3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:31.433939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2f8f14ac-fccb-4515-8b87-d54cbe229a3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:31.453976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-209db32e-047e-408c-8b4e-7eb2d2b3d883 None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:31.456569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-209db32e-047e-408c-8b4e-7eb2d2b3d883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:31.459044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f14ac-fccb-4515-8b87-d54cbe229a3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:31.460508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f14ac-fccb-4515-8b87-d54cbe229a3b service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:31.480815 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1369/2784] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:16:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:31.487424 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1416/2785] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:16:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:16:31.508747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209db32e-047e-408c-8b4e-7eb2d2b3d883 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:31.524172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209db32e-047e-408c-8b4e-7eb2d2b3d883 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:31.532622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6195af6-f882-41ec-9ea8-9e30c86ad558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:31.533364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6195af6-f882-41ec-9ea8-9e30c86ad558 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:31.534221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6195af6-f882-41ec-9ea8-9e30c86ad558 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:31.534512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6195af6-f882-41ec-9ea8-9e30c86ad558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:31.558524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6195af6-f882-41ec-9ea8-9e30c86ad558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:31.560296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6195af6-f882-41ec-9ea8-9e30c86ad558 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:31.574552 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1370/2786] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:16:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:16:31.713120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f14ac-fccb-4515-8b87-d54cbe229a3b service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:31.736157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f14ac-fccb-4515-8b87-d54cbe229a3b service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:31.750803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171e14c-fa00-41af-aaed-1fbc9caa13ed service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:31.751524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171e14c-fa00-41af-aaed-1fbc9caa13ed service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:31.754782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171e14c-fa00-41af-aaed-1fbc9caa13ed service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:31.755423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171e14c-fa00-41af-aaed-1fbc9caa13ed service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:31.768676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5171e14c-fa00-41af-aaed-1fbc9caa13ed service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:31.791720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171e14c-fa00-41af-aaed-1fbc9caa13ed service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:31.793965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171e14c-fa00-41af-aaed-1fbc9caa13ed service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:31.816552 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1417/2787] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:16:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:16:32.317842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b7f56-b799-449f-a803-b41814f7cf37 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:32.318746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b7f56-b799-449f-a803-b41814f7cf37 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:32.319037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b7f56-b799-449f-a803-b41814f7cf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:32.342600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aecc88-4139-40ab-8833-180de4fcc3fa None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:32.343143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aecc88-4139-40ab-8833-180de4fcc3fa None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:32.344921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aecc88-4139-40ab-8833-180de4fcc3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:32.383647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-97aecc88-4139-40ab-8833-180de4fcc3fa None None] MFA Rules not processed for user `5c0882e092c644758966c19d52d86795`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:32.384893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-97aecc88-4139-40ab-8833-180de4fcc3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:32.397847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-014b7f56-b799-449f-a803-b41814f7cf37 None None] MFA Rules not processed for user `3dfe3b60fca6438a8ab3242838e311c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:32.399203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-014b7f56-b799-449f-a803-b41814f7cf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:32.489125 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1418/2788] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:32.591479 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1371/2789] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:33.189203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aecc88-4139-40ab-8833-180de4fcc3fa None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:33.190843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-97aecc88-4139-40ab-8833-180de4fcc3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:33.227071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aecc88-4139-40ab-8833-180de4fcc3fa None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:33.243673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b108a7a-5c39-419e-80ba-3951faa4dbe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:33.244358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b108a7a-5c39-419e-80ba-3951faa4dbe8 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:33.244644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b108a7a-5c39-419e-80ba-3951faa4dbe8 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:33.244924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b108a7a-5c39-419e-80ba-3951faa4dbe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:33.266948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b108a7a-5c39-419e-80ba-3951faa4dbe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:33.269183 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b108a7a-5c39-419e-80ba-3951faa4dbe8 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:33.286907 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1419/2790] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:16:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:16:36.808130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b7f56-b799-449f-a803-b41814f7cf37 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:36.821308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b7f56-b799-449f-a803-b41814f7cf37 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:36.832662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8429798-cd01-43cf-9e3a-815ea5cb7f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:36.834487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8429798-cd01-43cf-9e3a-815ea5cb7f4b service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:36.835000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8429798-cd01-43cf-9e3a-815ea5cb7f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:36.836456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8429798-cd01-43cf-9e3a-815ea5cb7f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:36.846289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e8429798-cd01-43cf-9e3a-815ea5cb7f4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:36.881980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8429798-cd01-43cf-9e3a-815ea5cb7f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:36.883733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8429798-cd01-43cf-9e3a-815ea5cb7f4b service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:36.906704 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1372/2791] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:16:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:16:43.283125 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=78 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:44.156391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ac00a-4495-4dd9-ae39-90b84a7174fb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:44.156681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ac00a-4495-4dd9-ae39-90b84a7174fb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:44.156958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40ac00a-4495-4dd9-ae39-90b84a7174fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:44.176741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a40ac00a-4495-4dd9-ae39-90b84a7174fb None None] MFA Rules not processed for user `5d2572c3904f40c6b26ce92425f655f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:44.177952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a40ac00a-4495-4dd9-ae39-90b84a7174fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:44.249180 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1420/2792] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:44.444611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb42ee6-6fbf-4a00-9df3-5d97cd8bf2d5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:44.445186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb42ee6-6fbf-4a00-9df3-5d97cd8bf2d5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:44.445186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb42ee6-6fbf-4a00-9df3-5d97cd8bf2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:44.465229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ecb42ee6-6fbf-4a00-9df3-5d97cd8bf2d5 None None] MFA Rules not processed for user `6b13cdd4117640b49cf9f74cc12d16f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:44.466494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ecb42ee6-6fbf-4a00-9df3-5d97cd8bf2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:44.532132 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1373/2793] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:45.142727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ac00a-4495-4dd9-ae39-90b84a7174fb None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:45.143655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a40ac00a-4495-4dd9-ae39-90b84a7174fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:45.165668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40ac00a-4495-4dd9-ae39-90b84a7174fb None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:45.173789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f792f-c7fb-49cf-afc8-5fd7cab2bf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:45.177073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f792f-c7fb-49cf-afc8-5fd7cab2bf29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:45.177411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f792f-c7fb-49cf-afc8-5fd7cab2bf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:45.177692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f792f-c7fb-49cf-afc8-5fd7cab2bf29 admin admin] PATH_INFO: `/v3/users/f81f9be8cdb145b4a7b4d4aacb2ad66c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:45.179306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f792f-c7fb-49cf-afc8-5fd7cab2bf29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f81f9be8cdb145b4a7b4d4aacb2ad66c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:45.181568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f792f-c7fb-49cf-afc8-5fd7cab2bf29 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:45.454696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-485f792f-c7fb-49cf-afc8-5fd7cab2bf29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f81f9be8cdb145b4a7b4d4aacb2ad66c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:45.507032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-485f792f-c7fb-49cf-afc8-5fd7cab2bf29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f81f9be8cdb145b4a7b4d4aacb2ad66c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:45.544706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-485f792f-c7fb-49cf-afc8-5fd7cab2bf29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f81f9be8cdb145b4a7b4d4aacb2ad66c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:45.549812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-485f792f-c7fb-49cf-afc8-5fd7cab2bf29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f81f9be8cdb145b4a7b4d4aacb2ad66c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:45.624664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-485f792f-c7fb-49cf-afc8-5fd7cab2bf29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f81f9be8cdb145b4a7b4d4aacb2ad66c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:45.632776 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1421/2794] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:16:45 2022] DELETE /identity/v3/users/f81f9be8cdb145b4a7b4d4aacb2ad66c => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:16:45.637694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30cef9-eebc-44fa-9f3c-f41a908cc5bf None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:45.638618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30cef9-eebc-44fa-9f3c-f41a908cc5bf None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:45.639060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30cef9-eebc-44fa-9f3c-f41a908cc5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:45.676643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0b30cef9-eebc-44fa-9f3c-f41a908cc5bf None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:45.679176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0b30cef9-eebc-44fa-9f3c-f41a908cc5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:45.743877 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:45.762623 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1374/2795] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:45.811595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f792f-c7fb-49cf-afc8-5fd7cab2bf29 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:45.815339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-485f792f-c7fb-49cf-afc8-5fd7cab2bf29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:45.926299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f792f-c7fb-49cf-afc8-5fd7cab2bf29 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:45.933819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a1080-a296-43a8-8cac-905e3eab92c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:45.936666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a1080-a296-43a8-8cac-905e3eab92c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:45.936906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a1080-a296-43a8-8cac-905e3eab92c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:45.937184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a1080-a296-43a8-8cac-905e3eab92c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:45.948706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a1080-a296-43a8-8cac-905e3eab92c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:45.950814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a1080-a296-43a8-8cac-905e3eab92c9 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:45.975672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30cef9-eebc-44fa-9f3c-f41a908cc5bf None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:45.977066 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1422/2796] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:16:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:16:45.977201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0b30cef9-eebc-44fa-9f3c-f41a908cc5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:46.093158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30cef9-eebc-44fa-9f3c-f41a908cc5bf None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:46.100058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8099c2a-b075-4a8e-a186-61d0dc85470c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:46.100773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8099c2a-b075-4a8e-a186-61d0dc85470c service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:46.101062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8099c2a-b075-4a8e-a186-61d0dc85470c service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:46.101336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8099c2a-b075-4a8e-a186-61d0dc85470c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:46.103233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d8099c2a-b075-4a8e-a186-61d0dc85470c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:46.118033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8099c2a-b075-4a8e-a186-61d0dc85470c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:46.121500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8099c2a-b075-4a8e-a186-61d0dc85470c service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:46.155660 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1375/2797] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:16:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:16:47.214202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a1080-a296-43a8-8cac-905e3eab92c9 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:47.214202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8e3a1080-a296-43a8-8cac-905e3eab92c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:47.254046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a1080-a296-43a8-8cac-905e3eab92c9 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:47.277216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f73b68-1f4f-4d32-966d-a5175afdb3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:47.285526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f73b68-1f4f-4d32-966d-a5175afdb3c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:47.287244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f73b68-1f4f-4d32-966d-a5175afdb3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:47.287562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f73b68-1f4f-4d32-966d-a5175afdb3c1 admin admin] PATH_INFO: `/v3/projects/c996db49675c40debc779c00cbf03ce4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:47.293163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f73b68-1f4f-4d32-966d-a5175afdb3c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c996db49675c40debc779c00cbf03ce4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:47.297511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f73b68-1f4f-4d32-966d-a5175afdb3c1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:47.321943 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:47.579377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-72f73b68-1f4f-4d32-966d-a5175afdb3c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c996db49675c40debc779c00cbf03ce4', 'request_id': 'req-72f73b68-1f4f-4d32-966d-a5175afdb3c1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:47.599330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-72f73b68-1f4f-4d32-966d-a5175afdb3c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c996db49675c40debc779c00cbf03ce4', 'request_id': 'req-72f73b68-1f4f-4d32-966d-a5175afdb3c1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:47.616819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-72f73b68-1f4f-4d32-966d-a5175afdb3c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c996db49675c40debc779c00cbf03ce4', 'request_id': 'req-72f73b68-1f4f-4d32-966d-a5175afdb3c1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:47.695445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-72f73b68-1f4f-4d32-966d-a5175afdb3c1 admin admin] The token cache is being invalidate because project c996db49675c40debc779c00cbf03ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:16:47.695445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-72f73b68-1f4f-4d32-966d-a5175afdb3c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:47.695861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-72f73b68-1f4f-4d32-966d-a5175afdb3c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:47.700463 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1423/2798] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:16:47 2022] DELETE /identity/v3/projects/c996db49675c40debc779c00cbf03ce4 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:16:47.701796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8099c2a-b075-4a8e-a186-61d0dc85470c service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:47.727356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8099c2a-b075-4a8e-a186-61d0dc85470c service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:47.854661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa8dba-2b50-495f-bc0a-46bc7aa447e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:47.857270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa8dba-2b50-495f-bc0a-46bc7aa447e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:47.857270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa8dba-2b50-495f-bc0a-46bc7aa447e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:47.857270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa8dba-2b50-495f-bc0a-46bc7aa447e3 admin admin] PATH_INFO: `/v3/users/5d0d197dcc894bc2a5a004d01bcad221` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:47.859733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa8dba-2b50-495f-bc0a-46bc7aa447e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d0d197dcc894bc2a5a004d01bcad221)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:47.862880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa8dba-2b50-495f-bc0a-46bc7aa447e3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:48.128344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-12fa8dba-2b50-495f-bc0a-46bc7aa447e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d0d197dcc894bc2a5a004d01bcad221'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:48.148056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-12fa8dba-2b50-495f-bc0a-46bc7aa447e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d0d197dcc894bc2a5a004d01bcad221'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:48.149207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-12fa8dba-2b50-495f-bc0a-46bc7aa447e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d0d197dcc894bc2a5a004d01bcad221'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:48.150940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-12fa8dba-2b50-495f-bc0a-46bc7aa447e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d0d197dcc894bc2a5a004d01bcad221'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:48.159876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-12fa8dba-2b50-495f-bc0a-46bc7aa447e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d0d197dcc894bc2a5a004d01bcad221'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:48.254518 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:48.260848 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1376/2799] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:16:47 2022] DELETE /identity/v3/users/5d0d197dcc894bc2a5a004d01bcad221 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:16:49.169071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f73b68-1f4f-4d32-966d-a5175afdb3c1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:49.172317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-72f73b68-1f4f-4d32-966d-a5175afdb3c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:49.200340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f73b68-1f4f-4d32-966d-a5175afdb3c1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:49.321749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d002e5-edd9-45d8-8648-7f2ec318826e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:49.322810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d002e5-edd9-45d8-8648-7f2ec318826e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:49.323198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d002e5-edd9-45d8-8648-7f2ec318826e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:49.323572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d002e5-edd9-45d8-8648-7f2ec318826e admin admin] PATH_INFO: `/v3/projects/0eb02e490e2a48c48c0f909f5b14e1c2` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:49.327314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d002e5-edd9-45d8-8648-7f2ec318826e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eb02e490e2a48c48c0f909f5b14e1c2)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:49.332720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d002e5-edd9-45d8-8648-7f2ec318826e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:49.468352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-32d002e5-edd9-45d8-8648-7f2ec318826e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eb02e490e2a48c48c0f909f5b14e1c2', 'request_id': 'req-32d002e5-edd9-45d8-8648-7f2ec318826e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:49.485101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-32d002e5-edd9-45d8-8648-7f2ec318826e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eb02e490e2a48c48c0f909f5b14e1c2', 'request_id': 'req-32d002e5-edd9-45d8-8648-7f2ec318826e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:49.495002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-32d002e5-edd9-45d8-8648-7f2ec318826e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eb02e490e2a48c48c0f909f5b14e1c2', 'request_id': 'req-32d002e5-edd9-45d8-8648-7f2ec318826e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:49.569210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-32d002e5-edd9-45d8-8648-7f2ec318826e admin admin] The token cache is being invalidate because project 0eb02e490e2a48c48c0f909f5b14e1c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:16:49.570684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-32d002e5-edd9-45d8-8648-7f2ec318826e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:49.573395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-32d002e5-edd9-45d8-8648-7f2ec318826e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:49.577485 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1424/2800] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:16:49 2022] DELETE /identity/v3/projects/0eb02e490e2a48c48c0f909f5b14e1c2 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:16:49.583920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b278d-6a7d-41b6-af4e-3b321c62be51 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:49.584494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b278d-6a7d-41b6-af4e-3b321c62be51 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:49.585479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b278d-6a7d-41b6-af4e-3b321c62be51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:49.641081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-110b278d-6a7d-41b6-af4e-3b321c62be51 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:49.643691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-110b278d-6a7d-41b6-af4e-3b321c62be51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:49.790820 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1377/2801] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:49.798499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb7340-82ff-4c24-abb4-4e3bd63f6214 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:49.799287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb7340-82ff-4c24-abb4-4e3bd63f6214 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:49.799701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb7340-82ff-4c24-abb4-4e3bd63f6214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:49.859172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-30bb7340-82ff-4c24-abb4-4e3bd63f6214 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:49.860409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-30bb7340-82ff-4c24-abb4-4e3bd63f6214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:49.872553 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1425/2802] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:49.878637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b278d-6a7d-41b6-af4e-3b321c62be51 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:49.900273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110b278d-6a7d-41b6-af4e-3b321c62be51 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:49.918992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2980b-cc33-4a7a-8567-63d6bb415290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:49.919399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2980b-cc33-4a7a-8567-63d6bb415290 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:49.919687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2980b-cc33-4a7a-8567-63d6bb415290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:49.919971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2980b-cc33-4a7a-8567-63d6bb415290 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:49.920736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2980b-cc33-4a7a-8567-63d6bb415290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:16:49.921048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2980b-cc33-4a7a-8567-63d6bb415290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:49.923515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2980b-cc33-4a7a-8567-63d6bb415290 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:49.953857 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1378/2803] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:16:49.958761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb7340-82ff-4c24-abb4-4e3bd63f6214 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:49.969456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb7340-82ff-4c24-abb4-4e3bd63f6214 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:50.008002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b218d5-9767-4cc8-8290-5c001df793a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:50.008002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b218d5-9767-4cc8-8290-5c001df793a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:50.008002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b218d5-9767-4cc8-8290-5c001df793a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:50.008002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b218d5-9767-4cc8-8290-5c001df793a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:50.008617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b218d5-9767-4cc8-8290-5c001df793a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:50.008617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b218d5-9767-4cc8-8290-5c001df793a0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:50.419352 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1426/2804] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:16:49 2022] POST /identity/v3/projects => generated 377 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:16:50.423226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2980b-cc33-4a7a-8567-63d6bb415290 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:50.438527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2980b-cc33-4a7a-8567-63d6bb415290 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:50.577470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbffdb-8687-4bff-899f-d3ff140719b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:50.578212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbffdb-8687-4bff-899f-d3ff140719b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:50.578501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbffdb-8687-4bff-899f-d3ff140719b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:50.578784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbffdb-8687-4bff-899f-d3ff140719b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:50.579623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbffdb-8687-4bff-899f-d3ff140719b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:50.582190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbffdb-8687-4bff-899f-d3ff140719b7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:50.679084 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1379/2805] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:16:50 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:16:50.682825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b218d5-9767-4cc8-8290-5c001df793a0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:50.691401 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:50.701096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b218d5-9767-4cc8-8290-5c001df793a0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:50.726223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e34ec-b9d2-47a1-be3e-13561909200a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:50.726223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e34ec-b9d2-47a1-be3e-13561909200a admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:50.726223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e34ec-b9d2-47a1-be3e-13561909200a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:50.726223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326e34ec-b9d2-47a1-be3e-13561909200a admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:50.726954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e34ec-b9d2-47a1-be3e-13561909200a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:50.726954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326e34ec-b9d2-47a1-be3e-13561909200a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:50.753976 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1427/2806] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:16:50.756784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbffdb-8687-4bff-899f-d3ff140719b7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:50.771332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbffdb-8687-4bff-899f-d3ff140719b7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:50.784847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7af911-1eca-4ed4-ada6-c39d9cb6dc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:50.786493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7af911-1eca-4ed4-ada6-c39d9cb6dc36 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:50.786493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7af911-1eca-4ed4-ada6-c39d9cb6dc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:50.786493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7af911-1eca-4ed4-ada6-c39d9cb6dc36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:50.786841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7af911-1eca-4ed4-ada6-c39d9cb6dc36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:50.788566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7af911-1eca-4ed4-ada6-c39d9cb6dc36 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:50.806350 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1380/2807] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:16:50.810632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e34ec-b9d2-47a1-be3e-13561909200a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:50.826574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326e34ec-b9d2-47a1-be3e-13561909200a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:50.836878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1b287-c154-4986-9769-c0f2cbec50cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:50.844836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1b287-c154-4986-9769-c0f2cbec50cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:50.844836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1b287-c154-4986-9769-c0f2cbec50cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:50.844836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1b287-c154-4986-9769-c0f2cbec50cd admin admin] PATH_INFO: `/v3/projects/0b49a1a6d7c3436db526113e8743fb31/users/bc7e58d5fb354a8392bbfc42596c6b1a/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:50.877412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1b287-c154-4986-9769-c0f2cbec50cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b49a1a6d7c3436db526113e8743fb31, user_id=bc7e58d5fb354a8392bbfc42596c6b1a, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:50.881994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1b287-c154-4986-9769-c0f2cbec50cd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:51.019688 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1428/2808] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:16:50 2022] PUT /identity/v3/projects/0b49a1a6d7c3436db526113e8743fb31/users/bc7e58d5fb354a8392bbfc42596c6b1a/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:16:51.023506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9680c06-0f61-4864-a391-f2eb0aecd42d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:51.023878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9680c06-0f61-4864-a391-f2eb0aecd42d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:51.024370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9680c06-0f61-4864-a391-f2eb0aecd42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:51.068064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c9680c06-0f61-4864-a391-f2eb0aecd42d None None] MFA Rules not processed for user `bc7e58d5fb354a8392bbfc42596c6b1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:51.069382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c9680c06-0f61-4864-a391-f2eb0aecd42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:51.188533 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:51.207748 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1381/2809] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:51.214645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1b287-c154-4986-9769-c0f2cbec50cd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:51.343828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1b287-c154-4986-9769-c0f2cbec50cd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:51.350739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe4b90-7c42-4836-a31d-a82eefaa49ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:51.351711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe4b90-7c42-4836-a31d-a82eefaa49ac admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:51.352187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe4b90-7c42-4836-a31d-a82eefaa49ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:51.352936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe4b90-7c42-4836-a31d-a82eefaa49ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:51.353712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe4b90-7c42-4836-a31d-a82eefaa49ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:51.357272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fe4b90-7c42-4836-a31d-a82eefaa49ac admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:51.511546 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1429/2810] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:16:51 2022] POST /identity/v3/projects => generated 377 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:16:51.512824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9680c06-0f61-4864-a391-f2eb0aecd42d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:51.530254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9680c06-0f61-4864-a391-f2eb0aecd42d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:51.670916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83c232-9429-41fe-99b3-cdec3ed83429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:51.671847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83c232-9429-41fe-99b3-cdec3ed83429 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:51.672134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83c232-9429-41fe-99b3-cdec3ed83429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:51.672420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83c232-9429-41fe-99b3-cdec3ed83429 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:51.673107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83c232-9429-41fe-99b3-cdec3ed83429 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:51.677027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83c232-9429-41fe-99b3-cdec3ed83429 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:51.823248 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1382/2811] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:16:51 2022] POST /identity/v3/users => generated 295 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:16:51.826888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe4b90-7c42-4836-a31d-a82eefaa49ac admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:51.841427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe4b90-7c42-4836-a31d-a82eefaa49ac admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:51.849687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688766c-3824-4d1e-bbfb-afc84343f917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:51.850894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688766c-3824-4d1e-bbfb-afc84343f917 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:51.851184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688766c-3824-4d1e-bbfb-afc84343f917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:51.851473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688766c-3824-4d1e-bbfb-afc84343f917 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:51.852859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688766c-3824-4d1e-bbfb-afc84343f917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:51.854545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688766c-3824-4d1e-bbfb-afc84343f917 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:51.869976 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1430/2812] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:16:51.877392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83c232-9429-41fe-99b3-cdec3ed83429 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:51.893259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83c232-9429-41fe-99b3-cdec3ed83429 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:51.906415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4a947-71b2-44d9-a73c-a2703521e641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:51.910434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4a947-71b2-44d9-a73c-a2703521e641 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:51.910811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4a947-71b2-44d9-a73c-a2703521e641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:51.911152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4a947-71b2-44d9-a73c-a2703521e641 admin admin] PATH_INFO: `/v3/projects/d194a6deb7b64149a3e67162a21d01cf/users/e0ec3b4d4d784c7bb9f60bd0848d0d1e/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:51.957773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4a947-71b2-44d9-a73c-a2703521e641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d194a6deb7b64149a3e67162a21d01cf, user_id=e0ec3b4d4d784c7bb9f60bd0848d0d1e, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:51.962432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4a947-71b2-44d9-a73c-a2703521e641 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:52.072926 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1383/2813] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:16:51 2022] PUT /identity/v3/projects/d194a6deb7b64149a3e67162a21d01cf/users/e0ec3b4d4d784c7bb9f60bd0848d0d1e/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:16:52.077006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688766c-3824-4d1e-bbfb-afc84343f917 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:52.099824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688766c-3824-4d1e-bbfb-afc84343f917 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:52.219784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a15c50-cd04-486e-bc23-2fd0ab18e22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:52.220555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a15c50-cd04-486e-bc23-2fd0ab18e22a admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:52.221420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a15c50-cd04-486e-bc23-2fd0ab18e22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:52.222842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a15c50-cd04-486e-bc23-2fd0ab18e22a admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:52.223666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a15c50-cd04-486e-bc23-2fd0ab18e22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:52.225703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a15c50-cd04-486e-bc23-2fd0ab18e22a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:52.244621 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1431/2814] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:16:52.245884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4a947-71b2-44d9-a73c-a2703521e641 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:52.277734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4a947-71b2-44d9-a73c-a2703521e641 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:52.294184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b32fc6-bb17-4599-9ff8-24dba7bb35e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:52.296915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b32fc6-bb17-4599-9ff8-24dba7bb35e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:52.298349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b32fc6-bb17-4599-9ff8-24dba7bb35e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:52.300788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b32fc6-bb17-4599-9ff8-24dba7bb35e4 admin admin] PATH_INFO: `/v3/projects/d194a6deb7b64149a3e67162a21d01cf/users/e0ec3b4d4d784c7bb9f60bd0848d0d1e/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:52.307011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b32fc6-bb17-4599-9ff8-24dba7bb35e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d194a6deb7b64149a3e67162a21d01cf, user_id=e0ec3b4d4d784c7bb9f60bd0848d0d1e, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:52.310501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b32fc6-bb17-4599-9ff8-24dba7bb35e4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:52.343009 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1384/2815] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:16:52 2022] PUT /identity/v3/projects/d194a6deb7b64149a3e67162a21d01cf/users/e0ec3b4d4d784c7bb9f60bd0848d0d1e/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:16:52.344850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f46ed4-c160-4b67-bad6-2b5dc2105aa3 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:52.345279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f46ed4-c160-4b67-bad6-2b5dc2105aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:52.345401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f46ed4-c160-4b67-bad6-2b5dc2105aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:52.443429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-65f46ed4-c160-4b67-bad6-2b5dc2105aa3 None None] MFA Rules not processed for user `e0ec3b4d4d784c7bb9f60bd0848d0d1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:52.444665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-65f46ed4-c160-4b67-bad6-2b5dc2105aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:52.527346 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:52.645393 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1432/2816] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:53.082180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b32fc6-bb17-4599-9ff8-24dba7bb35e4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:53.085393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-46b32fc6-bb17-4599-9ff8-24dba7bb35e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:53.347973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b32fc6-bb17-4599-9ff8-24dba7bb35e4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:53.364750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547b21d-723b-4974-b4f5-e94d3e8751c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:53.366062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547b21d-723b-4974-b4f5-e94d3e8751c9 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:53.366539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547b21d-723b-4974-b4f5-e94d3e8751c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:53.367106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4547b21d-723b-4974-b4f5-e94d3e8751c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:53.386037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547b21d-723b-4974-b4f5-e94d3e8751c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:53.387775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4547b21d-723b-4974-b4f5-e94d3e8751c9 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:53.418577 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1385/2817] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:16:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:16:54.842066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f46ed4-c160-4b67-bad6-2b5dc2105aa3 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:54.843498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-65f46ed4-c160-4b67-bad6-2b5dc2105aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:54.987014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f46ed4-c160-4b67-bad6-2b5dc2105aa3 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:54.993471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf09c3-33ab-49f4-b1de-4e83c16e2b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:54.995481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf09c3-33ab-49f4-b1de-4e83c16e2b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:54.995481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf09c3-33ab-49f4-b1de-4e83c16e2b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:54.995481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf09c3-33ab-49f4-b1de-4e83c16e2b09 admin admin] PATH_INFO: `/v3/users/f33dfa6cef9545f68fc53f885a772af4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:55.002593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf09c3-33ab-49f4-b1de-4e83c16e2b09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f33dfa6cef9545f68fc53f885a772af4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:55.006918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf09c3-33ab-49f4-b1de-4e83c16e2b09 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:55.268837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e0bf09c3-33ab-49f4-b1de-4e83c16e2b09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f33dfa6cef9545f68fc53f885a772af4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:55.299572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547b21d-723b-4974-b4f5-e94d3e8751c9 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:55.314686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e0bf09c3-33ab-49f4-b1de-4e83c16e2b09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f33dfa6cef9545f68fc53f885a772af4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:55.316335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4547b21d-723b-4974-b4f5-e94d3e8751c9 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:55.333617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae867f05-e80a-490f-b2a1-90175ef9cca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:55.333617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae867f05-e80a-490f-b2a1-90175ef9cca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:55.333617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae867f05-e80a-490f-b2a1-90175ef9cca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:55.333617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae867f05-e80a-490f-b2a1-90175ef9cca9 admin admin] PATH_INFO: `/v3/users/bc7e58d5fb354a8392bbfc42596c6b1a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:55.334401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae867f05-e80a-490f-b2a1-90175ef9cca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc7e58d5fb354a8392bbfc42596c6b1a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:55.335858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae867f05-e80a-490f-b2a1-90175ef9cca9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:55.352857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e0bf09c3-33ab-49f4-b1de-4e83c16e2b09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f33dfa6cef9545f68fc53f885a772af4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:55.352857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e0bf09c3-33ab-49f4-b1de-4e83c16e2b09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f33dfa6cef9545f68fc53f885a772af4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:55.483618 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:55.513412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e0bf09c3-33ab-49f4-b1de-4e83c16e2b09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f33dfa6cef9545f68fc53f885a772af4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:55.523354 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1433/2818] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:16:54 2022] DELETE /identity/v3/users/f33dfa6cef9545f68fc53f885a772af4 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:16:55.647794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ae867f05-e80a-490f-b2a1-90175ef9cca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc7e58d5fb354a8392bbfc42596c6b1a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:55.678442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ae867f05-e80a-490f-b2a1-90175ef9cca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc7e58d5fb354a8392bbfc42596c6b1a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:55.679221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ae867f05-e80a-490f-b2a1-90175ef9cca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc7e58d5fb354a8392bbfc42596c6b1a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:55.680792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ae867f05-e80a-490f-b2a1-90175ef9cca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc7e58d5fb354a8392bbfc42596c6b1a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:55.698408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ae867f05-e80a-490f-b2a1-90175ef9cca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc7e58d5fb354a8392bbfc42596c6b1a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:55.775480 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1386/2819] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:16:55 2022] DELETE /identity/v3/users/bc7e58d5fb354a8392bbfc42596c6b1a => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:16:55.786474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b197b7-e32d-4397-88d8-58cb9571e70a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:55.787008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b197b7-e32d-4397-88d8-58cb9571e70a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:55.787936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b197b7-e32d-4397-88d8-58cb9571e70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:55.830017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-13b197b7-e32d-4397-88d8-58cb9571e70a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:55.831539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-13b197b7-e32d-4397-88d8-58cb9571e70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:55.916566 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:55.959736 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1434/2820] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:55.969936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae867f05-e80a-490f-b2a1-90175ef9cca9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:55.973719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ae867f05-e80a-490f-b2a1-90175ef9cca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:56.031905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b197b7-e32d-4397-88d8-58cb9571e70a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:56.037350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-13b197b7-e32d-4397-88d8-58cb9571e70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:56.053196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b197b7-e32d-4397-88d8-58cb9571e70a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:56.066906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713c55e-41f2-4d9b-be2b-e9623d3fb3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:56.069621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713c55e-41f2-4d9b-be2b-e9623d3fb3da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:56.071872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713c55e-41f2-4d9b-be2b-e9623d3fb3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:56.072297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713c55e-41f2-4d9b-be2b-e9623d3fb3da admin admin] PATH_INFO: `/v3/projects/80eb9bf754d6426096bc6cde25fd404b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:56.076371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713c55e-41f2-4d9b-be2b-e9623d3fb3da admin admin] RBAC: Authorizing `identity:delete_project(project_id=80eb9bf754d6426096bc6cde25fd404b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:56.081083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713c55e-41f2-4d9b-be2b-e9623d3fb3da admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:56.120145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae867f05-e80a-490f-b2a1-90175ef9cca9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:56.130558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1290c1d8-a6cd-4bcb-aee0-db801f97d2be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:56.131380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290c1d8-a6cd-4bcb-aee0-db801f97d2be service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:56.131780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290c1d8-a6cd-4bcb-aee0-db801f97d2be service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:56.132153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290c1d8-a6cd-4bcb-aee0-db801f97d2be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:56.149865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290c1d8-a6cd-4bcb-aee0-db801f97d2be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:56.153089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1290c1d8-a6cd-4bcb-aee0-db801f97d2be service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:56.186238 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1387/2821] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:16:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:16:56.261487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7713c55e-41f2-4d9b-be2b-e9623d3fb3da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80eb9bf754d6426096bc6cde25fd404b', 'request_id': 'req-7713c55e-41f2-4d9b-be2b-e9623d3fb3da'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:56.272005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7713c55e-41f2-4d9b-be2b-e9623d3fb3da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80eb9bf754d6426096bc6cde25fd404b', 'request_id': 'req-7713c55e-41f2-4d9b-be2b-e9623d3fb3da'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:56.285317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7713c55e-41f2-4d9b-be2b-e9623d3fb3da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80eb9bf754d6426096bc6cde25fd404b', 'request_id': 'req-7713c55e-41f2-4d9b-be2b-e9623d3fb3da'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:56.368432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7713c55e-41f2-4d9b-be2b-e9623d3fb3da admin admin] The token cache is being invalidate because project 80eb9bf754d6426096bc6cde25fd404b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:16:56.371415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7713c55e-41f2-4d9b-be2b-e9623d3fb3da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:56.371415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7713c55e-41f2-4d9b-be2b-e9623d3fb3da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:56.372335 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1435/2822] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:16:56 2022] DELETE /identity/v3/projects/80eb9bf754d6426096bc6cde25fd404b => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:16:56.379831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7594fe-a5aa-4cda-9487-9dc56b396190 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:56.381268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7594fe-a5aa-4cda-9487-9dc56b396190 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:56.381585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7594fe-a5aa-4cda-9487-9dc56b396190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:56.407825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-af7594fe-a5aa-4cda-9487-9dc56b396190 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:56.407825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-af7594fe-a5aa-4cda-9487-9dc56b396190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:56.484312 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1388/2823] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:56.495824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50643eef-bb2a-4744-9284-47f8c7c0dac5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:56.496193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50643eef-bb2a-4744-9284-47f8c7c0dac5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:56.497745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50643eef-bb2a-4744-9284-47f8c7c0dac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:56.519202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7594fe-a5aa-4cda-9487-9dc56b396190 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:56.524110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-af7594fe-a5aa-4cda-9487-9dc56b396190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:56.546315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-50643eef-bb2a-4744-9284-47f8c7c0dac5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:56.547812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-50643eef-bb2a-4744-9284-47f8c7c0dac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:56.572416 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1436/2824] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:16:56.573669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50643eef-bb2a-4744-9284-47f8c7c0dac5 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:56.598940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50643eef-bb2a-4744-9284-47f8c7c0dac5 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:56.610310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205430b3-0c13-4315-b4d5-5834eaa2843f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:56.611121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205430b3-0c13-4315-b4d5-5834eaa2843f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:56.612224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205430b3-0c13-4315-b4d5-5834eaa2843f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:56.612616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205430b3-0c13-4315-b4d5-5834eaa2843f admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:56.614788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205430b3-0c13-4315-b4d5-5834eaa2843f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:16:56.615213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205430b3-0c13-4315-b4d5-5834eaa2843f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:56.617539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205430b3-0c13-4315-b4d5-5834eaa2843f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:56.620759 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:56.633151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7594fe-a5aa-4cda-9487-9dc56b396190 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:56.634878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e41f71-130a-48ce-85fd-77ef5689594c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:56.635888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e41f71-130a-48ce-85fd-77ef5689594c service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:56.636247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e41f71-130a-48ce-85fd-77ef5689594c service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:56.636590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e41f71-130a-48ce-85fd-77ef5689594c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:56.639757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-27e41f71-130a-48ce-85fd-77ef5689594c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:56.648570 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1437/2825] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:16:56.653601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e41f71-130a-48ce-85fd-77ef5689594c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:56.654671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205430b3-0c13-4315-b4d5-5834eaa2843f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:56.656317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e41f71-130a-48ce-85fd-77ef5689594c service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:56.668706 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1389/2826] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:16:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:16:56.674697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205430b3-0c13-4315-b4d5-5834eaa2843f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:56.684865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245db419-a3bc-4ff0-aef9-915f855131fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:56.684865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245db419-a3bc-4ff0-aef9-915f855131fd admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:56.684865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245db419-a3bc-4ff0-aef9-915f855131fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:56.684865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245db419-a3bc-4ff0-aef9-915f855131fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:56.685242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245db419-a3bc-4ff0-aef9-915f855131fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:56.685242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245db419-a3bc-4ff0-aef9-915f855131fd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:56.794509 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1438/2827] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:16:56 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:16:56.795387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e41f71-130a-48ce-85fd-77ef5689594c service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:56.810960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e41f71-130a-48ce-85fd-77ef5689594c service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:56.916404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7563f98-3733-443c-aed6-b468514d0c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:56.921848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7563f98-3733-443c-aed6-b468514d0c63 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:56.921848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7563f98-3733-443c-aed6-b468514d0c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:56.921848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7563f98-3733-443c-aed6-b468514d0c63 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:56.921848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7563f98-3733-443c-aed6-b468514d0c63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:56.921848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7563f98-3733-443c-aed6-b468514d0c63 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:57.025349 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1390/2828] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:16:56 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:16:57.029500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245db419-a3bc-4ff0-aef9-915f855131fd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:57.047636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245db419-a3bc-4ff0-aef9-915f855131fd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:57.070592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cba5b-07cd-415d-9b38-ee2556d03022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:57.072234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cba5b-07cd-415d-9b38-ee2556d03022 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:57.072532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cba5b-07cd-415d-9b38-ee2556d03022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:57.073506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9cba5b-07cd-415d-9b38-ee2556d03022 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:57.075856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9cba5b-07cd-415d-9b38-ee2556d03022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:57.078006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9cba5b-07cd-415d-9b38-ee2556d03022 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:57.109029 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1439/2829] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:16:57.112986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7563f98-3733-443c-aed6-b468514d0c63 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:57.132360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7563f98-3733-443c-aed6-b468514d0c63 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:57.135989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0de92-2bf4-41dc-8cc0-921b10426e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:57.138951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0de92-2bf4-41dc-8cc0-921b10426e68 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:57.140581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0de92-2bf4-41dc-8cc0-921b10426e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:57.140870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0de92-2bf4-41dc-8cc0-921b10426e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:57.141654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0de92-2bf4-41dc-8cc0-921b10426e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:57.145933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0de92-2bf4-41dc-8cc0-921b10426e68 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:57.177249 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1391/2830] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:16:57.182241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cba5b-07cd-415d-9b38-ee2556d03022 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:57.187144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0de92-2bf4-41dc-8cc0-921b10426e68 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:57.190535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-22a0de92-2bf4-41dc-8cc0-921b10426e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:57.199691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9cba5b-07cd-415d-9b38-ee2556d03022 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:57.213522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b96d64-8bfb-4aef-8034-e12f52f90ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:57.213522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b96d64-8bfb-4aef-8034-e12f52f90ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:57.213522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b96d64-8bfb-4aef-8034-e12f52f90ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:57.222953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b96d64-8bfb-4aef-8034-e12f52f90ed4 admin admin] PATH_INFO: `/v3/projects/050d7677abb5475f990890c66b90abe6/users/d3a1bc0c85b0488183eaebfe740614b9/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:57.281660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b96d64-8bfb-4aef-8034-e12f52f90ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=050d7677abb5475f990890c66b90abe6, user_id=d3a1bc0c85b0488183eaebfe740614b9, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:57.288990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b96d64-8bfb-4aef-8034-e12f52f90ed4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:57.398829 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1440/2831] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:16:57 2022] PUT /identity/v3/projects/050d7677abb5475f990890c66b90abe6/users/d3a1bc0c85b0488183eaebfe740614b9/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:16:57.403611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b96d64-8bfb-4aef-8034-e12f52f90ed4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:57.413237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-03b96d64-8bfb-4aef-8034-e12f52f90ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:57.428296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0de92-2bf4-41dc-8cc0-921b10426e68 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:57.589663 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:57.614812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b96d64-8bfb-4aef-8034-e12f52f90ed4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:57.627917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad68a7a-26fa-423e-81bc-ea679d06d8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:57.628827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad68a7a-26fa-423e-81bc-ea679d06d8c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:57.629117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad68a7a-26fa-423e-81bc-ea679d06d8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:57.629392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad68a7a-26fa-423e-81bc-ea679d06d8c7 admin admin] PATH_INFO: `/v3/projects/0b49a1a6d7c3436db526113e8743fb31` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:57.632774 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:57.633515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad68a7a-26fa-423e-81bc-ea679d06d8c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b49a1a6d7c3436db526113e8743fb31)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:57.636228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad68a7a-26fa-423e-81bc-ea679d06d8c7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:57.679658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb4554-1684-438c-ba88-b5fdacdea9a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:57.680825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb4554-1684-438c-ba88-b5fdacdea9a3 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:57.681883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb4554-1684-438c-ba88-b5fdacdea9a3 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:57.683846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb4554-1684-438c-ba88-b5fdacdea9a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:57.700062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-35eb4554-1684-438c-ba88-b5fdacdea9a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:57.738506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb4554-1684-438c-ba88-b5fdacdea9a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:57.741470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb4554-1684-438c-ba88-b5fdacdea9a3 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:57.766842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dad68a7a-26fa-423e-81bc-ea679d06d8c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b49a1a6d7c3436db526113e8743fb31', 'request_id': 'req-dad68a7a-26fa-423e-81bc-ea679d06d8c7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:57.789602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dad68a7a-26fa-423e-81bc-ea679d06d8c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b49a1a6d7c3436db526113e8743fb31', 'request_id': 'req-dad68a7a-26fa-423e-81bc-ea679d06d8c7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:57.791249 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1392/2832] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:16:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:16:57.806393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95873742-587d-439d-93cf-08d18f2ad479 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:57.806393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95873742-587d-439d-93cf-08d18f2ad479 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:57.806393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95873742-587d-439d-93cf-08d18f2ad479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:57.818635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dad68a7a-26fa-423e-81bc-ea679d06d8c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b49a1a6d7c3436db526113e8743fb31', 'request_id': 'req-dad68a7a-26fa-423e-81bc-ea679d06d8c7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:57.864223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-95873742-587d-439d-93cf-08d18f2ad479 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:57.865741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-95873742-587d-439d-93cf-08d18f2ad479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:57.897143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dad68a7a-26fa-423e-81bc-ea679d06d8c7 admin admin] The token cache is being invalidate because project 0b49a1a6d7c3436db526113e8743fb31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:16:57.897445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dad68a7a-26fa-423e-81bc-ea679d06d8c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:57.899852 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dad68a7a-26fa-423e-81bc-ea679d06d8c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:57.906645 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1441/2833] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:16:57 2022] DELETE /identity/v3/projects/0b49a1a6d7c3436db526113e8743fb31 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:16:57.910518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad68a7a-26fa-423e-81bc-ea679d06d8c7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:57.913260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dad68a7a-26fa-423e-81bc-ea679d06d8c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:58.065046 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1393/2834] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:16:58.099415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95873742-587d-439d-93cf-08d18f2ad479 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:58.101009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-95873742-587d-439d-93cf-08d18f2ad479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:16:58.126308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad68a7a-26fa-423e-81bc-ea679d06d8c7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:58.146392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627df522-d1ca-407c-9ff7-b26911fdd2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:58.151760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627df522-d1ca-407c-9ff7-b26911fdd2ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:58.155974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627df522-d1ca-407c-9ff7-b26911fdd2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:58.155974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627df522-d1ca-407c-9ff7-b26911fdd2ec admin admin] PATH_INFO: `/v3/users/e0ec3b4d4d784c7bb9f60bd0848d0d1e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:58.155974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627df522-d1ca-407c-9ff7-b26911fdd2ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0ec3b4d4d784c7bb9f60bd0848d0d1e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:58.159111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627df522-d1ca-407c-9ff7-b26911fdd2ec admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:58.260794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95873742-587d-439d-93cf-08d18f2ad479 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:58.266926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16120e1b-69fd-4a8b-a8c7-eab57de9f909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:58.267758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16120e1b-69fd-4a8b-a8c7-eab57de9f909 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:58.268570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16120e1b-69fd-4a8b-a8c7-eab57de9f909 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:58.268920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16120e1b-69fd-4a8b-a8c7-eab57de9f909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:58.286906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16120e1b-69fd-4a8b-a8c7-eab57de9f909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:58.288663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16120e1b-69fd-4a8b-a8c7-eab57de9f909 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:58.301445 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1394/2835] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:16:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:16:58.427458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-627df522-d1ca-407c-9ff7-b26911fdd2ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0ec3b4d4d784c7bb9f60bd0848d0d1e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:58.478787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-627df522-d1ca-407c-9ff7-b26911fdd2ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0ec3b4d4d784c7bb9f60bd0848d0d1e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:58.511046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-627df522-d1ca-407c-9ff7-b26911fdd2ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0ec3b4d4d784c7bb9f60bd0848d0d1e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:58.513295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-627df522-d1ca-407c-9ff7-b26911fdd2ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0ec3b4d4d784c7bb9f60bd0848d0d1e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:58.590792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-627df522-d1ca-407c-9ff7-b26911fdd2ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0ec3b4d4d784c7bb9f60bd0848d0d1e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:58.596088 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:58.605266 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1442/2836] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:16:57 2022] DELETE /identity/v3/users/e0ec3b4d4d784c7bb9f60bd0848d0d1e => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:16:59.379171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16120e1b-69fd-4a8b-a8c7-eab57de9f909 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:16:59.391680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16120e1b-69fd-4a8b-a8c7-eab57de9f909 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:16:59.526678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0aa2aa-8334-4632-ae7f-0aec38273b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:16:59.528026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0aa2aa-8334-4632-ae7f-0aec38273b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:59.528806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0aa2aa-8334-4632-ae7f-0aec38273b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:59.529197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0aa2aa-8334-4632-ae7f-0aec38273b2a admin admin] PATH_INFO: `/v3/projects/d194a6deb7b64149a3e67162a21d01cf` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:59.530561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0aa2aa-8334-4632-ae7f-0aec38273b2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d194a6deb7b64149a3e67162a21d01cf)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:16:59.532616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0aa2aa-8334-4632-ae7f-0aec38273b2a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:16:59.658667 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:16:59.675024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fe0aa2aa-8334-4632-ae7f-0aec38273b2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd194a6deb7b64149a3e67162a21d01cf', 'request_id': 'req-fe0aa2aa-8334-4632-ae7f-0aec38273b2a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:59.751498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fe0aa2aa-8334-4632-ae7f-0aec38273b2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd194a6deb7b64149a3e67162a21d01cf', 'request_id': 'req-fe0aa2aa-8334-4632-ae7f-0aec38273b2a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:59.764303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fe0aa2aa-8334-4632-ae7f-0aec38273b2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd194a6deb7b64149a3e67162a21d01cf', 'request_id': 'req-fe0aa2aa-8334-4632-ae7f-0aec38273b2a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:59.812594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fe0aa2aa-8334-4632-ae7f-0aec38273b2a admin admin] The token cache is being invalidate because project d194a6deb7b64149a3e67162a21d01cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:16:59.817597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fe0aa2aa-8334-4632-ae7f-0aec38273b2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:59.817597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fe0aa2aa-8334-4632-ae7f-0aec38273b2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:16:59.817597 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1395/2837] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:16:59 2022] DELETE /identity/v3/projects/d194a6deb7b64149a3e67162a21d01cf => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:16:59.823034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ae9a8-8ce1-4d3d-a54e-d840fb6110fe None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:16:59.823578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ae9a8-8ce1-4d3d-a54e-d840fb6110fe None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:16:59.823705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ae9a8-8ce1-4d3d-a54e-d840fb6110fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:16:59.864228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-db8ae9a8-8ce1-4d3d-a54e-d840fb6110fe None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:16:59.865602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-db8ae9a8-8ce1-4d3d-a54e-d840fb6110fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:00.051067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285a8e5-ba9c-4eee-a9c1-d2ee0cec98c4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:00.051934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285a8e5-ba9c-4eee-a9c1-d2ee0cec98c4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:00.052427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285a8e5-ba9c-4eee-a9c1-d2ee0cec98c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:00.055667 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1443/2838] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:00.073670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7285a8e5-ba9c-4eee-a9c1-d2ee0cec98c4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:00.075401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7285a8e5-ba9c-4eee-a9c1-d2ee0cec98c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:00.090951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ae9a8-8ce1-4d3d-a54e-d840fb6110fe None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:00.098945 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1396/2839] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:00.103992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ae9a8-8ce1-4d3d-a54e-d840fb6110fe None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:00.116166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152ca36-fb66-45a0-972a-701e63cea64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:00.117408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152ca36-fb66-45a0-972a-701e63cea64d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:00.118325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152ca36-fb66-45a0-972a-701e63cea64d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:00.118813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152ca36-fb66-45a0-972a-701e63cea64d admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:00.120391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152ca36-fb66-45a0-972a-701e63cea64d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:17:00.120897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152ca36-fb66-45a0-972a-701e63cea64d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:00.123277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152ca36-fb66-45a0-972a-701e63cea64d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:00.142041 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1444/2840] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:17:00.147553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285a8e5-ba9c-4eee-a9c1-d2ee0cec98c4 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:00.162621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285a8e5-ba9c-4eee-a9c1-d2ee0cec98c4 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:00.169744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56017996-a40d-45a0-bbc4-2e8eb988265b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:00.170808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56017996-a40d-45a0-bbc4-2e8eb988265b admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:00.171612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56017996-a40d-45a0-bbc4-2e8eb988265b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:00.172318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56017996-a40d-45a0-bbc4-2e8eb988265b admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:00.174174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56017996-a40d-45a0-bbc4-2e8eb988265b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:00.177046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56017996-a40d-45a0-bbc4-2e8eb988265b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:00.335950 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1397/2841] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:17:00 2022] POST /identity/v3/projects => generated 393 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:17:00.337231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152ca36-fb66-45a0-972a-701e63cea64d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:00.351785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152ca36-fb66-45a0-972a-701e63cea64d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:00.495817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af075921-c443-415b-9636-cced1b07eacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:00.496771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af075921-c443-415b-9636-cced1b07eacc admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:00.497841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af075921-c443-415b-9636-cced1b07eacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:00.498431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af075921-c443-415b-9636-cced1b07eacc admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:00.499728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af075921-c443-415b-9636-cced1b07eacc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:00.507434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af075921-c443-415b-9636-cced1b07eacc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:00.601912 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1445/2842] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:17:00 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:17:00.606317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56017996-a40d-45a0-bbc4-2e8eb988265b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:00.633183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56017996-a40d-45a0-bbc4-2e8eb988265b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:00.645244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f4955-74e3-459c-aebd-ffcff7dc4056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:00.648489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f4955-74e3-459c-aebd-ffcff7dc4056 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:00.649712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f4955-74e3-459c-aebd-ffcff7dc4056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:00.650326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f4955-74e3-459c-aebd-ffcff7dc4056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:00.653150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f4955-74e3-459c-aebd-ffcff7dc4056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:00.655143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f4955-74e3-459c-aebd-ffcff7dc4056 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:00.683269 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1398/2843] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:17:00.686485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af075921-c443-415b-9636-cced1b07eacc admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:00.706538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af075921-c443-415b-9636-cced1b07eacc admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:00.725642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2ef3de-6eca-45ce-a1c4-33c27b47663b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:00.727585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ef3de-6eca-45ce-a1c4-33c27b47663b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:00.728765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ef3de-6eca-45ce-a1c4-33c27b47663b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:00.730572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2ef3de-6eca-45ce-a1c4-33c27b47663b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:00.731987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ef3de-6eca-45ce-a1c4-33c27b47663b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:00.734573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2ef3de-6eca-45ce-a1c4-33c27b47663b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:00.776875 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1446/2844] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:17:00.779488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f4955-74e3-459c-aebd-ffcff7dc4056 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:00.796346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f4955-74e3-459c-aebd-ffcff7dc4056 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:00.805478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26e384-3b7c-4f52-92c4-5de90d24eb23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:00.807389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26e384-3b7c-4f52-92c4-5de90d24eb23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:00.808714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26e384-3b7c-4f52-92c4-5de90d24eb23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:00.809260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26e384-3b7c-4f52-92c4-5de90d24eb23 admin admin] PATH_INFO: `/v3/projects/48a360b1efaa403eafbf44708c5a28d4/users/dc2412e0f18c4c6d8dd4352d4418db31/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:00.848014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26e384-3b7c-4f52-92c4-5de90d24eb23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a360b1efaa403eafbf44708c5a28d4, user_id=dc2412e0f18c4c6d8dd4352d4418db31, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:00.863231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26e384-3b7c-4f52-92c4-5de90d24eb23 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:00.938155 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1399/2845] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:17:00 2022] PUT /identity/v3/projects/48a360b1efaa403eafbf44708c5a28d4/users/dc2412e0f18c4c6d8dd4352d4418db31/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:17:00.948221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c67ba-11db-41bc-8574-b8d1ea269378 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:00.948818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c67ba-11db-41bc-8574-b8d1ea269378 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:00.951205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c67ba-11db-41bc-8574-b8d1ea269378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:01.023037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-280c67ba-11db-41bc-8574-b8d1ea269378 None None] MFA Rules not processed for user `dc2412e0f18c4c6d8dd4352d4418db31`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:01.029231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-280c67ba-11db-41bc-8574-b8d1ea269378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:01.136043 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:01.154142 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1447/2846] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:01.155063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26e384-3b7c-4f52-92c4-5de90d24eb23 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:01.315450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26e384-3b7c-4f52-92c4-5de90d24eb23 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:01.321565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599ead3-ed99-49fc-b782-cd5f4ea3911e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:01.322902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599ead3-ed99-49fc-b782-cd5f4ea3911e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:01.323307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599ead3-ed99-49fc-b782-cd5f4ea3911e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:01.324223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599ead3-ed99-49fc-b782-cd5f4ea3911e admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:01.324500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599ead3-ed99-49fc-b782-cd5f4ea3911e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:01.327402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599ead3-ed99-49fc-b782-cd5f4ea3911e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:01.495850 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1400/2847] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:17:01 2022] POST /identity/v3/projects => generated 391 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:17:01.505888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c67ba-11db-41bc-8574-b8d1ea269378 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:01.519615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c67ba-11db-41bc-8574-b8d1ea269378 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:01.648232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2cd4b-5107-444e-81e7-0bf21a5e6d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:01.648824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2cd4b-5107-444e-81e7-0bf21a5e6d1b admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:01.649203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2cd4b-5107-444e-81e7-0bf21a5e6d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:01.651040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db2cd4b-5107-444e-81e7-0bf21a5e6d1b admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:01.654346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2cd4b-5107-444e-81e7-0bf21a5e6d1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:01.659616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db2cd4b-5107-444e-81e7-0bf21a5e6d1b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:01.750702 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1448/2848] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:17:01 2022] POST /identity/v3/users => generated 302 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:17:01.753512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599ead3-ed99-49fc-b782-cd5f4ea3911e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:01.777506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599ead3-ed99-49fc-b782-cd5f4ea3911e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:01.791998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41a339-e51e-48d8-9796-a6fffedd610f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:01.795312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41a339-e51e-48d8-9796-a6fffedd610f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:01.795801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41a339-e51e-48d8-9796-a6fffedd610f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:01.796245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41a339-e51e-48d8-9796-a6fffedd610f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:01.797538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41a339-e51e-48d8-9796-a6fffedd610f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:01.804819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41a339-e51e-48d8-9796-a6fffedd610f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:01.827868 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1401/2849] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:17:01.831639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2cd4b-5107-444e-81e7-0bf21a5e6d1b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:01.853305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db2cd4b-5107-444e-81e7-0bf21a5e6d1b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:01.860513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd843a40-7fb0-4047-b616-650a089ddb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:01.860513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd843a40-7fb0-4047-b616-650a089ddb36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:01.860513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd843a40-7fb0-4047-b616-650a089ddb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:01.860513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd843a40-7fb0-4047-b616-650a089ddb36 admin admin] PATH_INFO: `/v3/projects/b4eeca046a424f60adf3e218db1d1782/users/ec112772f6a140c0856042d51b730435/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:01.944346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd843a40-7fb0-4047-b616-650a089ddb36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4eeca046a424f60adf3e218db1d1782, user_id=ec112772f6a140c0856042d51b730435, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:01.944528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd843a40-7fb0-4047-b616-650a089ddb36 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:02.024194 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1449/2850] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:17:01 2022] PUT /identity/v3/projects/b4eeca046a424f60adf3e218db1d1782/users/ec112772f6a140c0856042d51b730435/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:17:02.028999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41a339-e51e-48d8-9796-a6fffedd610f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:02.046079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41a339-e51e-48d8-9796-a6fffedd610f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:02.170971 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:02.277864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556d9ae-6824-45e8-a3a4-0033961caf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:02.278711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556d9ae-6824-45e8-a3a4-0033961caf62 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:02.279146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556d9ae-6824-45e8-a3a4-0033961caf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:02.279498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556d9ae-6824-45e8-a3a4-0033961caf62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:02.280372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556d9ae-6824-45e8-a3a4-0033961caf62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:02.282384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e556d9ae-6824-45e8-a3a4-0033961caf62 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:02.304311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd843a40-7fb0-4047-b616-650a089ddb36 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:02.307955 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1402/2851] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:17:02 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:17:02.309755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bd843a40-7fb0-4047-b616-650a089ddb36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:02.316325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556d9ae-6824-45e8-a3a4-0033961caf62 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:02.337143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556d9ae-6824-45e8-a3a4-0033961caf62 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:02.347585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26e6ab4-ac58-4abf-a43f-a75b4c8a69e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:02.349094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e6ab4-ac58-4abf-a43f-a75b4c8a69e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:02.349573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e6ab4-ac58-4abf-a43f-a75b4c8a69e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:02.350085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e6ab4-ac58-4abf-a43f-a75b4c8a69e0 admin admin] PATH_INFO: `/v3/projects/b4eeca046a424f60adf3e218db1d1782/users/ec112772f6a140c0856042d51b730435/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:02.357650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e6ab4-ac58-4abf-a43f-a75b4c8a69e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4eeca046a424f60adf3e218db1d1782, user_id=ec112772f6a140c0856042d51b730435, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:02.364019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26e6ab4-ac58-4abf-a43f-a75b4c8a69e0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:02.413632 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1403/2852] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:17:02 2022] PUT /identity/v3/projects/b4eeca046a424f60adf3e218db1d1782/users/ec112772f6a140c0856042d51b730435/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:17:02.475452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaa8d8-ab47-41e1-a06b-1e41885e7eda None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:02.475709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaa8d8-ab47-41e1-a06b-1e41885e7eda None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:02.475990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfaa8d8-ab47-41e1-a06b-1e41885e7eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:02.512392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7cfaa8d8-ab47-41e1-a06b-1e41885e7eda None None] MFA Rules not processed for user `ec112772f6a140c0856042d51b730435`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:02.514666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7cfaa8d8-ab47-41e1-a06b-1e41885e7eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:02.516964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd843a40-7fb0-4047-b616-650a089ddb36 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:02.679345 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:02.697037 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1404/2853] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:17:02.717283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33615887-4319-46ab-8ea4-6341384e1faf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:02.722344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33615887-4319-46ab-8ea4-6341384e1faf service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:02.722344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33615887-4319-46ab-8ea4-6341384e1faf service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:02.722344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33615887-4319-46ab-8ea4-6341384e1faf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:02.726615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-33615887-4319-46ab-8ea4-6341384e1faf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:02.771791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33615887-4319-46ab-8ea4-6341384e1faf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:02.776933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33615887-4319-46ab-8ea4-6341384e1faf service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:02.811372 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1450/2854] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:17:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:17:02.960728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfaa8d8-ab47-41e1-a06b-1e41885e7eda None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:02.985060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfaa8d8-ab47-41e1-a06b-1e41885e7eda None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:02.997872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be3816-f41a-4a62-9a46-f861d5b92eeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:03.012834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be3816-f41a-4a62-9a46-f861d5b92eeb service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:03.012834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be3816-f41a-4a62-9a46-f861d5b92eeb service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:03.012834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44be3816-f41a-4a62-9a46-f861d5b92eeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:03.014782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-44be3816-f41a-4a62-9a46-f861d5b92eeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:03.050286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33615887-4319-46ab-8ea4-6341384e1faf service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:03.052531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-33615887-4319-46ab-8ea4-6341384e1faf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:03.076571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33615887-4319-46ab-8ea4-6341384e1faf service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:03.096705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89cf6f-fea2-4562-bf7b-6cf4b95e85f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:03.099107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89cf6f-fea2-4562-bf7b-6cf4b95e85f8 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:03.100195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89cf6f-fea2-4562-bf7b-6cf4b95e85f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:03.101628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89cf6f-fea2-4562-bf7b-6cf4b95e85f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:03.130863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89cf6f-fea2-4562-bf7b-6cf4b95e85f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:03.138232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89cf6f-fea2-4562-bf7b-6cf4b95e85f8 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:03.178345 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1451/2855] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:17:03 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:17:03.217059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be3816-f41a-4a62-9a46-f861d5b92eeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:03.219024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44be3816-f41a-4a62-9a46-f861d5b92eeb service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:03.240882 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1405/2856] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:17:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:17:03.274788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89cf6f-fea2-4562-bf7b-6cf4b95e85f8 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:03.291394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89cf6f-fea2-4562-bf7b-6cf4b95e85f8 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:03.302448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2b858f-55af-4c44-8931-0a30cff9181f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:03.302448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b858f-55af-4c44-8931-0a30cff9181f service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:03.303953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b858f-55af-4c44-8931-0a30cff9181f service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:03.308154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2b858f-55af-4c44-8931-0a30cff9181f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:03.492392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b858f-55af-4c44-8931-0a30cff9181f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:03.494501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2b858f-55af-4c44-8931-0a30cff9181f service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:03.514489 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1452/2857] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:17:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:17:03.534967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be3816-f41a-4a62-9a46-f861d5b92eeb service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:03.626281 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:03.683185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44be3816-f41a-4a62-9a46-f861d5b92eeb service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:03.697337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37687738-bd57-4dda-b5e3-8fbbfa38299b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:03.701113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37687738-bd57-4dda-b5e3-8fbbfa38299b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:03.703658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37687738-bd57-4dda-b5e3-8fbbfa38299b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:03.705326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37687738-bd57-4dda-b5e3-8fbbfa38299b admin admin] PATH_INFO: `/v3/users/dc2412e0f18c4c6d8dd4352d4418db31` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:03.708982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37687738-bd57-4dda-b5e3-8fbbfa38299b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc2412e0f18c4c6d8dd4352d4418db31)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:03.714319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37687738-bd57-4dda-b5e3-8fbbfa38299b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:04.012711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37687738-bd57-4dda-b5e3-8fbbfa38299b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc2412e0f18c4c6d8dd4352d4418db31'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:04.052885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37687738-bd57-4dda-b5e3-8fbbfa38299b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc2412e0f18c4c6d8dd4352d4418db31'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:04.054312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37687738-bd57-4dda-b5e3-8fbbfa38299b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc2412e0f18c4c6d8dd4352d4418db31'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:04.055574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37687738-bd57-4dda-b5e3-8fbbfa38299b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc2412e0f18c4c6d8dd4352d4418db31'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:04.079459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37687738-bd57-4dda-b5e3-8fbbfa38299b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc2412e0f18c4c6d8dd4352d4418db31'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:04.209287 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1406/2858] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:17:03 2022] DELETE /identity/v3/users/dc2412e0f18c4c6d8dd4352d4418db31 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:17:04.214346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1a48a-4f31-4a69-b551-d4bdefed34eb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:04.214870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1a48a-4f31-4a69-b551-d4bdefed34eb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:04.214989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a1a48a-4f31-4a69-b551-d4bdefed34eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:04.288187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b5a1a48a-4f31-4a69-b551-d4bdefed34eb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:04.295916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b5a1a48a-4f31-4a69-b551-d4bdefed34eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:04.416498 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1453/2859] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:04.477543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37687738-bd57-4dda-b5e3-8fbbfa38299b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:04.479805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-37687738-bd57-4dda-b5e3-8fbbfa38299b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:04.645462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37687738-bd57-4dda-b5e3-8fbbfa38299b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:04.650377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d4f32-4086-48d3-ac15-27337fa863c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:04.652846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d4f32-4086-48d3-ac15-27337fa863c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:04.652846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d4f32-4086-48d3-ac15-27337fa863c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:04.652846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d4f32-4086-48d3-ac15-27337fa863c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:04.663970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d4f32-4086-48d3-ac15-27337fa863c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:04.666303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261d4f32-4086-48d3-ac15-27337fa863c5 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:04.687665 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1407/2860] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:17:06.009887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1a48a-4f31-4a69-b551-d4bdefed34eb None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:06.011373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b5a1a48a-4f31-4a69-b551-d4bdefed34eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:06.041055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a1a48a-4f31-4a69-b551-d4bdefed34eb None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:06.057647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c7967-32a0-4f62-92f2-6d455f75f28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:06.058800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c7967-32a0-4f62-92f2-6d455f75f28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:06.059280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c7967-32a0-4f62-92f2-6d455f75f28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:06.059770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c7967-32a0-4f62-92f2-6d455f75f28f admin admin] PATH_INFO: `/v3/users/3dfe3b60fca6438a8ab3242838e311c4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:06.061988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c7967-32a0-4f62-92f2-6d455f75f28f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dfe3b60fca6438a8ab3242838e311c4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:06.070606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c7967-32a0-4f62-92f2-6d455f75f28f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:06.344327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f03c7967-32a0-4f62-92f2-6d455f75f28f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dfe3b60fca6438a8ab3242838e311c4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:06.389792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f03c7967-32a0-4f62-92f2-6d455f75f28f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dfe3b60fca6438a8ab3242838e311c4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:06.391234 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:06.411079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f03c7967-32a0-4f62-92f2-6d455f75f28f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dfe3b60fca6438a8ab3242838e311c4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:06.411972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f03c7967-32a0-4f62-92f2-6d455f75f28f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dfe3b60fca6438a8ab3242838e311c4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:06.527448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f03c7967-32a0-4f62-92f2-6d455f75f28f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dfe3b60fca6438a8ab3242838e311c4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:06.538634 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1454/2861] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:17:06 2022] DELETE /identity/v3/users/3dfe3b60fca6438a8ab3242838e311c4 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:17:07.089358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d4f32-4086-48d3-ac15-27337fa863c5 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:07.094515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-261d4f32-4086-48d3-ac15-27337fa863c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:07.125096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261d4f32-4086-48d3-ac15-27337fa863c5 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:07.202493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c080e-fbb4-47bc-a6b7-09b70607505e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:07.218761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c080e-fbb4-47bc-a6b7-09b70607505e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:07.218761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98c080e-fbb4-47bc-a6b7-09b70607505e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:07.259977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cac2d-0453-4a1f-8acf-eb5d9e20ede7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:07.260860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cac2d-0453-4a1f-8acf-eb5d9e20ede7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:07.261305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cac2d-0453-4a1f-8acf-eb5d9e20ede7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:07.261569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cac2d-0453-4a1f-8acf-eb5d9e20ede7 admin admin] PATH_INFO: `/v3/projects/48a360b1efaa403eafbf44708c5a28d4` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:07.262821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cac2d-0453-4a1f-8acf-eb5d9e20ede7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48a360b1efaa403eafbf44708c5a28d4)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:07.264985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cac2d-0453-4a1f-8acf-eb5d9e20ede7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:07.276238 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:07.286955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c98c080e-fbb4-47bc-a6b7-09b70607505e None None] MFA Rules not processed for user `5d2572c3904f40c6b26ce92425f655f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:07.289488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c98c080e-fbb4-47bc-a6b7-09b70607505e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:07.372693 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1455/2862] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:17:07.590182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c080e-fbb4-47bc-a6b7-09b70607505e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:07.591802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c98c080e-fbb4-47bc-a6b7-09b70607505e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:07.619402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98c080e-fbb4-47bc-a6b7-09b70607505e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:07.643901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-846cac2d-0453-4a1f-8acf-eb5d9e20ede7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a360b1efaa403eafbf44708c5a28d4', 'request_id': 'req-846cac2d-0453-4a1f-8acf-eb5d9e20ede7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:07.761598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-846cac2d-0453-4a1f-8acf-eb5d9e20ede7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a360b1efaa403eafbf44708c5a28d4', 'request_id': 'req-846cac2d-0453-4a1f-8acf-eb5d9e20ede7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:07.771163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-846cac2d-0453-4a1f-8acf-eb5d9e20ede7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a360b1efaa403eafbf44708c5a28d4', 'request_id': 'req-846cac2d-0453-4a1f-8acf-eb5d9e20ede7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:07.798516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-846cac2d-0453-4a1f-8acf-eb5d9e20ede7 admin admin] The token cache is being invalidate because project 48a360b1efaa403eafbf44708c5a28d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:17:07.798961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-846cac2d-0453-4a1f-8acf-eb5d9e20ede7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:07.800058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-846cac2d-0453-4a1f-8acf-eb5d9e20ede7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:07.803726 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1408/2863] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:17:07 2022] DELETE /identity/v3/projects/48a360b1efaa403eafbf44708c5a28d4 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:17:07.823195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cac2d-0453-4a1f-8acf-eb5d9e20ede7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:07.823195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-846cac2d-0453-4a1f-8acf-eb5d9e20ede7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:07.839972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65406caf-41f4-4628-a04a-c9980da772a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:07.842603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65406caf-41f4-4628-a04a-c9980da772a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:07.842889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65406caf-41f4-4628-a04a-c9980da772a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:07.843167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65406caf-41f4-4628-a04a-c9980da772a9 admin admin] PATH_INFO: `/v3/projects/4ec85319ae8e45279a55eff890daab1a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:07.855595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65406caf-41f4-4628-a04a-c9980da772a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec85319ae8e45279a55eff890daab1a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:07.856996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65406caf-41f4-4628-a04a-c9980da772a9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:07.986889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cac2d-0453-4a1f-8acf-eb5d9e20ede7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:07.996080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2101a89-c456-469a-a1da-eb4954042924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:07.997464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2101a89-c456-469a-a1da-eb4954042924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:07.998058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2101a89-c456-469a-a1da-eb4954042924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:07.998492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2101a89-c456-469a-a1da-eb4954042924 admin admin] PATH_INFO: `/v3/users/ec112772f6a140c0856042d51b730435` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:08.000326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2101a89-c456-469a-a1da-eb4954042924 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec112772f6a140c0856042d51b730435)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:08.004562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2101a89-c456-469a-a1da-eb4954042924 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:08.757770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-65406caf-41f4-4628-a04a-c9980da772a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec85319ae8e45279a55eff890daab1a', 'request_id': 'req-65406caf-41f4-4628-a04a-c9980da772a9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:08.763766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a2101a89-c456-469a-a1da-eb4954042924 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec112772f6a140c0856042d51b730435'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:08.775752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-65406caf-41f4-4628-a04a-c9980da772a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec85319ae8e45279a55eff890daab1a', 'request_id': 'req-65406caf-41f4-4628-a04a-c9980da772a9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:08.796190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-65406caf-41f4-4628-a04a-c9980da772a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec85319ae8e45279a55eff890daab1a', 'request_id': 'req-65406caf-41f4-4628-a04a-c9980da772a9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:08.818012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a2101a89-c456-469a-a1da-eb4954042924 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec112772f6a140c0856042d51b730435'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:08.819686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a2101a89-c456-469a-a1da-eb4954042924 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec112772f6a140c0856042d51b730435'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:08.821073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a2101a89-c456-469a-a1da-eb4954042924 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec112772f6a140c0856042d51b730435'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:08.832204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a2101a89-c456-469a-a1da-eb4954042924 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec112772f6a140c0856042d51b730435'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:08.884013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-65406caf-41f4-4628-a04a-c9980da772a9 admin admin] The token cache is being invalidate because project 4ec85319ae8e45279a55eff890daab1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:17:08.889019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-65406caf-41f4-4628-a04a-c9980da772a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:08.889019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-65406caf-41f4-4628-a04a-c9980da772a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:08.889019 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1456/2864] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:17:07 2022] DELETE /identity/v3/projects/4ec85319ae8e45279a55eff890daab1a => generated 0 bytes in 1299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:17:08.894660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2657a-f370-46c0-9bc2-f69c855ec591 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:08.895302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2657a-f370-46c0-9bc2-f69c855ec591 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:08.895901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c2657a-f370-46c0-9bc2-f69c855ec591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:08.947471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c2c2657a-f370-46c0-9bc2-f69c855ec591 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:08.948766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c2c2657a-f370-46c0-9bc2-f69c855ec591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:08.965207 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1409/2865] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:17:07 2022] DELETE /identity/v3/users/ec112772f6a140c0856042d51b730435 => generated 0 bytes in 1157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:17:08.998046 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:09.134262 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1457/2866] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:09.141940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644cbea-1ff9-4da8-a13f-6061ca7a5b9e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:09.143607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644cbea-1ff9-4da8-a13f-6061ca7a5b9e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:09.143901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644cbea-1ff9-4da8-a13f-6061ca7a5b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:09.166631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8644cbea-1ff9-4da8-a13f-6061ca7a5b9e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:09.167995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8644cbea-1ff9-4da8-a13f-6061ca7a5b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:09.256241 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1410/2867] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:09.260718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2657a-f370-46c0-9bc2-f69c855ec591 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:09.285169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c2657a-f370-46c0-9bc2-f69c855ec591 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:09.301838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42729167-db0c-4db0-8f8d-09080bc58c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:09.303429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42729167-db0c-4db0-8f8d-09080bc58c13 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:09.303947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42729167-db0c-4db0-8f8d-09080bc58c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:09.304100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42729167-db0c-4db0-8f8d-09080bc58c13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:09.304950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42729167-db0c-4db0-8f8d-09080bc58c13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:17:09.305080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42729167-db0c-4db0-8f8d-09080bc58c13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:09.306724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42729167-db0c-4db0-8f8d-09080bc58c13 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:09.343771 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1458/2868] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:17:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:17:09.346129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644cbea-1ff9-4da8-a13f-6061ca7a5b9e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:09.358963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644cbea-1ff9-4da8-a13f-6061ca7a5b9e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:09.393969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4483d-269a-4f04-a6a5-feaf816c1803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:09.393969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4483d-269a-4f04-a6a5-feaf816c1803 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:09.393969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4483d-269a-4f04-a6a5-feaf816c1803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:09.393969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4483d-269a-4f04-a6a5-feaf816c1803 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:09.394372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4483d-269a-4f04-a6a5-feaf816c1803 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:09.399147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c4483d-269a-4f04-a6a5-feaf816c1803 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:09.517983 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1411/2869] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:17:09 2022] POST /identity/v3/projects => generated 371 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:17:09.523376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42729167-db0c-4db0-8f8d-09080bc58c13 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:09.539195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42729167-db0c-4db0-8f8d-09080bc58c13 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:09.631481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c630d-b704-4df5-8769-fa9ab4f93f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:09.632413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c630d-b704-4df5-8769-fa9ab4f93f15 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:09.632866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c630d-b704-4df5-8769-fa9ab4f93f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:09.633321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544c630d-b704-4df5-8769-fa9ab4f93f15 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:09.634221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c630d-b704-4df5-8769-fa9ab4f93f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:09.636439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544c630d-b704-4df5-8769-fa9ab4f93f15 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:09.673386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4483d-269a-4f04-a6a5-feaf816c1803 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:09.676071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-19c4483d-269a-4f04-a6a5-feaf816c1803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:09.717364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c4483d-269a-4f04-a6a5-feaf816c1803 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:09.728073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e10c65-7497-4274-95f9-8e0c04888d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:09.729033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e10c65-7497-4274-95f9-8e0c04888d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:09.729250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e10c65-7497-4274-95f9-8e0c04888d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:09.729531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e10c65-7497-4274-95f9-8e0c04888d0a admin admin] PATH_INFO: `/v3/projects/b4eeca046a424f60adf3e218db1d1782` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:09.730886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e10c65-7497-4274-95f9-8e0c04888d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4eeca046a424f60adf3e218db1d1782)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:09.733775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e10c65-7497-4274-95f9-8e0c04888d0a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:09.779893 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1459/2870] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:17:09 2022] POST /identity/v3/users => generated 286 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:17:09.781724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c630d-b704-4df5-8769-fa9ab4f93f15 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:09.802779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544c630d-b704-4df5-8769-fa9ab4f93f15 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:09.808671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6fffb-126c-409f-82ae-02aec22cbf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:09.812404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6fffb-126c-409f-82ae-02aec22cbf04 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:09.812404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6fffb-126c-409f-82ae-02aec22cbf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:09.812404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e6fffb-126c-409f-82ae-02aec22cbf04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:09.812404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6fffb-126c-409f-82ae-02aec22cbf04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:09.817882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e6fffb-126c-409f-82ae-02aec22cbf04 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:09.833153 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1460/2871] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:17:09.836588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6fffb-126c-409f-82ae-02aec22cbf04 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:09.848621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e6fffb-126c-409f-82ae-02aec22cbf04 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:09.855113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca3256-75aa-4786-b589-e1a9f769a966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:09.856566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca3256-75aa-4786-b589-e1a9f769a966 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:09.862925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca3256-75aa-4786-b589-e1a9f769a966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:09.863436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca3256-75aa-4786-b589-e1a9f769a966 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:09.864462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca3256-75aa-4786-b589-e1a9f769a966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:09.866708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bca3256-75aa-4786-b589-e1a9f769a966 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:09.890274 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1461/2872] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:17:09.895246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca3256-75aa-4786-b589-e1a9f769a966 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:09.897678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-04e10c65-7497-4274-95f9-8e0c04888d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4eeca046a424f60adf3e218db1d1782', 'request_id': 'req-04e10c65-7497-4274-95f9-8e0c04888d0a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:09.912624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca3256-75aa-4786-b589-e1a9f769a966 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:09.962267 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:09.984450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-04e10c65-7497-4274-95f9-8e0c04888d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4eeca046a424f60adf3e218db1d1782', 'request_id': 'req-04e10c65-7497-4274-95f9-8e0c04888d0a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:09.984866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5631c7-2a93-4f0b-b17e-c11b9b000811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:09.985913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5631c7-2a93-4f0b-b17e-c11b9b000811 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:09.986685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5631c7-2a93-4f0b-b17e-c11b9b000811 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:09.986939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5631c7-2a93-4f0b-b17e-c11b9b000811 admin admin] PATH_INFO: `/v3/projects/e5ab60edd2504c27a189fd0c99d3c73a/users/399d58e8046f445887912cf19e4dd325/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:09.994050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-04e10c65-7497-4274-95f9-8e0c04888d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4eeca046a424f60adf3e218db1d1782', 'request_id': 'req-04e10c65-7497-4274-95f9-8e0c04888d0a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:10.006566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5631c7-2a93-4f0b-b17e-c11b9b000811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5ab60edd2504c27a189fd0c99d3c73a, user_id=399d58e8046f445887912cf19e4dd325, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:10.009472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5631c7-2a93-4f0b-b17e-c11b9b000811 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:10.020303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-04e10c65-7497-4274-95f9-8e0c04888d0a admin admin] The token cache is being invalidate because project b4eeca046a424f60adf3e218db1d1782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:17:10.021202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-04e10c65-7497-4274-95f9-8e0c04888d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:10.021328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-04e10c65-7497-4274-95f9-8e0c04888d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:10.027535 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1412/2873] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:17:09 2022] DELETE /identity/v3/projects/b4eeca046a424f60adf3e218db1d1782 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:17:10.033968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af422d-b5dd-42ab-b387-b72572b1c0f0 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:10.034285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af422d-b5dd-42ab-b387-b72572b1c0f0 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:10.034604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af422d-b5dd-42ab-b387-b72572b1c0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:10.076367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-83af422d-b5dd-42ab-b387-b72572b1c0f0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:10.083067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-83af422d-b5dd-42ab-b387-b72572b1c0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:10.101840 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1413/2874] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:10.106244 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1462/2875] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:17:09 2022] PUT /identity/v3/projects/e5ab60edd2504c27a189fd0c99d3c73a/users/399d58e8046f445887912cf19e4dd325/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:17:10.110071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e33ad5-a767-4d1f-8010-f21c15cc37f4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:10.112859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e33ad5-a767-4d1f-8010-f21c15cc37f4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:10.112859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e33ad5-a767-4d1f-8010-f21c15cc37f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:10.121364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb4ee5-3042-490a-9aed-92266bfb3595 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:10.122288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb4ee5-3042-490a-9aed-92266bfb3595 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:10.122862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb4ee5-3042-490a-9aed-92266bfb3595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:10.145417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-46e33ad5-a767-4d1f-8010-f21c15cc37f4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:10.146694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-46e33ad5-a767-4d1f-8010-f21c15cc37f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:10.201740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f8fb4ee5-3042-490a-9aed-92266bfb3595 None None] MFA Rules not processed for user `399d58e8046f445887912cf19e4dd325`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:10.203019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f8fb4ee5-3042-490a-9aed-92266bfb3595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:10.334075 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1414/2876] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:10.341936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e33ad5-a767-4d1f-8010-f21c15cc37f4 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:10.367695 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e33ad5-a767-4d1f-8010-f21c15cc37f4 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:10.373308 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1463/2877] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:17:10.389149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb4ee5-3042-490a-9aed-92266bfb3595 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:10.390510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2f5fb-adb8-4bf2-baf1-9cb8a1dcddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:10.391449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2f5fb-adb8-4bf2-baf1-9cb8a1dcddcb admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:10.391599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f8fb4ee5-3042-490a-9aed-92266bfb3595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:10.391733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2f5fb-adb8-4bf2-baf1-9cb8a1dcddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:10.392014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c2f5fb-adb8-4bf2-baf1-9cb8a1dcddcb admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:10.392950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2f5fb-adb8-4bf2-baf1-9cb8a1dcddcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:17:10.406894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2f5fb-adb8-4bf2-baf1-9cb8a1dcddcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:10.409152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c2f5fb-adb8-4bf2-baf1-9cb8a1dcddcb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:10.437904 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1415/2878] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:17:10.441222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2f5fb-adb8-4bf2-baf1-9cb8a1dcddcb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:10.463094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c2f5fb-adb8-4bf2-baf1-9cb8a1dcddcb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:10.477736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74945d3f-40a9-438f-9abf-b97eb1406bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:10.482602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74945d3f-40a9-438f-9abf-b97eb1406bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:10.482602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74945d3f-40a9-438f-9abf-b97eb1406bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:10.482602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74945d3f-40a9-438f-9abf-b97eb1406bf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:10.482602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74945d3f-40a9-438f-9abf-b97eb1406bf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:10.500499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74945d3f-40a9-438f-9abf-b97eb1406bf5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:10.584113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb4ee5-3042-490a-9aed-92266bfb3595 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:10.594743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16516d82-4b02-4b01-b508-0bf3eabd87f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:10.595747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16516d82-4b02-4b01-b508-0bf3eabd87f6 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:10.596214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16516d82-4b02-4b01-b508-0bf3eabd87f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:10.596652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16516d82-4b02-4b01-b508-0bf3eabd87f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:10.615733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16516d82-4b02-4b01-b508-0bf3eabd87f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:10.619586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16516d82-4b02-4b01-b508-0bf3eabd87f6 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:10.637314 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1416/2879] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:17:10 2022] POST /identity/v3/projects => generated 379 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:17:10.641480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74945d3f-40a9-438f-9abf-b97eb1406bf5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:10.644701 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1464/2880] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:17:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:17:10.762836 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:10.894259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74945d3f-40a9-438f-9abf-b97eb1406bf5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:10.910852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd3b6e-bf44-4594-91ed-f3cace98b4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:10.912447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd3b6e-bf44-4594-91ed-f3cace98b4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:10.912908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd3b6e-bf44-4594-91ed-f3cace98b4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:10.919085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd3b6e-bf44-4594-91ed-f3cace98b4a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:10.919085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd3b6e-bf44-4594-91ed-f3cace98b4a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:10.919085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd3b6e-bf44-4594-91ed-f3cace98b4a6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:11.076849 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1417/2881] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:17:10 2022] POST /identity/v3/users => generated 290 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:17:11.081160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16516d82-4b02-4b01-b508-0bf3eabd87f6 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:11.116406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16516d82-4b02-4b01-b508-0bf3eabd87f6 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:11.134073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8e8da-94e1-472e-8e6b-84af81c46dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:11.135937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8e8da-94e1-472e-8e6b-84af81c46dee admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:11.140110 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8e8da-94e1-472e-8e6b-84af81c46dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:11.140617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8e8da-94e1-472e-8e6b-84af81c46dee admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:11.144096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8e8da-94e1-472e-8e6b-84af81c46dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:11.146717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8e8da-94e1-472e-8e6b-84af81c46dee admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:11.166273 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1465/2882] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:17:11.171692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd3b6e-bf44-4594-91ed-f3cace98b4a6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:11.188096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd3b6e-bf44-4594-91ed-f3cace98b4a6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:11.199279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b62e39-1211-4486-a2d5-5d5bbe3dbaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:11.200341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b62e39-1211-4486-a2d5-5d5bbe3dbaf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:11.200717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b62e39-1211-4486-a2d5-5d5bbe3dbaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:11.201171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b62e39-1211-4486-a2d5-5d5bbe3dbaf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:11.202009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b62e39-1211-4486-a2d5-5d5bbe3dbaf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:11.228276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b62e39-1211-4486-a2d5-5d5bbe3dbaf9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:11.257163 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1418/2883] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:17:11.260600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8e8da-94e1-472e-8e6b-84af81c46dee admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:11.278179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8e8da-94e1-472e-8e6b-84af81c46dee admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:11.307528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597dbce0-36ed-4f73-8a75-d0007d531892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:11.311831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dbce0-36ed-4f73-8a75-d0007d531892 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:11.312546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dbce0-36ed-4f73-8a75-d0007d531892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:11.314313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dbce0-36ed-4f73-8a75-d0007d531892 admin admin] PATH_INFO: `/v3/projects/3acad82e999d4637b72809e0cdcdbf5d/users/abfd013793ab4acf910a57ba5ea1cff8/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:11.382560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597dbce0-36ed-4f73-8a75-d0007d531892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3acad82e999d4637b72809e0cdcdbf5d, user_id=abfd013793ab4acf910a57ba5ea1cff8, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:11.389366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597dbce0-36ed-4f73-8a75-d0007d531892 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:11.494987 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1466/2884] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:17:11 2022] PUT /identity/v3/projects/3acad82e999d4637b72809e0cdcdbf5d/users/abfd013793ab4acf910a57ba5ea1cff8/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:17:11.499881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cb770-ed9c-4aa1-9988-a297a9f18f24 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:11.499881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cb770-ed9c-4aa1-9988-a297a9f18f24 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:11.499881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cb770-ed9c-4aa1-9988-a297a9f18f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:11.542279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-547cb770-ed9c-4aa1-9988-a297a9f18f24 None None] MFA Rules not processed for user `abfd013793ab4acf910a57ba5ea1cff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:11.544311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-547cb770-ed9c-4aa1-9988-a297a9f18f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:11.616773 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:11.922804 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1419/2885] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:12.148118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597dbce0-36ed-4f73-8a75-d0007d531892 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:12.150592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-597dbce0-36ed-4f73-8a75-d0007d531892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:12.246720 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:12.403521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597dbce0-36ed-4f73-8a75-d0007d531892 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:12.417863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05edb5d1-4a9b-42ef-85dd-1855dac3aaa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:12.420650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edb5d1-4a9b-42ef-85dd-1855dac3aaa0 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:12.421064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edb5d1-4a9b-42ef-85dd-1855dac3aaa0 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:12.424050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05edb5d1-4a9b-42ef-85dd-1855dac3aaa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:12.451002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05edb5d1-4a9b-42ef-85dd-1855dac3aaa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:12.455090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05edb5d1-4a9b-42ef-85dd-1855dac3aaa0 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:12.485115 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1467/2886] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:17:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:17:12.941697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc889-da9f-4f32-9787-26ad43dabaa0 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:12.942304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc889-da9f-4f32-9787-26ad43dabaa0 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:12.942304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aefc889-da9f-4f32-9787-26ad43dabaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:13.011283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6aefc889-da9f-4f32-9787-26ad43dabaa0 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:13.016390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6aefc889-da9f-4f32-9787-26ad43dabaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:13.151630 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:13.210649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05edb5d1-4a9b-42ef-85dd-1855dac3aaa0 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:13.212472 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1420/2887] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:17:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:13.212825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-05edb5d1-4a9b-42ef-85dd-1855dac3aaa0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:13.525571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05edb5d1-4a9b-42ef-85dd-1855dac3aaa0 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:13.538693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace5ff49-1df6-44ed-9a1a-1a93f38a0a6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:13.539586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5ff49-1df6-44ed-9a1a-1a93f38a0a6c service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:13.540354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5ff49-1df6-44ed-9a1a-1a93f38a0a6c service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:13.541152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace5ff49-1df6-44ed-9a1a-1a93f38a0a6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:13.566128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5ff49-1df6-44ed-9a1a-1a93f38a0a6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:13.568096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace5ff49-1df6-44ed-9a1a-1a93f38a0a6c service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:13.584591 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1468/2888] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:17:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:17:13.798512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefc889-da9f-4f32-9787-26ad43dabaa0 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:13.800305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6aefc889-da9f-4f32-9787-26ad43dabaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:13.995372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aefc889-da9f-4f32-9787-26ad43dabaa0 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:14.015228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4a262-5bf3-46e4-b460-86052d5e1eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:14.016147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4a262-5bf3-46e4-b460-86052d5e1eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:14.016434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4a262-5bf3-46e4-b460-86052d5e1eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:14.016712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff4a262-5bf3-46e4-b460-86052d5e1eeb admin admin] PATH_INFO: `/v3/users/399d58e8046f445887912cf19e4dd325` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:14.018904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4a262-5bf3-46e4-b460-86052d5e1eeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=399d58e8046f445887912cf19e4dd325)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:14.026432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff4a262-5bf3-46e4-b460-86052d5e1eeb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:14.097814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40424c5b-b399-4251-9825-c41953ee108e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:14.098092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40424c5b-b399-4251-9825-c41953ee108e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:14.098768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40424c5b-b399-4251-9825-c41953ee108e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:14.147564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-40424c5b-b399-4251-9825-c41953ee108e None None] MFA Rules not processed for user `abfd013793ab4acf910a57ba5ea1cff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:14.148826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-40424c5b-b399-4251-9825-c41953ee108e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:14.175504 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1469/2889] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:14.347489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4ff4a262-5bf3-46e4-b460-86052d5e1eeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '399d58e8046f445887912cf19e4dd325'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:14.381131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4ff4a262-5bf3-46e4-b460-86052d5e1eeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '399d58e8046f445887912cf19e4dd325'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:14.382778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4ff4a262-5bf3-46e4-b460-86052d5e1eeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '399d58e8046f445887912cf19e4dd325'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:14.384359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4ff4a262-5bf3-46e4-b460-86052d5e1eeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '399d58e8046f445887912cf19e4dd325'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:14.401402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4ff4a262-5bf3-46e4-b460-86052d5e1eeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '399d58e8046f445887912cf19e4dd325'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:14.480903 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1421/2890] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:17:13 2022] DELETE /identity/v3/users/399d58e8046f445887912cf19e4dd325 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:17:14.484068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aeb251-f8fa-4d18-ad2d-0839d7aba1e6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:14.484533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aeb251-f8fa-4d18-ad2d-0839d7aba1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:14.484619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aeb251-f8fa-4d18-ad2d-0839d7aba1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:14.518614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-10aeb251-f8fa-4d18-ad2d-0839d7aba1e6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:14.522285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-10aeb251-f8fa-4d18-ad2d-0839d7aba1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:14.748771 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1470/2891] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:14.810893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4a262-5bf3-46e4-b460-86052d5e1eeb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:14.812347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4ff4a262-5bf3-46e4-b460-86052d5e1eeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:14.995692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff4a262-5bf3-46e4-b460-86052d5e1eeb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:15.003925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3975edb-957f-455d-877f-112bcceaea09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:15.005149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3975edb-957f-455d-877f-112bcceaea09 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:15.005343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3975edb-957f-455d-877f-112bcceaea09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:15.007322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3975edb-957f-455d-877f-112bcceaea09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:15.035957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3975edb-957f-455d-877f-112bcceaea09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:15.037436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3975edb-957f-455d-877f-112bcceaea09 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:15.059972 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1422/2892] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:17:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:17:15.308987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d77a8-b9f7-414a-a4f0-9a8918ae488e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:15.309504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d77a8-b9f7-414a-a4f0-9a8918ae488e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:15.309839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4d77a8-b9f7-414a-a4f0-9a8918ae488e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:15.361281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4f4d77a8-b9f7-414a-a4f0-9a8918ae488e None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:15.364967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4f4d77a8-b9f7-414a-a4f0-9a8918ae488e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:15.521271 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:15.586920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3975edb-957f-455d-877f-112bcceaea09 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:15.590478 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1471/2893] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:17:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:15.590864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b3975edb-957f-455d-877f-112bcceaea09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:15.606735 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:15.753641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3975edb-957f-455d-877f-112bcceaea09 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:15.763848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14a7ae-7e7a-42e9-91b1-b855c5e309ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:15.765096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14a7ae-7e7a-42e9-91b1-b855c5e309ad service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:15.766006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14a7ae-7e7a-42e9-91b1-b855c5e309ad service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:15.766791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14a7ae-7e7a-42e9-91b1-b855c5e309ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:15.791179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14a7ae-7e7a-42e9-91b1-b855c5e309ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:15.793511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14a7ae-7e7a-42e9-91b1-b855c5e309ad service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:15.830549 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1423/2894] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:17:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:17:16.202980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa1680-0d7d-42ec-a510-67d133004fcf None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:16.203741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa1680-0d7d-42ec-a510-67d133004fcf None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:16.204249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa1680-0d7d-42ec-a510-67d133004fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:16.219634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14a7ae-7e7a-42e9-91b1-b855c5e309ad service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:16.225966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3a14a7ae-7e7a-42e9-91b1-b855c5e309ad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:16.252406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14a7ae-7e7a-42e9-91b1-b855c5e309ad service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:16.263583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53732989-fea5-40b5-9b6a-1048cf2f7453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:16.265142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53732989-fea5-40b5-9b6a-1048cf2f7453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:16.265613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53732989-fea5-40b5-9b6a-1048cf2f7453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:16.266870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53732989-fea5-40b5-9b6a-1048cf2f7453 admin admin] PATH_INFO: `/v3/users/abfd013793ab4acf910a57ba5ea1cff8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:16.269434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53732989-fea5-40b5-9b6a-1048cf2f7453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abfd013793ab4acf910a57ba5ea1cff8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:16.272937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53732989-fea5-40b5-9b6a-1048cf2f7453 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:16.278285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-92fa1680-0d7d-42ec-a510-67d133004fcf None None] MFA Rules not processed for user `d3a1bc0c85b0488183eaebfe740614b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:16.279709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-92fa1680-0d7d-42ec-a510-67d133004fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:16.473539 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1472/2895] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:16.489499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa1680-0d7d-42ec-a510-67d133004fcf None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:16.491574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-92fa1680-0d7d-42ec-a510-67d133004fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:16.557873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-53732989-fea5-40b5-9b6a-1048cf2f7453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abfd013793ab4acf910a57ba5ea1cff8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:16.603921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-53732989-fea5-40b5-9b6a-1048cf2f7453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abfd013793ab4acf910a57ba5ea1cff8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:16.606957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-53732989-fea5-40b5-9b6a-1048cf2f7453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abfd013793ab4acf910a57ba5ea1cff8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:16.607739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-53732989-fea5-40b5-9b6a-1048cf2f7453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abfd013793ab4acf910a57ba5ea1cff8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:16.620840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-53732989-fea5-40b5-9b6a-1048cf2f7453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abfd013793ab4acf910a57ba5ea1cff8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:16.708681 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1424/2896] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:17:16 2022] DELETE /identity/v3/users/abfd013793ab4acf910a57ba5ea1cff8 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:17:16.716080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d2eb3-4a58-4083-a8eb-227727905a94 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:16.716080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d2eb3-4a58-4083-a8eb-227727905a94 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:16.716472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92d2eb3-4a58-4083-a8eb-227727905a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:16.737593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa1680-0d7d-42ec-a510-67d133004fcf None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:16.806665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a92d2eb3-4a58-4083-a8eb-227727905a94 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:16.810155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a92d2eb3-4a58-4083-a8eb-227727905a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:16.951443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97131cfa-18a3-475e-934b-8d9cd83ffa7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:16.952217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97131cfa-18a3-475e-934b-8d9cd83ffa7f service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:16.952577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97131cfa-18a3-475e-934b-8d9cd83ffa7f service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:16.952925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97131cfa-18a3-475e-934b-8d9cd83ffa7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:16.962228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-97131cfa-18a3-475e-934b-8d9cd83ffa7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:16.995663 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:17.034556 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1425/2897] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:17:17.058488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d2eb3-4a58-4083-a8eb-227727905a94 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:17.060262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a92d2eb3-4a58-4083-a8eb-227727905a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:17.094204 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:17.094951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97131cfa-18a3-475e-934b-8d9cd83ffa7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:17.097698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97131cfa-18a3-475e-934b-8d9cd83ffa7f service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:17.119341 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1473/2898] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:17:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:17:17.122237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97131cfa-18a3-475e-934b-8d9cd83ffa7f service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:17.123711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-97131cfa-18a3-475e-934b-8d9cd83ffa7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:17.154736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97131cfa-18a3-475e-934b-8d9cd83ffa7f service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:17.170710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e225e-4608-4dd4-950b-0b214f92bce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:17.171726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e225e-4608-4dd4-950b-0b214f92bce0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:17.172175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e225e-4608-4dd4-950b-0b214f92bce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:17.172526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e225e-4608-4dd4-950b-0b214f92bce0 admin admin] PATH_INFO: `/v3/projects/e5ab60edd2504c27a189fd0c99d3c73a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:17.174019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e225e-4608-4dd4-950b-0b214f92bce0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5ab60edd2504c27a189fd0c99d3c73a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:17.176328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e225e-4608-4dd4-950b-0b214f92bce0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:17.307105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92d2eb3-4a58-4083-a8eb-227727905a94 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:17.328185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b06898-14b0-4828-9503-290ffe2e41d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:17.333387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b06898-14b0-4828-9503-290ffe2e41d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:17.333387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b06898-14b0-4828-9503-290ffe2e41d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:17.333387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b06898-14b0-4828-9503-290ffe2e41d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:17.351137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b06898-14b0-4828-9503-290ffe2e41d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:17.364321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b06898-14b0-4828-9503-290ffe2e41d7 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:17.387170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-901e225e-4608-4dd4-950b-0b214f92bce0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5ab60edd2504c27a189fd0c99d3c73a', 'request_id': 'req-901e225e-4608-4dd4-950b-0b214f92bce0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:17.392941 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1426/2899] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:17:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:17:17.407384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-901e225e-4608-4dd4-950b-0b214f92bce0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5ab60edd2504c27a189fd0c99d3c73a', 'request_id': 'req-901e225e-4608-4dd4-950b-0b214f92bce0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:17.435011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-901e225e-4608-4dd4-950b-0b214f92bce0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5ab60edd2504c27a189fd0c99d3c73a', 'request_id': 'req-901e225e-4608-4dd4-950b-0b214f92bce0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:17.523739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-901e225e-4608-4dd4-950b-0b214f92bce0 admin admin] The token cache is being invalidate because project e5ab60edd2504c27a189fd0c99d3c73a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:17:17.524278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-901e225e-4608-4dd4-950b-0b214f92bce0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:17.530643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-901e225e-4608-4dd4-950b-0b214f92bce0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:17.533384 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1474/2900] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:17:17 2022] DELETE /identity/v3/projects/e5ab60edd2504c27a189fd0c99d3c73a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:17:17.540385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5f653-5b0c-434c-a847-7ffaefc80e44 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:17.540775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5f653-5b0c-434c-a847-7ffaefc80e44 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:17.541232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5f653-5b0c-434c-a847-7ffaefc80e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:17.600730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5ba5f653-5b0c-434c-a847-7ffaefc80e44 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:17.605697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5ba5f653-5b0c-434c-a847-7ffaefc80e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:17.805186 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1427/2901] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:17.812892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cd508-5a50-4fde-a0ff-af78657d13d9 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:17.813320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cd508-5a50-4fde-a0ff-af78657d13d9 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:17.813455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cd508-5a50-4fde-a0ff-af78657d13d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:17.851676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7c5cd508-5a50-4fde-a0ff-af78657d13d9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:17.852929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7c5cd508-5a50-4fde-a0ff-af78657d13d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:17.884237 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1475/2902] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:17.888556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5f653-5b0c-434c-a847-7ffaefc80e44 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:17.906506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5f653-5b0c-434c-a847-7ffaefc80e44 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:17.927123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80b402-9cb8-4161-9ba6-271b3fe59d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:17.927907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80b402-9cb8-4161-9ba6-271b3fe59d75 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:17.928267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80b402-9cb8-4161-9ba6-271b3fe59d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:17.928658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae80b402-9cb8-4161-9ba6-271b3fe59d75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:17.929586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80b402-9cb8-4161-9ba6-271b3fe59d75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:17:17.930002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80b402-9cb8-4161-9ba6-271b3fe59d75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:17.931760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae80b402-9cb8-4161-9ba6-271b3fe59d75 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:17.971939 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1428/2903] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:17:17.976317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cd508-5a50-4fde-a0ff-af78657d13d9 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:17.988354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cd508-5a50-4fde-a0ff-af78657d13d9 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:18.024675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e394fd7-bdca-4578-b529-96508833ff4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:18.025487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e394fd7-bdca-4578-b529-96508833ff4c admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:18.027853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e394fd7-bdca-4578-b529-96508833ff4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:18.034546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e394fd7-bdca-4578-b529-96508833ff4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:18.035602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e394fd7-bdca-4578-b529-96508833ff4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:18.038195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e394fd7-bdca-4578-b529-96508833ff4c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:18.254298 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1476/2904] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:17:17 2022] POST /identity/v3/projects => generated 397 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:17:18.256399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80b402-9cb8-4161-9ba6-271b3fe59d75 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:18.273435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae80b402-9cb8-4161-9ba6-271b3fe59d75 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:18.452648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7390af-48cc-4bb2-aed7-b8c127422dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:18.460618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7390af-48cc-4bb2-aed7-b8c127422dee admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:18.460618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7390af-48cc-4bb2-aed7-b8c127422dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:18.460618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7390af-48cc-4bb2-aed7-b8c127422dee admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:18.460618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7390af-48cc-4bb2-aed7-b8c127422dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:18.460618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7390af-48cc-4bb2-aed7-b8c127422dee admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:18.591685 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1429/2905] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:17:18 2022] POST /identity/v3/users => generated 299 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:17:18.596219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e394fd7-bdca-4578-b529-96508833ff4c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:18.620960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e394fd7-bdca-4578-b529-96508833ff4c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:18.626985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e84197-1867-4f81-9955-a9ec5642afd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:18.627891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84197-1867-4f81-9955-a9ec5642afd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:18.628529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84197-1867-4f81-9955-a9ec5642afd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:18.628529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e84197-1867-4f81-9955-a9ec5642afd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:18.629279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e84197-1867-4f81-9955-a9ec5642afd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:18.630937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e84197-1867-4f81-9955-a9ec5642afd7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:18.654025 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1477/2906] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:17:18.657170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7390af-48cc-4bb2-aed7-b8c127422dee admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:18.677312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7390af-48cc-4bb2-aed7-b8c127422dee admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:18.693499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cd752-b1cd-4dcc-9f0a-61420cba0ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:18.694238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cd752-b1cd-4dcc-9f0a-61420cba0ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:18.694523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cd752-b1cd-4dcc-9f0a-61420cba0ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:18.695089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cd752-b1cd-4dcc-9f0a-61420cba0ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:18.696036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cd752-b1cd-4dcc-9f0a-61420cba0ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:18.697855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cd752-b1cd-4dcc-9f0a-61420cba0ac1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:18.719368 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1430/2907] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:17:18.721490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e84197-1867-4f81-9955-a9ec5642afd7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:18.737853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e84197-1867-4f81-9955-a9ec5642afd7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:18.758946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394f750-f610-4c88-a088-ab1bb6e99a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:18.758946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394f750-f610-4c88-a088-ab1bb6e99a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:18.758946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394f750-f610-4c88-a088-ab1bb6e99a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:18.758946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394f750-f610-4c88-a088-ab1bb6e99a14 admin admin] PATH_INFO: `/v3/projects/63cf02d9f25e4f1b81f2d87d2ab59439/users/321cdc930d674a948e8a018e767132e4/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:18.799490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394f750-f610-4c88-a088-ab1bb6e99a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cf02d9f25e4f1b81f2d87d2ab59439, user_id=321cdc930d674a948e8a018e767132e4, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:18.799490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f394f750-f610-4c88-a088-ab1bb6e99a14 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:18.859292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cd752-b1cd-4dcc-9f0a-61420cba0ac1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:18.864557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-660cd752-b1cd-4dcc-9f0a-61420cba0ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:18.884507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cd752-b1cd-4dcc-9f0a-61420cba0ac1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:18.904185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512479c-d5a9-4b4a-839f-4a4646119166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:18.905092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512479c-d5a9-4b4a-839f-4a4646119166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:18.905562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512479c-d5a9-4b4a-839f-4a4646119166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:18.906019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2512479c-d5a9-4b4a-839f-4a4646119166 admin admin] PATH_INFO: `/v3/users/5c0882e092c644758966c19d52d86795` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:18.907303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512479c-d5a9-4b4a-839f-4a4646119166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c0882e092c644758966c19d52d86795)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:18.909494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2512479c-d5a9-4b4a-839f-4a4646119166 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:18.945612 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:18.962848 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1478/2908] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:17:18 2022] PUT /identity/v3/projects/63cf02d9f25e4f1b81f2d87d2ab59439/users/321cdc930d674a948e8a018e767132e4/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:17:18.975586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78dea5-4374-4387-b0a7-7cca7814da07 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:18.975877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78dea5-4374-4387-b0a7-7cca7814da07 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:18.976158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78dea5-4374-4387-b0a7-7cca7814da07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:19.024699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1d78dea5-4374-4387-b0a7-7cca7814da07 None None] MFA Rules not processed for user `321cdc930d674a948e8a018e767132e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:19.025923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1d78dea5-4374-4387-b0a7-7cca7814da07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:19.057656 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:19.220910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2512479c-d5a9-4b4a-839f-4a4646119166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c0882e092c644758966c19d52d86795'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:19.238607 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1479/2909] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:19.240256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c2cd9-f38a-4bc0-8b86-c7c6e09978b1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:19.240844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c2cd9-f38a-4bc0-8b86-c7c6e09978b1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:19.241275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c2cd9-f38a-4bc0-8b86-c7c6e09978b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:19.272436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2512479c-d5a9-4b4a-839f-4a4646119166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c0882e092c644758966c19d52d86795'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:19.274893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2512479c-d5a9-4b4a-839f-4a4646119166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c0882e092c644758966c19d52d86795'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:19.285652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2512479c-d5a9-4b4a-839f-4a4646119166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c0882e092c644758966c19d52d86795'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:19.325597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2512479c-d5a9-4b4a-839f-4a4646119166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c0882e092c644758966c19d52d86795'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:19.335234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-793c2cd9-f38a-4bc0-8b86-c7c6e09978b1 None None] MFA Rules not processed for user `d3a1bc0c85b0488183eaebfe740614b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:19.343049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-793c2cd9-f38a-4bc0-8b86-c7c6e09978b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:19.443034 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1480/2910] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:19.444145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c2cd9-f38a-4bc0-8b86-c7c6e09978b1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:19.458747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-793c2cd9-f38a-4bc0-8b86-c7c6e09978b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:19.514177 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1431/2911] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:17:18 2022] DELETE /identity/v3/users/5c0882e092c644758966c19d52d86795 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:17:19.520341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512479c-d5a9-4b4a-839f-4a4646119166 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:19.520341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2512479c-d5a9-4b4a-839f-4a4646119166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:19.658475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c2cd9-f38a-4bc0-8b86-c7c6e09978b1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:19.741838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6410af1-3b62-4327-9987-b02772a9c174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:19.743999 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6410af1-3b62-4327-9987-b02772a9c174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:19.745093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6410af1-3b62-4327-9987-b02772a9c174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:19.745537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6410af1-3b62-4327-9987-b02772a9c174 admin admin] PATH_INFO: `/v3/projects/3acad82e999d4637b72809e0cdcdbf5d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:19.747715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6410af1-3b62-4327-9987-b02772a9c174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3acad82e999d4637b72809e0cdcdbf5d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:19.750077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6410af1-3b62-4327-9987-b02772a9c174 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:19.848802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2512479c-d5a9-4b4a-839f-4a4646119166 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:19.863508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4200d2-d4d5-4820-98be-bf133a4c0c58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:19.864192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4200d2-d4d5-4820-98be-bf133a4c0c58 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:19.864506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4200d2-d4d5-4820-98be-bf133a4c0c58 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:19.864749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4200d2-d4d5-4820-98be-bf133a4c0c58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:19.869070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bf4200d2-d4d5-4820-98be-bf133a4c0c58 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:19.889541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f6410af1-3b62-4327-9987-b02772a9c174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3acad82e999d4637b72809e0cdcdbf5d', 'request_id': 'req-f6410af1-3b62-4327-9987-b02772a9c174'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:19.897668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f6410af1-3b62-4327-9987-b02772a9c174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3acad82e999d4637b72809e0cdcdbf5d', 'request_id': 'req-f6410af1-3b62-4327-9987-b02772a9c174'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:19.925569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f6410af1-3b62-4327-9987-b02772a9c174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3acad82e999d4637b72809e0cdcdbf5d', 'request_id': 'req-f6410af1-3b62-4327-9987-b02772a9c174'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:20.020222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4200d2-d4d5-4820-98be-bf133a4c0c58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:20.022063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4200d2-d4d5-4820-98be-bf133a4c0c58 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:20.038805 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1432/2912] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:17:19 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:17:20.100842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f6410af1-3b62-4327-9987-b02772a9c174 admin admin] The token cache is being invalidate because project 3acad82e999d4637b72809e0cdcdbf5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:17:20.101831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f6410af1-3b62-4327-9987-b02772a9c174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:20.102864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f6410af1-3b62-4327-9987-b02772a9c174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:20.103041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30eb73-4fdc-42a7-ba54-529d0c01f645 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:20.103340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30eb73-4fdc-42a7-ba54-529d0c01f645 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:20.103700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d30eb73-4fdc-42a7-ba54-529d0c01f645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:20.107889 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1481/2913] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:17:19 2022] DELETE /identity/v3/projects/3acad82e999d4637b72809e0cdcdbf5d => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:17:20.115684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba315906-0fb6-4b49-8f07-a24aea611095 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:20.116121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba315906-0fb6-4b49-8f07-a24aea611095 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:20.116410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba315906-0fb6-4b49-8f07-a24aea611095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:20.141182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6d30eb73-4fdc-42a7-ba54-529d0c01f645 None None] MFA Rules not processed for user `321cdc930d674a948e8a018e767132e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:20.142947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6d30eb73-4fdc-42a7-ba54-529d0c01f645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:20.151803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ba315906-0fb6-4b49-8f07-a24aea611095 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:20.153097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ba315906-0fb6-4b49-8f07-a24aea611095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:20.280263 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1433/2914] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:17:20.285973 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1482/2915] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:20.296181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f198d-c148-401b-a191-2a75926cb6cd None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:20.300419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f198d-c148-401b-a191-2a75926cb6cd None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:20.300419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f198d-c148-401b-a191-2a75926cb6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:20.325999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-925f198d-c148-401b-a191-2a75926cb6cd None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:20.328021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-925f198d-c148-401b-a191-2a75926cb6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:20.341476 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1434/2916] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:20.346540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba315906-0fb6-4b49-8f07-a24aea611095 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:20.367850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba315906-0fb6-4b49-8f07-a24aea611095 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:20.375647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb0874-b610-402f-93df-0daa87f417b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:20.389783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb0874-b610-402f-93df-0daa87f417b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:20.389783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb0874-b610-402f-93df-0daa87f417b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:20.389783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb0874-b610-402f-93df-0daa87f417b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:20.389783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb0874-b610-402f-93df-0daa87f417b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:17:20.389783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb0874-b610-402f-93df-0daa87f417b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:20.389783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb0874-b610-402f-93df-0daa87f417b0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:20.415636 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1483/2917] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:17:20.420514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f198d-c148-401b-a191-2a75926cb6cd None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:20.433391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f198d-c148-401b-a191-2a75926cb6cd None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:20.449917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5475ab-ddb3-46b3-9f91-d7198f00e1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:20.450979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5475ab-ddb3-46b3-9f91-d7198f00e1fa admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:20.451436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5475ab-ddb3-46b3-9f91-d7198f00e1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:20.451669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5475ab-ddb3-46b3-9f91-d7198f00e1fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:20.452570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5475ab-ddb3-46b3-9f91-d7198f00e1fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:20.462040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5475ab-ddb3-46b3-9f91-d7198f00e1fa admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:20.652486 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1435/2918] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:17:20 2022] POST /identity/v3/projects => generated 373 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:17:20.656680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb0874-b610-402f-93df-0daa87f417b0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:20.677825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb0874-b610-402f-93df-0daa87f417b0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:20.718050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5475ab-ddb3-46b3-9f91-d7198f00e1fa admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:20.721376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eb5475ab-ddb3-46b3-9f91-d7198f00e1fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:20.788137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca967e-9584-425e-ba5e-cf50eb0ecf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:20.789291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca967e-9584-425e-ba5e-cf50eb0ecf74 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:20.790157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca967e-9584-425e-ba5e-cf50eb0ecf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:20.790698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca967e-9584-425e-ba5e-cf50eb0ecf74 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:20.791729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca967e-9584-425e-ba5e-cf50eb0ecf74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:20.794203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca967e-9584-425e-ba5e-cf50eb0ecf74 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:20.863465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5475ab-ddb3-46b3-9f91-d7198f00e1fa admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:20.872858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4442d1-3ae6-458c-a62b-2ddb51d63f34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:20.873847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4442d1-3ae6-458c-a62b-2ddb51d63f34 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:20.874566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4442d1-3ae6-458c-a62b-2ddb51d63f34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:20.875046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4442d1-3ae6-458c-a62b-2ddb51d63f34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:20.878083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1e4442d1-3ae6-458c-a62b-2ddb51d63f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:20.897022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4442d1-3ae6-458c-a62b-2ddb51d63f34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:20.898835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4442d1-3ae6-458c-a62b-2ddb51d63f34 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:20.919758 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:20.927544 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1436/2919] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:17:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:17:20.929841 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1484/2920] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:17:20 2022] POST /identity/v3/users => generated 287 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:17:20.930991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4442d1-3ae6-458c-a62b-2ddb51d63f34 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:20.934333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1e4442d1-3ae6-458c-a62b-2ddb51d63f34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:20.935827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca967e-9584-425e-ba5e-cf50eb0ecf74 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:20.949620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca967e-9584-425e-ba5e-cf50eb0ecf74 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:20.956259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed99c6-5bc1-45c8-88fc-d40c48c7fa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:20.972432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed99c6-5bc1-45c8-88fc-d40c48c7fa68 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:20.972432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed99c6-5bc1-45c8-88fc-d40c48c7fa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:20.972432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed99c6-5bc1-45c8-88fc-d40c48c7fa68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:20.972432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed99c6-5bc1-45c8-88fc-d40c48c7fa68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:20.972432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed99c6-5bc1-45c8-88fc-d40c48c7fa68 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:20.972958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4442d1-3ae6-458c-a62b-2ddb51d63f34 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:20.984917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e00ce-04d1-4d9c-811f-c752ef41a7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:20.986830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e00ce-04d1-4d9c-811f-c752ef41a7f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:20.987287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e00ce-04d1-4d9c-811f-c752ef41a7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:20.987729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e00ce-04d1-4d9c-811f-c752ef41a7f0 admin admin] PATH_INFO: `/v3/projects/753af14218bd47c39874eaef6c42d25d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:20.988768 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1485/2921] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:17:20.989724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e00ce-04d1-4d9c-811f-c752ef41a7f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=753af14218bd47c39874eaef6c42d25d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:20.991699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08e00ce-04d1-4d9c-811f-c752ef41a7f0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:20.991924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed99c6-5bc1-45c8-88fc-d40c48c7fa68 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:21.018708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed99c6-5bc1-45c8-88fc-d40c48c7fa68 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:21.032158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910cdee-fba0-4554-9933-865ee904c0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:21.033950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910cdee-fba0-4554-9933-865ee904c0fe admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:21.034531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910cdee-fba0-4554-9933-865ee904c0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:21.035197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910cdee-fba0-4554-9933-865ee904c0fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:21.036549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910cdee-fba0-4554-9933-865ee904c0fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:21.039779 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:21.040296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910cdee-fba0-4554-9933-865ee904c0fe admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:21.061941 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1486/2922] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:17:21.067108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910cdee-fba0-4554-9933-865ee904c0fe admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:21.089797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910cdee-fba0-4554-9933-865ee904c0fe admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:21.098931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcf3e1-401b-4426-a9c9-eeeb467aac45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:21.100049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcf3e1-401b-4426-a9c9-eeeb467aac45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:21.100929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcf3e1-401b-4426-a9c9-eeeb467aac45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:21.101485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dcf3e1-401b-4426-a9c9-eeeb467aac45 admin admin] PATH_INFO: `/v3/projects/b5d834f874ce42149411f1ab6c61f798/users/744a25fb94b94384b064ed10c3bd9374/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:21.125571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dcf3e1-401b-4426-a9c9-eeeb467aac45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d834f874ce42149411f1ab6c61f798, user_id=744a25fb94b94384b064ed10c3bd9374, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:21.130962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dcf3e1-401b-4426-a9c9-eeeb467aac45 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:21.326651 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1487/2923] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:17:21 2022] PUT /identity/v3/projects/b5d834f874ce42149411f1ab6c61f798/users/744a25fb94b94384b064ed10c3bd9374/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:17:21.328468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcf3e1-401b-4426-a9c9-eeeb467aac45 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:21.330997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-19dcf3e1-401b-4426-a9c9-eeeb467aac45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:21.358477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e08e00ce-04d1-4d9c-811f-c752ef41a7f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '753af14218bd47c39874eaef6c42d25d', 'request_id': 'req-e08e00ce-04d1-4d9c-811f-c752ef41a7f0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:21.421824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dcf3e1-401b-4426-a9c9-eeeb467aac45 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:21.489179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033622f3-4a05-4649-9a92-621b1c0c6b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:21.490066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033622f3-4a05-4649-9a92-621b1c0c6b88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:21.490403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033622f3-4a05-4649-9a92-621b1c0c6b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:21.490685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033622f3-4a05-4649-9a92-621b1c0c6b88 admin admin] PATH_INFO: `/v3/users/321cdc930d674a948e8a018e767132e4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:21.493681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033622f3-4a05-4649-9a92-621b1c0c6b88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=321cdc930d674a948e8a018e767132e4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:21.495687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033622f3-4a05-4649-9a92-621b1c0c6b88 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:21.498341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e08e00ce-04d1-4d9c-811f-c752ef41a7f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '753af14218bd47c39874eaef6c42d25d', 'request_id': 'req-e08e00ce-04d1-4d9c-811f-c752ef41a7f0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:21.508360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e08e00ce-04d1-4d9c-811f-c752ef41a7f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '753af14218bd47c39874eaef6c42d25d', 'request_id': 'req-e08e00ce-04d1-4d9c-811f-c752ef41a7f0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:21.527494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e08e00ce-04d1-4d9c-811f-c752ef41a7f0 admin admin] The token cache is being invalidate because project 753af14218bd47c39874eaef6c42d25d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:17:21.527791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e08e00ce-04d1-4d9c-811f-c752ef41a7f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:21.533475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e08e00ce-04d1-4d9c-811f-c752ef41a7f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:21.535196 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1437/2924] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:17:20 2022] DELETE /identity/v3/projects/753af14218bd47c39874eaef6c42d25d => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:17:21.536788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3069fcf-6325-484e-b9da-6c46b8b4d947 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:21.537287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3069fcf-6325-484e-b9da-6c46b8b4d947 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:21.537567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3069fcf-6325-484e-b9da-6c46b8b4d947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:21.576215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f3069fcf-6325-484e-b9da-6c46b8b4d947 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:21.579678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f3069fcf-6325-484e-b9da-6c46b8b4d947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:21.599799 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1438/2925] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:21.602250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f9563-70cd-4576-996e-cdf127665a1f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:21.602556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f9563-70cd-4576-996e-cdf127665a1f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:21.602839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f9563-70cd-4576-996e-cdf127665a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:21.635033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-286f9563-70cd-4576-996e-cdf127665a1f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:21.636422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-286f9563-70cd-4576-996e-cdf127665a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:21.650272 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1439/2926] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:21.657322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc2d72-3eed-4c26-918d-80d2ecc7a04f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:21.658641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc2d72-3eed-4c26-918d-80d2ecc7a04f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:21.658641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc2d72-3eed-4c26-918d-80d2ecc7a04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:21.703028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-efcc2d72-3eed-4c26-918d-80d2ecc7a04f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:21.704246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-efcc2d72-3eed-4c26-918d-80d2ecc7a04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:21.731862 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1440/2927] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:17:21.733765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-033622f3-4a05-4649-9a92-621b1c0c6b88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '321cdc930d674a948e8a018e767132e4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:21.736335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc2d72-3eed-4c26-918d-80d2ecc7a04f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:21.741030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-efcc2d72-3eed-4c26-918d-80d2ecc7a04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:21.765053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-033622f3-4a05-4649-9a92-621b1c0c6b88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '321cdc930d674a948e8a018e767132e4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:21.775181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-033622f3-4a05-4649-9a92-621b1c0c6b88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '321cdc930d674a948e8a018e767132e4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:21.779259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-033622f3-4a05-4649-9a92-621b1c0c6b88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '321cdc930d674a948e8a018e767132e4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:21.813617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc2d72-3eed-4c26-918d-80d2ecc7a04f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:21.818429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecfbad-9207-4d7e-9dd1-e85a5c285f60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:21.819504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecfbad-9207-4d7e-9dd1-e85a5c285f60 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:21.819859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecfbad-9207-4d7e-9dd1-e85a5c285f60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:21.820139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ecfbad-9207-4d7e-9dd1-e85a5c285f60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:21.846561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecfbad-9207-4d7e-9dd1-e85a5c285f60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:21.848276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ecfbad-9207-4d7e-9dd1-e85a5c285f60 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:21.870333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-033622f3-4a05-4649-9a92-621b1c0c6b88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '321cdc930d674a948e8a018e767132e4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:21.871726 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:21.874425 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1441/2928] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:17:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:17:21.875400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecfbad-9207-4d7e-9dd1-e85a5c285f60 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:21.879270 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1488/2929] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:17:21 2022] DELETE /identity/v3/users/321cdc930d674a948e8a018e767132e4 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:17:21.883714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95286fea-be82-487c-8a6b-65ce4772ce4b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:21.884001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95286fea-be82-487c-8a6b-65ce4772ce4b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:21.884279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95286fea-be82-487c-8a6b-65ce4772ce4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:21.887869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ecfbad-9207-4d7e-9dd1-e85a5c285f60 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:21.931217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-95286fea-be82-487c-8a6b-65ce4772ce4b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:21.932495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-95286fea-be82-487c-8a6b-65ce4772ce4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:22.004148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b226d9-905d-4fbb-9859-e8bd35547775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:22.005094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b226d9-905d-4fbb-9859-e8bd35547775 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:22.010014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b226d9-905d-4fbb-9859-e8bd35547775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:22.010014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b226d9-905d-4fbb-9859-e8bd35547775 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:22.010014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b226d9-905d-4fbb-9859-e8bd35547775 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:17:22.010014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b226d9-905d-4fbb-9859-e8bd35547775 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:22.010014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b226d9-905d-4fbb-9859-e8bd35547775 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:22.047367 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1489/2930] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:17:22.053164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f462b79-b3ef-49c0-9646-42d92be66c2c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:22.053164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f462b79-b3ef-49c0-9646-42d92be66c2c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:22.053164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f462b79-b3ef-49c0-9646-42d92be66c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:22.055582 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1442/2931] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:17:22.057570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b226d9-905d-4fbb-9859-e8bd35547775 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:22.059517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e2b226d9-905d-4fbb-9859-e8bd35547775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:22.089811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b226d9-905d-4fbb-9859-e8bd35547775 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:22.101555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb938091-631f-4d6f-ac9b-c2e1fb4ca114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:22.102902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb938091-631f-4d6f-ac9b-c2e1fb4ca114 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:22.104822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb938091-631f-4d6f-ac9b-c2e1fb4ca114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:22.105465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb938091-631f-4d6f-ac9b-c2e1fb4ca114 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:22.108075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb938091-631f-4d6f-ac9b-c2e1fb4ca114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:22.110015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb938091-631f-4d6f-ac9b-c2e1fb4ca114 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:22.115895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2f462b79-b3ef-49c0-9646-42d92be66c2c None None] MFA Rules not processed for user `865ff993f6a440d4a25b34daed8cd6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:22.117292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2f462b79-b3ef-49c0-9646-42d92be66c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:22.235288 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1490/2932] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:22.237185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f462b79-b3ef-49c0-9646-42d92be66c2c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:22.241017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2f462b79-b3ef-49c0-9646-42d92be66c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:22.283111 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1443/2933] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:17:22 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:17:22.284783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb938091-631f-4d6f-ac9b-c2e1fb4ca114 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:22.506639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f462b79-b3ef-49c0-9646-42d92be66c2c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:22.520236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb938091-631f-4d6f-ac9b-c2e1fb4ca114 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:22.533442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd13d87-0a85-4398-95a2-0f20c43fa1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:22.534837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd13d87-0a85-4398-95a2-0f20c43fa1cf admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:22.535574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd13d87-0a85-4398-95a2-0f20c43fa1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:22.536210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd13d87-0a85-4398-95a2-0f20c43fa1cf admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:22.537423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd13d87-0a85-4398-95a2-0f20c43fa1cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:22.539585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd13d87-0a85-4398-95a2-0f20c43fa1cf admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:22.634971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3e40a-dc78-4731-886a-1a1574ad454d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:22.636832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3e40a-dc78-4731-886a-1a1574ad454d service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:22.637290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3e40a-dc78-4731-886a-1a1574ad454d service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:22.637762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3e40a-dc78-4731-886a-1a1574ad454d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:22.658916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3e40a-dc78-4731-886a-1a1574ad454d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:22.663391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3e40a-dc78-4731-886a-1a1574ad454d service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:22.691816 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1444/2934] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:17:22 2022] POST /identity/v3/users => generated 291 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:17:22.713964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd13d87-0a85-4398-95a2-0f20c43fa1cf admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:22.721897 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1491/2935] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:17:22.755088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd13d87-0a85-4398-95a2-0f20c43fa1cf admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:22.771144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0641940-2653-4519-acf1-9f2aba3d60e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:22.772031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0641940-2653-4519-acf1-9f2aba3d60e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:22.776695 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0641940-2653-4519-acf1-9f2aba3d60e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:22.777143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0641940-2653-4519-acf1-9f2aba3d60e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:22.778557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0641940-2653-4519-acf1-9f2aba3d60e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:22.782215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0641940-2653-4519-acf1-9f2aba3d60e9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:22.797592 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1445/2936] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:17:22.801909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3e40a-dc78-4731-886a-1a1574ad454d service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:22.816723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3e40a-dc78-4731-886a-1a1574ad454d service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:22.824477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb9d06f-751b-4a2b-851b-b5a84face2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:22.824477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9d06f-751b-4a2b-851b-b5a84face2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:22.825303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9d06f-751b-4a2b-851b-b5a84face2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:22.825746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb9d06f-751b-4a2b-851b-b5a84face2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:22.827233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9d06f-751b-4a2b-851b-b5a84face2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:22.829832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb9d06f-751b-4a2b-851b-b5a84face2c1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:22.846967 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1492/2937] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:17:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:17:22.851532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0641940-2653-4519-acf1-9f2aba3d60e9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:22.867203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0641940-2653-4519-acf1-9f2aba3d60e9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:22.876099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389f84ee-573a-4468-817a-833e930872e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:22.877633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f84ee-573a-4468-817a-833e930872e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:22.877923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f84ee-573a-4468-817a-833e930872e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:22.878408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389f84ee-573a-4468-817a-833e930872e2 admin admin] PATH_INFO: `/v3/projects/ac7824c076524766acc485dd7861b750/users/e9d5d298d929453ab353349d0f8ce5b3/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:22.900165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f84ee-573a-4468-817a-833e930872e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac7824c076524766acc485dd7861b750, user_id=e9d5d298d929453ab353349d0f8ce5b3, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:22.902860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389f84ee-573a-4468-817a-833e930872e2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:23.080222 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:23.086330 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1446/2938] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:17:22 2022] PUT /identity/v3/projects/ac7824c076524766acc485dd7861b750/users/e9d5d298d929453ab353349d0f8ce5b3/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:17:23.099727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3d39c-849d-4610-b8fd-123ea0001643 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:23.101401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3d39c-849d-4610-b8fd-123ea0001643 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:23.101674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3d39c-849d-4610-b8fd-123ea0001643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:23.134345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8bd3d39c-849d-4610-b8fd-123ea0001643 None None] MFA Rules not processed for user `e9d5d298d929453ab353349d0f8ce5b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:23.135572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8bd3d39c-849d-4610-b8fd-123ea0001643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:23.232390 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1493/2939] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:23.247578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf23a52-e6b6-4bc6-9031-840026375131 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:23.248251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf23a52-e6b6-4bc6-9031-840026375131 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:23.248544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf23a52-e6b6-4bc6-9031-840026375131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:23.319294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8bf23a52-e6b6-4bc6-9031-840026375131 None None] MFA Rules not processed for user `e9d5d298d929453ab353349d0f8ce5b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:23.320725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8bf23a52-e6b6-4bc6-9031-840026375131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:23.345562 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1447/2940] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:23.365809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3d39c-849d-4610-b8fd-123ea0001643 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:23.367489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8bd3d39c-849d-4610-b8fd-123ea0001643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:23.552271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3d39c-849d-4610-b8fd-123ea0001643 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:23.563044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44574e6b-9b44-423a-bd4b-88f3353120bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:23.564060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44574e6b-9b44-423a-bd4b-88f3353120bd service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:23.564493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44574e6b-9b44-423a-bd4b-88f3353120bd service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:23.567160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44574e6b-9b44-423a-bd4b-88f3353120bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:23.605144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44574e6b-9b44-423a-bd4b-88f3353120bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:23.606962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44574e6b-9b44-423a-bd4b-88f3353120bd service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:23.645300 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1494/2941] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:17:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:17:24.092505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf23a52-e6b6-4bc6-9031-840026375131 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:24.096856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8bf23a52-e6b6-4bc6-9031-840026375131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:24.106735 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:24.276525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf23a52-e6b6-4bc6-9031-840026375131 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:24.295121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332812e9-e5ca-418b-a968-b999154d2c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:24.296033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332812e9-e5ca-418b-a968-b999154d2c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:24.296316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332812e9-e5ca-418b-a968-b999154d2c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:24.296587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332812e9-e5ca-418b-a968-b999154d2c46 admin admin] PATH_INFO: `/v3/projects/63cf02d9f25e4f1b81f2d87d2ab59439` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:24.298781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332812e9-e5ca-418b-a968-b999154d2c46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63cf02d9f25e4f1b81f2d87d2ab59439)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:24.301257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332812e9-e5ca-418b-a968-b999154d2c46 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:24.553586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-332812e9-e5ca-418b-a968-b999154d2c46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63cf02d9f25e4f1b81f2d87d2ab59439', 'request_id': 'req-332812e9-e5ca-418b-a968-b999154d2c46'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:24.705057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-332812e9-e5ca-418b-a968-b999154d2c46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63cf02d9f25e4f1b81f2d87d2ab59439', 'request_id': 'req-332812e9-e5ca-418b-a968-b999154d2c46'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:24.757104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-332812e9-e5ca-418b-a968-b999154d2c46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63cf02d9f25e4f1b81f2d87d2ab59439', 'request_id': 'req-332812e9-e5ca-418b-a968-b999154d2c46'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:24.823087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-332812e9-e5ca-418b-a968-b999154d2c46 admin admin] The token cache is being invalidate because project 63cf02d9f25e4f1b81f2d87d2ab59439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:17:24.823390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-332812e9-e5ca-418b-a968-b999154d2c46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:24.837580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-332812e9-e5ca-418b-a968-b999154d2c46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:17:24.842840 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1448/2942] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:17:24 2022] DELETE /identity/v3/projects/63cf02d9f25e4f1b81f2d87d2ab59439 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:17:24.850773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35af6b-627f-414a-ad53-8031bdd23a6c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:24.851226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35af6b-627f-414a-ad53-8031bdd23a6c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:24.851439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35af6b-627f-414a-ad53-8031bdd23a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:24.890965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ec35af6b-627f-414a-ad53-8031bdd23a6c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:24.893314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ec35af6b-627f-414a-ad53-8031bdd23a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:25.022802 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1495/2943] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:25.030213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4d3d9-de8d-4b07-99b6-43c009426297 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:25.031383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4d3d9-de8d-4b07-99b6-43c009426297 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:25.032182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4d3d9-de8d-4b07-99b6-43c009426297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:25.073717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a1b4d3d9-de8d-4b07-99b6-43c009426297 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:25.075470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a1b4d3d9-de8d-4b07-99b6-43c009426297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:25.087240 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1449/2944] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:25.091555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35af6b-627f-414a-ad53-8031bdd23a6c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:25.103518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35af6b-627f-414a-ad53-8031bdd23a6c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:25.108459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc12de1-ce97-4b2f-9edf-74daf2709ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:25.109887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc12de1-ce97-4b2f-9edf-74daf2709ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:25.110220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc12de1-ce97-4b2f-9edf-74daf2709ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:25.110521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc12de1-ce97-4b2f-9edf-74daf2709ca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:25.111940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc12de1-ce97-4b2f-9edf-74daf2709ca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:17:25.112160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc12de1-ce97-4b2f-9edf-74daf2709ca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:25.113848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc12de1-ce97-4b2f-9edf-74daf2709ca3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:25.129212 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1496/2945] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:17:25.133774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4d3d9-de8d-4b07-99b6-43c009426297 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:25.144251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4d3d9-de8d-4b07-99b6-43c009426297 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:25.159334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ec0cc-a88b-41e0-8ff9-506d1b016f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:25.160174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ec0cc-a88b-41e0-8ff9-506d1b016f8f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:25.160429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ec0cc-a88b-41e0-8ff9-506d1b016f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:25.160704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ec0cc-a88b-41e0-8ff9-506d1b016f8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:25.161414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ec0cc-a88b-41e0-8ff9-506d1b016f8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:25.163933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ec0cc-a88b-41e0-8ff9-506d1b016f8f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:25.357642 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1450/2946] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:17:25 2022] POST /identity/v3/projects => generated 387 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:17:25.358872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc12de1-ce97-4b2f-9edf-74daf2709ca3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:25.373985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc12de1-ce97-4b2f-9edf-74daf2709ca3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:25.519795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f1d64-668b-427c-9aeb-cffc2fd611b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:25.520672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f1d64-668b-427c-9aeb-cffc2fd611b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:25.521243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f1d64-668b-427c-9aeb-cffc2fd611b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:25.521243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10f1d64-668b-427c-9aeb-cffc2fd611b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:25.522014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f1d64-668b-427c-9aeb-cffc2fd611b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:25.524125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10f1d64-668b-427c-9aeb-cffc2fd611b8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:25.676634 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1497/2947] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:17:25 2022] POST /identity/v3/users => generated 294 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:17:25.680958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ec0cc-a88b-41e0-8ff9-506d1b016f8f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:25.697091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ec0cc-a88b-41e0-8ff9-506d1b016f8f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:25.707162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96350e77-8143-49d7-bb12-f3c47c0efb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:25.707863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96350e77-8143-49d7-bb12-f3c47c0efb0f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:25.708180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96350e77-8143-49d7-bb12-f3c47c0efb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:25.708468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96350e77-8143-49d7-bb12-f3c47c0efb0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:25.709220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96350e77-8143-49d7-bb12-f3c47c0efb0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:25.711168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96350e77-8143-49d7-bb12-f3c47c0efb0f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:25.725586 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1451/2948] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:17:25.729556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f1d64-668b-427c-9aeb-cffc2fd611b8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:25.743570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10f1d64-668b-427c-9aeb-cffc2fd611b8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:25.750006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c8ea6-25a3-4bd6-98db-34b226055b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:25.752407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c8ea6-25a3-4bd6-98db-34b226055b8f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:25.752956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c8ea6-25a3-4bd6-98db-34b226055b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:25.753629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c8ea6-25a3-4bd6-98db-34b226055b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:25.755350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c8ea6-25a3-4bd6-98db-34b226055b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:25.757282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c8ea6-25a3-4bd6-98db-34b226055b8f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:25.774561 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1498/2949] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:17:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:17:25.777138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96350e77-8143-49d7-bb12-f3c47c0efb0f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:25.794342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96350e77-8143-49d7-bb12-f3c47c0efb0f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:25.802055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814bfd2-dc5b-4d34-99fd-caba620a78ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:25.802055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814bfd2-dc5b-4d34-99fd-caba620a78ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:25.802380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814bfd2-dc5b-4d34-99fd-caba620a78ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:25.802783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1814bfd2-dc5b-4d34-99fd-caba620a78ab admin admin] PATH_INFO: `/v3/projects/4aa297c2d82a44678b28657f6c41f1a7/users/117737d52c2f4eb69ab580150320d1a7/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:25.831271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814bfd2-dc5b-4d34-99fd-caba620a78ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa297c2d82a44678b28657f6c41f1a7, user_id=117737d52c2f4eb69ab580150320d1a7, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:25.835587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1814bfd2-dc5b-4d34-99fd-caba620a78ab admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:25.999980 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1452/2950] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:17:25 2022] PUT /identity/v3/projects/4aa297c2d82a44678b28657f6c41f1a7/users/117737d52c2f4eb69ab580150320d1a7/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:17:26.007896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e7908-b8d9-44c5-95cb-8711fc193676 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:26.009732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e7908-b8d9-44c5-95cb-8711fc193676 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:26.010326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e7908-b8d9-44c5-95cb-8711fc193676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:26.038682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3f0e7908-b8d9-44c5-95cb-8711fc193676 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:26.040342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3f0e7908-b8d9-44c5-95cb-8711fc193676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:26.138439 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:26.145220 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1499/2951] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:26.155204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814bfd2-dc5b-4d34-99fd-caba620a78ab admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:26.158444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1814bfd2-dc5b-4d34-99fd-caba620a78ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:26.355203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1814bfd2-dc5b-4d34-99fd-caba620a78ab admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:26.359716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa46ff-7b3b-47c8-87b7-598ea2727d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:26.360390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa46ff-7b3b-47c8-87b7-598ea2727d99 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:26.361225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa46ff-7b3b-47c8-87b7-598ea2727d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:26.361680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa46ff-7b3b-47c8-87b7-598ea2727d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:26.374074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa46ff-7b3b-47c8-87b7-598ea2727d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:26.383743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa46ff-7b3b-47c8-87b7-598ea2727d99 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:26.393845 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1453/2952] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:17:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:17:27.681636 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:28.350073 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:29.090123 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:29.553022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e7908-b8d9-44c5-95cb-8711fc193676 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:29.555936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3f0e7908-b8d9-44c5-95cb-8711fc193676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:29.771373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e7908-b8d9-44c5-95cb-8711fc193676 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:29.785361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd8975-93f7-4165-8ba8-bd20220e7a7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:29.786366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd8975-93f7-4165-8ba8-bd20220e7a7e service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:29.786830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd8975-93f7-4165-8ba8-bd20220e7a7e service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:29.787732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd8975-93f7-4165-8ba8-bd20220e7a7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:29.795917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-51dd8975-93f7-4165-8ba8-bd20220e7a7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:29.968444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd8975-93f7-4165-8ba8-bd20220e7a7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:29.976821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd8975-93f7-4165-8ba8-bd20220e7a7e service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:30.021901 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1500/2953] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:17:29 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:17:30.310164 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:31.518806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa46ff-7b3b-47c8-87b7-598ea2727d99 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:31.521981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-72fa46ff-7b3b-47c8-87b7-598ea2727d99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:31.733781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa46ff-7b3b-47c8-87b7-598ea2727d99 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:31.739406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ecdfa-5b0c-4376-b3e3-f3bb5cb0071d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:31.740313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ecdfa-5b0c-4376-b3e3-f3bb5cb0071d service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:31.740967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ecdfa-5b0c-4376-b3e3-f3bb5cb0071d service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:31.741427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ecdfa-5b0c-4376-b3e3-f3bb5cb0071d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:31.743854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8f1ecdfa-5b0c-4376-b3e3-f3bb5cb0071d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:31.838665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ecdfa-5b0c-4376-b3e3-f3bb5cb0071d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:31.846434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1ecdfa-5b0c-4376-b3e3-f3bb5cb0071d service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:31.871728 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1454/2954] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:17:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:17:33.081590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086abae-5ba7-499c-8baf-e7b4518e441b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:33.082399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086abae-5ba7-499c-8baf-e7b4518e441b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:33.082399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086abae-5ba7-499c-8baf-e7b4518e441b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:33.123760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6086abae-5ba7-499c-8baf-e7b4518e441b None None] MFA Rules not processed for user `5d2572c3904f40c6b26ce92425f655f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:33.141202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6086abae-5ba7-499c-8baf-e7b4518e441b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:33.304103 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1501/2955] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:17:34.456042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ecdfa-5b0c-4376-b3e3-f3bb5cb0071d service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:34.458313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8f1ecdfa-5b0c-4376-b3e3-f3bb5cb0071d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:34.478474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1ecdfa-5b0c-4376-b3e3-f3bb5cb0071d service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:34.483031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b711d8b-4d62-4ecc-b159-75ab0926ea75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:34.484052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b711d8b-4d62-4ecc-b159-75ab0926ea75 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:34.484563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b711d8b-4d62-4ecc-b159-75ab0926ea75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:34.485658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b711d8b-4d62-4ecc-b159-75ab0926ea75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:34.488333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5b711d8b-4d62-4ecc-b159-75ab0926ea75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:34.505009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b711d8b-4d62-4ecc-b159-75ab0926ea75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:34.511202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b711d8b-4d62-4ecc-b159-75ab0926ea75 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:34.531031 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1455/2956] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:17:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:17:35.630087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16dc8f-41b7-4be1-bdcf-d1904671f779 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:35.630087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16dc8f-41b7-4be1-bdcf-d1904671f779 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:35.630087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16dc8f-41b7-4be1-bdcf-d1904671f779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:35.676488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-fa16dc8f-41b7-4be1-bdcf-d1904671f779 None None] MFA Rules not processed for user `744a25fb94b94384b064ed10c3bd9374`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:35.677737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fa16dc8f-41b7-4be1-bdcf-d1904671f779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:35.821188 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1502/2957] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:35.833277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b711d8b-4d62-4ecc-b159-75ab0926ea75 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:35.847178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b711d8b-4d62-4ecc-b159-75ab0926ea75 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:35.855201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc63a33-cef9-46c2-b413-22d60e6c6cab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:35.856495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc63a33-cef9-46c2-b413-22d60e6c6cab service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:35.857240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc63a33-cef9-46c2-b413-22d60e6c6cab service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:35.857751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc63a33-cef9-46c2-b413-22d60e6c6cab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:35.870195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc63a33-cef9-46c2-b413-22d60e6c6cab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:35.871970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc63a33-cef9-46c2-b413-22d60e6c6cab service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:35.883570 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1456/2958] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:17:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:17:44.353298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d4c67-3412-477f-b26d-4a99b4182458 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:44.354404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d4c67-3412-477f-b26d-4a99b4182458 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:44.354877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d4c67-3412-477f-b26d-4a99b4182458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:44.405541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8a7d4c67-3412-477f-b26d-4a99b4182458 None None] MFA Rules not processed for user `744a25fb94b94384b064ed10c3bd9374`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:44.406819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8a7d4c67-3412-477f-b26d-4a99b4182458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:44.453672 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1503/2959] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:45.878427 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:17:49.915042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a95e4-a87d-49dd-a18a-d204123024e6 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:49.915602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a95e4-a87d-49dd-a18a-d204123024e6 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:49.915602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a95e4-a87d-49dd-a18a-d204123024e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:49.989513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-992a95e4-a87d-49dd-a18a-d204123024e6 None None] MFA Rules not processed for user `117737d52c2f4eb69ab580150320d1a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:49.995077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-992a95e4-a87d-49dd-a18a-d204123024e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:50.229794 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1457/2960] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:17:50.577613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d4c67-3412-477f-b26d-4a99b4182458 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:17:50.606293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d4c67-3412-477f-b26d-4a99b4182458 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:17:50.622146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c40c54-a278-4d8b-9ca1-671c3d0f9a9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:17:50.624176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c40c54-a278-4d8b-9ca1-671c3d0f9a9e service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:50.626131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c40c54-a278-4d8b-9ca1-671c3d0f9a9e service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:50.626603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c40c54-a278-4d8b-9ca1-671c3d0f9a9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:50.648348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c40c54-a278-4d8b-9ca1-671c3d0f9a9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:17:50.654332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c40c54-a278-4d8b-9ca1-671c3d0f9a9e service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:17:50.681228 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1504/2961] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:17:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:17:56.079589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3131064-74f2-4e7e-909b-771e8e62193b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:17:56.080082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3131064-74f2-4e7e-909b-771e8e62193b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:17:56.080469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3131064-74f2-4e7e-909b-771e8e62193b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:17:56.124720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f3131064-74f2-4e7e-909b-771e8e62193b None None] MFA Rules not processed for user `117737d52c2f4eb69ab580150320d1a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:17:56.128015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f3131064-74f2-4e7e-909b-771e8e62193b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:17:56.159393 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1458/2962] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:17:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:18:00.681430 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:02.684300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c40c54-a278-4d8b-9ca1-671c3d0f9a9e service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:02.684300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-93c40c54-a278-4d8b-9ca1-671c3d0f9a9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:02.703873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c40c54-a278-4d8b-9ca1-671c3d0f9a9e service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:02.711069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbe4c6-063b-4f9d-86a4-e78cc1ac4316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:02.712593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbe4c6-063b-4f9d-86a4-e78cc1ac4316 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:02.712967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbe4c6-063b-4f9d-86a4-e78cc1ac4316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:02.713314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cbe4c6-063b-4f9d-86a4-e78cc1ac4316 admin admin] PATH_INFO: `/v3/users/a6fc909d2c0843b8a29eb1d47a755db9` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:02.714939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbe4c6-063b-4f9d-86a4-e78cc1ac4316 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6fc909d2c0843b8a29eb1d47a755db9)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:02.717187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cbe4c6-063b-4f9d-86a4-e78cc1ac4316 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:03.020335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-09cbe4c6-063b-4f9d-86a4-e78cc1ac4316 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6fc909d2c0843b8a29eb1d47a755db9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:03.076915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-09cbe4c6-063b-4f9d-86a4-e78cc1ac4316 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6fc909d2c0843b8a29eb1d47a755db9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:03.091353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-09cbe4c6-063b-4f9d-86a4-e78cc1ac4316 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6fc909d2c0843b8a29eb1d47a755db9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:03.093098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-09cbe4c6-063b-4f9d-86a4-e78cc1ac4316 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6fc909d2c0843b8a29eb1d47a755db9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:03.177703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-09cbe4c6-063b-4f9d-86a4-e78cc1ac4316 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6fc909d2c0843b8a29eb1d47a755db9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:03.189569 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1505/2963] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:18:02 2022] DELETE /identity/v3/users/a6fc909d2c0843b8a29eb1d47a755db9 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:03.191523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ccafd-2298-4a1d-98f6-b850ba66afc2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:03.192068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ccafd-2298-4a1d-98f6-b850ba66afc2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:03.192306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ccafd-2298-4a1d-98f6-b850ba66afc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:03.243468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-434ccafd-2298-4a1d-98f6-b850ba66afc2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:03.248084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-434ccafd-2298-4a1d-98f6-b850ba66afc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:03.339100 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1459/2964] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:18:03.352574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbe4c6-063b-4f9d-86a4-e78cc1ac4316 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:03.354035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-09cbe4c6-063b-4f9d-86a4-e78cc1ac4316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:03.528510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cbe4c6-063b-4f9d-86a4-e78cc1ac4316 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:03.538962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d578bea-6326-4a5f-acbf-a27512ee3569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:03.540464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d578bea-6326-4a5f-acbf-a27512ee3569 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:03.541088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d578bea-6326-4a5f-acbf-a27512ee3569 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:03.541863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d578bea-6326-4a5f-acbf-a27512ee3569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:03.567048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d578bea-6326-4a5f-acbf-a27512ee3569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:03.568610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d578bea-6326-4a5f-acbf-a27512ee3569 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:03.581074 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1506/2965] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:18:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:18:04.611535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ccafd-2298-4a1d-98f6-b850ba66afc2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:04.617238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-434ccafd-2298-4a1d-98f6-b850ba66afc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:04.633585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ccafd-2298-4a1d-98f6-b850ba66afc2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:04.660652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce0a5a8-2e60-472c-b181-1999c8c24854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:04.667002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0a5a8-2e60-472c-b181-1999c8c24854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:04.667390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0a5a8-2e60-472c-b181-1999c8c24854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:04.670590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce0a5a8-2e60-472c-b181-1999c8c24854 admin admin] PATH_INFO: `/v3/projects/865186bd56854ed987845ceb4b62aa2d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:04.674502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0a5a8-2e60-472c-b181-1999c8c24854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=865186bd56854ed987845ceb4b62aa2d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:04.676685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce0a5a8-2e60-472c-b181-1999c8c24854 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:04.832072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4ce0a5a8-2e60-472c-b181-1999c8c24854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '865186bd56854ed987845ceb4b62aa2d', 'request_id': 'req-4ce0a5a8-2e60-472c-b181-1999c8c24854'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:05.001229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4ce0a5a8-2e60-472c-b181-1999c8c24854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '865186bd56854ed987845ceb4b62aa2d', 'request_id': 'req-4ce0a5a8-2e60-472c-b181-1999c8c24854'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:05.009789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4ce0a5a8-2e60-472c-b181-1999c8c24854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '865186bd56854ed987845ceb4b62aa2d', 'request_id': 'req-4ce0a5a8-2e60-472c-b181-1999c8c24854'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:05.033844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4ce0a5a8-2e60-472c-b181-1999c8c24854 admin admin] The token cache is being invalidate because project 865186bd56854ed987845ceb4b62aa2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:18:05.034444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4ce0a5a8-2e60-472c-b181-1999c8c24854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:05.035375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4ce0a5a8-2e60-472c-b181-1999c8c24854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:05.037869 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1460/2966] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:18:04 2022] DELETE /identity/v3/projects/865186bd56854ed987845ceb4b62aa2d => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:05.045729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d578bea-6326-4a5f-acbf-a27512ee3569 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:05.059387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d578bea-6326-4a5f-acbf-a27512ee3569 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:05.168851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993adf4a-8a48-4215-8d2f-6521fc0ee96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:05.170197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993adf4a-8a48-4215-8d2f-6521fc0ee96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:05.170670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993adf4a-8a48-4215-8d2f-6521fc0ee96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:05.171120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993adf4a-8a48-4215-8d2f-6521fc0ee96d admin admin] PATH_INFO: `/v3/users/0925723b4edc4068933e573902109105` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:05.172632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993adf4a-8a48-4215-8d2f-6521fc0ee96d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0925723b4edc4068933e573902109105)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:05.174894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993adf4a-8a48-4215-8d2f-6521fc0ee96d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:05.197068 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:05.525368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-993adf4a-8a48-4215-8d2f-6521fc0ee96d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0925723b4edc4068933e573902109105'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:05.560332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-993adf4a-8a48-4215-8d2f-6521fc0ee96d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0925723b4edc4068933e573902109105'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:05.593050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-993adf4a-8a48-4215-8d2f-6521fc0ee96d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0925723b4edc4068933e573902109105'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:05.599403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-993adf4a-8a48-4215-8d2f-6521fc0ee96d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0925723b4edc4068933e573902109105'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:05.747314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-993adf4a-8a48-4215-8d2f-6521fc0ee96d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0925723b4edc4068933e573902109105'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:05.758184 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1507/2967] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:18:05 2022] DELETE /identity/v3/users/0925723b4edc4068933e573902109105 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:05.814933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54567af8-11e9-4b41-b20d-d135ac6362a2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:05.815506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54567af8-11e9-4b41-b20d-d135ac6362a2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:05.815506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54567af8-11e9-4b41-b20d-d135ac6362a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:05.832405 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:05.838923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-54567af8-11e9-4b41-b20d-d135ac6362a2 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:05.842705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-54567af8-11e9-4b41-b20d-d135ac6362a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:05.984337 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1461/2968] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:18:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:18:06.021069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993adf4a-8a48-4215-8d2f-6521fc0ee96d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:06.024976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-993adf4a-8a48-4215-8d2f-6521fc0ee96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:06.275837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993adf4a-8a48-4215-8d2f-6521fc0ee96d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:06.286285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3fd95-f68a-422e-a3f5-bbf8fbe71780 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:06.287017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3fd95-f68a-422e-a3f5-bbf8fbe71780 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:06.287304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3fd95-f68a-422e-a3f5-bbf8fbe71780 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:06.287773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3fd95-f68a-422e-a3f5-bbf8fbe71780 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:06.337216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3fd95-f68a-422e-a3f5-bbf8fbe71780 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:06.340555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3fd95-f68a-422e-a3f5-bbf8fbe71780 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:06.370183 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1508/2969] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:18:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:18:06.671114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54567af8-11e9-4b41-b20d-d135ac6362a2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:06.676365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-54567af8-11e9-4b41-b20d-d135ac6362a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:07.002264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54567af8-11e9-4b41-b20d-d135ac6362a2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:07.020126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26530698-430d-4d38-bc89-19169e1ce132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:07.023080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26530698-430d-4d38-bc89-19169e1ce132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:07.025014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26530698-430d-4d38-bc89-19169e1ce132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:07.026337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26530698-430d-4d38-bc89-19169e1ce132 admin admin] PATH_INFO: `/v3/projects/7cc867be397d45e1b04a568c2895eaeb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:07.029879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26530698-430d-4d38-bc89-19169e1ce132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cc867be397d45e1b04a568c2895eaeb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:07.035080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26530698-430d-4d38-bc89-19169e1ce132 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:07.966532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-26530698-430d-4d38-bc89-19169e1ce132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cc867be397d45e1b04a568c2895eaeb', 'request_id': 'req-26530698-430d-4d38-bc89-19169e1ce132'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:08.086182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-26530698-430d-4d38-bc89-19169e1ce132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cc867be397d45e1b04a568c2895eaeb', 'request_id': 'req-26530698-430d-4d38-bc89-19169e1ce132'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:08.105802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-26530698-430d-4d38-bc89-19169e1ce132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cc867be397d45e1b04a568c2895eaeb', 'request_id': 'req-26530698-430d-4d38-bc89-19169e1ce132'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:08.175472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-26530698-430d-4d38-bc89-19169e1ce132 admin admin] The token cache is being invalidate because project 7cc867be397d45e1b04a568c2895eaeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:18:08.181634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-26530698-430d-4d38-bc89-19169e1ce132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:08.183690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-26530698-430d-4d38-bc89-19169e1ce132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:08.188694 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1462/2970] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:18:06 2022] DELETE /identity/v3/projects/7cc867be397d45e1b04a568c2895eaeb => generated 0 bytes in 1518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:08.193724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd046c3-cc0e-4cc7-9505-828466e45adf None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:08.194302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd046c3-cc0e-4cc7-9505-828466e45adf None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:08.194302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd046c3-cc0e-4cc7-9505-828466e45adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:08.251233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8cd046c3-cc0e-4cc7-9505-828466e45adf None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:08.255645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8cd046c3-cc0e-4cc7-9505-828466e45adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:08.463974 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1509/2971] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:18:08.470411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213fa80-71f1-474f-84b7-bd8457e955ba None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:08.471277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213fa80-71f1-474f-84b7-bd8457e955ba None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:08.471753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213fa80-71f1-474f-84b7-bd8457e955ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:08.535406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1213fa80-71f1-474f-84b7-bd8457e955ba None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:08.544342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1213fa80-71f1-474f-84b7-bd8457e955ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:08.568466 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1463/2972] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:18:08.572920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd046c3-cc0e-4cc7-9505-828466e45adf None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:08.594918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd046c3-cc0e-4cc7-9505-828466e45adf None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:08.607787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6547f9d-ebff-46a7-9851-12cdc6b510fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:08.608484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6547f9d-ebff-46a7-9851-12cdc6b510fb admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:08.608773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6547f9d-ebff-46a7-9851-12cdc6b510fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:08.609237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6547f9d-ebff-46a7-9851-12cdc6b510fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:08.610092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6547f9d-ebff-46a7-9851-12cdc6b510fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:18:08.610448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6547f9d-ebff-46a7-9851-12cdc6b510fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:08.622401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6547f9d-ebff-46a7-9851-12cdc6b510fb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:08.644454 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1510/2973] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:18:08.649163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213fa80-71f1-474f-84b7-bd8457e955ba None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:08.664765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213fa80-71f1-474f-84b7-bd8457e955ba None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:08.686076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8763a-a914-4486-8a25-85135b6545b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:08.688563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8763a-a914-4486-8a25-85135b6545b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:08.688925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8763a-a914-4486-8a25-85135b6545b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:08.689831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8763a-a914-4486-8a25-85135b6545b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:08.692715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc8763a-a914-4486-8a25-85135b6545b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:08.694847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc8763a-a914-4486-8a25-85135b6545b5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:08.857086 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1464/2974] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:18:08 2022] POST /identity/v3/projects => generated 359 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:18:08.858328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6547f9d-ebff-46a7-9851-12cdc6b510fb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:08.872813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6547f9d-ebff-46a7-9851-12cdc6b510fb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:08.890720 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:09.010721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e265580-e90e-4d98-8589-df54eb35ed77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:09.015401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e265580-e90e-4d98-8589-df54eb35ed77 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:09.015698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e265580-e90e-4d98-8589-df54eb35ed77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:09.016071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e265580-e90e-4d98-8589-df54eb35ed77 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:09.017000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e265580-e90e-4d98-8589-df54eb35ed77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:09.019047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e265580-e90e-4d98-8589-df54eb35ed77 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:09.126819 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1511/2975] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:18:08 2022] POST /identity/v3/users => generated 280 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:18:09.131323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8763a-a914-4486-8a25-85135b6545b5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:09.155994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8763a-a914-4486-8a25-85135b6545b5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:09.179089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa21ec0-ff1b-4e56-9720-9e1fda80ec5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:09.181965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa21ec0-ff1b-4e56-9720-9e1fda80ec5b admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:09.182401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa21ec0-ff1b-4e56-9720-9e1fda80ec5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:09.182896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa21ec0-ff1b-4e56-9720-9e1fda80ec5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:09.183810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa21ec0-ff1b-4e56-9720-9e1fda80ec5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:09.195926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa21ec0-ff1b-4e56-9720-9e1fda80ec5b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:09.224519 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1465/2976] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:18:09.226673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e265580-e90e-4d98-8589-df54eb35ed77 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:09.245904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e265580-e90e-4d98-8589-df54eb35ed77 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:09.254027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda5f61e-b09b-4110-90a4-fafb2f67c932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:09.254917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5f61e-b09b-4110-90a4-fafb2f67c932 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:09.255302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5f61e-b09b-4110-90a4-fafb2f67c932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:09.255848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda5f61e-b09b-4110-90a4-fafb2f67c932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:09.256835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5f61e-b09b-4110-90a4-fafb2f67c932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:09.259016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda5f61e-b09b-4110-90a4-fafb2f67c932 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:09.273277 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1512/2977] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:18:09.277223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa21ec0-ff1b-4e56-9720-9e1fda80ec5b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:09.283700 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:09.289158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa21ec0-ff1b-4e56-9720-9e1fda80ec5b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:09.299935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73271e-3e92-4b26-841f-a7fbf9372bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:09.301371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73271e-3e92-4b26-841f-a7fbf9372bf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:09.301860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73271e-3e92-4b26-841f-a7fbf9372bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:09.302352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73271e-3e92-4b26-841f-a7fbf9372bf7 admin admin] PATH_INFO: `/v3/projects/a7b6155e84f14a7880a1dcbc4b0452f8/users/22cebfd66c284f34b1d2a45722eb4b8a/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:09.336960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73271e-3e92-4b26-841f-a7fbf9372bf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7b6155e84f14a7880a1dcbc4b0452f8, user_id=22cebfd66c284f34b1d2a45722eb4b8a, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:09.345610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73271e-3e92-4b26-841f-a7fbf9372bf7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:09.461592 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1466/2978] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:18:09 2022] PUT /identity/v3/projects/a7b6155e84f14a7880a1dcbc4b0452f8/users/22cebfd66c284f34b1d2a45722eb4b8a/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:09.472286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dbd1f-2c07-4535-8777-c804adebfb77 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:09.473172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dbd1f-2c07-4535-8777-c804adebfb77 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:09.473702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56dbd1f-2c07-4535-8777-c804adebfb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:09.535286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f56dbd1f-2c07-4535-8777-c804adebfb77 None None] MFA Rules not processed for user `22cebfd66c284f34b1d2a45722eb4b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:09.537993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f56dbd1f-2c07-4535-8777-c804adebfb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:09.730472 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1513/2979] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:18:09 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:18:09.735526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73271e-3e92-4b26-841f-a7fbf9372bf7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:09.905414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73271e-3e92-4b26-841f-a7fbf9372bf7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:09.927858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d835e3-e3ce-4c09-b75f-c5710056f17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:09.939737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d835e3-e3ce-4c09-b75f-c5710056f17d admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:09.939737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d835e3-e3ce-4c09-b75f-c5710056f17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:09.939737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d835e3-e3ce-4c09-b75f-c5710056f17d admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:09.939737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d835e3-e3ce-4c09-b75f-c5710056f17d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:09.957160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d835e3-e3ce-4c09-b75f-c5710056f17d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:10.130136 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1467/2980] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:18:09 2022] POST /identity/v3/projects => generated 359 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:18:10.142082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dbd1f-2c07-4535-8777-c804adebfb77 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:10.154482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56dbd1f-2c07-4535-8777-c804adebfb77 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:10.262416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f30372-d48d-473e-82b3-7790ac0d8e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:10.264217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f30372-d48d-473e-82b3-7790ac0d8e39 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:10.265504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f30372-d48d-473e-82b3-7790ac0d8e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:10.266823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f30372-d48d-473e-82b3-7790ac0d8e39 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:10.268119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f30372-d48d-473e-82b3-7790ac0d8e39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:10.270449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f30372-d48d-473e-82b3-7790ac0d8e39 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:10.375501 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1514/2981] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:18:10 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:18:10.380356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d835e3-e3ce-4c09-b75f-c5710056f17d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:10.400690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d835e3-e3ce-4c09-b75f-c5710056f17d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:10.428155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c3803-3d27-4686-8136-8e422c6afe3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:10.428909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c3803-3d27-4686-8136-8e422c6afe3b admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:10.430033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c3803-3d27-4686-8136-8e422c6afe3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:10.434488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c3803-3d27-4686-8136-8e422c6afe3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:10.434488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c3803-3d27-4686-8136-8e422c6afe3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:10.434488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c3803-3d27-4686-8136-8e422c6afe3b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:10.460130 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1468/2982] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:18:10.463454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f30372-d48d-473e-82b3-7790ac0d8e39 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:10.481084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f30372-d48d-473e-82b3-7790ac0d8e39 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:10.507424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dba1c4-43c7-40cc-9dfa-a51786b6305d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:10.508661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dba1c4-43c7-40cc-9dfa-a51786b6305d admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:10.509117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dba1c4-43c7-40cc-9dfa-a51786b6305d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:10.509554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dba1c4-43c7-40cc-9dfa-a51786b6305d admin admin] PATH_INFO: `/v3/projects/5bd426d913e94be8b73169e28cbf4139/users/4b7f4c04ce9a4625973d3d77d67bdab6/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:10.513982 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:10.529468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dba1c4-43c7-40cc-9dfa-a51786b6305d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd426d913e94be8b73169e28cbf4139, user_id=4b7f4c04ce9a4625973d3d77d67bdab6, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:10.533122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dba1c4-43c7-40cc-9dfa-a51786b6305d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:10.662028 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1515/2983] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:18:10 2022] PUT /identity/v3/projects/5bd426d913e94be8b73169e28cbf4139/users/4b7f4c04ce9a4625973d3d77d67bdab6/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:10.664126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c3803-3d27-4686-8136-8e422c6afe3b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:10.680037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c3803-3d27-4686-8136-8e422c6afe3b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:10.786429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd78ff-1855-4baa-8029-44e04590156b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:10.787724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd78ff-1855-4baa-8029-44e04590156b admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:10.788291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd78ff-1855-4baa-8029-44e04590156b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:10.788799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd78ff-1855-4baa-8029-44e04590156b admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:10.790066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd78ff-1855-4baa-8029-44e04590156b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:10.792317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd78ff-1855-4baa-8029-44e04590156b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:10.809242 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1469/2984] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:18:10.813222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dba1c4-43c7-40cc-9dfa-a51786b6305d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:10.849726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dba1c4-43c7-40cc-9dfa-a51786b6305d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:10.856130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b390a-00e2-4a2d-bc59-ef9058fdceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:10.857137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b390a-00e2-4a2d-bc59-ef9058fdceb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:10.857427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b390a-00e2-4a2d-bc59-ef9058fdceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:10.857744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b390a-00e2-4a2d-bc59-ef9058fdceb0 admin admin] PATH_INFO: `/v3/projects/5bd426d913e94be8b73169e28cbf4139/users/4b7f4c04ce9a4625973d3d77d67bdab6/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:10.860202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b390a-00e2-4a2d-bc59-ef9058fdceb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd426d913e94be8b73169e28cbf4139, user_id=4b7f4c04ce9a4625973d3d77d67bdab6, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:10.863744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3b390a-00e2-4a2d-bc59-ef9058fdceb0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:10.877586 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1516/2985] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:18:10 2022] PUT /identity/v3/projects/5bd426d913e94be8b73169e28cbf4139/users/4b7f4c04ce9a4625973d3d77d67bdab6/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:18:10.889717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0815ce-a839-4868-b535-1ec2765e680d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:10.890474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0815ce-a839-4868-b535-1ec2765e680d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:10.891951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0815ce-a839-4868-b535-1ec2765e680d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:10.947737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-aa0815ce-a839-4868-b535-1ec2765e680d None None] MFA Rules not processed for user `4b7f4c04ce9a4625973d3d77d67bdab6`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:10.949670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aa0815ce-a839-4868-b535-1ec2765e680d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:11.005458 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:11.052044 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1470/2986] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:18:10 2022] POST /identity/v3/auth/tokens => generated 3293 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:18:11.509161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b390a-00e2-4a2d-bc59-ef9058fdceb0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:11.511000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5d3b390a-00e2-4a2d-bc59-ef9058fdceb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:11.679389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b390a-00e2-4a2d-bc59-ef9058fdceb0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:11.706785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a9491-ee7f-42cd-a4f4-07ab3d5da11e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:11.708169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a9491-ee7f-42cd-a4f4-07ab3d5da11e service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:11.708738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a9491-ee7f-42cd-a4f4-07ab3d5da11e service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:11.709221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a9491-ee7f-42cd-a4f4-07ab3d5da11e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:11.744476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a9491-ee7f-42cd-a4f4-07ab3d5da11e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:11.748747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a9491-ee7f-42cd-a4f4-07ab3d5da11e service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:11.773526 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1517/2987] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:18:11 2022] GET /identity/v3/auth/tokens => generated 3293 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:18:15.644922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0815ce-a839-4868-b535-1ec2765e680d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:15.667458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0815ce-a839-4868-b535-1ec2765e680d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:15.684322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d7d69-7d6c-4847-a736-88b99470914a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:15.685015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d7d69-7d6c-4847-a736-88b99470914a service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:15.685295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d7d69-7d6c-4847-a736-88b99470914a service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:15.685572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d7d69-7d6c-4847-a736-88b99470914a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:15.687396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-468d7d69-7d6c-4847-a736-88b99470914a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:15.787598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d7d69-7d6c-4847-a736-88b99470914a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:15.790249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d7d69-7d6c-4847-a736-88b99470914a service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:15.809673 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1471/2988] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:18:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:18:16.378629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a9491-ee7f-42cd-a4f4-07ab3d5da11e service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:16.495893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a9491-ee7f-42cd-a4f4-07ab3d5da11e service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:16.502809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676814aa-142e-46dd-8dc7-d4a45f4ffb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:16.504929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676814aa-142e-46dd-8dc7-d4a45f4ffb3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:16.505394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676814aa-142e-46dd-8dc7-d4a45f4ffb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:16.505886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676814aa-142e-46dd-8dc7-d4a45f4ffb3f admin admin] PATH_INFO: `/v3/users/22cebfd66c284f34b1d2a45722eb4b8a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:16.507371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676814aa-142e-46dd-8dc7-d4a45f4ffb3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=22cebfd66c284f34b1d2a45722eb4b8a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:16.509540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676814aa-142e-46dd-8dc7-d4a45f4ffb3f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:16.775791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-676814aa-142e-46dd-8dc7-d4a45f4ffb3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22cebfd66c284f34b1d2a45722eb4b8a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:16.787393 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:16.796800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-676814aa-142e-46dd-8dc7-d4a45f4ffb3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22cebfd66c284f34b1d2a45722eb4b8a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:16.799767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d7d69-7d6c-4847-a736-88b99470914a service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:16.803880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-676814aa-142e-46dd-8dc7-d4a45f4ffb3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22cebfd66c284f34b1d2a45722eb4b8a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:16.804994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-676814aa-142e-46dd-8dc7-d4a45f4ffb3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22cebfd66c284f34b1d2a45722eb4b8a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:16.813802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d7d69-7d6c-4847-a736-88b99470914a service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:16.823044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb4af0c-bd57-4d88-81fe-ea12fcf3a6e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:16.824151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4af0c-bd57-4d88-81fe-ea12fcf3a6e6 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:16.824665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4af0c-bd57-4d88-81fe-ea12fcf3a6e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:16.824947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb4af0c-bd57-4d88-81fe-ea12fcf3a6e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:16.827460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-feb4af0c-bd57-4d88-81fe-ea12fcf3a6e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:16.929411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4af0c-bd57-4d88-81fe-ea12fcf3a6e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:16.932276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb4af0c-bd57-4d88-81fe-ea12fcf3a6e6 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:16.946493 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1472/2989] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:18:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:18:17.252999 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-676814aa-142e-46dd-8dc7-d4a45f4ffb3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22cebfd66c284f34b1d2a45722eb4b8a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:17.260320 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1518/2990] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:18:16 2022] DELETE /identity/v3/users/22cebfd66c284f34b1d2a45722eb4b8a => generated 0 bytes in 882 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:17.267123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfe9fa-db0b-4474-ba61-229bab08476e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:17.267440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfe9fa-db0b-4474-ba61-229bab08476e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:17.267694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfe9fa-db0b-4474-ba61-229bab08476e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:17.315539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-56cfe9fa-db0b-4474-ba61-229bab08476e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:17.318978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-56cfe9fa-db0b-4474-ba61-229bab08476e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:17.435052 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1473/2991] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:18:17.449476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676814aa-142e-46dd-8dc7-d4a45f4ffb3f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:17.453918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-676814aa-142e-46dd-8dc7-d4a45f4ffb3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:17.570405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676814aa-142e-46dd-8dc7-d4a45f4ffb3f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:17.575876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21425532-4ea6-45a1-8218-52fea2309eff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:17.577436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21425532-4ea6-45a1-8218-52fea2309eff service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:17.577821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21425532-4ea6-45a1-8218-52fea2309eff service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:17.578756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21425532-4ea6-45a1-8218-52fea2309eff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:17.601097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21425532-4ea6-45a1-8218-52fea2309eff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:17.606132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21425532-4ea6-45a1-8218-52fea2309eff service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:17.646166 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1519/2992] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:18:19.763763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfe9fa-db0b-4474-ba61-229bab08476e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:19.764287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-56cfe9fa-db0b-4474-ba61-229bab08476e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:19.783284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfe9fa-db0b-4474-ba61-229bab08476e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:19.838076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae4795-08af-42f3-bf66-beffc54a2283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:19.851730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae4795-08af-42f3-bf66-beffc54a2283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:19.852022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae4795-08af-42f3-bf66-beffc54a2283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:19.852316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae4795-08af-42f3-bf66-beffc54a2283 admin admin] PATH_INFO: `/v3/projects/a7b6155e84f14a7880a1dcbc4b0452f8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:19.878427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae4795-08af-42f3-bf66-beffc54a2283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7b6155e84f14a7880a1dcbc4b0452f8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:19.880238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae4795-08af-42f3-bf66-beffc54a2283 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:19.882012 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:20.282812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2bae4795-08af-42f3-bf66-beffc54a2283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7b6155e84f14a7880a1dcbc4b0452f8', 'request_id': 'req-2bae4795-08af-42f3-bf66-beffc54a2283'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:20.434706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2bae4795-08af-42f3-bf66-beffc54a2283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7b6155e84f14a7880a1dcbc4b0452f8', 'request_id': 'req-2bae4795-08af-42f3-bf66-beffc54a2283'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:20.443745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2bae4795-08af-42f3-bf66-beffc54a2283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7b6155e84f14a7880a1dcbc4b0452f8', 'request_id': 'req-2bae4795-08af-42f3-bf66-beffc54a2283'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:20.520077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2bae4795-08af-42f3-bf66-beffc54a2283 admin admin] The token cache is being invalidate because project a7b6155e84f14a7880a1dcbc4b0452f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:18:20.520713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2bae4795-08af-42f3-bf66-beffc54a2283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:20.521709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2bae4795-08af-42f3-bf66-beffc54a2283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:20.524501 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1474/2993] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:18:19 2022] DELETE /identity/v3/projects/a7b6155e84f14a7880a1dcbc4b0452f8 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:20.528491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21425532-4ea6-45a1-8218-52fea2309eff service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:20.539125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21425532-4ea6-45a1-8218-52fea2309eff service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:20.868995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc90c0-c761-4a2f-a9db-195d919c089b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:20.870815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc90c0-c761-4a2f-a9db-195d919c089b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:20.871883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc90c0-c761-4a2f-a9db-195d919c089b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:20.872369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc90c0-c761-4a2f-a9db-195d919c089b admin admin] PATH_INFO: `/v3/users/4b7f4c04ce9a4625973d3d77d67bdab6` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:20.874762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc90c0-c761-4a2f-a9db-195d919c089b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b7f4c04ce9a4625973d3d77d67bdab6)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:20.880479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc90c0-c761-4a2f-a9db-195d919c089b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:21.036062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9c3de-492f-4e08-895f-3c9d025612aa None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:21.037119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9c3de-492f-4e08-895f-3c9d025612aa None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:21.037592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9c3de-492f-4e08-895f-3c9d025612aa None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:21.041237 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1475/2994] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:18:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:18:21.051223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be17f8d-94dc-477e-913e-11e7fd482ebf None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:21.051809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be17f8d-94dc-477e-913e-11e7fd482ebf None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:21.053015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be17f8d-94dc-477e-913e-11e7fd482ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:21.081769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0be17f8d-94dc-477e-913e-11e7fd482ebf None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:21.083092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0be17f8d-94dc-477e-913e-11e7fd482ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:21.178394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a9dc90c0-c761-4a2f-a9db-195d919c089b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b7f4c04ce9a4625973d3d77d67bdab6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:21.227712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a9dc90c0-c761-4a2f-a9db-195d919c089b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b7f4c04ce9a4625973d3d77d67bdab6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:21.256750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a9dc90c0-c761-4a2f-a9db-195d919c089b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b7f4c04ce9a4625973d3d77d67bdab6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:21.262650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a9dc90c0-c761-4a2f-a9db-195d919c089b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b7f4c04ce9a4625973d3d77d67bdab6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:21.302352 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1476/2995] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:18:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:18:21.335674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be17f8d-94dc-477e-913e-11e7fd482ebf None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:21.339125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0be17f8d-94dc-477e-913e-11e7fd482ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:21.354701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a9dc90c0-c761-4a2f-a9db-195d919c089b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b7f4c04ce9a4625973d3d77d67bdab6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:21.356455 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:21.371005 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1520/2996] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:18:20 2022] DELETE /identity/v3/users/4b7f4c04ce9a4625973d3d77d67bdab6 => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:21.372006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be17f8d-94dc-477e-913e-11e7fd482ebf None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:21.436102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec810b8d-d604-4cd4-b46e-27c57a05334c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:21.436230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec810b8d-d604-4cd4-b46e-27c57a05334c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:21.436473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec810b8d-d604-4cd4-b46e-27c57a05334c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:21.497128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ec810b8d-d604-4cd4-b46e-27c57a05334c None None] MFA Rules not processed for user `d3a1bc0c85b0488183eaebfe740614b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:21.502061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ec810b8d-d604-4cd4-b46e-27c57a05334c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:21.565638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccac6f-e653-4fa6-93d2-53005c866065 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:21.565638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccac6f-e653-4fa6-93d2-53005c866065 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:21.565638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccac6f-e653-4fa6-93d2-53005c866065 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:21.565638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ccac6f-e653-4fa6-93d2-53005c866065 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:21.569414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b2ccac6f-e653-4fa6-93d2-53005c866065 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:21.612752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccac6f-e653-4fa6-93d2-53005c866065 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:21.622816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ccac6f-e653-4fa6-93d2-53005c866065 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:21.682494 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1477/2997] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:18:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:18:21.807926 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1521/2998] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:18:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:18:22.324186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccac6f-e653-4fa6-93d2-53005c866065 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:22.333573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b2ccac6f-e653-4fa6-93d2-53005c866065 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:22.363176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ccac6f-e653-4fa6-93d2-53005c866065 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:22.384346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b234cb8-6fa2-430a-816a-a9f11530cad8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:22.384346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b234cb8-6fa2-430a-816a-a9f11530cad8 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:22.384346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b234cb8-6fa2-430a-816a-a9f11530cad8 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:22.384346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b234cb8-6fa2-430a-816a-a9f11530cad8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:22.388867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5b234cb8-6fa2-430a-816a-a9f11530cad8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:22.421655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b234cb8-6fa2-430a-816a-a9f11530cad8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:22.424069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b234cb8-6fa2-430a-816a-a9f11530cad8 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:22.457030 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1478/2999] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:18:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:18:23.049111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec810b8d-d604-4cd4-b46e-27c57a05334c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:23.051781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ec810b8d-d604-4cd4-b46e-27c57a05334c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:23.212476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec810b8d-d604-4cd4-b46e-27c57a05334c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:23.222200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96647db-ae37-4cc0-b391-dfe16d1032a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:23.224787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96647db-ae37-4cc0-b391-dfe16d1032a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:23.224787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96647db-ae37-4cc0-b391-dfe16d1032a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:23.224787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96647db-ae37-4cc0-b391-dfe16d1032a6 admin admin] PATH_INFO: `/v3/projects/5bd426d913e94be8b73169e28cbf4139` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:23.226226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96647db-ae37-4cc0-b391-dfe16d1032a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bd426d913e94be8b73169e28cbf4139)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:23.228949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96647db-ae37-4cc0-b391-dfe16d1032a6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:23.361672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b234cb8-6fa2-430a-816a-a9f11530cad8 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:23.363708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5b234cb8-6fa2-430a-816a-a9f11530cad8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:23.370435 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:23.404305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e96647db-ae37-4cc0-b391-dfe16d1032a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bd426d913e94be8b73169e28cbf4139', 'request_id': 'req-e96647db-ae37-4cc0-b391-dfe16d1032a6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:23.417600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e96647db-ae37-4cc0-b391-dfe16d1032a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bd426d913e94be8b73169e28cbf4139', 'request_id': 'req-e96647db-ae37-4cc0-b391-dfe16d1032a6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:23.434260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e96647db-ae37-4cc0-b391-dfe16d1032a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bd426d913e94be8b73169e28cbf4139', 'request_id': 'req-e96647db-ae37-4cc0-b391-dfe16d1032a6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:23.543748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e96647db-ae37-4cc0-b391-dfe16d1032a6 admin admin] The token cache is being invalidate because project 5bd426d913e94be8b73169e28cbf4139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:18:23.548449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e96647db-ae37-4cc0-b391-dfe16d1032a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:23.548449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e96647db-ae37-4cc0-b391-dfe16d1032a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:23.549018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b234cb8-6fa2-430a-816a-a9f11530cad8 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:23.549765 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1522/3000] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:18:23 2022] DELETE /identity/v3/projects/5bd426d913e94be8b73169e28cbf4139 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:23.554804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b1d99-a779-414f-ab85-0d924631e6d9 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:23.555758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b1d99-a779-414f-ab85-0d924631e6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:23.556204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b1d99-a779-414f-ab85-0d924631e6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:23.600216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9b2b1d99-a779-414f-ab85-0d924631e6d9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:23.601856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9b2b1d99-a779-414f-ab85-0d924631e6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:23.673456 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:23.694828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0435f-5d40-49ca-92f3-2f5b7ddfe799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:23.695573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0435f-5d40-49ca-92f3-2f5b7ddfe799 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:23.695863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0435f-5d40-49ca-92f3-2f5b7ddfe799 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:23.696147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d0435f-5d40-49ca-92f3-2f5b7ddfe799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:23.703423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f6d0435f-5d40-49ca-92f3-2f5b7ddfe799 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:23.775706 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1523/3001] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:18:23.791470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2643d-39f0-4c83-9e04-c442cdb785be None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:23.792821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2643d-39f0-4c83-9e04-c442cdb785be None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:23.796913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2643d-39f0-4c83-9e04-c442cdb785be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:23.839715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0435f-5d40-49ca-92f3-2f5b7ddfe799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:23.841278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d0435f-5d40-49ca-92f3-2f5b7ddfe799 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:23.856469 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1479/3002] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:18:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:18:23.858529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-61c2643d-39f0-4c83-9e04-c442cdb785be None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:23.861988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-61c2643d-39f0-4c83-9e04-c442cdb785be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:23.887700 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1524/3003] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:18:23.893462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0435f-5d40-49ca-92f3-2f5b7ddfe799 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:23.910423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d0435f-5d40-49ca-92f3-2f5b7ddfe799 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:23.924117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a642f7-3255-4768-9af2-2bcf5bfef359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:23.925832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a642f7-3255-4768-9af2-2bcf5bfef359 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:23.926696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a642f7-3255-4768-9af2-2bcf5bfef359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:23.927058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a642f7-3255-4768-9af2-2bcf5bfef359 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:23.928918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a642f7-3255-4768-9af2-2bcf5bfef359 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:18:23.930493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a642f7-3255-4768-9af2-2bcf5bfef359 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:23.936282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a642f7-3255-4768-9af2-2bcf5bfef359 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:23.960136 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1480/3004] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:18:23.965068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2643d-39f0-4c83-9e04-c442cdb785be None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:23.979479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2643d-39f0-4c83-9e04-c442cdb785be None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:23.990490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8376f1d-d59b-4b9a-960b-dc29ec1a16bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:23.991436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8376f1d-d59b-4b9a-960b-dc29ec1a16bb admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:23.992163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8376f1d-d59b-4b9a-960b-dc29ec1a16bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:23.992497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8376f1d-d59b-4b9a-960b-dc29ec1a16bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:23.993203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8376f1d-d59b-4b9a-960b-dc29ec1a16bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:23.996496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8376f1d-d59b-4b9a-960b-dc29ec1a16bb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:24.034164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a642f7-3255-4768-9af2-2bcf5bfef359 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:24.035357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-42a642f7-3255-4768-9af2-2bcf5bfef359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:24.061102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a642f7-3255-4768-9af2-2bcf5bfef359 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:24.074923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0836628-450b-4363-8747-a8014eb3b928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:24.077032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0836628-450b-4363-8747-a8014eb3b928 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:24.077032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0836628-450b-4363-8747-a8014eb3b928 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:24.078967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0836628-450b-4363-8747-a8014eb3b928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:24.083087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b0836628-450b-4363-8747-a8014eb3b928 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:24.108013 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1525/3005] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:18:23 2022] POST /identity/v3/projects => generated 375 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:18:24.110140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0836628-450b-4363-8747-a8014eb3b928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:24.112946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8376f1d-d59b-4b9a-960b-dc29ec1a16bb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:24.113861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0836628-450b-4363-8747-a8014eb3b928 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:24.135919 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1481/3006] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:18:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:18:24.291104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8376f1d-d59b-4b9a-960b-dc29ec1a16bb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:24.304871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa98b9-bc75-49b2-aa5e-087a966f2980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:24.305576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa98b9-bc75-49b2-aa5e-087a966f2980 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:24.305866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa98b9-bc75-49b2-aa5e-087a966f2980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:24.306175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa98b9-bc75-49b2-aa5e-087a966f2980 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:24.312281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa98b9-bc75-49b2-aa5e-087a966f2980 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:24.322031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa98b9-bc75-49b2-aa5e-087a966f2980 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:24.468728 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1526/3007] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:18:24 2022] POST /identity/v3/users => generated 288 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:18:24.470349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0836628-450b-4363-8747-a8014eb3b928 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:24.490870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0836628-450b-4363-8747-a8014eb3b928 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:24.517557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee26436-8b06-4d6e-81e7-4b643dd7d192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:24.518370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee26436-8b06-4d6e-81e7-4b643dd7d192 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:24.518602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee26436-8b06-4d6e-81e7-4b643dd7d192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:24.518900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee26436-8b06-4d6e-81e7-4b643dd7d192 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:24.519651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee26436-8b06-4d6e-81e7-4b643dd7d192 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:24.521403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee26436-8b06-4d6e-81e7-4b643dd7d192 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:24.575914 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1482/3008] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:18:24.577662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa98b9-bc75-49b2-aa5e-087a966f2980 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:24.593230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa98b9-bc75-49b2-aa5e-087a966f2980 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:24.604741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a420e6c-e7ba-4a48-b300-bf54efd2e740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:24.606299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a420e6c-e7ba-4a48-b300-bf54efd2e740 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:24.606610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a420e6c-e7ba-4a48-b300-bf54efd2e740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:24.607040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a420e6c-e7ba-4a48-b300-bf54efd2e740 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:24.607645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a420e6c-e7ba-4a48-b300-bf54efd2e740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:24.613548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a420e6c-e7ba-4a48-b300-bf54efd2e740 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:24.637877 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1527/3009] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:18:24.643012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee26436-8b06-4d6e-81e7-4b643dd7d192 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:24.658379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee26436-8b06-4d6e-81e7-4b643dd7d192 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:24.670801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb68975-eea6-4ef3-86ac-0a79ee2316ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:24.671908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb68975-eea6-4ef3-86ac-0a79ee2316ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:24.672271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb68975-eea6-4ef3-86ac-0a79ee2316ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:24.672624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb68975-eea6-4ef3-86ac-0a79ee2316ee admin admin] PATH_INFO: `/v3/projects/0f0182f5bc064b78b55ee16d26c765c9/users/27d9a6f0b7f14233a871c4e010a21e48/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:24.742121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb68975-eea6-4ef3-86ac-0a79ee2316ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f0182f5bc064b78b55ee16d26c765c9, user_id=27d9a6f0b7f14233a871c4e010a21e48, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:24.754142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb68975-eea6-4ef3-86ac-0a79ee2316ee admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:24.852836 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:24.868380 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1483/3010] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:18:24 2022] PUT /identity/v3/projects/0f0182f5bc064b78b55ee16d26c765c9/users/27d9a6f0b7f14233a871c4e010a21e48/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:24.870161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba2099-90cd-45cb-9e82-1bf46c42a0eb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:24.870472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba2099-90cd-45cb-9e82-1bf46c42a0eb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:24.870763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba2099-90cd-45cb-9e82-1bf46c42a0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:24.945985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-baba2099-90cd-45cb-9e82-1bf46c42a0eb None None] MFA Rules not processed for user `27d9a6f0b7f14233a871c4e010a21e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:24.974653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-baba2099-90cd-45cb-9e82-1bf46c42a0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:25.175446 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1528/3011] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:18:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:18:25.180020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb68975-eea6-4ef3-86ac-0a79ee2316ee admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:25.481217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb68975-eea6-4ef3-86ac-0a79ee2316ee admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:25.519272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924f7dd-38fa-4d90-abcc-c6646dbd3e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:25.519272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924f7dd-38fa-4d90-abcc-c6646dbd3e18 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:25.519626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924f7dd-38fa-4d90-abcc-c6646dbd3e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:25.519788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924f7dd-38fa-4d90-abcc-c6646dbd3e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:25.520945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924f7dd-38fa-4d90-abcc-c6646dbd3e18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:25.529215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7924f7dd-38fa-4d90-abcc-c6646dbd3e18 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:25.701858 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1484/3012] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:18:25 2022] POST /identity/v3/projects => generated 375 bytes in 523 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:18:25.707099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba2099-90cd-45cb-9e82-1bf46c42a0eb None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:25.727033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba2099-90cd-45cb-9e82-1bf46c42a0eb None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:25.758788 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:25.926572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4d951-0c8b-43f9-8e9a-e0cab6a0600b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:25.927490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4d951-0c8b-43f9-8e9a-e0cab6a0600b admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:25.927974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4d951-0c8b-43f9-8e9a-e0cab6a0600b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:25.928756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4d951-0c8b-43f9-8e9a-e0cab6a0600b admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:25.929621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4d951-0c8b-43f9-8e9a-e0cab6a0600b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:25.932793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4d951-0c8b-43f9-8e9a-e0cab6a0600b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:26.221897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924f7dd-38fa-4d90-abcc-c6646dbd3e18 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:26.225327 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1529/3013] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:18:25 2022] POST /identity/v3/users => generated 294 bytes in 517 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:18:26.234969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7924f7dd-38fa-4d90-abcc-c6646dbd3e18 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:26.253306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e8af1-9f20-4bae-be1a-5d84f16bf498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:26.254344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e8af1-9f20-4bae-be1a-5d84f16bf498 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:26.254796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e8af1-9f20-4bae-be1a-5d84f16bf498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:26.255239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e8af1-9f20-4bae-be1a-5d84f16bf498 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:26.256234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e8af1-9f20-4bae-be1a-5d84f16bf498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:26.258052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e8af1-9f20-4bae-be1a-5d84f16bf498 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:26.290814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4d951-0c8b-43f9-8e9a-e0cab6a0600b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:26.291497 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1485/3014] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:18:26.305762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4d951-0c8b-43f9-8e9a-e0cab6a0600b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:26.321274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdf72f-5927-415d-afd5-737c03bfe679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:26.330078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdf72f-5927-415d-afd5-737c03bfe679 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:26.330596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdf72f-5927-415d-afd5-737c03bfe679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:26.331040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdf72f-5927-415d-afd5-737c03bfe679 admin admin] PATH_INFO: `/v3/projects/dd045d1a75fc4521af7d323b6ead7f22/users/e48b9269c1a94b3ead5ed94f633862d5/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:26.367947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bdf72f-5927-415d-afd5-737c03bfe679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd045d1a75fc4521af7d323b6ead7f22, user_id=e48b9269c1a94b3ead5ed94f633862d5, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:26.370690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bdf72f-5927-415d-afd5-737c03bfe679 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:26.456998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e8af1-9f20-4bae-be1a-5d84f16bf498 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:26.457833 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1530/3015] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:18:26 2022] PUT /identity/v3/projects/dd045d1a75fc4521af7d323b6ead7f22/users/e48b9269c1a94b3ead5ed94f633862d5/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:26.468057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e8af1-9f20-4bae-be1a-5d84f16bf498 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:26.603041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcb8878-edbe-4fa6-8814-24577d6ab665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:26.604488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb8878-edbe-4fa6-8814-24577d6ab665 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:26.604944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb8878-edbe-4fa6-8814-24577d6ab665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:26.605391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcb8878-edbe-4fa6-8814-24577d6ab665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:26.606363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb8878-edbe-4fa6-8814-24577d6ab665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:26.608187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcb8878-edbe-4fa6-8814-24577d6ab665 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:26.632384 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1486/3016] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:18:26 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:18:26.636750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdf72f-5927-415d-afd5-737c03bfe679 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:26.655902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdf72f-5927-415d-afd5-737c03bfe679 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:26.670154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf5150-d35e-4280-9858-a56919a0c27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:26.671653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf5150-d35e-4280-9858-a56919a0c27e admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:26.672607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf5150-d35e-4280-9858-a56919a0c27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:26.673066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf5150-d35e-4280-9858-a56919a0c27e admin admin] PATH_INFO: `/v3/projects/dd045d1a75fc4521af7d323b6ead7f22/users/e48b9269c1a94b3ead5ed94f633862d5/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:26.675350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf5150-d35e-4280-9858-a56919a0c27e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd045d1a75fc4521af7d323b6ead7f22, user_id=e48b9269c1a94b3ead5ed94f633862d5, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:26.678757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf5150-d35e-4280-9858-a56919a0c27e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:26.703777 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1531/3017] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:18:26 2022] PUT /identity/v3/projects/dd045d1a75fc4521af7d323b6ead7f22/users/e48b9269c1a94b3ead5ed94f633862d5/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:26.716181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad22f9-8d0e-47c3-8368-404d5eccbc1a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:26.717335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad22f9-8d0e-47c3-8368-404d5eccbc1a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:26.717811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad22f9-8d0e-47c3-8368-404d5eccbc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:26.775840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6dad22f9-8d0e-47c3-8368-404d5eccbc1a None None] MFA Rules not processed for user `e48b9269c1a94b3ead5ed94f633862d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:26.777326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6dad22f9-8d0e-47c3-8368-404d5eccbc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:26.901474 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:26.921614 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1487/3018] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:18:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:18:26.930887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf5150-d35e-4280-9858-a56919a0c27e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:26.956699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf5150-d35e-4280-9858-a56919a0c27e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:26.971047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f563ae5-a8e6-4ded-91b1-b59a444bfc6d tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:26.972032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f563ae5-a8e6-4ded-91b1-b59a444bfc6d tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:26.980417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f563ae5-a8e6-4ded-91b1-b59a444bfc6d tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:26.980417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f563ae5-a8e6-4ded-91b1-b59a444bfc6d tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:26.980417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f563ae5-a8e6-4ded-91b1-b59a444bfc6d tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:18:26.980417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f563ae5-a8e6-4ded-91b1-b59a444bfc6d tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:26.980417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f563ae5-a8e6-4ded-91b1-b59a444bfc6d tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:27.002976 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1532/3019] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:18:27.007655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad22f9-8d0e-47c3-8368-404d5eccbc1a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:27.024865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad22f9-8d0e-47c3-8368-404d5eccbc1a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:27.030765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0300cc-dd70-4a3b-9d3e-8462adbf181b tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:27.032430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0300cc-dd70-4a3b-9d3e-8462adbf181b tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:27.032932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0300cc-dd70-4a3b-9d3e-8462adbf181b tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:27.033454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0300cc-dd70-4a3b-9d3e-8462adbf181b tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:27.034386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0300cc-dd70-4a3b-9d3e-8462adbf181b tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:27.040838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0300cc-dd70-4a3b-9d3e-8462adbf181b tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:27.161468 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1488/3020] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:18:27 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:18:27.165579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f563ae5-a8e6-4ded-91b1-b59a444bfc6d tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:27.182176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f563ae5-a8e6-4ded-91b1-b59a444bfc6d tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:27.323607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50703d-0352-4be3-9e20-dfbeda093263 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:27.324478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50703d-0352-4be3-9e20-dfbeda093263 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:27.324926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50703d-0352-4be3-9e20-dfbeda093263 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:27.325320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50703d-0352-4be3-9e20-dfbeda093263 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:27.326211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50703d-0352-4be3-9e20-dfbeda093263 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:18:27.326650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50703d-0352-4be3-9e20-dfbeda093263 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:27.330988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a50703d-0352-4be3-9e20-dfbeda093263 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:27.362134 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1533/3021] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:18:27.863994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0300cc-dd70-4a3b-9d3e-8462adbf181b tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:27.866525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0d0300cc-dd70-4a3b-9d3e-8462adbf181b tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:28.032839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0300cc-dd70-4a3b-9d3e-8462adbf181b tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:28.042139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d13d9-06d3-4f70-be88-6007de868330 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:28.043014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d13d9-06d3-4f70-be88-6007de868330 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:28.043416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d13d9-06d3-4f70-be88-6007de868330 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:28.043803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d13d9-06d3-4f70-be88-6007de868330 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:28.069610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d13d9-06d3-4f70-be88-6007de868330 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:28.071586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d13d9-06d3-4f70-be88-6007de868330 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:28.099256 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1489/3022] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:18:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:18:28.156866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0fbe2-be44-42fc-bd9f-196862d8f974 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:28.157436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0fbe2-be44-42fc-bd9f-196862d8f974 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:28.158601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0fbe2-be44-42fc-bd9f-196862d8f974 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:28.163152 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1534/3023] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:18:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:18:28.189074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d13d9-06d3-4f70-be88-6007de868330 service nova] Authenticating service token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:18:28.219147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d13d9-06d3-4f70-be88-6007de868330 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:28.264744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d13d9-06d3-4f70-be88-6007de868330 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:28.292353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de882634-394b-471f-bd97-9b91d792cc23 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:28.293124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de882634-394b-471f-bd97-9b91d792cc23 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:28.293501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de882634-394b-471f-bd97-9b91d792cc23 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:28.293839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de882634-394b-471f-bd97-9b91d792cc23 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/projects/40f6929da2d8417997f40f256ab98bf9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:28.303962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de882634-394b-471f-bd97-9b91d792cc23 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:get_project(project_id=40f6929da2d8417997f40f256ab98bf9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:28.303962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de882634-394b-471f-bd97-9b91d792cc23 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:28.303962 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1490/3024] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:18:28 2022] GET /identity/v3/projects/40f6929da2d8417997f40f256ab98bf9 => generated 371 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:18:28.534224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9992151-2fd5-4523-8047-92409ec0bbda None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:28.534700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9992151-2fd5-4523-8047-92409ec0bbda None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:28.534966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9992151-2fd5-4523-8047-92409ec0bbda None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:28.536583 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1535/3025] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:18:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:18:28.555432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de882634-394b-471f-bd97-9b91d792cc23 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating service token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:18:28.585217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de882634-394b-471f-bd97-9b91d792cc23 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:28.621415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de882634-394b-471f-bd97-9b91d792cc23 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:28.648078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679c84b-85d0-4d39-957c-ac14e3749a8a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:28.649401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679c84b-85d0-4d39-957c-ac14e3749a8a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:28.650607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679c84b-85d0-4d39-957c-ac14e3749a8a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:28.651945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679c84b-85d0-4d39-957c-ac14e3749a8a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/projects/40f6929da2d8417997f40f256ab98bf9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:28.665866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679c84b-85d0-4d39-957c-ac14e3749a8a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:get_project(project_id=40f6929da2d8417997f40f256ab98bf9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:28.677697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679c84b-85d0-4d39-957c-ac14e3749a8a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:28.700677 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1491/3026] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:18:28 2022] GET /identity/v3/projects/40f6929da2d8417997f40f256ab98bf9 => generated 371 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:18:30.087196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f42666-d25f-4957-88eb-932720b577f4 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:30.087698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f42666-d25f-4957-88eb-932720b577f4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:30.087825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f42666-d25f-4957-88eb-932720b577f4 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:30.089290 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1536/3027] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:18:30.094799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679c84b-85d0-4d39-957c-ac14e3749a8a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating service token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:18:30.119863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679c84b-85d0-4d39-957c-ac14e3749a8a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:30.132960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679c84b-85d0-4d39-957c-ac14e3749a8a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:30.141259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223acd91-183e-4bb0-ba30-425746afd233 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:30.142712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223acd91-183e-4bb0-ba30-425746afd233 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:30.143426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223acd91-183e-4bb0-ba30-425746afd233 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:30.144002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223acd91-183e-4bb0-ba30-425746afd233 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/projects/40f6929da2d8417997f40f256ab98bf9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:30.145608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223acd91-183e-4bb0-ba30-425746afd233 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:get_project(project_id=40f6929da2d8417997f40f256ab98bf9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:30.148132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223acd91-183e-4bb0-ba30-425746afd233 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:30.151278 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1492/3028] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:18:30 2022] GET /identity/v3/projects/40f6929da2d8417997f40f256ab98bf9 => generated 371 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:18:30.179984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f42666-d25f-4957-88eb-932720b577f4 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:30.202865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f42666-d25f-4957-88eb-932720b577f4 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:30.206211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cf967-4e26-46ee-b8c8-6b3702d76e3a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:30.207375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cf967-4e26-46ee-b8c8-6b3702d76e3a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:30.207894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cf967-4e26-46ee-b8c8-6b3702d76e3a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:30.208398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cf967-4e26-46ee-b8c8-6b3702d76e3a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/projects/40f6929da2d8417997f40f256ab98bf9` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:30.210790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cf967-4e26-46ee-b8c8-6b3702d76e3a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:delete_project(project_id=40f6929da2d8417997f40f256ab98bf9)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:30.212952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cf967-4e26-46ee-b8c8-6b3702d76e3a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:30.352318 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:30.361232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a83cf967-4e26-46ee-b8c8-6b3702d76e3a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40f6929da2d8417997f40f256ab98bf9', 'request_id': 'req-a83cf967-4e26-46ee-b8c8-6b3702d76e3a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:30.366949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a83cf967-4e26-46ee-b8c8-6b3702d76e3a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40f6929da2d8417997f40f256ab98bf9', 'request_id': 'req-a83cf967-4e26-46ee-b8c8-6b3702d76e3a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:30.411609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a83cf967-4e26-46ee-b8c8-6b3702d76e3a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40f6929da2d8417997f40f256ab98bf9', 'request_id': 'req-a83cf967-4e26-46ee-b8c8-6b3702d76e3a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:30.591463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a83cf967-4e26-46ee-b8c8-6b3702d76e3a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] The token cache is being invalidate because project 40f6929da2d8417997f40f256ab98bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:18:30.591765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a83cf967-4e26-46ee-b8c8-6b3702d76e3a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:30.592740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a83cf967-4e26-46ee-b8c8-6b3702d76e3a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:30.595958 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1537/3029] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:18:30 2022] DELETE /identity/v3/projects/40f6929da2d8417997f40f256ab98bf9 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:30.600986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600a690-138c-4e87-a87f-8e53d1c4290d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:30.613454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600a690-138c-4e87-a87f-8e53d1c4290d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:30.613454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600a690-138c-4e87-a87f-8e53d1c4290d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:30.658984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d600a690-138c-4e87-a87f-8e53d1c4290d None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:30.660185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d600a690-138c-4e87-a87f-8e53d1c4290d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:30.774408 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1493/3030] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:18:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:18:30.817063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cabff7-da3d-40a5-b6bb-1af7533e6595 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:30.818517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cf967-4e26-46ee-b8c8-6b3702d76e3a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:30.825984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cabff7-da3d-40a5-b6bb-1af7533e6595 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:30.825984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cabff7-da3d-40a5-b6bb-1af7533e6595 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:30.825984 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1494/3031] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:18:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 14:18:30.826434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a83cf967-4e26-46ee-b8c8-6b3702d76e3a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:30.837876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cabff7-da3d-40a5-b6bb-1af7533e6595 None None] Authenticating service token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:18:30.840179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d3cabff7-da3d-40a5-b6bb-1af7533e6595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:30.923590 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:30.995670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cabff7-da3d-40a5-b6bb-1af7533e6595 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:30.998168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d3cabff7-da3d-40a5-b6bb-1af7533e6595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:31.045579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cf967-4e26-46ee-b8c8-6b3702d76e3a tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:31.071246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c823e-c8c7-42d3-be84-b1dda3a34a89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:31.084517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c823e-c8c7-42d3-be84-b1dda3a34a89 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:31.085361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c823e-c8c7-42d3-be84-b1dda3a34a89 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:31.086090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c823e-c8c7-42d3-be84-b1dda3a34a89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:31.119292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c823e-c8c7-42d3-be84-b1dda3a34a89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:31.123592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c823e-c8c7-42d3-be84-b1dda3a34a89 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:31.150052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cabff7-da3d-40a5-b6bb-1af7533e6595 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:31.152271 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1538/3032] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:18:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:18:31.163294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65dccd0-41e6-40e3-8b98-c6bbde398f2f tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:31.168506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dccd0-41e6-40e3-8b98-c6bbde398f2f tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:31.169083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dccd0-41e6-40e3-8b98-c6bbde398f2f tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:31.169688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65dccd0-41e6-40e3-8b98-c6bbde398f2f tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/projects/0f0182f5bc064b78b55ee16d26c765c9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:31.177825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65dccd0-41e6-40e3-8b98-c6bbde398f2f tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:get_project(project_id=0f0182f5bc064b78b55ee16d26c765c9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:31.178913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65dccd0-41e6-40e3-8b98-c6bbde398f2f tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:31.190394 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1495/3033] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:18:30 2022] GET /identity/v3/projects/0f0182f5bc064b78b55ee16d26c765c9 => generated 375 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:18:31.205546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c823e-c8c7-42d3-be84-b1dda3a34a89 service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:31.230567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c823e-c8c7-42d3-be84-b1dda3a34a89 service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:31.241261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ee308-e040-4fdc-86e8-707dd1d23a81 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:31.241261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ee308-e040-4fdc-86e8-707dd1d23a81 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:31.241261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ee308-e040-4fdc-86e8-707dd1d23a81 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:31.241570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ee308-e040-4fdc-86e8-707dd1d23a81 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:31.241570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ee308-e040-4fdc-86e8-707dd1d23a81 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:18:31.241570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ee308-e040-4fdc-86e8-707dd1d23a81 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:31.241825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ee308-e040-4fdc-86e8-707dd1d23a81 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:31.261499 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1539/3034] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:18:31.267542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65dccd0-41e6-40e3-8b98-c6bbde398f2f tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:31.291906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65dccd0-41e6-40e3-8b98-c6bbde398f2f tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:31.318646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ad4a80-e7d2-4bbf-8f90-175628ab0aa7 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:31.323349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad4a80-e7d2-4bbf-8f90-175628ab0aa7 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:31.323349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad4a80-e7d2-4bbf-8f90-175628ab0aa7 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:31.323349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ad4a80-e7d2-4bbf-8f90-175628ab0aa7 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:31.323349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad4a80-e7d2-4bbf-8f90-175628ab0aa7 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:31.326358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ad4a80-e7d2-4bbf-8f90-175628ab0aa7 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:31.496141 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1496/3035] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:18:31 2022] POST /identity/v3/projects => generated 369 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:18:31.500773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ee308-e040-4fdc-86e8-707dd1d23a81 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:31.525235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ee308-e040-4fdc-86e8-707dd1d23a81 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:31.620192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f169b-cbc9-47b7-b0bb-9dff231adb98 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:31.621264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f169b-cbc9-47b7-b0bb-9dff231adb98 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:31.621758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f169b-cbc9-47b7-b0bb-9dff231adb98 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:31.622297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f169b-cbc9-47b7-b0bb-9dff231adb98 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:31.623335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f169b-cbc9-47b7-b0bb-9dff231adb98 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:18:31.623852 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f169b-cbc9-47b7-b0bb-9dff231adb98 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:31.629019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f169b-cbc9-47b7-b0bb-9dff231adb98 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:31.642412 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1540/3036] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:18:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:18:32.569468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769cce7-f204-4190-8dd1-a9e5b2cf7c0d None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:32.571159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769cce7-f204-4190-8dd1-a9e5b2cf7c0d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:32.576283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8769cce7-f204-4190-8dd1-a9e5b2cf7c0d None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:32.576283 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1497/3037] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:18:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:18:32.597611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f169b-cbc9-47b7-b0bb-9dff231adb98 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:18:32.601334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b45f169b-cbc9-47b7-b0bb-9dff231adb98 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:32.773122 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:32.829484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f169b-cbc9-47b7-b0bb-9dff231adb98 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:32.839558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f169b-cbc9-47b7-b0bb-9dff231adb98 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:32.845670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6ab75-1411-40e4-8197-f2a5cc1cfca8 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:32.846968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6ab75-1411-40e4-8197-f2a5cc1cfca8 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:32.847475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6ab75-1411-40e4-8197-f2a5cc1cfca8 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:32.847953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6ab75-1411-40e4-8197-f2a5cc1cfca8 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/projects/1672fdb09e6146258519d94efbfe93be` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:32.849857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6ab75-1411-40e4-8197-f2a5cc1cfca8 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:get_project(project_id=1672fdb09e6146258519d94efbfe93be)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:32.852044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6ab75-1411-40e4-8197-f2a5cc1cfca8 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:32.854314 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1541/3038] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:18:32 2022] GET /identity/v3/projects/1672fdb09e6146258519d94efbfe93be => generated 369 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:18:33.351261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e23b74-5954-48ab-8c01-1fe0095f04f6 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:33.351624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e23b74-5954-48ab-8c01-1fe0095f04f6 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:33.351954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e23b74-5954-48ab-8c01-1fe0095f04f6 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:33.353868 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1498/3039] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:18:33.360263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6ab75-1411-40e4-8197-f2a5cc1cfca8 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:18:33.380263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6ab75-1411-40e4-8197-f2a5cc1cfca8 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:33.410056 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6ab75-1411-40e4-8197-f2a5cc1cfca8 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:33.415351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c464af-463c-490a-a144-c1955a18c78e tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:33.416267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c464af-463c-490a-a144-c1955a18c78e tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:33.416556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c464af-463c-490a-a144-c1955a18c78e tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:33.416868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c464af-463c-490a-a144-c1955a18c78e tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/projects/1672fdb09e6146258519d94efbfe93be` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:33.418139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c464af-463c-490a-a144-c1955a18c78e tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:get_project(project_id=1672fdb09e6146258519d94efbfe93be)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:33.420693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c464af-463c-490a-a144-c1955a18c78e tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:33.424411 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1542/3040] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:18:33 2022] GET /identity/v3/projects/1672fdb09e6146258519d94efbfe93be => generated 369 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:18:33.471509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e23b74-5954-48ab-8c01-1fe0095f04f6 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:33.488145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e23b74-5954-48ab-8c01-1fe0095f04f6 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:33.494059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99b571-e538-4b45-8f86-b8146a88b485 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:33.494887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99b571-e538-4b45-8f86-b8146a88b485 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:33.495517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99b571-e538-4b45-8f86-b8146a88b485 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:33.495968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99b571-e538-4b45-8f86-b8146a88b485 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:33.496846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99b571-e538-4b45-8f86-b8146a88b485 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:18:33.497668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99b571-e538-4b45-8f86-b8146a88b485 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:33.499476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99b571-e538-4b45-8f86-b8146a88b485 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:33.514024 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1499/3041] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:18:33.520540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c464af-463c-490a-a144-c1955a18c78e tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:33.530381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c464af-463c-490a-a144-c1955a18c78e tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:33.536417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b9001-e7d3-4600-a243-1d5870abe5ed tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:33.538071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b9001-e7d3-4600-a243-1d5870abe5ed tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:33.538415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b9001-e7d3-4600-a243-1d5870abe5ed tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:33.538756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b9001-e7d3-4600-a243-1d5870abe5ed tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:33.540717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b9001-e7d3-4600-a243-1d5870abe5ed tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:33.542896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b9001-e7d3-4600-a243-1d5870abe5ed tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:33.704834 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1543/3042] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:18:33 2022] POST /identity/v3/users => generated 383 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:18:33.709007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99b571-e538-4b45-8f86-b8146a88b485 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:33.720706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99b571-e538-4b45-8f86-b8146a88b485 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:33.725808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b934be-b553-4a2d-82f9-592f864d2238 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:33.726869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b934be-b553-4a2d-82f9-592f864d2238 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:33.727257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b934be-b553-4a2d-82f9-592f864d2238 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:33.727542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b934be-b553-4a2d-82f9-592f864d2238 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:33.728470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b934be-b553-4a2d-82f9-592f864d2238 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:18:33.728777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b934be-b553-4a2d-82f9-592f864d2238 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:33.730388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b934be-b553-4a2d-82f9-592f864d2238 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:33.756253 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1500/3043] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:18:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:18:34.156849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95da08-f907-4b8b-8d0b-3aafbbbe5ef3 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:34.157500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95da08-f907-4b8b-8d0b-3aafbbbe5ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:34.157933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c95da08-f907-4b8b-8d0b-3aafbbbe5ef3 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:34.159552 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1544/3044] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:18:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:18:34.165332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b934be-b553-4a2d-82f9-592f864d2238 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating service token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:18:34.179915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b934be-b553-4a2d-82f9-592f864d2238 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:34.191397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b934be-b553-4a2d-82f9-592f864d2238 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:34.198625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8ae42-ac7b-4a93-bb77-7ccabce0e3e3 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:34.199891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8ae42-ac7b-4a93-bb77-7ccabce0e3e3 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:34.200473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8ae42-ac7b-4a93-bb77-7ccabce0e3e3 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:34.201052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b8ae42-ac7b-4a93-bb77-7ccabce0e3e3 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/projects/1672fdb09e6146258519d94efbfe93be` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:34.202949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8ae42-ac7b-4a93-bb77-7ccabce0e3e3 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:get_project(project_id=1672fdb09e6146258519d94efbfe93be)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:34.208632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b8ae42-ac7b-4a93-bb77-7ccabce0e3e3 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:34.211262 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1501/3045] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:18:34 2022] GET /identity/v3/projects/1672fdb09e6146258519d94efbfe93be => generated 369 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:18:34.945132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3ce44-0c4e-4420-af88-28b340b2e3d1 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:34.946810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3ce44-0c4e-4420-af88-28b340b2e3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:34.946810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3ce44-0c4e-4420-af88-28b340b2e3d1 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:34.949094 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1545/3046] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:18:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:18:34.955111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8ae42-ac7b-4a93-bb77-7ccabce0e3e3 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating service token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:18:34.983770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8ae42-ac7b-4a93-bb77-7ccabce0e3e3 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:34.985096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b8ae42-ac7b-4a93-bb77-7ccabce0e3e3 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:34.990530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a4c52-e98d-4570-872b-882515fae79e tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:34.991722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a4c52-e98d-4570-872b-882515fae79e tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:34.992014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a4c52-e98d-4570-872b-882515fae79e tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:34.992291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a4c52-e98d-4570-872b-882515fae79e tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/projects/1672fdb09e6146258519d94efbfe93be` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:34.994930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a4c52-e98d-4570-872b-882515fae79e tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:get_project(project_id=1672fdb09e6146258519d94efbfe93be)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:34.997751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a4c52-e98d-4570-872b-882515fae79e tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:35.000453 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1502/3047] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:18:34 2022] GET /identity/v3/projects/1672fdb09e6146258519d94efbfe93be => generated 369 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:18:35.040567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3ce44-0c4e-4420-af88-28b340b2e3d1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:35.055590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3ce44-0c4e-4420-af88-28b340b2e3d1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:35.060442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f06dc4-d11b-4568-a78a-5ce034909c83 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:35.061448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f06dc4-d11b-4568-a78a-5ce034909c83 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:35.061732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f06dc4-d11b-4568-a78a-5ce034909c83 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:35.062946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f06dc4-d11b-4568-a78a-5ce034909c83 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/users/7123fda64611457bb461b224c953bb5c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:35.079198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f06dc4-d11b-4568-a78a-5ce034909c83 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7123fda64611457bb461b224c953bb5c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:35.087249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f06dc4-d11b-4568-a78a-5ce034909c83 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:35.263499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-94f06dc4-d11b-4568-a78a-5ce034909c83 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7123fda64611457bb461b224c953bb5c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:35.281175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-94f06dc4-d11b-4568-a78a-5ce034909c83 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7123fda64611457bb461b224c953bb5c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:35.289954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-94f06dc4-d11b-4568-a78a-5ce034909c83 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7123fda64611457bb461b224c953bb5c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:35.290757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-94f06dc4-d11b-4568-a78a-5ce034909c83 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7123fda64611457bb461b224c953bb5c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:35.440050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-94f06dc4-d11b-4568-a78a-5ce034909c83 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7123fda64611457bb461b224c953bb5c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:35.447117 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1546/3048] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:18:35 2022] DELETE /identity/v3/users/7123fda64611457bb461b224c953bb5c => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:35.451119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a4c52-e98d-4570-872b-882515fae79e tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:35.452932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9c9a4c52-e98d-4570-872b-882515fae79e tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:35.465587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a4c52-e98d-4570-872b-882515fae79e tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:35.529876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535853d-fcdb-4a5f-9b77-bf0789625bb6 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:35.530829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535853d-fcdb-4a5f-9b77-bf0789625bb6 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:35.531707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535853d-fcdb-4a5f-9b77-bf0789625bb6 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:35.531990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535853d-fcdb-4a5f-9b77-bf0789625bb6 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/projects/1672fdb09e6146258519d94efbfe93be` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:35.533314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535853d-fcdb-4a5f-9b77-bf0789625bb6 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1672fdb09e6146258519d94efbfe93be)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:35.535361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535853d-fcdb-4a5f-9b77-bf0789625bb6 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:35.544741 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:35.693563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6535853d-fcdb-4a5f-9b77-bf0789625bb6 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1672fdb09e6146258519d94efbfe93be', 'request_id': 'req-6535853d-fcdb-4a5f-9b77-bf0789625bb6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:35.777396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6535853d-fcdb-4a5f-9b77-bf0789625bb6 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1672fdb09e6146258519d94efbfe93be', 'request_id': 'req-6535853d-fcdb-4a5f-9b77-bf0789625bb6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:35.786604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6535853d-fcdb-4a5f-9b77-bf0789625bb6 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1672fdb09e6146258519d94efbfe93be', 'request_id': 'req-6535853d-fcdb-4a5f-9b77-bf0789625bb6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:35.798858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6535853d-fcdb-4a5f-9b77-bf0789625bb6 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] The token cache is being invalidate because project 1672fdb09e6146258519d94efbfe93be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:18:35.799155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6535853d-fcdb-4a5f-9b77-bf0789625bb6 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:35.800017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6535853d-fcdb-4a5f-9b77-bf0789625bb6 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:35.807411 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1503/3049] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:18:35 2022] DELETE /identity/v3/projects/1672fdb09e6146258519d94efbfe93be => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:35.822068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360ecf8-cf52-4f64-9d08-9892d64133a4 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:35.822392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360ecf8-cf52-4f64-9d08-9892d64133a4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:35.822675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d360ecf8-cf52-4f64-9d08-9892d64133a4 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:35.824063 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1547/3050] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:18:35.830072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535853d-fcdb-4a5f-9b77-bf0789625bb6 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating service token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:18:35.831571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6535853d-fcdb-4a5f-9b77-bf0789625bb6 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:35.911210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535853d-fcdb-4a5f-9b77-bf0789625bb6 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:35.912769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6535853d-fcdb-4a5f-9b77-bf0789625bb6 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:35.980968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535853d-fcdb-4a5f-9b77-bf0789625bb6 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:35.985827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09148434-cc2f-424a-a2a4-22bd5af2fd6f tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:35.987680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09148434-cc2f-424a-a2a4-22bd5af2fd6f tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:35.987680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09148434-cc2f-424a-a2a4-22bd5af2fd6f tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:35.987680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09148434-cc2f-424a-a2a4-22bd5af2fd6f tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/projects/0f0182f5bc064b78b55ee16d26c765c9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:35.988568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09148434-cc2f-424a-a2a4-22bd5af2fd6f tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:get_project(project_id=0f0182f5bc064b78b55ee16d26c765c9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:35.990659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09148434-cc2f-424a-a2a4-22bd5af2fd6f tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:35.992413 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1504/3051] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:18:35 2022] GET /identity/v3/projects/0f0182f5bc064b78b55ee16d26c765c9 => generated 375 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:18:36.136904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4b060-58e7-4ced-808e-5b777090631d None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:36.137428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4b060-58e7-4ced-808e-5b777090631d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:36.137535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4b060-58e7-4ced-808e-5b777090631d None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:36.139100 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1548/3052] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:18:36.144300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09148434-cc2f-424a-a2a4-22bd5af2fd6f tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating service token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:18:36.146788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-09148434-cc2f-424a-a2a4-22bd5af2fd6f tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:36.163052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09148434-cc2f-424a-a2a4-22bd5af2fd6f tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:36.173170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09148434-cc2f-424a-a2a4-22bd5af2fd6f tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:36.184536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e1a98-e046-4681-aeeb-647295ab31d3 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:36.184536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e1a98-e046-4681-aeeb-647295ab31d3 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:36.184536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e1a98-e046-4681-aeeb-647295ab31d3 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:36.184864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e1a98-e046-4681-aeeb-647295ab31d3 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/projects/0f0182f5bc064b78b55ee16d26c765c9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:36.184864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e1a98-e046-4681-aeeb-647295ab31d3 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:get_project(project_id=0f0182f5bc064b78b55ee16d26c765c9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:36.184864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e1a98-e046-4681-aeeb-647295ab31d3 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:36.185380 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1505/3053] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:18:36 2022] GET /identity/v3/projects/0f0182f5bc064b78b55ee16d26c765c9 => generated 375 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:18:37.774320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d18e5d-cf57-438c-b9ff-4fba878a8078 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:37.774831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d18e5d-cf57-438c-b9ff-4fba878a8078 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:37.774967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d18e5d-cf57-438c-b9ff-4fba878a8078 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:37.776304 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1549/3054] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:18:37.783570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e1a98-e046-4681-aeeb-647295ab31d3 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating service token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:18:37.799812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e1a98-e046-4681-aeeb-647295ab31d3 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:37.810207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e1a98-e046-4681-aeeb-647295ab31d3 tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:37.816177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a603497-b575-4e60-9b8a-fbb8958c767b tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e48b9269c1a94b3ead5ed94f633862d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd045d1a75fc4521af7d323b6ead7f22', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:37.817516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a603497-b575-4e60-9b8a-fbb8958c767b tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:37.817796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a603497-b575-4e60-9b8a-fbb8958c767b tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:37.818082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a603497-b575-4e60-9b8a-fbb8958c767b tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] PATH_INFO: `/v3/projects/0f0182f5bc064b78b55ee16d26c765c9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:37.819360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a603497-b575-4e60-9b8a-fbb8958c767b tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorizing `identity:get_project(project_id=0f0182f5bc064b78b55ee16d26c765c9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:37.821445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a603497-b575-4e60-9b8a-fbb8958c767b tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:37.823493 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1506/3055] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:18:37 2022] GET /identity/v3/projects/0f0182f5bc064b78b55ee16d26c765c9 => generated 375 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:18:39.277431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaaff8-4b02-48f8-90cf-347bc2e2914f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:39.277955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaaff8-4b02-48f8-90cf-347bc2e2914f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:39.278078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaaff8-4b02-48f8-90cf-347bc2e2914f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:39.298945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1ddaaff8-4b02-48f8-90cf-347bc2e2914f None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:39.300483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1ddaaff8-4b02-48f8-90cf-347bc2e2914f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:39.368704 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1550/3056] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:18:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:18:39.390272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a603497-b575-4e60-9b8a-fbb8958c767b tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:39.393049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9a603497-b575-4e60-9b8a-fbb8958c767b tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:39.414828 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:39.471058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a603497-b575-4e60-9b8a-fbb8958c767b tempest-QuotasAdminTestJSON-1118675406 tempest-QuotasAdminTestJSON-1118675406-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:39.476468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9046579-6d60-4822-9c45-22f0d8438bca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:39.477132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9046579-6d60-4822-9c45-22f0d8438bca service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:39.477417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9046579-6d60-4822-9c45-22f0d8438bca service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:39.477695 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9046579-6d60-4822-9c45-22f0d8438bca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:39.487303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9046579-6d60-4822-9c45-22f0d8438bca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:39.492367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9046579-6d60-4822-9c45-22f0d8438bca service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:39.497987 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1507/3057] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:18:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 14:18:40.718775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaaff8-4b02-48f8-90cf-347bc2e2914f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:40.723009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1ddaaff8-4b02-48f8-90cf-347bc2e2914f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:40.746683 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:40.856329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaaff8-4b02-48f8-90cf-347bc2e2914f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:40.864654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a2cfa-c871-405a-b103-ed0023788365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:40.866932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a2cfa-c871-405a-b103-ed0023788365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:40.867487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a2cfa-c871-405a-b103-ed0023788365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:40.868045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9a2cfa-c871-405a-b103-ed0023788365 admin admin] PATH_INFO: `/v3/users/27d9a6f0b7f14233a871c4e010a21e48` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:40.870976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a2cfa-c871-405a-b103-ed0023788365 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27d9a6f0b7f14233a871c4e010a21e48)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:40.878437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9a2cfa-c871-405a-b103-ed0023788365 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:41.313365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4c9a2cfa-c871-405a-b103-ed0023788365 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27d9a6f0b7f14233a871c4e010a21e48'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:41.363271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4c9a2cfa-c871-405a-b103-ed0023788365 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27d9a6f0b7f14233a871c4e010a21e48'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:41.379566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4c9a2cfa-c871-405a-b103-ed0023788365 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27d9a6f0b7f14233a871c4e010a21e48'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:41.389895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4c9a2cfa-c871-405a-b103-ed0023788365 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27d9a6f0b7f14233a871c4e010a21e48'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:41.526310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4c9a2cfa-c871-405a-b103-ed0023788365 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27d9a6f0b7f14233a871c4e010a21e48'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:41.536071 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1551/3058] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:18:40 2022] DELETE /identity/v3/users/27d9a6f0b7f14233a871c4e010a21e48 => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:41.540708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71410cce-f4e3-4bcb-92cf-8ca41d5e5c2f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:41.541287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71410cce-f4e3-4bcb-92cf-8ca41d5e5c2f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:41.541462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71410cce-f4e3-4bcb-92cf-8ca41d5e5c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:41.608595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-71410cce-f4e3-4bcb-92cf-8ca41d5e5c2f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:41.611410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-71410cce-f4e3-4bcb-92cf-8ca41d5e5c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:41.733252 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1508/3059] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:18:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:18:41.796771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a2cfa-c871-405a-b103-ed0023788365 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:41.799018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4c9a2cfa-c871-405a-b103-ed0023788365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:41.893681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9a2cfa-c871-405a-b103-ed0023788365 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:41.905607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd6cb8-8153-4ed2-862a-7e4d961610ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:41.906357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd6cb8-8153-4ed2-862a-7e4d961610ed service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:41.906844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd6cb8-8153-4ed2-862a-7e4d961610ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:41.908114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd6cb8-8153-4ed2-862a-7e4d961610ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:41.934786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd6cb8-8153-4ed2-862a-7e4d961610ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:41.936576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd6cb8-8153-4ed2-862a-7e4d961610ed service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:41.959046 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1552/3060] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:18:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:18:43.938088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71410cce-f4e3-4bcb-92cf-8ca41d5e5c2f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:43.940718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-71410cce-f4e3-4bcb-92cf-8ca41d5e5c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:43.998337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71410cce-f4e3-4bcb-92cf-8ca41d5e5c2f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:44.017925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207281f-5bce-4d59-b9c5-93410c966332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:44.017925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207281f-5bce-4d59-b9c5-93410c966332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:44.017925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207281f-5bce-4d59-b9c5-93410c966332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:44.017925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7207281f-5bce-4d59-b9c5-93410c966332 admin admin] PATH_INFO: `/v3/projects/0f0182f5bc064b78b55ee16d26c765c9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:44.018402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207281f-5bce-4d59-b9c5-93410c966332 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f0182f5bc064b78b55ee16d26c765c9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:44.031365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7207281f-5bce-4d59-b9c5-93410c966332 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:44.255158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7207281f-5bce-4d59-b9c5-93410c966332 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f0182f5bc064b78b55ee16d26c765c9', 'request_id': 'req-7207281f-5bce-4d59-b9c5-93410c966332'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:44.350049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7207281f-5bce-4d59-b9c5-93410c966332 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f0182f5bc064b78b55ee16d26c765c9', 'request_id': 'req-7207281f-5bce-4d59-b9c5-93410c966332'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:44.360432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7207281f-5bce-4d59-b9c5-93410c966332 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f0182f5bc064b78b55ee16d26c765c9', 'request_id': 'req-7207281f-5bce-4d59-b9c5-93410c966332'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:44.379287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7207281f-5bce-4d59-b9c5-93410c966332 admin admin] The token cache is being invalidate because project 0f0182f5bc064b78b55ee16d26c765c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:18:44.379814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7207281f-5bce-4d59-b9c5-93410c966332 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:44.380977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7207281f-5bce-4d59-b9c5-93410c966332 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:44.391975 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1509/3061] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:18:43 2022] DELETE /identity/v3/projects/0f0182f5bc064b78b55ee16d26c765c9 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:44.396030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd6cb8-8153-4ed2-862a-7e4d961610ed service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:44.431927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd6cb8-8153-4ed2-862a-7e4d961610ed service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:44.484719 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:44.575466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352cbbb4-1d59-47f8-80e9-fd6812917c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:44.576865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cbbb4-1d59-47f8-80e9-fd6812917c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:44.577151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cbbb4-1d59-47f8-80e9-fd6812917c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:44.578061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352cbbb4-1d59-47f8-80e9-fd6812917c72 admin admin] PATH_INFO: `/v3/users/e48b9269c1a94b3ead5ed94f633862d5` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:44.580428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cbbb4-1d59-47f8-80e9-fd6812917c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e48b9269c1a94b3ead5ed94f633862d5)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:44.582406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352cbbb4-1d59-47f8-80e9-fd6812917c72 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:44.849305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-352cbbb4-1d59-47f8-80e9-fd6812917c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e48b9269c1a94b3ead5ed94f633862d5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:44.882886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-352cbbb4-1d59-47f8-80e9-fd6812917c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e48b9269c1a94b3ead5ed94f633862d5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:44.902844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-352cbbb4-1d59-47f8-80e9-fd6812917c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e48b9269c1a94b3ead5ed94f633862d5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:44.906883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-352cbbb4-1d59-47f8-80e9-fd6812917c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e48b9269c1a94b3ead5ed94f633862d5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:45.020072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-352cbbb4-1d59-47f8-80e9-fd6812917c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e48b9269c1a94b3ead5ed94f633862d5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:45.034856 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1553/3062] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:18:44 2022] DELETE /identity/v3/users/e48b9269c1a94b3ead5ed94f633862d5 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:46.799916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207281f-5bce-4d59-b9c5-93410c966332 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:46.801671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7207281f-5bce-4d59-b9c5-93410c966332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:46.823086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7207281f-5bce-4d59-b9c5-93410c966332 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:46.864778 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:46.902786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce05369a-4c67-4370-919c-fdcd952a687b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:46.903952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05369a-4c67-4370-919c-fdcd952a687b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:46.904435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05369a-4c67-4370-919c-fdcd952a687b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:46.905664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce05369a-4c67-4370-919c-fdcd952a687b admin admin] PATH_INFO: `/v3/projects/dd045d1a75fc4521af7d323b6ead7f22` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:46.907201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05369a-4c67-4370-919c-fdcd952a687b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd045d1a75fc4521af7d323b6ead7f22)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:46.910385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce05369a-4c67-4370-919c-fdcd952a687b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:47.223744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce05369a-4c67-4370-919c-fdcd952a687b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd045d1a75fc4521af7d323b6ead7f22', 'request_id': 'req-ce05369a-4c67-4370-919c-fdcd952a687b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:47.292615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce05369a-4c67-4370-919c-fdcd952a687b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd045d1a75fc4521af7d323b6ead7f22', 'request_id': 'req-ce05369a-4c67-4370-919c-fdcd952a687b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:47.302015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce05369a-4c67-4370-919c-fdcd952a687b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd045d1a75fc4521af7d323b6ead7f22', 'request_id': 'req-ce05369a-4c67-4370-919c-fdcd952a687b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:47.316515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce05369a-4c67-4370-919c-fdcd952a687b admin admin] The token cache is being invalidate because project dd045d1a75fc4521af7d323b6ead7f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:18:47.317106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce05369a-4c67-4370-919c-fdcd952a687b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:47.317936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce05369a-4c67-4370-919c-fdcd952a687b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:47.325628 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1510/3063] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:18:46 2022] DELETE /identity/v3/projects/dd045d1a75fc4521af7d323b6ead7f22 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:47.326990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168afc9-c773-4b5e-b8b1-394637fe5bd0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:47.327483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168afc9-c773-4b5e-b8b1-394637fe5bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:47.327765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c168afc9-c773-4b5e-b8b1-394637fe5bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:47.354378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c168afc9-c773-4b5e-b8b1-394637fe5bd0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:47.356156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c168afc9-c773-4b5e-b8b1-394637fe5bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:47.435852 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1554/3064] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:18:47.446933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99565ec5-c98e-4e8b-9486-691ff51f9bb9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:47.447859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99565ec5-c98e-4e8b-9486-691ff51f9bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:47.448655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99565ec5-c98e-4e8b-9486-691ff51f9bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:47.482632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-99565ec5-c98e-4e8b-9486-691ff51f9bb9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:47.485503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-99565ec5-c98e-4e8b-9486-691ff51f9bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:47.504262 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1511/3065] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:18:47.508854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168afc9-c773-4b5e-b8b1-394637fe5bd0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:47.522711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c168afc9-c773-4b5e-b8b1-394637fe5bd0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:47.539628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b55d7-96a6-414d-aa04-64e97c47d266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:47.540323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b55d7-96a6-414d-aa04-64e97c47d266 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:47.540609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b55d7-96a6-414d-aa04-64e97c47d266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:47.540895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b55d7-96a6-414d-aa04-64e97c47d266 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:47.541640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b55d7-96a6-414d-aa04-64e97c47d266 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:18:47.541958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b55d7-96a6-414d-aa04-64e97c47d266 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:47.543575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38b55d7-96a6-414d-aa04-64e97c47d266 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:47.563006 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1555/3066] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:18:47.568973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99565ec5-c98e-4e8b-9486-691ff51f9bb9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:47.584191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99565ec5-c98e-4e8b-9486-691ff51f9bb9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:47.594455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e55120-64ad-4c5d-8f21-ec0d9ccbe5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:47.596790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e55120-64ad-4c5d-8f21-ec0d9ccbe5f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:47.597856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e55120-64ad-4c5d-8f21-ec0d9ccbe5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:47.600970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e55120-64ad-4c5d-8f21-ec0d9ccbe5f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:47.600970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e55120-64ad-4c5d-8f21-ec0d9ccbe5f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:47.603991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e55120-64ad-4c5d-8f21-ec0d9ccbe5f1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:47.704885 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1512/3067] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:18:47 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:18:47.709523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b55d7-96a6-414d-aa04-64e97c47d266 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:47.733722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b55d7-96a6-414d-aa04-64e97c47d266 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:47.812829 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:47.863823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dff184-84f0-4e9e-be9f-e5da4c1e2854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:47.867036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dff184-84f0-4e9e-be9f-e5da4c1e2854 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:47.871965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dff184-84f0-4e9e-be9f-e5da4c1e2854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:47.871965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dff184-84f0-4e9e-be9f-e5da4c1e2854 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:47.871965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dff184-84f0-4e9e-be9f-e5da4c1e2854 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:47.880680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dff184-84f0-4e9e-be9f-e5da4c1e2854 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:48.019046 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1556/3068] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:18:47 2022] POST /identity/v3/users => generated 289 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:18:48.023188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e55120-64ad-4c5d-8f21-ec0d9ccbe5f1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:48.047818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e55120-64ad-4c5d-8f21-ec0d9ccbe5f1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:48.066943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341449e0-ee1b-4cd8-8174-1d639f60a567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:48.067664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341449e0-ee1b-4cd8-8174-1d639f60a567 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:48.067951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341449e0-ee1b-4cd8-8174-1d639f60a567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:48.075496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341449e0-ee1b-4cd8-8174-1d639f60a567 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:48.078052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341449e0-ee1b-4cd8-8174-1d639f60a567 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:48.078052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341449e0-ee1b-4cd8-8174-1d639f60a567 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:48.145893 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1513/3069] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:18:48.149504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dff184-84f0-4e9e-be9f-e5da4c1e2854 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:48.182157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dff184-84f0-4e9e-be9f-e5da4c1e2854 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:48.214519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3a9ba3-beea-4890-bf5a-80510fb52478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:48.216074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a9ba3-beea-4890-bf5a-80510fb52478 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:48.216482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a9ba3-beea-4890-bf5a-80510fb52478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:48.216767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a9ba3-beea-4890-bf5a-80510fb52478 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:48.217529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a9ba3-beea-4890-bf5a-80510fb52478 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:48.229682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3a9ba3-beea-4890-bf5a-80510fb52478 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:48.284100 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1557/3070] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:18:48.287451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341449e0-ee1b-4cd8-8174-1d639f60a567 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:48.303823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341449e0-ee1b-4cd8-8174-1d639f60a567 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:48.346171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29115f-18ee-48fc-8813-70b9744af502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:48.350782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29115f-18ee-48fc-8813-70b9744af502 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:48.352135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29115f-18ee-48fc-8813-70b9744af502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:48.352425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29115f-18ee-48fc-8813-70b9744af502 admin admin] PATH_INFO: `/v3/projects/7be0d52fd266445caf0abddf2141b3ed/users/4e74d74ca11f4813b9b9a8630790b29c/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:48.419888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29115f-18ee-48fc-8813-70b9744af502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7be0d52fd266445caf0abddf2141b3ed, user_id=4e74d74ca11f4813b9b9a8630790b29c, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:48.422848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29115f-18ee-48fc-8813-70b9744af502 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:48.545046 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1514/3071] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:18:48 2022] PUT /identity/v3/projects/7be0d52fd266445caf0abddf2141b3ed/users/4e74d74ca11f4813b9b9a8630790b29c/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:48.557205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922150fc-2651-46c2-820e-f1c4d0f2eafb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:48.557770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922150fc-2651-46c2-820e-f1c4d0f2eafb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:48.557770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922150fc-2651-46c2-820e-f1c4d0f2eafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:48.615549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-922150fc-2651-46c2-820e-f1c4d0f2eafb None None] MFA Rules not processed for user `4e74d74ca11f4813b9b9a8630790b29c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:48.616842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-922150fc-2651-46c2-820e-f1c4d0f2eafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:48.745541 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1558/3072] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:18:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:18:48.750123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29115f-18ee-48fc-8813-70b9744af502 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:48.984193 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:48.996576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29115f-18ee-48fc-8813-70b9744af502 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:49.034375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc1fff-6e13-4374-a5e9-99673343e4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:49.037226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc1fff-6e13-4374-a5e9-99673343e4f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:49.037527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc1fff-6e13-4374-a5e9-99673343e4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:49.037817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc1fff-6e13-4374-a5e9-99673343e4f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:49.041390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc1fff-6e13-4374-a5e9-99673343e4f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:49.052397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc1fff-6e13-4374-a5e9-99673343e4f1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:49.243254 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1515/3073] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:18:48 2022] POST /identity/v3/projects => generated 377 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:18:49.247802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922150fc-2651-46c2-820e-f1c4d0f2eafb None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:49.277014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922150fc-2651-46c2-820e-f1c4d0f2eafb None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:49.453814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e461f9-cf1c-4ffe-b829-5ca5fbfd9f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:49.454720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e461f9-cf1c-4ffe-b829-5ca5fbfd9f97 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:49.458214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e461f9-cf1c-4ffe-b829-5ca5fbfd9f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:49.458214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e461f9-cf1c-4ffe-b829-5ca5fbfd9f97 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:49.458214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e461f9-cf1c-4ffe-b829-5ca5fbfd9f97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:49.459063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e461f9-cf1c-4ffe-b829-5ca5fbfd9f97 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:49.616544 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1559/3074] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:18:49 2022] POST /identity/v3/users => generated 295 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:18:49.620128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc1fff-6e13-4374-a5e9-99673343e4f1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:49.635489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc1fff-6e13-4374-a5e9-99673343e4f1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:49.667597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42efa4-890d-4d49-a36e-31d9b4eb6350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:49.668309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42efa4-890d-4d49-a36e-31d9b4eb6350 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:49.668602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42efa4-890d-4d49-a36e-31d9b4eb6350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:49.668888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42efa4-890d-4d49-a36e-31d9b4eb6350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:49.669638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42efa4-890d-4d49-a36e-31d9b4eb6350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:49.671299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42efa4-890d-4d49-a36e-31d9b4eb6350 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:49.734917 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1516/3075] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:18:49.740793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e461f9-cf1c-4ffe-b829-5ca5fbfd9f97 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:49.754757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e461f9-cf1c-4ffe-b829-5ca5fbfd9f97 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:49.781989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66af6f-b7a0-4a5b-bf74-d35e0aec46d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:49.783095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66af6f-b7a0-4a5b-bf74-d35e0aec46d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:49.783392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66af6f-b7a0-4a5b-bf74-d35e0aec46d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:49.783682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66af6f-b7a0-4a5b-bf74-d35e0aec46d4 admin admin] PATH_INFO: `/v3/projects/f4f52eb1cb164071900a39135a8bba77/users/c35554c5eb1c4339a3041ffe6b6493aa/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:49.868100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66af6f-b7a0-4a5b-bf74-d35e0aec46d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f52eb1cb164071900a39135a8bba77, user_id=c35554c5eb1c4339a3041ffe6b6493aa, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:49.872785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d66af6f-b7a0-4a5b-bf74-d35e0aec46d4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:49.944969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42efa4-890d-4d49-a36e-31d9b4eb6350 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:49.947256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2d42efa4-890d-4d49-a36e-31d9b4eb6350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:50.023696 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1560/3076] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:18:49 2022] PUT /identity/v3/projects/f4f52eb1cb164071900a39135a8bba77/users/c35554c5eb1c4339a3041ffe6b6493aa/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:50.026786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66af6f-b7a0-4a5b-bf74-d35e0aec46d4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:50.077404 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:50.216855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42efa4-890d-4d49-a36e-31d9b4eb6350 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:50.267506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66af6f-b7a0-4a5b-bf74-d35e0aec46d4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:50.273877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a22792-9717-4bd8-bfd2-a534ecd5936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:50.276510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a22792-9717-4bd8-bfd2-a534ecd5936c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:50.276510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a22792-9717-4bd8-bfd2-a534ecd5936c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:50.276510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a22792-9717-4bd8-bfd2-a534ecd5936c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:50.277018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a22792-9717-4bd8-bfd2-a534ecd5936c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:50.279342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a22792-9717-4bd8-bfd2-a534ecd5936c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:50.315017 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1561/3077] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:18:50.315017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a22792-9717-4bd8-bfd2-a534ecd5936c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:50.319255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a0a22792-9717-4bd8-bfd2-a534ecd5936c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:50.353202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a22792-9717-4bd8-bfd2-a534ecd5936c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:50.362797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65834a5f-88d3-49bd-9ceb-eda6a712054f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:50.364078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65834a5f-88d3-49bd-9ceb-eda6a712054f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:50.364078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65834a5f-88d3-49bd-9ceb-eda6a712054f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:50.364392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65834a5f-88d3-49bd-9ceb-eda6a712054f admin admin] PATH_INFO: `/v3/users/5d2572c3904f40c6b26ce92425f655f6` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:50.365703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65834a5f-88d3-49bd-9ceb-eda6a712054f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d2572c3904f40c6b26ce92425f655f6)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:50.368373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65834a5f-88d3-49bd-9ceb-eda6a712054f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:50.420073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02cc72-f630-466c-ac85-607a3fbf8957 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:50.420838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02cc72-f630-466c-ac85-607a3fbf8957 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:50.421170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02cc72-f630-466c-ac85-607a3fbf8957 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:50.421511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02cc72-f630-466c-ac85-607a3fbf8957 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:50.427226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ea02cc72-f630-466c-ac85-607a3fbf8957 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:50.458729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02cc72-f630-466c-ac85-607a3fbf8957 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:50.460554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02cc72-f630-466c-ac85-607a3fbf8957 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:50.475529 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1517/3078] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:18:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:18:50.476801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02cc72-f630-466c-ac85-607a3fbf8957 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:50.478527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ea02cc72-f630-466c-ac85-607a3fbf8957 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:50.557051 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:50.581236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02cc72-f630-466c-ac85-607a3fbf8957 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:50.587909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960482f-6562-4168-b8eb-5323178c63f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:50.588683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960482f-6562-4168-b8eb-5323178c63f8 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:50.589172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960482f-6562-4168-b8eb-5323178c63f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:50.589666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d960482f-6562-4168-b8eb-5323178c63f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:50.591925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d960482f-6562-4168-b8eb-5323178c63f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:50.632467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-65834a5f-88d3-49bd-9ceb-eda6a712054f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d2572c3904f40c6b26ce92425f655f6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:50.680727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-65834a5f-88d3-49bd-9ceb-eda6a712054f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d2572c3904f40c6b26ce92425f655f6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:50.691034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-65834a5f-88d3-49bd-9ceb-eda6a712054f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d2572c3904f40c6b26ce92425f655f6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:50.691761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-65834a5f-88d3-49bd-9ceb-eda6a712054f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d2572c3904f40c6b26ce92425f655f6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:50.711061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960482f-6562-4168-b8eb-5323178c63f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:50.714863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d960482f-6562-4168-b8eb-5323178c63f8 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:50.769226 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1518/3079] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:18:50 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:18:50.781776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960482f-6562-4168-b8eb-5323178c63f8 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:50.795159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-65834a5f-88d3-49bd-9ceb-eda6a712054f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d2572c3904f40c6b26ce92425f655f6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:50.810675 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1562/3080] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:18:50 2022] DELETE /identity/v3/users/5d2572c3904f40c6b26ce92425f655f6 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:50.816199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c964d-3945-493c-bd3d-345c65734c22 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:50.818269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c964d-3945-493c-bd3d-345c65734c22 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:50.819003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c964d-3945-493c-bd3d-345c65734c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:50.822539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d960482f-6562-4168-b8eb-5323178c63f8 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:50.863016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b53c964d-3945-493c-bd3d-345c65734c22 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:50.864675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b53c964d-3945-493c-bd3d-345c65734c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:50.974533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aadc87-f366-4550-adf3-a4ab2e015e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:50.975597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aadc87-f366-4550-adf3-a4ab2e015e68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:50.976030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aadc87-f366-4550-adf3-a4ab2e015e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:50.976323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aadc87-f366-4550-adf3-a4ab2e015e68 admin admin] PATH_INFO: `/v3/projects/f4f52eb1cb164071900a39135a8bba77/users/c35554c5eb1c4339a3041ffe6b6493aa/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:50.987324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aadc87-f366-4550-adf3-a4ab2e015e68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4f52eb1cb164071900a39135a8bba77, user_id=c35554c5eb1c4339a3041ffe6b6493aa, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:50.990009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aadc87-f366-4550-adf3-a4ab2e015e68 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:51.003637 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1563/3081] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:18:51.042382 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1519/3082] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:18:50 2022] PUT /identity/v3/projects/f4f52eb1cb164071900a39135a8bba77/users/c35554c5eb1c4339a3041ffe6b6493aa/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:51.044901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9e31a-e49f-435e-92da-220d4a362179 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:51.045788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9e31a-e49f-435e-92da-220d4a362179 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:51.046385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9e31a-e49f-435e-92da-220d4a362179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:51.152384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-37d9e31a-e49f-435e-92da-220d4a362179 None None] MFA Rules not processed for user `c35554c5eb1c4339a3041ffe6b6493aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:51.153508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-37d9e31a-e49f-435e-92da-220d4a362179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:51.179464 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:51.287194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aadc87-f366-4550-adf3-a4ab2e015e68 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:51.289765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d1aadc87-f366-4550-adf3-a4ab2e015e68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:51.300105 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1564/3083] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:18:51 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:18:51.303750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc244ed-540d-493c-bb3e-c9ed1b1c1a20 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:51.304366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc244ed-540d-493c-bb3e-c9ed1b1c1a20 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:51.304726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc244ed-540d-493c-bb3e-c9ed1b1c1a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:51.329248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7bc244ed-540d-493c-bb3e-c9ed1b1c1a20 None None] MFA Rules not processed for user `4e74d74ca11f4813b9b9a8630790b29c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:51.330924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7bc244ed-540d-493c-bb3e-c9ed1b1c1a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:51.408471 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1565/3084] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:18:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:18:51.568701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aadc87-f366-4550-adf3-a4ab2e015e68 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:51.579816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d687d4e-555c-4c6f-b680-d9f6761fa0aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:51.580497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d687d4e-555c-4c6f-b680-d9f6761fa0aa service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:51.581355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d687d4e-555c-4c6f-b680-d9f6761fa0aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:51.581644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d687d4e-555c-4c6f-b680-d9f6761fa0aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:51.694132 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:51.742184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d687d4e-555c-4c6f-b680-d9f6761fa0aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:51.747843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d687d4e-555c-4c6f-b680-d9f6761fa0aa service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:51.767592 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1520/3085] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:18:51.947249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc244ed-540d-493c-bb3e-c9ed1b1c1a20 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:51.950595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7bc244ed-540d-493c-bb3e-c9ed1b1c1a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:52.151086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d687d4e-555c-4c6f-b680-d9f6761fa0aa service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:52.152576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2d687d4e-555c-4c6f-b680-d9f6761fa0aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:52.181141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d687d4e-555c-4c6f-b680-d9f6761fa0aa service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:52.200812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111f475-a53a-428e-b7b8-14eed71a3adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:52.201984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111f475-a53a-428e-b7b8-14eed71a3adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:52.202476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111f475-a53a-428e-b7b8-14eed71a3adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:52.202970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111f475-a53a-428e-b7b8-14eed71a3adc admin admin] PATH_INFO: `/v3/projects/11c8fff81ce3494b9567aafd67b2e31d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:52.205461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111f475-a53a-428e-b7b8-14eed71a3adc admin admin] RBAC: Authorizing `identity:delete_project(project_id=11c8fff81ce3494b9567aafd67b2e31d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:52.207221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc244ed-540d-493c-bb3e-c9ed1b1c1a20 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:52.208548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111f475-a53a-428e-b7b8-14eed71a3adc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:52.225214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf373e4-2f9b-4289-a3e7-09e7f1b3c787 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:52.226860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf373e4-2f9b-4289-a3e7-09e7f1b3c787 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:52.226860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf373e4-2f9b-4289-a3e7-09e7f1b3c787 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:52.226860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf373e4-2f9b-4289-a3e7-09e7f1b3c787 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:52.230942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1bf373e4-2f9b-4289-a3e7-09e7f1b3c787 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:52.272421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf373e4-2f9b-4289-a3e7-09e7f1b3c787 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:52.279302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf373e4-2f9b-4289-a3e7-09e7f1b3c787 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:52.328238 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1566/3086] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:18:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:18:52.410804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0111f475-a53a-428e-b7b8-14eed71a3adc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11c8fff81ce3494b9567aafd67b2e31d', 'request_id': 'req-0111f475-a53a-428e-b7b8-14eed71a3adc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:52.559774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0111f475-a53a-428e-b7b8-14eed71a3adc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11c8fff81ce3494b9567aafd67b2e31d', 'request_id': 'req-0111f475-a53a-428e-b7b8-14eed71a3adc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:52.572004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0111f475-a53a-428e-b7b8-14eed71a3adc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11c8fff81ce3494b9567aafd67b2e31d', 'request_id': 'req-0111f475-a53a-428e-b7b8-14eed71a3adc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:52.596971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0111f475-a53a-428e-b7b8-14eed71a3adc admin admin] The token cache is being invalidate because project 11c8fff81ce3494b9567aafd67b2e31d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:18:52.597287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0111f475-a53a-428e-b7b8-14eed71a3adc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:52.598812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0111f475-a53a-428e-b7b8-14eed71a3adc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:52.602807 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1521/3087] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:18:52 2022] DELETE /identity/v3/projects/11c8fff81ce3494b9567aafd67b2e31d => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:18:52.606892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf373e4-2f9b-4289-a3e7-09e7f1b3c787 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:52.634114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf373e4-2f9b-4289-a3e7-09e7f1b3c787 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:52.743527 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:52.843362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4364b-a95e-4893-8734-c081316edcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:52.844495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4364b-a95e-4893-8734-c081316edcc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:52.844959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4364b-a95e-4893-8734-c081316edcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:52.846244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4364b-a95e-4893-8734-c081316edcc5 admin admin] PATH_INFO: `/v3/users/06077ae6adb84fc8b979d88d34267c0c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:52.847896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4364b-a95e-4893-8734-c081316edcc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06077ae6adb84fc8b979d88d34267c0c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:52.854519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4364b-a95e-4893-8734-c081316edcc5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:53.162665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-34e4364b-a95e-4893-8734-c081316edcc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06077ae6adb84fc8b979d88d34267c0c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:53.208097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ff882-223a-4c4e-8fbc-c866d121c50b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:53.208646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ff882-223a-4c4e-8fbc-c866d121c50b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:53.209083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4ff882-223a-4c4e-8fbc-c866d121c50b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:53.279375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-34e4364b-a95e-4893-8734-c081316edcc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06077ae6adb84fc8b979d88d34267c0c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:53.295372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7e4ff882-223a-4c4e-8fbc-c866d121c50b None None] MFA Rules not processed for user `4e74d74ca11f4813b9b9a8630790b29c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:53.296629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7e4ff882-223a-4c4e-8fbc-c866d121c50b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:53.311143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-34e4364b-a95e-4893-8734-c081316edcc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06077ae6adb84fc8b979d88d34267c0c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:53.312367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-34e4364b-a95e-4893-8734-c081316edcc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06077ae6adb84fc8b979d88d34267c0c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:53.439636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-34e4364b-a95e-4893-8734-c081316edcc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06077ae6adb84fc8b979d88d34267c0c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:53.446885 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1567/3088] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:18:52 2022] DELETE /identity/v3/users/06077ae6adb84fc8b979d88d34267c0c => generated 0 bytes in 837 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:53.513432 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1522/3089] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:18:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:18:54.804191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4364b-a95e-4893-8734-c081316edcc5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:54.806263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-34e4364b-a95e-4893-8734-c081316edcc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:54.955046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4364b-a95e-4893-8734-c081316edcc5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:54.960679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9ae09-52ef-495d-a49e-4e9fc1fe79fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:54.961678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9ae09-52ef-495d-a49e-4e9fc1fe79fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:54.963507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9ae09-52ef-495d-a49e-4e9fc1fe79fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:54.963507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9ae09-52ef-495d-a49e-4e9fc1fe79fc admin admin] PATH_INFO: `/v3/projects/6468b350591d4fb4826f86222dc53abc` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:54.964980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9ae09-52ef-495d-a49e-4e9fc1fe79fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6468b350591d4fb4826f86222dc53abc)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:54.967430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9ae09-52ef-495d-a49e-4e9fc1fe79fc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:55.356253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-eea9ae09-52ef-495d-a49e-4e9fc1fe79fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6468b350591d4fb4826f86222dc53abc', 'request_id': 'req-eea9ae09-52ef-495d-a49e-4e9fc1fe79fc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:55.362380 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:55.364680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-eea9ae09-52ef-495d-a49e-4e9fc1fe79fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6468b350591d4fb4826f86222dc53abc', 'request_id': 'req-eea9ae09-52ef-495d-a49e-4e9fc1fe79fc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:55.375526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-eea9ae09-52ef-495d-a49e-4e9fc1fe79fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6468b350591d4fb4826f86222dc53abc', 'request_id': 'req-eea9ae09-52ef-495d-a49e-4e9fc1fe79fc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:55.476629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-eea9ae09-52ef-495d-a49e-4e9fc1fe79fc admin admin] The token cache is being invalidate because project 6468b350591d4fb4826f86222dc53abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:18:55.477293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-eea9ae09-52ef-495d-a49e-4e9fc1fe79fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:55.478428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-eea9ae09-52ef-495d-a49e-4e9fc1fe79fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:18:55.482053 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1568/3090] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:18:54 2022] DELETE /identity/v3/projects/6468b350591d4fb4826f86222dc53abc => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:55.487074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b944c66-00f8-4371-a2a2-eafe31d88ac1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:55.487643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b944c66-00f8-4371-a2a2-eafe31d88ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:55.487643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b944c66-00f8-4371-a2a2-eafe31d88ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:55.538604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9b944c66-00f8-4371-a2a2-eafe31d88ac1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:55.539457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9b944c66-00f8-4371-a2a2-eafe31d88ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:55.718461 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1523/3091] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:18:55.726346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ccae6-6931-43d1-b58d-e39b501123de None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:55.726674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ccae6-6931-43d1-b58d-e39b501123de None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:55.726912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ccae6-6931-43d1-b58d-e39b501123de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:55.766409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3d6ccae6-6931-43d1-b58d-e39b501123de None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:55.768238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3d6ccae6-6931-43d1-b58d-e39b501123de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:55.791692 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1569/3092] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:18:55.793263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b944c66-00f8-4371-a2a2-eafe31d88ac1 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:55.828506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b944c66-00f8-4371-a2a2-eafe31d88ac1 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:55.866715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d08ce-bb23-44c6-95b2-738e4a9289b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:55.867426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d08ce-bb23-44c6-95b2-738e4a9289b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:55.875614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d08ce-bb23-44c6-95b2-738e4a9289b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:55.876022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d08ce-bb23-44c6-95b2-738e4a9289b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:55.877314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d08ce-bb23-44c6-95b2-738e4a9289b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:18:55.877633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d08ce-bb23-44c6-95b2-738e4a9289b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:55.887645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d08ce-bb23-44c6-95b2-738e4a9289b2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:55.897514 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:55.939869 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1524/3093] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:18:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:18:55.944457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ccae6-6931-43d1-b58d-e39b501123de None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:55.955080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ccae6-6931-43d1-b58d-e39b501123de None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:55.960632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc26801-39de-495c-9615-97712d507bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:55.961633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc26801-39de-495c-9615-97712d507bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:55.961633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc26801-39de-495c-9615-97712d507bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:55.961921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc26801-39de-495c-9615-97712d507bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:55.962655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc26801-39de-495c-9615-97712d507bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:55.964694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc26801-39de-495c-9615-97712d507bc1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:56.083712 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1570/3094] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:18:55 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:18:56.084967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d08ce-bb23-44c6-95b2-738e4a9289b2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:56.100615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d08ce-bb23-44c6-95b2-738e4a9289b2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:56.226046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d338081-1a04-4d39-96c8-3850ebca3c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:56.226776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d338081-1a04-4d39-96c8-3850ebca3c36 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:56.227057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d338081-1a04-4d39-96c8-3850ebca3c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:56.227332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d338081-1a04-4d39-96c8-3850ebca3c36 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:56.228036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d338081-1a04-4d39-96c8-3850ebca3c36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:56.240873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d338081-1a04-4d39-96c8-3850ebca3c36 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:56.308521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb408332-1070-4188-89e9-f3bb15bb19fe None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:56.309594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb408332-1070-4188-89e9-f3bb15bb19fe None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:56.310180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb408332-1070-4188-89e9-f3bb15bb19fe None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:56.312386 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1571/3095] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:18:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:18:56.318659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f033e8-81d5-494d-98df-057e6b17c74d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:56.319628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f033e8-81d5-494d-98df-057e6b17c74d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:56.320148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f033e8-81d5-494d-98df-057e6b17c74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:56.370048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-50f033e8-81d5-494d-98df-057e6b17c74d None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:56.375159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-50f033e8-81d5-494d-98df-057e6b17c74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:56.467088 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1525/3096] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:18:56 2022] POST /identity/v3/users => generated 293 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:18:56.475757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d338081-1a04-4d39-96c8-3850ebca3c36 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:56.505821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d338081-1a04-4d39-96c8-3850ebca3c36 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:56.531132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52979309-d1ce-4b35-b467-d4f024fb81a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:56.533046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52979309-d1ce-4b35-b467-d4f024fb81a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:56.535735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52979309-d1ce-4b35-b467-d4f024fb81a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:56.536046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52979309-d1ce-4b35-b467-d4f024fb81a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:56.539305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52979309-d1ce-4b35-b467-d4f024fb81a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:56.544696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52979309-d1ce-4b35-b467-d4f024fb81a4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:56.610875 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1526/3097] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:18:56.615531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52979309-d1ce-4b35-b467-d4f024fb81a4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:56.638782 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1572/3098] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:18:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:18:56.659076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f033e8-81d5-494d-98df-057e6b17c74d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:56.660847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-50f033e8-81d5-494d-98df-057e6b17c74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:56.675568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52979309-d1ce-4b35-b467-d4f024fb81a4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:56.701714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae058d2-ebaa-40f1-b519-e4d45fcca4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:56.706961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae058d2-ebaa-40f1-b519-e4d45fcca4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:56.706961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae058d2-ebaa-40f1-b519-e4d45fcca4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:56.706961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae058d2-ebaa-40f1-b519-e4d45fcca4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:56.709709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f033e8-81d5-494d-98df-057e6b17c74d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:56.710295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae058d2-ebaa-40f1-b519-e4d45fcca4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:56.717715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae058d2-ebaa-40f1-b519-e4d45fcca4a2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:56.734628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f1f1a-3720-4c93-a403-a12b66e0a123 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:56.738640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f1f1a-3720-4c93-a403-a12b66e0a123 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:56.745971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f1f1a-3720-4c93-a403-a12b66e0a123 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:56.746631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f1f1a-3720-4c93-a403-a12b66e0a123 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:56.762535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f1f1a-3720-4c93-a403-a12b66e0a123 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:56.764679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f1f1a-3720-4c93-a403-a12b66e0a123 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:56.802633 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1527/3099] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:18:56 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:18:56.804668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae058d2-ebaa-40f1-b519-e4d45fcca4a2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:56.816632 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1573/3100] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:18:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:18:56.849198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae058d2-ebaa-40f1-b519-e4d45fcca4a2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:56.870751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab98a14-1925-439d-b110-9ccbe8b49691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:56.872428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab98a14-1925-439d-b110-9ccbe8b49691 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:56.872979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab98a14-1925-439d-b110-9ccbe8b49691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:56.873500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab98a14-1925-439d-b110-9ccbe8b49691 admin admin] PATH_INFO: `/v3/projects/c1abf14b7d354c44935fb502294dca06/users/9099143abbce4dc78f650d702d51af72/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:56.974277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab98a14-1925-439d-b110-9ccbe8b49691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1abf14b7d354c44935fb502294dca06, user_id=9099143abbce4dc78f650d702d51af72, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:56.977248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab98a14-1925-439d-b110-9ccbe8b49691 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:57.126747 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1528/3101] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:18:56 2022] PUT /identity/v3/projects/c1abf14b7d354c44935fb502294dca06/users/9099143abbce4dc78f650d702d51af72/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:18:57.129782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92990a-45ff-4822-97cf-3e9a6c19044a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:57.130459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92990a-45ff-4822-97cf-3e9a6c19044a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:57.130459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92990a-45ff-4822-97cf-3e9a6c19044a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:57.191139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-fd92990a-45ff-4822-97cf-3e9a6c19044a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:18:57.194570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fd92990a-45ff-4822-97cf-3e9a6c19044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:57.439742 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1574/3102] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:18:57.458214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab98a14-1925-439d-b110-9ccbe8b49691 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:57.460179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4ab98a14-1925-439d-b110-9ccbe8b49691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:57.671152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab98a14-1925-439d-b110-9ccbe8b49691 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:57.687199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c4a7d-7f59-4f82-9f2d-5c55c02378b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:57.689559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c4a7d-7f59-4f82-9f2d-5c55c02378b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:57.689559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c4a7d-7f59-4f82-9f2d-5c55c02378b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:57.692775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172c4a7d-7f59-4f82-9f2d-5c55c02378b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:57.736015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c4a7d-7f59-4f82-9f2d-5c55c02378b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:57.739995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172c4a7d-7f59-4f82-9f2d-5c55c02378b8 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:57.776277 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1529/3103] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:18:59.037698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92990a-45ff-4822-97cf-3e9a6c19044a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:59.054419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd92990a-45ff-4822-97cf-3e9a6c19044a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:59.072009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06865f0-837b-46a1-b06a-da453ca64f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:59.074804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06865f0-837b-46a1-b06a-da453ca64f0d service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:59.075319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06865f0-837b-46a1-b06a-da453ca64f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:59.077419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06865f0-837b-46a1-b06a-da453ca64f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:59.089324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d06865f0-837b-46a1-b06a-da453ca64f0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:59.204619 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:18:59.285694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06865f0-837b-46a1-b06a-da453ca64f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:59.287230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06865f0-837b-46a1-b06a-da453ca64f0d service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:59.319803 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1575/3104] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:18:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:18:59.523568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c4a7d-7f59-4f82-9f2d-5c55c02378b8 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:18:59.537938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172c4a7d-7f59-4f82-9f2d-5c55c02378b8 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:18:59.553725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cd2f22-018b-480e-917b-61039c80eaba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:18:59.554439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd2f22-018b-480e-917b-61039c80eaba service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:18:59.554728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd2f22-018b-480e-917b-61039c80eaba service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:18:59.555012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cd2f22-018b-480e-917b-61039c80eaba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:18:59.562077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-04cd2f22-018b-480e-917b-61039c80eaba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:18:59.584160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd2f22-018b-480e-917b-61039c80eaba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:18:59.589055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cd2f22-018b-480e-917b-61039c80eaba service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:18:59.637986 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1530/3105] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:18:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:19:04.128224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffebb8d-a9b4-4595-964a-e9d7dad777ff None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:04.128800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffebb8d-a9b4-4595-964a-e9d7dad777ff None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:04.128800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffebb8d-a9b4-4595-964a-e9d7dad777ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:04.198483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5ffebb8d-a9b4-4595-964a-e9d7dad777ff None None] MFA Rules not processed for user `744a25fb94b94384b064ed10c3bd9374`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:19:04.202242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5ffebb8d-a9b4-4595-964a-e9d7dad777ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:04.433958 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1576/3106] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:19:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:19:09.615010 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=84,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:19:13.356818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1643571-f997-49f7-9234-03433d71fc7a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:13.359663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1643571-f997-49f7-9234-03433d71fc7a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:13.360095 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1643571-f997-49f7-9234-03433d71fc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:13.406350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b1643571-f997-49f7-9234-03433d71fc7a None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:19:13.408826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b1643571-f997-49f7-9234-03433d71fc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:13.616575 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1531/3107] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:19:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:19:13.626252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffebb8d-a9b4-4595-964a-e9d7dad777ff None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:13.628473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5ffebb8d-a9b4-4595-964a-e9d7dad777ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:13.842161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffebb8d-a9b4-4595-964a-e9d7dad777ff None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:13.849998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37c0b0-18a8-4bae-948b-52556a3899f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:13.851081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37c0b0-18a8-4bae-948b-52556a3899f9 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:13.851619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37c0b0-18a8-4bae-948b-52556a3899f9 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:13.852717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf37c0b0-18a8-4bae-948b-52556a3899f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:13.869253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37c0b0-18a8-4bae-948b-52556a3899f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:13.871076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf37c0b0-18a8-4bae-948b-52556a3899f9 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:13.918746 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1577/3108] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:19:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:19:14.559734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2488d-f314-49e8-b871-7426829fccca None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:14.561010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2488d-f314-49e8-b871-7426829fccca None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:14.561312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2488d-f314-49e8-b871-7426829fccca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:14.698826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b3e2488d-f314-49e8-b871-7426829fccca None None] MFA Rules not processed for user `9099143abbce4dc78f650d702d51af72`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:19:14.700627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b3e2488d-f314-49e8-b871-7426829fccca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:14.935524 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1532/3109] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:19:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:19:14.935725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37c0b0-18a8-4bae-948b-52556a3899f9 service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:14.954231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf37c0b0-18a8-4bae-948b-52556a3899f9 service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:14.961025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00b427-a8a4-4322-8abc-06373447022d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:14.962118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00b427-a8a4-4322-8abc-06373447022d admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:14.962594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00b427-a8a4-4322-8abc-06373447022d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:14.963039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a00b427-a8a4-4322-8abc-06373447022d admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:14.964321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00b427-a8a4-4322-8abc-06373447022d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:14.967195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a00b427-a8a4-4322-8abc-06373447022d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:15.102917 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1578/3110] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:19:14 2022] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:19:15.107524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2488d-f314-49e8-b871-7426829fccca None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:15.130692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2488d-f314-49e8-b871-7426829fccca None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:15.339516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae3ab0-e889-4ed3-9eaf-e1f3f2c331bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:15.345728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae3ab0-e889-4ed3-9eaf-e1f3f2c331bc admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:15.346684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae3ab0-e889-4ed3-9eaf-e1f3f2c331bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:15.347397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae3ab0-e889-4ed3-9eaf-e1f3f2c331bc admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:15.348684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae3ab0-e889-4ed3-9eaf-e1f3f2c331bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:15.352084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae3ab0-e889-4ed3-9eaf-e1f3f2c331bc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:15.482539 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:19:15.488217 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1533/3111] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:19:15 2022] POST /identity/v3/users => generated 299 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:19:15.489804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00b427-a8a4-4322-8abc-06373447022d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:15.500307 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:19:15.509749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a00b427-a8a4-4322-8abc-06373447022d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:15.526772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde219e3-fb13-45b6-97e5-0884524e71cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:15.526772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde219e3-fb13-45b6-97e5-0884524e71cb admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:15.526772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde219e3-fb13-45b6-97e5-0884524e71cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:15.526772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde219e3-fb13-45b6-97e5-0884524e71cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:15.530055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde219e3-fb13-45b6-97e5-0884524e71cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:15.534916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde219e3-fb13-45b6-97e5-0884524e71cb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:15.567912 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1579/3112] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:19:15.573419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae3ab0-e889-4ed3-9eaf-e1f3f2c331bc admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:15.598021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae3ab0-e889-4ed3-9eaf-e1f3f2c331bc admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:15.606816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4a0eb-d944-4904-a4a3-7cd0c239bf53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:15.608629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4a0eb-d944-4904-a4a3-7cd0c239bf53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:15.609079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4a0eb-d944-4904-a4a3-7cd0c239bf53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:15.609518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4a0eb-d944-4904-a4a3-7cd0c239bf53 admin admin] PATH_INFO: `/v3/projects/ad4e70db1715482a97ac80b6cf582c00/users/58aa09f776ab4ed0b15a1040102b370f/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:15.650817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4a0eb-d944-4904-a4a3-7cd0c239bf53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4e70db1715482a97ac80b6cf582c00, user_id=58aa09f776ab4ed0b15a1040102b370f, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:15.653717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4a0eb-d944-4904-a4a3-7cd0c239bf53 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:15.773490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde219e3-fb13-45b6-97e5-0884524e71cb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:15.775743 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1534/3113] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:19:15 2022] PUT /identity/v3/projects/ad4e70db1715482a97ac80b6cf582c00/users/58aa09f776ab4ed0b15a1040102b370f/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:19:15.793665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde219e3-fb13-45b6-97e5-0884524e71cb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:15.914653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47289628-50fa-4885-9329-edb3a460a742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:15.916485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47289628-50fa-4885-9329-edb3a460a742 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:15.917260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47289628-50fa-4885-9329-edb3a460a742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:15.917886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47289628-50fa-4885-9329-edb3a460a742 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:15.919609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47289628-50fa-4885-9329-edb3a460a742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:15.921885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47289628-50fa-4885-9329-edb3a460a742 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:15.939552 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1580/3114] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:19:15.945349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4a0eb-d944-4904-a4a3-7cd0c239bf53 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:15.963995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4a0eb-d944-4904-a4a3-7cd0c239bf53 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:15.978887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b15bfb-dd1a-4ff6-ba1d-cd4fcc3417b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:15.979825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b15bfb-dd1a-4ff6-ba1d-cd4fcc3417b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:15.980103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b15bfb-dd1a-4ff6-ba1d-cd4fcc3417b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:15.980682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b15bfb-dd1a-4ff6-ba1d-cd4fcc3417b6 admin admin] PATH_INFO: `/v3/projects/ad4e70db1715482a97ac80b6cf582c00/users/58aa09f776ab4ed0b15a1040102b370f/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:15.987443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b15bfb-dd1a-4ff6-ba1d-cd4fcc3417b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4e70db1715482a97ac80b6cf582c00, user_id=58aa09f776ab4ed0b15a1040102b370f, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:15.997650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b15bfb-dd1a-4ff6-ba1d-cd4fcc3417b6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:16.031136 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1535/3115] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:19:15 2022] PUT /identity/v3/projects/ad4e70db1715482a97ac80b6cf582c00/users/58aa09f776ab4ed0b15a1040102b370f/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:19:17.637503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47289628-50fa-4885-9329-edb3a460a742 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:17.813008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47289628-50fa-4885-9329-edb3a460a742 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:17.922036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c54ab-4b2f-4a67-bcaa-33acc633f168 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:17.924042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c54ab-4b2f-4a67-bcaa-33acc633f168 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:17.924550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c54ab-4b2f-4a67-bcaa-33acc633f168 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:17.925044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c54ab-4b2f-4a67-bcaa-33acc633f168 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:17.928689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c26c54ab-4b2f-4a67-bcaa-33acc633f168 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:18.010030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c54ab-4b2f-4a67-bcaa-33acc633f168 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:18.012657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26c54ab-4b2f-4a67-bcaa-33acc633f168 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:18.029624 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1581/3116] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:19:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:19:18.099637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b15bfb-dd1a-4ff6-ba1d-cd4fcc3417b6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:18.102621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-13b15bfb-dd1a-4ff6-ba1d-cd4fcc3417b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:18.138576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b15bfb-dd1a-4ff6-ba1d-cd4fcc3417b6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:18.155401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7dbc8-4765-46a7-8448-4b71c111c2dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:18.156468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7dbc8-4765-46a7-8448-4b71c111c2dc service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:18.157117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7dbc8-4765-46a7-8448-4b71c111c2dc service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:18.160245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7dbc8-4765-46a7-8448-4b71c111c2dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:18.162520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6fa7dbc8-4765-46a7-8448-4b71c111c2dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:18.183896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7dbc8-4765-46a7-8448-4b71c111c2dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:18.187610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7dbc8-4765-46a7-8448-4b71c111c2dc service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:18.219433 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1536/3117] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:19:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:19:25.325128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c54ab-4b2f-4a67-bcaa-33acc633f168 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:25.326886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c26c54ab-4b2f-4a67-bcaa-33acc633f168 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:25.334883 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:19:25.441636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c54ab-4b2f-4a67-bcaa-33acc633f168 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:25.450176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8821c7d-4268-42b4-a786-8952f6d672c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:25.451849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8821c7d-4268-42b4-a786-8952f6d672c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:25.452138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8821c7d-4268-42b4-a786-8952f6d672c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:25.452424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8821c7d-4268-42b4-a786-8952f6d672c6 admin admin] PATH_INFO: `/v3/users/e9d5d298d929453ab353349d0f8ce5b3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:25.454007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8821c7d-4268-42b4-a786-8952f6d672c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9d5d298d929453ab353349d0f8ce5b3)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:25.458268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8821c7d-4268-42b4-a786-8952f6d672c6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:25.749964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d8821c7d-4268-42b4-a786-8952f6d672c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9d5d298d929453ab353349d0f8ce5b3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:25.769317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d8821c7d-4268-42b4-a786-8952f6d672c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9d5d298d929453ab353349d0f8ce5b3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:25.779617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d8821c7d-4268-42b4-a786-8952f6d672c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9d5d298d929453ab353349d0f8ce5b3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:25.780719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d8821c7d-4268-42b4-a786-8952f6d672c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9d5d298d929453ab353349d0f8ce5b3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:25.930002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d8821c7d-4268-42b4-a786-8952f6d672c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9d5d298d929453ab353349d0f8ce5b3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:25.939350 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1582/3118] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:19:25 2022] DELETE /identity/v3/users/e9d5d298d929453ab353349d0f8ce5b3 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:19:25.943590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee8da9-6943-43b1-90e5-6a7dc563bb9f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:25.944113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee8da9-6943-43b1-90e5-6a7dc563bb9f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:25.944229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee8da9-6943-43b1-90e5-6a7dc563bb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:25.992589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-89ee8da9-6943-43b1-90e5-6a7dc563bb9f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:19:25.995586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-89ee8da9-6943-43b1-90e5-6a7dc563bb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:26.149708 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1537/3119] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:19:26.196246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8821c7d-4268-42b4-a786-8952f6d672c6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:26.197388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d8821c7d-4268-42b4-a786-8952f6d672c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:26.353560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8821c7d-4268-42b4-a786-8952f6d672c6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:26.368750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7679ab-7fc6-4b76-99b4-32339f52ae4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:26.369000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7679ab-7fc6-4b76-99b4-32339f52ae4a service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:26.369289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7679ab-7fc6-4b76-99b4-32339f52ae4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:26.369570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7679ab-7fc6-4b76-99b4-32339f52ae4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:26.389413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7679ab-7fc6-4b76-99b4-32339f52ae4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:26.391545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7679ab-7fc6-4b76-99b4-32339f52ae4a service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:26.416334 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1583/3120] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:19:27.576127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee8da9-6943-43b1-90e5-6a7dc563bb9f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:27.578370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-89ee8da9-6943-43b1-90e5-6a7dc563bb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:27.607220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee8da9-6943-43b1-90e5-6a7dc563bb9f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:27.632444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591fc6a-1a78-41f2-80d7-db6ae440449b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:27.633021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591fc6a-1a78-41f2-80d7-db6ae440449b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:27.633564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591fc6a-1a78-41f2-80d7-db6ae440449b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:27.633860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591fc6a-1a78-41f2-80d7-db6ae440449b admin admin] PATH_INFO: `/v3/projects/ac7824c076524766acc485dd7861b750` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:27.635442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591fc6a-1a78-41f2-80d7-db6ae440449b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac7824c076524766acc485dd7861b750)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:27.646637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591fc6a-1a78-41f2-80d7-db6ae440449b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:27.862124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5591fc6a-1a78-41f2-80d7-db6ae440449b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac7824c076524766acc485dd7861b750', 'request_id': 'req-5591fc6a-1a78-41f2-80d7-db6ae440449b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:27.956551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5591fc6a-1a78-41f2-80d7-db6ae440449b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac7824c076524766acc485dd7861b750', 'request_id': 'req-5591fc6a-1a78-41f2-80d7-db6ae440449b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:27.964064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5591fc6a-1a78-41f2-80d7-db6ae440449b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac7824c076524766acc485dd7861b750', 'request_id': 'req-5591fc6a-1a78-41f2-80d7-db6ae440449b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:28.008610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5591fc6a-1a78-41f2-80d7-db6ae440449b admin admin] The token cache is being invalidate because project ac7824c076524766acc485dd7861b750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:19:28.013904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5591fc6a-1a78-41f2-80d7-db6ae440449b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:28.015017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5591fc6a-1a78-41f2-80d7-db6ae440449b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:28.023888 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1538/3121] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:19:27 2022] DELETE /identity/v3/projects/ac7824c076524766acc485dd7861b750 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:19:28.029503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940dc842-d362-4994-95eb-acd8ac4bc0a8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:28.030497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940dc842-d362-4994-95eb-acd8ac4bc0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:28.031006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940dc842-d362-4994-95eb-acd8ac4bc0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:28.089086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-940dc842-d362-4994-95eb-acd8ac4bc0a8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:19:28.091458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-940dc842-d362-4994-95eb-acd8ac4bc0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:28.168136 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:19:28.302089 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1584/3122] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:19:28.309250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d22b3-122f-4f4b-a980-68526c84c7ee None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:28.309950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d22b3-122f-4f4b-a980-68526c84c7ee None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:28.310752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518d22b3-122f-4f4b-a980-68526c84c7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:28.360664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-518d22b3-122f-4f4b-a980-68526c84c7ee None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:19:28.361926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-518d22b3-122f-4f4b-a980-68526c84c7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:28.392760 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1539/3123] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:19:28.395005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940dc842-d362-4994-95eb-acd8ac4bc0a8 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:28.414557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940dc842-d362-4994-95eb-acd8ac4bc0a8 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:28.426081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167d9f3-4f51-46ed-8f0b-8249c9822536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:28.427424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167d9f3-4f51-46ed-8f0b-8249c9822536 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:28.427927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167d9f3-4f51-46ed-8f0b-8249c9822536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:28.428455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167d9f3-4f51-46ed-8f0b-8249c9822536 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:28.437906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167d9f3-4f51-46ed-8f0b-8249c9822536 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:19:28.437906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167d9f3-4f51-46ed-8f0b-8249c9822536 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:28.437906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167d9f3-4f51-46ed-8f0b-8249c9822536 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:28.464201 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1585/3124] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:19:28.468712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d22b3-122f-4f4b-a980-68526c84c7ee None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:28.484099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518d22b3-122f-4f4b-a980-68526c84c7ee None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:28.496046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3304a5-f0c8-4765-b8e3-15504c945ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:28.496674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3304a5-f0c8-4765-b8e3-15504c945ecf admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:28.496950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3304a5-f0c8-4765-b8e3-15504c945ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:28.497228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3304a5-f0c8-4765-b8e3-15504c945ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:28.497952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3304a5-f0c8-4765-b8e3-15504c945ecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:28.504524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3304a5-f0c8-4765-b8e3-15504c945ecf admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:28.703229 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1540/3125] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:19:28 2022] POST /identity/v3/projects => generated 381 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:19:28.704642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167d9f3-4f51-46ed-8f0b-8249c9822536 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:28.721072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167d9f3-4f51-46ed-8f0b-8249c9822536 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:28.899467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08b887-4e0f-40ed-80a3-ab84bea3f435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:28.900320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08b887-4e0f-40ed-80a3-ab84bea3f435 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:28.900902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08b887-4e0f-40ed-80a3-ab84bea3f435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:28.901255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08b887-4e0f-40ed-80a3-ab84bea3f435 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:28.902020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08b887-4e0f-40ed-80a3-ab84bea3f435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:28.908326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08b887-4e0f-40ed-80a3-ab84bea3f435 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:29.030883 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1586/3126] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:19:28 2022] POST /identity/v3/users => generated 291 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:19:29.035393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3304a5-f0c8-4765-b8e3-15504c945ecf admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:29.043573 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:19:29.050327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3304a5-f0c8-4765-b8e3-15504c945ecf admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:29.065496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd1ddc-9b24-4e3d-be33-537e23d6a84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:29.066962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd1ddc-9b24-4e3d-be33-537e23d6a84d admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:29.067680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd1ddc-9b24-4e3d-be33-537e23d6a84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:29.068150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd1ddc-9b24-4e3d-be33-537e23d6a84d admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:29.069112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd1ddc-9b24-4e3d-be33-537e23d6a84d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:29.074278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd1ddc-9b24-4e3d-be33-537e23d6a84d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:29.104748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08b887-4e0f-40ed-80a3-ab84bea3f435 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:29.115250 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1541/3127] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:19:29.119403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08b887-4e0f-40ed-80a3-ab84bea3f435 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:29.132370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0248d1-e35a-4316-8484-e0954def2d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:29.133577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0248d1-e35a-4316-8484-e0954def2d61 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:29.134132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0248d1-e35a-4316-8484-e0954def2d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:29.134610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0248d1-e35a-4316-8484-e0954def2d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:29.135595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0248d1-e35a-4316-8484-e0954def2d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:29.138345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0248d1-e35a-4316-8484-e0954def2d61 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:29.171245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd1ddc-9b24-4e3d-be33-537e23d6a84d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:29.180123 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1587/3128] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:19:29.185686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd1ddc-9b24-4e3d-be33-537e23d6a84d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:29.198864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732f693-364e-471f-81ec-4b1560cac60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:29.200394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732f693-364e-471f-81ec-4b1560cac60a admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:29.200899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732f693-364e-471f-81ec-4b1560cac60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:29.201373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732f693-364e-471f-81ec-4b1560cac60a admin admin] PATH_INFO: `/v3/projects/ce3e2af12ee14f92b2bdd702c7ed6abf/users/7ecca8ca495d43208e9b7e33da7caeb8/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:29.243868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732f693-364e-471f-81ec-4b1560cac60a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3e2af12ee14f92b2bdd702c7ed6abf, user_id=7ecca8ca495d43208e9b7e33da7caeb8, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:29.246712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732f693-364e-471f-81ec-4b1560cac60a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:29.324939 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1542/3129] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:19:29 2022] PUT /identity/v3/projects/ce3e2af12ee14f92b2bdd702c7ed6abf/users/7ecca8ca495d43208e9b7e33da7caeb8/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:19:29.326710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e075bea-19a9-44c3-ba4b-e6318c914b8e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:29.327014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e075bea-19a9-44c3-ba4b-e6318c914b8e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:29.327299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e075bea-19a9-44c3-ba4b-e6318c914b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:29.402581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1e075bea-19a9-44c3-ba4b-e6318c914b8e None None] MFA Rules not processed for user `7ecca8ca495d43208e9b7e33da7caeb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:19:29.403847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1e075bea-19a9-44c3-ba4b-e6318c914b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:29.696979 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1588/3130] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:19:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:19:30.200713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6306cd-7e21-45d8-8cac-63ba653d5226 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:30.201265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6306cd-7e21-45d8-8cac-63ba653d5226 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:30.201458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6306cd-7e21-45d8-8cac-63ba653d5226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:30.249805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5f6306cd-7e21-45d8-8cac-63ba653d5226 None None] MFA Rules not processed for user `4e74d74ca11f4813b9b9a8630790b29c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:19:30.259507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5f6306cd-7e21-45d8-8cac-63ba653d5226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:30.326052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e075bea-19a9-44c3-ba4b-e6318c914b8e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:30.327470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1e075bea-19a9-44c3-ba4b-e6318c914b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:30.360182 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:19:30.435940 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1543/3131] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:19:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:19:30.504823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e075bea-19a9-44c3-ba4b-e6318c914b8e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:30.528882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672dd5b-277d-4097-8b8c-c581ea58dec5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:30.531048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672dd5b-277d-4097-8b8c-c581ea58dec5 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:30.533153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672dd5b-277d-4097-8b8c-c581ea58dec5 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:30.533467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672dd5b-277d-4097-8b8c-c581ea58dec5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:30.553217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672dd5b-277d-4097-8b8c-c581ea58dec5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:30.555636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672dd5b-277d-4097-8b8c-c581ea58dec5 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:30.578811 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1589/3132] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:19:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:19:30.722613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6306cd-7e21-45d8-8cac-63ba653d5226 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:30.924420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6306cd-7e21-45d8-8cac-63ba653d5226 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:30.936343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b1971-db9d-4785-8250-8e9de7d02d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:30.946324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b1971-db9d-4785-8250-8e9de7d02d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:30.946324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b1971-db9d-4785-8250-8e9de7d02d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:30.952612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b1971-db9d-4785-8250-8e9de7d02d66 admin admin] PATH_INFO: `/v3/users/7ecca8ca495d43208e9b7e33da7caeb8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:30.959028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b1971-db9d-4785-8250-8e9de7d02d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ecca8ca495d43208e9b7e33da7caeb8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:30.961795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b1971-db9d-4785-8250-8e9de7d02d66 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:31.289919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-944b1971-db9d-4785-8250-8e9de7d02d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ecca8ca495d43208e9b7e33da7caeb8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:31.331042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-944b1971-db9d-4785-8250-8e9de7d02d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ecca8ca495d43208e9b7e33da7caeb8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:31.332736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-944b1971-db9d-4785-8250-8e9de7d02d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ecca8ca495d43208e9b7e33da7caeb8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:31.345642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-944b1971-db9d-4785-8250-8e9de7d02d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ecca8ca495d43208e9b7e33da7caeb8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:31.356543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-944b1971-db9d-4785-8250-8e9de7d02d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ecca8ca495d43208e9b7e33da7caeb8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:31.361624 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:19:31.509469 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1544/3133] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:19:30 2022] DELETE /identity/v3/users/7ecca8ca495d43208e9b7e33da7caeb8 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:19:31.514710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7a9c0-8c83-41d9-8e46-9813cbd782bf None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:31.515557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7a9c0-8c83-41d9-8e46-9813cbd782bf None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:31.516560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7a9c0-8c83-41d9-8e46-9813cbd782bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:31.542521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f8c7a9c0-8c83-41d9-8e46-9813cbd782bf None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:19:31.543981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f8c7a9c0-8c83-41d9-8e46-9813cbd782bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:31.698779 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1590/3134] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:19:31.727074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b1971-db9d-4785-8250-8e9de7d02d66 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:31.728562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-944b1971-db9d-4785-8250-8e9de7d02d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:31.904777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b1971-db9d-4785-8250-8e9de7d02d66 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:31.909357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daae98d4-d1c5-4eae-a140-d2904199d9fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:31.910275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae98d4-d1c5-4eae-a140-d2904199d9fa service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:31.910752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae98d4-d1c5-4eae-a140-d2904199d9fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:31.911295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daae98d4-d1c5-4eae-a140-d2904199d9fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:31.931841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae98d4-d1c5-4eae-a140-d2904199d9fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:31.933587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daae98d4-d1c5-4eae-a140-d2904199d9fa service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:31.970502 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1545/3135] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:19:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:19:33.167497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7a9c0-8c83-41d9-8e46-9813cbd782bf None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:33.176489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f8c7a9c0-8c83-41d9-8e46-9813cbd782bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:33.201525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7a9c0-8c83-41d9-8e46-9813cbd782bf None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:33.218719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc15007-5e6f-49c0-8ff4-fb32059907a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:33.221288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc15007-5e6f-49c0-8ff4-fb32059907a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:33.221760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc15007-5e6f-49c0-8ff4-fb32059907a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:33.222252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc15007-5e6f-49c0-8ff4-fb32059907a0 admin admin] PATH_INFO: `/v3/projects/ce3e2af12ee14f92b2bdd702c7ed6abf` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:33.230699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc15007-5e6f-49c0-8ff4-fb32059907a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce3e2af12ee14f92b2bdd702c7ed6abf)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:33.232899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc15007-5e6f-49c0-8ff4-fb32059907a0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:33.443519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fbc15007-5e6f-49c0-8ff4-fb32059907a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce3e2af12ee14f92b2bdd702c7ed6abf', 'request_id': 'req-fbc15007-5e6f-49c0-8ff4-fb32059907a0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:33.464144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fbc15007-5e6f-49c0-8ff4-fb32059907a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce3e2af12ee14f92b2bdd702c7ed6abf', 'request_id': 'req-fbc15007-5e6f-49c0-8ff4-fb32059907a0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:33.484910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fbc15007-5e6f-49c0-8ff4-fb32059907a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce3e2af12ee14f92b2bdd702c7ed6abf', 'request_id': 'req-fbc15007-5e6f-49c0-8ff4-fb32059907a0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:33.588612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fbc15007-5e6f-49c0-8ff4-fb32059907a0 admin admin] The token cache is being invalidate because project ce3e2af12ee14f92b2bdd702c7ed6abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:19:33.589046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fbc15007-5e6f-49c0-8ff4-fb32059907a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:33.590012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fbc15007-5e6f-49c0-8ff4-fb32059907a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:33.595055 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1591/3136] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:19:33 2022] DELETE /identity/v3/projects/ce3e2af12ee14f92b2bdd702c7ed6abf => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:19:33.600099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c7df2-0076-4ead-b95f-3f63c13a16e5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:33.600621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c7df2-0076-4ead-b95f-3f63c13a16e5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:33.600727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c7df2-0076-4ead-b95f-3f63c13a16e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:33.633913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a50c7df2-0076-4ead-b95f-3f63c13a16e5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:19:33.635262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a50c7df2-0076-4ead-b95f-3f63c13a16e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:33.694588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70adb51-60c7-4e82-8ba0-1143da6071a7 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:33.697353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70adb51-60c7-4e82-8ba0-1143da6071a7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:33.697804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70adb51-60c7-4e82-8ba0-1143da6071a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:33.794655 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1546/3137] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:19:33.798454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61581778-55de-4848-be2d-2ecde7bd1a7c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:33.798974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61581778-55de-4848-be2d-2ecde7bd1a7c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:33.799425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61581778-55de-4848-be2d-2ecde7bd1a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:33.811558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a70adb51-60c7-4e82-8ba0-1143da6071a7 None None] MFA Rules not processed for user `58aa09f776ab4ed0b15a1040102b370f`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:19:33.816692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a70adb51-60c7-4e82-8ba0-1143da6071a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:33.840666 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:19:33.848605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-61581778-55de-4848-be2d-2ecde7bd1a7c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:19:33.850366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-61581778-55de-4848-be2d-2ecde7bd1a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:33.864380 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1547/3138] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:19:33.865591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61581778-55de-4848-be2d-2ecde7bd1a7c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:33.881174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61581778-55de-4848-be2d-2ecde7bd1a7c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:33.883805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337220ad-2796-43ad-87a5-156d53feeb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:33.884692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337220ad-2796-43ad-87a5-156d53feeb49 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:33.885157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337220ad-2796-43ad-87a5-156d53feeb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:33.885603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337220ad-2796-43ad-87a5-156d53feeb49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:33.886614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337220ad-2796-43ad-87a5-156d53feeb49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:19:33.887114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337220ad-2796-43ad-87a5-156d53feeb49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:33.889683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337220ad-2796-43ad-87a5-156d53feeb49 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:33.907650 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1548/3139] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:19:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:19:33.909137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337220ad-2796-43ad-87a5-156d53feeb49 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:33.921184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337220ad-2796-43ad-87a5-156d53feeb49 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:33.928875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd607de-0863-41cf-baf9-6c45e1863697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:33.929982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd607de-0863-41cf-baf9-6c45e1863697 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:33.930484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd607de-0863-41cf-baf9-6c45e1863697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:33.930969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd607de-0863-41cf-baf9-6c45e1863697 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:33.932084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd607de-0863-41cf-baf9-6c45e1863697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:33.934238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd607de-0863-41cf-baf9-6c45e1863697 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:34.059953 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1549/3140] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:19:33 2022] POST /identity/v3/projects => generated 359 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:19:34.069636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd607de-0863-41cf-baf9-6c45e1863697 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:34.072713 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1592/3141] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:19:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:19:34.083192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70adb51-60c7-4e82-8ba0-1143da6071a7 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:34.086955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a70adb51-60c7-4e82-8ba0-1143da6071a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:34.233333 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:19:34.242045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70adb51-60c7-4e82-8ba0-1143da6071a7 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:34.246933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd607de-0863-41cf-baf9-6c45e1863697 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:34.263919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1ad66-dda0-4ed7-bc44-a3ae60317c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:34.265188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1ad66-dda0-4ed7-bc44-a3ae60317c38 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:34.268253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1ad66-dda0-4ed7-bc44-a3ae60317c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:34.268253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1ad66-dda0-4ed7-bc44-a3ae60317c38 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:34.271063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1ad66-dda0-4ed7-bc44-a3ae60317c38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:34.275796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1ad66-dda0-4ed7-bc44-a3ae60317c38 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:34.372520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7388e-ed25-4787-8ba1-8da6d11318bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:34.374359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7388e-ed25-4787-8ba1-8da6d11318bb service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:34.374869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7388e-ed25-4787-8ba1-8da6d11318bb service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:34.376273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7388e-ed25-4787-8ba1-8da6d11318bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:34.419097 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1550/3142] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:19:34 2022] POST /identity/v3/users => generated 280 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:19:34.424634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1ad66-dda0-4ed7-bc44-a3ae60317c38 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:34.447253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1ad66-dda0-4ed7-bc44-a3ae60317c38 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:34.464180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09883efb-0b3b-4585-b005-ade18f3c05f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:34.473840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09883efb-0b3b-4585-b005-ade18f3c05f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:34.473840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09883efb-0b3b-4585-b005-ade18f3c05f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:34.473840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09883efb-0b3b-4585-b005-ade18f3c05f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:34.473840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09883efb-0b3b-4585-b005-ade18f3c05f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:34.479142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09883efb-0b3b-4585-b005-ade18f3c05f8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:34.505563 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1551/3143] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:19:34.507662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09883efb-0b3b-4585-b005-ade18f3c05f8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:34.531319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7388e-ed25-4787-8ba1-8da6d11318bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:34.536600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7388e-ed25-4787-8ba1-8da6d11318bb service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:34.537744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09883efb-0b3b-4585-b005-ade18f3c05f8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:34.553425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af9d566-39b0-40e1-89c3-a4732e1ce393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:34.558324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9d566-39b0-40e1-89c3-a4732e1ce393 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:34.558324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9d566-39b0-40e1-89c3-a4732e1ce393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:34.558324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af9d566-39b0-40e1-89c3-a4732e1ce393 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:34.558864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9d566-39b0-40e1-89c3-a4732e1ce393 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:34.562475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af9d566-39b0-40e1-89c3-a4732e1ce393 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:34.564134 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1593/3144] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:19:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:19:34.581722 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1552/3145] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:19:34.585813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7388e-ed25-4787-8ba1-8da6d11318bb service glance] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:34.615193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7388e-ed25-4787-8ba1-8da6d11318bb service glance] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:34.618591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a02c5-cacf-4c0e-b187-d529560bb267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:34.621163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a02c5-cacf-4c0e-b187-d529560bb267 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:34.621778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a02c5-cacf-4c0e-b187-d529560bb267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:34.622263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23a02c5-cacf-4c0e-b187-d529560bb267 admin admin] PATH_INFO: `/v3/projects/ba47d30f2bf143e794d45c96c0df6c15/users/8297fa1f96f94e709ba3d511cbd9a012/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:34.633831 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:19:34.647276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a02c5-cacf-4c0e-b187-d529560bb267 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba47d30f2bf143e794d45c96c0df6c15, user_id=8297fa1f96f94e709ba3d511cbd9a012, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:34.656352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23a02c5-cacf-4c0e-b187-d529560bb267 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:34.743763 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1594/3146] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:19:34 2022] PUT /identity/v3/projects/ba47d30f2bf143e794d45c96c0df6c15/users/8297fa1f96f94e709ba3d511cbd9a012/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:19:34.744164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7193dd-8db6-4eda-af4b-bcd9df41edb2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:34.744558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7193dd-8db6-4eda-af4b-bcd9df41edb2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:34.744671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7193dd-8db6-4eda-af4b-bcd9df41edb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:34.847040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-cd7193dd-8db6-4eda-af4b-bcd9df41edb2 None None] MFA Rules not processed for user `8297fa1f96f94e709ba3d511cbd9a012`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:19:34.849547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cd7193dd-8db6-4eda-af4b-bcd9df41edb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:34.959324 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1553/3147] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:19:34 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:19:34.981704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a02c5-cacf-4c0e-b187-d529560bb267 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:34.983773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e23a02c5-cacf-4c0e-b187-d529560bb267 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:35.285621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23a02c5-cacf-4c0e-b187-d529560bb267 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:35.309623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd6ab5-5fb0-4b88-a0b9-d41750ead67e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:35.311491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd6ab5-5fb0-4b88-a0b9-d41750ead67e service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:35.311491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd6ab5-5fb0-4b88-a0b9-d41750ead67e service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:35.311491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd6ab5-5fb0-4b88-a0b9-d41750ead67e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:35.351121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd6ab5-5fb0-4b88-a0b9-d41750ead67e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:35.352728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd6ab5-5fb0-4b88-a0b9-d41750ead67e service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:35.381937 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1595/3148] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:19:34 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:19:35.586332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7193dd-8db6-4eda-af4b-bcd9df41edb2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:35.923625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7193dd-8db6-4eda-af4b-bcd9df41edb2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:35.936971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fd469-95b8-4969-a5f3-e83dcbfa6829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:35.938007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fd469-95b8-4969-a5f3-e83dcbfa6829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:35.940127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fd469-95b8-4969-a5f3-e83dcbfa6829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:35.940416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8fd469-95b8-4969-a5f3-e83dcbfa6829 admin admin] PATH_INFO: `/v3/users/8297fa1f96f94e709ba3d511cbd9a012` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:35.942734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fd469-95b8-4969-a5f3-e83dcbfa6829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8297fa1f96f94e709ba3d511cbd9a012)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:35.963676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8fd469-95b8-4969-a5f3-e83dcbfa6829 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:36.252414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eb8fd469-95b8-4969-a5f3-e83dcbfa6829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8297fa1f96f94e709ba3d511cbd9a012'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:36.271905 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:19:36.296714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eb8fd469-95b8-4969-a5f3-e83dcbfa6829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8297fa1f96f94e709ba3d511cbd9a012'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:36.300919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eb8fd469-95b8-4969-a5f3-e83dcbfa6829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8297fa1f96f94e709ba3d511cbd9a012'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:36.301668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eb8fd469-95b8-4969-a5f3-e83dcbfa6829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8297fa1f96f94e709ba3d511cbd9a012'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:36.324594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eb8fd469-95b8-4969-a5f3-e83dcbfa6829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8297fa1f96f94e709ba3d511cbd9a012'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:36.442014 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1554/3149] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:19:35 2022] DELETE /identity/v3/users/8297fa1f96f94e709ba3d511cbd9a012 => generated 0 bytes in 853 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:19:36.443250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05207972-fb43-4abe-bd52-1d371ef8791c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:36.443778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05207972-fb43-4abe-bd52-1d371ef8791c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:36.443902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05207972-fb43-4abe-bd52-1d371ef8791c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:36.518527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-05207972-fb43-4abe-bd52-1d371ef8791c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:19:36.522607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-05207972-fb43-4abe-bd52-1d371ef8791c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:36.753462 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1596/3150] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:19:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:19:36.778841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fd469-95b8-4969-a5f3-e83dcbfa6829 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:36.782274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eb8fd469-95b8-4969-a5f3-e83dcbfa6829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:36.978219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8fd469-95b8-4969-a5f3-e83dcbfa6829 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:36.987187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b01f31-79a8-4e53-bde4-a2451f825ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:36.990007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b01f31-79a8-4e53-bde4-a2451f825ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:36.990573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b01f31-79a8-4e53-bde4-a2451f825ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:36.991099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b01f31-79a8-4e53-bde4-a2451f825ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:37.027635 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b01f31-79a8-4e53-bde4-a2451f825ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:37.036872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b01f31-79a8-4e53-bde4-a2451f825ae8 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:37.111963 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1555/3151] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:19:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:19:38.928600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05207972-fb43-4abe-bd52-1d371ef8791c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:38.930855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-05207972-fb43-4abe-bd52-1d371ef8791c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:38.964929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05207972-fb43-4abe-bd52-1d371ef8791c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:38.990428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0f04b-9703-4941-88b8-d00b6564ba84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:38.990964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0f04b-9703-4941-88b8-d00b6564ba84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:39.010766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0f04b-9703-4941-88b8-d00b6564ba84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:39.011126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0f04b-9703-4941-88b8-d00b6564ba84 admin admin] PATH_INFO: `/v3/projects/ba47d30f2bf143e794d45c96c0df6c15` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:39.018254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0f04b-9703-4941-88b8-d00b6564ba84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba47d30f2bf143e794d45c96c0df6c15)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:39.018254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0f04b-9703-4941-88b8-d00b6564ba84 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:39.267169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9ae0f04b-9703-4941-88b8-d00b6564ba84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba47d30f2bf143e794d45c96c0df6c15', 'request_id': 'req-9ae0f04b-9703-4941-88b8-d00b6564ba84'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:39.289130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9ae0f04b-9703-4941-88b8-d00b6564ba84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba47d30f2bf143e794d45c96c0df6c15', 'request_id': 'req-9ae0f04b-9703-4941-88b8-d00b6564ba84'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:39.305527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9ae0f04b-9703-4941-88b8-d00b6564ba84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba47d30f2bf143e794d45c96c0df6c15', 'request_id': 'req-9ae0f04b-9703-4941-88b8-d00b6564ba84'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:39.318575 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:19:39.451952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9ae0f04b-9703-4941-88b8-d00b6564ba84 admin admin] The token cache is being invalidate because project ba47d30f2bf143e794d45c96c0df6c15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:19:39.452259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9ae0f04b-9703-4941-88b8-d00b6564ba84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:39.456427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9ae0f04b-9703-4941-88b8-d00b6564ba84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:39.465917 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1597/3152] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:19:38 2022] DELETE /identity/v3/projects/ba47d30f2bf143e794d45c96c0df6c15 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:19:39.467808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccc93a-8268-4afe-9a36-c116f53e4baa None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:39.468701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccc93a-8268-4afe-9a36-c116f53e4baa None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:39.469173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccc93a-8268-4afe-9a36-c116f53e4baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:39.637028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-30ccc93a-8268-4afe-9a36-c116f53e4baa None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:19:39.638547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-30ccc93a-8268-4afe-9a36-c116f53e4baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:39.866615 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1556/3153] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:19:39.936335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e6ba6-998c-4519-8ba1-ae77fb27fd64 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:39.937225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e6ba6-998c-4519-8ba1-ae77fb27fd64 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:39.938360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e6ba6-998c-4519-8ba1-ae77fb27fd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:39.961603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-631e6ba6-998c-4519-8ba1-ae77fb27fd64 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:19:39.963135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-631e6ba6-998c-4519-8ba1-ae77fb27fd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:39.981931 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1598/3154] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:19:39.987249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccc93a-8268-4afe-9a36-c116f53e4baa None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:40.007895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccc93a-8268-4afe-9a36-c116f53e4baa None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:40.037595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562f152-266a-45a2-8dd2-a9d255bf56f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:40.038305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562f152-266a-45a2-8dd2-a9d255bf56f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:40.038595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562f152-266a-45a2-8dd2-a9d255bf56f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:40.038974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562f152-266a-45a2-8dd2-a9d255bf56f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:40.061263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562f152-266a-45a2-8dd2-a9d255bf56f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:19:40.061664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562f152-266a-45a2-8dd2-a9d255bf56f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:40.069299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562f152-266a-45a2-8dd2-a9d255bf56f7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:40.114660 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1557/3155] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:19:40.115977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e6ba6-998c-4519-8ba1-ae77fb27fd64 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:40.130145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e6ba6-998c-4519-8ba1-ae77fb27fd64 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:40.141743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09d0c3-976a-469d-bf38-a2cb0919df28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:40.142578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09d0c3-976a-469d-bf38-a2cb0919df28 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:40.146416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09d0c3-976a-469d-bf38-a2cb0919df28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:40.146416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b09d0c3-976a-469d-bf38-a2cb0919df28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:40.147205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09d0c3-976a-469d-bf38-a2cb0919df28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:40.151692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b09d0c3-976a-469d-bf38-a2cb0919df28 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:40.339676 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1599/3156] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:19:40 2022] POST /identity/v3/projects => generated 383 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:19:40.345607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562f152-266a-45a2-8dd2-a9d255bf56f7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:40.388895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562f152-266a-45a2-8dd2-a9d255bf56f7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:40.460345 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:19:40.548322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd942d-5765-483d-bd78-017ecd5abcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:40.549395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd942d-5765-483d-bd78-017ecd5abcdc admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:40.550411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd942d-5765-483d-bd78-017ecd5abcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:40.551285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd942d-5765-483d-bd78-017ecd5abcdc admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:40.561139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd942d-5765-483d-bd78-017ecd5abcdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:40.561139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd942d-5765-483d-bd78-017ecd5abcdc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:40.690182 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1558/3157] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:19:40 2022] POST /identity/v3/users => generated 292 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:19:40.690660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09d0c3-976a-469d-bf38-a2cb0919df28 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:40.705259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b09d0c3-976a-469d-bf38-a2cb0919df28 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:40.715407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6533f4-15f5-4c8f-9dc6-4c9744f09162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:40.717696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6533f4-15f5-4c8f-9dc6-4c9744f09162 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:40.721815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6533f4-15f5-4c8f-9dc6-4c9744f09162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:40.722723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6533f4-15f5-4c8f-9dc6-4c9744f09162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:40.725794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6533f4-15f5-4c8f-9dc6-4c9744f09162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:40.733539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6533f4-15f5-4c8f-9dc6-4c9744f09162 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:40.776567 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1600/3158] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:19:40.777383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd942d-5765-483d-bd78-017ecd5abcdc admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:40.810236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd942d-5765-483d-bd78-017ecd5abcdc admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:40.827871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9cc5b-269a-4aee-b25b-191d5e9bb3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:40.832082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9cc5b-269a-4aee-b25b-191d5e9bb3e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:40.832561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9cc5b-269a-4aee-b25b-191d5e9bb3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:40.834629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9cc5b-269a-4aee-b25b-191d5e9bb3e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:40.837698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9cc5b-269a-4aee-b25b-191d5e9bb3e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:40.839557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9cc5b-269a-4aee-b25b-191d5e9bb3e5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:40.865386 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1559/3159] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:19:40.874596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6533f4-15f5-4c8f-9dc6-4c9744f09162 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:40.888922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6533f4-15f5-4c8f-9dc6-4c9744f09162 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:40.901017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13147ab-16c4-406c-af9e-d692c6345f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:40.906250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13147ab-16c4-406c-af9e-d692c6345f8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:40.907106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13147ab-16c4-406c-af9e-d692c6345f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:40.908724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13147ab-16c4-406c-af9e-d692c6345f8d admin admin] PATH_INFO: `/v3/projects/420245e289574680ae1c78218dc8e12b/users/97544bddf4d94925b0c6764a8cb0914b/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:40.957601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13147ab-16c4-406c-af9e-d692c6345f8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=420245e289574680ae1c78218dc8e12b, user_id=97544bddf4d94925b0c6764a8cb0914b, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:40.960411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13147ab-16c4-406c-af9e-d692c6345f8d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:41.086781 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1601/3160] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:19:40 2022] PUT /identity/v3/projects/420245e289574680ae1c78218dc8e12b/users/97544bddf4d94925b0c6764a8cb0914b/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:19:41.092177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525f284-155f-4f6b-b564-5bd9d06703de None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:41.092471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525f284-155f-4f6b-b564-5bd9d06703de None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:41.092759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525f284-155f-4f6b-b564-5bd9d06703de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:41.156443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1525f284-155f-4f6b-b564-5bd9d06703de None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:19:41.157759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1525f284-155f-4f6b-b564-5bd9d06703de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:41.327182 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1560/3161] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:19:41.347206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13147ab-16c4-406c-af9e-d692c6345f8d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:41.354660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c13147ab-16c4-406c-af9e-d692c6345f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:41.475206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13147ab-16c4-406c-af9e-d692c6345f8d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:41.479363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5864480-081e-4571-a096-24e82a1022cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:41.480042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5864480-081e-4571-a096-24e82a1022cb service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:41.480326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5864480-081e-4571-a096-24e82a1022cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:41.480602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5864480-081e-4571-a096-24e82a1022cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:41.506441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5864480-081e-4571-a096-24e82a1022cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:41.508989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5864480-081e-4571-a096-24e82a1022cb service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:41.531138 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1602/3162] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:19:48.593427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ad991-2913-4eaf-a16b-a4da98a0cca9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:48.601896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ad991-2913-4eaf-a16b-a4da98a0cca9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:48.601896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ad991-2913-4eaf-a16b-a4da98a0cca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:48.622410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-702ad991-2913-4eaf-a16b-a4da98a0cca9 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:19:48.624121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-702ad991-2913-4eaf-a16b-a4da98a0cca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:48.744999 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1561/3163] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:19:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:19:48.759666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5864480-081e-4571-a096-24e82a1022cb service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:48.762580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b5864480-081e-4571-a096-24e82a1022cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:48.809623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ad991-2913-4eaf-a16b-a4da98a0cca9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:48.811873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-702ad991-2913-4eaf-a16b-a4da98a0cca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:48.843233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ad991-2913-4eaf-a16b-a4da98a0cca9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:48.852655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da804529-1553-47e5-bd76-99fee0fd4b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:48.853841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da804529-1553-47e5-bd76-99fee0fd4b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:48.854370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da804529-1553-47e5-bd76-99fee0fd4b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:48.855159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da804529-1553-47e5-bd76-99fee0fd4b1c admin admin] PATH_INFO: `/v3/users/d3a1bc0c85b0488183eaebfe740614b9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:48.860461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da804529-1553-47e5-bd76-99fee0fd4b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3a1bc0c85b0488183eaebfe740614b9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:48.861280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da804529-1553-47e5-bd76-99fee0fd4b1c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:48.867836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5864480-081e-4571-a096-24e82a1022cb service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:48.873723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f7f32-9c5b-48d6-9d39-7586e82bd6f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:48.874695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f7f32-9c5b-48d6-9d39-7586e82bd6f8 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:48.875539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f7f32-9c5b-48d6-9d39-7586e82bd6f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:48.875981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716f7f32-9c5b-48d6-9d39-7586e82bd6f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:48.887465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f7f32-9c5b-48d6-9d39-7586e82bd6f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:48.889333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716f7f32-9c5b-48d6-9d39-7586e82bd6f8 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:48.901031 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1603/3164] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:19:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:19:49.123703 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:19:49.190116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-da804529-1553-47e5-bd76-99fee0fd4b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3a1bc0c85b0488183eaebfe740614b9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:49.276617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-da804529-1553-47e5-bd76-99fee0fd4b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3a1bc0c85b0488183eaebfe740614b9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:49.277536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-da804529-1553-47e5-bd76-99fee0fd4b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3a1bc0c85b0488183eaebfe740614b9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:49.284558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-da804529-1553-47e5-bd76-99fee0fd4b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3a1bc0c85b0488183eaebfe740614b9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:49.292028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-da804529-1553-47e5-bd76-99fee0fd4b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3a1bc0c85b0488183eaebfe740614b9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:49.394846 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1562/3165] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:19:48 2022] DELETE /identity/v3/users/d3a1bc0c85b0488183eaebfe740614b9 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:19:50.716696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f7f32-9c5b-48d6-9d39-7586e82bd6f8 service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:50.740502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716f7f32-9c5b-48d6-9d39-7586e82bd6f8 service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:50.782728 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:19:50.906511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9597ed-8389-4531-ae53-5196f2fbff59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:50.909914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9597ed-8389-4531-ae53-5196f2fbff59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:50.913992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9597ed-8389-4531-ae53-5196f2fbff59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:50.913992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9597ed-8389-4531-ae53-5196f2fbff59 admin admin] PATH_INFO: `/v3/projects/050d7677abb5475f990890c66b90abe6` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:50.914481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9597ed-8389-4531-ae53-5196f2fbff59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=050d7677abb5475f990890c66b90abe6)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:50.919629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9597ed-8389-4531-ae53-5196f2fbff59 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:51.081062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8a9597ed-8389-4531-ae53-5196f2fbff59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '050d7677abb5475f990890c66b90abe6', 'request_id': 'req-8a9597ed-8389-4531-ae53-5196f2fbff59'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:51.095541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8a9597ed-8389-4531-ae53-5196f2fbff59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '050d7677abb5475f990890c66b90abe6', 'request_id': 'req-8a9597ed-8389-4531-ae53-5196f2fbff59'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:51.113218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8a9597ed-8389-4531-ae53-5196f2fbff59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '050d7677abb5475f990890c66b90abe6', 'request_id': 'req-8a9597ed-8389-4531-ae53-5196f2fbff59'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:51.198317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8a9597ed-8389-4531-ae53-5196f2fbff59 admin admin] The token cache is being invalidate because project 050d7677abb5475f990890c66b90abe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:19:51.198605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8a9597ed-8389-4531-ae53-5196f2fbff59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:51.199662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8a9597ed-8389-4531-ae53-5196f2fbff59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:19:51.201848 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1604/3166] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:19:50 2022] DELETE /identity/v3/projects/050d7677abb5475f990890c66b90abe6 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:19:51.207004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c332b-c029-4183-8ffc-6ab66e0d6981 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:51.207899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c332b-c029-4183-8ffc-6ab66e0d6981 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:51.208336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c332b-c029-4183-8ffc-6ab66e0d6981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:51.246877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-043c332b-c029-4183-8ffc-6ab66e0d6981 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:19:51.248162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-043c332b-c029-4183-8ffc-6ab66e0d6981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:51.336284 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1563/3167] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:19:51.337868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d71b28-5ef3-435b-b1e6-fb55914edd20 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:51.338195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d71b28-5ef3-435b-b1e6-fb55914edd20 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:51.338477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d71b28-5ef3-435b-b1e6-fb55914edd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:51.379948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-84d71b28-5ef3-435b-b1e6-fb55914edd20 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:19:51.382678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-84d71b28-5ef3-435b-b1e6-fb55914edd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:51.407690 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1605/3168] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:19:51.408753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c332b-c029-4183-8ffc-6ab66e0d6981 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:51.423329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c332b-c029-4183-8ffc-6ab66e0d6981 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:51.433651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d739a9e-3dfc-455f-ba66-b956c7fa39c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:51.435032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d739a9e-3dfc-455f-ba66-b956c7fa39c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:51.435032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d739a9e-3dfc-455f-ba66-b956c7fa39c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:51.435032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d739a9e-3dfc-455f-ba66-b956c7fa39c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:51.436763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d739a9e-3dfc-455f-ba66-b956c7fa39c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:19:51.439838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d739a9e-3dfc-455f-ba66-b956c7fa39c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:51.441871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d739a9e-3dfc-455f-ba66-b956c7fa39c3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:51.483568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d71b28-5ef3-435b-b1e6-fb55914edd20 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:51.496840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d71b28-5ef3-435b-b1e6-fb55914edd20 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:51.497040 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1564/3169] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:19:51.514148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180a88e-6691-4b85-ae5d-33d5793a0239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:51.515150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180a88e-6691-4b85-ae5d-33d5793a0239 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:51.515550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180a88e-6691-4b85-ae5d-33d5793a0239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:51.516041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d180a88e-6691-4b85-ae5d-33d5793a0239 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:51.517080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180a88e-6691-4b85-ae5d-33d5793a0239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:51.520361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d180a88e-6691-4b85-ae5d-33d5793a0239 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:51.745729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d739a9e-3dfc-455f-ba66-b956c7fa39c3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:51.753969 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1606/3170] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:19:51 2022] POST /identity/v3/projects => generated 397 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:19:51.763902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d739a9e-3dfc-455f-ba66-b956c7fa39c3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:51.931144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b44c6-2238-4448-8787-0aff1c1c47ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:51.932012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b44c6-2238-4448-8787-0aff1c1c47ca admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:51.932664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b44c6-2238-4448-8787-0aff1c1c47ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:51.941931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9b44c6-2238-4448-8787-0aff1c1c47ca admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:51.941931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b44c6-2238-4448-8787-0aff1c1c47ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:51.941931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9b44c6-2238-4448-8787-0aff1c1c47ca admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:52.095116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180a88e-6691-4b85-ae5d-33d5793a0239 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:52.095292 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1565/3171] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:19:51 2022] POST /identity/v3/users => generated 299 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:19:52.111132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d180a88e-6691-4b85-ae5d-33d5793a0239 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:52.126306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58aff5-1331-4d64-90be-0fe7192acbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:52.127072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58aff5-1331-4d64-90be-0fe7192acbe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:52.127363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58aff5-1331-4d64-90be-0fe7192acbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:52.127644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58aff5-1331-4d64-90be-0fe7192acbe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:52.128451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58aff5-1331-4d64-90be-0fe7192acbe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:52.132311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58aff5-1331-4d64-90be-0fe7192acbe7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:52.162457 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1607/3172] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:19:52.163963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b44c6-2238-4448-8787-0aff1c1c47ca admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:52.177909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9b44c6-2238-4448-8787-0aff1c1c47ca admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:52.183662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e5edb-0f1f-48a6-a028-d565473fe71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:52.185451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e5edb-0f1f-48a6-a028-d565473fe71e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:52.185790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e5edb-0f1f-48a6-a028-d565473fe71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:52.186161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e5edb-0f1f-48a6-a028-d565473fe71e admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:52.187002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e5edb-0f1f-48a6-a028-d565473fe71e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:52.189816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e5edb-0f1f-48a6-a028-d565473fe71e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:52.212112 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1566/3173] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:19:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:19:52.216028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58aff5-1331-4d64-90be-0fe7192acbe7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:52.232313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58aff5-1331-4d64-90be-0fe7192acbe7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:52.245057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cebd7f-9cba-47b2-8afa-8e4d8bd8c29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:52.245981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cebd7f-9cba-47b2-8afa-8e4d8bd8c29b admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:52.246297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cebd7f-9cba-47b2-8afa-8e4d8bd8c29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:52.246568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cebd7f-9cba-47b2-8afa-8e4d8bd8c29b admin admin] PATH_INFO: `/v3/projects/6a016620a72e4a01879abfbf8f9fb98c/users/2e8fc4623d924e09874d49f59572346a/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:52.284038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cebd7f-9cba-47b2-8afa-8e4d8bd8c29b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a016620a72e4a01879abfbf8f9fb98c, user_id=2e8fc4623d924e09874d49f59572346a, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:52.286737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cebd7f-9cba-47b2-8afa-8e4d8bd8c29b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:52.389292 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1608/3174] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:19:52 2022] PUT /identity/v3/projects/6a016620a72e4a01879abfbf8f9fb98c/users/2e8fc4623d924e09874d49f59572346a/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:19:52.396429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b62494-0fba-4b1c-b9ca-c49d1e3b3a2e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:52.397000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b62494-0fba-4b1c-b9ca-c49d1e3b3a2e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:52.397459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b62494-0fba-4b1c-b9ca-c49d1e3b3a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:52.444598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a7b62494-0fba-4b1c-b9ca-c49d1e3b3a2e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:19:52.446210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a7b62494-0fba-4b1c-b9ca-c49d1e3b3a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:52.470855 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:19:52.632814 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1567/3175] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:19:52.657493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cebd7f-9cba-47b2-8afa-8e4d8bd8c29b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:52.659296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c0cebd7f-9cba-47b2-8afa-8e4d8bd8c29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:52.826870 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:19:52.936177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cebd7f-9cba-47b2-8afa-8e4d8bd8c29b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:52.951497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278babd1-4dff-432b-9c47-9af17ab6a6bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:52.952974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278babd1-4dff-432b-9c47-9af17ab6a6bf service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:52.953267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278babd1-4dff-432b-9c47-9af17ab6a6bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:52.954712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278babd1-4dff-432b-9c47-9af17ab6a6bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:52.990687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278babd1-4dff-432b-9c47-9af17ab6a6bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:53.004388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278babd1-4dff-432b-9c47-9af17ab6a6bf service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:19:53.038234 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1609/3176] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:19:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:19:59.497406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b62494-0fba-4b1c-b9ca-c49d1e3b3a2e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:19:59.500487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a7b62494-0fba-4b1c-b9ca-c49d1e3b3a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:59.744276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b62494-0fba-4b1c-b9ca-c49d1e3b3a2e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:19:59.765106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc158df-efc2-419b-bec8-ff031dbeafe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:19:59.765298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc158df-efc2-419b-bec8-ff031dbeafe7 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:59.765528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc158df-efc2-419b-bec8-ff031dbeafe7 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:59.766924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc158df-efc2-419b-bec8-ff031dbeafe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:59.771197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6cc158df-efc2-419b-bec8-ff031dbeafe7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:19:59.864642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64420e94-250f-4f18-8ea7-30c04be4a597 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:19:59.865147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64420e94-250f-4f18-8ea7-30c04be4a597 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:19:59.865574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64420e94-250f-4f18-8ea7-30c04be4a597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:19:59.982984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc158df-efc2-419b-bec8-ff031dbeafe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:19:59.993049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc158df-efc2-419b-bec8-ff031dbeafe7 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:00.043197 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1568/3177] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:19:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:20:00.076328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-64420e94-250f-4f18-8ea7-30c04be4a597 None None] MFA Rules not processed for user `97544bddf4d94925b0c6764a8cb0914b`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:00.078667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-64420e94-250f-4f18-8ea7-30c04be4a597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:00.337247 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1610/3178] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:19:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:00.348544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ba059-96d0-45f1-9fea-32d3a6fb55c2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:00.349428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ba059-96d0-45f1-9fea-32d3a6fb55c2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:00.350485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807ba059-96d0-45f1-9fea-32d3a6fb55c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:00.396560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-807ba059-96d0-45f1-9fea-32d3a6fb55c2 None None] MFA Rules not processed for user `97544bddf4d94925b0c6764a8cb0914b`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:00.398275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-807ba059-96d0-45f1-9fea-32d3a6fb55c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:00.424297 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1569/3179] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:00.500893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64420e94-250f-4f18-8ea7-30c04be4a597 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:00.529290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64420e94-250f-4f18-8ea7-30c04be4a597 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:00.548371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f7333a-545a-49b5-8ee7-3c16dbb29b35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:00.552754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7333a-545a-49b5-8ee7-3c16dbb29b35 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:00.552754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7333a-545a-49b5-8ee7-3c16dbb29b35 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:00.552754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f7333a-545a-49b5-8ee7-3c16dbb29b35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:00.585591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7333a-545a-49b5-8ee7-3c16dbb29b35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:00.587248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f7333a-545a-49b5-8ee7-3c16dbb29b35 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:00.656050 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1611/3180] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:20:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:20:02.536653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ba059-96d0-45f1-9fea-32d3a6fb55c2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:02.539191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-807ba059-96d0-45f1-9fea-32d3a6fb55c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:02.570559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807ba059-96d0-45f1-9fea-32d3a6fb55c2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:02.582250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12117a6-afea-4d94-96b5-e1c70ec14d25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:02.586408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12117a6-afea-4d94-96b5-e1c70ec14d25 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:02.604053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12117a6-afea-4d94-96b5-e1c70ec14d25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:02.604053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12117a6-afea-4d94-96b5-e1c70ec14d25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:02.608073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c12117a6-afea-4d94-96b5-e1c70ec14d25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:02.667859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12117a6-afea-4d94-96b5-e1c70ec14d25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:02.674177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12117a6-afea-4d94-96b5-e1c70ec14d25 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:02.714778 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1570/3181] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:20:10.611934 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=55 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:12.686494 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:18.464422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebc7f5-c268-4db5-955c-7019178f3b8e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:18.464933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebc7f5-c268-4db5-955c-7019178f3b8e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:18.465261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebc7f5-c268-4db5-955c-7019178f3b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:18.520306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a6ebc7f5-c268-4db5-955c-7019178f3b8e None None] MFA Rules not processed for user `2e8fc4623d924e09874d49f59572346a`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:18.526274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a6ebc7f5-c268-4db5-955c-7019178f3b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:18.805567 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1612/3182] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:18.824495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4f600-b1c3-457d-920e-fec9a0dc19a5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:18.825461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4f600-b1c3-457d-920e-fec9a0dc19a5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:18.826778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4f600-b1c3-457d-920e-fec9a0dc19a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:18.863480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-74a4f600-b1c3-457d-920e-fec9a0dc19a5 None None] MFA Rules not processed for user `2e8fc4623d924e09874d49f59572346a`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:18.866044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-74a4f600-b1c3-457d-920e-fec9a0dc19a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:18.876929 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1571/3183] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:18.958292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebc7f5-c268-4db5-955c-7019178f3b8e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:18.959882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a6ebc7f5-c268-4db5-955c-7019178f3b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:19.012203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebc7f5-c268-4db5-955c-7019178f3b8e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:19.038416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f5331-cf98-4c86-a269-f6c0f4852e78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:19.039124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f5331-cf98-4c86-a269-f6c0f4852e78 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:19.039411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f5331-cf98-4c86-a269-f6c0f4852e78 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:19.039686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f5331-cf98-4c86-a269-f6c0f4852e78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:19.052687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f5331-cf98-4c86-a269-f6c0f4852e78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:19.054698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f5331-cf98-4c86-a269-f6c0f4852e78 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:19.068201 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1613/3184] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:20:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:20:19.553817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4f600-b1c3-457d-920e-fec9a0dc19a5 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:19.569746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4f600-b1c3-457d-920e-fec9a0dc19a5 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:19.577355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09bab9-14ee-4b73-b8ed-0f8c1019402a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:19.578723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09bab9-14ee-4b73-b8ed-0f8c1019402a service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:19.579216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09bab9-14ee-4b73-b8ed-0f8c1019402a service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:19.579677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09bab9-14ee-4b73-b8ed-0f8c1019402a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:19.581926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ac09bab9-14ee-4b73-b8ed-0f8c1019402a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:19.654633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09bab9-14ee-4b73-b8ed-0f8c1019402a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:19.657488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09bab9-14ee-4b73-b8ed-0f8c1019402a service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:19.675151 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1572/3185] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:20:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:20:19.683041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f5331-cf98-4c86-a269-f6c0f4852e78 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:19.686890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-af8f5331-cf98-4c86-a269-f6c0f4852e78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:19.782924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f5331-cf98-4c86-a269-f6c0f4852e78 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:19.791164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93fd55-2302-4d7c-8693-d8fd701d3c4a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:19.792001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93fd55-2302-4d7c-8693-d8fd701d3c4a service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:19.792287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93fd55-2302-4d7c-8693-d8fd701d3c4a service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:19.792563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93fd55-2302-4d7c-8693-d8fd701d3c4a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:19.794421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3f93fd55-2302-4d7c-8693-d8fd701d3c4a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:19.807259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93fd55-2302-4d7c-8693-d8fd701d3c4a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:19.808838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93fd55-2302-4d7c-8693-d8fd701d3c4a service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:19.836209 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1614/3186] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:20:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:20:19.957200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09bab9-14ee-4b73-b8ed-0f8c1019402a service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:19.960753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ac09bab9-14ee-4b73-b8ed-0f8c1019402a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:20.012733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09bab9-14ee-4b73-b8ed-0f8c1019402a service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:20.033746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64520515-83bb-4595-a1e1-63e4668e1d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:20.034686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64520515-83bb-4595-a1e1-63e4668e1d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:20.034974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64520515-83bb-4595-a1e1-63e4668e1d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:20.035248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64520515-83bb-4595-a1e1-63e4668e1d77 admin admin] PATH_INFO: `/v3/users/744a25fb94b94384b064ed10c3bd9374` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:20.041196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64520515-83bb-4595-a1e1-63e4668e1d77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=744a25fb94b94384b064ed10c3bd9374)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:20.047438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64520515-83bb-4595-a1e1-63e4668e1d77 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:20.343889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-64520515-83bb-4595-a1e1-63e4668e1d77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '744a25fb94b94384b064ed10c3bd9374'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:20.376280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-64520515-83bb-4595-a1e1-63e4668e1d77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '744a25fb94b94384b064ed10c3bd9374'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:20.377323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-64520515-83bb-4595-a1e1-63e4668e1d77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '744a25fb94b94384b064ed10c3bd9374'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:20.378837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-64520515-83bb-4595-a1e1-63e4668e1d77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '744a25fb94b94384b064ed10c3bd9374'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:20.391009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-64520515-83bb-4595-a1e1-63e4668e1d77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '744a25fb94b94384b064ed10c3bd9374'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:20.479006 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1573/3187] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:20:19 2022] DELETE /identity/v3/users/744a25fb94b94384b064ed10c3bd9374 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:21.039066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93fd55-2302-4d7c-8693-d8fd701d3c4a service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:21.052385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93fd55-2302-4d7c-8693-d8fd701d3c4a service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:21.211215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0005303a-8505-4b60-a045-345d2ef09b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:21.212139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005303a-8505-4b60-a045-345d2ef09b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:21.212426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005303a-8505-4b60-a045-345d2ef09b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:21.212707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0005303a-8505-4b60-a045-345d2ef09b72 admin admin] PATH_INFO: `/v3/projects/b5d834f874ce42149411f1ab6c61f798` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:21.215236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005303a-8505-4b60-a045-345d2ef09b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d834f874ce42149411f1ab6c61f798)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:21.219099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0005303a-8505-4b60-a045-345d2ef09b72 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:21.235263 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:21.420532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0005303a-8505-4b60-a045-345d2ef09b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d834f874ce42149411f1ab6c61f798', 'request_id': 'req-0005303a-8505-4b60-a045-345d2ef09b72'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:21.444266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0005303a-8505-4b60-a045-345d2ef09b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d834f874ce42149411f1ab6c61f798', 'request_id': 'req-0005303a-8505-4b60-a045-345d2ef09b72'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:21.456899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0005303a-8505-4b60-a045-345d2ef09b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d834f874ce42149411f1ab6c61f798', 'request_id': 'req-0005303a-8505-4b60-a045-345d2ef09b72'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:21.556159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0005303a-8505-4b60-a045-345d2ef09b72 admin admin] The token cache is being invalidate because project b5d834f874ce42149411f1ab6c61f798 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:20:21.556797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0005303a-8505-4b60-a045-345d2ef09b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:21.559990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0005303a-8505-4b60-a045-345d2ef09b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:21.567168 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1615/3188] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:20:21 2022] DELETE /identity/v3/projects/b5d834f874ce42149411f1ab6c61f798 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:21.572248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de00509-24c5-4e5a-888c-a42b4b2d2fef None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:21.572739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de00509-24c5-4e5a-888c-a42b4b2d2fef None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:21.572863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de00509-24c5-4e5a-888c-a42b4b2d2fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:21.659436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8de00509-24c5-4e5a-888c-a42b4b2d2fef None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:21.661334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8de00509-24c5-4e5a-888c-a42b4b2d2fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:21.908714 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1574/3189] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:21.917007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc82a1-1098-40af-ba8e-d45ba358eb09 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:21.917599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc82a1-1098-40af-ba8e-d45ba358eb09 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:21.918317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc82a1-1098-40af-ba8e-d45ba358eb09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:21.958271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d6dc82a1-1098-40af-ba8e-d45ba358eb09 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:21.960016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d6dc82a1-1098-40af-ba8e-d45ba358eb09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:21.990950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de00509-24c5-4e5a-888c-a42b4b2d2fef None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:22.008871 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:22.011808 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1616/3190] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:22.024657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de00509-24c5-4e5a-888c-a42b4b2d2fef None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:22.043131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70e3f6-51de-4c4d-8e90-53d81ccac33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:22.044030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70e3f6-51de-4c4d-8e90-53d81ccac33f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:22.044291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70e3f6-51de-4c4d-8e90-53d81ccac33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:22.044611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70e3f6-51de-4c4d-8e90-53d81ccac33f admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:22.045400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70e3f6-51de-4c4d-8e90-53d81ccac33f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:20:22.045742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70e3f6-51de-4c4d-8e90-53d81ccac33f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:22.048897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f70e3f6-51de-4c4d-8e90-53d81ccac33f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:22.102578 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1575/3191] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:20:22.120939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc82a1-1098-40af-ba8e-d45ba358eb09 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:22.136357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc82a1-1098-40af-ba8e-d45ba358eb09 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:22.155593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9654c-9d6d-4ad2-99c3-e4c65deafbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:22.158756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9654c-9d6d-4ad2-99c3-e4c65deafbab admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:22.159336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9654c-9d6d-4ad2-99c3-e4c65deafbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:22.159875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad9654c-9d6d-4ad2-99c3-e4c65deafbab admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:22.162256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9654c-9d6d-4ad2-99c3-e4c65deafbab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:22.168763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad9654c-9d6d-4ad2-99c3-e4c65deafbab admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:22.372342 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1617/3192] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:20:22 2022] POST /identity/v3/projects => generated 389 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:20:22.374007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70e3f6-51de-4c4d-8e90-53d81ccac33f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:22.387181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f70e3f6-51de-4c4d-8e90-53d81ccac33f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:22.484368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb5e4f-bbeb-49e2-b7fb-20b118424dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:22.486254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb5e4f-bbeb-49e2-b7fb-20b118424dfe admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:22.489652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb5e4f-bbeb-49e2-b7fb-20b118424dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:22.489652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb5e4f-bbeb-49e2-b7fb-20b118424dfe admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:22.489652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb5e4f-bbeb-49e2-b7fb-20b118424dfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:22.490265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb5e4f-bbeb-49e2-b7fb-20b118424dfe admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:22.615087 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1576/3193] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:20:22 2022] POST /identity/v3/users => generated 295 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:20:22.617006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9654c-9d6d-4ad2-99c3-e4c65deafbab admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:22.632110 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad9654c-9d6d-4ad2-99c3-e4c65deafbab admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:22.646204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930ce3c-b0c6-42f9-8134-081c13e8dc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:22.648318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930ce3c-b0c6-42f9-8134-081c13e8dc8f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:22.648844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930ce3c-b0c6-42f9-8134-081c13e8dc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:22.649590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930ce3c-b0c6-42f9-8134-081c13e8dc8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:22.650763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930ce3c-b0c6-42f9-8134-081c13e8dc8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:22.656204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6930ce3c-b0c6-42f9-8134-081c13e8dc8f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:22.673897 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1618/3194] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:20:22.678529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb5e4f-bbeb-49e2-b7fb-20b118424dfe admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:22.692809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb5e4f-bbeb-49e2-b7fb-20b118424dfe admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:22.698937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb0ff2-1b23-464a-a7de-a249acd94e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:22.701627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb0ff2-1b23-464a-a7de-a249acd94e7f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:22.701627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb0ff2-1b23-464a-a7de-a249acd94e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:22.701627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb0ff2-1b23-464a-a7de-a249acd94e7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:22.703671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb0ff2-1b23-464a-a7de-a249acd94e7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:22.705843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb0ff2-1b23-464a-a7de-a249acd94e7f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:22.724175 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1577/3195] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:20:22.728446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930ce3c-b0c6-42f9-8134-081c13e8dc8f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:22.752202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6930ce3c-b0c6-42f9-8134-081c13e8dc8f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:22.760468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377c742-6583-4c8b-a089-d0d8884a3e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:22.764579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377c742-6583-4c8b-a089-d0d8884a3e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:22.765656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377c742-6583-4c8b-a089-d0d8884a3e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:22.766186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377c742-6583-4c8b-a089-d0d8884a3e93 admin admin] PATH_INFO: `/v3/projects/553bef746c2a4abc8c043aea8ca991e4/users/5fb93b17457e4e6b81ce3e6d79750903/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:22.791843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377c742-6583-4c8b-a089-d0d8884a3e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=553bef746c2a4abc8c043aea8ca991e4, user_id=5fb93b17457e4e6b81ce3e6d79750903, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:22.795202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377c742-6583-4c8b-a089-d0d8884a3e93 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:22.928330 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1619/3196] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:20:22 2022] PUT /identity/v3/projects/553bef746c2a4abc8c043aea8ca991e4/users/5fb93b17457e4e6b81ce3e6d79750903/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:22.933619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc649607-7743-4db1-8bb0-0bff2996be3d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:22.934349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc649607-7743-4db1-8bb0-0bff2996be3d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:22.934871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc649607-7743-4db1-8bb0-0bff2996be3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:22.983367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-cc649607-7743-4db1-8bb0-0bff2996be3d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:22.985742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cc649607-7743-4db1-8bb0-0bff2996be3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:23.095748 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1578/3197] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:23.150804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377c742-6583-4c8b-a089-d0d8884a3e93 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:23.153467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e377c742-6583-4c8b-a089-d0d8884a3e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:23.296360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377c742-6583-4c8b-a089-d0d8884a3e93 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:23.303452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649e77f-9c93-4456-b8e8-2659ff958e7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:23.304135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649e77f-9c93-4456-b8e8-2659ff958e7d service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:23.304426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649e77f-9c93-4456-b8e8-2659ff958e7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:23.304881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4649e77f-9c93-4456-b8e8-2659ff958e7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:23.318038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649e77f-9c93-4456-b8e8-2659ff958e7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:23.319698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4649e77f-9c93-4456-b8e8-2659ff958e7d service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:23.338584 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1620/3198] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:20:24.227055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c37a7d-65e0-468d-8c7a-9c1cc8ce376a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:24.229859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c37a7d-65e0-468d-8c7a-9c1cc8ce376a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:24.230190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c37a7d-65e0-468d-8c7a-9c1cc8ce376a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:24.254424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-51c37a7d-65e0-468d-8c7a-9c1cc8ce376a None None] MFA Rules not processed for user `9099143abbce4dc78f650d702d51af72`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:24.255791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-51c37a7d-65e0-468d-8c7a-9c1cc8ce376a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:24.332635 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1579/3199] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:27.409154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649e77f-9c93-4456-b8e8-2659ff958e7d service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:27.410691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4649e77f-9c93-4456-b8e8-2659ff958e7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:27.479081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4649e77f-9c93-4456-b8e8-2659ff958e7d service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:27.504538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13534bb2-a137-4302-abd0-edfe22d563b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:27.505644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13534bb2-a137-4302-abd0-edfe22d563b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:27.507233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13534bb2-a137-4302-abd0-edfe22d563b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:27.507702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13534bb2-a137-4302-abd0-edfe22d563b1 admin admin] PATH_INFO: `/v3/users/6b13cdd4117640b49cf9f74cc12d16f4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:27.509814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13534bb2-a137-4302-abd0-edfe22d563b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b13cdd4117640b49cf9f74cc12d16f4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:27.512645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13534bb2-a137-4302-abd0-edfe22d563b1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:27.789416 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:27.815020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-13534bb2-a137-4302-abd0-edfe22d563b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b13cdd4117640b49cf9f74cc12d16f4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:27.830404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-13534bb2-a137-4302-abd0-edfe22d563b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b13cdd4117640b49cf9f74cc12d16f4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:27.839096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-13534bb2-a137-4302-abd0-edfe22d563b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b13cdd4117640b49cf9f74cc12d16f4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:27.843481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-13534bb2-a137-4302-abd0-edfe22d563b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b13cdd4117640b49cf9f74cc12d16f4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:27.971076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-13534bb2-a137-4302-abd0-edfe22d563b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b13cdd4117640b49cf9f74cc12d16f4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:27.980926 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1621/3200] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:20:27 2022] DELETE /identity/v3/users/6b13cdd4117640b49cf9f74cc12d16f4 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:28.674534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c37a7d-65e0-468d-8c7a-9c1cc8ce376a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:28.695703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c37a7d-65e0-468d-8c7a-9c1cc8ce376a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:28.718632 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:28.797435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b15e9-bc54-41eb-9563-5a760622ec6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:28.798724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b15e9-bc54-41eb-9563-5a760622ec6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:28.802089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b15e9-bc54-41eb-9563-5a760622ec6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:28.802089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b15e9-bc54-41eb-9563-5a760622ec6d admin admin] PATH_INFO: `/v3/projects/9d84f729c1414a42a73792d4093d5bda` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:28.802089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b15e9-bc54-41eb-9563-5a760622ec6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d84f729c1414a42a73792d4093d5bda)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:28.803582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b15e9-bc54-41eb-9563-5a760622ec6d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:28.998925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6f5b15e9-bc54-41eb-9563-5a760622ec6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d84f729c1414a42a73792d4093d5bda', 'request_id': 'req-6f5b15e9-bc54-41eb-9563-5a760622ec6d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:29.119772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6f5b15e9-bc54-41eb-9563-5a760622ec6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d84f729c1414a42a73792d4093d5bda', 'request_id': 'req-6f5b15e9-bc54-41eb-9563-5a760622ec6d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:29.128780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6f5b15e9-bc54-41eb-9563-5a760622ec6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d84f729c1414a42a73792d4093d5bda', 'request_id': 'req-6f5b15e9-bc54-41eb-9563-5a760622ec6d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:29.142330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6f5b15e9-bc54-41eb-9563-5a760622ec6d admin admin] The token cache is being invalidate because project 9d84f729c1414a42a73792d4093d5bda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:20:29.142683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6f5b15e9-bc54-41eb-9563-5a760622ec6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:29.143373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6f5b15e9-bc54-41eb-9563-5a760622ec6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:29.148546 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1580/3201] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:20:28 2022] DELETE /identity/v3/projects/9d84f729c1414a42a73792d4093d5bda => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:29.149819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13534bb2-a137-4302-abd0-edfe22d563b1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:29.151463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-13534bb2-a137-4302-abd0-edfe22d563b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:29.170290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13534bb2-a137-4302-abd0-edfe22d563b1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:29.258811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7951a-b131-4968-a46e-334c1c975e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:29.262507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7951a-b131-4968-a46e-334c1c975e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:29.262507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7951a-b131-4968-a46e-334c1c975e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:29.262507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7951a-b131-4968-a46e-334c1c975e45 admin admin] PATH_INFO: `/v3/users/c56cc2a24db643d69308ceb1d8c06c50` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:29.262507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7951a-b131-4968-a46e-334c1c975e45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56cc2a24db643d69308ceb1d8c06c50)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:29.265640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7951a-b131-4968-a46e-334c1c975e45 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:29.631645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3ab7951a-b131-4968-a46e-334c1c975e45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56cc2a24db643d69308ceb1d8c06c50'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:29.631645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3ab7951a-b131-4968-a46e-334c1c975e45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56cc2a24db643d69308ceb1d8c06c50'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:29.643527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3ab7951a-b131-4968-a46e-334c1c975e45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56cc2a24db643d69308ceb1d8c06c50'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:29.646157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3ab7951a-b131-4968-a46e-334c1c975e45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56cc2a24db643d69308ceb1d8c06c50'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:29.846657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3ab7951a-b131-4968-a46e-334c1c975e45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56cc2a24db643d69308ceb1d8c06c50'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:29.856320 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1622/3202] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:20:29 2022] DELETE /identity/v3/users/c56cc2a24db643d69308ceb1d8c06c50 => generated 0 bytes in 707 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:30.502389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b15e9-bc54-41eb-9563-5a760622ec6d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:30.514319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6f5b15e9-bc54-41eb-9563-5a760622ec6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:30.528111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b15e9-bc54-41eb-9563-5a760622ec6d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:30.617103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110bbc5e-33c1-41c5-8c61-8ad1001b5571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:30.618893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bbc5e-33c1-41c5-8c61-8ad1001b5571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:30.619325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bbc5e-33c1-41c5-8c61-8ad1001b5571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:30.619810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110bbc5e-33c1-41c5-8c61-8ad1001b5571 admin admin] PATH_INFO: `/v3/projects/2104b56eef7740d293b14b72f61f2de1` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:30.622874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bbc5e-33c1-41c5-8c61-8ad1001b5571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2104b56eef7740d293b14b72f61f2de1)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:30.628087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110bbc5e-33c1-41c5-8c61-8ad1001b5571 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:30.827163 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:30.832573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-110bbc5e-33c1-41c5-8c61-8ad1001b5571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2104b56eef7740d293b14b72f61f2de1', 'request_id': 'req-110bbc5e-33c1-41c5-8c61-8ad1001b5571'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:30.988139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-110bbc5e-33c1-41c5-8c61-8ad1001b5571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2104b56eef7740d293b14b72f61f2de1', 'request_id': 'req-110bbc5e-33c1-41c5-8c61-8ad1001b5571'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:30.997955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-110bbc5e-33c1-41c5-8c61-8ad1001b5571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2104b56eef7740d293b14b72f61f2de1', 'request_id': 'req-110bbc5e-33c1-41c5-8c61-8ad1001b5571'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:31.047915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-110bbc5e-33c1-41c5-8c61-8ad1001b5571 admin admin] The token cache is being invalidate because project 2104b56eef7740d293b14b72f61f2de1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:20:31.048427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-110bbc5e-33c1-41c5-8c61-8ad1001b5571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:31.049305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-110bbc5e-33c1-41c5-8c61-8ad1001b5571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:31.052109 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1581/3203] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:20:30 2022] DELETE /identity/v3/projects/2104b56eef7740d293b14b72f61f2de1 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:31.057011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d7c88-57ee-49a6-a5ba-91d5d84cf84a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:31.058507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d7c88-57ee-49a6-a5ba-91d5d84cf84a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:31.058932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82d7c88-57ee-49a6-a5ba-91d5d84cf84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:31.100741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b82d7c88-57ee-49a6-a5ba-91d5d84cf84a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:31.102329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b82d7c88-57ee-49a6-a5ba-91d5d84cf84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:31.140818 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:31.195970 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1623/3204] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:31.235652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a43b8-6bf8-4c2e-9660-8eeade82c40d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:31.238653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a43b8-6bf8-4c2e-9660-8eeade82c40d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:31.238653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a43b8-6bf8-4c2e-9660-8eeade82c40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:31.266876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1b2a43b8-6bf8-4c2e-9660-8eeade82c40d None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:31.281413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c904aba-654a-401d-ae9c-fc320fc61195 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:31.282007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c904aba-654a-401d-ae9c-fc320fc61195 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:31.284753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c904aba-654a-401d-ae9c-fc320fc61195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:31.291187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1b2a43b8-6bf8-4c2e-9660-8eeade82c40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:31.351073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6c904aba-654a-401d-ae9c-fc320fc61195 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:31.354131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6c904aba-654a-401d-ae9c-fc320fc61195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:31.385139 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1624/3205] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:31.386685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c904aba-654a-401d-ae9c-fc320fc61195 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:31.406825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c904aba-654a-401d-ae9c-fc320fc61195 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:31.421854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed118e0-1ebb-402b-a128-8d0c5b3857eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:31.422751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed118e0-1ebb-402b-a128-8d0c5b3857eb admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:31.422940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed118e0-1ebb-402b-a128-8d0c5b3857eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:31.425773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed118e0-1ebb-402b-a128-8d0c5b3857eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:31.425773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed118e0-1ebb-402b-a128-8d0c5b3857eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:20:31.425773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed118e0-1ebb-402b-a128-8d0c5b3857eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:31.431065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed118e0-1ebb-402b-a128-8d0c5b3857eb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:31.456965 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1625/3207] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:20:31.457784 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1582/3207] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:20:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:31.457912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed118e0-1ebb-402b-a128-8d0c5b3857eb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:31.461251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a43b8-6bf8-4c2e-9660-8eeade82c40d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:31.464495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-aed118e0-1ebb-402b-a128-8d0c5b3857eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:31.489219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a43b8-6bf8-4c2e-9660-8eeade82c40d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:31.502826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1461d5-3486-4d69-a045-7fc6a063beaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:31.504558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1461d5-3486-4d69-a045-7fc6a063beaa admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:31.504987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1461d5-3486-4d69-a045-7fc6a063beaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:31.505430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1461d5-3486-4d69-a045-7fc6a063beaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:31.507286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1461d5-3486-4d69-a045-7fc6a063beaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:31.511383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1461d5-3486-4d69-a045-7fc6a063beaa admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:31.659974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed118e0-1ebb-402b-a128-8d0c5b3857eb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:31.666135 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1583/3208] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:20:31 2022] POST /identity/v3/projects => generated 375 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:20:31.669861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1461d5-3486-4d69-a045-7fc6a063beaa admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:31.670058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba1e88-a7ec-4d22-9e03-69c66cc50082 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:31.670762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba1e88-a7ec-4d22-9e03-69c66cc50082 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:31.671563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba1e88-a7ec-4d22-9e03-69c66cc50082 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:31.672097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba1e88-a7ec-4d22-9e03-69c66cc50082 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:31.713360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba1e88-a7ec-4d22-9e03-69c66cc50082 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:31.715019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba1e88-a7ec-4d22-9e03-69c66cc50082 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:31.737987 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1626/3209] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:20:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:20:31.822481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1461d5-3486-4d69-a045-7fc6a063beaa admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:31.841170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc7582-dc55-4010-a637-40911e24a4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:31.841668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc7582-dc55-4010-a637-40911e24a4d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:31.841955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc7582-dc55-4010-a637-40911e24a4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:31.842260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc7582-dc55-4010-a637-40911e24a4d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:31.854261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc7582-dc55-4010-a637-40911e24a4d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:31.859287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc7582-dc55-4010-a637-40911e24a4d4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:32.000098 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1584/3210] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:20:31 2022] POST /identity/v3/users => generated 288 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:20:32.015292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba1e88-a7ec-4d22-9e03-69c66cc50082 service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:32.051440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba1e88-a7ec-4d22-9e03-69c66cc50082 service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:32.078544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3725741-12ab-4609-a2c1-06629e69066e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:32.079994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3725741-12ab-4609-a2c1-06629e69066e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:32.080455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3725741-12ab-4609-a2c1-06629e69066e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:32.080964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3725741-12ab-4609-a2c1-06629e69066e admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:32.081981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3725741-12ab-4609-a2c1-06629e69066e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:32.085181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3725741-12ab-4609-a2c1-06629e69066e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:32.146373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc7582-dc55-4010-a637-40911e24a4d4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:32.150491 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1627/3211] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:20:32.161171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc7582-dc55-4010-a637-40911e24a4d4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:32.178452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949605cf-2685-4fee-81b8-361e7edc9182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:32.179258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949605cf-2685-4fee-81b8-361e7edc9182 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:32.180509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949605cf-2685-4fee-81b8-361e7edc9182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:32.180793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949605cf-2685-4fee-81b8-361e7edc9182 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:32.187783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949605cf-2685-4fee-81b8-361e7edc9182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:32.189543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949605cf-2685-4fee-81b8-361e7edc9182 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:32.225875 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1585/3212] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:20:32.234442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3725741-12ab-4609-a2c1-06629e69066e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:32.252476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3725741-12ab-4609-a2c1-06629e69066e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:32.286831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a5895-43e7-48c9-b252-d7403c12faba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:32.288071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a5895-43e7-48c9-b252-d7403c12faba admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:32.288502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a5895-43e7-48c9-b252-d7403c12faba admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:32.290542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342a5895-43e7-48c9-b252-d7403c12faba admin admin] PATH_INFO: `/v3/projects/d8ab4d4be0a54b6e94a9b69fff2a630b/users/30c41272d39d42989d736dc3a9680664/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:32.360607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a5895-43e7-48c9-b252-d7403c12faba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8ab4d4be0a54b6e94a9b69fff2a630b, user_id=30c41272d39d42989d736dc3a9680664, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:32.363461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342a5895-43e7-48c9-b252-d7403c12faba admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:32.446471 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1628/3213] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:20:32 2022] PUT /identity/v3/projects/d8ab4d4be0a54b6e94a9b69fff2a630b/users/30c41272d39d42989d736dc3a9680664/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:32.457006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864fb9-9389-4687-b52e-9c7334092fc8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:32.457304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864fb9-9389-4687-b52e-9c7334092fc8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:32.457584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78864fb9-9389-4687-b52e-9c7334092fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:32.543752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-78864fb9-9389-4687-b52e-9c7334092fc8 None None] MFA Rules not processed for user `30c41272d39d42989d736dc3a9680664`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:32.545001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-78864fb9-9389-4687-b52e-9c7334092fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:32.819893 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1586/3214] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:32.823443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a5895-43e7-48c9-b252-d7403c12faba admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:32.886300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78864fb9-9389-4687-b52e-9c7334092fc8 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:32.887814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-78864fb9-9389-4687-b52e-9c7334092fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:33.038504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342a5895-43e7-48c9-b252-d7403c12faba admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:33.056454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c6f93-c2ae-45dd-b4a9-d9a3c4d5234e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:33.057237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c6f93-c2ae-45dd-b4a9-d9a3c4d5234e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:33.057588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c6f93-c2ae-45dd-b4a9-d9a3c4d5234e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:33.058437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c6f93-c2ae-45dd-b4a9-d9a3c4d5234e admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:33.065416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c6f93-c2ae-45dd-b4a9-d9a3c4d5234e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:33.065416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c6f93-c2ae-45dd-b4a9-d9a3c4d5234e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:33.087788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78864fb9-9389-4687-b52e-9c7334092fc8 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:33.100665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b48fd-91d5-44da-b82e-a36c3f6b5573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:33.102050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b48fd-91d5-44da-b82e-a36c3f6b5573 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:33.102520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b48fd-91d5-44da-b82e-a36c3f6b5573 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:33.103403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9b48fd-91d5-44da-b82e-a36c3f6b5573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:33.105785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4c9b48fd-91d5-44da-b82e-a36c3f6b5573 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:33.127899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b48fd-91d5-44da-b82e-a36c3f6b5573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:33.130016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9b48fd-91d5-44da-b82e-a36c3f6b5573 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:33.145340 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1587/3215] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:20:33.220483 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1629/3216] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:20:32 2022] POST /identity/v3/projects => generated 375 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:20:33.224499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b48fd-91d5-44da-b82e-a36c3f6b5573 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:33.237243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9b48fd-91d5-44da-b82e-a36c3f6b5573 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:33.428101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0279ff1-22fc-4d9d-804f-9fc84fffcbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:33.428889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0279ff1-22fc-4d9d-804f-9fc84fffcbd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:33.429178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0279ff1-22fc-4d9d-804f-9fc84fffcbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:33.429536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0279ff1-22fc-4d9d-804f-9fc84fffcbd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:33.430348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0279ff1-22fc-4d9d-804f-9fc84fffcbd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:33.432446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0279ff1-22fc-4d9d-804f-9fc84fffcbd0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:33.468502 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:33.646877 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1588/3217] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:20:33 2022] POST /identity/v3/users => generated 294 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:20:33.648341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c6f93-c2ae-45dd-b4a9-d9a3c4d5234e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:33.665721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c6f93-c2ae-45dd-b4a9-d9a3c4d5234e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:33.680659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19eb15-5a98-43a6-adf2-fefcaa08dea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:33.681817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19eb15-5a98-43a6-adf2-fefcaa08dea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:33.682423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19eb15-5a98-43a6-adf2-fefcaa08dea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:33.682966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19eb15-5a98-43a6-adf2-fefcaa08dea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:33.684219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19eb15-5a98-43a6-adf2-fefcaa08dea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:33.686084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19eb15-5a98-43a6-adf2-fefcaa08dea9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:33.715686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0279ff1-22fc-4d9d-804f-9fc84fffcbd0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:33.717174 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1630/3218] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:20:33.735210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0279ff1-22fc-4d9d-804f-9fc84fffcbd0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:33.746784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bf75e-d919-4eec-bc41-888a0dd7b84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:33.748252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bf75e-d919-4eec-bc41-888a0dd7b84f admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:33.748832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bf75e-d919-4eec-bc41-888a0dd7b84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:33.749412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7bf75e-d919-4eec-bc41-888a0dd7b84f admin admin] PATH_INFO: `/v3/projects/3bfaa8cb0bc346e1b99044bf7c81e485/users/73d9cc297c4f44c4803422abe3620f35/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:33.788738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7bf75e-d919-4eec-bc41-888a0dd7b84f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bfaa8cb0bc346e1b99044bf7c81e485, user_id=73d9cc297c4f44c4803422abe3620f35, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:33.791887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7bf75e-d919-4eec-bc41-888a0dd7b84f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:33.950815 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1589/3219] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:20:33 2022] PUT /identity/v3/projects/3bfaa8cb0bc346e1b99044bf7c81e485/users/73d9cc297c4f44c4803422abe3620f35/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:33.951904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19eb15-5a98-43a6-adf2-fefcaa08dea9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:33.965764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19eb15-5a98-43a6-adf2-fefcaa08dea9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:34.123429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6381e1eb-9a9d-4e45-a241-c1394e949358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:34.126218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381e1eb-9a9d-4e45-a241-c1394e949358 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:34.126766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381e1eb-9a9d-4e45-a241-c1394e949358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:34.127242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6381e1eb-9a9d-4e45-a241-c1394e949358 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:34.128516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381e1eb-9a9d-4e45-a241-c1394e949358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:34.130433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6381e1eb-9a9d-4e45-a241-c1394e949358 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:34.155348 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1631/3220] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:20:34.161732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bf75e-d919-4eec-bc41-888a0dd7b84f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:34.176998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7bf75e-d919-4eec-bc41-888a0dd7b84f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:34.191857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0688373-61cd-41ad-bec7-88a3dad31c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:34.192872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0688373-61cd-41ad-bec7-88a3dad31c73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:34.193183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0688373-61cd-41ad-bec7-88a3dad31c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:34.193655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0688373-61cd-41ad-bec7-88a3dad31c73 admin admin] PATH_INFO: `/v3/projects/3bfaa8cb0bc346e1b99044bf7c81e485/users/73d9cc297c4f44c4803422abe3620f35/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:34.198507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0688373-61cd-41ad-bec7-88a3dad31c73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bfaa8cb0bc346e1b99044bf7c81e485, user_id=73d9cc297c4f44c4803422abe3620f35, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:34.203975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0688373-61cd-41ad-bec7-88a3dad31c73 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:34.240636 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1590/3221] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:20:34 2022] PUT /identity/v3/projects/3bfaa8cb0bc346e1b99044bf7c81e485/users/73d9cc297c4f44c4803422abe3620f35/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:34.242630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399209e3-2a11-431f-8c67-1df4f81ff701 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:34.243062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399209e3-2a11-431f-8c67-1df4f81ff701 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:34.243348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399209e3-2a11-431f-8c67-1df4f81ff701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:34.277141 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:34.320845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-399209e3-2a11-431f-8c67-1df4f81ff701 None None] MFA Rules not processed for user `73d9cc297c4f44c4803422abe3620f35`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:34.324121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-399209e3-2a11-431f-8c67-1df4f81ff701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:34.497935 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1632/3222] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:34.505883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0688373-61cd-41ad-bec7-88a3dad31c73 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:34.528538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0688373-61cd-41ad-bec7-88a3dad31c73 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:34.537122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be603e1-eec1-443e-932f-9223066db5c6 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d9cc297c4f44c4803422abe3620f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfaa8cb0bc346e1b99044bf7c81e485', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:34.538327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be603e1-eec1-443e-932f-9223066db5c6 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:34.538621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be603e1-eec1-443e-932f-9223066db5c6 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:34.538980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be603e1-eec1-443e-932f-9223066db5c6 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:34.539835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be603e1-eec1-443e-932f-9223066db5c6 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:20:34.540182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be603e1-eec1-443e-932f-9223066db5c6 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:34.541825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be603e1-eec1-443e-932f-9223066db5c6 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:34.576119 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1591/3223] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:20:34.576902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399209e3-2a11-431f-8c67-1df4f81ff701 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:34.596135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399209e3-2a11-431f-8c67-1df4f81ff701 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:34.637192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d3b7b-423f-42ae-91c6-795306b01c73 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d9cc297c4f44c4803422abe3620f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfaa8cb0bc346e1b99044bf7c81e485', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:34.640867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d3b7b-423f-42ae-91c6-795306b01c73 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:34.641700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d3b7b-423f-42ae-91c6-795306b01c73 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:34.642343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d3b7b-423f-42ae-91c6-795306b01c73 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:34.643401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d3b7b-423f-42ae-91c6-795306b01c73 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:34.649009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d3b7b-423f-42ae-91c6-795306b01c73 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:34.889190 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1633/3224] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:20:34 2022] POST /identity/v3/projects => generated 369 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:20:34.894048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be603e1-eec1-443e-932f-9223066db5c6 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:34.913176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be603e1-eec1-443e-932f-9223066db5c6 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:35.130793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a741b-5dcc-4799-b395-9c24de6b8ec5 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d9cc297c4f44c4803422abe3620f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfaa8cb0bc346e1b99044bf7c81e485', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:35.133193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a741b-5dcc-4799-b395-9c24de6b8ec5 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:35.133919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a741b-5dcc-4799-b395-9c24de6b8ec5 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:35.136127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a741b-5dcc-4799-b395-9c24de6b8ec5 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:35.141466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a741b-5dcc-4799-b395-9c24de6b8ec5 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:20:35.142003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a741b-5dcc-4799-b395-9c24de6b8ec5 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:35.143706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709a741b-5dcc-4799-b395-9c24de6b8ec5 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:35.197260 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1592/3225] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:20:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:20:35.571975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d3b7b-423f-42ae-91c6-795306b01c73 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:35.575864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f18d3b7b-423f-42ae-91c6-795306b01c73 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:35.878497 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:35.893787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d3b7b-423f-42ae-91c6-795306b01c73 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:35.912580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf11b2-766e-4346-80e0-a996f45e8429 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:35.913618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf11b2-766e-4346-80e0-a996f45e8429 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:35.914142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf11b2-766e-4346-80e0-a996f45e8429 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:35.914616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf11b2-766e-4346-80e0-a996f45e8429 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:35.970718 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:35.979203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf11b2-766e-4346-80e0-a996f45e8429 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:35.984860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bf11b2-766e-4346-80e0-a996f45e8429 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:36.038280 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1634/3226] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:20:35 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:20:36.079041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38669c16-35ae-44e9-a274-ca3b59695e84 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:36.079554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38669c16-35ae-44e9-a274-ca3b59695e84 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:36.080126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38669c16-35ae-44e9-a274-ca3b59695e84 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:36.082296 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1593/3227] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:20:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:20:36.092940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf11b2-766e-4346-80e0-a996f45e8429 service nova] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:20:36.115394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf11b2-766e-4346-80e0-a996f45e8429 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:36.141981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf11b2-766e-4346-80e0-a996f45e8429 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:36.152994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea08f6a-6ed4-467b-a57a-37f65897a284 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d9cc297c4f44c4803422abe3620f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfaa8cb0bc346e1b99044bf7c81e485', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:36.154201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea08f6a-6ed4-467b-a57a-37f65897a284 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:36.154817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea08f6a-6ed4-467b-a57a-37f65897a284 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:36.155421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea08f6a-6ed4-467b-a57a-37f65897a284 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] PATH_INFO: `/v3/projects/aed9e09fe6094ce78d6d1a55752ed6a8` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:36.157465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea08f6a-6ed4-467b-a57a-37f65897a284 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorizing `identity:get_project(project_id=aed9e09fe6094ce78d6d1a55752ed6a8)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:36.159824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea08f6a-6ed4-467b-a57a-37f65897a284 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:36.174340 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1635/3228] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:20:36 2022] GET /identity/v3/projects/aed9e09fe6094ce78d6d1a55752ed6a8 => generated 369 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:20:36.930935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b90c0-7c29-4bed-bcc7-7bd77d2cd718 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:36.931290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b90c0-7c29-4bed-bcc7-7bd77d2cd718 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:36.932254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b90c0-7c29-4bed-bcc7-7bd77d2cd718 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:36.935503 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1594/3229] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:20:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:20:36.940336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea08f6a-6ed4-467b-a57a-37f65897a284 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:20:36.944195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dea08f6a-6ed4-467b-a57a-37f65897a284 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:36.995093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea08f6a-6ed4-467b-a57a-37f65897a284 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:37.045911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea08f6a-6ed4-467b-a57a-37f65897a284 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:37.065197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9d3eb-4c41-4ba0-842b-7a6c1b9d2623 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d9cc297c4f44c4803422abe3620f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfaa8cb0bc346e1b99044bf7c81e485', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:37.068379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9d3eb-4c41-4ba0-842b-7a6c1b9d2623 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:37.069429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9d3eb-4c41-4ba0-842b-7a6c1b9d2623 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:37.069875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9d3eb-4c41-4ba0-842b-7a6c1b9d2623 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] PATH_INFO: `/v3/projects/aed9e09fe6094ce78d6d1a55752ed6a8` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:37.075825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9d3eb-4c41-4ba0-842b-7a6c1b9d2623 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorizing `identity:get_project(project_id=aed9e09fe6094ce78d6d1a55752ed6a8)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:37.086504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9d3eb-4c41-4ba0-842b-7a6c1b9d2623 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:37.095627 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1636/3230] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:20:36 2022] GET /identity/v3/projects/aed9e09fe6094ce78d6d1a55752ed6a8 => generated 369 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:20:37.167059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b90c0-7c29-4bed-bcc7-7bd77d2cd718 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:37.216388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b90c0-7c29-4bed-bcc7-7bd77d2cd718 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:37.242842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c66194-0b3c-45ab-a114-8f543075f145 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d9cc297c4f44c4803422abe3620f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfaa8cb0bc346e1b99044bf7c81e485', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:37.246877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c66194-0b3c-45ab-a114-8f543075f145 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:37.249028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c66194-0b3c-45ab-a114-8f543075f145 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:37.251093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c66194-0b3c-45ab-a114-8f543075f145 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:37.252955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c66194-0b3c-45ab-a114-8f543075f145 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:20:37.254084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c66194-0b3c-45ab-a114-8f543075f145 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:37.260204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c66194-0b3c-45ab-a114-8f543075f145 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:37.302859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9d3eb-4c41-4ba0-842b-7a6c1b9d2623 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:37.311267 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1595/3231] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:20:37.323440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9d3eb-4c41-4ba0-842b-7a6c1b9d2623 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:37.352755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fbaf3-ddb4-40fb-aa87-a518b4375129 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d9cc297c4f44c4803422abe3620f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfaa8cb0bc346e1b99044bf7c81e485', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:37.356069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fbaf3-ddb4-40fb-aa87-a518b4375129 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:37.356480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fbaf3-ddb4-40fb-aa87-a518b4375129 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:37.356870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fbaf3-ddb4-40fb-aa87-a518b4375129 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:37.369196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300fbaf3-ddb4-40fb-aa87-a518b4375129 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:37.373204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300fbaf3-ddb4-40fb-aa87-a518b4375129 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:37.512786 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1637/3232] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:20:37 2022] POST /identity/v3/users => generated 383 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:20:37.514325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c66194-0b3c-45ab-a114-8f543075f145 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:37.539353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c66194-0b3c-45ab-a114-8f543075f145 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:37.547431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1acd8-a6f9-4876-ae35-fa840193a034 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d9cc297c4f44c4803422abe3620f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfaa8cb0bc346e1b99044bf7c81e485', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:37.548468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1acd8-a6f9-4876-ae35-fa840193a034 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:37.548915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1acd8-a6f9-4876-ae35-fa840193a034 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:37.549340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b1acd8-a6f9-4876-ae35-fa840193a034 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:37.551348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1acd8-a6f9-4876-ae35-fa840193a034 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:20:37.551859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1acd8-a6f9-4876-ae35-fa840193a034 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:37.566259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b1acd8-a6f9-4876-ae35-fa840193a034 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:37.601656 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1596/3233] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:20:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:20:37.629444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb256d5-1056-498a-a84f-28f3d2d17b9f None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:37.629742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb256d5-1056-498a-a84f-28f3d2d17b9f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:37.630066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb256d5-1056-498a-a84f-28f3d2d17b9f None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:37.634144 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1638/3234] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:20:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:20:37.639246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1acd8-a6f9-4876-ae35-fa840193a034 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Authenticating service token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:20:37.663012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1acd8-a6f9-4876-ae35-fa840193a034 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:37.683958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b1acd8-a6f9-4876-ae35-fa840193a034 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:37.694828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f1248-9d9c-4a97-8b24-c1740fa3ae15 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d9cc297c4f44c4803422abe3620f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfaa8cb0bc346e1b99044bf7c81e485', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:37.699100 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f1248-9d9c-4a97-8b24-c1740fa3ae15 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:37.699465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f1248-9d9c-4a97-8b24-c1740fa3ae15 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:37.700564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f1248-9d9c-4a97-8b24-c1740fa3ae15 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] PATH_INFO: `/v3/projects/aed9e09fe6094ce78d6d1a55752ed6a8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:37.706267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f1248-9d9c-4a97-8b24-c1740fa3ae15 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorizing `identity:get_project(project_id=aed9e09fe6094ce78d6d1a55752ed6a8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:37.711870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f1248-9d9c-4a97-8b24-c1740fa3ae15 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:37.732950 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1597/3235] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:20:37 2022] GET /identity/v3/projects/aed9e09fe6094ce78d6d1a55752ed6a8 => generated 369 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:20:38.020373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7519a-21b8-4fe4-be14-59a3ebafcc46 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:38.021848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7519a-21b8-4fe4-be14-59a3ebafcc46 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:38.022693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7519a-21b8-4fe4-be14-59a3ebafcc46 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:38.024135 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1639/3236] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:20:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 14:20:38.030726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f1248-9d9c-4a97-8b24-c1740fa3ae15 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Authenticating service token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:20:38.065512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f1248-9d9c-4a97-8b24-c1740fa3ae15 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:38.080768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f1248-9d9c-4a97-8b24-c1740fa3ae15 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:38.095801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d8c91-5a83-44f0-9045-7e8e507d10e7 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d9cc297c4f44c4803422abe3620f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfaa8cb0bc346e1b99044bf7c81e485', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:38.097066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d8c91-5a83-44f0-9045-7e8e507d10e7 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:38.097503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d8c91-5a83-44f0-9045-7e8e507d10e7 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:38.099118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d8c91-5a83-44f0-9045-7e8e507d10e7 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] PATH_INFO: `/v3/projects/aed9e09fe6094ce78d6d1a55752ed6a8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:38.099916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d8c91-5a83-44f0-9045-7e8e507d10e7 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorizing `identity:get_project(project_id=aed9e09fe6094ce78d6d1a55752ed6a8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:38.104472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97d8c91-5a83-44f0-9045-7e8e507d10e7 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:38.111635 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1598/3237] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:20:38 2022] GET /identity/v3/projects/aed9e09fe6094ce78d6d1a55752ed6a8 => generated 369 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:20:38.157035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7519a-21b8-4fe4-be14-59a3ebafcc46 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:38.211825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7519a-21b8-4fe4-be14-59a3ebafcc46 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:38.229117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8fa23b-3b72-4e7c-85cb-c166e9bf069a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d9cc297c4f44c4803422abe3620f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfaa8cb0bc346e1b99044bf7c81e485', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:38.239419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fa23b-3b72-4e7c-85cb-c166e9bf069a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:38.239712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fa23b-3b72-4e7c-85cb-c166e9bf069a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:38.245046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8fa23b-3b72-4e7c-85cb-c166e9bf069a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] PATH_INFO: `/v3/users/34f53f7c32274187a62b73379b0cb6e5` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:38.364204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fa23b-3b72-4e7c-85cb-c166e9bf069a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorizing `identity:delete_user(user_id=34f53f7c32274187a62b73379b0cb6e5)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:38.369191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8fa23b-3b72-4e7c-85cb-c166e9bf069a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:38.605883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b8fa23b-3b72-4e7c-85cb-c166e9bf069a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34f53f7c32274187a62b73379b0cb6e5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:38.627764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b8fa23b-3b72-4e7c-85cb-c166e9bf069a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34f53f7c32274187a62b73379b0cb6e5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:38.639053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b8fa23b-3b72-4e7c-85cb-c166e9bf069a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34f53f7c32274187a62b73379b0cb6e5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:38.640958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b8fa23b-3b72-4e7c-85cb-c166e9bf069a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34f53f7c32274187a62b73379b0cb6e5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:38.748109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b8fa23b-3b72-4e7c-85cb-c166e9bf069a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34f53f7c32274187a62b73379b0cb6e5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:38.757473 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1640/3238] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:20:38 2022] DELETE /identity/v3/users/34f53f7c32274187a62b73379b0cb6e5 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:38.762088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d8c91-5a83-44f0-9045-7e8e507d10e7 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:38.769508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b97d8c91-5a83-44f0-9045-7e8e507d10e7 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:38.795384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8fc8c-99f2-4136-96c8-8d84c26be960 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:38.795863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8fc8c-99f2-4136-96c8-8d84c26be960 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:38.796676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8fc8c-99f2-4136-96c8-8d84c26be960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:38.825967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97d8c91-5a83-44f0-9045-7e8e507d10e7 tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:38.852374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-98c8fc8c-99f2-4136-96c8-8d84c26be960 None None] MFA Rules not processed for user `5fb93b17457e4e6b81ce3e6d79750903`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:38.854691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-98c8fc8c-99f2-4136-96c8-8d84c26be960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:38.988955 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:39.031200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ba8f9-d099-40c9-857b-1f20b07eb08a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73d9cc297c4f44c4803422abe3620f35', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3bfaa8cb0bc346e1b99044bf7c81e485', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:39.033214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ba8f9-d099-40c9-857b-1f20b07eb08a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:39.033505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ba8f9-d099-40c9-857b-1f20b07eb08a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:39.033787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23ba8f9-d099-40c9-857b-1f20b07eb08a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] PATH_INFO: `/v3/projects/aed9e09fe6094ce78d6d1a55752ed6a8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:39.040557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ba8f9-d099-40c9-857b-1f20b07eb08a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorizing `identity:delete_project(project_id=aed9e09fe6094ce78d6d1a55752ed6a8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:39.057097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23ba8f9-d099-40c9-857b-1f20b07eb08a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:39.086153 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1641/3239] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:20:39.091341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67885d-bc64-4a92-9873-a895050e173f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:39.091653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67885d-bc64-4a92-9873-a895050e173f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:39.091920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be67885d-bc64-4a92-9873-a895050e173f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:39.142577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-be67885d-bc64-4a92-9873-a895050e173f None None] MFA Rules not processed for user `5fb93b17457e4e6b81ce3e6d79750903`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:39.143538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-be67885d-bc64-4a92-9873-a895050e173f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:39.158456 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1642/3240] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:20:39.200248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67885d-bc64-4a92-9873-a895050e173f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:39.201682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-be67885d-bc64-4a92-9873-a895050e173f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:39.288838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d23ba8f9-d099-40c9-857b-1f20b07eb08a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aed9e09fe6094ce78d6d1a55752ed6a8', 'request_id': 'req-d23ba8f9-d099-40c9-857b-1f20b07eb08a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:39.362959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d23ba8f9-d099-40c9-857b-1f20b07eb08a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aed9e09fe6094ce78d6d1a55752ed6a8', 'request_id': 'req-d23ba8f9-d099-40c9-857b-1f20b07eb08a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:39.382636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d23ba8f9-d099-40c9-857b-1f20b07eb08a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aed9e09fe6094ce78d6d1a55752ed6a8', 'request_id': 'req-d23ba8f9-d099-40c9-857b-1f20b07eb08a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:39.385017 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:39.417180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d23ba8f9-d099-40c9-857b-1f20b07eb08a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] The token cache is being invalidate because project aed9e09fe6094ce78d6d1a55752ed6a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:20:39.418578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d23ba8f9-d099-40c9-857b-1f20b07eb08a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:39.421077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be67885d-bc64-4a92-9873-a895050e173f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:39.422300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d23ba8f9-d099-40c9-857b-1f20b07eb08a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:39.430417 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1599/3241] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:20:38 2022] DELETE /identity/v3/projects/aed9e09fe6094ce78d6d1a55752ed6a8 => generated 0 bytes in 669 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:39.438434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ba8f9-d099-40c9-857b-1f20b07eb08a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:39.440598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d23ba8f9-d099-40c9-857b-1f20b07eb08a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:39.592484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23ba8f9-d099-40c9-857b-1f20b07eb08a tempest-QuotasAdminTestV236-1599267775 tempest-QuotasAdminTestV236-1599267775-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:39.602385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66d0a3-d904-4202-b1e8-3988dc53d612 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:39.603369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66d0a3-d904-4202-b1e8-3988dc53d612 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:39.603747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66d0a3-d904-4202-b1e8-3988dc53d612 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:39.604058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66d0a3-d904-4202-b1e8-3988dc53d612 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:39.605813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d6766-089b-4bb1-be5a-76214d90933c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:39.605988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1b66d0a3-d904-4202-b1e8-3988dc53d612 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:39.606733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d6766-089b-4bb1-be5a-76214d90933c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:39.607022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d6766-089b-4bb1-be5a-76214d90933c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:39.607351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d6766-089b-4bb1-be5a-76214d90933c admin admin] PATH_INFO: `/v3/users/30c41272d39d42989d736dc3a9680664` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:39.610632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d6766-089b-4bb1-be5a-76214d90933c admin admin] RBAC: Authorizing `identity:delete_user(user_id=30c41272d39d42989d736dc3a9680664)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:39.619741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d6766-089b-4bb1-be5a-76214d90933c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:39.743812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66d0a3-d904-4202-b1e8-3988dc53d612 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:39.746962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66d0a3-d904-4202-b1e8-3988dc53d612 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:39.762924 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1643/3242] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:20:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:20:39.831102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3b3d6766-089b-4bb1-be5a-76214d90933c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30c41272d39d42989d736dc3a9680664'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:39.846601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3b3d6766-089b-4bb1-be5a-76214d90933c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30c41272d39d42989d736dc3a9680664'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:39.847346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3b3d6766-089b-4bb1-be5a-76214d90933c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30c41272d39d42989d736dc3a9680664'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:39.848003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3b3d6766-089b-4bb1-be5a-76214d90933c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30c41272d39d42989d736dc3a9680664'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:39.857185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3b3d6766-089b-4bb1-be5a-76214d90933c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30c41272d39d42989d736dc3a9680664'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:39.963818 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1600/3243] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:20:39 2022] DELETE /identity/v3/users/30c41272d39d42989d736dc3a9680664 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:39.965694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66112291-4735-40ef-ad53-1427d5644a88 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:39.966191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66112291-4735-40ef-ad53-1427d5644a88 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:39.966788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66112291-4735-40ef-ad53-1427d5644a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:39.977501 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:40.015853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-66112291-4735-40ef-ad53-1427d5644a88 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:40.017154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-66112291-4735-40ef-ad53-1427d5644a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:40.188978 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1644/3244] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:40.222123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d6766-089b-4bb1-be5a-76214d90933c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:40.227908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3b3d6766-089b-4bb1-be5a-76214d90933c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:40.390962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d6766-089b-4bb1-be5a-76214d90933c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:40.403791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9bbfb-f323-43de-a53e-a989c2a25fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:40.407807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9bbfb-f323-43de-a53e-a989c2a25fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:40.408096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9bbfb-f323-43de-a53e-a989c2a25fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:40.408378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9bbfb-f323-43de-a53e-a989c2a25fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:40.442786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9bbfb-f323-43de-a53e-a989c2a25fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:40.444359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f9bbfb-f323-43de-a53e-a989c2a25fb5 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:40.490458 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1601/3245] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:20:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:20:41.484870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7d987-336d-4c1f-8d25-75d0c8cb2460 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:41.485830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7d987-336d-4c1f-8d25-75d0c8cb2460 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:41.486427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7d987-336d-4c1f-8d25-75d0c8cb2460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:41.513125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-52a7d987-336d-4c1f-8d25-75d0c8cb2460 None None] MFA Rules not processed for user `2e8fc4623d924e09874d49f59572346a`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:41.514442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-52a7d987-336d-4c1f-8d25-75d0c8cb2460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:41.610680 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1645/3246] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:42.085133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcbbd7-7bb6-4e8b-adb9-a53cfdec83a8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:42.085563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcbbd7-7bb6-4e8b-adb9-a53cfdec83a8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:42.086010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bcbbd7-7bb6-4e8b-adb9-a53cfdec83a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:42.145023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-61bcbbd7-7bb6-4e8b-adb9-a53cfdec83a8 None None] MFA Rules not processed for user `2e8fc4623d924e09874d49f59572346a`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:42.146578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-61bcbbd7-7bb6-4e8b-adb9-a53cfdec83a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:42.172153 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1602/3247] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:42.219144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bd545-b231-425f-a11e-bba55960c99a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:42.220087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bd545-b231-425f-a11e-bba55960c99a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:42.220567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bd545-b231-425f-a11e-bba55960c99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:42.267286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ba0bd545-b231-425f-a11e-bba55960c99a None None] MFA Rules not processed for user `2e8fc4623d924e09874d49f59572346a`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:42.270299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ba0bd545-b231-425f-a11e-bba55960c99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:42.290513 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1646/3248] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:42.334193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f70b1-9f6e-476c-8774-f53eff80fd8d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:42.334516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f70b1-9f6e-476c-8774-f53eff80fd8d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:42.334844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f70b1-9f6e-476c-8774-f53eff80fd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:42.345361 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:42.374521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-591f70b1-9f6e-476c-8774-f53eff80fd8d None None] MFA Rules not processed for user `2e8fc4623d924e09874d49f59572346a`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:42.375968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-591f70b1-9f6e-476c-8774-f53eff80fd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:42.402366 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1603/3249] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:42.992080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b852b4-68bb-4c18-8d94-3d976f9ade27 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:42.992713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b852b4-68bb-4c18-8d94-3d976f9ade27 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:42.992713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b852b4-68bb-4c18-8d94-3d976f9ade27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:43.032152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c4b852b4-68bb-4c18-8d94-3d976f9ade27 None None] MFA Rules not processed for user `2e8fc4623d924e09874d49f59572346a`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:43.033572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c4b852b4-68bb-4c18-8d94-3d976f9ade27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:43.052292 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1647/3250] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:44.147768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f70b1-9f6e-476c-8774-f53eff80fd8d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:44.149247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-591f70b1-9f6e-476c-8774-f53eff80fd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:44.178924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f70b1-9f6e-476c-8774-f53eff80fd8d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:44.212763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcbe91-df1b-4fce-9371-1dc4d790cc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:44.213705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcbe91-df1b-4fce-9371-1dc4d790cc58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:44.213964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcbe91-df1b-4fce-9371-1dc4d790cc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:44.214272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edcbe91-df1b-4fce-9371-1dc4d790cc58 admin admin] PATH_INFO: `/v3/projects/d8ab4d4be0a54b6e94a9b69fff2a630b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:44.228558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edcbe91-df1b-4fce-9371-1dc4d790cc58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8ab4d4be0a54b6e94a9b69fff2a630b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:44.232811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edcbe91-df1b-4fce-9371-1dc4d790cc58 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:44.445383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7edcbe91-df1b-4fce-9371-1dc4d790cc58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8ab4d4be0a54b6e94a9b69fff2a630b', 'request_id': 'req-7edcbe91-df1b-4fce-9371-1dc4d790cc58'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:44.536425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7edcbe91-df1b-4fce-9371-1dc4d790cc58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8ab4d4be0a54b6e94a9b69fff2a630b', 'request_id': 'req-7edcbe91-df1b-4fce-9371-1dc4d790cc58'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:44.548233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7edcbe91-df1b-4fce-9371-1dc4d790cc58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8ab4d4be0a54b6e94a9b69fff2a630b', 'request_id': 'req-7edcbe91-df1b-4fce-9371-1dc4d790cc58'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:44.578508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7edcbe91-df1b-4fce-9371-1dc4d790cc58 admin admin] The token cache is being invalidate because project d8ab4d4be0a54b6e94a9b69fff2a630b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:20:44.578804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7edcbe91-df1b-4fce-9371-1dc4d790cc58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:44.579622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7edcbe91-df1b-4fce-9371-1dc4d790cc58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:44.582060 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1604/3251] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:20:44 2022] DELETE /identity/v3/projects/d8ab4d4be0a54b6e94a9b69fff2a630b => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:44.587500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b852b4-68bb-4c18-8d94-3d976f9ade27 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:44.617340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b852b4-68bb-4c18-8d94-3d976f9ade27 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:44.819591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb71a2-e120-4e8b-ab03-a4a194ad9b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:44.820695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb71a2-e120-4e8b-ab03-a4a194ad9b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:44.821147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb71a2-e120-4e8b-ab03-a4a194ad9b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:44.824736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb71a2-e120-4e8b-ab03-a4a194ad9b87 admin admin] PATH_INFO: `/v3/users/73d9cc297c4f44c4803422abe3620f35` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:44.826446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb71a2-e120-4e8b-ab03-a4a194ad9b87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73d9cc297c4f44c4803422abe3620f35)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:44.831659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb71a2-e120-4e8b-ab03-a4a194ad9b87 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:45.240729 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:45.276937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-64bb71a2-e120-4e8b-ab03-a4a194ad9b87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73d9cc297c4f44c4803422abe3620f35'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:45.326762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-64bb71a2-e120-4e8b-ab03-a4a194ad9b87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73d9cc297c4f44c4803422abe3620f35'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:45.344267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-64bb71a2-e120-4e8b-ab03-a4a194ad9b87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73d9cc297c4f44c4803422abe3620f35'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:45.371050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-64bb71a2-e120-4e8b-ab03-a4a194ad9b87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73d9cc297c4f44c4803422abe3620f35'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:45.473969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-64bb71a2-e120-4e8b-ab03-a4a194ad9b87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73d9cc297c4f44c4803422abe3620f35'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:45.495599 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1648/3252] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:20:44 2022] DELETE /identity/v3/users/73d9cc297c4f44c4803422abe3620f35 => generated 0 bytes in 905 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:48.042828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcbe91-df1b-4fce-9371-1dc4d790cc58 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:48.044862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7edcbe91-df1b-4fce-9371-1dc4d790cc58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:48.085397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edcbe91-df1b-4fce-9371-1dc4d790cc58 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:48.270859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4a938e-87b4-400e-a1ef-4659f0773ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:48.284642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a938e-87b4-400e-a1ef-4659f0773ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:48.284934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a938e-87b4-400e-a1ef-4659f0773ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:48.287642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4a938e-87b4-400e-a1ef-4659f0773ce7 admin admin] PATH_INFO: `/v3/projects/3bfaa8cb0bc346e1b99044bf7c81e485` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:48.290958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a938e-87b4-400e-a1ef-4659f0773ce7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bfaa8cb0bc346e1b99044bf7c81e485)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:48.294386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4a938e-87b4-400e-a1ef-4659f0773ce7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:48.559823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed4a938e-87b4-400e-a1ef-4659f0773ce7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bfaa8cb0bc346e1b99044bf7c81e485', 'request_id': 'req-ed4a938e-87b4-400e-a1ef-4659f0773ce7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:48.662332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed4a938e-87b4-400e-a1ef-4659f0773ce7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bfaa8cb0bc346e1b99044bf7c81e485', 'request_id': 'req-ed4a938e-87b4-400e-a1ef-4659f0773ce7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:48.669265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed4a938e-87b4-400e-a1ef-4659f0773ce7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bfaa8cb0bc346e1b99044bf7c81e485', 'request_id': 'req-ed4a938e-87b4-400e-a1ef-4659f0773ce7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:48.680091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed4a938e-87b4-400e-a1ef-4659f0773ce7 admin admin] The token cache is being invalidate because project 3bfaa8cb0bc346e1b99044bf7c81e485 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:20:48.680463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed4a938e-87b4-400e-a1ef-4659f0773ce7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:48.681208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed4a938e-87b4-400e-a1ef-4659f0773ce7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:48.682940 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1605/3253] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:20:48 2022] DELETE /identity/v3/projects/3bfaa8cb0bc346e1b99044bf7c81e485 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:48.690356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1f1b8-b61b-432d-9556-c9300bd80ae4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:48.690840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1f1b8-b61b-432d-9556-c9300bd80ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:48.690950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b1f1b8-b61b-432d-9556-c9300bd80ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:48.709871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-90b1f1b8-b61b-432d-9556-c9300bd80ae4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:48.711162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-90b1f1b8-b61b-432d-9556-c9300bd80ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:48.773335 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1649/3254] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:48.783432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447349b0-2889-41df-9be5-8be33f8c3f86 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:48.788011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447349b0-2889-41df-9be5-8be33f8c3f86 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:48.788011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447349b0-2889-41df-9be5-8be33f8c3f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:48.807736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-447349b0-2889-41df-9be5-8be33f8c3f86 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:48.809050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-447349b0-2889-41df-9be5-8be33f8c3f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:48.819883 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1606/3255] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:48.823974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1f1b8-b61b-432d-9556-c9300bd80ae4 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:48.839647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b1f1b8-b61b-432d-9556-c9300bd80ae4 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:48.852704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942afa99-2061-463a-a8e8-fa300de6ad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:48.853333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942afa99-2061-463a-a8e8-fa300de6ad8b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:48.853623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942afa99-2061-463a-a8e8-fa300de6ad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:48.854251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942afa99-2061-463a-a8e8-fa300de6ad8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:48.855001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942afa99-2061-463a-a8e8-fa300de6ad8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:20:48.855312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942afa99-2061-463a-a8e8-fa300de6ad8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:48.857184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942afa99-2061-463a-a8e8-fa300de6ad8b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:48.871397 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1650/3256] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:20:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:20:48.876429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447349b0-2889-41df-9be5-8be33f8c3f86 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:48.882462 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:48.886628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447349b0-2889-41df-9be5-8be33f8c3f86 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:48.891509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a65363-c5dd-4aab-bd71-6bbc3d312983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:48.892269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a65363-c5dd-4aab-bd71-6bbc3d312983 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:48.892630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a65363-c5dd-4aab-bd71-6bbc3d312983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:48.892983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a65363-c5dd-4aab-bd71-6bbc3d312983 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:48.893721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a65363-c5dd-4aab-bd71-6bbc3d312983 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:48.895891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a65363-c5dd-4aab-bd71-6bbc3d312983 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:49.078622 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1607/3257] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:20:48 2022] POST /identity/v3/projects => generated 407 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:20:49.079923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942afa99-2061-463a-a8e8-fa300de6ad8b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:49.090362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942afa99-2061-463a-a8e8-fa300de6ad8b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:49.151394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa4693-2226-46c7-b61a-36eaa0951d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:49.151995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa4693-2226-46c7-b61a-36eaa0951d89 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:49.152280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa4693-2226-46c7-b61a-36eaa0951d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:49.152590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fa4693-2226-46c7-b61a-36eaa0951d89 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:49.153306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa4693-2226-46c7-b61a-36eaa0951d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:49.155822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fa4693-2226-46c7-b61a-36eaa0951d89 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:49.274218 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1651/3258] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:20:49 2022] POST /identity/v3/users => generated 304 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:20:49.277114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a65363-c5dd-4aab-bd71-6bbc3d312983 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:49.289981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a65363-c5dd-4aab-bd71-6bbc3d312983 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:49.296881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdea3b5-11f6-4d3e-8f6d-65804dded480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:49.298649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdea3b5-11f6-4d3e-8f6d-65804dded480 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:49.299047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdea3b5-11f6-4d3e-8f6d-65804dded480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:49.303262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdea3b5-11f6-4d3e-8f6d-65804dded480 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:49.303262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdea3b5-11f6-4d3e-8f6d-65804dded480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:49.303262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdea3b5-11f6-4d3e-8f6d-65804dded480 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:49.316135 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1608/3259] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:20:49.320648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa4693-2226-46c7-b61a-36eaa0951d89 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:49.335492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fa4693-2226-46c7-b61a-36eaa0951d89 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:49.344871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1657b7-a715-49b6-b4aa-8c96d2550481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:49.346240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1657b7-a715-49b6-b4aa-8c96d2550481 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:49.346636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1657b7-a715-49b6-b4aa-8c96d2550481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:49.347023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1657b7-a715-49b6-b4aa-8c96d2550481 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:49.347988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1657b7-a715-49b6-b4aa-8c96d2550481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:49.352685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1657b7-a715-49b6-b4aa-8c96d2550481 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:49.370880 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1652/3260] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:20:49.375140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdea3b5-11f6-4d3e-8f6d-65804dded480 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:49.385830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdea3b5-11f6-4d3e-8f6d-65804dded480 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:49.393128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87117cf3-7727-4695-ba5b-4115359c3625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:49.394480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87117cf3-7727-4695-ba5b-4115359c3625 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:49.394967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87117cf3-7727-4695-ba5b-4115359c3625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:49.395468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87117cf3-7727-4695-ba5b-4115359c3625 admin admin] PATH_INFO: `/v3/projects/5e09f2d885b54590ad14ce88a1e11515/users/01eb809a725f44f3ae564d8d1d936eef/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:49.419629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87117cf3-7727-4695-ba5b-4115359c3625 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e09f2d885b54590ad14ce88a1e11515, user_id=01eb809a725f44f3ae564d8d1d936eef, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:49.424314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87117cf3-7727-4695-ba5b-4115359c3625 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:49.512136 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1609/3261] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:20:49 2022] PUT /identity/v3/projects/5e09f2d885b54590ad14ce88a1e11515/users/01eb809a725f44f3ae564d8d1d936eef/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:20:49.524375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa600a33-794a-431b-b551-c2fdd3fdfcb8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:49.524673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa600a33-794a-431b-b551-c2fdd3fdfcb8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:49.524953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa600a33-794a-431b-b551-c2fdd3fdfcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:49.566805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-aa600a33-794a-431b-b551-c2fdd3fdfcb8 None None] MFA Rules not processed for user `01eb809a725f44f3ae564d8d1d936eef`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:49.568290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-aa600a33-794a-431b-b551-c2fdd3fdfcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:49.579842 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:49.666258 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1653/3262] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:49.676787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87117cf3-7727-4695-ba5b-4115359c3625 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:49.779424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87117cf3-7727-4695-ba5b-4115359c3625 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:49.785941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f907b-b769-488c-8bc6-2921f19da61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:49.786655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f907b-b769-488c-8bc6-2921f19da61d admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:49.786936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f907b-b769-488c-8bc6-2921f19da61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:49.787603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f907b-b769-488c-8bc6-2921f19da61d admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:49.788173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f907b-b769-488c-8bc6-2921f19da61d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:49.790867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f907b-b769-488c-8bc6-2921f19da61d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:49.922478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa600a33-794a-431b-b551-c2fdd3fdfcb8 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:49.929628 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1610/3263] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:20:49 2022] POST /identity/v3/projects => generated 407 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:20:49.942580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa600a33-794a-431b-b551-c2fdd3fdfcb8 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:50.023029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc57c92-c9e1-4546-aaa3-45f4214213f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:50.023827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc57c92-c9e1-4546-aaa3-45f4214213f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:50.024189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc57c92-c9e1-4546-aaa3-45f4214213f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:50.024543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc57c92-c9e1-4546-aaa3-45f4214213f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:50.025531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc57c92-c9e1-4546-aaa3-45f4214213f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:50.027807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc57c92-c9e1-4546-aaa3-45f4214213f0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:50.128892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f907b-b769-488c-8bc6-2921f19da61d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:50.129435 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1654/3264] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:20:49 2022] POST /identity/v3/users => generated 310 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:20:50.143887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f907b-b769-488c-8bc6-2921f19da61d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:50.159145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baacd64-22a5-4ae0-9847-4182353af67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:50.160072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baacd64-22a5-4ae0-9847-4182353af67c admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:50.160506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baacd64-22a5-4ae0-9847-4182353af67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:50.160947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baacd64-22a5-4ae0-9847-4182353af67c admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:50.162081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baacd64-22a5-4ae0-9847-4182353af67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:50.163870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baacd64-22a5-4ae0-9847-4182353af67c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:50.197412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc57c92-c9e1-4546-aaa3-45f4214213f0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:50.210543 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1611/3265] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:20:50.212517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc57c92-c9e1-4546-aaa3-45f4214213f0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:50.222622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249bfc7-8c9f-4796-b08d-f13ca1581bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:50.225180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249bfc7-8c9f-4796-b08d-f13ca1581bcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:50.234403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249bfc7-8c9f-4796-b08d-f13ca1581bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:50.234403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a249bfc7-8c9f-4796-b08d-f13ca1581bcb admin admin] PATH_INFO: `/v3/projects/d467eac48ca84fa68ca8909d0531d641/users/c3b815f8dd6341a69d09d8fea026c064/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:50.270176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249bfc7-8c9f-4796-b08d-f13ca1581bcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d467eac48ca84fa68ca8909d0531d641, user_id=c3b815f8dd6341a69d09d8fea026c064, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:50.273672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a249bfc7-8c9f-4796-b08d-f13ca1581bcb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:50.386393 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1655/3266] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:20:50 2022] PUT /identity/v3/projects/d467eac48ca84fa68ca8909d0531d641/users/c3b815f8dd6341a69d09d8fea026c064/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:50.393002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baacd64-22a5-4ae0-9847-4182353af67c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:50.414375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baacd64-22a5-4ae0-9847-4182353af67c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:50.539821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a54f0-ee60-4ea0-ba2e-ffbf772769a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:50.540201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a54f0-ee60-4ea0-ba2e-ffbf772769a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:50.540491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a54f0-ee60-4ea0-ba2e-ffbf772769a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:50.540826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a54f0-ee60-4ea0-ba2e-ffbf772769a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:50.542342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a54f0-ee60-4ea0-ba2e-ffbf772769a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:50.544795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a54f0-ee60-4ea0-ba2e-ffbf772769a0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:50.564451 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1612/3267] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:20:50 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:20:50.567371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249bfc7-8c9f-4796-b08d-f13ca1581bcb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:50.586186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a249bfc7-8c9f-4796-b08d-f13ca1581bcb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:50.593484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464bcae-d769-4d87-aaee-1969adeb6484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:50.594688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464bcae-d769-4d87-aaee-1969adeb6484 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:50.594977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464bcae-d769-4d87-aaee-1969adeb6484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:50.595257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3464bcae-d769-4d87-aaee-1969adeb6484 admin admin] PATH_INFO: `/v3/projects/d467eac48ca84fa68ca8909d0531d641/users/c3b815f8dd6341a69d09d8fea026c064/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:50.597727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464bcae-d769-4d87-aaee-1969adeb6484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d467eac48ca84fa68ca8909d0531d641, user_id=c3b815f8dd6341a69d09d8fea026c064, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:50.602695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3464bcae-d769-4d87-aaee-1969adeb6484 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:50.618130 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1656/3268] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:20:50 2022] PUT /identity/v3/projects/d467eac48ca84fa68ca8909d0531d641/users/c3b815f8dd6341a69d09d8fea026c064/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:50.629150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729e788-6508-4063-8a76-93f22a51b9b0 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:50.629444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729e788-6508-4063-8a76-93f22a51b9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:50.630486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3729e788-6508-4063-8a76-93f22a51b9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:50.709366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3729e788-6508-4063-8a76-93f22a51b9b0 None None] MFA Rules not processed for user `c3b815f8dd6341a69d09d8fea026c064`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:50.710493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3729e788-6508-4063-8a76-93f22a51b9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:50.719695 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:50.833503 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1613/3269] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:50 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:50.841122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464bcae-d769-4d87-aaee-1969adeb6484 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:50.950757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3464bcae-d769-4d87-aaee-1969adeb6484 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:50.964086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c979fb6-9faf-452d-8faf-2b7d525b8d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:50.969287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c979fb6-9faf-452d-8faf-2b7d525b8d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:50.969933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c979fb6-9faf-452d-8faf-2b7d525b8d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:50.970514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c979fb6-9faf-452d-8faf-2b7d525b8d40 admin admin] PATH_INFO: `/v3/users/01eb809a725f44f3ae564d8d1d936eef` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:50.973568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c979fb6-9faf-452d-8faf-2b7d525b8d40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01eb809a725f44f3ae564d8d1d936eef)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:50.979347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c979fb6-9faf-452d-8faf-2b7d525b8d40 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:50.989819 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:51.230140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5c979fb6-9faf-452d-8faf-2b7d525b8d40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01eb809a725f44f3ae564d8d1d936eef'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:51.266376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5c979fb6-9faf-452d-8faf-2b7d525b8d40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01eb809a725f44f3ae564d8d1d936eef'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:51.279608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5c979fb6-9faf-452d-8faf-2b7d525b8d40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01eb809a725f44f3ae564d8d1d936eef'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:51.280420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5c979fb6-9faf-452d-8faf-2b7d525b8d40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01eb809a725f44f3ae564d8d1d936eef'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:51.382234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5c979fb6-9faf-452d-8faf-2b7d525b8d40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01eb809a725f44f3ae564d8d1d936eef'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:51.401069 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1657/3270] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:20:50 2022] DELETE /identity/v3/users/01eb809a725f44f3ae564d8d1d936eef => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:51.402669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed2b99-f108-44af-9e16-7870fda67618 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:51.403119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed2b99-f108-44af-9e16-7870fda67618 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:51.403449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed2b99-f108-44af-9e16-7870fda67618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:51.436244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4eed2b99-f108-44af-9e16-7870fda67618 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:51.436244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4eed2b99-f108-44af-9e16-7870fda67618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:51.618686 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1614/3271] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:20:51.656812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c979fb6-9faf-452d-8faf-2b7d525b8d40 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:51.658358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5c979fb6-9faf-452d-8faf-2b7d525b8d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:51.854228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c979fb6-9faf-452d-8faf-2b7d525b8d40 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:51.859687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13984fc-5a3f-470f-b9ce-01da033a1b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:51.861036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13984fc-5a3f-470f-b9ce-01da033a1b4c service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:51.861596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13984fc-5a3f-470f-b9ce-01da033a1b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:51.862057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13984fc-5a3f-470f-b9ce-01da033a1b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:51.875400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13984fc-5a3f-470f-b9ce-01da033a1b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:51.877164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13984fc-5a3f-470f-b9ce-01da033a1b4c service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:51.893408 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1658/3272] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:20:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:20:52.310336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed2b99-f108-44af-9e16-7870fda67618 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:52.313379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4eed2b99-f108-44af-9e16-7870fda67618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:52.335025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed2b99-f108-44af-9e16-7870fda67618 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:52.348868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb81f3-d593-4e6f-b6f0-eee5346ee1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:52.354468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb81f3-d593-4e6f-b6f0-eee5346ee1a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:52.354787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb81f3-d593-4e6f-b6f0-eee5346ee1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:52.355245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb81f3-d593-4e6f-b6f0-eee5346ee1a1 admin admin] PATH_INFO: `/v3/users/97544bddf4d94925b0c6764a8cb0914b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:52.358975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb81f3-d593-4e6f-b6f0-eee5346ee1a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97544bddf4d94925b0c6764a8cb0914b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:52.367880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb81f3-d593-4e6f-b6f0-eee5346ee1a1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:52.609129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6dbb81f3-d593-4e6f-b6f0-eee5346ee1a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97544bddf4d94925b0c6764a8cb0914b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:52.642548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6dbb81f3-d593-4e6f-b6f0-eee5346ee1a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97544bddf4d94925b0c6764a8cb0914b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:52.643739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6dbb81f3-d593-4e6f-b6f0-eee5346ee1a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97544bddf4d94925b0c6764a8cb0914b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:52.644377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6dbb81f3-d593-4e6f-b6f0-eee5346ee1a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97544bddf4d94925b0c6764a8cb0914b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:52.656726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6dbb81f3-d593-4e6f-b6f0-eee5346ee1a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97544bddf4d94925b0c6764a8cb0914b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:52.757889 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1615/3273] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:20:52 2022] DELETE /identity/v3/users/97544bddf4d94925b0c6764a8cb0914b => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:52.775374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13984fc-5a3f-470f-b9ce-01da033a1b4c service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:52.777109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d13984fc-5a3f-470f-b9ce-01da033a1b4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:52.800623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13984fc-5a3f-470f-b9ce-01da033a1b4c service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:52.935678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d57d0-9210-4aed-ad93-9820bdc57513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:52.937090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d57d0-9210-4aed-ad93-9820bdc57513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:52.937381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d57d0-9210-4aed-ad93-9820bdc57513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:52.937658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6d57d0-9210-4aed-ad93-9820bdc57513 admin admin] PATH_INFO: `/v3/projects/5e09f2d885b54590ad14ce88a1e11515` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:52.938951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d57d0-9210-4aed-ad93-9820bdc57513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e09f2d885b54590ad14ce88a1e11515)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:52.941329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6d57d0-9210-4aed-ad93-9820bdc57513 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:53.072110 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:53.107615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5f6d57d0-9210-4aed-ad93-9820bdc57513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e09f2d885b54590ad14ce88a1e11515', 'request_id': 'req-5f6d57d0-9210-4aed-ad93-9820bdc57513'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:53.116332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5f6d57d0-9210-4aed-ad93-9820bdc57513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e09f2d885b54590ad14ce88a1e11515', 'request_id': 'req-5f6d57d0-9210-4aed-ad93-9820bdc57513'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:53.129452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5f6d57d0-9210-4aed-ad93-9820bdc57513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e09f2d885b54590ad14ce88a1e11515', 'request_id': 'req-5f6d57d0-9210-4aed-ad93-9820bdc57513'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:53.269844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5f6d57d0-9210-4aed-ad93-9820bdc57513 admin admin] The token cache is being invalidate because project 5e09f2d885b54590ad14ce88a1e11515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:20:53.270172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5f6d57d0-9210-4aed-ad93-9820bdc57513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:53.272594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5f6d57d0-9210-4aed-ad93-9820bdc57513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:53.274264 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1659/3274] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:20:52 2022] DELETE /identity/v3/projects/5e09f2d885b54590ad14ce88a1e11515 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:53.278378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb81f3-d593-4e6f-b6f0-eee5346ee1a1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:53.280003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6dbb81f3-d593-4e6f-b6f0-eee5346ee1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:53.302513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb81f3-d593-4e6f-b6f0-eee5346ee1a1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:53.304543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d57d0-9210-4aed-ad93-9820bdc57513 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:53.306212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5f6d57d0-9210-4aed-ad93-9820bdc57513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:53.356074 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:53.435906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6d57d0-9210-4aed-ad93-9820bdc57513 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:53.455189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446426f-a8a1-4d49-bb30-3092869b2246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:53.456103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446426f-a8a1-4d49-bb30-3092869b2246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:53.456522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446426f-a8a1-4d49-bb30-3092869b2246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:53.456676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446426f-a8a1-4d49-bb30-3092869b2246 admin admin] PATH_INFO: `/v3/projects/420245e289574680ae1c78218dc8e12b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:53.460207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446426f-a8a1-4d49-bb30-3092869b2246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=420245e289574680ae1c78218dc8e12b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:53.462380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446426f-a8a1-4d49-bb30-3092869b2246 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:53.479940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9679cd-1ef1-4e3b-bba3-2fc874d77077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:53.480852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9679cd-1ef1-4e3b-bba3-2fc874d77077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:53.486344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9679cd-1ef1-4e3b-bba3-2fc874d77077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:53.486717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9679cd-1ef1-4e3b-bba3-2fc874d77077 admin admin] PATH_INFO: `/v3/users/c3b815f8dd6341a69d09d8fea026c064` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:53.488146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9679cd-1ef1-4e3b-bba3-2fc874d77077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3b815f8dd6341a69d09d8fea026c064)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:53.493206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9679cd-1ef1-4e3b-bba3-2fc874d77077 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:53.606552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5446426f-a8a1-4d49-bb30-3092869b2246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '420245e289574680ae1c78218dc8e12b', 'request_id': 'req-5446426f-a8a1-4d49-bb30-3092869b2246'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:53.615109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5446426f-a8a1-4d49-bb30-3092869b2246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '420245e289574680ae1c78218dc8e12b', 'request_id': 'req-5446426f-a8a1-4d49-bb30-3092869b2246'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:53.625551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5446426f-a8a1-4d49-bb30-3092869b2246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '420245e289574680ae1c78218dc8e12b', 'request_id': 'req-5446426f-a8a1-4d49-bb30-3092869b2246'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:53.700852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ea9679cd-1ef1-4e3b-bba3-2fc874d77077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3b815f8dd6341a69d09d8fea026c064'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:53.721437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5446426f-a8a1-4d49-bb30-3092869b2246 admin admin] The token cache is being invalidate because project 420245e289574680ae1c78218dc8e12b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:20:53.722259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5446426f-a8a1-4d49-bb30-3092869b2246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:53.723164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5446426f-a8a1-4d49-bb30-3092869b2246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:53.726022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ea9679cd-1ef1-4e3b-bba3-2fc874d77077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3b815f8dd6341a69d09d8fea026c064'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:53.729789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ea9679cd-1ef1-4e3b-bba3-2fc874d77077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3b815f8dd6341a69d09d8fea026c064'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:53.729789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ea9679cd-1ef1-4e3b-bba3-2fc874d77077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3b815f8dd6341a69d09d8fea026c064'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:53.731181 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1660/3275] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:20:53 2022] DELETE /identity/v3/projects/420245e289574680ae1c78218dc8e12b => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:20:53.735216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce423e-9077-4901-9be2-34e00ad7466d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:53.735810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce423e-9077-4901-9be2-34e00ad7466d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:53.736353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce423e-9077-4901-9be2-34e00ad7466d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:53.756740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ea9679cd-1ef1-4e3b-bba3-2fc874d77077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3b815f8dd6341a69d09d8fea026c064'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:53.787720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-69ce423e-9077-4901-9be2-34e00ad7466d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:53.788960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-69ce423e-9077-4901-9be2-34e00ad7466d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:53.828625 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1616/3276] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:20:53 2022] DELETE /identity/v3/users/c3b815f8dd6341a69d09d8fea026c064 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:53.912301 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1661/3277] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:53.915199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5282a-8684-4832-910a-5e4a4ac23432 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:53.915199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5282a-8684-4832-910a-5e4a4ac23432 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:53.915199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5282a-8684-4832-910a-5e4a4ac23432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:53.948079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-53e5282a-8684-4832-910a-5e4a4ac23432 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:53.951539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-53e5282a-8684-4832-910a-5e4a4ac23432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:54.038343 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1617/3278] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:54.039960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce423e-9077-4901-9be2-34e00ad7466d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:54.053644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce423e-9077-4901-9be2-34e00ad7466d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:54.060976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1446def-083c-4a6b-8927-df06abcf8590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:54.062564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1446def-083c-4a6b-8927-df06abcf8590 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:54.062915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1446def-083c-4a6b-8927-df06abcf8590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:54.063303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1446def-083c-4a6b-8927-df06abcf8590 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:54.064160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1446def-083c-4a6b-8927-df06abcf8590 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:20:54.064572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1446def-083c-4a6b-8927-df06abcf8590 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:54.066531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1446def-083c-4a6b-8927-df06abcf8590 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:54.091037 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1662/3279] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:20:54.092163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5282a-8684-4832-910a-5e4a4ac23432 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:54.110302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5282a-8684-4832-910a-5e4a4ac23432 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:54.129133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7905e40-8e77-4042-bdc2-a5951061c260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:54.130504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7905e40-8e77-4042-bdc2-a5951061c260 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:54.130912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7905e40-8e77-4042-bdc2-a5951061c260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:54.131343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7905e40-8e77-4042-bdc2-a5951061c260 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:54.133837 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:54.143921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7905e40-8e77-4042-bdc2-a5951061c260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:54.143921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7905e40-8e77-4042-bdc2-a5951061c260 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:54.249779 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1618/3280] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:20:54 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:20:54.254646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1446def-083c-4a6b-8927-df06abcf8590 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:54.277797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1446def-083c-4a6b-8927-df06abcf8590 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:54.351721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc0a33-c613-401c-bccc-fae6fb5d2a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:54.352709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc0a33-c613-401c-bccc-fae6fb5d2a51 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:54.353255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc0a33-c613-401c-bccc-fae6fb5d2a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:54.353868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc0a33-c613-401c-bccc-fae6fb5d2a51 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:54.355630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc0a33-c613-401c-bccc-fae6fb5d2a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:54.357986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc0a33-c613-401c-bccc-fae6fb5d2a51 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:54.462220 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1663/3281] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:20:54 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:20:54.466840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7905e40-8e77-4042-bdc2-a5951061c260 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:54.487573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7905e40-8e77-4042-bdc2-a5951061c260 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:54.503571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb28ae-a073-4a85-9dee-f4af9fa110e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:54.507414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb28ae-a073-4a85-9dee-f4af9fa110e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:54.507878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb28ae-a073-4a85-9dee-f4af9fa110e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:54.508303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb28ae-a073-4a85-9dee-f4af9fa110e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:54.509258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb28ae-a073-4a85-9dee-f4af9fa110e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:54.515454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb28ae-a073-4a85-9dee-f4af9fa110e1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:54.548677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc0a33-c613-401c-bccc-fae6fb5d2a51 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:54.561068 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1619/3282] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:20:54.572597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc0a33-c613-401c-bccc-fae6fb5d2a51 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:54.593225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0cfd4-d993-4e69-913f-f44713231c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:54.594082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0cfd4-d993-4e69-913f-f44713231c3c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:54.594349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0cfd4-d993-4e69-913f-f44713231c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:54.594635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0cfd4-d993-4e69-913f-f44713231c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:54.596859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0cfd4-d993-4e69-913f-f44713231c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:54.598993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0cfd4-d993-4e69-913f-f44713231c3c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:54.612883 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1664/3283] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:20:54.616936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb28ae-a073-4a85-9dee-f4af9fa110e1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:54.622410 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:54.633764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb28ae-a073-4a85-9dee-f4af9fa110e1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:54.644383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7399619e-2440-4a24-9ea7-f97cdae39bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:54.646213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399619e-2440-4a24-9ea7-f97cdae39bbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:54.646647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399619e-2440-4a24-9ea7-f97cdae39bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:54.647101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7399619e-2440-4a24-9ea7-f97cdae39bbd admin admin] PATH_INFO: `/v3/projects/d0730f3c6ab749508db7b57f9be02f56/users/cb444a9e01dc497ca9b8f3c1b65fe532/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:54.688243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0cfd4-d993-4e69-913f-f44713231c3c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:54.690928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-caa0cfd4-d993-4e69-913f-f44713231c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:54.703135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399619e-2440-4a24-9ea7-f97cdae39bbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0730f3c6ab749508db7b57f9be02f56, user_id=cb444a9e01dc497ca9b8f3c1b65fe532, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:54.710418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7399619e-2440-4a24-9ea7-f97cdae39bbd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:54.733804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0cfd4-d993-4e69-913f-f44713231c3c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:54.748530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397950c6-944f-42de-8639-bbfa87fb49f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:54.750035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397950c6-944f-42de-8639-bbfa87fb49f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:54.750355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397950c6-944f-42de-8639-bbfa87fb49f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:54.756525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397950c6-944f-42de-8639-bbfa87fb49f1 admin admin] PATH_INFO: `/v3/projects/d467eac48ca84fa68ca8909d0531d641` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:54.756525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397950c6-944f-42de-8639-bbfa87fb49f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d467eac48ca84fa68ca8909d0531d641)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:54.756525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397950c6-944f-42de-8639-bbfa87fb49f1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:54.813766 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1620/3284] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:20:54 2022] PUT /identity/v3/projects/d0730f3c6ab749508db7b57f9be02f56/users/cb444a9e01dc497ca9b8f3c1b65fe532/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:54.820078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd611b9-608d-4c52-9465-8b2fb6475811 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:54.820466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd611b9-608d-4c52-9465-8b2fb6475811 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:54.820758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd611b9-608d-4c52-9465-8b2fb6475811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:54.854718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5fd611b9-608d-4c52-9465-8b2fb6475811 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:54.855943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5fd611b9-608d-4c52-9465-8b2fb6475811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:54.944997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-397950c6-944f-42de-8639-bbfa87fb49f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd467eac48ca84fa68ca8909d0531d641', 'request_id': 'req-397950c6-944f-42de-8639-bbfa87fb49f1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:54.971205 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1621/3285] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:54.976712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-397950c6-944f-42de-8639-bbfa87fb49f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd467eac48ca84fa68ca8909d0531d641', 'request_id': 'req-397950c6-944f-42de-8639-bbfa87fb49f1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:54.985616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd611b9-608d-4c52-9465-8b2fb6475811 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:54.987692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5fd611b9-608d-4c52-9465-8b2fb6475811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:54.994769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-397950c6-944f-42de-8639-bbfa87fb49f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd467eac48ca84fa68ca8909d0531d641', 'request_id': 'req-397950c6-944f-42de-8639-bbfa87fb49f1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:55.070696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd611b9-608d-4c52-9465-8b2fb6475811 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:55.138230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2446f1d-7f85-4675-96cc-f6e11041b144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:55.140227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2446f1d-7f85-4675-96cc-f6e11041b144 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:55.141100 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2446f1d-7f85-4675-96cc-f6e11041b144 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:55.141635 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2446f1d-7f85-4675-96cc-f6e11041b144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:55.160950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-397950c6-944f-42de-8639-bbfa87fb49f1 admin admin] The token cache is being invalidate because project d467eac48ca84fa68ca8909d0531d641 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:20:55.161269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-397950c6-944f-42de-8639-bbfa87fb49f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:55.163241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-397950c6-944f-42de-8639-bbfa87fb49f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:20:55.170476 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1665/3286] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:20:54 2022] DELETE /identity/v3/projects/d467eac48ca84fa68ca8909d0531d641 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:55.172220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cce0a-7384-4451-8920-a4738e956d13 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:55.172515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cce0a-7384-4451-8920-a4738e956d13 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:55.172802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55cce0a-7384-4451-8920-a4738e956d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:55.228074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d55cce0a-7384-4451-8920-a4738e956d13 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:55.229365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d55cce0a-7384-4451-8920-a4738e956d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:55.273443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2446f1d-7f85-4675-96cc-f6e11041b144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:55.279022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2446f1d-7f85-4675-96cc-f6e11041b144 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:55.305554 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1622/3287] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:20:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:20:55.343819 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:55.435241 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1666/3288] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:55.444111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0016c6-3047-40d7-ad90-9698fc35283c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:55.445268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0016c6-3047-40d7-ad90-9698fc35283c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:55.445728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0016c6-3047-40d7-ad90-9698fc35283c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:55.497065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5e0016c6-3047-40d7-ad90-9698fc35283c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:55.501535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5e0016c6-3047-40d7-ad90-9698fc35283c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:55.525068 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1623/3289] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:55.530310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cce0a-7384-4451-8920-a4738e956d13 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:55.544450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55cce0a-7384-4451-8920-a4738e956d13 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:55.554364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4b097-3009-4cd0-9ca2-8e8269769979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:55.555197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4b097-3009-4cd0-9ca2-8e8269769979 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:55.555554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4b097-3009-4cd0-9ca2-8e8269769979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:55.555901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb4b097-3009-4cd0-9ca2-8e8269769979 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:55.557042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4b097-3009-4cd0-9ca2-8e8269769979 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:20:55.557425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4b097-3009-4cd0-9ca2-8e8269769979 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:55.560627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb4b097-3009-4cd0-9ca2-8e8269769979 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:55.584724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0016c6-3047-40d7-ad90-9698fc35283c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:55.585319 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1667/3290] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:20:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:20:55.596744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0016c6-3047-40d7-ad90-9698fc35283c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:55.602241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8610f-10d6-4b44-8cb2-a76708d04706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:55.602923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8610f-10d6-4b44-8cb2-a76708d04706 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:55.603250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8610f-10d6-4b44-8cb2-a76708d04706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:55.603510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8610f-10d6-4b44-8cb2-a76708d04706 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:55.604263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8610f-10d6-4b44-8cb2-a76708d04706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:55.607182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8610f-10d6-4b44-8cb2-a76708d04706 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:55.686029 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:55.731108 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1624/3291] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:20:55 2022] POST /identity/v3/projects => generated 403 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:20:55.735564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4b097-3009-4cd0-9ca2-8e8269769979 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:55.747438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb4b097-3009-4cd0-9ca2-8e8269769979 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:55.841849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928b76c-4601-4a28-be6a-5b24e255cb4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:55.843304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928b76c-4601-4a28-be6a-5b24e255cb4c admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:55.844959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928b76c-4601-4a28-be6a-5b24e255cb4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:55.846206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f928b76c-4601-4a28-be6a-5b24e255cb4c admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:55.846945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928b76c-4601-4a28-be6a-5b24e255cb4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:55.848975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f928b76c-4601-4a28-be6a-5b24e255cb4c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:55.965447 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1668/3292] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:20:55 2022] POST /identity/v3/users => generated 302 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:20:55.970877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8610f-10d6-4b44-8cb2-a76708d04706 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:55.982197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8610f-10d6-4b44-8cb2-a76708d04706 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:55.998207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df7db6-08f1-4e34-8998-c9040f161d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:55.999436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df7db6-08f1-4e34-8998-c9040f161d19 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:56.000349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df7db6-08f1-4e34-8998-c9040f161d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:56.000637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df7db6-08f1-4e34-8998-c9040f161d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:56.002311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df7db6-08f1-4e34-8998-c9040f161d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:56.003951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df7db6-08f1-4e34-8998-c9040f161d19 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:56.033228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928b76c-4601-4a28-be6a-5b24e255cb4c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:56.042346 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1625/3293] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:20:56.047469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f928b76c-4601-4a28-be6a-5b24e255cb4c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:56.053415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7a69dd-c246-48bf-b1ce-06e9277ecdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:56.054268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a69dd-c246-48bf-b1ce-06e9277ecdd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:56.054774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a69dd-c246-48bf-b1ce-06e9277ecdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:56.055031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7a69dd-c246-48bf-b1ce-06e9277ecdd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:56.055873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a69dd-c246-48bf-b1ce-06e9277ecdd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:56.057569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7a69dd-c246-48bf-b1ce-06e9277ecdd8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:56.071214 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1669/3294] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:20:56.075257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df7db6-08f1-4e34-8998-c9040f161d19 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:56.090472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df7db6-08f1-4e34-8998-c9040f161d19 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:56.099959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63655ce-f619-4ce3-b4f4-27fe0b40ad4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:56.101437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63655ce-f619-4ce3-b4f4-27fe0b40ad4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:56.101924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63655ce-f619-4ce3-b4f4-27fe0b40ad4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:56.102511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63655ce-f619-4ce3-b4f4-27fe0b40ad4b admin admin] PATH_INFO: `/v3/projects/e87200e4ce6d4557a3fa7d14fa5c4522/users/f046713aba294ff0b42446ccd05f2e06/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:56.131931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63655ce-f619-4ce3-b4f4-27fe0b40ad4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e87200e4ce6d4557a3fa7d14fa5c4522, user_id=f046713aba294ff0b42446ccd05f2e06, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:56.135439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63655ce-f619-4ce3-b4f4-27fe0b40ad4b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:56.213676 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1626/3295] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:20:56 2022] PUT /identity/v3/projects/e87200e4ce6d4557a3fa7d14fa5c4522/users/f046713aba294ff0b42446ccd05f2e06/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:56.224121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdb9c4-0686-4db7-897d-f6292b2884f1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:56.224488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdb9c4-0686-4db7-897d-f6292b2884f1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:56.224772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fdb9c4-0686-4db7-897d-f6292b2884f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:56.270298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-46fdb9c4-0686-4db7-897d-f6292b2884f1 None None] MFA Rules not processed for user `f046713aba294ff0b42446ccd05f2e06`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:56.272479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-46fdb9c4-0686-4db7-897d-f6292b2884f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:56.440934 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1670/3296] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:56.442998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63655ce-f619-4ce3-b4f4-27fe0b40ad4b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:56.544599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63655ce-f619-4ce3-b4f4-27fe0b40ad4b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:56.551060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d544b-015e-4e20-9e48-7f39a498fc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:56.551914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d544b-015e-4e20-9e48-7f39a498fc25 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:56.552203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d544b-015e-4e20-9e48-7f39a498fc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:56.552857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0d544b-015e-4e20-9e48-7f39a498fc25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:56.553569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d544b-015e-4e20-9e48-7f39a498fc25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:56.555573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0d544b-015e-4e20-9e48-7f39a498fc25 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:56.672806 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1627/3297] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:20:56 2022] POST /identity/v3/projects => generated 403 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:20:56.676724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdb9c4-0686-4db7-897d-f6292b2884f1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:56.692331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fdb9c4-0686-4db7-897d-f6292b2884f1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:56.726888 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:56.765721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd2a09-c944-482e-89b2-3aeca0250510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:56.767684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd2a09-c944-482e-89b2-3aeca0250510 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:56.767981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd2a09-c944-482e-89b2-3aeca0250510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:56.768426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bd2a09-c944-482e-89b2-3aeca0250510 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:56.769609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd2a09-c944-482e-89b2-3aeca0250510 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:56.772087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bd2a09-c944-482e-89b2-3aeca0250510 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:56.879400 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1671/3298] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:20:56 2022] POST /identity/v3/users => generated 308 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:20:56.891269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d544b-015e-4e20-9e48-7f39a498fc25 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:56.903460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0d544b-015e-4e20-9e48-7f39a498fc25 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:56.909799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a176df-bf21-4774-95ec-8f56fbed6f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:56.910863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a176df-bf21-4774-95ec-8f56fbed6f3d admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:56.911496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a176df-bf21-4774-95ec-8f56fbed6f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:56.912107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a176df-bf21-4774-95ec-8f56fbed6f3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:56.913042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a176df-bf21-4774-95ec-8f56fbed6f3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:56.914956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a176df-bf21-4774-95ec-8f56fbed6f3d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:56.928802 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1628/3299] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:20:56.932650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd2a09-c944-482e-89b2-3aeca0250510 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:56.947173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bd2a09-c944-482e-89b2-3aeca0250510 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:56.956111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdac095-a5af-4a54-a31c-aa4dd54f93a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:56.957748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdac095-a5af-4a54-a31c-aa4dd54f93a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:56.958287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdac095-a5af-4a54-a31c-aa4dd54f93a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:56.958763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdac095-a5af-4a54-a31c-aa4dd54f93a9 admin admin] PATH_INFO: `/v3/projects/226aa7fd989645ac8029cda856ba3660/users/1adf409150f846e6ae0ec1582ecbee3b/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:56.991217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdac095-a5af-4a54-a31c-aa4dd54f93a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=226aa7fd989645ac8029cda856ba3660, user_id=1adf409150f846e6ae0ec1582ecbee3b, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:56.999592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdac095-a5af-4a54-a31c-aa4dd54f93a9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:57.091966 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1672/3300] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:20:56 2022] PUT /identity/v3/projects/226aa7fd989645ac8029cda856ba3660/users/1adf409150f846e6ae0ec1582ecbee3b/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:57.096132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a176df-bf21-4774-95ec-8f56fbed6f3d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:57.113033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a176df-bf21-4774-95ec-8f56fbed6f3d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:57.226050 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:57.245233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3583902a-8965-424c-9782-1ad53d1dc3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:57.245957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583902a-8965-424c-9782-1ad53d1dc3ef admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:57.246379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583902a-8965-424c-9782-1ad53d1dc3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:57.246800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3583902a-8965-424c-9782-1ad53d1dc3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:57.248248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583902a-8965-424c-9782-1ad53d1dc3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:57.250266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3583902a-8965-424c-9782-1ad53d1dc3ef admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:57.262775 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1629/3301] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:20:57 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:20:57.268115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdac095-a5af-4a54-a31c-aa4dd54f93a9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:57.282917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdac095-a5af-4a54-a31c-aa4dd54f93a9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:57.292202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661853b5-9152-4385-808a-a32f72d63a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:57.295022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661853b5-9152-4385-808a-a32f72d63a71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:57.295295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661853b5-9152-4385-808a-a32f72d63a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:57.295581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661853b5-9152-4385-808a-a32f72d63a71 admin admin] PATH_INFO: `/v3/projects/226aa7fd989645ac8029cda856ba3660/users/1adf409150f846e6ae0ec1582ecbee3b/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:57.303382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661853b5-9152-4385-808a-a32f72d63a71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=226aa7fd989645ac8029cda856ba3660, user_id=1adf409150f846e6ae0ec1582ecbee3b, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:57.308531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661853b5-9152-4385-808a-a32f72d63a71 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:57.350053 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1673/3302] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:20:57 2022] PUT /identity/v3/projects/226aa7fd989645ac8029cda856ba3660/users/1adf409150f846e6ae0ec1582ecbee3b/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:20:57.352454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299b369-d8e7-4c72-8fc0-47507f4634d8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:57.352992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299b369-d8e7-4c72-8fc0-47507f4634d8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:57.354425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6299b369-d8e7-4c72-8fc0-47507f4634d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:57.398452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6299b369-d8e7-4c72-8fc0-47507f4634d8 None None] MFA Rules not processed for user `1adf409150f846e6ae0ec1582ecbee3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:20:57.400046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6299b369-d8e7-4c72-8fc0-47507f4634d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:57.589392 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1630/3303] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:20:57 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:20:57.596699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661853b5-9152-4385-808a-a32f72d63a71 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:57.598820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-661853b5-9152-4385-808a-a32f72d63a71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:20:57.724817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661853b5-9152-4385-808a-a32f72d63a71 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:57.737236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d7547-45da-4dc5-88bb-f222ba1ef630 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:57.738187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d7547-45da-4dc5-88bb-f222ba1ef630 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:57.738621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d7547-45da-4dc5-88bb-f222ba1ef630 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:57.739044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d7547-45da-4dc5-88bb-f222ba1ef630 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:57.749212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d7547-45da-4dc5-88bb-f222ba1ef630 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:57.751287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d7547-45da-4dc5-88bb-f222ba1ef630 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:57.771387 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1674/3304] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:20:57 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:20:59.223801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299b369-d8e7-4c72-8fc0-47507f4634d8 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:59.259040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6299b369-d8e7-4c72-8fc0-47507f4634d8 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:59.275773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5325ca-2c25-4793-961c-3080ff5d469c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:59.276504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5325ca-2c25-4793-961c-3080ff5d469c service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:59.276724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5325ca-2c25-4793-961c-3080ff5d469c service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:59.277003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5325ca-2c25-4793-961c-3080ff5d469c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:59.407928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5325ca-2c25-4793-961c-3080ff5d469c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:59.409871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5325ca-2c25-4793-961c-3080ff5d469c service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:59.428224 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1631/3305] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:20:59 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:20:59.466657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d7547-45da-4dc5-88bb-f222ba1ef630 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:20:59.610554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d7547-45da-4dc5-88bb-f222ba1ef630 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:20:59.617045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602281a-0f7d-4c2a-ac2f-18271e0b6ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:20:59.619036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602281a-0f7d-4c2a-ac2f-18271e0b6ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:20:59.620853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602281a-0f7d-4c2a-ac2f-18271e0b6ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:20:59.624175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602281a-0f7d-4c2a-ac2f-18271e0b6ee4 admin admin] PATH_INFO: `/v3/users/f046713aba294ff0b42446ccd05f2e06` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:20:59.627999 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602281a-0f7d-4c2a-ac2f-18271e0b6ee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f046713aba294ff0b42446ccd05f2e06)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:20:59.632548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602281a-0f7d-4c2a-ac2f-18271e0b6ee4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:20:59.649517 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:20:59.970612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7602281a-0f7d-4c2a-ac2f-18271e0b6ee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f046713aba294ff0b42446ccd05f2e06'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:00.001415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7602281a-0f7d-4c2a-ac2f-18271e0b6ee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f046713aba294ff0b42446ccd05f2e06'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:00.029241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7602281a-0f7d-4c2a-ac2f-18271e0b6ee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f046713aba294ff0b42446ccd05f2e06'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:00.032745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7602281a-0f7d-4c2a-ac2f-18271e0b6ee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f046713aba294ff0b42446ccd05f2e06'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:00.114902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7602281a-0f7d-4c2a-ac2f-18271e0b6ee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f046713aba294ff0b42446ccd05f2e06'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:00.124455 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1675/3306] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:20:59 2022] DELETE /identity/v3/users/f046713aba294ff0b42446ccd05f2e06 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:00.128982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a60088-f9af-4964-9ae0-df8e53f1a43c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:00.129292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a60088-f9af-4964-9ae0-df8e53f1a43c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:00.129583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a60088-f9af-4964-9ae0-df8e53f1a43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:00.180211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-16a60088-f9af-4964-9ae0-df8e53f1a43c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:00.181372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-16a60088-f9af-4964-9ae0-df8e53f1a43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:00.366612 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1632/3307] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:00.395900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602281a-0f7d-4c2a-ac2f-18271e0b6ee4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:00.397415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7602281a-0f7d-4c2a-ac2f-18271e0b6ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:00.556654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602281a-0f7d-4c2a-ac2f-18271e0b6ee4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:00.562767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e88a06-c954-4789-88ec-bb62f0411c14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:00.563654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e88a06-c954-4789-88ec-bb62f0411c14 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:00.564121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e88a06-c954-4789-88ec-bb62f0411c14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:00.564578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e88a06-c954-4789-88ec-bb62f0411c14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:00.593209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e88a06-c954-4789-88ec-bb62f0411c14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:00.598178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e88a06-c954-4789-88ec-bb62f0411c14 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:00.638151 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1676/3308] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:01.528162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a60088-f9af-4964-9ae0-df8e53f1a43c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:01.529719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-16a60088-f9af-4964-9ae0-df8e53f1a43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:01.573124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a60088-f9af-4964-9ae0-df8e53f1a43c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:01.575226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626ce4d-088c-43e8-ab7d-63d573470e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:01.576047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626ce4d-088c-43e8-ab7d-63d573470e12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:01.576245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626ce4d-088c-43e8-ab7d-63d573470e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:01.576884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626ce4d-088c-43e8-ab7d-63d573470e12 admin admin] PATH_INFO: `/v3/projects/e87200e4ce6d4557a3fa7d14fa5c4522` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:01.578568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626ce4d-088c-43e8-ab7d-63d573470e12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e87200e4ce6d4557a3fa7d14fa5c4522)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:01.580704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626ce4d-088c-43e8-ab7d-63d573470e12 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:01.625046 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:01.867501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d626ce4d-088c-43e8-ab7d-63d573470e12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e87200e4ce6d4557a3fa7d14fa5c4522', 'request_id': 'req-d626ce4d-088c-43e8-ab7d-63d573470e12'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:01.929095 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d626ce4d-088c-43e8-ab7d-63d573470e12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e87200e4ce6d4557a3fa7d14fa5c4522', 'request_id': 'req-d626ce4d-088c-43e8-ab7d-63d573470e12'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:01.947898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d626ce4d-088c-43e8-ab7d-63d573470e12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e87200e4ce6d4557a3fa7d14fa5c4522', 'request_id': 'req-d626ce4d-088c-43e8-ab7d-63d573470e12'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:01.979841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d626ce4d-088c-43e8-ab7d-63d573470e12 admin admin] The token cache is being invalidate because project e87200e4ce6d4557a3fa7d14fa5c4522 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:21:01.980797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d626ce4d-088c-43e8-ab7d-63d573470e12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:01.981964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d626ce4d-088c-43e8-ab7d-63d573470e12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:01.985961 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1633/3309] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:21:01 2022] DELETE /identity/v3/projects/e87200e4ce6d4557a3fa7d14fa5c4522 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:01.990202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e88a06-c954-4789-88ec-bb62f0411c14 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:02.001313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e88a06-c954-4789-88ec-bb62f0411c14 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:02.208776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9bf5b-4ea5-491b-9414-b540c59b5bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:02.210252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9bf5b-4ea5-491b-9414-b540c59b5bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:02.212516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9bf5b-4ea5-491b-9414-b540c59b5bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:02.218670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9bf5b-4ea5-491b-9414-b540c59b5bd0 admin admin] PATH_INFO: `/v3/users/1adf409150f846e6ae0ec1582ecbee3b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:02.233190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9bf5b-4ea5-491b-9414-b540c59b5bd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1adf409150f846e6ae0ec1582ecbee3b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:02.233190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed9bf5b-4ea5-491b-9414-b540c59b5bd0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:02.388909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626ce4d-088c-43e8-ab7d-63d573470e12 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:02.401384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d626ce4d-088c-43e8-ab7d-63d573470e12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:02.426741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626ce4d-088c-43e8-ab7d-63d573470e12 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:02.440380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db11b40-72cf-4915-ab3c-75910e3dd465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:02.442741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db11b40-72cf-4915-ab3c-75910e3dd465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:02.442741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db11b40-72cf-4915-ab3c-75910e3dd465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:02.442741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db11b40-72cf-4915-ab3c-75910e3dd465 admin admin] PATH_INFO: `/v3/users/865ff993f6a440d4a25b34daed8cd6ff` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:02.445456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db11b40-72cf-4915-ab3c-75910e3dd465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=865ff993f6a440d4a25b34daed8cd6ff)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:02.453211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db11b40-72cf-4915-ab3c-75910e3dd465 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:02.465494 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:02.497501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8ed9bf5b-4ea5-491b-9414-b540c59b5bd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1adf409150f846e6ae0ec1582ecbee3b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:02.525209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8ed9bf5b-4ea5-491b-9414-b540c59b5bd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1adf409150f846e6ae0ec1582ecbee3b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:02.537439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8ed9bf5b-4ea5-491b-9414-b540c59b5bd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1adf409150f846e6ae0ec1582ecbee3b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:02.544639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8ed9bf5b-4ea5-491b-9414-b540c59b5bd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1adf409150f846e6ae0ec1582ecbee3b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:02.633617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8ed9bf5b-4ea5-491b-9414-b540c59b5bd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1adf409150f846e6ae0ec1582ecbee3b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:02.644243 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1677/3310] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:21:01 2022] DELETE /identity/v3/users/1adf409150f846e6ae0ec1582ecbee3b => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:02.767514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1db11b40-72cf-4915-ab3c-75910e3dd465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '865ff993f6a440d4a25b34daed8cd6ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:02.801737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1db11b40-72cf-4915-ab3c-75910e3dd465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '865ff993f6a440d4a25b34daed8cd6ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:02.801737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1db11b40-72cf-4915-ab3c-75910e3dd465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '865ff993f6a440d4a25b34daed8cd6ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:02.802300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1db11b40-72cf-4915-ab3c-75910e3dd465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '865ff993f6a440d4a25b34daed8cd6ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:02.822904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1db11b40-72cf-4915-ab3c-75910e3dd465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '865ff993f6a440d4a25b34daed8cd6ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:02.921791 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1634/3311] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:21:02 2022] DELETE /identity/v3/users/865ff993f6a440d4a25b34daed8cd6ff => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:03.806793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9bf5b-4ea5-491b-9414-b540c59b5bd0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:03.808796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8ed9bf5b-4ea5-491b-9414-b540c59b5bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:03.957402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9bf5b-4ea5-491b-9414-b540c59b5bd0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:04.046470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20c1c8-66fa-46a1-b1ae-1f82ad10ae6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:04.047742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20c1c8-66fa-46a1-b1ae-1f82ad10ae6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:04.048232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20c1c8-66fa-46a1-b1ae-1f82ad10ae6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:04.048873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20c1c8-66fa-46a1-b1ae-1f82ad10ae6d admin admin] PATH_INFO: `/v3/projects/cca4d994dab34629b739d4870f887a84` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:04.050368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20c1c8-66fa-46a1-b1ae-1f82ad10ae6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cca4d994dab34629b739d4870f887a84)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:04.053644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc20c1c8-66fa-46a1-b1ae-1f82ad10ae6d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:04.259015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fc20c1c8-66fa-46a1-b1ae-1f82ad10ae6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cca4d994dab34629b739d4870f887a84', 'request_id': 'req-fc20c1c8-66fa-46a1-b1ae-1f82ad10ae6d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:04.273796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fc20c1c8-66fa-46a1-b1ae-1f82ad10ae6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cca4d994dab34629b739d4870f887a84', 'request_id': 'req-fc20c1c8-66fa-46a1-b1ae-1f82ad10ae6d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:04.275197 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:04.283877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db11b40-72cf-4915-ab3c-75910e3dd465 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:04.284587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fc20c1c8-66fa-46a1-b1ae-1f82ad10ae6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cca4d994dab34629b739d4870f887a84', 'request_id': 'req-fc20c1c8-66fa-46a1-b1ae-1f82ad10ae6d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:04.286712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1db11b40-72cf-4915-ab3c-75910e3dd465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:04.315774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db11b40-72cf-4915-ab3c-75910e3dd465 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:04.432965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4cafcc-9eb7-47b9-a3b0-1aeb476e4f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:04.436904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cafcc-9eb7-47b9-a3b0-1aeb476e4f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:04.436904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cafcc-9eb7-47b9-a3b0-1aeb476e4f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:04.437183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cafcc-9eb7-47b9-a3b0-1aeb476e4f1d admin admin] PATH_INFO: `/v3/users/2e8fc4623d924e09874d49f59572346a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:04.440322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fc20c1c8-66fa-46a1-b1ae-1f82ad10ae6d admin admin] The token cache is being invalidate because project cca4d994dab34629b739d4870f887a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:21:04.440625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fc20c1c8-66fa-46a1-b1ae-1f82ad10ae6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:04.442474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fc20c1c8-66fa-46a1-b1ae-1f82ad10ae6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:04.443455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4cafcc-9eb7-47b9-a3b0-1aeb476e4f1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e8fc4623d924e09874d49f59572346a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:04.445469 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1678/3312] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:21:03 2022] DELETE /identity/v3/projects/cca4d994dab34629b739d4870f887a84 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:04.446325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20c1c8-66fa-46a1-b1ae-1f82ad10ae6d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:04.449263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fc20c1c8-66fa-46a1-b1ae-1f82ad10ae6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:04.450779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4cafcc-9eb7-47b9-a3b0-1aeb476e4f1d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:04.472367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20c1c8-66fa-46a1-b1ae-1f82ad10ae6d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:04.476543 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:04.486529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a7149-9516-4ad2-9c42-92c9b88afbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:04.487662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a7149-9516-4ad2-9c42-92c9b88afbbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:04.487961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a7149-9516-4ad2-9c42-92c9b88afbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:04.488244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a7149-9516-4ad2-9c42-92c9b88afbbd admin admin] PATH_INFO: `/v3/projects/226aa7fd989645ac8029cda856ba3660` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:04.489485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a7149-9516-4ad2-9c42-92c9b88afbbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=226aa7fd989645ac8029cda856ba3660)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:04.491641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06a7149-9516-4ad2-9c42-92c9b88afbbd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:04.725543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c06a7149-9516-4ad2-9c42-92c9b88afbbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '226aa7fd989645ac8029cda856ba3660', 'request_id': 'req-c06a7149-9516-4ad2-9c42-92c9b88afbbd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:04.726027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5f4cafcc-9eb7-47b9-a3b0-1aeb476e4f1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e8fc4623d924e09874d49f59572346a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:04.745492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c06a7149-9516-4ad2-9c42-92c9b88afbbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '226aa7fd989645ac8029cda856ba3660', 'request_id': 'req-c06a7149-9516-4ad2-9c42-92c9b88afbbd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:04.751674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5f4cafcc-9eb7-47b9-a3b0-1aeb476e4f1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e8fc4623d924e09874d49f59572346a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:04.752625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5f4cafcc-9eb7-47b9-a3b0-1aeb476e4f1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e8fc4623d924e09874d49f59572346a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:04.753300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5f4cafcc-9eb7-47b9-a3b0-1aeb476e4f1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e8fc4623d924e09874d49f59572346a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:04.760299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c06a7149-9516-4ad2-9c42-92c9b88afbbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '226aa7fd989645ac8029cda856ba3660', 'request_id': 'req-c06a7149-9516-4ad2-9c42-92c9b88afbbd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:04.763491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5f4cafcc-9eb7-47b9-a3b0-1aeb476e4f1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e8fc4623d924e09874d49f59572346a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:04.853093 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1635/3313] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:21:04 2022] DELETE /identity/v3/users/2e8fc4623d924e09874d49f59572346a => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:04.857766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4cafcc-9eb7-47b9-a3b0-1aeb476e4f1d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:04.863051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5f4cafcc-9eb7-47b9-a3b0-1aeb476e4f1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:04.911677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c06a7149-9516-4ad2-9c42-92c9b88afbbd admin admin] The token cache is being invalidate because project 226aa7fd989645ac8029cda856ba3660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:21:04.911677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c06a7149-9516-4ad2-9c42-92c9b88afbbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:04.911677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c06a7149-9516-4ad2-9c42-92c9b88afbbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:04.916159 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1679/3314] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:21:04 2022] DELETE /identity/v3/projects/226aa7fd989645ac8029cda856ba3660 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:04.917981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f00e5-38e6-41a4-8a71-5f630518e194 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:04.920425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f00e5-38e6-41a4-8a71-5f630518e194 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:04.923753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f00e5-38e6-41a4-8a71-5f630518e194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:04.976466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f78f00e5-38e6-41a4-8a71-5f630518e194 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:04.977699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f78f00e5-38e6-41a4-8a71-5f630518e194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:05.069533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4cafcc-9eb7-47b9-a3b0-1aeb476e4f1d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:05.092102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc89d6-e65f-4579-9da9-554977266142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:05.094322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc89d6-e65f-4579-9da9-554977266142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:05.094611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc89d6-e65f-4579-9da9-554977266142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:05.094943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc89d6-e65f-4579-9da9-554977266142 admin admin] PATH_INFO: `/v3/users/4a8d83c4076b4aa4bb1eb6d3f70e0fc8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:05.099358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc89d6-e65f-4579-9da9-554977266142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a8d83c4076b4aa4bb1eb6d3f70e0fc8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:05.101604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc89d6-e65f-4579-9da9-554977266142 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:05.109359 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1680/3315] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:05.118037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7439e-f026-4e04-9fb5-261a9aa2f519 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:05.118359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7439e-f026-4e04-9fb5-261a9aa2f519 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:05.118700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7439e-f026-4e04-9fb5-261a9aa2f519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:05.176997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-47e7439e-f026-4e04-9fb5-261a9aa2f519 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:05.179305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-47e7439e-f026-4e04-9fb5-261a9aa2f519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:05.214380 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1681/3316] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:21:05.249554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7439e-f026-4e04-9fb5-261a9aa2f519 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:05.275385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7439e-f026-4e04-9fb5-261a9aa2f519 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:05.284092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93522657-2859-400d-9fa5-e42c5ff565f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:05.284926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93522657-2859-400d-9fa5-e42c5ff565f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:05.285200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93522657-2859-400d-9fa5-e42c5ff565f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:05.285516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93522657-2859-400d-9fa5-e42c5ff565f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:05.286508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93522657-2859-400d-9fa5-e42c5ff565f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:21:05.288185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93522657-2859-400d-9fa5-e42c5ff565f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:05.289845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93522657-2859-400d-9fa5-e42c5ff565f6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:05.314151 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1682/3317] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:21:05.319683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93522657-2859-400d-9fa5-e42c5ff565f6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:05.338449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93522657-2859-400d-9fa5-e42c5ff565f6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:05.358868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a4623-f986-4ea1-bca3-b337ec862401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:05.361507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a4623-f986-4ea1-bca3-b337ec862401 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:05.361795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a4623-f986-4ea1-bca3-b337ec862401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:05.362068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a4623-f986-4ea1-bca3-b337ec862401 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:05.367117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a4623-f986-4ea1-bca3-b337ec862401 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:05.369300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a4623-f986-4ea1-bca3-b337ec862401 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:05.377144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-46dc89d6-e65f-4579-9da9-554977266142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a8d83c4076b4aa4bb1eb6d3f70e0fc8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:05.400076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-46dc89d6-e65f-4579-9da9-554977266142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a8d83c4076b4aa4bb1eb6d3f70e0fc8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:05.401575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-46dc89d6-e65f-4579-9da9-554977266142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a8d83c4076b4aa4bb1eb6d3f70e0fc8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:05.402984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-46dc89d6-e65f-4579-9da9-554977266142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a8d83c4076b4aa4bb1eb6d3f70e0fc8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:05.414049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-46dc89d6-e65f-4579-9da9-554977266142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a8d83c4076b4aa4bb1eb6d3f70e0fc8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:05.523558 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1683/3318] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:21:05 2022] POST /identity/v3/projects => generated 397 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:21:05.527885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a4623-f986-4ea1-bca3-b337ec862401 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:05.531503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-225a4623-f986-4ea1-bca3-b337ec862401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:05.545380 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1636/3319] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:21:04 2022] DELETE /identity/v3/users/4a8d83c4076b4aa4bb1eb6d3f70e0fc8 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:05.593493 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:05.635746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a4623-f986-4ea1-bca3-b337ec862401 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:05.746347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a505ea9-1a80-4199-85a2-77a7544c17ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:05.747022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a505ea9-1a80-4199-85a2-77a7544c17ef admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:05.747318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a505ea9-1a80-4199-85a2-77a7544c17ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:05.747596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a505ea9-1a80-4199-85a2-77a7544c17ef admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:05.748303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a505ea9-1a80-4199-85a2-77a7544c17ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:05.750822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a505ea9-1a80-4199-85a2-77a7544c17ef admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:05.849097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc89d6-e65f-4579-9da9-554977266142 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:05.851092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-46dc89d6-e65f-4579-9da9-554977266142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:05.872447 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1684/3320] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:21:05 2022] POST /identity/v3/users => generated 299 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:21:05.877295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a505ea9-1a80-4199-85a2-77a7544c17ef admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:05.915179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a505ea9-1a80-4199-85a2-77a7544c17ef admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:05.917643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc89d6-e65f-4579-9da9-554977266142 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:05.922402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d25ad1-8441-4344-9fe6-7f0f4b47104c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:05.923223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d25ad1-8441-4344-9fe6-7f0f4b47104c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:05.923643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d25ad1-8441-4344-9fe6-7f0f4b47104c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:05.924017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d25ad1-8441-4344-9fe6-7f0f4b47104c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:05.924882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d25ad1-8441-4344-9fe6-7f0f4b47104c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:05.927253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d25ad1-8441-4344-9fe6-7f0f4b47104c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:05.931753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640c927-d6f7-451f-96d8-b14e6606f75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:05.933201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640c927-d6f7-451f-96d8-b14e6606f75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:05.936851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640c927-d6f7-451f-96d8-b14e6606f75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:05.937476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640c927-d6f7-451f-96d8-b14e6606f75e admin admin] PATH_INFO: `/v3/projects/6a016620a72e4a01879abfbf8f9fb98c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:05.943099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640c927-d6f7-451f-96d8-b14e6606f75e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a016620a72e4a01879abfbf8f9fb98c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:05.943299 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1685/3321] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:21:05.945462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c640c927-d6f7-451f-96d8-b14e6606f75e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:05.946879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d25ad1-8441-4344-9fe6-7f0f4b47104c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:05.958687 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:05.988436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d25ad1-8441-4344-9fe6-7f0f4b47104c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:06.035260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6aa5c-9ece-48a6-8956-8ffe9cd7d3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:06.048676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6aa5c-9ece-48a6-8956-8ffe9cd7d3e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:06.050294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6aa5c-9ece-48a6-8956-8ffe9cd7d3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:06.050828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6aa5c-9ece-48a6-8956-8ffe9cd7d3e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:06.052140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6aa5c-9ece-48a6-8956-8ffe9cd7d3e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:06.057034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6aa5c-9ece-48a6-8956-8ffe9cd7d3e7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:06.095288 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1686/3322] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:21:06.099407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6aa5c-9ece-48a6-8956-8ffe9cd7d3e7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:06.113821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6aa5c-9ece-48a6-8956-8ffe9cd7d3e7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:06.152821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c640c927-d6f7-451f-96d8-b14e6606f75e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a016620a72e4a01879abfbf8f9fb98c', 'request_id': 'req-c640c927-d6f7-451f-96d8-b14e6606f75e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:06.235047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff78c9-c319-485c-b5ba-9ddc59e25f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:06.236080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff78c9-c319-485c-b5ba-9ddc59e25f8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:06.236369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff78c9-c319-485c-b5ba-9ddc59e25f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:06.236645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff78c9-c319-485c-b5ba-9ddc59e25f8e admin admin] PATH_INFO: `/v3/projects/1a0b3107524f49f0a7baeb11f532c602/users/27e1ad83ad08491794838942e1c068d3/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:06.273535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c640c927-d6f7-451f-96d8-b14e6606f75e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a016620a72e4a01879abfbf8f9fb98c', 'request_id': 'req-c640c927-d6f7-451f-96d8-b14e6606f75e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:06.280365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff78c9-c319-485c-b5ba-9ddc59e25f8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a0b3107524f49f0a7baeb11f532c602, user_id=27e1ad83ad08491794838942e1c068d3, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:06.282992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c640c927-d6f7-451f-96d8-b14e6606f75e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a016620a72e4a01879abfbf8f9fb98c', 'request_id': 'req-c640c927-d6f7-451f-96d8-b14e6606f75e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:06.283727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff78c9-c319-485c-b5ba-9ddc59e25f8e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:06.319229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c640c927-d6f7-451f-96d8-b14e6606f75e admin admin] The token cache is being invalidate because project 6a016620a72e4a01879abfbf8f9fb98c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:21:06.319550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c640c927-d6f7-451f-96d8-b14e6606f75e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:06.323007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c640c927-d6f7-451f-96d8-b14e6606f75e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:06.336253 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1637/3323] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:21:05 2022] DELETE /identity/v3/projects/6a016620a72e4a01879abfbf8f9fb98c => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:21:06.337853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859516f2-ccc0-48a7-9f03-be9b1fa5f31c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:06.338181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859516f2-ccc0-48a7-9f03-be9b1fa5f31c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:06.338464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859516f2-ccc0-48a7-9f03-be9b1fa5f31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:06.388056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-859516f2-ccc0-48a7-9f03-be9b1fa5f31c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:06.389852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-859516f2-ccc0-48a7-9f03-be9b1fa5f31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:06.397975 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1687/3324] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:21:06 2022] PUT /identity/v3/projects/1a0b3107524f49f0a7baeb11f532c602/users/27e1ad83ad08491794838942e1c068d3/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:06.402818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562100e-b8ee-4ac9-8835-c24917eccba1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:06.403381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562100e-b8ee-4ac9-8835-c24917eccba1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:06.403879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562100e-b8ee-4ac9-8835-c24917eccba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:06.453182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1562100e-b8ee-4ac9-8835-c24917eccba1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:06.455601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1562100e-b8ee-4ac9-8835-c24917eccba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:06.526675 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:06.539791 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1638/3325] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:06.540848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859516f2-ccc0-48a7-9f03-be9b1fa5f31c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:06.547048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-859516f2-ccc0-48a7-9f03-be9b1fa5f31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:06.560906 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1688/3326] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:21:06.564130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fd8ff-d027-4601-a0d5-ce518f95b659 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:06.564431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fd8ff-d027-4601-a0d5-ce518f95b659 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:06.568766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fd8ff-d027-4601-a0d5-ce518f95b659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:06.574076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859516f2-ccc0-48a7-9f03-be9b1fa5f31c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:06.591160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8e897-d6c0-4462-b2f4-89622c37dd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:06.592086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8e897-d6c0-4462-b2f4-89622c37dd49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:06.592425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8e897-d6c0-4462-b2f4-89622c37dd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:06.592707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8e897-d6c0-4462-b2f4-89622c37dd49 admin admin] PATH_INFO: `/v3/projects/7c26eb8e51fe4d348cc3ef2f95249237` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:06.594450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8e897-d6c0-4462-b2f4-89622c37dd49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c26eb8e51fe4d348cc3ef2f95249237)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:06.596532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8e897-d6c0-4462-b2f4-89622c37dd49 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:06.631336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9d7fd8ff-d027-4601-a0d5-ce518f95b659 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:06.632553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9d7fd8ff-d027-4601-a0d5-ce518f95b659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:06.648864 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1689/3327] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:06.648864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fd8ff-d027-4601-a0d5-ce518f95b659 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:06.648864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9d7fd8ff-d027-4601-a0d5-ce518f95b659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:06.752418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1dc8e897-d6c0-4462-b2f4-89622c37dd49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c26eb8e51fe4d348cc3ef2f95249237', 'request_id': 'req-1dc8e897-d6c0-4462-b2f4-89622c37dd49'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:06.812872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fd8ff-d027-4601-a0d5-ce518f95b659 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:06.827937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1dc8e897-d6c0-4462-b2f4-89622c37dd49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c26eb8e51fe4d348cc3ef2f95249237', 'request_id': 'req-1dc8e897-d6c0-4462-b2f4-89622c37dd49'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:06.839553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1dc8e897-d6c0-4462-b2f4-89622c37dd49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c26eb8e51fe4d348cc3ef2f95249237', 'request_id': 'req-1dc8e897-d6c0-4462-b2f4-89622c37dd49'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:06.867616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1dc8e897-d6c0-4462-b2f4-89622c37dd49 admin admin] The token cache is being invalidate because project 7c26eb8e51fe4d348cc3ef2f95249237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:21:06.868235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1dc8e897-d6c0-4462-b2f4-89622c37dd49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:06.869468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1dc8e897-d6c0-4462-b2f4-89622c37dd49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:06.871664 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1639/3328] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:21:06 2022] DELETE /identity/v3/projects/7c26eb8e51fe4d348cc3ef2f95249237 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:06.875199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8e897-d6c0-4462-b2f4-89622c37dd49 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:06.883325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1dc8e897-d6c0-4462-b2f4-89622c37dd49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:06.924134 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:06.964870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479f442-ef70-4d7b-82c3-8eb920249a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:06.966568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479f442-ef70-4d7b-82c3-8eb920249a7b service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:06.967225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479f442-ef70-4d7b-82c3-8eb920249a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:06.967225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479f442-ef70-4d7b-82c3-8eb920249a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:06.972969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1479f442-ef70-4d7b-82c3-8eb920249a7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:07.023784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8e897-d6c0-4462-b2f4-89622c37dd49 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:07.039093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348399b2-c98b-4372-9a35-f8413d3557cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:07.039835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348399b2-c98b-4372-9a35-f8413d3557cd admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:07.040130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348399b2-c98b-4372-9a35-f8413d3557cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:07.040441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348399b2-c98b-4372-9a35-f8413d3557cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:07.041184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348399b2-c98b-4372-9a35-f8413d3557cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:21:07.041499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348399b2-c98b-4372-9a35-f8413d3557cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:07.043218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348399b2-c98b-4372-9a35-f8413d3557cd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:07.086174 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1640/3329] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:21:07.093252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479f442-ef70-4d7b-82c3-8eb920249a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:07.095089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479f442-ef70-4d7b-82c3-8eb920249a7b service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:07.095337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a72bb3-593a-4944-aab7-500a2b5e5ab3 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:07.095741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a72bb3-593a-4944-aab7-500a2b5e5ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:07.096188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a72bb3-593a-4944-aab7-500a2b5e5ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:07.106823 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1690/3330] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:07.107654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479f442-ef70-4d7b-82c3-8eb920249a7b service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:07.120942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479f442-ef70-4d7b-82c3-8eb920249a7b service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:07.126491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e1328-9403-43bb-b258-3d02db53f045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:07.127357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e1328-9403-43bb-b258-3d02db53f045 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:07.127603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e1328-9403-43bb-b258-3d02db53f045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:07.127912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e1328-9403-43bb-b258-3d02db53f045 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:07.128771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e1328-9403-43bb-b258-3d02db53f045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:07.130836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e1328-9403-43bb-b258-3d02db53f045 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:07.166830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-33a72bb3-593a-4944-aab7-500a2b5e5ab3 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:07.168168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-33a72bb3-593a-4944-aab7-500a2b5e5ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:07.200370 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1641/3331] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:07.209964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183b9cc-9f76-40e3-9c78-1130f5c0048c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:07.210488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183b9cc-9f76-40e3-9c78-1130f5c0048c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:07.210593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183b9cc-9f76-40e3-9c78-1130f5c0048c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:07.247653 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1691/3332] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:21:07 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:21:07.252521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e1328-9403-43bb-b258-3d02db53f045 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:07.263124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c183b9cc-9f76-40e3-9c78-1130f5c0048c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:07.265780 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:07.271408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c183b9cc-9f76-40e3-9c78-1130f5c0048c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:07.413103 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1642/3333] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:07.416963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183b9cc-9f76-40e3-9c78-1130f5c0048c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:07.444378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183b9cc-9f76-40e3-9c78-1130f5c0048c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:07.459778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9432774-41a6-4d2c-83c4-1541ad46566c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:07.461736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9432774-41a6-4d2c-83c4-1541ad46566c admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:07.461736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9432774-41a6-4d2c-83c4-1541ad46566c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:07.461736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9432774-41a6-4d2c-83c4-1541ad46566c admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:07.462495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9432774-41a6-4d2c-83c4-1541ad46566c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:21:07.462975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9432774-41a6-4d2c-83c4-1541ad46566c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:07.464827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9432774-41a6-4d2c-83c4-1541ad46566c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:07.469073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e1328-9403-43bb-b258-3d02db53f045 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:07.490028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb80b7-b60c-4f8d-8371-35ee79d62cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:07.490876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb80b7-b60c-4f8d-8371-35ee79d62cd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:07.491171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb80b7-b60c-4f8d-8371-35ee79d62cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:07.494614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb80b7-b60c-4f8d-8371-35ee79d62cd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:07.494614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb80b7-b60c-4f8d-8371-35ee79d62cd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:07.494614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eb80b7-b60c-4f8d-8371-35ee79d62cd9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:07.509920 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1643/3334] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:21:07.514057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9432774-41a6-4d2c-83c4-1541ad46566c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:07.535286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9432774-41a6-4d2c-83c4-1541ad46566c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:07.549196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cac03-2c31-48b5-b18b-d2645c1af8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:07.550150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cac03-2c31-48b5-b18b-d2645c1af8be admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:07.550579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cac03-2c31-48b5-b18b-d2645c1af8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:07.551023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cac03-2c31-48b5-b18b-d2645c1af8be admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:07.551869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cac03-2c31-48b5-b18b-d2645c1af8be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:07.554070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cac03-2c31-48b5-b18b-d2645c1af8be admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:07.656681 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1692/3335] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:21:07 2022] POST /identity/v3/users => generated 291 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:21:07.675012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb80b7-b60c-4f8d-8371-35ee79d62cd9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:07.691242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb80b7-b60c-4f8d-8371-35ee79d62cd9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:07.708422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822e0d6-712e-4859-9d11-3ab333d0d6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:07.709951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822e0d6-712e-4859-9d11-3ab333d0d6a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:07.710422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822e0d6-712e-4859-9d11-3ab333d0d6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:07.711069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822e0d6-712e-4859-9d11-3ab333d0d6a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:07.714717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822e0d6-712e-4859-9d11-3ab333d0d6a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:07.728562 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1644/3336] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:21:07 2022] POST /identity/v3/projects => generated 381 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:21:07.728879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822e0d6-712e-4859-9d11-3ab333d0d6a6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:07.729590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cac03-2c31-48b5-b18b-d2645c1af8be admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:07.746675 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1693/3337] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:21:07.750175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822e0d6-712e-4859-9d11-3ab333d0d6a6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:07.769266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822e0d6-712e-4859-9d11-3ab333d0d6a6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:07.886428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca12b80-48fc-44d2-b5ad-ce3fe06a59ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:07.887318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca12b80-48fc-44d2-b5ad-ce3fe06a59ca admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:07.887746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca12b80-48fc-44d2-b5ad-ce3fe06a59ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:07.888161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca12b80-48fc-44d2-b5ad-ce3fe06a59ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:07.889047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca12b80-48fc-44d2-b5ad-ce3fe06a59ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:07.893532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca12b80-48fc-44d2-b5ad-ce3fe06a59ca admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:07.898997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cac03-2c31-48b5-b18b-d2645c1af8be admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:07.911542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d58619-16bb-485e-b8b0-2e7c66884a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:07.912347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d58619-16bb-485e-b8b0-2e7c66884a3f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:07.912569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d58619-16bb-485e-b8b0-2e7c66884a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:07.912921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d58619-16bb-485e-b8b0-2e7c66884a3f admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:07.918149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d58619-16bb-485e-b8b0-2e7c66884a3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:07.918149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d58619-16bb-485e-b8b0-2e7c66884a3f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:07.923698 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1694/3338] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:21:07.946158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca12b80-48fc-44d2-b5ad-ce3fe06a59ca admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:07.979338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca12b80-48fc-44d2-b5ad-ce3fe06a59ca admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:07.994292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580345a8-46ca-4ee4-88c2-deee3c14306f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:07.995213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580345a8-46ca-4ee4-88c2-deee3c14306f admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:07.995495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580345a8-46ca-4ee4-88c2-deee3c14306f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:07.995941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580345a8-46ca-4ee4-88c2-deee3c14306f admin admin] PATH_INFO: `/v3/projects/8976f27d27f24d4a8f8ac4da9300a956/users/68dd6976fe754e4ab64acd9beb22d266/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:08.021085 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:08.028137 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1645/3339] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:21:07 2022] POST /identity/v3/users => generated 291 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:21:08.033441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d58619-16bb-485e-b8b0-2e7c66884a3f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:08.046249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580345a8-46ca-4ee4-88c2-deee3c14306f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8976f27d27f24d4a8f8ac4da9300a956, user_id=68dd6976fe754e4ab64acd9beb22d266, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:08.057768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d58619-16bb-485e-b8b0-2e7c66884a3f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:08.072184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580345a8-46ca-4ee4-88c2-deee3c14306f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:08.076063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc59943-ae1f-482e-9cac-abd981061286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:08.077381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc59943-ae1f-482e-9cac-abd981061286 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:08.077828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc59943-ae1f-482e-9cac-abd981061286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:08.078380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc59943-ae1f-482e-9cac-abd981061286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:08.078775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc59943-ae1f-482e-9cac-abd981061286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:08.088434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc59943-ae1f-482e-9cac-abd981061286 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:08.121859 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1646/3340] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:21:08.126622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc59943-ae1f-482e-9cac-abd981061286 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:08.147780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc59943-ae1f-482e-9cac-abd981061286 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:08.160547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b032ec-d8b8-4a24-a8fd-c197e8fef385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:08.161247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b032ec-d8b8-4a24-a8fd-c197e8fef385 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:08.161534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b032ec-d8b8-4a24-a8fd-c197e8fef385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:08.161813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b032ec-d8b8-4a24-a8fd-c197e8fef385 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:08.170874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b032ec-d8b8-4a24-a8fd-c197e8fef385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:08.170874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b032ec-d8b8-4a24-a8fd-c197e8fef385 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:08.171824 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1695/3341] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:21:07 2022] PUT /identity/v3/projects/8976f27d27f24d4a8f8ac4da9300a956/users/68dd6976fe754e4ab64acd9beb22d266/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:08.173803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576823d-7db2-42ec-9b84-c4abde5a1998 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:08.174473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576823d-7db2-42ec-9b84-c4abde5a1998 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:08.175159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576823d-7db2-42ec-9b84-c4abde5a1998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:08.207380 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1647/3342] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:21:08.208418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b032ec-d8b8-4a24-a8fd-c197e8fef385 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:08.224041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1576823d-7db2-42ec-9b84-c4abde5a1998 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:08.229306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1576823d-7db2-42ec-9b84-c4abde5a1998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:08.247687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b032ec-d8b8-4a24-a8fd-c197e8fef385 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:08.406706 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:08.434564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea93bad2-50af-4d7f-8d0a-e883ff50775d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:08.441875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93bad2-50af-4d7f-8d0a-e883ff50775d admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:08.442682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93bad2-50af-4d7f-8d0a-e883ff50775d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:08.443765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea93bad2-50af-4d7f-8d0a-e883ff50775d admin admin] PATH_INFO: `/v3/projects/de80bebab4ea4cf18c49ad91380a66fa/users/90af8a68166241fe90dafa006532f832/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:08.445534 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1696/3343] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:08.491768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93bad2-50af-4d7f-8d0a-e883ff50775d admin admin] RBAC: Authorizing `identity:create_grant(project_id=de80bebab4ea4cf18c49ad91380a66fa, user_id=90af8a68166241fe90dafa006532f832, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:08.499807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea93bad2-50af-4d7f-8d0a-e883ff50775d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:08.529734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576823d-7db2-42ec-9b84-c4abde5a1998 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:08.532900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1576823d-7db2-42ec-9b84-c4abde5a1998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:08.650114 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1648/3344] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:21:08 2022] PUT /identity/v3/projects/de80bebab4ea4cf18c49ad91380a66fa/users/90af8a68166241fe90dafa006532f832/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:08.660725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576823d-7db2-42ec-9b84-c4abde5a1998 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:08.661652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a95e1-6eed-4191-9470-4f0a33ac1c22 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:08.662062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a95e1-6eed-4191-9470-4f0a33ac1c22 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:08.662407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a95e1-6eed-4191-9470-4f0a33ac1c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:08.744097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096400ab-76ca-4f2a-83f7-e4d7e0171bac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:08.747738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096400ab-76ca-4f2a-83f7-e4d7e0171bac service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:08.748050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096400ab-76ca-4f2a-83f7-e4d7e0171bac service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:08.748312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9f0a95e1-6eed-4191-9470-4f0a33ac1c22 None None] MFA Rules not processed for user `90af8a68166241fe90dafa006532f832`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:08.748429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096400ab-76ca-4f2a-83f7-e4d7e0171bac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:08.752567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9f0a95e1-6eed-4191-9470-4f0a33ac1c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:08.868989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096400ab-76ca-4f2a-83f7-e4d7e0171bac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:08.871479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096400ab-76ca-4f2a-83f7-e4d7e0171bac service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:08.894446 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1697/3345] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:21:08.961473 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1649/3346] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:08.964021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096400ab-76ca-4f2a-83f7-e4d7e0171bac service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:08.980940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096400ab-76ca-4f2a-83f7-e4d7e0171bac service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:08.987738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736fb9b-70e2-451c-8ffe-078832f923ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:08.988684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736fb9b-70e2-451c-8ffe-078832f923ca admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:08.988980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736fb9b-70e2-451c-8ffe-078832f923ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:08.989261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5736fb9b-70e2-451c-8ffe-078832f923ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:08.990035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736fb9b-70e2-451c-8ffe-078832f923ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:08.992241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5736fb9b-70e2-451c-8ffe-078832f923ca admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:09.117608 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1698/3347] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:21:08 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:21:09.122910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a95e1-6eed-4191-9470-4f0a33ac1c22 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:09.147649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a95e1-6eed-4191-9470-4f0a33ac1c22 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:09.239768 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:09.253198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3792bd-5c73-43aa-9d9a-50e014f0dde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:09.253908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3792bd-5c73-43aa-9d9a-50e014f0dde7 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:09.254232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3792bd-5c73-43aa-9d9a-50e014f0dde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:09.255022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3792bd-5c73-43aa-9d9a-50e014f0dde7 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:09.255306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3792bd-5c73-43aa-9d9a-50e014f0dde7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:09.257703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3792bd-5c73-43aa-9d9a-50e014f0dde7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:09.400312 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1650/3348] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:21:09 2022] POST /identity/v3/users => generated 297 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:21:09.402007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736fb9b-70e2-451c-8ffe-078832f923ca admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:09.415193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5736fb9b-70e2-451c-8ffe-078832f923ca admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:09.421101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291099a-312e-4415-a360-0e5631325469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:09.430765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291099a-312e-4415-a360-0e5631325469 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:09.430765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291099a-312e-4415-a360-0e5631325469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:09.430765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291099a-312e-4415-a360-0e5631325469 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:09.430765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291099a-312e-4415-a360-0e5631325469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:09.430765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9291099a-312e-4415-a360-0e5631325469 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:09.455385 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1699/3349] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:21:09.458999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3792bd-5c73-43aa-9d9a-50e014f0dde7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:09.472482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3792bd-5c73-43aa-9d9a-50e014f0dde7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:09.491251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44489a7f-c666-4ebe-8de0-f790b12c9aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:09.494261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44489a7f-c666-4ebe-8de0-f790b12c9aea admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:09.495539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44489a7f-c666-4ebe-8de0-f790b12c9aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:09.495945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44489a7f-c666-4ebe-8de0-f790b12c9aea admin admin] PATH_INFO: `/v3/projects/43445dbacfcc4f8497fa3686358e4d81/users/8599593e2c6c4bf3ad8a2c6a7ed15d0a/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:09.527539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44489a7f-c666-4ebe-8de0-f790b12c9aea admin admin] RBAC: Authorizing `identity:create_grant(project_id=43445dbacfcc4f8497fa3686358e4d81, user_id=8599593e2c6c4bf3ad8a2c6a7ed15d0a, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:09.531462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44489a7f-c666-4ebe-8de0-f790b12c9aea admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:09.626822 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1651/3350] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:21:09 2022] PUT /identity/v3/projects/43445dbacfcc4f8497fa3686358e4d81/users/8599593e2c6c4bf3ad8a2c6a7ed15d0a/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:21:09.631084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291099a-312e-4415-a360-0e5631325469 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:09.648390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291099a-312e-4415-a360-0e5631325469 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:09.698139 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:09.757211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cb828-b33c-4db0-920d-94e2fa2711eb None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:09.757615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cb828-b33c-4db0-920d-94e2fa2711eb None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:09.757994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2cb828-b33c-4db0-920d-94e2fa2711eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:09.770969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982e053-612a-495f-8963-7b76bcdc57c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:09.771657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982e053-612a-495f-8963-7b76bcdc57c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:09.775854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982e053-612a-495f-8963-7b76bcdc57c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:09.775854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982e053-612a-495f-8963-7b76bcdc57c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:09.775854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982e053-612a-495f-8963-7b76bcdc57c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:09.778518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2982e053-612a-495f-8963-7b76bcdc57c3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:09.804655 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1700/3351] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:21:09.805850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982e053-612a-495f-8963-7b76bcdc57c3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:09.817120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8e2cb828-b33c-4db0-920d-94e2fa2711eb None None] MFA Rules not processed for user `cb444a9e01dc497ca9b8f3c1b65fe532`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:09.818471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8e2cb828-b33c-4db0-920d-94e2fa2711eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:09.832373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982e053-612a-495f-8963-7b76bcdc57c3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:09.841268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac833af-f73e-4ada-8751-262e10c6a998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:09.842717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac833af-f73e-4ada-8751-262e10c6a998 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:09.843134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac833af-f73e-4ada-8751-262e10c6a998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:09.843513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac833af-f73e-4ada-8751-262e10c6a998 admin admin] PATH_INFO: `/v3/projects/43445dbacfcc4f8497fa3686358e4d81/users/8599593e2c6c4bf3ad8a2c6a7ed15d0a/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:09.846335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac833af-f73e-4ada-8751-262e10c6a998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43445dbacfcc4f8497fa3686358e4d81, user_id=8599593e2c6c4bf3ad8a2c6a7ed15d0a, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:09.851739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac833af-f73e-4ada-8751-262e10c6a998 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:09.879662 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1701/3352] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:21:09 2022] PUT /identity/v3/projects/43445dbacfcc4f8497fa3686358e4d81/users/8599593e2c6c4bf3ad8a2c6a7ed15d0a/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:09.890928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d4c87-e5e3-4f41-9197-c729710f3b68 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:09.891324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d4c87-e5e3-4f41-9197-c729710f3b68 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:09.891820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d4c87-e5e3-4f41-9197-c729710f3b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:09.951366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7d0d4c87-e5e3-4f41-9197-c729710f3b68 None None] MFA Rules not processed for user `8599593e2c6c4bf3ad8a2c6a7ed15d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:09.956301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7d0d4c87-e5e3-4f41-9197-c729710f3b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:09.981360 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1652/3353] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:09.999574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cb828-b33c-4db0-920d-94e2fa2711eb None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:10.001795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8e2cb828-b33c-4db0-920d-94e2fa2711eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:10.071902 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1702/3354] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:21:10.211183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2cb828-b33c-4db0-920d-94e2fa2711eb None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:10.296133 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:10.345327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d4c87-e5e3-4f41-9197-c729710f3b68 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:10.347016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7d0d4c87-e5e3-4f41-9197-c729710f3b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:10.352259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a1ded-268b-4874-bffe-20e3fd605089 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:10.352938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a1ded-268b-4874-bffe-20e3fd605089 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:10.353478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a1ded-268b-4874-bffe-20e3fd605089 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:10.353810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a1ded-268b-4874-bffe-20e3fd605089 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:10.373277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d4c87-e5e3-4f41-9197-c729710f3b68 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:10.388758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab7c0a-0819-4039-8ef6-57341b3ec59b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:10.389730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab7c0a-0819-4039-8ef6-57341b3ec59b service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:10.390330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab7c0a-0819-4039-8ef6-57341b3ec59b service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:10.390330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab7c0a-0819-4039-8ef6-57341b3ec59b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:10.403573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab7c0a-0819-4039-8ef6-57341b3ec59b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:10.406156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab7c0a-0819-4039-8ef6-57341b3ec59b service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:10.417300 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1703/3355] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:10.433657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a1ded-268b-4874-bffe-20e3fd605089 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:10.433887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74951d3c-7157-41b1-844f-7deae1abb547 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:10.434175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74951d3c-7157-41b1-844f-7deae1abb547 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:10.434520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74951d3c-7157-41b1-844f-7deae1abb547 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:10.435287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a1ded-268b-4874-bffe-20e3fd605089 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:10.438120 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1704/3356] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:21:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 14:21:10.445551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74951d3c-7157-41b1-844f-7deae1abb547 None None] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:21:10.452254 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1653/3357] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:10.464463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74951d3c-7157-41b1-844f-7deae1abb547 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:10.499393 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74951d3c-7157-41b1-844f-7deae1abb547 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:10.501543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc881813-b328-41c9-85e0-9a9dc7d9467b tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8599593e2c6c4bf3ad8a2c6a7ed15d0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43445dbacfcc4f8497fa3686358e4d81', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:10.503227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc881813-b328-41c9-85e0-9a9dc7d9467b tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:10.503621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc881813-b328-41c9-85e0-9a9dc7d9467b tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:10.504001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc881813-b328-41c9-85e0-9a9dc7d9467b tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] PATH_INFO: `/v3/projects/de80bebab4ea4cf18c49ad91380a66fa` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:10.507832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc881813-b328-41c9-85e0-9a9dc7d9467b tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: Authorizing `identity:get_project(project_id=de80bebab4ea4cf18c49ad91380a66fa)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:10.512178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc881813-b328-41c9-85e0-9a9dc7d9467b tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:10.527056 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1705/3358] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:21:10 2022] GET /identity/v3/projects/de80bebab4ea4cf18c49ad91380a66fa => generated 381 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:21:10.768717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ed664-23ef-4b76-b621-0e3c1d5efebf None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:10.769301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ed664-23ef-4b76-b621-0e3c1d5efebf None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:10.769301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ed664-23ef-4b76-b621-0e3c1d5efebf None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:10.770845 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1654/3359] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:21:10.777250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc881813-b328-41c9-85e0-9a9dc7d9467b tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:21:10.805951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc881813-b328-41c9-85e0-9a9dc7d9467b tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:10.823168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc881813-b328-41c9-85e0-9a9dc7d9467b tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:10.829943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c7c0d-f2c3-41ea-be0d-63ee079ae921 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8599593e2c6c4bf3ad8a2c6a7ed15d0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43445dbacfcc4f8497fa3686358e4d81', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:10.831107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c7c0d-f2c3-41ea-be0d-63ee079ae921 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:10.832786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c7c0d-f2c3-41ea-be0d-63ee079ae921 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:10.833247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c7c0d-f2c3-41ea-be0d-63ee079ae921 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] PATH_INFO: `/v3/projects/de80bebab4ea4cf18c49ad91380a66fa` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:10.835382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c7c0d-f2c3-41ea-be0d-63ee079ae921 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: Authorizing `identity:get_project(project_id=de80bebab4ea4cf18c49ad91380a66fa)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:10.838170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c7c0d-f2c3-41ea-be0d-63ee079ae921 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:10.852318 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1706/3360] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:21:10 2022] GET /identity/v3/projects/de80bebab4ea4cf18c49ad91380a66fa => generated 381 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:21:11.042131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88be6b4-634a-4c63-afbb-3bf9c3d1a377 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:11.042131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88be6b4-634a-4c63-afbb-3bf9c3d1a377 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:11.042131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88be6b4-634a-4c63-afbb-3bf9c3d1a377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:11.073272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c88be6b4-634a-4c63-afbb-3bf9c3d1a377 None None] MFA Rules not processed for user `90af8a68166241fe90dafa006532f832`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:11.074708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c88be6b4-634a-4c63-afbb-3bf9c3d1a377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:11.224775 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1655/3361] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:11.440403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c7c0d-f2c3-41ea-be0d-63ee079ae921 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:11.456061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c7c0d-f2c3-41ea-be0d-63ee079ae921 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:11.462656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111214c-9d26-4061-a843-49f038854f56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:11.465375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111214c-9d26-4061-a843-49f038854f56 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:11.465840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111214c-9d26-4061-a843-49f038854f56 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:11.466467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b111214c-9d26-4061-a843-49f038854f56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:11.482467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111214c-9d26-4061-a843-49f038854f56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:11.485357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b111214c-9d26-4061-a843-49f038854f56 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:11.514213 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1707/3362] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:12.567257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11356a3-e972-46c9-8919-8be249449d7f None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:12.567821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11356a3-e972-46c9-8919-8be249449d7f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:12.567821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11356a3-e972-46c9-8919-8be249449d7f None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:12.570046 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1656/3363] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:21:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:21:12.575340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111214c-9d26-4061-a843-49f038854f56 service nova] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:21:12.595925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111214c-9d26-4061-a843-49f038854f56 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:12.615835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b111214c-9d26-4061-a843-49f038854f56 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:12.620402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc82559-3a1b-4592-af43-679e1ede9972 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8599593e2c6c4bf3ad8a2c6a7ed15d0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43445dbacfcc4f8497fa3686358e4d81', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:12.621826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc82559-3a1b-4592-af43-679e1ede9972 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:12.622369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc82559-3a1b-4592-af43-679e1ede9972 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:12.622877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc82559-3a1b-4592-af43-679e1ede9972 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] PATH_INFO: `/v3/projects/de80bebab4ea4cf18c49ad91380a66fa` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:12.625110 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc82559-3a1b-4592-af43-679e1ede9972 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: Authorizing `identity:get_project(project_id=de80bebab4ea4cf18c49ad91380a66fa)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:12.644342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc82559-3a1b-4592-af43-679e1ede9972 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:12.655371 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1708/3364] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:21:12 2022] GET /identity/v3/projects/de80bebab4ea4cf18c49ad91380a66fa => generated 381 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:21:12.999595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f4bdb-b3b3-4cee-9563-7f9ea982c632 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:13.000353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f4bdb-b3b3-4cee-9563-7f9ea982c632 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:13.001243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f4bdb-b3b3-4cee-9563-7f9ea982c632 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:13.003547 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1657/3365] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:21:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:21:13.008807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc82559-3a1b-4592-af43-679e1ede9972 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:21:13.040599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc82559-3a1b-4592-af43-679e1ede9972 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:13.060154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc82559-3a1b-4592-af43-679e1ede9972 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:13.091581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6571b27-b1ff-4215-a901-3c437ea55a35 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8599593e2c6c4bf3ad8a2c6a7ed15d0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43445dbacfcc4f8497fa3686358e4d81', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:13.093814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6571b27-b1ff-4215-a901-3c437ea55a35 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:13.094136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6571b27-b1ff-4215-a901-3c437ea55a35 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:13.094429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6571b27-b1ff-4215-a901-3c437ea55a35 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] PATH_INFO: `/v3/projects/de80bebab4ea4cf18c49ad91380a66fa` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:13.099293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6571b27-b1ff-4215-a901-3c437ea55a35 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: Authorizing `identity:get_project(project_id=de80bebab4ea4cf18c49ad91380a66fa)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:13.101957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6571b27-b1ff-4215-a901-3c437ea55a35 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:13.104503 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1709/3366] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:21:13 2022] GET /identity/v3/projects/de80bebab4ea4cf18c49ad91380a66fa => generated 381 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:21:13.184498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c51be-fc1d-4ccf-9329-9668ada2db65 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:13.184683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c51be-fc1d-4ccf-9329-9668ada2db65 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:13.184923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1c51be-fc1d-4ccf-9329-9668ada2db65 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:13.186695 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1658/3367] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:21:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:21:13.194495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6571b27-b1ff-4215-a901-3c437ea55a35 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:21:13.237799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6571b27-b1ff-4215-a901-3c437ea55a35 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:13.247340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6571b27-b1ff-4215-a901-3c437ea55a35 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:13.256287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b0181-8d87-48f6-b489-e38c793aa718 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8599593e2c6c4bf3ad8a2c6a7ed15d0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43445dbacfcc4f8497fa3686358e4d81', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:13.257890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b0181-8d87-48f6-b489-e38c793aa718 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:13.258549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b0181-8d87-48f6-b489-e38c793aa718 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:13.259153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b0181-8d87-48f6-b489-e38c793aa718 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] PATH_INFO: `/v3/projects/de80bebab4ea4cf18c49ad91380a66fa` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:13.261639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b0181-8d87-48f6-b489-e38c793aa718 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: Authorizing `identity:get_project(project_id=de80bebab4ea4cf18c49ad91380a66fa)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:13.265589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b0181-8d87-48f6-b489-e38c793aa718 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:13.269489 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1710/3368] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:21:13 2022] GET /identity/v3/projects/de80bebab4ea4cf18c49ad91380a66fa => generated 381 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:21:13.549846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da45a5-dd58-4ad1-85c8-59c3a4541165 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:13.550181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da45a5-dd58-4ad1-85c8-59c3a4541165 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:13.550465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da45a5-dd58-4ad1-85c8-59c3a4541165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:13.593776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e6da45a5-dd58-4ad1-85c8-59c3a4541165 None None] MFA Rules not processed for user `90af8a68166241fe90dafa006532f832`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:13.597849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e6da45a5-dd58-4ad1-85c8-59c3a4541165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:13.622357 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1659/3369] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:14.470539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947ccdb-eff7-424b-8991-a7a4d84a1f33 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:14.471091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947ccdb-eff7-424b-8991-a7a4d84a1f33 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:14.471496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947ccdb-eff7-424b-8991-a7a4d84a1f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:14.494524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1947ccdb-eff7-424b-8991-a7a4d84a1f33 None None] MFA Rules not processed for user `cb444a9e01dc497ca9b8f3c1b65fe532`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:14.496238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1947ccdb-eff7-424b-8991-a7a4d84a1f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:14.512127 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1711/3370] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:16.114922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d44963-2887-4810-9ffe-39d0b5c92891 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:16.115475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d44963-2887-4810-9ffe-39d0b5c92891 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:16.115475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d44963-2887-4810-9ffe-39d0b5c92891 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:16.116847 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1660/3371] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:21:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:21:16.130002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947ccdb-eff7-424b-8991-a7a4d84a1f33 None None] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:21:16.154440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947ccdb-eff7-424b-8991-a7a4d84a1f33 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:16.190968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947ccdb-eff7-424b-8991-a7a4d84a1f33 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:16.229907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34cff0-eb99-423f-a459-eff52b976f0e tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8599593e2c6c4bf3ad8a2c6a7ed15d0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43445dbacfcc4f8497fa3686358e4d81', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:16.230839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34cff0-eb99-423f-a459-eff52b976f0e tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:16.231299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34cff0-eb99-423f-a459-eff52b976f0e tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:16.231725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34cff0-eb99-423f-a459-eff52b976f0e tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] PATH_INFO: `/v3/projects/de80bebab4ea4cf18c49ad91380a66fa` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:16.234255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34cff0-eb99-423f-a459-eff52b976f0e tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: Authorizing `identity:get_project(project_id=de80bebab4ea4cf18c49ad91380a66fa)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:16.238394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34cff0-eb99-423f-a459-eff52b976f0e tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:16.254638 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1712/3372] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:21:16 2022] GET /identity/v3/projects/de80bebab4ea4cf18c49ad91380a66fa => generated 381 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:21:16.517064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39204d92-6577-4343-94d2-9fc146d3d931 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:16.517697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39204d92-6577-4343-94d2-9fc146d3d931 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:16.522265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39204d92-6577-4343-94d2-9fc146d3d931 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:16.522627 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1661/3373] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:21:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:21:16.532317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34cff0-eb99-423f-a459-eff52b976f0e tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:21:16.552023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34cff0-eb99-423f-a459-eff52b976f0e tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:16.584830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34cff0-eb99-423f-a459-eff52b976f0e tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:16.606920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913cb2a-f381-4ef4-b175-84ee3e280030 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8599593e2c6c4bf3ad8a2c6a7ed15d0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43445dbacfcc4f8497fa3686358e4d81', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:16.608461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913cb2a-f381-4ef4-b175-84ee3e280030 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:16.608750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913cb2a-f381-4ef4-b175-84ee3e280030 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:16.609035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913cb2a-f381-4ef4-b175-84ee3e280030 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] PATH_INFO: `/v3/projects/de80bebab4ea4cf18c49ad91380a66fa` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:16.617237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913cb2a-f381-4ef4-b175-84ee3e280030 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: Authorizing `identity:get_project(project_id=de80bebab4ea4cf18c49ad91380a66fa)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:16.619734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913cb2a-f381-4ef4-b175-84ee3e280030 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:16.630898 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1713/3374] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:21:16 2022] GET /identity/v3/projects/de80bebab4ea4cf18c49ad91380a66fa => generated 381 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:21:16.732542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2c379-b917-48c3-84b3-d1046062d2c8 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:16.733668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2c379-b917-48c3-84b3-d1046062d2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:16.734680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2c379-b917-48c3-84b3-d1046062d2c8 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:16.737180 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1662/3375] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:21:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:21:16.744105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913cb2a-f381-4ef4-b175-84ee3e280030 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:21:16.754185 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:16.766324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913cb2a-f381-4ef4-b175-84ee3e280030 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:16.794430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913cb2a-f381-4ef4-b175-84ee3e280030 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:16.803262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33edb1-f4dd-46fc-b0b7-13acaa138b16 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8599593e2c6c4bf3ad8a2c6a7ed15d0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43445dbacfcc4f8497fa3686358e4d81', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:16.804699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33edb1-f4dd-46fc-b0b7-13acaa138b16 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:16.806505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33edb1-f4dd-46fc-b0b7-13acaa138b16 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:16.806981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33edb1-f4dd-46fc-b0b7-13acaa138b16 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] PATH_INFO: `/v3/projects/de80bebab4ea4cf18c49ad91380a66fa` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:16.815528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33edb1-f4dd-46fc-b0b7-13acaa138b16 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: Authorizing `identity:get_project(project_id=de80bebab4ea4cf18c49ad91380a66fa)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:16.831860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca33edb1-f4dd-46fc-b0b7-13acaa138b16 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:16.839474 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1714/3376] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:21:16 2022] GET /identity/v3/projects/de80bebab4ea4cf18c49ad91380a66fa => generated 381 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:21:17.163690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c790058-5388-4a94-8cc9-acf2d3a1a1bd None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:17.165121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c790058-5388-4a94-8cc9-acf2d3a1a1bd None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:17.165550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c790058-5388-4a94-8cc9-acf2d3a1a1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:17.234347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2c790058-5388-4a94-8cc9-acf2d3a1a1bd None None] MFA Rules not processed for user `90af8a68166241fe90dafa006532f832`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:17.238767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2c790058-5388-4a94-8cc9-acf2d3a1a1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:17.266955 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1663/3377] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:18.697000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1748853-a2db-4462-863f-c37e4df36014 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:18.703360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1748853-a2db-4462-863f-c37e4df36014 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:18.703360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1748853-a2db-4462-863f-c37e4df36014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:18.759405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d1748853-a2db-4462-863f-c37e4df36014 None None] MFA Rules not processed for user `27e1ad83ad08491794838942e1c068d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:18.763937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d1748853-a2db-4462-863f-c37e4df36014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:18.875835 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1715/3378] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:18 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:18.888501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c790058-5388-4a94-8cc9-acf2d3a1a1bd None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:18.923339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c790058-5388-4a94-8cc9-acf2d3a1a1bd None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:18.927393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e21388-6f0f-438e-bd73-0b448cb9b3bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:18.928135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e21388-6f0f-438e-bd73-0b448cb9b3bd service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:18.928490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e21388-6f0f-438e-bd73-0b448cb9b3bd service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:18.928946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e21388-6f0f-438e-bd73-0b448cb9b3bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:18.952034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9265b09-d0fc-4076-ae9a-b2caaabe8378 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:18.957359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9265b09-d0fc-4076-ae9a-b2caaabe8378 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:18.957359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9265b09-d0fc-4076-ae9a-b2caaabe8378 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:18.957553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e21388-6f0f-438e-bd73-0b448cb9b3bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:18.958637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e21388-6f0f-438e-bd73-0b448cb9b3bd service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:18.964910 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1716/3379] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:21:18 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:21:18.971939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9265b09-d0fc-4076-ae9a-b2caaabe8378 None None] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:21:18.992072 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1664/3380] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:19.020590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9265b09-d0fc-4076-ae9a-b2caaabe8378 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:19.044287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9265b09-d0fc-4076-ae9a-b2caaabe8378 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:19.044744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef36be-a01b-41cf-a292-3e2fff640ab1 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8599593e2c6c4bf3ad8a2c6a7ed15d0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '43445dbacfcc4f8497fa3686358e4d81', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:19.046778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef36be-a01b-41cf-a292-3e2fff640ab1 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:19.047476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef36be-a01b-41cf-a292-3e2fff640ab1 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:19.047781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cef36be-a01b-41cf-a292-3e2fff640ab1 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] PATH_INFO: `/v3/projects/de80bebab4ea4cf18c49ad91380a66fa` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:19.049367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef36be-a01b-41cf-a292-3e2fff640ab1 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: Authorizing `identity:get_project(project_id=de80bebab4ea4cf18c49ad91380a66fa)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:19.055849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cef36be-a01b-41cf-a292-3e2fff640ab1 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:19.092310 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1717/3381] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:21:18 2022] GET /identity/v3/projects/de80bebab4ea4cf18c49ad91380a66fa => generated 381 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:21:19.197260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e21388-6f0f-438e-bd73-0b448cb9b3bd service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:19.200005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-38e21388-6f0f-438e-bd73-0b448cb9b3bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:19.352326 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:19.361512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e21388-6f0f-438e-bd73-0b448cb9b3bd service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:19.367184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa9fac-81e2-4030-92ea-2fbd50fa9912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:19.368492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa9fac-81e2-4030-92ea-2fbd50fa9912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:19.369221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa9fac-81e2-4030-92ea-2fbd50fa9912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:19.369720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa9fac-81e2-4030-92ea-2fbd50fa9912 admin admin] PATH_INFO: `/v3/users/117737d52c2f4eb69ab580150320d1a7` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:19.371446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa9fac-81e2-4030-92ea-2fbd50fa9912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=117737d52c2f4eb69ab580150320d1a7)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:19.374244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aa9fac-81e2-4030-92ea-2fbd50fa9912 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:19.544681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef36be-a01b-41cf-a292-3e2fff640ab1 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:19.557334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cef36be-a01b-41cf-a292-3e2fff640ab1 tempest-QuotasAdminNegativeTest-278181667 tempest-QuotasAdminNegativeTest-278181667-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:19.568290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf04457-a7cf-42b9-af25-0ef69c8cdeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:19.570828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf04457-a7cf-42b9-af25-0ef69c8cdeb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:19.571323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf04457-a7cf-42b9-af25-0ef69c8cdeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:19.571888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf04457-a7cf-42b9-af25-0ef69c8cdeb9 admin admin] PATH_INFO: `/v3/users/90af8a68166241fe90dafa006532f832` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:19.574836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf04457-a7cf-42b9-af25-0ef69c8cdeb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90af8a68166241fe90dafa006532f832)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:19.579865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf04457-a7cf-42b9-af25-0ef69c8cdeb9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:19.678394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e0aa9fac-81e2-4030-92ea-2fbd50fa9912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '117737d52c2f4eb69ab580150320d1a7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:19.696329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e0aa9fac-81e2-4030-92ea-2fbd50fa9912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '117737d52c2f4eb69ab580150320d1a7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:19.697269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e0aa9fac-81e2-4030-92ea-2fbd50fa9912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '117737d52c2f4eb69ab580150320d1a7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:19.702154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e0aa9fac-81e2-4030-92ea-2fbd50fa9912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '117737d52c2f4eb69ab580150320d1a7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:19.712076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e0aa9fac-81e2-4030-92ea-2fbd50fa9912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '117737d52c2f4eb69ab580150320d1a7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:19.790542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3cf04457-a7cf-42b9-af25-0ef69c8cdeb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90af8a68166241fe90dafa006532f832'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:19.819833 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1665/3382] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:21:19 2022] DELETE /identity/v3/users/117737d52c2f4eb69ab580150320d1a7 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:19.827077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3cf04457-a7cf-42b9-af25-0ef69c8cdeb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90af8a68166241fe90dafa006532f832'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:19.839428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3cf04457-a7cf-42b9-af25-0ef69c8cdeb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90af8a68166241fe90dafa006532f832'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:19.840191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3cf04457-a7cf-42b9-af25-0ef69c8cdeb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90af8a68166241fe90dafa006532f832'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:19.948673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3cf04457-a7cf-42b9-af25-0ef69c8cdeb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90af8a68166241fe90dafa006532f832'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:19.961683 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1718/3383] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:21:19 2022] DELETE /identity/v3/users/90af8a68166241fe90dafa006532f832 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:19.966829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc9ea9-27ac-4787-9e34-824fc88adc7d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:19.968263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc9ea9-27ac-4787-9e34-824fc88adc7d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:19.968263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc9ea9-27ac-4787-9e34-824fc88adc7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:20.004539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b1dc9ea9-27ac-4787-9e34-824fc88adc7d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:20.011896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b1dc9ea9-27ac-4787-9e34-824fc88adc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:20.186843 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1666/3384] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:20.200457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf04457-a7cf-42b9-af25-0ef69c8cdeb9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:20.203327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3cf04457-a7cf-42b9-af25-0ef69c8cdeb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:20.325754 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:20.340173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf04457-a7cf-42b9-af25-0ef69c8cdeb9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:20.366158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5c4e93-f074-487d-9de1-127a994a989f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:20.378542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c4e93-f074-487d-9de1-127a994a989f service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:20.396494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c4e93-f074-487d-9de1-127a994a989f service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:20.396494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5c4e93-f074-487d-9de1-127a994a989f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:20.416302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c4e93-f074-487d-9de1-127a994a989f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:20.418695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5c4e93-f074-487d-9de1-127a994a989f service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:20.478861 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1719/3385] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:21.110174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc9ea9-27ac-4787-9e34-824fc88adc7d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:21.110174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b1dc9ea9-27ac-4787-9e34-824fc88adc7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:21.132679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc9ea9-27ac-4787-9e34-824fc88adc7d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:21.143816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63e3ba-d0ed-4a3c-8f51-03d8901fd60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:21.147168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63e3ba-d0ed-4a3c-8f51-03d8901fd60a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:21.147677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63e3ba-d0ed-4a3c-8f51-03d8901fd60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:21.149146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63e3ba-d0ed-4a3c-8f51-03d8901fd60a admin admin] PATH_INFO: `/v3/projects/4aa297c2d82a44678b28657f6c41f1a7` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:21.150900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63e3ba-d0ed-4a3c-8f51-03d8901fd60a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aa297c2d82a44678b28657f6c41f1a7)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:21.156474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63e3ba-d0ed-4a3c-8f51-03d8901fd60a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:21.360151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9b63e3ba-d0ed-4a3c-8f51-03d8901fd60a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa297c2d82a44678b28657f6c41f1a7', 'request_id': 'req-9b63e3ba-d0ed-4a3c-8f51-03d8901fd60a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:21.450257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9b63e3ba-d0ed-4a3c-8f51-03d8901fd60a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa297c2d82a44678b28657f6c41f1a7', 'request_id': 'req-9b63e3ba-d0ed-4a3c-8f51-03d8901fd60a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:21.487241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9b63e3ba-d0ed-4a3c-8f51-03d8901fd60a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa297c2d82a44678b28657f6c41f1a7', 'request_id': 'req-9b63e3ba-d0ed-4a3c-8f51-03d8901fd60a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:21.527662 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:21.539037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9b63e3ba-d0ed-4a3c-8f51-03d8901fd60a admin admin] The token cache is being invalidate because project 4aa297c2d82a44678b28657f6c41f1a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:21:21.539371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9b63e3ba-d0ed-4a3c-8f51-03d8901fd60a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:21.540821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9b63e3ba-d0ed-4a3c-8f51-03d8901fd60a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:21.542880 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1667/3386] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:21:21 2022] DELETE /identity/v3/projects/4aa297c2d82a44678b28657f6c41f1a7 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:21.548621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e6d9c-09ab-4780-9f9d-0bc86aae7293 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:21.549571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e6d9c-09ab-4780-9f9d-0bc86aae7293 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:21.550008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817e6d9c-09ab-4780-9f9d-0bc86aae7293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:21.588625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-817e6d9c-09ab-4780-9f9d-0bc86aae7293 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:21.594751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-817e6d9c-09ab-4780-9f9d-0bc86aae7293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:21.715342 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1720/3387] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:21:21.724605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380eb0c-15be-4e31-b994-438fa0aafc2e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:21.725449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380eb0c-15be-4e31-b994-438fa0aafc2e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:21.725825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c380eb0c-15be-4e31-b994-438fa0aafc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:21.757972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c380eb0c-15be-4e31-b994-438fa0aafc2e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:21.761923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c380eb0c-15be-4e31-b994-438fa0aafc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:21.789518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e6d9c-09ab-4780-9f9d-0bc86aae7293 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:21.790727 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1668/3388] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:21.805005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817e6d9c-09ab-4780-9f9d-0bc86aae7293 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:21.821022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae8265-26b7-49e1-982d-0d3da18ba9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:21.821639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae8265-26b7-49e1-982d-0d3da18ba9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:21.824526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae8265-26b7-49e1-982d-0d3da18ba9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:21.824526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ae8265-26b7-49e1-982d-0d3da18ba9e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:21.824526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae8265-26b7-49e1-982d-0d3da18ba9e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:21:21.824526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae8265-26b7-49e1-982d-0d3da18ba9e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:21.835356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ae8265-26b7-49e1-982d-0d3da18ba9e5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:21.918834 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1721/3389] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:21:21.930545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380eb0c-15be-4e31-b994-438fa0aafc2e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:21.997888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c380eb0c-15be-4e31-b994-438fa0aafc2e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:22.016074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d09c6-3025-4751-9871-1f3f17fdf9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:22.017629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d09c6-3025-4751-9871-1f3f17fdf9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:22.018241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d09c6-3025-4751-9871-1f3f17fdf9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:22.018679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d09c6-3025-4751-9871-1f3f17fdf9e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:22.020469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d09c6-3025-4751-9871-1f3f17fdf9e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:22.032063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d09c6-3025-4751-9871-1f3f17fdf9e2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:22.189222 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1669/3390] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:21:21 2022] POST /identity/v3/projects => generated 365 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:21:22.191363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae8265-26b7-49e1-982d-0d3da18ba9e5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:22.208513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ae8265-26b7-49e1-982d-0d3da18ba9e5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:22.367846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8707091-bd26-407e-b8c8-2247f29bdbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:22.368600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8707091-bd26-407e-b8c8-2247f29bdbee admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:22.368892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8707091-bd26-407e-b8c8-2247f29bdbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:22.369166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8707091-bd26-407e-b8c8-2247f29bdbee admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:22.370735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8707091-bd26-407e-b8c8-2247f29bdbee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:22.377974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8707091-bd26-407e-b8c8-2247f29bdbee admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:22.527098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d09c6-3025-4751-9871-1f3f17fdf9e2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:22.529920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-663d09c6-3025-4751-9871-1f3f17fdf9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:22.558615 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1722/3391] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:21:22 2022] POST /identity/v3/users => generated 283 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:21:22.565046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8707091-bd26-407e-b8c8-2247f29bdbee admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:22.601908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d09c6-3025-4751-9871-1f3f17fdf9e2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:22.636714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8707091-bd26-407e-b8c8-2247f29bdbee admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:22.637762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b47dd-7169-4610-9ac2-c828662ad429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:22.643280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b47dd-7169-4610-9ac2-c828662ad429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:22.646616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b47dd-7169-4610-9ac2-c828662ad429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:22.660797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b47dd-7169-4610-9ac2-c828662ad429 admin admin] PATH_INFO: `/v3/projects/de80bebab4ea4cf18c49ad91380a66fa` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:22.662590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b47dd-7169-4610-9ac2-c828662ad429 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de80bebab4ea4cf18c49ad91380a66fa)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:22.665392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f70825-8447-4eae-97df-bad0585a6275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:22.667365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f70825-8447-4eae-97df-bad0585a6275 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:22.667658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f70825-8447-4eae-97df-bad0585a6275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:22.668040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456b47dd-7169-4610-9ac2-c828662ad429 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:22.669221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f70825-8447-4eae-97df-bad0585a6275 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:22.672463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f70825-8447-4eae-97df-bad0585a6275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:22.677188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f70825-8447-4eae-97df-bad0585a6275 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:22.704057 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1723/3392] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:21:22.707954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f70825-8447-4eae-97df-bad0585a6275 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:22.742947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f70825-8447-4eae-97df-bad0585a6275 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:22.760261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d19341-0d4c-438d-930a-07b075db3b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:22.762727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d19341-0d4c-438d-930a-07b075db3b3c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:22.763019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d19341-0d4c-438d-930a-07b075db3b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:22.763300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d19341-0d4c-438d-930a-07b075db3b3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:22.770274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d19341-0d4c-438d-930a-07b075db3b3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:22.773891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d19341-0d4c-438d-930a-07b075db3b3c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:22.798153 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1724/3393] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:21:22.800872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d19341-0d4c-438d-930a-07b075db3b3c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:22.814117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d19341-0d4c-438d-930a-07b075db3b3c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:22.819506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76393ffd-9698-4c46-a88d-303b2bb43193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:22.820656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76393ffd-9698-4c46-a88d-303b2bb43193 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:22.821048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76393ffd-9698-4c46-a88d-303b2bb43193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:22.821497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76393ffd-9698-4c46-a88d-303b2bb43193 admin admin] PATH_INFO: `/v3/projects/c26cdffe8258474bbc98b705b7eaca01/users/b1162c7e3ac04d04ae8bed46e0fe0f4f/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:22.843822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76393ffd-9698-4c46-a88d-303b2bb43193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c26cdffe8258474bbc98b705b7eaca01, user_id=b1162c7e3ac04d04ae8bed46e0fe0f4f, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:22.847112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76393ffd-9698-4c46-a88d-303b2bb43193 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:22.862457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-456b47dd-7169-4610-9ac2-c828662ad429 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de80bebab4ea4cf18c49ad91380a66fa', 'request_id': 'req-456b47dd-7169-4610-9ac2-c828662ad429'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:22.941305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-456b47dd-7169-4610-9ac2-c828662ad429 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de80bebab4ea4cf18c49ad91380a66fa', 'request_id': 'req-456b47dd-7169-4610-9ac2-c828662ad429'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:22.975217 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1725/3394] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:21:22 2022] PUT /identity/v3/projects/c26cdffe8258474bbc98b705b7eaca01/users/b1162c7e3ac04d04ae8bed46e0fe0f4f/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:22.977536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-456b47dd-7169-4610-9ac2-c828662ad429 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de80bebab4ea4cf18c49ad91380a66fa', 'request_id': 'req-456b47dd-7169-4610-9ac2-c828662ad429'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:22.984664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a0fce-6ee4-4c47-8335-5e1a26b25b00 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:22.988974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a0fce-6ee4-4c47-8335-5e1a26b25b00 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:22.989847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a0fce-6ee4-4c47-8335-5e1a26b25b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:23.025506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-456b47dd-7169-4610-9ac2-c828662ad429 admin admin] The token cache is being invalidate because project de80bebab4ea4cf18c49ad91380a66fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:21:23.027234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-456b47dd-7169-4610-9ac2-c828662ad429 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:23.030924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-456b47dd-7169-4610-9ac2-c828662ad429 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:23.035682 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1670/3395] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:21:22 2022] DELETE /identity/v3/projects/de80bebab4ea4cf18c49ad91380a66fa => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:23.042378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-607a0fce-6ee4-4c47-8335-5e1a26b25b00 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:23.043617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-607a0fce-6ee4-4c47-8335-5e1a26b25b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:23.043977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b47dd-7169-4610-9ac2-c828662ad429 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:23.047515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-456b47dd-7169-4610-9ac2-c828662ad429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:23.080091 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:23.185451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456b47dd-7169-4610-9ac2-c828662ad429 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:23.190722 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1726/3396] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:23.197501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9b10b8-7c0c-4ce3-a133-7c03be664c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:23.198867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b10b8-7c0c-4ce3-a133-7c03be664c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:23.199068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b10b8-7c0c-4ce3-a133-7c03be664c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:23.199217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9b10b8-7c0c-4ce3-a133-7c03be664c71 admin admin] PATH_INFO: `/v3/users/8599593e2c6c4bf3ad8a2c6a7ed15d0a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:23.200719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b10b8-7c0c-4ce3-a133-7c03be664c71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8599593e2c6c4bf3ad8a2c6a7ed15d0a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:23.208708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9b10b8-7c0c-4ce3-a133-7c03be664c71 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:23.227409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a0fce-6ee4-4c47-8335-5e1a26b25b00 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:23.234240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-607a0fce-6ee4-4c47-8335-5e1a26b25b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:23.465323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a0fce-6ee4-4c47-8335-5e1a26b25b00 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:23.471264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7d9b10b8-7c0c-4ce3-a133-7c03be664c71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8599593e2c6c4bf3ad8a2c6a7ed15d0a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:23.476079 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:23.479991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc704e6-ade7-4cf2-aae6-0cfd3e1c7adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:23.481826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc704e6-ade7-4cf2-aae6-0cfd3e1c7adc service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:23.484715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc704e6-ade7-4cf2-aae6-0cfd3e1c7adc service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:23.486319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc704e6-ade7-4cf2-aae6-0cfd3e1c7adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:23.507291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7d9b10b8-7c0c-4ce3-a133-7c03be664c71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8599593e2c6c4bf3ad8a2c6a7ed15d0a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:23.508632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7d9b10b8-7c0c-4ce3-a133-7c03be664c71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8599593e2c6c4bf3ad8a2c6a7ed15d0a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:23.509903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7d9b10b8-7c0c-4ce3-a133-7c03be664c71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8599593e2c6c4bf3ad8a2c6a7ed15d0a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:23.511027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc704e6-ade7-4cf2-aae6-0cfd3e1c7adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:23.516682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc704e6-ade7-4cf2-aae6-0cfd3e1c7adc service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:23.527838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7d9b10b8-7c0c-4ce3-a133-7c03be664c71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8599593e2c6c4bf3ad8a2c6a7ed15d0a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:23.544864 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1727/3397] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:23.638145 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1671/3398] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:21:23 2022] DELETE /identity/v3/users/8599593e2c6c4bf3ad8a2c6a7ed15d0a => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:25.164799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc704e6-ade7-4cf2-aae6-0cfd3e1c7adc service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:25.176809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc704e6-ade7-4cf2-aae6-0cfd3e1c7adc service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:25.392819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cded74a-eb5f-4190-94fa-adde82abea12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:25.392819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cded74a-eb5f-4190-94fa-adde82abea12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:25.392819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cded74a-eb5f-4190-94fa-adde82abea12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:25.392819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cded74a-eb5f-4190-94fa-adde82abea12 admin admin] PATH_INFO: `/v3/projects/43445dbacfcc4f8497fa3686358e4d81` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:25.394628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cded74a-eb5f-4190-94fa-adde82abea12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43445dbacfcc4f8497fa3686358e4d81)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:25.399066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cded74a-eb5f-4190-94fa-adde82abea12 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:25.632450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6cded74a-eb5f-4190-94fa-adde82abea12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43445dbacfcc4f8497fa3686358e4d81', 'request_id': 'req-6cded74a-eb5f-4190-94fa-adde82abea12'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:25.659190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6cded74a-eb5f-4190-94fa-adde82abea12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43445dbacfcc4f8497fa3686358e4d81', 'request_id': 'req-6cded74a-eb5f-4190-94fa-adde82abea12'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:25.679436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6cded74a-eb5f-4190-94fa-adde82abea12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43445dbacfcc4f8497fa3686358e4d81', 'request_id': 'req-6cded74a-eb5f-4190-94fa-adde82abea12'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:25.711576 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:25.846471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6cded74a-eb5f-4190-94fa-adde82abea12 admin admin] The token cache is being invalidate because project 43445dbacfcc4f8497fa3686358e4d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:21:25.846894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6cded74a-eb5f-4190-94fa-adde82abea12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:25.849907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6cded74a-eb5f-4190-94fa-adde82abea12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:25.852613 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1728/3399] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:21:25 2022] DELETE /identity/v3/projects/43445dbacfcc4f8497fa3686358e4d81 => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:25.861155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffac31d-fcaa-46ef-b729-300d46486f2c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:25.861612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffac31d-fcaa-46ef-b729-300d46486f2c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:25.867879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffac31d-fcaa-46ef-b729-300d46486f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:25.968096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1ffac31d-fcaa-46ef-b729-300d46486f2c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:25.969700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1ffac31d-fcaa-46ef-b729-300d46486f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:26.112199 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1672/3400] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:26.188961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915af19-340d-4ee6-85aa-b51f2646f6cb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:26.190234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915af19-340d-4ee6-85aa-b51f2646f6cb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:26.190234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7915af19-340d-4ee6-85aa-b51f2646f6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:26.225311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7915af19-340d-4ee6-85aa-b51f2646f6cb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:26.226861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7915af19-340d-4ee6-85aa-b51f2646f6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:26.239356 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1729/3401] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:26.240519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffac31d-fcaa-46ef-b729-300d46486f2c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:26.251991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffac31d-fcaa-46ef-b729-300d46486f2c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:26.257072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d7583-5bff-4307-b7c0-581180a84e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:26.257774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d7583-5bff-4307-b7c0-581180a84e35 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:26.258050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d7583-5bff-4307-b7c0-581180a84e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:26.258382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363d7583-5bff-4307-b7c0-581180a84e35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:26.259138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d7583-5bff-4307-b7c0-581180a84e35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:21:26.259441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d7583-5bff-4307-b7c0-581180a84e35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:26.261333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363d7583-5bff-4307-b7c0-581180a84e35 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:26.281419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915af19-340d-4ee6-85aa-b51f2646f6cb None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:26.287035 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1673/3402] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:21:26.291157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7915af19-340d-4ee6-85aa-b51f2646f6cb None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:26.296915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51cba4-cb02-4d67-953b-d62088ed0afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:26.297755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51cba4-cb02-4d67-953b-d62088ed0afc admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:26.298046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51cba4-cb02-4d67-953b-d62088ed0afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:26.298352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51cba4-cb02-4d67-953b-d62088ed0afc admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:26.299074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51cba4-cb02-4d67-953b-d62088ed0afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:26.301009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51cba4-cb02-4d67-953b-d62088ed0afc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:26.415834 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1730/3403] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:21:26 2022] POST /identity/v3/projects => generated 397 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:21:26.419925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d7583-5bff-4307-b7c0-581180a84e35 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:26.436271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363d7583-5bff-4307-b7c0-581180a84e35 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:26.637957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9800bd9-cad4-4a1a-9b53-23bb105eb023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:26.638333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9800bd9-cad4-4a1a-9b53-23bb105eb023 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:26.638733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9800bd9-cad4-4a1a-9b53-23bb105eb023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:26.639146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9800bd9-cad4-4a1a-9b53-23bb105eb023 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:26.639961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9800bd9-cad4-4a1a-9b53-23bb105eb023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:26.644234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9800bd9-cad4-4a1a-9b53-23bb105eb023 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:26.786621 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1674/3404] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:21:26 2022] POST /identity/v3/users => generated 299 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:21:26.790363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51cba4-cb02-4d67-953b-d62088ed0afc admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:26.819463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51cba4-cb02-4d67-953b-d62088ed0afc admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:26.841044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd616d9-dfb5-4a50-a1c6-c6abef6ee998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:26.841878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd616d9-dfb5-4a50-a1c6-c6abef6ee998 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:26.843701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd616d9-dfb5-4a50-a1c6-c6abef6ee998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:26.844060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd616d9-dfb5-4a50-a1c6-c6abef6ee998 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:26.845049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd616d9-dfb5-4a50-a1c6-c6abef6ee998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:26.846872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd616d9-dfb5-4a50-a1c6-c6abef6ee998 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:26.889541 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1731/3405] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:21:26.895659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9800bd9-cad4-4a1a-9b53-23bb105eb023 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:26.911084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9800bd9-cad4-4a1a-9b53-23bb105eb023 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:26.920080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b655d05-4b0b-4b3c-8a3c-5c224923e443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:26.923682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b655d05-4b0b-4b3c-8a3c-5c224923e443 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:26.923682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b655d05-4b0b-4b3c-8a3c-5c224923e443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:26.923682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b655d05-4b0b-4b3c-8a3c-5c224923e443 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:26.923682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b655d05-4b0b-4b3c-8a3c-5c224923e443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:26.926537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b655d05-4b0b-4b3c-8a3c-5c224923e443 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:26.959211 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1675/3406] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:21:26.960281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd616d9-dfb5-4a50-a1c6-c6abef6ee998 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:26.980564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd616d9-dfb5-4a50-a1c6-c6abef6ee998 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:26.993699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbfa6a-892a-469e-8867-e3ffd6a141eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:26.994715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbfa6a-892a-469e-8867-e3ffd6a141eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:26.994990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbfa6a-892a-469e-8867-e3ffd6a141eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:26.995270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdbfa6a-892a-469e-8867-e3ffd6a141eb admin admin] PATH_INFO: `/v3/projects/7341c97f88114f2e84e22aa8435f06f7/users/a4c1c7070bd14c42a301a525690004e4/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:27.027851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbfa6a-892a-469e-8867-e3ffd6a141eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7341c97f88114f2e84e22aa8435f06f7, user_id=a4c1c7070bd14c42a301a525690004e4, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:27.034828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdbfa6a-892a-469e-8867-e3ffd6a141eb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:27.114899 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1732/3407] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:21:26 2022] PUT /identity/v3/projects/7341c97f88114f2e84e22aa8435f06f7/users/a4c1c7070bd14c42a301a525690004e4/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:27.125357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37ed87-9c32-4a7a-9ea5-f8b9e364ab34 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:27.126767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37ed87-9c32-4a7a-9ea5-f8b9e364ab34 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:27.127655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a37ed87-9c32-4a7a-9ea5-f8b9e364ab34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:27.161644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9a37ed87-9c32-4a7a-9ea5-f8b9e364ab34 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:27.162592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9a37ed87-9c32-4a7a-9ea5-f8b9e364ab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:27.202544 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:27.335411 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1676/3408] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:27.373713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbfa6a-892a-469e-8867-e3ffd6a141eb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:27.375811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3fdbfa6a-892a-469e-8867-e3ffd6a141eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:27.480478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdbfa6a-892a-469e-8867-e3ffd6a141eb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:27.484450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc11e6-c6ca-49ec-bec8-8e29ffef7f2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:27.485121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc11e6-c6ca-49ec-bec8-8e29ffef7f2f service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:27.485615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc11e6-c6ca-49ec-bec8-8e29ffef7f2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:27.485964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc11e6-c6ca-49ec-bec8-8e29ffef7f2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:27.508926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc11e6-c6ca-49ec-bec8-8e29ffef7f2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:27.524302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc11e6-c6ca-49ec-bec8-8e29ffef7f2f service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:27.543219 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1733/3409] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:28.464354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37ed87-9c32-4a7a-9ea5-f8b9e364ab34 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:28.466586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9a37ed87-9c32-4a7a-9ea5-f8b9e364ab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:28.495179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a37ed87-9c32-4a7a-9ea5-f8b9e364ab34 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:28.501457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c14f17-72b2-446d-83a8-17ccefe83eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:28.502665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c14f17-72b2-446d-83a8-17ccefe83eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:28.503131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c14f17-72b2-446d-83a8-17ccefe83eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:28.503608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c14f17-72b2-446d-83a8-17ccefe83eec admin admin] PATH_INFO: `/v3/users/5fb93b17457e4e6b81ce3e6d79750903` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:28.505182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c14f17-72b2-446d-83a8-17ccefe83eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fb93b17457e4e6b81ce3e6d79750903)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:28.509755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c14f17-72b2-446d-83a8-17ccefe83eec admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:28.622249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01e4ee-7fdc-440c-b570-de0ca93ec55f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:28.622732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01e4ee-7fdc-440c-b570-de0ca93ec55f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:28.622809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01e4ee-7fdc-440c-b570-de0ca93ec55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:28.683124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7f01e4ee-7fdc-440c-b570-de0ca93ec55f None None] MFA Rules not processed for user `68dd6976fe754e4ab64acd9beb22d266`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:28.686934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7f01e4ee-7fdc-440c-b570-de0ca93ec55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:28.860340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-07c14f17-72b2-446d-83a8-17ccefe83eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fb93b17457e4e6b81ce3e6d79750903'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:28.864769 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1734/3410] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:28.877922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c5a1f-733a-439f-9ecb-48cf40c4f5eb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:28.878248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c5a1f-733a-439f-9ecb-48cf40c4f5eb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:28.878520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-07c14f17-72b2-446d-83a8-17ccefe83eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fb93b17457e4e6b81ce3e6d79750903'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:28.878857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c5a1f-733a-439f-9ecb-48cf40c4f5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:28.879361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-07c14f17-72b2-446d-83a8-17ccefe83eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fb93b17457e4e6b81ce3e6d79750903'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:28.880254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-07c14f17-72b2-446d-83a8-17ccefe83eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fb93b17457e4e6b81ce3e6d79750903'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:28.889426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-07c14f17-72b2-446d-83a8-17ccefe83eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fb93b17457e4e6b81ce3e6d79750903'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:28.914603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f69c5a1f-733a-439f-9ecb-48cf40c4f5eb None None] MFA Rules not processed for user `68dd6976fe754e4ab64acd9beb22d266`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:28.914603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f69c5a1f-733a-439f-9ecb-48cf40c4f5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:28.925449 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1735/3411] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:28.943105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c5a1f-733a-439f-9ecb-48cf40c4f5eb None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:28.944915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f69c5a1f-733a-439f-9ecb-48cf40c4f5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:28.969441 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:28.971881 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1677/3412] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:21:28 2022] DELETE /identity/v3/users/5fb93b17457e4e6b81ce3e6d79750903 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:29.101673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c5a1f-733a-439f-9ecb-48cf40c4f5eb None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:29.250962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb9d6b-0d5a-469d-9f23-19af5e072d29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:29.251645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb9d6b-0d5a-469d-9f23-19af5e072d29 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:29.251933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb9d6b-0d5a-469d-9f23-19af5e072d29 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:29.252214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fb9d6b-0d5a-469d-9f23-19af5e072d29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:29.256351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-72fb9d6b-0d5a-469d-9f23-19af5e072d29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:29.386588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb9d6b-0d5a-469d-9f23-19af5e072d29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:29.388520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fb9d6b-0d5a-469d-9f23-19af5e072d29 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:29.408656 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1736/3413] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:21:29.469496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c14f17-72b2-446d-83a8-17ccefe83eec admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:29.471017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-07c14f17-72b2-446d-83a8-17ccefe83eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:29.667045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c14f17-72b2-446d-83a8-17ccefe83eec admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:29.679563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc7f65-2c41-4cf0-8c40-7942eb94ff03 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:29.680255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc7f65-2c41-4cf0-8c40-7942eb94ff03 service glance] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:29.680545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc7f65-2c41-4cf0-8c40-7942eb94ff03 service glance] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:29.680826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc7f65-2c41-4cf0-8c40-7942eb94ff03 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:29.685202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-73bc7f65-2c41-4cf0-8c40-7942eb94ff03 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:29.721489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc7f65-2c41-4cf0-8c40-7942eb94ff03 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:29.721489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc7f65-2c41-4cf0-8c40-7942eb94ff03 service glance] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:29.756673 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1678/3414] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:30.016424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb9d6b-0d5a-469d-9f23-19af5e072d29 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:30.019889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-72fb9d6b-0d5a-469d-9f23-19af5e072d29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:30.203363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fb9d6b-0d5a-469d-9f23-19af5e072d29 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:30.217286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f1e92-cda3-494a-92a2-1174f598acb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:30.221897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f1e92-cda3-494a-92a2-1174f598acb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:30.222213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f1e92-cda3-494a-92a2-1174f598acb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:30.225560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f1e92-cda3-494a-92a2-1174f598acb7 admin admin] PATH_INFO: `/v3/projects/553bef746c2a4abc8c043aea8ca991e4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:30.230179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f1e92-cda3-494a-92a2-1174f598acb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=553bef746c2a4abc8c043aea8ca991e4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:30.231580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f1e92-cda3-494a-92a2-1174f598acb7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:30.436517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-667f1e92-cda3-494a-92a2-1174f598acb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '553bef746c2a4abc8c043aea8ca991e4', 'request_id': 'req-667f1e92-cda3-494a-92a2-1174f598acb7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:30.466788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-667f1e92-cda3-494a-92a2-1174f598acb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '553bef746c2a4abc8c043aea8ca991e4', 'request_id': 'req-667f1e92-cda3-494a-92a2-1174f598acb7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:30.489319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-667f1e92-cda3-494a-92a2-1174f598acb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '553bef746c2a4abc8c043aea8ca991e4', 'request_id': 'req-667f1e92-cda3-494a-92a2-1174f598acb7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:30.559838 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:30.598866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-667f1e92-cda3-494a-92a2-1174f598acb7 admin admin] The token cache is being invalidate because project 553bef746c2a4abc8c043aea8ca991e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:21:30.599231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-667f1e92-cda3-494a-92a2-1174f598acb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:30.600167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-667f1e92-cda3-494a-92a2-1174f598acb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:30.603353 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1737/3415] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:21:30 2022] DELETE /identity/v3/projects/553bef746c2a4abc8c043aea8ca991e4 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:30.612109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b448e0-3d49-4348-ac4b-33cf9cb2ed93 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:30.612109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b448e0-3d49-4348-ac4b-33cf9cb2ed93 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:30.612109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b448e0-3d49-4348-ac4b-33cf9cb2ed93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:30.649101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c4b448e0-3d49-4348-ac4b-33cf9cb2ed93 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:30.658257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c4b448e0-3d49-4348-ac4b-33cf9cb2ed93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:30.719172 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:30.835624 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1679/3416] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:30.844718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc57d1-908f-4171-add5-fd50272ab62f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:30.845509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc57d1-908f-4171-add5-fd50272ab62f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:30.845920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc57d1-908f-4171-add5-fd50272ab62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:30.881598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-38cc57d1-908f-4171-add5-fd50272ab62f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:30.883037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-38cc57d1-908f-4171-add5-fd50272ab62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:30.902124 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1738/3417] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:30.907345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b448e0-3d49-4348-ac4b-33cf9cb2ed93 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:30.925899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b448e0-3d49-4348-ac4b-33cf9cb2ed93 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:30.937344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8943c-170b-4406-a971-dfc3083fa059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:30.938390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8943c-170b-4406-a971-dfc3083fa059 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:30.938833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8943c-170b-4406-a971-dfc3083fa059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:30.939268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba8943c-170b-4406-a971-dfc3083fa059 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:30.940204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba8943c-170b-4406-a971-dfc3083fa059 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:21:30.942126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba8943c-170b-4406-a971-dfc3083fa059 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:30.942622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba8943c-170b-4406-a971-dfc3083fa059 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:30.975871 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1680/3418] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:21:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:21:30.980572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc57d1-908f-4171-add5-fd50272ab62f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:31.000135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc57d1-908f-4171-add5-fd50272ab62f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:31.018406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a7603-f529-43c4-a939-22433a24690d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:31.019771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a7603-f529-43c4-a939-22433a24690d admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:31.020304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a7603-f529-43c4-a939-22433a24690d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:31.020934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a7603-f529-43c4-a939-22433a24690d admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:31.022564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a7603-f529-43c4-a939-22433a24690d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:31.024760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a7603-f529-43c4-a939-22433a24690d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:31.171558 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1739/3419] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:21:30 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:21:31.176040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8943c-170b-4406-a971-dfc3083fa059 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:31.194927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba8943c-170b-4406-a971-dfc3083fa059 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:31.405309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ac252-2ab5-47f4-838f-554c72f1b03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:31.406128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ac252-2ab5-47f4-838f-554c72f1b03f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:31.406482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ac252-2ab5-47f4-838f-554c72f1b03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:31.407127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2ac252-2ab5-47f4-838f-554c72f1b03f admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:31.407867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ac252-2ab5-47f4-838f-554c72f1b03f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:31.411912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2ac252-2ab5-47f4-838f-554c72f1b03f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:31.435177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a7603-f529-43c4-a939-22433a24690d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:31.437092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-389a7603-f529-43c4-a939-22433a24690d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:31.527590 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1681/3420] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:21:31 2022] POST /identity/v3/users => generated 293 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:21:31.528890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ac252-2ab5-47f4-838f-554c72f1b03f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:31.552725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2ac252-2ab5-47f4-838f-554c72f1b03f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:31.563176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6951da-3aa7-48ae-a403-b01b21f02e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:31.563884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6951da-3aa7-48ae-a403-b01b21f02e75 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:31.564162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6951da-3aa7-48ae-a403-b01b21f02e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:31.564444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6951da-3aa7-48ae-a403-b01b21f02e75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:31.565247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6951da-3aa7-48ae-a403-b01b21f02e75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:31.566898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6951da-3aa7-48ae-a403-b01b21f02e75 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:31.567490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a7603-f529-43c4-a939-22433a24690d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:31.571627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c691b520-7056-4433-9407-ba119ffc982a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:31.572463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691b520-7056-4433-9407-ba119ffc982a service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:31.572894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691b520-7056-4433-9407-ba119ffc982a service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:31.573359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c691b520-7056-4433-9407-ba119ffc982a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:31.576679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c691b520-7056-4433-9407-ba119ffc982a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:31.605485 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1682/3421] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:21:31.606517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6951da-3aa7-48ae-a403-b01b21f02e75 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:31.635315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6951da-3aa7-48ae-a403-b01b21f02e75 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:31.661060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c2658-f949-4b33-882f-c51abe808211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:31.663661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c2658-f949-4b33-882f-c51abe808211 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:31.664118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c2658-f949-4b33-882f-c51abe808211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:31.669680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9c2658-f949-4b33-882f-c51abe808211 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:31.669680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c2658-f949-4b33-882f-c51abe808211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:31.669680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9c2658-f949-4b33-882f-c51abe808211 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:31.733531 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1683/3422] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:21:31 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:21:31.738544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c2658-f949-4b33-882f-c51abe808211 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:31.759908 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:31.775021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691b520-7056-4433-9407-ba119ffc982a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:31.776662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c691b520-7056-4433-9407-ba119ffc982a service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:31.776834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9c2658-f949-4b33-882f-c51abe808211 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:31.796323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8253386-2921-45b1-8d67-aa5b53f8efd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:31.798274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8253386-2921-45b1-8d67-aa5b53f8efd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:31.798718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8253386-2921-45b1-8d67-aa5b53f8efd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:31.799192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8253386-2921-45b1-8d67-aa5b53f8efd9 admin admin] PATH_INFO: `/v3/projects/b96080b2953f4fb086a9e077e9a2998a/users/422a87b2c32043daa4631c90a612b9ea/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:31.802528 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1740/3423] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:31.830888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8253386-2921-45b1-8d67-aa5b53f8efd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b96080b2953f4fb086a9e077e9a2998a, user_id=422a87b2c32043daa4631c90a612b9ea, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:31.835015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8253386-2921-45b1-8d67-aa5b53f8efd9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:31.928300 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1684/3424] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:21:31 2022] PUT /identity/v3/projects/b96080b2953f4fb086a9e077e9a2998a/users/422a87b2c32043daa4631c90a612b9ea/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:31.933986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd851254-c1b2-472a-aa38-f4f5b317ceb4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:31.934356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd851254-c1b2-472a-aa38-f4f5b317ceb4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:31.934580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd851254-c1b2-472a-aa38-f4f5b317ceb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:31.988110 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-dd851254-c1b2-472a-aa38-f4f5b317ceb4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:31.989449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dd851254-c1b2-472a-aa38-f4f5b317ceb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:32.200922 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1741/3425] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:21:32.333571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8253386-2921-45b1-8d67-aa5b53f8efd9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:32.466383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8253386-2921-45b1-8d67-aa5b53f8efd9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:32.481639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7130c55-1266-419f-98d5-42dd58331992 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:32.481854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7130c55-1266-419f-98d5-42dd58331992 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:32.482317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7130c55-1266-419f-98d5-42dd58331992 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:32.482837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7130c55-1266-419f-98d5-42dd58331992 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:32.498992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7130c55-1266-419f-98d5-42dd58331992 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:32.500520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7130c55-1266-419f-98d5-42dd58331992 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:32.509183 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:32.520601 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1685/3426] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:33.010548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd851254-c1b2-472a-aa38-f4f5b317ceb4 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:33.010548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dd851254-c1b2-472a-aa38-f4f5b317ceb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:33.195426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd851254-c1b2-472a-aa38-f4f5b317ceb4 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:33.213734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f930fd22-148c-4c1a-b28f-89baf53cbc98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:33.214849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930fd22-148c-4c1a-b28f-89baf53cbc98 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:33.215252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930fd22-148c-4c1a-b28f-89baf53cbc98 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:33.215626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f930fd22-148c-4c1a-b28f-89baf53cbc98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:33.228432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f930fd22-148c-4c1a-b28f-89baf53cbc98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:33.250365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930fd22-148c-4c1a-b28f-89baf53cbc98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:33.254898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f930fd22-148c-4c1a-b28f-89baf53cbc98 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:33.282492 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1742/3427] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:33.615703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7130c55-1266-419f-98d5-42dd58331992 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:33.617929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d7130c55-1266-419f-98d5-42dd58331992 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:33.644553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7130c55-1266-419f-98d5-42dd58331992 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:33.654389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058e18a-c92e-4c36-b49b-a5b4f6bfa6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:33.656343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058e18a-c92e-4c36-b49b-a5b4f6bfa6db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:33.656796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058e18a-c92e-4c36-b49b-a5b4f6bfa6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:33.657708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058e18a-c92e-4c36-b49b-a5b4f6bfa6db admin admin] PATH_INFO: `/v3/users/4e74d74ca11f4813b9b9a8630790b29c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:33.659432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058e18a-c92e-4c36-b49b-a5b4f6bfa6db admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e74d74ca11f4813b9b9a8630790b29c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:33.661817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058e18a-c92e-4c36-b49b-a5b4f6bfa6db admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:33.952375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c058e18a-c92e-4c36-b49b-a5b4f6bfa6db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e74d74ca11f4813b9b9a8630790b29c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:33.969160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c058e18a-c92e-4c36-b49b-a5b4f6bfa6db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e74d74ca11f4813b9b9a8630790b29c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:33.970606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c058e18a-c92e-4c36-b49b-a5b4f6bfa6db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e74d74ca11f4813b9b9a8630790b29c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:33.971978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c058e18a-c92e-4c36-b49b-a5b4f6bfa6db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e74d74ca11f4813b9b9a8630790b29c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:33.981873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c058e18a-c92e-4c36-b49b-a5b4f6bfa6db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e74d74ca11f4813b9b9a8630790b29c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:34.080722 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1686/3428] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:21:33 2022] DELETE /identity/v3/users/4e74d74ca11f4813b9b9a8630790b29c => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:34.085368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2ebe5-ee21-44c8-a460-6a1a432e1464 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:34.085660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2ebe5-ee21-44c8-a460-6a1a432e1464 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:34.085935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f2ebe5-ee21-44c8-a460-6a1a432e1464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:34.118316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-65f2ebe5-ee21-44c8-a460-6a1a432e1464 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:34.119763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-65f2ebe5-ee21-44c8-a460-6a1a432e1464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:34.190385 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1743/3429] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:34.199158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058e18a-c92e-4c36-b49b-a5b4f6bfa6db admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:34.200605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c058e18a-c92e-4c36-b49b-a5b4f6bfa6db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:34.303290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058e18a-c92e-4c36-b49b-a5b4f6bfa6db admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:34.318419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecabbcd-f3c6-41d1-8cdf-8abc446999c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:34.319119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecabbcd-f3c6-41d1-8cdf-8abc446999c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:34.319405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecabbcd-f3c6-41d1-8cdf-8abc446999c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:34.319690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecabbcd-f3c6-41d1-8cdf-8abc446999c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:34.345368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecabbcd-f3c6-41d1-8cdf-8abc446999c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:34.346877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecabbcd-f3c6-41d1-8cdf-8abc446999c9 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:34.364847 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1687/3430] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:35.345780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2ebe5-ee21-44c8-a460-6a1a432e1464 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:35.347297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-65f2ebe5-ee21-44c8-a460-6a1a432e1464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:35.380028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f2ebe5-ee21-44c8-a460-6a1a432e1464 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:35.408290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11fd25-ee32-49af-b081-7d5a401ca1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:35.413412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11fd25-ee32-49af-b081-7d5a401ca1a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:35.414230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11fd25-ee32-49af-b081-7d5a401ca1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:35.417173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed11fd25-ee32-49af-b081-7d5a401ca1a6 admin admin] PATH_INFO: `/v3/projects/7be0d52fd266445caf0abddf2141b3ed` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:35.419786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11fd25-ee32-49af-b081-7d5a401ca1a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7be0d52fd266445caf0abddf2141b3ed)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:35.423425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed11fd25-ee32-49af-b081-7d5a401ca1a6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:35.493978 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:35.651254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ed11fd25-ee32-49af-b081-7d5a401ca1a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7be0d52fd266445caf0abddf2141b3ed', 'request_id': 'req-ed11fd25-ee32-49af-b081-7d5a401ca1a6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:35.680156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ed11fd25-ee32-49af-b081-7d5a401ca1a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7be0d52fd266445caf0abddf2141b3ed', 'request_id': 'req-ed11fd25-ee32-49af-b081-7d5a401ca1a6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:35.698081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ed11fd25-ee32-49af-b081-7d5a401ca1a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7be0d52fd266445caf0abddf2141b3ed', 'request_id': 'req-ed11fd25-ee32-49af-b081-7d5a401ca1a6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:35.819374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ed11fd25-ee32-49af-b081-7d5a401ca1a6 admin admin] The token cache is being invalidate because project 7be0d52fd266445caf0abddf2141b3ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:21:35.819374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ed11fd25-ee32-49af-b081-7d5a401ca1a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:35.819810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ed11fd25-ee32-49af-b081-7d5a401ca1a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:35.825637 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1744/3431] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:21:35 2022] DELETE /identity/v3/projects/7be0d52fd266445caf0abddf2141b3ed => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:35.828285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecabbcd-f3c6-41d1-8cdf-8abc446999c9 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:35.843740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecabbcd-f3c6-41d1-8cdf-8abc446999c9 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:35.994431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47f59c8-902b-4944-95ac-9c06a3c9d5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:35.995946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f59c8-902b-4944-95ac-9c06a3c9d5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:35.996252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f59c8-902b-4944-95ac-9c06a3c9d5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:35.996592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47f59c8-902b-4944-95ac-9c06a3c9d5c9 admin admin] PATH_INFO: `/v3/users/c35554c5eb1c4339a3041ffe6b6493aa` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:35.998024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f59c8-902b-4944-95ac-9c06a3c9d5c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c35554c5eb1c4339a3041ffe6b6493aa)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:36.001281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47f59c8-902b-4944-95ac-9c06a3c9d5c9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:36.037810 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:36.253388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e47f59c8-902b-4944-95ac-9c06a3c9d5c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c35554c5eb1c4339a3041ffe6b6493aa'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:36.292613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e47f59c8-902b-4944-95ac-9c06a3c9d5c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c35554c5eb1c4339a3041ffe6b6493aa'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:36.293397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e47f59c8-902b-4944-95ac-9c06a3c9d5c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c35554c5eb1c4339a3041ffe6b6493aa'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:36.294027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e47f59c8-902b-4944-95ac-9c06a3c9d5c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c35554c5eb1c4339a3041ffe6b6493aa'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:36.313106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e47f59c8-902b-4944-95ac-9c06a3c9d5c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c35554c5eb1c4339a3041ffe6b6493aa'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:36.396760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11fd25-ee32-49af-b081-7d5a401ca1a6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:36.402289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ed11fd25-ee32-49af-b081-7d5a401ca1a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:36.426881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed11fd25-ee32-49af-b081-7d5a401ca1a6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:36.432079 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1688/3432] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:21:35 2022] DELETE /identity/v3/users/c35554c5eb1c4339a3041ffe6b6493aa => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:36.438841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d40a7-817d-48ec-808b-46cf01d98859 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:36.439127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d40a7-817d-48ec-808b-46cf01d98859 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:36.439415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733d40a7-817d-48ec-808b-46cf01d98859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:36.487768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-733d40a7-817d-48ec-808b-46cf01d98859 None None] MFA Rules not processed for user `422a87b2c32043daa4631c90a612b9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:36.489161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-733d40a7-817d-48ec-808b-46cf01d98859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:36.562281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ba965-835c-4b58-ae82-dfdc4fa618be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:36.563189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ba965-835c-4b58-ae82-dfdc4fa618be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:36.563477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ba965-835c-4b58-ae82-dfdc4fa618be admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:36.563757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ba965-835c-4b58-ae82-dfdc4fa618be admin admin] PATH_INFO: `/v3/users/27e1ad83ad08491794838942e1c068d3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:36.568176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ba965-835c-4b58-ae82-dfdc4fa618be admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e1ad83ad08491794838942e1c068d3)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:36.570444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ba965-835c-4b58-ae82-dfdc4fa618be admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:36.603323 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1689/3433] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:36.613260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56e122-81e1-430b-b630-c7b09fa8196d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:36.613997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56e122-81e1-430b-b630-c7b09fa8196d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:36.614633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56e122-81e1-430b-b630-c7b09fa8196d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:36.659607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0a56e122-81e1-430b-b630-c7b09fa8196d None None] MFA Rules not processed for user `422a87b2c32043daa4631c90a612b9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:36.661413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0a56e122-81e1-430b-b630-c7b09fa8196d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:36.688207 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1690/3434] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:21:36.698599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb790a-cbcc-4afb-8a43-edb5fab41eb4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:36.699413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb790a-cbcc-4afb-8a43-edb5fab41eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:36.699536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb790a-cbcc-4afb-8a43-edb5fab41eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:36.736901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-23cb790a-cbcc-4afb-8a43-edb5fab41eb4 None None] MFA Rules not processed for user `422a87b2c32043daa4631c90a612b9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:36.738876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-23cb790a-cbcc-4afb-8a43-edb5fab41eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:36.750199 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1691/3435] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:36.849191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6c8ba965-835c-4b58-ae82-dfdc4fa618be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e1ad83ad08491794838942e1c068d3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:36.872550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6c8ba965-835c-4b58-ae82-dfdc4fa618be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e1ad83ad08491794838942e1c068d3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:36.888448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6c8ba965-835c-4b58-ae82-dfdc4fa618be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e1ad83ad08491794838942e1c068d3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:36.890051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6c8ba965-835c-4b58-ae82-dfdc4fa618be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e1ad83ad08491794838942e1c068d3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:36.983138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6c8ba965-835c-4b58-ae82-dfdc4fa618be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e1ad83ad08491794838942e1c068d3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:36.994866 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1745/3436] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:21:36 2022] DELETE /identity/v3/users/27e1ad83ad08491794838942e1c068d3 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:21:37.169749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb790a-cbcc-4afb-8a43-edb5fab41eb4 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:37.171572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-23cb790a-cbcc-4afb-8a43-edb5fab41eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:37.332637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb790a-cbcc-4afb-8a43-edb5fab41eb4 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:37.452846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5287fc-ad47-431b-b9d4-d50695993c84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:37.453533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5287fc-ad47-431b-b9d4-d50695993c84 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:37.454316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5287fc-ad47-431b-b9d4-d50695993c84 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:37.454316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5287fc-ad47-431b-b9d4-d50695993c84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:37.457461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5c5287fc-ad47-431b-b9d4-d50695993c84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:37.620610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5287fc-ad47-431b-b9d4-d50695993c84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:37.629464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5287fc-ad47-431b-b9d4-d50695993c84 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:37.664011 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1692/3437] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:37.774695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ba965-835c-4b58-ae82-dfdc4fa618be admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:37.776670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6c8ba965-835c-4b58-ae82-dfdc4fa618be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:37.816380 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:37.854757 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:37.925754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ba965-835c-4b58-ae82-dfdc4fa618be admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:37.931339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43753808-3999-4df3-97a0-94645946a1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:37.932411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43753808-3999-4df3-97a0-94645946a1cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:37.932799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43753808-3999-4df3-97a0-94645946a1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:37.933199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43753808-3999-4df3-97a0-94645946a1cb admin admin] PATH_INFO: `/v3/projects/f4f52eb1cb164071900a39135a8bba77` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:37.934726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43753808-3999-4df3-97a0-94645946a1cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4f52eb1cb164071900a39135a8bba77)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:37.938048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43753808-3999-4df3-97a0-94645946a1cb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:38.098715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-43753808-3999-4df3-97a0-94645946a1cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4f52eb1cb164071900a39135a8bba77', 'request_id': 'req-43753808-3999-4df3-97a0-94645946a1cb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:38.105313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-43753808-3999-4df3-97a0-94645946a1cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4f52eb1cb164071900a39135a8bba77', 'request_id': 'req-43753808-3999-4df3-97a0-94645946a1cb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:38.114915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-43753808-3999-4df3-97a0-94645946a1cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4f52eb1cb164071900a39135a8bba77', 'request_id': 'req-43753808-3999-4df3-97a0-94645946a1cb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:38.200815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5287fc-ad47-431b-b9d4-d50695993c84 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:38.202472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5c5287fc-ad47-431b-b9d4-d50695993c84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:38.204801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-43753808-3999-4df3-97a0-94645946a1cb admin admin] The token cache is being invalidate because project f4f52eb1cb164071900a39135a8bba77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:21:38.206013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-43753808-3999-4df3-97a0-94645946a1cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:38.208759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-43753808-3999-4df3-97a0-94645946a1cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:38.215738 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1746/3438] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:21:37 2022] DELETE /identity/v3/projects/f4f52eb1cb164071900a39135a8bba77 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:38.225262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd333c5-246b-4393-bc09-660b4cdbad24 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:38.226728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd333c5-246b-4393-bc09-660b4cdbad24 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:38.228555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd333c5-246b-4393-bc09-660b4cdbad24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:38.236630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5287fc-ad47-431b-b9d4-d50695993c84 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:38.275598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9cd333c5-246b-4393-bc09-660b4cdbad24 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:38.283539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9cd333c5-246b-4393-bc09-660b4cdbad24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:38.419400 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1747/3439] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:38.420759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd333c5-246b-4393-bc09-660b4cdbad24 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:38.430489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9cd333c5-246b-4393-bc09-660b4cdbad24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:38.448450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cbb2bd-e00a-424b-aea5-98dbb445655b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:38.452573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cbb2bd-e00a-424b-aea5-98dbb445655b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:38.457725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cbb2bd-e00a-424b-aea5-98dbb445655b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:38.460674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cbb2bd-e00a-424b-aea5-98dbb445655b admin admin] PATH_INFO: `/v3/projects/1a0b3107524f49f0a7baeb11f532c602` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:38.462493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cbb2bd-e00a-424b-aea5-98dbb445655b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a0b3107524f49f0a7baeb11f532c602)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:38.467570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cbb2bd-e00a-424b-aea5-98dbb445655b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:38.572845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd333c5-246b-4393-bc09-660b4cdbad24 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:38.577865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3089740f-6ddd-415d-a725-6a36e8419d36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:38.578830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089740f-6ddd-415d-a725-6a36e8419d36 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:38.579364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089740f-6ddd-415d-a725-6a36e8419d36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:38.579846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3089740f-6ddd-415d-a725-6a36e8419d36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:38.581983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3089740f-6ddd-415d-a725-6a36e8419d36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:38.596250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089740f-6ddd-415d-a725-6a36e8419d36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:38.598111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3089740f-6ddd-415d-a725-6a36e8419d36 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:38.611011 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1748/3440] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:38.612723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d20d6-244a-4307-98ea-3778c5381504 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:38.613221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d20d6-244a-4307-98ea-3778c5381504 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:38.613736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d20d6-244a-4307-98ea-3778c5381504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:38.679800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1e9d20d6-244a-4307-98ea-3778c5381504 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:38.681911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1e9d20d6-244a-4307-98ea-3778c5381504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:38.683861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6cbb2bd-e00a-424b-aea5-98dbb445655b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a0b3107524f49f0a7baeb11f532c602', 'request_id': 'req-f6cbb2bd-e00a-424b-aea5-98dbb445655b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:38.768016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6cbb2bd-e00a-424b-aea5-98dbb445655b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a0b3107524f49f0a7baeb11f532c602', 'request_id': 'req-f6cbb2bd-e00a-424b-aea5-98dbb445655b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:38.772585 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1749/3441] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:38.777950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d20d6-244a-4307-98ea-3778c5381504 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:38.778548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6cbb2bd-e00a-424b-aea5-98dbb445655b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a0b3107524f49f0a7baeb11f532c602', 'request_id': 'req-f6cbb2bd-e00a-424b-aea5-98dbb445655b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:38.787223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d20d6-244a-4307-98ea-3778c5381504 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:38.795930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16604410-cb99-4c4d-b028-82332ffd2344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:38.796910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16604410-cb99-4c4d-b028-82332ffd2344 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:38.799953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16604410-cb99-4c4d-b028-82332ffd2344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:38.800412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16604410-cb99-4c4d-b028-82332ffd2344 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:38.801333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16604410-cb99-4c4d-b028-82332ffd2344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:21:38.801823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16604410-cb99-4c4d-b028-82332ffd2344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:38.804650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16604410-cb99-4c4d-b028-82332ffd2344 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:38.818222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6cbb2bd-e00a-424b-aea5-98dbb445655b admin admin] The token cache is being invalidate because project 1a0b3107524f49f0a7baeb11f532c602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:21:38.818222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6cbb2bd-e00a-424b-aea5-98dbb445655b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:38.819978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6cbb2bd-e00a-424b-aea5-98dbb445655b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:38.821909 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1693/3442] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:21:38 2022] DELETE /identity/v3/projects/1a0b3107524f49f0a7baeb11f532c602 => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:21:38.829186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a8aa6-c5f5-4284-8646-d5aa9cf1ee1e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:38.829362 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1750/3443] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:21:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:21:38.829902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a8aa6-c5f5-4284-8646-d5aa9cf1ee1e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:38.830405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a8aa6-c5f5-4284-8646-d5aa9cf1ee1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:38.830533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16604410-cb99-4c4d-b028-82332ffd2344 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:38.834915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-16604410-cb99-4c4d-b028-82332ffd2344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:38.856848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16604410-cb99-4c4d-b028-82332ffd2344 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:38.862585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96309ed-bc8c-43a0-bda9-50e72b08d3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:38.864130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96309ed-bc8c-43a0-bda9-50e72b08d3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:38.866365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96309ed-bc8c-43a0-bda9-50e72b08d3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:38.866803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96309ed-bc8c-43a0-bda9-50e72b08d3b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:38.868444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96309ed-bc8c-43a0-bda9-50e72b08d3b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:38.878728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96309ed-bc8c-43a0-bda9-50e72b08d3b6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:38.886227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ed6a8aa6-c5f5-4284-8646-d5aa9cf1ee1e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:38.890614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ed6a8aa6-c5f5-4284-8646-d5aa9cf1ee1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:38.936142 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1694/3444] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:38.937993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4eac0-e99a-4c7b-aa22-1d34f67d7b9c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:38.938638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4eac0-e99a-4c7b-aa22-1d34f67d7b9c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:38.939088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd4eac0-e99a-4c7b-aa22-1d34f67d7b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:38.984061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3cd4eac0-e99a-4c7b-aa22-1d34f67d7b9c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:38.985544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3cd4eac0-e99a-4c7b-aa22-1d34f67d7b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:39.016087 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1695/3445] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:39.021707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4eac0-e99a-4c7b-aa22-1d34f67d7b9c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:39.059414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd4eac0-e99a-4c7b-aa22-1d34f67d7b9c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:39.064785 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1751/3446] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:21:38 2022] POST /identity/v3/projects => generated 395 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:21:39.067492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96309ed-bc8c-43a0-bda9-50e72b08d3b6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:39.209594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96309ed-bc8c-43a0-bda9-50e72b08d3b6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:39.224315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22b4bd-767a-4638-91ba-89fa97d557d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:39.230988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22b4bd-767a-4638-91ba-89fa97d557d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:39.231974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22b4bd-767a-4638-91ba-89fa97d557d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:39.232415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22b4bd-767a-4638-91ba-89fa97d557d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:39.234944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22b4bd-767a-4638-91ba-89fa97d557d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:39.241188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f22b4bd-767a-4638-91ba-89fa97d557d7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:39.282904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0eb138-9d71-4cd2-b026-e4521feba239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:39.283595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eb138-9d71-4cd2-b026-e4521feba239 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:39.286401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eb138-9d71-4cd2-b026-e4521feba239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:39.286401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eb138-9d71-4cd2-b026-e4521feba239 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:39.286401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0eb138-9d71-4cd2-b026-e4521feba239 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:21:39.286401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0eb138-9d71-4cd2-b026-e4521feba239 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:39.286783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0eb138-9d71-4cd2-b026-e4521feba239 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:39.300906 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1696/3447] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:21:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:21:39.302972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d6d25-7e75-44e2-9a8e-9c5f0f29d4ca None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:39.303269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d6d25-7e75-44e2-9a8e-9c5f0f29d4ca None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:39.303547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d6d25-7e75-44e2-9a8e-9c5f0f29d4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:39.333477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ba0d6d25-7e75-44e2-9a8e-9c5f0f29d4ca None None] MFA Rules not processed for user `422a87b2c32043daa4631c90a612b9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:39.334962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ba0d6d25-7e75-44e2-9a8e-9c5f0f29d4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:39.353999 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1752/3448] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:21:39 2022] POST /identity/v3/users => generated 298 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:21:39.355130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22b4bd-767a-4638-91ba-89fa97d557d7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:39.389245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f22b4bd-767a-4638-91ba-89fa97d557d7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:39.403973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51783e-fad4-45fe-a9ad-cac4efa449bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:39.405803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51783e-fad4-45fe-a9ad-cac4efa449bb admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:39.405989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51783e-fad4-45fe-a9ad-cac4efa449bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:39.411158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51783e-fad4-45fe-a9ad-cac4efa449bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:39.411967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51783e-fad4-45fe-a9ad-cac4efa449bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:39.422362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51783e-fad4-45fe-a9ad-cac4efa449bb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:39.469251 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1697/3449] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:39.471320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d6d25-7e75-44e2-9a8e-9c5f0f29d4ca None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:39.546782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d6d25-7e75-44e2-9a8e-9c5f0f29d4ca None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:39.571019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aedd46-8419-4a2d-8723-97839bc2cc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:39.583815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aedd46-8419-4a2d-8723-97839bc2cc50 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:39.584965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aedd46-8419-4a2d-8723-97839bc2cc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:39.586855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aedd46-8419-4a2d-8723-97839bc2cc50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:39.589422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aedd46-8419-4a2d-8723-97839bc2cc50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:39.604203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aedd46-8419-4a2d-8723-97839bc2cc50 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:39.604814 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1753/3450] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:21:39 2022] POST /identity/v3/projects => generated 383 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:21:39.607396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51783e-fad4-45fe-a9ad-cac4efa449bb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:39.645530 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1698/3451] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:21:39.649189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aedd46-8419-4a2d-8723-97839bc2cc50 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:39.667804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aedd46-8419-4a2d-8723-97839bc2cc50 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:39.711692 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:39.777165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51783e-fad4-45fe-a9ad-cac4efa449bb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:39.790229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31263dae-bbae-4a43-bd0c-079c7db52cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:39.791111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706fb6c-3fa0-4be6-9483-c4df6967923e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:39.791915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31263dae-bbae-4a43-bd0c-079c7db52cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:39.792352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31263dae-bbae-4a43-bd0c-079c7db52cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:39.792468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706fb6c-3fa0-4be6-9483-c4df6967923e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:39.792874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31263dae-bbae-4a43-bd0c-079c7db52cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:39.793262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706fb6c-3fa0-4be6-9483-c4df6967923e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:39.793984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31263dae-bbae-4a43-bd0c-079c7db52cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:39.794809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706fb6c-3fa0-4be6-9483-c4df6967923e admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:39.796746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706fb6c-3fa0-4be6-9483-c4df6967923e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:39.796935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31263dae-bbae-4a43-bd0c-079c7db52cb3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:39.802729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706fb6c-3fa0-4be6-9483-c4df6967923e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:39.807541 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:39.813379 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1699/3452] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:21:39.817575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31263dae-bbae-4a43-bd0c-079c7db52cb3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:39.837488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31263dae-bbae-4a43-bd0c-079c7db52cb3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:39.845970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e42a2d-73d5-4b9f-8610-00b7d445552d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:39.847187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e42a2d-73d5-4b9f-8610-00b7d445552d admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:39.847768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e42a2d-73d5-4b9f-8610-00b7d445552d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:39.848177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e42a2d-73d5-4b9f-8610-00b7d445552d admin admin] PATH_INFO: `/v3/projects/09ba51ee4f434f99bff84b05bc1240e1/users/79c2150c281040b2828136aeb4d0e7db/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:39.872483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e42a2d-73d5-4b9f-8610-00b7d445552d admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ba51ee4f434f99bff84b05bc1240e1, user_id=79c2150c281040b2828136aeb4d0e7db, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:39.875922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e42a2d-73d5-4b9f-8610-00b7d445552d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:39.951089 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1754/3453] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:21:39 2022] POST /identity/v3/users => generated 292 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:21:39.955507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706fb6c-3fa0-4be6-9483-c4df6967923e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:39.994303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706fb6c-3fa0-4be6-9483-c4df6967923e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:40.004566 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1700/3454] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:21:39 2022] PUT /identity/v3/projects/09ba51ee4f434f99bff84b05bc1240e1/users/79c2150c281040b2828136aeb4d0e7db/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:40.009054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f943ff6-82af-4c92-b3bf-3524d92a2d9a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:40.009370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f943ff6-82af-4c92-b3bf-3524d92a2d9a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:40.009620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f943ff6-82af-4c92-b3bf-3524d92a2d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:40.078394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2f943ff6-82af-4c92-b3bf-3524d92a2d9a None None] MFA Rules not processed for user `79c2150c281040b2828136aeb4d0e7db`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:40.079698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2f943ff6-82af-4c92-b3bf-3524d92a2d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:40.268804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4c08e-e7c7-4f26-bb2f-5e8b63e18a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:40.270868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4c08e-e7c7-4f26-bb2f-5e8b63e18a8b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:40.272867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4c08e-e7c7-4f26-bb2f-5e8b63e18a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:40.273232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4c08e-e7c7-4f26-bb2f-5e8b63e18a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:40.276213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4c08e-e7c7-4f26-bb2f-5e8b63e18a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:40.278999 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4c08e-e7c7-4f26-bb2f-5e8b63e18a8b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:40.324727 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1755/3455] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:21:40.328333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4c08e-e7c7-4f26-bb2f-5e8b63e18a8b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:40.365722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4c08e-e7c7-4f26-bb2f-5e8b63e18a8b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:40.378421 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1701/3456] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:40.379402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f943ff6-82af-4c92-b3bf-3524d92a2d9a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:40.395024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bf772-2bd6-4e88-89be-48724117eb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:40.397823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bf772-2bd6-4e88-89be-48724117eb9c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:40.398278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bf772-2bd6-4e88-89be-48724117eb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:40.405596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4bf772-2bd6-4e88-89be-48724117eb9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:40.405596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4bf772-2bd6-4e88-89be-48724117eb9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:40.409410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f943ff6-82af-4c92-b3bf-3524d92a2d9a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:40.413274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4bf772-2bd6-4e88-89be-48724117eb9c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:40.436507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c972b2-7f35-40dc-9019-e2683a5f97d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:40.438480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c972b2-7f35-40dc-9019-e2683a5f97d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:40.438774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c972b2-7f35-40dc-9019-e2683a5f97d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:40.439059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c972b2-7f35-40dc-9019-e2683a5f97d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:40.439798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c972b2-7f35-40dc-9019-e2683a5f97d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:40.443916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c972b2-7f35-40dc-9019-e2683a5f97d3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:40.478244 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1756/3457] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:21:40 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:21:40.484423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bf772-2bd6-4e88-89be-48724117eb9c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:40.520713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4bf772-2bd6-4e88-89be-48724117eb9c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:40.536808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583acbd5-6a31-4ba6-8b52-53d738180675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:40.539235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583acbd5-6a31-4ba6-8b52-53d738180675 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:40.541233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583acbd5-6a31-4ba6-8b52-53d738180675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:40.541687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583acbd5-6a31-4ba6-8b52-53d738180675 admin admin] PATH_INFO: `/v3/projects/803223d7c8a1478b95dc053c366ba557/users/bae1cc7815ac4f75969d6effb8607d14/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:40.579824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583acbd5-6a31-4ba6-8b52-53d738180675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=803223d7c8a1478b95dc053c366ba557, user_id=bae1cc7815ac4f75969d6effb8607d14, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:40.586783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583acbd5-6a31-4ba6-8b52-53d738180675 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:40.628055 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1702/3458] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:21:40 2022] POST /identity/v3/projects => generated 395 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:21:40.632795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c972b2-7f35-40dc-9019-e2683a5f97d3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:40.775984 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1757/3459] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:21:40 2022] PUT /identity/v3/projects/803223d7c8a1478b95dc053c366ba557/users/bae1cc7815ac4f75969d6effb8607d14/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:40.783671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea246488-98be-4bae-b06f-699e3237aee7 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:40.784349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea246488-98be-4bae-b06f-699e3237aee7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:40.784710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea246488-98be-4bae-b06f-699e3237aee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:40.815992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c972b2-7f35-40dc-9019-e2683a5f97d3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:40.838899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ea246488-98be-4bae-b06f-699e3237aee7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:40.841411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ea246488-98be-4bae-b06f-699e3237aee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:40.978587 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1758/3460] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:41.013555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84092b8-30ae-4075-aff1-876fa3ef5480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:41.014408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84092b8-30ae-4075-aff1-876fa3ef5480 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:41.014699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84092b8-30ae-4075-aff1-876fa3ef5480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:41.014982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84092b8-30ae-4075-aff1-876fa3ef5480 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:41.036983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84092b8-30ae-4075-aff1-876fa3ef5480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:41.039039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84092b8-30ae-4075-aff1-876fa3ef5480 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:41.084697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea246488-98be-4bae-b06f-699e3237aee7 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:41.086715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ea246488-98be-4bae-b06f-699e3237aee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:41.141435 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:41.198944 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1703/3461] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:21:40 2022] POST /identity/v3/users => generated 304 bytes in 567 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:21:41.203709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84092b8-30ae-4075-aff1-876fa3ef5480 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:41.250118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84092b8-30ae-4075-aff1-876fa3ef5480 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:41.273704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e8054-e06b-482f-ba8f-cd0e505cf9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:41.275157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e8054-e06b-482f-ba8f-cd0e505cf9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:41.275703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e8054-e06b-482f-ba8f-cd0e505cf9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:41.277508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e8054-e06b-482f-ba8f-cd0e505cf9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:41.279041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e8054-e06b-482f-ba8f-cd0e505cf9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:41.284439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e8054-e06b-482f-ba8f-cd0e505cf9e3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:41.298964 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1704/3462] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:21:41.300590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6047d-83fc-4495-8893-5b3a87be1d95 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:41.300882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6047d-83fc-4495-8893-5b3a87be1d95 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:41.301167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6047d-83fc-4495-8893-5b3a87be1d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:41.311477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea246488-98be-4bae-b06f-699e3237aee7 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:41.318643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a995f-61db-4d4b-9dfc-e21b4ae048d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:41.319614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a995f-61db-4d4b-9dfc-e21b4ae048d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:41.321584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a995f-61db-4d4b-9dfc-e21b4ae048d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:41.322990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5a995f-61db-4d4b-9dfc-e21b4ae048d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:41.348624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a995f-61db-4d4b-9dfc-e21b4ae048d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:41.355585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5a995f-61db-4d4b-9dfc-e21b4ae048d5 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:41.363712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-05e6047d-83fc-4495-8893-5b3a87be1d95 None None] MFA Rules not processed for user `b1162c7e3ac04d04ae8bed46e0fe0f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:41.365109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-05e6047d-83fc-4495-8893-5b3a87be1d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:41.389176 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1759/3463] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:21:41.397759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a995f-61db-4d4b-9dfc-e21b4ae048d5 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:41.420040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5a995f-61db-4d4b-9dfc-e21b4ae048d5 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:41.427397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062d62e-11a4-4c0e-b7c0-05f9cbb10471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:41.428617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062d62e-11a4-4c0e-b7c0-05f9cbb10471 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:41.429033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062d62e-11a4-4c0e-b7c0-05f9cbb10471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:41.429435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062d62e-11a4-4c0e-b7c0-05f9cbb10471 admin admin] PATH_INFO: `/v3/projects/88419ca765d44dcbb57522a224b11193/users/fb45da52a0e14bb287118192c5088fec/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:41.454817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062d62e-11a4-4c0e-b7c0-05f9cbb10471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88419ca765d44dcbb57522a224b11193, user_id=fb45da52a0e14bb287118192c5088fec, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:41.458006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9062d62e-11a4-4c0e-b7c0-05f9cbb10471 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:41.554186 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1705/3464] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:41 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:41.646066 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1760/3465] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:21:41 2022] PUT /identity/v3/projects/88419ca765d44dcbb57522a224b11193/users/fb45da52a0e14bb287118192c5088fec/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:41.650227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6047d-83fc-4495-8893-5b3a87be1d95 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:41.671282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6047d-83fc-4495-8893-5b3a87be1d95 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:41.722433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062d62e-11a4-4c0e-b7c0-05f9cbb10471 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:41.724050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9062d62e-11a4-4c0e-b7c0-05f9cbb10471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:41.907676 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:41.960886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf5eb6b-3a5c-445d-923c-1bb24c3bc39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:41.961095 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5eb6b-3a5c-445d-923c-1bb24c3bc39b admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:41.961386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5eb6b-3a5c-445d-923c-1bb24c3bc39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:41.961667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf5eb6b-3a5c-445d-923c-1bb24c3bc39b admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:41.962456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5eb6b-3a5c-445d-923c-1bb24c3bc39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:41.964184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf5eb6b-3a5c-445d-923c-1bb24c3bc39b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:42.026842 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1706/3466] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:21:42.028138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ed1b9-2bcc-4152-ad85-18937f6d0a6c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:42.028433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ed1b9-2bcc-4152-ad85-18937f6d0a6c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:42.028713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ed1b9-2bcc-4152-ad85-18937f6d0a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:42.046946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062d62e-11a4-4c0e-b7c0-05f9cbb10471 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:42.063827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38a5148-26a6-473d-9f9a-bcc6ebe08204 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:42.064566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a5148-26a6-473d-9f9a-bcc6ebe08204 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:42.064781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a5148-26a6-473d-9f9a-bcc6ebe08204 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:42.065064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38a5148-26a6-473d-9f9a-bcc6ebe08204 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:42.088237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d33ed1b9-2bcc-4152-ad85-18937f6d0a6c None None] MFA Rules not processed for user `422a87b2c32043daa4631c90a612b9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:42.090770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d33ed1b9-2bcc-4152-ad85-18937f6d0a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:42.262899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a5148-26a6-473d-9f9a-bcc6ebe08204 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:42.266186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38a5148-26a6-473d-9f9a-bcc6ebe08204 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:42.272020 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1707/3467] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:42.275059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ed1b9-2bcc-4152-ad85-18937f6d0a6c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:42.278418 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1761/3468] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:41 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:21:42.291028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ed1b9-2bcc-4152-ad85-18937f6d0a6c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:42.303410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a494be0-5eea-4a87-98ee-4d2369eabb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:42.304637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a494be0-5eea-4a87-98ee-4d2369eabb7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:42.305091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a494be0-5eea-4a87-98ee-4d2369eabb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:42.306041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a494be0-5eea-4a87-98ee-4d2369eabb7f admin admin] PATH_INFO: `/v3/projects/88419ca765d44dcbb57522a224b11193/users/fb45da52a0e14bb287118192c5088fec/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:42.314594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a494be0-5eea-4a87-98ee-4d2369eabb7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=88419ca765d44dcbb57522a224b11193, user_id=fb45da52a0e14bb287118192c5088fec, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:42.317829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a494be0-5eea-4a87-98ee-4d2369eabb7f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:42.361320 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1708/3469] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:21:42 2022] PUT /identity/v3/projects/88419ca765d44dcbb57522a224b11193/users/fb45da52a0e14bb287118192c5088fec/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:42.372089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142da85-2b84-423f-9d28-14c18adad2c0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:42.372416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142da85-2b84-423f-9d28-14c18adad2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:42.372633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142da85-2b84-423f-9d28-14c18adad2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:42.454445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3142da85-2b84-423f-9d28-14c18adad2c0 None None] MFA Rules not processed for user `fb45da52a0e14bb287118192c5088fec`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:42.455921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3142da85-2b84-423f-9d28-14c18adad2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:42.667705 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1762/3470] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:42.844309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a494be0-5eea-4a87-98ee-4d2369eabb7f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:42.857957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5a494be0-5eea-4a87-98ee-4d2369eabb7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:42.979668 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:43.154057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a494be0-5eea-4a87-98ee-4d2369eabb7f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:43.184991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe552b9-4172-444f-8fad-0178a11de27a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:43.185298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe552b9-4172-444f-8fad-0178a11de27a service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:43.186231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe552b9-4172-444f-8fad-0178a11de27a service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:43.186741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe552b9-4172-444f-8fad-0178a11de27a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:43.208155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe552b9-4172-444f-8fad-0178a11de27a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:43.209912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe552b9-4172-444f-8fad-0178a11de27a service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:43.223332 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:43.233422 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1709/3471] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:44.320092 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:44.457098 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:46.410373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142da85-2b84-423f-9d28-14c18adad2c0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:46.441516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142da85-2b84-423f-9d28-14c18adad2c0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:46.447354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a35f45-910e-4e82-b06f-cd882636bf06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:46.448210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a35f45-910e-4e82-b06f-cd882636bf06 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:46.448652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a35f45-910e-4e82-b06f-cd882636bf06 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:46.449119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a35f45-910e-4e82-b06f-cd882636bf06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:46.578571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a35f45-910e-4e82-b06f-cd882636bf06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:46.580224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a35f45-910e-4e82-b06f-cd882636bf06 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:46.605051 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1763/3472] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:46.627143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe552b9-4172-444f-8fad-0178a11de27a service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:46.771154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe552b9-4172-444f-8fad-0178a11de27a service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:46.785295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d199a-d331-4848-9274-9f9e67c21293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:46.785295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d199a-d331-4848-9274-9f9e67c21293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:46.785741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d199a-d331-4848-9274-9f9e67c21293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:46.786084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d199a-d331-4848-9274-9f9e67c21293 admin admin] PATH_INFO: `/v3/users/79c2150c281040b2828136aeb4d0e7db` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:46.791288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d199a-d331-4848-9274-9f9e67c21293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c2150c281040b2828136aeb4d0e7db)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:46.793794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d199a-d331-4848-9274-9f9e67c21293 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:47.080976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-996d199a-d331-4848-9274-9f9e67c21293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c2150c281040b2828136aeb4d0e7db'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:47.104598 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:47.111891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-996d199a-d331-4848-9274-9f9e67c21293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c2150c281040b2828136aeb4d0e7db'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:47.114364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-996d199a-d331-4848-9274-9f9e67c21293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c2150c281040b2828136aeb4d0e7db'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:47.115689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-996d199a-d331-4848-9274-9f9e67c21293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c2150c281040b2828136aeb4d0e7db'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:47.132469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-996d199a-d331-4848-9274-9f9e67c21293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c2150c281040b2828136aeb4d0e7db'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:47.240865 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1710/3473] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:21:46 2022] DELETE /identity/v3/users/79c2150c281040b2828136aeb4d0e7db => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:47.245886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014c201-0975-4bee-acc2-17b44f85e6a4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:47.246305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014c201-0975-4bee-acc2-17b44f85e6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:47.246652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014c201-0975-4bee-acc2-17b44f85e6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:47.291885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b014c201-0975-4bee-acc2-17b44f85e6a4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:47.298554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b014c201-0975-4bee-acc2-17b44f85e6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:47.544720 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1764/3474] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:47.752464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d199a-d331-4848-9274-9f9e67c21293 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:47.753998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-996d199a-d331-4848-9274-9f9e67c21293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:47.932747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d199a-d331-4848-9274-9f9e67c21293 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:47.937506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d6c272-a3d4-420b-b3ce-036981ab20e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:47.938891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6c272-a3d4-420b-b3ce-036981ab20e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:47.939414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6c272-a3d4-420b-b3ce-036981ab20e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:47.940119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d6c272-a3d4-420b-b3ce-036981ab20e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:47.951875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6c272-a3d4-420b-b3ce-036981ab20e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:47.953925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d6c272-a3d4-420b-b3ce-036981ab20e5 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:47.966255 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1711/3475] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:49.663750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c70f5b-b0f0-4488-9705-6d87c50d6ef2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:49.665276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c70f5b-b0f0-4488-9705-6d87c50d6ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:49.665739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c70f5b-b0f0-4488-9705-6d87c50d6ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:49.681394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a75db-cd07-42d4-a2a4-e6967157a5bd None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:49.686202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a75db-cd07-42d4-a2a4-e6967157a5bd None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:49.686202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a75db-cd07-42d4-a2a4-e6967157a5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:49.722582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-357a75db-cd07-42d4-a2a4-e6967157a5bd None None] MFA Rules not processed for user `b1162c7e3ac04d04ae8bed46e0fe0f4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:49.730819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-357a75db-cd07-42d4-a2a4-e6967157a5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:49.781950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-20c70f5b-b0f0-4488-9705-6d87c50d6ef2 None None] MFA Rules not processed for user `a4c1c7070bd14c42a301a525690004e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:49.782254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-20c70f5b-b0f0-4488-9705-6d87c50d6ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:49.918151 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:49.948232 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1712/3476] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:21:49.967749 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1765/3477] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:49.978167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941ec3b-11a8-4965-8222-70cc7e892b34 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:49.983703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941ec3b-11a8-4965-8222-70cc7e892b34 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:49.983703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b941ec3b-11a8-4965-8222-70cc7e892b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:50.015066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b941ec3b-11a8-4965-8222-70cc7e892b34 None None] MFA Rules not processed for user `a4c1c7070bd14c42a301a525690004e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:50.016434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b941ec3b-11a8-4965-8222-70cc7e892b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:50.033906 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1713/3478] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:50.980564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c70f5b-b0f0-4488-9705-6d87c50d6ef2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:50.982036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-20c70f5b-b0f0-4488-9705-6d87c50d6ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:51.154406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c70f5b-b0f0-4488-9705-6d87c50d6ef2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:51.164600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b974a-318a-43b6-8348-3e47f27cd0d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:51.165376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b974a-318a-43b6-8348-3e47f27cd0d1 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:51.165769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b974a-318a-43b6-8348-3e47f27cd0d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:51.166766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b974a-318a-43b6-8348-3e47f27cd0d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:51.192221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b974a-318a-43b6-8348-3e47f27cd0d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:51.192684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178b974a-318a-43b6-8348-3e47f27cd0d1 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:51.199609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941ec3b-11a8-4965-8222-70cc7e892b34 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:51.201842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b941ec3b-11a8-4965-8222-70cc7e892b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:51.219672 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1766/3479] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:50 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:51.240810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b941ec3b-11a8-4965-8222-70cc7e892b34 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:51.250863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aac181-6853-4d8c-b6e5-040616f15a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:51.252231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aac181-6853-4d8c-b6e5-040616f15a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:51.252684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aac181-6853-4d8c-b6e5-040616f15a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:51.253118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aac181-6853-4d8c-b6e5-040616f15a8f admin admin] PATH_INFO: `/v3/projects/09ba51ee4f434f99bff84b05bc1240e1` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:51.257770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aac181-6853-4d8c-b6e5-040616f15a8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=09ba51ee4f434f99bff84b05bc1240e1)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:51.261328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aac181-6853-4d8c-b6e5-040616f15a8f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:51.512039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-64aac181-6853-4d8c-b6e5-040616f15a8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09ba51ee4f434f99bff84b05bc1240e1', 'request_id': 'req-64aac181-6853-4d8c-b6e5-040616f15a8f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:51.616073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-64aac181-6853-4d8c-b6e5-040616f15a8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09ba51ee4f434f99bff84b05bc1240e1', 'request_id': 'req-64aac181-6853-4d8c-b6e5-040616f15a8f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:51.626707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-64aac181-6853-4d8c-b6e5-040616f15a8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09ba51ee4f434f99bff84b05bc1240e1', 'request_id': 'req-64aac181-6853-4d8c-b6e5-040616f15a8f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:51.664396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-64aac181-6853-4d8c-b6e5-040616f15a8f admin admin] The token cache is being invalidate because project 09ba51ee4f434f99bff84b05bc1240e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:21:51.664396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-64aac181-6853-4d8c-b6e5-040616f15a8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:51.674582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-64aac181-6853-4d8c-b6e5-040616f15a8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:51.680703 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1714/3480] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:21:51 2022] DELETE /identity/v3/projects/09ba51ee4f434f99bff84b05bc1240e1 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:51.685813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b974a-318a-43b6-8348-3e47f27cd0d1 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:51.706532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178b974a-318a-43b6-8348-3e47f27cd0d1 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:51.896423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d839dc9-16a0-4207-b30b-99ebd2780552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:51.897594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d839dc9-16a0-4207-b30b-99ebd2780552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:51.898969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d839dc9-16a0-4207-b30b-99ebd2780552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:51.900488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d839dc9-16a0-4207-b30b-99ebd2780552 admin admin] PATH_INFO: `/v3/users/fb45da52a0e14bb287118192c5088fec` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:51.904416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d839dc9-16a0-4207-b30b-99ebd2780552 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb45da52a0e14bb287118192c5088fec)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:51.911858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d839dc9-16a0-4207-b30b-99ebd2780552 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:52.230631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4d839dc9-16a0-4207-b30b-99ebd2780552 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb45da52a0e14bb287118192c5088fec'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:52.314856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4d839dc9-16a0-4207-b30b-99ebd2780552 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb45da52a0e14bb287118192c5088fec'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:52.353612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4d839dc9-16a0-4207-b30b-99ebd2780552 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb45da52a0e14bb287118192c5088fec'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:52.359077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4d839dc9-16a0-4207-b30b-99ebd2780552 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb45da52a0e14bb287118192c5088fec'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:52.458356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4d839dc9-16a0-4207-b30b-99ebd2780552 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb45da52a0e14bb287118192c5088fec'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:52.465208 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:52.478883 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1767/3481] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:21:51 2022] DELETE /identity/v3/users/fb45da52a0e14bb287118192c5088fec => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:53.296809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aac181-6853-4d8c-b6e5-040616f15a8f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:53.298615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-64aac181-6853-4d8c-b6e5-040616f15a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:53.307296 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:53.538428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aac181-6853-4d8c-b6e5-040616f15a8f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:53.699244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d839dc9-16a0-4207-b30b-99ebd2780552 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:53.707557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4d839dc9-16a0-4207-b30b-99ebd2780552 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:53.761217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06626a87-15c0-47b5-bb41-d56f3449aa11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:53.767089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06626a87-15c0-47b5-bb41-d56f3449aa11 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:53.769773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06626a87-15c0-47b5-bb41-d56f3449aa11 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:53.770863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06626a87-15c0-47b5-bb41-d56f3449aa11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:53.783548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-06626a87-15c0-47b5-bb41-d56f3449aa11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:53.833929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06626a87-15c0-47b5-bb41-d56f3449aa11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:53.835869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06626a87-15c0-47b5-bb41-d56f3449aa11 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:53.877930 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1715/3482] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:53.958749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d839dc9-16a0-4207-b30b-99ebd2780552 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:53.996154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd009c-e24f-4591-9336-9d5bc6875e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:53.996154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd009c-e24f-4591-9336-9d5bc6875e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:53.996154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd009c-e24f-4591-9336-9d5bc6875e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:53.996154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd009c-e24f-4591-9336-9d5bc6875e87 admin admin] PATH_INFO: `/v3/projects/88419ca765d44dcbb57522a224b11193` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:53.996716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd009c-e24f-4591-9336-9d5bc6875e87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88419ca765d44dcbb57522a224b11193)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:53.997050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd009c-e24f-4591-9336-9d5bc6875e87 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:54.214139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a6dd009c-e24f-4591-9336-9d5bc6875e87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88419ca765d44dcbb57522a224b11193', 'request_id': 'req-a6dd009c-e24f-4591-9336-9d5bc6875e87'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:54.236332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a6dd009c-e24f-4591-9336-9d5bc6875e87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88419ca765d44dcbb57522a224b11193', 'request_id': 'req-a6dd009c-e24f-4591-9336-9d5bc6875e87'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:54.244851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a6dd009c-e24f-4591-9336-9d5bc6875e87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88419ca765d44dcbb57522a224b11193', 'request_id': 'req-a6dd009c-e24f-4591-9336-9d5bc6875e87'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:54.318962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a6dd009c-e24f-4591-9336-9d5bc6875e87 admin admin] The token cache is being invalidate because project 88419ca765d44dcbb57522a224b11193 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:21:54.319569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a6dd009c-e24f-4591-9336-9d5bc6875e87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:54.321148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a6dd009c-e24f-4591-9336-9d5bc6875e87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:21:54.323587 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1768/3483] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:21:53 2022] DELETE /identity/v3/projects/88419ca765d44dcbb57522a224b11193 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:54.328971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838c740-8114-4d26-b893-835a88ae9977 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:54.329495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838c740-8114-4d26-b893-835a88ae9977 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:54.329751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838c740-8114-4d26-b893-835a88ae9977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:54.371306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3838c740-8114-4d26-b893-835a88ae9977 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:54.378935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3838c740-8114-4d26-b893-835a88ae9977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:54.534283 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1716/3484] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:54.544119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbe798-815b-42dc-a3ce-cf639452076a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:54.545132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbe798-815b-42dc-a3ce-cf639452076a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:54.545746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bbe798-815b-42dc-a3ce-cf639452076a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:54.580498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-84bbe798-815b-42dc-a3ce-cf639452076a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:54.581953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-84bbe798-815b-42dc-a3ce-cf639452076a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:54.618912 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1769/3485] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:21:54.625230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838c740-8114-4d26-b893-835a88ae9977 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:54.650946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838c740-8114-4d26-b893-835a88ae9977 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:54.674927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d764f-3b4f-4739-b378-226057ba99d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:54.675780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d764f-3b4f-4739-b378-226057ba99d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:54.688829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d764f-3b4f-4739-b378-226057ba99d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:54.688829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d764f-3b4f-4739-b378-226057ba99d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:54.688829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d764f-3b4f-4739-b378-226057ba99d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:21:54.693016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d764f-3b4f-4739-b378-226057ba99d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:54.696438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d764f-3b4f-4739-b378-226057ba99d5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:54.720013 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1717/3486] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:21:54.724435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbe798-815b-42dc-a3ce-cf639452076a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:54.744474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bbe798-815b-42dc-a3ce-cf639452076a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:54.766861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0d773-e9bd-424c-b498-448184baf954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:54.769268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0d773-e9bd-424c-b498-448184baf954 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:54.771173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0d773-e9bd-424c-b498-448184baf954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:54.772746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f0d773-e9bd-424c-b498-448184baf954 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:54.773661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0d773-e9bd-424c-b498-448184baf954 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:54.779855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f0d773-e9bd-424c-b498-448184baf954 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:54.930821 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1770/3487] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:21:54 2022] POST /identity/v3/projects => generated 401 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:21:54.935152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d764f-3b4f-4739-b378-226057ba99d5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:54.972470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d764f-3b4f-4739-b378-226057ba99d5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:55.151876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37edf2a-dd53-4815-9563-63e7a27d9bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:55.152581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37edf2a-dd53-4815-9563-63e7a27d9bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:55.152872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37edf2a-dd53-4815-9563-63e7a27d9bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:55.153153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37edf2a-dd53-4815-9563-63e7a27d9bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:55.156374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37edf2a-dd53-4815-9563-63e7a27d9bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:55.165105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37edf2a-dd53-4815-9563-63e7a27d9bb3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:55.330490 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1718/3488] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:21:54 2022] POST /identity/v3/users => generated 301 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:21:55.337342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0d773-e9bd-424c-b498-448184baf954 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:55.386341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f0d773-e9bd-424c-b498-448184baf954 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:55.418293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db87a8c-9a71-4ce2-8e86-c4546fff2a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:55.423099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db87a8c-9a71-4ce2-8e86-c4546fff2a63 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:55.423099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db87a8c-9a71-4ce2-8e86-c4546fff2a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:55.423099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db87a8c-9a71-4ce2-8e86-c4546fff2a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:55.425694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db87a8c-9a71-4ce2-8e86-c4546fff2a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:55.428687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db87a8c-9a71-4ce2-8e86-c4546fff2a63 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:55.458737 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1771/3489] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:21:55.463357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37edf2a-dd53-4815-9563-63e7a27d9bb3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:55.480242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37edf2a-dd53-4815-9563-63e7a27d9bb3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:55.495192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d25c66e-e9c0-41c6-9b95-53e010eeb5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:55.500973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25c66e-e9c0-41c6-9b95-53e010eeb5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:55.500973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25c66e-e9c0-41c6-9b95-53e010eeb5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:55.500973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d25c66e-e9c0-41c6-9b95-53e010eeb5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:55.500973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25c66e-e9c0-41c6-9b95-53e010eeb5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:55.508626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d25c66e-e9c0-41c6-9b95-53e010eeb5b9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:55.541640 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1719/3490] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:21:55.546663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db87a8c-9a71-4ce2-8e86-c4546fff2a63 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:55.572949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db87a8c-9a71-4ce2-8e86-c4546fff2a63 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:55.595316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8de2f5-efd2-4465-ba61-edd95b6232bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:55.596334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8de2f5-efd2-4465-ba61-edd95b6232bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:55.596623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8de2f5-efd2-4465-ba61-edd95b6232bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:55.596905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8de2f5-efd2-4465-ba61-edd95b6232bd admin admin] PATH_INFO: `/v3/projects/4e1681c067b64811bf9b533502f37749/users/c798e9fcecb9498aa6674947409afd7b/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:55.639889 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:55.662545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8de2f5-efd2-4465-ba61-edd95b6232bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e1681c067b64811bf9b533502f37749, user_id=c798e9fcecb9498aa6674947409afd7b, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:55.669427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8de2f5-efd2-4465-ba61-edd95b6232bd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:55.815758 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1772/3491] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:21:55 2022] PUT /identity/v3/projects/4e1681c067b64811bf9b533502f37749/users/c798e9fcecb9498aa6674947409afd7b/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:21:55.822875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30045ad9-0643-451e-8b78-047f2d661d06 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:55.823170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30045ad9-0643-451e-8b78-047f2d661d06 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:55.823502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30045ad9-0643-451e-8b78-047f2d661d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:55.878204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-30045ad9-0643-451e-8b78-047f2d661d06 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:21:55.879734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-30045ad9-0643-451e-8b78-047f2d661d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:56.014878 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1720/3492] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:21:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:21:56.023505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8de2f5-efd2-4465-ba61-edd95b6232bd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:56.025892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3d8de2f5-efd2-4465-ba61-edd95b6232bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:56.102554 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:21:56.187262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8de2f5-efd2-4465-ba61-edd95b6232bd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:56.192919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68a90d-47d1-4ce9-884d-59a7df680ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:56.202584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68a90d-47d1-4ce9-884d-59a7df680ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:56.202584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68a90d-47d1-4ce9-884d-59a7df680ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:56.202584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68a90d-47d1-4ce9-884d-59a7df680ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:56.235712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68a90d-47d1-4ce9-884d-59a7df680ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:56.238226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68a90d-47d1-4ce9-884d-59a7df680ec3 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:56.261679 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1773/3493] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:56.478933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30045ad9-0643-451e-8b78-047f2d661d06 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:56.481943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-30045ad9-0643-451e-8b78-047f2d661d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:56.514872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30045ad9-0643-451e-8b78-047f2d661d06 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:56.521522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4c3bc-0523-448d-8127-f8915da9086b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:56.523294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4c3bc-0523-448d-8127-f8915da9086b service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:56.523595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4c3bc-0523-448d-8127-f8915da9086b service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:56.523878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4c3bc-0523-448d-8127-f8915da9086b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:56.529765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-73a4c3bc-0523-448d-8127-f8915da9086b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:56.550566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4c3bc-0523-448d-8127-f8915da9086b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:56.560412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4c3bc-0523-448d-8127-f8915da9086b service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:56.573775 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1721/3494] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:21:58.872483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68a90d-47d1-4ce9-884d-59a7df680ec3 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:21:58.877071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1c68a90d-47d1-4ce9-884d-59a7df680ec3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:59.094476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68a90d-47d1-4ce9-884d-59a7df680ec3 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:21:59.104135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c9cdf-f5f4-41d6-8990-85a9a8b8bd54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:21:59.104602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c9cdf-f5f4-41d6-8990-85a9a8b8bd54 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:21:59.104888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c9cdf-f5f4-41d6-8990-85a9a8b8bd54 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:21:59.105165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c9cdf-f5f4-41d6-8990-85a9a8b8bd54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:21:59.110677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-235c9cdf-f5f4-41d6-8990-85a9a8b8bd54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:21:59.153794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c9cdf-f5f4-41d6-8990-85a9a8b8bd54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:21:59.161990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c9cdf-f5f4-41d6-8990-85a9a8b8bd54 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:21:59.199817 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1774/3495] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:21:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:22:01.223492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c8205-fd35-4e71-8faf-6786192fb5fc None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:01.229940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c8205-fd35-4e71-8faf-6786192fb5fc None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:01.231524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c8205-fd35-4e71-8faf-6786192fb5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:01.260388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4d4c8205-fd35-4e71-8faf-6786192fb5fc None None] MFA Rules not processed for user `68dd6976fe754e4ab64acd9beb22d266`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:01.264161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4d4c8205-fd35-4e71-8faf-6786192fb5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:01.433600 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1722/3496] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:07.593472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba3af7-2ec2-4951-a877-659501ccfc4e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:07.593962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba3af7-2ec2-4951-a877-659501ccfc4e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:07.594303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba3af7-2ec2-4951-a877-659501ccfc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:07.688631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d1ba3af7-2ec2-4951-a877-659501ccfc4e None None] MFA Rules not processed for user `bae1cc7815ac4f75969d6effb8607d14`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:07.690053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d1ba3af7-2ec2-4951-a877-659501ccfc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:07.836462 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1775/3497] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:08.492399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c8205-fd35-4e71-8faf-6786192fb5fc None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:08.510655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c8205-fd35-4e71-8faf-6786192fb5fc None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:08.523385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce024f-9fae-4577-b48d-d289b1e3f11a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:08.524299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce024f-9fae-4577-b48d-d289b1e3f11a service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:08.524771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce024f-9fae-4577-b48d-d289b1e3f11a service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:08.525719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce024f-9fae-4577-b48d-d289b1e3f11a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:08.543284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce024f-9fae-4577-b48d-d289b1e3f11a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:08.545851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce024f-9fae-4577-b48d-d289b1e3f11a service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:08.568909 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1723/3498] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:22:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:22:08.870054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba3af7-2ec2-4951-a877-659501ccfc4e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:08.875299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d1ba3af7-2ec2-4951-a877-659501ccfc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:08.905301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba3af7-2ec2-4951-a877-659501ccfc4e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:08.912638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b453ac6-a7a1-4c0c-8b15-f2d4beee1fb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:08.913712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b453ac6-a7a1-4c0c-8b15-f2d4beee1fb2 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:08.914924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b453ac6-a7a1-4c0c-8b15-f2d4beee1fb2 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:08.915417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b453ac6-a7a1-4c0c-8b15-f2d4beee1fb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:08.917890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1b453ac6-a7a1-4c0c-8b15-f2d4beee1fb2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:08.952253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b453ac6-a7a1-4c0c-8b15-f2d4beee1fb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:08.954051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b453ac6-a7a1-4c0c-8b15-f2d4beee1fb2 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:08.994775 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1776/3499] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:22:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:22:10.422174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18ae52-0d9a-4bd7-afeb-3b0e9d4a0d82 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:10.423119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18ae52-0d9a-4bd7-afeb-3b0e9d4a0d82 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:10.423879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18ae52-0d9a-4bd7-afeb-3b0e9d4a0d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:10.477586 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:22:10.491779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6c18ae52-0d9a-4bd7-afeb-3b0e9d4a0d82 None None] MFA Rules not processed for user `c798e9fcecb9498aa6674947409afd7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:10.493271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6c18ae52-0d9a-4bd7-afeb-3b0e9d4a0d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:10.652016 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1724/3500] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:10.727596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b453ac6-a7a1-4c0c-8b15-f2d4beee1fb2 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:10.763050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b453ac6-a7a1-4c0c-8b15-f2d4beee1fb2 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:10.776968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e0da5-9ee7-4d1b-9a88-9780c884125b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:10.781187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e0da5-9ee7-4d1b-9a88-9780c884125b service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:10.781675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e0da5-9ee7-4d1b-9a88-9780c884125b service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:10.782389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e0da5-9ee7-4d1b-9a88-9780c884125b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:10.808966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e0da5-9ee7-4d1b-9a88-9780c884125b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:10.810643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e0da5-9ee7-4d1b-9a88-9780c884125b service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:10.875638 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1777/3501] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:22:10 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:22:15.855122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd97571-4928-4d02-af79-702a2db015f8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:15.856793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd97571-4928-4d02-af79-702a2db015f8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:15.861988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd97571-4928-4d02-af79-702a2db015f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:15.896131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1bd97571-4928-4d02-af79-702a2db015f8 None None] MFA Rules not processed for user `bae1cc7815ac4f75969d6effb8607d14`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:15.897573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1bd97571-4928-4d02-af79-702a2db015f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:15.931868 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1725/3502] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:17.358829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e0da5-9ee7-4d1b-9a88-9780c884125b service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:17.360455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-302e0da5-9ee7-4d1b-9a88-9780c884125b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:17.377415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e0da5-9ee7-4d1b-9a88-9780c884125b service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:17.390681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26f039-080c-4bb0-a797-e127eaf3e6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:17.391687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26f039-080c-4bb0-a797-e127eaf3e6d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:17.392133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26f039-080c-4bb0-a797-e127eaf3e6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:17.392236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26f039-080c-4bb0-a797-e127eaf3e6d7 admin admin] PATH_INFO: `/v3/users/cb444a9e01dc497ca9b8f3c1b65fe532` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:17.393579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26f039-080c-4bb0-a797-e127eaf3e6d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb444a9e01dc497ca9b8f3c1b65fe532)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:17.395611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26f039-080c-4bb0-a797-e127eaf3e6d7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:17.412902 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:22:17.596802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6f26f039-080c-4bb0-a797-e127eaf3e6d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb444a9e01dc497ca9b8f3c1b65fe532'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:17.618336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6f26f039-080c-4bb0-a797-e127eaf3e6d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb444a9e01dc497ca9b8f3c1b65fe532'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:17.628174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6f26f039-080c-4bb0-a797-e127eaf3e6d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb444a9e01dc497ca9b8f3c1b65fe532'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:17.629221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6f26f039-080c-4bb0-a797-e127eaf3e6d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb444a9e01dc497ca9b8f3c1b65fe532'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:17.732895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6f26f039-080c-4bb0-a797-e127eaf3e6d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb444a9e01dc497ca9b8f3c1b65fe532'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:17.744511 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1778/3503] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:22:17 2022] DELETE /identity/v3/users/cb444a9e01dc497ca9b8f3c1b65fe532 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:22:18.162352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd97571-4928-4d02-af79-702a2db015f8 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:18.177069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd97571-4928-4d02-af79-702a2db015f8 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:18.289192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4440bbf4-1a18-4a7b-adfc-4d538a76da05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:18.290273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440bbf4-1a18-4a7b-adfc-4d538a76da05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:18.290584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440bbf4-1a18-4a7b-adfc-4d538a76da05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:18.291032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4440bbf4-1a18-4a7b-adfc-4d538a76da05 admin admin] PATH_INFO: `/v3/projects/d0730f3c6ab749508db7b57f9be02f56` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:18.292569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440bbf4-1a18-4a7b-adfc-4d538a76da05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0730f3c6ab749508db7b57f9be02f56)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:18.295423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4440bbf4-1a18-4a7b-adfc-4d538a76da05 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:18.431064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4440bbf4-1a18-4a7b-adfc-4d538a76da05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0730f3c6ab749508db7b57f9be02f56', 'request_id': 'req-4440bbf4-1a18-4a7b-adfc-4d538a76da05'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:18.514900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4440bbf4-1a18-4a7b-adfc-4d538a76da05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0730f3c6ab749508db7b57f9be02f56', 'request_id': 'req-4440bbf4-1a18-4a7b-adfc-4d538a76da05'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:18.527440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4440bbf4-1a18-4a7b-adfc-4d538a76da05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0730f3c6ab749508db7b57f9be02f56', 'request_id': 'req-4440bbf4-1a18-4a7b-adfc-4d538a76da05'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:18.549225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4440bbf4-1a18-4a7b-adfc-4d538a76da05 admin admin] The token cache is being invalidate because project d0730f3c6ab749508db7b57f9be02f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:22:18.549638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4440bbf4-1a18-4a7b-adfc-4d538a76da05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:18.550548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4440bbf4-1a18-4a7b-adfc-4d538a76da05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:18.552900 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1726/3504] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:22:18 2022] DELETE /identity/v3/projects/d0730f3c6ab749508db7b57f9be02f56 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:22:18.558954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ac19c-e60e-4751-aa8f-85193dee26c9 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:18.559765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ac19c-e60e-4751-aa8f-85193dee26c9 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:18.560727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ac19c-e60e-4751-aa8f-85193dee26c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:18.603174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-819ac19c-e60e-4751-aa8f-85193dee26c9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:18.604302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-819ac19c-e60e-4751-aa8f-85193dee26c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:18.676481 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1779/3505] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:18.684614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f61d90-57d8-4eab-a55f-1bf1477a49e4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:18.684903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f61d90-57d8-4eab-a55f-1bf1477a49e4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:18.685551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f61d90-57d8-4eab-a55f-1bf1477a49e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:18.733544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b5f61d90-57d8-4eab-a55f-1bf1477a49e4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:18.736394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b5f61d90-57d8-4eab-a55f-1bf1477a49e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:18.774022 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1727/3506] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:22:18.776844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ac19c-e60e-4751-aa8f-85193dee26c9 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:18.798881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ac19c-e60e-4751-aa8f-85193dee26c9 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:18.807190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9490bda-075f-4c26-8a94-3ae3ee443f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:18.808699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9490bda-075f-4c26-8a94-3ae3ee443f87 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:18.809408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9490bda-075f-4c26-8a94-3ae3ee443f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:18.809830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9490bda-075f-4c26-8a94-3ae3ee443f87 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:18.812195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9490bda-075f-4c26-8a94-3ae3ee443f87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:22:18.812723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9490bda-075f-4c26-8a94-3ae3ee443f87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:18.819420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9490bda-075f-4c26-8a94-3ae3ee443f87 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:18.842054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f61d90-57d8-4eab-a55f-1bf1477a49e4 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:18.848651 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1780/3507] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:22:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:22:18.853572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f61d90-57d8-4eab-a55f-1bf1477a49e4 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:18.872727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab533d8-17a9-4941-8360-8490cd4dea9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:18.874617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab533d8-17a9-4941-8360-8490cd4dea9d admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:18.874908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab533d8-17a9-4941-8360-8490cd4dea9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:18.875193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab533d8-17a9-4941-8360-8490cd4dea9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:18.875915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab533d8-17a9-4941-8360-8490cd4dea9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:18.877904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab533d8-17a9-4941-8360-8490cd4dea9d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:18.909400 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:22:18.979712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9490bda-075f-4c26-8a94-3ae3ee443f87 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:18.983368 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1728/3508] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:22:18 2022] POST /identity/v3/projects => generated 377 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:22:18.999062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9490bda-075f-4c26-8a94-3ae3ee443f87 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:19.089600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d738c-232b-4457-8cbb-a2ff855415b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:19.090626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d738c-232b-4457-8cbb-a2ff855415b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:19.090917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d738c-232b-4457-8cbb-a2ff855415b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:19.091248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d738c-232b-4457-8cbb-a2ff855415b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:19.091948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d738c-232b-4457-8cbb-a2ff855415b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:19.093997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d738c-232b-4457-8cbb-a2ff855415b4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:19.179233 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1781/3509] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:22:18 2022] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:22:19.183328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab533d8-17a9-4941-8360-8490cd4dea9d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:19.196048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab533d8-17a9-4941-8360-8490cd4dea9d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:19.202549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0cc61-9a08-4d4e-9ea1-dbeeaf169fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:19.203369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0cc61-9a08-4d4e-9ea1-dbeeaf169fcc admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:19.203689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0cc61-9a08-4d4e-9ea1-dbeeaf169fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:19.203946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0cc61-9a08-4d4e-9ea1-dbeeaf169fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:19.204722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0cc61-9a08-4d4e-9ea1-dbeeaf169fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:19.206556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0cc61-9a08-4d4e-9ea1-dbeeaf169fcc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:19.234823 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1729/3510] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:22:19.238990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d738c-232b-4457-8cbb-a2ff855415b4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:19.246675 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:22:19.251620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d738c-232b-4457-8cbb-a2ff855415b4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:19.256611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14555125-dcc5-4e18-b065-60eff6a43461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:19.257435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14555125-dcc5-4e18-b065-60eff6a43461 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:19.257894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14555125-dcc5-4e18-b065-60eff6a43461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:19.258214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14555125-dcc5-4e18-b065-60eff6a43461 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:19.258956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14555125-dcc5-4e18-b065-60eff6a43461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:19.261864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14555125-dcc5-4e18-b065-60eff6a43461 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:19.275225 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1782/3511] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:22:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:22:19.280279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0cc61-9a08-4d4e-9ea1-dbeeaf169fcc admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:19.302224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0cc61-9a08-4d4e-9ea1-dbeeaf169fcc admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:19.307279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ff261-33e0-493c-aeca-932e3b1ac78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:19.308179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ff261-33e0-493c-aeca-932e3b1ac78f admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:19.308466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ff261-33e0-493c-aeca-932e3b1ac78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:19.308746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ff261-33e0-493c-aeca-932e3b1ac78f admin admin] PATH_INFO: `/v3/projects/e2fc1ac5806c4620a87da96e49c45dcf/users/1ebfe6431d2942b4b82ebf264e664524/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:19.326532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ff261-33e0-493c-aeca-932e3b1ac78f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2fc1ac5806c4620a87da96e49c45dcf, user_id=1ebfe6431d2942b4b82ebf264e664524, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:19.329181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ff261-33e0-493c-aeca-932e3b1ac78f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:19.421701 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1730/3512] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:22:19 2022] PUT /identity/v3/projects/e2fc1ac5806c4620a87da96e49c45dcf/users/1ebfe6431d2942b4b82ebf264e664524/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:22:19.423825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbdae0-f630-41af-9b6d-05397d785e5d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:19.423825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbdae0-f630-41af-9b6d-05397d785e5d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:19.424091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbdae0-f630-41af-9b6d-05397d785e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:19.457033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-22fbdae0-f630-41af-9b6d-05397d785e5d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:19.470616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-22fbdae0-f630-41af-9b6d-05397d785e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:19.616375 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1783/3513] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:19.660176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ff261-33e0-493c-aeca-932e3b1ac78f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:19.662391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0b4ff261-33e0-493c-aeca-932e3b1ac78f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:19.821523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ff261-33e0-493c-aeca-932e3b1ac78f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:19.825922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe749910-5de1-4c81-abc8-07333e9c1353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:19.826892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe749910-5de1-4c81-abc8-07333e9c1353 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:19.827282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe749910-5de1-4c81-abc8-07333e9c1353 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:19.827743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe749910-5de1-4c81-abc8-07333e9c1353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:19.843461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe749910-5de1-4c81-abc8-07333e9c1353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:19.845773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe749910-5de1-4c81-abc8-07333e9c1353 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:19.861525 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1731/3514] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:22:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:22:20.024841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924b8aa-4e3f-41de-87ef-1b4cd520d135 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:20.025186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924b8aa-4e3f-41de-87ef-1b4cd520d135 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:20.025471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9924b8aa-4e3f-41de-87ef-1b4cd520d135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:20.123010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9924b8aa-4e3f-41de-87ef-1b4cd520d135 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:20.124496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9924b8aa-4e3f-41de-87ef-1b4cd520d135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:20.275083 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1784/3515] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:22:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:20.342258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe749910-5de1-4c81-abc8-07333e9c1353 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:20.349112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fe749910-5de1-4c81-abc8-07333e9c1353 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:20.524051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe749910-5de1-4c81-abc8-07333e9c1353 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:20.533179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a509722-4e94-443d-80e5-a68c2a2c0d3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:20.534048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a509722-4e94-443d-80e5-a68c2a2c0d3c service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:20.534384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a509722-4e94-443d-80e5-a68c2a2c0d3c service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:20.534669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a509722-4e94-443d-80e5-a68c2a2c0d3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:20.563641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a509722-4e94-443d-80e5-a68c2a2c0d3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:20.565331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a509722-4e94-443d-80e5-a68c2a2c0d3c service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:20.580312 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1732/3516] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:22:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:22:25.572516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924b8aa-4e3f-41de-87ef-1b4cd520d135 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:25.574648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9924b8aa-4e3f-41de-87ef-1b4cd520d135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:25.617391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9924b8aa-4e3f-41de-87ef-1b4cd520d135 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:25.632486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5688481a-98f7-4c89-9425-9d41f22fcbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:25.633966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688481a-98f7-4c89-9425-9d41f22fcbe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:25.635748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688481a-98f7-4c89-9425-9d41f22fcbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:25.636185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5688481a-98f7-4c89-9425-9d41f22fcbe3 admin admin] PATH_INFO: `/v3/users/c798e9fcecb9498aa6674947409afd7b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:25.642617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688481a-98f7-4c89-9425-9d41f22fcbe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c798e9fcecb9498aa6674947409afd7b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:25.648943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5688481a-98f7-4c89-9425-9d41f22fcbe3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:25.905589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5688481a-98f7-4c89-9425-9d41f22fcbe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c798e9fcecb9498aa6674947409afd7b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:25.920772 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:22:25.923417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5688481a-98f7-4c89-9425-9d41f22fcbe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c798e9fcecb9498aa6674947409afd7b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:25.933230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5688481a-98f7-4c89-9425-9d41f22fcbe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c798e9fcecb9498aa6674947409afd7b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:25.936544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5688481a-98f7-4c89-9425-9d41f22fcbe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c798e9fcecb9498aa6674947409afd7b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:26.116644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5688481a-98f7-4c89-9425-9d41f22fcbe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c798e9fcecb9498aa6674947409afd7b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:26.146320 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1785/3517] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:22:25 2022] DELETE /identity/v3/users/c798e9fcecb9498aa6674947409afd7b => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:22:27.298402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a509722-4e94-443d-80e5-a68c2a2c0d3c service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:27.314274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a509722-4e94-443d-80e5-a68c2a2c0d3c service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:27.398592 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:22:27.444392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29683b-d0c7-4338-8932-9cc29db38fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:27.445559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29683b-d0c7-4338-8932-9cc29db38fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:27.446012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29683b-d0c7-4338-8932-9cc29db38fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:27.446396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29683b-d0c7-4338-8932-9cc29db38fd0 admin admin] PATH_INFO: `/v3/projects/4e1681c067b64811bf9b533502f37749` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:27.456064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29683b-d0c7-4338-8932-9cc29db38fd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e1681c067b64811bf9b533502f37749)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:27.458812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd29683b-d0c7-4338-8932-9cc29db38fd0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:27.669146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dd29683b-d0c7-4338-8932-9cc29db38fd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e1681c067b64811bf9b533502f37749', 'request_id': 'req-dd29683b-d0c7-4338-8932-9cc29db38fd0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:27.674038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085b62e-c9a4-46c7-9347-1b2890f58d29 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:27.674630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085b62e-c9a4-46c7-9347-1b2890f58d29 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:27.674738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a085b62e-c9a4-46c7-9347-1b2890f58d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:27.703269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a085b62e-c9a4-46c7-9347-1b2890f58d29 None None] MFA Rules not processed for user `a4c1c7070bd14c42a301a525690004e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:27.710825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a085b62e-c9a4-46c7-9347-1b2890f58d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:27.733181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dd29683b-d0c7-4338-8932-9cc29db38fd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e1681c067b64811bf9b533502f37749', 'request_id': 'req-dd29683b-d0c7-4338-8932-9cc29db38fd0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:27.742459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dd29683b-d0c7-4338-8932-9cc29db38fd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e1681c067b64811bf9b533502f37749', 'request_id': 'req-dd29683b-d0c7-4338-8932-9cc29db38fd0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:27.775452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dd29683b-d0c7-4338-8932-9cc29db38fd0 admin admin] The token cache is being invalidate because project 4e1681c067b64811bf9b533502f37749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:22:27.780246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dd29683b-d0c7-4338-8932-9cc29db38fd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:27.782832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dd29683b-d0c7-4338-8932-9cc29db38fd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:27.785400 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1733/3518] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:22:27 2022] DELETE /identity/v3/projects/4e1681c067b64811bf9b533502f37749 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:22:27.793823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236f73a-57fc-4611-b55e-67c1ddcb31d5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:27.794146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236f73a-57fc-4611-b55e-67c1ddcb31d5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:27.795144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236f73a-57fc-4611-b55e-67c1ddcb31d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:27.801109 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1786/3519] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:22:27.823072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f236f73a-57fc-4611-b55e-67c1ddcb31d5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:27.824500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f236f73a-57fc-4611-b55e-67c1ddcb31d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:27.975148 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1734/3520] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:27.976909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b870b2-bd4f-41a9-b202-012afe76b02e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:27.977393 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b870b2-bd4f-41a9-b202-012afe76b02e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:27.978021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b870b2-bd4f-41a9-b202-012afe76b02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:28.012669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-81b870b2-bd4f-41a9-b202-012afe76b02e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:28.014992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-81b870b2-bd4f-41a9-b202-012afe76b02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:28.029853 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1787/3521] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:28.034134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236f73a-57fc-4611-b55e-67c1ddcb31d5 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:28.044797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236f73a-57fc-4611-b55e-67c1ddcb31d5 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:28.050002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490d8cd-eba9-4c71-aa03-611b3389d28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:28.050830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490d8cd-eba9-4c71-aa03-611b3389d28f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:28.051278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490d8cd-eba9-4c71-aa03-611b3389d28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:28.051675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490d8cd-eba9-4c71-aa03-611b3389d28f admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:28.052577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490d8cd-eba9-4c71-aa03-611b3389d28f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:22:28.053117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490d8cd-eba9-4c71-aa03-611b3389d28f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:28.054850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490d8cd-eba9-4c71-aa03-611b3389d28f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:28.083016 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1735/3522] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:22:28.084274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b870b2-bd4f-41a9-b202-012afe76b02e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:28.096523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b870b2-bd4f-41a9-b202-012afe76b02e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:28.103668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d46b1-ab84-47d4-8226-e0dc7425b1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:28.104527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d46b1-ab84-47d4-8226-e0dc7425b1aa admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:28.105374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d46b1-ab84-47d4-8226-e0dc7425b1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:28.105913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d46b1-ab84-47d4-8226-e0dc7425b1aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:28.106922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d46b1-ab84-47d4-8226-e0dc7425b1aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:28.109355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d46b1-ab84-47d4-8226-e0dc7425b1aa admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:28.245471 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1788/3523] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:22:28 2022] POST /identity/v3/projects => generated 391 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:22:28.246209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490d8cd-eba9-4c71-aa03-611b3389d28f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:28.261306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490d8cd-eba9-4c71-aa03-611b3389d28f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:28.352673 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:22:28.379505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d9aed-b3e0-40b1-8de8-f90ba8bf40ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:28.379505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d9aed-b3e0-40b1-8de8-f90ba8bf40ce admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:28.379505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d9aed-b3e0-40b1-8de8-f90ba8bf40ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:28.379505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d9aed-b3e0-40b1-8de8-f90ba8bf40ce admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:28.379888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d9aed-b3e0-40b1-8de8-f90ba8bf40ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:28.381688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4d9aed-b3e0-40b1-8de8-f90ba8bf40ce admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:28.430711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d46b1-ab84-47d4-8226-e0dc7425b1aa admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:28.433167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-586d46b1-ab84-47d4-8226-e0dc7425b1aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:28.501227 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1736/3524] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:22:28 2022] POST /identity/v3/users => generated 296 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:22:28.502459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d9aed-b3e0-40b1-8de8-f90ba8bf40ce admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:28.509903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d46b1-ab84-47d4-8226-e0dc7425b1aa admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:28.515391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2ea7e-862d-4baf-b328-8d2d413eb46b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:28.516272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2ea7e-862d-4baf-b328-8d2d413eb46b service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:28.516676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2ea7e-862d-4baf-b328-8d2d413eb46b service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:28.517055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd2ea7e-862d-4baf-b328-8d2d413eb46b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:28.519842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5fd2ea7e-862d-4baf-b328-8d2d413eb46b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:28.531561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d9aed-b3e0-40b1-8de8-f90ba8bf40ce admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:28.534378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2ea7e-862d-4baf-b328-8d2d413eb46b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:28.536472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd2ea7e-862d-4baf-b328-8d2d413eb46b service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:28.550574 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1789/3525] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:22:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:22:28.552581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a61aef-53fa-44e4-9df6-0ce72a28fa95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:28.553301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a61aef-53fa-44e4-9df6-0ce72a28fa95 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:28.553591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a61aef-53fa-44e4-9df6-0ce72a28fa95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:28.553871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a61aef-53fa-44e4-9df6-0ce72a28fa95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:28.554646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a61aef-53fa-44e4-9df6-0ce72a28fa95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:28.556250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a61aef-53fa-44e4-9df6-0ce72a28fa95 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:28.581262 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1737/3526] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:22:28.585691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2ea7e-862d-4baf-b328-8d2d413eb46b service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:28.608818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd2ea7e-862d-4baf-b328-8d2d413eb46b service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:28.616033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f16ce6-f0d4-4632-ad57-bc3551ac0037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:28.617238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f16ce6-f0d4-4632-ad57-bc3551ac0037 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:28.617698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f16ce6-f0d4-4632-ad57-bc3551ac0037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:28.622954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f16ce6-f0d4-4632-ad57-bc3551ac0037 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:28.622954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f16ce6-f0d4-4632-ad57-bc3551ac0037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:28.622954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f16ce6-f0d4-4632-ad57-bc3551ac0037 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:28.648163 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1790/3527] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:22:28.652125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a61aef-53fa-44e4-9df6-0ce72a28fa95 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:28.664099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a61aef-53fa-44e4-9df6-0ce72a28fa95 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:28.670975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7e8d8-f68f-4d93-802d-52f3bf931cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:28.673922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7e8d8-f68f-4d93-802d-52f3bf931cae admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:28.674266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7e8d8-f68f-4d93-802d-52f3bf931cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:28.674992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7e8d8-f68f-4d93-802d-52f3bf931cae admin admin] PATH_INFO: `/v3/projects/2bdc844179d641a683d56841456fee6c/users/311c5366698c453cb38ee7bdab7ce51f/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:28.701807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7e8d8-f68f-4d93-802d-52f3bf931cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bdc844179d641a683d56841456fee6c, user_id=311c5366698c453cb38ee7bdab7ce51f, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:28.705939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f7e8d8-f68f-4d93-802d-52f3bf931cae admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:28.833774 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1738/3528] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:22:28 2022] PUT /identity/v3/projects/2bdc844179d641a683d56841456fee6c/users/311c5366698c453cb38ee7bdab7ce51f/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:22:28.855479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1ce26-4759-459f-905b-f67c32a7e4eb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:28.856015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1ce26-4759-459f-905b-f67c32a7e4eb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:28.856112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1ce26-4759-459f-905b-f67c32a7e4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:28.894865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-25a1ce26-4759-459f-905b-f67c32a7e4eb None None] MFA Rules not processed for user `311c5366698c453cb38ee7bdab7ce51f`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:28.896161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-25a1ce26-4759-459f-905b-f67c32a7e4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:28.947257 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:22:28.994715 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1791/3529] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:29.222581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7e8d8-f68f-4d93-802d-52f3bf931cae admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:29.224414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-28f7e8d8-f68f-4d93-802d-52f3bf931cae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:29.323661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7e8d8-f68f-4d93-802d-52f3bf931cae admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:29.330211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18e8f22-52e5-4406-bfaa-6310e7c222bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:29.331272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e8f22-52e5-4406-bfaa-6310e7c222bb service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:29.331637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e8f22-52e5-4406-bfaa-6310e7c222bb service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:29.331917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18e8f22-52e5-4406-bfaa-6310e7c222bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:29.343868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e8f22-52e5-4406-bfaa-6310e7c222bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:29.345474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18e8f22-52e5-4406-bfaa-6310e7c222bb service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:29.355895 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1739/3530] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:22:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:22:30.035707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1ce26-4759-459f-905b-f67c32a7e4eb None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:30.134791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1ce26-4759-459f-905b-f67c32a7e4eb None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:30.143113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b26b298-c03d-45df-b9ee-0b7e7cf46d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:30.144477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26b298-c03d-45df-b9ee-0b7e7cf46d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:30.144978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26b298-c03d-45df-b9ee-0b7e7cf46d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:30.145646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b26b298-c03d-45df-b9ee-0b7e7cf46d6f admin admin] PATH_INFO: `/v3/users/311c5366698c453cb38ee7bdab7ce51f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:30.147180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b26b298-c03d-45df-b9ee-0b7e7cf46d6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=311c5366698c453cb38ee7bdab7ce51f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:30.149947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b26b298-c03d-45df-b9ee-0b7e7cf46d6f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:30.452732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9b26b298-c03d-45df-b9ee-0b7e7cf46d6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '311c5366698c453cb38ee7bdab7ce51f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:30.470441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9b26b298-c03d-45df-b9ee-0b7e7cf46d6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '311c5366698c453cb38ee7bdab7ce51f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:30.484587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9b26b298-c03d-45df-b9ee-0b7e7cf46d6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '311c5366698c453cb38ee7bdab7ce51f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:30.486620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9b26b298-c03d-45df-b9ee-0b7e7cf46d6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '311c5366698c453cb38ee7bdab7ce51f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:30.633907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9b26b298-c03d-45df-b9ee-0b7e7cf46d6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '311c5366698c453cb38ee7bdab7ce51f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:30.643778 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1792/3531] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:22:30 2022] DELETE /identity/v3/users/311c5366698c453cb38ee7bdab7ce51f => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:22:30.648612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2babf-bf57-4ab0-9d8e-0c66dfdd4e4a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:30.649092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2babf-bf57-4ab0-9d8e-0c66dfdd4e4a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:30.652379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2babf-bf57-4ab0-9d8e-0c66dfdd4e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:30.679062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2be2babf-bf57-4ab0-9d8e-0c66dfdd4e4a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:30.681939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2be2babf-bf57-4ab0-9d8e-0c66dfdd4e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:30.811625 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1740/3532] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:30.866485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b26b298-c03d-45df-b9ee-0b7e7cf46d6f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:30.867863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9b26b298-c03d-45df-b9ee-0b7e7cf46d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:30.968377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b26b298-c03d-45df-b9ee-0b7e7cf46d6f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:30.974358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458d1680-3b2f-4871-8c9c-0cf0b24c6b2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:30.974807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d1680-3b2f-4871-8c9c-0cf0b24c6b2c service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:30.975096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d1680-3b2f-4871-8c9c-0cf0b24c6b2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:30.975446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458d1680-3b2f-4871-8c9c-0cf0b24c6b2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:30.989699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d1680-3b2f-4871-8c9c-0cf0b24c6b2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:30.991182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458d1680-3b2f-4871-8c9c-0cf0b24c6b2c service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:30.995644 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:22:31.006307 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1793/3533] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:22:31.052730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a493e-b880-46b9-8bc0-4da1c6a32945 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:31.054949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a493e-b880-46b9-8bc0-4da1c6a32945 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:31.055255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a493e-b880-46b9-8bc0-4da1c6a32945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:31.113106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0a7a493e-b880-46b9-8bc0-4da1c6a32945 None None] MFA Rules not processed for user `1ebfe6431d2942b4b82ebf264e664524`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:31.114708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0a7a493e-b880-46b9-8bc0-4da1c6a32945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:31.140821 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:22:31.230031 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1741/3534] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:31.241740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f71d0-5026-4131-860c-96f9a6754a87 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:31.242452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f71d0-5026-4131-860c-96f9a6754a87 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:31.242452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f71d0-5026-4131-860c-96f9a6754a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:31.282841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ab4f71d0-5026-4131-860c-96f9a6754a87 None None] MFA Rules not processed for user `1ebfe6431d2942b4b82ebf264e664524`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:31.284413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ab4f71d0-5026-4131-860c-96f9a6754a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:31.322613 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1794/3535] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:31.335599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a493e-b880-46b9-8bc0-4da1c6a32945 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:31.337843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0a7a493e-b880-46b9-8bc0-4da1c6a32945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:31.505177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a493e-b880-46b9-8bc0-4da1c6a32945 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:31.515509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01db119-f366-4a00-9b03-1d3ba356aec7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:31.517215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01db119-f366-4a00-9b03-1d3ba356aec7 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:31.521870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01db119-f366-4a00-9b03-1d3ba356aec7 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:31.522629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01db119-f366-4a00-9b03-1d3ba356aec7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:31.538485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01db119-f366-4a00-9b03-1d3ba356aec7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:31.540305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01db119-f366-4a00-9b03-1d3ba356aec7 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:31.553518 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1742/3536] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:22:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:22:32.654161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f71d0-5026-4131-860c-96f9a6754a87 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:32.657024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ab4f71d0-5026-4131-860c-96f9a6754a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:32.678758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f71d0-5026-4131-860c-96f9a6754a87 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:32.696562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b42d40-b7f8-4079-8494-1f7691602030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:32.697456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b42d40-b7f8-4079-8494-1f7691602030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:32.697737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b42d40-b7f8-4079-8494-1f7691602030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:32.698208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b42d40-b7f8-4079-8494-1f7691602030 admin admin] PATH_INFO: `/v3/projects/2bdc844179d641a683d56841456fee6c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:32.702251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b42d40-b7f8-4079-8494-1f7691602030 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bdc844179d641a683d56841456fee6c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:32.704397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b42d40-b7f8-4079-8494-1f7691602030 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:32.892294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d3b42d40-b7f8-4079-8494-1f7691602030 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bdc844179d641a683d56841456fee6c', 'request_id': 'req-d3b42d40-b7f8-4079-8494-1f7691602030'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:32.910515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d3b42d40-b7f8-4079-8494-1f7691602030 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bdc844179d641a683d56841456fee6c', 'request_id': 'req-d3b42d40-b7f8-4079-8494-1f7691602030'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:32.956881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d3b42d40-b7f8-4079-8494-1f7691602030 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bdc844179d641a683d56841456fee6c', 'request_id': 'req-d3b42d40-b7f8-4079-8494-1f7691602030'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:33.074131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d3b42d40-b7f8-4079-8494-1f7691602030 admin admin] The token cache is being invalidate because project 2bdc844179d641a683d56841456fee6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:22:33.074978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d3b42d40-b7f8-4079-8494-1f7691602030 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:33.077272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d3b42d40-b7f8-4079-8494-1f7691602030 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:33.088054 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1795/3537] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:22:32 2022] DELETE /identity/v3/projects/2bdc844179d641a683d56841456fee6c => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:22:33.089889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c227565-7df7-47f6-867d-2da2295895e5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:33.090390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c227565-7df7-47f6-867d-2da2295895e5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:33.090510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c227565-7df7-47f6-867d-2da2295895e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:33.142465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9c227565-7df7-47f6-867d-2da2295895e5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:33.146001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9c227565-7df7-47f6-867d-2da2295895e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:33.284440 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1743/3538] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:33.293301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7d0ab-8866-442c-b49c-3a8878a5a9c0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:33.296109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7d0ab-8866-442c-b49c-3a8878a5a9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:33.296109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7d0ab-8866-442c-b49c-3a8878a5a9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:33.338146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-95f7d0ab-8866-442c-b49c-3a8878a5a9c0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:33.339666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-95f7d0ab-8866-442c-b49c-3a8878a5a9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:33.362769 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1796/3539] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:33.363663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c227565-7df7-47f6-867d-2da2295895e5 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:33.393007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c227565-7df7-47f6-867d-2da2295895e5 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:33.416488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4431cb-4b28-41d0-a6ad-070e60e7b298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:33.417403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4431cb-4b28-41d0-a6ad-070e60e7b298 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:33.417883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4431cb-4b28-41d0-a6ad-070e60e7b298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:33.418338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4431cb-4b28-41d0-a6ad-070e60e7b298 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:33.419358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4431cb-4b28-41d0-a6ad-070e60e7b298 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:22:33.420277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4431cb-4b28-41d0-a6ad-070e60e7b298 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:33.426363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4431cb-4b28-41d0-a6ad-070e60e7b298 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:33.458066 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1744/3540] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:22:33.462180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7d0ab-8866-442c-b49c-3a8878a5a9c0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:33.475885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7d0ab-8866-442c-b49c-3a8878a5a9c0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:33.487629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baad4cb-be12-422e-b007-d3644aa9da61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:33.488439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baad4cb-be12-422e-b007-d3644aa9da61 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:33.488787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baad4cb-be12-422e-b007-d3644aa9da61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:33.489121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baad4cb-be12-422e-b007-d3644aa9da61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:33.490049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baad4cb-be12-422e-b007-d3644aa9da61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:33.493137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baad4cb-be12-422e-b007-d3644aa9da61 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:33.624419 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1797/3541] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:22:33 2022] POST /identity/v3/projects => generated 401 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:22:33.626907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4431cb-4b28-41d0-a6ad-070e60e7b298 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:33.637717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4431cb-4b28-41d0-a6ad-070e60e7b298 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:33.755695 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:22:33.814910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6816aa-4614-4979-87e6-7a32d7218786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:33.815689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6816aa-4614-4979-87e6-7a32d7218786 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:33.816048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6816aa-4614-4979-87e6-7a32d7218786 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:33.816402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6816aa-4614-4979-87e6-7a32d7218786 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:33.817187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6816aa-4614-4979-87e6-7a32d7218786 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:33.819216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6816aa-4614-4979-87e6-7a32d7218786 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:33.844784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3f88b-7fea-4f11-a915-70dfee3ba843 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:33.846051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3f88b-7fea-4f11-a915-70dfee3ba843 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:33.846524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3f88b-7fea-4f11-a915-70dfee3ba843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:33.868835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-65f3f88b-7fea-4f11-a915-70dfee3ba843 None None] MFA Rules not processed for user `68dd6976fe754e4ab64acd9beb22d266`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:33.871497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-65f3f88b-7fea-4f11-a915-70dfee3ba843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:33.976791 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1798/3542] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:22:33.990730 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1745/3543] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:22:33 2022] POST /identity/v3/users => generated 301 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:22:33.998267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3f88b-7fea-4f11-a915-70dfee3ba843 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:34.020248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3f88b-7fea-4f11-a915-70dfee3ba843 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:34.036735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c947c4-46bf-4a2e-80ef-aae46e91bac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:34.037637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c947c4-46bf-4a2e-80ef-aae46e91bac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:34.038079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c947c4-46bf-4a2e-80ef-aae46e91bac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:34.038565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c947c4-46bf-4a2e-80ef-aae46e91bac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:34.039516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c947c4-46bf-4a2e-80ef-aae46e91bac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:34.041615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c947c4-46bf-4a2e-80ef-aae46e91bac6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:34.068699 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1799/3544] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:22:34.072861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6816aa-4614-4979-87e6-7a32d7218786 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:34.107824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6816aa-4614-4979-87e6-7a32d7218786 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:34.119143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f51c2a-ae1b-4ebb-b77b-b3bf36a2b1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:34.121238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f51c2a-ae1b-4ebb-b77b-b3bf36a2b1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:34.121738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f51c2a-ae1b-4ebb-b77b-b3bf36a2b1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:34.122890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f51c2a-ae1b-4ebb-b77b-b3bf36a2b1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:34.123995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f51c2a-ae1b-4ebb-b77b-b3bf36a2b1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:34.147126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f51c2a-ae1b-4ebb-b77b-b3bf36a2b1e0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:34.198672 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1746/3545] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:22:34.204005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c947c4-46bf-4a2e-80ef-aae46e91bac6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:34.219170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c947c4-46bf-4a2e-80ef-aae46e91bac6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:34.239334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a6e34-6bfa-4c5e-9482-42b7e6c918cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:34.240318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a6e34-6bfa-4c5e-9482-42b7e6c918cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:34.243671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a6e34-6bfa-4c5e-9482-42b7e6c918cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:34.244847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a6e34-6bfa-4c5e-9482-42b7e6c918cd admin admin] PATH_INFO: `/v3/projects/8342cba8bba040449f81fa7164d41a99/users/cca097bdc4e242d4be74a3e6e71bff8b/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:34.291161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a6e34-6bfa-4c5e-9482-42b7e6c918cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8342cba8bba040449f81fa7164d41a99, user_id=cca097bdc4e242d4be74a3e6e71bff8b, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:34.294509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a6e34-6bfa-4c5e-9482-42b7e6c918cd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:34.427046 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1800/3546] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:22:34 2022] PUT /identity/v3/projects/8342cba8bba040449f81fa7164d41a99/users/cca097bdc4e242d4be74a3e6e71bff8b/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:22:34.439851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0297c-8cb5-44ff-b271-c5b91cfdd518 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:34.440483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0297c-8cb5-44ff-b271-c5b91cfdd518 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:34.440967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c0297c-8cb5-44ff-b271-c5b91cfdd518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:34.478440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-48c0297c-8cb5-44ff-b271-c5b91cfdd518 None None] MFA Rules not processed for user `cca097bdc4e242d4be74a3e6e71bff8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:34.478440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-48c0297c-8cb5-44ff-b271-c5b91cfdd518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:34.603032 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1747/3547] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:35.273268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a6e34-6bfa-4c5e-9482-42b7e6c918cd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:35.275506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f96a6e34-6bfa-4c5e-9482-42b7e6c918cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:35.324254 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:22:35.502931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a6e34-6bfa-4c5e-9482-42b7e6c918cd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:35.514162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683cb1b-9d73-4e20-bc20-e80f2b07ae1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:35.515407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683cb1b-9d73-4e20-bc20-e80f2b07ae1a service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:35.516479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683cb1b-9d73-4e20-bc20-e80f2b07ae1a service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:35.516948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683cb1b-9d73-4e20-bc20-e80f2b07ae1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:35.533338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683cb1b-9d73-4e20-bc20-e80f2b07ae1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:35.535597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683cb1b-9d73-4e20-bc20-e80f2b07ae1a service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:35.549401 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1801/3548] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:22:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:22:35.605683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0297c-8cb5-44ff-b271-c5b91cfdd518 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:35.732753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c0297c-8cb5-44ff-b271-c5b91cfdd518 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:35.742392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff094a1-54a6-45f6-9695-b175a170e4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:35.743301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff094a1-54a6-45f6-9695-b175a170e4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:35.743592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff094a1-54a6-45f6-9695-b175a170e4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:35.743874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff094a1-54a6-45f6-9695-b175a170e4d6 admin admin] PATH_INFO: `/v3/users/cca097bdc4e242d4be74a3e6e71bff8b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:35.749600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff094a1-54a6-45f6-9695-b175a170e4d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cca097bdc4e242d4be74a3e6e71bff8b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:35.757953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff094a1-54a6-45f6-9695-b175a170e4d6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:35.963099 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:22:35.966678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6ff094a1-54a6-45f6-9695-b175a170e4d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cca097bdc4e242d4be74a3e6e71bff8b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:35.982082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6ff094a1-54a6-45f6-9695-b175a170e4d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cca097bdc4e242d4be74a3e6e71bff8b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:35.983058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6ff094a1-54a6-45f6-9695-b175a170e4d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cca097bdc4e242d4be74a3e6e71bff8b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:35.983693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6ff094a1-54a6-45f6-9695-b175a170e4d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cca097bdc4e242d4be74a3e6e71bff8b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:35.993687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6ff094a1-54a6-45f6-9695-b175a170e4d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cca097bdc4e242d4be74a3e6e71bff8b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:36.107436 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1748/3549] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:22:35 2022] DELETE /identity/v3/users/cca097bdc4e242d4be74a3e6e71bff8b => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:22:36.119462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba530c-5f0c-4ebb-8006-3080e0c5ad25 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:36.119462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba530c-5f0c-4ebb-8006-3080e0c5ad25 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:36.119462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba530c-5f0c-4ebb-8006-3080e0c5ad25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:36.137754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-09ba530c-5f0c-4ebb-8006-3080e0c5ad25 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:36.139598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-09ba530c-5f0c-4ebb-8006-3080e0c5ad25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:36.240278 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1802/3550] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:36.266136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff094a1-54a6-45f6-9695-b175a170e4d6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:36.266136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6ff094a1-54a6-45f6-9695-b175a170e4d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:36.418291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff094a1-54a6-45f6-9695-b175a170e4d6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:36.431091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a1be8-f813-4e34-9e2f-a9b4c5af8b85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:36.432037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a1be8-f813-4e34-9e2f-a9b4c5af8b85 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:36.432037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a1be8-f813-4e34-9e2f-a9b4c5af8b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:36.432340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a1be8-f813-4e34-9e2f-a9b4c5af8b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:36.476799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a1be8-f813-4e34-9e2f-a9b4c5af8b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:36.476799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a1be8-f813-4e34-9e2f-a9b4c5af8b85 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:36.508323 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1749/3551] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:22:37.878752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba530c-5f0c-4ebb-8006-3080e0c5ad25 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:37.880860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-09ba530c-5f0c-4ebb-8006-3080e0c5ad25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:37.916565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba530c-5f0c-4ebb-8006-3080e0c5ad25 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:37.935452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40c239-b712-49c9-9d52-2f836a982c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:37.937260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40c239-b712-49c9-9d52-2f836a982c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:37.937680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40c239-b712-49c9-9d52-2f836a982c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:37.938059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40c239-b712-49c9-9d52-2f836a982c4f admin admin] PATH_INFO: `/v3/projects/8342cba8bba040449f81fa7164d41a99` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:37.943506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40c239-b712-49c9-9d52-2f836a982c4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8342cba8bba040449f81fa7164d41a99)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:37.945877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40c239-b712-49c9-9d52-2f836a982c4f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:38.130830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ce40c239-b712-49c9-9d52-2f836a982c4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8342cba8bba040449f81fa7164d41a99', 'request_id': 'req-ce40c239-b712-49c9-9d52-2f836a982c4f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:38.143785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ce40c239-b712-49c9-9d52-2f836a982c4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8342cba8bba040449f81fa7164d41a99', 'request_id': 'req-ce40c239-b712-49c9-9d52-2f836a982c4f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:38.168190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ce40c239-b712-49c9-9d52-2f836a982c4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8342cba8bba040449f81fa7164d41a99', 'request_id': 'req-ce40c239-b712-49c9-9d52-2f836a982c4f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:38.307830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ce40c239-b712-49c9-9d52-2f836a982c4f admin admin] The token cache is being invalidate because project 8342cba8bba040449f81fa7164d41a99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:22:38.308215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ce40c239-b712-49c9-9d52-2f836a982c4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:38.309031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ce40c239-b712-49c9-9d52-2f836a982c4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:38.313343 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1803/3552] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:22:37 2022] DELETE /identity/v3/projects/8342cba8bba040449f81fa7164d41a99 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:22:38.318824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cf9fc-9801-4be9-81ac-a6a134abe73b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:38.322501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cf9fc-9801-4be9-81ac-a6a134abe73b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:38.323463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317cf9fc-9801-4be9-81ac-a6a134abe73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:38.371421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-317cf9fc-9801-4be9-81ac-a6a134abe73b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:38.372994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-317cf9fc-9801-4be9-81ac-a6a134abe73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:38.539066 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1750/3553] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:38.541047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67062762-65e9-4d57-a891-665b7255a227 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:38.541226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67062762-65e9-4d57-a891-665b7255a227 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:38.541542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67062762-65e9-4d57-a891-665b7255a227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:38.579066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-67062762-65e9-4d57-a891-665b7255a227 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:38.581535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-67062762-65e9-4d57-a891-665b7255a227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:38.591132 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1804/3554] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:22:38.596736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cf9fc-9801-4be9-81ac-a6a134abe73b None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:38.612217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317cf9fc-9801-4be9-81ac-a6a134abe73b None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:38.632809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78075425-fd46-48b6-9a18-827a29a792e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:38.632809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78075425-fd46-48b6-9a18-827a29a792e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:38.632809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78075425-fd46-48b6-9a18-827a29a792e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:38.632809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78075425-fd46-48b6-9a18-827a29a792e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:38.633945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78075425-fd46-48b6-9a18-827a29a792e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:22:38.633945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78075425-fd46-48b6-9a18-827a29a792e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:38.633945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78075425-fd46-48b6-9a18-827a29a792e0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:38.656175 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1751/3555] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:22:38.660526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67062762-65e9-4d57-a891-665b7255a227 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:38.674801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67062762-65e9-4d57-a891-665b7255a227 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:38.691899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e7faa7-b2e2-4454-a3a3-a826ba736176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:38.692995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7faa7-b2e2-4454-a3a3-a826ba736176 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:38.693503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7faa7-b2e2-4454-a3a3-a826ba736176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:38.694133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e7faa7-b2e2-4454-a3a3-a826ba736176 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:38.696606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7faa7-b2e2-4454-a3a3-a826ba736176 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:38.699191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e7faa7-b2e2-4454-a3a3-a826ba736176 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:38.721332 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:22:38.793105 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1805/3556] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:22:38 2022] POST /identity/v3/projects => generated 403 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:22:38.798136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78075425-fd46-48b6-9a18-827a29a792e0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:38.810872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78075425-fd46-48b6-9a18-827a29a792e0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:38.908972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deabb5f-5365-4833-859d-6bf9dc04d09c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:38.909449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deabb5f-5365-4833-859d-6bf9dc04d09c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:38.909542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deabb5f-5365-4833-859d-6bf9dc04d09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:38.940760 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:22:38.945075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0deabb5f-5365-4833-859d-6bf9dc04d09c None None] MFA Rules not processed for user `68dd6976fe754e4ab64acd9beb22d266`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:38.947845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0deabb5f-5365-4833-859d-6bf9dc04d09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:38.962903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411898c5-b38d-4b30-975d-0327311cc7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:38.964039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411898c5-b38d-4b30-975d-0327311cc7a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:38.965631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411898c5-b38d-4b30-975d-0327311cc7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:38.965631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411898c5-b38d-4b30-975d-0327311cc7a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:38.968016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411898c5-b38d-4b30-975d-0327311cc7a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:38.976376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411898c5-b38d-4b30-975d-0327311cc7a2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:39.048438 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1806/3557] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:39.082993 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1752/3558] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:22:38 2022] POST /identity/v3/users => generated 302 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:22:39.083343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deabb5f-5365-4833-859d-6bf9dc04d09c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:39.094659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deabb5f-5365-4833-859d-6bf9dc04d09c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:39.103488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36222a11-f89e-4630-80fc-4738898a9e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:39.104175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36222a11-f89e-4630-80fc-4738898a9e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:39.104464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36222a11-f89e-4630-80fc-4738898a9e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:39.104871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36222a11-f89e-4630-80fc-4738898a9e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:39.105608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36222a11-f89e-4630-80fc-4738898a9e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:39.108029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36222a11-f89e-4630-80fc-4738898a9e89 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:39.126514 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1807/3559] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:22:39.128518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411898c5-b38d-4b30-975d-0327311cc7a2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:39.139559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411898c5-b38d-4b30-975d-0327311cc7a2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:39.147142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c7147-51c4-4298-bfe1-f23868b54f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:39.147142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c7147-51c4-4298-bfe1-f23868b54f00 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:39.147434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c7147-51c4-4298-bfe1-f23868b54f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:39.147685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c7147-51c4-4298-bfe1-f23868b54f00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:39.148819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c7147-51c4-4298-bfe1-f23868b54f00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:39.150571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c7147-51c4-4298-bfe1-f23868b54f00 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:39.167827 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1753/3560] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:22:39.168029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36222a11-f89e-4630-80fc-4738898a9e89 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:39.180267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36222a11-f89e-4630-80fc-4738898a9e89 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:39.188357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847746a4-9e17-430d-b3b6-95e6a7425f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:39.189859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847746a4-9e17-430d-b3b6-95e6a7425f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:39.190340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847746a4-9e17-430d-b3b6-95e6a7425f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:39.190912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847746a4-9e17-430d-b3b6-95e6a7425f30 admin admin] PATH_INFO: `/v3/projects/62ffc3b784554186922368aafd349e6a/users/3e475a5d289e46c0b0429c84fb9ee0fb/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:39.230928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847746a4-9e17-430d-b3b6-95e6a7425f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ffc3b784554186922368aafd349e6a, user_id=3e475a5d289e46c0b0429c84fb9ee0fb, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:39.235066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847746a4-9e17-430d-b3b6-95e6a7425f30 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:39.324318 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1808/3561] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:22:39 2022] PUT /identity/v3/projects/62ffc3b784554186922368aafd349e6a/users/3e475a5d289e46c0b0429c84fb9ee0fb/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:22:39.331374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d5df9-6b34-4c76-a98f-4130c153038b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:39.331845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d5df9-6b34-4c76-a98f-4130c153038b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:39.332116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d5df9-6b34-4c76-a98f-4130c153038b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:39.377887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e96d5df9-6b34-4c76-a98f-4130c153038b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:39.379151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e96d5df9-6b34-4c76-a98f-4130c153038b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:39.458777 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1754/3562] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:39.489435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847746a4-9e17-430d-b3b6-95e6a7425f30 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:39.492157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-847746a4-9e17-430d-b3b6-95e6a7425f30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:39.570031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847746a4-9e17-430d-b3b6-95e6a7425f30 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:39.576567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75f878-61d9-4799-be8a-bf73fad26d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:39.577827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75f878-61d9-4799-be8a-bf73fad26d8a service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:39.578167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75f878-61d9-4799-be8a-bf73fad26d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:39.578451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75f878-61d9-4799-be8a-bf73fad26d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:39.593628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75f878-61d9-4799-be8a-bf73fad26d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:39.595844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75f878-61d9-4799-be8a-bf73fad26d8a service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:39.609853 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1809/3563] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:22:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:22:43.463784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fd199-a2a4-4bf9-bb91-bebf35201b3f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:43.465338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fd199-a2a4-4bf9-bb91-bebf35201b3f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:43.465831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10fd199-a2a4-4bf9-bb91-bebf35201b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:43.499756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b10fd199-a2a4-4bf9-bb91-bebf35201b3f None None] MFA Rules not processed for user `68dd6976fe754e4ab64acd9beb22d266`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:43.501726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b10fd199-a2a4-4bf9-bb91-bebf35201b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:43.648592 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1755/3564] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:44.194405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c61ed-57de-4405-b695-a5d5876cf1db None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:44.194844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c61ed-57de-4405-b695-a5d5876cf1db None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:44.194987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c61ed-57de-4405-b695-a5d5876cf1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:44.226329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-520c61ed-57de-4405-b695-a5d5876cf1db None None] MFA Rules not processed for user `68dd6976fe754e4ab64acd9beb22d266`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:44.228364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-520c61ed-57de-4405-b695-a5d5876cf1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:44.237736 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1810/3565] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:45.613741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb567a87-76f6-4e95-b949-fda209d1ffae None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:45.614372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb567a87-76f6-4e95-b949-fda209d1ffae None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:45.614372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb567a87-76f6-4e95-b949-fda209d1ffae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:45.652315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-bb567a87-76f6-4e95-b949-fda209d1ffae None None] MFA Rules not processed for user `68dd6976fe754e4ab64acd9beb22d266`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:45.655233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bb567a87-76f6-4e95-b949-fda209d1ffae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:45.673265 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1756/3566] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:46.135538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c61ed-57de-4405-b695-a5d5876cf1db None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:46.138473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-520c61ed-57de-4405-b695-a5d5876cf1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:46.158202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c61ed-57de-4405-b695-a5d5876cf1db None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:46.164165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37670c-5d08-4e04-b7e7-cbe1a8485623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:46.165277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37670c-5d08-4e04-b7e7-cbe1a8485623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:46.165840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37670c-5d08-4e04-b7e7-cbe1a8485623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:46.171287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37670c-5d08-4e04-b7e7-cbe1a8485623 admin admin] PATH_INFO: `/v3/users/9099143abbce4dc78f650d702d51af72` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:46.171287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37670c-5d08-4e04-b7e7-cbe1a8485623 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9099143abbce4dc78f650d702d51af72)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:46.171811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37670c-5d08-4e04-b7e7-cbe1a8485623 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:46.371287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5b37670c-5d08-4e04-b7e7-cbe1a8485623 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9099143abbce4dc78f650d702d51af72'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:46.425431 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:22:46.439526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5b37670c-5d08-4e04-b7e7-cbe1a8485623 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9099143abbce4dc78f650d702d51af72'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:46.450957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5b37670c-5d08-4e04-b7e7-cbe1a8485623 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9099143abbce4dc78f650d702d51af72'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:46.454359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5b37670c-5d08-4e04-b7e7-cbe1a8485623 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9099143abbce4dc78f650d702d51af72'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:46.576773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5b37670c-5d08-4e04-b7e7-cbe1a8485623 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9099143abbce4dc78f650d702d51af72'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:46.612808 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1811/3567] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:22:46 2022] DELETE /identity/v3/users/9099143abbce4dc78f650d702d51af72 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:22:46.662641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c738f-c646-4677-abcf-6b8e9bf0043e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:46.664868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c738f-c646-4677-abcf-6b8e9bf0043e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:46.665397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c738f-c646-4677-abcf-6b8e9bf0043e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:46.710583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5c2c738f-c646-4677-abcf-6b8e9bf0043e None None] MFA Rules not processed for user `68dd6976fe754e4ab64acd9beb22d266`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:46.711948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5c2c738f-c646-4677-abcf-6b8e9bf0043e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:46.814510 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1757/3568] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:46.975445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37670c-5d08-4e04-b7e7-cbe1a8485623 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:46.977011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5b37670c-5d08-4e04-b7e7-cbe1a8485623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:47.080849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37670c-5d08-4e04-b7e7-cbe1a8485623 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:47.089364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30abde93-f26b-4232-8caf-f85ecb3f0e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:47.091535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abde93-f26b-4232-8caf-f85ecb3f0e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:47.091826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abde93-f26b-4232-8caf-f85ecb3f0e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:47.092106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30abde93-f26b-4232-8caf-f85ecb3f0e59 admin admin] PATH_INFO: `/v3/projects/c1abf14b7d354c44935fb502294dca06` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:47.093867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abde93-f26b-4232-8caf-f85ecb3f0e59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1abf14b7d354c44935fb502294dca06)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:47.096783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30abde93-f26b-4232-8caf-f85ecb3f0e59 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:47.246058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-30abde93-f26b-4232-8caf-f85ecb3f0e59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1abf14b7d354c44935fb502294dca06', 'request_id': 'req-30abde93-f26b-4232-8caf-f85ecb3f0e59'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:47.257036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-30abde93-f26b-4232-8caf-f85ecb3f0e59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1abf14b7d354c44935fb502294dca06', 'request_id': 'req-30abde93-f26b-4232-8caf-f85ecb3f0e59'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:47.270622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-30abde93-f26b-4232-8caf-f85ecb3f0e59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1abf14b7d354c44935fb502294dca06', 'request_id': 'req-30abde93-f26b-4232-8caf-f85ecb3f0e59'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:47.349268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-30abde93-f26b-4232-8caf-f85ecb3f0e59 admin admin] The token cache is being invalidate because project c1abf14b7d354c44935fb502294dca06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:22:47.349711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-30abde93-f26b-4232-8caf-f85ecb3f0e59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:47.351315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-30abde93-f26b-4232-8caf-f85ecb3f0e59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:47.358005 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1812/3569] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:22:46 2022] DELETE /identity/v3/projects/c1abf14b7d354c44935fb502294dca06 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:22:47.359336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c738f-c646-4677-abcf-6b8e9bf0043e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:47.375705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2c738f-c646-4677-abcf-6b8e9bf0043e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:47.395919 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:22:47.477117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae31a33-3d5d-41c1-84b9-30eb1d7631ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:47.478473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae31a33-3d5d-41c1-84b9-30eb1d7631ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:47.479013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae31a33-3d5d-41c1-84b9-30eb1d7631ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:47.479440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae31a33-3d5d-41c1-84b9-30eb1d7631ae admin admin] PATH_INFO: `/v3/users/58aa09f776ab4ed0b15a1040102b370f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:47.480864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae31a33-3d5d-41c1-84b9-30eb1d7631ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=58aa09f776ab4ed0b15a1040102b370f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:47.484243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae31a33-3d5d-41c1-84b9-30eb1d7631ae admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:47.745428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25601ad-29f8-4594-b4cb-2049d47ee60b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:47.745734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25601ad-29f8-4594-b4cb-2049d47ee60b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:47.746009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25601ad-29f8-4594-b4cb-2049d47ee60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:47.774305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a25601ad-29f8-4594-b4cb-2049d47ee60b None None] MFA Rules not processed for user `68dd6976fe754e4ab64acd9beb22d266`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:47.781291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a25601ad-29f8-4594-b4cb-2049d47ee60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:47.798788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ae31a33-3d5d-41c1-84b9-30eb1d7631ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58aa09f776ab4ed0b15a1040102b370f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:47.830711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ae31a33-3d5d-41c1-84b9-30eb1d7631ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58aa09f776ab4ed0b15a1040102b370f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:47.832299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ae31a33-3d5d-41c1-84b9-30eb1d7631ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58aa09f776ab4ed0b15a1040102b370f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:47.833282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ae31a33-3d5d-41c1-84b9-30eb1d7631ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58aa09f776ab4ed0b15a1040102b370f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:47.847496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ae31a33-3d5d-41c1-84b9-30eb1d7631ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58aa09f776ab4ed0b15a1040102b370f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:47.893298 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1813/3570] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:47.955816 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1758/3571] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:22:47 2022] DELETE /identity/v3/users/58aa09f776ab4ed0b15a1040102b370f => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:22:48.741261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1a9de-20c6-456d-a7b3-a9b3effe2e4c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:48.741805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1a9de-20c6-456d-a7b3-a9b3effe2e4c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:48.741805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1a9de-20c6-456d-a7b3-a9b3effe2e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:48.766634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b1b1a9de-20c6-456d-a7b3-a9b3effe2e4c None None] MFA Rules not processed for user `68dd6976fe754e4ab64acd9beb22d266`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:48.767001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae31a33-3d5d-41c1-84b9-30eb1d7631ae admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:48.767864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b1b1a9de-20c6-456d-a7b3-a9b3effe2e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:48.768418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7ae31a33-3d5d-41c1-84b9-30eb1d7631ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:48.772442 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:22:48.850244 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1814/3572] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:48.886164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae31a33-3d5d-41c1-84b9-30eb1d7631ae admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:48.902527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f23bf9-4982-4d20-a00f-5c9e600863e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:48.905496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f23bf9-4982-4d20-a00f-5c9e600863e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:48.905857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f23bf9-4982-4d20-a00f-5c9e600863e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:48.906764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f23bf9-4982-4d20-a00f-5c9e600863e4 admin admin] PATH_INFO: `/v3/projects/ad4e70db1715482a97ac80b6cf582c00` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:48.908167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f23bf9-4982-4d20-a00f-5c9e600863e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad4e70db1715482a97ac80b6cf582c00)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:48.910833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f23bf9-4982-4d20-a00f-5c9e600863e4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:49.062326 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:22:49.074836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-13f23bf9-4982-4d20-a00f-5c9e600863e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad4e70db1715482a97ac80b6cf582c00', 'request_id': 'req-13f23bf9-4982-4d20-a00f-5c9e600863e4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:49.167689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-13f23bf9-4982-4d20-a00f-5c9e600863e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad4e70db1715482a97ac80b6cf582c00', 'request_id': 'req-13f23bf9-4982-4d20-a00f-5c9e600863e4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:49.177355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-13f23bf9-4982-4d20-a00f-5c9e600863e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad4e70db1715482a97ac80b6cf582c00', 'request_id': 'req-13f23bf9-4982-4d20-a00f-5c9e600863e4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:49.195638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-13f23bf9-4982-4d20-a00f-5c9e600863e4 admin admin] The token cache is being invalidate because project ad4e70db1715482a97ac80b6cf582c00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:22:49.196284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-13f23bf9-4982-4d20-a00f-5c9e600863e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:49.197120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-13f23bf9-4982-4d20-a00f-5c9e600863e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:22:49.199427 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1759/3573] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:22:48 2022] DELETE /identity/v3/projects/ad4e70db1715482a97ac80b6cf582c00 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:22:49.213862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f438a-58d6-45b5-bb32-383b3919aec4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:49.214341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f438a-58d6-45b5-bb32-383b3919aec4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:49.214756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f438a-58d6-45b5-bb32-383b3919aec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:49.264001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-096f438a-58d6-45b5-bb32-383b3919aec4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:49.266253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-096f438a-58d6-45b5-bb32-383b3919aec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:49.370843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73bc13-250d-4454-94c5-71a4be43d057 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:49.371407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73bc13-250d-4454-94c5-71a4be43d057 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:49.371900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73bc13-250d-4454-94c5-71a4be43d057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:49.393103 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1815/3574] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:22:49.400941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf4b92-6ea6-4eaa-8f44-4252b985bed2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:49.401458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf4b92-6ea6-4eaa-8f44-4252b985bed2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:49.401895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf4b92-6ea6-4eaa-8f44-4252b985bed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:49.411873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0c73bc13-250d-4454-94c5-71a4be43d057 None None] MFA Rules not processed for user `68dd6976fe754e4ab64acd9beb22d266`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:49.414852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0c73bc13-250d-4454-94c5-71a4be43d057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:49.446059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1ddf4b92-6ea6-4eaa-8f44-4252b985bed2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:49.447325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1ddf4b92-6ea6-4eaa-8f44-4252b985bed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:49.484389 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1816/3575] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:49.491242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf4b92-6ea6-4eaa-8f44-4252b985bed2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:49.513454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf4b92-6ea6-4eaa-8f44-4252b985bed2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:49.531989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450cd3a-0077-498e-8f6b-c2d727b3d325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:49.532684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450cd3a-0077-498e-8f6b-c2d727b3d325 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:49.532968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450cd3a-0077-498e-8f6b-c2d727b3d325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:49.533249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450cd3a-0077-498e-8f6b-c2d727b3d325 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:49.533994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450cd3a-0077-498e-8f6b-c2d727b3d325 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:22:49.534378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450cd3a-0077-498e-8f6b-c2d727b3d325 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:49.540502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4450cd3a-0077-498e-8f6b-c2d727b3d325 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:49.570566 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1817/3576] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:22:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:22:49.583777 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1760/3577] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:49.583979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450cd3a-0077-498e-8f6b-c2d727b3d325 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:49.629993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4450cd3a-0077-498e-8f6b-c2d727b3d325 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:49.657488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e504a00-43ce-4292-bc6f-a2edeb7829f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:49.658231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e504a00-43ce-4292-bc6f-a2edeb7829f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:49.658525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e504a00-43ce-4292-bc6f-a2edeb7829f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:49.658809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e504a00-43ce-4292-bc6f-a2edeb7829f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:49.659523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e504a00-43ce-4292-bc6f-a2edeb7829f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:49.661675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e504a00-43ce-4292-bc6f-a2edeb7829f4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:49.784239 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1818/3578] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:22:49 2022] POST /identity/v3/projects => generated 385 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:22:49.791053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73bc13-250d-4454-94c5-71a4be43d057 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:49.806565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73bc13-250d-4454-94c5-71a4be43d057 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:49.914129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee000e0-0a45-4fd4-a9ad-358e7596b496 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:49.914480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee000e0-0a45-4fd4-a9ad-358e7596b496 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:49.914768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee000e0-0a45-4fd4-a9ad-358e7596b496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:49.921709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be627ff-ac30-4bb5-b0c3-3703caf87a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:49.922710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be627ff-ac30-4bb5-b0c3-3703caf87a03 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:49.923109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be627ff-ac30-4bb5-b0c3-3703caf87a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:49.923484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be627ff-ac30-4bb5-b0c3-3703caf87a03 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:49.926562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be627ff-ac30-4bb5-b0c3-3703caf87a03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:49.930749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be627ff-ac30-4bb5-b0c3-3703caf87a03 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:49.976140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-eee000e0-0a45-4fd4-a9ad-358e7596b496 None None] MFA Rules not processed for user `3e475a5d289e46c0b0429c84fb9ee0fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:49.977542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-eee000e0-0a45-4fd4-a9ad-358e7596b496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:50.059149 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1761/3579] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:22:49 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:22:50.063934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be627ff-ac30-4bb5-b0c3-3703caf87a03 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:50.101612 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1819/3580] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:50.106163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be627ff-ac30-4bb5-b0c3-3703caf87a03 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:50.115617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de831c-b4fd-4f8f-9b91-92d2b12d5a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:50.116315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de831c-b4fd-4f8f-9b91-92d2b12d5a6c admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:50.116597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de831c-b4fd-4f8f-9b91-92d2b12d5a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:50.116870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de831c-b4fd-4f8f-9b91-92d2b12d5a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:50.117782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de831c-b4fd-4f8f-9b91-92d2b12d5a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:50.119605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de831c-b4fd-4f8f-9b91-92d2b12d5a6c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:50.143101 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1762/3581] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:22:50.147081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee000e0-0a45-4fd4-a9ad-358e7596b496 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:50.154750 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:22:50.181726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee000e0-0a45-4fd4-a9ad-358e7596b496 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:50.190416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c85bc-d5db-4b35-9ad0-3e30f4d05f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:50.191371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c85bc-d5db-4b35-9ad0-3e30f4d05f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:50.191842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c85bc-d5db-4b35-9ad0-3e30f4d05f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:50.192275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c85bc-d5db-4b35-9ad0-3e30f4d05f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:50.193178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c85bc-d5db-4b35-9ad0-3e30f4d05f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:50.197025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c85bc-d5db-4b35-9ad0-3e30f4d05f05 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:50.238028 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1820/3582] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:22:50.239530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de831c-b4fd-4f8f-9b91-92d2b12d5a6c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:50.258785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de831c-b4fd-4f8f-9b91-92d2b12d5a6c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:50.265378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8ad82-905d-46cf-aade-18bb1df43311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:50.266456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8ad82-905d-46cf-aade-18bb1df43311 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:50.266842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8ad82-905d-46cf-aade-18bb1df43311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:50.267220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8ad82-905d-46cf-aade-18bb1df43311 admin admin] PATH_INFO: `/v3/projects/d414f416e2de43748b63c4ca72bbb494/users/b3a68ad6956b4455a857df0d3ac76489/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:50.295638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8ad82-905d-46cf-aade-18bb1df43311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d414f416e2de43748b63c4ca72bbb494, user_id=b3a68ad6956b4455a857df0d3ac76489, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:50.295638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8ad82-905d-46cf-aade-18bb1df43311 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:50.396498 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1763/3583] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:22:50 2022] PUT /identity/v3/projects/d414f416e2de43748b63c4ca72bbb494/users/b3a68ad6956b4455a857df0d3ac76489/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:22:50.397177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb3bed-e61c-4b63-8e0b-7b8b8ccd080a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:50.397177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb3bed-e61c-4b63-8e0b-7b8b8ccd080a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:50.397177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fb3bed-e61c-4b63-8e0b-7b8b8ccd080a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:50.420941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-03fb3bed-e61c-4b63-8e0b-7b8b8ccd080a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:50.422452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-03fb3bed-e61c-4b63-8e0b-7b8b8ccd080a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:50.461548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8ad82-905d-46cf-aade-18bb1df43311 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:50.463450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-93e8ad82-905d-46cf-aade-18bb1df43311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:50.495459 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:22:50.570998 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1821/3584] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:22:50.586992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8ad82-905d-46cf-aade-18bb1df43311 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:50.593875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb3bed-e61c-4b63-8e0b-7b8b8ccd080a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:50.595357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd42af0-6f04-40a6-b05e-843c1251976e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:50.600182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd42af0-6f04-40a6-b05e-843c1251976e service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:50.600182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd42af0-6f04-40a6-b05e-843c1251976e service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:50.600426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-03fb3bed-e61c-4b63-8e0b-7b8b8ccd080a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:50.600523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd42af0-6f04-40a6-b05e-843c1251976e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:50.685071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd42af0-6f04-40a6-b05e-843c1251976e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:50.716815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd42af0-6f04-40a6-b05e-843c1251976e service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:50.717356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fb3bed-e61c-4b63-8e0b-7b8b8ccd080a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:50.717356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f67650-4489-4c6d-8e67-2605952f61c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:50.717546 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1764/3585] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:22:50 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:22:50.717870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f67650-4489-4c6d-8e67-2605952f61c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:50.717870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f67650-4489-4c6d-8e67-2605952f61c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:50.717870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f67650-4489-4c6d-8e67-2605952f61c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:50.717870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f67650-4489-4c6d-8e67-2605952f61c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:50.717870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f67650-4489-4c6d-8e67-2605952f61c6 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:50.730019 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1822/3586] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:22:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:22:52.085846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd42af0-6f04-40a6-b05e-843c1251976e service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:22:52.087351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fdd42af0-6f04-40a6-b05e-843c1251976e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:52.104609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd42af0-6f04-40a6-b05e-843c1251976e service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:22:52.111053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d205ef3-773f-47b6-b010-90960e3f8841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:22:52.111901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d205ef3-773f-47b6-b010-90960e3f8841 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:52.112193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d205ef3-773f-47b6-b010-90960e3f8841 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:52.112473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d205ef3-773f-47b6-b010-90960e3f8841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:52.115751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7d205ef3-773f-47b6-b010-90960e3f8841 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:52.136832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d205ef3-773f-47b6-b010-90960e3f8841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:22:52.144500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d205ef3-773f-47b6-b010-90960e3f8841 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:22:52.160664 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1765/3587] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:22:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:22:53.899072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41b459-6c23-4666-9b39-9b048862a4c9 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:22:53.899595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41b459-6c23-4666-9b39-9b048862a4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:22:53.899715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41b459-6c23-4666-9b39-9b048862a4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:22:53.928854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1e41b459-6c23-4666-9b39-9b048862a4c9 None None] MFA Rules not processed for user `68dd6976fe754e4ab64acd9beb22d266`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:22:53.931446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1e41b459-6c23-4666-9b39-9b048862a4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:22:54.133079 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1823/3588] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:22:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:01.522364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db5220-24ba-4bfb-b533-6a6489e3c16a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:01.523180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db5220-24ba-4bfb-b533-6a6489e3c16a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:01.523640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db5220-24ba-4bfb-b533-6a6489e3c16a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:01.561498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b9db5220-24ba-4bfb-b533-6a6489e3c16a None None] MFA Rules not processed for user `b3a68ad6956b4455a857df0d3ac76489`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:01.563219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b9db5220-24ba-4bfb-b533-6a6489e3c16a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:01.708959 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1766/3589] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:01.713344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41b459-6c23-4666-9b39-9b048862a4c9 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:01.729020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41b459-6c23-4666-9b39-9b048862a4c9 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:01.734636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85452866-4e76-4287-bdb0-511723484a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:01.735321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85452866-4e76-4287-bdb0-511723484a6e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:01.735604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85452866-4e76-4287-bdb0-511723484a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:01.736067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85452866-4e76-4287-bdb0-511723484a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:01.736924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85452866-4e76-4287-bdb0-511723484a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:01.739249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85452866-4e76-4287-bdb0-511723484a6e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:01.845640 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1824/3590] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:23:01 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:23:01.848041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db5220-24ba-4bfb-b533-6a6489e3c16a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:01.878195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db5220-24ba-4bfb-b533-6a6489e3c16a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:01.948116 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:23:01.989007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900dc32-b8a4-44e3-bcb6-d50f3715529d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:01.990637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900dc32-b8a4-44e3-bcb6-d50f3715529d admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:01.991747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900dc32-b8a4-44e3-bcb6-d50f3715529d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:01.992209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900dc32-b8a4-44e3-bcb6-d50f3715529d admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:01.994164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900dc32-b8a4-44e3-bcb6-d50f3715529d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:01.997774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7900dc32-b8a4-44e3-bcb6-d50f3715529d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:02.086587 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1767/3591] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:23:01 2022] POST /identity/v3/users => generated 298 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:23:02.087935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85452866-4e76-4287-bdb0-511723484a6e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:02.107178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85452866-4e76-4287-bdb0-511723484a6e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:02.121165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8f632-5690-42c1-a00c-b48dab0985c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:02.122872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8f632-5690-42c1-a00c-b48dab0985c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:02.123540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8f632-5690-42c1-a00c-b48dab0985c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:02.123540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8f632-5690-42c1-a00c-b48dab0985c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:02.126381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8f632-5690-42c1-a00c-b48dab0985c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:02.130353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8f632-5690-42c1-a00c-b48dab0985c8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:02.152808 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1825/3592] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:23:02.154416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900dc32-b8a4-44e3-bcb6-d50f3715529d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:02.174613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900dc32-b8a4-44e3-bcb6-d50f3715529d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:02.191070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669cfd9-dcf2-41a1-a636-0f19dbe35927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:02.192066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669cfd9-dcf2-41a1-a636-0f19dbe35927 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:02.192358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669cfd9-dcf2-41a1-a636-0f19dbe35927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:02.192709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669cfd9-dcf2-41a1-a636-0f19dbe35927 admin admin] PATH_INFO: `/v3/projects/604c073337934c7b9a6aa984424b5ea4/users/3f51c716f5ca4712b9de904ffbbe1bdd/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:02.232568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669cfd9-dcf2-41a1-a636-0f19dbe35927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=604c073337934c7b9a6aa984424b5ea4, user_id=3f51c716f5ca4712b9de904ffbbe1bdd, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:02.236761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669cfd9-dcf2-41a1-a636-0f19dbe35927 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:02.345704 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1768/3593] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:23:02 2022] PUT /identity/v3/projects/604c073337934c7b9a6aa984424b5ea4/users/3f51c716f5ca4712b9de904ffbbe1bdd/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:23:02.346929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8f632-5690-42c1-a00c-b48dab0985c8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:02.361014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8f632-5690-42c1-a00c-b48dab0985c8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:02.369200 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:23:02.448799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbfe25-dce7-4611-8d0c-bd04ae17850c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:02.449527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbfe25-dce7-4611-8d0c-bd04ae17850c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:02.449827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbfe25-dce7-4611-8d0c-bd04ae17850c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:02.450710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbfe25-dce7-4611-8d0c-bd04ae17850c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:02.457092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbfe25-dce7-4611-8d0c-bd04ae17850c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:02.457092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbfe25-dce7-4611-8d0c-bd04ae17850c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:02.469332 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1826/3594] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:23:02.470578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669cfd9-dcf2-41a1-a636-0f19dbe35927 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:02.482875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669cfd9-dcf2-41a1-a636-0f19dbe35927 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:02.488156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e22dec-60bf-4204-b803-3fc9adfbf899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:02.489320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e22dec-60bf-4204-b803-3fc9adfbf899 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:02.489613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e22dec-60bf-4204-b803-3fc9adfbf899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:02.489895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e22dec-60bf-4204-b803-3fc9adfbf899 admin admin] PATH_INFO: `/v3/projects/604c073337934c7b9a6aa984424b5ea4/users/3f51c716f5ca4712b9de904ffbbe1bdd/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:02.492272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e22dec-60bf-4204-b803-3fc9adfbf899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=604c073337934c7b9a6aa984424b5ea4, user_id=3f51c716f5ca4712b9de904ffbbe1bdd, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:02.504754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e22dec-60bf-4204-b803-3fc9adfbf899 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:02.514197 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1769/3595] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:23:02 2022] PUT /identity/v3/projects/604c073337934c7b9a6aa984424b5ea4/users/3f51c716f5ca4712b9de904ffbbe1bdd/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:23:08.031912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbfe25-dce7-4611-8d0c-bd04ae17850c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:08.033698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a2cbfe25-dce7-4611-8d0c-bd04ae17850c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:08.054469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbfe25-dce7-4611-8d0c-bd04ae17850c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:08.201766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea525be-59f7-4881-9297-d544dfba5d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:08.202709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea525be-59f7-4881-9297-d544dfba5d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:08.203104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea525be-59f7-4881-9297-d544dfba5d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:08.203388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea525be-59f7-4881-9297-d544dfba5d3d admin admin] PATH_INFO: `/v3/users/422a87b2c32043daa4631c90a612b9ea` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:08.210078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea525be-59f7-4881-9297-d544dfba5d3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=422a87b2c32043daa4631c90a612b9ea)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:08.212263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea525be-59f7-4881-9297-d544dfba5d3d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:08.483926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3ea525be-59f7-4881-9297-d544dfba5d3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '422a87b2c32043daa4631c90a612b9ea'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:08.510521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3ea525be-59f7-4881-9297-d544dfba5d3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '422a87b2c32043daa4631c90a612b9ea'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:08.527215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3ea525be-59f7-4881-9297-d544dfba5d3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '422a87b2c32043daa4631c90a612b9ea'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:08.527813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3ea525be-59f7-4881-9297-d544dfba5d3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '422a87b2c32043daa4631c90a612b9ea'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:08.635628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3ea525be-59f7-4881-9297-d544dfba5d3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '422a87b2c32043daa4631c90a612b9ea'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:08.644339 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1827/3596] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:23:08 2022] DELETE /identity/v3/users/422a87b2c32043daa4631c90a612b9ea => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:23:10.318964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e22dec-60bf-4204-b803-3fc9adfbf899 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:10.321693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-01e22dec-60bf-4204-b803-3fc9adfbf899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:10.349173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e22dec-60bf-4204-b803-3fc9adfbf899 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:10.469984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e498683-5915-4752-a4ae-0551977eb3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:10.471169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e498683-5915-4752-a4ae-0551977eb3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:10.471612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e498683-5915-4752-a4ae-0551977eb3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:10.472328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e498683-5915-4752-a4ae-0551977eb3c7 admin admin] PATH_INFO: `/v3/projects/b96080b2953f4fb086a9e077e9a2998a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:10.473872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e498683-5915-4752-a4ae-0551977eb3c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b96080b2953f4fb086a9e077e9a2998a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:10.475876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e498683-5915-4752-a4ae-0551977eb3c7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:10.616101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8e498683-5915-4752-a4ae-0551977eb3c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b96080b2953f4fb086a9e077e9a2998a', 'request_id': 'req-8e498683-5915-4752-a4ae-0551977eb3c7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:10.710609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8e498683-5915-4752-a4ae-0551977eb3c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b96080b2953f4fb086a9e077e9a2998a', 'request_id': 'req-8e498683-5915-4752-a4ae-0551977eb3c7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:10.721090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8e498683-5915-4752-a4ae-0551977eb3c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b96080b2953f4fb086a9e077e9a2998a', 'request_id': 'req-8e498683-5915-4752-a4ae-0551977eb3c7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:10.758495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8e498683-5915-4752-a4ae-0551977eb3c7 admin admin] The token cache is being invalidate because project b96080b2953f4fb086a9e077e9a2998a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:23:10.758955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8e498683-5915-4752-a4ae-0551977eb3c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:10.764448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8e498683-5915-4752-a4ae-0551977eb3c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:10.770437 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1770/3597] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:23:10 2022] DELETE /identity/v3/projects/b96080b2953f4fb086a9e077e9a2998a => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:23:10.772144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e93c3-a4a4-4be5-95bd-335e667b3c22 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:10.772587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e93c3-a4a4-4be5-95bd-335e667b3c22 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:10.772682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e93c3-a4a4-4be5-95bd-335e667b3c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:10.816682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-296e93c3-a4a4-4be5-95bd-335e667b3c22 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:10.817871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-296e93c3-a4a4-4be5-95bd-335e667b3c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:10.859606 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:23:10.945973 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1828/3598] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:10.954261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be429167-e5c4-4d55-b2af-6e0e9a6a94ca None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:10.954559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be429167-e5c4-4d55-b2af-6e0e9a6a94ca None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:10.954843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be429167-e5c4-4d55-b2af-6e0e9a6a94ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:10.982781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-be429167-e5c4-4d55-b2af-6e0e9a6a94ca None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:10.984060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-be429167-e5c4-4d55-b2af-6e0e9a6a94ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:11.019971 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1771/3599] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:11.024187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e93c3-a4a4-4be5-95bd-335e667b3c22 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:11.045963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e93c3-a4a4-4be5-95bd-335e667b3c22 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:11.058320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95e984-8b52-4a8f-bade-74203da7a035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:11.060041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95e984-8b52-4a8f-bade-74203da7a035 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:11.060743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95e984-8b52-4a8f-bade-74203da7a035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:11.061180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95e984-8b52-4a8f-bade-74203da7a035 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:11.063918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95e984-8b52-4a8f-bade-74203da7a035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:23:11.064822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95e984-8b52-4a8f-bade-74203da7a035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:11.066777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf95e984-8b52-4a8f-bade-74203da7a035 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:11.088705 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1829/3600] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:23:11.093647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be429167-e5c4-4d55-b2af-6e0e9a6a94ca None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:11.114710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be429167-e5c4-4d55-b2af-6e0e9a6a94ca None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:11.125636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a8fca-a6c9-4f53-959c-e3b01dd4f3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:11.128340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a8fca-a6c9-4f53-959c-e3b01dd4f3be admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:11.128896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a8fca-a6c9-4f53-959c-e3b01dd4f3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:11.129355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a8fca-a6c9-4f53-959c-e3b01dd4f3be admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:11.130404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a8fca-a6c9-4f53-959c-e3b01dd4f3be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:11.134554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a8fca-a6c9-4f53-959c-e3b01dd4f3be admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:11.149394 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:23:11.250429 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1772/3601] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:23:11 2022] POST /identity/v3/projects => generated 391 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:23:11.254591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95e984-8b52-4a8f-bade-74203da7a035 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:11.267040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95e984-8b52-4a8f-bade-74203da7a035 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:11.344476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7b0d3-f872-435a-b0ac-3ecabc7f1eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:11.345419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7b0d3-f872-435a-b0ac-3ecabc7f1eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:11.346720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7b0d3-f872-435a-b0ac-3ecabc7f1eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:11.347150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a7b0d3-f872-435a-b0ac-3ecabc7f1eb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:11.348403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7b0d3-f872-435a-b0ac-3ecabc7f1eb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:11.351069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a7b0d3-f872-435a-b0ac-3ecabc7f1eb0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:11.484943 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1830/3602] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:23:11 2022] POST /identity/v3/users => generated 296 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:23:11.489309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a8fca-a6c9-4f53-959c-e3b01dd4f3be admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:11.504694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a8fca-a6c9-4f53-959c-e3b01dd4f3be admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:11.533589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a0ccf-8bbf-415a-9737-caf4dee09cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:11.538950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a0ccf-8bbf-415a-9737-caf4dee09cce admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:11.539447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a0ccf-8bbf-415a-9737-caf4dee09cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:11.540745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a0ccf-8bbf-415a-9737-caf4dee09cce admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:11.541674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a0ccf-8bbf-415a-9737-caf4dee09cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:11.543698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a0ccf-8bbf-415a-9737-caf4dee09cce admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:11.566569 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1773/3603] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:23:11.570530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7b0d3-f872-435a-b0ac-3ecabc7f1eb0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:11.594076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a7b0d3-f872-435a-b0ac-3ecabc7f1eb0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:11.600906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f51b2-fee0-42bb-916e-e243fe32178d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:11.601938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f51b2-fee0-42bb-916e-e243fe32178d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:11.602423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f51b2-fee0-42bb-916e-e243fe32178d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:11.602953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f51b2-fee0-42bb-916e-e243fe32178d admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:11.604123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f51b2-fee0-42bb-916e-e243fe32178d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:11.613925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f51b2-fee0-42bb-916e-e243fe32178d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:11.629326 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1831/3604] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:23:11.631298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a0ccf-8bbf-415a-9737-caf4dee09cce admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:11.642028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a0ccf-8bbf-415a-9737-caf4dee09cce admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:11.647546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59676046-cf87-46ed-9a5d-a645c2929b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:11.648531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59676046-cf87-46ed-9a5d-a645c2929b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:11.648888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59676046-cf87-46ed-9a5d-a645c2929b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:11.649241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59676046-cf87-46ed-9a5d-a645c2929b48 admin admin] PATH_INFO: `/v3/projects/ec29014a0a8a422d8ed94d2fa205be10/users/cf357eaa322546a6aa44101dae62af13/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:11.665670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59676046-cf87-46ed-9a5d-a645c2929b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec29014a0a8a422d8ed94d2fa205be10, user_id=cf357eaa322546a6aa44101dae62af13, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:11.668432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59676046-cf87-46ed-9a5d-a645c2929b48 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:11.756846 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1774/3605] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:23:11 2022] PUT /identity/v3/projects/ec29014a0a8a422d8ed94d2fa205be10/users/cf357eaa322546a6aa44101dae62af13/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:23:11.757857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ced08-9af9-45e4-bca7-1b67a6d58f01 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:11.758431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ced08-9af9-45e4-bca7-1b67a6d58f01 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:11.758792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ced08-9af9-45e4-bca7-1b67a6d58f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:11.781111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-865ced08-9af9-45e4-bca7-1b67a6d58f01 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:11.782489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-865ced08-9af9-45e4-bca7-1b67a6d58f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:11.874135 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1832/3606] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:23:11.912103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59676046-cf87-46ed-9a5d-a645c2929b48 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:11.914542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-59676046-cf87-46ed-9a5d-a645c2929b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:12.059430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59676046-cf87-46ed-9a5d-a645c2929b48 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:12.067470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1e9b8-9f22-4f5a-aa71-59c77958e3d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:12.075816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1e9b8-9f22-4f5a-aa71-59c77958e3d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:12.075816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1e9b8-9f22-4f5a-aa71-59c77958e3d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:12.075816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1e9b8-9f22-4f5a-aa71-59c77958e3d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:12.088584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1e9b8-9f22-4f5a-aa71-59c77958e3d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:12.091347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1e9b8-9f22-4f5a-aa71-59c77958e3d8 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:12.107421 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1775/3607] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:23:14.290220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e9cdd-c8db-4621-aa45-b6fa0fce1578 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:14.290850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e9cdd-c8db-4621-aa45-b6fa0fce1578 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:14.290850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e9cdd-c8db-4621-aa45-b6fa0fce1578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:14.329608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-266e9cdd-c8db-4621-aa45-b6fa0fce1578 None None] MFA Rules not processed for user `68dd6976fe754e4ab64acd9beb22d266`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:14.331759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-266e9cdd-c8db-4621-aa45-b6fa0fce1578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:14.395115 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:23:14.473778 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1833/3608] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:17.227086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dbe0a-af68-4ec0-86d1-d4def23889f5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:17.227086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dbe0a-af68-4ec0-86d1-d4def23889f5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:17.227086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dbe0a-af68-4ec0-86d1-d4def23889f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:17.263757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c83dbe0a-af68-4ec0-86d1-d4def23889f5 None None] MFA Rules not processed for user `68dd6976fe754e4ab64acd9beb22d266`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:17.265699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c83dbe0a-af68-4ec0-86d1-d4def23889f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:17.287688 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1776/3609] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:21.780039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63f695-c8e7-436e-8860-3faa8128d88d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:21.780966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63f695-c8e7-436e-8860-3faa8128d88d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:21.781592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63f695-c8e7-436e-8860-3faa8128d88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:21.820386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5c63f695-c8e7-436e-8860-3faa8128d88d None None] MFA Rules not processed for user `cf357eaa322546a6aa44101dae62af13`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:21.822491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5c63f695-c8e7-436e-8860-3faa8128d88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:21.931674 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1834/3610] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:21.942387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f651d-e5e2-400d-88ad-826e52bb852e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:21.944163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f651d-e5e2-400d-88ad-826e52bb852e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:21.947527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006f651d-e5e2-400d-88ad-826e52bb852e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:21.994161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-006f651d-e5e2-400d-88ad-826e52bb852e None None] MFA Rules not processed for user `cf357eaa322546a6aa44101dae62af13`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:21.996146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-006f651d-e5e2-400d-88ad-826e52bb852e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:22.020853 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1777/3611] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:23:22.067663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63f695-c8e7-436e-8860-3faa8128d88d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:22.069429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5c63f695-c8e7-436e-8860-3faa8128d88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:22.258193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63f695-c8e7-436e-8860-3faa8128d88d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:22.267855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c626de-e78d-44c4-8731-1f81009a9bf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:22.274296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c626de-e78d-44c4-8731-1f81009a9bf8 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:22.274296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c626de-e78d-44c4-8731-1f81009a9bf8 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:22.275132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c626de-e78d-44c4-8731-1f81009a9bf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:22.293244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c626de-e78d-44c4-8731-1f81009a9bf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:22.295308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c626de-e78d-44c4-8731-1f81009a9bf8 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:22.307499 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1835/3612] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:23:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:23:22.369124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac125ff-dc17-4cab-9c20-156a56698a31 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:22.369708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac125ff-dc17-4cab-9c20-156a56698a31 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:22.370211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac125ff-dc17-4cab-9c20-156a56698a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:22.539872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8ac125ff-dc17-4cab-9c20-156a56698a31 None None] MFA Rules not processed for user `3f51c716f5ca4712b9de904ffbbe1bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:22.541533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8ac125ff-dc17-4cab-9c20-156a56698a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:22.859264 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1778/3613] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 492 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:24.112071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c626de-e78d-44c4-8731-1f81009a9bf8 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:24.125649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a3c626de-e78d-44c4-8731-1f81009a9bf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:24.154915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c626de-e78d-44c4-8731-1f81009a9bf8 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:24.164889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5875e1-cb91-4190-b941-38cddc0b7de6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:24.165573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5875e1-cb91-4190-b941-38cddc0b7de6 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:24.165922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5875e1-cb91-4190-b941-38cddc0b7de6 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:24.166283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5875e1-cb91-4190-b941-38cddc0b7de6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:24.182836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0f5875e1-cb91-4190-b941-38cddc0b7de6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:24.323614 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:23:24.351197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5875e1-cb91-4190-b941-38cddc0b7de6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:24.353186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5875e1-cb91-4190-b941-38cddc0b7de6 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:24.385085 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1836/3614] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:23:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:23:25.052559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac125ff-dc17-4cab-9c20-156a56698a31 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:25.054787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8ac125ff-dc17-4cab-9c20-156a56698a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:25.102855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcefe5-e18b-412f-a72f-2f4086b68864 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:25.103411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcefe5-e18b-412f-a72f-2f4086b68864 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:25.104569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcefe5-e18b-412f-a72f-2f4086b68864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:25.140592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac125ff-dc17-4cab-9c20-156a56698a31 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:25.157014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-defcefe5-e18b-412f-a72f-2f4086b68864 None None] MFA Rules not processed for user `1ebfe6431d2942b4b82ebf264e664524`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:25.160895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-defcefe5-e18b-412f-a72f-2f4086b68864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:25.206709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f84f7a-78e3-409c-a222-a7223778c95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:25.209228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84f7a-78e3-409c-a222-a7223778c95f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:25.212113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84f7a-78e3-409c-a222-a7223778c95f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:25.215970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84f7a-78e3-409c-a222-a7223778c95f admin admin] PATH_INFO: `/v3/users/b1162c7e3ac04d04ae8bed46e0fe0f4f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:25.220269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f84f7a-78e3-409c-a222-a7223778c95f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1162c7e3ac04d04ae8bed46e0fe0f4f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:25.223358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f84f7a-78e3-409c-a222-a7223778c95f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:25.310190 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:23:25.325672 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1837/3615] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:25.584508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a0f84f7a-78e3-409c-a222-a7223778c95f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1162c7e3ac04d04ae8bed46e0fe0f4f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:25.613919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a0f84f7a-78e3-409c-a222-a7223778c95f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1162c7e3ac04d04ae8bed46e0fe0f4f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:25.626511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a0f84f7a-78e3-409c-a222-a7223778c95f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1162c7e3ac04d04ae8bed46e0fe0f4f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:25.628581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a0f84f7a-78e3-409c-a222-a7223778c95f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1162c7e3ac04d04ae8bed46e0fe0f4f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:25.644881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a0f84f7a-78e3-409c-a222-a7223778c95f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1162c7e3ac04d04ae8bed46e0fe0f4f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:25.724954 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1779/3616] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:23:25 2022] DELETE /identity/v3/users/b1162c7e3ac04d04ae8bed46e0fe0f4f => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:23:26.343601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcefe5-e18b-412f-a72f-2f4086b68864 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:26.375769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcefe5-e18b-412f-a72f-2f4086b68864 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:26.483813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c67851-15de-442f-aa34-87bb3561364b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:26.485367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c67851-15de-442f-aa34-87bb3561364b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:26.486201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c67851-15de-442f-aa34-87bb3561364b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:26.487005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c67851-15de-442f-aa34-87bb3561364b admin admin] PATH_INFO: `/v3/projects/c26cdffe8258474bbc98b705b7eaca01` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:26.516384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c67851-15de-442f-aa34-87bb3561364b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c26cdffe8258474bbc98b705b7eaca01)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:26.522904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c67851-15de-442f-aa34-87bb3561364b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:26.729265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-17c67851-15de-442f-aa34-87bb3561364b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c26cdffe8258474bbc98b705b7eaca01', 'request_id': 'req-17c67851-15de-442f-aa34-87bb3561364b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:26.767005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-17c67851-15de-442f-aa34-87bb3561364b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c26cdffe8258474bbc98b705b7eaca01', 'request_id': 'req-17c67851-15de-442f-aa34-87bb3561364b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:26.805367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-17c67851-15de-442f-aa34-87bb3561364b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c26cdffe8258474bbc98b705b7eaca01', 'request_id': 'req-17c67851-15de-442f-aa34-87bb3561364b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:26.945059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-17c67851-15de-442f-aa34-87bb3561364b admin admin] The token cache is being invalidate because project c26cdffe8258474bbc98b705b7eaca01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:23:26.945641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-17c67851-15de-442f-aa34-87bb3561364b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:26.947304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-17c67851-15de-442f-aa34-87bb3561364b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:26.955878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f86b5-a44e-4cad-90a1-1d14b5964b82 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:26.956397 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1838/3617] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:23:26 2022] DELETE /identity/v3/projects/c26cdffe8258474bbc98b705b7eaca01 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:23:26.956842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f86b5-a44e-4cad-90a1-1d14b5964b82 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:26.957134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f86b5-a44e-4cad-90a1-1d14b5964b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:27.006682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d72f86b5-a44e-4cad-90a1-1d14b5964b82 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:27.007953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d72f86b5-a44e-4cad-90a1-1d14b5964b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:27.169288 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1780/3618] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:23:27.178832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dad87-5bf1-4b11-b155-850cef9b9d3f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:27.179131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dad87-5bf1-4b11-b155-850cef9b9d3f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:27.179414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8dad87-5bf1-4b11-b155-850cef9b9d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:27.224446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3d8dad87-5bf1-4b11-b155-850cef9b9d3f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:27.226285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3d8dad87-5bf1-4b11-b155-850cef9b9d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:27.250618 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1839/3619] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:27.255658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f86b5-a44e-4cad-90a1-1d14b5964b82 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:27.270587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f86b5-a44e-4cad-90a1-1d14b5964b82 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:27.288479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ca3ef-e68a-4238-bbff-6d9ac39623fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:27.289591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ca3ef-e68a-4238-bbff-6d9ac39623fe admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:27.290229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ca3ef-e68a-4238-bbff-6d9ac39623fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:27.290904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ca3ef-e68a-4238-bbff-6d9ac39623fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:27.291834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ca3ef-e68a-4238-bbff-6d9ac39623fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:23:27.292307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ca3ef-e68a-4238-bbff-6d9ac39623fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:27.295044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ca3ef-e68a-4238-bbff-6d9ac39623fe admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:27.326354 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1781/3620] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:23:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:23:27.330381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dad87-5bf1-4b11-b155-850cef9b9d3f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:27.341111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8dad87-5bf1-4b11-b155-850cef9b9d3f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:27.346730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd3f2c-835c-465c-84ef-9b19ca81678e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:27.349145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd3f2c-835c-465c-84ef-9b19ca81678e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:27.349611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd3f2c-835c-465c-84ef-9b19ca81678e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:27.350055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd3f2c-835c-465c-84ef-9b19ca81678e admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:27.351096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd3f2c-835c-465c-84ef-9b19ca81678e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:27.359340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd3f2c-835c-465c-84ef-9b19ca81678e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:27.370216 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:23:27.528419 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1840/3621] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:23:27 2022] POST /identity/v3/projects => generated 379 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:23:27.534292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ca3ef-e68a-4238-bbff-6d9ac39623fe admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:27.550801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ca3ef-e68a-4238-bbff-6d9ac39623fe admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:27.704948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3a735-3699-46f8-928f-42204cf634b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:27.705890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3a735-3699-46f8-928f-42204cf634b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:27.706361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3a735-3699-46f8-928f-42204cf634b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:27.706914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b3a735-3699-46f8-928f-42204cf634b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:27.707776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3a735-3699-46f8-928f-42204cf634b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:27.710060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b3a735-3699-46f8-928f-42204cf634b9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:27.881900 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1782/3622] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:23:27 2022] POST /identity/v3/users => generated 290 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:23:27.883468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd3f2c-835c-465c-84ef-9b19ca81678e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:27.914435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd3f2c-835c-465c-84ef-9b19ca81678e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:27.937791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec4004-2295-437c-b3e8-37ccc4b5f14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:27.938807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec4004-2295-437c-b3e8-37ccc4b5f14b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:27.939257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec4004-2295-437c-b3e8-37ccc4b5f14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:27.939743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec4004-2295-437c-b3e8-37ccc4b5f14b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:27.940665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec4004-2295-437c-b3e8-37ccc4b5f14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:27.943072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec4004-2295-437c-b3e8-37ccc4b5f14b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:27.961459 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1841/3623] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:23:27.962060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3a735-3699-46f8-928f-42204cf634b9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:27.977349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b3a735-3699-46f8-928f-42204cf634b9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:27.991565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71636e0-97b3-4dd3-beb0-018b5a6397df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:27.992501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71636e0-97b3-4dd3-beb0-018b5a6397df admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:27.992997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71636e0-97b3-4dd3-beb0-018b5a6397df admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:27.993624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71636e0-97b3-4dd3-beb0-018b5a6397df admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:27.994588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71636e0-97b3-4dd3-beb0-018b5a6397df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:27.996404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71636e0-97b3-4dd3-beb0-018b5a6397df admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:28.034796 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1783/3624] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:23:28.040552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec4004-2295-437c-b3e8-37ccc4b5f14b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:28.101931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec4004-2295-437c-b3e8-37ccc4b5f14b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:28.122893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7e529-75cf-4c39-bad0-2efad87bbdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:28.136418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7e529-75cf-4c39-bad0-2efad87bbdee admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:28.139450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7e529-75cf-4c39-bad0-2efad87bbdee admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:28.141548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba7e529-75cf-4c39-bad0-2efad87bbdee admin admin] PATH_INFO: `/v3/projects/b5de50fd63d94fdab26292dfe659d3b8/users/f52d884ec2854a09a81a0df5bfb197f0/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:28.188524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7e529-75cf-4c39-bad0-2efad87bbdee admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5de50fd63d94fdab26292dfe659d3b8, user_id=f52d884ec2854a09a81a0df5bfb197f0, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:28.193840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba7e529-75cf-4c39-bad0-2efad87bbdee admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:28.325436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17f8f2-e1cd-4a93-972e-8dce7d764b7e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:28.326574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17f8f2-e1cd-4a93-972e-8dce7d764b7e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:28.326574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17f8f2-e1cd-4a93-972e-8dce7d764b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:28.327465 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1842/3625] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:23:28 2022] PUT /identity/v3/projects/b5de50fd63d94fdab26292dfe659d3b8/users/f52d884ec2854a09a81a0df5bfb197f0/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:23:28.349746 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:23:28.364630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-bf17f8f2-e1cd-4a93-972e-8dce7d764b7e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:28.368066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bf17f8f2-e1cd-4a93-972e-8dce7d764b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:28.505668 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1784/3626] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:28.519785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7e529-75cf-4c39-bad0-2efad87bbdee admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:28.523308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7ba7e529-75cf-4c39-bad0-2efad87bbdee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:28.642676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba7e529-75cf-4c39-bad0-2efad87bbdee admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:28.653311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b797d-70bb-4cf6-8b7f-549fbb0d84ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:28.658617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b797d-70bb-4cf6-8b7f-549fbb0d84ee service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:28.658913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b797d-70bb-4cf6-8b7f-549fbb0d84ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:28.659205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b797d-70bb-4cf6-8b7f-549fbb0d84ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:28.680496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b797d-70bb-4cf6-8b7f-549fbb0d84ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:28.686371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b797d-70bb-4cf6-8b7f-549fbb0d84ee service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:28.724529 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1843/3627] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:23:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:23:29.426945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17f8f2-e1cd-4a93-972e-8dce7d764b7e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:29.428498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bf17f8f2-e1cd-4a93-972e-8dce7d764b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:29.473997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17f8f2-e1cd-4a93-972e-8dce7d764b7e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:29.492126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e201fa77-345e-470f-99ff-4e261312f30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:29.493329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201fa77-345e-470f-99ff-4e261312f30d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:29.493792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201fa77-345e-470f-99ff-4e261312f30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:29.494835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e201fa77-345e-470f-99ff-4e261312f30d admin admin] PATH_INFO: `/v3/users/3e475a5d289e46c0b0429c84fb9ee0fb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:29.500954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201fa77-345e-470f-99ff-4e261312f30d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e475a5d289e46c0b0429c84fb9ee0fb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:29.503307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e201fa77-345e-470f-99ff-4e261312f30d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:29.850264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e201fa77-345e-470f-99ff-4e261312f30d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e475a5d289e46c0b0429c84fb9ee0fb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:29.922178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e201fa77-345e-470f-99ff-4e261312f30d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e475a5d289e46c0b0429c84fb9ee0fb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:29.924188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e201fa77-345e-470f-99ff-4e261312f30d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e475a5d289e46c0b0429c84fb9ee0fb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:29.925659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e201fa77-345e-470f-99ff-4e261312f30d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e475a5d289e46c0b0429c84fb9ee0fb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:29.962450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e201fa77-345e-470f-99ff-4e261312f30d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e475a5d289e46c0b0429c84fb9ee0fb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:30.046682 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1785/3628] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:23:29 2022] DELETE /identity/v3/users/3e475a5d289e46c0b0429c84fb9ee0fb => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:23:31.518255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b797d-70bb-4cf6-8b7f-549fbb0d84ee service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:31.533383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b797d-70bb-4cf6-8b7f-549fbb0d84ee service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:31.622144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d2fea-64d1-489c-9d78-3355e133301a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:31.623551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d2fea-64d1-489c-9d78-3355e133301a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:31.624070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d2fea-64d1-489c-9d78-3355e133301a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:31.624560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d2fea-64d1-489c-9d78-3355e133301a admin admin] PATH_INFO: `/v3/projects/62ffc3b784554186922368aafd349e6a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:31.626773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d2fea-64d1-489c-9d78-3355e133301a admin admin] RBAC: Authorizing `identity:delete_project(project_id=62ffc3b784554186922368aafd349e6a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:31.629488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9d2fea-64d1-489c-9d78-3355e133301a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:31.784180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4b9d2fea-64d1-489c-9d78-3355e133301a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62ffc3b784554186922368aafd349e6a', 'request_id': 'req-4b9d2fea-64d1-489c-9d78-3355e133301a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:31.805762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4b9d2fea-64d1-489c-9d78-3355e133301a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62ffc3b784554186922368aafd349e6a', 'request_id': 'req-4b9d2fea-64d1-489c-9d78-3355e133301a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:31.830764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4b9d2fea-64d1-489c-9d78-3355e133301a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62ffc3b784554186922368aafd349e6a', 'request_id': 'req-4b9d2fea-64d1-489c-9d78-3355e133301a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:31.836519 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:DELETE=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:23:31.919475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4b9d2fea-64d1-489c-9d78-3355e133301a admin admin] The token cache is being invalidate because project 62ffc3b784554186922368aafd349e6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:23:31.921957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4b9d2fea-64d1-489c-9d78-3355e133301a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:31.921957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4b9d2fea-64d1-489c-9d78-3355e133301a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:31.923621 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1844/3629] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:23:31 2022] DELETE /identity/v3/projects/62ffc3b784554186922368aafd349e6a => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:23:31.928721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5aaf72-8456-4878-b7b4-0bba0b67616d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:31.929249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5aaf72-8456-4878-b7b4-0bba0b67616d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:31.929333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5aaf72-8456-4878-b7b4-0bba0b67616d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:31.965061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-cd5aaf72-8456-4878-b7b4-0bba0b67616d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:31.968116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cd5aaf72-8456-4878-b7b4-0bba0b67616d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:32.077070 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1786/3630] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:32.087622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dcf42-c185-4622-bed6-3bc00dadd0df None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:32.087964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dcf42-c185-4622-bed6-3bc00dadd0df None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:32.088268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692dcf42-c185-4622-bed6-3bc00dadd0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:32.146871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-692dcf42-c185-4622-bed6-3bc00dadd0df None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:32.149159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-692dcf42-c185-4622-bed6-3bc00dadd0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:32.178999 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1845/3631] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:32.181071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5aaf72-8456-4878-b7b4-0bba0b67616d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:32.206238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5aaf72-8456-4878-b7b4-0bba0b67616d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:32.246058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cffa92-7199-4a90-b42a-7a34f1006751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:32.248653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cffa92-7199-4a90-b42a-7a34f1006751 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:32.248976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cffa92-7199-4a90-b42a-7a34f1006751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:32.249257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cffa92-7199-4a90-b42a-7a34f1006751 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:32.259422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cffa92-7199-4a90-b42a-7a34f1006751 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:23:32.259422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cffa92-7199-4a90-b42a-7a34f1006751 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:32.261015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cffa92-7199-4a90-b42a-7a34f1006751 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:32.299271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dcf42-c185-4622-bed6-3bc00dadd0df None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:32.313129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692dcf42-c185-4622-bed6-3bc00dadd0df None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:32.317225 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1787/3632] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:23:32.335885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42dc3a-f725-4c6d-80e9-270702f01a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:32.337743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42dc3a-f725-4c6d-80e9-270702f01a83 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:32.338654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42dc3a-f725-4c6d-80e9-270702f01a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:32.339382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42dc3a-f725-4c6d-80e9-270702f01a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:32.341194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42dc3a-f725-4c6d-80e9-270702f01a83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:32.344944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42dc3a-f725-4c6d-80e9-270702f01a83 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:32.471691 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1846/3633] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:23:32 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:23:32.477737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac7435-2c11-4f36-b813-3d51dbfb13ba None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:32.478318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac7435-2c11-4f36-b813-3d51dbfb13ba None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:32.479131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac7435-2c11-4f36-b813-3d51dbfb13ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:32.489713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42dc3a-f725-4c6d-80e9-270702f01a83 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:32.504702 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:23:32.521035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-26ac7435-2c11-4f36-b813-3d51dbfb13ba None None] MFA Rules not processed for user `b3a68ad6956b4455a857df0d3ac76489`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:32.523639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-26ac7435-2c11-4f36-b813-3d51dbfb13ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:32.704392 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1788/3634] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:32.793919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42dc3a-f725-4c6d-80e9-270702f01a83 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:32.801142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2007e4-c8f3-45b7-a12b-d659a8237b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:32.802064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2007e4-c8f3-45b7-a12b-d659a8237b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:32.802392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2007e4-c8f3-45b7-a12b-d659a8237b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:32.802742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2007e4-c8f3-45b7-a12b-d659a8237b7d admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:32.803460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2007e4-c8f3-45b7-a12b-d659a8237b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:32.806144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2007e4-c8f3-45b7-a12b-d659a8237b7d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:32.942893 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1847/3635] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:23:32 2022] POST /identity/v3/users => generated 293 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:23:32.947227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac7435-2c11-4f36-b813-3d51dbfb13ba None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:32.975217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac7435-2c11-4f36-b813-3d51dbfb13ba None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:33.001419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36014d-dbd7-4637-8e8a-702623b9d67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:33.003093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36014d-dbd7-4637-8e8a-702623b9d67f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:33.003589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36014d-dbd7-4637-8e8a-702623b9d67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:33.003969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c36014d-dbd7-4637-8e8a-702623b9d67f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:33.004988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36014d-dbd7-4637-8e8a-702623b9d67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:33.007338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c36014d-dbd7-4637-8e8a-702623b9d67f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:33.021070 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1789/3636] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:23:33.024856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2007e4-c8f3-45b7-a12b-d659a8237b7d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:33.038858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2007e4-c8f3-45b7-a12b-d659a8237b7d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:33.049304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88398274-aa96-4510-b40a-523fe1d8c3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:33.053234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88398274-aa96-4510-b40a-523fe1d8c3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:33.053719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88398274-aa96-4510-b40a-523fe1d8c3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:33.054179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88398274-aa96-4510-b40a-523fe1d8c3f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:33.055374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88398274-aa96-4510-b40a-523fe1d8c3f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:33.057328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88398274-aa96-4510-b40a-523fe1d8c3f0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:33.091749 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1848/3637] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:23:33.091972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36014d-dbd7-4637-8e8a-702623b9d67f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:33.103185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c36014d-dbd7-4637-8e8a-702623b9d67f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:33.110825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400be9ef-ac98-404b-9f4e-cfb76721e672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:33.111910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400be9ef-ac98-404b-9f4e-cfb76721e672 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:33.112199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400be9ef-ac98-404b-9f4e-cfb76721e672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:33.113069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400be9ef-ac98-404b-9f4e-cfb76721e672 admin admin] PATH_INFO: `/v3/projects/f26164ae836a4b0282a67a6284ad534a/users/2cba8748b6144d58a6f0ee45b2319d27/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:33.135003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400be9ef-ac98-404b-9f4e-cfb76721e672 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f26164ae836a4b0282a67a6284ad534a, user_id=2cba8748b6144d58a6f0ee45b2319d27, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:33.138669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400be9ef-ac98-404b-9f4e-cfb76721e672 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:33.235906 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1790/3638] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:23:33 2022] PUT /identity/v3/projects/f26164ae836a4b0282a67a6284ad534a/users/2cba8748b6144d58a6f0ee45b2319d27/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:23:33.245048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb12b84-b53e-45df-8439-91fcc28534f6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:33.245694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb12b84-b53e-45df-8439-91fcc28534f6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:33.246149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb12b84-b53e-45df-8439-91fcc28534f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:33.282672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-feb12b84-b53e-45df-8439-91fcc28534f6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:33.283919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-feb12b84-b53e-45df-8439-91fcc28534f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:33.412020 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1849/3639] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:33.434383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400be9ef-ac98-404b-9f4e-cfb76721e672 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:33.435848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-400be9ef-ac98-404b-9f4e-cfb76721e672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:33.553537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400be9ef-ac98-404b-9f4e-cfb76721e672 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:33.568940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3d7b2-a669-403e-8f79-a5fe7de8c802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:33.569953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3d7b2-a669-403e-8f79-a5fe7de8c802 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:33.570501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3d7b2-a669-403e-8f79-a5fe7de8c802 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:33.571926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3d7b2-a669-403e-8f79-a5fe7de8c802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:33.585743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3d7b2-a669-403e-8f79-a5fe7de8c802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:33.587658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3d7b2-a669-403e-8f79-a5fe7de8c802 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:33.601591 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1791/3640] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:23:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:23:39.863893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb12b84-b53e-45df-8439-91fcc28534f6 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:39.863893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-feb12b84-b53e-45df-8439-91fcc28534f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:39.880123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb12b84-b53e-45df-8439-91fcc28534f6 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:39.903004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7c683-b237-4fc3-b932-d4783c939f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:39.904112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7c683-b237-4fc3-b932-d4783c939f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:39.904403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7c683-b237-4fc3-b932-d4783c939f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:39.904716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7c683-b237-4fc3-b932-d4783c939f86 admin admin] PATH_INFO: `/v3/users/a4c1c7070bd14c42a301a525690004e4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:39.907390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7c683-b237-4fc3-b932-d4783c939f86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4c1c7070bd14c42a301a525690004e4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:39.910235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7c683-b237-4fc3-b932-d4783c939f86 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:40.156060 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:INSERT=5,keystone:DELETE=6,keystone:SELECT=89 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:23:40.166683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d9d7c683-b237-4fc3-b932-d4783c939f86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4c1c7070bd14c42a301a525690004e4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:40.196761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d9d7c683-b237-4fc3-b932-d4783c939f86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4c1c7070bd14c42a301a525690004e4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:40.213862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d9d7c683-b237-4fc3-b932-d4783c939f86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4c1c7070bd14c42a301a525690004e4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:40.215047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d9d7c683-b237-4fc3-b932-d4783c939f86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4c1c7070bd14c42a301a525690004e4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:40.315080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d9d7c683-b237-4fc3-b932-d4783c939f86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4c1c7070bd14c42a301a525690004e4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:40.327172 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1850/3641] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:23:39 2022] DELETE /identity/v3/users/a4c1c7070bd14c42a301a525690004e4 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:23:41.650949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3d7b2-a669-403e-8f79-a5fe7de8c802 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:41.664570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3d7b2-a669-403e-8f79-a5fe7de8c802 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:41.810785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ddbaaa-1318-4e3a-9db0-6c8ec8663df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:41.811709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddbaaa-1318-4e3a-9db0-6c8ec8663df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:41.812011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddbaaa-1318-4e3a-9db0-6c8ec8663df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:41.812294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ddbaaa-1318-4e3a-9db0-6c8ec8663df4 admin admin] PATH_INFO: `/v3/projects/7341c97f88114f2e84e22aa8435f06f7` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:41.814941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddbaaa-1318-4e3a-9db0-6c8ec8663df4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7341c97f88114f2e84e22aa8435f06f7)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:41.816987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ddbaaa-1318-4e3a-9db0-6c8ec8663df4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:41.872187 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:23:41.990860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-23ddbaaa-1318-4e3a-9db0-6c8ec8663df4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7341c97f88114f2e84e22aa8435f06f7', 'request_id': 'req-23ddbaaa-1318-4e3a-9db0-6c8ec8663df4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:42.070431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-23ddbaaa-1318-4e3a-9db0-6c8ec8663df4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7341c97f88114f2e84e22aa8435f06f7', 'request_id': 'req-23ddbaaa-1318-4e3a-9db0-6c8ec8663df4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:42.106999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-23ddbaaa-1318-4e3a-9db0-6c8ec8663df4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7341c97f88114f2e84e22aa8435f06f7', 'request_id': 'req-23ddbaaa-1318-4e3a-9db0-6c8ec8663df4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:42.151567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-23ddbaaa-1318-4e3a-9db0-6c8ec8663df4 admin admin] The token cache is being invalidate because project 7341c97f88114f2e84e22aa8435f06f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:23:42.151873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-23ddbaaa-1318-4e3a-9db0-6c8ec8663df4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:42.155456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-23ddbaaa-1318-4e3a-9db0-6c8ec8663df4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:42.159237 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1792/3642] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:23:41 2022] DELETE /identity/v3/projects/7341c97f88114f2e84e22aa8435f06f7 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:23:42.164284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da37d8-e047-4470-805d-2ac120aeb77f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:42.164836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da37d8-e047-4470-805d-2ac120aeb77f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:42.165079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da37d8-e047-4470-805d-2ac120aeb77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:42.204538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c6da37d8-e047-4470-805d-2ac120aeb77f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:42.206134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c6da37d8-e047-4470-805d-2ac120aeb77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:42.306567 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1851/3643] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:42.315444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c03fd-c8e6-45d3-99a8-8ab0111c7fc1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:42.315738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c03fd-c8e6-45d3-99a8-8ab0111c7fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:42.316021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c03fd-c8e6-45d3-99a8-8ab0111c7fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:42.355418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0a7c03fd-c8e6-45d3-99a8-8ab0111c7fc1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:42.356776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0a7c03fd-c8e6-45d3-99a8-8ab0111c7fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:42.379856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da37d8-e047-4470-805d-2ac120aeb77f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:42.396015 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1793/3644] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:42.396222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da37d8-e047-4470-805d-2ac120aeb77f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:42.415418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03081f-3785-4d1c-99eb-ca6a93077f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:42.415418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03081f-3785-4d1c-99eb-ca6a93077f16 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:42.415914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03081f-3785-4d1c-99eb-ca6a93077f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:42.417086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03081f-3785-4d1c-99eb-ca6a93077f16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:42.417876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03081f-3785-4d1c-99eb-ca6a93077f16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:23:42.418380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03081f-3785-4d1c-99eb-ca6a93077f16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:42.420495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03081f-3785-4d1c-99eb-ca6a93077f16 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:42.441538 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1852/3645] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:23:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:23:42.445741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c03fd-c8e6-45d3-99a8-8ab0111c7fc1 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:42.466090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c03fd-c8e6-45d3-99a8-8ab0111c7fc1 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:42.473156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28a846-a7bf-460d-b9e4-d1dd01718dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:42.473156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28a846-a7bf-460d-b9e4-d1dd01718dff admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:42.473156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28a846-a7bf-460d-b9e4-d1dd01718dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:42.473156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b28a846-a7bf-460d-b9e4-d1dd01718dff admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:42.473541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28a846-a7bf-460d-b9e4-d1dd01718dff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:42.479860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b28a846-a7bf-460d-b9e4-d1dd01718dff admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:42.603583 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1794/3646] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:23:42 2022] POST /identity/v3/projects => generated 391 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:23:42.608384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03081f-3785-4d1c-99eb-ca6a93077f16 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:42.623528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03081f-3785-4d1c-99eb-ca6a93077f16 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:42.771423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f659650-6dad-48f7-a105-539c31ff2f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:42.772119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f659650-6dad-48f7-a105-539c31ff2f03 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:42.772409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f659650-6dad-48f7-a105-539c31ff2f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:42.772689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f659650-6dad-48f7-a105-539c31ff2f03 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:42.773394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f659650-6dad-48f7-a105-539c31ff2f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:42.775370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f659650-6dad-48f7-a105-539c31ff2f03 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:42.879443 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1853/3647] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:23:42 2022] POST /identity/v3/users => generated 296 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:23:42.883141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28a846-a7bf-460d-b9e4-d1dd01718dff admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:42.910736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b28a846-a7bf-460d-b9e4-d1dd01718dff admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:42.922021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7dfdf-d093-4569-a40c-382223e76d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:42.923160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7dfdf-d093-4569-a40c-382223e76d9f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:42.923656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7dfdf-d093-4569-a40c-382223e76d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:42.924142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7dfdf-d093-4569-a40c-382223e76d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:42.925172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7dfdf-d093-4569-a40c-382223e76d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:42.930441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7dfdf-d093-4569-a40c-382223e76d9f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:42.942797 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1795/3648] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:23:42.946506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f659650-6dad-48f7-a105-539c31ff2f03 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:42.968696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f659650-6dad-48f7-a105-539c31ff2f03 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:42.983994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69a21d-4879-4b47-bf96-8e98144642fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:42.985490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69a21d-4879-4b47-bf96-8e98144642fb admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:42.985976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69a21d-4879-4b47-bf96-8e98144642fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:42.986681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69a21d-4879-4b47-bf96-8e98144642fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:42.987685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69a21d-4879-4b47-bf96-8e98144642fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:42.989982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69a21d-4879-4b47-bf96-8e98144642fb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:43.006426 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1854/3649] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:23:42 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:23:43.013280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7dfdf-d093-4569-a40c-382223e76d9f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:43.036045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7dfdf-d093-4569-a40c-382223e76d9f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:43.041859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8ba63-a78e-4130-b5da-9e646d7a84e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:43.045770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8ba63-a78e-4130-b5da-9e646d7a84e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:43.046341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8ba63-a78e-4130-b5da-9e646d7a84e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:43.047464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8ba63-a78e-4130-b5da-9e646d7a84e3 admin admin] PATH_INFO: `/v3/projects/30fa1444888541f5964c11639287a40a/users/b2d1d0ee8b184a9da24961d0886d132e/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:43.081516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8ba63-a78e-4130-b5da-9e646d7a84e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30fa1444888541f5964c11639287a40a, user_id=b2d1d0ee8b184a9da24961d0886d132e, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:43.086397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8ba63-a78e-4130-b5da-9e646d7a84e3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:43.194842 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1796/3650] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:23:43 2022] PUT /identity/v3/projects/30fa1444888541f5964c11639287a40a/users/b2d1d0ee8b184a9da24961d0886d132e/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:23:43.204860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f85eef-f008-4b94-a10d-14e0ace85a65 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:43.211012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f85eef-f008-4b94-a10d-14e0ace85a65 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:43.211012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f85eef-f008-4b94-a10d-14e0ace85a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:43.253391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-04f85eef-f008-4b94-a10d-14e0ace85a65 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:43.258182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-04f85eef-f008-4b94-a10d-14e0ace85a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:43.310667 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:23:43.435291 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1855/3651] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:43.478006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8ba63-a78e-4130-b5da-9e646d7a84e3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:43.480106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4af8ba63-a78e-4130-b5da-9e646d7a84e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:43.605007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8ba63-a78e-4130-b5da-9e646d7a84e3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:43.610326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ea311-0608-43e1-99f2-34e041037a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:43.614392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ea311-0608-43e1-99f2-34e041037a44 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:43.614392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ea311-0608-43e1-99f2-34e041037a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:43.614392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ea311-0608-43e1-99f2-34e041037a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:43.632754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ea311-0608-43e1-99f2-34e041037a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:43.637596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ea311-0608-43e1-99f2-34e041037a44 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:43.651316 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1797/3652] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:23:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:23:44.673247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f85eef-f008-4b94-a10d-14e0ace85a65 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:44.674778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-04f85eef-f008-4b94-a10d-14e0ace85a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:44.700872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f85eef-f008-4b94-a10d-14e0ace85a65 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:44.706644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcd4c93-3e8e-4baf-b02f-53dfa5f92838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:44.707847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd4c93-3e8e-4baf-b02f-53dfa5f92838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:44.708142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd4c93-3e8e-4baf-b02f-53dfa5f92838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:44.708484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcd4c93-3e8e-4baf-b02f-53dfa5f92838 admin admin] PATH_INFO: `/v3/users/bae1cc7815ac4f75969d6effb8607d14` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:44.711027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd4c93-3e8e-4baf-b02f-53dfa5f92838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bae1cc7815ac4f75969d6effb8607d14)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:44.712978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcd4c93-3e8e-4baf-b02f-53dfa5f92838 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:44.984669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8fcd4c93-3e8e-4baf-b02f-53dfa5f92838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bae1cc7815ac4f75969d6effb8607d14'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:45.009875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8fcd4c93-3e8e-4baf-b02f-53dfa5f92838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bae1cc7815ac4f75969d6effb8607d14'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:45.020792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8fcd4c93-3e8e-4baf-b02f-53dfa5f92838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bae1cc7815ac4f75969d6effb8607d14'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:45.021976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8fcd4c93-3e8e-4baf-b02f-53dfa5f92838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bae1cc7815ac4f75969d6effb8607d14'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:45.116236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8fcd4c93-3e8e-4baf-b02f-53dfa5f92838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bae1cc7815ac4f75969d6effb8607d14'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:45.128267 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1856/3653] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:23:44 2022] DELETE /identity/v3/users/bae1cc7815ac4f75969d6effb8607d14 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:23:46.566138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ea311-0608-43e1-99f2-34e041037a44 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:46.584813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ea311-0608-43e1-99f2-34e041037a44 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:46.689146 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:23:46.785454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5f26f-e1f8-44c3-b5d3-4bd953bf640a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:46.793620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5f26f-e1f8-44c3-b5d3-4bd953bf640a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:46.795499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5f26f-e1f8-44c3-b5d3-4bd953bf640a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:46.796027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5f26f-e1f8-44c3-b5d3-4bd953bf640a admin admin] PATH_INFO: `/v3/projects/803223d7c8a1478b95dc053c366ba557` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:46.804968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5f26f-e1f8-44c3-b5d3-4bd953bf640a admin admin] RBAC: Authorizing `identity:delete_project(project_id=803223d7c8a1478b95dc053c366ba557)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:46.815856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5f26f-e1f8-44c3-b5d3-4bd953bf640a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:47.078606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b9d5f26f-e1f8-44c3-b5d3-4bd953bf640a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '803223d7c8a1478b95dc053c366ba557', 'request_id': 'req-b9d5f26f-e1f8-44c3-b5d3-4bd953bf640a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:47.141565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b9d5f26f-e1f8-44c3-b5d3-4bd953bf640a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '803223d7c8a1478b95dc053c366ba557', 'request_id': 'req-b9d5f26f-e1f8-44c3-b5d3-4bd953bf640a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:47.152205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b9d5f26f-e1f8-44c3-b5d3-4bd953bf640a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '803223d7c8a1478b95dc053c366ba557', 'request_id': 'req-b9d5f26f-e1f8-44c3-b5d3-4bd953bf640a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:47.177352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b9d5f26f-e1f8-44c3-b5d3-4bd953bf640a admin admin] The token cache is being invalidate because project 803223d7c8a1478b95dc053c366ba557 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:23:47.177352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b9d5f26f-e1f8-44c3-b5d3-4bd953bf640a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:47.178850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b9d5f26f-e1f8-44c3-b5d3-4bd953bf640a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:23:47.186335 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1798/3654] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:23:46 2022] DELETE /identity/v3/projects/803223d7c8a1478b95dc053c366ba557 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:23:47.187215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87775410-ced4-469d-8d6d-bc38cef2919d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:47.187664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87775410-ced4-469d-8d6d-bc38cef2919d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:47.187781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87775410-ced4-469d-8d6d-bc38cef2919d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:47.227809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-87775410-ced4-469d-8d6d-bc38cef2919d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:47.229477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-87775410-ced4-469d-8d6d-bc38cef2919d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:47.354830 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1857/3655] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:23:47.364733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96e97b-6804-46ec-aa52-04152d4c9ac8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:47.365378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96e97b-6804-46ec-aa52-04152d4c9ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:47.365766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96e97b-6804-46ec-aa52-04152d4c9ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:47.405278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8b96e97b-6804-46ec-aa52-04152d4c9ac8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:47.413386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8b96e97b-6804-46ec-aa52-04152d4c9ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:47.435165 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1799/3656] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:47.435963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87775410-ced4-469d-8d6d-bc38cef2919d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:47.453829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87775410-ced4-469d-8d6d-bc38cef2919d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:47.466885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1318e9-5dfa-4759-9001-6df3474a6bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:47.471613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1318e9-5dfa-4759-9001-6df3474a6bed admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:47.471613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1318e9-5dfa-4759-9001-6df3474a6bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:47.471613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1318e9-5dfa-4759-9001-6df3474a6bed admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:47.471613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1318e9-5dfa-4759-9001-6df3474a6bed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:23:47.471613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1318e9-5dfa-4759-9001-6df3474a6bed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:47.471613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1318e9-5dfa-4759-9001-6df3474a6bed admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:47.505172 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1858/3657] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:23:47.509866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96e97b-6804-46ec-aa52-04152d4c9ac8 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:47.526252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96e97b-6804-46ec-aa52-04152d4c9ac8 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:47.535277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705a238-6c09-46ff-a103-07e27eab3b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:47.536276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a238-6c09-46ff-a103-07e27eab3b7b admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:47.538305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a238-6c09-46ff-a103-07e27eab3b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:47.539532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705a238-6c09-46ff-a103-07e27eab3b7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:47.542931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705a238-6c09-46ff-a103-07e27eab3b7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:47.546678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705a238-6c09-46ff-a103-07e27eab3b7b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:47.676104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1318e9-5dfa-4759-9001-6df3474a6bed admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:47.676701 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1800/3658] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:23:47 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:23:47.691373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1318e9-5dfa-4759-9001-6df3474a6bed admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:47.735033 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:23:47.847634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0364b-2967-466e-b44d-f0f23fddcf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:47.848398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0364b-2967-466e-b44d-f0f23fddcf23 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:47.848692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0364b-2967-466e-b44d-f0f23fddcf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:47.848973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0364b-2967-466e-b44d-f0f23fddcf23 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:47.849678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0364b-2967-466e-b44d-f0f23fddcf23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:47.852580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0364b-2967-466e-b44d-f0f23fddcf23 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:47.984030 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1859/3659] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:23:47 2022] POST /identity/v3/users => generated 290 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:23:47.988065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705a238-6c09-46ff-a103-07e27eab3b7b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:48.008106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705a238-6c09-46ff-a103-07e27eab3b7b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:48.018116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2555d1-b356-4e56-aa0f-d941b88f2e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:48.021031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2555d1-b356-4e56-aa0f-d941b88f2e4a admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:48.021378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2555d1-b356-4e56-aa0f-d941b88f2e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:48.021670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2555d1-b356-4e56-aa0f-d941b88f2e4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:48.026461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2555d1-b356-4e56-aa0f-d941b88f2e4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:48.029357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2555d1-b356-4e56-aa0f-d941b88f2e4a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:48.064136 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1801/3660] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:23:48.065837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0364b-2967-466e-b44d-f0f23fddcf23 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:48.085159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0364b-2967-466e-b44d-f0f23fddcf23 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:48.090113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd78460-6c89-40b8-8eaf-790f5eab8028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:48.091744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd78460-6c89-40b8-8eaf-790f5eab8028 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:48.092269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd78460-6c89-40b8-8eaf-790f5eab8028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:48.092670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd78460-6c89-40b8-8eaf-790f5eab8028 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:48.093520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd78460-6c89-40b8-8eaf-790f5eab8028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:48.100233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd78460-6c89-40b8-8eaf-790f5eab8028 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:48.132452 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1860/3661] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:23:48.134064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2555d1-b356-4e56-aa0f-d941b88f2e4a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:48.155554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2555d1-b356-4e56-aa0f-d941b88f2e4a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:48.174918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87859faa-d7c3-425f-b200-900716b34392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:48.176004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87859faa-d7c3-425f-b200-900716b34392 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:48.179310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87859faa-d7c3-425f-b200-900716b34392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:48.179687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87859faa-d7c3-425f-b200-900716b34392 admin admin] PATH_INFO: `/v3/projects/5d909cbc18ab4bad931205a3c3a46512/users/2928d7efad6a46d7b69df9644a6480b2/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:48.250182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87859faa-d7c3-425f-b200-900716b34392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d909cbc18ab4bad931205a3c3a46512, user_id=2928d7efad6a46d7b69df9644a6480b2, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:48.258721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87859faa-d7c3-425f-b200-900716b34392 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:48.365240 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1802/3662] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:23:48 2022] PUT /identity/v3/projects/5d909cbc18ab4bad931205a3c3a46512/users/2928d7efad6a46d7b69df9644a6480b2/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:23:48.370144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1cc91-8b45-4f6b-aa2f-92ca2219c589 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:48.371049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1cc91-8b45-4f6b-aa2f-92ca2219c589 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:48.371854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d1cc91-8b45-4f6b-aa2f-92ca2219c589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:48.399573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-39d1cc91-8b45-4f6b-aa2f-92ca2219c589 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:48.401478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-39d1cc91-8b45-4f6b-aa2f-92ca2219c589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:48.437127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d9779-3494-4f1b-90a2-5155c384bdc4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:48.437668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d9779-3494-4f1b-90a2-5155c384bdc4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:48.438072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d9779-3494-4f1b-90a2-5155c384bdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:48.497590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-261d9779-3494-4f1b-90a2-5155c384bdc4 None None] MFA Rules not processed for user `68dd6976fe754e4ab64acd9beb22d266`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:48.499121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-261d9779-3494-4f1b-90a2-5155c384bdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:48.570518 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1861/3663] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:48.615502 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1803/3664] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:23:48.640134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1cc91-8b45-4f6b-aa2f-92ca2219c589 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:48.642686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-39d1cc91-8b45-4f6b-aa2f-92ca2219c589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:48.796438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d1cc91-8b45-4f6b-aa2f-92ca2219c589 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:48.801983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e9987-22d9-4fc0-956e-5401b48a81ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:48.802908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e9987-22d9-4fc0-956e-5401b48a81ed service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:48.803426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e9987-22d9-4fc0-956e-5401b48a81ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:48.803933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e9987-22d9-4fc0-956e-5401b48a81ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:48.818951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e9987-22d9-4fc0-956e-5401b48a81ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:48.821158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e9987-22d9-4fc0-956e-5401b48a81ed service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:48.835335 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1862/3665] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:23:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:23:49.081908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda02692-d634-4fd5-b229-fb0f78de25e7 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:49.082418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda02692-d634-4fd5-b229-fb0f78de25e7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:49.082552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda02692-d634-4fd5-b229-fb0f78de25e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:49.143874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-eda02692-d634-4fd5-b229-fb0f78de25e7 None None] MFA Rules not processed for user `f52d884ec2854a09a81a0df5bfb197f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:49.159803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eda02692-d634-4fd5-b229-fb0f78de25e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:49.169411 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:23:49.369576 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1804/3666] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:49.429040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e9987-22d9-4fc0-956e-5401b48a81ed service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:49.430426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bc8e9987-22d9-4fc0-956e-5401b48a81ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:49.596242 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:23:49.662934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e9987-22d9-4fc0-956e-5401b48a81ed service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:49.671525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05ff96-d952-402c-886a-b50f0f735975 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:49.672395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05ff96-d952-402c-886a-b50f0f735975 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:49.672686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05ff96-d952-402c-886a-b50f0f735975 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:49.672962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05ff96-d952-402c-886a-b50f0f735975 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:49.688589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05ff96-d952-402c-886a-b50f0f735975 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:49.690479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf05ff96-d952-402c-886a-b50f0f735975 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:49.706263 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1863/3667] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:23:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:23:54.156567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550289a-ce3a-4b47-a6dc-242fcea9ed5d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:54.157111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550289a-ce3a-4b47-a6dc-242fcea9ed5d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:54.157111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550289a-ce3a-4b47-a6dc-242fcea9ed5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:54.243137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6550289a-ce3a-4b47-a6dc-242fcea9ed5d None None] MFA Rules not processed for user `2cba8748b6144d58a6f0ee45b2319d27`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:54.245488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6550289a-ce3a-4b47-a6dc-242fcea9ed5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:54.388671 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1805/3668] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:54.399039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452e9b2-84a5-4b53-8f31-03c6f4891b2a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:54.399603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452e9b2-84a5-4b53-8f31-03c6f4891b2a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:54.399603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452e9b2-84a5-4b53-8f31-03c6f4891b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:54.446485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d452e9b2-84a5-4b53-8f31-03c6f4891b2a None None] MFA Rules not processed for user `2cba8748b6144d58a6f0ee45b2319d27`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:54.448115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d452e9b2-84a5-4b53-8f31-03c6f4891b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:54.456185 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1864/3669] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:23:54.469947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550289a-ce3a-4b47-a6dc-242fcea9ed5d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:23:54.471793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6550289a-ce3a-4b47-a6dc-242fcea9ed5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:54.500147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550289a-ce3a-4b47-a6dc-242fcea9ed5d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:23:54.509049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879350e-b5cf-469d-89f9-82bd0e419e1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:23:54.509934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879350e-b5cf-469d-89f9-82bd0e419e1c service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:54.510433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879350e-b5cf-469d-89f9-82bd0e419e1c service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:54.510958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879350e-b5cf-469d-89f9-82bd0e419e1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:54.526577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879350e-b5cf-469d-89f9-82bd0e419e1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:23:54.530201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879350e-b5cf-469d-89f9-82bd0e419e1c service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:23:54.548074 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1806/3670] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:23:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:23:56.886140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b44b3-cd0f-42fe-bd59-03552162c0a7 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:23:56.886140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b44b3-cd0f-42fe-bd59-03552162c0a7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:23:56.886140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b44b3-cd0f-42fe-bd59-03552162c0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:23:56.920077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-185b44b3-cd0f-42fe-bd59-03552162c0a7 None None] MFA Rules not processed for user `f52d884ec2854a09a81a0df5bfb197f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:23:56.921585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-185b44b3-cd0f-42fe-bd59-03552162c0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:23:56.933116 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1865/3671] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:23:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:24:02.190670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda9397-9f01-434a-9b2b-f99505a93ebf None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:02.191083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda9397-9f01-434a-9b2b-f99505a93ebf None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:02.191278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda9397-9f01-434a-9b2b-f99505a93ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:02.247857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8fda9397-9f01-434a-9b2b-f99505a93ebf None None] MFA Rules not processed for user `b2d1d0ee8b184a9da24961d0886d132e`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:24:02.249300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8fda9397-9f01-434a-9b2b-f99505a93ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:02.448048 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1807/3672] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:24:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:24:03.119054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b44b3-cd0f-42fe-bd59-03552162c0a7 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:03.157585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b44b3-cd0f-42fe-bd59-03552162c0a7 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:03.175959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520b0de-036a-4230-8902-1f7e38471e0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:03.179108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520b0de-036a-4230-8902-1f7e38471e0e service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:03.179958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520b0de-036a-4230-8902-1f7e38471e0e service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:03.180437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520b0de-036a-4230-8902-1f7e38471e0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:03.195066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520b0de-036a-4230-8902-1f7e38471e0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:03.197728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520b0de-036a-4230-8902-1f7e38471e0e service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:03.245276 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1866/3673] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:24:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:24:06.974197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fe9b6-5108-4126-ae0c-ac9c1583518f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:06.974765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fe9b6-5108-4126-ae0c-ac9c1583518f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:06.975001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1fe9b6-5108-4126-ae0c-ac9c1583518f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:07.062835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1b1fe9b6-5108-4126-ae0c-ac9c1583518f None None] MFA Rules not processed for user `2928d7efad6a46d7b69df9644a6480b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:24:07.066173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1b1fe9b6-5108-4126-ae0c-ac9c1583518f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:07.077475 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:24:07.166466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc804be-95fa-4c79-acbc-a6443b4eed2c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:07.167279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc804be-95fa-4c79-acbc-a6443b4eed2c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:07.167756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc804be-95fa-4c79-acbc-a6443b4eed2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:07.213534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3cc804be-95fa-4c79-acbc-a6443b4eed2c None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:24:07.215057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3cc804be-95fa-4c79-acbc-a6443b4eed2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:07.289468 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1808/3674] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:24:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:24:07.302269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa430c-df0c-4793-91e9-1f6bd66af53d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:07.302684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa430c-df0c-4793-91e9-1f6bd66af53d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:07.303103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa430c-df0c-4793-91e9-1f6bd66af53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:07.368393 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1867/3675] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:24:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:24:07.373288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-04fa430c-df0c-4793-91e9-1f6bd66af53d None None] MFA Rules not processed for user `2928d7efad6a46d7b69df9644a6480b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:24:07.374579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-04fa430c-df0c-4793-91e9-1f6bd66af53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:07.439520 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1809/3676] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:24:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:24:07.603717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc804be-95fa-4c79-acbc-a6443b4eed2c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:07.606334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3cc804be-95fa-4c79-acbc-a6443b4eed2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:07.752877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc804be-95fa-4c79-acbc-a6443b4eed2c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:07.766376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71afb0be-3e3c-4454-9f4f-e98aaca6b847 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:07.767395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afb0be-3e3c-4454-9f4f-e98aaca6b847 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:07.768546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afb0be-3e3c-4454-9f4f-e98aaca6b847 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:07.769167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afb0be-3e3c-4454-9f4f-e98aaca6b847 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:07.784062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71afb0be-3e3c-4454-9f4f-e98aaca6b847 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:07.786678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71afb0be-3e3c-4454-9f4f-e98aaca6b847 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:07.833281 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1868/3677] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:24:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:24:08.754369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa430c-df0c-4793-91e9-1f6bd66af53d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:08.789792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa430c-df0c-4793-91e9-1f6bd66af53d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:08.818920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524086f0-7ce9-43c7-966d-64ed900eae8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:08.819630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524086f0-7ce9-43c7-966d-64ed900eae8d service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:08.826457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524086f0-7ce9-43c7-966d-64ed900eae8d service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:08.826811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524086f0-7ce9-43c7-966d-64ed900eae8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:08.875430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524086f0-7ce9-43c7-966d-64ed900eae8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:08.876812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524086f0-7ce9-43c7-966d-64ed900eae8d service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:08.908524 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1810/3678] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:24:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:24:17.796772 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=84 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:24:18.895044 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=34 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:24:21.904276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71afb0be-3e3c-4454-9f4f-e98aaca6b847 service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:21.905716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-71afb0be-3e3c-4454-9f4f-e98aaca6b847 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:22.094283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71afb0be-3e3c-4454-9f4f-e98aaca6b847 service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:22.100877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17edf0-5948-4dc1-9062-db7add94f4fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:22.101663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17edf0-5948-4dc1-9062-db7add94f4fd service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:22.102188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17edf0-5948-4dc1-9062-db7add94f4fd service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:22.103383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17edf0-5948-4dc1-9062-db7add94f4fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:22.108517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ab17edf0-5948-4dc1-9062-db7add94f4fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:22.154921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17edf0-5948-4dc1-9062-db7add94f4fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:22.156433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17edf0-5948-4dc1-9062-db7add94f4fd service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:22.188576 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1869/3679] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:24:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:24:22.198572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524086f0-7ce9-43c7-966d-64ed900eae8d service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:22.223437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-524086f0-7ce9-43c7-966d-64ed900eae8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:22.276004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524086f0-7ce9-43c7-966d-64ed900eae8d service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:22.311123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99afef3-392b-41a2-8eb4-7b1e801baecf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:22.312136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99afef3-392b-41a2-8eb4-7b1e801baecf service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:22.316272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99afef3-392b-41a2-8eb4-7b1e801baecf service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:22.316908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99afef3-392b-41a2-8eb4-7b1e801baecf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:22.336073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17edf0-5948-4dc1-9062-db7add94f4fd service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:22.338181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ab17edf0-5948-4dc1-9062-db7add94f4fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:22.352911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c99afef3-392b-41a2-8eb4-7b1e801baecf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:22.400597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17edf0-5948-4dc1-9062-db7add94f4fd service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:22.425464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99afef3-392b-41a2-8eb4-7b1e801baecf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:22.425851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6d74b-2b66-4720-a568-f9e10c90ea7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:22.426912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6d74b-2b66-4720-a568-f9e10c90ea7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:22.429378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6d74b-2b66-4720-a568-f9e10c90ea7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:22.429680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6d74b-2b66-4720-a568-f9e10c90ea7f admin admin] PATH_INFO: `/v3/users/b2d1d0ee8b184a9da24961d0886d132e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:22.431559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99afef3-392b-41a2-8eb4-7b1e801baecf service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:22.439619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6d74b-2b66-4720-a568-f9e10c90ea7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d1d0ee8b184a9da24961d0886d132e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:22.444910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d6d74b-2b66-4720-a568-f9e10c90ea7f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:22.494013 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1811/3680] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:24:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:24:22.781285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-50d6d74b-2b66-4720-a568-f9e10c90ea7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d1d0ee8b184a9da24961d0886d132e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:22.802988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-50d6d74b-2b66-4720-a568-f9e10c90ea7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d1d0ee8b184a9da24961d0886d132e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:22.813826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-50d6d74b-2b66-4720-a568-f9e10c90ea7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d1d0ee8b184a9da24961d0886d132e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:22.814662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-50d6d74b-2b66-4720-a568-f9e10c90ea7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d1d0ee8b184a9da24961d0886d132e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:22.817892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99afef3-392b-41a2-8eb4-7b1e801baecf service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:22.831290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99afef3-392b-41a2-8eb4-7b1e801baecf service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:22.843185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722117d6-549a-41de-9055-f7c3b15b041f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:22.844155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722117d6-549a-41de-9055-f7c3b15b041f service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:22.844568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722117d6-549a-41de-9055-f7c3b15b041f service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:22.844984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722117d6-549a-41de-9055-f7c3b15b041f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:22.847266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-722117d6-549a-41de-9055-f7c3b15b041f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:22.867239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722117d6-549a-41de-9055-f7c3b15b041f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:22.869013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722117d6-549a-41de-9055-f7c3b15b041f service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:22.915492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-50d6d74b-2b66-4720-a568-f9e10c90ea7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d1d0ee8b184a9da24961d0886d132e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:22.916834 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1812/3681] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:24:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:24:22.938136 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1870/3682] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:24:22 2022] DELETE /identity/v3/users/b2d1d0ee8b184a9da24961d0886d132e => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:24:23.541191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722117d6-549a-41de-9055-f7c3b15b041f service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:23.557246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722117d6-549a-41de-9055-f7c3b15b041f service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:23.699617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2194a-c6f6-4544-a7c7-038c1138a959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:23.699617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2194a-c6f6-4544-a7c7-038c1138a959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:23.699617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2194a-c6f6-4544-a7c7-038c1138a959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:23.699617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2194a-c6f6-4544-a7c7-038c1138a959 admin admin] PATH_INFO: `/v3/projects/30fa1444888541f5964c11639287a40a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:23.711572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2194a-c6f6-4544-a7c7-038c1138a959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30fa1444888541f5964c11639287a40a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:23.722137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2194a-c6f6-4544-a7c7-038c1138a959 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:23.899600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-22c2194a-c6f6-4544-a7c7-038c1138a959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30fa1444888541f5964c11639287a40a', 'request_id': 'req-22c2194a-c6f6-4544-a7c7-038c1138a959'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:23.976104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-22c2194a-c6f6-4544-a7c7-038c1138a959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30fa1444888541f5964c11639287a40a', 'request_id': 'req-22c2194a-c6f6-4544-a7c7-038c1138a959'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:23.987893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-22c2194a-c6f6-4544-a7c7-038c1138a959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30fa1444888541f5964c11639287a40a', 'request_id': 'req-22c2194a-c6f6-4544-a7c7-038c1138a959'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:24.017636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-22c2194a-c6f6-4544-a7c7-038c1138a959 admin admin] The token cache is being invalidate because project 30fa1444888541f5964c11639287a40a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:24:24.017937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-22c2194a-c6f6-4544-a7c7-038c1138a959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:24.023742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-22c2194a-c6f6-4544-a7c7-038c1138a959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:24.036998 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1813/3683] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:24:23 2022] DELETE /identity/v3/projects/30fa1444888541f5964c11639287a40a => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:24:24.039185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109fdff-1404-4a2f-beed-9362f0df6157 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:24.040273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109fdff-1404-4a2f-beed-9362f0df6157 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:24.041110 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109fdff-1404-4a2f-beed-9362f0df6157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:24.078486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b109fdff-1404-4a2f-beed-9362f0df6157 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:24:24.080145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b109fdff-1404-4a2f-beed-9362f0df6157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:24.258089 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1871/3684] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:24:24.265963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac79e9-9ca9-4181-8737-3f9769c7f5e4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:24.266299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac79e9-9ca9-4181-8737-3f9769c7f5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:24.266559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac79e9-9ca9-4181-8737-3f9769c7f5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:24.311827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-bfac79e9-9ca9-4181-8737-3f9769c7f5e4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:24:24.317266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bfac79e9-9ca9-4181-8737-3f9769c7f5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:24.323846 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1814/3685] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:24:24.328025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109fdff-1404-4a2f-beed-9362f0df6157 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:24.333386 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:24:24.340301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109fdff-1404-4a2f-beed-9362f0df6157 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:24.361809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e4af2-463c-406c-a41c-e041986a4160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:24.365109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e4af2-463c-406c-a41c-e041986a4160 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:24.365333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e4af2-463c-406c-a41c-e041986a4160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:24.366022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e4af2-463c-406c-a41c-e041986a4160 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:24.368614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e4af2-463c-406c-a41c-e041986a4160 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:24:24.369191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e4af2-463c-406c-a41c-e041986a4160 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:24.374298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e4af2-463c-406c-a41c-e041986a4160 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:24.428290 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1872/3686] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:24:24.431585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac79e9-9ca9-4181-8737-3f9769c7f5e4 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:24.455404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac79e9-9ca9-4181-8737-3f9769c7f5e4 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:24.475585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d422717-e881-403b-9217-d10e482faec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:24.483840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d422717-e881-403b-9217-d10e482faec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:24.483840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d422717-e881-403b-9217-d10e482faec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:24.483840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d422717-e881-403b-9217-d10e482faec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:24.483840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d422717-e881-403b-9217-d10e482faec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:24.487501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d422717-e881-403b-9217-d10e482faec1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:24.766394 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1815/3687] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:24:24 2022] POST /identity/v3/projects => generated 381 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:24:24.767815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e4af2-463c-406c-a41c-e041986a4160 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:24.782739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e4af2-463c-406c-a41c-e041986a4160 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:25.031246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfc912-d555-445b-85b4-4c2b6735dbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:25.032334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfc912-d555-445b-85b4-4c2b6735dbee admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:25.033612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfc912-d555-445b-85b4-4c2b6735dbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:25.034844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfc912-d555-445b-85b4-4c2b6735dbee admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:25.036604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfc912-d555-445b-85b4-4c2b6735dbee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:25.046217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bfc912-d555-445b-85b4-4c2b6735dbee admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:25.139541 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1873/3688] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:24:24 2022] POST /identity/v3/users => generated 291 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:24:25.143337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d422717-e881-403b-9217-d10e482faec1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:25.169422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d422717-e881-403b-9217-d10e482faec1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:25.226270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db6ab2-bb56-4f6e-ba22-1049857efd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:25.227266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db6ab2-bb56-4f6e-ba22-1049857efd64 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:25.227801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db6ab2-bb56-4f6e-ba22-1049857efd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:25.228291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db6ab2-bb56-4f6e-ba22-1049857efd64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:25.231459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db6ab2-bb56-4f6e-ba22-1049857efd64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:25.235914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db6ab2-bb56-4f6e-ba22-1049857efd64 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:25.270207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfc912-d555-445b-85b4-4c2b6735dbee admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:25.291962 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1816/3689] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:24:25.302736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfc912-d555-445b-85b4-4c2b6735dbee admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:25.314951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5f87a5-c35d-4b91-a193-fb9b2f98164b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:25.316405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f87a5-c35d-4b91-a193-fb9b2f98164b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:25.317385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f87a5-c35d-4b91-a193-fb9b2f98164b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:25.317670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5f87a5-c35d-4b91-a193-fb9b2f98164b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:25.318497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f87a5-c35d-4b91-a193-fb9b2f98164b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:25.322392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5f87a5-c35d-4b91-a193-fb9b2f98164b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:25.347664 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1874/3690] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:24:25.351554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db6ab2-bb56-4f6e-ba22-1049857efd64 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:25.366473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db6ab2-bb56-4f6e-ba22-1049857efd64 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:25.380056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc19e2-6836-43e2-8a0f-480838acdf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:25.380988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc19e2-6836-43e2-8a0f-480838acdf20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:25.381326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc19e2-6836-43e2-8a0f-480838acdf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:25.381607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc19e2-6836-43e2-8a0f-480838acdf20 admin admin] PATH_INFO: `/v3/projects/02bc6e761bcb48b2886278d074bd75f3/users/37d12d9086194620a7ee04c9ba97062d/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:25.420612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc19e2-6836-43e2-8a0f-480838acdf20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02bc6e761bcb48b2886278d074bd75f3, user_id=37d12d9086194620a7ee04c9ba97062d, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:25.426039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccc19e2-6836-43e2-8a0f-480838acdf20 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:25.540552 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:24:25.547118 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1817/3691] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:24:25 2022] PUT /identity/v3/projects/02bc6e761bcb48b2886278d074bd75f3/users/37d12d9086194620a7ee04c9ba97062d/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:24:25.563355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb6f65-9445-45c9-ae35-ec3650735155 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:25.563355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb6f65-9445-45c9-ae35-ec3650735155 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:25.563355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb6f65-9445-45c9-ae35-ec3650735155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:25.591960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-31cb6f65-9445-45c9-ae35-ec3650735155 None None] MFA Rules not processed for user `37d12d9086194620a7ee04c9ba97062d`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:24:25.593310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-31cb6f65-9445-45c9-ae35-ec3650735155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:25.727948 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1875/3692] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:24:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:24:25.741953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc19e2-6836-43e2-8a0f-480838acdf20 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:25.745705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5ccc19e2-6836-43e2-8a0f-480838acdf20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:25.851953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccc19e2-6836-43e2-8a0f-480838acdf20 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:25.858456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96957d60-e837-4832-bcd1-2778fd4b7953 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:25.861721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96957d60-e837-4832-bcd1-2778fd4b7953 service glance] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:25.862415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96957d60-e837-4832-bcd1-2778fd4b7953 service glance] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:25.862850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96957d60-e837-4832-bcd1-2778fd4b7953 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:25.875849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96957d60-e837-4832-bcd1-2778fd4b7953 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:25.877788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96957d60-e837-4832-bcd1-2778fd4b7953 service glance] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:25.892512 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1818/3693] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:24:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:24:26.234732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc964e-0737-4af2-bfd5-37f5fab27c34 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:26.243812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc964e-0737-4af2-bfd5-37f5fab27c34 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:26.244694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc964e-0737-4af2-bfd5-37f5fab27c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:26.297715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7adc964e-0737-4af2-bfd5-37f5fab27c34 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:24:26.301549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7adc964e-0737-4af2-bfd5-37f5fab27c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:26.422411 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1876/3694] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:24:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:24:26.498232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96957d60-e837-4832-bcd1-2778fd4b7953 service glance] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:26.501021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-96957d60-e837-4832-bcd1-2778fd4b7953 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:26.666839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96957d60-e837-4832-bcd1-2778fd4b7953 service glance] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:26.672510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09fc27-15bd-46c8-9961-837318f25b5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:26.672510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09fc27-15bd-46c8-9961-837318f25b5d service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:26.672510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09fc27-15bd-46c8-9961-837318f25b5d service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:26.672510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09fc27-15bd-46c8-9961-837318f25b5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:26.685270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09fc27-15bd-46c8-9961-837318f25b5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:26.687058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09fc27-15bd-46c8-9961-837318f25b5d service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:26.697989 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1819/3695] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:24:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:24:33.659724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc964e-0737-4af2-bfd5-37f5fab27c34 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:33.663036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7adc964e-0737-4af2-bfd5-37f5fab27c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:33.676275 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:24:33.744565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc964e-0737-4af2-bfd5-37f5fab27c34 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:33.751215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc67f7-8ce8-45f5-961b-6ae70c20d5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:33.753483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc67f7-8ce8-45f5-961b-6ae70c20d5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:33.753483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc67f7-8ce8-45f5-961b-6ae70c20d5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:33.753483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc67f7-8ce8-45f5-961b-6ae70c20d5f2 admin admin] PATH_INFO: `/v3/users/cf357eaa322546a6aa44101dae62af13` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:33.754307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc67f7-8ce8-45f5-961b-6ae70c20d5f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf357eaa322546a6aa44101dae62af13)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:33.756326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc67f7-8ce8-45f5-961b-6ae70c20d5f2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:33.944161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-61dc67f7-8ce8-45f5-961b-6ae70c20d5f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf357eaa322546a6aa44101dae62af13'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:33.956660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-61dc67f7-8ce8-45f5-961b-6ae70c20d5f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf357eaa322546a6aa44101dae62af13'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:33.963624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-61dc67f7-8ce8-45f5-961b-6ae70c20d5f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf357eaa322546a6aa44101dae62af13'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:33.965383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-61dc67f7-8ce8-45f5-961b-6ae70c20d5f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf357eaa322546a6aa44101dae62af13'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:34.039661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-61dc67f7-8ce8-45f5-961b-6ae70c20d5f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf357eaa322546a6aa44101dae62af13'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:34.046357 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1877/3696] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:24:33 2022] DELETE /identity/v3/users/cf357eaa322546a6aa44101dae62af13 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:24:34.330158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09fc27-15bd-46c8-9961-837318f25b5d service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:34.348875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09fc27-15bd-46c8-9961-837318f25b5d service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:34.459932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82ac84-aba8-4e66-a481-e4004e7a87b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:34.460868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82ac84-aba8-4e66-a481-e4004e7a87b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:34.461153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82ac84-aba8-4e66-a481-e4004e7a87b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:34.461430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82ac84-aba8-4e66-a481-e4004e7a87b7 admin admin] PATH_INFO: `/v3/projects/ec29014a0a8a422d8ed94d2fa205be10` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:34.462827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82ac84-aba8-4e66-a481-e4004e7a87b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec29014a0a8a422d8ed94d2fa205be10)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:34.465513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82ac84-aba8-4e66-a481-e4004e7a87b7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:34.569218 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:24:34.579526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bc82ac84-aba8-4e66-a481-e4004e7a87b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec29014a0a8a422d8ed94d2fa205be10', 'request_id': 'req-bc82ac84-aba8-4e66-a481-e4004e7a87b7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:34.662889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bc82ac84-aba8-4e66-a481-e4004e7a87b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec29014a0a8a422d8ed94d2fa205be10', 'request_id': 'req-bc82ac84-aba8-4e66-a481-e4004e7a87b7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:34.671007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bc82ac84-aba8-4e66-a481-e4004e7a87b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec29014a0a8a422d8ed94d2fa205be10', 'request_id': 'req-bc82ac84-aba8-4e66-a481-e4004e7a87b7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:34.685114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bc82ac84-aba8-4e66-a481-e4004e7a87b7 admin admin] The token cache is being invalidate because project ec29014a0a8a422d8ed94d2fa205be10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:24:34.685423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bc82ac84-aba8-4e66-a481-e4004e7a87b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:34.686115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bc82ac84-aba8-4e66-a481-e4004e7a87b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:34.689931 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1820/3697] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:24:34 2022] DELETE /identity/v3/projects/ec29014a0a8a422d8ed94d2fa205be10 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:24:34.692701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a0d72-2e1e-4a57-9dc1-da08c6ba088e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:34.693153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a0d72-2e1e-4a57-9dc1-da08c6ba088e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:34.693246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a0d72-2e1e-4a57-9dc1-da08c6ba088e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:34.711740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-853a0d72-2e1e-4a57-9dc1-da08c6ba088e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:24:34.713002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-853a0d72-2e1e-4a57-9dc1-da08c6ba088e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:34.780298 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1878/3698] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:24:34.789755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7efa6-0590-468d-85a7-23a1d3151707 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:34.790049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7efa6-0590-468d-85a7-23a1d3151707 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:34.790411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af7efa6-0590-468d-85a7-23a1d3151707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:34.810415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6af7efa6-0590-468d-85a7-23a1d3151707 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:24:34.811617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6af7efa6-0590-468d-85a7-23a1d3151707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:34.819500 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1821/3699] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:24:34.823885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a0d72-2e1e-4a57-9dc1-da08c6ba088e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:34.834874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a0d72-2e1e-4a57-9dc1-da08c6ba088e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:34.839505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c057b-8318-43e2-a08b-f4ca94d510d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:34.840875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c057b-8318-43e2-a08b-f4ca94d510d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:34.841165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c057b-8318-43e2-a08b-f4ca94d510d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:34.841443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c057b-8318-43e2-a08b-f4ca94d510d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:34.842205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c057b-8318-43e2-a08b-f4ca94d510d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:24:34.842514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c057b-8318-43e2-a08b-f4ca94d510d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:34.844316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c057b-8318-43e2-a08b-f4ca94d510d1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:34.867837 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1879/3700] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:24:34.869445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7efa6-0590-468d-85a7-23a1d3151707 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:34.881181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af7efa6-0590-468d-85a7-23a1d3151707 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:34.885894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce943a7-ae06-40fd-b879-8be884481c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:34.886744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce943a7-ae06-40fd-b879-8be884481c8e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:34.887026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce943a7-ae06-40fd-b879-8be884481c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:34.887313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce943a7-ae06-40fd-b879-8be884481c8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:34.888159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce943a7-ae06-40fd-b879-8be884481c8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:34.890079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce943a7-ae06-40fd-b879-8be884481c8e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:34.983371 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1822/3701] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:24:34 2022] POST /identity/v3/projects => generated 379 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:24:34.985525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c057b-8318-43e2-a08b-f4ca94d510d1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:35.002639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c057b-8318-43e2-a08b-f4ca94d510d1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:35.020864 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:24:35.037338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676db85-3956-452a-8274-727a49d8244b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:35.037338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676db85-3956-452a-8274-727a49d8244b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:35.037338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b676db85-3956-452a-8274-727a49d8244b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:35.054207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b676db85-3956-452a-8274-727a49d8244b None None] MFA Rules not processed for user `2928d7efad6a46d7b69df9644a6480b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:24:35.055417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b676db85-3956-452a-8274-727a49d8244b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:35.092221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bba7e1-cffc-4bf6-b4b1-d3b7b088e391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:35.092912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bba7e1-cffc-4bf6-b4b1-d3b7b088e391 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:35.093340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bba7e1-cffc-4bf6-b4b1-d3b7b088e391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:35.093714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bba7e1-cffc-4bf6-b4b1-d3b7b088e391 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:35.094475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bba7e1-cffc-4bf6-b4b1-d3b7b088e391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:35.096508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bba7e1-cffc-4bf6-b4b1-d3b7b088e391 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:35.121492 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1823/3702] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:24:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:24:35.123143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e88e89-841a-4fe6-8ac6-57f5269fa2de None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:35.123773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e88e89-841a-4fe6-8ac6-57f5269fa2de None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:35.124066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e88e89-841a-4fe6-8ac6-57f5269fa2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:35.142571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-30e88e89-841a-4fe6-8ac6-57f5269fa2de None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:24:35.143772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-30e88e89-841a-4fe6-8ac6-57f5269fa2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:35.218548 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1880/3703] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:24:34 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:24:35.222506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bba7e1-cffc-4bf6-b4b1-d3b7b088e391 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:35.223968 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1824/3704] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:24:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:24:35.236243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bba7e1-cffc-4bf6-b4b1-d3b7b088e391 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:35.239006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e88e89-841a-4fe6-8ac6-57f5269fa2de None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:35.244032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-30e88e89-841a-4fe6-8ac6-57f5269fa2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:35.244141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582bc07-e1e1-4ce3-99d6-084b282c26e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:35.244141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582bc07-e1e1-4ce3-99d6-084b282c26e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:35.244141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582bc07-e1e1-4ce3-99d6-084b282c26e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:35.244141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582bc07-e1e1-4ce3-99d6-084b282c26e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:35.244472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582bc07-e1e1-4ce3-99d6-084b282c26e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:35.245887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582bc07-e1e1-4ce3-99d6-084b282c26e1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:35.256607 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1881/3705] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:24:35.261953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582bc07-e1e1-4ce3-99d6-084b282c26e1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:35.274071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582bc07-e1e1-4ce3-99d6-084b282c26e1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:35.280311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc38c09-1f9f-43a3-930b-627841e82572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:35.280989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc38c09-1f9f-43a3-930b-627841e82572 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:35.281412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc38c09-1f9f-43a3-930b-627841e82572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:35.281656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc38c09-1f9f-43a3-930b-627841e82572 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:35.282427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc38c09-1f9f-43a3-930b-627841e82572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:35.284060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc38c09-1f9f-43a3-930b-627841e82572 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:35.300658 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1882/3706] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:24:35.301388 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:24:35.301889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc38c09-1f9f-43a3-930b-627841e82572 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:35.312265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc38c09-1f9f-43a3-930b-627841e82572 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:35.317549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b658d-19de-4dd7-bec4-f8f52f818925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:35.318511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b658d-19de-4dd7-bec4-f8f52f818925 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:35.319261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b658d-19de-4dd7-bec4-f8f52f818925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:35.319497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b658d-19de-4dd7-bec4-f8f52f818925 admin admin] PATH_INFO: `/v3/projects/d16eb550d1df4dd3bc2df35d9be320a8/users/586ae8d7c81047469eb9258be767c3d3/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:35.329194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e88e89-841a-4fe6-8ac6-57f5269fa2de None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:35.335848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca82d29-4ad4-4dca-bc21-45682c6a9327 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:35.337678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca82d29-4ad4-4dca-bc21-45682c6a9327 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:35.337970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca82d29-4ad4-4dca-bc21-45682c6a9327 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:35.338284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca82d29-4ad4-4dca-bc21-45682c6a9327 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:35.349069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca82d29-4ad4-4dca-bc21-45682c6a9327 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:35.350780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca82d29-4ad4-4dca-bc21-45682c6a9327 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:35.363988 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1825/3707] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:24:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 14:24:35.465098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b658d-19de-4dd7-bec4-f8f52f818925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16eb550d1df4dd3bc2df35d9be320a8, user_id=586ae8d7c81047469eb9258be767c3d3, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:35.468055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b658d-19de-4dd7-bec4-f8f52f818925 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:35.573101 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1883/3708] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:24:35 2022] PUT /identity/v3/projects/d16eb550d1df4dd3bc2df35d9be320a8/users/586ae8d7c81047469eb9258be767c3d3/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:24:35.578755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533883be-c2af-48a9-8271-9e180cfb8582 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:35.579049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533883be-c2af-48a9-8271-9e180cfb8582 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:35.579381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533883be-c2af-48a9-8271-9e180cfb8582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:35.598822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-533883be-c2af-48a9-8271-9e180cfb8582 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:24:35.600038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-533883be-c2af-48a9-8271-9e180cfb8582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:35.671017 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1826/3709] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:24:35.681719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b658d-19de-4dd7-bec4-f8f52f818925 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:35.684150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a23b658d-19de-4dd7-bec4-f8f52f818925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:35.749341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b658d-19de-4dd7-bec4-f8f52f818925 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:35.753056 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b9a7e-dbee-453b-84b3-c14213f9df13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:35.753853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b9a7e-dbee-453b-84b3-c14213f9df13 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:35.754247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b9a7e-dbee-453b-84b3-c14213f9df13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:35.754596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b9a7e-dbee-453b-84b3-c14213f9df13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:35.764286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b9a7e-dbee-453b-84b3-c14213f9df13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:35.765811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b9a7e-dbee-453b-84b3-c14213f9df13 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:35.776057 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1884/3710] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:24:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:24:35.891659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533883be-c2af-48a9-8271-9e180cfb8582 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:35.893186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-533883be-c2af-48a9-8271-9e180cfb8582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:35.906222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533883be-c2af-48a9-8271-9e180cfb8582 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:35.911785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6fa19-d5b7-45ba-bf51-99f0ca88f9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:35.912855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6fa19-d5b7-45ba-bf51-99f0ca88f9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:35.913325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6fa19-d5b7-45ba-bf51-99f0ca88f9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:35.913770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6fa19-d5b7-45ba-bf51-99f0ca88f9d0 admin admin] PATH_INFO: `/v3/users/37d12d9086194620a7ee04c9ba97062d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:35.915265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6fa19-d5b7-45ba-bf51-99f0ca88f9d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d12d9086194620a7ee04c9ba97062d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:35.917506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6fa19-d5b7-45ba-bf51-99f0ca88f9d0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:36.126463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-99d6fa19-d5b7-45ba-bf51-99f0ca88f9d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d12d9086194620a7ee04c9ba97062d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:36.139584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-99d6fa19-d5b7-45ba-bf51-99f0ca88f9d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d12d9086194620a7ee04c9ba97062d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:36.140574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-99d6fa19-d5b7-45ba-bf51-99f0ca88f9d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d12d9086194620a7ee04c9ba97062d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:36.141208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-99d6fa19-d5b7-45ba-bf51-99f0ca88f9d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d12d9086194620a7ee04c9ba97062d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:36.150073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-99d6fa19-d5b7-45ba-bf51-99f0ca88f9d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d12d9086194620a7ee04c9ba97062d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:36.237534 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1827/3711] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:24:35 2022] DELETE /identity/v3/users/37d12d9086194620a7ee04c9ba97062d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:24:36.242573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd938b-f116-4530-90c9-69686b11aa31 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:36.243169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd938b-f116-4530-90c9-69686b11aa31 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:36.243511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fd938b-f116-4530-90c9-69686b11aa31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:36.264095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-67fd938b-f116-4530-90c9-69686b11aa31 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:24:36.265686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-67fd938b-f116-4530-90c9-69686b11aa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:36.352954 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:24:36.374949 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1885/3712] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:24:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:24:36.385844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6fa19-d5b7-45ba-bf51-99f0ca88f9d0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:36.388524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-99d6fa19-d5b7-45ba-bf51-99f0ca88f9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:36.474400 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:24:36.479175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6fa19-d5b7-45ba-bf51-99f0ca88f9d0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:36.483554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff2d94-964a-4982-9b41-02dab5c7818f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:36.484406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff2d94-964a-4982-9b41-02dab5c7818f service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:36.484795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff2d94-964a-4982-9b41-02dab5c7818f service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:36.484963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff2d94-964a-4982-9b41-02dab5c7818f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:36.495068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff2d94-964a-4982-9b41-02dab5c7818f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:36.497223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff2d94-964a-4982-9b41-02dab5c7818f service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:36.506813 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1828/3713] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:24:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:24:37.069200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd938b-f116-4530-90c9-69686b11aa31 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:37.074929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-67fd938b-f116-4530-90c9-69686b11aa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:37.095582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fd938b-f116-4530-90c9-69686b11aa31 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:37.103262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902253c-c179-41ae-906f-cd8fbbea7dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:37.104433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902253c-c179-41ae-906f-cd8fbbea7dd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:37.104889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902253c-c179-41ae-906f-cd8fbbea7dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:37.105908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902253c-c179-41ae-906f-cd8fbbea7dd9 admin admin] PATH_INFO: `/v3/projects/02bc6e761bcb48b2886278d074bd75f3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:37.107361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902253c-c179-41ae-906f-cd8fbbea7dd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02bc6e761bcb48b2886278d074bd75f3)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:37.113478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902253c-c179-41ae-906f-cd8fbbea7dd9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:37.251236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2902253c-c179-41ae-906f-cd8fbbea7dd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02bc6e761bcb48b2886278d074bd75f3', 'request_id': 'req-2902253c-c179-41ae-906f-cd8fbbea7dd9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:37.261315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2902253c-c179-41ae-906f-cd8fbbea7dd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02bc6e761bcb48b2886278d074bd75f3', 'request_id': 'req-2902253c-c179-41ae-906f-cd8fbbea7dd9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:37.274582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2902253c-c179-41ae-906f-cd8fbbea7dd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02bc6e761bcb48b2886278d074bd75f3', 'request_id': 'req-2902253c-c179-41ae-906f-cd8fbbea7dd9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:37.403479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2902253c-c179-41ae-906f-cd8fbbea7dd9 admin admin] The token cache is being invalidate because project 02bc6e761bcb48b2886278d074bd75f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:24:37.403861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2902253c-c179-41ae-906f-cd8fbbea7dd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:37.408022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2902253c-c179-41ae-906f-cd8fbbea7dd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:24:37.410163 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1886/3714] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:24:37 2022] DELETE /identity/v3/projects/02bc6e761bcb48b2886278d074bd75f3 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:24:37.415258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858b192-d11a-4f6c-b633-ef3d43aa86c1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:37.416158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858b192-d11a-4f6c-b633-ef3d43aa86c1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:37.419889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858b192-d11a-4f6c-b633-ef3d43aa86c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:37.455353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4858b192-d11a-4f6c-b633-ef3d43aa86c1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:24:37.456831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4858b192-d11a-4f6c-b633-ef3d43aa86c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:37.563174 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1829/3715] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:24:37.572069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a98ef-5303-4129-b0b5-0f30e2021d8b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:37.572361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a98ef-5303-4129-b0b5-0f30e2021d8b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:37.572845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a98ef-5303-4129-b0b5-0f30e2021d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:37.598584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-478a98ef-5303-4129-b0b5-0f30e2021d8b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:24:37.598584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-478a98ef-5303-4129-b0b5-0f30e2021d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:37.607686 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1887/3716] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:24:37.611855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858b192-d11a-4f6c-b633-ef3d43aa86c1 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:37.624483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4858b192-d11a-4f6c-b633-ef3d43aa86c1 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:37.629087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e1030-6119-4747-816e-92e5b932b2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:37.629750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e1030-6119-4747-816e-92e5b932b2a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:37.630033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e1030-6119-4747-816e-92e5b932b2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:37.630346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e1030-6119-4747-816e-92e5b932b2a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:37.631075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e1030-6119-4747-816e-92e5b932b2a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:24:37.631395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e1030-6119-4747-816e-92e5b932b2a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:37.632978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e1030-6119-4747-816e-92e5b932b2a7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:37.646148 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1830/3717] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:24:37.652400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a98ef-5303-4129-b0b5-0f30e2021d8b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:37.660093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a98ef-5303-4129-b0b5-0f30e2021d8b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:37.664788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bfd5b-57f5-4fb6-b466-2c153af85afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:37.665440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bfd5b-57f5-4fb6-b466-2c153af85afb admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:37.665718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bfd5b-57f5-4fb6-b466-2c153af85afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:37.665989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123bfd5b-57f5-4fb6-b466-2c153af85afb admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:37.666715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bfd5b-57f5-4fb6-b466-2c153af85afb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:37.669371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123bfd5b-57f5-4fb6-b466-2c153af85afb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:37.829552 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1888/3718] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:24:37 2022] POST /identity/v3/projects => generated 395 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:24:37.831119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e1030-6119-4747-816e-92e5b932b2a7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:37.843767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e1030-6119-4747-816e-92e5b932b2a7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:37.916882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba6ebc-91d1-4053-bfda-a89d62761e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:37.918308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba6ebc-91d1-4053-bfda-a89d62761e80 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:37.918790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba6ebc-91d1-4053-bfda-a89d62761e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:37.919070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ba6ebc-91d1-4053-bfda-a89d62761e80 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:37.919769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba6ebc-91d1-4053-bfda-a89d62761e80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:37.921841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ba6ebc-91d1-4053-bfda-a89d62761e80 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:37.974058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bfd5b-57f5-4fb6-b466-2c153af85afb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:37.976041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-123bfd5b-57f5-4fb6-b466-2c153af85afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:38.024436 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1831/3719] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:24:37 2022] POST /identity/v3/users => generated 298 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:24:38.029169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba6ebc-91d1-4053-bfda-a89d62761e80 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:38.044324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ba6ebc-91d1-4053-bfda-a89d62761e80 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:38.049115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123bfd5b-57f5-4fb6-b466-2c153af85afb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:38.049784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e704e86-d44e-47dd-9b79-0968f2ba70c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:38.050500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e704e86-d44e-47dd-9b79-0968f2ba70c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:38.050792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e704e86-d44e-47dd-9b79-0968f2ba70c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:38.051066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e704e86-d44e-47dd-9b79-0968f2ba70c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:38.051927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e704e86-d44e-47dd-9b79-0968f2ba70c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:38.053584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e704e86-d44e-47dd-9b79-0968f2ba70c5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:38.054267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cb3a3-0906-4f53-8950-d87644a60aba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:38.055238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cb3a3-0906-4f53-8950-d87644a60aba service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:38.055721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cb3a3-0906-4f53-8950-d87644a60aba service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:38.062418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cb3a3-0906-4f53-8950-d87644a60aba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:38.062418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-367cb3a3-0906-4f53-8950-d87644a60aba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:38.066160 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1832/3720] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:24:38.070408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e704e86-d44e-47dd-9b79-0968f2ba70c5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:38.102539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e704e86-d44e-47dd-9b79-0968f2ba70c5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:38.126729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf98f22-1207-429d-8eaf-698f35f85834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:38.127420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf98f22-1207-429d-8eaf-698f35f85834 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:38.127708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf98f22-1207-429d-8eaf-698f35f85834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:38.127988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf98f22-1207-429d-8eaf-698f35f85834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:38.128718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf98f22-1207-429d-8eaf-698f35f85834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:38.131183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf98f22-1207-429d-8eaf-698f35f85834 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:38.160382 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1833/3721] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:24:38.160563 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:24:38.162528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf98f22-1207-429d-8eaf-698f35f85834 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:38.181843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cb3a3-0906-4f53-8950-d87644a60aba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:38.181843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cb3a3-0906-4f53-8950-d87644a60aba service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:38.185696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf98f22-1207-429d-8eaf-698f35f85834 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:38.192875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e407a-fcd9-49a4-851a-f9fb92fd632c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:38.193168 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1889/3722] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:24:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:24:38.194801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e407a-fcd9-49a4-851a-f9fb92fd632c admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:38.195494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e407a-fcd9-49a4-851a-f9fb92fd632c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:38.196020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826e407a-fcd9-49a4-851a-f9fb92fd632c admin admin] PATH_INFO: `/v3/projects/be46ed6c017e4c988d40ffd281d2a9e2/users/76bd949bbb4a47a6aa32a00e82767058/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:38.237184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e407a-fcd9-49a4-851a-f9fb92fd632c admin admin] RBAC: Authorizing `identity:create_grant(project_id=be46ed6c017e4c988d40ffd281d2a9e2, user_id=76bd949bbb4a47a6aa32a00e82767058, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:38.250073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826e407a-fcd9-49a4-851a-f9fb92fd632c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:38.391891 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1834/3723] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:24:38 2022] PUT /identity/v3/projects/be46ed6c017e4c988d40ffd281d2a9e2/users/76bd949bbb4a47a6aa32a00e82767058/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:24:38.397259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5caef-5ae7-492f-ae20-2e8052120e74 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:38.397581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5caef-5ae7-492f-ae20-2e8052120e74 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:38.397862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5caef-5ae7-492f-ae20-2e8052120e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:38.422968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3df5caef-5ae7-492f-ae20-2e8052120e74 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:24:38.425059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3df5caef-5ae7-492f-ae20-2e8052120e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:38.540898 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1890/3724] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:24:38.583146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e407a-fcd9-49a4-851a-f9fb92fd632c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:38.588148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-826e407a-fcd9-49a4-851a-f9fb92fd632c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:38.597568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5caef-5ae7-492f-ae20-2e8052120e74 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:38.607168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3df5caef-5ae7-492f-ae20-2e8052120e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:38.670969 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:24:38.742574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826e407a-fcd9-49a4-851a-f9fb92fd632c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:38.742823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5caef-5ae7-492f-ae20-2e8052120e74 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:38.750618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a5be1b-6338-443b-852d-4d75f54af78f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:38.751362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5be1b-6338-443b-852d-4d75f54af78f service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:38.751916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5be1b-6338-443b-852d-4d75f54af78f service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:38.752093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3214cf0-e354-45ee-a1cf-e23b93c9be15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:38.752308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a5be1b-6338-443b-852d-4d75f54af78f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:38.753137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3214cf0-e354-45ee-a1cf-e23b93c9be15 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:38.753733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3214cf0-e354-45ee-a1cf-e23b93c9be15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:38.754238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3214cf0-e354-45ee-a1cf-e23b93c9be15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:38.758208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a3214cf0-e354-45ee-a1cf-e23b93c9be15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:38.771491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3214cf0-e354-45ee-a1cf-e23b93c9be15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:38.773327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3214cf0-e354-45ee-a1cf-e23b93c9be15 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:38.773738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5be1b-6338-443b-852d-4d75f54af78f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:38.791504 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1835/3725] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:24:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:24:38.798873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a5be1b-6338-443b-852d-4d75f54af78f service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:38.815267 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1891/3726] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:24:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:24:39.158926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3214cf0-e354-45ee-a1cf-e23b93c9be15 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:39.173328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3214cf0-e354-45ee-a1cf-e23b93c9be15 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:39.178127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62f0e9-4f1e-4325-8580-0b8fac3741e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:39.179497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62f0e9-4f1e-4325-8580-0b8fac3741e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:39.179497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62f0e9-4f1e-4325-8580-0b8fac3741e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:39.179497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62f0e9-4f1e-4325-8580-0b8fac3741e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:39.181528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5e62f0e9-4f1e-4325-8580-0b8fac3741e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:39.309825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62f0e9-4f1e-4325-8580-0b8fac3741e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:39.311421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62f0e9-4f1e-4325-8580-0b8fac3741e5 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:39.326091 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1836/3727] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:24:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:24:46.586535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b865801-4451-4c69-8bf9-d00110e4b9c2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:46.592156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b865801-4451-4c69-8bf9-d00110e4b9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:46.592156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b865801-4451-4c69-8bf9-d00110e4b9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:46.613301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4b865801-4451-4c69-8bf9-d00110e4b9c2 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:24:46.622982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4b865801-4451-4c69-8bf9-d00110e4b9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:46.679869 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1892/3728] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:24:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:24:46.692980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62f0e9-4f1e-4325-8580-0b8fac3741e5 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:46.694402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5e62f0e9-4f1e-4325-8580-0b8fac3741e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:46.774182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62f0e9-4f1e-4325-8580-0b8fac3741e5 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:46.780733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87106e33-4361-41cd-85be-5239c9784116 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:46.781490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87106e33-4361-41cd-85be-5239c9784116 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:46.781778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87106e33-4361-41cd-85be-5239c9784116 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:46.782060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87106e33-4361-41cd-85be-5239c9784116 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:46.791005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87106e33-4361-41cd-85be-5239c9784116 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:46.792843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87106e33-4361-41cd-85be-5239c9784116 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:46.801485 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1837/3729] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:24:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:24:49.148200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11696f7-6dd7-4847-af95-d15f2d0a092f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:49.149113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11696f7-6dd7-4847-af95-d15f2d0a092f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:49.149556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11696f7-6dd7-4847-af95-d15f2d0a092f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:49.288681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f11696f7-6dd7-4847-af95-d15f2d0a092f None None] MFA Rules not processed for user `586ae8d7c81047469eb9258be767c3d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:24:49.291577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f11696f7-6dd7-4847-af95-d15f2d0a092f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:49.398413 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:24:49.475770 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1893/3730] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:24:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:24:49.489638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fea730-250b-4c94-923b-f8d3afe4efa1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:49.490445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fea730-250b-4c94-923b-f8d3afe4efa1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:49.490445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fea730-250b-4c94-923b-f8d3afe4efa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:49.536821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-73fea730-250b-4c94-923b-f8d3afe4efa1 None None] MFA Rules not processed for user `586ae8d7c81047469eb9258be767c3d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:24:49.537573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-73fea730-250b-4c94-923b-f8d3afe4efa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:49.566927 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1838/3731] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:24:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:24:49.720991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11696f7-6dd7-4847-af95-d15f2d0a092f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:49.722513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f11696f7-6dd7-4847-af95-d15f2d0a092f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:49.788234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11696f7-6dd7-4847-af95-d15f2d0a092f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:49.813400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb571577-44c0-4892-a866-f6564fcfee43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:49.832477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb571577-44c0-4892-a866-f6564fcfee43 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:49.843885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb571577-44c0-4892-a866-f6564fcfee43 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:49.845944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb571577-44c0-4892-a866-f6564fcfee43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:49.880642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb571577-44c0-4892-a866-f6564fcfee43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:49.888276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb571577-44c0-4892-a866-f6564fcfee43 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:49.943510 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1894/3732] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:24:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:24:55.087213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc163b74-7148-4ee6-992e-223c5deefd49 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:55.087674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc163b74-7148-4ee6-992e-223c5deefd49 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:55.087773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc163b74-7148-4ee6-992e-223c5deefd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:55.199828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-cc163b74-7148-4ee6-992e-223c5deefd49 None None] MFA Rules not processed for user `76bd949bbb4a47a6aa32a00e82767058`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:24:55.201109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cc163b74-7148-4ee6-992e-223c5deefd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:55.326921 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:24:55.527932 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1839/3733] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:24:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:24:55.529980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ddde2-4c95-47c3-86e0-3e83c156046e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:55.530933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ddde2-4c95-47c3-86e0-3e83c156046e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:55.531164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ddde2-4c95-47c3-86e0-3e83c156046e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:55.585664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d66ddde2-4c95-47c3-86e0-3e83c156046e None None] MFA Rules not processed for user `76bd949bbb4a47a6aa32a00e82767058`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:24:55.594862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d66ddde2-4c95-47c3-86e0-3e83c156046e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:55.637429 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1895/3734] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:24:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:24:55.761605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc163b74-7148-4ee6-992e-223c5deefd49 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:24:55.761605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cc163b74-7148-4ee6-992e-223c5deefd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:24:55.846150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc163b74-7148-4ee6-992e-223c5deefd49 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:24:55.877513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08ebfd-c5ec-4e91-931f-d43d6ec66558 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:24:55.878219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08ebfd-c5ec-4e91-931f-d43d6ec66558 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:24:55.880539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08ebfd-c5ec-4e91-931f-d43d6ec66558 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:24:55.880969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a08ebfd-c5ec-4e91-931f-d43d6ec66558 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:24:55.907402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08ebfd-c5ec-4e91-931f-d43d6ec66558 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:24:55.912680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a08ebfd-c5ec-4e91-931f-d43d6ec66558 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:24:55.950774 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1840/3735] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:24:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:25:01.376231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ddde2-4c95-47c3-86e0-3e83c156046e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:01.378964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d66ddde2-4c95-47c3-86e0-3e83c156046e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:01.463682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ddde2-4c95-47c3-86e0-3e83c156046e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:01.483915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9980844-0802-4958-b6eb-ba3cdd4dcd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:01.487185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9980844-0802-4958-b6eb-ba3cdd4dcd01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:01.497250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9980844-0802-4958-b6eb-ba3cdd4dcd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:01.498455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9980844-0802-4958-b6eb-ba3cdd4dcd01 admin admin] PATH_INFO: `/v3/users/1ebfe6431d2942b4b82ebf264e664524` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:01.504311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9980844-0802-4958-b6eb-ba3cdd4dcd01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ebfe6431d2942b4b82ebf264e664524)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:01.521732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9980844-0802-4958-b6eb-ba3cdd4dcd01 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:01.854589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d9980844-0802-4958-b6eb-ba3cdd4dcd01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ebfe6431d2942b4b82ebf264e664524'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:25:01.944382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d9980844-0802-4958-b6eb-ba3cdd4dcd01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ebfe6431d2942b4b82ebf264e664524'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:25:01.964805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d9980844-0802-4958-b6eb-ba3cdd4dcd01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ebfe6431d2942b4b82ebf264e664524'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:25:01.966471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d9980844-0802-4958-b6eb-ba3cdd4dcd01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ebfe6431d2942b4b82ebf264e664524'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:25:02.074815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d9980844-0802-4958-b6eb-ba3cdd4dcd01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ebfe6431d2942b4b82ebf264e664524'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:25:02.094194 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1896/3736] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:25:01 2022] DELETE /identity/v3/users/1ebfe6431d2942b4b82ebf264e664524 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:25:02.599238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08ebfd-c5ec-4e91-931f-d43d6ec66558 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:02.639782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a08ebfd-c5ec-4e91-931f-d43d6ec66558 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:02.805909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af21ca2-b307-401c-8dbd-efcaa0b6f2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:02.807117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af21ca2-b307-401c-8dbd-efcaa0b6f2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:02.807526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af21ca2-b307-401c-8dbd-efcaa0b6f2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:02.808033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af21ca2-b307-401c-8dbd-efcaa0b6f2bc admin admin] PATH_INFO: `/v3/projects/e2fc1ac5806c4620a87da96e49c45dcf` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:02.815318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af21ca2-b307-401c-8dbd-efcaa0b6f2bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2fc1ac5806c4620a87da96e49c45dcf)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:02.823668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af21ca2-b307-401c-8dbd-efcaa0b6f2bc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:03.040116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1af21ca2-b307-401c-8dbd-efcaa0b6f2bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2fc1ac5806c4620a87da96e49c45dcf', 'request_id': 'req-1af21ca2-b307-401c-8dbd-efcaa0b6f2bc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:25:03.125556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1af21ca2-b307-401c-8dbd-efcaa0b6f2bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2fc1ac5806c4620a87da96e49c45dcf', 'request_id': 'req-1af21ca2-b307-401c-8dbd-efcaa0b6f2bc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:25:03.137379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1af21ca2-b307-401c-8dbd-efcaa0b6f2bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2fc1ac5806c4620a87da96e49c45dcf', 'request_id': 'req-1af21ca2-b307-401c-8dbd-efcaa0b6f2bc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:25:03.163373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1af21ca2-b307-401c-8dbd-efcaa0b6f2bc admin admin] The token cache is being invalidate because project e2fc1ac5806c4620a87da96e49c45dcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:25:03.163678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1af21ca2-b307-401c-8dbd-efcaa0b6f2bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:25:03.165483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1af21ca2-b307-401c-8dbd-efcaa0b6f2bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:25:03.176477 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1841/3737] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:25:02 2022] DELETE /identity/v3/projects/e2fc1ac5806c4620a87da96e49c45dcf => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:25:03.183351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6db360-5dea-4737-84a0-19e0699721af None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:03.186632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6db360-5dea-4737-84a0-19e0699721af None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:03.187397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6db360-5dea-4737-84a0-19e0699721af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:03.252688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8b6db360-5dea-4737-84a0-19e0699721af None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:25:03.255177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8b6db360-5dea-4737-84a0-19e0699721af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:03.448057 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1897/3738] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:25:03.457365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6186da6-30f3-4b3d-883c-95b33949fa1a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:03.457662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6186da6-30f3-4b3d-883c-95b33949fa1a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:03.457972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6186da6-30f3-4b3d-883c-95b33949fa1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:03.600601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a6186da6-30f3-4b3d-883c-95b33949fa1a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:25:03.600601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a6186da6-30f3-4b3d-883c-95b33949fa1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:03.600601 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1842/3739] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:25:03.604836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6db360-5dea-4737-84a0-19e0699721af None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:03.639109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6db360-5dea-4737-84a0-19e0699721af None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:03.655755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a65b3d-c6d9-4fcf-8d36-673347d1db58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:03.663994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a65b3d-c6d9-4fcf-8d36-673347d1db58 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:03.663994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a65b3d-c6d9-4fcf-8d36-673347d1db58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:03.663994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a65b3d-c6d9-4fcf-8d36-673347d1db58 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:03.667385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a65b3d-c6d9-4fcf-8d36-673347d1db58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:25:03.667710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a65b3d-c6d9-4fcf-8d36-673347d1db58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:03.674248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a65b3d-c6d9-4fcf-8d36-673347d1db58 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:03.743012 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1898/3740] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:25:03.748381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6186da6-30f3-4b3d-883c-95b33949fa1a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:03.765263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6186da6-30f3-4b3d-883c-95b33949fa1a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:03.776791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bce7f-4423-4f24-aeae-44c4b8d81458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:03.782579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bce7f-4423-4f24-aeae-44c4b8d81458 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:03.782579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bce7f-4423-4f24-aeae-44c4b8d81458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:03.782579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bce7f-4423-4f24-aeae-44c4b8d81458 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:03.782579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bce7f-4423-4f24-aeae-44c4b8d81458 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:03.788192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bce7f-4423-4f24-aeae-44c4b8d81458 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:03.922602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a65b3d-c6d9-4fcf-8d36-673347d1db58 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:03.926500 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1843/3741] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:25:03 2022] POST /identity/v3/projects => generated 393 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:25:03.941437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a65b3d-c6d9-4fcf-8d36-673347d1db58 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:03.957064 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:25:04.238465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bb755-69dd-4100-b83d-e0a163953bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:04.238465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bb755-69dd-4100-b83d-e0a163953bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:04.238465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bb755-69dd-4100-b83d-e0a163953bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:04.238465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125bb755-69dd-4100-b83d-e0a163953bd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:04.239156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125bb755-69dd-4100-b83d-e0a163953bd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:04.258034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125bb755-69dd-4100-b83d-e0a163953bd0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:04.412726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bce7f-4423-4f24-aeae-44c4b8d81458 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:04.421271 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1899/3742] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:25:03 2022] POST /identity/v3/users => generated 297 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:25:04.428690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bce7f-4423-4f24-aeae-44c4b8d81458 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:04.444207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93148f-b0c7-4af8-acdb-da072fcb1d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:04.445039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93148f-b0c7-4af8-acdb-da072fcb1d64 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:04.445565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93148f-b0c7-4af8-acdb-da072fcb1d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:04.445951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c93148f-b0c7-4af8-acdb-da072fcb1d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:04.446830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93148f-b0c7-4af8-acdb-da072fcb1d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:04.449283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c93148f-b0c7-4af8-acdb-da072fcb1d64 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:04.459051 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:25:04.501304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bb755-69dd-4100-b83d-e0a163953bd0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:04.501964 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1844/3743] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:25:04.521250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125bb755-69dd-4100-b83d-e0a163953bd0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:04.540572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d11688-74b8-4a24-86e2-3020e006e866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:04.541242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d11688-74b8-4a24-86e2-3020e006e866 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:04.541532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d11688-74b8-4a24-86e2-3020e006e866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:04.541817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d11688-74b8-4a24-86e2-3020e006e866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:04.543187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d11688-74b8-4a24-86e2-3020e006e866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:04.551830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d11688-74b8-4a24-86e2-3020e006e866 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:04.572328 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1900/3744] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:25:04.577804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93148f-b0c7-4af8-acdb-da072fcb1d64 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:04.592958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c93148f-b0c7-4af8-acdb-da072fcb1d64 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:04.599409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37252d48-fbb7-4daf-9973-3105dd663582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:04.600312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37252d48-fbb7-4daf-9973-3105dd663582 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:04.600641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37252d48-fbb7-4daf-9973-3105dd663582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:04.601202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37252d48-fbb7-4daf-9973-3105dd663582 admin admin] PATH_INFO: `/v3/projects/7ea9920e4bd64d908f7312d30865f400/users/d5bd18a1135c4d1db18e9bf273cb0ea4/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:04.619530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37252d48-fbb7-4daf-9973-3105dd663582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ea9920e4bd64d908f7312d30865f400, user_id=d5bd18a1135c4d1db18e9bf273cb0ea4, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:04.623165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37252d48-fbb7-4daf-9973-3105dd663582 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:04.713123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097455b2-5234-430a-9b02-18e978108471 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:04.713267 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1845/3745] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:25:04 2022] PUT /identity/v3/projects/7ea9920e4bd64d908f7312d30865f400/users/d5bd18a1135c4d1db18e9bf273cb0ea4/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:25:04.713456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097455b2-5234-430a-9b02-18e978108471 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:04.713853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097455b2-5234-430a-9b02-18e978108471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:04.783315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-097455b2-5234-430a-9b02-18e978108471 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:25:04.784794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-097455b2-5234-430a-9b02-18e978108471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:04.931393 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1901/3746] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:25:04.955473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37252d48-fbb7-4daf-9973-3105dd663582 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:04.960322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-37252d48-fbb7-4daf-9973-3105dd663582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:05.139478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37252d48-fbb7-4daf-9973-3105dd663582 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:05.148222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966eb90-8a94-4714-ac71-730dccc2e04d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:05.173791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966eb90-8a94-4714-ac71-730dccc2e04d service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:05.174383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966eb90-8a94-4714-ac71-730dccc2e04d service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:05.174686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966eb90-8a94-4714-ac71-730dccc2e04d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:05.198266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966eb90-8a94-4714-ac71-730dccc2e04d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:05.200823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f966eb90-8a94-4714-ac71-730dccc2e04d service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:05.230728 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1846/3747] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:25:06.349532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2402a-9063-48cd-8428-b1a090603791 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:06.349951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2402a-9063-48cd-8428-b1a090603791 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:06.350113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2402a-9063-48cd-8428-b1a090603791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:06.408775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d0f2402a-9063-48cd-8428-b1a090603791 None None] MFA Rules not processed for user `2cba8748b6144d58a6f0ee45b2319d27`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:25:06.411439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d0f2402a-9063-48cd-8428-b1a090603791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:06.562865 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1902/3748] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:25:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:25:09.117281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966eb90-8a94-4714-ac71-730dccc2e04d service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:09.119911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f966eb90-8a94-4714-ac71-730dccc2e04d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:09.291925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966eb90-8a94-4714-ac71-730dccc2e04d service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:09.299635 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9ebb4-3fb8-4b6f-ace4-b9604019f9f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:09.301142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9ebb4-3fb8-4b6f-ace4-b9604019f9f4 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:09.301592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9ebb4-3fb8-4b6f-ace4-b9604019f9f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:09.301906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9ebb4-3fb8-4b6f-ace4-b9604019f9f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:09.303984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-88e9ebb4-3fb8-4b6f-ace4-b9604019f9f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:09.419668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9ebb4-3fb8-4b6f-ace4-b9604019f9f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:09.424777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9ebb4-3fb8-4b6f-ace4-b9604019f9f4 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:09.456792 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1847/3749] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:25:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:25:14.819267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb9e13-b759-4e4a-b3f4-539e45fc62c0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:14.820261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb9e13-b759-4e4a-b3f4-539e45fc62c0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:14.821338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb9e13-b759-4e4a-b3f4-539e45fc62c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:14.859284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ddeb9e13-b759-4e4a-b3f4-539e45fc62c0 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:25:14.860794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ddeb9e13-b759-4e4a-b3f4-539e45fc62c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:14.940536 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:25:14.993380 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1903/3750] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:25:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:25:15.035298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9ebb4-3fb8-4b6f-ace4-b9604019f9f4 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:15.035298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-88e9ebb4-3fb8-4b6f-ace4-b9604019f9f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:15.047900 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:25:15.146849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9ebb4-3fb8-4b6f-ace4-b9604019f9f4 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:15.154834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd24156-2a36-4273-9779-f3efc554a904 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:15.155529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd24156-2a36-4273-9779-f3efc554a904 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:15.156086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd24156-2a36-4273-9779-f3efc554a904 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:15.156385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd24156-2a36-4273-9779-f3efc554a904 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:15.175876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd24156-2a36-4273-9779-f3efc554a904 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:15.179711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd24156-2a36-4273-9779-f3efc554a904 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:15.204139 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1848/3751] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:25:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 14:25:20.065940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9c41e-f56d-4b2e-9751-02bf6707ea60 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:20.068914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9c41e-f56d-4b2e-9751-02bf6707ea60 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:20.069249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9c41e-f56d-4b2e-9751-02bf6707ea60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:20.114503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2aa9c41e-f56d-4b2e-9751-02bf6707ea60 None None] MFA Rules not processed for user `d5bd18a1135c4d1db18e9bf273cb0ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:25:20.115723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2aa9c41e-f56d-4b2e-9751-02bf6707ea60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:20.281421 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1904/3752] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:25:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:25:20.293507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed849a-543a-423e-934e-839b1f0d2a01 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:20.294837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed849a-543a-423e-934e-839b1f0d2a01 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:20.295201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ed849a-543a-423e-934e-839b1f0d2a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:20.322013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-46ed849a-543a-423e-934e-839b1f0d2a01 None None] MFA Rules not processed for user `d5bd18a1135c4d1db18e9bf273cb0ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:25:20.325524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-46ed849a-543a-423e-934e-839b1f0d2a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:20.357128 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1849/3753] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:25:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:25:20.401022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9c41e-f56d-4b2e-9751-02bf6707ea60 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:20.403144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2aa9c41e-f56d-4b2e-9751-02bf6707ea60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:20.442741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9c41e-f56d-4b2e-9751-02bf6707ea60 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:20.449237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41b4d4-9ee3-4eb9-8d58-2663fdc0bcae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:20.451063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41b4d4-9ee3-4eb9-8d58-2663fdc0bcae service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:20.451357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41b4d4-9ee3-4eb9-8d58-2663fdc0bcae service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:20.451646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41b4d4-9ee3-4eb9-8d58-2663fdc0bcae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:20.466660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41b4d4-9ee3-4eb9-8d58-2663fdc0bcae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:20.468795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41b4d4-9ee3-4eb9-8d58-2663fdc0bcae service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:20.479780 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1905/3754] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:25:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:25:22.067912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5359745-88a9-4268-ab20-0e18d37d1528 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:22.068581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5359745-88a9-4268-ab20-0e18d37d1528 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:22.069077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567e837-726a-4414-894f-8a724f353e01 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:22.069459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567e837-726a-4414-894f-8a724f353e01 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:22.069794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567e837-726a-4414-894f-8a724f353e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:22.070235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5359745-88a9-4268-ab20-0e18d37d1528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:22.130525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a5359745-88a9-4268-ab20-0e18d37d1528 None None] MFA Rules not processed for user `d5bd18a1135c4d1db18e9bf273cb0ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:25:22.132195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1567e837-726a-4414-894f-8a724f353e01 None None] MFA Rules not processed for user `b3a68ad6956b4455a857df0d3ac76489`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:25:22.132327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a5359745-88a9-4268-ab20-0e18d37d1528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:22.136532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1567e837-726a-4414-894f-8a724f353e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:22.142354 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1906/3755] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:25:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:25:22.258370 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1850/3756] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:25:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:25:26.721487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd3d4c-1746-478c-b574-ce00a9cf9d9e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:26.722245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd3d4c-1746-478c-b574-ce00a9cf9d9e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:26.722245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd3d4c-1746-478c-b574-ce00a9cf9d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:26.759096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-34bd3d4c-1746-478c-b574-ce00a9cf9d9e None None] MFA Rules not processed for user `586ae8d7c81047469eb9258be767c3d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:25:26.760364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-34bd3d4c-1746-478c-b574-ce00a9cf9d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:26.889912 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1907/3757] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:25:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:25:27.859133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567e837-726a-4414-894f-8a724f353e01 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:27.863504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1567e837-726a-4414-894f-8a724f353e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:27.955992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567e837-726a-4414-894f-8a724f353e01 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:27.961125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89aec20-9c46-4ee6-8579-2f7557c4437a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:27.961822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89aec20-9c46-4ee6-8579-2f7557c4437a service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:27.962132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89aec20-9c46-4ee6-8579-2f7557c4437a service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:27.962557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89aec20-9c46-4ee6-8579-2f7557c4437a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:27.964555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e89aec20-9c46-4ee6-8579-2f7557c4437a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:27.985197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89aec20-9c46-4ee6-8579-2f7557c4437a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:27.987198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89aec20-9c46-4ee6-8579-2f7557c4437a service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:27.999381 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1851/3758] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:25:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:25:28.117116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd3d4c-1746-478c-b574-ce00a9cf9d9e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:28.120168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-34bd3d4c-1746-478c-b574-ce00a9cf9d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:28.143367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd3d4c-1746-478c-b574-ce00a9cf9d9e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:28.149231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fcbe2b-80a6-446a-959b-6ba671351709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:28.151064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcbe2b-80a6-446a-959b-6ba671351709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:28.152330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcbe2b-80a6-446a-959b-6ba671351709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:28.153031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fcbe2b-80a6-446a-959b-6ba671351709 admin admin] PATH_INFO: `/v3/users/f52d884ec2854a09a81a0df5bfb197f0` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:28.155099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fcbe2b-80a6-446a-959b-6ba671351709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f52d884ec2854a09a81a0df5bfb197f0)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:28.158521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fcbe2b-80a6-446a-959b-6ba671351709 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:28.368539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-72fcbe2b-80a6-446a-959b-6ba671351709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f52d884ec2854a09a81a0df5bfb197f0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:25:28.369771 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:25:28.423044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-72fcbe2b-80a6-446a-959b-6ba671351709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f52d884ec2854a09a81a0df5bfb197f0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:25:28.436661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-72fcbe2b-80a6-446a-959b-6ba671351709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f52d884ec2854a09a81a0df5bfb197f0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:25:28.438432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-72fcbe2b-80a6-446a-959b-6ba671351709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f52d884ec2854a09a81a0df5bfb197f0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:25:28.504603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-72fcbe2b-80a6-446a-959b-6ba671351709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f52d884ec2854a09a81a0df5bfb197f0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:25:28.528745 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1908/3759] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:25:28 2022] DELETE /identity/v3/users/f52d884ec2854a09a81a0df5bfb197f0 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:25:28.889068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89aec20-9c46-4ee6-8579-2f7557c4437a service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:28.903052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89aec20-9c46-4ee6-8579-2f7557c4437a service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:28.972429 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:25:29.040552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88ae12-4374-43b7-9db4-fc6f2e28b660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:29.040552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88ae12-4374-43b7-9db4-fc6f2e28b660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:29.040552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88ae12-4374-43b7-9db4-fc6f2e28b660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:29.040552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88ae12-4374-43b7-9db4-fc6f2e28b660 admin admin] PATH_INFO: `/v3/projects/b5de50fd63d94fdab26292dfe659d3b8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:29.042675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88ae12-4374-43b7-9db4-fc6f2e28b660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5de50fd63d94fdab26292dfe659d3b8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:29.045692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88ae12-4374-43b7-9db4-fc6f2e28b660 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:29.183576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9b88ae12-4374-43b7-9db4-fc6f2e28b660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5de50fd63d94fdab26292dfe659d3b8', 'request_id': 'req-9b88ae12-4374-43b7-9db4-fc6f2e28b660'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:25:29.262806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9b88ae12-4374-43b7-9db4-fc6f2e28b660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5de50fd63d94fdab26292dfe659d3b8', 'request_id': 'req-9b88ae12-4374-43b7-9db4-fc6f2e28b660'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:25:29.272168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9b88ae12-4374-43b7-9db4-fc6f2e28b660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5de50fd63d94fdab26292dfe659d3b8', 'request_id': 'req-9b88ae12-4374-43b7-9db4-fc6f2e28b660'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:25:29.300586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9b88ae12-4374-43b7-9db4-fc6f2e28b660 admin admin] The token cache is being invalidate because project b5de50fd63d94fdab26292dfe659d3b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:25:29.300889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9b88ae12-4374-43b7-9db4-fc6f2e28b660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:25:29.303081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9b88ae12-4374-43b7-9db4-fc6f2e28b660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:25:29.307261 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1852/3760] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:25:28 2022] DELETE /identity/v3/projects/b5de50fd63d94fdab26292dfe659d3b8 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:25:29.313061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d26607-45b9-46f6-8fed-85221fbe0f5b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:29.319710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d26607-45b9-46f6-8fed-85221fbe0f5b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:29.319710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d26607-45b9-46f6-8fed-85221fbe0f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:29.344335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-84d26607-45b9-46f6-8fed-85221fbe0f5b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:25:29.345617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-84d26607-45b9-46f6-8fed-85221fbe0f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:29.465302 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1909/3761] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:25:29.467088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0832842-eef3-4feb-bda6-1c267e224b2d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:29.467391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0832842-eef3-4feb-bda6-1c267e224b2d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:29.467674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0832842-eef3-4feb-bda6-1c267e224b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:29.498247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c0832842-eef3-4feb-bda6-1c267e224b2d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:25:29.507586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c0832842-eef3-4feb-bda6-1c267e224b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:29.519671 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1853/3762] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:25:29.523827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d26607-45b9-46f6-8fed-85221fbe0f5b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:29.539044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d26607-45b9-46f6-8fed-85221fbe0f5b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:29.563772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671bcae-4b18-4750-baa3-a7ca91885a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:29.564695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671bcae-4b18-4750-baa3-a7ca91885a11 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:29.564979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671bcae-4b18-4750-baa3-a7ca91885a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:29.565254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671bcae-4b18-4750-baa3-a7ca91885a11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:29.565994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671bcae-4b18-4750-baa3-a7ca91885a11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:25:29.566344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671bcae-4b18-4750-baa3-a7ca91885a11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:29.567977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671bcae-4b18-4750-baa3-a7ca91885a11 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:29.608323 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1910/3763] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:25:29.610082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0832842-eef3-4feb-bda6-1c267e224b2d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:29.631537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0832842-eef3-4feb-bda6-1c267e224b2d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:29.663602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306a439-20e5-48cd-8ea6-a60b83da1335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:29.664749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306a439-20e5-48cd-8ea6-a60b83da1335 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:29.664917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306a439-20e5-48cd-8ea6-a60b83da1335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:29.665604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306a439-20e5-48cd-8ea6-a60b83da1335 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:29.666929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306a439-20e5-48cd-8ea6-a60b83da1335 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:29.672262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306a439-20e5-48cd-8ea6-a60b83da1335 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:29.784750 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1854/3764] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:25:29 2022] POST /identity/v3/projects => generated 371 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:25:29.790072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671bcae-4b18-4750-baa3-a7ca91885a11 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:29.806581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671bcae-4b18-4750-baa3-a7ca91885a11 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:29.961230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d2573-7124-4c41-b85c-53e2e5d9d8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:29.962243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d2573-7124-4c41-b85c-53e2e5d9d8d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:29.964233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d2573-7124-4c41-b85c-53e2e5d9d8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:29.966037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d2573-7124-4c41-b85c-53e2e5d9d8d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:29.967579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d2573-7124-4c41-b85c-53e2e5d9d8d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:29.971191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d2573-7124-4c41-b85c-53e2e5d9d8d0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:30.054286 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1911/3765] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:25:29 2022] POST /identity/v3/users => generated 286 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:25:30.056698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306a439-20e5-48cd-8ea6-a60b83da1335 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:30.087349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306a439-20e5-48cd-8ea6-a60b83da1335 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:30.136846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75becd4-3ecd-4eee-aab6-684b3cb0f58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:30.137713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75becd4-3ecd-4eee-aab6-684b3cb0f58d admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:30.138219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75becd4-3ecd-4eee-aab6-684b3cb0f58d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:30.138381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75becd4-3ecd-4eee-aab6-684b3cb0f58d admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:30.139357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75becd4-3ecd-4eee-aab6-684b3cb0f58d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:30.144591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75becd4-3ecd-4eee-aab6-684b3cb0f58d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:30.204469 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1855/3766] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:25:30.206475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d2573-7124-4c41-b85c-53e2e5d9d8d0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:30.221760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d2573-7124-4c41-b85c-53e2e5d9d8d0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:30.248156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716a03c-e03a-408c-a7d5-16cb87d7e617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:30.248617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716a03c-e03a-408c-a7d5-16cb87d7e617 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:30.249622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716a03c-e03a-408c-a7d5-16cb87d7e617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:30.249909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716a03c-e03a-408c-a7d5-16cb87d7e617 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:30.256901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716a03c-e03a-408c-a7d5-16cb87d7e617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:30.268459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716a03c-e03a-408c-a7d5-16cb87d7e617 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:30.328683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75becd4-3ecd-4eee-aab6-684b3cb0f58d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:30.336370 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1912/3767] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:25:30.351846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75becd4-3ecd-4eee-aab6-684b3cb0f58d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:30.361277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436fe553-81dc-41b6-b320-5f3c25b5c6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:30.362397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fe553-81dc-41b6-b320-5f3c25b5c6c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:30.362855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fe553-81dc-41b6-b320-5f3c25b5c6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:30.363641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436fe553-81dc-41b6-b320-5f3c25b5c6c1 admin admin] PATH_INFO: `/v3/projects/a48503d035ed4bf785f69bbb7a88986d/users/7df31896310c40c1851a7c66becb2e62/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:30.412276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fe553-81dc-41b6-b320-5f3c25b5c6c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a48503d035ed4bf785f69bbb7a88986d, user_id=7df31896310c40c1851a7c66becb2e62, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:30.414994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436fe553-81dc-41b6-b320-5f3c25b5c6c1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:30.617260 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1856/3768] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:25:30 2022] PUT /identity/v3/projects/a48503d035ed4bf785f69bbb7a88986d/users/7df31896310c40c1851a7c66becb2e62/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:25:30.629757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5c56f-2ed0-4b89-8256-ea5720e0b2fb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:30.630126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5c56f-2ed0-4b89-8256-ea5720e0b2fb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:30.630434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5c56f-2ed0-4b89-8256-ea5720e0b2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:30.700067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e6e5c56f-2ed0-4b89-8256-ea5720e0b2fb None None] MFA Rules not processed for user `7df31896310c40c1851a7c66becb2e62`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:25:30.701721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e6e5c56f-2ed0-4b89-8256-ea5720e0b2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:30.746796 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:25:30.826554 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1913/3769] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:25:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:25:30.837807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06081d-b0d6-4ff7-88bb-c8312359a76a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:30.838144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06081d-b0d6-4ff7-88bb-c8312359a76a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:30.838853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06081d-b0d6-4ff7-88bb-c8312359a76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:30.881080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4d06081d-b0d6-4ff7-88bb-c8312359a76a None None] MFA Rules not processed for user `7df31896310c40c1851a7c66becb2e62`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:25:30.882425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4d06081d-b0d6-4ff7-88bb-c8312359a76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:30.911911 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1857/3770] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:25:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:25:31.172995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5c56f-2ed0-4b89-8256-ea5720e0b2fb None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:31.176785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e6e5c56f-2ed0-4b89-8256-ea5720e0b2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:31.378416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5c56f-2ed0-4b89-8256-ea5720e0b2fb None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:31.396443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65804a30-573d-4309-bfd3-e25764f4665d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:31.400684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65804a30-573d-4309-bfd3-e25764f4665d service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:31.400684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65804a30-573d-4309-bfd3-e25764f4665d service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:31.400684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65804a30-573d-4309-bfd3-e25764f4665d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:31.424604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65804a30-573d-4309-bfd3-e25764f4665d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:31.428713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65804a30-573d-4309-bfd3-e25764f4665d service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:31.452889 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1914/3771] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:25:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:25:40.869010 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:25:41.437261 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=52 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:25:45.376016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543d9ee-a7b4-477f-8a43-eaac5ac8b274 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:45.377042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543d9ee-a7b4-477f-8a43-eaac5ac8b274 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:45.377488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543d9ee-a7b4-477f-8a43-eaac5ac8b274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:45.406248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b543d9ee-a7b4-477f-8a43-eaac5ac8b274 None None] MFA Rules not processed for user `2928d7efad6a46d7b69df9644a6480b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:25:45.409483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b543d9ee-a7b4-477f-8a43-eaac5ac8b274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:45.501127 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1858/3772] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:25:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:25:46.840385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d3e11-0f6b-48c8-bd9b-1931f2b3c0da None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:46.840955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d3e11-0f6b-48c8-bd9b-1931f2b3c0da None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:46.840955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d3e11-0f6b-48c8-bd9b-1931f2b3c0da None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:46.843641 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1915/3773] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:25:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:25:46.850844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d526d-59e6-4b59-895b-eb3cd68f5bfd None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:46.851988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d526d-59e6-4b59-895b-eb3cd68f5bfd None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:46.852622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d526d-59e6-4b59-895b-eb3cd68f5bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:46.936798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-003d526d-59e6-4b59-895b-eb3cd68f5bfd None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:25:46.938786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-003d526d-59e6-4b59-895b-eb3cd68f5bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:47.031633 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1859/3774] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:25:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:25:47.054451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d3e11-0f6b-48c8-bd9b-1931f2b3c0da None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:47.059153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d23d3e11-0f6b-48c8-bd9b-1931f2b3c0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:47.064677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d526d-59e6-4b59-895b-eb3cd68f5bfd None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:25:47.066323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-003d526d-59e6-4b59-895b-eb3cd68f5bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:47.083968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23d3e11-0f6b-48c8-bd9b-1931f2b3c0da None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:47.090756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d526d-59e6-4b59-895b-eb3cd68f5bfd None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:25:47.091602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770d8c6-f352-4364-aa12-a0e29c790c15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:47.092513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770d8c6-f352-4364-aa12-a0e29c790c15 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:47.093045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770d8c6-f352-4364-aa12-a0e29c790c15 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:47.093533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770d8c6-f352-4364-aa12-a0e29c790c15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:47.106353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770d8c6-f352-4364-aa12-a0e29c790c15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:47.108882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770d8c6-f352-4364-aa12-a0e29c790c15 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:47.116147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe17ec-b200-4438-a13b-272a5cbda552 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:25:47.118984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe17ec-b200-4438-a13b-272a5cbda552 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:47.119438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe17ec-b200-4438-a13b-272a5cbda552 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:47.120239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe17ec-b200-4438-a13b-272a5cbda552 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:47.126621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d5fe17ec-b200-4438-a13b-272a5cbda552 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:47.144517 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1916/3775] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:25:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:25:47.164991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe17ec-b200-4438-a13b-272a5cbda552 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:25:47.170450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fe17ec-b200-4438-a13b-272a5cbda552 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:25:47.186546 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1860/3776] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:25:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:25:47.807996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac8665-4132-4283-be64-e1cc976f5157 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:47.808649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac8665-4132-4283-be64-e1cc976f5157 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:47.809157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac8665-4132-4283-be64-e1cc976f5157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:47.871275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-97ac8665-4132-4283-be64-e1cc976f5157 None None] MFA Rules not processed for user `2928d7efad6a46d7b69df9644a6480b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:25:47.872671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-97ac8665-4132-4283-be64-e1cc976f5157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:47.898859 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1917/3777] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:25:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:25:50.340127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b16fb-cd53-46a9-8c33-a56122b6c3bd None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:25:50.340127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b16fb-cd53-46a9-8c33-a56122b6c3bd None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:25:50.340127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917b16fb-cd53-46a9-8c33-a56122b6c3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:25:50.369402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-917b16fb-cd53-46a9-8c33-a56122b6c3bd None None] MFA Rules not processed for user `76bd949bbb4a47a6aa32a00e82767058`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:25:50.370818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-917b16fb-cd53-46a9-8c33-a56122b6c3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:25:50.496769 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1861/3778] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:25:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:25:57.862940 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=9 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:00.475170 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:06.370607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0614583-eb26-445c-871a-a2d05526ee9d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:06.371269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0614583-eb26-445c-871a-a2d05526ee9d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:06.371269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0614583-eb26-445c-871a-a2d05526ee9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:06.411512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d0614583-eb26-445c-871a-a2d05526ee9d None None] MFA Rules not processed for user `2cba8748b6144d58a6f0ee45b2319d27`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:06.414946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d0614583-eb26-445c-871a-a2d05526ee9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:06.574608 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1918/3779] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:07.563054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b16fb-cd53-46a9-8c33-a56122b6c3bd None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:07.567566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-917b16fb-cd53-46a9-8c33-a56122b6c3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:07.685125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917b16fb-cd53-46a9-8c33-a56122b6c3bd None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:07.685125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fdbdd-2272-48ce-92f6-66d456e0a6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:07.685125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fdbdd-2272-48ce-92f6-66d456e0a6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:07.685125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fdbdd-2272-48ce-92f6-66d456e0a6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:07.685530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fdbdd-2272-48ce-92f6-66d456e0a6fd admin admin] PATH_INFO: `/v3/users/68dd6976fe754e4ab64acd9beb22d266` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:07.687631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fdbdd-2272-48ce-92f6-66d456e0a6fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=68dd6976fe754e4ab64acd9beb22d266)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:07.695214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fdbdd-2272-48ce-92f6-66d456e0a6fd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:07.914777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d62fdbdd-2272-48ce-92f6-66d456e0a6fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68dd6976fe754e4ab64acd9beb22d266'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:07.929342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d62fdbdd-2272-48ce-92f6-66d456e0a6fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68dd6976fe754e4ab64acd9beb22d266'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:07.930637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d62fdbdd-2272-48ce-92f6-66d456e0a6fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68dd6976fe754e4ab64acd9beb22d266'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:07.931506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d62fdbdd-2272-48ce-92f6-66d456e0a6fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68dd6976fe754e4ab64acd9beb22d266'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:07.940670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d62fdbdd-2272-48ce-92f6-66d456e0a6fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68dd6976fe754e4ab64acd9beb22d266'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:08.032864 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1862/3780] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:26:07 2022] DELETE /identity/v3/users/68dd6976fe754e4ab64acd9beb22d266 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:08.717997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0614583-eb26-445c-871a-a2d05526ee9d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:08.739900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0614583-eb26-445c-871a-a2d05526ee9d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:08.937465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aa19c5-c435-4985-9a5e-b7576e9e9a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:08.939030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa19c5-c435-4985-9a5e-b7576e9e9a98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:08.939319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa19c5-c435-4985-9a5e-b7576e9e9a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:08.939604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aa19c5-c435-4985-9a5e-b7576e9e9a98 admin admin] PATH_INFO: `/v3/projects/8976f27d27f24d4a8f8ac4da9300a956` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:08.942011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa19c5-c435-4985-9a5e-b7576e9e9a98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8976f27d27f24d4a8f8ac4da9300a956)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:08.943998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aa19c5-c435-4985-9a5e-b7576e9e9a98 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:09.128744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-90aa19c5-c435-4985-9a5e-b7576e9e9a98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8976f27d27f24d4a8f8ac4da9300a956', 'request_id': 'req-90aa19c5-c435-4985-9a5e-b7576e9e9a98'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:09.140583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-90aa19c5-c435-4985-9a5e-b7576e9e9a98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8976f27d27f24d4a8f8ac4da9300a956', 'request_id': 'req-90aa19c5-c435-4985-9a5e-b7576e9e9a98'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:09.151839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-90aa19c5-c435-4985-9a5e-b7576e9e9a98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8976f27d27f24d4a8f8ac4da9300a956', 'request_id': 'req-90aa19c5-c435-4985-9a5e-b7576e9e9a98'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:09.229239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-90aa19c5-c435-4985-9a5e-b7576e9e9a98 admin admin] The token cache is being invalidate because project 8976f27d27f24d4a8f8ac4da9300a956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:26:09.230201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-90aa19c5-c435-4985-9a5e-b7576e9e9a98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:09.232321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-90aa19c5-c435-4985-9a5e-b7576e9e9a98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:09.235164 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1919/3781] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:26:08 2022] DELETE /identity/v3/projects/8976f27d27f24d4a8f8ac4da9300a956 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:09.240719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdf93c-ca6d-49ca-9b6d-2a3231888b92 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:09.241213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdf93c-ca6d-49ca-9b6d-2a3231888b92 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:09.241549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bdf93c-ca6d-49ca-9b6d-2a3231888b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:09.292984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-53bdf93c-ca6d-49ca-9b6d-2a3231888b92 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:09.295267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-53bdf93c-ca6d-49ca-9b6d-2a3231888b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:09.420330 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1863/3782] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:26:09.429802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274678e5-74cb-4539-b3a4-327df17aa343 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:09.435241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274678e5-74cb-4539-b3a4-327df17aa343 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:09.435241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274678e5-74cb-4539-b3a4-327df17aa343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:09.473071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-274678e5-74cb-4539-b3a4-327df17aa343 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:09.474363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-274678e5-74cb-4539-b3a4-327df17aa343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:09.488714 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1920/3783] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:09.493086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdf93c-ca6d-49ca-9b6d-2a3231888b92 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:09.505432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bdf93c-ca6d-49ca-9b6d-2a3231888b92 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:09.522723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed308b-49c5-446f-8176-a141b880f1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:09.523752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed308b-49c5-446f-8176-a141b880f1fe admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:09.524235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed308b-49c5-446f-8176-a141b880f1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:09.524714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed308b-49c5-446f-8176-a141b880f1fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:09.525685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed308b-49c5-446f-8176-a141b880f1fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:26:09.526257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed308b-49c5-446f-8176-a141b880f1fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:09.528215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed308b-49c5-446f-8176-a141b880f1fe admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:09.549686 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1864/3784] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:09.551253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274678e5-74cb-4539-b3a4-327df17aa343 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:09.562539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274678e5-74cb-4539-b3a4-327df17aa343 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:09.576942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05eb2b-7f05-4f33-ba13-fbae174a3da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:09.577631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05eb2b-7f05-4f33-ba13-fbae174a3da4 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:09.578120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05eb2b-7f05-4f33-ba13-fbae174a3da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:09.578407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05eb2b-7f05-4f33-ba13-fbae174a3da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:09.579113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05eb2b-7f05-4f33-ba13-fbae174a3da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:09.581142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05eb2b-7f05-4f33-ba13-fbae174a3da4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:09.746775 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1921/3785] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:26:09 2022] POST /identity/v3/projects => generated 365 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:09.751105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed308b-49c5-446f-8176-a141b880f1fe admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:09.766666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed308b-49c5-446f-8176-a141b880f1fe admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:09.773691 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:09.836051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d1e70-94ac-426f-b61f-9d50f57fa625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:09.836872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d1e70-94ac-426f-b61f-9d50f57fa625 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:09.837239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d1e70-94ac-426f-b61f-9d50f57fa625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:09.837587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d1e70-94ac-426f-b61f-9d50f57fa625 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:09.838438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d1e70-94ac-426f-b61f-9d50f57fa625 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:09.840488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d1e70-94ac-426f-b61f-9d50f57fa625 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:09.963601 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1865/3786] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:26:09 2022] POST /identity/v3/users => generated 283 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:09.964715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05eb2b-7f05-4f33-ba13-fbae174a3da4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:09.975603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05eb2b-7f05-4f33-ba13-fbae174a3da4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:09.982342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec74ab2-0457-41bd-90f5-f73b538e400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:09.983302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec74ab2-0457-41bd-90f5-f73b538e400d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:09.983588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec74ab2-0457-41bd-90f5-f73b538e400d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:09.983867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec74ab2-0457-41bd-90f5-f73b538e400d admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:09.984607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec74ab2-0457-41bd-90f5-f73b538e400d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:09.986492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec74ab2-0457-41bd-90f5-f73b538e400d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:09.991748 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:10.000351 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1922/3787] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:26:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:26:10.004616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d1e70-94ac-426f-b61f-9d50f57fa625 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:10.018950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d1e70-94ac-426f-b61f-9d50f57fa625 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:10.024001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc08e4-816a-49cc-a08b-f58392d92299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:10.024727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc08e4-816a-49cc-a08b-f58392d92299 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:10.025020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc08e4-816a-49cc-a08b-f58392d92299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:10.025299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc08e4-816a-49cc-a08b-f58392d92299 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:10.026258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc08e4-816a-49cc-a08b-f58392d92299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:10.031957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc08e4-816a-49cc-a08b-f58392d92299 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:10.043563 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1866/3788] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:26:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:26:10.044503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec74ab2-0457-41bd-90f5-f73b538e400d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:10.067098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec74ab2-0457-41bd-90f5-f73b538e400d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:10.076590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3ffe7-114b-4247-a0f8-b82973f9e141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:10.080581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3ffe7-114b-4247-a0f8-b82973f9e141 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:10.080894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3ffe7-114b-4247-a0f8-b82973f9e141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:10.081167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3ffe7-114b-4247-a0f8-b82973f9e141 admin admin] PATH_INFO: `/v3/projects/9aa502349b444e199a236c0f5782743d/users/4c86a363f09841e29cc41804d48fc561/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:10.102425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3ffe7-114b-4247-a0f8-b82973f9e141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa502349b444e199a236c0f5782743d, user_id=4c86a363f09841e29cc41804d48fc561, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:10.106035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3ffe7-114b-4247-a0f8-b82973f9e141 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:10.238261 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1923/3789] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:26:10 2022] PUT /identity/v3/projects/9aa502349b444e199a236c0f5782743d/users/4c86a363f09841e29cc41804d48fc561/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:10.244235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4bbd2-d7f3-4be5-ba34-e6395fdc434b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:10.244817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4bbd2-d7f3-4be5-ba34-e6395fdc434b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:10.244817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4bbd2-d7f3-4be5-ba34-e6395fdc434b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:10.280387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-50b4bbd2-d7f3-4be5-ba34-e6395fdc434b None None] MFA Rules not processed for user `4c86a363f09841e29cc41804d48fc561`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:10.281876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-50b4bbd2-d7f3-4be5-ba34-e6395fdc434b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:10.373075 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1867/3790] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:10.388080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3ffe7-114b-4247-a0f8-b82973f9e141 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:10.390060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1ba3ffe7-114b-4247-a0f8-b82973f9e141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:10.505131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3ffe7-114b-4247-a0f8-b82973f9e141 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:10.521051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930f700-3bbe-4008-81a5-0f199e718e6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:10.523387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930f700-3bbe-4008-81a5-0f199e718e6b service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:10.523387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930f700-3bbe-4008-81a5-0f199e718e6b service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:10.524201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930f700-3bbe-4008-81a5-0f199e718e6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:10.535250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930f700-3bbe-4008-81a5-0f199e718e6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:10.536931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930f700-3bbe-4008-81a5-0f199e718e6b service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:10.545081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4bbd2-d7f3-4be5-ba34-e6395fdc434b None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:10.547689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-50b4bbd2-d7f3-4be5-ba34-e6395fdc434b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:10.550921 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1924/3791] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:26:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:26:10.568234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054c7b3-a416-404f-94d5-44c236bad276 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:10.568524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054c7b3-a416-404f-94d5-44c236bad276 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:10.568808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054c7b3-a416-404f-94d5-44c236bad276 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:10.570526 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1925/3792] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:26:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 14:26:10.576891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054c7b3-a416-404f-94d5-44c236bad276 None None] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:26:10.601328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054c7b3-a416-404f-94d5-44c236bad276 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:10.614754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054c7b3-a416-404f-94d5-44c236bad276 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:10.621541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96795fae-28a7-43d1-b009-34db1ee6fd29 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c86a363f09841e29cc41804d48fc561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9aa502349b444e199a236c0f5782743d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:10.622674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96795fae-28a7-43d1-b009-34db1ee6fd29 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:10.626526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96795fae-28a7-43d1-b009-34db1ee6fd29 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:10.631964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96795fae-28a7-43d1-b009-34db1ee6fd29 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] PATH_INFO: `/v3/projects/9aa502349b444e199a236c0f5782743d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:10.631964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96795fae-28a7-43d1-b009-34db1ee6fd29 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] RBAC: Authorizing `identity:get_project(project_id=9aa502349b444e199a236c0f5782743d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:10.631964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96795fae-28a7-43d1-b009-34db1ee6fd29 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:10.643390 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1926/3793] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:26:10 2022] GET /identity/v3/projects/9aa502349b444e199a236c0f5782743d => generated 365 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:10.716484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97807f3d-4131-403e-ab93-04aef9198232 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:10.716770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97807f3d-4131-403e-ab93-04aef9198232 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:10.717332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97807f3d-4131-403e-ab93-04aef9198232 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:10.720556 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1927/3794] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:26:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 14:26:10.726980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97807f3d-4131-403e-ab93-04aef9198232 None None] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:26:10.739913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4bbd2-d7f3-4be5-ba34-e6395fdc434b None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:10.749826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4ff135-331b-4814-9cdd-f84225751595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:10.751080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ff135-331b-4814-9cdd-f84225751595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:10.751434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ff135-331b-4814-9cdd-f84225751595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:10.751806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4ff135-331b-4814-9cdd-f84225751595 admin admin] PATH_INFO: `/v3/users/586ae8d7c81047469eb9258be767c3d3` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:10.753230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ff135-331b-4814-9cdd-f84225751595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=586ae8d7c81047469eb9258be767c3d3)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:10.755271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4ff135-331b-4814-9cdd-f84225751595 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:10.757692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97807f3d-4131-403e-ab93-04aef9198232 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:10.778494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97807f3d-4131-403e-ab93-04aef9198232 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:10.783069 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:10.791825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e13b76-27ad-46bb-a720-e485a0de6727 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c86a363f09841e29cc41804d48fc561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9aa502349b444e199a236c0f5782743d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:10.795096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e13b76-27ad-46bb-a720-e485a0de6727 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:10.795584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e13b76-27ad-46bb-a720-e485a0de6727 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:10.797211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e13b76-27ad-46bb-a720-e485a0de6727 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] PATH_INFO: `/v3/projects/9aa502349b444e199a236c0f5782743d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:10.799022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e13b76-27ad-46bb-a720-e485a0de6727 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] RBAC: Authorizing `identity:get_project(project_id=9aa502349b444e199a236c0f5782743d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:10.800997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e13b76-27ad-46bb-a720-e485a0de6727 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:10.802919 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1928/3795] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:26:10 2022] GET /identity/v3/projects/9aa502349b444e199a236c0f5782743d => generated 365 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:11.042699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9e4ff135-331b-4814-9cdd-f84225751595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '586ae8d7c81047469eb9258be767c3d3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:11.059861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9e4ff135-331b-4814-9cdd-f84225751595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '586ae8d7c81047469eb9258be767c3d3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:11.061098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9e4ff135-331b-4814-9cdd-f84225751595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '586ae8d7c81047469eb9258be767c3d3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:11.061794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9e4ff135-331b-4814-9cdd-f84225751595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '586ae8d7c81047469eb9258be767c3d3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:11.080816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9e4ff135-331b-4814-9cdd-f84225751595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '586ae8d7c81047469eb9258be767c3d3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:11.110601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35537c-f759-41df-a057-98ad3d898631 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:11.110894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35537c-f759-41df-a057-98ad3d898631 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:11.111177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35537c-f759-41df-a057-98ad3d898631 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:11.116442 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1929/3796] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:26:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 14:26:11.127168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35537c-f759-41df-a057-98ad3d898631 None None] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:26:11.129553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bb35537c-f759-41df-a057-98ad3d898631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:11.193407 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1868/3797] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:26:10 2022] DELETE /identity/v3/users/586ae8d7c81047469eb9258be767c3d3 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:11.223325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35537c-f759-41df-a057-98ad3d898631 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:11.226886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bb35537c-f759-41df-a057-98ad3d898631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:11.271632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35537c-f759-41df-a057-98ad3d898631 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:11.422815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25142656-db07-4229-9c13-5ae7f49f0cb1 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c86a363f09841e29cc41804d48fc561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9aa502349b444e199a236c0f5782743d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:11.427951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25142656-db07-4229-9c13-5ae7f49f0cb1 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:11.428431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25142656-db07-4229-9c13-5ae7f49f0cb1 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:11.428731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25142656-db07-4229-9c13-5ae7f49f0cb1 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] PATH_INFO: `/v3/projects/9aa502349b444e199a236c0f5782743d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:11.432336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25142656-db07-4229-9c13-5ae7f49f0cb1 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] RBAC: Authorizing `identity:get_project(project_id=9aa502349b444e199a236c0f5782743d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:11.437814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25142656-db07-4229-9c13-5ae7f49f0cb1 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:11.445031 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1930/3798] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:26:11 2022] GET /identity/v3/projects/9aa502349b444e199a236c0f5782743d => generated 365 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:11.648741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43076b-a150-4e91-a585-2a69156df80e None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:11.649641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43076b-a150-4e91-a585-2a69156df80e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:11.650152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43076b-a150-4e91-a585-2a69156df80e None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:11.652700 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1869/3799] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:26:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:26:11.658785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25142656-db07-4229-9c13-5ae7f49f0cb1 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:26:11.661603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-25142656-db07-4229-9c13-5ae7f49f0cb1 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:11.718214 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:11.759047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25142656-db07-4229-9c13-5ae7f49f0cb1 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:11.773676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43076b-a150-4e91-a585-2a69156df80e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:11.773979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25142656-db07-4229-9c13-5ae7f49f0cb1 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:11.776504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6e43076b-a150-4e91-a585-2a69156df80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:11.781464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed1597-5086-408b-9f13-d3b2c392ab11 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c86a363f09841e29cc41804d48fc561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9aa502349b444e199a236c0f5782743d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:11.783489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed1597-5086-408b-9f13-d3b2c392ab11 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:11.783990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed1597-5086-408b-9f13-d3b2c392ab11 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:11.785173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed1597-5086-408b-9f13-d3b2c392ab11 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] PATH_INFO: `/v3/projects/9aa502349b444e199a236c0f5782743d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:11.788151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed1597-5086-408b-9f13-d3b2c392ab11 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] RBAC: Authorizing `identity:get_project(project_id=9aa502349b444e199a236c0f5782743d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:11.790820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed1597-5086-408b-9f13-d3b2c392ab11 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:11.793379 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1931/3800] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:26:11 2022] GET /identity/v3/projects/9aa502349b444e199a236c0f5782743d => generated 365 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:11.851193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb80cd-fb91-4d39-9257-c1559e4fdca0 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:11.851403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb80cd-fb91-4d39-9257-c1559e4fdca0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:11.851873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cb80cd-fb91-4d39-9257-c1559e4fdca0 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:11.853405 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1932/3801] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:26:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 14:26:11.860932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb80cd-fb91-4d39-9257-c1559e4fdca0 None None] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 14:26:11.871384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43076b-a150-4e91-a585-2a69156df80e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:11.877700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a7671-1a15-400f-ab26-5a764e654168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:11.878739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a7671-1a15-400f-ab26-5a764e654168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:11.879130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a7671-1a15-400f-ab26-5a764e654168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:11.879511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a7671-1a15-400f-ab26-5a764e654168 admin admin] PATH_INFO: `/v3/projects/d16eb550d1df4dd3bc2df35d9be320a8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:11.879739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb80cd-fb91-4d39-9257-c1559e4fdca0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:11.880885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a7671-1a15-400f-ab26-5a764e654168 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d16eb550d1df4dd3bc2df35d9be320a8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:11.882972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a7671-1a15-400f-ab26-5a764e654168 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:11.892176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cb80cd-fb91-4d39-9257-c1559e4fdca0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:11.902930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc636ba-c508-46c7-87a5-6c8d881c4bb4 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4c86a363f09841e29cc41804d48fc561', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9aa502349b444e199a236c0f5782743d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:11.905175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc636ba-c508-46c7-87a5-6c8d881c4bb4 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:11.905175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc636ba-c508-46c7-87a5-6c8d881c4bb4 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:11.905175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc636ba-c508-46c7-87a5-6c8d881c4bb4 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] PATH_INFO: `/v3/projects/9aa502349b444e199a236c0f5782743d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:11.906068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc636ba-c508-46c7-87a5-6c8d881c4bb4 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] RBAC: Authorizing `identity:get_project(project_id=9aa502349b444e199a236c0f5782743d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:11.908542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc636ba-c508-46c7-87a5-6c8d881c4bb4 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:11.918348 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1933/3802] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 14:26:11 2022] GET /identity/v3/projects/9aa502349b444e199a236c0f5782743d => generated 365 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:11.954242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc636ba-c508-46c7-87a5-6c8d881c4bb4 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:11.958393 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1fc636ba-c508-46c7-87a5-6c8d881c4bb4 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:11.975551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc636ba-c508-46c7-87a5-6c8d881c4bb4 tempest-QuotasTestJSON-1125427239 tempest-QuotasTestJSON-1125427239-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:11.988155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77acc6d8-0a9a-46e6-aa38-3df00d38c642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:11.989115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acc6d8-0a9a-46e6-aa38-3df00d38c642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:11.989575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acc6d8-0a9a-46e6-aa38-3df00d38c642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:11.989906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77acc6d8-0a9a-46e6-aa38-3df00d38c642 admin admin] PATH_INFO: `/v3/users/4c86a363f09841e29cc41804d48fc561` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:11.992006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77acc6d8-0a9a-46e6-aa38-3df00d38c642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c86a363f09841e29cc41804d48fc561)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:11.994689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77acc6d8-0a9a-46e6-aa38-3df00d38c642 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:12.013450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ba4a7671-1a15-400f-ab26-5a764e654168 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd16eb550d1df4dd3bc2df35d9be320a8', 'request_id': 'req-ba4a7671-1a15-400f-ab26-5a764e654168'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:12.141657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ba4a7671-1a15-400f-ab26-5a764e654168 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd16eb550d1df4dd3bc2df35d9be320a8', 'request_id': 'req-ba4a7671-1a15-400f-ab26-5a764e654168'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:12.152068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ba4a7671-1a15-400f-ab26-5a764e654168 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd16eb550d1df4dd3bc2df35d9be320a8', 'request_id': 'req-ba4a7671-1a15-400f-ab26-5a764e654168'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:12.172340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ba4a7671-1a15-400f-ab26-5a764e654168 admin admin] The token cache is being invalidate because project d16eb550d1df4dd3bc2df35d9be320a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:26:12.172669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ba4a7671-1a15-400f-ab26-5a764e654168 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:12.174336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ba4a7671-1a15-400f-ab26-5a764e654168 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:12.175975 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1870/3803] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:26:11 2022] DELETE /identity/v3/projects/d16eb550d1df4dd3bc2df35d9be320a8 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:12.181236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34d450-22d4-48ad-adc7-bde18696a8f5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:12.181525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34d450-22d4-48ad-adc7-bde18696a8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:12.181800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34d450-22d4-48ad-adc7-bde18696a8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:12.238421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2e34d450-22d4-48ad-adc7-bde18696a8f5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:12.239630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2e34d450-22d4-48ad-adc7-bde18696a8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:12.291344 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:12.295242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77acc6d8-0a9a-46e6-aa38-3df00d38c642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c86a363f09841e29cc41804d48fc561'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:12.341349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77acc6d8-0a9a-46e6-aa38-3df00d38c642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c86a363f09841e29cc41804d48fc561'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:12.356836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77acc6d8-0a9a-46e6-aa38-3df00d38c642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c86a363f09841e29cc41804d48fc561'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:12.358770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77acc6d8-0a9a-46e6-aa38-3df00d38c642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c86a363f09841e29cc41804d48fc561'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:12.372162 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1871/3804] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:12.381071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b1de4-79d9-440f-8e24-c838d19217e7 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:12.381391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b1de4-79d9-440f-8e24-c838d19217e7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:12.381673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b1de4-79d9-440f-8e24-c838d19217e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:12.421408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-587b1de4-79d9-440f-8e24-c838d19217e7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:12.423251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-587b1de4-79d9-440f-8e24-c838d19217e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:12.442483 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1872/3805] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:26:12.446675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b1de4-79d9-440f-8e24-c838d19217e7 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:12.451142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77acc6d8-0a9a-46e6-aa38-3df00d38c642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c86a363f09841e29cc41804d48fc561'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:12.464896 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1934/3806] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:26:11 2022] DELETE /identity/v3/users/4c86a363f09841e29cc41804d48fc561 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:12.466196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f1156-e326-4a10-a3da-28fb58afae3c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:12.466478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f1156-e326-4a10-a3da-28fb58afae3c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:12.466762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f1156-e326-4a10-a3da-28fb58afae3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:12.506215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-df9f1156-e326-4a10-a3da-28fb58afae3c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:12.507508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-df9f1156-e326-4a10-a3da-28fb58afae3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:12.516326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b1de4-79d9-440f-8e24-c838d19217e7 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:12.610140 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1935/3807] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:12.618945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f1156-e326-4a10-a3da-28fb58afae3c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:12.621241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-df9f1156-e326-4a10-a3da-28fb58afae3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:12.634565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfca227-fc52-44a9-8717-f1b83194dcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:12.635552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfca227-fc52-44a9-8717-f1b83194dcfc admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:12.636221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfca227-fc52-44a9-8717-f1b83194dcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:12.636221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfca227-fc52-44a9-8717-f1b83194dcfc admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:12.636961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfca227-fc52-44a9-8717-f1b83194dcfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:26:12.637277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfca227-fc52-44a9-8717-f1b83194dcfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:12.639419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfca227-fc52-44a9-8717-f1b83194dcfc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:12.671204 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1873/3808] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:12.673107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfca227-fc52-44a9-8717-f1b83194dcfc admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:12.683107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6bfca227-fc52-44a9-8717-f1b83194dcfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:12.699578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfca227-fc52-44a9-8717-f1b83194dcfc admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:12.705982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca5a29-ac82-43f6-a795-8e5fc98760cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:12.706794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca5a29-ac82-43f6-a795-8e5fc98760cc admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:12.707140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca5a29-ac82-43f6-a795-8e5fc98760cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:12.707493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca5a29-ac82-43f6-a795-8e5fc98760cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:12.708265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca5a29-ac82-43f6-a795-8e5fc98760cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:12.709503 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:12.711662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca5a29-ac82-43f6-a795-8e5fc98760cc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:12.734802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f1156-e326-4a10-a3da-28fb58afae3c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:12.771190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f28c7a-5d38-4b88-8ebe-43a9b3a11545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:12.771842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f28c7a-5d38-4b88-8ebe-43a9b3a11545 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:12.774041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f28c7a-5d38-4b88-8ebe-43a9b3a11545 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:12.774228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f28c7a-5d38-4b88-8ebe-43a9b3a11545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:12.802586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f28c7a-5d38-4b88-8ebe-43a9b3a11545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:12.802586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f28c7a-5d38-4b88-8ebe-43a9b3a11545 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:12.836537 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1874/3809] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:26:12 2022] POST /identity/v3/projects => generated 381 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:12.836537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dc64e-3c93-43ea-915d-a7103aac3a98 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:12.836537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dc64e-3c93-43ea-915d-a7103aac3a98 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:12.836537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dc64e-3c93-43ea-915d-a7103aac3a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:12.836988 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1936/3810] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:26:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:26:12.847197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f28c7a-5d38-4b88-8ebe-43a9b3a11545 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:12.875520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3c4dc64e-3c93-43ea-915d-a7103aac3a98 None None] MFA Rules not processed for user `2928d7efad6a46d7b69df9644a6480b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:12.877371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3c4dc64e-3c93-43ea-915d-a7103aac3a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:12.880838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f28c7a-5d38-4b88-8ebe-43a9b3a11545 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:13.044533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a0596-ee7e-4e9e-92a5-4b2b1a6bc1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:13.045865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a0596-ee7e-4e9e-92a5-4b2b1a6bc1a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:13.046178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a0596-ee7e-4e9e-92a5-4b2b1a6bc1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:13.046460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a0596-ee7e-4e9e-92a5-4b2b1a6bc1a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:13.049532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a0596-ee7e-4e9e-92a5-4b2b1a6bc1a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:13.055661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a0596-ee7e-4e9e-92a5-4b2b1a6bc1a2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:13.166049 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1937/3811] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:26:12 2022] POST /identity/v3/users => generated 291 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:13.171833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a0596-ee7e-4e9e-92a5-4b2b1a6bc1a2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:13.189882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a0596-ee7e-4e9e-92a5-4b2b1a6bc1a2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:13.202359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36d201-2224-49e5-98f4-2c3c7704bb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:13.203365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36d201-2224-49e5-98f4-2c3c7704bb98 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:13.203854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36d201-2224-49e5-98f4-2c3c7704bb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:13.204288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36d201-2224-49e5-98f4-2c3c7704bb98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:13.205628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36d201-2224-49e5-98f4-2c3c7704bb98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:13.208341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf36d201-2224-49e5-98f4-2c3c7704bb98 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:13.239869 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1938/3812] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:26:13.243929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36d201-2224-49e5-98f4-2c3c7704bb98 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:13.255007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf36d201-2224-49e5-98f4-2c3c7704bb98 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:13.260120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da86567f-a34e-47c5-b639-ccc5f0e06756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:13.260805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86567f-a34e-47c5-b639-ccc5f0e06756 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:13.261123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86567f-a34e-47c5-b639-ccc5f0e06756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:13.261380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da86567f-a34e-47c5-b639-ccc5f0e06756 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:13.262292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86567f-a34e-47c5-b639-ccc5f0e06756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:13.263914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da86567f-a34e-47c5-b639-ccc5f0e06756 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:13.268735 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1875/3813] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:13.304697 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1939/3814] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:26:13.310015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dc64e-3c93-43ea-915d-a7103aac3a98 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:13.332914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dc64e-3c93-43ea-915d-a7103aac3a98 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:13.351006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9089a3-e9af-412f-8985-11fbaf16f6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:13.362731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9089a3-e9af-412f-8985-11fbaf16f6d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:13.366484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9089a3-e9af-412f-8985-11fbaf16f6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:13.369102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9089a3-e9af-412f-8985-11fbaf16f6d0 admin admin] PATH_INFO: `/v3/projects/22a99d8ab776495b88588bfc655cef34/users/de2b1234a0794559850d628fdd801a4f/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:13.425764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9089a3-e9af-412f-8985-11fbaf16f6d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a99d8ab776495b88588bfc655cef34, user_id=de2b1234a0794559850d628fdd801a4f, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:13.429784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9089a3-e9af-412f-8985-11fbaf16f6d0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:13.553947 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1876/3815] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:26:13 2022] PUT /identity/v3/projects/22a99d8ab776495b88588bfc655cef34/users/de2b1234a0794559850d628fdd801a4f/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:13.555748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c384d62-def5-4fe5-a309-b29e657f2d00 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:13.556039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c384d62-def5-4fe5-a309-b29e657f2d00 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:13.556320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c384d62-def5-4fe5-a309-b29e657f2d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:13.592799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2c384d62-def5-4fe5-a309-b29e657f2d00 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:13.594200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2c384d62-def5-4fe5-a309-b29e657f2d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:13.716142 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1940/3816] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:13.739974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9089a3-e9af-412f-8985-11fbaf16f6d0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:13.756704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c384d62-def5-4fe5-a309-b29e657f2d00 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:13.760268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2c384d62-def5-4fe5-a309-b29e657f2d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:13.763971 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:13.777980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c384d62-def5-4fe5-a309-b29e657f2d00 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:13.785622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53af11-c509-45a5-b188-1af6941c6e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:13.787021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53af11-c509-45a5-b188-1af6941c6e85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:13.787437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53af11-c509-45a5-b188-1af6941c6e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:13.787847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53af11-c509-45a5-b188-1af6941c6e85 admin admin] PATH_INFO: `/v3/projects/9aa502349b444e199a236c0f5782743d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:13.789423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53af11-c509-45a5-b188-1af6941c6e85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa502349b444e199a236c0f5782743d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:13.792835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53af11-c509-45a5-b188-1af6941c6e85 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:13.873561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9089a3-e9af-412f-8985-11fbaf16f6d0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:13.888782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dafecfb-5a3f-439e-9ffd-cc96692b8a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:13.889483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafecfb-5a3f-439e-9ffd-cc96692b8a6a service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:13.889775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafecfb-5a3f-439e-9ffd-cc96692b8a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:13.890054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dafecfb-5a3f-439e-9ffd-cc96692b8a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:13.903312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafecfb-5a3f-439e-9ffd-cc96692b8a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:13.905558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dafecfb-5a3f-439e-9ffd-cc96692b8a6a service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:13.939213 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1877/3817] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:26:13.945792 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:13.953028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7e53af11-c509-45a5-b188-1af6941c6e85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa502349b444e199a236c0f5782743d', 'request_id': 'req-7e53af11-c509-45a5-b188-1af6941c6e85'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:13.970459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7e53af11-c509-45a5-b188-1af6941c6e85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa502349b444e199a236c0f5782743d', 'request_id': 'req-7e53af11-c509-45a5-b188-1af6941c6e85'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:13.979721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7e53af11-c509-45a5-b188-1af6941c6e85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa502349b444e199a236c0f5782743d', 'request_id': 'req-7e53af11-c509-45a5-b188-1af6941c6e85'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:14.074789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7e53af11-c509-45a5-b188-1af6941c6e85 admin admin] The token cache is being invalidate because project 9aa502349b444e199a236c0f5782743d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:26:14.075292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7e53af11-c509-45a5-b188-1af6941c6e85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:14.078236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7e53af11-c509-45a5-b188-1af6941c6e85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:14.080377 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1941/3818] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:26:13 2022] DELETE /identity/v3/projects/9aa502349b444e199a236c0f5782743d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:14.088446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86c07f-ce8b-44b0-8a23-1b355c12339a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:14.088686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86c07f-ce8b-44b0-8a23-1b355c12339a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:14.088912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f86c07f-ce8b-44b0-8a23-1b355c12339a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:14.116865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4f86c07f-ce8b-44b0-8a23-1b355c12339a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:14.118566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4f86c07f-ce8b-44b0-8a23-1b355c12339a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:14.193073 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1878/3819] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:14.204384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66adb4-3dee-4276-8920-ee9ddb162224 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:14.204679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66adb4-3dee-4276-8920-ee9ddb162224 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:14.204988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66adb4-3dee-4276-8920-ee9ddb162224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:14.232289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3b66adb4-3dee-4276-8920-ee9ddb162224 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:14.233898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3b66adb4-3dee-4276-8920-ee9ddb162224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:14.242667 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1942/3820] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:14.247491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86c07f-ce8b-44b0-8a23-1b355c12339a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:14.258683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f86c07f-ce8b-44b0-8a23-1b355c12339a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:14.264132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab75a11-6356-4759-8354-22d17490803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:14.268371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab75a11-6356-4759-8354-22d17490803d admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:14.268371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab75a11-6356-4759-8354-22d17490803d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:14.268371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab75a11-6356-4759-8354-22d17490803d admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:14.268371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab75a11-6356-4759-8354-22d17490803d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:26:14.268371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab75a11-6356-4759-8354-22d17490803d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:14.268371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab75a11-6356-4759-8354-22d17490803d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:14.279960 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1879/3821] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:26:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:14.284456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66adb4-3dee-4276-8920-ee9ddb162224 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:14.294617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66adb4-3dee-4276-8920-ee9ddb162224 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:14.299373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33e61c-542f-453f-a8d0-6bc90928ce8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:14.300059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33e61c-542f-453f-a8d0-6bc90928ce8e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:14.300362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33e61c-542f-453f-a8d0-6bc90928ce8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:14.300626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb33e61c-542f-453f-a8d0-6bc90928ce8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:14.301335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33e61c-542f-453f-a8d0-6bc90928ce8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:14.303273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb33e61c-542f-453f-a8d0-6bc90928ce8e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:14.394386 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1943/3822] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:26:14 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:26:14.396407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab75a11-6356-4759-8354-22d17490803d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:14.408403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab75a11-6356-4759-8354-22d17490803d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:14.498590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d024d3-3c1f-478c-9c5e-c90551f0bba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:14.499341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d024d3-3c1f-478c-9c5e-c90551f0bba5 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:14.499630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d024d3-3c1f-478c-9c5e-c90551f0bba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:14.500029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d024d3-3c1f-478c-9c5e-c90551f0bba5 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:14.500772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d024d3-3c1f-478c-9c5e-c90551f0bba5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:14.502749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d024d3-3c1f-478c-9c5e-c90551f0bba5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:14.648898 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1880/3823] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:26:14 2022] POST /identity/v3/users => generated 295 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:14.653591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33e61c-542f-453f-a8d0-6bc90928ce8e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:14.669268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb33e61c-542f-453f-a8d0-6bc90928ce8e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:14.674668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f509a81-2448-41b3-99b9-51b2dd71efe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:14.675771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f509a81-2448-41b3-99b9-51b2dd71efe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:14.676066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f509a81-2448-41b3-99b9-51b2dd71efe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:14.676476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f509a81-2448-41b3-99b9-51b2dd71efe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:14.677226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f509a81-2448-41b3-99b9-51b2dd71efe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:14.678955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f509a81-2448-41b3-99b9-51b2dd71efe3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:14.694404 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1944/3824] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:26:14.697411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d024d3-3c1f-478c-9c5e-c90551f0bba5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:14.736854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d024d3-3c1f-478c-9c5e-c90551f0bba5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:14.770979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911b9d3-45f1-4e83-9e77-aea7cdffd024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:14.771652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911b9d3-45f1-4e83-9e77-aea7cdffd024 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:14.771935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911b9d3-45f1-4e83-9e77-aea7cdffd024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:14.772473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911b9d3-45f1-4e83-9e77-aea7cdffd024 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:14.773440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911b9d3-45f1-4e83-9e77-aea7cdffd024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:14.779047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911b9d3-45f1-4e83-9e77-aea7cdffd024 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:14.828959 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1881/3825] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:26:14.834545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f509a81-2448-41b3-99b9-51b2dd71efe3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:14.853751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f509a81-2448-41b3-99b9-51b2dd71efe3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:14.863932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921aa31-4b40-4a0a-aeb0-9c6d4d86d390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:14.865005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921aa31-4b40-4a0a-aeb0-9c6d4d86d390 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:14.865297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921aa31-4b40-4a0a-aeb0-9c6d4d86d390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:14.865581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921aa31-4b40-4a0a-aeb0-9c6d4d86d390 admin admin] PATH_INFO: `/v3/projects/f4ffc3f062c04bf9a64175f1d4829c0f/users/eee0949ddc584dcfb866960cbfb2ce43/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:14.903586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921aa31-4b40-4a0a-aeb0-9c6d4d86d390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ffc3f062c04bf9a64175f1d4829c0f, user_id=eee0949ddc584dcfb866960cbfb2ce43, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:14.907485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921aa31-4b40-4a0a-aeb0-9c6d4d86d390 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:15.034777 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1945/3826] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:26:14 2022] PUT /identity/v3/projects/f4ffc3f062c04bf9a64175f1d4829c0f/users/eee0949ddc584dcfb866960cbfb2ce43/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:15.041129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2f2c1-f0ae-4f67-b163-2fbda18ea698 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:15.041977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2f2c1-f0ae-4f67-b163-2fbda18ea698 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:15.044676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb2f2c1-f0ae-4f67-b163-2fbda18ea698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:15.089040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9bb2f2c1-f0ae-4f67-b163-2fbda18ea698 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:15.093254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9bb2f2c1-f0ae-4f67-b163-2fbda18ea698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:15.140597 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:15.264479 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1882/3827] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:15.324791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921aa31-4b40-4a0a-aeb0-9c6d4d86d390 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:15.326678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8921aa31-4b40-4a0a-aeb0-9c6d4d86d390 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:15.446459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921aa31-4b40-4a0a-aeb0-9c6d4d86d390 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:15.452185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7693ea0-c662-4d78-a172-f4fc18971796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:15.453102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7693ea0-c662-4d78-a172-f4fc18971796 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:15.454039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7693ea0-c662-4d78-a172-f4fc18971796 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:15.454039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7693ea0-c662-4d78-a172-f4fc18971796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:15.465914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7693ea0-c662-4d78-a172-f4fc18971796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:15.467632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7693ea0-c662-4d78-a172-f4fc18971796 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:15.478474 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1946/3828] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:26:24.956105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4585fe-eba8-4d66-8ce5-4d3b5e61e49d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:24.957446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4585fe-eba8-4d66-8ce5-4d3b5e61e49d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:24.957973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4585fe-eba8-4d66-8ce5-4d3b5e61e49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:25.018853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7e4585fe-eba8-4d66-8ce5-4d3b5e61e49d None None] MFA Rules not processed for user `76bd949bbb4a47a6aa32a00e82767058`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:25.020170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7e4585fe-eba8-4d66-8ce5-4d3b5e61e49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:25.154821 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1883/3829] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:25.216477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7693ea0-c662-4d78-a172-f4fc18971796 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:25.225457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d7693ea0-c662-4d78-a172-f4fc18971796 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:25.249355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7693ea0-c662-4d78-a172-f4fc18971796 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:25.276483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ec0c1-66ef-480b-9915-56b58d7cac25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:25.278441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ec0c1-66ef-480b-9915-56b58d7cac25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:25.278903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ec0c1-66ef-480b-9915-56b58d7cac25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:25.279361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ec0c1-66ef-480b-9915-56b58d7cac25 admin admin] PATH_INFO: `/v3/users/7df31896310c40c1851a7c66becb2e62` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:25.284572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ec0c1-66ef-480b-9915-56b58d7cac25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7df31896310c40c1851a7c66becb2e62)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:25.287922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ec0c1-66ef-480b-9915-56b58d7cac25 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:25.600211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-450ec0c1-66ef-480b-9915-56b58d7cac25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7df31896310c40c1851a7c66becb2e62'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:25.624315 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:25.627649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-450ec0c1-66ef-480b-9915-56b58d7cac25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7df31896310c40c1851a7c66becb2e62'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:25.637936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-450ec0c1-66ef-480b-9915-56b58d7cac25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7df31896310c40c1851a7c66becb2e62'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:25.639032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-450ec0c1-66ef-480b-9915-56b58d7cac25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7df31896310c40c1851a7c66becb2e62'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:25.749128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-450ec0c1-66ef-480b-9915-56b58d7cac25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7df31896310c40c1851a7c66becb2e62'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:25.763470 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1947/3830] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:26:25 2022] DELETE /identity/v3/users/7df31896310c40c1851a7c66becb2e62 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:25.768352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18239145-9f0a-47ce-b24b-4f3acac088f1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:25.768896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18239145-9f0a-47ce-b24b-4f3acac088f1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:25.769375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18239145-9f0a-47ce-b24b-4f3acac088f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:25.810491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-18239145-9f0a-47ce-b24b-4f3acac088f1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:25.812167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-18239145-9f0a-47ce-b24b-4f3acac088f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:25.889020 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1884/3831] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:25.911870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ec0c1-66ef-480b-9915-56b58d7cac25 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:25.913574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-450ec0c1-66ef-480b-9915-56b58d7cac25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:25.989581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ec0c1-66ef-480b-9915-56b58d7cac25 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:25.993910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73343495-f544-4129-926e-9873374b643e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:25.995708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73343495-f544-4129-926e-9873374b643e service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:25.996106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73343495-f544-4129-926e-9873374b643e service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:25.996493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73343495-f544-4129-926e-9873374b643e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:26.009343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73343495-f544-4129-926e-9873374b643e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:26.011851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73343495-f544-4129-926e-9873374b643e service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:26.027316 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1948/3832] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:26:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:26:27.334848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18239145-9f0a-47ce-b24b-4f3acac088f1 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:27.336503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-18239145-9f0a-47ce-b24b-4f3acac088f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:27.358449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18239145-9f0a-47ce-b24b-4f3acac088f1 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:27.376910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fe7c4-3c22-4031-b961-3916c3c44dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:27.379228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fe7c4-3c22-4031-b961-3916c3c44dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:27.382574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fe7c4-3c22-4031-b961-3916c3c44dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:27.382574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fe7c4-3c22-4031-b961-3916c3c44dd2 admin admin] PATH_INFO: `/v3/projects/a48503d035ed4bf785f69bbb7a88986d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:27.384481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fe7c4-3c22-4031-b961-3916c3c44dd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a48503d035ed4bf785f69bbb7a88986d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:27.391713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fe7c4-3c22-4031-b961-3916c3c44dd2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:27.551028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-689fe7c4-3c22-4031-b961-3916c3c44dd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a48503d035ed4bf785f69bbb7a88986d', 'request_id': 'req-689fe7c4-3c22-4031-b961-3916c3c44dd2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:27.661485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-689fe7c4-3c22-4031-b961-3916c3c44dd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a48503d035ed4bf785f69bbb7a88986d', 'request_id': 'req-689fe7c4-3c22-4031-b961-3916c3c44dd2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:27.669659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-689fe7c4-3c22-4031-b961-3916c3c44dd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a48503d035ed4bf785f69bbb7a88986d', 'request_id': 'req-689fe7c4-3c22-4031-b961-3916c3c44dd2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:27.673178 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:27.692676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-689fe7c4-3c22-4031-b961-3916c3c44dd2 admin admin] The token cache is being invalidate because project a48503d035ed4bf785f69bbb7a88986d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:26:27.693056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-689fe7c4-3c22-4031-b961-3916c3c44dd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:27.696821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-689fe7c4-3c22-4031-b961-3916c3c44dd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:27.701394 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1885/3833] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:26:27 2022] DELETE /identity/v3/projects/a48503d035ed4bf785f69bbb7a88986d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:27.707192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c0a32-3c9c-45ae-abbc-47d84a54ba31 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:27.707711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c0a32-3c9c-45ae-abbc-47d84a54ba31 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:27.714345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c0a32-3c9c-45ae-abbc-47d84a54ba31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:27.746112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ac1c0a32-3c9c-45ae-abbc-47d84a54ba31 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:27.746112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ac1c0a32-3c9c-45ae-abbc-47d84a54ba31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:27.853786 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1949/3834] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:27.854664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb85f1-44df-4055-97c1-def427c69d11 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:27.854962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb85f1-44df-4055-97c1-def427c69d11 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:27.855247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb85f1-44df-4055-97c1-def427c69d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:27.903074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d3cb85f1-44df-4055-97c1-def427c69d11 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:27.908214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d3cb85f1-44df-4055-97c1-def427c69d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:27.930025 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1886/3835] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:26:27.931452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c0a32-3c9c-45ae-abbc-47d84a54ba31 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:27.949227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c0a32-3c9c-45ae-abbc-47d84a54ba31 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:27.960426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626f4dc-1926-495b-ac3c-703125e97ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:27.961764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626f4dc-1926-495b-ac3c-703125e97ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:27.962084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626f4dc-1926-495b-ac3c-703125e97ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:27.962477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626f4dc-1926-495b-ac3c-703125e97ac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:27.964245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626f4dc-1926-495b-ac3c-703125e97ac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:26:27.964697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626f4dc-1926-495b-ac3c-703125e97ac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:27.966658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626f4dc-1926-495b-ac3c-703125e97ac3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:27.991771 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1950/3836] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:26:27.993573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb85f1-44df-4055-97c1-def427c69d11 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:28.004422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb85f1-44df-4055-97c1-def427c69d11 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:28.012824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa9586-eebc-4ea3-8343-35d806ec950c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:28.013541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa9586-eebc-4ea3-8343-35d806ec950c admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:28.014761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa9586-eebc-4ea3-8343-35d806ec950c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:28.015034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa9586-eebc-4ea3-8343-35d806ec950c admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:28.018924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa9586-eebc-4ea3-8343-35d806ec950c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:28.021136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa9586-eebc-4ea3-8343-35d806ec950c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:28.148164 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1887/3837] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:26:27 2022] POST /identity/v3/projects => generated 389 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:26:28.152801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626f4dc-1926-495b-ac3c-703125e97ac3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:28.164094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626f4dc-1926-495b-ac3c-703125e97ac3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:28.341728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cf0d1-f054-4837-8162-bcdf8c1973ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:28.341728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cf0d1-f054-4837-8162-bcdf8c1973ad admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:28.341944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cf0d1-f054-4837-8162-bcdf8c1973ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:28.342268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7cf0d1-f054-4837-8162-bcdf8c1973ad admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:28.342821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7cf0d1-f054-4837-8162-bcdf8c1973ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:28.349499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7cf0d1-f054-4837-8162-bcdf8c1973ad admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:28.420818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c75390-55d2-42d6-b089-e0f2aa8f66d5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:28.421252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c75390-55d2-42d6-b089-e0f2aa8f66d5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:28.421335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c75390-55d2-42d6-b089-e0f2aa8f66d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:28.471812 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:28.476591 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1951/3838] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:26:28 2022] POST /identity/v3/users => generated 295 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:26:28.487310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cf0d1-f054-4837-8162-bcdf8c1973ad admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:28.503826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-65c75390-55d2-42d6-b089-e0f2aa8f66d5 None None] MFA Rules not processed for user `de2b1234a0794559850d628fdd801a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:28.505067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-65c75390-55d2-42d6-b089-e0f2aa8f66d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:28.525726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7cf0d1-f054-4837-8162-bcdf8c1973ad admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:28.547676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dee4d9-88df-41d5-9c86-295dd39aa34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:28.547676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dee4d9-88df-41d5-9c86-295dd39aa34c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:28.548036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dee4d9-88df-41d5-9c86-295dd39aa34c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:28.548516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dee4d9-88df-41d5-9c86-295dd39aa34c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:28.549269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dee4d9-88df-41d5-9c86-295dd39aa34c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:28.550919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dee4d9-88df-41d5-9c86-295dd39aa34c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:28.589552 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1952/3839] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:26:28.590689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dee4d9-88df-41d5-9c86-295dd39aa34c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:28.608973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dee4d9-88df-41d5-9c86-295dd39aa34c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:28.618933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a82a43-48e5-4a31-b8c4-1723f8d3997a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:28.621244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a82a43-48e5-4a31-b8c4-1723f8d3997a admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:28.621534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a82a43-48e5-4a31-b8c4-1723f8d3997a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:28.621813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a82a43-48e5-4a31-b8c4-1723f8d3997a admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:28.623734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a82a43-48e5-4a31-b8c4-1723f8d3997a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:28.628214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a82a43-48e5-4a31-b8c4-1723f8d3997a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:28.654156 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1953/3840] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:26:28.657117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a82a43-48e5-4a31-b8c4-1723f8d3997a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:28.663099 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1888/3841] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:26:28.674086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3391d7-425c-486a-a896-d110b1316db2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:28.674490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3391d7-425c-486a-a896-d110b1316db2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:28.674833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3391d7-425c-486a-a896-d110b1316db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:28.675709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a82a43-48e5-4a31-b8c4-1723f8d3997a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:28.686010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1c84b-13e2-478a-8d3d-124124be4c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:28.687463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1c84b-13e2-478a-8d3d-124124be4c1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:28.687914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1c84b-13e2-478a-8d3d-124124be4c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:28.688366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1c84b-13e2-478a-8d3d-124124be4c1b admin admin] PATH_INFO: `/v3/projects/c173e2c49b224ca7960a67bb86d2f86f/users/443e8867bfd245489c013cc5f5fe3928/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:28.695643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-df3391d7-425c-486a-a896-d110b1316db2 None None] MFA Rules not processed for user `de2b1234a0794559850d628fdd801a4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:28.697042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-df3391d7-425c-486a-a896-d110b1316db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:28.708828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1c84b-13e2-478a-8d3d-124124be4c1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c173e2c49b224ca7960a67bb86d2f86f, user_id=443e8867bfd245489c013cc5f5fe3928, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:28.715648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1c84b-13e2-478a-8d3d-124124be4c1b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:28.719188 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1889/3842] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:28.797205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3391d7-425c-486a-a896-d110b1316db2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:28.799318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-df3391d7-425c-486a-a896-d110b1316db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:28.842293 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1954/3843] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:26:28 2022] PUT /identity/v3/projects/c173e2c49b224ca7960a67bb86d2f86f/users/443e8867bfd245489c013cc5f5fe3928/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:26:28.844568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4ff62-52c2-43e0-a794-6e9270bafc47 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:28.845048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4ff62-52c2-43e0-a794-6e9270bafc47 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:28.845539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4ff62-52c2-43e0-a794-6e9270bafc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:28.923891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f7c4ff62-52c2-43e0-a794-6e9270bafc47 None None] MFA Rules not processed for user `443e8867bfd245489c013cc5f5fe3928`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:28.925267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f7c4ff62-52c2-43e0-a794-6e9270bafc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:29.009030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3391d7-425c-486a-a896-d110b1316db2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:29.067643 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:29.082970 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1955/3844] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:28 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:29.087614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4ff62-52c2-43e0-a794-6e9270bafc47 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:29.125497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fcd53-44a9-423e-a9da-ba18f3c6ae0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:29.126378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fcd53-44a9-423e-a9da-ba18f3c6ae0c service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:29.126719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fcd53-44a9-423e-a9da-ba18f3c6ae0c service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:29.127071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fcd53-44a9-423e-a9da-ba18f3c6ae0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:29.258541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4ff62-52c2-43e0-a794-6e9270bafc47 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:29.269671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fcd53-44a9-423e-a9da-ba18f3c6ae0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:29.270029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abd6ea-644f-48f3-b139-0ef587e711d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:29.271616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abd6ea-644f-48f3-b139-0ef587e711d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:29.271916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abd6ea-644f-48f3-b139-0ef587e711d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:29.272198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20abd6ea-644f-48f3-b139-0ef587e711d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:29.272912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abd6ea-644f-48f3-b139-0ef587e711d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:29.273742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fcd53-44a9-423e-a9da-ba18f3c6ae0c service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:29.275714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20abd6ea-644f-48f3-b139-0ef587e711d9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:29.300437 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1890/3845] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:26:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:26:29.335497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fcd53-44a9-423e-a9da-ba18f3c6ae0c service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:29.336948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-437fcd53-44a9-423e-a9da-ba18f3c6ae0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:29.403194 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1956/3846] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:26:29 2022] POST /identity/v3/projects => generated 391 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:29.406862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abd6ea-644f-48f3-b139-0ef587e711d9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:29.436431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fcd53-44a9-423e-a9da-ba18f3c6ae0c service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:29.547424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20abd6ea-644f-48f3-b139-0ef587e711d9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:29.562787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdcb3d-e1f7-475e-a1f4-fddf1a3f956a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:29.565046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdcb3d-e1f7-475e-a1f4-fddf1a3f956a admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:29.565348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdcb3d-e1f7-475e-a1f4-fddf1a3f956a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:29.565630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccdcb3d-e1f7-475e-a1f4-fddf1a3f956a admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:29.567266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdcb3d-e1f7-475e-a1f4-fddf1a3f956a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:29.567931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e11f6-090b-4787-9251-dd169ffce700 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:29.569729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e11f6-090b-4787-9251-dd169ffce700 service glance] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:29.570021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e11f6-090b-4787-9251-dd169ffce700 service glance] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:29.570322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e11f6-090b-4787-9251-dd169ffce700 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:29.571670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccdcb3d-e1f7-475e-a1f4-fddf1a3f956a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:29.578542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f85e11f6-090b-4787-9251-dd169ffce700 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:29.745625 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1957/3847] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:26:29 2022] POST /identity/v3/users => generated 302 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:29.747300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdcb3d-e1f7-475e-a1f4-fddf1a3f956a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:29.784837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccdcb3d-e1f7-475e-a1f4-fddf1a3f956a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:29.794451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e11f6-090b-4787-9251-dd169ffce700 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:29.795939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e11f6-090b-4787-9251-dd169ffce700 service glance] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:29.807228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd142309-5d9d-4e0b-87f5-87a191eaad06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:29.808620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd142309-5d9d-4e0b-87f5-87a191eaad06 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:29.812014 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:29.812529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd142309-5d9d-4e0b-87f5-87a191eaad06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:29.812948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd142309-5d9d-4e0b-87f5-87a191eaad06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:29.813754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd142309-5d9d-4e0b-87f5-87a191eaad06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:29.815384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd142309-5d9d-4e0b-87f5-87a191eaad06 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:29.858604 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1891/3848] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:26:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:26:29.864947 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1958/3849] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:26:29.869902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e11f6-090b-4787-9251-dd169ffce700 service glance] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:29.908447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e11f6-090b-4787-9251-dd169ffce700 service glance] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:29.914129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f3f57-c452-46b6-9947-94cf72db9c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:29.916243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f3f57-c452-46b6-9947-94cf72db9c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:29.917144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f3f57-c452-46b6-9947-94cf72db9c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:29.917767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f3f57-c452-46b6-9947-94cf72db9c67 admin admin] PATH_INFO: `/v3/projects/5ec5dfedad624a2f8b5ed39e72180211/users/7435398dd5094fcb99f4ebe87918c75b/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:29.946805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f3f57-c452-46b6-9947-94cf72db9c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec5dfedad624a2f8b5ed39e72180211, user_id=7435398dd5094fcb99f4ebe87918c75b, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:29.951348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f3f57-c452-46b6-9947-94cf72db9c67 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:30.060865 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1892/3850] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:26:29 2022] PUT /identity/v3/projects/5ec5dfedad624a2f8b5ed39e72180211/users/7435398dd5094fcb99f4ebe87918c75b/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:30.062844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd142309-5d9d-4e0b-87f5-87a191eaad06 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:30.109617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd142309-5d9d-4e0b-87f5-87a191eaad06 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:30.196604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c396f9-3e67-442e-b00a-d286164309c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:30.198006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c396f9-3e67-442e-b00a-d286164309c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:30.198863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c396f9-3e67-442e-b00a-d286164309c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:30.198863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c396f9-3e67-442e-b00a-d286164309c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:30.200002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c396f9-3e67-442e-b00a-d286164309c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:30.201520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c396f9-3e67-442e-b00a-d286164309c6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:30.231595 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1959/3851] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:26:30.235938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f3f57-c452-46b6-9947-94cf72db9c67 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:30.266616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f3f57-c452-46b6-9947-94cf72db9c67 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:30.290085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f6171-75c3-4234-95b6-6f36b912088d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:30.291814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f6171-75c3-4234-95b6-6f36b912088d admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:30.292571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f6171-75c3-4234-95b6-6f36b912088d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:30.292571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f6171-75c3-4234-95b6-6f36b912088d admin admin] PATH_INFO: `/v3/projects/5ec5dfedad624a2f8b5ed39e72180211/users/7435398dd5094fcb99f4ebe87918c75b/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:30.304188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f6171-75c3-4234-95b6-6f36b912088d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ec5dfedad624a2f8b5ed39e72180211, user_id=7435398dd5094fcb99f4ebe87918c75b, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:30.307714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f6171-75c3-4234-95b6-6f36b912088d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:30.336649 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:30.343244 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1893/3852] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:26:30 2022] PUT /identity/v3/projects/5ec5dfedad624a2f8b5ed39e72180211/users/7435398dd5094fcb99f4ebe87918c75b/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:30.355079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7116eee-fafc-4a7d-aa49-42a626271469 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:30.355878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7116eee-fafc-4a7d-aa49-42a626271469 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:30.356382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7116eee-fafc-4a7d-aa49-42a626271469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:30.432957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b7116eee-fafc-4a7d-aa49-42a626271469 None None] MFA Rules not processed for user `7435398dd5094fcb99f4ebe87918c75b`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:30.438821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b7116eee-fafc-4a7d-aa49-42a626271469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:30.634535 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1960/3853] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:30.640360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f6171-75c3-4234-95b6-6f36b912088d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:30.669453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f6171-75c3-4234-95b6-6f36b912088d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:30.692837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182216ac-8d0a-487f-8b7a-2b02f7c30590 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:30.693847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182216ac-8d0a-487f-8b7a-2b02f7c30590 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:30.695732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182216ac-8d0a-487f-8b7a-2b02f7c30590 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:30.696257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182216ac-8d0a-487f-8b7a-2b02f7c30590 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:30.697231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182216ac-8d0a-487f-8b7a-2b02f7c30590 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:30.699051 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-182216ac-8d0a-487f-8b7a-2b02f7c30590 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:30.699051 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:26:30.699051 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:26:30.700594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182216ac-8d0a-487f-8b7a-2b02f7c30590 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:30.811428 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1894/3854] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:26:30 2022] POST /identity/v3/domains => generated 275 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:30.811934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7116eee-fafc-4a7d-aa49-42a626271469 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:30.837378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7116eee-fafc-4a7d-aa49-42a626271469 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:30.920020 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:30.981645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba0a9b-72ab-46d0-8e32-260d7478ed26 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:30.982827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba0a9b-72ab-46d0-8e32-260d7478ed26 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:30.983874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba0a9b-72ab-46d0-8e32-260d7478ed26 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:30.984268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba0a9b-72ab-46d0-8e32-260d7478ed26 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/1e4caebf571d4344a73cd6517f6a9bba/config` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:30.985267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba0a9b-72ab-46d0-8e32-260d7478ed26 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=1e4caebf571d4344a73cd6517f6a9bba)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:30.986703 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-acba0a9b-72ab-46d0-8e32-260d7478ed26 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:30.986703 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:26:30.986703 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:26:30.993150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba0a9b-72ab-46d0-8e32-260d7478ed26 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:31.014698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182216ac-8d0a-487f-8b7a-2b02f7c30590 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:31.016711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-182216ac-8d0a-487f-8b7a-2b02f7c30590 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:31.146860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182216ac-8d0a-487f-8b7a-2b02f7c30590 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:31.154443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fe3fc-7b98-4362-933b-5f07bc2a1e4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:31.155121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fe3fc-7b98-4362-933b-5f07bc2a1e4e service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:31.155411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fe3fc-7b98-4362-933b-5f07bc2a1e4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:31.155694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fe3fc-7b98-4362-933b-5f07bc2a1e4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:31.158339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2d1fe3fc-7b98-4362-933b-5f07bc2a1e4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:31.182434 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1961/3855] 10.222.0.43 () {60 vars in 1268 bytes} [Tue Jul 19 14:26:30 2022] PUT /identity/v3/domains/1e4caebf571d4344a73cd6517f6a9bba/config => generated 138 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:26:31.186235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba0a9b-72ab-46d0-8e32-260d7478ed26 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:31.237472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba0a9b-72ab-46d0-8e32-260d7478ed26 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:31.249216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f748bbe-3539-4f57-8e40-9e32cb26989e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:31.252844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f748bbe-3539-4f57-8e40-9e32cb26989e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:31.253248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f748bbe-3539-4f57-8e40-9e32cb26989e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:31.253685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f748bbe-3539-4f57-8e40-9e32cb26989e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/1e4caebf571d4344a73cd6517f6a9bba/config/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:31.260760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f748bbe-3539-4f57-8e40-9e32cb26989e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1e4caebf571d4344a73cd6517f6a9bba, group=identity)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:31.260760 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-0f748bbe-3539-4f57-8e40-9e32cb26989e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:31.260760 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:26:31.260760 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:26:31.260760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f748bbe-3539-4f57-8e40-9e32cb26989e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:31.268988 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1962/3856] 10.222.0.43 () {58 vars in 1274 bytes} [Tue Jul 19 14:26:31 2022] GET /identity/v3/domains/1e4caebf571d4344a73cd6517f6a9bba/config/identity => generated 45 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:31.274558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f748bbe-3539-4f57-8e40-9e32cb26989e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:31.288777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f748bbe-3539-4f57-8e40-9e32cb26989e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:31.296463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660ee26-7955-4d08-9d29-24748c7bb08b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:31.301052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660ee26-7955-4d08-9d29-24748c7bb08b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:31.301571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660ee26-7955-4d08-9d29-24748c7bb08b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:31.301871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660ee26-7955-4d08-9d29-24748c7bb08b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/1e4caebf571d4344a73cd6517f6a9bba/config/identity/driver` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:31.303289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660ee26-7955-4d08-9d29-24748c7bb08b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1e4caebf571d4344a73cd6517f6a9bba, group=identity, option=driver)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:31.305349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660ee26-7955-4d08-9d29-24748c7bb08b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:31.327176 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1963/3857] 10.222.0.43 () {58 vars in 1295 bytes} [Tue Jul 19 14:26:31 2022] GET /identity/v3/domains/1e4caebf571d4344a73cd6517f6a9bba/config/identity/driver => generated 31 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:31.330071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660ee26-7955-4d08-9d29-24748c7bb08b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:31.372170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660ee26-7955-4d08-9d29-24748c7bb08b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:31.385415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ff130-755f-4d11-8ca4-776efb81a48d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:31.386335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ff130-755f-4d11-8ca4-776efb81a48d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:31.386632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ff130-755f-4d11-8ca4-776efb81a48d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:31.386982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ff130-755f-4d11-8ca4-776efb81a48d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/1e4caebf571d4344a73cd6517f6a9bba/config/ldap` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:31.387303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1fe3fc-7b98-4362-933b-5f07bc2a1e4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:31.389053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1fe3fc-7b98-4362-933b-5f07bc2a1e4e service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:31.389191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ff130-755f-4d11-8ca4-776efb81a48d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1e4caebf571d4344a73cd6517f6a9bba, group=ldap)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:31.399909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ff130-755f-4d11-8ca4-776efb81a48d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:31.422668 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1964/3858] 10.222.0.43 () {58 vars in 1262 bytes} [Tue Jul 19 14:26:31 2022] GET /identity/v3/domains/1e4caebf571d4344a73cd6517f6a9bba/config/ldap => generated 106 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:31.423933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ff130-755f-4d11-8ca4-776efb81a48d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:31.427546 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1895/3859] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:26:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:26:31.460818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ff130-755f-4d11-8ca4-776efb81a48d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:31.473214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8330c3-028a-4b55-97f6-596b3b4d1fa5 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:31.475332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8330c3-028a-4b55-97f6-596b3b4d1fa5 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:31.475620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8330c3-028a-4b55-97f6-596b3b4d1fa5 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:31.475935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8330c3-028a-4b55-97f6-596b3b4d1fa5 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/1e4caebf571d4344a73cd6517f6a9bba/config/ldap/url` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:31.477825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8330c3-028a-4b55-97f6-596b3b4d1fa5 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1e4caebf571d4344a73cd6517f6a9bba, group=ldap, option=url)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:31.479694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8330c3-028a-4b55-97f6-596b3b4d1fa5 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:31.499341 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1965/3860] 10.222.0.43 () {58 vars in 1274 bytes} [Tue Jul 19 14:26:31 2022] GET /identity/v3/domains/1e4caebf571d4344a73cd6517f6a9bba/config/ldap/url => generated 46 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:31.504747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fe3fc-7b98-4362-933b-5f07bc2a1e4e service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:31.527627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fe3fc-7b98-4362-933b-5f07bc2a1e4e service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:31.539711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be846d-6fc3-4c57-96ec-6cddba55ec31 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:31.540624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be846d-6fc3-4c57-96ec-6cddba55ec31 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:31.540918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be846d-6fc3-4c57-96ec-6cddba55ec31 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:31.541960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be846d-6fc3-4c57-96ec-6cddba55ec31 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/1e4caebf571d4344a73cd6517f6a9bba/config/ldap/user_tree_dn` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:31.545231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be846d-6fc3-4c57-96ec-6cddba55ec31 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=1e4caebf571d4344a73cd6517f6a9bba, group=ldap, option=user_tree_dn)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:31.551926 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-33be846d-6fc3-4c57-96ec-6cddba55ec31 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:31.551926 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:26:31.551926 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:26:31.557868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be846d-6fc3-4c57-96ec-6cddba55ec31 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:31.579547 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1896/3861] 10.222.0.43 () {58 vars in 1301 bytes} [Tue Jul 19 14:26:31 2022] GET /identity/v3/domains/1e4caebf571d4344a73cd6517f6a9bba/config/ldap/user_tree_dn => generated 63 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:31.581123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8330c3-028a-4b55-97f6-596b3b4d1fa5 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:31.598284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8330c3-028a-4b55-97f6-596b3b4d1fa5 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:31.615406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d88e72-1fb0-4bce-a2c6-5fa7370c51f6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:31.615606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d88e72-1fb0-4bce-a2c6-5fa7370c51f6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:31.616699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d88e72-1fb0-4bce-a2c6-5fa7370c51f6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:31.617102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d88e72-1fb0-4bce-a2c6-5fa7370c51f6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/1e4caebf571d4344a73cd6517f6a9bba/config` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:31.618698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d88e72-1fb0-4bce-a2c6-5fa7370c51f6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=1e4caebf571d4344a73cd6517f6a9bba)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:31.623491 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-47d88e72-1fb0-4bce-a2c6-5fa7370c51f6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:31.623491 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:26:31.623491 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:26:31.624735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d88e72-1fb0-4bce-a2c6-5fa7370c51f6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:31.691217 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1966/3862] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jul 19 14:26:31 2022] DELETE /identity/v3/domains/1e4caebf571d4344a73cd6517f6a9bba/config => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:31.695476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be846d-6fc3-4c57-96ec-6cddba55ec31 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:31.711355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be846d-6fc3-4c57-96ec-6cddba55ec31 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:31.742421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103993de-284d-447a-bd6d-1840e1d99d17 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:31.743310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103993de-284d-447a-bd6d-1840e1d99d17 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:31.743604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103993de-284d-447a-bd6d-1840e1d99d17 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:31.744028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103993de-284d-447a-bd6d-1840e1d99d17 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/1e4caebf571d4344a73cd6517f6a9bba` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:31.746317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103993de-284d-447a-bd6d-1840e1d99d17 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1e4caebf571d4344a73cd6517f6a9bba)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:31.747904 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-103993de-284d-447a-bd6d-1840e1d99d17 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:31.747904 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:26:31.747904 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:26:31.749335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103993de-284d-447a-bd6d-1840e1d99d17 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:31.785710 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:31.806861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-103993de-284d-447a-bd6d-1840e1d99d17 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1e4caebf571d4344a73cd6517f6a9bba'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:31.808112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-103993de-284d-447a-bd6d-1840e1d99d17 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1e4caebf571d4344a73cd6517f6a9bba'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:31.940636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-103993de-284d-447a-bd6d-1840e1d99d17 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1e4caebf571d4344a73cd6517f6a9bba'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:31.945621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-103993de-284d-447a-bd6d-1840e1d99d17 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1e4caebf571d4344a73cd6517f6a9bba'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:31.952354 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1897/3863] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:26:31 2022] PATCH /identity/v3/domains/1e4caebf571d4344a73cd6517f6a9bba => generated 276 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:31.954835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d88e72-1fb0-4bce-a2c6-5fa7370c51f6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:31.956600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-47d88e72-1fb0-4bce-a2c6-5fa7370c51f6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:31.988328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d88e72-1fb0-4bce-a2c6-5fa7370c51f6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:32.114006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:32.116219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:32.116736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:32.117488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/1e4caebf571d4344a73cd6517f6a9bba` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:32.138032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1e4caebf571d4344a73cd6517f6a9bba)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:32.149357 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:32.149357 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:26:32.149357 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:26:32.158443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:32.203847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1e4caebf571d4344a73cd6517f6a9bba'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:32.264389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1e4caebf571d4344a73cd6517f6a9bba'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:32.325852 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:32.437095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e4caebf571d4344a73cd6517f6a9bba', 'request_id': 'req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:32.444156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e4caebf571d4344a73cd6517f6a9bba', 'request_id': 'req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:32.453734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e4caebf571d4344a73cd6517f6a9bba', 'request_id': 'req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:32.556142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] The token cache is being invalidate because project 1e4caebf571d4344a73cd6517f6a9bba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:26:32.556486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:32.557330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:32.582275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1e4caebf571d4344a73cd6517f6a9bba', 'request_id': 'req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:32.583071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1e4caebf571d4344a73cd6517f6a9bba', 'request_id': 'req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:32.585149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1e4caebf571d4344a73cd6517f6a9bba', 'request_id': 'req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:32.608776 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1967/3864] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:26:31 2022] DELETE /identity/v3/domains/1e4caebf571d4344a73cd6517f6a9bba => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:32.613938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103993de-284d-447a-bd6d-1840e1d99d17 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:32.643942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103993de-284d-447a-bd6d-1840e1d99d17 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:32.774694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd3785-bae6-41bc-97d7-a707737d776e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:32.776220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd3785-bae6-41bc-97d7-a707737d776e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:32.777163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd3785-bae6-41bc-97d7-a707737d776e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:32.777501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd3785-bae6-41bc-97d7-a707737d776e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:32.778373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd3785-bae6-41bc-97d7-a707737d776e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:32.780579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecd3785-bae6-41bc-97d7-a707737d776e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:32.894433 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1898/3865] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:26:32 2022] POST /identity/v3/domains => generated 276 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:32.896352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:32.899042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:32.920802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7f3c0-d7e0-4f3c-b1c3-d47ba07105a0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:33.083764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e6a40-52c3-4f14-a7a4-b5199daf88db tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:33.085343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e6a40-52c3-4f14-a7a4-b5199daf88db tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:33.096277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e6a40-52c3-4f14-a7a4-b5199daf88db tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:33.096277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e6a40-52c3-4f14-a7a4-b5199daf88db tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/0b52552292d440a4816ba70583677494/config` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:33.096277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e6a40-52c3-4f14-a7a4-b5199daf88db tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=0b52552292d440a4816ba70583677494)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:33.096277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11e6a40-52c3-4f14-a7a4-b5199daf88db tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:33.222925 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1968/3866] 10.222.0.43 () {60 vars in 1268 bytes} [Tue Jul 19 14:26:32 2022] PUT /identity/v3/domains/0b52552292d440a4816ba70583677494/config => generated 138 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:33.227334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd3785-bae6-41bc-97d7-a707737d776e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:33.245413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd3785-bae6-41bc-97d7-a707737d776e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:33.258388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af37d0e-7a51-4576-92ff-247b4e5c6f47 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:33.262151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af37d0e-7a51-4576-92ff-247b4e5c6f47 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:33.262624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af37d0e-7a51-4576-92ff-247b4e5c6f47 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:33.263726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af37d0e-7a51-4576-92ff-247b4e5c6f47 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/0b52552292d440a4816ba70583677494/config` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:33.268176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af37d0e-7a51-4576-92ff-247b4e5c6f47 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=0b52552292d440a4816ba70583677494)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:33.269882 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-1af37d0e-7a51-4576-92ff-247b4e5c6f47 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:33.269882 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:26:33.269882 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:26:33.275140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af37d0e-7a51-4576-92ff-247b4e5c6f47 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:33.428737 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1899/3867] 10.222.0.43 () {60 vars in 1270 bytes} [Tue Jul 19 14:26:33 2022] PATCH /identity/v3/domains/0b52552292d440a4816ba70583677494/config => generated 142 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:33.433928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e6a40-52c3-4f14-a7a4-b5199daf88db tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:33.454941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e6a40-52c3-4f14-a7a4-b5199daf88db tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:33.460594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1d4c2-7ffb-4e09-9769-ef6062d322c9 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:33.462687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1d4c2-7ffb-4e09-9769-ef6062d322c9 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:33.463254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1d4c2-7ffb-4e09-9769-ef6062d322c9 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:33.463848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1d4c2-7ffb-4e09-9769-ef6062d322c9 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/0b52552292d440a4816ba70583677494/config` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:33.465805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1d4c2-7ffb-4e09-9769-ef6062d322c9 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=0b52552292d440a4816ba70583677494)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:33.468077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1d4c2-7ffb-4e09-9769-ef6062d322c9 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:33.474522 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1969/3868] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jul 19 14:26:33 2022] GET /identity/v3/domains/0b52552292d440a4816ba70583677494/config => generated 142 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:33.478492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af37d0e-7a51-4576-92ff-247b4e5c6f47 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:33.500082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af37d0e-7a51-4576-92ff-247b4e5c6f47 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:33.508251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a500c-0c83-4340-baf1-e1d361ec3b78 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:33.511217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a500c-0c83-4340-baf1-e1d361ec3b78 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:33.512481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a500c-0c83-4340-baf1-e1d361ec3b78 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:33.512481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a500c-0c83-4340-baf1-e1d361ec3b78 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/0b52552292d440a4816ba70583677494/config` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:33.517653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a500c-0c83-4340-baf1-e1d361ec3b78 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=0b52552292d440a4816ba70583677494)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:33.519086 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-b01a500c-0c83-4340-baf1-e1d361ec3b78 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:33.519086 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:26:33.519086 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:26:33.520161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a500c-0c83-4340-baf1-e1d361ec3b78 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:33.609176 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1900/3869] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jul 19 14:26:33 2022] DELETE /identity/v3/domains/0b52552292d440a4816ba70583677494/config => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:33.611669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1d4c2-7ffb-4e09-9769-ef6062d322c9 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:33.656631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1d4c2-7ffb-4e09-9769-ef6062d322c9 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:33.665661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cfffe-736a-4ab4-8097-93fd9cc6cc12 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:33.668867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cfffe-736a-4ab4-8097-93fd9cc6cc12 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:33.669292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cfffe-736a-4ab4-8097-93fd9cc6cc12 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:33.670136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cfffe-736a-4ab4-8097-93fd9cc6cc12 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/0b52552292d440a4816ba70583677494/config` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:33.673101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cfffe-736a-4ab4-8097-93fd9cc6cc12 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=0b52552292d440a4816ba70583677494)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:33.677769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cfffe-736a-4ab4-8097-93fd9cc6cc12 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:33.701604 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-925cfffe-736a-4ab4-8097-93fd9cc6cc12 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Could not find any options in domain configuration for domain 0b52552292d440a4816ba70583677494.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 0b52552292d440a4816ba70583677494. Jul 19 14:26:33.701604 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:26:33.701604 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:26:33.701604 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:26:33.701604 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:26:33.701604 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:26:33.701604 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:26:33.701604 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:26:33.701604 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:26:33.701604 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:26:33.701604 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:26:33.701604 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:26:33.701604 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 19 14:26:33.702775 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 19 14:26:33.702775 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 19 14:26:33.702775 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 19 14:26:33.702775 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:26:33.702775 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:26:33.702775 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 19 14:26:33.702775 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 19 14:26:33.702775 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain 0b52552292d440a4816ba70583677494. Jul 19 14:26:33.702775 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:26:33.705071 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1970/3870] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jul 19 14:26:33 2022] GET /identity/v3/domains/0b52552292d440a4816ba70583677494/config => generated 151 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:26:33.709459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a500c-0c83-4340-baf1-e1d361ec3b78 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:33.755711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a500c-0c83-4340-baf1-e1d361ec3b78 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:33.803596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875749f4-acf0-4638-85b2-b5bacf03980b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:33.804552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875749f4-acf0-4638-85b2-b5bacf03980b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:33.804848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875749f4-acf0-4638-85b2-b5bacf03980b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:33.805315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875749f4-acf0-4638-85b2-b5bacf03980b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/0b52552292d440a4816ba70583677494/config` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:33.805988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875749f4-acf0-4638-85b2-b5bacf03980b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=0b52552292d440a4816ba70583677494)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:33.807751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875749f4-acf0-4638-85b2-b5bacf03980b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:33.825122 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1901/3871] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jul 19 14:26:33 2022] DELETE /identity/v3/domains/0b52552292d440a4816ba70583677494/config => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:26:33.830420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cfffe-736a-4ab4-8097-93fd9cc6cc12 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:33.844859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cfffe-736a-4ab4-8097-93fd9cc6cc12 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:33.859769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd12320-8c42-4d64-90ea-710ac507a064 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:33.861501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd12320-8c42-4d64-90ea-710ac507a064 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:33.861838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd12320-8c42-4d64-90ea-710ac507a064 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:33.862175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd12320-8c42-4d64-90ea-710ac507a064 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/0b52552292d440a4816ba70583677494` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:33.867841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd12320-8c42-4d64-90ea-710ac507a064 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0b52552292d440a4816ba70583677494)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:33.869316 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-0fd12320-8c42-4d64-90ea-710ac507a064 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:33.869316 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:26:33.869316 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:26:33.874009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd12320-8c42-4d64-90ea-710ac507a064 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:33.941041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0fd12320-8c42-4d64-90ea-710ac507a064 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0b52552292d440a4816ba70583677494'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:33.945687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0fd12320-8c42-4d64-90ea-710ac507a064 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0b52552292d440a4816ba70583677494'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:34.059583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0fd12320-8c42-4d64-90ea-710ac507a064 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0b52552292d440a4816ba70583677494'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:34.060480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0fd12320-8c42-4d64-90ea-710ac507a064 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0b52552292d440a4816ba70583677494'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:34.063646 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1971/3872] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:26:33 2022] PATCH /identity/v3/domains/0b52552292d440a4816ba70583677494 => generated 277 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:34.067728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875749f4-acf0-4638-85b2-b5bacf03980b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:34.069415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-875749f4-acf0-4638-85b2-b5bacf03980b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:34.119557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875749f4-acf0-4638-85b2-b5bacf03980b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:34.232403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e18ee-469a-48cc-9271-3a2ab8949e76 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:34.234366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e18ee-469a-48cc-9271-3a2ab8949e76 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:34.234865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e18ee-469a-48cc-9271-3a2ab8949e76 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:34.235355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e18ee-469a-48cc-9271-3a2ab8949e76 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/0b52552292d440a4816ba70583677494` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:34.261705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e18ee-469a-48cc-9271-3a2ab8949e76 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0b52552292d440a4816ba70583677494)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:34.263246 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-3b3e18ee-469a-48cc-9271-3a2ab8949e76 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:34.263246 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:26:34.263246 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:26:34.264836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3e18ee-469a-48cc-9271-3a2ab8949e76 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:34.300319 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=85,keystone:UPDATE=1,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:34.320769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3b3e18ee-469a-48cc-9271-3a2ab8949e76 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0b52552292d440a4816ba70583677494'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:34.351597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3b3e18ee-469a-48cc-9271-3a2ab8949e76 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0b52552292d440a4816ba70583677494'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:34.582145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3b3e18ee-469a-48cc-9271-3a2ab8949e76 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b52552292d440a4816ba70583677494', 'request_id': 'req-3b3e18ee-469a-48cc-9271-3a2ab8949e76'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:34.707251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3b3e18ee-469a-48cc-9271-3a2ab8949e76 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b52552292d440a4816ba70583677494', 'request_id': 'req-3b3e18ee-469a-48cc-9271-3a2ab8949e76'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:34.741400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3b3e18ee-469a-48cc-9271-3a2ab8949e76 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b52552292d440a4816ba70583677494', 'request_id': 'req-3b3e18ee-469a-48cc-9271-3a2ab8949e76'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:34.779591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3b3e18ee-469a-48cc-9271-3a2ab8949e76 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] The token cache is being invalidate because project 0b52552292d440a4816ba70583677494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:26:34.781035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3b3e18ee-469a-48cc-9271-3a2ab8949e76 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:34.784082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3b3e18ee-469a-48cc-9271-3a2ab8949e76 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:34.798367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3b3e18ee-469a-48cc-9271-3a2ab8949e76 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0b52552292d440a4816ba70583677494', 'request_id': 'req-3b3e18ee-469a-48cc-9271-3a2ab8949e76'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:34.799404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3b3e18ee-469a-48cc-9271-3a2ab8949e76 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0b52552292d440a4816ba70583677494', 'request_id': 'req-3b3e18ee-469a-48cc-9271-3a2ab8949e76'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:34.800179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3b3e18ee-469a-48cc-9271-3a2ab8949e76 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0b52552292d440a4816ba70583677494', 'request_id': 'req-3b3e18ee-469a-48cc-9271-3a2ab8949e76'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:34.819007 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1902/3873] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:26:34 2022] DELETE /identity/v3/domains/0b52552292d440a4816ba70583677494 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:34.824401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd12320-8c42-4d64-90ea-710ac507a064 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:34.831428 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:34.840071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd12320-8c42-4d64-90ea-710ac507a064 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:34.925134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be5864-fe3e-412f-9994-19c4c2c6b483 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:34.925953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be5864-fe3e-412f-9994-19c4c2c6b483 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:34.926624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be5864-fe3e-412f-9994-19c4c2c6b483 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:34.927021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be5864-fe3e-412f-9994-19c4c2c6b483 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:34.927891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be5864-fe3e-412f-9994-19c4c2c6b483 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:34.929502 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-33be5864-fe3e-412f-9994-19c4c2c6b483 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:34.929502 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:26:34.929502 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:26:34.930848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be5864-fe3e-412f-9994-19c4c2c6b483 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:35.025748 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1972/3874] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:26:34 2022] POST /identity/v3/domains => generated 277 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:35.030185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e18ee-469a-48cc-9271-3a2ab8949e76 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:35.032472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3b3e18ee-469a-48cc-9271-3a2ab8949e76 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:35.059723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e18ee-469a-48cc-9271-3a2ab8949e76 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:35.149597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88431a11-79e4-47e9-8931-483370df1ae7 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:35.149597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88431a11-79e4-47e9-8931-483370df1ae7 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:35.149597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88431a11-79e4-47e9-8931-483370df1ae7 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:35.149932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88431a11-79e4-47e9-8931-483370df1ae7 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/ae7f7b55733440d5842b405d25d9b90f/config` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:35.149932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88431a11-79e4-47e9-8931-483370df1ae7 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=ae7f7b55733440d5842b405d25d9b90f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:35.149932 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-88431a11-79e4-47e9-8931-483370df1ae7 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:35.149932 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:26:35.149932 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:26:35.149932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88431a11-79e4-47e9-8931-483370df1ae7 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:35.270684 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1903/3875] 10.222.0.43 () {60 vars in 1268 bytes} [Tue Jul 19 14:26:35 2022] PUT /identity/v3/domains/ae7f7b55733440d5842b405d25d9b90f/config => generated 138 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:26:35.272424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be5864-fe3e-412f-9994-19c4c2c6b483 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:35.286153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be5864-fe3e-412f-9994-19c4c2c6b483 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:35.292569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304724d3-df3d-4d30-ac23-1b18718ae89e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:35.293764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304724d3-df3d-4d30-ac23-1b18718ae89e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:35.294327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304724d3-df3d-4d30-ac23-1b18718ae89e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:35.295315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304724d3-df3d-4d30-ac23-1b18718ae89e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/ae7f7b55733440d5842b405d25d9b90f/config/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:35.301108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304724d3-df3d-4d30-ac23-1b18718ae89e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=ae7f7b55733440d5842b405d25d9b90f, group=identity)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:35.301108 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-304724d3-df3d-4d30-ac23-1b18718ae89e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:35.301108 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:26:35.301108 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:26:35.301108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304724d3-df3d-4d30-ac23-1b18718ae89e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:35.424063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92d45d-354f-4945-9fa6-5e81bc5c7b10 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:35.424569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92d45d-354f-4945-9fa6-5e81bc5c7b10 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:35.425011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92d45d-354f-4945-9fa6-5e81bc5c7b10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:35.451979 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1973/3876] 10.222.0.43 () {60 vars in 1296 bytes} [Tue Jul 19 14:26:35 2022] PATCH /identity/v3/domains/ae7f7b55733440d5842b405d25d9b90f/config/identity => generated 177 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:26:35.462746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304724d3-df3d-4d30-ac23-1b18718ae89e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:35.495715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304724d3-df3d-4d30-ac23-1b18718ae89e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:35.502881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-aa92d45d-354f-4945-9fa6-5e81bc5c7b10 None None] MFA Rules not processed for user `eee0949ddc584dcfb866960cbfb2ce43`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:35.505618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c88ff-3887-479b-8d62-7d1551eb0fd3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:35.506479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aa92d45d-354f-4945-9fa6-5e81bc5c7b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:35.508898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c88ff-3887-479b-8d62-7d1551eb0fd3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:35.509187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c88ff-3887-479b-8d62-7d1551eb0fd3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:35.509468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c88ff-3887-479b-8d62-7d1551eb0fd3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/ae7f7b55733440d5842b405d25d9b90f/config/identity/driver` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:35.512941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c88ff-3887-479b-8d62-7d1551eb0fd3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=ae7f7b55733440d5842b405d25d9b90f, group=identity, option=driver)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:35.513147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53c88ff-3887-479b-8d62-7d1551eb0fd3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:35.540135 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:35.670453 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1904/3877] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:26:35.679066 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1974/3878] 10.222.0.43 () {60 vars in 1317 bytes} [Tue Jul 19 14:26:35 2022] PATCH /identity/v3/domains/ae7f7b55733440d5842b405d25d9b90f/config/identity/driver => generated 175 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:35.680507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92d45d-354f-4945-9fa6-5e81bc5c7b10 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:35.698948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92d45d-354f-4945-9fa6-5e81bc5c7b10 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:35.712616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e30abe-6985-49b2-8535-6e7728e0b31f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:35.716279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e30abe-6985-49b2-8535-6e7728e0b31f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:35.716279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e30abe-6985-49b2-8535-6e7728e0b31f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:35.716279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e30abe-6985-49b2-8535-6e7728e0b31f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/ae7f7b55733440d5842b405d25d9b90f/config/identity/driver` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:35.717018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e30abe-6985-49b2-8535-6e7728e0b31f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=ae7f7b55733440d5842b405d25d9b90f, group=identity, option=driver)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:35.719606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e30abe-6985-49b2-8535-6e7728e0b31f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:35.835544 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1905/3879] 10.222.0.43 () {58 vars in 1298 bytes} [Tue Jul 19 14:26:35 2022] DELETE /identity/v3/domains/ae7f7b55733440d5842b405d25d9b90f/config/identity/driver => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:35.840799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c88ff-3887-479b-8d62-7d1551eb0fd3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:35.874468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53c88ff-3887-479b-8d62-7d1551eb0fd3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:35.891703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fe3d4-f5d2-40a3-9aa4-c1796ad180d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:35.893042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fe3d4-f5d2-40a3-9aa4-c1796ad180d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:35.895034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fe3d4-f5d2-40a3-9aa4-c1796ad180d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:35.899273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60fe3d4-f5d2-40a3-9aa4-c1796ad180d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/ae7f7b55733440d5842b405d25d9b90f/config/identity/driver` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:35.904838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60fe3d4-f5d2-40a3-9aa4-c1796ad180d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=ae7f7b55733440d5842b405d25d9b90f, group=identity, option=driver)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:35.910631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60fe3d4-f5d2-40a3-9aa4-c1796ad180d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:35.964126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-d60fe3d4-f5d2-40a3-9aa4-c1796ad180d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Could not find option driver in group identity in domain configuration for domain ae7f7b55733440d5842b405d25d9b90f.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain ae7f7b55733440d5842b405d25d9b90f. Jul 19 14:26:35.964126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:26:35.964126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:26:35.964126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:26:35.964126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:26:35.964126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:26:35.964126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:26:35.964126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:26:35.964126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:26:35.964126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:26:35.964126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:26:35.964126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:26:35.964126 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 19 14:26:35.965408 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 19 14:26:35.965408 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 19 14:26:35.965408 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 19 14:26:35.965408 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:26:35.965408 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:26:35.965408 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 19 14:26:35.965408 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 19 14:26:35.965408 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain ae7f7b55733440d5842b405d25d9b90f. Jul 19 14:26:35.965408 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:26:35.969190 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1975/3880] 10.222.0.43 () {58 vars in 1295 bytes} [Tue Jul 19 14:26:35 2022] GET /identity/v3/domains/ae7f7b55733440d5842b405d25d9b90f/config/identity/driver => generated 171 bytes in 126 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:26:35.970040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e30abe-6985-49b2-8535-6e7728e0b31f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:35.996119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e30abe-6985-49b2-8535-6e7728e0b31f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:36.015412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fe3d4-f5d2-40a3-9aa4-c1796ad180d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:36.022862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d60fe3d4-f5d2-40a3-9aa4-c1796ad180d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:36.024583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbaee2-458f-4b73-a699-8d956b8f59b8 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:36.024583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbaee2-458f-4b73-a699-8d956b8f59b8 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:36.024583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbaee2-458f-4b73-a699-8d956b8f59b8 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:36.025377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbaee2-458f-4b73-a699-8d956b8f59b8 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/ae7f7b55733440d5842b405d25d9b90f/config/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:36.027747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbaee2-458f-4b73-a699-8d956b8f59b8 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=ae7f7b55733440d5842b405d25d9b90f, group=identity)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:36.029743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbaee2-458f-4b73-a699-8d956b8f59b8 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:36.132396 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1906/3881] 10.222.0.43 () {58 vars in 1277 bytes} [Tue Jul 19 14:26:35 2022] DELETE /identity/v3/domains/ae7f7b55733440d5842b405d25d9b90f/config/identity => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:36.136982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbaee2-458f-4b73-a699-8d956b8f59b8 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:36.151776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbaee2-458f-4b73-a699-8d956b8f59b8 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:36.163024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72228b8f-a494-4c68-8496-8b60242c5fa4 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:36.170436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72228b8f-a494-4c68-8496-8b60242c5fa4 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:36.170436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72228b8f-a494-4c68-8496-8b60242c5fa4 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:36.170736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72228b8f-a494-4c68-8496-8b60242c5fa4 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/ae7f7b55733440d5842b405d25d9b90f/config/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:36.173114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72228b8f-a494-4c68-8496-8b60242c5fa4 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=ae7f7b55733440d5842b405d25d9b90f, group=identity)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:36.175778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72228b8f-a494-4c68-8496-8b60242c5fa4 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:36.221224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-72228b8f-a494-4c68-8496-8b60242c5fa4 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Could not find group identity in domain configuration for domain ae7f7b55733440d5842b405d25d9b90f.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain ae7f7b55733440d5842b405d25d9b90f. Jul 19 14:26:36.221224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:26:36.221224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:26:36.221224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:26:36.221224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:26:36.221224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:26:36.221224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:26:36.221224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:26:36.221224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:26:36.221224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:26:36.221224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:26:36.221224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:26:36.221224 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 19 14:26:36.222349 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 19 14:26:36.222349 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 19 14:26:36.222349 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 19 14:26:36.222349 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:26:36.222349 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:26:36.222349 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 19 14:26:36.222349 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 19 14:26:36.222349 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain ae7f7b55733440d5842b405d25d9b90f. Jul 19 14:26:36.222349 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:26:36.233634 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1907/3882] 10.222.0.43 () {58 vars in 1274 bytes} [Tue Jul 19 14:26:36 2022] GET /identity/v3/domains/ae7f7b55733440d5842b405d25d9b90f/config/identity => generated 154 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:26:36.234565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60fe3d4-f5d2-40a3-9aa4-c1796ad180d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:36.235134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72228b8f-a494-4c68-8496-8b60242c5fa4 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:36.251629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507c4f9-8005-4a6c-a2e4-bb042abc8390 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:36.252400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507c4f9-8005-4a6c-a2e4-bb042abc8390 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:36.253018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507c4f9-8005-4a6c-a2e4-bb042abc8390 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:36.253306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507c4f9-8005-4a6c-a2e4-bb042abc8390 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:36.262675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72228b8f-a494-4c68-8496-8b60242c5fa4 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:36.271668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2ae0a-e4cb-4b95-94ca-6f2fc200f3d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:36.272827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507c4f9-8005-4a6c-a2e4-bb042abc8390 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:36.274351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2ae0a-e4cb-4b95-94ca-6f2fc200f3d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:36.276781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2ae0a-e4cb-4b95-94ca-6f2fc200f3d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:36.277959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2ae0a-e4cb-4b95-94ca-6f2fc200f3d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/ae7f7b55733440d5842b405d25d9b90f/config` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:36.278781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2ae0a-e4cb-4b95-94ca-6f2fc200f3d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=ae7f7b55733440d5842b405d25d9b90f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:36.279462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507c4f9-8005-4a6c-a2e4-bb042abc8390 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:36.280727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a2ae0a-e4cb-4b95-94ca-6f2fc200f3d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:36.311954 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1976/3883] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:26:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:26:36.332740 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1908/3884] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jul 19 14:26:36 2022] DELETE /identity/v3/domains/ae7f7b55733440d5842b405d25d9b90f/config => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:36.337239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507c4f9-8005-4a6c-a2e4-bb042abc8390 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:36.359972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507c4f9-8005-4a6c-a2e4-bb042abc8390 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:36.376602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb7d16-7ca1-4875-bd6a-b7e74db7e9de tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:36.382568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb7d16-7ca1-4875-bd6a-b7e74db7e9de tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:36.382912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb7d16-7ca1-4875-bd6a-b7e74db7e9de tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:36.383466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb7d16-7ca1-4875-bd6a-b7e74db7e9de tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/ae7f7b55733440d5842b405d25d9b90f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:36.388458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb7d16-7ca1-4875-bd6a-b7e74db7e9de tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ae7f7b55733440d5842b405d25d9b90f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:36.393560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb7d16-7ca1-4875-bd6a-b7e74db7e9de tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:36.419067 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:36.442458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-75fb7d16-7ca1-4875-bd6a-b7e74db7e9de tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ae7f7b55733440d5842b405d25d9b90f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:36.443344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-75fb7d16-7ca1-4875-bd6a-b7e74db7e9de tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ae7f7b55733440d5842b405d25d9b90f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:36.682666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-75fb7d16-7ca1-4875-bd6a-b7e74db7e9de tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ae7f7b55733440d5842b405d25d9b90f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:36.683560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-75fb7d16-7ca1-4875-bd6a-b7e74db7e9de tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ae7f7b55733440d5842b405d25d9b90f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:36.686514 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1977/3885] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:26:36 2022] PATCH /identity/v3/domains/ae7f7b55733440d5842b405d25d9b90f => generated 278 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:36.690471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2ae0a-e4cb-4b95-94ca-6f2fc200f3d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:36.692842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-95a2ae0a-e4cb-4b95-94ca-6f2fc200f3d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:36.720112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2ae0a-e4cb-4b95-94ca-6f2fc200f3d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:36.875834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103e5d8-cd15-4a24-8872-f5ec0310e018 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:36.879282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103e5d8-cd15-4a24-8872-f5ec0310e018 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:36.879703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103e5d8-cd15-4a24-8872-f5ec0310e018 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:36.880091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103e5d8-cd15-4a24-8872-f5ec0310e018 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/ae7f7b55733440d5842b405d25d9b90f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:36.908322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103e5d8-cd15-4a24-8872-f5ec0310e018 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ae7f7b55733440d5842b405d25d9b90f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:36.917332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1103e5d8-cd15-4a24-8872-f5ec0310e018 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:36.975963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1103e5d8-cd15-4a24-8872-f5ec0310e018 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ae7f7b55733440d5842b405d25d9b90f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:37.007725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1103e5d8-cd15-4a24-8872-f5ec0310e018 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ae7f7b55733440d5842b405d25d9b90f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:37.160745 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:37.185995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1103e5d8-cd15-4a24-8872-f5ec0310e018 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae7f7b55733440d5842b405d25d9b90f', 'request_id': 'req-1103e5d8-cd15-4a24-8872-f5ec0310e018'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:37.279003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1103e5d8-cd15-4a24-8872-f5ec0310e018 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae7f7b55733440d5842b405d25d9b90f', 'request_id': 'req-1103e5d8-cd15-4a24-8872-f5ec0310e018'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:37.288997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1103e5d8-cd15-4a24-8872-f5ec0310e018 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae7f7b55733440d5842b405d25d9b90f', 'request_id': 'req-1103e5d8-cd15-4a24-8872-f5ec0310e018'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:37.317694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1103e5d8-cd15-4a24-8872-f5ec0310e018 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] The token cache is being invalidate because project ae7f7b55733440d5842b405d25d9b90f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:26:37.324004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1103e5d8-cd15-4a24-8872-f5ec0310e018 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:37.325965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1103e5d8-cd15-4a24-8872-f5ec0310e018 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:37.352551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1103e5d8-cd15-4a24-8872-f5ec0310e018 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ae7f7b55733440d5842b405d25d9b90f', 'request_id': 'req-1103e5d8-cd15-4a24-8872-f5ec0310e018'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:37.353259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1103e5d8-cd15-4a24-8872-f5ec0310e018 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ae7f7b55733440d5842b405d25d9b90f', 'request_id': 'req-1103e5d8-cd15-4a24-8872-f5ec0310e018'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:37.359914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1103e5d8-cd15-4a24-8872-f5ec0310e018 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ae7f7b55733440d5842b405d25d9b90f', 'request_id': 'req-1103e5d8-cd15-4a24-8872-f5ec0310e018'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:37.373084 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1909/3886] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:26:36 2022] DELETE /identity/v3/domains/ae7f7b55733440d5842b405d25d9b90f => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:37.378267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb7d16-7ca1-4875-bd6a-b7e74db7e9de tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:37.393816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb7d16-7ca1-4875-bd6a-b7e74db7e9de tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:37.513363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14b50a-8112-4264-bca7-36dc08790056 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:37.514422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14b50a-8112-4264-bca7-36dc08790056 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:37.514885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14b50a-8112-4264-bca7-36dc08790056 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:37.515367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14b50a-8112-4264-bca7-36dc08790056 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:37.516205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14b50a-8112-4264-bca7-36dc08790056 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:37.518749 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-8b14b50a-8112-4264-bca7-36dc08790056 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:37.518749 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:26:37.518749 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:26:37.522204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14b50a-8112-4264-bca7-36dc08790056 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:37.533532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103e5d8-cd15-4a24-8872-f5ec0310e018 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:37.541908 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1978/3887] 10.222.0.43 () {58 vars in 1172 bytes} [Tue Jul 19 14:26:37 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:26:37.542432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1103e5d8-cd15-4a24-8872-f5ec0310e018 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:37.564668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103e5d8-cd15-4a24-8872-f5ec0310e018 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:37.566058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aca2f6-1cb2-4c25-bac9-106fde2085c0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:37.567205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aca2f6-1cb2-4c25-bac9-106fde2085c0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:37.567598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aca2f6-1cb2-4c25-bac9-106fde2085c0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:37.567985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aca2f6-1cb2-4c25-bac9-106fde2085c0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:37.571917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aca2f6-1cb2-4c25-bac9-106fde2085c0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:37.579855 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-28aca2f6-1cb2-4c25-bac9-106fde2085c0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:37.579855 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:26:37.579855 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:26:37.581073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aca2f6-1cb2-4c25-bac9-106fde2085c0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:37.584065 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1910/3888] 10.222.0.43 () {58 vars in 1199 bytes} [Tue Jul 19 14:26:37 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:37.586723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14b50a-8112-4264-bca7-36dc08790056 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:37.606862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14b50a-8112-4264-bca7-36dc08790056 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:37.617039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432fe8b-f19e-4ca2-a0d5-ebd1d9ca513b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:37.617763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432fe8b-f19e-4ca2-a0d5-ebd1d9ca513b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:37.618278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432fe8b-f19e-4ca2-a0d5-ebd1d9ca513b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:37.620145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432fe8b-f19e-4ca2-a0d5-ebd1d9ca513b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:37.621018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432fe8b-f19e-4ca2-a0d5-ebd1d9ca513b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:37.623047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432fe8b-f19e-4ca2-a0d5-ebd1d9ca513b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:37.624436 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1979/3889] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Jul 19 14:26:37 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:37.629361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aca2f6-1cb2-4c25-bac9-106fde2085c0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:37.644845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aca2f6-1cb2-4c25-bac9-106fde2085c0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:37.658614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b3daa-9c82-46e5-806e-522b6c6a8847 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:37.659496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b3daa-9c82-46e5-806e-522b6c6a8847 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:37.659789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b3daa-9c82-46e5-806e-522b6c6a8847 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:37.660074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b3daa-9c82-46e5-806e-522b6c6a8847 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:37.660756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b3daa-9c82-46e5-806e-522b6c6a8847 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:37.662533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b3daa-9c82-46e5-806e-522b6c6a8847 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:37.670493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432fe8b-f19e-4ca2-a0d5-ebd1d9ca513b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:37.675379 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1911/3890] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:26:37 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:37.688478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432fe8b-f19e-4ca2-a0d5-ebd1d9ca513b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:37.694470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b84d5-62d5-485f-8139-76d17da55774 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:37.695315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b84d5-62d5-485f-8139-76d17da55774 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:37.695650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b84d5-62d5-485f-8139-76d17da55774 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:37.695940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b84d5-62d5-485f-8139-76d17da55774 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:37.696715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b84d5-62d5-485f-8139-76d17da55774 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:37.698695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b84d5-62d5-485f-8139-76d17da55774 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:37.704898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b3daa-9c82-46e5-806e-522b6c6a8847 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:37.706138 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1980/3891] 10.222.0.43 () {58 vars in 1187 bytes} [Tue Jul 19 14:26:37 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:26:37.719220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b3daa-9c82-46e5-806e-522b6c6a8847 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:37.724456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f844505-c4f4-4ce6-b650-24b7fa8504a1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:37.725474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f844505-c4f4-4ce6-b650-24b7fa8504a1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:37.725604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f844505-c4f4-4ce6-b650-24b7fa8504a1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:37.725925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f844505-c4f4-4ce6-b650-24b7fa8504a1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:37.726679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f844505-c4f4-4ce6-b650-24b7fa8504a1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:37.729382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f844505-c4f4-4ce6-b650-24b7fa8504a1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:37.736004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b84d5-62d5-485f-8139-76d17da55774 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:37.741952 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1912/3892] 10.222.0.43 () {58 vars in 1199 bytes} [Tue Jul 19 14:26:37 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 19 14:26:37.747446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b84d5-62d5-485f-8139-76d17da55774 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:37.753204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e3ddc-03a6-4ccb-b20f-07b8e788f503 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:37.753658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e3ddc-03a6-4ccb-b20f-07b8e788f503 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:37.753955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e3ddc-03a6-4ccb-b20f-07b8e788f503 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:37.754280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e3ddc-03a6-4ccb-b20f-07b8e788f503 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:37.755008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e3ddc-03a6-4ccb-b20f-07b8e788f503 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:37.756757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08e3ddc-03a6-4ccb-b20f-07b8e788f503 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:37.763269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f844505-c4f4-4ce6-b650-24b7fa8504a1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:37.770242 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1981/3893] 10.222.0.43 () {58 vars in 1202 bytes} [Tue Jul 19 14:26:37 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:37.779057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f844505-c4f4-4ce6-b650-24b7fa8504a1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:37.825118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1de45-93fb-4228-9573-28b0735912f0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:37.825942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1de45-93fb-4228-9573-28b0735912f0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:37.826261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1de45-93fb-4228-9573-28b0735912f0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:37.826545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db1de45-93fb-4228-9573-28b0735912f0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:37.836461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1de45-93fb-4228-9573-28b0735912f0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:37.840232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db1de45-93fb-4228-9573-28b0735912f0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:37.844397 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1913/3894] 10.222.0.43 () {58 vars in 1208 bytes} [Tue Jul 19 14:26:37 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:37.846119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e3ddc-03a6-4ccb-b20f-07b8e788f503 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:37.867132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e3ddc-03a6-4ccb-b20f-07b8e788f503 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:37.892205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ef6b6-6d56-46d6-acb3-4182ba07bea6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:37.893028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ef6b6-6d56-46d6-acb3-4182ba07bea6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:37.893320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ef6b6-6d56-46d6-acb3-4182ba07bea6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:37.893604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ef6b6-6d56-46d6-acb3-4182ba07bea6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:37.894309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ef6b6-6d56-46d6-acb3-4182ba07bea6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:37.900910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ef6b6-6d56-46d6-acb3-4182ba07bea6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:37.900910 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1982/3895] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:26:37 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:37.903567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1de45-93fb-4228-9573-28b0735912f0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:37.916248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db1de45-93fb-4228-9573-28b0735912f0 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:37.940807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b19dd-a1e1-4ec5-9e78-64a49bfa23e2 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:37.941783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b19dd-a1e1-4ec5-9e78-64a49bfa23e2 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:37.942212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b19dd-a1e1-4ec5-9e78-64a49bfa23e2 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:37.942595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b19dd-a1e1-4ec5-9e78-64a49bfa23e2 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:37.943542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b19dd-a1e1-4ec5-9e78-64a49bfa23e2 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:37.950022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b19dd-a1e1-4ec5-9e78-64a49bfa23e2 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:37.956014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ef6b6-6d56-46d6-acb3-4182ba07bea6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:37.966516 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1914/3896] 10.222.0.43 () {58 vars in 1217 bytes} [Tue Jul 19 14:26:37 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:37.971598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ef6b6-6d56-46d6-acb3-4182ba07bea6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:37.990642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccd887-d768-4d3b-b7c0-a3e397daec36 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:37.991752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccd887-d768-4d3b-b7c0-a3e397daec36 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:37.992168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccd887-d768-4d3b-b7c0-a3e397daec36 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:37.993610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccd887-d768-4d3b-b7c0-a3e397daec36 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:37.995673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccd887-d768-4d3b-b7c0-a3e397daec36 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:37.999281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ccd887-d768-4d3b-b7c0-a3e397daec36 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:38.005785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b19dd-a1e1-4ec5-9e78-64a49bfa23e2 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:38.011703 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1983/3897] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jul 19 14:26:37 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 19 14:26:38.019409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b19dd-a1e1-4ec5-9e78-64a49bfa23e2 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:38.025996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ab1a6-f8fb-4425-8727-4920803fb449 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:38.027701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ab1a6-f8fb-4425-8727-4920803fb449 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:38.028094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ab1a6-f8fb-4425-8727-4920803fb449 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:38.028479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ab1a6-f8fb-4425-8727-4920803fb449 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:38.029326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ab1a6-f8fb-4425-8727-4920803fb449 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:38.034052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ab1a6-f8fb-4425-8727-4920803fb449 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:38.040467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccd887-d768-4d3b-b7c0-a3e397daec36 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:38.051046 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1915/3898] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:26:38 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:38.055347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ccd887-d768-4d3b-b7c0-a3e397daec36 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:38.064074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a59cf-7245-4511-ac1d-ae41b6e89507 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:38.065198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a59cf-7245-4511-ac1d-ae41b6e89507 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:38.080058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a59cf-7245-4511-ac1d-ae41b6e89507 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:38.080311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1a59cf-7245-4511-ac1d-ae41b6e89507 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:38.081027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a59cf-7245-4511-ac1d-ae41b6e89507 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:38.104431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1a59cf-7245-4511-ac1d-ae41b6e89507 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:38.104431 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1984/3899] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jul 19 14:26:38 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:38.104674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ab1a6-f8fb-4425-8727-4920803fb449 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:38.123276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ab1a6-f8fb-4425-8727-4920803fb449 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:38.140998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6ccd6-fc24-475f-a7a2-48ff7a8eb8c1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:38.142626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6ccd6-fc24-475f-a7a2-48ff7a8eb8c1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:38.146064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6ccd6-fc24-475f-a7a2-48ff7a8eb8c1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:38.146793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d6ccd6-fc24-475f-a7a2-48ff7a8eb8c1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:38.163241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6ccd6-fc24-475f-a7a2-48ff7a8eb8c1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:38.169721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d6ccd6-fc24-475f-a7a2-48ff7a8eb8c1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:38.182272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a59cf-7245-4511-ac1d-ae41b6e89507 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:38.183217 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1916/3900] 10.222.0.43 () {58 vars in 1226 bytes} [Tue Jul 19 14:26:38 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:38.225324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1a59cf-7245-4511-ac1d-ae41b6e89507 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:38.246558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9fb12-ea32-405b-a091-cffe051abae6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:38.247460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9fb12-ea32-405b-a091-cffe051abae6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:38.247753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9fb12-ea32-405b-a091-cffe051abae6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:38.248036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9fb12-ea32-405b-a091-cffe051abae6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:38.248753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9fb12-ea32-405b-a091-cffe051abae6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:38.251219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9fb12-ea32-405b-a091-cffe051abae6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:38.255880 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1985/3901] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:26:38 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:38.257493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6ccd6-fc24-475f-a7a2-48ff7a8eb8c1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:38.270440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d6ccd6-fc24-475f-a7a2-48ff7a8eb8c1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:38.306310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3752d5-a1b5-4a54-b7be-7f013728da43 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:38.318492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3752d5-a1b5-4a54-b7be-7f013728da43 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:38.321418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3752d5-a1b5-4a54-b7be-7f013728da43 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:38.322225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3752d5-a1b5-4a54-b7be-7f013728da43 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:38.325546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3752d5-a1b5-4a54-b7be-7f013728da43 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:38.330281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3752d5-a1b5-4a54-b7be-7f013728da43 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:38.338921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9fb12-ea32-405b-a091-cffe051abae6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:38.340786 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1917/3902] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jul 19 14:26:38 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:38.360238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9fb12-ea32-405b-a091-cffe051abae6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:38.375220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930b2dd-5d7f-4a88-8666-23ab44541f5e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:38.376045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930b2dd-5d7f-4a88-8666-23ab44541f5e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:38.376335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930b2dd-5d7f-4a88-8666-23ab44541f5e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:38.376618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930b2dd-5d7f-4a88-8666-23ab44541f5e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:38.377295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930b2dd-5d7f-4a88-8666-23ab44541f5e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:38.384473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7930b2dd-5d7f-4a88-8666-23ab44541f5e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:38.391965 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1986/3903] 10.222.0.43 () {58 vars in 1241 bytes} [Tue Jul 19 14:26:38 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:38.396340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3752d5-a1b5-4a54-b7be-7f013728da43 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:38.417663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3752d5-a1b5-4a54-b7be-7f013728da43 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:38.445834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed573f7-6e5a-4f15-a65b-b45d8f1bc8ec tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:38.445834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed573f7-6e5a-4f15-a65b-b45d8f1bc8ec tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:38.446632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed573f7-6e5a-4f15-a65b-b45d8f1bc8ec tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:38.446632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed573f7-6e5a-4f15-a65b-b45d8f1bc8ec tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:38.447069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed573f7-6e5a-4f15-a65b-b45d8f1bc8ec tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:38.460076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed573f7-6e5a-4f15-a65b-b45d8f1bc8ec tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:38.466254 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1918/3904] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jul 19 14:26:38 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:38.470176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930b2dd-5d7f-4a88-8666-23ab44541f5e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:38.486579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7930b2dd-5d7f-4a88-8666-23ab44541f5e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:38.513605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee56f10-921f-4efb-92b3-dab894718d55 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:38.518925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee56f10-921f-4efb-92b3-dab894718d55 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:38.519596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee56f10-921f-4efb-92b3-dab894718d55 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:38.521578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee56f10-921f-4efb-92b3-dab894718d55 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:38.522505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee56f10-921f-4efb-92b3-dab894718d55 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:38.527800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee56f10-921f-4efb-92b3-dab894718d55 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:38.565729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed573f7-6e5a-4f15-a65b-b45d8f1bc8ec tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:38.570800 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1987/3905] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jul 19 14:26:38 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:38.580672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed573f7-6e5a-4f15-a65b-b45d8f1bc8ec tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:38.614487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb05c85-9933-425c-b51b-6f48325ad2ce tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:38.615416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb05c85-9933-425c-b51b-6f48325ad2ce tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:38.615605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb05c85-9933-425c-b51b-6f48325ad2ce tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:38.616065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb05c85-9933-425c-b51b-6f48325ad2ce tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:38.617179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb05c85-9933-425c-b51b-6f48325ad2ce tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:38.619055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb05c85-9933-425c-b51b-6f48325ad2ce tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:38.624799 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1919/3906] 10.222.0.43 () {58 vars in 1268 bytes} [Tue Jul 19 14:26:38 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 19 14:26:38.629392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee56f10-921f-4efb-92b3-dab894718d55 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:38.650147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee56f10-921f-4efb-92b3-dab894718d55 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:38.671036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7837a-afa8-4aec-9907-6e181b4c7d5a tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:38.674084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7837a-afa8-4aec-9907-6e181b4c7d5a tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:38.674084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7837a-afa8-4aec-9907-6e181b4c7d5a tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:38.674084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7837a-afa8-4aec-9907-6e181b4c7d5a tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:38.674768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7837a-afa8-4aec-9907-6e181b4c7d5a tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:38.687593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7837a-afa8-4aec-9907-6e181b4c7d5a tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:38.689902 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1988/3907] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jul 19 14:26:38 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:38.694277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb05c85-9933-425c-b51b-6f48325ad2ce tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:38.710075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb05c85-9933-425c-b51b-6f48325ad2ce tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:38.726131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682121a3-3a31-45d3-84fd-e79cd2af9efe tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:38.727014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682121a3-3a31-45d3-84fd-e79cd2af9efe tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:38.727383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682121a3-3a31-45d3-84fd-e79cd2af9efe tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:38.727734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682121a3-3a31-45d3-84fd-e79cd2af9efe tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:38.729156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682121a3-3a31-45d3-84fd-e79cd2af9efe tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:38.731626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682121a3-3a31-45d3-84fd-e79cd2af9efe tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:38.737425 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1920/3908] 10.222.0.43 () {58 vars in 1256 bytes} [Tue Jul 19 14:26:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:38.738588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7837a-afa8-4aec-9907-6e181b4c7d5a tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:38.753754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7837a-afa8-4aec-9907-6e181b4c7d5a tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:38.777544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf865fd-2679-44e7-a4da-90ec515fab4c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:38.778013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf865fd-2679-44e7-a4da-90ec515fab4c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:38.778583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf865fd-2679-44e7-a4da-90ec515fab4c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:38.781479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf865fd-2679-44e7-a4da-90ec515fab4c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:38.782674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf865fd-2679-44e7-a4da-90ec515fab4c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:38.784999 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf865fd-2679-44e7-a4da-90ec515fab4c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:38.789677 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1989/3909] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jul 19 14:26:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 19 14:26:38.795724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682121a3-3a31-45d3-84fd-e79cd2af9efe tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:38.811052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682121a3-3a31-45d3-84fd-e79cd2af9efe tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:38.834294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828094e-cd73-4e2b-afe5-51ff79f273cc tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:38.839455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828094e-cd73-4e2b-afe5-51ff79f273cc tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:38.839455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828094e-cd73-4e2b-afe5-51ff79f273cc tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:38.839455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c828094e-cd73-4e2b-afe5-51ff79f273cc tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:38.839455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828094e-cd73-4e2b-afe5-51ff79f273cc tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:38.840070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c828094e-cd73-4e2b-afe5-51ff79f273cc tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:38.843540 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1921/3910] 10.222.0.43 () {58 vars in 1241 bytes} [Tue Jul 19 14:26:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:38.845695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf865fd-2679-44e7-a4da-90ec515fab4c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:38.864323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf865fd-2679-44e7-a4da-90ec515fab4c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:38.872282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9a787-9934-4a0f-bbb6-a06a4c7c5fc1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:38.874370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9a787-9934-4a0f-bbb6-a06a4c7c5fc1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:38.874828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9a787-9934-4a0f-bbb6-a06a4c7c5fc1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:38.875264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c9a787-9934-4a0f-bbb6-a06a4c7c5fc1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:38.877323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9a787-9934-4a0f-bbb6-a06a4c7c5fc1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:38.879573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c9a787-9934-4a0f-bbb6-a06a4c7c5fc1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:38.885850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828094e-cd73-4e2b-afe5-51ff79f273cc tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:38.891096 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1990/3911] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jul 19 14:26:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:38.896301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c828094e-cd73-4e2b-afe5-51ff79f273cc tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:38.931395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32b816-e023-4df1-ad25-04de62a665c6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:38.933245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32b816-e023-4df1-ad25-04de62a665c6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:38.934365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32b816-e023-4df1-ad25-04de62a665c6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:38.935322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32b816-e023-4df1-ad25-04de62a665c6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:38.936235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32b816-e023-4df1-ad25-04de62a665c6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:38.938404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32b816-e023-4df1-ad25-04de62a665c6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:38.940343 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1922/3912] 10.222.0.43 () {58 vars in 1253 bytes} [Tue Jul 19 14:26:38 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:38.944353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9a787-9934-4a0f-bbb6-a06a4c7c5fc1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:38.968337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c9a787-9934-4a0f-bbb6-a06a4c7c5fc1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:38.983550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faaa976-75cc-4a1e-9531-7a64fbaee711 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:38.984952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaa976-75cc-4a1e-9531-7a64fbaee711 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:38.984952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaa976-75cc-4a1e-9531-7a64fbaee711 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:38.984952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faaa976-75cc-4a1e-9531-7a64fbaee711 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:38.985679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faaa976-75cc-4a1e-9531-7a64fbaee711 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:38.987285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faaa976-75cc-4a1e-9531-7a64fbaee711 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:38.991564 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1991/3913] 10.222.0.43 () {58 vars in 1289 bytes} [Tue Jul 19 14:26:38 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:38.992649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32b816-e023-4df1-ad25-04de62a665c6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:39.027625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32b816-e023-4df1-ad25-04de62a665c6 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:39.080230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d453bcb-994d-4114-826f-1048a6f9f98d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:39.091493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d453bcb-994d-4114-826f-1048a6f9f98d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:39.095528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d453bcb-994d-4114-826f-1048a6f9f98d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:39.096125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d453bcb-994d-4114-826f-1048a6f9f98d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:39.097224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d453bcb-994d-4114-826f-1048a6f9f98d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:39.099395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d453bcb-994d-4114-826f-1048a6f9f98d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:39.108830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faaa976-75cc-4a1e-9531-7a64fbaee711 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:39.111711 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1923/3914] 10.222.0.43 () {58 vars in 1256 bytes} [Tue Jul 19 14:26:38 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:39.129356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faaa976-75cc-4a1e-9531-7a64fbaee711 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:39.155304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad101f4-a016-4730-947c-3b0c9f0e6d00 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:39.157209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad101f4-a016-4730-947c-3b0c9f0e6d00 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:39.158926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad101f4-a016-4730-947c-3b0c9f0e6d00 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:39.159678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad101f4-a016-4730-947c-3b0c9f0e6d00 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:39.163226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad101f4-a016-4730-947c-3b0c9f0e6d00 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:39.167582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad101f4-a016-4730-947c-3b0c9f0e6d00 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:39.171228 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1992/3915] 10.222.0.43 () {58 vars in 1265 bytes} [Tue Jul 19 14:26:39 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:39.175312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d453bcb-994d-4114-826f-1048a6f9f98d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:39.194228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d453bcb-994d-4114-826f-1048a6f9f98d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:39.211154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f848d5b-f3a3-4eba-a678-0c383048ee05 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:39.212821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f848d5b-f3a3-4eba-a678-0c383048ee05 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:39.213826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f848d5b-f3a3-4eba-a678-0c383048ee05 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:39.214570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f848d5b-f3a3-4eba-a678-0c383048ee05 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:39.215430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f848d5b-f3a3-4eba-a678-0c383048ee05 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:39.223760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f848d5b-f3a3-4eba-a678-0c383048ee05 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:39.226543 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1924/3916] 10.222.0.43 () {58 vars in 1307 bytes} [Tue Jul 19 14:26:39 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:39.231598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad101f4-a016-4730-947c-3b0c9f0e6d00 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:39.249103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad101f4-a016-4730-947c-3b0c9f0e6d00 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:39.265075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8414644-a582-41ec-b7dc-6e2cbf02253f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:39.266166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8414644-a582-41ec-b7dc-6e2cbf02253f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:39.266464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8414644-a582-41ec-b7dc-6e2cbf02253f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:39.266747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8414644-a582-41ec-b7dc-6e2cbf02253f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:39.267417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8414644-a582-41ec-b7dc-6e2cbf02253f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:39.273421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8414644-a582-41ec-b7dc-6e2cbf02253f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:39.282236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f848d5b-f3a3-4eba-a678-0c383048ee05 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:39.282643 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1993/3917] 10.222.0.43 () {58 vars in 1289 bytes} [Tue Jul 19 14:26:39 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:39.312040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f848d5b-f3a3-4eba-a678-0c383048ee05 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:39.323380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa1e37-c05e-4600-8818-731c1586834d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:39.325188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa1e37-c05e-4600-8818-731c1586834d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:39.325706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa1e37-c05e-4600-8818-731c1586834d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:39.326232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa1e37-c05e-4600-8818-731c1586834d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:39.333435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa1e37-c05e-4600-8818-731c1586834d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:39.333435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa1e37-c05e-4600-8818-731c1586834d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:39.333435 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1925/3918] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:26:39 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:39.334580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8414644-a582-41ec-b7dc-6e2cbf02253f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:39.352714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8414644-a582-41ec-b7dc-6e2cbf02253f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:39.364464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c889f-f6ed-4150-9d83-d9473348744c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:39.365291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c889f-f6ed-4150-9d83-d9473348744c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:39.365661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c889f-f6ed-4150-9d83-d9473348744c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:39.366010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c889f-f6ed-4150-9d83-d9473348744c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:39.366722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c889f-f6ed-4150-9d83-d9473348744c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:39.371391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c889f-f6ed-4150-9d83-d9473348744c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:39.379594 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1994/3919] 10.222.0.43 () {58 vars in 1226 bytes} [Tue Jul 19 14:26:39 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:39.383707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa1e37-c05e-4600-8818-731c1586834d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:39.405867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa1e37-c05e-4600-8818-731c1586834d tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:39.412511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d0e13-03b7-4af8-8ffe-4792e0537085 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:39.413349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d0e13-03b7-4af8-8ffe-4792e0537085 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:39.413639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d0e13-03b7-4af8-8ffe-4792e0537085 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:39.413929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7d0e13-03b7-4af8-8ffe-4792e0537085 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:39.414636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d0e13-03b7-4af8-8ffe-4792e0537085 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:39.416825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7d0e13-03b7-4af8-8ffe-4792e0537085 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:39.419987 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1926/3920] 10.222.0.43 () {58 vars in 1241 bytes} [Tue Jul 19 14:26:39 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:39.423289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c889f-f6ed-4150-9d83-d9473348744c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:39.443574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c889f-f6ed-4150-9d83-d9473348744c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:39.448719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66762251-2567-45bf-9e0d-22b675ee9ed3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:39.456609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66762251-2567-45bf-9e0d-22b675ee9ed3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:39.456609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66762251-2567-45bf-9e0d-22b675ee9ed3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:39.456609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66762251-2567-45bf-9e0d-22b675ee9ed3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:39.456609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66762251-2567-45bf-9e0d-22b675ee9ed3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:39.457227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66762251-2567-45bf-9e0d-22b675ee9ed3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:39.458582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d0e13-03b7-4af8-8ffe-4792e0537085 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:39.459134 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1995/3921] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jul 19 14:26:39 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:39.479932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7d0e13-03b7-4af8-8ffe-4792e0537085 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:39.486971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda1ce1-b1a1-4cdd-8ff2-2cf31516cf40 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:39.487791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda1ce1-b1a1-4cdd-8ff2-2cf31516cf40 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:39.488105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda1ce1-b1a1-4cdd-8ff2-2cf31516cf40 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:39.488729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda1ce1-b1a1-4cdd-8ff2-2cf31516cf40 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:39.489819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda1ce1-b1a1-4cdd-8ff2-2cf31516cf40 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:39.490689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda1ce1-b1a1-4cdd-8ff2-2cf31516cf40 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:39.495556 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1927/3922] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jul 19 14:26:39 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 19 14:26:39.497006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66762251-2567-45bf-9e0d-22b675ee9ed3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:39.515508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66762251-2567-45bf-9e0d-22b675ee9ed3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:39.531326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ed0b6-e91a-435c-8cc3-613fce3ffb3e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:39.533373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ed0b6-e91a-435c-8cc3-613fce3ffb3e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:39.533373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ed0b6-e91a-435c-8cc3-613fce3ffb3e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:39.533373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ed0b6-e91a-435c-8cc3-613fce3ffb3e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:39.534665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ed0b6-e91a-435c-8cc3-613fce3ffb3e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:39.536492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ed0b6-e91a-435c-8cc3-613fce3ffb3e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:39.537995 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1996/3923] 10.222.0.43 () {58 vars in 1253 bytes} [Tue Jul 19 14:26:39 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:39.542702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda1ce1-b1a1-4cdd-8ff2-2cf31516cf40 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:39.555234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda1ce1-b1a1-4cdd-8ff2-2cf31516cf40 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:39.577220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b762d-6351-452b-8f24-82cc8597614f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:39.578053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b762d-6351-452b-8f24-82cc8597614f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:39.578376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b762d-6351-452b-8f24-82cc8597614f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:39.578917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679b762d-6351-452b-8f24-82cc8597614f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:39.579334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b762d-6351-452b-8f24-82cc8597614f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:39.580968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679b762d-6351-452b-8f24-82cc8597614f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:39.582300 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1928/3924] 10.222.0.43 () {58 vars in 1256 bytes} [Tue Jul 19 14:26:39 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 19 14:26:39.586293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ed0b6-e91a-435c-8cc3-613fce3ffb3e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:39.597897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ed0b6-e91a-435c-8cc3-613fce3ffb3e tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:39.609264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe86fe7-938b-45f4-a1ec-c1b1c13957d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:39.610703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe86fe7-938b-45f4-a1ec-c1b1c13957d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:39.612652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe86fe7-938b-45f4-a1ec-c1b1c13957d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:39.613285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe86fe7-938b-45f4-a1ec-c1b1c13957d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:39.618922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe86fe7-938b-45f4-a1ec-c1b1c13957d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:39.620932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe86fe7-938b-45f4-a1ec-c1b1c13957d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:39.623458 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1997/3925] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jul 19 14:26:39 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:39.628054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b762d-6351-452b-8f24-82cc8597614f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:39.646838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679b762d-6351-452b-8f24-82cc8597614f tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:39.657115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f57d43-1c4c-411c-93cc-01e79c069e4c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:39.657802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f57d43-1c4c-411c-93cc-01e79c069e4c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:39.658139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f57d43-1c4c-411c-93cc-01e79c069e4c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:39.658403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f57d43-1c4c-411c-93cc-01e79c069e4c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:39.659077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f57d43-1c4c-411c-93cc-01e79c069e4c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:39.660671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f57d43-1c4c-411c-93cc-01e79c069e4c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:39.661918 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1929/3926] 10.222.0.43 () {58 vars in 1256 bytes} [Tue Jul 19 14:26:39 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 19 14:26:39.666667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe86fe7-938b-45f4-a1ec-c1b1c13957d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:39.683093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe86fe7-938b-45f4-a1ec-c1b1c13957d3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:39.698961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061207c-03e9-426a-80ad-55ba3b869ef4 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:39.699917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061207c-03e9-426a-80ad-55ba3b869ef4 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:39.700254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061207c-03e9-426a-80ad-55ba3b869ef4 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:39.700618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061207c-03e9-426a-80ad-55ba3b869ef4 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:39.701370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061207c-03e9-426a-80ad-55ba3b869ef4 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:39.704475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061207c-03e9-426a-80ad-55ba3b869ef4 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:39.706903 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1998/3927] 10.222.0.43 () {58 vars in 1292 bytes} [Tue Jul 19 14:26:39 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 19 14:26:39.711397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f57d43-1c4c-411c-93cc-01e79c069e4c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:39.724866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f57d43-1c4c-411c-93cc-01e79c069e4c tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:39.746036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f83427-8bb3-4b9f-9564-9c460f0e5909 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:39.746866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f83427-8bb3-4b9f-9564-9c460f0e5909 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:39.747153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f83427-8bb3-4b9f-9564-9c460f0e5909 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:39.747435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f83427-8bb3-4b9f-9564-9c460f0e5909 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:39.748104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f83427-8bb3-4b9f-9564-9c460f0e5909 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:39.749708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f83427-8bb3-4b9f-9564-9c460f0e5909 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:39.750979 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1930/3928] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:26:39 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:39.755275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061207c-03e9-426a-80ad-55ba3b869ef4 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:39.782332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061207c-03e9-426a-80ad-55ba3b869ef4 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:39.788726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4175e-27a5-452d-81fd-864d3b7adba3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:39.789650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4175e-27a5-452d-81fd-864d3b7adba3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:39.789835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4175e-27a5-452d-81fd-864d3b7adba3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:39.790148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4175e-27a5-452d-81fd-864d3b7adba3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:39.790887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4175e-27a5-452d-81fd-864d3b7adba3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:39.795145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4175e-27a5-452d-81fd-864d3b7adba3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:39.796984 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 1999/3929] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:26:39 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:39.800591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f83427-8bb3-4b9f-9564-9c460f0e5909 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:39.816237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f83427-8bb3-4b9f-9564-9c460f0e5909 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:39.831003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e9973-44fc-40a3-b2a0-e8af48ef0824 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:39.831003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e9973-44fc-40a3-b2a0-e8af48ef0824 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:39.831003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e9973-44fc-40a3-b2a0-e8af48ef0824 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:39.831328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e9973-44fc-40a3-b2a0-e8af48ef0824 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:39.832106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e9973-44fc-40a3-b2a0-e8af48ef0824 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:39.833885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e9973-44fc-40a3-b2a0-e8af48ef0824 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:39.835749 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1931/3930] 10.222.0.43 () {58 vars in 1211 bytes} [Tue Jul 19 14:26:39 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:39.840612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4175e-27a5-452d-81fd-864d3b7adba3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:39.852758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4175e-27a5-452d-81fd-864d3b7adba3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:39.861557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b9efb-de95-49af-8978-759705d05edd tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:39.864160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b9efb-de95-49af-8978-759705d05edd tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:39.864160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b9efb-de95-49af-8978-759705d05edd tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:39.864160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b9efb-de95-49af-8978-759705d05edd tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:39.864160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b9efb-de95-49af-8978-759705d05edd tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:39.871380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b9efb-de95-49af-8978-759705d05edd tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:39.874044 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2000/3931] 10.222.0.43 () {58 vars in 1226 bytes} [Tue Jul 19 14:26:39 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:39.877740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e9973-44fc-40a3-b2a0-e8af48ef0824 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:39.910345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e9973-44fc-40a3-b2a0-e8af48ef0824 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:39.933296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37436777-6b17-4adf-ba5a-e004fdb750d2 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:39.934178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37436777-6b17-4adf-ba5a-e004fdb750d2 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:39.936281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37436777-6b17-4adf-ba5a-e004fdb750d2 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:39.939496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37436777-6b17-4adf-ba5a-e004fdb750d2 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:39.940413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37436777-6b17-4adf-ba5a-e004fdb750d2 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:39.943652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37436777-6b17-4adf-ba5a-e004fdb750d2 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:39.951790 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1932/3932] 10.222.0.43 () {58 vars in 1214 bytes} [Tue Jul 19 14:26:39 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:39.957147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b9efb-de95-49af-8978-759705d05edd tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:39.971351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b9efb-de95-49af-8978-759705d05edd tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:39.984493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7d7e5-ccd1-4265-9fa2-b93a4f6e6f26 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:39.985403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7d7e5-ccd1-4265-9fa2-b93a4f6e6f26 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:39.985827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7d7e5-ccd1-4265-9fa2-b93a4f6e6f26 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:39.986200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7d7e5-ccd1-4265-9fa2-b93a4f6e6f26 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:39.986967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7d7e5-ccd1-4265-9fa2-b93a4f6e6f26 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:39.988664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7d7e5-ccd1-4265-9fa2-b93a4f6e6f26 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:39.991221 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2001/3933] 10.222.0.43 () {58 vars in 1217 bytes} [Tue Jul 19 14:26:39 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 19 14:26:39.996168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37436777-6b17-4adf-ba5a-e004fdb750d2 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:40.014820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37436777-6b17-4adf-ba5a-e004fdb750d2 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:40.024175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4cada-4288-4549-93f9-4f9691716584 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:40.027070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4cada-4288-4549-93f9-4f9691716584 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:40.027549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4cada-4288-4549-93f9-4f9691716584 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:40.028014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df4cada-4288-4549-93f9-4f9691716584 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:40.029479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4cada-4288-4549-93f9-4f9691716584 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:40.031324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df4cada-4288-4549-93f9-4f9691716584 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:40.033805 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1933/3934] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:26:39 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:40.037670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7d7e5-ccd1-4265-9fa2-b93a4f6e6f26 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:40.052903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7d7e5-ccd1-4265-9fa2-b93a4f6e6f26 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:40.071633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e87cd-e888-45df-9e94-e94704dc04a1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:40.072808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e87cd-e888-45df-9e94-e94704dc04a1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:40.073448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e87cd-e888-45df-9e94-e94704dc04a1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:40.073448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e87cd-e888-45df-9e94-e94704dc04a1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:40.073945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e87cd-e888-45df-9e94-e94704dc04a1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:40.075751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e87cd-e888-45df-9e94-e94704dc04a1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:40.087469 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2002/3935] 10.222.0.43 () {58 vars in 1238 bytes} [Tue Jul 19 14:26:40 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:40.088991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4cada-4288-4549-93f9-4f9691716584 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:40.101991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df4cada-4288-4549-93f9-4f9691716584 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:40.109539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a380b-16a7-4c83-b3c6-1a86b64b215b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:40.110575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a380b-16a7-4c83-b3c6-1a86b64b215b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:40.110912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a380b-16a7-4c83-b3c6-1a86b64b215b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:40.111207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a380b-16a7-4c83-b3c6-1a86b64b215b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:40.112080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a380b-16a7-4c83-b3c6-1a86b64b215b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:40.113752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a380b-16a7-4c83-b3c6-1a86b64b215b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:40.115704 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1934/3936] 10.222.0.43 () {58 vars in 1259 bytes} [Tue Jul 19 14:26:40 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:40.121705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e87cd-e888-45df-9e94-e94704dc04a1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:40.160785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e87cd-e888-45df-9e94-e94704dc04a1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:40.193617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a380b-16a7-4c83-b3c6-1a86b64b215b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:40.195772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2f2a380b-16a7-4c83-b3c6-1a86b64b215b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:40.196644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99659c8b-d246-432e-82c0-3c4f0c573c3b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:40.202504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99659c8b-d246-432e-82c0-3c4f0c573c3b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:40.202504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99659c8b-d246-432e-82c0-3c4f0c573c3b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:40.202817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99659c8b-d246-432e-82c0-3c4f0c573c3b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:40.204518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99659c8b-d246-432e-82c0-3c4f0c573c3b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:40.208653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99659c8b-d246-432e-82c0-3c4f0c573c3b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:40.210691 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2003/3937] 10.222.0.43 () {58 vars in 1262 bytes} [Tue Jul 19 14:26:40 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:40.228785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99659c8b-d246-432e-82c0-3c4f0c573c3b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:40.270517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99659c8b-d246-432e-82c0-3c4f0c573c3b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:40.290308 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:40.294240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2fc3b-47c5-4310-8afd-3ac525944ad3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:40.295003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2fc3b-47c5-4310-8afd-3ac525944ad3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:40.295285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2fc3b-47c5-4310-8afd-3ac525944ad3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:40.295566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2fc3b-47c5-4310-8afd-3ac525944ad3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:40.296244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2fc3b-47c5-4310-8afd-3ac525944ad3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:40.297906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2fc3b-47c5-4310-8afd-3ac525944ad3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:40.301841 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2004/3938] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:26:40 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:40.309761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a380b-16a7-4c83-b3c6-1a86b64b215b tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:40.310957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2fc3b-47c5-4310-8afd-3ac525944ad3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:40.320197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c93c4f-00ac-41e4-be67-4b24eb42b956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:40.320521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c93c4f-00ac-41e4-be67-4b24eb42b956 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:40.320834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c93c4f-00ac-41e4-be67-4b24eb42b956 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:40.321109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c93c4f-00ac-41e4-be67-4b24eb42b956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:40.324351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-24c93c4f-00ac-41e4-be67-4b24eb42b956 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:40.346560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2fc3b-47c5-4310-8afd-3ac525944ad3 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:40.353930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c93c4f-00ac-41e4-be67-4b24eb42b956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:40.355224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c93c4f-00ac-41e4-be67-4b24eb42b956 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:40.371743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8b0dc-20bb-4f3c-9876-b95428b7d9c1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:40.372610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8b0dc-20bb-4f3c-9876-b95428b7d9c1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:40.372900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8b0dc-20bb-4f3c-9876-b95428b7d9c1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:40.373181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8b0dc-20bb-4f3c-9876-b95428b7d9c1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:40.374022 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1935/3939] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:26:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:26:40.384660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8b0dc-20bb-4f3c-9876-b95428b7d9c1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:40.384660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8b0dc-20bb-4f3c-9876-b95428b7d9c1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:40.387306 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2005/3940] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:26:40 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:40.388699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c93c4f-00ac-41e4-be67-4b24eb42b956 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:40.417759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c93c4f-00ac-41e4-be67-4b24eb42b956 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:40.432160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96073418-de68-4a67-8c43-76fafaab2bcb tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:40.434709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96073418-de68-4a67-8c43-76fafaab2bcb tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:40.435006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96073418-de68-4a67-8c43-76fafaab2bcb tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:40.435277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96073418-de68-4a67-8c43-76fafaab2bcb tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:40.446273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96073418-de68-4a67-8c43-76fafaab2bcb tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:40.446273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96073418-de68-4a67-8c43-76fafaab2bcb tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:40.446273 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1936/3941] 10.222.0.43 () {58 vars in 1277 bytes} [Tue Jul 19 14:26:40 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 14:26:40.452648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8b0dc-20bb-4f3c-9876-b95428b7d9c1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:40.492659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8b0dc-20bb-4f3c-9876-b95428b7d9c1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:40.518408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92eaf91-e7b5-4eb9-b18f-04a487a3a773 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:40.519829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92eaf91-e7b5-4eb9-b18f-04a487a3a773 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:40.520332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92eaf91-e7b5-4eb9-b18f-04a487a3a773 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:40.520823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92eaf91-e7b5-4eb9-b18f-04a487a3a773 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/ae7f7b55733440d5842b405d25d9b90f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:40.533697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92eaf91-e7b5-4eb9-b18f-04a487a3a773 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 14:26:40.564929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-e92eaf91-e7b5-4eb9-b18f-04a487a3a773 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Could not find domain: ae7f7b55733440d5842b405d25d9b90f.: keystone.exception.DomainNotFound: Could not find domain: ae7f7b55733440d5842b405d25d9b90f. Jul 19 14:26:40.564929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:26:40.564929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 14:26:40.564929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 14:26:40.564929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 14:26:40.564929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 14:26:40.564929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 14:26:40.564929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 14:26:40.564929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: ae7f7b55733440d5842b405d25d9b90f. Jul 19 14:26:40.564929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:26:40.564929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:26:40.564929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:26:40.564929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:26:40.564929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:26:40.564929 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:26:40.565973 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:26:40.565973 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:26:40.565973 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:26:40.565973 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:26:40.565973 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:26:40.565973 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:26:40.565973 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:26:40.565973 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:26:40.565973 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 14:26:40.565973 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 14:26:40.565973 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 14:26:40.565973 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 14:26:40.565973 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 14:26:40.565973 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 14:26:40.565973 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:26:40.565973 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:26:40.567055 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:26:40.567055 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:26:40.567055 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:26:40.567055 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:26:40.567055 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:26:40.567055 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 14:26:40.567055 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:26:40.567055 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:26:40.567055 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:26:40.567055 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:26:40.567055 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:26:40.567055 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:26:40.567055 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:26:40.567055 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:26:40.567055 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 14:26:40.567055 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 14:26:40.567055 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: ae7f7b55733440d5842b405d25d9b90f. Jul 19 14:26:40.569046 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:26:40.569208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96073418-de68-4a67-8c43-76fafaab2bcb tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:40.570043 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2006/3942] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:26:40 2022] PATCH /identity/v3/domains/ae7f7b55733440d5842b405d25d9b90f => generated 112 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:26:40.582667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96073418-de68-4a67-8c43-76fafaab2bcb tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:40.596092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf76a3-1407-4f6a-ae2b-41ad5eda288a tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:40.597199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf76a3-1407-4f6a-ae2b-41ad5eda288a tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:40.597505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf76a3-1407-4f6a-ae2b-41ad5eda288a tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:40.597787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf76a3-1407-4f6a-ae2b-41ad5eda288a tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/0b52552292d440a4816ba70583677494` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:40.622409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf76a3-1407-4f6a-ae2b-41ad5eda288a tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 14:26:40.654790 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-7edf76a3-1407-4f6a-ae2b-41ad5eda288a tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Could not find domain: 0b52552292d440a4816ba70583677494.: keystone.exception.DomainNotFound: Could not find domain: 0b52552292d440a4816ba70583677494. Jul 19 14:26:40.654790 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:26:40.654790 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 14:26:40.654790 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 14:26:40.654790 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 14:26:40.654790 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 14:26:40.654790 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 14:26:40.654790 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 14:26:40.654790 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0b52552292d440a4816ba70583677494. Jul 19 14:26:40.654790 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:26:40.654790 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:26:40.654790 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:26:40.654790 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:26:40.654790 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:26:40.654790 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:26:40.655916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:26:40.655916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:26:40.655916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:26:40.655916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:26:40.655916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:26:40.655916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:26:40.655916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:26:40.655916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:26:40.655916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 14:26:40.655916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 14:26:40.655916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 14:26:40.655916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 14:26:40.655916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 14:26:40.655916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 14:26:40.655916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:26:40.655916 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:26:40.656894 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:26:40.656894 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:26:40.656894 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:26:40.656894 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:26:40.656894 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:26:40.656894 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 14:26:40.656894 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:26:40.656894 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:26:40.656894 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:26:40.656894 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:26:40.656894 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:26:40.656894 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:26:40.656894 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:26:40.656894 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:26:40.656894 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 14:26:40.656894 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 14:26:40.656894 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 0b52552292d440a4816ba70583677494. Jul 19 14:26:40.657933 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:26:40.663110 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1937/3943] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:26:40 2022] PATCH /identity/v3/domains/0b52552292d440a4816ba70583677494 => generated 112 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:26:40.668607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92eaf91-e7b5-4eb9-b18f-04a487a3a773 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:40.699624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92eaf91-e7b5-4eb9-b18f-04a487a3a773 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:40.710922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d508607-725c-4dcb-8281-32f17599dfb1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7435398dd5094fcb99f4ebe87918c75b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5ec5dfedad624a2f8b5ed39e72180211', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:40.712042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d508607-725c-4dcb-8281-32f17599dfb1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:40.712329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d508607-725c-4dcb-8281-32f17599dfb1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:40.712608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d508607-725c-4dcb-8281-32f17599dfb1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] PATH_INFO: `/v3/domains/1e4caebf571d4344a73cd6517f6a9bba` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:40.717739 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:40.724414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d508607-725c-4dcb-8281-32f17599dfb1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 14:26:40.740814 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-7d508607-725c-4dcb-8281-32f17599dfb1 tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Could not find domain: 1e4caebf571d4344a73cd6517f6a9bba.: keystone.exception.DomainNotFound: Could not find domain: 1e4caebf571d4344a73cd6517f6a9bba. Jul 19 14:26:40.740814 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:26:40.740814 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 14:26:40.740814 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 14:26:40.740814 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 14:26:40.740814 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 14:26:40.740814 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 14:26:40.740814 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 14:26:40.740814 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1e4caebf571d4344a73cd6517f6a9bba. Jul 19 14:26:40.740814 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:26:40.740814 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:26:40.740814 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:26:40.740814 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:26:40.740814 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:26:40.740814 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:26:40.741817 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:26:40.741817 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:26:40.741817 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:26:40.741817 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:26:40.741817 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:26:40.741817 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:26:40.741817 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:26:40.741817 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:26:40.741817 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 14:26:40.741817 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 14:26:40.741817 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 14:26:40.741817 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 14:26:40.741817 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 14:26:40.741817 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 14:26:40.741817 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:26:40.741817 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:26:40.743158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:26:40.743158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:26:40.743158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:26:40.743158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:26:40.743158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:26:40.743158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 14:26:40.743158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:26:40.743158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:26:40.743158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:26:40.743158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:26:40.743158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:26:40.743158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:26:40.743158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:26:40.743158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:26:40.743158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 14:26:40.743158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 14:26:40.743158 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1e4caebf571d4344a73cd6517f6a9bba. Jul 19 14:26:40.745668 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:26:40.748873 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2007/3944] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:26:40 2022] PATCH /identity/v3/domains/1e4caebf571d4344a73cd6517f6a9bba => generated 112 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:26:40.755129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf76a3-1407-4f6a-ae2b-41ad5eda288a tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:40.755129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7edf76a3-1407-4f6a-ae2b-41ad5eda288a tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:40.999032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf76a3-1407-4f6a-ae2b-41ad5eda288a tempest-DomainConfigurationTestJSON-1489264414 tempest-DomainConfigurationTestJSON-1489264414-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:41.006067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126cf8c-afba-4f28-97cf-3b9fc36c8adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:41.006981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126cf8c-afba-4f28-97cf-3b9fc36c8adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:41.007529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126cf8c-afba-4f28-97cf-3b9fc36c8adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:41.007763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126cf8c-afba-4f28-97cf-3b9fc36c8adb admin admin] PATH_INFO: `/v3/users/443e8867bfd245489c013cc5f5fe3928` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:41.017549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126cf8c-afba-4f28-97cf-3b9fc36c8adb admin admin] RBAC: Authorizing `identity:delete_user(user_id=443e8867bfd245489c013cc5f5fe3928)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:41.017549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126cf8c-afba-4f28-97cf-3b9fc36c8adb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:41.237792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0126cf8c-afba-4f28-97cf-3b9fc36c8adb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '443e8867bfd245489c013cc5f5fe3928'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:41.276129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0126cf8c-afba-4f28-97cf-3b9fc36c8adb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '443e8867bfd245489c013cc5f5fe3928'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:41.283224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0126cf8c-afba-4f28-97cf-3b9fc36c8adb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '443e8867bfd245489c013cc5f5fe3928'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:41.283925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0126cf8c-afba-4f28-97cf-3b9fc36c8adb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '443e8867bfd245489c013cc5f5fe3928'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:41.294082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0126cf8c-afba-4f28-97cf-3b9fc36c8adb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '443e8867bfd245489c013cc5f5fe3928'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:41.384301 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1938/3945] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:26:40 2022] DELETE /identity/v3/users/443e8867bfd245489c013cc5f5fe3928 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:41.388525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06656ad3-483b-442e-a00c-087592caa663 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:41.389133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06656ad3-483b-442e-a00c-087592caa663 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:41.389620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06656ad3-483b-442e-a00c-087592caa663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:41.434917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-06656ad3-483b-442e-a00c-087592caa663 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:41.436208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-06656ad3-483b-442e-a00c-087592caa663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:41.565547 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2008/3946] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:41.576780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126cf8c-afba-4f28-97cf-3b9fc36c8adb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:41.578568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0126cf8c-afba-4f28-97cf-3b9fc36c8adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:41.661215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126cf8c-afba-4f28-97cf-3b9fc36c8adb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:41.665098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d30da-3f41-4819-8776-4b5b42c3f080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:41.665848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d30da-3f41-4819-8776-4b5b42c3f080 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:41.666193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d30da-3f41-4819-8776-4b5b42c3f080 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:41.666474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d30da-3f41-4819-8776-4b5b42c3f080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:41.675787 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:41.678305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d30da-3f41-4819-8776-4b5b42c3f080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:41.683991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d30da-3f41-4819-8776-4b5b42c3f080 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:41.701275 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1939/3947] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:26:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:26:42.792846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06656ad3-483b-442e-a00c-087592caa663 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:42.795058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-06656ad3-483b-442e-a00c-087592caa663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:42.812885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06656ad3-483b-442e-a00c-087592caa663 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:42.817910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0ae91-0af3-4514-a3ab-8523431b87dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:42.819066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0ae91-0af3-4514-a3ab-8523431b87dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:42.819550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0ae91-0af3-4514-a3ab-8523431b87dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:42.819989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f0ae91-0af3-4514-a3ab-8523431b87dc admin admin] PATH_INFO: `/v3/users/b3a68ad6956b4455a857df0d3ac76489` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:42.821298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0ae91-0af3-4514-a3ab-8523431b87dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3a68ad6956b4455a857df0d3ac76489)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:42.824390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f0ae91-0af3-4514-a3ab-8523431b87dc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:43.016648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d30da-3f41-4819-8776-4b5b42c3f080 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:43.018899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-474d30da-3f41-4819-8776-4b5b42c3f080 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:43.042205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d30da-3f41-4819-8776-4b5b42c3f080 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:43.047840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90832c80-7437-44a9-8d7c-21ca3ed0efbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:43.049005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90832c80-7437-44a9-8d7c-21ca3ed0efbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:43.049300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90832c80-7437-44a9-8d7c-21ca3ed0efbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:43.049583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90832c80-7437-44a9-8d7c-21ca3ed0efbb admin admin] PATH_INFO: `/v3/projects/c173e2c49b224ca7960a67bb86d2f86f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:43.051429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90832c80-7437-44a9-8d7c-21ca3ed0efbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=c173e2c49b224ca7960a67bb86d2f86f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:43.053788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90832c80-7437-44a9-8d7c-21ca3ed0efbb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:43.064666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a5f0ae91-0af3-4514-a3ab-8523431b87dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3a68ad6956b4455a857df0d3ac76489'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:43.093317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a5f0ae91-0af3-4514-a3ab-8523431b87dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3a68ad6956b4455a857df0d3ac76489'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:43.101544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a5f0ae91-0af3-4514-a3ab-8523431b87dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3a68ad6956b4455a857df0d3ac76489'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:43.102622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a5f0ae91-0af3-4514-a3ab-8523431b87dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3a68ad6956b4455a857df0d3ac76489'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:43.199759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-90832c80-7437-44a9-8d7c-21ca3ed0efbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c173e2c49b224ca7960a67bb86d2f86f', 'request_id': 'req-90832c80-7437-44a9-8d7c-21ca3ed0efbb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:43.200102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a5f0ae91-0af3-4514-a3ab-8523431b87dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3a68ad6956b4455a857df0d3ac76489'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:43.226181 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2009/3948] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:26:42 2022] DELETE /identity/v3/users/b3a68ad6956b4455a857df0d3ac76489 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:43.307790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-90832c80-7437-44a9-8d7c-21ca3ed0efbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c173e2c49b224ca7960a67bb86d2f86f', 'request_id': 'req-90832c80-7437-44a9-8d7c-21ca3ed0efbb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:43.316756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-90832c80-7437-44a9-8d7c-21ca3ed0efbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c173e2c49b224ca7960a67bb86d2f86f', 'request_id': 'req-90832c80-7437-44a9-8d7c-21ca3ed0efbb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:43.329296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-90832c80-7437-44a9-8d7c-21ca3ed0efbb admin admin] The token cache is being invalidate because project c173e2c49b224ca7960a67bb86d2f86f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:26:43.329644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-90832c80-7437-44a9-8d7c-21ca3ed0efbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:43.330528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-90832c80-7437-44a9-8d7c-21ca3ed0efbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:43.336490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0ae91-0af3-4514-a3ab-8523431b87dc admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:43.337341 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1940/3949] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:26:43 2022] DELETE /identity/v3/projects/c173e2c49b224ca7960a67bb86d2f86f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:43.338652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a5f0ae91-0af3-4514-a3ab-8523431b87dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:43.445892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f0ae91-0af3-4514-a3ab-8523431b87dc admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:43.454820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5066a1a6-9710-452d-9d15-f0ea4d3fa23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:43.456221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066a1a6-9710-452d-9d15-f0ea4d3fa23b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:43.456511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066a1a6-9710-452d-9d15-f0ea4d3fa23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:43.456791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5066a1a6-9710-452d-9d15-f0ea4d3fa23b admin admin] PATH_INFO: `/v3/users/7435398dd5094fcb99f4ebe87918c75b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:43.458606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066a1a6-9710-452d-9d15-f0ea4d3fa23b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7435398dd5094fcb99f4ebe87918c75b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:43.461633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5066a1a6-9710-452d-9d15-f0ea4d3fa23b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:43.491301 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:43.672445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5066a1a6-9710-452d-9d15-f0ea4d3fa23b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7435398dd5094fcb99f4ebe87918c75b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:43.695514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5066a1a6-9710-452d-9d15-f0ea4d3fa23b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7435398dd5094fcb99f4ebe87918c75b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:43.705553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5066a1a6-9710-452d-9d15-f0ea4d3fa23b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7435398dd5094fcb99f4ebe87918c75b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:43.710605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5066a1a6-9710-452d-9d15-f0ea4d3fa23b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7435398dd5094fcb99f4ebe87918c75b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:43.740956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90832c80-7437-44a9-8d7c-21ca3ed0efbb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:43.742433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-90832c80-7437-44a9-8d7c-21ca3ed0efbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:43.781561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5066a1a6-9710-452d-9d15-f0ea4d3fa23b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7435398dd5094fcb99f4ebe87918c75b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:43.788644 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2010/3950] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:26:43 2022] DELETE /identity/v3/users/7435398dd5094fcb99f4ebe87918c75b => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:43.876001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90832c80-7437-44a9-8d7c-21ca3ed0efbb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:43.895881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cc3a4-055b-4a00-a49a-5a186fc623e0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:43.896396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cc3a4-055b-4a00-a49a-5a186fc623e0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:43.896482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cc3a4-055b-4a00-a49a-5a186fc623e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:43.921695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d40cc3a4-055b-4a00-a49a-5a186fc623e0 None None] MFA Rules not processed for user `eee0949ddc584dcfb866960cbfb2ce43`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:43.924031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d40cc3a4-055b-4a00-a49a-5a186fc623e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:43.966207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef7b9f-cfc5-4077-b144-d2ec50d6b9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:43.967490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef7b9f-cfc5-4077-b144-d2ec50d6b9d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:43.968408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef7b9f-cfc5-4077-b144-d2ec50d6b9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:43.968907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef7b9f-cfc5-4077-b144-d2ec50d6b9d3 admin admin] PATH_INFO: `/v3/projects/d414f416e2de43748b63c4ca72bbb494` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:43.970610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef7b9f-cfc5-4077-b144-d2ec50d6b9d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d414f416e2de43748b63c4ca72bbb494)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:43.972810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ef7b9f-cfc5-4077-b144-d2ec50d6b9d3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:44.050872 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2011/3951] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:44.133250 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:44.166078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-82ef7b9f-cfc5-4077-b144-d2ec50d6b9d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd414f416e2de43748b63c4ca72bbb494', 'request_id': 'req-82ef7b9f-cfc5-4077-b144-d2ec50d6b9d3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:44.262397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-82ef7b9f-cfc5-4077-b144-d2ec50d6b9d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd414f416e2de43748b63c4ca72bbb494', 'request_id': 'req-82ef7b9f-cfc5-4077-b144-d2ec50d6b9d3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:44.270925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-82ef7b9f-cfc5-4077-b144-d2ec50d6b9d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd414f416e2de43748b63c4ca72bbb494', 'request_id': 'req-82ef7b9f-cfc5-4077-b144-d2ec50d6b9d3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:44.299133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-82ef7b9f-cfc5-4077-b144-d2ec50d6b9d3 admin admin] The token cache is being invalidate because project d414f416e2de43748b63c4ca72bbb494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:26:44.299440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-82ef7b9f-cfc5-4077-b144-d2ec50d6b9d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:44.301198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-82ef7b9f-cfc5-4077-b144-d2ec50d6b9d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:44.311929 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1941/3952] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:26:43 2022] DELETE /identity/v3/projects/d414f416e2de43748b63c4ca72bbb494 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:44.315859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cc3a4-055b-4a00-a49a-5a186fc623e0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:44.317786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d40cc3a4-055b-4a00-a49a-5a186fc623e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:44.348107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cc3a4-055b-4a00-a49a-5a186fc623e0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:44.411816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef7b9f-cfc5-4077-b144-d2ec50d6b9d3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:44.413266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-82ef7b9f-cfc5-4077-b144-d2ec50d6b9d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:44.478483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4193a64-6f7a-4443-8666-e5bff7c71234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:44.482811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4193a64-6f7a-4443-8666-e5bff7c71234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:44.483102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4193a64-6f7a-4443-8666-e5bff7c71234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:44.483638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4193a64-6f7a-4443-8666-e5bff7c71234 admin admin] PATH_INFO: `/v3/users/3f51c716f5ca4712b9de904ffbbe1bdd` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:44.487023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4193a64-6f7a-4443-8666-e5bff7c71234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f51c716f5ca4712b9de904ffbbe1bdd)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:44.488965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4193a64-6f7a-4443-8666-e5bff7c71234 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:44.540324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ef7b9f-cfc5-4077-b144-d2ec50d6b9d3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:44.553782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb67f7-668c-4756-a0ff-96c94f7c19ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:44.555340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb67f7-668c-4756-a0ff-96c94f7c19ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:44.555741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb67f7-668c-4756-a0ff-96c94f7c19ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:44.556154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb67f7-668c-4756-a0ff-96c94f7c19ce admin admin] PATH_INFO: `/v3/projects/5ec5dfedad624a2f8b5ed39e72180211` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:44.559410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb67f7-668c-4756-a0ff-96c94f7c19ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ec5dfedad624a2f8b5ed39e72180211)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:44.562603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb67f7-668c-4756-a0ff-96c94f7c19ce admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:44.667472 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:44.675795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e4193a64-6f7a-4443-8666-e5bff7c71234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f51c716f5ca4712b9de904ffbbe1bdd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:44.690622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e4193a64-6f7a-4443-8666-e5bff7c71234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f51c716f5ca4712b9de904ffbbe1bdd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:44.699871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e4193a64-6f7a-4443-8666-e5bff7c71234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f51c716f5ca4712b9de904ffbbe1bdd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:44.701527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e4193a64-6f7a-4443-8666-e5bff7c71234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f51c716f5ca4712b9de904ffbbe1bdd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:44.721345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2acb67f7-668c-4756-a0ff-96c94f7c19ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ec5dfedad624a2f8b5ed39e72180211', 'request_id': 'req-2acb67f7-668c-4756-a0ff-96c94f7c19ce'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:44.775606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e4193a64-6f7a-4443-8666-e5bff7c71234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f51c716f5ca4712b9de904ffbbe1bdd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:44.785018 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2012/3953] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:26:44 2022] DELETE /identity/v3/users/3f51c716f5ca4712b9de904ffbbe1bdd => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:44.832985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2acb67f7-668c-4756-a0ff-96c94f7c19ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ec5dfedad624a2f8b5ed39e72180211', 'request_id': 'req-2acb67f7-668c-4756-a0ff-96c94f7c19ce'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:44.840689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2acb67f7-668c-4756-a0ff-96c94f7c19ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ec5dfedad624a2f8b5ed39e72180211', 'request_id': 'req-2acb67f7-668c-4756-a0ff-96c94f7c19ce'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:44.854252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2acb67f7-668c-4756-a0ff-96c94f7c19ce admin admin] The token cache is being invalidate because project 5ec5dfedad624a2f8b5ed39e72180211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:26:44.854623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2acb67f7-668c-4756-a0ff-96c94f7c19ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:44.855509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2acb67f7-668c-4756-a0ff-96c94f7c19ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:44.857552 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1942/3954] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:26:44 2022] DELETE /identity/v3/projects/5ec5dfedad624a2f8b5ed39e72180211 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:26:44.862520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89355df-ec80-4bf5-adb1-0a0265654639 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:44.862816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89355df-ec80-4bf5-adb1-0a0265654639 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:44.863120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89355df-ec80-4bf5-adb1-0a0265654639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:44.893203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d89355df-ec80-4bf5-adb1-0a0265654639 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:44.895070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d89355df-ec80-4bf5-adb1-0a0265654639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:44.982145 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2013/3955] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:44.987452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ae22f-56cc-4239-8604-c60ebe8f3c54 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:44.987820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ae22f-56cc-4239-8604-c60ebe8f3c54 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:44.988039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ae22f-56cc-4239-8604-c60ebe8f3c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:45.010613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-db6ae22f-56cc-4239-8604-c60ebe8f3c54 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:45.011913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-db6ae22f-56cc-4239-8604-c60ebe8f3c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:45.037752 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1943/3956] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:26:45.039717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89355df-ec80-4bf5-adb1-0a0265654639 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:45.059498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89355df-ec80-4bf5-adb1-0a0265654639 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:45.066325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d168f-a7bc-4d85-b322-155f68484ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:45.067198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d168f-a7bc-4d85-b322-155f68484ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:45.067718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d168f-a7bc-4d85-b322-155f68484ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:45.068079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d168f-a7bc-4d85-b322-155f68484ec4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:45.069106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d168f-a7bc-4d85-b322-155f68484ec4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:26:45.069495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d168f-a7bc-4d85-b322-155f68484ec4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:45.072138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d168f-a7bc-4d85-b322-155f68484ec4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:45.098817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ae22f-56cc-4239-8604-c60ebe8f3c54 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:45.110879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ae22f-56cc-4239-8604-c60ebe8f3c54 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:45.112570 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2014/3957] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:26:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:45.145429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3980a7-68e5-4122-bd2a-8bff21e454d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:45.147971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3980a7-68e5-4122-bd2a-8bff21e454d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:45.148463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3980a7-68e5-4122-bd2a-8bff21e454d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:45.149038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3980a7-68e5-4122-bd2a-8bff21e454d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:45.155743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3980a7-68e5-4122-bd2a-8bff21e454d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:45.159523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3980a7-68e5-4122-bd2a-8bff21e454d6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:45.283558 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1944/3958] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:26:45 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:45.287417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d168f-a7bc-4d85-b322-155f68484ec4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:45.301753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d168f-a7bc-4d85-b322-155f68484ec4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:45.381163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10855a57-b0ae-4a06-818d-6c02d0c804c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:45.382308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10855a57-b0ae-4a06-818d-6c02d0c804c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:45.382838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10855a57-b0ae-4a06-818d-6c02d0c804c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:45.383358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10855a57-b0ae-4a06-818d-6c02d0c804c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:45.384291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10855a57-b0ae-4a06-818d-6c02d0c804c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:45.387095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10855a57-b0ae-4a06-818d-6c02d0c804c7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:45.486864 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2015/3959] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:26:45 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:45.492327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3980a7-68e5-4122-bd2a-8bff21e454d6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:45.506459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3980a7-68e5-4122-bd2a-8bff21e454d6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:45.516493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beeed11-59e9-41be-8749-679f45e9ba46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:45.519500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeed11-59e9-41be-8749-679f45e9ba46 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:45.520737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeed11-59e9-41be-8749-679f45e9ba46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:45.522981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beeed11-59e9-41be-8749-679f45e9ba46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:45.526319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beeed11-59e9-41be-8749-679f45e9ba46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:45.528946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beeed11-59e9-41be-8749-679f45e9ba46 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:45.545379 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1945/3960] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:26:45.549428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10855a57-b0ae-4a06-818d-6c02d0c804c7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:45.562425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10855a57-b0ae-4a06-818d-6c02d0c804c7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:45.568550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01cd19-8d18-4517-8df2-624be628af22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:45.579472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beeed11-59e9-41be-8749-679f45e9ba46 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:45.580970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01cd19-8d18-4517-8df2-624be628af22 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:45.582378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01cd19-8d18-4517-8df2-624be628af22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:45.582774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0beeed11-59e9-41be-8749-679f45e9ba46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:45.584070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b01cd19-8d18-4517-8df2-624be628af22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:45.587049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01cd19-8d18-4517-8df2-624be628af22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:45.590426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b01cd19-8d18-4517-8df2-624be628af22 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:45.601673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beeed11-59e9-41be-8749-679f45e9ba46 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:45.607810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b886a6-58cf-4403-af05-952a65a1486d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:45.609311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b886a6-58cf-4403-af05-952a65a1486d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:45.609755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b886a6-58cf-4403-af05-952a65a1486d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:45.610219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b886a6-58cf-4403-af05-952a65a1486d admin admin] PATH_INFO: `/v3/projects/604c073337934c7b9a6aa984424b5ea4` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:45.613215 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2016/3961] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:26:45.616374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b886a6-58cf-4403-af05-952a65a1486d admin admin] RBAC: Authorizing `identity:delete_project(project_id=604c073337934c7b9a6aa984424b5ea4)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:45.617514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01cd19-8d18-4517-8df2-624be628af22 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:45.621261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b886a6-58cf-4403-af05-952a65a1486d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:45.623459 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:45.633699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b01cd19-8d18-4517-8df2-624be628af22 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:45.639339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f360e05-1402-4e08-90a2-312e25d1cff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:45.641052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f360e05-1402-4e08-90a2-312e25d1cff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:45.641503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f360e05-1402-4e08-90a2-312e25d1cff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:45.641941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f360e05-1402-4e08-90a2-312e25d1cff6 admin admin] PATH_INFO: `/v3/projects/13782762ae174ba082aa2049b6d4d7e5/users/f70c6d9721c8413db62996aa30d1babd/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:45.714967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f360e05-1402-4e08-90a2-312e25d1cff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13782762ae174ba082aa2049b6d4d7e5, user_id=f70c6d9721c8413db62996aa30d1babd, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:45.717804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f360e05-1402-4e08-90a2-312e25d1cff6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:45.772025 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:45.779072 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2017/3962] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:26:45 2022] PUT /identity/v3/projects/13782762ae174ba082aa2049b6d4d7e5/users/f70c6d9721c8413db62996aa30d1babd/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:45.780037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f360e05-1402-4e08-90a2-312e25d1cff6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:45.790222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0f360e05-1402-4e08-90a2-312e25d1cff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:45.805381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-54b886a6-58cf-4403-af05-952a65a1486d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '604c073337934c7b9a6aa984424b5ea4', 'request_id': 'req-54b886a6-58cf-4403-af05-952a65a1486d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:45.878328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-54b886a6-58cf-4403-af05-952a65a1486d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '604c073337934c7b9a6aa984424b5ea4', 'request_id': 'req-54b886a6-58cf-4403-af05-952a65a1486d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:45.886246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-54b886a6-58cf-4403-af05-952a65a1486d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '604c073337934c7b9a6aa984424b5ea4', 'request_id': 'req-54b886a6-58cf-4403-af05-952a65a1486d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:45.912604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-54b886a6-58cf-4403-af05-952a65a1486d admin admin] The token cache is being invalidate because project 604c073337934c7b9a6aa984424b5ea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:26:45.912905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-54b886a6-58cf-4403-af05-952a65a1486d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:45.913205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f360e05-1402-4e08-90a2-312e25d1cff6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:45.913608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-54b886a6-58cf-4403-af05-952a65a1486d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:45.915787 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1946/3963] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:26:45 2022] DELETE /identity/v3/projects/604c073337934c7b9a6aa984424b5ea4 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:26:45.917956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb8896-bc88-4dfb-a989-01fd781ee786 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:45.918280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb8896-bc88-4dfb-a989-01fd781ee786 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:45.918585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb8896-bc88-4dfb-a989-01fd781ee786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:45.968379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-18bb8896-bc88-4dfb-a989-01fd781ee786 None None] MFA Rules not processed for user `f70c6d9721c8413db62996aa30d1babd`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:45.969820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-18bb8896-bc88-4dfb-a989-01fd781ee786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:46.031877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b7f73-ca23-4d9c-b7a9-e9062574b745 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:46.031877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b7f73-ca23-4d9c-b7a9-e9062574b745 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:46.031877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b7f73-ca23-4d9c-b7a9-e9062574b745 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:46.031877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b7f73-ca23-4d9c-b7a9-e9062574b745 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:46.032711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ad5b7f73-ca23-4d9c-b7a9-e9062574b745 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:46.049957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b7f73-ca23-4d9c-b7a9-e9062574b745 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:46.051935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b7f73-ca23-4d9c-b7a9-e9062574b745 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:46.069927 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1947/3964] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:46.069927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b2d70-8800-4ba6-bab5-668d45f50033 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:46.069927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b2d70-8800-4ba6-bab5-668d45f50033 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:46.069927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1b2d70-8800-4ba6-bab5-668d45f50033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:46.087479 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2018/3965] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:26:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:26:46.089226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b7f73-ca23-4d9c-b7a9-e9062574b745 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:46.095078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ad5b7f73-ca23-4d9c-b7a9-e9062574b745 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:46.104720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0f1b2d70-8800-4ba6-bab5-668d45f50033 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:46.106567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0f1b2d70-8800-4ba6-bab5-668d45f50033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:46.262976 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1948/3966] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:46.272760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b7f73-ca23-4d9c-b7a9-e9062574b745 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:46.277252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d51b86-e85e-47e2-b24b-04998a317e6e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:46.278778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d51b86-e85e-47e2-b24b-04998a317e6e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:46.289305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d51b86-e85e-47e2-b24b-04998a317e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:46.300447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43ff25-2490-449c-b747-e7a2581675db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:46.301134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43ff25-2490-449c-b747-e7a2581675db admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:46.301792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43ff25-2490-449c-b747-e7a2581675db admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:46.302130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43ff25-2490-449c-b747-e7a2581675db admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:46.302815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43ff25-2490-449c-b747-e7a2581675db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:46.305364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43ff25-2490-449c-b747-e7a2581675db admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:46.311809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f2d51b86-e85e-47e2-b24b-04998a317e6e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:46.313315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f2d51b86-e85e-47e2-b24b-04998a317e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:46.331038 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1949/3967] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:46.332660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d51b86-e85e-47e2-b24b-04998a317e6e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:46.350329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d51b86-e85e-47e2-b24b-04998a317e6e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:46.356131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927cca5-44db-489d-ab14-9642efddd9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:46.357089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927cca5-44db-489d-ab14-9642efddd9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:46.357571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927cca5-44db-489d-ab14-9642efddd9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:46.358068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9927cca5-44db-489d-ab14-9642efddd9e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:46.359317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927cca5-44db-489d-ab14-9642efddd9e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:26:46.359896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927cca5-44db-489d-ab14-9642efddd9e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:46.361835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9927cca5-44db-489d-ab14-9642efddd9e5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:46.378734 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1950/3968] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:26:46.381209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927cca5-44db-489d-ab14-9642efddd9e5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:46.391538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9927cca5-44db-489d-ab14-9642efddd9e5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:46.396267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d3a1b-db1d-4613-b13e-938f283d6bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:46.397023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d3a1b-db1d-4613-b13e-938f283d6bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:46.397435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d3a1b-db1d-4613-b13e-938f283d6bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:46.397724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423d3a1b-db1d-4613-b13e-938f283d6bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:46.398789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d3a1b-db1d-4613-b13e-938f283d6bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:46.400779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423d3a1b-db1d-4613-b13e-938f283d6bb0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:46.460622 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2019/3969] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:26:46 2022] POST /identity/v3/projects => generated 373 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:46.465567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43ff25-2490-449c-b747-e7a2581675db admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:46.509042 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1951/3970] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:26:46 2022] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:46.514555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d3a1b-db1d-4613-b13e-938f283d6bb0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:46.549709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43ff25-2490-449c-b747-e7a2581675db admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:46.617080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2739a-c3ac-405c-8e17-3306df2fc0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:46.618047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2739a-c3ac-405c-8e17-3306df2fc0de admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:46.618577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2739a-c3ac-405c-8e17-3306df2fc0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:46.619235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2739a-c3ac-405c-8e17-3306df2fc0de admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:46.620243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a2739a-c3ac-405c-8e17-3306df2fc0de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:46.622498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a2739a-c3ac-405c-8e17-3306df2fc0de admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:46.632663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423d3a1b-db1d-4613-b13e-938f283d6bb0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:46.640272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6c316-2f86-4343-a07a-de13c15797a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:46.641436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6c316-2f86-4343-a07a-de13c15797a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:46.641821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6c316-2f86-4343-a07a-de13c15797a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:46.642316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6c316-2f86-4343-a07a-de13c15797a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:46.643301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6c316-2f86-4343-a07a-de13c15797a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:46.645414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6c316-2f86-4343-a07a-de13c15797a8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:46.713528 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2020/3971] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:26:46 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:46.717636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2739a-c3ac-405c-8e17-3306df2fc0de admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:46.727835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2739a-c3ac-405c-8e17-3306df2fc0de admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:46.733789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb7402-5f21-4d12-85df-8dc756b6de7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:46.734593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb7402-5f21-4d12-85df-8dc756b6de7c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:46.734950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb7402-5f21-4d12-85df-8dc756b6de7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:46.735427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb7402-5f21-4d12-85df-8dc756b6de7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:46.736558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb7402-5f21-4d12-85df-8dc756b6de7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:46.737801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb7402-5f21-4d12-85df-8dc756b6de7c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:46.749662 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1952/3972] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:26:46 2022] POST /identity/v3/users => generated 288 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:26:46.753399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6c316-2f86-4343-a07a-de13c15797a8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:46.756115 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2021/3973] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:26:46.757137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb7402-5f21-4d12-85df-8dc756b6de7c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:46.767524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb7402-5f21-4d12-85df-8dc756b6de7c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:46.772804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c19926-995b-42db-8fea-30d5ab2118c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:46.773783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c19926-995b-42db-8fea-30d5ab2118c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:46.774174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c19926-995b-42db-8fea-30d5ab2118c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:46.774535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c19926-995b-42db-8fea-30d5ab2118c0 admin admin] PATH_INFO: `/v3/projects/327efe749c7947b99ede86bf8b45e13c/users/3ca7cc6b34394f5da8311c2ae74ce159/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:46.783050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6c316-2f86-4343-a07a-de13c15797a8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:46.791682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c19926-995b-42db-8fea-30d5ab2118c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=327efe749c7947b99ede86bf8b45e13c, user_id=3ca7cc6b34394f5da8311c2ae74ce159, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:46.795294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b149a-7b0b-4048-af34-039f05b3fb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:46.795503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c19926-995b-42db-8fea-30d5ab2118c0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:46.795989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b149a-7b0b-4048-af34-039f05b3fb17 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:46.797470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b149a-7b0b-4048-af34-039f05b3fb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:46.797761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b149a-7b0b-4048-af34-039f05b3fb17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:46.798551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b149a-7b0b-4048-af34-039f05b3fb17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:46.800485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b149a-7b0b-4048-af34-039f05b3fb17 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:46.805127 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:46.815714 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1953/3974] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:26:46.819658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b149a-7b0b-4048-af34-039f05b3fb17 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:46.831529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b149a-7b0b-4048-af34-039f05b3fb17 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:46.836670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ac541-d07a-4d68-93b6-d8c2c2c1fde1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:46.837375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ac541-d07a-4d68-93b6-d8c2c2c1fde1 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:46.837680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ac541-d07a-4d68-93b6-d8c2c2c1fde1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:46.838215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ac541-d07a-4d68-93b6-d8c2c2c1fde1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:46.842327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ac541-d07a-4d68-93b6-d8c2c2c1fde1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:46.842327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ac541-d07a-4d68-93b6-d8c2c2c1fde1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:46.855374 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1954/3975] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:26:46.859455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ac541-d07a-4d68-93b6-d8c2c2c1fde1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:46.871792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ac541-d07a-4d68-93b6-d8c2c2c1fde1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:46.877839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5183d85-da56-45dd-b53b-813647cbfc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:46.878895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5183d85-da56-45dd-b53b-813647cbfc6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:46.879188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5183d85-da56-45dd-b53b-813647cbfc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:46.879468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5183d85-da56-45dd-b53b-813647cbfc6a admin admin] PATH_INFO: `/v3/projects/0e298c9977714fd2a7191eaa04038933/users/bfba896c72964388b328edeb9af61880/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:46.899047 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2022/3976] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:26:46 2022] PUT /identity/v3/projects/327efe749c7947b99ede86bf8b45e13c/users/3ca7cc6b34394f5da8311c2ae74ce159/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:46.899741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5183d85-da56-45dd-b53b-813647cbfc6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e298c9977714fd2a7191eaa04038933, user_id=bfba896c72964388b328edeb9af61880, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:46.903474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5183d85-da56-45dd-b53b-813647cbfc6a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:46.903770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c19926-995b-42db-8fea-30d5ab2118c0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:46.981772 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1955/3977] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:26:46 2022] PUT /identity/v3/projects/0e298c9977714fd2a7191eaa04038933/users/bfba896c72964388b328edeb9af61880/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:46.985456 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:46.986874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460606e0-73f8-4234-93f3-35e8be666325 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:46.987391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460606e0-73f8-4234-93f3-35e8be666325 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:46.987917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460606e0-73f8-4234-93f3-35e8be666325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:47.017978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c19926-995b-42db-8fea-30d5ab2118c0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:47.029990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-460606e0-73f8-4234-93f3-35e8be666325 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:47.032300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-460606e0-73f8-4234-93f3-35e8be666325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:47.101948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559cd9a-6bda-46fb-8df2-b0d4a60af0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:47.102906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559cd9a-6bda-46fb-8df2-b0d4a60af0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:47.103621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559cd9a-6bda-46fb-8df2-b0d4a60af0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:47.104209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559cd9a-6bda-46fb-8df2-b0d4a60af0b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:47.105094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559cd9a-6bda-46fb-8df2-b0d4a60af0b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:47.107112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9559cd9a-6bda-46fb-8df2-b0d4a60af0b7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:47.122737 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2023/3978] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:26:47.126808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559cd9a-6bda-46fb-8df2-b0d4a60af0b7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:47.146023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9559cd9a-6bda-46fb-8df2-b0d4a60af0b7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:47.159857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942eb31-a2ba-4d90-a2e7-dc3dc11f17e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:47.174312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942eb31-a2ba-4d90-a2e7-dc3dc11f17e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:47.174312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942eb31-a2ba-4d90-a2e7-dc3dc11f17e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:47.174312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942eb31-a2ba-4d90-a2e7-dc3dc11f17e6 admin admin] PATH_INFO: `/v3/projects/327efe749c7947b99ede86bf8b45e13c/users/3ca7cc6b34394f5da8311c2ae74ce159/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:47.174888 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1956/3979] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:47.175019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942eb31-a2ba-4d90-a2e7-dc3dc11f17e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=327efe749c7947b99ede86bf8b45e13c, user_id=3ca7cc6b34394f5da8311c2ae74ce159, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:47.175019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942eb31-a2ba-4d90-a2e7-dc3dc11f17e6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:47.183509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460606e0-73f8-4234-93f3-35e8be666325 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:47.184062 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2024/3980] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:26:47 2022] PUT /identity/v3/projects/327efe749c7947b99ede86bf8b45e13c/users/3ca7cc6b34394f5da8311c2ae74ce159/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:26:47.190334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-460606e0-73f8-4234-93f3-35e8be666325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:47.195219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614bdeb-5bf8-44ec-b486-1497e466f383 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:47.196284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614bdeb-5bf8-44ec-b486-1497e466f383 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:47.198222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614bdeb-5bf8-44ec-b486-1497e466f383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:47.241711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4614bdeb-5bf8-44ec-b486-1497e466f383 None None] MFA Rules not processed for user `3ca7cc6b34394f5da8311c2ae74ce159`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:47.242936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4614bdeb-5bf8-44ec-b486-1497e466f383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:47.270929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460606e0-73f8-4234-93f3-35e8be666325 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:47.348322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ed93c-ae6f-4ced-8d3c-17e38b478c22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:47.350569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ed93c-ae6f-4ced-8d3c-17e38b478c22 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:47.350569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ed93c-ae6f-4ced-8d3c-17e38b478c22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:47.350569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ed93c-ae6f-4ced-8d3c-17e38b478c22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:47.399038 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2025/3981] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:47 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:47.403738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614bdeb-5bf8-44ec-b486-1497e466f383 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:47.437743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614bdeb-5bf8-44ec-b486-1497e466f383 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:47.446622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bb353-3ec2-479f-a6f2-6b320aaca99d tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ca7cc6b34394f5da8311c2ae74ce159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327efe749c7947b99ede86bf8b45e13c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:47.448048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bb353-3ec2-479f-a6f2-6b320aaca99d tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:47.448477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bb353-3ec2-479f-a6f2-6b320aaca99d tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:47.448621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0bb353-3ec2-479f-a6f2-6b320aaca99d tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:47.450293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bb353-3ec2-479f-a6f2-6b320aaca99d tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:47.451734 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-dd0bb353-3ec2-479f-a6f2-6b320aaca99d tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:47.451734 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:26:47.451734 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:26:47.452653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0bb353-3ec2-479f-a6f2-6b320aaca99d tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:47.487175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ed93c-ae6f-4ced-8d3c-17e38b478c22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:47.488793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ed93c-ae6f-4ced-8d3c-17e38b478c22 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:47.511062 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1957/3982] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:26:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:26:47.569661 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2026/3983] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:26:47 2022] POST /identity/v3/services => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:47.570583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ed93c-ae6f-4ced-8d3c-17e38b478c22 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:47.583402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ed93c-ae6f-4ced-8d3c-17e38b478c22 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:47.601532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9933a7-8c82-4d81-b200-56eabb385d8e tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ca7cc6b34394f5da8311c2ae74ce159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327efe749c7947b99ede86bf8b45e13c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:47.616789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9933a7-8c82-4d81-b200-56eabb385d8e tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:47.616789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9933a7-8c82-4d81-b200-56eabb385d8e tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:47.616789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9933a7-8c82-4d81-b200-56eabb385d8e tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:47.616789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9933a7-8c82-4d81-b200-56eabb385d8e tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:47.617315 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-7b9933a7-8c82-4d81-b200-56eabb385d8e tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:47.617315 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:26:47.617315 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:26:47.617315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9933a7-8c82-4d81-b200-56eabb385d8e tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:47.669304 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:47.700035 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1958/3984] 10.222.0.43 () {60 vars in 1212 bytes} [Tue Jul 19 14:26:47 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:47.710193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bb353-3ec2-479f-a6f2-6b320aaca99d tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:47.725718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0bb353-3ec2-479f-a6f2-6b320aaca99d tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:47.731374 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:47.734238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aea317-4893-43da-8dfe-f6db6dc1c883 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ca7cc6b34394f5da8311c2ae74ce159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327efe749c7947b99ede86bf8b45e13c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:47.734948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aea317-4893-43da-8dfe-f6db6dc1c883 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:47.735244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aea317-4893-43da-8dfe-f6db6dc1c883 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:47.736001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aea317-4893-43da-8dfe-f6db6dc1c883 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:47.736559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aea317-4893-43da-8dfe-f6db6dc1c883 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:47.738442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aea317-4893-43da-8dfe-f6db6dc1c883 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:47.861297 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2027/3985] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:26:47 2022] POST /identity/v3/services => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:47.865911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9933a7-8c82-4d81-b200-56eabb385d8e tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:47.876248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9933a7-8c82-4d81-b200-56eabb385d8e tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:47.893973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadb623-d1e7-4e8e-a03f-9989f5a20fef tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ca7cc6b34394f5da8311c2ae74ce159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327efe749c7947b99ede86bf8b45e13c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:47.895580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadb623-d1e7-4e8e-a03f-9989f5a20fef tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:47.896037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadb623-d1e7-4e8e-a03f-9989f5a20fef tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:47.896496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadb623-d1e7-4e8e-a03f-9989f5a20fef tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:47.897394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fadb623-d1e7-4e8e-a03f-9989f5a20fef tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:47.899365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fadb623-d1e7-4e8e-a03f-9989f5a20fef tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:47.985598 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1959/3986] 10.222.0.43 () {60 vars in 1212 bytes} [Tue Jul 19 14:26:47 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:47.987050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aea317-4893-43da-8dfe-f6db6dc1c883 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:48.001847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aea317-4893-43da-8dfe-f6db6dc1c883 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:48.007343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cefe7-c01c-40c6-9f67-013a4817c99e tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ca7cc6b34394f5da8311c2ae74ce159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327efe749c7947b99ede86bf8b45e13c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:48.008009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cefe7-c01c-40c6-9f67-013a4817c99e tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:48.008464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cefe7-c01c-40c6-9f67-013a4817c99e tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:48.008817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2cefe7-c01c-40c6-9f67-013a4817c99e tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:48.010305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2cefe7-c01c-40c6-9f67-013a4817c99e tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:48.011396 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-fa2cefe7-c01c-40c6-9f67-013a4817c99e tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:48.011396 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:26:48.011396 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:26:48.013365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2cefe7-c01c-40c6-9f67-013a4817c99e tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:48.024010 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2028/3987] 10.222.0.43 () {58 vars in 1190 bytes} [Tue Jul 19 14:26:47 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 765 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:48.026373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadb623-d1e7-4e8e-a03f-9989f5a20fef tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:48.040389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadb623-d1e7-4e8e-a03f-9989f5a20fef tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:48.047073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb03c7-e507-49de-9b53-9fbd1d0e7aeb tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ca7cc6b34394f5da8311c2ae74ce159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327efe749c7947b99ede86bf8b45e13c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:48.048219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb03c7-e507-49de-9b53-9fbd1d0e7aeb tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:48.048506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb03c7-e507-49de-9b53-9fbd1d0e7aeb tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:48.049229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb03c7-e507-49de-9b53-9fbd1d0e7aeb tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/8fa0931b212b4377ba9d428a41538ab0` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:48.050416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb03c7-e507-49de-9b53-9fbd1d0e7aeb tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=8fa0931b212b4377ba9d428a41538ab0)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:48.051806 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-96bb03c7-e507-49de-9b53-9fbd1d0e7aeb tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:48.051806 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:26:48.051806 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:26:48.052717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bb03c7-e507-49de-9b53-9fbd1d0e7aeb tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:48.076889 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1960/3988] 10.222.0.43 () {58 vars in 1289 bytes} [Tue Jul 19 14:26:48 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/8fa0931b212b4377ba9d428a41538ab0 => generated 334 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:26:48.082784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cefe7-c01c-40c6-9f67-013a4817c99e tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:48.094224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2cefe7-c01c-40c6-9f67-013a4817c99e tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:48.101039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e5ef9-73ca-40c8-9be8-69f33e3011ab tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ca7cc6b34394f5da8311c2ae74ce159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327efe749c7947b99ede86bf8b45e13c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:48.102252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e5ef9-73ca-40c8-9be8-69f33e3011ab tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:48.102861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e5ef9-73ca-40c8-9be8-69f33e3011ab tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:48.103133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e5ef9-73ca-40c8-9be8-69f33e3011ab tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/8fa0931b212b4377ba9d428a41538ab0` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:48.104647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e5ef9-73ca-40c8-9be8-69f33e3011ab tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=8fa0931b212b4377ba9d428a41538ab0)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:48.105600 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-b53e5ef9-73ca-40c8-9be8-69f33e3011ab tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:48.105600 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:26:48.105600 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:26:48.107491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e5ef9-73ca-40c8-9be8-69f33e3011ab tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:48.124855 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2029/3989] 10.222.0.43 () {58 vars in 1290 bytes} [Tue Jul 19 14:26:48 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/8fa0931b212b4377ba9d428a41538ab0 => generated 0 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:48.125127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb03c7-e507-49de-9b53-9fbd1d0e7aeb tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:48.132545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb03c7-e507-49de-9b53-9fbd1d0e7aeb tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:48.139058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2d1e2-f0ef-4ad7-963b-5402ca62911b tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ca7cc6b34394f5da8311c2ae74ce159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327efe749c7947b99ede86bf8b45e13c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:48.140110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2d1e2-f0ef-4ad7-963b-5402ca62911b tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:48.140614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2d1e2-f0ef-4ad7-963b-5402ca62911b tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:48.141059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba2d1e2-f0ef-4ad7-963b-5402ca62911b tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/8fa0931b212b4377ba9d428a41538ab0` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:48.141910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2d1e2-f0ef-4ad7-963b-5402ca62911b tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=8fa0931b212b4377ba9d428a41538ab0)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:48.143201 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-0ba2d1e2-f0ef-4ad7-963b-5402ca62911b tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:48.143201 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:26:48.143201 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:26:48.144513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba2d1e2-f0ef-4ad7-963b-5402ca62911b tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:48.227814 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1961/3990] 10.222.0.43 () {58 vars in 1292 bytes} [Tue Jul 19 14:26:48 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/8fa0931b212b4377ba9d428a41538ab0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:48.232799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e5ef9-73ca-40c8-9be8-69f33e3011ab tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:48.250611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e5ef9-73ca-40c8-9be8-69f33e3011ab tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:48.271771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8e174-5bf7-4109-a5eb-36dca82f3e22 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ca7cc6b34394f5da8311c2ae74ce159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327efe749c7947b99ede86bf8b45e13c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:48.272694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8e174-5bf7-4109-a5eb-36dca82f3e22 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:48.272979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8e174-5bf7-4109-a5eb-36dca82f3e22 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:48.274234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb8e174-5bf7-4109-a5eb-36dca82f3e22 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:48.274234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8e174-5bf7-4109-a5eb-36dca82f3e22 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:48.276781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb8e174-5bf7-4109-a5eb-36dca82f3e22 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:48.290503 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2030/3991] 10.222.0.43 () {58 vars in 1190 bytes} [Tue Jul 19 14:26:48 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:48.294213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2d1e2-f0ef-4ad7-963b-5402ca62911b tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:48.306568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba2d1e2-f0ef-4ad7-963b-5402ca62911b tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:48.312276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f3814-7076-406e-84d4-f09b1b908f5f tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ca7cc6b34394f5da8311c2ae74ce159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327efe749c7947b99ede86bf8b45e13c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:48.313141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f3814-7076-406e-84d4-f09b1b908f5f tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:48.313430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f3814-7076-406e-84d4-f09b1b908f5f tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:48.313716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2f3814-7076-406e-84d4-f09b1b908f5f tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/8fa0931b212b4377ba9d428a41538ab0` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:48.314426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f3814-7076-406e-84d4-f09b1b908f5f tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=8fa0931b212b4377ba9d428a41538ab0)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:48.316748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2f3814-7076-406e-84d4-f09b1b908f5f tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:48.342011 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-5d2f3814-7076-406e-84d4-f09b1b908f5f tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Could not find Endpoint Group: 8fa0931b212b4377ba9d428a41538ab0.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 8fa0931b212b4377ba9d428a41538ab0. Jul 19 14:26:48.342011 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:26:48.342011 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:26:48.342011 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:26:48.342011 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:26:48.342011 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:26:48.342011 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:26:48.342011 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:26:48.342011 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:26:48.342011 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:26:48.342011 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:26:48.342011 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:26:48.342011 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Jul 19 14:26:48.342011 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Jul 19 14:26:48.343051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Jul 19 14:26:48.343051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Jul 19 14:26:48.343051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Jul 19 14:26:48.343051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Jul 19 14:26:48.343051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: 8fa0931b212b4377ba9d428a41538ab0. Jul 19 14:26:48.343051 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:26:48.346672 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1962/3992] 10.222.0.43 () {58 vars in 1292 bytes} [Tue Jul 19 14:26:48 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/8fa0931b212b4377ba9d428a41538ab0 => generated 120 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 19 14:26:48.347894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8e174-5bf7-4109-a5eb-36dca82f3e22 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:48.358961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb8e174-5bf7-4109-a5eb-36dca82f3e22 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:48.364961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6e196-5bfe-4316-9f2d-73938bf7fb8b tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ca7cc6b34394f5da8311c2ae74ce159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327efe749c7947b99ede86bf8b45e13c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:48.366055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6e196-5bfe-4316-9f2d-73938bf7fb8b tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:48.366835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6e196-5bfe-4316-9f2d-73938bf7fb8b tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:48.367288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6e196-5bfe-4316-9f2d-73938bf7fb8b tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] PATH_INFO: `/v3/services/6d516283269343a2bf3c4c18e8fe7585` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:48.368110 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6e196-5bfe-4316-9f2d-73938bf7fb8b tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6d516283269343a2bf3c4c18e8fe7585)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:48.369136 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-18f6e196-5bfe-4316-9f2d-73938bf7fb8b tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:48.369136 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:26:48.369136 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:26:48.370031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6e196-5bfe-4316-9f2d-73938bf7fb8b tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:48.470807 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2031/3993] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:26:48 2022] DELETE /identity/v3/services/6d516283269343a2bf3c4c18e8fe7585 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:48.472062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f3814-7076-406e-84d4-f09b1b908f5f tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:48.488386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2f3814-7076-406e-84d4-f09b1b908f5f tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:48.528034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70610412-3657-4c13-94ce-e0cf93db7e0a tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ca7cc6b34394f5da8311c2ae74ce159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327efe749c7947b99ede86bf8b45e13c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:48.528034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70610412-3657-4c13-94ce-e0cf93db7e0a tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:48.528034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70610412-3657-4c13-94ce-e0cf93db7e0a tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:48.528795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70610412-3657-4c13-94ce-e0cf93db7e0a tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:48.528795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70610412-3657-4c13-94ce-e0cf93db7e0a tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:48.530452 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-70610412-3657-4c13-94ce-e0cf93db7e0a tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:48.530452 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:26:48.530452 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:26:48.531604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70610412-3657-4c13-94ce-e0cf93db7e0a tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:48.655338 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:48.655338 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1963/3994] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:26:48 2022] POST /identity/v3/services => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:48.657940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6e196-5bfe-4316-9f2d-73938bf7fb8b tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:48.685957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6e196-5bfe-4316-9f2d-73938bf7fb8b tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:48.720778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76c7f0-8b50-4090-bfea-3973fd23ea28 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ca7cc6b34394f5da8311c2ae74ce159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327efe749c7947b99ede86bf8b45e13c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:48.721037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70610412-3657-4c13-94ce-e0cf93db7e0a tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:48.721666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76c7f0-8b50-4090-bfea-3973fd23ea28 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:48.721962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76c7f0-8b50-4090-bfea-3973fd23ea28 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:48.722283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76c7f0-8b50-4090-bfea-3973fd23ea28 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:48.723216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76c7f0-8b50-4090-bfea-3973fd23ea28 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:48.725767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-70610412-3657-4c13-94ce-e0cf93db7e0a tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:48.739975 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-cd76c7f0-8b50-4090-bfea-3973fd23ea28 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:48.739975 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:26:48.739975 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:26:48.743360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd76c7f0-8b50-4090-bfea-3973fd23ea28 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:48.746028 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:48.767342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70610412-3657-4c13-94ce-e0cf93db7e0a tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:48.772825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a8b4b-ec74-46a5-b1f9-2fa9adc52eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:48.773897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a8b4b-ec74-46a5-b1f9-2fa9adc52eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:48.774345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a8b4b-ec74-46a5-b1f9-2fa9adc52eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:48.774724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a8b4b-ec74-46a5-b1f9-2fa9adc52eec admin admin] PATH_INFO: `/v3/users/2cba8748b6144d58a6f0ee45b2319d27` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:48.776760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a8b4b-ec74-46a5-b1f9-2fa9adc52eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cba8748b6144d58a6f0ee45b2319d27)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:48.778915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a8b4b-ec74-46a5-b1f9-2fa9adc52eec admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:48.853575 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2032/3995] 10.222.0.43 () {60 vars in 1212 bytes} [Tue Jul 19 14:26:48 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:26:48.857585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76c7f0-8b50-4090-bfea-3973fd23ea28 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:48.870605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76c7f0-8b50-4090-bfea-3973fd23ea28 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:48.882115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc16b9-7b4f-413f-91f1-9ac34eafaa18 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ca7cc6b34394f5da8311c2ae74ce159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327efe749c7947b99ede86bf8b45e13c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:48.893315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc16b9-7b4f-413f-91f1-9ac34eafaa18 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:48.893315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc16b9-7b4f-413f-91f1-9ac34eafaa18 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:48.893315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc16b9-7b4f-413f-91f1-9ac34eafaa18 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:48.893315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc16b9-7b4f-413f-91f1-9ac34eafaa18 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:48.893315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc16b9-7b4f-413f-91f1-9ac34eafaa18 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:49.013121 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2033/3996] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:26:48 2022] POST /identity/v3/services => generated 289 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:49.020280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc16b9-7b4f-413f-91f1-9ac34eafaa18 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:49.040533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a77a8b4b-ec74-46a5-b1f9-2fa9adc52eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cba8748b6144d58a6f0ee45b2319d27'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:49.049965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc16b9-7b4f-413f-91f1-9ac34eafaa18 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:49.056488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb868e3a-f724-415d-8e22-9d0e2a930b37 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ca7cc6b34394f5da8311c2ae74ce159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327efe749c7947b99ede86bf8b45e13c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:49.057598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a77a8b4b-ec74-46a5-b1f9-2fa9adc52eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cba8748b6144d58a6f0ee45b2319d27'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:49.057949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb868e3a-f724-415d-8e22-9d0e2a930b37 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:49.058344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a77a8b4b-ec74-46a5-b1f9-2fa9adc52eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cba8748b6144d58a6f0ee45b2319d27'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:49.061943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb868e3a-f724-415d-8e22-9d0e2a930b37 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:49.061943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb868e3a-f724-415d-8e22-9d0e2a930b37 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/f728a9fae25d4409ba19fe656d875983` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:49.062192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a77a8b4b-ec74-46a5-b1f9-2fa9adc52eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cba8748b6144d58a6f0ee45b2319d27'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:49.062322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb868e3a-f724-415d-8e22-9d0e2a930b37 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=f728a9fae25d4409ba19fe656d875983)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:49.062322 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-bb868e3a-f724-415d-8e22-9d0e2a930b37 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:49.062322 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:26:49.062322 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:26:49.062823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb868e3a-f724-415d-8e22-9d0e2a930b37 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:49.073002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a77a8b4b-ec74-46a5-b1f9-2fa9adc52eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cba8748b6144d58a6f0ee45b2319d27'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:49.185721 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2034/3997] 10.222.0.43 () {60 vars in 1312 bytes} [Tue Jul 19 14:26:49 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/f728a9fae25d4409ba19fe656d875983 => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:49.187311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb868e3a-f724-415d-8e22-9d0e2a930b37 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:49.188177 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1964/3998] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:26:48 2022] DELETE /identity/v3/users/2cba8748b6144d58a6f0ee45b2319d27 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:49.190014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bb868e3a-f724-415d-8e22-9d0e2a930b37 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:49.205130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb868e3a-f724-415d-8e22-9d0e2a930b37 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:49.278408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd435d-4f3f-4ae7-87e3-11e6598461e1 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ca7cc6b34394f5da8311c2ae74ce159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327efe749c7947b99ede86bf8b45e13c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:49.279471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd435d-4f3f-4ae7-87e3-11e6598461e1 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:49.279755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd435d-4f3f-4ae7-87e3-11e6598461e1 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:49.280226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd435d-4f3f-4ae7-87e3-11e6598461e1 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] PATH_INFO: `/v3/services/4c78cbf0b9334943aa1271617a806879` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:49.280922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd435d-4f3f-4ae7-87e3-11e6598461e1 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4c78cbf0b9334943aa1271617a806879)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:49.282706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd435d-4f3f-4ae7-87e3-11e6598461e1 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:49.432465 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2035/3999] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:26:49 2022] DELETE /identity/v3/services/4c78cbf0b9334943aa1271617a806879 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:49.440608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a8b4b-ec74-46a5-b1f9-2fa9adc52eec admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:49.457135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a8b4b-ec74-46a5-b1f9-2fa9adc52eec admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:49.483649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65023f2a-4c03-44db-89f5-9971c157b982 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ca7cc6b34394f5da8311c2ae74ce159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327efe749c7947b99ede86bf8b45e13c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:49.484501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65023f2a-4c03-44db-89f5-9971c157b982 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:49.484983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65023f2a-4c03-44db-89f5-9971c157b982 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:49.485277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65023f2a-4c03-44db-89f5-9971c157b982 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/f728a9fae25d4409ba19fe656d875983` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:49.485959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65023f2a-4c03-44db-89f5-9971c157b982 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=f728a9fae25d4409ba19fe656d875983)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:49.487726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65023f2a-4c03-44db-89f5-9971c157b982 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:49.543069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd435d-4f3f-4ae7-87e3-11e6598461e1 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:49.545517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-70cd435d-4f3f-4ae7-87e3-11e6598461e1 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:49.645139 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1965/4000] 10.222.0.43 () {58 vars in 1292 bytes} [Tue Jul 19 14:26:49 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/f728a9fae25d4409ba19fe656d875983 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:49.649155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65023f2a-4c03-44db-89f5-9971c157b982 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:49.656732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd435d-4f3f-4ae7-87e3-11e6598461e1 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:49.663319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4d81e-bf68-48e6-bfd5-0a1ce1fa4916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:49.663602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65023f2a-4c03-44db-89f5-9971c157b982 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:49.664500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4d81e-bf68-48e6-bfd5-0a1ce1fa4916 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:49.665093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4d81e-bf68-48e6-bfd5-0a1ce1fa4916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:49.665346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4d81e-bf68-48e6-bfd5-0a1ce1fa4916 admin admin] PATH_INFO: `/v3/projects/f26164ae836a4b0282a67a6284ad534a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:49.667725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4d81e-bf68-48e6-bfd5-0a1ce1fa4916 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f26164ae836a4b0282a67a6284ad534a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:49.669648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c4d81e-bf68-48e6-bfd5-0a1ce1fa4916 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:49.678507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15470511-d183-4868-b032-ec2e03841886 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ca7cc6b34394f5da8311c2ae74ce159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327efe749c7947b99ede86bf8b45e13c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:49.679487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15470511-d183-4868-b032-ec2e03841886 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:49.679844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15470511-d183-4868-b032-ec2e03841886 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:49.680195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15470511-d183-4868-b032-ec2e03841886 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] PATH_INFO: `/v3/services/f96046854f114aa8b1e0b2c42fe5fa90` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:49.680934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15470511-d183-4868-b032-ec2e03841886 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorizing `identity:delete_service(service_id=f96046854f114aa8b1e0b2c42fe5fa90)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:49.682153 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-15470511-d183-4868-b032-ec2e03841886 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:49.682153 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:26:49.682153 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:26:49.691539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15470511-d183-4868-b032-ec2e03841886 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:49.788594 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:49.796224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77c4d81e-bf68-48e6-bfd5-0a1ce1fa4916 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f26164ae836a4b0282a67a6284ad534a', 'request_id': 'req-77c4d81e-bf68-48e6-bfd5-0a1ce1fa4916'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:49.807629 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1966/4001] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:26:49 2022] DELETE /identity/v3/services/f96046854f114aa8b1e0b2c42fe5fa90 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:26:49.813475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15470511-d183-4868-b032-ec2e03841886 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:49.814035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77c4d81e-bf68-48e6-bfd5-0a1ce1fa4916 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f26164ae836a4b0282a67a6284ad534a', 'request_id': 'req-77c4d81e-bf68-48e6-bfd5-0a1ce1fa4916'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:49.832798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77c4d81e-bf68-48e6-bfd5-0a1ce1fa4916 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f26164ae836a4b0282a67a6284ad534a', 'request_id': 'req-77c4d81e-bf68-48e6-bfd5-0a1ce1fa4916'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:49.864097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15470511-d183-4868-b032-ec2e03841886 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:49.910275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77c4d81e-bf68-48e6-bfd5-0a1ce1fa4916 admin admin] The token cache is being invalidate because project f26164ae836a4b0282a67a6284ad534a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:26:49.910646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77c4d81e-bf68-48e6-bfd5-0a1ce1fa4916 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:49.912174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77c4d81e-bf68-48e6-bfd5-0a1ce1fa4916 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:49.915634 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2036/4002] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:26:49 2022] DELETE /identity/v3/projects/f26164ae836a4b0282a67a6284ad534a => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:49.924333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79fc55-9789-49cc-bea6-d55722b7b695 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:49.924695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79fc55-9789-49cc-bea6-d55722b7b695 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:49.925765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79fc55-9789-49cc-bea6-d55722b7b695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:49.950405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8a79fc55-9789-49cc-bea6-d55722b7b695 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:49.952937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8a79fc55-9789-49cc-bea6-d55722b7b695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:49.958431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14374570-aa04-44c0-a4df-ce4733d8dc03 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ca7cc6b34394f5da8311c2ae74ce159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327efe749c7947b99ede86bf8b45e13c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:49.959582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14374570-aa04-44c0-a4df-ce4733d8dc03 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:49.960605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14374570-aa04-44c0-a4df-ce4733d8dc03 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:49.960605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14374570-aa04-44c0-a4df-ce4733d8dc03 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/c6a45cc1b5bc4f10aca6c53014e3a081` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:49.960605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14374570-aa04-44c0-a4df-ce4733d8dc03 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=c6a45cc1b5bc4f10aca6c53014e3a081)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:49.965442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14374570-aa04-44c0-a4df-ce4733d8dc03 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:50.049594 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2037/4003] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:49 2022] POST /identity/v3/auth/tokens => generated 3363 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:50.051481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83152a26-f25b-4c3e-886d-be525131c0fb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:50.051779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83152a26-f25b-4c3e-886d-be525131c0fb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:50.052060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83152a26-f25b-4c3e-886d-be525131c0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:50.055167 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1967/4004] 10.222.0.43 () {58 vars in 1292 bytes} [Tue Jul 19 14:26:49 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/c6a45cc1b5bc4f10aca6c53014e3a081 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:26:50.067099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14374570-aa04-44c0-a4df-ce4733d8dc03 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:50.071028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-14374570-aa04-44c0-a4df-ce4733d8dc03 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:50.092895 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:50.094596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-83152a26-f25b-4c3e-886d-be525131c0fb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:50.097779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-83152a26-f25b-4c3e-886d-be525131c0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:50.102328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14374570-aa04-44c0-a4df-ce4733d8dc03 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:50.111989 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2038/4005] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:50 2022] POST /identity/v3/auth/tokens => generated 3363 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:50.117907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83152a26-f25b-4c3e-886d-be525131c0fb None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:50.118257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67da5d8-fbdf-4b2c-ba79-75b837f319c1 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ca7cc6b34394f5da8311c2ae74ce159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '327efe749c7947b99ede86bf8b45e13c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:50.118694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67da5d8-fbdf-4b2c-ba79-75b837f319c1 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:50.119734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67da5d8-fbdf-4b2c-ba79-75b837f319c1 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:50.121004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67da5d8-fbdf-4b2c-ba79-75b837f319c1 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] PATH_INFO: `/v3/services/723516dba68b4f6eb98672001f6a445a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:50.121942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67da5d8-fbdf-4b2c-ba79-75b837f319c1 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorizing `identity:delete_service(service_id=723516dba68b4f6eb98672001f6a445a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:50.124313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67da5d8-fbdf-4b2c-ba79-75b837f319c1 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:50.141505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83152a26-f25b-4c3e-886d-be525131c0fb None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:50.147939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b3fe5-f888-4a27-a514-70c2982cc321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:50.149720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b3fe5-f888-4a27-a514-70c2982cc321 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:50.150294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b3fe5-f888-4a27-a514-70c2982cc321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:50.151487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0b3fe5-f888-4a27-a514-70c2982cc321 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:50.152484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b3fe5-f888-4a27-a514-70c2982cc321 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:26:50.152952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b3fe5-f888-4a27-a514-70c2982cc321 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:50.156085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0b3fe5-f888-4a27-a514-70c2982cc321 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:50.176422 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2039/4006] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:50.177565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b3fe5-f888-4a27-a514-70c2982cc321 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:50.192065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0b3fe5-f888-4a27-a514-70c2982cc321 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:50.198743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce03d3-f2c6-417f-a8d8-110c11a0c249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:50.199636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce03d3-f2c6-417f-a8d8-110c11a0c249 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:50.200078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce03d3-f2c6-417f-a8d8-110c11a0c249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:50.200508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce03d3-f2c6-417f-a8d8-110c11a0c249 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:50.201673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce03d3-f2c6-417f-a8d8-110c11a0c249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:50.203932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce03d3-f2c6-417f-a8d8-110c11a0c249 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:50.239934 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1968/4007] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:26:50 2022] DELETE /identity/v3/services/723516dba68b4f6eb98672001f6a445a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:26:50.243349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67da5d8-fbdf-4b2c-ba79-75b837f319c1 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:50.247128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b67da5d8-fbdf-4b2c-ba79-75b837f319c1 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:50.299086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67da5d8-fbdf-4b2c-ba79-75b837f319c1 tempest-EndPointGroupsTest-2000676856 tempest-EndPointGroupsTest-2000676856-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:50.307149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6d7c32-f111-42db-a10f-a2140525b829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:50.308313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d7c32-f111-42db-a10f-a2140525b829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:50.308643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d7c32-f111-42db-a10f-a2140525b829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:50.308932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6d7c32-f111-42db-a10f-a2140525b829 admin admin] PATH_INFO: `/v3/users/f70c6d9721c8413db62996aa30d1babd` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:50.310360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d7c32-f111-42db-a10f-a2140525b829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f70c6d9721c8413db62996aa30d1babd)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:50.314420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6d7c32-f111-42db-a10f-a2140525b829 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:50.331982 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2040/4008] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:26:50 2022] POST /identity/v3/projects => generated 379 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:50.336090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce03d3-f2c6-417f-a8d8-110c11a0c249 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:50.436229 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce03d3-f2c6-417f-a8d8-110c11a0c249 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:50.442019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32eb2ba-c09c-4ee6-b7b0-504803bbf9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:50.442937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32eb2ba-c09c-4ee6-b7b0-504803bbf9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:50.443192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32eb2ba-c09c-4ee6-b7b0-504803bbf9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:50.443553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32eb2ba-c09c-4ee6-b7b0-504803bbf9b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:50.444360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32eb2ba-c09c-4ee6-b7b0-504803bbf9b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:50.448305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32eb2ba-c09c-4ee6-b7b0-504803bbf9b5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:50.521570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3a6d7c32-f111-42db-a10f-a2140525b829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f70c6d9721c8413db62996aa30d1babd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:50.579683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3a6d7c32-f111-42db-a10f-a2140525b829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f70c6d9721c8413db62996aa30d1babd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:50.580501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3a6d7c32-f111-42db-a10f-a2140525b829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f70c6d9721c8413db62996aa30d1babd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:50.581132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3a6d7c32-f111-42db-a10f-a2140525b829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f70c6d9721c8413db62996aa30d1babd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:50.582074 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2041/4009] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:26:50 2022] POST /identity/v3/users => generated 290 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:26:50.586031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32eb2ba-c09c-4ee6-b7b0-504803bbf9b5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:50.596586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f32eb2ba-c09c-4ee6-b7b0-504803bbf9b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:50.598530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3a6d7c32-f111-42db-a10f-a2140525b829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f70c6d9721c8413db62996aa30d1babd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:50.620902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32eb2ba-c09c-4ee6-b7b0-504803bbf9b5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:50.622772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a347b-e7e3-4a59-832c-85a50177e1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:50.622772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a347b-e7e3-4a59-832c-85a50177e1db admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:50.622772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a347b-e7e3-4a59-832c-85a50177e1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:50.622772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a347b-e7e3-4a59-832c-85a50177e1db admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:50.623214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a347b-e7e3-4a59-832c-85a50177e1db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:50.624894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9a347b-e7e3-4a59-832c-85a50177e1db admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:50.644412 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2042/4010] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:26:50.645401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a347b-e7e3-4a59-832c-85a50177e1db admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:50.661808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9a347b-e7e3-4a59-832c-85a50177e1db admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:50.673626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf5b9b-bcb3-4fd6-9f47-3429750ec66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:50.674433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf5b9b-bcb3-4fd6-9f47-3429750ec66f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:50.674723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf5b9b-bcb3-4fd6-9f47-3429750ec66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:50.675003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf5b9b-bcb3-4fd6-9f47-3429750ec66f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:50.675992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf5b9b-bcb3-4fd6-9f47-3429750ec66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:50.678521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf5b9b-bcb3-4fd6-9f47-3429750ec66f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:50.694231 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2043/4011] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:26:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:26:50.698761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf5b9b-bcb3-4fd6-9f47-3429750ec66f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:50.712580 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1969/4012] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:26:50 2022] DELETE /identity/v3/users/f70c6d9721c8413db62996aa30d1babd => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:26:50.717400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d47a72-5d01-416d-9166-36de04b7bb5f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:50.717873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d47a72-5d01-416d-9166-36de04b7bb5f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:50.718357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d47a72-5d01-416d-9166-36de04b7bb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:50.722247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf5b9b-bcb3-4fd6-9f47-3429750ec66f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:50.751083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-46d47a72-5d01-416d-9166-36de04b7bb5f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:50.755248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-46d47a72-5d01-416d-9166-36de04b7bb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:50.893772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa6500-ff38-454a-b9da-68efc23e40e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:50.896294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa6500-ff38-454a-b9da-68efc23e40e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:50.898057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa6500-ff38-454a-b9da-68efc23e40e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:50.901466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa6500-ff38-454a-b9da-68efc23e40e6 admin admin] PATH_INFO: `/v3/projects/8826c62db018440db0f796a863d674c6/users/013b13b6d741411a95806dce36c2bd20/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:50.936251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa6500-ff38-454a-b9da-68efc23e40e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8826c62db018440db0f796a863d674c6, user_id=013b13b6d741411a95806dce36c2bd20, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:50.939891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa6500-ff38-454a-b9da-68efc23e40e6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:50.958224 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1970/4013] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:26:51.005103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d47a72-5d01-416d-9166-36de04b7bb5f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:51.006757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-46d47a72-5d01-416d-9166-36de04b7bb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:51.044047 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2044/4014] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:26:50 2022] PUT /identity/v3/projects/8826c62db018440db0f796a863d674c6/users/013b13b6d741411a95806dce36c2bd20/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:26:51.049045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336f5eb-3e16-499b-92b8-f8522aef17d2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:51.049549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336f5eb-3e16-499b-92b8-f8522aef17d2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:51.050500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336f5eb-3e16-499b-92b8-f8522aef17d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:51.123381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d336f5eb-3e16-499b-92b8-f8522aef17d2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:51.131657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d336f5eb-3e16-499b-92b8-f8522aef17d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:51.176863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d47a72-5d01-416d-9166-36de04b7bb5f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:51.249296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d6f2f-55a7-4ac9-9198-17e22166ad79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:51.250361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d6f2f-55a7-4ac9-9198-17e22166ad79 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:51.250961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d6f2f-55a7-4ac9-9198-17e22166ad79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:51.251883 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2045/4015] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:51.252685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d6f2f-55a7-4ac9-9198-17e22166ad79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:51.266885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d6f2f-55a7-4ac9-9198-17e22166ad79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:51.269021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d6f2f-55a7-4ac9-9198-17e22166ad79 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:51.273862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336f5eb-3e16-499b-92b8-f8522aef17d2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:51.277081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d336f5eb-3e16-499b-92b8-f8522aef17d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:51.283622 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1971/4016] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:26:51.298746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336f5eb-3e16-499b-92b8-f8522aef17d2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:51.302689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61a98c-a4cb-4685-9570-3e9f9e95efe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:51.303463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61a98c-a4cb-4685-9570-3e9f9e95efe1 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:51.303752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61a98c-a4cb-4685-9570-3e9f9e95efe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:51.304032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61a98c-a4cb-4685-9570-3e9f9e95efe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:51.328388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61a98c-a4cb-4685-9570-3e9f9e95efe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:51.328388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61a98c-a4cb-4685-9570-3e9f9e95efe1 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:51.343876 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2046/4017] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:26:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:26:51.359756 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:51.405171 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:52.687734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d6f2f-55a7-4ac9-9198-17e22166ad79 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:52.689420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b21d6f2f-55a7-4ac9-9198-17e22166ad79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:52.712658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d6f2f-55a7-4ac9-9198-17e22166ad79 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:52.743096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a57597-efb2-4de3-8213-d3aa2f517dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:52.747975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a57597-efb2-4de3-8213-d3aa2f517dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:52.748267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a57597-efb2-4de3-8213-d3aa2f517dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:52.751209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a57597-efb2-4de3-8213-d3aa2f517dc5 admin admin] PATH_INFO: `/v3/projects/13782762ae174ba082aa2049b6d4d7e5` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:52.759523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a57597-efb2-4de3-8213-d3aa2f517dc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13782762ae174ba082aa2049b6d4d7e5)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:52.763866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a57597-efb2-4de3-8213-d3aa2f517dc5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:52.950306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-22a57597-efb2-4de3-8213-d3aa2f517dc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13782762ae174ba082aa2049b6d4d7e5', 'request_id': 'req-22a57597-efb2-4de3-8213-d3aa2f517dc5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:53.012686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-22a57597-efb2-4de3-8213-d3aa2f517dc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13782762ae174ba082aa2049b6d4d7e5', 'request_id': 'req-22a57597-efb2-4de3-8213-d3aa2f517dc5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:53.022339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-22a57597-efb2-4de3-8213-d3aa2f517dc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13782762ae174ba082aa2049b6d4d7e5', 'request_id': 'req-22a57597-efb2-4de3-8213-d3aa2f517dc5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:53.043033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-22a57597-efb2-4de3-8213-d3aa2f517dc5 admin admin] The token cache is being invalidate because project 13782762ae174ba082aa2049b6d4d7e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:26:53.044887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-22a57597-efb2-4de3-8213-d3aa2f517dc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:53.045970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-22a57597-efb2-4de3-8213-d3aa2f517dc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:53.053951 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1972/4018] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:26:52 2022] DELETE /identity/v3/projects/13782762ae174ba082aa2049b6d4d7e5 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:53.057692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61a98c-a4cb-4685-9570-3e9f9e95efe1 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:53.069338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61a98c-a4cb-4685-9570-3e9f9e95efe1 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:53.138575 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:53.161702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154b186-be60-4006-bca4-e6cec91f36c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:53.162703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154b186-be60-4006-bca4-e6cec91f36c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:53.162993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154b186-be60-4006-bca4-e6cec91f36c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:53.163269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154b186-be60-4006-bca4-e6cec91f36c7 admin admin] PATH_INFO: `/v3/users/3ca7cc6b34394f5da8311c2ae74ce159` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:53.165295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154b186-be60-4006-bca4-e6cec91f36c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca7cc6b34394f5da8311c2ae74ce159)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:53.168679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154b186-be60-4006-bca4-e6cec91f36c7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:53.309082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a57597-efb2-4de3-8213-d3aa2f517dc5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:53.310932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-22a57597-efb2-4de3-8213-d3aa2f517dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:53.457323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a154b186-be60-4006-bca4-e6cec91f36c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca7cc6b34394f5da8311c2ae74ce159'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:53.478415 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:53.481556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a57597-efb2-4de3-8213-d3aa2f517dc5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:53.488815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88b65c-0148-4b25-8613-fdca7848d232 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:53.489556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88b65c-0148-4b25-8613-fdca7848d232 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:53.490181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88b65c-0148-4b25-8613-fdca7848d232 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:53.490515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88b65c-0148-4b25-8613-fdca7848d232 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:53.492925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4f88b65c-0148-4b25-8613-fdca7848d232 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:53.499734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a154b186-be60-4006-bca4-e6cec91f36c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca7cc6b34394f5da8311c2ae74ce159'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:53.509262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88b65c-0148-4b25-8613-fdca7848d232 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:53.511808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f88b65c-0148-4b25-8613-fdca7848d232 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:53.518247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a154b186-be60-4006-bca4-e6cec91f36c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca7cc6b34394f5da8311c2ae74ce159'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:53.519267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a154b186-be60-4006-bca4-e6cec91f36c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca7cc6b34394f5da8311c2ae74ce159'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:53.535407 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1973/4019] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:26:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:26:53.649864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a154b186-be60-4006-bca4-e6cec91f36c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca7cc6b34394f5da8311c2ae74ce159'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:53.652694 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2047/4020] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:26:53 2022] DELETE /identity/v3/users/3ca7cc6b34394f5da8311c2ae74ce159 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:54.876592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88b65c-0148-4b25-8613-fdca7848d232 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:54.878683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4f88b65c-0148-4b25-8613-fdca7848d232 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:54.899371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88b65c-0148-4b25-8613-fdca7848d232 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:55.006079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f28827-a879-4e1d-bea5-65f771c503a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:55.007959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f28827-a879-4e1d-bea5-65f771c503a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:55.011924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f28827-a879-4e1d-bea5-65f771c503a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:55.013597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f28827-a879-4e1d-bea5-65f771c503a2 admin admin] PATH_INFO: `/v3/projects/327efe749c7947b99ede86bf8b45e13c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:55.023064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f28827-a879-4e1d-bea5-65f771c503a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=327efe749c7947b99ede86bf8b45e13c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:55.027567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f28827-a879-4e1d-bea5-65f771c503a2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:55.249730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-94f28827-a879-4e1d-bea5-65f771c503a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '327efe749c7947b99ede86bf8b45e13c', 'request_id': 'req-94f28827-a879-4e1d-bea5-65f771c503a2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:55.335703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-94f28827-a879-4e1d-bea5-65f771c503a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '327efe749c7947b99ede86bf8b45e13c', 'request_id': 'req-94f28827-a879-4e1d-bea5-65f771c503a2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:55.343824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-94f28827-a879-4e1d-bea5-65f771c503a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '327efe749c7947b99ede86bf8b45e13c', 'request_id': 'req-94f28827-a879-4e1d-bea5-65f771c503a2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:55.359802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-94f28827-a879-4e1d-bea5-65f771c503a2 admin admin] The token cache is being invalidate because project 327efe749c7947b99ede86bf8b45e13c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:26:55.360088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-94f28827-a879-4e1d-bea5-65f771c503a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:55.360856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-94f28827-a879-4e1d-bea5-65f771c503a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:55.364270 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1974/4021] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:26:54 2022] DELETE /identity/v3/projects/327efe749c7947b99ede86bf8b45e13c => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:55.369587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d78614-f75a-4fda-8409-d84222e38764 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:55.370543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d78614-f75a-4fda-8409-d84222e38764 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:55.371008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d78614-f75a-4fda-8409-d84222e38764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:55.394463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-31d78614-f75a-4fda-8409-d84222e38764 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:55.411248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-31d78614-f75a-4fda-8409-d84222e38764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:55.524863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e87b01-70a5-437b-88a5-93402baadf4e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:55.525263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e87b01-70a5-437b-88a5-93402baadf4e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:55.526133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e87b01-70a5-437b-88a5-93402baadf4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:55.533466 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2048/4022] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:55.546706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b8e87b01-70a5-437b-88a5-93402baadf4e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:55.547636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b8e87b01-70a5-437b-88a5-93402baadf4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:55.561570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d78614-f75a-4fda-8409-d84222e38764 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:55.562381 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1975/4023] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:55.573613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d78614-f75a-4fda-8409-d84222e38764 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:55.583559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baad92-983b-4f66-b7c6-f80ef80eae23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:55.587131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baad92-983b-4f66-b7c6-f80ef80eae23 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:55.590423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baad92-983b-4f66-b7c6-f80ef80eae23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:55.590423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43baad92-983b-4f66-b7c6-f80ef80eae23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:55.590423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baad92-983b-4f66-b7c6-f80ef80eae23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:26:55.590423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baad92-983b-4f66-b7c6-f80ef80eae23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:55.591712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43baad92-983b-4f66-b7c6-f80ef80eae23 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:55.627712 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2049/4024] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:55.629500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e87b01-70a5-437b-88a5-93402baadf4e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:55.667849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e87b01-70a5-437b-88a5-93402baadf4e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:55.685119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819bd78-771f-4de0-a8fd-f6c3a24bd05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:55.685368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819bd78-771f-4de0-a8fd-f6c3a24bd05f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:55.685637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819bd78-771f-4de0-a8fd-f6c3a24bd05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:55.685916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819bd78-771f-4de0-a8fd-f6c3a24bd05f admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:55.693760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819bd78-771f-4de0-a8fd-f6c3a24bd05f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:55.693760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819bd78-771f-4de0-a8fd-f6c3a24bd05f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:55.835434 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1976/4025] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:26:55 2022] POST /identity/v3/projects => generated 369 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:55.840187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baad92-983b-4f66-b7c6-f80ef80eae23 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:55.855527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43baad92-983b-4f66-b7c6-f80ef80eae23 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:55.969296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1958ceb-58dc-4bd3-9869-1d92e773dd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:55.970004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1958ceb-58dc-4bd3-9869-1d92e773dd4b admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:55.970343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1958ceb-58dc-4bd3-9869-1d92e773dd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:55.970675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1958ceb-58dc-4bd3-9869-1d92e773dd4b admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:55.972178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1958ceb-58dc-4bd3-9869-1d92e773dd4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:55.974376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1958ceb-58dc-4bd3-9869-1d92e773dd4b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:55.984720 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:56.075882 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2050/4026] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:26:55 2022] POST /identity/v3/users => generated 285 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:56.081485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819bd78-771f-4de0-a8fd-f6c3a24bd05f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:56.097055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819bd78-771f-4de0-a8fd-f6c3a24bd05f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:56.104350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58e0ab-ae3a-426c-861c-4c21f20e2485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:56.105336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58e0ab-ae3a-426c-861c-4c21f20e2485 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:56.105981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58e0ab-ae3a-426c-861c-4c21f20e2485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:56.107684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd58e0ab-ae3a-426c-861c-4c21f20e2485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:56.108873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58e0ab-ae3a-426c-861c-4c21f20e2485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:56.112555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd58e0ab-ae3a-426c-861c-4c21f20e2485 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:56.133477 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1977/4027] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:26:56.138120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1958ceb-58dc-4bd3-9869-1d92e773dd4b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:56.156311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1958ceb-58dc-4bd3-9869-1d92e773dd4b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:56.183416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e499f1-11b7-454b-8ac1-5ad383b3e5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:56.184131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e499f1-11b7-454b-8ac1-5ad383b3e5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:56.184485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e499f1-11b7-454b-8ac1-5ad383b3e5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:56.184830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e499f1-11b7-454b-8ac1-5ad383b3e5a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:56.185773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e499f1-11b7-454b-8ac1-5ad383b3e5a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:56.187574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e499f1-11b7-454b-8ac1-5ad383b3e5a4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:56.211744 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2051/4028] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:26:56.216599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58e0ab-ae3a-426c-861c-4c21f20e2485 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:56.232977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd58e0ab-ae3a-426c-861c-4c21f20e2485 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:56.239681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c700562-b719-4cc1-816a-ea8288ecea03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:56.241096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c700562-b719-4cc1-816a-ea8288ecea03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:56.241643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c700562-b719-4cc1-816a-ea8288ecea03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:56.242386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c700562-b719-4cc1-816a-ea8288ecea03 admin admin] PATH_INFO: `/v3/projects/b8d54244589445d2ad3ac4c7328fdb3e/users/7511957de5294fb2b5ca686458af6c8d/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:56.281318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c700562-b719-4cc1-816a-ea8288ecea03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d54244589445d2ad3ac4c7328fdb3e, user_id=7511957de5294fb2b5ca686458af6c8d, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:56.291480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c700562-b719-4cc1-816a-ea8288ecea03 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:56.440969 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1978/4029] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:26:56 2022] PUT /identity/v3/projects/b8d54244589445d2ad3ac4c7328fdb3e/users/7511957de5294fb2b5ca686458af6c8d/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:56.448105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a39daf-f8d4-4df3-9421-acf74f2dfff7 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:56.448617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a39daf-f8d4-4df3-9421-acf74f2dfff7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:56.448751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a39daf-f8d4-4df3-9421-acf74f2dfff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:56.484762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a1a39daf-f8d4-4df3-9421-acf74f2dfff7 None None] MFA Rules not processed for user `7511957de5294fb2b5ca686458af6c8d`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:56.486024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a1a39daf-f8d4-4df3-9421-acf74f2dfff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:56.639593 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2052/4030] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:56 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:56.640253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c700562-b719-4cc1-816a-ea8288ecea03 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:56.683950 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:56.771625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c700562-b719-4cc1-816a-ea8288ecea03 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:56.786579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde162b-3902-466d-8e74-11930d3332fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:56.786579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde162b-3902-466d-8e74-11930d3332fa admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:56.786579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde162b-3902-466d-8e74-11930d3332fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:56.786579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccde162b-3902-466d-8e74-11930d3332fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:56.787015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde162b-3902-466d-8e74-11930d3332fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:56.787015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccde162b-3902-466d-8e74-11930d3332fa admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:56.903214 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1979/4031] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:26:56 2022] POST /identity/v3/projects => generated 367 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:56.908281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a39daf-f8d4-4df3-9421-acf74f2dfff7 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:56.950222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a39daf-f8d4-4df3-9421-acf74f2dfff7 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:57.099040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5fa35-5a6e-498f-a560-6edb62de86e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:57.099776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5fa35-5a6e-498f-a560-6edb62de86e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:57.100053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5fa35-5a6e-498f-a560-6edb62de86e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:57.100822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd5fa35-5a6e-498f-a560-6edb62de86e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:57.101159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5fa35-5a6e-498f-a560-6edb62de86e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:57.104009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd5fa35-5a6e-498f-a560-6edb62de86e3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:57.204420 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2053/4032] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:26:56 2022] POST /identity/v3/users => generated 290 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:57.204644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde162b-3902-466d-8e74-11930d3332fa admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:57.222873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccde162b-3902-466d-8e74-11930d3332fa admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:57.237110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cef0e-956d-41eb-a551-52bdaeaf3199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:57.238303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cef0e-956d-41eb-a551-52bdaeaf3199 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:57.238813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cef0e-956d-41eb-a551-52bdaeaf3199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:57.239332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242cef0e-956d-41eb-a551-52bdaeaf3199 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:57.240493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cef0e-956d-41eb-a551-52bdaeaf3199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:57.242571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242cef0e-956d-41eb-a551-52bdaeaf3199 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:57.264989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5fa35-5a6e-498f-a560-6edb62de86e3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:57.278089 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1980/4033] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:26:57.281444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd5fa35-5a6e-498f-a560-6edb62de86e3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:57.289545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a351b-e621-44da-aed7-06425523dd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:57.290824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a351b-e621-44da-aed7-06425523dd24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:57.292087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a351b-e621-44da-aed7-06425523dd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:57.292769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a351b-e621-44da-aed7-06425523dd24 admin admin] PATH_INFO: `/v3/projects/6ef66e6fd42349b883344b86b9ecb050/users/e8aa7ea0f2be45f787371d1c28a51ce3/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:57.356893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a351b-e621-44da-aed7-06425523dd24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef66e6fd42349b883344b86b9ecb050, user_id=e8aa7ea0f2be45f787371d1c28a51ce3, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:57.368532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a351b-e621-44da-aed7-06425523dd24 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:57.441736 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2054/4034] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:26:57 2022] PUT /identity/v3/projects/6ef66e6fd42349b883344b86b9ecb050/users/e8aa7ea0f2be45f787371d1c28a51ce3/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:57.454481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cef0e-956d-41eb-a551-52bdaeaf3199 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:57.477297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242cef0e-956d-41eb-a551-52bdaeaf3199 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:57.627355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39c9dd2-7ffa-45da-a1aa-643c7a599816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:57.630468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c9dd2-7ffa-45da-a1aa-643c7a599816 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:57.631007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c9dd2-7ffa-45da-a1aa-643c7a599816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:57.635464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c9dd2-7ffa-45da-a1aa-643c7a599816 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:57.637438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c9dd2-7ffa-45da-a1aa-643c7a599816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:57.655017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39c9dd2-7ffa-45da-a1aa-643c7a599816 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:57.668796 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1981/4035] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:26:57.672809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a351b-e621-44da-aed7-06425523dd24 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:57.685125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a351b-e621-44da-aed7-06425523dd24 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:57.690606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad90a0-8c62-4dce-a6f0-decfa16a9cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:57.691847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad90a0-8c62-4dce-a6f0-decfa16a9cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:57.692319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad90a0-8c62-4dce-a6f0-decfa16a9cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:57.692851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad90a0-8c62-4dce-a6f0-decfa16a9cc5 admin admin] PATH_INFO: `/v3/projects/6ef66e6fd42349b883344b86b9ecb050/users/e8aa7ea0f2be45f787371d1c28a51ce3/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:57.695062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad90a0-8c62-4dce-a6f0-decfa16a9cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ef66e6fd42349b883344b86b9ecb050, user_id=e8aa7ea0f2be45f787371d1c28a51ce3, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:57.710301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad90a0-8c62-4dce-a6f0-decfa16a9cc5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:57.724469 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2055/4036] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:26:57 2022] PUT /identity/v3/projects/6ef66e6fd42349b883344b86b9ecb050/users/e8aa7ea0f2be45f787371d1c28a51ce3/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:26:57.736006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59161-2797-455a-b9a0-c9f433d5ddcc None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:57.736297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59161-2797-455a-b9a0-c9f433d5ddcc None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:57.736796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a59161-2797-455a-b9a0-c9f433d5ddcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:57.803667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d7a59161-2797-455a-b9a0-c9f433d5ddcc None None] MFA Rules not processed for user `e8aa7ea0f2be45f787371d1c28a51ce3`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:26:57.804963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d7a59161-2797-455a-b9a0-c9f433d5ddcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:57.997514 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1982/4037] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:26:57 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:26:58.004314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad90a0-8c62-4dce-a6f0-decfa16a9cc5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:58.024561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad90a0-8c62-4dce-a6f0-decfa16a9cc5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:58.038843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efc3cb-fee0-43cc-912e-48e53f581274 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:58.039713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efc3cb-fee0-43cc-912e-48e53f581274 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:58.040111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efc3cb-fee0-43cc-912e-48e53f581274 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:58.040506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efc3cb-fee0-43cc-912e-48e53f581274 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:58.042830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efc3cb-fee0-43cc-912e-48e53f581274 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:58.051735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efc3cb-fee0-43cc-912e-48e53f581274 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:58.179888 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2056/4038] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:26:58 2022] POST /identity/v3/projects => generated 360 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:58.185465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a59161-2797-455a-b9a0-c9f433d5ddcc None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:58.213795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a59161-2797-455a-b9a0-c9f433d5ddcc None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:58.372206 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:58.382662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978f1bf-60fa-4798-baec-33c9f33f556c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:58.383604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978f1bf-60fa-4798-baec-33c9f33f556c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:58.384344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978f1bf-60fa-4798-baec-33c9f33f556c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:58.384776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978f1bf-60fa-4798-baec-33c9f33f556c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:58.385600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978f1bf-60fa-4798-baec-33c9f33f556c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:58.387981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978f1bf-60fa-4798-baec-33c9f33f556c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:58.505218 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1983/4039] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:26:58 2022] POST /identity/v3/users => generated 416 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:58.509222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efc3cb-fee0-43cc-912e-48e53f581274 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:58.517804 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:58.533992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efc3cb-fee0-43cc-912e-48e53f581274 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:58.547654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53245622-391e-4f79-ac8f-d5849781fe47 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:58.548751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53245622-391e-4f79-ac8f-d5849781fe47 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:58.549215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53245622-391e-4f79-ac8f-d5849781fe47 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:58.549604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53245622-391e-4f79-ac8f-d5849781fe47 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/users/2763809dcbb240b8a3f87d7434952af2` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:58.576233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53245622-391e-4f79-ac8f-d5849781fe47 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:get_user(user_id=2763809dcbb240b8a3f87d7434952af2)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:58.578912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53245622-391e-4f79-ac8f-d5849781fe47 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:58.580874 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2057/4040] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Jul 19 14:26:58 2022] GET /identity/v3/users/2763809dcbb240b8a3f87d7434952af2 => generated 416 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:26:58.588977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978f1bf-60fa-4798-baec-33c9f33f556c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:58.600677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978f1bf-60fa-4798-baec-33c9f33f556c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:58.606750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fbc4f-b241-475f-a23e-04c8bcd69e6a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:58.607935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fbc4f-b241-475f-a23e-04c8bcd69e6a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:58.608219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fbc4f-b241-475f-a23e-04c8bcd69e6a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:58.608975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778fbc4f-b241-475f-a23e-04c8bcd69e6a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/users/2763809dcbb240b8a3f87d7434952af2` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:58.610463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778fbc4f-b241-475f-a23e-04c8bcd69e6a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2763809dcbb240b8a3f87d7434952af2)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:58.613063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778fbc4f-b241-475f-a23e-04c8bcd69e6a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:58.765251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-778fbc4f-b241-475f-a23e-04c8bcd69e6a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2763809dcbb240b8a3f87d7434952af2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:58.789462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-778fbc4f-b241-475f-a23e-04c8bcd69e6a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2763809dcbb240b8a3f87d7434952af2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:58.790607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-778fbc4f-b241-475f-a23e-04c8bcd69e6a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2763809dcbb240b8a3f87d7434952af2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:58.792116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-778fbc4f-b241-475f-a23e-04c8bcd69e6a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2763809dcbb240b8a3f87d7434952af2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:58.810234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-778fbc4f-b241-475f-a23e-04c8bcd69e6a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2763809dcbb240b8a3f87d7434952af2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:58.910122 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1984/4041] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:26:58 2022] DELETE /identity/v3/users/2763809dcbb240b8a3f87d7434952af2 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:58.917055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53245622-391e-4f79-ac8f-d5849781fe47 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:58.919736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-53245622-391e-4f79-ac8f-d5849781fe47 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:58.939886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53245622-391e-4f79-ac8f-d5849781fe47 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:59.063708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945890d3-b51e-4a19-9270-fc2736a0b0df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:59.065521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945890d3-b51e-4a19-9270-fc2736a0b0df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:59.065818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945890d3-b51e-4a19-9270-fc2736a0b0df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:59.066281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945890d3-b51e-4a19-9270-fc2736a0b0df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/f1d3edefa223480aba0e6cc32c5bc196` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:59.067919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945890d3-b51e-4a19-9270-fc2736a0b0df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f1d3edefa223480aba0e6cc32c5bc196)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:59.070833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945890d3-b51e-4a19-9270-fc2736a0b0df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:59.228390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-945890d3-b51e-4a19-9270-fc2736a0b0df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1d3edefa223480aba0e6cc32c5bc196', 'request_id': 'req-945890d3-b51e-4a19-9270-fc2736a0b0df'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:59.250015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-945890d3-b51e-4a19-9270-fc2736a0b0df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1d3edefa223480aba0e6cc32c5bc196', 'request_id': 'req-945890d3-b51e-4a19-9270-fc2736a0b0df'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:59.260441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-945890d3-b51e-4a19-9270-fc2736a0b0df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1d3edefa223480aba0e6cc32c5bc196', 'request_id': 'req-945890d3-b51e-4a19-9270-fc2736a0b0df'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:59.355507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-945890d3-b51e-4a19-9270-fc2736a0b0df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] The token cache is being invalidate because project f1d3edefa223480aba0e6cc32c5bc196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:26:59.356131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-945890d3-b51e-4a19-9270-fc2736a0b0df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:59.357845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-945890d3-b51e-4a19-9270-fc2736a0b0df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:59.360353 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2058/4042] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:26:58 2022] DELETE /identity/v3/projects/f1d3edefa223480aba0e6cc32c5bc196 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:26:59.365913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fbc4f-b241-475f-a23e-04c8bcd69e6a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:59.377380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778fbc4f-b241-475f-a23e-04c8bcd69e6a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:59.438809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945890d3-b51e-4a19-9270-fc2736a0b0df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:59.440919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-945890d3-b51e-4a19-9270-fc2736a0b0df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:59.445228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c417b1-fb20-4bab-91df-f9ce205fff7f tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:59.446230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c417b1-fb20-4bab-91df-f9ce205fff7f tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:59.446770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c417b1-fb20-4bab-91df-f9ce205fff7f tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:59.447583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c417b1-fb20-4bab-91df-f9ce205fff7f tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:59.449273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c417b1-fb20-4bab-91df-f9ce205fff7f tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:59.451322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c417b1-fb20-4bab-91df-f9ce205fff7f tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:59.539679 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1985/4043] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:26:59 2022] POST /identity/v3/projects => generated 348 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:26:59.544414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c417b1-fb20-4bab-91df-f9ce205fff7f tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:59.547064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-40c417b1-fb20-4bab-91df-f9ce205fff7f tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:59.564477 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:59.569427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945890d3-b51e-4a19-9270-fc2736a0b0df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:59.618726 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:26:59.647010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56387084-8d35-4d5a-85cd-ed92f00529b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:59.648167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56387084-8d35-4d5a-85cd-ed92f00529b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:59.648167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56387084-8d35-4d5a-85cd-ed92f00529b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:59.648413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56387084-8d35-4d5a-85cd-ed92f00529b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:59.652835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-56387084-8d35-4d5a-85cd-ed92f00529b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:26:59.681936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56387084-8d35-4d5a-85cd-ed92f00529b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:59.683634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56387084-8d35-4d5a-85cd-ed92f00529b5 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:59.729365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c417b1-fb20-4bab-91df-f9ce205fff7f tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:59.730135 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2059/4044] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:26:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:26:59.733049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2789b-5b44-4bae-999e-ff1fe7960708 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:59.753646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2789b-5b44-4bae-999e-ff1fe7960708 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:59.757839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2789b-5b44-4bae-999e-ff1fe7960708 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:59.757839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df2789b-5b44-4bae-999e-ff1fe7960708 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:59.757839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2789b-5b44-4bae-999e-ff1fe7960708 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:26:59.757839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2789b-5b44-4bae-999e-ff1fe7960708 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:59.758283 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-9df2789b-5b44-4bae-999e-ff1fe7960708 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:59.758283 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:26:59.758283 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:26:59.760304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df2789b-5b44-4bae-999e-ff1fe7960708 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:59.796385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56387084-8d35-4d5a-85cd-ed92f00529b5 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:59.798404 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1986/4045] 10.222.0.43 () {58 vars in 1159 bytes} [Tue Jul 19 14:26:59 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:26:59.818972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56387084-8d35-4d5a-85cd-ed92f00529b5 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:59.831541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddd795-af75-4936-90fb-ecdd826f4249 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:59.832239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddd795-af75-4936-90fb-ecdd826f4249 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:59.838359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddd795-af75-4936-90fb-ecdd826f4249 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:59.838359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddd795-af75-4936-90fb-ecdd826f4249 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:59.838359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ddd795-af75-4936-90fb-ecdd826f4249 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:59.838359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ddd795-af75-4936-90fb-ecdd826f4249 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:59.881072 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2060/4046] 10.222.0.43 () {58 vars in 1127 bytes} [Tue Jul 19 14:26:59 2022] GET /identity/v3/domains => generated 829 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:26:59.885879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2789b-5b44-4bae-999e-ff1fe7960708 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:26:59.904731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df2789b-5b44-4bae-999e-ff1fe7960708 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:26:59.910327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da23b6-4e4e-495a-afb1-cf4c37f1b097 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:26:59.911686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da23b6-4e4e-495a-afb1-cf4c37f1b097 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:26:59.912283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da23b6-4e4e-495a-afb1-cf4c37f1b097 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:26:59.912875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da23b6-4e4e-495a-afb1-cf4c37f1b097 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/4329a602c48d417a8758d92a097e7b21` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:26:59.914554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da23b6-4e4e-495a-afb1-cf4c37f1b097 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:update_project(project_id=4329a602c48d417a8758d92a097e7b21)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:26:59.915880 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-e3da23b6-4e4e-495a-afb1-cf4c37f1b097 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:26:59.915880 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:26:59.915880 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:26:59.917391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da23b6-4e4e-495a-afb1-cf4c37f1b097 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:26:59.941873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e3da23b6-4e4e-495a-afb1-cf4c37f1b097 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4329a602c48d417a8758d92a097e7b21'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:26:59.946070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e3da23b6-4e4e-495a-afb1-cf4c37f1b097 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4329a602c48d417a8758d92a097e7b21'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:00.048219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e3da23b6-4e4e-495a-afb1-cf4c37f1b097 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4329a602c48d417a8758d92a097e7b21'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:00.049563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e3da23b6-4e4e-495a-afb1-cf4c37f1b097 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4329a602c48d417a8758d92a097e7b21'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:00.054482 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1987/4047] 10.222.0.43 () {60 vars in 1251 bytes} [Tue Jul 19 14:26:59 2022] PATCH /identity/v3/projects/4329a602c48d417a8758d92a097e7b21 => generated 362 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:27:00.059619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddd795-af75-4936-90fb-ecdd826f4249 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:00.062278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-24ddd795-af75-4936-90fb-ecdd826f4249 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:00.082838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddd795-af75-4936-90fb-ecdd826f4249 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:00.216419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d351853-842b-4e45-aadb-7a8f405863b0 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:00.217522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d351853-842b-4e45-aadb-7a8f405863b0 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:00.217955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d351853-842b-4e45-aadb-7a8f405863b0 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:00.218450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d351853-842b-4e45-aadb-7a8f405863b0 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/4329a602c48d417a8758d92a097e7b21` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:00.243773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d351853-842b-4e45-aadb-7a8f405863b0 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4329a602c48d417a8758d92a097e7b21)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:00.246326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d351853-842b-4e45-aadb-7a8f405863b0 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:00.281695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8d351853-842b-4e45-aadb-7a8f405863b0 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4329a602c48d417a8758d92a097e7b21'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:00.297146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8d351853-842b-4e45-aadb-7a8f405863b0 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4329a602c48d417a8758d92a097e7b21'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:00.403226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8d351853-842b-4e45-aadb-7a8f405863b0 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4329a602c48d417a8758d92a097e7b21', 'request_id': 'req-8d351853-842b-4e45-aadb-7a8f405863b0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:00.409121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da23b6-4e4e-495a-afb1-cf4c37f1b097 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:00.411992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8d351853-842b-4e45-aadb-7a8f405863b0 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4329a602c48d417a8758d92a097e7b21', 'request_id': 'req-8d351853-842b-4e45-aadb-7a8f405863b0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:00.412158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e3da23b6-4e4e-495a-afb1-cf4c37f1b097 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:00.422827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8d351853-842b-4e45-aadb-7a8f405863b0 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4329a602c48d417a8758d92a097e7b21', 'request_id': 'req-8d351853-842b-4e45-aadb-7a8f405863b0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:00.499238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8d351853-842b-4e45-aadb-7a8f405863b0 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] The token cache is being invalidate because project 4329a602c48d417a8758d92a097e7b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:00.500138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8d351853-842b-4e45-aadb-7a8f405863b0 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:00.500959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8d351853-842b-4e45-aadb-7a8f405863b0 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:00.515829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8d351853-842b-4e45-aadb-7a8f405863b0 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4329a602c48d417a8758d92a097e7b21', 'request_id': 'req-8d351853-842b-4e45-aadb-7a8f405863b0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:00.519498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8d351853-842b-4e45-aadb-7a8f405863b0 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4329a602c48d417a8758d92a097e7b21', 'request_id': 'req-8d351853-842b-4e45-aadb-7a8f405863b0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:00.524297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8d351853-842b-4e45-aadb-7a8f405863b0 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4329a602c48d417a8758d92a097e7b21', 'request_id': 'req-8d351853-842b-4e45-aadb-7a8f405863b0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:00.543768 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:00.552073 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2061/4048] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:00 2022] DELETE /identity/v3/projects/4329a602c48d417a8758d92a097e7b21 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:00.558806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d9b91-5e90-4b22-80c7-0a92891cbf64 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:00.558806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d9b91-5e90-4b22-80c7-0a92891cbf64 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:00.559258 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d9b91-5e90-4b22-80c7-0a92891cbf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:00.611042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da23b6-4e4e-495a-afb1-cf4c37f1b097 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:00.613034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-880d9b91-5e90-4b22-80c7-0a92891cbf64 None None] MFA Rules not processed for user `bfba896c72964388b328edeb9af61880`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:00.614989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-880d9b91-5e90-4b22-80c7-0a92891cbf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:00.813772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0034a71-e82a-4476-b31d-1141a991ca9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:00.814498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0034a71-e82a-4476-b31d-1141a991ca9e service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:00.814894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0034a71-e82a-4476-b31d-1141a991ca9e service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:00.815182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0034a71-e82a-4476-b31d-1141a991ca9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:00.819292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c0034a71-e82a-4476-b31d-1141a991ca9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:00.834724 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:00.859385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0034a71-e82a-4476-b31d-1141a991ca9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:00.860985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0034a71-e82a-4476-b31d-1141a991ca9e service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:00.867096 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2062/4049] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:00.867891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d9b91-5e90-4b22-80c7-0a92891cbf64 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:00.870700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-880d9b91-5e90-4b22-80c7-0a92891cbf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:00.902273 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1988/4050] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:27:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:27:01.032941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d9b91-5e90-4b22-80c7-0a92891cbf64 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:01.049656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead6f96-efb0-4b35-a423-80c938d49e1d tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:01.050742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead6f96-efb0-4b35-a423-80c938d49e1d tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:01.051195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead6f96-efb0-4b35-a423-80c938d49e1d tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:01.051637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ead6f96-efb0-4b35-a423-80c938d49e1d tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:01.052531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead6f96-efb0-4b35-a423-80c938d49e1d tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:01.054665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ead6f96-efb0-4b35-a423-80c938d49e1d tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:01.160406 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2063/4051] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:27:00 2022] POST /identity/v3/projects => generated 359 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:01.163988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0034a71-e82a-4476-b31d-1141a991ca9e service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:01.180226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0034a71-e82a-4476-b31d-1141a991ca9e service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:01.328462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4b345-21ab-40b9-9a5b-ed199625b47c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:01.329471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4b345-21ab-40b9-9a5b-ed199625b47c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:01.329837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4b345-21ab-40b9-9a5b-ed199625b47c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:01.330214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4b345-21ab-40b9-9a5b-ed199625b47c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/7ac20ae054f54119bab71c7414c20d6a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:01.332536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4b345-21ab-40b9-9a5b-ed199625b47c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:get_project(project_id=7ac20ae054f54119bab71c7414c20d6a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:01.339850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4b345-21ab-40b9-9a5b-ed199625b47c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:01.346271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead6f96-efb0-4b35-a423-80c938d49e1d tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:01.351297 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1989/4052] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:27:01 2022] GET /identity/v3/projects/7ac20ae054f54119bab71c7414c20d6a => generated 359 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:27:01.370593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ead6f96-efb0-4b35-a423-80c938d49e1d tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:01.392953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e2e76-dce2-47f7-afa7-d76659232364 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:01.393943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e2e76-dce2-47f7-afa7-d76659232364 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:01.394355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e2e76-dce2-47f7-afa7-d76659232364 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:01.394682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e2e76-dce2-47f7-afa7-d76659232364 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/7ac20ae054f54119bab71c7414c20d6a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:01.397666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e2e76-dce2-47f7-afa7-d76659232364 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7ac20ae054f54119bab71c7414c20d6a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:01.409203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e2e76-dce2-47f7-afa7-d76659232364 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:01.578725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-183e2e76-dce2-47f7-afa7-d76659232364 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ac20ae054f54119bab71c7414c20d6a', 'request_id': 'req-183e2e76-dce2-47f7-afa7-d76659232364'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:01.592085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-183e2e76-dce2-47f7-afa7-d76659232364 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ac20ae054f54119bab71c7414c20d6a', 'request_id': 'req-183e2e76-dce2-47f7-afa7-d76659232364'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:01.612791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-183e2e76-dce2-47f7-afa7-d76659232364 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ac20ae054f54119bab71c7414c20d6a', 'request_id': 'req-183e2e76-dce2-47f7-afa7-d76659232364'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:01.619486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4b345-21ab-40b9-9a5b-ed199625b47c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:01.623559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0ff4b345-21ab-40b9-9a5b-ed199625b47c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:01.714190 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:01.719152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-183e2e76-dce2-47f7-afa7-d76659232364 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] The token cache is being invalidate because project 7ac20ae054f54119bab71c7414c20d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:01.719446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-183e2e76-dce2-47f7-afa7-d76659232364 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:01.720573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-183e2e76-dce2-47f7-afa7-d76659232364 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:01.731821 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2064/4053] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:01 2022] DELETE /identity/v3/projects/7ac20ae054f54119bab71c7414c20d6a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:01.737089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e2e76-dce2-47f7-afa7-d76659232364 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:01.738765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-183e2e76-dce2-47f7-afa7-d76659232364 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:01.837583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4b345-21ab-40b9-9a5b-ed199625b47c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:01.880265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e2e76-dce2-47f7-afa7-d76659232364 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:01.892359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9ff91-9a59-4a8f-8402-87dbec1f79df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:01.893063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9ff91-9a59-4a8f-8402-87dbec1f79df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:01.893389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9ff91-9a59-4a8f-8402-87dbec1f79df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:01.893676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9ff91-9a59-4a8f-8402-87dbec1f79df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:01.894457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9ff91-9a59-4a8f-8402-87dbec1f79df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:01.896339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9ff91-9a59-4a8f-8402-87dbec1f79df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:01.990872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1223e1-3d9f-4490-af80-35b4a42d1b63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:01.991601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1223e1-3d9f-4490-af80-35b4a42d1b63 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:01.992134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1223e1-3d9f-4490-af80-35b4a42d1b63 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:01.992134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1223e1-3d9f-4490-af80-35b4a42d1b63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:01.995028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7f1223e1-3d9f-4490-af80-35b4a42d1b63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:02.033985 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:02.079771 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2065/4054] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:27:01 2022] POST /identity/v3/projects => generated 359 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:02.083918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9ff91-9a59-4a8f-8402-87dbec1f79df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:02.111550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1223e1-3d9f-4490-af80-35b4a42d1b63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:02.113582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1223e1-3d9f-4490-af80-35b4a42d1b63 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:02.128269 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1990/4055] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:27:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:27:02.239374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9ff91-9a59-4a8f-8402-87dbec1f79df tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:02.251423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490bf75-5bbf-46d1-8bfc-d2f18e2846f1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:02.252511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490bf75-5bbf-46d1-8bfc-d2f18e2846f1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:02.255387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490bf75-5bbf-46d1-8bfc-d2f18e2846f1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:02.255763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2490bf75-5bbf-46d1-8bfc-d2f18e2846f1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/aba8bd5a71434e49af4d215dabae8a46` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:02.257527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490bf75-5bbf-46d1-8bfc-d2f18e2846f1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:get_project(project_id=aba8bd5a71434e49af4d215dabae8a46)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:02.265392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2490bf75-5bbf-46d1-8bfc-d2f18e2846f1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:02.267530 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2066/4056] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:27:02 2022] GET /identity/v3/projects/aba8bd5a71434e49af4d215dabae8a46 => generated 359 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:27:02.271751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1223e1-3d9f-4490-af80-35b4a42d1b63 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:02.289174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1223e1-3d9f-4490-af80-35b4a42d1b63 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:02.310503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffe88d-596a-40db-92e5-4f5413519f2c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:02.311994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffe88d-596a-40db-92e5-4f5413519f2c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:02.311994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffe88d-596a-40db-92e5-4f5413519f2c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:02.312295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffe88d-596a-40db-92e5-4f5413519f2c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/aba8bd5a71434e49af4d215dabae8a46` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:02.313582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffe88d-596a-40db-92e5-4f5413519f2c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:delete_project(project_id=aba8bd5a71434e49af4d215dabae8a46)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:02.315684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffe88d-596a-40db-92e5-4f5413519f2c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:02.493461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fdffe88d-596a-40db-92e5-4f5413519f2c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aba8bd5a71434e49af4d215dabae8a46', 'request_id': 'req-fdffe88d-596a-40db-92e5-4f5413519f2c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:02.642737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fdffe88d-596a-40db-92e5-4f5413519f2c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aba8bd5a71434e49af4d215dabae8a46', 'request_id': 'req-fdffe88d-596a-40db-92e5-4f5413519f2c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:02.662744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fdffe88d-596a-40db-92e5-4f5413519f2c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aba8bd5a71434e49af4d215dabae8a46', 'request_id': 'req-fdffe88d-596a-40db-92e5-4f5413519f2c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:02.731284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fdffe88d-596a-40db-92e5-4f5413519f2c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] The token cache is being invalidate because project aba8bd5a71434e49af4d215dabae8a46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:02.732958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fdffe88d-596a-40db-92e5-4f5413519f2c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:02.734303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fdffe88d-596a-40db-92e5-4f5413519f2c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:02.749148 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1991/4057] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:02 2022] DELETE /identity/v3/projects/aba8bd5a71434e49af4d215dabae8a46 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:02.754890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490bf75-5bbf-46d1-8bfc-d2f18e2846f1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:02.757026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2490bf75-5bbf-46d1-8bfc-d2f18e2846f1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:02.794501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2490bf75-5bbf-46d1-8bfc-d2f18e2846f1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:03.007086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8d5a9-31b7-48b6-9507-a8f1fdfaa277 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:03.007774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8d5a9-31b7-48b6-9507-a8f1fdfaa277 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:03.008066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8d5a9-31b7-48b6-9507-a8f1fdfaa277 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:03.008413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8d5a9-31b7-48b6-9507-a8f1fdfaa277 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:03.009270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8d5a9-31b7-48b6-9507-a8f1fdfaa277 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:03.022396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8d5a9-31b7-48b6-9507-a8f1fdfaa277 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:03.170262 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2067/4058] 10.222.0.43 () {60 vars in 1151 bytes} [Tue Jul 19 14:27:02 2022] POST /identity/v3/projects => generated 347 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:03.174483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffe88d-596a-40db-92e5-4f5413519f2c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:03.188877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffe88d-596a-40db-92e5-4f5413519f2c tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:03.351348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ffeb5-f81a-496f-a4e4-6e7399a0ea68 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:03.352379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ffeb5-f81a-496f-a4e4-6e7399a0ea68 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:03.353003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ffeb5-f81a-496f-a4e4-6e7399a0ea68 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:03.353193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ffeb5-f81a-496f-a4e4-6e7399a0ea68 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/8feafda73b0f4c6c97da55f9ba8e3a2f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:03.356743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ffeb5-f81a-496f-a4e4-6e7399a0ea68 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:get_project(project_id=8feafda73b0f4c6c97da55f9ba8e3a2f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:03.363722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ffeb5-f81a-496f-a4e4-6e7399a0ea68 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:03.370804 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1992/4059] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:27:03 2022] GET /identity/v3/projects/8feafda73b0f4c6c97da55f9ba8e3a2f => generated 347 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:27:03.371698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8d5a9-31b7-48b6-9507-a8f1fdfaa277 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:03.402021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8d5a9-31b7-48b6-9507-a8f1fdfaa277 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:03.411742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683f761-f929-4a74-8c04-2ec9f076acb3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:03.412650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683f761-f929-4a74-8c04-2ec9f076acb3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:03.416962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683f761-f929-4a74-8c04-2ec9f076acb3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:03.417237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683f761-f929-4a74-8c04-2ec9f076acb3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/8feafda73b0f4c6c97da55f9ba8e3a2f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:03.424587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683f761-f929-4a74-8c04-2ec9f076acb3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8feafda73b0f4c6c97da55f9ba8e3a2f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:03.432002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683f761-f929-4a74-8c04-2ec9f076acb3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:03.456379 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:03.680916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6683f761-f929-4a74-8c04-2ec9f076acb3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8feafda73b0f4c6c97da55f9ba8e3a2f', 'request_id': 'req-6683f761-f929-4a74-8c04-2ec9f076acb3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:03.699536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6683f761-f929-4a74-8c04-2ec9f076acb3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8feafda73b0f4c6c97da55f9ba8e3a2f', 'request_id': 'req-6683f761-f929-4a74-8c04-2ec9f076acb3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:03.716841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6683f761-f929-4a74-8c04-2ec9f076acb3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8feafda73b0f4c6c97da55f9ba8e3a2f', 'request_id': 'req-6683f761-f929-4a74-8c04-2ec9f076acb3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:03.824113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6683f761-f929-4a74-8c04-2ec9f076acb3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] The token cache is being invalidate because project 8feafda73b0f4c6c97da55f9ba8e3a2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:03.824113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6683f761-f929-4a74-8c04-2ec9f076acb3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:03.824943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6683f761-f929-4a74-8c04-2ec9f076acb3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:03.828398 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2068/4060] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:03 2022] DELETE /identity/v3/projects/8feafda73b0f4c6c97da55f9ba8e3a2f => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:27:03.835550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ffeb5-f81a-496f-a4e4-6e7399a0ea68 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:03.837563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-529ffeb5-f81a-496f-a4e4-6e7399a0ea68 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:03.860915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ffeb5-f81a-496f-a4e4-6e7399a0ea68 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:03.959219 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:03.967706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a8b16-6cb9-4c8e-a3e5-86f403a0ffa6 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:03.969462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a8b16-6cb9-4c8e-a3e5-86f403a0ffa6 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:03.969980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a8b16-6cb9-4c8e-a3e5-86f403a0ffa6 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:03.971176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433a8b16-6cb9-4c8e-a3e5-86f403a0ffa6 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:03.972381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a8b16-6cb9-4c8e-a3e5-86f403a0ffa6 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:03.975625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433a8b16-6cb9-4c8e-a3e5-86f403a0ffa6 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:04.105514 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1993/4061] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:27:03 2022] POST /identity/v3/domains => generated 276 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:04.106726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683f761-f929-4a74-8c04-2ec9f076acb3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:04.133555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683f761-f929-4a74-8c04-2ec9f076acb3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:04.297504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf8880-1548-418f-bf63-bc00106ec898 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:04.297717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf8880-1548-418f-bf63-bc00106ec898 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:04.298019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf8880-1548-418f-bf63-bc00106ec898 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:04.298343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf8880-1548-418f-bf63-bc00106ec898 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:04.299061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf8880-1548-418f-bf63-bc00106ec898 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:04.302502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf8880-1548-418f-bf63-bc00106ec898 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:04.530414 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2069/4062] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:27:04 2022] POST /identity/v3/projects => generated 402 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:04.536472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a8b16-6cb9-4c8e-a3e5-86f403a0ffa6 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:04.585672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433a8b16-6cb9-4c8e-a3e5-86f403a0ffa6 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:04.744912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a02791-418f-4608-860a-21e05f34f78a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:04.748559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a02791-418f-4608-860a-21e05f34f78a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:04.750004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a02791-418f-4608-860a-21e05f34f78a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:04.758157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a02791-418f-4608-860a-21e05f34f78a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/4ca08568eae64a6c8366a0f77e4063cd` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:04.763768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a02791-418f-4608-860a-21e05f34f78a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:get_project(project_id=4ca08568eae64a6c8366a0f77e4063cd)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:04.776119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a02791-418f-4608-860a-21e05f34f78a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:04.786720 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1994/4063] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:27:04 2022] GET /identity/v3/projects/4ca08568eae64a6c8366a0f77e4063cd => generated 402 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:27:04.795956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf8880-1548-418f-bf63-bc00106ec898 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:04.822562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf8880-1548-418f-bf63-bc00106ec898 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:04.836343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068cfc0-b75f-405d-93c4-5fc8bfa2a0c1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:04.837311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068cfc0-b75f-405d-93c4-5fc8bfa2a0c1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:04.837663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068cfc0-b75f-405d-93c4-5fc8bfa2a0c1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:04.838184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068cfc0-b75f-405d-93c4-5fc8bfa2a0c1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/4ca08568eae64a6c8366a0f77e4063cd` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:04.839892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068cfc0-b75f-405d-93c4-5fc8bfa2a0c1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4ca08568eae64a6c8366a0f77e4063cd)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:04.841785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068cfc0-b75f-405d-93c4-5fc8bfa2a0c1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:05.063359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3068cfc0-b75f-405d-93c4-5fc8bfa2a0c1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ca08568eae64a6c8366a0f77e4063cd', 'request_id': 'req-3068cfc0-b75f-405d-93c4-5fc8bfa2a0c1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:05.076150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3068cfc0-b75f-405d-93c4-5fc8bfa2a0c1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ca08568eae64a6c8366a0f77e4063cd', 'request_id': 'req-3068cfc0-b75f-405d-93c4-5fc8bfa2a0c1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:05.088980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3068cfc0-b75f-405d-93c4-5fc8bfa2a0c1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ca08568eae64a6c8366a0f77e4063cd', 'request_id': 'req-3068cfc0-b75f-405d-93c4-5fc8bfa2a0c1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:05.097023 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:05.253310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3068cfc0-b75f-405d-93c4-5fc8bfa2a0c1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] The token cache is being invalidate because project 4ca08568eae64a6c8366a0f77e4063cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:05.260359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3068cfc0-b75f-405d-93c4-5fc8bfa2a0c1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:05.262655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3068cfc0-b75f-405d-93c4-5fc8bfa2a0c1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:05.270391 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2070/4064] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:04 2022] DELETE /identity/v3/projects/4ca08568eae64a6c8366a0f77e4063cd => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:05.271919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a02791-418f-4608-860a-21e05f34f78a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:05.274040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-91a02791-418f-4608-860a-21e05f34f78a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:05.304944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a02791-418f-4608-860a-21e05f34f78a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:05.462287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576292fd-f45d-4a58-926e-8e5c2a608dcc tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:05.463218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576292fd-f45d-4a58-926e-8e5c2a608dcc tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:05.463543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576292fd-f45d-4a58-926e-8e5c2a608dcc tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:05.464402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576292fd-f45d-4a58-926e-8e5c2a608dcc tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/domains/15f31945508840ecae885b8a6472dcbc` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:05.466891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576292fd-f45d-4a58-926e-8e5c2a608dcc tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=15f31945508840ecae885b8a6472dcbc)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:05.468748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576292fd-f45d-4a58-926e-8e5c2a608dcc tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:05.523900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-576292fd-f45d-4a58-926e-8e5c2a608dcc tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '15f31945508840ecae885b8a6472dcbc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:05.526620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-576292fd-f45d-4a58-926e-8e5c2a608dcc tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '15f31945508840ecae885b8a6472dcbc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:05.632033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-576292fd-f45d-4a58-926e-8e5c2a608dcc tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '15f31945508840ecae885b8a6472dcbc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:05.635490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-576292fd-f45d-4a58-926e-8e5c2a608dcc tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '15f31945508840ecae885b8a6472dcbc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:05.647304 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1995/4065] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:27:05 2022] PATCH /identity/v3/domains/15f31945508840ecae885b8a6472dcbc => generated 277 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:27:05.647532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068cfc0-b75f-405d-93c4-5fc8bfa2a0c1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:05.672469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068cfc0-b75f-405d-93c4-5fc8bfa2a0c1 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:05.887291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:05.889216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:05.890006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:05.890601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/domains/15f31945508840ecae885b8a6472dcbc` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:05.912389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=15f31945508840ecae885b8a6472dcbc)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:05.917621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:05.951525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '15f31945508840ecae885b8a6472dcbc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:05.968376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '15f31945508840ecae885b8a6472dcbc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:06.109259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15f31945508840ecae885b8a6472dcbc', 'request_id': 'req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:06.127847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15f31945508840ecae885b8a6472dcbc', 'request_id': 'req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:06.143752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15f31945508840ecae885b8a6472dcbc', 'request_id': 'req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:06.232835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] The token cache is being invalidate because project 15f31945508840ecae885b8a6472dcbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:06.233275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:06.236248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:06.261624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '15f31945508840ecae885b8a6472dcbc', 'request_id': 'req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:06.263712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '15f31945508840ecae885b8a6472dcbc', 'request_id': 'req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:06.265491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '15f31945508840ecae885b8a6472dcbc', 'request_id': 'req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:06.303581 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2071/4066] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:27:05 2022] DELETE /identity/v3/domains/15f31945508840ecae885b8a6472dcbc => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:06.308792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576292fd-f45d-4a58-926e-8e5c2a608dcc tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:06.326517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-576292fd-f45d-4a58-926e-8e5c2a608dcc tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:06.424248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576292fd-f45d-4a58-926e-8e5c2a608dcc tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:06.573299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a167dc-23a0-4c4a-b963-dff099341934 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:06.574122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a167dc-23a0-4c4a-b963-dff099341934 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:06.574678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a167dc-23a0-4c4a-b963-dff099341934 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:06.575054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a167dc-23a0-4c4a-b963-dff099341934 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:06.575973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a167dc-23a0-4c4a-b963-dff099341934 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:06.578211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a167dc-23a0-4c4a-b963-dff099341934 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:06.583507 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:06.666788 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1996/4067] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:27:06 2022] POST /identity/v3/domains => generated 276 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:06.671191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:06.673595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:06.709365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4cfda-e6cc-4ae7-85e5-df1438cc3e8a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:06.810473 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:06.878410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c19e1-6747-499c-9c6b-c75cff2e39cc tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:06.879341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c19e1-6747-499c-9c6b-c75cff2e39cc tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:06.879730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c19e1-6747-499c-9c6b-c75cff2e39cc tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:06.880135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c19e1-6747-499c-9c6b-c75cff2e39cc tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:06.881004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c19e1-6747-499c-9c6b-c75cff2e39cc tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:06.884294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c19e1-6747-499c-9c6b-c75cff2e39cc tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:07.001569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae88e2-0016-4719-8e33-35685ea5b68c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:07.001864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae88e2-0016-4719-8e33-35685ea5b68c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:07.005824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae88e2-0016-4719-8e33-35685ea5b68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:07.033414 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2072/4068] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:27:06 2022] POST /identity/v3/projects => generated 408 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:07.034697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c19e1-6747-499c-9c6b-c75cff2e39cc tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:07.099324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d4ae88e2-0016-4719-8e33-35685ea5b68c None None] MFA Rules not processed for user `013b13b6d741411a95806dce36c2bd20`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:07.101736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d4ae88e2-0016-4719-8e33-35685ea5b68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:07.269884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c19e1-6747-499c-9c6b-c75cff2e39cc tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:07.290645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a23e8b-72a0-4d23-aabb-845ecdc4e92a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:07.290645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a23e8b-72a0-4d23-aabb-845ecdc4e92a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:07.290645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a23e8b-72a0-4d23-aabb-845ecdc4e92a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:07.291780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a23e8b-72a0-4d23-aabb-845ecdc4e92a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:07.291780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a23e8b-72a0-4d23-aabb-845ecdc4e92a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:07.296551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a23e8b-72a0-4d23-aabb-845ecdc4e92a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:07.318740 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1997/4069] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:27:07.659438 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2073/4070] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:27:07 2022] POST /identity/v3/projects => generated 404 bytes in 625 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:07.662399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae88e2-0016-4719-8e33-35685ea5b68c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:07.664844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a23e8b-72a0-4d23-aabb-845ecdc4e92a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:07.671158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-80a23e8b-72a0-4d23-aabb-845ecdc4e92a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:07.683943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae88e2-0016-4719-8e33-35685ea5b68c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:07.793622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f333912-6a78-4617-95f6-37e811952792 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:07.794406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f333912-6a78-4617-95f6-37e811952792 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:07.794891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f333912-6a78-4617-95f6-37e811952792 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:07.795347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f333912-6a78-4617-95f6-37e811952792 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/168dd233aae34f818a985c38aa9b041c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:07.796802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f333912-6a78-4617-95f6-37e811952792 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:delete_project(project_id=168dd233aae34f818a985c38aa9b041c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:07.799145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f333912-6a78-4617-95f6-37e811952792 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:07.811001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a23e8b-72a0-4d23-aabb-845ecdc4e92a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:07.824596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7282390-d860-47ac-ace9-d92420599e10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:07.825488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7282390-d860-47ac-ace9-d92420599e10 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:07.826024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7282390-d860-47ac-ace9-d92420599e10 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:07.826334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7282390-d860-47ac-ace9-d92420599e10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:07.864242 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:07.918773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7282390-d860-47ac-ace9-d92420599e10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:07.920777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7282390-d860-47ac-ace9-d92420599e10 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:07.933408 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2074/4071] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:27:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:27:07.977054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4f333912-6a78-4617-95f6-37e811952792 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '168dd233aae34f818a985c38aa9b041c', 'request_id': 'req-4f333912-6a78-4617-95f6-37e811952792'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:08.084425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4f333912-6a78-4617-95f6-37e811952792 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '168dd233aae34f818a985c38aa9b041c', 'request_id': 'req-4f333912-6a78-4617-95f6-37e811952792'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:08.093615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4f333912-6a78-4617-95f6-37e811952792 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '168dd233aae34f818a985c38aa9b041c', 'request_id': 'req-4f333912-6a78-4617-95f6-37e811952792'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:08.113591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4f333912-6a78-4617-95f6-37e811952792 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] The token cache is being invalidate because project 168dd233aae34f818a985c38aa9b041c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:08.114378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4f333912-6a78-4617-95f6-37e811952792 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:08.115409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4f333912-6a78-4617-95f6-37e811952792 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:08.118272 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1998/4072] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:07 2022] DELETE /identity/v3/projects/168dd233aae34f818a985c38aa9b041c => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:08.125539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7282390-d860-47ac-ace9-d92420599e10 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:08.137783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7282390-d860-47ac-ace9-d92420599e10 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:08.277829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b488f-f3f5-4e23-be09-7abe7398a3aa tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:08.279040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b488f-f3f5-4e23-be09-7abe7398a3aa tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:08.279474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b488f-f3f5-4e23-be09-7abe7398a3aa tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:08.279916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b488f-f3f5-4e23-be09-7abe7398a3aa tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/16923ad6c7a74bcbb47a7f53a5dd3ad5` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:08.287774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b488f-f3f5-4e23-be09-7abe7398a3aa tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:delete_project(project_id=16923ad6c7a74bcbb47a7f53a5dd3ad5)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:08.291658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b488f-f3f5-4e23-be09-7abe7398a3aa tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:08.575017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d71b488f-f3f5-4e23-be09-7abe7398a3aa tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16923ad6c7a74bcbb47a7f53a5dd3ad5', 'request_id': 'req-d71b488f-f3f5-4e23-be09-7abe7398a3aa'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:08.597966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d71b488f-f3f5-4e23-be09-7abe7398a3aa tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16923ad6c7a74bcbb47a7f53a5dd3ad5', 'request_id': 'req-d71b488f-f3f5-4e23-be09-7abe7398a3aa'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:08.620713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d71b488f-f3f5-4e23-be09-7abe7398a3aa tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16923ad6c7a74bcbb47a7f53a5dd3ad5', 'request_id': 'req-d71b488f-f3f5-4e23-be09-7abe7398a3aa'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:08.706463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d71b488f-f3f5-4e23-be09-7abe7398a3aa tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] The token cache is being invalidate because project 16923ad6c7a74bcbb47a7f53a5dd3ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:08.710411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d71b488f-f3f5-4e23-be09-7abe7398a3aa tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:08.710411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d71b488f-f3f5-4e23-be09-7abe7398a3aa tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:08.711955 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2075/4073] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:08 2022] DELETE /identity/v3/projects/16923ad6c7a74bcbb47a7f53a5dd3ad5 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:08.715896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f333912-6a78-4617-95f6-37e811952792 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:08.717981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4f333912-6a78-4617-95f6-37e811952792 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:08.741000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f333912-6a78-4617-95f6-37e811952792 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:08.773226 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:08.912346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016748d0-db70-4d6f-a4a9-004d8afd5031 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:08.913821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016748d0-db70-4d6f-a4a9-004d8afd5031 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:08.914421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016748d0-db70-4d6f-a4a9-004d8afd5031 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:08.914872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016748d0-db70-4d6f-a4a9-004d8afd5031 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/domains/1416841065104301ab0611249785c431` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:08.917755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016748d0-db70-4d6f-a4a9-004d8afd5031 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1416841065104301ab0611249785c431)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:08.919619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016748d0-db70-4d6f-a4a9-004d8afd5031 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:08.949715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-016748d0-db70-4d6f-a4a9-004d8afd5031 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1416841065104301ab0611249785c431'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:08.950955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-016748d0-db70-4d6f-a4a9-004d8afd5031 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1416841065104301ab0611249785c431'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:09.056108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-016748d0-db70-4d6f-a4a9-004d8afd5031 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1416841065104301ab0611249785c431'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:09.063718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-016748d0-db70-4d6f-a4a9-004d8afd5031 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1416841065104301ab0611249785c431'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:09.069830 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 1999/4074] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:27:08 2022] PATCH /identity/v3/domains/1416841065104301ab0611249785c431 => generated 277 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:27:09.075642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b488f-f3f5-4e23-be09-7abe7398a3aa tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:09.087474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d71b488f-f3f5-4e23-be09-7abe7398a3aa tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:09.106973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f3b43-e42f-422b-98bb-9d8e87c505b2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:09.109790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f3b43-e42f-422b-98bb-9d8e87c505b2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:09.109790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f3b43-e42f-422b-98bb-9d8e87c505b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:09.120873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b488f-f3f5-4e23-be09-7abe7398a3aa tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:09.132819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9c7f3b43-e42f-422b-98bb-9d8e87c505b2 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:09.136840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9c7f3b43-e42f-422b-98bb-9d8e87c505b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:09.259828 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2000/4075] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:27:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:09.297194 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:09.322072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28d6ca-a873-4540-8cad-68843210d3a7 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:09.323248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28d6ca-a873-4540-8cad-68843210d3a7 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:09.323537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28d6ca-a873-4540-8cad-68843210d3a7 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:09.323888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b28d6ca-a873-4540-8cad-68843210d3a7 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/domains/1416841065104301ab0611249785c431` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:09.354239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28d6ca-a873-4540-8cad-68843210d3a7 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1416841065104301ab0611249785c431)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:09.356571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b28d6ca-a873-4540-8cad-68843210d3a7 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:09.393570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b28d6ca-a873-4540-8cad-68843210d3a7 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1416841065104301ab0611249785c431'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:09.416414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b28d6ca-a873-4540-8cad-68843210d3a7 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1416841065104301ab0611249785c431'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:09.434351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f3b43-e42f-422b-98bb-9d8e87c505b2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:09.436448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9c7f3b43-e42f-422b-98bb-9d8e87c505b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:09.613104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b28d6ca-a873-4540-8cad-68843210d3a7 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1416841065104301ab0611249785c431', 'request_id': 'req-6b28d6ca-a873-4540-8cad-68843210d3a7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:09.624081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b28d6ca-a873-4540-8cad-68843210d3a7 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1416841065104301ab0611249785c431', 'request_id': 'req-6b28d6ca-a873-4540-8cad-68843210d3a7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:09.636702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b28d6ca-a873-4540-8cad-68843210d3a7 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1416841065104301ab0611249785c431', 'request_id': 'req-6b28d6ca-a873-4540-8cad-68843210d3a7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:09.646026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f3b43-e42f-422b-98bb-9d8e87c505b2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:09.653555 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:09.715108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b28d6ca-a873-4540-8cad-68843210d3a7 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] The token cache is being invalidate because project 1416841065104301ab0611249785c431 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:09.715452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b28d6ca-a873-4540-8cad-68843210d3a7 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:09.716608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b28d6ca-a873-4540-8cad-68843210d3a7 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:09.738481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b28d6ca-a873-4540-8cad-68843210d3a7 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1416841065104301ab0611249785c431', 'request_id': 'req-6b28d6ca-a873-4540-8cad-68843210d3a7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:09.740415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b28d6ca-a873-4540-8cad-68843210d3a7 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1416841065104301ab0611249785c431', 'request_id': 'req-6b28d6ca-a873-4540-8cad-68843210d3a7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:09.741574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b28d6ca-a873-4540-8cad-68843210d3a7 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1416841065104301ab0611249785c431', 'request_id': 'req-6b28d6ca-a873-4540-8cad-68843210d3a7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:09.761558 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2076/4076] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:27:09 2022] DELETE /identity/v3/domains/1416841065104301ab0611249785c431 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:09.763227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28d6ca-a873-4540-8cad-68843210d3a7 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:09.766850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6b28d6ca-a873-4540-8cad-68843210d3a7 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:09.773408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50a582-ce57-4dc2-93db-41619b9c2f37 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:09.774829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50a582-ce57-4dc2-93db-41619b9c2f37 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:09.775315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50a582-ce57-4dc2-93db-41619b9c2f37 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:09.775758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50a582-ce57-4dc2-93db-41619b9c2f37 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:09.779315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4a50a582-ce57-4dc2-93db-41619b9c2f37 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:09.958242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50a582-ce57-4dc2-93db-41619b9c2f37 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:09.961607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50a582-ce57-4dc2-93db-41619b9c2f37 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:09.996492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b28d6ca-a873-4540-8cad-68843210d3a7 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:09.999239 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2001/4077] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:27:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:27:10.004112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50a582-ce57-4dc2-93db-41619b9c2f37 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:10.008215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4a50a582-ce57-4dc2-93db-41619b9c2f37 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:10.019713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8e063-b1b7-47b6-ba76-88a931880428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:10.019713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8e063-b1b7-47b6-ba76-88a931880428 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:10.020363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8e063-b1b7-47b6-ba76-88a931880428 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:10.020363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8e063-b1b7-47b6-ba76-88a931880428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:10.027109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e6c8e063-b1b7-47b6-ba76-88a931880428 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:10.071690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8e063-b1b7-47b6-ba76-88a931880428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:10.079171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8e063-b1b7-47b6-ba76-88a931880428 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:10.129876 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2077/4078] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:27:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:27:10.224873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50a582-ce57-4dc2-93db-41619b9c2f37 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:10.234860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc9ac2-0690-4c88-9f26-44945a5c030b tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:10.235552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc9ac2-0690-4c88-9f26-44945a5c030b tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:10.236433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc9ac2-0690-4c88-9f26-44945a5c030b tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:10.236738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc9ac2-0690-4c88-9f26-44945a5c030b tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:10.237502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc9ac2-0690-4c88-9f26-44945a5c030b tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:10.243632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc9ac2-0690-4c88-9f26-44945a5c030b tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:10.429624 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2002/4079] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:27:09 2022] POST /identity/v3/projects => generated 378 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:10.430843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8e063-b1b7-47b6-ba76-88a931880428 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:10.451023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8e063-b1b7-47b6-ba76-88a931880428 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:10.480197 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:10.602873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a752b7-0f8e-419a-83c6-79a59c7d4b72 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:10.604756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a752b7-0f8e-419a-83c6-79a59c7d4b72 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:10.606478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a752b7-0f8e-419a-83c6-79a59c7d4b72 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:10.606963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a752b7-0f8e-419a-83c6-79a59c7d4b72 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/eee8d8feec7e464a975f9f88fa156a1d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:10.612643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a752b7-0f8e-419a-83c6-79a59c7d4b72 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:get_project(project_id=eee8d8feec7e464a975f9f88fa156a1d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:10.620857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a752b7-0f8e-419a-83c6-79a59c7d4b72 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:10.627281 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2078/4080] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:27:10 2022] GET /identity/v3/projects/eee8d8feec7e464a975f9f88fa156a1d => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:27:10.630465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc9ac2-0690-4c88-9f26-44945a5c030b tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:10.650582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc9ac2-0690-4c88-9f26-44945a5c030b tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:10.686600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c40275-2e89-4508-b229-5dc3a7e3bfe2 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:10.694013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c40275-2e89-4508-b229-5dc3a7e3bfe2 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:10.694587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c40275-2e89-4508-b229-5dc3a7e3bfe2 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:10.695068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c40275-2e89-4508-b229-5dc3a7e3bfe2 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:10.699838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c40275-2e89-4508-b229-5dc3a7e3bfe2 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:10.701971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c40275-2e89-4508-b229-5dc3a7e3bfe2 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:10.791351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a752b7-0f8e-419a-83c6-79a59c7d4b72 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:10.811348 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2003/4081] 10.222.0.43 () {58 vars in 1130 bytes} [Tue Jul 19 14:27:10 2022] GET /identity/v3/projects => generated 6238 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:10.815128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a752b7-0f8e-419a-83c6-79a59c7d4b72 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:10.828145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dee19a-2a7a-4f04-af80-ff97a6145c7e tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:10.829385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dee19a-2a7a-4f04-af80-ff97a6145c7e tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:10.829860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dee19a-2a7a-4f04-af80-ff97a6145c7e tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:10.830590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dee19a-2a7a-4f04-af80-ff97a6145c7e tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/eee8d8feec7e464a975f9f88fa156a1d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:10.837632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dee19a-2a7a-4f04-af80-ff97a6145c7e tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:delete_project(project_id=eee8d8feec7e464a975f9f88fa156a1d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:10.841308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dee19a-2a7a-4f04-af80-ff97a6145c7e tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:11.115711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b8dee19a-2a7a-4f04-af80-ff97a6145c7e tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eee8d8feec7e464a975f9f88fa156a1d', 'request_id': 'req-b8dee19a-2a7a-4f04-af80-ff97a6145c7e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:11.171054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b8dee19a-2a7a-4f04-af80-ff97a6145c7e tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eee8d8feec7e464a975f9f88fa156a1d', 'request_id': 'req-b8dee19a-2a7a-4f04-af80-ff97a6145c7e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:11.190517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b8dee19a-2a7a-4f04-af80-ff97a6145c7e tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eee8d8feec7e464a975f9f88fa156a1d', 'request_id': 'req-b8dee19a-2a7a-4f04-af80-ff97a6145c7e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:11.304429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b8dee19a-2a7a-4f04-af80-ff97a6145c7e tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] The token cache is being invalidate because project eee8d8feec7e464a975f9f88fa156a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:11.304759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b8dee19a-2a7a-4f04-af80-ff97a6145c7e tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:11.307100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b8dee19a-2a7a-4f04-af80-ff97a6145c7e tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:11.321686 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2079/4082] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:10 2022] DELETE /identity/v3/projects/eee8d8feec7e464a975f9f88fa156a1d => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:11.323158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c40275-2e89-4508-b229-5dc3a7e3bfe2 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:11.325364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-91c40275-2e89-4508-b229-5dc3a7e3bfe2 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:11.360714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c40275-2e89-4508-b229-5dc3a7e3bfe2 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:11.467210 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:11.635758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f44565-4cbc-4378-a90d-4f942bc164f5 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:11.636472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f44565-4cbc-4378-a90d-4f942bc164f5 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:11.636774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f44565-4cbc-4378-a90d-4f942bc164f5 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:11.637163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f44565-4cbc-4378-a90d-4f942bc164f5 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:11.638297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f44565-4cbc-4378-a90d-4f942bc164f5 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:11.641423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f44565-4cbc-4378-a90d-4f942bc164f5 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:11.664297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dee19a-2a7a-4f04-af80-ff97a6145c7e tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:11.666949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b8dee19a-2a7a-4f04-af80-ff97a6145c7e tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:11.765440 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2004/4083] 10.222.0.43 () {60 vars in 1151 bytes} [Tue Jul 19 14:27:11 2022] POST /identity/v3/projects => generated 346 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:11.770239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f44565-4cbc-4378-a90d-4f942bc164f5 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:11.953986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f44565-4cbc-4378-a90d-4f942bc164f5 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:11.967754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f49db9-ce76-415d-9e99-c7f487ce1f92 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:11.968627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f49db9-ce76-415d-9e99-c7f487ce1f92 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:11.968918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f49db9-ce76-415d-9e99-c7f487ce1f92 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:11.969193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f49db9-ce76-415d-9e99-c7f487ce1f92 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/81f9cf6fdcce44ff87d6edcae25acbb1` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:11.973561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f49db9-ce76-415d-9e99-c7f487ce1f92 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:update_project(project_id=81f9cf6fdcce44ff87d6edcae25acbb1)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:11.975902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f49db9-ce76-415d-9e99-c7f487ce1f92 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:11.994662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dee19a-2a7a-4f04-af80-ff97a6145c7e tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:12.132005 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2005/4084] 10.222.0.43 () {60 vars in 1251 bytes} [Tue Jul 19 14:27:11 2022] PATCH /identity/v3/projects/81f9cf6fdcce44ff87d6edcae25acbb1 => generated 361 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:27:12.136355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f49db9-ce76-415d-9e99-c7f487ce1f92 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:12.148985 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:12.168001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f49db9-ce76-415d-9e99-c7f487ce1f92 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:12.187729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2245c80-559f-46ff-96d1-e61083bf7e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:12.190700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2245c80-559f-46ff-96d1-e61083bf7e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:12.192889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2245c80-559f-46ff-96d1-e61083bf7e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:12.192889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2245c80-559f-46ff-96d1-e61083bf7e5b admin admin] PATH_INFO: `/v3/users/76bd949bbb4a47a6aa32a00e82767058` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:12.194615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2245c80-559f-46ff-96d1-e61083bf7e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=76bd949bbb4a47a6aa32a00e82767058)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:12.200500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c124cdd-9f97-451b-baac-cc9728013907 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:12.201337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c124cdd-9f97-451b-baac-cc9728013907 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:12.201598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2245c80-559f-46ff-96d1-e61083bf7e5b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:12.201722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c124cdd-9f97-451b-baac-cc9728013907 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:12.201886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c124cdd-9f97-451b-baac-cc9728013907 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/81f9cf6fdcce44ff87d6edcae25acbb1` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:12.244773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c124cdd-9f97-451b-baac-cc9728013907 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:get_project(project_id=81f9cf6fdcce44ff87d6edcae25acbb1)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:12.246996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c124cdd-9f97-451b-baac-cc9728013907 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:12.258724 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2006/4085] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:27:12 2022] GET /identity/v3/projects/81f9cf6fdcce44ff87d6edcae25acbb1 => generated 348 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:27:12.259920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c124cdd-9f97-451b-baac-cc9728013907 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:12.300410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c124cdd-9f97-451b-baac-cc9728013907 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:12.316023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444e04a-4298-4cad-bc8b-8c26061d5e4a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:12.316928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444e04a-4298-4cad-bc8b-8c26061d5e4a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:12.317216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444e04a-4298-4cad-bc8b-8c26061d5e4a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:12.317498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444e04a-4298-4cad-bc8b-8c26061d5e4a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/81f9cf6fdcce44ff87d6edcae25acbb1` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:12.318792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444e04a-4298-4cad-bc8b-8c26061d5e4a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:delete_project(project_id=81f9cf6fdcce44ff87d6edcae25acbb1)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:12.320723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444e04a-4298-4cad-bc8b-8c26061d5e4a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:12.416678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d2245c80-559f-46ff-96d1-e61083bf7e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76bd949bbb4a47a6aa32a00e82767058'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:12.438456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d2245c80-559f-46ff-96d1-e61083bf7e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76bd949bbb4a47a6aa32a00e82767058'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:12.448868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d2245c80-559f-46ff-96d1-e61083bf7e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76bd949bbb4a47a6aa32a00e82767058'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:12.449675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d2245c80-559f-46ff-96d1-e61083bf7e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76bd949bbb4a47a6aa32a00e82767058'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:12.498806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a444e04a-4298-4cad-bc8b-8c26061d5e4a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81f9cf6fdcce44ff87d6edcae25acbb1', 'request_id': 'req-a444e04a-4298-4cad-bc8b-8c26061d5e4a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:12.501200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d2245c80-559f-46ff-96d1-e61083bf7e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76bd949bbb4a47a6aa32a00e82767058'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:12.511324 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2080/4086] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:27:11 2022] DELETE /identity/v3/users/76bd949bbb4a47a6aa32a00e82767058 => generated 0 bytes in 848 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:12.514762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2245c80-559f-46ff-96d1-e61083bf7e5b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:12.528829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d2245c80-559f-46ff-96d1-e61083bf7e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:12.638503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a444e04a-4298-4cad-bc8b-8c26061d5e4a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81f9cf6fdcce44ff87d6edcae25acbb1', 'request_id': 'req-a444e04a-4298-4cad-bc8b-8c26061d5e4a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:12.660570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a444e04a-4298-4cad-bc8b-8c26061d5e4a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81f9cf6fdcce44ff87d6edcae25acbb1', 'request_id': 'req-a444e04a-4298-4cad-bc8b-8c26061d5e4a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:12.673185 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:UPDATE=1,keystone:DELETE=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:12.707594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a444e04a-4298-4cad-bc8b-8c26061d5e4a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] The token cache is being invalidate because project 81f9cf6fdcce44ff87d6edcae25acbb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:12.707887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a444e04a-4298-4cad-bc8b-8c26061d5e4a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:12.719188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a444e04a-4298-4cad-bc8b-8c26061d5e4a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:12.722925 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2007/4087] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:12 2022] DELETE /identity/v3/projects/81f9cf6fdcce44ff87d6edcae25acbb1 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:12.734276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444e04a-4298-4cad-bc8b-8c26061d5e4a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:12.737671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a444e04a-4298-4cad-bc8b-8c26061d5e4a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:12.737983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2245c80-559f-46ff-96d1-e61083bf7e5b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:12.753783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ea50e-92ac-465c-a527-a486a52551e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:12.757162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ea50e-92ac-465c-a527-a486a52551e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:12.757162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ea50e-92ac-465c-a527-a486a52551e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:12.757162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ea50e-92ac-465c-a527-a486a52551e6 admin admin] PATH_INFO: `/v3/users/de2b1234a0794559850d628fdd801a4f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:12.757876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ea50e-92ac-465c-a527-a486a52551e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de2b1234a0794559850d628fdd801a4f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:12.763009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ea50e-92ac-465c-a527-a486a52551e6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:12.923090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444e04a-4298-4cad-bc8b-8c26061d5e4a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:12.982499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b96ea50e-92ac-465c-a527-a486a52551e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de2b1234a0794559850d628fdd801a4f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:13.000273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b96ea50e-92ac-465c-a527-a486a52551e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de2b1234a0794559850d628fdd801a4f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:13.014154 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:13.020282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b96ea50e-92ac-465c-a527-a486a52551e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de2b1234a0794559850d628fdd801a4f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:13.022667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b96ea50e-92ac-465c-a527-a486a52551e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de2b1234a0794559850d628fdd801a4f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:13.063087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f70a1-ca43-4057-ac53-a06da7f4ab7a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:13.064057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f70a1-ca43-4057-ac53-a06da7f4ab7a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:13.064406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f70a1-ca43-4057-ac53-a06da7f4ab7a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:13.065297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32f70a1-ca43-4057-ac53-a06da7f4ab7a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:13.068339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f70a1-ca43-4057-ac53-a06da7f4ab7a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:13.068339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32f70a1-ca43-4057-ac53-a06da7f4ab7a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:13.113335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b96ea50e-92ac-465c-a527-a486a52551e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de2b1234a0794559850d628fdd801a4f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:13.120982 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2081/4088] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:27:12 2022] DELETE /identity/v3/users/de2b1234a0794559850d628fdd801a4f => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:13.198369 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2008/4089] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:27:12 2022] POST /identity/v3/projects => generated 360 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:13.204716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ea50e-92ac-465c-a527-a486a52551e6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:13.204716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b96ea50e-92ac-465c-a527-a486a52551e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:13.355807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ea50e-92ac-465c-a527-a486a52551e6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:13.487969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2a1fb-559f-47c7-82c5-a8f9513d699a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:13.488894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2a1fb-559f-47c7-82c5-a8f9513d699a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:13.489185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2a1fb-559f-47c7-82c5-a8f9513d699a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:13.489474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd2a1fb-559f-47c7-82c5-a8f9513d699a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/37cd348ea5a34b78b2f4128e891e5ec0` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:13.490810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2a1fb-559f-47c7-82c5-a8f9513d699a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:update_project(project_id=37cd348ea5a34b78b2f4128e891e5ec0)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:13.491845 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-4dd2a1fb-559f-47c7-82c5-a8f9513d699a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:27:13.491845 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:27:13.491845 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:27:13.493041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd2a1fb-559f-47c7-82c5-a8f9513d699a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:13.690498 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2082/4090] 10.222.0.43 () {60 vars in 1251 bytes} [Tue Jul 19 14:27:13 2022] PATCH /identity/v3/projects/37cd348ea5a34b78b2f4128e891e5ec0 => generated 372 bytes in 486 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:27:13.692194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f70a1-ca43-4057-ac53-a06da7f4ab7a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:13.707804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32f70a1-ca43-4057-ac53-a06da7f4ab7a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:13.721721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100482a5-bea4-4bb1-809f-06e064c0a682 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:13.723163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100482a5-bea4-4bb1-809f-06e064c0a682 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:13.723634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100482a5-bea4-4bb1-809f-06e064c0a682 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:13.724193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100482a5-bea4-4bb1-809f-06e064c0a682 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/37cd348ea5a34b78b2f4128e891e5ec0` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:13.768529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100482a5-bea4-4bb1-809f-06e064c0a682 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:get_project(project_id=37cd348ea5a34b78b2f4128e891e5ec0)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:13.768529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100482a5-bea4-4bb1-809f-06e064c0a682 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:13.779012 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2009/4091] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:27:13 2022] GET /identity/v3/projects/37cd348ea5a34b78b2f4128e891e5ec0 => generated 359 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:27:13.780604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2a1fb-559f-47c7-82c5-a8f9513d699a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:13.795882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd2a1fb-559f-47c7-82c5-a8f9513d699a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:13.814525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01b978-8ab7-4db3-87ff-d4b8f217f90a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:13.815454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01b978-8ab7-4db3-87ff-d4b8f217f90a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:13.815746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01b978-8ab7-4db3-87ff-d4b8f217f90a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:13.816026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01b978-8ab7-4db3-87ff-d4b8f217f90a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/37cd348ea5a34b78b2f4128e891e5ec0` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:13.821301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01b978-8ab7-4db3-87ff-d4b8f217f90a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:delete_project(project_id=37cd348ea5a34b78b2f4128e891e5ec0)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:13.825779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b01b978-8ab7-4db3-87ff-d4b8f217f90a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:13.980743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b01b978-8ab7-4db3-87ff-d4b8f217f90a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37cd348ea5a34b78b2f4128e891e5ec0', 'request_id': 'req-7b01b978-8ab7-4db3-87ff-d4b8f217f90a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:13.983743 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=5,keystone:UPDATE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:14.000395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b01b978-8ab7-4db3-87ff-d4b8f217f90a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37cd348ea5a34b78b2f4128e891e5ec0', 'request_id': 'req-7b01b978-8ab7-4db3-87ff-d4b8f217f90a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:14.011798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b01b978-8ab7-4db3-87ff-d4b8f217f90a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37cd348ea5a34b78b2f4128e891e5ec0', 'request_id': 'req-7b01b978-8ab7-4db3-87ff-d4b8f217f90a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:14.078435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100482a5-bea4-4bb1-809f-06e064c0a682 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:14.085995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-100482a5-bea4-4bb1-809f-06e064c0a682 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:14.121224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b01b978-8ab7-4db3-87ff-d4b8f217f90a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] The token cache is being invalidate because project 37cd348ea5a34b78b2f4128e891e5ec0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:14.121935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b01b978-8ab7-4db3-87ff-d4b8f217f90a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:14.123679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b01b978-8ab7-4db3-87ff-d4b8f217f90a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:14.129851 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2083/4092] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:13 2022] DELETE /identity/v3/projects/37cd348ea5a34b78b2f4128e891e5ec0 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:14.137643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01b978-8ab7-4db3-87ff-d4b8f217f90a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:14.139136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7b01b978-8ab7-4db3-87ff-d4b8f217f90a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:14.264825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01b978-8ab7-4db3-87ff-d4b8f217f90a tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:14.272697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e5fe7-a32d-4d10-9490-25cbec99d8cf tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:14.273390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e5fe7-a32d-4d10-9490-25cbec99d8cf tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:14.273863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e5fe7-a32d-4d10-9490-25cbec99d8cf tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:14.274175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e5fe7-a32d-4d10-9490-25cbec99d8cf tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:14.275334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e5fe7-a32d-4d10-9490-25cbec99d8cf tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:14.279285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e5fe7-a32d-4d10-9490-25cbec99d8cf tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:14.330748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100482a5-bea4-4bb1-809f-06e064c0a682 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:14.371352 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:14.418386 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2084/4093] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:27:14 2022] POST /identity/v3/projects => generated 354 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:14.419521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e5fe7-a32d-4d10-9490-25cbec99d8cf tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:14.429715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec99fc0-11de-422d-a6bb-d7e9cb7ea1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:14.434783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec99fc0-11de-422d-a6bb-d7e9cb7ea1bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:14.435375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec99fc0-11de-422d-a6bb-d7e9cb7ea1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:14.435993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec99fc0-11de-422d-a6bb-d7e9cb7ea1bc admin admin] PATH_INFO: `/v3/projects/22a99d8ab776495b88588bfc655cef34` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:14.437884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec99fc0-11de-422d-a6bb-d7e9cb7ea1bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=22a99d8ab776495b88588bfc655cef34)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:14.440763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec99fc0-11de-422d-a6bb-d7e9cb7ea1bc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:14.622937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eec99fc0-11de-422d-a6bb-d7e9cb7ea1bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22a99d8ab776495b88588bfc655cef34', 'request_id': 'req-eec99fc0-11de-422d-a6bb-d7e9cb7ea1bc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:14.625908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e5fe7-a32d-4d10-9490-25cbec99d8cf tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:14.710091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eec99fc0-11de-422d-a6bb-d7e9cb7ea1bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22a99d8ab776495b88588bfc655cef34', 'request_id': 'req-eec99fc0-11de-422d-a6bb-d7e9cb7ea1bc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:14.724495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eec99fc0-11de-422d-a6bb-d7e9cb7ea1bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22a99d8ab776495b88588bfc655cef34', 'request_id': 'req-eec99fc0-11de-422d-a6bb-d7e9cb7ea1bc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:14.752183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eec99fc0-11de-422d-a6bb-d7e9cb7ea1bc admin admin] The token cache is being invalidate because project 22a99d8ab776495b88588bfc655cef34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:14.752183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eec99fc0-11de-422d-a6bb-d7e9cb7ea1bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:14.752183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eec99fc0-11de-422d-a6bb-d7e9cb7ea1bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:14.762655 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2010/4094] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:14 2022] DELETE /identity/v3/projects/22a99d8ab776495b88588bfc655cef34 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:27:14.766413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bd636-c1a8-41bd-bbc6-c82fdb6ed11c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:14.766927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bd636-c1a8-41bd-bbc6-c82fdb6ed11c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:14.768843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bd636-c1a8-41bd-bbc6-c82fdb6ed11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:14.827010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1cc6ea-51e3-4492-8456-bd4c2c8bdd26 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:14.827896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cc6ea-51e3-4492-8456-bd4c2c8bdd26 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:14.828332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cc6ea-51e3-4492-8456-bd4c2c8bdd26 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:14.828505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1cc6ea-51e3-4492-8456-bd4c2c8bdd26 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/af21263f483546c9bedb2ceb090b9377` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:14.829858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1cc6ea-51e3-4492-8456-bd4c2c8bdd26 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:update_project(project_id=af21263f483546c9bedb2ceb090b9377)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:14.832183 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1cc6ea-51e3-4492-8456-bd4c2c8bdd26 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:14.838079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e47bd636-c1a8-41bd-bbc6-c82fdb6ed11c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:14.845614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e47bd636-c1a8-41bd-bbc6-c82fdb6ed11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:14.848923 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:14.995794 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2085/4095] 10.222.0.43 () {60 vars in 1251 bytes} [Tue Jul 19 14:27:14 2022] PATCH /identity/v3/projects/af21263f483546c9bedb2ceb090b9377 => generated 368 bytes in 577 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:27:14.996902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1cc6ea-51e3-4492-8456-bd4c2c8bdd26 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:15.006538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ba1cc6ea-51e3-4492-8456-bd4c2c8bdd26 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:15.033742 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2011/4096] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:15.035004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bd636-c1a8-41bd-bbc6-c82fdb6ed11c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:15.039002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e47bd636-c1a8-41bd-bbc6-c82fdb6ed11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:15.063127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1cc6ea-51e3-4492-8456-bd4c2c8bdd26 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:15.081502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1cab0-0434-4d0d-8b77-41263055befd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:15.082247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1cab0-0434-4d0d-8b77-41263055befd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:15.082597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1cab0-0434-4d0d-8b77-41263055befd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:15.090643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf1cab0-0434-4d0d-8b77-41263055befd admin admin] PATH_INFO: `/v3/projects/be46ed6c017e4c988d40ffd281d2a9e2` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:15.091618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bd636-c1a8-41bd-bbc6-c82fdb6ed11c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:15.094394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf1cab0-0434-4d0d-8b77-41263055befd admin admin] RBAC: Authorizing `identity:delete_project(project_id=be46ed6c017e4c988d40ffd281d2a9e2)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:15.097097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf1cab0-0434-4d0d-8b77-41263055befd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:15.126526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403c0c8-ffd5-4b90-9221-c006b7c96c92 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:15.127420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403c0c8-ffd5-4b90-9221-c006b7c96c92 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:15.127709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403c0c8-ffd5-4b90-9221-c006b7c96c92 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:15.128062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403c0c8-ffd5-4b90-9221-c006b7c96c92 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/af21263f483546c9bedb2ceb090b9377` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:15.165045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403c0c8-ffd5-4b90-9221-c006b7c96c92 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:get_project(project_id=af21263f483546c9bedb2ceb090b9377)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:15.170490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7403c0c8-ffd5-4b90-9221-c006b7c96c92 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:15.175178 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2012/4097] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:27:15 2022] GET /identity/v3/projects/af21263f483546c9bedb2ceb090b9377 => generated 355 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:27:15.175779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baef73a-da26-419b-a0b9-d70b2a4a7d76 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:15.176075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baef73a-da26-419b-a0b9-d70b2a4a7d76 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:15.177147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baef73a-da26-419b-a0b9-d70b2a4a7d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:15.201946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5baef73a-da26-419b-a0b9-d70b2a4a7d76 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:15.203787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5baef73a-da26-419b-a0b9-d70b2a4a7d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:15.221048 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2013/4098] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:15.222604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baef73a-da26-419b-a0b9-d70b2a4a7d76 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:15.258029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baef73a-da26-419b-a0b9-d70b2a4a7d76 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:15.268226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0cc04-e0d6-47a4-8b23-8ef5ebd069f3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:15.269311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0cc04-e0d6-47a4-8b23-8ef5ebd069f3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:15.269700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0cc04-e0d6-47a4-8b23-8ef5ebd069f3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:15.270291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0cc04-e0d6-47a4-8b23-8ef5ebd069f3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/projects/af21263f483546c9bedb2ceb090b9377` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:15.271946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0cc04-e0d6-47a4-8b23-8ef5ebd069f3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorizing `identity:delete_project(project_id=af21263f483546c9bedb2ceb090b9377)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:15.274917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0cc04-e0d6-47a4-8b23-8ef5ebd069f3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:15.305893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fbf1cab0-0434-4d0d-8b77-41263055befd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be46ed6c017e4c988d40ffd281d2a9e2', 'request_id': 'req-fbf1cab0-0434-4d0d-8b77-41263055befd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:15.319479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fbf1cab0-0434-4d0d-8b77-41263055befd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be46ed6c017e4c988d40ffd281d2a9e2', 'request_id': 'req-fbf1cab0-0434-4d0d-8b77-41263055befd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:15.341448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fbf1cab0-0434-4d0d-8b77-41263055befd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be46ed6c017e4c988d40ffd281d2a9e2', 'request_id': 'req-fbf1cab0-0434-4d0d-8b77-41263055befd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:15.401293 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:15.447557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b3b0cc04-e0d6-47a4-8b23-8ef5ebd069f3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af21263f483546c9bedb2ceb090b9377', 'request_id': 'req-b3b0cc04-e0d6-47a4-8b23-8ef5ebd069f3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:15.451730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fbf1cab0-0434-4d0d-8b77-41263055befd admin admin] The token cache is being invalidate because project be46ed6c017e4c988d40ffd281d2a9e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:15.452030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fbf1cab0-0434-4d0d-8b77-41263055befd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:15.456846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fbf1cab0-0434-4d0d-8b77-41263055befd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:15.459883 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2086/4099] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:14 2022] DELETE /identity/v3/projects/be46ed6c017e4c988d40ffd281d2a9e2 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:15.466957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1cab0-0434-4d0d-8b77-41263055befd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:15.470689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fbf1cab0-0434-4d0d-8b77-41263055befd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:15.530064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b3b0cc04-e0d6-47a4-8b23-8ef5ebd069f3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af21263f483546c9bedb2ceb090b9377', 'request_id': 'req-b3b0cc04-e0d6-47a4-8b23-8ef5ebd069f3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:15.537778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b3b0cc04-e0d6-47a4-8b23-8ef5ebd069f3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af21263f483546c9bedb2ceb090b9377', 'request_id': 'req-b3b0cc04-e0d6-47a4-8b23-8ef5ebd069f3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:15.559683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b3b0cc04-e0d6-47a4-8b23-8ef5ebd069f3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] The token cache is being invalidate because project af21263f483546c9bedb2ceb090b9377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:15.559924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b3b0cc04-e0d6-47a4-8b23-8ef5ebd069f3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:15.560573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b3b0cc04-e0d6-47a4-8b23-8ef5ebd069f3 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:15.565987 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2014/4100] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:15 2022] DELETE /identity/v3/projects/af21263f483546c9bedb2ceb090b9377 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:15.565987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a39a41-6a12-456c-a08c-227d3e57f0ef None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:15.565987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a39a41-6a12-456c-a08c-227d3e57f0ef None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:15.569007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a39a41-6a12-456c-a08c-227d3e57f0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:15.610766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-47a39a41-6a12-456c-a08c-227d3e57f0ef None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:15.611999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-47a39a41-6a12-456c-a08c-227d3e57f0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:15.617663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf1cab0-0434-4d0d-8b77-41263055befd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:15.720227 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2015/4101] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:15.738143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a39a41-6a12-456c-a08c-227d3e57f0ef None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:15.742582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-47a39a41-6a12-456c-a08c-227d3e57f0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:15.763162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae691d4-0d43-4c2d-a756-772a138570f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:15.780457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae691d4-0d43-4c2d-a756-772a138570f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:15.783732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae691d4-0d43-4c2d-a756-772a138570f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:15.784480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae691d4-0d43-4c2d-a756-772a138570f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:15.787539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae691d4-0d43-4c2d-a756-772a138570f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:27:15.788900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae691d4-0d43-4c2d-a756-772a138570f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:15.803902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae691d4-0d43-4c2d-a756-772a138570f6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:15.869760 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2087/4102] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:27:15.869760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9280-7289-4dab-a1f7-cfb25f00f0c2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:15.870119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9280-7289-4dab-a1f7-cfb25f00f0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:15.870677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c9280-7289-4dab-a1f7-cfb25f00f0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:15.911698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-801c9280-7289-4dab-a1f7-cfb25f00f0c2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:15.913839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-801c9280-7289-4dab-a1f7-cfb25f00f0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:15.942659 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2088/4103] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:15.944032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c9280-7289-4dab-a1f7-cfb25f00f0c2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:15.948169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-801c9280-7289-4dab-a1f7-cfb25f00f0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:15.969906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c9280-7289-4dab-a1f7-cfb25f00f0c2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:15.983395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd645c6e-4be3-4453-8731-63293cb96e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:15.984809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd645c6e-4be3-4453-8731-63293cb96e57 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:15.985357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd645c6e-4be3-4453-8731-63293cb96e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:15.985841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd645c6e-4be3-4453-8731-63293cb96e57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:15.987196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd645c6e-4be3-4453-8731-63293cb96e57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:15.993058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd645c6e-4be3-4453-8731-63293cb96e57 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:16.012722 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:16.024338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a39a41-6a12-456c-a08c-227d3e57f0ef None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:16.032940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092140f0-329f-46d9-9038-c8ca4ec25da4 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:16.034469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092140f0-329f-46d9-9038-c8ca4ec25da4 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:16.035006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092140f0-329f-46d9-9038-c8ca4ec25da4 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:16.035867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092140f0-329f-46d9-9038-c8ca4ec25da4 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/domains/1416841065104301ab0611249785c431` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:16.051055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092140f0-329f-46d9-9038-c8ca4ec25da4 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 14:27:16.074212 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-092140f0-329f-46d9-9038-c8ca4ec25da4 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Could not find domain: 1416841065104301ab0611249785c431.: keystone.exception.DomainNotFound: Could not find domain: 1416841065104301ab0611249785c431. Jul 19 14:27:16.074212 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:27:16.074212 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 14:27:16.074212 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 14:27:16.074212 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 14:27:16.074212 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 14:27:16.074212 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 14:27:16.074212 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 14:27:16.074212 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1416841065104301ab0611249785c431. Jul 19 14:27:16.074212 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:27:16.074212 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:27:16.074212 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:27:16.074212 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:27:16.074212 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:27:16.074212 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:27:16.074212 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:27:16.075563 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:27:16.075563 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:27:16.075563 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:27:16.075563 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:27:16.075563 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:27:16.075563 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:27:16.075563 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:27:16.075563 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 14:27:16.075563 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 14:27:16.075563 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 14:27:16.075563 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 14:27:16.075563 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 14:27:16.075563 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 14:27:16.075563 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:27:16.075563 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:27:16.075563 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:27:16.076705 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:27:16.076705 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:27:16.076705 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:27:16.076705 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:27:16.076705 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 14:27:16.076705 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:27:16.076705 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:27:16.076705 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:27:16.076705 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:27:16.076705 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:27:16.076705 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:27:16.076705 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:27:16.076705 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:27:16.076705 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 14:27:16.076705 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 14:27:16.076705 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1416841065104301ab0611249785c431. Jul 19 14:27:16.076705 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:27:16.078780 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2016/4104] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:27:15 2022] PATCH /identity/v3/domains/1416841065104301ab0611249785c431 => generated 112 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:27:16.078780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092140f0-329f-46d9-9038-c8ca4ec25da4 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:16.108292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092140f0-329f-46d9-9038-c8ca4ec25da4 tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:16.115576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1666c3e-7f34-4ecc-9ccb-1a60ce7e5728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:16.116448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1666c3e-7f34-4ecc-9ccb-1a60ce7e5728 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:16.116839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1666c3e-7f34-4ecc-9ccb-1a60ce7e5728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:16.117256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1666c3e-7f34-4ecc-9ccb-1a60ce7e5728 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:16.118196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1666c3e-7f34-4ecc-9ccb-1a60ce7e5728 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:27:16.118598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1666c3e-7f34-4ecc-9ccb-1a60ce7e5728 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:16.124041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1666c3e-7f34-4ecc-9ccb-1a60ce7e5728 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:16.160900 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2089/4105] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:27:15 2022] POST /identity/v3/projects => generated 397 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:16.162157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd645c6e-4be3-4453-8731-63293cb96e57 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:16.163282 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2017/4106] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:27:16.165003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1666c3e-7f34-4ecc-9ccb-1a60ce7e5728 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:16.196886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1666c3e-7f34-4ecc-9ccb-1a60ce7e5728 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:16.346703 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:16.351331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd645c6e-4be3-4453-8731-63293cb96e57 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:16.361834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a392468-3f84-4f09-ac2c-ee90089d3f6d tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e8aa7ea0f2be45f787371d1c28a51ce3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6ef66e6fd42349b883344b86b9ecb050', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:16.368141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a392468-3f84-4f09-ac2c-ee90089d3f6d tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:16.369215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a392468-3f84-4f09-ac2c-ee90089d3f6d tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:16.369857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a392468-3f84-4f09-ac2c-ee90089d3f6d tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] PATH_INFO: `/v3/domains/15f31945508840ecae885b8a6472dcbc` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:16.390498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a392468-3f84-4f09-ac2c-ee90089d3f6d tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 14:27:16.412767 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-5a392468-3f84-4f09-ac2c-ee90089d3f6d tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Could not find domain: 15f31945508840ecae885b8a6472dcbc.: keystone.exception.DomainNotFound: Could not find domain: 15f31945508840ecae885b8a6472dcbc. Jul 19 14:27:16.412767 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:27:16.412767 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 14:27:16.412767 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 14:27:16.412767 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 14:27:16.412767 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 14:27:16.412767 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 14:27:16.412767 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 14:27:16.412767 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 15f31945508840ecae885b8a6472dcbc. Jul 19 14:27:16.412767 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:27:16.412767 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:27:16.412767 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:27:16.412767 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:27:16.412767 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:27:16.412767 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:27:16.412767 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:27:16.414059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:27:16.414059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:27:16.414059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:27:16.414059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:27:16.414059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:27:16.414059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:27:16.414059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:27:16.414059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 14:27:16.414059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 14:27:16.414059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 14:27:16.414059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 14:27:16.414059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 14:27:16.414059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 14:27:16.414059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:27:16.414059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:27:16.414059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:27:16.415138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:27:16.415138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:27:16.415138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:27:16.415138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:27:16.415138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 14:27:16.415138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:27:16.415138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:27:16.415138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:27:16.415138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:27:16.415138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:27:16.415138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:27:16.415138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:27:16.415138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:27:16.415138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 14:27:16.415138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 14:27:16.415138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 15f31945508840ecae885b8a6472dcbc. Jul 19 14:27:16.415138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:27:16.420227 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2090/4107] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:27:16 2022] PATCH /identity/v3/domains/15f31945508840ecae885b8a6472dcbc => generated 112 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:27:16.422019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a392468-3f84-4f09-ac2c-ee90089d3f6d tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:16.425409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47309c63-88ec-4759-83d2-51f3a688761a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:16.426800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47309c63-88ec-4759-83d2-51f3a688761a admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:16.427288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47309c63-88ec-4759-83d2-51f3a688761a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:16.427863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47309c63-88ec-4759-83d2-51f3a688761a admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:16.435006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47309c63-88ec-4759-83d2-51f3a688761a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:16.444727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47309c63-88ec-4759-83d2-51f3a688761a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:16.445170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a392468-3f84-4f09-ac2c-ee90089d3f6d tempest-ProjectsTestJSON-200879094 tempest-ProjectsTestJSON-200879094-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:16.466319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b5366-a8ee-4074-b7cd-81f1477fc7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:16.466319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b5366-a8ee-4074-b7cd-81f1477fc7ac admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:16.466319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b5366-a8ee-4074-b7cd-81f1477fc7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:16.466319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b5366-a8ee-4074-b7cd-81f1477fc7ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:16.467194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b5366-a8ee-4074-b7cd-81f1477fc7ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:16.469636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179b5366-a8ee-4074-b7cd-81f1477fc7ac admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:16.609319 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2091/4108] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:27:16 2022] POST /identity/v3/projects => generated 375 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:16.609319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b5366-a8ee-4074-b7cd-81f1477fc7ac admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:16.626702 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2018/4109] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:27:16 2022] POST /identity/v3/users => generated 299 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:16.627793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47309c63-88ec-4759-83d2-51f3a688761a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:16.631987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-179b5366-a8ee-4074-b7cd-81f1477fc7ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:16.659713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47309c63-88ec-4759-83d2-51f3a688761a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:16.771337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7f2b2-c297-4a6d-a595-26d5a66f378f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:16.772732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7f2b2-c297-4a6d-a595-26d5a66f378f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:16.773028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7f2b2-c297-4a6d-a595-26d5a66f378f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:16.773564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7f2b2-c297-4a6d-a595-26d5a66f378f admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:16.774779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7f2b2-c297-4a6d-a595-26d5a66f378f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:16.778137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7f2b2-c297-4a6d-a595-26d5a66f378f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:16.791363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b5366-a8ee-4074-b7cd-81f1477fc7ac admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:16.799175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb5ef0-65b8-4abb-b3ab-d736f6ef8e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:16.800479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb5ef0-65b8-4abb-b3ab-d736f6ef8e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:16.800934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb5ef0-65b8-4abb-b3ab-d736f6ef8e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:16.801385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb5ef0-65b8-4abb-b3ab-d736f6ef8e2f admin admin] PATH_INFO: `/v3/users/7511957de5294fb2b5ca686458af6c8d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:16.802849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb5ef0-65b8-4abb-b3ab-d736f6ef8e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7511957de5294fb2b5ca686458af6c8d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:16.805551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb5ef0-65b8-4abb-b3ab-d736f6ef8e2f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:16.857519 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2019/4110] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:27:16 2022] POST /identity/v3/users => generated 288 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:16.857519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7f2b2-c297-4a6d-a595-26d5a66f378f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:16.872954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7f2b2-c297-4a6d-a595-26d5a66f378f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:16.879451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a7851-61d1-4c19-a48e-f2cab813a73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:16.880495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a7851-61d1-4c19-a48e-f2cab813a73e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:16.880839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a7851-61d1-4c19-a48e-f2cab813a73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:16.881185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a7851-61d1-4c19-a48e-f2cab813a73e admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:16.882479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a7851-61d1-4c19-a48e-f2cab813a73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:16.883973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a7851-61d1-4c19-a48e-f2cab813a73e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:16.899329 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2020/4111] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:16.901874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee3d0f-b584-4a04-8ee0-12214938ade2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:16.902195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee3d0f-b584-4a04-8ee0-12214938ade2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:16.902476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ee3d0f-b584-4a04-8ee0-12214938ade2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:16.931185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-18ee3d0f-b584-4a04-8ee0-12214938ade2 None None] MFA Rules not processed for user `d5bd18a1135c4d1db18e9bf273cb0ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:16.933268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-18ee3d0f-b584-4a04-8ee0-12214938ade2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:17.040731 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2021/4112] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:17.042212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee3d0f-b584-4a04-8ee0-12214938ade2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:17.059398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ee3d0f-b584-4a04-8ee0-12214938ade2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:17.065487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e692d-35be-4314-885e-b4f2aa9762ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:17.068423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e692d-35be-4314-885e-b4f2aa9762ad admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:17.069245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e692d-35be-4314-885e-b4f2aa9762ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:17.071255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e692d-35be-4314-885e-b4f2aa9762ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:17.071255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e692d-35be-4314-885e-b4f2aa9762ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:17.073006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e692d-35be-4314-885e-b4f2aa9762ad admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:17.090732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-eccb5ef0-65b8-4abb-b3ab-d736f6ef8e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7511957de5294fb2b5ca686458af6c8d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:17.098613 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2022/4113] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:17.100888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e692d-35be-4314-885e-b4f2aa9762ad admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:17.121470 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:17.123597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e692d-35be-4314-885e-b4f2aa9762ad admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:17.124035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-eccb5ef0-65b8-4abb-b3ab-d736f6ef8e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7511957de5294fb2b5ca686458af6c8d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:17.128681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47af79a-7ff4-4aa4-95c1-2845e976eea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:17.130291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47af79a-7ff4-4aa4-95c1-2845e976eea1 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:17.130431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47af79a-7ff4-4aa4-95c1-2845e976eea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:17.130787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47af79a-7ff4-4aa4-95c1-2845e976eea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:17.132625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47af79a-7ff4-4aa4-95c1-2845e976eea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:17.134212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47af79a-7ff4-4aa4-95c1-2845e976eea1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:17.158255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-eccb5ef0-65b8-4abb-b3ab-d736f6ef8e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7511957de5294fb2b5ca686458af6c8d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:17.160984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-eccb5ef0-65b8-4abb-b3ab-d736f6ef8e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7511957de5294fb2b5ca686458af6c8d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:17.161713 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2023/4114] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:17.163098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37303785-54b3-48ce-826c-1c81d912ebb7 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:17.163426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37303785-54b3-48ce-826c-1c81d912ebb7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:17.163763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37303785-54b3-48ce-826c-1c81d912ebb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:17.194734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-37303785-54b3-48ce-826c-1c81d912ebb7 None None] MFA Rules not processed for user `013b13b6d741411a95806dce36c2bd20`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:17.195909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-37303785-54b3-48ce-826c-1c81d912ebb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:17.232369 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:17.273231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-eccb5ef0-65b8-4abb-b3ab-d736f6ef8e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7511957de5294fb2b5ca686458af6c8d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:17.288868 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2092/4115] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:27:16 2022] DELETE /identity/v3/users/7511957de5294fb2b5ca686458af6c8d => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:17.289872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb5ef0-65b8-4abb-b3ab-d736f6ef8e2f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:17.293399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-eccb5ef0-65b8-4abb-b3ab-d736f6ef8e2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:17.309781 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2024/4116] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:17.311068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37303785-54b3-48ce-826c-1c81d912ebb7 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:17.312381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-37303785-54b3-48ce-826c-1c81d912ebb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:17.327887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37303785-54b3-48ce-826c-1c81d912ebb7 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:17.444014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb5ef0-65b8-4abb-b3ab-d736f6ef8e2f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:17.457399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45393ad8-49eb-4cc5-99ae-e1b41dd088c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:17.458493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45393ad8-49eb-4cc5-99ae-e1b41dd088c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:17.460091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45393ad8-49eb-4cc5-99ae-e1b41dd088c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:17.460308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45393ad8-49eb-4cc5-99ae-e1b41dd088c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:17.461707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45393ad8-49eb-4cc5-99ae-e1b41dd088c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:17.463845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45393ad8-49eb-4cc5-99ae-e1b41dd088c7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:17.477666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37aec1a-6d07-4cc5-8a18-a05419facb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:17.480476 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2093/4117] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:17 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:17.480881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37aec1a-6d07-4cc5-8a18-a05419facb66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:17.481336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37aec1a-6d07-4cc5-8a18-a05419facb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:17.481793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37aec1a-6d07-4cc5-8a18-a05419facb66 admin admin] PATH_INFO: `/v3/projects/7e10183006414c8d96d3be9d995560ae/users/41685fc5b447416faf39e4d43a444b4c/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:17.482545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40262d14-c3a2-422a-9b9c-1928a4225614 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:17.482890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40262d14-c3a2-422a-9b9c-1928a4225614 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:17.490288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40262d14-c3a2-422a-9b9c-1928a4225614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:17.505681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-40262d14-c3a2-422a-9b9c-1928a4225614 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:17.507107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-40262d14-c3a2-422a-9b9c-1928a4225614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:17.515654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37aec1a-6d07-4cc5-8a18-a05419facb66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e10183006414c8d96d3be9d995560ae, user_id=41685fc5b447416faf39e4d43a444b4c, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:17.522882 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2094/4118] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:17.523873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40262d14-c3a2-422a-9b9c-1928a4225614 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:17.534358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37aec1a-6d07-4cc5-8a18-a05419facb66 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:17.535817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40262d14-c3a2-422a-9b9c-1928a4225614 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:17.542037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45da49-62f1-41de-a4a8-7780e264466d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:17.542764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45da49-62f1-41de-a4a8-7780e264466d admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:17.543276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45da49-62f1-41de-a4a8-7780e264466d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:17.543652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de45da49-62f1-41de-a4a8-7780e264466d admin admin] PATH_INFO: `/v3/projects/62baf700c71547259cced4c57f6b88c0/users/cab8538aa1eb4eb4a2e23d6e73a9f805/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:17.562825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45da49-62f1-41de-a4a8-7780e264466d admin admin] RBAC: Authorizing `identity:create_grant(project_id=62baf700c71547259cced4c57f6b88c0, user_id=cab8538aa1eb4eb4a2e23d6e73a9f805, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:17.565849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de45da49-62f1-41de-a4a8-7780e264466d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:17.639256 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2025/4119] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:27:17 2022] PUT /identity/v3/projects/7e10183006414c8d96d3be9d995560ae/users/41685fc5b447416faf39e4d43a444b4c/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:17.643036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37aec1a-6d07-4cc5-8a18-a05419facb66 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:17.643036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f37aec1a-6d07-4cc5-8a18-a05419facb66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:17.709121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37aec1a-6d07-4cc5-8a18-a05419facb66 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:17.713791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253c701-f733-472a-8220-4551762327b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:17.714488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253c701-f733-472a-8220-4551762327b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:17.714779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253c701-f733-472a-8220-4551762327b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:17.715051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253c701-f733-472a-8220-4551762327b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:17.780168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253c701-f733-472a-8220-4551762327b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:17.781717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253c701-f733-472a-8220-4551762327b4 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:17.787083 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:17.793113 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2026/4120] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:27:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:27:17.794670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9def9a-2215-4984-894f-a9c70e4e627b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:17.795087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9def9a-2215-4984-894f-a9c70e4e627b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:17.795475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9def9a-2215-4984-894f-a9c70e4e627b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:17.815055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5d9def9a-2215-4984-894f-a9c70e4e627b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:17.816267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5d9def9a-2215-4984-894f-a9c70e4e627b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:17.828057 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2027/4121] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:17.836361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9def9a-2215-4984-894f-a9c70e4e627b None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:17.851705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9def9a-2215-4984-894f-a9c70e4e627b None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:17.856993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca778a5-303b-4e3b-9fd0-043e5ed8cb60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:17.857667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca778a5-303b-4e3b-9fd0-043e5ed8cb60 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:17.859531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca778a5-303b-4e3b-9fd0-043e5ed8cb60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:17.859531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca778a5-303b-4e3b-9fd0-043e5ed8cb60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:17.869264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca778a5-303b-4e3b-9fd0-043e5ed8cb60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:17.870920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca778a5-303b-4e3b-9fd0-043e5ed8cb60 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:17.881347 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2028/4122] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:27:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:27:17.999618 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2095/4123] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:27:17 2022] PUT /identity/v3/projects/62baf700c71547259cced4c57f6b88c0/users/cab8538aa1eb4eb4a2e23d6e73a9f805/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:18.010246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e302abb-f3ac-46f5-a762-f34419386f53 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:18.021149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e302abb-f3ac-46f5-a762-f34419386f53 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:18.021149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e302abb-f3ac-46f5-a762-f34419386f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:18.039380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0e302abb-f3ac-46f5-a762-f34419386f53 None None] MFA Rules not processed for user `cab8538aa1eb4eb4a2e23d6e73a9f805`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:18.040594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0e302abb-f3ac-46f5-a762-f34419386f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:18.106958 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2029/4124] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:18.532085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45da49-62f1-41de-a4a8-7780e264466d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:18.537841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-de45da49-62f1-41de-a4a8-7780e264466d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:18.702755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de45da49-62f1-41de-a4a8-7780e264466d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:18.713136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518597be-4395-42bf-8fd3-989311f555c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:18.714159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518597be-4395-42bf-8fd3-989311f555c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:18.714526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518597be-4395-42bf-8fd3-989311f555c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:18.715286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518597be-4395-42bf-8fd3-989311f555c0 admin admin] PATH_INFO: `/v3/projects/b8d54244589445d2ad3ac4c7328fdb3e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:18.717605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518597be-4395-42bf-8fd3-989311f555c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8d54244589445d2ad3ac4c7328fdb3e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:18.719854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518597be-4395-42bf-8fd3-989311f555c0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:18.918973 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:18.921790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-518597be-4395-42bf-8fd3-989311f555c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8d54244589445d2ad3ac4c7328fdb3e', 'request_id': 'req-518597be-4395-42bf-8fd3-989311f555c0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:18.935111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-518597be-4395-42bf-8fd3-989311f555c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8d54244589445d2ad3ac4c7328fdb3e', 'request_id': 'req-518597be-4395-42bf-8fd3-989311f555c0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:18.946060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-518597be-4395-42bf-8fd3-989311f555c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8d54244589445d2ad3ac4c7328fdb3e', 'request_id': 'req-518597be-4395-42bf-8fd3-989311f555c0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:19.078413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-518597be-4395-42bf-8fd3-989311f555c0 admin admin] The token cache is being invalidate because project b8d54244589445d2ad3ac4c7328fdb3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:19.081457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-518597be-4395-42bf-8fd3-989311f555c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:19.084978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-518597be-4395-42bf-8fd3-989311f555c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:19.095770 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2096/4125] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:18 2022] DELETE /identity/v3/projects/b8d54244589445d2ad3ac4c7328fdb3e => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:19.100130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e302abb-f3ac-46f5-a762-f34419386f53 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:19.128586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e302abb-f3ac-46f5-a762-f34419386f53 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:19.210438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa2b2c-9de7-4c25-b44c-1b53f2818f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:19.219567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa2b2c-9de7-4c25-b44c-1b53f2818f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:19.220183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa2b2c-9de7-4c25-b44c-1b53f2818f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:19.222620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa2b2c-9de7-4c25-b44c-1b53f2818f00 admin admin] PATH_INFO: `/v3/users/e8aa7ea0f2be45f787371d1c28a51ce3` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:19.222620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa2b2c-9de7-4c25-b44c-1b53f2818f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8aa7ea0f2be45f787371d1c28a51ce3)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:19.225391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa2b2c-9de7-4c25-b44c-1b53f2818f00 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:19.498001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-75fa2b2c-9de7-4c25-b44c-1b53f2818f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8aa7ea0f2be45f787371d1c28a51ce3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:19.522578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518597be-4395-42bf-8fd3-989311f555c0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:19.529525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-518597be-4395-42bf-8fd3-989311f555c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:19.534704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-75fa2b2c-9de7-4c25-b44c-1b53f2818f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8aa7ea0f2be45f787371d1c28a51ce3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:19.535574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-75fa2b2c-9de7-4c25-b44c-1b53f2818f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8aa7ea0f2be45f787371d1c28a51ce3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:19.538254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-75fa2b2c-9de7-4c25-b44c-1b53f2818f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8aa7ea0f2be45f787371d1c28a51ce3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:19.547428 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:19.551400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-75fa2b2c-9de7-4c25-b44c-1b53f2818f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8aa7ea0f2be45f787371d1c28a51ce3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:19.691333 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2030/4126] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:27:19 2022] DELETE /identity/v3/users/e8aa7ea0f2be45f787371d1c28a51ce3 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:19.796742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518597be-4395-42bf-8fd3-989311f555c0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:19.884334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad449af6-b3f5-4bdd-b30a-f739d8a8497f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:19.885674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad449af6-b3f5-4bdd-b30a-f739d8a8497f service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:19.885993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad449af6-b3f5-4bdd-b30a-f739d8a8497f service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:19.886299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad449af6-b3f5-4bdd-b30a-f739d8a8497f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:19.888298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ad449af6-b3f5-4bdd-b30a-f739d8a8497f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:19.972622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad449af6-b3f5-4bdd-b30a-f739d8a8497f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:19.989496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad449af6-b3f5-4bdd-b30a-f739d8a8497f service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:20.008544 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2097/4127] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:27:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:27:20.841497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa2b2c-9de7-4c25-b44c-1b53f2818f00 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:20.843571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-75fa2b2c-9de7-4c25-b44c-1b53f2818f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:20.951702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa2b2c-9de7-4c25-b44c-1b53f2818f00 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:20.959326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764047a5-6ffb-46c6-b53f-7544523d6f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:20.961605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764047a5-6ffb-46c6-b53f-7544523d6f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:20.962158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764047a5-6ffb-46c6-b53f-7544523d6f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:20.963196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764047a5-6ffb-46c6-b53f-7544523d6f8c admin admin] PATH_INFO: `/v3/projects/6ef66e6fd42349b883344b86b9ecb050` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:20.969477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764047a5-6ffb-46c6-b53f-7544523d6f8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ef66e6fd42349b883344b86b9ecb050)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:20.974525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764047a5-6ffb-46c6-b53f-7544523d6f8c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:21.172905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-764047a5-6ffb-46c6-b53f-7544523d6f8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ef66e6fd42349b883344b86b9ecb050', 'request_id': 'req-764047a5-6ffb-46c6-b53f-7544523d6f8c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:21.253762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-764047a5-6ffb-46c6-b53f-7544523d6f8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ef66e6fd42349b883344b86b9ecb050', 'request_id': 'req-764047a5-6ffb-46c6-b53f-7544523d6f8c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:21.282872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-764047a5-6ffb-46c6-b53f-7544523d6f8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ef66e6fd42349b883344b86b9ecb050', 'request_id': 'req-764047a5-6ffb-46c6-b53f-7544523d6f8c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:21.342323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-764047a5-6ffb-46c6-b53f-7544523d6f8c admin admin] The token cache is being invalidate because project 6ef66e6fd42349b883344b86b9ecb050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:21.345788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-764047a5-6ffb-46c6-b53f-7544523d6f8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:21.347494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-764047a5-6ffb-46c6-b53f-7544523d6f8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:21.354676 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2031/4128] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:20 2022] DELETE /identity/v3/projects/6ef66e6fd42349b883344b86b9ecb050 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:21.358856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31fae7-faa0-4e75-af6e-54df9576a183 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:21.359703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31fae7-faa0-4e75-af6e-54df9576a183 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:21.359703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31fae7-faa0-4e75-af6e-54df9576a183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:21.397209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-fe31fae7-faa0-4e75-af6e-54df9576a183 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:21.400541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fe31fae7-faa0-4e75-af6e-54df9576a183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:21.411873 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:21.596846 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2098/4129] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:21.605314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe07f8-5779-4003-8c86-0290a6d542ce None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:21.605609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe07f8-5779-4003-8c86-0290a6d542ce None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:21.605894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe07f8-5779-4003-8c86-0290a6d542ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:21.640670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5bbe07f8-5779-4003-8c86-0290a6d542ce None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:21.646522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5bbe07f8-5779-4003-8c86-0290a6d542ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:21.661863 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2032/4130] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:21.667377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31fae7-faa0-4e75-af6e-54df9576a183 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:21.686222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31fae7-faa0-4e75-af6e-54df9576a183 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:21.706184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2c3d5-6f8d-4e8d-9a3f-2c209cb3461e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:21.707044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2c3d5-6f8d-4e8d-9a3f-2c209cb3461e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:21.707425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2c3d5-6f8d-4e8d-9a3f-2c209cb3461e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:21.707800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d2c3d5-6f8d-4e8d-9a3f-2c209cb3461e admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:21.708821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2c3d5-6f8d-4e8d-9a3f-2c209cb3461e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:27:21.709551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2c3d5-6f8d-4e8d-9a3f-2c209cb3461e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:21.715151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d2c3d5-6f8d-4e8d-9a3f-2c209cb3461e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:21.757730 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2099/4131] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:27:21.763348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe07f8-5779-4003-8c86-0290a6d542ce None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:21.785619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe07f8-5779-4003-8c86-0290a6d542ce None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:21.791828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc55dd-63cc-4611-9ee2-fa68034af8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:21.795419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc55dd-63cc-4611-9ee2-fa68034af8c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:21.795419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc55dd-63cc-4611-9ee2-fa68034af8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:21.795419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc55dd-63cc-4611-9ee2-fa68034af8c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:21.795419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc55dd-63cc-4611-9ee2-fa68034af8c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:21.796889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc55dd-63cc-4611-9ee2-fa68034af8c4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:21.913132 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2033/4132] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:27:21 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:27:21.918115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2c3d5-6f8d-4e8d-9a3f-2c209cb3461e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:21.943158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d2c3d5-6f8d-4e8d-9a3f-2c209cb3461e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:22.062339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da2bff-747c-418e-ba09-bfe8b83e21bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:22.063212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da2bff-747c-418e-ba09-bfe8b83e21bf admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:22.063745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da2bff-747c-418e-ba09-bfe8b83e21bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:22.066569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da2bff-747c-418e-ba09-bfe8b83e21bf admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:22.067712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da2bff-747c-418e-ba09-bfe8b83e21bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:22.070740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da2bff-747c-418e-ba09-bfe8b83e21bf admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:22.155790 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2100/4133] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:27:21 2022] POST /identity/v3/users => generated 292 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:22.160093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc55dd-63cc-4611-9ee2-fa68034af8c4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:22.177625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc55dd-63cc-4611-9ee2-fa68034af8c4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:22.207557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15022c0f-da71-4feb-a146-a066489fbf49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:22.208269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15022c0f-da71-4feb-a146-a066489fbf49 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:22.208587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15022c0f-da71-4feb-a146-a066489fbf49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:22.208875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15022c0f-da71-4feb-a146-a066489fbf49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:22.209627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15022c0f-da71-4feb-a146-a066489fbf49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:22.219559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15022c0f-da71-4feb-a146-a066489fbf49 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:22.251449 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2034/4134] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:22.252728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da2bff-747c-418e-ba09-bfe8b83e21bf admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:22.268596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da2bff-747c-418e-ba09-bfe8b83e21bf admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:22.285815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e2033-bd6a-4103-99ff-4f33383b366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:22.286971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e2033-bd6a-4103-99ff-4f33383b366f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:22.287774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e2033-bd6a-4103-99ff-4f33383b366f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:22.288480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e2033-bd6a-4103-99ff-4f33383b366f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:22.294737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e2033-bd6a-4103-99ff-4f33383b366f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:22.297082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e2033-bd6a-4103-99ff-4f33383b366f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:22.313780 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2101/4135] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:22.317744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15022c0f-da71-4feb-a146-a066489fbf49 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:22.335512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15022c0f-da71-4feb-a146-a066489fbf49 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:22.342284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b889b9c-6ef3-4b61-aa59-cae1fb9dcb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:22.343528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b889b9c-6ef3-4b61-aa59-cae1fb9dcb8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:22.343767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b889b9c-6ef3-4b61-aa59-cae1fb9dcb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:22.344104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b889b9c-6ef3-4b61-aa59-cae1fb9dcb8f admin admin] PATH_INFO: `/v3/projects/6d9d9471580d47109e64898e5eb886f4/users/78fb4ce3eb8e4ac1adb439b688cc1ea7/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:22.375510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b889b9c-6ef3-4b61-aa59-cae1fb9dcb8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d9d9471580d47109e64898e5eb886f4, user_id=78fb4ce3eb8e4ac1adb439b688cc1ea7, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:22.378357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b889b9c-6ef3-4b61-aa59-cae1fb9dcb8f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:22.447443 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2035/4136] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:27:22 2022] PUT /identity/v3/projects/6d9d9471580d47109e64898e5eb886f4/users/78fb4ce3eb8e4ac1adb439b688cc1ea7/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:22.460746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12a418-848c-4651-b57f-34632b9cb10c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:22.461296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12a418-848c-4651-b57f-34632b9cb10c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:22.467458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12a418-848c-4651-b57f-34632b9cb10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:22.554753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-df12a418-848c-4651-b57f-34632b9cb10c None None] MFA Rules not processed for user `78fb4ce3eb8e4ac1adb439b688cc1ea7`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:22.559469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-df12a418-848c-4651-b57f-34632b9cb10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:22.829406 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2102/4137] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:22.834311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b889b9c-6ef3-4b61-aa59-cae1fb9dcb8f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:22.879645 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:23.048395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b889b9c-6ef3-4b61-aa59-cae1fb9dcb8f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:23.066767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb97e73-c4da-4949-9fa1-f08e78ae8215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:23.067670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb97e73-c4da-4949-9fa1-f08e78ae8215 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:23.072082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb97e73-c4da-4949-9fa1-f08e78ae8215 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:23.072463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb97e73-c4da-4949-9fa1-f08e78ae8215 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:23.073787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb97e73-c4da-4949-9fa1-f08e78ae8215 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:23.082643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb97e73-c4da-4949-9fa1-f08e78ae8215 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:23.252120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12a418-848c-4651-b57f-34632b9cb10c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:23.262236 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2036/4138] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:27:22 2022] POST /identity/v3/projects => generated 385 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:23.268875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12a418-848c-4651-b57f-34632b9cb10c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:23.295169 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:23.468080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996cda5f-902a-4082-8256-9fcd19eefa68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:23.469955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cda5f-902a-4082-8256-9fcd19eefa68 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:23.470640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cda5f-902a-4082-8256-9fcd19eefa68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:23.472441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996cda5f-902a-4082-8256-9fcd19eefa68 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:23.474313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996cda5f-902a-4082-8256-9fcd19eefa68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:23.486226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996cda5f-902a-4082-8256-9fcd19eefa68 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:23.692832 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2103/4139] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:27:23 2022] POST /identity/v3/users => generated 299 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:23.693962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb97e73-c4da-4949-9fa1-f08e78ae8215 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:23.710079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb97e73-c4da-4949-9fa1-f08e78ae8215 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:23.722983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ffeed-bc1e-416d-9f82-4fe915a76ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:23.723945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ffeed-bc1e-416d-9f82-4fe915a76ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:23.724240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ffeed-bc1e-416d-9f82-4fe915a76ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:23.724573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ffeed-bc1e-416d-9f82-4fe915a76ba1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:23.725312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ffeed-bc1e-416d-9f82-4fe915a76ba1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:23.728526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ffeed-bc1e-416d-9f82-4fe915a76ba1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:23.748476 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2037/4140] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:23.761911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996cda5f-902a-4082-8256-9fcd19eefa68 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:23.785765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996cda5f-902a-4082-8256-9fcd19eefa68 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:23.794596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c9d7a-863b-4553-91b3-971fefbe83fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:23.795857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c9d7a-863b-4553-91b3-971fefbe83fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:23.796181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c9d7a-863b-4553-91b3-971fefbe83fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:23.796630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c9d7a-863b-4553-91b3-971fefbe83fc admin admin] PATH_INFO: `/v3/projects/00b0ea739c924dd8a487930adef1335c/users/c3d80152112f408e8d7aca3a10d77896/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:23.817680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c9d7a-863b-4553-91b3-971fefbe83fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b0ea739c924dd8a487930adef1335c, user_id=c3d80152112f408e8d7aca3a10d77896, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:23.822522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c9d7a-863b-4553-91b3-971fefbe83fc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:23.959854 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2104/4141] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:27:23 2022] PUT /identity/v3/projects/00b0ea739c924dd8a487930adef1335c/users/c3d80152112f408e8d7aca3a10d77896/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:23.964782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ffeed-bc1e-416d-9f82-4fe915a76ba1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:23.977668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ffeed-bc1e-416d-9f82-4fe915a76ba1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:24.117010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d330c6c-b6ca-413e-aa32-04ab2147e0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:24.131003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d330c6c-b6ca-413e-aa32-04ab2147e0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:24.132196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d330c6c-b6ca-413e-aa32-04ab2147e0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:24.132622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d330c6c-b6ca-413e-aa32-04ab2147e0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:24.133959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d330c6c-b6ca-413e-aa32-04ab2147e0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:24.139346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d330c6c-b6ca-413e-aa32-04ab2147e0a3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:24.156424 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2038/4142] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:24.157479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c9d7a-863b-4553-91b3-971fefbe83fc admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:24.175729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c9d7a-863b-4553-91b3-971fefbe83fc admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:24.188393 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80673136-e73b-4dea-96fe-002987feec92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:24.189343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80673136-e73b-4dea-96fe-002987feec92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:24.189631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80673136-e73b-4dea-96fe-002987feec92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:24.189915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80673136-e73b-4dea-96fe-002987feec92 admin admin] PATH_INFO: `/v3/projects/00b0ea739c924dd8a487930adef1335c/users/c3d80152112f408e8d7aca3a10d77896/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:24.200361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80673136-e73b-4dea-96fe-002987feec92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00b0ea739c924dd8a487930adef1335c, user_id=c3d80152112f408e8d7aca3a10d77896, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:24.203717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80673136-e73b-4dea-96fe-002987feec92 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:24.246619 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2105/4143] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:27:24 2022] PUT /identity/v3/projects/00b0ea739c924dd8a487930adef1335c/users/c3d80152112f408e8d7aca3a10d77896/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:24.450258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2aac2-7ce2-43de-aac7-d5e1de65e311 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:24.450617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2aac2-7ce2-43de-aac7-d5e1de65e311 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:24.451146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2aac2-7ce2-43de-aac7-d5e1de65e311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:24.481367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-86a2aac2-7ce2-43de-aac7-d5e1de65e311 None None] MFA Rules not processed for user `c3d80152112f408e8d7aca3a10d77896`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:24.483482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-86a2aac2-7ce2-43de-aac7-d5e1de65e311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:24.669820 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2039/4144] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:24.674923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80673136-e73b-4dea-96fe-002987feec92 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:24.706071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80673136-e73b-4dea-96fe-002987feec92 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:24.724585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c3dee-2405-4f61-b2c4-e87ff70af322 tempest-ProjectsNegativeTestJSON-2019847040 tempest-ProjectsNegativeTestJSON-2019847040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d80152112f408e8d7aca3a10d77896', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b0ea739c924dd8a487930adef1335c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:24.726552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c3dee-2405-4f61-b2c4-e87ff70af322 tempest-ProjectsNegativeTestJSON-2019847040 tempest-ProjectsNegativeTestJSON-2019847040-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:24.729078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c3dee-2405-4f61-b2c4-e87ff70af322 tempest-ProjectsNegativeTestJSON-2019847040 tempest-ProjectsNegativeTestJSON-2019847040-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:24.729607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c3dee-2405-4f61-b2c4-e87ff70af322 tempest-ProjectsNegativeTestJSON-2019847040 tempest-ProjectsNegativeTestJSON-2019847040-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:24.737423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c3dee-2405-4f61-b2c4-e87ff70af322 tempest-ProjectsNegativeTestJSON-2019847040 tempest-ProjectsNegativeTestJSON-2019847040-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:24.741625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c3dee-2405-4f61-b2c4-e87ff70af322 tempest-ProjectsNegativeTestJSON-2019847040 tempest-ProjectsNegativeTestJSON-2019847040-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:24.901047 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2106/4145] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:27:24 2022] POST /identity/v3/projects => generated 360 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:24.906453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2aac2-7ce2-43de-aac7-d5e1de65e311 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:24.942129 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:25.079066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2aac2-7ce2-43de-aac7-d5e1de65e311 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:25.169743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3dc1d-8e2c-4f8b-b55f-526c29273ba2 tempest-ProjectsNegativeTestJSON-334139633 tempest-ProjectsNegativeTestJSON-334139633-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78fb4ce3eb8e4ac1adb439b688cc1ea7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6d9d9471580d47109e64898e5eb886f4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:25.171488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3dc1d-8e2c-4f8b-b55f-526c29273ba2 tempest-ProjectsNegativeTestJSON-334139633 tempest-ProjectsNegativeTestJSON-334139633-project] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:25.171945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3dc1d-8e2c-4f8b-b55f-526c29273ba2 tempest-ProjectsNegativeTestJSON-334139633 tempest-ProjectsNegativeTestJSON-334139633-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:25.172419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3dc1d-8e2c-4f8b-b55f-526c29273ba2 tempest-ProjectsNegativeTestJSON-334139633 tempest-ProjectsNegativeTestJSON-334139633-project] PATH_INFO: `/v3/projects/0ddb17a2a95a4bd8b5437c38d0822df9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:25.175333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3dc1d-8e2c-4f8b-b55f-526c29273ba2 tempest-ProjectsNegativeTestJSON-334139633 tempest-ProjectsNegativeTestJSON-334139633-project] RBAC: Authorizing `identity:delete_project(project_id=0ddb17a2a95a4bd8b5437c38d0822df9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:25.206929 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-7ca3dc1d-8e2c-4f8b-b55f-526c29273ba2 tempest-ProjectsNegativeTestJSON-334139633 tempest-ProjectsNegativeTestJSON-334139633-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jul 19 14:27:25.206929 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:27:25.206929 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:27:25.206929 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:27:25.206929 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:27:25.206929 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:27:25.206929 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:27:25.206929 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:27:25.206929 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:27:25.206929 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:27:25.206929 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:27:25.206929 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:27:25.206929 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Jul 19 14:27:25.206929 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 19 14:27:25.213323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 19 14:27:25.213323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 19 14:27:25.213323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 19 14:27:25.213323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 19 14:27:25.213323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 14:27:25.213323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 19 14:27:25.213323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jul 19 14:27:25.213323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:27:25.214399 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2040/4146] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:24 2022] DELETE /identity/v3/projects/0ddb17a2a95a4bd8b5437c38d0822df9 => generated 136 bytes in 308 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:27:25.215173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c3dee-2405-4f61-b2c4-e87ff70af322 tempest-ProjectsNegativeTestJSON-2019847040 tempest-ProjectsNegativeTestJSON-2019847040-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:25.404305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c3dee-2405-4f61-b2c4-e87ff70af322 tempest-ProjectsNegativeTestJSON-2019847040 tempest-ProjectsNegativeTestJSON-2019847040-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:25.424627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165a0da0-44f1-49dc-a3f3-23a91baf3267 tempest-ProjectsNegativeTestJSON-2019847040 tempest-ProjectsNegativeTestJSON-2019847040-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3d80152112f408e8d7aca3a10d77896', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '00b0ea739c924dd8a487930adef1335c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:25.425531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a0da0-44f1-49dc-a3f3-23a91baf3267 tempest-ProjectsNegativeTestJSON-2019847040 tempest-ProjectsNegativeTestJSON-2019847040-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:25.425826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a0da0-44f1-49dc-a3f3-23a91baf3267 tempest-ProjectsNegativeTestJSON-2019847040 tempest-ProjectsNegativeTestJSON-2019847040-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:25.426126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165a0da0-44f1-49dc-a3f3-23a91baf3267 tempest-ProjectsNegativeTestJSON-2019847040 tempest-ProjectsNegativeTestJSON-2019847040-project-admin] PATH_INFO: `/v3/projects/0ddb17a2a95a4bd8b5437c38d0822df9` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:25.433468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a0da0-44f1-49dc-a3f3-23a91baf3267 tempest-ProjectsNegativeTestJSON-2019847040 tempest-ProjectsNegativeTestJSON-2019847040-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0ddb17a2a95a4bd8b5437c38d0822df9)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:25.433468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165a0da0-44f1-49dc-a3f3-23a91baf3267 tempest-ProjectsNegativeTestJSON-2019847040 tempest-ProjectsNegativeTestJSON-2019847040-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:25.689237 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:25.704557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-165a0da0-44f1-49dc-a3f3-23a91baf3267 tempest-ProjectsNegativeTestJSON-2019847040 tempest-ProjectsNegativeTestJSON-2019847040-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ddb17a2a95a4bd8b5437c38d0822df9', 'request_id': 'req-165a0da0-44f1-49dc-a3f3-23a91baf3267'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:25.713855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-165a0da0-44f1-49dc-a3f3-23a91baf3267 tempest-ProjectsNegativeTestJSON-2019847040 tempest-ProjectsNegativeTestJSON-2019847040-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ddb17a2a95a4bd8b5437c38d0822df9', 'request_id': 'req-165a0da0-44f1-49dc-a3f3-23a91baf3267'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:25.729474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-165a0da0-44f1-49dc-a3f3-23a91baf3267 tempest-ProjectsNegativeTestJSON-2019847040 tempest-ProjectsNegativeTestJSON-2019847040-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ddb17a2a95a4bd8b5437c38d0822df9', 'request_id': 'req-165a0da0-44f1-49dc-a3f3-23a91baf3267'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:25.884322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-165a0da0-44f1-49dc-a3f3-23a91baf3267 tempest-ProjectsNegativeTestJSON-2019847040 tempest-ProjectsNegativeTestJSON-2019847040-project-admin] The token cache is being invalidate because project 0ddb17a2a95a4bd8b5437c38d0822df9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:25.885350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-165a0da0-44f1-49dc-a3f3-23a91baf3267 tempest-ProjectsNegativeTestJSON-2019847040 tempest-ProjectsNegativeTestJSON-2019847040-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:25.888635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-165a0da0-44f1-49dc-a3f3-23a91baf3267 tempest-ProjectsNegativeTestJSON-2019847040 tempest-ProjectsNegativeTestJSON-2019847040-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:25.892780 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2107/4147] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:25 2022] DELETE /identity/v3/projects/0ddb17a2a95a4bd8b5437c38d0822df9 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:25.898062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3dc1d-8e2c-4f8b-b55f-526c29273ba2 tempest-ProjectsNegativeTestJSON-334139633 tempest-ProjectsNegativeTestJSON-334139633-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:25.900673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7ca3dc1d-8e2c-4f8b-b55f-526c29273ba2 tempest-ProjectsNegativeTestJSON-334139633 tempest-ProjectsNegativeTestJSON-334139633-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:26.087016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3dc1d-8e2c-4f8b-b55f-526c29273ba2 tempest-ProjectsNegativeTestJSON-334139633 tempest-ProjectsNegativeTestJSON-334139633-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:26.215340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cee2e-7069-4b4f-8ee6-2cfb305ea118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:26.216250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cee2e-7069-4b4f-8ee6-2cfb305ea118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:26.216534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cee2e-7069-4b4f-8ee6-2cfb305ea118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:26.216812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1cee2e-7069-4b4f-8ee6-2cfb305ea118 admin admin] PATH_INFO: `/v3/users/78fb4ce3eb8e4ac1adb439b688cc1ea7` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:26.218072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1cee2e-7069-4b4f-8ee6-2cfb305ea118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78fb4ce3eb8e4ac1adb439b688cc1ea7)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:26.220058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1cee2e-7069-4b4f-8ee6-2cfb305ea118 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:26.246403 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:26.505611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7e1cee2e-7069-4b4f-8ee6-2cfb305ea118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78fb4ce3eb8e4ac1adb439b688cc1ea7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:26.536575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7e1cee2e-7069-4b4f-8ee6-2cfb305ea118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78fb4ce3eb8e4ac1adb439b688cc1ea7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:26.536575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7e1cee2e-7069-4b4f-8ee6-2cfb305ea118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78fb4ce3eb8e4ac1adb439b688cc1ea7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:26.536575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7e1cee2e-7069-4b4f-8ee6-2cfb305ea118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78fb4ce3eb8e4ac1adb439b688cc1ea7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:26.545713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7e1cee2e-7069-4b4f-8ee6-2cfb305ea118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78fb4ce3eb8e4ac1adb439b688cc1ea7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:26.641128 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2041/4148] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:27:25 2022] DELETE /identity/v3/users/78fb4ce3eb8e4ac1adb439b688cc1ea7 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:26.652244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d42b53-eab8-49c9-b102-73d8aea9fefc None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:26.652532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d42b53-eab8-49c9-b102-73d8aea9fefc None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:26.653079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d42b53-eab8-49c9-b102-73d8aea9fefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:26.672981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cee2e-7069-4b4f-8ee6-2cfb305ea118 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:26.674959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7e1cee2e-7069-4b4f-8ee6-2cfb305ea118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:26.757986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c6d42b53-eab8-49c9-b102-73d8aea9fefc None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:26.760943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c6d42b53-eab8-49c9-b102-73d8aea9fefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:26.952507 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2108/4149] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:26.961700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1cee2e-7069-4b4f-8ee6-2cfb305ea118 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:26.969205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1a184-f558-4549-a2cd-9a42aec101e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:26.970294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1a184-f558-4549-a2cd-9a42aec101e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:26.970592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1a184-f558-4549-a2cd-9a42aec101e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:26.971030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b1a184-f558-4549-a2cd-9a42aec101e7 admin admin] PATH_INFO: `/v3/users/cab8538aa1eb4eb4a2e23d6e73a9f805` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:26.972476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1a184-f558-4549-a2cd-9a42aec101e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cab8538aa1eb4eb4a2e23d6e73a9f805)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:26.974532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b1a184-f558-4549-a2cd-9a42aec101e7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:26.980707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d42b53-eab8-49c9-b102-73d8aea9fefc None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:26.988048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c6d42b53-eab8-49c9-b102-73d8aea9fefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:27.159598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d42b53-eab8-49c9-b102-73d8aea9fefc None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:27.166992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ec962e-9256-4690-8be9-b44cc4f0d87d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:27.169348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec962e-9256-4690-8be9-b44cc4f0d87d service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:27.169903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec962e-9256-4690-8be9-b44cc4f0d87d service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:27.170427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ec962e-9256-4690-8be9-b44cc4f0d87d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:27.186348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec962e-9256-4690-8be9-b44cc4f0d87d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:27.189852 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ec962e-9256-4690-8be9-b44cc4f0d87d service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:27.232322 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2109/4150] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:27:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:27:27.259972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-88b1a184-f558-4549-a2cd-9a42aec101e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cab8538aa1eb4eb4a2e23d6e73a9f805'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:27.281719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-88b1a184-f558-4549-a2cd-9a42aec101e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cab8538aa1eb4eb4a2e23d6e73a9f805'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:27.282726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-88b1a184-f558-4549-a2cd-9a42aec101e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cab8538aa1eb4eb4a2e23d6e73a9f805'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:27.283410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-88b1a184-f558-4549-a2cd-9a42aec101e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cab8538aa1eb4eb4a2e23d6e73a9f805'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:27.298090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-88b1a184-f558-4549-a2cd-9a42aec101e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cab8538aa1eb4eb4a2e23d6e73a9f805'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:27.387856 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2042/4151] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:27:26 2022] DELETE /identity/v3/users/cab8538aa1eb4eb4a2e23d6e73a9f805 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:27.393143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1a849-7513-4ad6-8934-44c4d434d925 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:27.393515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1a849-7513-4ad6-8934-44c4d434d925 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:27.393865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1a849-7513-4ad6-8934-44c4d434d925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:27.416160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e0f1a849-7513-4ad6-8934-44c4d434d925 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:27.417665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e0f1a849-7513-4ad6-8934-44c4d434d925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:27.644608 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2110/4152] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:27.706243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1a184-f558-4549-a2cd-9a42aec101e7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:27.708220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-88b1a184-f558-4549-a2cd-9a42aec101e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:27.742218 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:27.835970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1a849-7513-4ad6-8934-44c4d434d925 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:27.838814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e0f1a849-7513-4ad6-8934-44c4d434d925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:27.845325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b1a184-f558-4549-a2cd-9a42aec101e7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:27.849811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f92c33-b7c9-43ce-824a-c8ea6660e8f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:27.851747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f92c33-b7c9-43ce-824a-c8ea6660e8f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:27.852124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f92c33-b7c9-43ce-824a-c8ea6660e8f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:27.852543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f92c33-b7c9-43ce-824a-c8ea6660e8f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:27.869613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1a849-7513-4ad6-8934-44c4d434d925 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:27.891316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b828b-dcf2-4c56-ae85-00bac2f5f3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:27.893001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b828b-dcf2-4c56-ae85-00bac2f5f3e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:27.893499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b828b-dcf2-4c56-ae85-00bac2f5f3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:27.893968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b828b-dcf2-4c56-ae85-00bac2f5f3e4 admin admin] PATH_INFO: `/v3/projects/6d9d9471580d47109e64898e5eb886f4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:27.895473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b828b-dcf2-4c56-ae85-00bac2f5f3e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d9d9471580d47109e64898e5eb886f4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:27.903281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0b828b-dcf2-4c56-ae85-00bac2f5f3e4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:27.905879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f92c33-b7c9-43ce-824a-c8ea6660e8f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:27.912157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f92c33-b7c9-43ce-824a-c8ea6660e8f5 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:27.928535 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:27.950077 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2043/4153] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:27:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:27:28.131300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bb0b828b-dcf2-4c56-ae85-00bac2f5f3e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d9d9471580d47109e64898e5eb886f4', 'request_id': 'req-bb0b828b-dcf2-4c56-ae85-00bac2f5f3e4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:28.162805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bb0b828b-dcf2-4c56-ae85-00bac2f5f3e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d9d9471580d47109e64898e5eb886f4', 'request_id': 'req-bb0b828b-dcf2-4c56-ae85-00bac2f5f3e4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:28.181549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bb0b828b-dcf2-4c56-ae85-00bac2f5f3e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d9d9471580d47109e64898e5eb886f4', 'request_id': 'req-bb0b828b-dcf2-4c56-ae85-00bac2f5f3e4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:28.292515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bb0b828b-dcf2-4c56-ae85-00bac2f5f3e4 admin admin] The token cache is being invalidate because project 6d9d9471580d47109e64898e5eb886f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:28.293224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bb0b828b-dcf2-4c56-ae85-00bac2f5f3e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:28.294757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bb0b828b-dcf2-4c56-ae85-00bac2f5f3e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:28.301354 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2111/4154] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:27 2022] DELETE /identity/v3/projects/6d9d9471580d47109e64898e5eb886f4 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:28.305357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f92c33-b7c9-43ce-824a-c8ea6660e8f5 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:28.317338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f92c33-b7c9-43ce-824a-c8ea6660e8f5 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:28.393096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7ae48-1b84-4140-8907-fee539d76d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:28.395077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7ae48-1b84-4140-8907-fee539d76d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:28.395077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7ae48-1b84-4140-8907-fee539d76d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:28.395077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7ae48-1b84-4140-8907-fee539d76d35 admin admin] PATH_INFO: `/v3/users/c3d80152112f408e8d7aca3a10d77896` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:28.396057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7ae48-1b84-4140-8907-fee539d76d35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3d80152112f408e8d7aca3a10d77896)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:28.398039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7ae48-1b84-4140-8907-fee539d76d35 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:28.600412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-01a7ae48-1b84-4140-8907-fee539d76d35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3d80152112f408e8d7aca3a10d77896'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:28.628998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-01a7ae48-1b84-4140-8907-fee539d76d35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3d80152112f408e8d7aca3a10d77896'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:28.630043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-01a7ae48-1b84-4140-8907-fee539d76d35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3d80152112f408e8d7aca3a10d77896'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:28.631027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-01a7ae48-1b84-4140-8907-fee539d76d35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3d80152112f408e8d7aca3a10d77896'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:28.648616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-01a7ae48-1b84-4140-8907-fee539d76d35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3d80152112f408e8d7aca3a10d77896'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:28.739821 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2044/4155] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:27:28 2022] DELETE /identity/v3/users/c3d80152112f408e8d7aca3a10d77896 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:29.273750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b828b-dcf2-4c56-ae85-00bac2f5f3e4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:29.275948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bb0b828b-dcf2-4c56-ae85-00bac2f5f3e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:29.312617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b828b-dcf2-4c56-ae85-00bac2f5f3e4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:29.444233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1fc5ef-2071-4a3e-91e6-e6b980078f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:29.449370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fc5ef-2071-4a3e-91e6-e6b980078f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:29.449703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fc5ef-2071-4a3e-91e6-e6b980078f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:29.450219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1fc5ef-2071-4a3e-91e6-e6b980078f1a admin admin] PATH_INFO: `/v3/projects/00b0ea739c924dd8a487930adef1335c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:29.452623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fc5ef-2071-4a3e-91e6-e6b980078f1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=00b0ea739c924dd8a487930adef1335c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:29.453794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1fc5ef-2071-4a3e-91e6-e6b980078f1a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:29.662148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0e1fc5ef-2071-4a3e-91e6-e6b980078f1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00b0ea739c924dd8a487930adef1335c', 'request_id': 'req-0e1fc5ef-2071-4a3e-91e6-e6b980078f1a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:29.675537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0e1fc5ef-2071-4a3e-91e6-e6b980078f1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00b0ea739c924dd8a487930adef1335c', 'request_id': 'req-0e1fc5ef-2071-4a3e-91e6-e6b980078f1a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:29.686020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0e1fc5ef-2071-4a3e-91e6-e6b980078f1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00b0ea739c924dd8a487930adef1335c', 'request_id': 'req-0e1fc5ef-2071-4a3e-91e6-e6b980078f1a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:29.753110 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0e1fc5ef-2071-4a3e-91e6-e6b980078f1a admin admin] The token cache is being invalidate because project 00b0ea739c924dd8a487930adef1335c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:29.753408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0e1fc5ef-2071-4a3e-91e6-e6b980078f1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:29.755235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0e1fc5ef-2071-4a3e-91e6-e6b980078f1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:29.755981 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2112/4156] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:29 2022] DELETE /identity/v3/projects/00b0ea739c924dd8a487930adef1335c => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:29.763508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23a7f-f66a-4712-a148-2bc382475d77 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:29.764125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23a7f-f66a-4712-a148-2bc382475d77 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:29.764125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada23a7f-f66a-4712-a148-2bc382475d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:29.796058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ada23a7f-f66a-4712-a148-2bc382475d77 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:29.797171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ada23a7f-f66a-4712-a148-2bc382475d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:29.850789 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:29.905559 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2045/4157] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:29.914365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340fbf9-bb6d-475b-984e-1a0ed4965bf0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:29.914664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340fbf9-bb6d-475b-984e-1a0ed4965bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:29.914946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b340fbf9-bb6d-475b-984e-1a0ed4965bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:29.944165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada23a7f-f66a-4712-a148-2bc382475d77 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:29.946032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ada23a7f-f66a-4712-a148-2bc382475d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:29.966259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b340fbf9-bb6d-475b-984e-1a0ed4965bf0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:29.967528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b340fbf9-bb6d-475b-984e-1a0ed4965bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:29.976878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada23a7f-f66a-4712-a148-2bc382475d77 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:29.979397 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2113/4158] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:29.985722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340fbf9-bb6d-475b-984e-1a0ed4965bf0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:29.989554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4a720-9099-483c-8b7e-ef1fa42041c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:29.990539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4a720-9099-483c-8b7e-ef1fa42041c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:29.990822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4a720-9099-483c-8b7e-ef1fa42041c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:29.993525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4a720-9099-483c-8b7e-ef1fa42041c2 admin admin] PATH_INFO: `/v3/projects/62baf700c71547259cced4c57f6b88c0` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:29.997240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4a720-9099-483c-8b7e-ef1fa42041c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62baf700c71547259cced4c57f6b88c0)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:30.002240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4a720-9099-483c-8b7e-ef1fa42041c2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:30.016653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b340fbf9-bb6d-475b-984e-1a0ed4965bf0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:30.025842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7999e-b8cd-4df1-bd41-70bad601fb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:30.026669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7999e-b8cd-4df1-bd41-70bad601fb9e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:30.027170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7999e-b8cd-4df1-bd41-70bad601fb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:30.027463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7999e-b8cd-4df1-bd41-70bad601fb9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:30.028224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7999e-b8cd-4df1-bd41-70bad601fb9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:27:30.029118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7999e-b8cd-4df1-bd41-70bad601fb9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:30.030955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7999e-b8cd-4df1-bd41-70bad601fb9e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:30.053225 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2114/4159] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:27:30.062447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7999e-b8cd-4df1-bd41-70bad601fb9e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:30.074888 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:30.081618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7999e-b8cd-4df1-bd41-70bad601fb9e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:30.094277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c461c8f-9b40-4f65-9c8a-f43db7c53b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:30.097064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c461c8f-9b40-4f65-9c8a-f43db7c53b7f admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:30.098892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c461c8f-9b40-4f65-9c8a-f43db7c53b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:30.099602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c461c8f-9b40-4f65-9c8a-f43db7c53b7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:30.100858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c461c8f-9b40-4f65-9c8a-f43db7c53b7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:30.103384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c461c8f-9b40-4f65-9c8a-f43db7c53b7f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:30.211389 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2115/4160] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:27:30 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:30.216497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c461c8f-9b40-4f65-9c8a-f43db7c53b7f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:30.257800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0ba4a720-9099-483c-8b7e-ef1fa42041c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62baf700c71547259cced4c57f6b88c0', 'request_id': 'req-0ba4a720-9099-483c-8b7e-ef1fa42041c2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:30.307841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c461c8f-9b40-4f65-9c8a-f43db7c53b7f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:30.318023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc70c08-3ef2-43da-805d-7bf07fcf74ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:30.320476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc70c08-3ef2-43da-805d-7bf07fcf74ec admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:30.320776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc70c08-3ef2-43da-805d-7bf07fcf74ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:30.321059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc70c08-3ef2-43da-805d-7bf07fcf74ec admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:30.321951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc70c08-3ef2-43da-805d-7bf07fcf74ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:30.325692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc70c08-3ef2-43da-805d-7bf07fcf74ec admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:30.330511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0ba4a720-9099-483c-8b7e-ef1fa42041c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62baf700c71547259cced4c57f6b88c0', 'request_id': 'req-0ba4a720-9099-483c-8b7e-ef1fa42041c2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:30.347921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0ba4a720-9099-483c-8b7e-ef1fa42041c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62baf700c71547259cced4c57f6b88c0', 'request_id': 'req-0ba4a720-9099-483c-8b7e-ef1fa42041c2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:30.376685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0ba4a720-9099-483c-8b7e-ef1fa42041c2 admin admin] The token cache is being invalidate because project 62baf700c71547259cced4c57f6b88c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:30.376685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0ba4a720-9099-483c-8b7e-ef1fa42041c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:30.376685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0ba4a720-9099-483c-8b7e-ef1fa42041c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:30.376685 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2046/4161] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:29 2022] DELETE /identity/v3/projects/62baf700c71547259cced4c57f6b88c0 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:30.380481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae2725-fdf5-461c-b683-753053f14b92 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:30.381058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae2725-fdf5-461c-b683-753053f14b92 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:30.386627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae2725-fdf5-461c-b683-753053f14b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:30.417824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f2ae2725-fdf5-461c-b683-753053f14b92 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:30.419640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f2ae2725-fdf5-461c-b683-753053f14b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:30.467375 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2116/4163] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:27:30 2022] POST /identity/v3/users => generated 291 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:27:30.494920 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2047/4163] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:27:30.494920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae2725-fdf5-461c-b683-753053f14b92 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:30.494920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f2ae2725-fdf5-461c-b683-753053f14b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:30.495505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d30e36-dac2-4988-80dd-ea9813c53fc6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:30.495505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d30e36-dac2-4988-80dd-ea9813c53fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:30.495505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d30e36-dac2-4988-80dd-ea9813c53fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:30.495848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae2725-fdf5-461c-b683-753053f14b92 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:30.504667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b603f-b64e-4196-861b-7009969384f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:30.505799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b603f-b64e-4196-861b-7009969384f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:30.506381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b603f-b64e-4196-861b-7009969384f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:30.507581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b603f-b64e-4196-861b-7009969384f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:30.509635 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b603f-b64e-4196-861b-7009969384f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:30.513840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b603f-b64e-4196-861b-7009969384f6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:30.519851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f6d30e36-dac2-4988-80dd-ea9813c53fc6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:30.520818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f6d30e36-dac2-4988-80dd-ea9813c53fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:30.532816 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2117/4164] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:30.537911 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2048/4165] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:30.538121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d30e36-dac2-4988-80dd-ea9813c53fc6 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:30.540033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b603f-b64e-4196-861b-7009969384f6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:30.555729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b603f-b64e-4196-861b-7009969384f6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:30.560886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d30e36-dac2-4988-80dd-ea9813c53fc6 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:30.567090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a3da3-b9f2-4855-8c5e-6c1d05c1cdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:30.567891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a3da3-b9f2-4855-8c5e-6c1d05c1cdc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:30.568180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a3da3-b9f2-4855-8c5e-6c1d05c1cdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:30.568599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a3da3-b9f2-4855-8c5e-6c1d05c1cdc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:30.568995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677e6a0-dd85-454f-92ce-e227fd7a436c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:30.569350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a3da3-b9f2-4855-8c5e-6c1d05c1cdc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:30.570350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677e6a0-dd85-454f-92ce-e227fd7a436c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:30.572870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a3da3-b9f2-4855-8c5e-6c1d05c1cdc2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:30.574795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677e6a0-dd85-454f-92ce-e227fd7a436c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:30.575078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f677e6a0-dd85-454f-92ce-e227fd7a436c admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:30.576434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677e6a0-dd85-454f-92ce-e227fd7a436c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:27:30.576434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677e6a0-dd85-454f-92ce-e227fd7a436c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:30.580239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f677e6a0-dd85-454f-92ce-e227fd7a436c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:30.589192 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2049/4166] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:30.594585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a3da3-b9f2-4855-8c5e-6c1d05c1cdc2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:30.602500 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2118/4167] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:27:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:27:30.607535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677e6a0-dd85-454f-92ce-e227fd7a436c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:30.613288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a3da3-b9f2-4855-8c5e-6c1d05c1cdc2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:30.621703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f677e6a0-dd85-454f-92ce-e227fd7a436c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:30.622819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f465148-d2fb-4c27-b50b-50bca0c92d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:30.625810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f465148-d2fb-4c27-b50b-50bca0c92d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:30.627504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dc84d-5f85-4137-8ce3-b3037a7ce021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:30.627693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f465148-d2fb-4c27-b50b-50bca0c92d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:30.628143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f465148-d2fb-4c27-b50b-50bca0c92d47 admin admin] PATH_INFO: `/v3/projects/d2cb443567824913b06dca1de538bd55/users/2f6d1220ff4a49e58fbddafb586b3995/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:30.628484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dc84d-5f85-4137-8ce3-b3037a7ce021 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:30.628859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dc84d-5f85-4137-8ce3-b3037a7ce021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:30.629230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dc84d-5f85-4137-8ce3-b3037a7ce021 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:30.630707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9dc84d-5f85-4137-8ce3-b3037a7ce021 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:30.633149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9dc84d-5f85-4137-8ce3-b3037a7ce021 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:30.658468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f465148-d2fb-4c27-b50b-50bca0c92d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2cb443567824913b06dca1de538bd55, user_id=2f6d1220ff4a49e58fbddafb586b3995, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:30.662682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f465148-d2fb-4c27-b50b-50bca0c92d47 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:30.940042 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2050/4168] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:27:30 2022] PUT /identity/v3/projects/d2cb443567824913b06dca1de538bd55/users/2f6d1220ff4a49e58fbddafb586b3995/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:30.951733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e41250-32cc-4878-9327-f2dabd380164 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:30.952282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e41250-32cc-4878-9327-f2dabd380164 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:30.952777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e41250-32cc-4878-9327-f2dabd380164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:30.995900 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2119/4169] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:27:30 2022] POST /identity/v3/projects => generated 387 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:27:30.999833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dc84d-5f85-4137-8ce3-b3037a7ce021 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:31.023718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-60e41250-32cc-4878-9327-f2dabd380164 None None] MFA Rules not processed for user `2f6d1220ff4a49e58fbddafb586b3995`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:31.027342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-60e41250-32cc-4878-9327-f2dabd380164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:31.159405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dc84d-5f85-4137-8ce3-b3037a7ce021 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:31.174021 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:31.188881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7baf9f-2b8c-4a9c-a465-e60d3ed843d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:31.189725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7baf9f-2b8c-4a9c-a465-e60d3ed843d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:31.190143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7baf9f-2b8c-4a9c-a465-e60d3ed843d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:31.190537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7baf9f-2b8c-4a9c-a465-e60d3ed843d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:31.192578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7baf9f-2b8c-4a9c-a465-e60d3ed843d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:31.193659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7baf9f-2b8c-4a9c-a465-e60d3ed843d1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:31.227440 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2051/4170] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:31.246430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e41250-32cc-4878-9327-f2dabd380164 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:31.277565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e41250-32cc-4878-9327-f2dabd380164 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:31.288898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71396b-f77d-4deb-85ba-f11910b773db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:31.290028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71396b-f77d-4deb-85ba-f11910b773db admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:31.291696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71396b-f77d-4deb-85ba-f11910b773db admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:31.292173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71396b-f77d-4deb-85ba-f11910b773db admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:31.297232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71396b-f77d-4deb-85ba-f11910b773db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:31.301815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a71396b-f77d-4deb-85ba-f11910b773db admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:31.303711 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2120/4171] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:27:30 2022] POST /identity/v3/users => generated 294 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:31.307809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7baf9f-2b8c-4a9c-a465-e60d3ed843d1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:31.346757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7baf9f-2b8c-4a9c-a465-e60d3ed843d1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:31.374032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bfaa3-41e5-4b8f-a0dd-b5c5d1d9eeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:31.377354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bfaa3-41e5-4b8f-a0dd-b5c5d1d9eeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:31.380215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bfaa3-41e5-4b8f-a0dd-b5c5d1d9eeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:31.382543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bfaa3-41e5-4b8f-a0dd-b5c5d1d9eeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:31.384333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bfaa3-41e5-4b8f-a0dd-b5c5d1d9eeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:31.391815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bfaa3-41e5-4b8f-a0dd-b5c5d1d9eeb6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:31.431374 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2052/4172] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:27:31 2022] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:31.434038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71396b-f77d-4deb-85ba-f11910b773db admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:31.436925 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2121/4173] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:31.438172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bfaa3-41e5-4b8f-a0dd-b5c5d1d9eeb6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:31.486816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bfaa3-41e5-4b8f-a0dd-b5c5d1d9eeb6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:31.505647 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:31.669822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a71396b-f77d-4deb-85ba-f11910b773db admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:31.685350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e16fc-80c4-4948-84da-fd5701d28ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:31.686316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e16fc-80c4-4948-84da-fd5701d28ddc admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:31.686607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e16fc-80c4-4948-84da-fd5701d28ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:31.686886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e16fc-80c4-4948-84da-fd5701d28ddc admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:31.687593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e16fc-80c4-4948-84da-fd5701d28ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:31.689616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e16fc-80c4-4948-84da-fd5701d28ddc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:31.730336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659c479-227f-49f9-834d-16ab3a9264c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:31.733489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659c479-227f-49f9-834d-16ab3a9264c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:31.737025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659c479-227f-49f9-834d-16ab3a9264c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:31.739096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659c479-227f-49f9-834d-16ab3a9264c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:31.741245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659c479-227f-49f9-834d-16ab3a9264c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:31.749735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659c479-227f-49f9-834d-16ab3a9264c5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:31.792614 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2122/4174] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:31.795235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659c479-227f-49f9-834d-16ab3a9264c5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:31.803647 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2053/4175] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:27:31 2022] POST /identity/v3/users => generated 291 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:31.804564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e16fc-80c4-4948-84da-fd5701d28ddc admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:31.831714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e16fc-80c4-4948-84da-fd5701d28ddc admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:31.837222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659c479-227f-49f9-834d-16ab3a9264c5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:31.843351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d601360-4955-41b0-83d9-54931478a473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:31.844057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d601360-4955-41b0-83d9-54931478a473 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:31.844342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d601360-4955-41b0-83d9-54931478a473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:31.844625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d601360-4955-41b0-83d9-54931478a473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:31.845363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d601360-4955-41b0-83d9-54931478a473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:31.861870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b10d9a-1ade-4843-8f10-892d58052a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:31.862923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d601360-4955-41b0-83d9-54931478a473 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:31.868132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b10d9a-1ade-4843-8f10-892d58052a27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:31.871219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b10d9a-1ade-4843-8f10-892d58052a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:31.873535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b10d9a-1ade-4843-8f10-892d58052a27 admin admin] PATH_INFO: `/v3/projects/473c994c21b742abae0e11b0ab033921/users/505a5026c10a49a893e04d45a011167d/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:31.908802 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2054/4176] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:31.909745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d601360-4955-41b0-83d9-54931478a473 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:31.929139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d601360-4955-41b0-83d9-54931478a473 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:31.935508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b10d9a-1ade-4843-8f10-892d58052a27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=473c994c21b742abae0e11b0ab033921, user_id=505a5026c10a49a893e04d45a011167d, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:31.939807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b10d9a-1ade-4843-8f10-892d58052a27 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:31.941476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbaf04-7d0a-43bc-9ca0-d94562846205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:31.942196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbaf04-7d0a-43bc-9ca0-d94562846205 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:31.942488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbaf04-7d0a-43bc-9ca0-d94562846205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:31.942769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbaf04-7d0a-43bc-9ca0-d94562846205 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:31.943698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbaf04-7d0a-43bc-9ca0-d94562846205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:31.945696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbaf04-7d0a-43bc-9ca0-d94562846205 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:31.976007 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2055/4177] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:31 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:31.977171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbaf04-7d0a-43bc-9ca0-d94562846205 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:32.002726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbaf04-7d0a-43bc-9ca0-d94562846205 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:32.013995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc600f1d-229a-40ed-91fe-d873c7160c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:32.016562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc600f1d-229a-40ed-91fe-d873c7160c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:32.016854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc600f1d-229a-40ed-91fe-d873c7160c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:32.017246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc600f1d-229a-40ed-91fe-d873c7160c16 admin admin] PATH_INFO: `/v3/projects/854188b714fe44d384e318f355b83bef/users/a7a59cea81aa485e9824169d9e88d25b/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:32.029080 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2123/4178] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:27:31 2022] PUT /identity/v3/projects/473c994c21b742abae0e11b0ab033921/users/505a5026c10a49a893e04d45a011167d/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:32.034355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217a668-6a49-4f08-9dc5-0ea8df69c490 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:32.034763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217a668-6a49-4f08-9dc5-0ea8df69c490 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:32.035361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217a668-6a49-4f08-9dc5-0ea8df69c490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:32.051235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc600f1d-229a-40ed-91fe-d873c7160c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=854188b714fe44d384e318f355b83bef, user_id=a7a59cea81aa485e9824169d9e88d25b, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:32.057818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc600f1d-229a-40ed-91fe-d873c7160c16 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:32.097244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1217a668-6a49-4f08-9dc5-0ea8df69c490 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:32.102649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1217a668-6a49-4f08-9dc5-0ea8df69c490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:32.160336 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2056/4179] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:27:31 2022] PUT /identity/v3/projects/854188b714fe44d384e318f355b83bef/users/a7a59cea81aa485e9824169d9e88d25b/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:32.161996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fa297-34e7-464b-be6a-1012a924d618 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:32.162388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fa297-34e7-464b-be6a-1012a924d618 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:32.162689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fa297-34e7-464b-be6a-1012a924d618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:32.237682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-470fa297-34e7-464b-be6a-1012a924d618 None None] MFA Rules not processed for user `a7a59cea81aa485e9824169d9e88d25b`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:32.239018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-470fa297-34e7-464b-be6a-1012a924d618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:32.309035 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2124/4180] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:32.434877 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2057/4181] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:32.435727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217a668-6a49-4f08-9dc5-0ea8df69c490 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:32.489967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fa297-34e7-464b-be6a-1012a924d618 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:32.491735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-470fa297-34e7-464b-be6a-1012a924d618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:32.510025 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:32.607412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217a668-6a49-4f08-9dc5-0ea8df69c490 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:32.636256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fa297-34e7-464b-be6a-1012a924d618 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:32.647485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9eac8-2d42-4a9d-829e-04dec91e16e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:32.648429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9eac8-2d42-4a9d-829e-04dec91e16e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:32.662512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9eac8-2d42-4a9d-829e-04dec91e16e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:32.662512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9eac8-2d42-4a9d-829e-04dec91e16e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:32.662810 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:32.706879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b6672-a6cf-407a-998e-24547dec0c1e tempest-IdentityV3ProjectsTest-1060905194 tempest-IdentityV3ProjectsTest-1060905194-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f6d1220ff4a49e58fbddafb586b3995', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd2cb443567824913b06dca1de538bd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:32.707926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b6672-a6cf-407a-998e-24547dec0c1e tempest-IdentityV3ProjectsTest-1060905194 tempest-IdentityV3ProjectsTest-1060905194-project] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:32.708448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b6672-a6cf-407a-998e-24547dec0c1e tempest-IdentityV3ProjectsTest-1060905194 tempest-IdentityV3ProjectsTest-1060905194-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:32.708742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b6672-a6cf-407a-998e-24547dec0c1e tempest-IdentityV3ProjectsTest-1060905194 tempest-IdentityV3ProjectsTest-1060905194-project] PATH_INFO: `/v3/users/2f6d1220ff4a49e58fbddafb586b3995/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:32.711226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b6672-a6cf-407a-998e-24547dec0c1e tempest-IdentityV3ProjectsTest-1060905194 tempest-IdentityV3ProjectsTest-1060905194-project] RBAC: Authorizing `identity:list_user_projects(user_id=2f6d1220ff4a49e58fbddafb586b3995)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:32.719628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b6672-a6cf-407a-998e-24547dec0c1e tempest-IdentityV3ProjectsTest-1060905194 tempest-IdentityV3ProjectsTest-1060905194-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:32.779327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9eac8-2d42-4a9d-829e-04dec91e16e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:32.781097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9eac8-2d42-4a9d-829e-04dec91e16e6 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:32.802997 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2125/4182] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jul 19 14:27:32 2022] GET /identity/v3/users/2f6d1220ff4a49e58fbddafb586b3995/projects => generated 517 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:27:32.806343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee5ca3-e3be-4df7-9812-d025de23773b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:32.807228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee5ca3-e3be-4df7-9812-d025de23773b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:32.807674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee5ca3-e3be-4df7-9812-d025de23773b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:32.814693 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2058/4183] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:27:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:27:32.841760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6fee5ca3-e3be-4df7-9812-d025de23773b None None] MFA Rules not processed for user `2f6d1220ff4a49e58fbddafb586b3995`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:32.843278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6fee5ca3-e3be-4df7-9812-d025de23773b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:32.875865 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2126/4184] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:32.877343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe5456-3e40-4847-8aed-7d2125b9b822 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:32.877848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe5456-3e40-4847-8aed-7d2125b9b822 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:32.878159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe5456-3e40-4847-8aed-7d2125b9b822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:32.939399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4bbe5456-3e40-4847-8aed-7d2125b9b822 None None] MFA Rules not processed for user `2f6d1220ff4a49e58fbddafb586b3995`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:32.939399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4bbe5456-3e40-4847-8aed-7d2125b9b822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:33.063984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.models.token_model [None req-4bbe5456-3e40-4847-8aed-7d2125b9b822 None None] User 2f6d1220ff4a49e58fbddafb586b3995 has no access to project 854188b714fe44d384e318f355b83bef {{(pid=80679) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Jul 19 14:27:33.070744 n-d-master-1 devstack@keystone.service[80679]: WARNING keystone.server.flask.application [None req-4bbe5456-3e40-4847-8aed-7d2125b9b822 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.43: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 19 14:27:33.081427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee5ca3-e3be-4df7-9812-d025de23773b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:33.089052 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2059/4185] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:32 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 211 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 19 14:27:33.097422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee5ca3-e3be-4df7-9812-d025de23773b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:33.105502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78918221-0eda-45de-a263-b0b725f92f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:33.106707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78918221-0eda-45de-a263-b0b725f92f43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:33.107193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78918221-0eda-45de-a263-b0b725f92f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:33.107666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78918221-0eda-45de-a263-b0b725f92f43 admin admin] PATH_INFO: `/v3/users/2f6d1220ff4a49e58fbddafb586b3995` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:33.109189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78918221-0eda-45de-a263-b0b725f92f43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f6d1220ff4a49e58fbddafb586b3995)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:33.112455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78918221-0eda-45de-a263-b0b725f92f43 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:33.416529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-78918221-0eda-45de-a263-b0b725f92f43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f6d1220ff4a49e58fbddafb586b3995'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:33.432426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-78918221-0eda-45de-a263-b0b725f92f43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f6d1220ff4a49e58fbddafb586b3995'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:33.441913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-78918221-0eda-45de-a263-b0b725f92f43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f6d1220ff4a49e58fbddafb586b3995'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:33.443681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-78918221-0eda-45de-a263-b0b725f92f43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f6d1220ff4a49e58fbddafb586b3995'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:33.542630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-78918221-0eda-45de-a263-b0b725f92f43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f6d1220ff4a49e58fbddafb586b3995'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:33.564418 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2127/4186] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:27:33 2022] DELETE /identity/v3/users/2f6d1220ff4a49e58fbddafb586b3995 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:33.569530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756923bc-829c-473e-bdb0-ea6d6b3a0703 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:33.570020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756923bc-829c-473e-bdb0-ea6d6b3a0703 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:33.570667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756923bc-829c-473e-bdb0-ea6d6b3a0703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:33.605085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-756923bc-829c-473e-bdb0-ea6d6b3a0703 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:33.611873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-756923bc-829c-473e-bdb0-ea6d6b3a0703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:33.752719 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2060/4187] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:33.794710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78918221-0eda-45de-a263-b0b725f92f43 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:33.796333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-78918221-0eda-45de-a263-b0b725f92f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:33.932517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78918221-0eda-45de-a263-b0b725f92f43 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:33.941052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abd652-7513-4c37-9df9-24b41f24862d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:33.941724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abd652-7513-4c37-9df9-24b41f24862d service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:33.942009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abd652-7513-4c37-9df9-24b41f24862d service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:33.942320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4abd652-7513-4c37-9df9-24b41f24862d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:33.956502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abd652-7513-4c37-9df9-24b41f24862d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:33.958318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4abd652-7513-4c37-9df9-24b41f24862d service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:33.975932 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2128/4188] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:27:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:27:35.682602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756923bc-829c-473e-bdb0-ea6d6b3a0703 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:35.684084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-756923bc-829c-473e-bdb0-ea6d6b3a0703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:35.708739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756923bc-829c-473e-bdb0-ea6d6b3a0703 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:35.723202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e80201-189e-4a37-8ae4-a2733e11c06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:35.724174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e80201-189e-4a37-8ae4-a2733e11c06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:35.724523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e80201-189e-4a37-8ae4-a2733e11c06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:35.726082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e80201-189e-4a37-8ae4-a2733e11c06f admin admin] PATH_INFO: `/v3/projects/d2cb443567824913b06dca1de538bd55` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:35.727455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e80201-189e-4a37-8ae4-a2733e11c06f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2cb443567824913b06dca1de538bd55)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:35.734850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e80201-189e-4a37-8ae4-a2733e11c06f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:35.756031 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:35.862090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abd652-7513-4c37-9df9-24b41f24862d service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:35.863880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e4abd652-7513-4c37-9df9-24b41f24862d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:35.881470 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:35.891651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4abd652-7513-4c37-9df9-24b41f24862d service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:35.894497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-40e80201-189e-4a37-8ae4-a2733e11c06f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2cb443567824913b06dca1de538bd55', 'request_id': 'req-40e80201-189e-4a37-8ae4-a2733e11c06f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:35.952922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-40e80201-189e-4a37-8ae4-a2733e11c06f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2cb443567824913b06dca1de538bd55', 'request_id': 'req-40e80201-189e-4a37-8ae4-a2733e11c06f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:35.963436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-40e80201-189e-4a37-8ae4-a2733e11c06f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2cb443567824913b06dca1de538bd55', 'request_id': 'req-40e80201-189e-4a37-8ae4-a2733e11c06f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:35.981241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-40e80201-189e-4a37-8ae4-a2733e11c06f admin admin] The token cache is being invalidate because project d2cb443567824913b06dca1de538bd55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:35.981835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-40e80201-189e-4a37-8ae4-a2733e11c06f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:35.983450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-40e80201-189e-4a37-8ae4-a2733e11c06f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:35.986693 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2061/4189] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:35 2022] DELETE /identity/v3/projects/d2cb443567824913b06dca1de538bd55 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:35.990717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e80201-189e-4a37-8ae4-a2733e11c06f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:35.993145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-40e80201-189e-4a37-8ae4-a2733e11c06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:36.003222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f47ff-2ece-41e2-952b-e835ba494cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:36.004813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f47ff-2ece-41e2-952b-e835ba494cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:36.005306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f47ff-2ece-41e2-952b-e835ba494cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:36.005822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f47ff-2ece-41e2-952b-e835ba494cf7 admin admin] PATH_INFO: `/v3/users/bfba896c72964388b328edeb9af61880` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:36.008745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f47ff-2ece-41e2-952b-e835ba494cf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfba896c72964388b328edeb9af61880)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:36.014319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f47ff-2ece-41e2-952b-e835ba494cf7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:36.112318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e80201-189e-4a37-8ae4-a2733e11c06f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:36.121609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4579a-ee5f-40cb-a932-15e309e32d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:36.123778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4579a-ee5f-40cb-a932-15e309e32d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:36.124134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4579a-ee5f-40cb-a932-15e309e32d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:36.125208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4579a-ee5f-40cb-a932-15e309e32d16 admin admin] PATH_INFO: `/v3/users/a7a59cea81aa485e9824169d9e88d25b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:36.128388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4579a-ee5f-40cb-a932-15e309e32d16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7a59cea81aa485e9824169d9e88d25b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:36.132085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4579a-ee5f-40cb-a932-15e309e32d16 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:36.269383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-de2f47ff-2ece-41e2-952b-e835ba494cf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfba896c72964388b328edeb9af61880'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:36.301328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-de2f47ff-2ece-41e2-952b-e835ba494cf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfba896c72964388b328edeb9af61880'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:36.328996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-de2f47ff-2ece-41e2-952b-e835ba494cf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfba896c72964388b328edeb9af61880'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:36.329922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-de2f47ff-2ece-41e2-952b-e835ba494cf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfba896c72964388b328edeb9af61880'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:36.339111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4aa4579a-ee5f-40cb-a932-15e309e32d16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7a59cea81aa485e9824169d9e88d25b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:36.379559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4aa4579a-ee5f-40cb-a932-15e309e32d16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7a59cea81aa485e9824169d9e88d25b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:36.381707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4aa4579a-ee5f-40cb-a932-15e309e32d16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7a59cea81aa485e9824169d9e88d25b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:36.383314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4aa4579a-ee5f-40cb-a932-15e309e32d16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7a59cea81aa485e9824169d9e88d25b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:36.403249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4aa4579a-ee5f-40cb-a932-15e309e32d16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7a59cea81aa485e9824169d9e88d25b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:36.450460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-de2f47ff-2ece-41e2-952b-e835ba494cf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfba896c72964388b328edeb9af61880'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:36.466348 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2129/4190] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:27:35 2022] DELETE /identity/v3/users/bfba896c72964388b328edeb9af61880 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:36.525610 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2062/4191] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:27:35 2022] DELETE /identity/v3/users/a7a59cea81aa485e9824169d9e88d25b => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:37.065316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c23c04-6b7d-4677-bc67-f2477d1bbd47 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:37.065891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c23c04-6b7d-4677-bc67-f2477d1bbd47 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:37.065891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c23c04-6b7d-4677-bc67-f2477d1bbd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:37.105121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-51c23c04-6b7d-4677-bc67-f2477d1bbd47 None None] MFA Rules not processed for user `41685fc5b447416faf39e4d43a444b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:37.106457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-51c23c04-6b7d-4677-bc67-f2477d1bbd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:37.233522 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2130/4192] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:37.244627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77507b87-fb3c-4645-abe8-f2580a73ff7a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:37.245116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77507b87-fb3c-4645-abe8-f2580a73ff7a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:37.245327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77507b87-fb3c-4645-abe8-f2580a73ff7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:37.291902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-77507b87-fb3c-4645-abe8-f2580a73ff7a None None] MFA Rules not processed for user `41685fc5b447416faf39e4d43a444b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:37.293447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-77507b87-fb3c-4645-abe8-f2580a73ff7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:37.307694 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2063/4193] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:37.310473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c23c04-6b7d-4677-bc67-f2477d1bbd47 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:37.312806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-51c23c04-6b7d-4677-bc67-f2477d1bbd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:37.324092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77507b87-fb3c-4645-abe8-f2580a73ff7a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:37.331273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-77507b87-fb3c-4645-abe8-f2580a73ff7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:37.366087 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:37.380489 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:37.494620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c23c04-6b7d-4677-bc67-f2477d1bbd47 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:37.515934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce8e48-57dd-4d09-a0c6-80e66cd5088a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:37.516831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce8e48-57dd-4d09-a0c6-80e66cd5088a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:37.521628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce8e48-57dd-4d09-a0c6-80e66cd5088a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:37.521944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce8e48-57dd-4d09-a0c6-80e66cd5088a admin admin] PATH_INFO: `/v3/projects/0e298c9977714fd2a7191eaa04038933` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:37.526668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce8e48-57dd-4d09-a0c6-80e66cd5088a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e298c9977714fd2a7191eaa04038933)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:37.532085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcce8e48-57dd-4d09-a0c6-80e66cd5088a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:37.565947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77507b87-fb3c-4645-abe8-f2580a73ff7a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:37.580905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cdc42-b5fd-4b6b-8bc9-8feb202a0f9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:37.584435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cdc42-b5fd-4b6b-8bc9-8feb202a0f9a service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:37.589312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cdc42-b5fd-4b6b-8bc9-8feb202a0f9a service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:37.589312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cdc42-b5fd-4b6b-8bc9-8feb202a0f9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:37.605828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cdc42-b5fd-4b6b-8bc9-8feb202a0f9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:37.608377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cdc42-b5fd-4b6b-8bc9-8feb202a0f9a service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:37.627479 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2064/4194] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:27:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:27:37.694642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bcce8e48-57dd-4d09-a0c6-80e66cd5088a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e298c9977714fd2a7191eaa04038933', 'request_id': 'req-bcce8e48-57dd-4d09-a0c6-80e66cd5088a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:37.708139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bcce8e48-57dd-4d09-a0c6-80e66cd5088a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e298c9977714fd2a7191eaa04038933', 'request_id': 'req-bcce8e48-57dd-4d09-a0c6-80e66cd5088a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:37.723491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bcce8e48-57dd-4d09-a0c6-80e66cd5088a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e298c9977714fd2a7191eaa04038933', 'request_id': 'req-bcce8e48-57dd-4d09-a0c6-80e66cd5088a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:37.810141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cdc42-b5fd-4b6b-8bc9-8feb202a0f9a service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:37.812765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b80cdc42-b5fd-4b6b-8bc9-8feb202a0f9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:37.831372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bcce8e48-57dd-4d09-a0c6-80e66cd5088a admin admin] The token cache is being invalidate because project 0e298c9977714fd2a7191eaa04038933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:37.831982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bcce8e48-57dd-4d09-a0c6-80e66cd5088a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:37.833295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bcce8e48-57dd-4d09-a0c6-80e66cd5088a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:37.839303 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2131/4195] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:37 2022] DELETE /identity/v3/projects/0e298c9977714fd2a7191eaa04038933 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:37.845037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90528501-66c1-4853-9c88-fe65e7fd0047 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:37.846255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90528501-66c1-4853-9c88-fe65e7fd0047 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:37.846741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90528501-66c1-4853-9c88-fe65e7fd0047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:37.870517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cdc42-b5fd-4b6b-8bc9-8feb202a0f9a service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:37.916447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-90528501-66c1-4853-9c88-fe65e7fd0047 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:37.916447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-90528501-66c1-4853-9c88-fe65e7fd0047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:38.030207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf2a43-1c4c-46d4-b6b2-b90d83bf9ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:38.031221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf2a43-1c4c-46d4-b6b2-b90d83bf9ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:38.031577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf2a43-1c4c-46d4-b6b2-b90d83bf9ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:38.031930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf2a43-1c4c-46d4-b6b2-b90d83bf9ad6 admin admin] PATH_INFO: `/v3/projects/854188b714fe44d384e318f355b83bef` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:38.034933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf2a43-1c4c-46d4-b6b2-b90d83bf9ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=854188b714fe44d384e318f355b83bef)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:38.037214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbf2a43-1c4c-46d4-b6b2-b90d83bf9ad6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:38.098916 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2132/4196] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:38.107222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee8d54-98c3-4f8f-a7c6-6d46a93a2f99 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:38.107772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee8d54-98c3-4f8f-a7c6-6d46a93a2f99 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:38.114648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee8d54-98c3-4f8f-a7c6-6d46a93a2f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:38.140586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6dee8d54-98c3-4f8f-a7c6-6d46a93a2f99 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:38.141832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6dee8d54-98c3-4f8f-a7c6-6d46a93a2f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:38.165740 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2133/4197] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:27:38.170281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee8d54-98c3-4f8f-a7c6-6d46a93a2f99 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:38.189394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee8d54-98c3-4f8f-a7c6-6d46a93a2f99 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:38.238471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2dbf2a43-1c4c-46d4-b6b2-b90d83bf9ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '854188b714fe44d384e318f355b83bef', 'request_id': 'req-2dbf2a43-1c4c-46d4-b6b2-b90d83bf9ad6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:38.312671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2dbf2a43-1c4c-46d4-b6b2-b90d83bf9ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '854188b714fe44d384e318f355b83bef', 'request_id': 'req-2dbf2a43-1c4c-46d4-b6b2-b90d83bf9ad6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:38.320474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4d18b-15ac-43a2-8060-ff2e5e5c5608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:38.322475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4d18b-15ac-43a2-8060-ff2e5e5c5608 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:38.322475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4d18b-15ac-43a2-8060-ff2e5e5c5608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:38.322906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4d18b-15ac-43a2-8060-ff2e5e5c5608 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:38.324300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4d18b-15ac-43a2-8060-ff2e5e5c5608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:27:38.324460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2dbf2a43-1c4c-46d4-b6b2-b90d83bf9ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '854188b714fe44d384e318f355b83bef', 'request_id': 'req-2dbf2a43-1c4c-46d4-b6b2-b90d83bf9ad6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:38.324931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4d18b-15ac-43a2-8060-ff2e5e5c5608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:38.326988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4d18b-15ac-43a2-8060-ff2e5e5c5608 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:38.341817 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2134/4198] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:27:38.342982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4d18b-15ac-43a2-8060-ff2e5e5c5608 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:38.345701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-90d4d18b-15ac-43a2-8060-ff2e5e5c5608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:38.356251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2dbf2a43-1c4c-46d4-b6b2-b90d83bf9ad6 admin admin] The token cache is being invalidate because project 854188b714fe44d384e318f355b83bef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:38.356251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2dbf2a43-1c4c-46d4-b6b2-b90d83bf9ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:38.356892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2dbf2a43-1c4c-46d4-b6b2-b90d83bf9ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:38.365922 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2065/4199] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:37 2022] DELETE /identity/v3/projects/854188b714fe44d384e318f355b83bef => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:38.366847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf2a43-1c4c-46d4-b6b2-b90d83bf9ad6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:38.369710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2dbf2a43-1c4c-46d4-b6b2-b90d83bf9ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:38.394223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf2a43-1c4c-46d4-b6b2-b90d83bf9ad6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:38.402388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652bd30-1f90-4078-845b-4fb370a76ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:38.403128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652bd30-1f90-4078-845b-4fb370a76ffe admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:38.403321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652bd30-1f90-4078-845b-4fb370a76ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:38.403676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652bd30-1f90-4078-845b-4fb370a76ffe admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:38.404499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652bd30-1f90-4078-845b-4fb370a76ffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:38.407662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652bd30-1f90-4078-845b-4fb370a76ffe admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:38.476616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4d18b-15ac-43a2-8060-ff2e5e5c5608 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:38.493505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2579f212-5dee-48c5-b4e2-e00b2345fb6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:38.496283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579f212-5dee-48c5-b4e2-e00b2345fb6a service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:38.500297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579f212-5dee-48c5-b4e2-e00b2345fb6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:38.501658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2579f212-5dee-48c5-b4e2-e00b2345fb6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:38.508070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2579f212-5dee-48c5-b4e2-e00b2345fb6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:38.537934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579f212-5dee-48c5-b4e2-e00b2345fb6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:38.542280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2579f212-5dee-48c5-b4e2-e00b2345fb6a service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:38.563508 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2135/4200] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:27:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:27:38.567861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79657560-a79d-418e-929e-fe9ba7088681 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:38.568159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79657560-a79d-418e-929e-fe9ba7088681 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:38.568442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79657560-a79d-418e-929e-fe9ba7088681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:38.597996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-79657560-a79d-418e-929e-fe9ba7088681 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:38.600098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-79657560-a79d-418e-929e-fe9ba7088681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:38.612694 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2136/4201] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:38.630162 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2066/4202] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:27:38 2022] POST /identity/v3/projects => generated 397 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:38.630529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee448b9-1c36-48c9-b131-66c0fd421ad6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:38.643876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652bd30-1f90-4078-845b-4fb370a76ffe admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:38.644863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee448b9-1c36-48c9-b131-66c0fd421ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:38.646129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee448b9-1c36-48c9-b131-66c0fd421ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:38.684397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-dee448b9-1c36-48c9-b131-66c0fd421ad6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:38.686537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dee448b9-1c36-48c9-b131-66c0fd421ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:38.796430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652bd30-1f90-4078-845b-4fb370a76ffe admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:38.803835 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2137/4203] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:38.808352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917e8e0-3a88-42df-8eae-dbc517c28e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:38.808838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee448b9-1c36-48c9-b131-66c0fd421ad6 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:38.809216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917e8e0-3a88-42df-8eae-dbc517c28e73 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:38.809602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917e8e0-3a88-42df-8eae-dbc517c28e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:38.809982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d917e8e0-3a88-42df-8eae-dbc517c28e73 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:38.810810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917e8e0-3a88-42df-8eae-dbc517c28e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:38.812853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d917e8e0-3a88-42df-8eae-dbc517c28e73 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:38.821409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee448b9-1c36-48c9-b131-66c0fd421ad6 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:38.829337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed32f82-1383-430f-9a6c-9148b819abad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:38.830454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed32f82-1383-430f-9a6c-9148b819abad admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:38.831243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed32f82-1383-430f-9a6c-9148b819abad admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:38.831688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed32f82-1383-430f-9a6c-9148b819abad admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:38.832473 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:38.832904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed32f82-1383-430f-9a6c-9148b819abad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:27:38.833559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed32f82-1383-430f-9a6c-9148b819abad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:38.841722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed32f82-1383-430f-9a6c-9148b819abad admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:38.863242 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:38.871318 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2138/4204] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:27:38.875998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed32f82-1383-430f-9a6c-9148b819abad admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:38.894561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed32f82-1383-430f-9a6c-9148b819abad admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:38.901642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4226073-6aee-4cd9-a5d3-cd3037b498c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:38.902751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4226073-6aee-4cd9-a5d3-cd3037b498c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:38.903222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4226073-6aee-4cd9-a5d3-cd3037b498c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:38.903675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4226073-6aee-4cd9-a5d3-cd3037b498c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:38.904754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4226073-6aee-4cd9-a5d3-cd3037b498c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:38.913990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4226073-6aee-4cd9-a5d3-cd3037b498c3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:38.950001 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2067/4205] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:27:38 2022] POST /identity/v3/users => generated 299 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:38.954551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917e8e0-3a88-42df-8eae-dbc517c28e73 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:38.987803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d917e8e0-3a88-42df-8eae-dbc517c28e73 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:38.994828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7d673-202f-443c-a535-e3ab4092eccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:38.995584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7d673-202f-443c-a535-e3ab4092eccf admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:38.995896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7d673-202f-443c-a535-e3ab4092eccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:38.996306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b7d673-202f-443c-a535-e3ab4092eccf admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:38.997563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7d673-202f-443c-a535-e3ab4092eccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:38.999761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b7d673-202f-443c-a535-e3ab4092eccf admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:39.022716 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2139/4206] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:27:38 2022] POST /identity/v3/projects => generated 363 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:39.026691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4226073-6aee-4cd9-a5d3-cd3037b498c3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:39.043026 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2068/4207] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:39.047261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7d673-202f-443c-a535-e3ab4092eccf admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:39.072611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b7d673-202f-443c-a535-e3ab4092eccf admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:39.170327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4226073-6aee-4cd9-a5d3-cd3037b498c3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:39.183104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d99237-5ce2-452b-b6ed-84667bc3ef89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:39.184145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d99237-5ce2-452b-b6ed-84667bc3ef89 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:39.184673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d99237-5ce2-452b-b6ed-84667bc3ef89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:39.185385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d99237-5ce2-452b-b6ed-84667bc3ef89 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:39.187595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d99237-5ce2-452b-b6ed-84667bc3ef89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:39.191440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d99237-5ce2-452b-b6ed-84667bc3ef89 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:39.206196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec4817-287d-46a3-9de4-b11b0fdf69c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:39.207329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec4817-287d-46a3-9de4-b11b0fdf69c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:39.207849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec4817-287d-46a3-9de4-b11b0fdf69c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:39.208404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec4817-287d-46a3-9de4-b11b0fdf69c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:39.209539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec4817-287d-46a3-9de4-b11b0fdf69c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:39.215687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec4817-287d-46a3-9de4-b11b0fdf69c8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:39.233316 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2069/4208] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:39.238858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec4817-287d-46a3-9de4-b11b0fdf69c8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:39.262428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec4817-287d-46a3-9de4-b11b0fdf69c8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:39.277791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b0340-933a-4be7-ba37-5b033441ff1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:39.277791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b0340-933a-4be7-ba37-5b033441ff1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:39.277791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b0340-933a-4be7-ba37-5b033441ff1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:39.277791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b0340-933a-4be7-ba37-5b033441ff1d admin admin] PATH_INFO: `/v3/projects/39753f2e16e74cb38395aebae58d2c0d/users/6243dbb5b9c74c3fa487b431a36924f9/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:39.293832 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2140/4209] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:27:39 2022] POST /identity/v3/users => generated 282 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:27:39.300058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d99237-5ce2-452b-b6ed-84667bc3ef89 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:39.315691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b0340-933a-4be7-ba37-5b033441ff1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=39753f2e16e74cb38395aebae58d2c0d, user_id=6243dbb5b9c74c3fa487b431a36924f9, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:39.319593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d99237-5ce2-452b-b6ed-84667bc3ef89 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:39.321719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b0340-933a-4be7-ba37-5b033441ff1d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:39.350120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df69bd-f320-4aa6-9912-d613c400c9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:39.350120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df69bd-f320-4aa6-9912-d613c400c9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:39.350120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df69bd-f320-4aa6-9912-d613c400c9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:39.350120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df69bd-f320-4aa6-9912-d613c400c9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:39.351108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df69bd-f320-4aa6-9912-d613c400c9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:39.351108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df69bd-f320-4aa6-9912-d613c400c9c0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:39.372120 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2141/4210] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:39.378377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df69bd-f320-4aa6-9912-d613c400c9c0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:39.398605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df69bd-f320-4aa6-9912-d613c400c9c0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:39.405755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaffae3-3b4f-4c49-9a57-a5a920101e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:39.409009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaffae3-3b4f-4c49-9a57-a5a920101e28 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:39.409009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaffae3-3b4f-4c49-9a57-a5a920101e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:39.409009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaffae3-3b4f-4c49-9a57-a5a920101e28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:39.409009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaffae3-3b4f-4c49-9a57-a5a920101e28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:39.411485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaffae3-3b4f-4c49-9a57-a5a920101e28 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:39.424374 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2142/4211] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:39.428596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaffae3-3b4f-4c49-9a57-a5a920101e28 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:39.450371 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2070/4212] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:27:39 2022] PUT /identity/v3/projects/39753f2e16e74cb38395aebae58d2c0d/users/6243dbb5b9c74c3fa487b431a36924f9/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:39.452115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8b2f0-73d8-471a-a53e-1d431f7ceb66 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:39.452501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8b2f0-73d8-471a-a53e-1d431f7ceb66 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:39.452877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8b2f0-73d8-471a-a53e-1d431f7ceb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:39.456689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaffae3-3b4f-4c49-9a57-a5a920101e28 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:39.488503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-38d8b2f0-73d8-471a-a53e-1d431f7ceb66 None None] MFA Rules not processed for user `6243dbb5b9c74c3fa487b431a36924f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:39.493065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-38d8b2f0-73d8-471a-a53e-1d431f7ceb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:39.594045 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:39.599137 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:39.618254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a7f7a-ee06-400b-b26b-889b47b7a9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:39.620847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a7f7a-ee06-400b-b26b-889b47b7a9e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:39.621635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a7f7a-ee06-400b-b26b-889b47b7a9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:39.622313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a7f7a-ee06-400b-b26b-889b47b7a9e9 admin admin] PATH_INFO: `/v3/projects/e38a7dbb549e4e97b1af2daaee55f38e/users/a0673fec4b254fdf92389841073a438c/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:39.645910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a7f7a-ee06-400b-b26b-889b47b7a9e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e38a7dbb549e4e97b1af2daaee55f38e, user_id=a0673fec4b254fdf92389841073a438c, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:39.656014 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2071/4213] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:39 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:39.664418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a7f7a-ee06-400b-b26b-889b47b7a9e9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:39.671675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8b2f0-73d8-471a-a53e-1d431f7ceb66 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:39.675897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-38d8b2f0-73d8-471a-a53e-1d431f7ceb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:39.760806 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2143/4214] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:27:39 2022] PUT /identity/v3/projects/e38a7dbb549e4e97b1af2daaee55f38e/users/a0673fec4b254fdf92389841073a438c/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:27:39.771242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b4229-6d2f-4f01-848d-70c5600a96f0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:39.771538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b4229-6d2f-4f01-848d-70c5600a96f0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:39.772397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b4229-6d2f-4f01-848d-70c5600a96f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:39.829167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8b2f0-73d8-471a-a53e-1d431f7ceb66 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:39.847630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-873b4229-6d2f-4f01-848d-70c5600a96f0 None None] MFA Rules not processed for user `a0673fec4b254fdf92389841073a438c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:39.855311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-873b4229-6d2f-4f01-848d-70c5600a96f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:40.025486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3f3db-6239-4584-ad4b-357703d25450 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:40.026867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3f3db-6239-4584-ad4b-357703d25450 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:40.027410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3f3db-6239-4584-ad4b-357703d25450 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:40.027861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3f3db-6239-4584-ad4b-357703d25450 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:40.093824 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2144/4215] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:39 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:27:40.107204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b4229-6d2f-4f01-848d-70c5600a96f0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:40.108996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-873b4229-6d2f-4f01-848d-70c5600a96f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:40.140293 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:40.181760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3f3db-6239-4584-ad4b-357703d25450 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:40.186125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3f3db-6239-4584-ad4b-357703d25450 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:40.239903 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2072/4216] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:27:39 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:27:40.293651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b4229-6d2f-4f01-848d-70c5600a96f0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:40.302794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf38bd-7b55-40fb-bbdf-ec50920f63d4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:40.304107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf38bd-7b55-40fb-bbdf-ec50920f63d4 service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:40.320646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf38bd-7b55-40fb-bbdf-ec50920f63d4 service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:40.320646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf38bd-7b55-40fb-bbdf-ec50920f63d4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:40.361289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf38bd-7b55-40fb-bbdf-ec50920f63d4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:40.371194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf38bd-7b55-40fb-bbdf-ec50920f63d4 service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:40.425346 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2145/4217] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:27:40 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:27:40.593621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94133105-6121-49de-b76b-cd28b8fb2e81 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:40.594770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94133105-6121-49de-b76b-cd28b8fb2e81 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:40.595223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94133105-6121-49de-b76b-cd28b8fb2e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:40.661166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-94133105-6121-49de-b76b-cd28b8fb2e81 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:40.665594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-94133105-6121-49de-b76b-cd28b8fb2e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:40.699318 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:40.797841 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2073/4218] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:27:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:40.819328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf38bd-7b55-40fb-bbdf-ec50920f63d4 service glance] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:40.821129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bfbf38bd-7b55-40fb-bbdf-ec50920f63d4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:40.984387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf38bd-7b55-40fb-bbdf-ec50920f63d4 service glance] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:40.997544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e6340-9892-4470-b625-d8ff2841f483 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:40.998287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e6340-9892-4470-b625-d8ff2841f483 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:40.998580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e6340-9892-4470-b625-d8ff2841f483 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:40.998875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e6340-9892-4470-b625-d8ff2841f483 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:41.025830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e6340-9892-4470-b625-d8ff2841f483 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:41.027545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e6340-9892-4470-b625-d8ff2841f483 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:41.068518 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2146/4219] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:27:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:27:41.663190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94133105-6121-49de-b76b-cd28b8fb2e81 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:41.792053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94133105-6121-49de-b76b-cd28b8fb2e81 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:41.800319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b179cd-34e4-452b-9501-b8873177626a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:41.801727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b179cd-34e4-452b-9501-b8873177626a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:41.802194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b179cd-34e4-452b-9501-b8873177626a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:41.803128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b179cd-34e4-452b-9501-b8873177626a admin admin] PATH_INFO: `/v3/users/a0673fec4b254fdf92389841073a438c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:41.804624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b179cd-34e4-452b-9501-b8873177626a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0673fec4b254fdf92389841073a438c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:41.808451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b179cd-34e4-452b-9501-b8873177626a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:41.837629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e6340-9892-4470-b625-d8ff2841f483 service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:41.846436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e6340-9892-4470-b625-d8ff2841f483 service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:41.870622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e75a7-7a17-4166-a9cf-dcf9c9cc42b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:41.871529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e75a7-7a17-4166-a9cf-dcf9c9cc42b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:41.871814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e75a7-7a17-4166-a9cf-dcf9c9cc42b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:41.872095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e75a7-7a17-4166-a9cf-dcf9c9cc42b6 admin admin] PATH_INFO: `/v3/users/6243dbb5b9c74c3fa487b431a36924f9` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:41.877561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e75a7-7a17-4166-a9cf-dcf9c9cc42b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6243dbb5b9c74c3fa487b431a36924f9)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:41.879558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e75a7-7a17-4166-a9cf-dcf9c9cc42b6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:42.039308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e9b179cd-34e4-452b-9501-b8873177626a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0673fec4b254fdf92389841073a438c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:42.059378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e9b179cd-34e4-452b-9501-b8873177626a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0673fec4b254fdf92389841073a438c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:42.072258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e9b179cd-34e4-452b-9501-b8873177626a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0673fec4b254fdf92389841073a438c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:42.072258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e9b179cd-34e4-452b-9501-b8873177626a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0673fec4b254fdf92389841073a438c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:42.072258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e9b179cd-34e4-452b-9501-b8873177626a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0673fec4b254fdf92389841073a438c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:42.172645 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2074/4220] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:27:41 2022] DELETE /identity/v3/users/a0673fec4b254fdf92389841073a438c => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:42.177942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51044371-c775-4a9e-a50d-dd41023ae99a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:42.178462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51044371-c775-4a9e-a50d-dd41023ae99a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:42.178763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51044371-c775-4a9e-a50d-dd41023ae99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:42.179255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4a5e75a7-7a17-4166-a9cf-dcf9c9cc42b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6243dbb5b9c74c3fa487b431a36924f9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:42.224184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-51044371-c775-4a9e-a50d-dd41023ae99a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:42.225431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-51044371-c775-4a9e-a50d-dd41023ae99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:42.243755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4a5e75a7-7a17-4166-a9cf-dcf9c9cc42b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6243dbb5b9c74c3fa487b431a36924f9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:42.273945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4a5e75a7-7a17-4166-a9cf-dcf9c9cc42b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6243dbb5b9c74c3fa487b431a36924f9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:42.276343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4a5e75a7-7a17-4166-a9cf-dcf9c9cc42b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6243dbb5b9c74c3fa487b431a36924f9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:42.338117 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:42.364687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4a5e75a7-7a17-4166-a9cf-dcf9c9cc42b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6243dbb5b9c74c3fa487b431a36924f9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:42.373342 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2147/4221] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:27:41 2022] DELETE /identity/v3/users/6243dbb5b9c74c3fa487b431a36924f9 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:27:42.378134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9e854-26e9-4610-ac02-644209ae76a2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:42.388434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9e854-26e9-4610-ac02-644209ae76a2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:42.388812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9e854-26e9-4610-ac02-644209ae76a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:42.416477 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2075/4222] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:27:42.432848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51044371-c775-4a9e-a50d-dd41023ae99a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:42.436252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-51044371-c775-4a9e-a50d-dd41023ae99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:42.462311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e3a9e854-26e9-4610-ac02-644209ae76a2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:42.464893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e3a9e854-26e9-4610-ac02-644209ae76a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:42.477373 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:42.561274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51044371-c775-4a9e-a50d-dd41023ae99a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:42.679647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e80e25-2bf3-4a44-8577-2a342d7ef2fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:42.680325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e80e25-2bf3-4a44-8577-2a342d7ef2fa service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:42.680598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e80e25-2bf3-4a44-8577-2a342d7ef2fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:42.680887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e80e25-2bf3-4a44-8577-2a342d7ef2fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:42.693761 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2148/4223] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:42.704763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e80e25-2bf3-4a44-8577-2a342d7ef2fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:42.708468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e80e25-2bf3-4a44-8577-2a342d7ef2fa service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:42.728279 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2076/4224] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:27:42.760560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9e854-26e9-4610-ac02-644209ae76a2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:42.777409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a9e854-26e9-4610-ac02-644209ae76a2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:42.787060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ff8122-e1f7-440a-a802-9f5f3b1c1569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:42.789280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8122-e1f7-440a-a802-9f5f3b1c1569 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:42.793023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8122-e1f7-440a-a802-9f5f3b1c1569 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:42.794059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ff8122-e1f7-440a-a802-9f5f3b1c1569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:42.821728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff8122-e1f7-440a-a802-9f5f3b1c1569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:42.825585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ff8122-e1f7-440a-a802-9f5f3b1c1569 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:42.871457 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2149/4225] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:27:43.896566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aeebdf-e8bd-4b8e-8193-5142ee8770f1 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:43.897075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aeebdf-e8bd-4b8e-8193-5142ee8770f1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:43.897238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aeebdf-e8bd-4b8e-8193-5142ee8770f1 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:43.900759 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2077/4226] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:27:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:27:43.910799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1f0d7-5efd-4b94-8e1a-158e6dcd11d0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:43.911324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1f0d7-5efd-4b94-8e1a-158e6dcd11d0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:43.911451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1f0d7-5efd-4b94-8e1a-158e6dcd11d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:43.943570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-bbc1f0d7-5efd-4b94-8e1a-158e6dcd11d0 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:43.945691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bbc1f0d7-5efd-4b94-8e1a-158e6dcd11d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:44.072150 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2150/4227] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:27:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:27:44.119007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aeebdf-e8bd-4b8e-8193-5142ee8770f1 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:44.122692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-95aeebdf-e8bd-4b8e-8193-5142ee8770f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:44.188908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aeebdf-e8bd-4b8e-8193-5142ee8770f1 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:44.225508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee345b-7124-4dfd-8219-b068f714bc45 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:44.227397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee345b-7124-4dfd-8219-b068f714bc45 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:44.228883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee345b-7124-4dfd-8219-b068f714bc45 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:44.229272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee345b-7124-4dfd-8219-b068f714bc45 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:44.255057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee345b-7124-4dfd-8219-b068f714bc45 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:44.255057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fee345b-7124-4dfd-8219-b068f714bc45 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:44.280165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1f0d7-5efd-4b94-8e1a-158e6dcd11d0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:44.282791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bbc1f0d7-5efd-4b94-8e1a-158e6dcd11d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:44.295196 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2078/4228] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:27:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:27:44.318570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1f0d7-5efd-4b94-8e1a-158e6dcd11d0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:44.335701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fec7e3-40a8-4920-9dbc-ec93f89294b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:44.337223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fec7e3-40a8-4920-9dbc-ec93f89294b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:44.337763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fec7e3-40a8-4920-9dbc-ec93f89294b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:44.338310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fec7e3-40a8-4920-9dbc-ec93f89294b8 admin admin] PATH_INFO: `/v3/projects/e38a7dbb549e4e97b1af2daaee55f38e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:44.342633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fec7e3-40a8-4920-9dbc-ec93f89294b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e38a7dbb549e4e97b1af2daaee55f38e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:44.345857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fec7e3-40a8-4920-9dbc-ec93f89294b8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:44.512116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b9fec7e3-40a8-4920-9dbc-ec93f89294b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e38a7dbb549e4e97b1af2daaee55f38e', 'request_id': 'req-b9fec7e3-40a8-4920-9dbc-ec93f89294b8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:44.523968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b9fec7e3-40a8-4920-9dbc-ec93f89294b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e38a7dbb549e4e97b1af2daaee55f38e', 'request_id': 'req-b9fec7e3-40a8-4920-9dbc-ec93f89294b8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:44.541144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b9fec7e3-40a8-4920-9dbc-ec93f89294b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e38a7dbb549e4e97b1af2daaee55f38e', 'request_id': 'req-b9fec7e3-40a8-4920-9dbc-ec93f89294b8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:44.735136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b9fec7e3-40a8-4920-9dbc-ec93f89294b8 admin admin] The token cache is being invalidate because project e38a7dbb549e4e97b1af2daaee55f38e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:44.735888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b9fec7e3-40a8-4920-9dbc-ec93f89294b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:44.739168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b9fec7e3-40a8-4920-9dbc-ec93f89294b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:44.742272 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2151/4229] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:44 2022] DELETE /identity/v3/projects/e38a7dbb549e4e97b1af2daaee55f38e => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:44.747703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175062b-e74b-4edc-8df6-1325c9f927b7 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:44.752142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175062b-e74b-4edc-8df6-1325c9f927b7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:44.752142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175062b-e74b-4edc-8df6-1325c9f927b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:44.799442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4175062b-e74b-4edc-8df6-1325c9f927b7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:44.801562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4175062b-e74b-4edc-8df6-1325c9f927b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:44.919759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fec7e3-40a8-4920-9dbc-ec93f89294b8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:44.921285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b9fec7e3-40a8-4920-9dbc-ec93f89294b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:44.943106 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:44.988704 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2079/4230] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:45.000356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0774c5e-a63e-42ce-9d23-fb32f127896d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:45.003585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0774c5e-a63e-42ce-9d23-fb32f127896d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:45.004159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0774c5e-a63e-42ce-9d23-fb32f127896d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:45.029782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f0774c5e-a63e-42ce-9d23-fb32f127896d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:45.031598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f0774c5e-a63e-42ce-9d23-fb32f127896d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:45.049021 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2080/4231] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:45.050647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0774c5e-a63e-42ce-9d23-fb32f127896d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:45.064442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0774c5e-a63e-42ce-9d23-fb32f127896d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:45.068519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fec7e3-40a8-4920-9dbc-ec93f89294b8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:45.073883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dff0e-1d3e-4e17-abe7-4b326babe730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:45.076116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dff0e-1d3e-4e17-abe7-4b326babe730 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:45.077801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dff0e-1d3e-4e17-abe7-4b326babe730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:45.078296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404dff0e-1d3e-4e17-abe7-4b326babe730 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:45.079608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404dff0e-1d3e-4e17-abe7-4b326babe730 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:27:45.080400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1c0ac-cffb-46f8-9f69-377b785d3da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:45.081484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1c0ac-cffb-46f8-9f69-377b785d3da6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:45.081993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404dff0e-1d3e-4e17-abe7-4b326babe730 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:45.083848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404dff0e-1d3e-4e17-abe7-4b326babe730 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:45.086529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1c0ac-cffb-46f8-9f69-377b785d3da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:45.086825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1c0ac-cffb-46f8-9f69-377b785d3da6 admin admin] PATH_INFO: `/v3/projects/39753f2e16e74cb38395aebae58d2c0d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:45.093950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1c0ac-cffb-46f8-9f69-377b785d3da6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39753f2e16e74cb38395aebae58d2c0d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:45.099351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1c0ac-cffb-46f8-9f69-377b785d3da6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:45.109118 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2081/4232] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:27:45.114195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dff0e-1d3e-4e17-abe7-4b326babe730 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:45.131146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404dff0e-1d3e-4e17-abe7-4b326babe730 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:45.142356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9aab8-038a-4fc9-aea7-447ba9afcf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:45.143485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9aab8-038a-4fc9-aea7-447ba9afcf4a admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:45.143946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9aab8-038a-4fc9-aea7-447ba9afcf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:45.144484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9aab8-038a-4fc9-aea7-447ba9afcf4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:45.157698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9aab8-038a-4fc9-aea7-447ba9afcf4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:45.160488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9aab8-038a-4fc9-aea7-447ba9afcf4a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:45.168148 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:45.270011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bbd1c0ac-cffb-46f8-9f69-377b785d3da6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39753f2e16e74cb38395aebae58d2c0d', 'request_id': 'req-bbd1c0ac-cffb-46f8-9f69-377b785d3da6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:45.273691 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2082/4233] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:27:45 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:45.276484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57404bc-9013-415b-a3f4-239024490b5c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:45.281922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57404bc-9013-415b-a3f4-239024490b5c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:45.282245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57404bc-9013-415b-a3f4-239024490b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:45.285095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bbd1c0ac-cffb-46f8-9f69-377b785d3da6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39753f2e16e74cb38395aebae58d2c0d', 'request_id': 'req-bbd1c0ac-cffb-46f8-9f69-377b785d3da6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:45.308071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bbd1c0ac-cffb-46f8-9f69-377b785d3da6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39753f2e16e74cb38395aebae58d2c0d', 'request_id': 'req-bbd1c0ac-cffb-46f8-9f69-377b785d3da6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:45.350719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f57404bc-9013-415b-a3f4-239024490b5c None None] MFA Rules not processed for user `505a5026c10a49a893e04d45a011167d`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:45.355627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f57404bc-9013-415b-a3f4-239024490b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:45.427871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bbd1c0ac-cffb-46f8-9f69-377b785d3da6 admin admin] The token cache is being invalidate because project 39753f2e16e74cb38395aebae58d2c0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:27:45.428173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bbd1c0ac-cffb-46f8-9f69-377b785d3da6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:45.429578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bbd1c0ac-cffb-46f8-9f69-377b785d3da6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:27:45.433444 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2152/4234] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:27:44 2022] DELETE /identity/v3/projects/39753f2e16e74cb38395aebae58d2c0d => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:45.434297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1c0ac-cffb-46f8-9f69-377b785d3da6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:45.436939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bbd1c0ac-cffb-46f8-9f69-377b785d3da6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:45.500726 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2083/4235] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:45.500726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a188cd9-2cb8-4f1b-a575-43351eb85876 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:45.500726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a188cd9-2cb8-4f1b-a575-43351eb85876 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:45.500726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a188cd9-2cb8-4f1b-a575-43351eb85876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:45.544033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1a188cd9-2cb8-4f1b-a575-43351eb85876 None None] MFA Rules not processed for user `2928d7efad6a46d7b69df9644a6480b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:45.545380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1a188cd9-2cb8-4f1b-a575-43351eb85876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:45.635170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1c0ac-cffb-46f8-9f69-377b785d3da6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:45.703383 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2084/4236] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:45.704171 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:45.705037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc021ada-a498-488e-a49e-d99878a35d3c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:45.705231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc021ada-a498-488e-a49e-d99878a35d3c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:45.705585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc021ada-a498-488e-a49e-d99878a35d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:45.745005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-dc021ada-a498-488e-a49e-d99878a35d3c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:45.747258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-dc021ada-a498-488e-a49e-d99878a35d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:45.753809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a96c03-9a36-4664-a245-945d02090746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:45.754618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a96c03-9a36-4664-a245-945d02090746 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:45.756544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a96c03-9a36-4664-a245-945d02090746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:45.756846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a96c03-9a36-4664-a245-945d02090746 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:45.757718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a96c03-9a36-4664-a245-945d02090746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:45.770395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a96c03-9a36-4664-a245-945d02090746 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:45.770894 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2085/4237] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:45.772087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc021ada-a498-488e-a49e-d99878a35d3c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:45.773875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-dc021ada-a498-488e-a49e-d99878a35d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:45.809871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc021ada-a498-488e-a49e-d99878a35d3c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:45.827195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6eea8-e138-4f8c-9eb5-adf2e2069c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:45.828015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6eea8-e138-4f8c-9eb5-adf2e2069c1e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:45.828369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6eea8-e138-4f8c-9eb5-adf2e2069c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:45.828726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6eea8-e138-4f8c-9eb5-adf2e2069c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:45.829575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6eea8-e138-4f8c-9eb5-adf2e2069c1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:45.831709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6eea8-e138-4f8c-9eb5-adf2e2069c1e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:45.879551 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2153/4238] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:27:45 2022] POST /identity/v3/users => generated 287 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:45.881428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace83dc-25b2-4af8-b918-2f5ed7723a10 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:45.881728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace83dc-25b2-4af8-b918-2f5ed7723a10 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:45.882235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace83dc-25b2-4af8-b918-2f5ed7723a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:45.915177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-eace83dc-25b2-4af8-b918-2f5ed7723a10 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:45.917748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-eace83dc-25b2-4af8-b918-2f5ed7723a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:45.940037 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2154/4239] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:45.941624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace83dc-25b2-4af8-b918-2f5ed7723a10 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:45.969899 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2086/4240] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:27:45 2022] POST /identity/v3/projects => generated 389 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:45.971262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6eea8-e138-4f8c-9eb5-adf2e2069c1e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:45.976718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace83dc-25b2-4af8-b918-2f5ed7723a10 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:46.092184 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:46.138485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6eea8-e138-4f8c-9eb5-adf2e2069c1e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:46.148268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f2e43-bf63-4ed3-8c34-fa8814a50eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:46.151086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f2e43-bf63-4ed3-8c34-fa8814a50eff admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:46.151830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f2e43-bf63-4ed3-8c34-fa8814a50eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:46.152318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f2e43-bf63-4ed3-8c34-fa8814a50eff admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:46.153588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f2e43-bf63-4ed3-8c34-fa8814a50eff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:27:46.154133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f2e43-bf63-4ed3-8c34-fa8814a50eff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:46.156238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f2e43-bf63-4ed3-8c34-fa8814a50eff admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:46.166818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ece39-5c2a-4a8b-bcf9-17edfe4f0ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:46.167848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ece39-5c2a-4a8b-bcf9-17edfe4f0ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:46.168815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ece39-5c2a-4a8b-bcf9-17edfe4f0ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:46.169302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ece39-5c2a-4a8b-bcf9-17edfe4f0ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:46.171011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ece39-5c2a-4a8b-bcf9-17edfe4f0ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:46.172725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ece39-5c2a-4a8b-bcf9-17edfe4f0ae8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:46.180520 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2087/4241] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:27:46.183006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f2e43-bf63-4ed3-8c34-fa8814a50eff admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:46.202371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f2e43-bf63-4ed3-8c34-fa8814a50eff admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:46.202981 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2155/4242] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:46.203997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ece39-5c2a-4a8b-bcf9-17edfe4f0ae8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:46.215231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31533dc5-ff04-4b61-8533-0b79f922f172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:46.216675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31533dc5-ff04-4b61-8533-0b79f922f172 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:46.225056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31533dc5-ff04-4b61-8533-0b79f922f172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:46.226476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31533dc5-ff04-4b61-8533-0b79f922f172 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:46.227493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31533dc5-ff04-4b61-8533-0b79f922f172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:46.229048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ece39-5c2a-4a8b-bcf9-17edfe4f0ae8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:46.230544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31533dc5-ff04-4b61-8533-0b79f922f172 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:46.241222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fa852-ccc6-4aad-80df-f7698108802d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:46.244550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fa852-ccc6-4aad-80df-f7698108802d admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:46.244939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fa852-ccc6-4aad-80df-f7698108802d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:46.246372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306fa852-ccc6-4aad-80df-f7698108802d admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:46.247361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fa852-ccc6-4aad-80df-f7698108802d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:46.249317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306fa852-ccc6-4aad-80df-f7698108802d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:46.321181 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2088/4243] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:27:46 2022] POST /identity/v3/users => generated 301 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:46.331191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31533dc5-ff04-4b61-8533-0b79f922f172 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:46.335669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31533dc5-ff04-4b61-8533-0b79f922f172 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:46.361411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202130c8-16d7-43d6-826a-55e0c8ada59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:46.362224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202130c8-16d7-43d6-826a-55e0c8ada59f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:46.362650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202130c8-16d7-43d6-826a-55e0c8ada59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:46.364303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202130c8-16d7-43d6-826a-55e0c8ada59f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:46.364815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202130c8-16d7-43d6-826a-55e0c8ada59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:46.374006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202130c8-16d7-43d6-826a-55e0c8ada59f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:46.374188 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2156/4244] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:27:46 2022] POST /identity/v3/projects => generated 379 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:46.374188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fa852-ccc6-4aad-80df-f7698108802d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:46.392442 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2089/4245] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:46.393706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202130c8-16d7-43d6-826a-55e0c8ada59f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:46.409001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202130c8-16d7-43d6-826a-55e0c8ada59f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:46.547477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306fa852-ccc6-4aad-80df-f7698108802d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:46.556164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09a197-596c-4441-a3a3-06cb6dd2f3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:46.558211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09a197-596c-4441-a3a3-06cb6dd2f3d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:46.563701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09a197-596c-4441-a3a3-06cb6dd2f3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:46.563701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09a197-596c-4441-a3a3-06cb6dd2f3d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:46.563866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79259e-5d28-4034-b2f2-68105fdf9dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:46.563866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79259e-5d28-4034-b2f2-68105fdf9dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:46.563866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79259e-5d28-4034-b2f2-68105fdf9dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:46.563866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f79259e-5d28-4034-b2f2-68105fdf9dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:46.564205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79259e-5d28-4034-b2f2-68105fdf9dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:46.564294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09a197-596c-4441-a3a3-06cb6dd2f3d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:46.571390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f79259e-5d28-4034-b2f2-68105fdf9dc1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:46.573694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc09a197-596c-4441-a3a3-06cb6dd2f3d0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:46.630414 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2157/4246] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:46.631511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79259e-5d28-4034-b2f2-68105fdf9dc1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:46.647066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f79259e-5d28-4034-b2f2-68105fdf9dc1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:46.668891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf1925-53b8-4994-a779-790f9f95b4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:46.670938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf1925-53b8-4994-a779-790f9f95b4a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:46.672834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf1925-53b8-4994-a779-790f9f95b4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:46.674057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cf1925-53b8-4994-a779-790f9f95b4a8 admin admin] PATH_INFO: `/v3/projects/f7560c1bc9604ce18122728044cee65b/users/1fe2cc7547f24fff8c797088a326f918/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:46.698736 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2090/4247] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:27:46 2022] POST /identity/v3/users => generated 290 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:27:46.699423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09a197-596c-4441-a3a3-06cb6dd2f3d0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:46.709787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf1925-53b8-4994-a779-790f9f95b4a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7560c1bc9604ce18122728044cee65b, user_id=1fe2cc7547f24fff8c797088a326f918, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:46.715704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cf1925-53b8-4994-a779-790f9f95b4a8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:46.726536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09a197-596c-4441-a3a3-06cb6dd2f3d0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:46.737208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384bb549-ceb2-47a1-af64-7bb89bcdf860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:46.738358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bb549-ceb2-47a1-af64-7bb89bcdf860 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:46.738862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bb549-ceb2-47a1-af64-7bb89bcdf860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:46.739367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384bb549-ceb2-47a1-af64-7bb89bcdf860 admin admin] PATH_INFO: `/v3/projects/e813e300219e4d54b8ef3b4d1e932df5/users/31b1550fecb642b4823088a513938e65/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:46.763985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bb549-ceb2-47a1-af64-7bb89bcdf860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e813e300219e4d54b8ef3b4d1e932df5, user_id=31b1550fecb642b4823088a513938e65, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:46.771835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384bb549-ceb2-47a1-af64-7bb89bcdf860 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:46.784073 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2158/4248] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:27:46 2022] PUT /identity/v3/projects/f7560c1bc9604ce18122728044cee65b/users/1fe2cc7547f24fff8c797088a326f918/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:46.785055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf1925-53b8-4994-a779-790f9f95b4a8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:46.807757 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:46.846440 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2091/4249] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:27:46 2022] PUT /identity/v3/projects/e813e300219e4d54b8ef3b4d1e932df5/users/31b1550fecb642b4823088a513938e65/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:46.848183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578541d-459c-415b-ae01-cdfe8f54915d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:46.848737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578541d-459c-415b-ae01-cdfe8f54915d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:46.849378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e578541d-459c-415b-ae01-cdfe8f54915d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:46.920525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cf1925-53b8-4994-a779-790f9f95b4a8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:46.925094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e578541d-459c-415b-ae01-cdfe8f54915d None None] MFA Rules not processed for user `1fe2cc7547f24fff8c797088a326f918`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:46.926555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e578541d-459c-415b-ae01-cdfe8f54915d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:47.018285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d941e-5b2f-4933-9d48-380ffbd8cdc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:47.019156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d941e-5b2f-4933-9d48-380ffbd8cdc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:47.019518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d941e-5b2f-4933-9d48-380ffbd8cdc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:47.020297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0d941e-5b2f-4933-9d48-380ffbd8cdc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:47.021164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d941e-5b2f-4933-9d48-380ffbd8cdc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:47.022823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0d941e-5b2f-4933-9d48-380ffbd8cdc5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:47.038820 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2159/4250] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:47.039792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d941e-5b2f-4933-9d48-380ffbd8cdc5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:47.047632 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2092/4251] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:47.049263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578541d-459c-415b-ae01-cdfe8f54915d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:47.057291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0d941e-5b2f-4933-9d48-380ffbd8cdc5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:47.060593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11a56b-ca6d-459b-b7e2-1a47d774a47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:47.061136 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:47.062249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11a56b-ca6d-459b-b7e2-1a47d774a47c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:47.062546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11a56b-ca6d-459b-b7e2-1a47d774a47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:47.062832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e11a56b-ca6d-459b-b7e2-1a47d774a47c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:47.063581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e11a56b-ca6d-459b-b7e2-1a47d774a47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:47.065458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e11a56b-ca6d-459b-b7e2-1a47d774a47c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:47.067707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e578541d-459c-415b-ae01-cdfe8f54915d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:47.074275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0a167-90eb-4c7e-ad0a-84d50d9ca8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:47.075021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0a167-90eb-4c7e-ad0a-84d50d9ca8ef admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:47.075459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0a167-90eb-4c7e-ad0a-84d50d9ca8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:47.075882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf0a167-90eb-4c7e-ad0a-84d50d9ca8ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:47.076676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0a167-90eb-4c7e-ad0a-84d50d9ca8ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:47.078242 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2160/4252] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:47.079478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf0a167-90eb-4c7e-ad0a-84d50d9ca8ef admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:47.084322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11a56b-ca6d-459b-b7e2-1a47d774a47c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:47.086731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7e11a56b-ca6d-459b-b7e2-1a47d774a47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:47.100057 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2093/4253] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:27:47.101047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0a167-90eb-4c7e-ad0a-84d50d9ca8ef admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:47.113367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf0a167-90eb-4c7e-ad0a-84d50d9ca8ef admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:47.120158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e432e6-b9ef-4b8c-abed-c971d64de14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:47.121211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e432e6-b9ef-4b8c-abed-c971d64de14b admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:47.121506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e432e6-b9ef-4b8c-abed-c971d64de14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:47.121794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e432e6-b9ef-4b8c-abed-c971d64de14b admin admin] PATH_INFO: `/v3/projects/e813e300219e4d54b8ef3b4d1e932df5/users/31b1550fecb642b4823088a513938e65/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:47.123968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e432e6-b9ef-4b8c-abed-c971d64de14b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e813e300219e4d54b8ef3b4d1e932df5, user_id=31b1550fecb642b4823088a513938e65, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:47.127330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e432e6-b9ef-4b8c-abed-c971d64de14b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:47.145614 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2094/4254] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:27:47 2022] PUT /identity/v3/projects/e813e300219e4d54b8ef3b4d1e932df5/users/31b1550fecb642b4823088a513938e65/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:47.145614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e432e6-b9ef-4b8c-abed-c971d64de14b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:47.181317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e11a56b-ca6d-459b-b7e2-1a47d774a47c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:47.302270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20409bd-37e4-4bce-ac1d-e74f66160f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:47.302270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20409bd-37e4-4bce-ac1d-e74f66160f28 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:47.302705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20409bd-37e4-4bce-ac1d-e74f66160f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:47.302996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20409bd-37e4-4bce-ac1d-e74f66160f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:47.366758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e432e6-b9ef-4b8c-abed-c971d64de14b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:47.367843 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:47.387267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13965438-f39c-429f-8e04-2e6b0476c46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:47.389412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13965438-f39c-429f-8e04-2e6b0476c46b admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:47.389704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13965438-f39c-429f-8e04-2e6b0476c46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:47.399502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13965438-f39c-429f-8e04-2e6b0476c46b admin admin] PATH_INFO: `/v3/projects/4a703c8585da41a387a0259df57040c6/users/1a99bb893dde460a906d6d8a0a39f92c/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:47.461042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13965438-f39c-429f-8e04-2e6b0476c46b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a703c8585da41a387a0259df57040c6, user_id=1a99bb893dde460a906d6d8a0a39f92c, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:47.464501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13965438-f39c-429f-8e04-2e6b0476c46b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:47.508919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20409bd-37e4-4bce-ac1d-e74f66160f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:47.512198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20409bd-37e4-4bce-ac1d-e74f66160f28 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:47.530046 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2161/4255] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:27:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:27:47.620092 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2095/4256] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:27:47 2022] PUT /identity/v3/projects/4a703c8585da41a387a0259df57040c6/users/1a99bb893dde460a906d6d8a0a39f92c/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:27:47.625505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266dd9f7-ed13-4dd3-b042-024c338254d6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:47.625945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266dd9f7-ed13-4dd3-b042-024c338254d6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:47.626322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266dd9f7-ed13-4dd3-b042-024c338254d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:47.674924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-266dd9f7-ed13-4dd3-b042-024c338254d6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:27:47.674924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-266dd9f7-ed13-4dd3-b042-024c338254d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:47.881830 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2162/4257] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:27:47.973325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13965438-f39c-429f-8e04-2e6b0476c46b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:27:47.976131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-13965438-f39c-429f-8e04-2e6b0476c46b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:27:48.111610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13965438-f39c-429f-8e04-2e6b0476c46b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:27:48.116887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ea5ad-462f-4920-b463-d743e336486c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:27:48.123263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ea5ad-462f-4920-b463-d743e336486c service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:27:48.123263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ea5ad-462f-4920-b463-d743e336486c service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:27:48.123263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ea5ad-462f-4920-b463-d743e336486c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:27:48.130272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ea5ad-462f-4920-b463-d743e336486c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:27:48.132508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1ea5ad-462f-4920-b463-d743e336486c service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:27:48.149308 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2096/4258] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:27:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:27:57.870833 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=47 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:27:58.140696 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=68,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:28:02.493846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b13fc5-8a67-4b9c-9e76-21dbefab0ca7 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:02.494341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b13fc5-8a67-4b9c-9e76-21dbefab0ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:02.494448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b13fc5-8a67-4b9c-9e76-21dbefab0ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:02.558648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e9b13fc5-8a67-4b9c-9e76-21dbefab0ca7 None None] MFA Rules not processed for user `31b1550fecb642b4823088a513938e65`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:28:02.563624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e9b13fc5-8a67-4b9c-9e76-21dbefab0ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:02.813145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ea5ad-462f-4920-b463-d743e336486c service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:02.814200 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2163/4259] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:28:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:28:02.815873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cc1ea5ad-462f-4920-b463-d743e336486c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:03.086570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ea5ad-462f-4920-b463-d743e336486c service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:03.091128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b409ceb-7ae6-4690-9c4d-2458177a14e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:03.091894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b409ceb-7ae6-4690-9c4d-2458177a14e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:03.092269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b409ceb-7ae6-4690-9c4d-2458177a14e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:03.092560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b409ceb-7ae6-4690-9c4d-2458177a14e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:03.263488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b409ceb-7ae6-4690-9c4d-2458177a14e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:03.265084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b409ceb-7ae6-4690-9c4d-2458177a14e7 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:03.298375 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2097/4260] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:28:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:28:04.469263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c57dc-236c-4f5b-9aaf-862dd7952a87 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:04.470179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c57dc-236c-4f5b-9aaf-862dd7952a87 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:04.470743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c57dc-236c-4f5b-9aaf-862dd7952a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:04.529763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5b5c57dc-236c-4f5b-9aaf-862dd7952a87 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:28:04.538059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179c36e-4729-42a9-b9c4-4489dc5507b4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:04.538059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179c36e-4729-42a9-b9c4-4489dc5507b4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:04.538059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179c36e-4729-42a9-b9c4-4489dc5507b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:04.543818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5b5c57dc-236c-4f5b-9aaf-862dd7952a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:04.619793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4179c36e-4729-42a9-b9c4-4489dc5507b4 None None] MFA Rules not processed for user `1a99bb893dde460a906d6d8a0a39f92c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:28:04.620447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4179c36e-4729-42a9-b9c4-4489dc5507b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:04.737956 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2164/4261] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:28:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:28:04.753544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c57dc-236c-4f5b-9aaf-862dd7952a87 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:04.755927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5b5c57dc-236c-4f5b-9aaf-862dd7952a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:04.870850 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2098/4262] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:28:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:28:04.883046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7517c8-c17d-4ae1-ab37-898a0f8dd479 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:04.883658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7517c8-c17d-4ae1-ab37-898a0f8dd479 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:04.884704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7517c8-c17d-4ae1-ab37-898a0f8dd479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:04.934865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4e7517c8-c17d-4ae1-ab37-898a0f8dd479 None None] MFA Rules not processed for user `1a99bb893dde460a906d6d8a0a39f92c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:28:04.937062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4e7517c8-c17d-4ae1-ab37-898a0f8dd479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:04.970455 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2099/4263] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:28:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:28:04.981406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7517c8-c17d-4ae1-ab37-898a0f8dd479 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:04.983628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4e7517c8-c17d-4ae1-ab37-898a0f8dd479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:05.036022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c57dc-236c-4f5b-9aaf-862dd7952a87 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:05.062621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd94524-6ed1-44f5-86b9-5eda3058d342 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:05.065619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd94524-6ed1-44f5-86b9-5eda3058d342 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:05.067418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd94524-6ed1-44f5-86b9-5eda3058d342 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:05.068152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd94524-6ed1-44f5-86b9-5eda3058d342 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:05.088579 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:28:05.109616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd94524-6ed1-44f5-86b9-5eda3058d342 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:05.116173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd94524-6ed1-44f5-86b9-5eda3058d342 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:05.147000 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2165/4264] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:28:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 14:28:05.273402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7517c8-c17d-4ae1-ab37-898a0f8dd479 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:05.288192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958dd08-5e5d-402a-bf73-880ebf019c56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:05.288192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958dd08-5e5d-402a-bf73-880ebf019c56 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:05.288192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958dd08-5e5d-402a-bf73-880ebf019c56 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:05.288192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958dd08-5e5d-402a-bf73-880ebf019c56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:05.301248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958dd08-5e5d-402a-bf73-880ebf019c56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:05.308762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7958dd08-5e5d-402a-bf73-880ebf019c56 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:05.354504 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2100/4265] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:28:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:28:15.131734 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:28:15.342331 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=26 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:28:17.669192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd94524-6ed1-44f5-86b9-5eda3058d342 service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:17.671480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5bd94524-6ed1-44f5-86b9-5eda3058d342 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:17.705467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd94524-6ed1-44f5-86b9-5eda3058d342 service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:17.731669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2aa4ea-e5a5-4356-945c-aa43c5c69be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:17.733480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aa4ea-e5a5-4356-945c-aa43c5c69be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:17.738309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aa4ea-e5a5-4356-945c-aa43c5c69be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:17.738728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2aa4ea-e5a5-4356-945c-aa43c5c69be6 admin admin] PATH_INFO: `/v3/users/41685fc5b447416faf39e4d43a444b4c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:17.741918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2aa4ea-e5a5-4356-945c-aa43c5c69be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41685fc5b447416faf39e4d43a444b4c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:17.751062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2aa4ea-e5a5-4356-945c-aa43c5c69be6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:18.039046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8d2aa4ea-e5a5-4356-945c-aa43c5c69be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41685fc5b447416faf39e4d43a444b4c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:18.078766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8d2aa4ea-e5a5-4356-945c-aa43c5c69be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41685fc5b447416faf39e4d43a444b4c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:18.099631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8d2aa4ea-e5a5-4356-945c-aa43c5c69be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41685fc5b447416faf39e4d43a444b4c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:18.104969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8d2aa4ea-e5a5-4356-945c-aa43c5c69be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41685fc5b447416faf39e4d43a444b4c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:18.187861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8d2aa4ea-e5a5-4356-945c-aa43c5c69be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41685fc5b447416faf39e4d43a444b4c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:18.197773 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2166/4266] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:28:17 2022] DELETE /identity/v3/users/41685fc5b447416faf39e4d43a444b4c => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:28:20.263572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958dd08-5e5d-402a-bf73-880ebf019c56 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:20.279257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958dd08-5e5d-402a-bf73-880ebf019c56 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:20.436421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ffc4d4-0f06-4a20-b397-1fc6e5eeb3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:20.436421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffc4d4-0f06-4a20-b397-1fc6e5eeb3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:20.436421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffc4d4-0f06-4a20-b397-1fc6e5eeb3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:20.436421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ffc4d4-0f06-4a20-b397-1fc6e5eeb3fd admin admin] PATH_INFO: `/v3/projects/7e10183006414c8d96d3be9d995560ae` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:20.444382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffc4d4-0f06-4a20-b397-1fc6e5eeb3fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e10183006414c8d96d3be9d995560ae)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:20.447041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ffc4d4-0f06-4a20-b397-1fc6e5eeb3fd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:20.650449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-74ffc4d4-0f06-4a20-b397-1fc6e5eeb3fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e10183006414c8d96d3be9d995560ae', 'request_id': 'req-74ffc4d4-0f06-4a20-b397-1fc6e5eeb3fd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:20.735156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-74ffc4d4-0f06-4a20-b397-1fc6e5eeb3fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e10183006414c8d96d3be9d995560ae', 'request_id': 'req-74ffc4d4-0f06-4a20-b397-1fc6e5eeb3fd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:20.744805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-74ffc4d4-0f06-4a20-b397-1fc6e5eeb3fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e10183006414c8d96d3be9d995560ae', 'request_id': 'req-74ffc4d4-0f06-4a20-b397-1fc6e5eeb3fd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:20.783952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-74ffc4d4-0f06-4a20-b397-1fc6e5eeb3fd admin admin] The token cache is being invalidate because project 7e10183006414c8d96d3be9d995560ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:28:20.784371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-74ffc4d4-0f06-4a20-b397-1fc6e5eeb3fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:20.790947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-74ffc4d4-0f06-4a20-b397-1fc6e5eeb3fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:20.792911 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2101/4267] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:28:20 2022] DELETE /identity/v3/projects/7e10183006414c8d96d3be9d995560ae => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:28:20.798083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f62fed-a4cb-468f-9fd4-ee3b7ebc40a0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:20.798632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f62fed-a4cb-468f-9fd4-ee3b7ebc40a0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:20.798734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f62fed-a4cb-468f-9fd4-ee3b7ebc40a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:20.826198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e9f62fed-a4cb-468f-9fd4-ee3b7ebc40a0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:28:20.828138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e9f62fed-a4cb-468f-9fd4-ee3b7ebc40a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:21.008466 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2167/4268] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:28:21.016574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fc36e-d1ff-4250-b42d-9dcfbaec39ba None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:21.016869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fc36e-d1ff-4250-b42d-9dcfbaec39ba None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:21.017279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fc36e-d1ff-4250-b42d-9dcfbaec39ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:21.068265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-744fc36e-d1ff-4250-b42d-9dcfbaec39ba None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:28:21.071060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-744fc36e-d1ff-4250-b42d-9dcfbaec39ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:21.098885 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2102/4269] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:28:21.099098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f62fed-a4cb-468f-9fd4-ee3b7ebc40a0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:21.117885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f62fed-a4cb-468f-9fd4-ee3b7ebc40a0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:21.166517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71f305-4e53-4368-b13e-876b333b17dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:21.172979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71f305-4e53-4368-b13e-876b333b17dd admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:21.173413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71f305-4e53-4368-b13e-876b333b17dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:21.179475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71f305-4e53-4368-b13e-876b333b17dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:21.186046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71f305-4e53-4368-b13e-876b333b17dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:28:21.189436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71f305-4e53-4368-b13e-876b333b17dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:21.189436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de71f305-4e53-4368-b13e-876b333b17dd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:21.284021 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2168/4270] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:28:21.288301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fc36e-d1ff-4250-b42d-9dcfbaec39ba None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:21.300149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fc36e-d1ff-4250-b42d-9dcfbaec39ba None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:21.349289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc772a-64c2-41ae-b01c-b96bbeb99602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:21.355308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc772a-64c2-41ae-b01c-b96bbeb99602 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:21.355853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc772a-64c2-41ae-b01c-b96bbeb99602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:21.362547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc772a-64c2-41ae-b01c-b96bbeb99602 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:21.363611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc772a-64c2-41ae-b01c-b96bbeb99602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:21.365801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc772a-64c2-41ae-b01c-b96bbeb99602 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:21.568594 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2103/4271] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:28:21 2022] POST /identity/v3/projects => generated 381 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:28:21.569847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71f305-4e53-4368-b13e-876b333b17dd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:21.596577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71f305-4e53-4368-b13e-876b333b17dd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:21.923538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e852d6d-bf42-4c11-a921-67a07f8a3567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:21.928531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e852d6d-bf42-4c11-a921-67a07f8a3567 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:21.940581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e852d6d-bf42-4c11-a921-67a07f8a3567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:21.941146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e852d6d-bf42-4c11-a921-67a07f8a3567 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:21.942032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e852d6d-bf42-4c11-a921-67a07f8a3567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:21.944142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e852d6d-bf42-4c11-a921-67a07f8a3567 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:21.998274 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:28:22.105216 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2169/4272] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:28:21 2022] POST /identity/v3/users => generated 291 bytes in 533 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:28:22.107135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc772a-64c2-41ae-b01c-b96bbeb99602 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:22.135232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc772a-64c2-41ae-b01c-b96bbeb99602 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:22.153743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957495a9-bd70-43d8-896d-eda1805a3bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:22.154954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957495a9-bd70-43d8-896d-eda1805a3bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:22.155474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957495a9-bd70-43d8-896d-eda1805a3bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:22.163410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957495a9-bd70-43d8-896d-eda1805a3bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:22.164341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957495a9-bd70-43d8-896d-eda1805a3bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:22.179286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957495a9-bd70-43d8-896d-eda1805a3bbd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:22.250584 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2104/4273] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:28:22.283238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e852d6d-bf42-4c11-a921-67a07f8a3567 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:22.304196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e852d6d-bf42-4c11-a921-67a07f8a3567 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:22.309871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380e291-a1b3-4c66-ab1c-d02e60c546c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:22.314909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380e291-a1b3-4c66-ab1c-d02e60c546c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:22.315450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380e291-a1b3-4c66-ab1c-d02e60c546c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:22.317250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380e291-a1b3-4c66-ab1c-d02e60c546c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:22.319077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380e291-a1b3-4c66-ab1c-d02e60c546c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:22.325470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380e291-a1b3-4c66-ab1c-d02e60c546c7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:22.376509 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2170/4274] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:28:22.381134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957495a9-bd70-43d8-896d-eda1805a3bbd admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:22.408690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957495a9-bd70-43d8-896d-eda1805a3bbd admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:22.434942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb30ec4-0452-4d0d-9372-dc26d4430566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:22.439772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb30ec4-0452-4d0d-9372-dc26d4430566 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:22.442270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb30ec4-0452-4d0d-9372-dc26d4430566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:22.442854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb30ec4-0452-4d0d-9372-dc26d4430566 admin admin] PATH_INFO: `/v3/projects/852706cbe1c64efc848920aa9318ac65/users/58ca259abcd74fa5a2ba691445c67b26/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:22.543721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb30ec4-0452-4d0d-9372-dc26d4430566 admin admin] RBAC: Authorizing `identity:create_grant(project_id=852706cbe1c64efc848920aa9318ac65, user_id=58ca259abcd74fa5a2ba691445c67b26, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:22.559777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb30ec4-0452-4d0d-9372-dc26d4430566 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:22.881464 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2105/4275] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:28:22 2022] PUT /identity/v3/projects/852706cbe1c64efc848920aa9318ac65/users/58ca259abcd74fa5a2ba691445c67b26/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:28:22.882737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33539ba1-b0d7-4cf0-b563-943674619ff0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:22.883033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33539ba1-b0d7-4cf0-b563-943674619ff0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:22.883316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33539ba1-b0d7-4cf0-b563-943674619ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:22.952956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-33539ba1-b0d7-4cf0-b563-943674619ff0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:28:22.954214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-33539ba1-b0d7-4cf0-b563-943674619ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:23.109149 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2171/4276] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:28:23.169363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb30ec4-0452-4d0d-9372-dc26d4430566 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:23.171517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6fb30ec4-0452-4d0d-9372-dc26d4430566 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:23.342984 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:28:23.504583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb30ec4-0452-4d0d-9372-dc26d4430566 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:23.663617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7839c96-e7f6-4090-b4e4-fdbe1feb692f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:23.663617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7839c96-e7f6-4090-b4e4-fdbe1feb692f service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:23.663617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7839c96-e7f6-4090-b4e4-fdbe1feb692f service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:23.663617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7839c96-e7f6-4090-b4e4-fdbe1feb692f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:23.667096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7839c96-e7f6-4090-b4e4-fdbe1feb692f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:23.667096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7839c96-e7f6-4090-b4e4-fdbe1feb692f service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:23.667096 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2106/4277] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:28:33.095590 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:INSERT=3,keystone:SELECT=34 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:28:33.843553 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=14 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:28:36.242812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5bfe3-ba9c-46a5-87ce-2121489de9b4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:36.246313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5bfe3-ba9c-46a5-87ce-2121489de9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:36.246806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da5bfe3-ba9c-46a5-87ce-2121489de9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:36.303475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4da5bfe3-ba9c-46a5-87ce-2121489de9b4 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:28:36.309456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4da5bfe3-ba9c-46a5-87ce-2121489de9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:36.495649 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2172/4278] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:28:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:28:36.512201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7839c96-e7f6-4090-b4e4-fdbe1feb692f service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:36.515054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c7839c96-e7f6-4090-b4e4-fdbe1feb692f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:36.637657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7839c96-e7f6-4090-b4e4-fdbe1feb692f service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:36.644740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967f490-0791-41be-8903-c048a923b77f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:36.645944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967f490-0791-41be-8903-c048a923b77f service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:36.646525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967f490-0791-41be-8903-c048a923b77f service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:36.647201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f967f490-0791-41be-8903-c048a923b77f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:36.659060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967f490-0791-41be-8903-c048a923b77f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:36.660982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f967f490-0791-41be-8903-c048a923b77f service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:36.672662 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2107/4279] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:28:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:28:39.910474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da716f-65f4-4fb3-8333-56c225235553 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:39.911026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da716f-65f4-4fb3-8333-56c225235553 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:39.911026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da716f-65f4-4fb3-8333-56c225235553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:39.952494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d6da716f-65f4-4fb3-8333-56c225235553 None None] MFA Rules not processed for user `58ca259abcd74fa5a2ba691445c67b26`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:28:39.956703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d6da716f-65f4-4fb3-8333-56c225235553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:40.066499 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2173/4280] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:28:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:28:40.187393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967f490-0791-41be-8903-c048a923b77f service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:40.189245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f967f490-0791-41be-8903-c048a923b77f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:40.324831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f967f490-0791-41be-8903-c048a923b77f service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:40.362847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeeb7d5-dae9-4d3e-ad3d-68f987edc17d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:40.363635 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeeb7d5-dae9-4d3e-ad3d-68f987edc17d service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:40.364037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeeb7d5-dae9-4d3e-ad3d-68f987edc17d service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:40.364406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeeb7d5-dae9-4d3e-ad3d-68f987edc17d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:40.390564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeeb7d5-dae9-4d3e-ad3d-68f987edc17d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:40.397715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeeb7d5-dae9-4d3e-ad3d-68f987edc17d service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:40.416990 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2108/4281] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:28:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:28:50.062126 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=57 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:28:50.410419 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=66 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:28:51.705770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da716f-65f4-4fb3-8333-56c225235553 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:51.707587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d6da716f-65f4-4fb3-8333-56c225235553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:51.737327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da716f-65f4-4fb3-8333-56c225235553 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:51.751574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe0efd-dcf5-43ad-8a1d-f5d587020dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:51.752489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe0efd-dcf5-43ad-8a1d-f5d587020dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:51.752956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe0efd-dcf5-43ad-8a1d-f5d587020dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:51.753388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe0efd-dcf5-43ad-8a1d-f5d587020dc5 admin admin] PATH_INFO: `/v3/users/1a99bb893dde460a906d6d8a0a39f92c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:51.755068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe0efd-dcf5-43ad-8a1d-f5d587020dc5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a99bb893dde460a906d6d8a0a39f92c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:51.758229 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbe0efd-dcf5-43ad-8a1d-f5d587020dc5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:52.000808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-acbe0efd-dcf5-43ad-8a1d-f5d587020dc5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a99bb893dde460a906d6d8a0a39f92c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:52.051087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-acbe0efd-dcf5-43ad-8a1d-f5d587020dc5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a99bb893dde460a906d6d8a0a39f92c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:52.069814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-acbe0efd-dcf5-43ad-8a1d-f5d587020dc5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a99bb893dde460a906d6d8a0a39f92c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:52.070962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-acbe0efd-dcf5-43ad-8a1d-f5d587020dc5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a99bb893dde460a906d6d8a0a39f92c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:52.181528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-acbe0efd-dcf5-43ad-8a1d-f5d587020dc5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a99bb893dde460a906d6d8a0a39f92c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:52.188982 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2174/4282] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:28:51 2022] DELETE /identity/v3/users/1a99bb893dde460a906d6d8a0a39f92c => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:28:53.866593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeeb7d5-dae9-4d3e-ad3d-68f987edc17d service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:53.891782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeeb7d5-dae9-4d3e-ad3d-68f987edc17d service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:53.921406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe0efd-dcf5-43ad-8a1d-f5d587020dc5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:53.923559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-acbe0efd-dcf5-43ad-8a1d-f5d587020dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:54.254771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b051d9-692c-4dca-8761-958fd9d26b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:54.257211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b051d9-692c-4dca-8761-958fd9d26b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:54.257211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b051d9-692c-4dca-8761-958fd9d26b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:54.257211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b051d9-692c-4dca-8761-958fd9d26b31 admin admin] PATH_INFO: `/v3/projects/4a703c8585da41a387a0259df57040c6` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:54.266310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe0efd-dcf5-43ad-8a1d-f5d587020dc5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:54.267849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b051d9-692c-4dca-8761-958fd9d26b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a703c8585da41a387a0259df57040c6)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:54.269781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b051d9-692c-4dca-8761-958fd9d26b31 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:54.286624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966367bd-c0e3-4e8b-94e2-d3356354bc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:54.287445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966367bd-c0e3-4e8b-94e2-d3356354bc6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:54.287730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966367bd-c0e3-4e8b-94e2-d3356354bc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:54.288007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966367bd-c0e3-4e8b-94e2-d3356354bc6a admin admin] PATH_INFO: `/v3/users/58ca259abcd74fa5a2ba691445c67b26` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:54.295573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966367bd-c0e3-4e8b-94e2-d3356354bc6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=58ca259abcd74fa5a2ba691445c67b26)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:54.297618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966367bd-c0e3-4e8b-94e2-d3356354bc6a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:54.587101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-966367bd-c0e3-4e8b-94e2-d3356354bc6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58ca259abcd74fa5a2ba691445c67b26'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:54.589892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-63b051d9-692c-4dca-8761-958fd9d26b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a703c8585da41a387a0259df57040c6', 'request_id': 'req-63b051d9-692c-4dca-8761-958fd9d26b31'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:54.629194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-966367bd-c0e3-4e8b-94e2-d3356354bc6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58ca259abcd74fa5a2ba691445c67b26'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:54.639836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-966367bd-c0e3-4e8b-94e2-d3356354bc6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58ca259abcd74fa5a2ba691445c67b26'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:54.641421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-966367bd-c0e3-4e8b-94e2-d3356354bc6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58ca259abcd74fa5a2ba691445c67b26'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:54.646774 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:28:54.763216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-63b051d9-692c-4dca-8761-958fd9d26b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a703c8585da41a387a0259df57040c6', 'request_id': 'req-63b051d9-692c-4dca-8761-958fd9d26b31'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:54.773497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-63b051d9-692c-4dca-8761-958fd9d26b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a703c8585da41a387a0259df57040c6', 'request_id': 'req-63b051d9-692c-4dca-8761-958fd9d26b31'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:54.801379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-63b051d9-692c-4dca-8761-958fd9d26b31 admin admin] The token cache is being invalidate because project 4a703c8585da41a387a0259df57040c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:28:54.802503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-63b051d9-692c-4dca-8761-958fd9d26b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:54.823670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-63b051d9-692c-4dca-8761-958fd9d26b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:54.831814 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2109/4283] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:28:53 2022] DELETE /identity/v3/projects/4a703c8585da41a387a0259df57040c6 => generated 0 bytes in 966 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:28:54.837731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a0f79-ba76-4944-acc3-19da94bd126d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:54.838518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a0f79-ba76-4944-acc3-19da94bd126d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:54.839031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a0f79-ba76-4944-acc3-19da94bd126d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:54.868398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-966367bd-c0e3-4e8b-94e2-d3356354bc6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58ca259abcd74fa5a2ba691445c67b26'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:54.891581 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2175/4284] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:28:53 2022] DELETE /identity/v3/users/58ca259abcd74fa5a2ba691445c67b26 => generated 0 bytes in 956 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:28:54.910528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-437a0f79-ba76-4944-acc3-19da94bd126d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:28:54.913569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-437a0f79-ba76-4944-acc3-19da94bd126d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:54.999645 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2110/4285] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:28:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:28:55.009795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338de93-61e3-45cf-ac5f-b0a1a4997cc7 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:55.010741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338de93-61e3-45cf-ac5f-b0a1a4997cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:55.010741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338de93-61e3-45cf-ac5f-b0a1a4997cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:55.052110 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1338de93-61e3-45cf-ac5f-b0a1a4997cc7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:28:55.053568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1338de93-61e3-45cf-ac5f-b0a1a4997cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:55.064531 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2176/4286] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:28:55.069687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a0f79-ba76-4944-acc3-19da94bd126d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:55.082001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a0f79-ba76-4944-acc3-19da94bd126d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:55.089757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977322c-08b3-4026-ad44-ce5a8d3e7bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:55.089757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977322c-08b3-4026-ad44-ce5a8d3e7bee admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:55.089757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977322c-08b3-4026-ad44-ce5a8d3e7bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:55.089757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977322c-08b3-4026-ad44-ce5a8d3e7bee admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:55.101350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977322c-08b3-4026-ad44-ce5a8d3e7bee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:28:55.101877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977322c-08b3-4026-ad44-ce5a8d3e7bee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:55.107185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977322c-08b3-4026-ad44-ce5a8d3e7bee admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:55.143154 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2111/4287] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:28:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:28:55.145482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338de93-61e3-45cf-ac5f-b0a1a4997cc7 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:55.156785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338de93-61e3-45cf-ac5f-b0a1a4997cc7 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:55.161839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db67d0-7d2e-4517-a1be-cd0f6d60c1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:55.162552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db67d0-7d2e-4517-a1be-cd0f6d60c1be admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:55.162842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db67d0-7d2e-4517-a1be-cd0f6d60c1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:55.163118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db67d0-7d2e-4517-a1be-cd0f6d60c1be admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:55.164043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db67d0-7d2e-4517-a1be-cd0f6d60c1be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:55.167535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db67d0-7d2e-4517-a1be-cd0f6d60c1be admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:55.295637 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2177/4288] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:28:55 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:28:55.297558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977322c-08b3-4026-ad44-ce5a8d3e7bee admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:55.313862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977322c-08b3-4026-ad44-ce5a8d3e7bee admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:55.338045 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:28:55.419966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ce91d4-e955-44d8-9783-632143b8d584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:55.420728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce91d4-e955-44d8-9783-632143b8d584 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:55.421255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce91d4-e955-44d8-9783-632143b8d584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:55.421602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ce91d4-e955-44d8-9783-632143b8d584 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:55.422455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce91d4-e955-44d8-9783-632143b8d584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:55.424850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ce91d4-e955-44d8-9783-632143b8d584 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:55.528833 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2112/4289] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:28:55 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:28:55.532483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db67d0-7d2e-4517-a1be-cd0f6d60c1be admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:55.570132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db67d0-7d2e-4517-a1be-cd0f6d60c1be admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:55.582319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ae9f3-0430-4050-b78a-04cf7e80a40f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:55.582718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ae9f3-0430-4050-b78a-04cf7e80a40f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:55.582941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ae9f3-0430-4050-b78a-04cf7e80a40f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:55.584106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b361a96-bd92-41be-8935-53f3f44722fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:55.584885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b361a96-bd92-41be-8935-53f3f44722fa admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:55.587873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b361a96-bd92-41be-8935-53f3f44722fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:55.588336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b361a96-bd92-41be-8935-53f3f44722fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:55.589116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b361a96-bd92-41be-8935-53f3f44722fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:55.591071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b361a96-bd92-41be-8935-53f3f44722fa admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:55.615878 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2178/4290] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:28:55.622934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5f8ae9f3-0430-4050-b78a-04cf7e80a40f None None] MFA Rules not processed for user `2928d7efad6a46d7b69df9644a6480b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:28:55.622934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5f8ae9f3-0430-4050-b78a-04cf7e80a40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:55.623199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b361a96-bd92-41be-8935-53f3f44722fa admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:55.661534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b361a96-bd92-41be-8935-53f3f44722fa admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:55.678360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c96a43-73a4-419e-9de8-90e5b9ffa02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:55.679131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c96a43-73a4-419e-9de8-90e5b9ffa02e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:55.679342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c96a43-73a4-419e-9de8-90e5b9ffa02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:55.681826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c96a43-73a4-419e-9de8-90e5b9ffa02e admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:55.682634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c96a43-73a4-419e-9de8-90e5b9ffa02e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:55.684263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c96a43-73a4-419e-9de8-90e5b9ffa02e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:55.727755 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2179/4291] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:28:55 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:28:55.732214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c96a43-73a4-419e-9de8-90e5b9ffa02e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:55.747744 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2113/4292] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:28:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:28:55.787291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c96a43-73a4-419e-9de8-90e5b9ffa02e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:55.825028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997861c-deb7-4a39-ab18-c9edb6285d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:55.827085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997861c-deb7-4a39-ab18-c9edb6285d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:55.830226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997861c-deb7-4a39-ab18-c9edb6285d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:55.830757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997861c-deb7-4a39-ab18-c9edb6285d0a admin admin] PATH_INFO: `/v3/projects/ddf968f6954d4e558a53342cc9ac1689/users/73550e910b4c4c34adebdaa746719b0f/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:55.890201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997861c-deb7-4a39-ab18-c9edb6285d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf968f6954d4e558a53342cc9ac1689, user_id=73550e910b4c4c34adebdaa746719b0f, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:55.893567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997861c-deb7-4a39-ab18-c9edb6285d0a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:55.979371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ae9f3-0430-4050-b78a-04cf7e80a40f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:55.988376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5f8ae9f3-0430-4050-b78a-04cf7e80a40f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:56.025886 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2180/4293] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:28:55 2022] PUT /identity/v3/projects/ddf968f6954d4e558a53342cc9ac1689/users/73550e910b4c4c34adebdaa746719b0f/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:28:56.033730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a97d0d-2578-4d85-a644-8d60c40bd71f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:56.036582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a97d0d-2578-4d85-a644-8d60c40bd71f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:56.036582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a97d0d-2578-4d85-a644-8d60c40bd71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:56.037764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ae9f3-0430-4050-b78a-04cf7e80a40f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:56.103816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b2a97d0d-2578-4d85-a644-8d60c40bd71f None None] MFA Rules not processed for user `73550e910b4c4c34adebdaa746719b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:28:56.107376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b2a97d0d-2578-4d85-a644-8d60c40bd71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:56.232443 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2181/4294] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:28:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:28:56.247974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a97d0d-2578-4d85-a644-8d60c40bd71f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:56.250315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b2a97d0d-2578-4d85-a644-8d60c40bd71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:56.262778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f92264-db60-4c48-a503-1816ebe66a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:56.264228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f92264-db60-4c48-a503-1816ebe66a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:56.265314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f92264-db60-4c48-a503-1816ebe66a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:56.265770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f92264-db60-4c48-a503-1816ebe66a52 admin admin] PATH_INFO: `/v3/projects/852706cbe1c64efc848920aa9318ac65` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:56.269577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f92264-db60-4c48-a503-1816ebe66a52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=852706cbe1c64efc848920aa9318ac65)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:56.273864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f92264-db60-4c48-a503-1816ebe66a52 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:56.427865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a97d0d-2578-4d85-a644-8d60c40bd71f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:56.428976 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:28:56.458522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab30360-9c25-4c05-9434-a3ce5a695fda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:56.460716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab30360-9c25-4c05-9434-a3ce5a695fda service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:56.461322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-36f92264-db60-4c48-a503-1816ebe66a52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '852706cbe1c64efc848920aa9318ac65', 'request_id': 'req-36f92264-db60-4c48-a503-1816ebe66a52'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:56.463901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab30360-9c25-4c05-9434-a3ce5a695fda service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:56.464466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab30360-9c25-4c05-9434-a3ce5a695fda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:56.488471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab30360-9c25-4c05-9434-a3ce5a695fda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:56.490365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab30360-9c25-4c05-9434-a3ce5a695fda service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:56.510658 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2182/4295] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:28:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:28:56.537774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-36f92264-db60-4c48-a503-1816ebe66a52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '852706cbe1c64efc848920aa9318ac65', 'request_id': 'req-36f92264-db60-4c48-a503-1816ebe66a52'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:56.558299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-36f92264-db60-4c48-a503-1816ebe66a52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '852706cbe1c64efc848920aa9318ac65', 'request_id': 'req-36f92264-db60-4c48-a503-1816ebe66a52'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:56.592292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-36f92264-db60-4c48-a503-1816ebe66a52 admin admin] The token cache is being invalidate because project 852706cbe1c64efc848920aa9318ac65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:28:56.597417 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:28:56.597417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-36f92264-db60-4c48-a503-1816ebe66a52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:56.600084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-36f92264-db60-4c48-a503-1816ebe66a52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:56.604053 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2114/4296] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:28:55 2022] DELETE /identity/v3/projects/852706cbe1c64efc848920aa9318ac65 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:28:56.610693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39179f7-1c95-4a16-8ed6-a40631027bf5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:56.614065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39179f7-1c95-4a16-8ed6-a40631027bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:56.620447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39179f7-1c95-4a16-8ed6-a40631027bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:56.648538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a39179f7-1c95-4a16-8ed6-a40631027bf5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:28:56.650483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a39179f7-1c95-4a16-8ed6-a40631027bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:56.763490 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2183/4297] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:28:56.772822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c5dbf-c488-448f-9d96-f3d43d563177 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:56.772822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c5dbf-c488-448f-9d96-f3d43d563177 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:56.772822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7c5dbf-c488-448f-9d96-f3d43d563177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:56.838972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3a7c5dbf-c488-448f-9d96-f3d43d563177 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:28:56.843464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3a7c5dbf-c488-448f-9d96-f3d43d563177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:56.874888 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2115/4298] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:28:56.879411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39179f7-1c95-4a16-8ed6-a40631027bf5 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:56.903153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39179f7-1c95-4a16-8ed6-a40631027bf5 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:56.926932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee014b-a4a9-4ac9-bf43-78187c4d7e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:56.927631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee014b-a4a9-4ac9-bf43-78187c4d7e9d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:56.927918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee014b-a4a9-4ac9-bf43-78187c4d7e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:56.928196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ee014b-a4a9-4ac9-bf43-78187c4d7e9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:56.928940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee014b-a4a9-4ac9-bf43-78187c4d7e9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:28:56.929249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee014b-a4a9-4ac9-bf43-78187c4d7e9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:56.930948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ee014b-a4a9-4ac9-bf43-78187c4d7e9d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:56.972424 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2184/4299] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:28:56.974059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c5dbf-c488-448f-9d96-f3d43d563177 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:56.985361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7c5dbf-c488-448f-9d96-f3d43d563177 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:56.997393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947109e-d569-428b-a42d-ecefb425c608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:57.003515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947109e-d569-428b-a42d-ecefb425c608 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:57.004029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947109e-d569-428b-a42d-ecefb425c608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:57.004480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947109e-d569-428b-a42d-ecefb425c608 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:57.005376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947109e-d569-428b-a42d-ecefb425c608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:57.012067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947109e-d569-428b-a42d-ecefb425c608 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:57.124561 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2116/4300] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:28:56 2022] POST /identity/v3/projects => generated 365 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:28:57.128692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee014b-a4a9-4ac9-bf43-78187c4d7e9d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:57.154572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ee014b-a4a9-4ac9-bf43-78187c4d7e9d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:57.260883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66153255-8474-4f02-ac95-115fe0bcdfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:57.263984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66153255-8474-4f02-ac95-115fe0bcdfd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:57.264563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66153255-8474-4f02-ac95-115fe0bcdfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:57.265063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66153255-8474-4f02-ac95-115fe0bcdfd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:57.266727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66153255-8474-4f02-ac95-115fe0bcdfd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:57.271080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66153255-8474-4f02-ac95-115fe0bcdfd0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:57.379938 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2185/4301] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:28:57 2022] POST /identity/v3/users => generated 283 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:28:57.380059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947109e-d569-428b-a42d-ecefb425c608 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:57.393478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947109e-d569-428b-a42d-ecefb425c608 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:57.408467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac656a80-ab65-4cd1-aa27-f28a4619f9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:57.409249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac656a80-ab65-4cd1-aa27-f28a4619f9ed admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:57.409646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac656a80-ab65-4cd1-aa27-f28a4619f9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:57.409997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac656a80-ab65-4cd1-aa27-f28a4619f9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:57.414658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac656a80-ab65-4cd1-aa27-f28a4619f9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:57.415629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac656a80-ab65-4cd1-aa27-f28a4619f9ed admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:57.453510 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2117/4302] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:28:57.457282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66153255-8474-4f02-ac95-115fe0bcdfd0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:57.478119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66153255-8474-4f02-ac95-115fe0bcdfd0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:57.540236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9a4a3-34e1-4e50-a31c-2142caa133f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:57.552271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9a4a3-34e1-4e50-a31c-2142caa133f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:57.552559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9a4a3-34e1-4e50-a31c-2142caa133f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:57.552849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9a4a3-34e1-4e50-a31c-2142caa133f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:57.558572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9a4a3-34e1-4e50-a31c-2142caa133f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:57.569585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9a4a3-34e1-4e50-a31c-2142caa133f5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:57.591653 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2186/4303] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:28:57 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:28:57.594117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac656a80-ab65-4cd1-aa27-f28a4619f9ed admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:57.619133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac656a80-ab65-4cd1-aa27-f28a4619f9ed admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:57.626925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ee983-4ec1-4334-8ba0-669939ef7e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:57.628065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ee983-4ec1-4334-8ba0-669939ef7e0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:57.630899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ee983-4ec1-4334-8ba0-669939ef7e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:57.631299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ee983-4ec1-4334-8ba0-669939ef7e0d admin admin] PATH_INFO: `/v3/projects/95c7b9f62e714ca7b1eebf7551502bdb/users/a576dd711a504226a27402982036c4c8/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:57.690221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ee983-4ec1-4334-8ba0-669939ef7e0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c7b9f62e714ca7b1eebf7551502bdb, user_id=a576dd711a504226a27402982036c4c8, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:57.690221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ee983-4ec1-4334-8ba0-669939ef7e0d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:57.810193 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2118/4304] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:28:57 2022] PUT /identity/v3/projects/95c7b9f62e714ca7b1eebf7551502bdb/users/a576dd711a504226a27402982036c4c8/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:28:57.826463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e53e53-226c-46af-a4d4-da130e61dbb3 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:57.826946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e53e53-226c-46af-a4d4-da130e61dbb3 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:57.829671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e53e53-226c-46af-a4d4-da130e61dbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:57.982117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d2e53e53-226c-46af-a4d4-da130e61dbb3 None None] MFA Rules not processed for user `a576dd711a504226a27402982036c4c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:28:57.988394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d2e53e53-226c-46af-a4d4-da130e61dbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:58.239642 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:28:58.282146 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2187/4305] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:28:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 459 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:28:58.481061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ee983-4ec1-4334-8ba0-669939ef7e0d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:58.489617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7e5ee983-4ec1-4334-8ba0-669939ef7e0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:58.635873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ee983-4ec1-4334-8ba0-669939ef7e0d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:58.642443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756a4b8-a597-401f-9505-fbe9565a57fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:58.643393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756a4b8-a597-401f-9505-fbe9565a57fd service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:58.643852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756a4b8-a597-401f-9505-fbe9565a57fd service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:58.644407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756a4b8-a597-401f-9505-fbe9565a57fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:58.654895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756a4b8-a597-401f-9505-fbe9565a57fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:58.657046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0756a4b8-a597-401f-9505-fbe9565a57fd service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:58.680072 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2119/4306] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:28:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:28:58.724503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e53e53-226c-46af-a4d4-da130e61dbb3 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:58.908730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e53e53-226c-46af-a4d4-da130e61dbb3 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:58.926934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622684c-4320-4e9a-ae5a-a603a03343a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:58.927913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622684c-4320-4e9a-ae5a-a603a03343a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:58.928256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622684c-4320-4e9a-ae5a-a603a03343a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:58.928534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622684c-4320-4e9a-ae5a-a603a03343a9 admin admin] PATH_INFO: `/v3/users/a576dd711a504226a27402982036c4c8` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:58.929823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622684c-4320-4e9a-ae5a-a603a03343a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a576dd711a504226a27402982036c4c8)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:58.932369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622684c-4320-4e9a-ae5a-a603a03343a9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:59.259284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1622684c-4320-4e9a-ae5a-a603a03343a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a576dd711a504226a27402982036c4c8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:59.311672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756a4b8-a597-401f-9505-fbe9565a57fd service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:59.315012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0756a4b8-a597-401f-9505-fbe9565a57fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:59.338666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1622684c-4320-4e9a-ae5a-a603a03343a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a576dd711a504226a27402982036c4c8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:59.341825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0756a4b8-a597-401f-9505-fbe9565a57fd service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:28:59.347860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96155d9c-3442-4f95-856f-c2c3037b018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:28:59.366546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96155d9c-3442-4f95-856f-c2c3037b018e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:59.367013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96155d9c-3442-4f95-856f-c2c3037b018e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:59.370118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96155d9c-3442-4f95-856f-c2c3037b018e admin admin] PATH_INFO: `/v3/users/73550e910b4c4c34adebdaa746719b0f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:59.381031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1622684c-4320-4e9a-ae5a-a603a03343a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a576dd711a504226a27402982036c4c8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:59.390750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1622684c-4320-4e9a-ae5a-a603a03343a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a576dd711a504226a27402982036c4c8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:59.392779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96155d9c-3442-4f95-856f-c2c3037b018e admin admin] RBAC: Authorizing `identity:delete_user(user_id=73550e910b4c4c34adebdaa746719b0f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:28:59.394950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96155d9c-3442-4f95-856f-c2c3037b018e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:28:59.484883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1622684c-4320-4e9a-ae5a-a603a03343a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a576dd711a504226a27402982036c4c8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:59.513298 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2188/4307] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:28:58 2022] DELETE /identity/v3/users/a576dd711a504226a27402982036c4c8 => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:28:59.517970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ef736-838f-406d-9fb1-e60eb1cd5dc7 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:59.518834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ef736-838f-406d-9fb1-e60eb1cd5dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:59.519195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ef736-838f-406d-9fb1-e60eb1cd5dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:59.560884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-896ef736-838f-406d-9fb1-e60eb1cd5dc7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:28:59.563391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-896ef736-838f-406d-9fb1-e60eb1cd5dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:59.697104 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2189/4308] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:28:59.714871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-96155d9c-3442-4f95-856f-c2c3037b018e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73550e910b4c4c34adebdaa746719b0f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:59.726018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ef736-838f-406d-9fb1-e60eb1cd5dc7 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:28:59.731837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-896ef736-838f-406d-9fb1-e60eb1cd5dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:59.733491 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:28:59.744241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-96155d9c-3442-4f95-856f-c2c3037b018e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73550e910b4c4c34adebdaa746719b0f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:59.744923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-96155d9c-3442-4f95-856f-c2c3037b018e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73550e910b4c4c34adebdaa746719b0f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:59.745733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-96155d9c-3442-4f95-856f-c2c3037b018e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73550e910b4c4c34adebdaa746719b0f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:59.762723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-96155d9c-3442-4f95-856f-c2c3037b018e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73550e910b4c4c34adebdaa746719b0f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:28:59.783041 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:28:59.850576 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2120/4309] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:28:59 2022] DELETE /identity/v3/users/73550e910b4c4c34adebdaa746719b0f => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:28:59.857114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ad1d1-f99f-4df2-9fb9-fdfe62246773 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:28:59.857607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ad1d1-f99f-4df2-9fb9-fdfe62246773 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:28:59.858238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ad1d1-f99f-4df2-9fb9-fdfe62246773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:28:59.908259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-372ad1d1-f99f-4df2-9fb9-fdfe62246773 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:28:59.924432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-372ad1d1-f99f-4df2-9fb9-fdfe62246773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:28:59.996254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ef736-838f-406d-9fb1-e60eb1cd5dc7 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:00.090315 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2121/4310] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:28:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:00.102866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3106516-ea15-470f-976d-3ec4cd1ab72d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:00.103745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3106516-ea15-470f-976d-3ec4cd1ab72d service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:00.104040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3106516-ea15-470f-976d-3ec4cd1ab72d service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:00.104980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3106516-ea15-470f-976d-3ec4cd1ab72d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:00.105528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ad1d1-f99f-4df2-9fb9-fdfe62246773 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:00.107276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b3106516-ea15-470f-976d-3ec4cd1ab72d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:00.114978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-372ad1d1-f99f-4df2-9fb9-fdfe62246773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:00.137440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372ad1d1-f99f-4df2-9fb9-fdfe62246773 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:00.138665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3106516-ea15-470f-976d-3ec4cd1ab72d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:00.141447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3106516-ea15-470f-976d-3ec4cd1ab72d service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:00.145825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfcd8c-6be5-49a2-a041-f5bb073a8186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:00.145825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfcd8c-6be5-49a2-a041-f5bb073a8186 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:00.145825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfcd8c-6be5-49a2-a041-f5bb073a8186 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:00.145825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfcd8c-6be5-49a2-a041-f5bb073a8186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:00.159975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcfcd8c-6be5-49a2-a041-f5bb073a8186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:00.163029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcfcd8c-6be5-49a2-a041-f5bb073a8186 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:00.163899 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2190/4311] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:28:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:29:00.188782 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2122/4312] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:29:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:29:01.759109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3106516-ea15-470f-976d-3ec4cd1ab72d service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:01.764807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b3106516-ea15-470f-976d-3ec4cd1ab72d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:01.814291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3106516-ea15-470f-976d-3ec4cd1ab72d service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:01.854658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f62a79-cfa4-4112-a6c8-81f92e43fcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:01.859256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f62a79-cfa4-4112-a6c8-81f92e43fcee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:01.859256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f62a79-cfa4-4112-a6c8-81f92e43fcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:01.859256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f62a79-cfa4-4112-a6c8-81f92e43fcee admin admin] PATH_INFO: `/v3/projects/ddf968f6954d4e558a53342cc9ac1689` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:01.861161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f62a79-cfa4-4112-a6c8-81f92e43fcee admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddf968f6954d4e558a53342cc9ac1689)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:01.866650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f62a79-cfa4-4112-a6c8-81f92e43fcee admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:02.031524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-31f62a79-cfa4-4112-a6c8-81f92e43fcee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddf968f6954d4e558a53342cc9ac1689', 'request_id': 'req-31f62a79-cfa4-4112-a6c8-81f92e43fcee'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:02.040575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-31f62a79-cfa4-4112-a6c8-81f92e43fcee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddf968f6954d4e558a53342cc9ac1689', 'request_id': 'req-31f62a79-cfa4-4112-a6c8-81f92e43fcee'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:02.049928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-31f62a79-cfa4-4112-a6c8-81f92e43fcee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddf968f6954d4e558a53342cc9ac1689', 'request_id': 'req-31f62a79-cfa4-4112-a6c8-81f92e43fcee'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:02.154446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-31f62a79-cfa4-4112-a6c8-81f92e43fcee admin admin] The token cache is being invalidate because project ddf968f6954d4e558a53342cc9ac1689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:29:02.155073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-31f62a79-cfa4-4112-a6c8-81f92e43fcee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:02.156456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-31f62a79-cfa4-4112-a6c8-81f92e43fcee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:02.171118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3300a-bc8e-424e-a73a-d47e9234e938 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:02.172063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3300a-bc8e-424e-a73a-d47e9234e938 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:02.172510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3300a-bc8e-424e-a73a-d47e9234e938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:02.174068 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2191/4313] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:29:01 2022] DELETE /identity/v3/projects/ddf968f6954d4e558a53342cc9ac1689 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:02.230217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-15c3300a-bc8e-424e-a73a-d47e9234e938 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:02.231397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-15c3300a-bc8e-424e-a73a-d47e9234e938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:02.296668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f62a79-cfa4-4112-a6c8-81f92e43fcee admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:02.298254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-31f62a79-cfa4-4112-a6c8-81f92e43fcee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:02.477246 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2123/4314] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:02.484163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26f6dc-1a0d-44c6-939e-27640e681795 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:02.484482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26f6dc-1a0d-44c6-939e-27640e681795 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:02.484770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26f6dc-1a0d-44c6-939e-27640e681795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:02.560756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-af26f6dc-1a0d-44c6-939e-27640e681795 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:02.562003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-af26f6dc-1a0d-44c6-939e-27640e681795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:02.569194 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:02.616307 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2124/4315] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:02.617231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26f6dc-1a0d-44c6-939e-27640e681795 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:02.626775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f62a79-cfa4-4112-a6c8-81f92e43fcee admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:02.649720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15d5cf-c7f6-4144-9ab2-c53aa8ffcd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:02.656448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26f6dc-1a0d-44c6-939e-27640e681795 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:02.656983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15d5cf-c7f6-4144-9ab2-c53aa8ffcd1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:02.657484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15d5cf-c7f6-4144-9ab2-c53aa8ffcd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:02.657882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15d5cf-c7f6-4144-9ab2-c53aa8ffcd1a admin admin] PATH_INFO: `/v3/projects/95c7b9f62e714ca7b1eebf7551502bdb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:02.662242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15d5cf-c7f6-4144-9ab2-c53aa8ffcd1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=95c7b9f62e714ca7b1eebf7551502bdb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:02.666901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15d5cf-c7f6-4144-9ab2-c53aa8ffcd1a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:02.676289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01475eb-ee64-4934-88cb-1cc938274a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:02.677733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01475eb-ee64-4934-88cb-1cc938274a47 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:02.678779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01475eb-ee64-4934-88cb-1cc938274a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:02.679074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01475eb-ee64-4934-88cb-1cc938274a47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:02.679833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01475eb-ee64-4934-88cb-1cc938274a47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:29:02.680678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01475eb-ee64-4934-88cb-1cc938274a47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:02.682553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01475eb-ee64-4934-88cb-1cc938274a47 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:02.741955 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2125/4316] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:29:02.743461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01475eb-ee64-4934-88cb-1cc938274a47 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:02.759307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01475eb-ee64-4934-88cb-1cc938274a47 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:02.768610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810b3ad-a96d-4acf-901b-1fcb70848ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:02.769262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810b3ad-a96d-4acf-901b-1fcb70848ddd admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:02.769552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810b3ad-a96d-4acf-901b-1fcb70848ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:02.769834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810b3ad-a96d-4acf-901b-1fcb70848ddd admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:02.770763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810b3ad-a96d-4acf-901b-1fcb70848ddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:02.785485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810b3ad-a96d-4acf-901b-1fcb70848ddd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:02.869755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b15d5cf-c7f6-4144-9ab2-c53aa8ffcd1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95c7b9f62e714ca7b1eebf7551502bdb', 'request_id': 'req-7b15d5cf-c7f6-4144-9ab2-c53aa8ffcd1a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:02.880600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b15d5cf-c7f6-4144-9ab2-c53aa8ffcd1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95c7b9f62e714ca7b1eebf7551502bdb', 'request_id': 'req-7b15d5cf-c7f6-4144-9ab2-c53aa8ffcd1a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:02.889831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b15d5cf-c7f6-4144-9ab2-c53aa8ffcd1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95c7b9f62e714ca7b1eebf7551502bdb', 'request_id': 'req-7b15d5cf-c7f6-4144-9ab2-c53aa8ffcd1a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:02.956747 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2126/4317] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:29:02 2022] POST /identity/v3/projects => generated 395 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:02.957949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810b3ad-a96d-4acf-901b-1fcb70848ddd admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:02.982113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b15d5cf-c7f6-4144-9ab2-c53aa8ffcd1a admin admin] The token cache is being invalidate because project 95c7b9f62e714ca7b1eebf7551502bdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:29:02.982113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b15d5cf-c7f6-4144-9ab2-c53aa8ffcd1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:03.000044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b15d5cf-c7f6-4144-9ab2-c53aa8ffcd1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:03.032882 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2192/4318] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:29:02 2022] DELETE /identity/v3/projects/95c7b9f62e714ca7b1eebf7551502bdb => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:03.035044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2c0ac-d03f-4fbe-8fc7-0c74b2f1720e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:03.035438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2c0ac-d03f-4fbe-8fc7-0c74b2f1720e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:03.035816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c2c0ac-d03f-4fbe-8fc7-0c74b2f1720e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:03.113428 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:03.115767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-06c2c0ac-d03f-4fbe-8fc7-0c74b2f1720e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:03.119224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-06c2c0ac-d03f-4fbe-8fc7-0c74b2f1720e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:03.278235 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2193/4319] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:03.286165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52846a2-6570-4831-b47d-38a3b19caecf None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:03.286165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52846a2-6570-4831-b47d-38a3b19caecf None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:03.286165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52846a2-6570-4831-b47d-38a3b19caecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:03.310875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810b3ad-a96d-4acf-901b-1fcb70848ddd admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:03.334590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e52846a2-6570-4831-b47d-38a3b19caecf None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:03.335048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6ca32-6fc1-4b0e-8df8-e14443c82e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:03.335635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e52846a2-6570-4831-b47d-38a3b19caecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:03.335966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6ca32-6fc1-4b0e-8df8-e14443c82e15 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:03.338945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6ca32-6fc1-4b0e-8df8-e14443c82e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:03.338945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6ca32-6fc1-4b0e-8df8-e14443c82e15 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:03.338945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6ca32-6fc1-4b0e-8df8-e14443c82e15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:03.341163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d6ca32-6fc1-4b0e-8df8-e14443c82e15 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:03.353986 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2194/4320] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:03.359272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52846a2-6570-4831-b47d-38a3b19caecf None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:03.630083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52846a2-6570-4831-b47d-38a3b19caecf None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:03.630083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abffd5-dbb7-48c7-a7bb-dabde65e6cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:03.630083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abffd5-dbb7-48c7-a7bb-dabde65e6cba admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:03.630083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abffd5-dbb7-48c7-a7bb-dabde65e6cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:03.633532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46abffd5-dbb7-48c7-a7bb-dabde65e6cba admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:03.633532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abffd5-dbb7-48c7-a7bb-dabde65e6cba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:29:03.633532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abffd5-dbb7-48c7-a7bb-dabde65e6cba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:03.633532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46abffd5-dbb7-48c7-a7bb-dabde65e6cba admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:03.633532 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2195/4321] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:29:03.639698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abffd5-dbb7-48c7-a7bb-dabde65e6cba admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:03.654387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46abffd5-dbb7-48c7-a7bb-dabde65e6cba admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:03.660253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae7df9-723d-4cbd-9e33-fcc920fedc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:03.662704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae7df9-723d-4cbd-9e33-fcc920fedc31 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:03.670147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae7df9-723d-4cbd-9e33-fcc920fedc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:03.670670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae7df9-723d-4cbd-9e33-fcc920fedc31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:03.671768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae7df9-723d-4cbd-9e33-fcc920fedc31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:03.675622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ae7df9-723d-4cbd-9e33-fcc920fedc31 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:03.926702 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2127/4322] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:29:02 2022] POST /identity/v3/users => generated 298 bytes in 966 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:03.929653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6ca32-6fc1-4b0e-8df8-e14443c82e15 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:03.937387 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2196/4323] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:29:03 2022] POST /identity/v3/projects => generated 373 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:29:03.939330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-84d6ca32-6fc1-4b0e-8df8-e14443c82e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:03.945474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae7df9-723d-4cbd-9e33-fcc920fedc31 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:03.965790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6ca32-6fc1-4b0e-8df8-e14443c82e15 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:04.109034 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:04.178405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae7df9-723d-4cbd-9e33-fcc920fedc31 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:04.187225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29522313-15f4-4974-b382-d627cb2dd54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:04.188452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29522313-15f4-4974-b382-d627cb2dd54f admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:04.188749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29522313-15f4-4974-b382-d627cb2dd54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:04.190402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29522313-15f4-4974-b382-d627cb2dd54f admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:04.191372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29522313-15f4-4974-b382-d627cb2dd54f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:04.197555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29522313-15f4-4974-b382-d627cb2dd54f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:04.244247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c4c3a-ab57-4fc1-8846-87775dc29256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:04.244967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c4c3a-ab57-4fc1-8846-87775dc29256 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:04.245257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c4c3a-ab57-4fc1-8846-87775dc29256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:04.245554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c4c3a-ab57-4fc1-8846-87775dc29256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:04.252561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c4c3a-ab57-4fc1-8846-87775dc29256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:04.254260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c4c3a-ab57-4fc1-8846-87775dc29256 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:04.293132 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2128/4324] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:29:03 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:29:04.294667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de9b0d-4063-4cc9-be21-9847b4e17d6d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:04.295067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de9b0d-4063-4cc9-be21-9847b4e17d6d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:04.295357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de9b0d-4063-4cc9-be21-9847b4e17d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:04.351405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-91de9b0d-4063-4cc9-be21-9847b4e17d6d None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:04.357669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-91de9b0d-4063-4cc9-be21-9847b4e17d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:04.398062 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2197/4325] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:29:03 2022] POST /identity/v3/users => generated 287 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:04.398062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29522313-15f4-4974-b382-d627cb2dd54f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:04.473095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29522313-15f4-4974-b382-d627cb2dd54f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:04.487089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c03f4-a5d3-4d51-95f8-b50a991bb3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:04.487900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c03f4-a5d3-4d51-95f8-b50a991bb3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:04.489921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c03f4-a5d3-4d51-95f8-b50a991bb3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:04.490304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c03f4-a5d3-4d51-95f8-b50a991bb3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:04.492429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c03f4-a5d3-4d51-95f8-b50a991bb3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:04.494576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c03f4-a5d3-4d51-95f8-b50a991bb3e4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:04.528132 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2198/4326] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:29:04.529043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c03f4-a5d3-4d51-95f8-b50a991bb3e4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:04.529645 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2129/4327] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:29:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:04.531853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de9b0d-4063-4cc9-be21-9847b4e17d6d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:04.555408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de9b0d-4063-4cc9-be21-9847b4e17d6d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:04.565636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c03f4-a5d3-4d51-95f8-b50a991bb3e4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:04.569600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13c0a4-aafa-4644-b0d9-7762ef050fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:04.569600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13c0a4-aafa-4644-b0d9-7762ef050fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:04.569600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13c0a4-aafa-4644-b0d9-7762ef050fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:04.569600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13c0a4-aafa-4644-b0d9-7762ef050fe9 admin admin] PATH_INFO: `/v3/projects/4c1243f7a75b4a16a5ed152af82e437a/users/b9e1e7bf96f14aa69aafb39fd9caed59/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:04.580287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e4c69-141d-4eac-90be-825551a2df53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:04.581043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e4c69-141d-4eac-90be-825551a2df53 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:04.581334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e4c69-141d-4eac-90be-825551a2df53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:04.581618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e4c69-141d-4eac-90be-825551a2df53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:04.582384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e4c69-141d-4eac-90be-825551a2df53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:04.585928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7e4c69-141d-4eac-90be-825551a2df53 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:04.608199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13c0a4-aafa-4644-b0d9-7762ef050fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c1243f7a75b4a16a5ed152af82e437a, user_id=b9e1e7bf96f14aa69aafb39fd9caed59, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:04.614618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13c0a4-aafa-4644-b0d9-7762ef050fe9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:04.618486 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2199/4328] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:29:04.622068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e4c69-141d-4eac-90be-825551a2df53 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:04.625843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ad7e4c69-141d-4eac-90be-825551a2df53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:04.690595 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2130/4329] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:29:04 2022] PUT /identity/v3/projects/4c1243f7a75b4a16a5ed152af82e437a/users/b9e1e7bf96f14aa69aafb39fd9caed59/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:04.696515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13c0a4-aafa-4644-b0d9-7762ef050fe9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:04.764363 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:04.828320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13c0a4-aafa-4644-b0d9-7762ef050fe9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:04.842020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b658fd5-53ec-4e1a-9e45-99b5c975fad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:04.843132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b658fd5-53ec-4e1a-9e45-99b5c975fad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:04.843580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b658fd5-53ec-4e1a-9e45-99b5c975fad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:04.844059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b658fd5-53ec-4e1a-9e45-99b5c975fad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:04.845029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b658fd5-53ec-4e1a-9e45-99b5c975fad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:04.849078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b658fd5-53ec-4e1a-9e45-99b5c975fad1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:04.877471 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2131/4330] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:29:04 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:29:04.881434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f3fba-8fe0-48ce-9dfd-5037c124e3a8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:04.882045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f3fba-8fe0-48ce-9dfd-5037c124e3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:04.882546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f3fba-8fe0-48ce-9dfd-5037c124e3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:04.902654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e4c69-141d-4eac-90be-825551a2df53 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:04.925842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-146f3fba-8fe0-48ce-9dfd-5037c124e3a8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:04.931118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-146f3fba-8fe0-48ce-9dfd-5037c124e3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:04.952184 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2132/4331] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:04.953375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f3fba-8fe0-48ce-9dfd-5037c124e3a8 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:04.982931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f3fba-8fe0-48ce-9dfd-5037c124e3a8 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:04.998168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e83cd1-5f35-46c4-abe7-2dc49fc7267a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:04.999359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e83cd1-5f35-46c4-abe7-2dc49fc7267a admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:04.999842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e83cd1-5f35-46c4-abe7-2dc49fc7267a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:05.000298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e83cd1-5f35-46c4-abe7-2dc49fc7267a admin admin] PATH_INFO: `/v3/projects/2f097426cd2644dbbe4738a6b5bf0d53/users/8bd0c292a5cb432a91ca8079023d2555/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:05.041885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e83cd1-5f35-46c4-abe7-2dc49fc7267a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f097426cd2644dbbe4738a6b5bf0d53, user_id=8bd0c292a5cb432a91ca8079023d2555, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:05.045342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e83cd1-5f35-46c4-abe7-2dc49fc7267a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:05.074150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a902f6d2-db50-4146-bf10-ed0392f89afe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:05.075481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902f6d2-db50-4146-bf10-ed0392f89afe service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:05.075982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902f6d2-db50-4146-bf10-ed0392f89afe service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:05.076428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a902f6d2-db50-4146-bf10-ed0392f89afe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:05.129243 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2133/4332] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:29:04 2022] PUT /identity/v3/projects/2f097426cd2644dbbe4738a6b5bf0d53/users/8bd0c292a5cb432a91ca8079023d2555/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:05.139129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e83cd1-5f35-46c4-abe7-2dc49fc7267a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:05.139129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f1e83cd1-5f35-46c4-abe7-2dc49fc7267a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:05.145831 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:05.246983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e83cd1-5f35-46c4-abe7-2dc49fc7267a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:05.264986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902f6d2-db50-4146-bf10-ed0392f89afe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:05.271956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a902f6d2-db50-4146-bf10-ed0392f89afe service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:05.287149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9b030-9cd8-4302-8d56-26c087ee9a6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:05.293946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9b030-9cd8-4302-8d56-26c087ee9a6b service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:05.294334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9b030-9cd8-4302-8d56-26c087ee9a6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:05.294787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9b030-9cd8-4302-8d56-26c087ee9a6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:05.315398 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2200/4333] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:29:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:29:05.317323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04dcae-3f2c-4761-bdee-af358d546558 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:05.319301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04dcae-3f2c-4761-bdee-af358d546558 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:05.319751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04dcae-3f2c-4761-bdee-af358d546558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:05.403133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-fe04dcae-3f2c-4761-bdee-af358d546558 None None] MFA Rules not processed for user `8bd0c292a5cb432a91ca8079023d2555`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:05.404679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fe04dcae-3f2c-4761-bdee-af358d546558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:05.462718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9b030-9cd8-4302-8d56-26c087ee9a6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:05.463428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9b030-9cd8-4302-8d56-26c087ee9a6b service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:05.475797 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2134/4334] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:29:05.477677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b61b0-3aa5-40dc-8a42-a0537bbdea39 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:05.477981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b61b0-3aa5-40dc-8a42-a0537bbdea39 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:05.478291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b61b0-3aa5-40dc-8a42-a0537bbdea39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:05.503209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6c5b61b0-3aa5-40dc-8a42-a0537bbdea39 None None] MFA Rules not processed for user `d5bd18a1135c4d1db18e9bf273cb0ea4`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:05.511237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6c5b61b0-3aa5-40dc-8a42-a0537bbdea39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:05.581768 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2201/4335] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:05.593804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04dcae-3f2c-4761-bdee-af358d546558 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:05.597981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fe04dcae-3f2c-4761-bdee-af358d546558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:05.672802 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:05.734651 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2135/4336] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:05.904905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04dcae-3f2c-4761-bdee-af358d546558 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:05.925328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957f1a9-5d3f-4c7f-9614-e855000e6f40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:05.926250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957f1a9-5d3f-4c7f-9614-e855000e6f40 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:05.926658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957f1a9-5d3f-4c7f-9614-e855000e6f40 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:05.927496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957f1a9-5d3f-4c7f-9614-e855000e6f40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:05.946426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957f1a9-5d3f-4c7f-9614-e855000e6f40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:05.949564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957f1a9-5d3f-4c7f-9614-e855000e6f40 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:05.981209 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2202/4337] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:29:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:29:08.907365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b61b0-3aa5-40dc-8a42-a0537bbdea39 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:08.944771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b61b0-3aa5-40dc-8a42-a0537bbdea39 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:08.954803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e79b5-04d0-4e37-9f76-66b5ddc915f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:08.955985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e79b5-04d0-4e37-9f76-66b5ddc915f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:08.956416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e79b5-04d0-4e37-9f76-66b5ddc915f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:08.956836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e79b5-04d0-4e37-9f76-66b5ddc915f3 admin admin] PATH_INFO: `/v3/users/8bd0c292a5cb432a91ca8079023d2555` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:08.958922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e79b5-04d0-4e37-9f76-66b5ddc915f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bd0c292a5cb432a91ca8079023d2555)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:08.968478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e79b5-04d0-4e37-9f76-66b5ddc915f3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:09.271077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-000e79b5-04d0-4e37-9f76-66b5ddc915f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bd0c292a5cb432a91ca8079023d2555'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:09.325227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-000e79b5-04d0-4e37-9f76-66b5ddc915f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bd0c292a5cb432a91ca8079023d2555'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:09.326365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-000e79b5-04d0-4e37-9f76-66b5ddc915f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bd0c292a5cb432a91ca8079023d2555'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:09.327178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-000e79b5-04d0-4e37-9f76-66b5ddc915f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bd0c292a5cb432a91ca8079023d2555'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:09.348912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-000e79b5-04d0-4e37-9f76-66b5ddc915f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bd0c292a5cb432a91ca8079023d2555'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:09.444632 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2136/4338] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:29:08 2022] DELETE /identity/v3/users/8bd0c292a5cb432a91ca8079023d2555 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:09.450023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bb28a-4ae9-4d58-9646-12f069d14656 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:09.450023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bb28a-4ae9-4d58-9646-12f069d14656 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:09.450691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bb28a-4ae9-4d58-9646-12f069d14656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:09.500890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-259bb28a-4ae9-4d58-9646-12f069d14656 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:09.502373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-259bb28a-4ae9-4d58-9646-12f069d14656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:09.629310 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:09.706493 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2203/4339] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:09.731050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e79b5-04d0-4e37-9f76-66b5ddc915f3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:09.733288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-000e79b5-04d0-4e37-9f76-66b5ddc915f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:09.841896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bb28a-4ae9-4d58-9646-12f069d14656 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:09.843708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-259bb28a-4ae9-4d58-9646-12f069d14656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:09.919871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e79b5-04d0-4e37-9f76-66b5ddc915f3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:09.929826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba4d51-32e0-4bd7-8bee-ddaadb8643a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:09.931249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba4d51-32e0-4bd7-8bee-ddaadb8643a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:09.931542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba4d51-32e0-4bd7-8bee-ddaadb8643a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:09.931824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adba4d51-32e0-4bd7-8bee-ddaadb8643a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:09.966791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba4d51-32e0-4bd7-8bee-ddaadb8643a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:09.968853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adba4d51-32e0-4bd7-8bee-ddaadb8643a6 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:09.995656 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2137/4340] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:29:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:29:10.062511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bb28a-4ae9-4d58-9646-12f069d14656 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:10.076705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb5af6-c08c-459d-98b4-1a7a801b902b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:10.077094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb5af6-c08c-459d-98b4-1a7a801b902b service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:10.077492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb5af6-c08c-459d-98b4-1a7a801b902b service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:10.077972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb5af6-c08c-459d-98b4-1a7a801b902b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:10.087102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bebb5af6-c08c-459d-98b4-1a7a801b902b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:10.279565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb5af6-c08c-459d-98b4-1a7a801b902b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:10.281261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb5af6-c08c-459d-98b4-1a7a801b902b service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:10.308683 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2204/4341] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:29:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:29:10.567337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba4d51-32e0-4bd7-8bee-ddaadb8643a6 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:10.568803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-adba4d51-32e0-4bd7-8bee-ddaadb8643a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:10.594631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adba4d51-32e0-4bd7-8bee-ddaadb8643a6 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:10.604372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a670f-8b99-4a0d-a87c-ac48f0fa93ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:10.606346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a670f-8b99-4a0d-a87c-ac48f0fa93ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:10.606712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a670f-8b99-4a0d-a87c-ac48f0fa93ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:10.606957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a670f-8b99-4a0d-a87c-ac48f0fa93ef admin admin] PATH_INFO: `/v3/projects/2f097426cd2644dbbe4738a6b5bf0d53` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:10.612667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a670f-8b99-4a0d-a87c-ac48f0fa93ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f097426cd2644dbbe4738a6b5bf0d53)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:10.614794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a670f-8b99-4a0d-a87c-ac48f0fa93ef admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:10.795652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f29a670f-8b99-4a0d-a87c-ac48f0fa93ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f097426cd2644dbbe4738a6b5bf0d53', 'request_id': 'req-f29a670f-8b99-4a0d-a87c-ac48f0fa93ef'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:10.907471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f29a670f-8b99-4a0d-a87c-ac48f0fa93ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f097426cd2644dbbe4738a6b5bf0d53', 'request_id': 'req-f29a670f-8b99-4a0d-a87c-ac48f0fa93ef'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:10.909689 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:10.916377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f29a670f-8b99-4a0d-a87c-ac48f0fa93ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f097426cd2644dbbe4738a6b5bf0d53', 'request_id': 'req-f29a670f-8b99-4a0d-a87c-ac48f0fa93ef'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:10.940212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f29a670f-8b99-4a0d-a87c-ac48f0fa93ef admin admin] The token cache is being invalidate because project 2f097426cd2644dbbe4738a6b5bf0d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:29:10.940796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f29a670f-8b99-4a0d-a87c-ac48f0fa93ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:10.941460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f29a670f-8b99-4a0d-a87c-ac48f0fa93ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:10.943358 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2138/4342] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:29:10 2022] DELETE /identity/v3/projects/2f097426cd2644dbbe4738a6b5bf0d53 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:10.951283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b7757-a0ef-49dd-8908-16f6a7fbd14c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:10.952231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b7757-a0ef-49dd-8908-16f6a7fbd14c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:10.952742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b7757-a0ef-49dd-8908-16f6a7fbd14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:11.004889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9d5b7757-a0ef-49dd-8908-16f6a7fbd14c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:11.015166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9d5b7757-a0ef-49dd-8908-16f6a7fbd14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:11.215659 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2205/4343] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:11.221229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563d0d4-05a7-4523-8590-5937fa31be45 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:11.221229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563d0d4-05a7-4523-8590-5937fa31be45 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:11.221229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563d0d4-05a7-4523-8590-5937fa31be45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:11.262346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b563d0d4-05a7-4523-8590-5937fa31be45 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:11.264022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b563d0d4-05a7-4523-8590-5937fa31be45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:11.284761 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2139/4344] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:11.285474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b7757-a0ef-49dd-8908-16f6a7fbd14c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:11.301297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b7757-a0ef-49dd-8908-16f6a7fbd14c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:11.340196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37393f6-6ab0-4e9b-9b3f-1426872d96f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:11.341095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37393f6-6ab0-4e9b-9b3f-1426872d96f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:11.341527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37393f6-6ab0-4e9b-9b3f-1426872d96f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:11.341978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37393f6-6ab0-4e9b-9b3f-1426872d96f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:11.342909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37393f6-6ab0-4e9b-9b3f-1426872d96f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:29:11.343362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37393f6-6ab0-4e9b-9b3f-1426872d96f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:11.345293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37393f6-6ab0-4e9b-9b3f-1426872d96f9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:11.377290 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2206/4345] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:29:11.379123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563d0d4-05a7-4523-8590-5937fa31be45 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:11.391961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b563d0d4-05a7-4523-8590-5937fa31be45 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:11.397595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05756987-4bd4-470a-8785-f517165c1c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:11.398531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05756987-4bd4-470a-8785-f517165c1c2e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:11.398942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05756987-4bd4-470a-8785-f517165c1c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:11.399226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05756987-4bd4-470a-8785-f517165c1c2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:11.401560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05756987-4bd4-470a-8785-f517165c1c2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:11.403743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05756987-4bd4-470a-8785-f517165c1c2e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:11.515013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37393f6-6ab0-4e9b-9b3f-1426872d96f9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:11.516336 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2140/4346] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:29:11 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:11.522980 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:11.527524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37393f6-6ab0-4e9b-9b3f-1426872d96f9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:11.693313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a10bba-8ef6-4d60-a91f-010b7bb9ee11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:11.694137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a10bba-8ef6-4d60-a91f-010b7bb9ee11 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:11.694586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a10bba-8ef6-4d60-a91f-010b7bb9ee11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:11.694965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a10bba-8ef6-4d60-a91f-010b7bb9ee11 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:11.695884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a10bba-8ef6-4d60-a91f-010b7bb9ee11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:11.703928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a10bba-8ef6-4d60-a91f-010b7bb9ee11 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:11.826083 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2207/4347] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:29:11 2022] POST /identity/v3/users => generated 288 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:11.827712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05756987-4bd4-470a-8785-f517165c1c2e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:11.848125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05756987-4bd4-470a-8785-f517165c1c2e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:11.865592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e71283-d15a-4dcc-8445-93d0cd86d0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:11.866441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e71283-d15a-4dcc-8445-93d0cd86d0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:11.866790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e71283-d15a-4dcc-8445-93d0cd86d0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:11.867075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e71283-d15a-4dcc-8445-93d0cd86d0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:11.868431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e71283-d15a-4dcc-8445-93d0cd86d0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:11.879686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e71283-d15a-4dcc-8445-93d0cd86d0b8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:11.902968 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2141/4348] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:29:11.906982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a10bba-8ef6-4d60-a91f-010b7bb9ee11 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:11.944366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a10bba-8ef6-4d60-a91f-010b7bb9ee11 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:11.968613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a29cc-ee61-4361-85c6-034d937b647d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:11.975562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a29cc-ee61-4361-85c6-034d937b647d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:11.975562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a29cc-ee61-4361-85c6-034d937b647d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:11.978402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a29cc-ee61-4361-85c6-034d937b647d admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:11.983173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a29cc-ee61-4361-85c6-034d937b647d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:12.000529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a29cc-ee61-4361-85c6-034d937b647d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:12.037930 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2208/4349] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:29:12.041654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e71283-d15a-4dcc-8445-93d0cd86d0b8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:12.057321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e71283-d15a-4dcc-8445-93d0cd86d0b8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:12.062866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20213d6-876c-48f5-9a30-875186706a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:12.064091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20213d6-876c-48f5-9a30-875186706a32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:12.064560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20213d6-876c-48f5-9a30-875186706a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:12.064990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20213d6-876c-48f5-9a30-875186706a32 admin admin] PATH_INFO: `/v3/projects/aea98f3ceee444dfafdafeb56e56f078/users/a897c5155e4e478fa883fdd3aa80ba89/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:12.085933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20213d6-876c-48f5-9a30-875186706a32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aea98f3ceee444dfafdafeb56e56f078, user_id=a897c5155e4e478fa883fdd3aa80ba89, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:12.088824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20213d6-876c-48f5-9a30-875186706a32 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:12.201279 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2142/4350] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:29:12 2022] PUT /identity/v3/projects/aea98f3ceee444dfafdafeb56e56f078/users/a897c5155e4e478fa883fdd3aa80ba89/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:29:12.217088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f8cf4-e5b1-45eb-aaa1-e981dfbf8e07 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:12.220313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f8cf4-e5b1-45eb-aaa1-e981dfbf8e07 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:12.220313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f8cf4-e5b1-45eb-aaa1-e981dfbf8e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:12.304402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8e0f8cf4-e5b1-45eb-aaa1-e981dfbf8e07 None None] MFA Rules not processed for user `a897c5155e4e478fa883fdd3aa80ba89`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:12.309304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8e0f8cf4-e5b1-45eb-aaa1-e981dfbf8e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:12.503464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20213d6-876c-48f5-9a30-875186706a32 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:12.504304 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2209/4351] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:12.637028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20213d6-876c-48f5-9a30-875186706a32 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:12.649099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53257eca-2a6c-4175-9f3b-4845ca65db7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:12.652673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53257eca-2a6c-4175-9f3b-4845ca65db7a admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:12.653256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53257eca-2a6c-4175-9f3b-4845ca65db7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:12.654811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53257eca-2a6c-4175-9f3b-4845ca65db7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:12.656420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53257eca-2a6c-4175-9f3b-4845ca65db7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:12.704760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53257eca-2a6c-4175-9f3b-4845ca65db7a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:12.868988 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2143/4352] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:29:12 2022] POST /identity/v3/projects => generated 375 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:12.872750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f8cf4-e5b1-45eb-aaa1-e981dfbf8e07 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:12.907332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f8cf4-e5b1-45eb-aaa1-e981dfbf8e07 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:13.059741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062d883-7dcb-4e19-84e8-fe6ab59cb337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:13.059741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062d883-7dcb-4e19-84e8-fe6ab59cb337 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:13.060498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062d883-7dcb-4e19-84e8-fe6ab59cb337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:13.060498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062d883-7dcb-4e19-84e8-fe6ab59cb337 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:13.060988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062d883-7dcb-4e19-84e8-fe6ab59cb337 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:13.063076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062d883-7dcb-4e19-84e8-fe6ab59cb337 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:13.156533 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:13.167756 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2210/4353] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:29:12 2022] POST /identity/v3/users => generated 294 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:13.174176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53257eca-2a6c-4175-9f3b-4845ca65db7a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:13.186370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53257eca-2a6c-4175-9f3b-4845ca65db7a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:13.194263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2603d-61be-4e82-b505-14ef804b8d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:13.194988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2603d-61be-4e82-b505-14ef804b8d92 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:13.195263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2603d-61be-4e82-b505-14ef804b8d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:13.195544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff2603d-61be-4e82-b505-14ef804b8d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:13.196326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2603d-61be-4e82-b505-14ef804b8d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:13.198917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff2603d-61be-4e82-b505-14ef804b8d92 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:13.235664 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2144/4354] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:29:13.239906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062d883-7dcb-4e19-84e8-fe6ab59cb337 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:13.257736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062d883-7dcb-4e19-84e8-fe6ab59cb337 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:13.269537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbc005-a9ac-4d0c-b6b7-6c325de19d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:13.270733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbc005-a9ac-4d0c-b6b7-6c325de19d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:13.271122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbc005-a9ac-4d0c-b6b7-6c325de19d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:13.271495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfbc005-a9ac-4d0c-b6b7-6c325de19d7b admin admin] PATH_INFO: `/v3/projects/ddf9ce4266554d27aa9d561ecbfe3496/users/fc99c51e1ccb4ef7a670dcc8f137a477/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:13.311073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfbc005-a9ac-4d0c-b6b7-6c325de19d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf9ce4266554d27aa9d561ecbfe3496, user_id=fc99c51e1ccb4ef7a670dcc8f137a477, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:13.321323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfbc005-a9ac-4d0c-b6b7-6c325de19d7b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:13.407660 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2211/4355] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:29:13 2022] PUT /identity/v3/projects/ddf9ce4266554d27aa9d561ecbfe3496/users/fc99c51e1ccb4ef7a670dcc8f137a477/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:13.411711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2603d-61be-4e82-b505-14ef804b8d92 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:13.437002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff2603d-61be-4e82-b505-14ef804b8d92 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:13.616226 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:13.627608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7258ac-befc-4430-a131-cda86b72fb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:13.629861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7258ac-befc-4430-a131-cda86b72fb32 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:13.630160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7258ac-befc-4430-a131-cda86b72fb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:13.630452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7258ac-befc-4430-a131-cda86b72fb32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:13.631207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7258ac-befc-4430-a131-cda86b72fb32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:13.639648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7258ac-befc-4430-a131-cda86b72fb32 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:13.672517 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2145/4356] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:29:13.677947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbc005-a9ac-4d0c-b6b7-6c325de19d7b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:13.697283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfbc005-a9ac-4d0c-b6b7-6c325de19d7b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:13.704495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91611de-4cff-40a6-8475-e8e6e2b4d7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:13.705620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91611de-4cff-40a6-8475-e8e6e2b4d7d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:13.705967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91611de-4cff-40a6-8475-e8e6e2b4d7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:13.706345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91611de-4cff-40a6-8475-e8e6e2b4d7d2 admin admin] PATH_INFO: `/v3/projects/ddf9ce4266554d27aa9d561ecbfe3496/users/fc99c51e1ccb4ef7a670dcc8f137a477/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:13.708812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91611de-4cff-40a6-8475-e8e6e2b4d7d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf9ce4266554d27aa9d561ecbfe3496, user_id=fc99c51e1ccb4ef7a670dcc8f137a477, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:13.712339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91611de-4cff-40a6-8475-e8e6e2b4d7d2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:13.726705 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2212/4357] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:29:13 2022] PUT /identity/v3/projects/ddf9ce4266554d27aa9d561ecbfe3496/users/fc99c51e1ccb4ef7a670dcc8f137a477/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:13.745865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b59971-770e-497b-9043-962aa6284b07 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:13.746405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b59971-770e-497b-9043-962aa6284b07 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:13.746530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b59971-770e-497b-9043-962aa6284b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:13.803023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-67b59971-770e-497b-9043-962aa6284b07 None None] MFA Rules not processed for user `fc99c51e1ccb4ef7a670dcc8f137a477`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:13.804177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-67b59971-770e-497b-9043-962aa6284b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:13.996391 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2146/4358] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:14.001201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91611de-4cff-40a6-8475-e8e6e2b4d7d2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:14.039957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91611de-4cff-40a6-8475-e8e6e2b4d7d2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:14.045120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bf251-7b6b-41bd-97c5-bd769bac500c tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc99c51e1ccb4ef7a670dcc8f137a477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddf9ce4266554d27aa9d561ecbfe3496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:14.045829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bf251-7b6b-41bd-97c5-bd769bac500c tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:14.046144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bf251-7b6b-41bd-97c5-bd769bac500c tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:14.046437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bf251-7b6b-41bd-97c5-bd769bac500c tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:14.048756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bf251-7b6b-41bd-97c5-bd769bac500c tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:14.051638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bf251-7b6b-41bd-97c5-bd769bac500c tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:14.279800 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2213/4359] 10.222.0.43 () {60 vars in 1151 bytes} [Tue Jul 19 14:29:14 2022] POST /identity/v3/projects => generated 349 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:14.284303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b59971-770e-497b-9043-962aa6284b07 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:14.299336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b59971-770e-497b-9043-962aa6284b07 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:14.506364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8c9e4-5cbd-4c1e-969b-204a875d4d4f tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc99c51e1ccb4ef7a670dcc8f137a477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddf9ce4266554d27aa9d561ecbfe3496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:14.507452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8c9e4-5cbd-4c1e-969b-204a875d4d4f tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:14.507947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8c9e4-5cbd-4c1e-969b-204a875d4d4f tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:14.508656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a8c9e4-5cbd-4c1e-969b-204a875d4d4f tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:14.510154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8c9e4-5cbd-4c1e-969b-204a875d4d4f tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:14.512506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a8c9e4-5cbd-4c1e-969b-204a875d4d4f tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:14.696964 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2147/4360] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:29:14 2022] POST /identity/v3/projects => generated 351 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:14.698581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bf251-7b6b-41bd-97c5-bd769bac500c tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:14.728492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bf251-7b6b-41bd-97c5-bd769bac500c tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:14.949154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee2ef0-a1db-45fe-8124-946ce30b8ca5 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc99c51e1ccb4ef7a670dcc8f137a477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddf9ce4266554d27aa9d561ecbfe3496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:14.959103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee2ef0-a1db-45fe-8124-946ce30b8ca5 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:14.964445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee2ef0-a1db-45fe-8124-946ce30b8ca5 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:14.964445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee2ef0-a1db-45fe-8124-946ce30b8ca5 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] PATH_INFO: `/v3/users/a897c5155e4e478fa883fdd3aa80ba89` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:14.969905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee2ef0-a1db-45fe-8124-946ce30b8ca5 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorizing `identity:get_user(user_id=a897c5155e4e478fa883fdd3aa80ba89)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:14.980075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee2ef0-a1db-45fe-8124-946ce30b8ca5 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:14.992211 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2214/4361] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Jul 19 14:29:14 2022] GET /identity/v3/users/a897c5155e4e478fa883fdd3aa80ba89 => generated 288 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:29:14.993782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8c9e4-5cbd-4c1e-969b-204a875d4d4f tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:15.011081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a8c9e4-5cbd-4c1e-969b-204a875d4d4f tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:15.043043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e8c0d-1f4b-45cd-976b-6d19fd51a704 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc99c51e1ccb4ef7a670dcc8f137a477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddf9ce4266554d27aa9d561ecbfe3496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:15.043754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e8c0d-1f4b-45cd-976b-6d19fd51a704 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:15.044048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e8c0d-1f4b-45cd-976b-6d19fd51a704 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:15.044336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e8c0d-1f4b-45cd-976b-6d19fd51a704 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:15.045179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e8c0d-1f4b-45cd-976b-6d19fd51a704 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:15.047129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929e8c0d-1f4b-45cd-976b-6d19fd51a704 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:15.148348 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2148/4362] 10.222.0.43 () {60 vars in 1161 bytes} [Tue Jul 19 14:29:14 2022] POST /identity/v3/credentials => generated 430 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:15.150215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee2ef0-a1db-45fe-8124-946ce30b8ca5 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:15.171248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee2ef0-a1db-45fe-8124-946ce30b8ca5 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:15.187900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37664390-7eea-494b-bf23-6a01c3d5176a tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc99c51e1ccb4ef7a670dcc8f137a477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddf9ce4266554d27aa9d561ecbfe3496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:15.191293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37664390-7eea-494b-bf23-6a01c3d5176a tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:15.192303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37664390-7eea-494b-bf23-6a01c3d5176a tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:15.192822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37664390-7eea-494b-bf23-6a01c3d5176a tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] PATH_INFO: `/v3/credentials/65c53d7da06947fea37f34be97a6511bb119417225819663f7b35df1b039040e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:15.198001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37664390-7eea-494b-bf23-6a01c3d5176a tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=65c53d7da06947fea37f34be97a6511bb119417225819663f7b35df1b039040e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:15.205462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37664390-7eea-494b-bf23-6a01c3d5176a tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:15.213295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37664390-7eea-494b-bf23-6a01c3d5176a tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=65c53d7da06947fea37f34be97a6511bb119417225819663f7b35df1b039040e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:15.215537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37664390-7eea-494b-bf23-6a01c3d5176a tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:15.318590 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2215/4363] 10.222.0.43 () {60 vars in 1357 bytes} [Tue Jul 19 14:29:15 2022] PATCH /identity/v3/credentials/65c53d7da06947fea37f34be97a6511bb119417225819663f7b35df1b039040e => generated 437 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:29:15.323433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e8c0d-1f4b-45cd-976b-6d19fd51a704 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:15.335337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e8c0d-1f4b-45cd-976b-6d19fd51a704 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:15.350597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbeb7c-19ac-4db2-becf-7222473d677e tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc99c51e1ccb4ef7a670dcc8f137a477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddf9ce4266554d27aa9d561ecbfe3496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:15.352587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbeb7c-19ac-4db2-becf-7222473d677e tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:15.373133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbeb7c-19ac-4db2-becf-7222473d677e tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:15.374371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fbeb7c-19ac-4db2-becf-7222473d677e tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] PATH_INFO: `/v3/credentials/65c53d7da06947fea37f34be97a6511bb119417225819663f7b35df1b039040e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:15.381599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbeb7c-19ac-4db2-becf-7222473d677e tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=65c53d7da06947fea37f34be97a6511bb119417225819663f7b35df1b039040e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:15.386200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fbeb7c-19ac-4db2-becf-7222473d677e tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:15.394745 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2149/4364] 10.222.0.43 () {58 vars in 1334 bytes} [Tue Jul 19 14:29:15 2022] GET /identity/v3/credentials/65c53d7da06947fea37f34be97a6511bb119417225819663f7b35df1b039040e => generated 437 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:29:15.399230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37664390-7eea-494b-bf23-6a01c3d5176a tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:15.412534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37664390-7eea-494b-bf23-6a01c3d5176a tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:15.421637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87508226-1b4c-4539-b974-8af8a0a2c48e tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc99c51e1ccb4ef7a670dcc8f137a477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddf9ce4266554d27aa9d561ecbfe3496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:15.421637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87508226-1b4c-4539-b974-8af8a0a2c48e tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:15.421637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87508226-1b4c-4539-b974-8af8a0a2c48e tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:15.422208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87508226-1b4c-4539-b974-8af8a0a2c48e tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] PATH_INFO: `/v3/credentials/65c53d7da06947fea37f34be97a6511bb119417225819663f7b35df1b039040e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:15.463420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87508226-1b4c-4539-b974-8af8a0a2c48e tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=65c53d7da06947fea37f34be97a6511bb119417225819663f7b35df1b039040e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:15.468898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87508226-1b4c-4539-b974-8af8a0a2c48e tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:15.614013 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2216/4365] 10.222.0.43 () {58 vars in 1337 bytes} [Tue Jul 19 14:29:15 2022] DELETE /identity/v3/credentials/65c53d7da06947fea37f34be97a6511bb119417225819663f7b35df1b039040e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:15.620983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbeb7c-19ac-4db2-becf-7222473d677e tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:15.638058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fbeb7c-19ac-4db2-becf-7222473d677e tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:15.655988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731a1d8-1056-42ef-a99e-384d6279d214 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc99c51e1ccb4ef7a670dcc8f137a477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddf9ce4266554d27aa9d561ecbfe3496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:15.657084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731a1d8-1056-42ef-a99e-384d6279d214 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:15.657739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731a1d8-1056-42ef-a99e-384d6279d214 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:15.658294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731a1d8-1056-42ef-a99e-384d6279d214 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:15.665225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731a1d8-1056-42ef-a99e-384d6279d214 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:15.665225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731a1d8-1056-42ef-a99e-384d6279d214 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:15.796215 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2150/4366] 10.222.0.43 () {60 vars in 1161 bytes} [Tue Jul 19 14:29:15 2022] POST /identity/v3/credentials => generated 429 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:15.800045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87508226-1b4c-4539-b974-8af8a0a2c48e tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:15.814837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87508226-1b4c-4539-b974-8af8a0a2c48e tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:15.827770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abba83f-97a2-4871-ad5b-ee8e55b5e4c6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc99c51e1ccb4ef7a670dcc8f137a477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddf9ce4266554d27aa9d561ecbfe3496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:15.830657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abba83f-97a2-4871-ad5b-ee8e55b5e4c6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:15.831585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abba83f-97a2-4871-ad5b-ee8e55b5e4c6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:15.832648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abba83f-97a2-4871-ad5b-ee8e55b5e4c6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:15.835122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abba83f-97a2-4871-ad5b-ee8e55b5e4c6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:15.852833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abba83f-97a2-4871-ad5b-ee8e55b5e4c6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:15.950326 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2217/4367] 10.222.0.43 () {60 vars in 1161 bytes} [Tue Jul 19 14:29:15 2022] POST /identity/v3/credentials => generated 431 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:15.954831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731a1d8-1056-42ef-a99e-384d6279d214 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:15.972346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731a1d8-1056-42ef-a99e-384d6279d214 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:16.011230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e365561-f410-458a-9311-590b1953c945 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc99c51e1ccb4ef7a670dcc8f137a477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddf9ce4266554d27aa9d561ecbfe3496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:16.011995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e365561-f410-458a-9311-590b1953c945 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:16.012217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e365561-f410-458a-9311-590b1953c945 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:16.012499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e365561-f410-458a-9311-590b1953c945 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:16.013197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e365561-f410-458a-9311-590b1953c945 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:16.018221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e365561-f410-458a-9311-590b1953c945 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:16.049273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e365561-f410-458a-9311-590b1953c945 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:16.056111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e365561-f410-458a-9311-590b1953c945 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:16.062488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e365561-f410-458a-9311-590b1953c945 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:16.064312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e365561-f410-458a-9311-590b1953c945 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:16.067426 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2151/4368] 10.222.0.43 () {58 vars in 1139 bytes} [Tue Jul 19 14:29:15 2022] GET /identity/v3/credentials => generated 945 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:29:16.070907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abba83f-97a2-4871-ad5b-ee8e55b5e4c6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:16.093610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abba83f-97a2-4871-ad5b-ee8e55b5e4c6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:16.124849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615818d2-0f56-4b34-a44f-40fc752ebac9 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc99c51e1ccb4ef7a670dcc8f137a477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddf9ce4266554d27aa9d561ecbfe3496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:16.127197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615818d2-0f56-4b34-a44f-40fc752ebac9 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:16.128734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615818d2-0f56-4b34-a44f-40fc752ebac9 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:16.129289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615818d2-0f56-4b34-a44f-40fc752ebac9 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] PATH_INFO: `/v3/credentials/2b224c2f8de395ae9b21c53db6b0cd942d0d9df748c83dd93e5a3aa2a26f498a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:16.138924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615818d2-0f56-4b34-a44f-40fc752ebac9 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=2b224c2f8de395ae9b21c53db6b0cd942d0d9df748c83dd93e5a3aa2a26f498a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:16.151968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615818d2-0f56-4b34-a44f-40fc752ebac9 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:16.236411 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2218/4369] 10.222.0.43 () {58 vars in 1337 bytes} [Tue Jul 19 14:29:16 2022] DELETE /identity/v3/credentials/2b224c2f8de395ae9b21c53db6b0cd942d0d9df748c83dd93e5a3aa2a26f498a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:16.243855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e365561-f410-458a-9311-590b1953c945 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:16.284014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e365561-f410-458a-9311-590b1953c945 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:16.310672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bde787-2851-435b-922c-ce7661474512 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc99c51e1ccb4ef7a670dcc8f137a477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddf9ce4266554d27aa9d561ecbfe3496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:16.312968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bde787-2851-435b-922c-ce7661474512 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:16.313563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bde787-2851-435b-922c-ce7661474512 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:16.314763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bde787-2851-435b-922c-ce7661474512 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] PATH_INFO: `/v3/credentials/0fb21897074a66b1ad4f80f632311ebac0c15cbe21be125a93e10a45f69a59f6` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:16.321930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bde787-2851-435b-922c-ce7661474512 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=0fb21897074a66b1ad4f80f632311ebac0c15cbe21be125a93e10a45f69a59f6)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:16.326367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bde787-2851-435b-922c-ce7661474512 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:16.460351 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2152/4370] 10.222.0.43 () {58 vars in 1337 bytes} [Tue Jul 19 14:29:16 2022] DELETE /identity/v3/credentials/0fb21897074a66b1ad4f80f632311ebac0c15cbe21be125a93e10a45f69a59f6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:16.467355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615818d2-0f56-4b34-a44f-40fc752ebac9 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:16.487195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615818d2-0f56-4b34-a44f-40fc752ebac9 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:16.509064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b631b-ec17-4929-bf29-26997f986fb6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc99c51e1ccb4ef7a670dcc8f137a477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddf9ce4266554d27aa9d561ecbfe3496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:16.512176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b631b-ec17-4929-bf29-26997f986fb6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:16.512176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b631b-ec17-4929-bf29-26997f986fb6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:16.512176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b631b-ec17-4929-bf29-26997f986fb6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] PATH_INFO: `/v3/projects/72bb66dcc9884269816fcfb010b5c780` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:16.516852 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b631b-ec17-4929-bf29-26997f986fb6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorizing `identity:delete_project(project_id=72bb66dcc9884269816fcfb010b5c780)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:16.519067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b631b-ec17-4929-bf29-26997f986fb6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:16.714900 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:16.748842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f33b631b-ec17-4929-bf29-26997f986fb6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72bb66dcc9884269816fcfb010b5c780', 'request_id': 'req-f33b631b-ec17-4929-bf29-26997f986fb6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:16.791439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f33b631b-ec17-4929-bf29-26997f986fb6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72bb66dcc9884269816fcfb010b5c780', 'request_id': 'req-f33b631b-ec17-4929-bf29-26997f986fb6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:16.802942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f33b631b-ec17-4929-bf29-26997f986fb6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72bb66dcc9884269816fcfb010b5c780', 'request_id': 'req-f33b631b-ec17-4929-bf29-26997f986fb6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:16.875100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f33b631b-ec17-4929-bf29-26997f986fb6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] The token cache is being invalidate because project 72bb66dcc9884269816fcfb010b5c780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:29:16.875875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f33b631b-ec17-4929-bf29-26997f986fb6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:16.877864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f33b631b-ec17-4929-bf29-26997f986fb6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:16.881474 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2219/4371] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:29:16 2022] DELETE /identity/v3/projects/72bb66dcc9884269816fcfb010b5c780 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:16.887208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bde787-2851-435b-922c-ce7661474512 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:16.891068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-81bde787-2851-435b-922c-ce7661474512 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:16.915780 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:16.934385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bde787-2851-435b-922c-ce7661474512 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:17.180664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510798ce-8f7f-4794-8768-f37947a40b52 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc99c51e1ccb4ef7a670dcc8f137a477', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ddf9ce4266554d27aa9d561ecbfe3496', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:17.183631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510798ce-8f7f-4794-8768-f37947a40b52 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:17.184126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510798ce-8f7f-4794-8768-f37947a40b52 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:17.184567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510798ce-8f7f-4794-8768-f37947a40b52 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] PATH_INFO: `/v3/projects/3af9f774938441a39d79e8db2809f33a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:17.189435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510798ce-8f7f-4794-8768-f37947a40b52 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3af9f774938441a39d79e8db2809f33a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:17.198141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510798ce-8f7f-4794-8768-f37947a40b52 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:17.409086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-510798ce-8f7f-4794-8768-f37947a40b52 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3af9f774938441a39d79e8db2809f33a', 'request_id': 'req-510798ce-8f7f-4794-8768-f37947a40b52'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:17.513183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-510798ce-8f7f-4794-8768-f37947a40b52 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3af9f774938441a39d79e8db2809f33a', 'request_id': 'req-510798ce-8f7f-4794-8768-f37947a40b52'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:17.522522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-510798ce-8f7f-4794-8768-f37947a40b52 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3af9f774938441a39d79e8db2809f33a', 'request_id': 'req-510798ce-8f7f-4794-8768-f37947a40b52'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:17.553077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-510798ce-8f7f-4794-8768-f37947a40b52 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] The token cache is being invalidate because project 3af9f774938441a39d79e8db2809f33a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:29:17.553599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-510798ce-8f7f-4794-8768-f37947a40b52 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:17.554628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-510798ce-8f7f-4794-8768-f37947a40b52 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:17.564422 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2153/4372] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:29:16 2022] DELETE /identity/v3/projects/3af9f774938441a39d79e8db2809f33a => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:17.568791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b631b-ec17-4929-bf29-26997f986fb6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:17.571719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f33b631b-ec17-4929-bf29-26997f986fb6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:17.765015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b631b-ec17-4929-bf29-26997f986fb6 tempest-CredentialsTestJSON-1780021151 tempest-CredentialsTestJSON-1780021151-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:17.912876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024fd0a-fbe7-4de9-bae1-04a0663570cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:17.915865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024fd0a-fbe7-4de9-bae1-04a0663570cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:17.917753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024fd0a-fbe7-4de9-bae1-04a0663570cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:17.918295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024fd0a-fbe7-4de9-bae1-04a0663570cb admin admin] PATH_INFO: `/v3/users/a897c5155e4e478fa883fdd3aa80ba89` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:17.921965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7389b-310a-4e15-a7a2-42865f5a1f6c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:17.922516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7389b-310a-4e15-a7a2-42865f5a1f6c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:17.923016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7389b-310a-4e15-a7a2-42865f5a1f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:17.929419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024fd0a-fbe7-4de9-bae1-04a0663570cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a897c5155e4e478fa883fdd3aa80ba89)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:17.944469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024fd0a-fbe7-4de9-bae1-04a0663570cb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:18.008777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-96a7389b-310a-4e15-a7a2-42865f5a1f6c None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:18.011643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-96a7389b-310a-4e15-a7a2-42865f5a1f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:18.247318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f024fd0a-fbe7-4de9-bae1-04a0663570cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a897c5155e4e478fa883fdd3aa80ba89'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:18.308023 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2154/4373] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:29:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:29:18.312858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f024fd0a-fbe7-4de9-bae1-04a0663570cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a897c5155e4e478fa883fdd3aa80ba89'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:18.323592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f024fd0a-fbe7-4de9-bae1-04a0663570cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a897c5155e4e478fa883fdd3aa80ba89'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:18.324447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f024fd0a-fbe7-4de9-bae1-04a0663570cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a897c5155e4e478fa883fdd3aa80ba89'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:18.326626 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:18.397044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7389b-310a-4e15-a7a2-42865f5a1f6c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:18.397044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-96a7389b-310a-4e15-a7a2-42865f5a1f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:18.416275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f024fd0a-fbe7-4de9-bae1-04a0663570cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a897c5155e4e478fa883fdd3aa80ba89'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:18.424647 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2220/4374] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:29:17 2022] DELETE /identity/v3/users/a897c5155e4e478fa883fdd3aa80ba89 => generated 0 bytes in 857 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:18.431053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bdfeb-b777-4138-9e53-acd1d3bbcbaf None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:18.431677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bdfeb-b777-4138-9e53-acd1d3bbcbaf None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:18.432160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7bdfeb-b777-4138-9e53-acd1d3bbcbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:18.442780 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:18.481991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6a7bdfeb-b777-4138-9e53-acd1d3bbcbaf None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:18.484067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6a7bdfeb-b777-4138-9e53-acd1d3bbcbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:18.671468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7389b-310a-4e15-a7a2-42865f5a1f6c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:18.689588 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2221/4375] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:18.757485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7bdfeb-b777-4138-9e53-acd1d3bbcbaf None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:18.760044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6a7bdfeb-b777-4138-9e53-acd1d3bbcbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:18.830569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a8b15-9b1e-4814-a770-eefd3c25f08c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:18.831452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a8b15-9b1e-4814-a770-eefd3c25f08c service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:18.831704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a8b15-9b1e-4814-a770-eefd3c25f08c service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:18.832008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a8b15-9b1e-4814-a770-eefd3c25f08c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:18.834153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c70a8b15-9b1e-4814-a770-eefd3c25f08c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:19.011875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7bdfeb-b777-4138-9e53-acd1d3bbcbaf None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:19.029580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a8b15-9b1e-4814-a770-eefd3c25f08c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:19.029580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70a8b15-9b1e-4814-a770-eefd3c25f08c service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:19.037614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25274222-4d32-4a24-8119-2f34582235f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:19.038392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25274222-4d32-4a24-8119-2f34582235f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:19.038677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25274222-4d32-4a24-8119-2f34582235f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:19.038955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25274222-4d32-4a24-8119-2f34582235f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:19.064084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25274222-4d32-4a24-8119-2f34582235f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:19.065957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25274222-4d32-4a24-8119-2f34582235f6 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:19.069776 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2155/4376] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:29:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:29:19.095260 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2222/4377] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:29:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:29:21.642071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a8b15-9b1e-4814-a770-eefd3c25f08c service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:21.644107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c70a8b15-9b1e-4814-a770-eefd3c25f08c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:21.672743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a8b15-9b1e-4814-a770-eefd3c25f08c service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:21.684887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fac19c-683d-4dee-a9da-7869cf1941d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:21.688000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fac19c-683d-4dee-a9da-7869cf1941d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:21.688285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fac19c-683d-4dee-a9da-7869cf1941d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:21.688569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fac19c-683d-4dee-a9da-7869cf1941d0 admin admin] PATH_INFO: `/v3/projects/aea98f3ceee444dfafdafeb56e56f078` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:21.692285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fac19c-683d-4dee-a9da-7869cf1941d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aea98f3ceee444dfafdafeb56e56f078)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:21.699024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fac19c-683d-4dee-a9da-7869cf1941d0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:21.994888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e7fac19c-683d-4dee-a9da-7869cf1941d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aea98f3ceee444dfafdafeb56e56f078', 'request_id': 'req-e7fac19c-683d-4dee-a9da-7869cf1941d0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:22.014254 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:22.118723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e7fac19c-683d-4dee-a9da-7869cf1941d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aea98f3ceee444dfafdafeb56e56f078', 'request_id': 'req-e7fac19c-683d-4dee-a9da-7869cf1941d0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:22.141595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e7fac19c-683d-4dee-a9da-7869cf1941d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aea98f3ceee444dfafdafeb56e56f078', 'request_id': 'req-e7fac19c-683d-4dee-a9da-7869cf1941d0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:22.164330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e7fac19c-683d-4dee-a9da-7869cf1941d0 admin admin] The token cache is being invalidate because project aea98f3ceee444dfafdafeb56e56f078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:29:22.164989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e7fac19c-683d-4dee-a9da-7869cf1941d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:22.170859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e7fac19c-683d-4dee-a9da-7869cf1941d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:22.182394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25274222-4d32-4a24-8119-2f34582235f6 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:22.188871 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2156/4378] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:29:21 2022] DELETE /identity/v3/projects/aea98f3ceee444dfafdafeb56e56f078 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:22.195112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25274222-4d32-4a24-8119-2f34582235f6 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:22.428288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a277255d-4af3-4ebc-9bc6-65055c4feac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:22.432569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277255d-4af3-4ebc-9bc6-65055c4feac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:22.438233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277255d-4af3-4ebc-9bc6-65055c4feac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:22.438726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a277255d-4af3-4ebc-9bc6-65055c4feac1 admin admin] PATH_INFO: `/v3/users/fc99c51e1ccb4ef7a670dcc8f137a477` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:22.441194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277255d-4af3-4ebc-9bc6-65055c4feac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc99c51e1ccb4ef7a670dcc8f137a477)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:22.449198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a277255d-4af3-4ebc-9bc6-65055c4feac1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:22.823637 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:INSERT=1,keystone:DELETE=6,keystone:SELECT=93 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:22.863853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a277255d-4af3-4ebc-9bc6-65055c4feac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc99c51e1ccb4ef7a670dcc8f137a477'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:22.899303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a277255d-4af3-4ebc-9bc6-65055c4feac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc99c51e1ccb4ef7a670dcc8f137a477'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:22.928435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a277255d-4af3-4ebc-9bc6-65055c4feac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc99c51e1ccb4ef7a670dcc8f137a477'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:22.932384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a277255d-4af3-4ebc-9bc6-65055c4feac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc99c51e1ccb4ef7a670dcc8f137a477'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:23.010826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a277255d-4af3-4ebc-9bc6-65055c4feac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc99c51e1ccb4ef7a670dcc8f137a477'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:23.020834 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2223/4379] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:29:22 2022] DELETE /identity/v3/users/fc99c51e1ccb4ef7a670dcc8f137a477 => generated 0 bytes in 836 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:24.914746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fac19c-683d-4dee-a9da-7869cf1941d0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:24.916383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e7fac19c-683d-4dee-a9da-7869cf1941d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:24.945308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fac19c-683d-4dee-a9da-7869cf1941d0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:25.130781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a237a3-db34-4027-8c72-ff9f95143da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:25.131833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a237a3-db34-4027-8c72-ff9f95143da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:25.132252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a237a3-db34-4027-8c72-ff9f95143da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:25.132664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a237a3-db34-4027-8c72-ff9f95143da7 admin admin] PATH_INFO: `/v3/projects/ddf9ce4266554d27aa9d561ecbfe3496` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:25.135752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a237a3-db34-4027-8c72-ff9f95143da7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddf9ce4266554d27aa9d561ecbfe3496)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:25.140285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a237a3-db34-4027-8c72-ff9f95143da7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:25.338411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-03a237a3-db34-4027-8c72-ff9f95143da7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddf9ce4266554d27aa9d561ecbfe3496', 'request_id': 'req-03a237a3-db34-4027-8c72-ff9f95143da7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:25.457395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-03a237a3-db34-4027-8c72-ff9f95143da7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddf9ce4266554d27aa9d561ecbfe3496', 'request_id': 'req-03a237a3-db34-4027-8c72-ff9f95143da7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:25.501757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-03a237a3-db34-4027-8c72-ff9f95143da7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddf9ce4266554d27aa9d561ecbfe3496', 'request_id': 'req-03a237a3-db34-4027-8c72-ff9f95143da7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:25.572840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-03a237a3-db34-4027-8c72-ff9f95143da7 admin admin] The token cache is being invalidate because project ddf9ce4266554d27aa9d561ecbfe3496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:29:25.577631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-03a237a3-db34-4027-8c72-ff9f95143da7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:25.578705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-03a237a3-db34-4027-8c72-ff9f95143da7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:25.585834 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2157/4380] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:29:24 2022] DELETE /identity/v3/projects/ddf9ce4266554d27aa9d561ecbfe3496 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:25.592422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ae334-fcc4-445a-84e5-17e87e18a4df None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:25.592979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ae334-fcc4-445a-84e5-17e87e18a4df None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:25.592979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2ae334-fcc4-445a-84e5-17e87e18a4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:25.645255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3a2ae334-fcc4-445a-84e5-17e87e18a4df None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:25.647768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3a2ae334-fcc4-445a-84e5-17e87e18a4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:25.758324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a237a3-db34-4027-8c72-ff9f95143da7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:25.759670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-03a237a3-db34-4027-8c72-ff9f95143da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:25.843281 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2224/4381] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:25.845789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd33e1-6ea1-48b6-8bae-3957c9744ce1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:25.845789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd33e1-6ea1-48b6-8bae-3957c9744ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:25.845789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd33e1-6ea1-48b6-8bae-3957c9744ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:25.888583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4afd33e1-6ea1-48b6-8bae-3957c9744ce1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:25.891942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4afd33e1-6ea1-48b6-8bae-3957c9744ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:25.935807 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2225/4382] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:25.936784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd33e1-6ea1-48b6-8bae-3957c9744ce1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:25.972880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd33e1-6ea1-48b6-8bae-3957c9744ce1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:25.987854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305cef2-a6cf-4c8c-840e-368c54748cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:25.991406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305cef2-a6cf-4c8c-840e-368c54748cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:25.991724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305cef2-a6cf-4c8c-840e-368c54748cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:25.993769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305cef2-a6cf-4c8c-840e-368c54748cc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:25.993769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305cef2-a6cf-4c8c-840e-368c54748cc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:29:25.993769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305cef2-a6cf-4c8c-840e-368c54748cc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:25.996660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305cef2-a6cf-4c8c-840e-368c54748cc0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:26.039956 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2226/4383] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:29:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:29:26.043937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305cef2-a6cf-4c8c-840e-368c54748cc0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:26.060373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305cef2-a6cf-4c8c-840e-368c54748cc0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:26.066566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de659407-1f23-4496-af4d-9a829674cb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:26.067453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de659407-1f23-4496-af4d-9a829674cb1d admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:26.068962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de659407-1f23-4496-af4d-9a829674cb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:26.069260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de659407-1f23-4496-af4d-9a829674cb1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:26.079593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de659407-1f23-4496-af4d-9a829674cb1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:26.081318 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:26.081781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de659407-1f23-4496-af4d-9a829674cb1d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:26.163148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a237a3-db34-4027-8c72-ff9f95143da7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:26.173352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2bb76-6c59-446d-b75a-33c02e0e43a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:26.175846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2bb76-6c59-446d-b75a-33c02e0e43a4 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:26.175846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2bb76-6c59-446d-b75a-33c02e0e43a4 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:26.175846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2bb76-6c59-446d-b75a-33c02e0e43a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:26.177067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eed2bb76-6c59-446d-b75a-33c02e0e43a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:26.211660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2bb76-6c59-446d-b75a-33c02e0e43a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:26.211660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2bb76-6c59-446d-b75a-33c02e0e43a4 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:26.235503 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2158/4384] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:29:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:29:26.279084 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2227/4385] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:29:26 2022] POST /identity/v3/projects => generated 369 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:26.283373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2bb76-6c59-446d-b75a-33c02e0e43a4 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:26.320289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2bb76-6c59-446d-b75a-33c02e0e43a4 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:26.596653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b075f-5d24-4aa5-b264-154c76120ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:26.597504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b075f-5d24-4aa5-b264-154c76120ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:26.598326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b075f-5d24-4aa5-b264-154c76120ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:26.598717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b075f-5d24-4aa5-b264-154c76120ed9 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:26.599587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b075f-5d24-4aa5-b264-154c76120ed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:26.614819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b075f-5d24-4aa5-b264-154c76120ed9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:26.797375 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2159/4386] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:29:26 2022] POST /identity/v3/users => generated 285 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:29:26.800509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de659407-1f23-4496-af4d-9a829674cb1d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:26.822570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de659407-1f23-4496-af4d-9a829674cb1d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:26.835567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5dd7d-f7e3-4201-b9a2-ec075d943417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:26.839917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5dd7d-f7e3-4201-b9a2-ec075d943417 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:26.841424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5dd7d-f7e3-4201-b9a2-ec075d943417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:26.841887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc5dd7d-f7e3-4201-b9a2-ec075d943417 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:26.844882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5dd7d-f7e3-4201-b9a2-ec075d943417 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:26.850270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc5dd7d-f7e3-4201-b9a2-ec075d943417 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:26.900567 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2228/4387] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:29:26.900900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b075f-5d24-4aa5-b264-154c76120ed9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:26.913753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b075f-5d24-4aa5-b264-154c76120ed9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:26.922016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fd9bf-1cac-463a-956f-d7524c795190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:26.923012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fd9bf-1cac-463a-956f-d7524c795190 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:26.923443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fd9bf-1cac-463a-956f-d7524c795190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:26.923863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fd9bf-1cac-463a-956f-d7524c795190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:26.925248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fd9bf-1cac-463a-956f-d7524c795190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:26.927110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fd9bf-1cac-463a-956f-d7524c795190 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:26.942267 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2160/4388] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:29:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:29:26.945931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5dd7d-f7e3-4201-b9a2-ec075d943417 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:26.975030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc5dd7d-f7e3-4201-b9a2-ec075d943417 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:26.983284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547954d-2b35-4a1d-86bb-4e95310ba983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:26.984645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547954d-2b35-4a1d-86bb-4e95310ba983 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:26.985870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547954d-2b35-4a1d-86bb-4e95310ba983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:26.987168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547954d-2b35-4a1d-86bb-4e95310ba983 admin admin] PATH_INFO: `/v3/projects/48e6f1a95ee940b280d4ae92caa839e0/users/c8c9b5de15bc4febb3edc2e3b4f7fad6/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:27.038684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547954d-2b35-4a1d-86bb-4e95310ba983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e6f1a95ee940b280d4ae92caa839e0, user_id=c8c9b5de15bc4febb3edc2e3b4f7fad6, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:27.046162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547954d-2b35-4a1d-86bb-4e95310ba983 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:27.180150 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2229/4389] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:29:26 2022] PUT /identity/v3/projects/48e6f1a95ee940b280d4ae92caa839e0/users/c8c9b5de15bc4febb3edc2e3b4f7fad6/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:29:27.191990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aadf29-b081-4633-8362-59c877eedfac None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:27.191990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aadf29-b081-4633-8362-59c877eedfac None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:27.192625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aadf29-b081-4633-8362-59c877eedfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:27.260307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c4aadf29-b081-4633-8362-59c877eedfac None None] MFA Rules not processed for user `c8c9b5de15bc4febb3edc2e3b4f7fad6`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:27.265916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c4aadf29-b081-4633-8362-59c877eedfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:27.350816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7fd19-3493-4930-a8f6-90859a313bc5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:27.351200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7fd19-3493-4930-a8f6-90859a313bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:27.352803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7fd19-3493-4930-a8f6-90859a313bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:27.401945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d2a7fd19-3493-4930-a8f6-90859a313bc5 None None] MFA Rules not processed for user `505a5026c10a49a893e04d45a011167d`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:27.403406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d2a7fd19-3493-4930-a8f6-90859a313bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:27.441482 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2161/4390] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:27 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:27.449035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aadf29-b081-4633-8362-59c877eedfac None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:27.515049 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:27.545645 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:27.552798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aadf29-b081-4633-8362-59c877eedfac None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:27.561248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39528852-c743-4053-9ad7-b650a2d51893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:27.562347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528852-c743-4053-9ad7-b650a2d51893 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:27.562773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528852-c743-4053-9ad7-b650a2d51893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:27.563210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39528852-c743-4053-9ad7-b650a2d51893 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:27.564021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39528852-c743-4053-9ad7-b650a2d51893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:27.567428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39528852-c743-4053-9ad7-b650a2d51893 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:27.582274 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2230/4391] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:27.592880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5052f-b42f-46dd-9910-c4006979e572 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:27.593768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5052f-b42f-46dd-9910-c4006979e572 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:27.594220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a5052f-b42f-46dd-9910-c4006979e572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:27.637515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e8a5052f-b42f-46dd-9910-c4006979e572 None None] MFA Rules not processed for user `505a5026c10a49a893e04d45a011167d`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:27.638862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e8a5052f-b42f-46dd-9910-c4006979e572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:27.647526 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2231/4392] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:29:27.658739 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2162/4393] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:29:27 2022] POST /identity/v3/projects => generated 367 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:27.665901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5052f-b42f-46dd-9910-c4006979e572 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:27.689232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a5052f-b42f-46dd-9910-c4006979e572 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:27.845292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378faa6-7f56-44d6-a4bd-0aaeeae5b075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:27.846026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378faa6-7f56-44d6-a4bd-0aaeeae5b075 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:27.846638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378faa6-7f56-44d6-a4bd-0aaeeae5b075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:27.847116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3378faa6-7f56-44d6-a4bd-0aaeeae5b075 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:27.847887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378faa6-7f56-44d6-a4bd-0aaeeae5b075 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:27.850022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3378faa6-7f56-44d6-a4bd-0aaeeae5b075 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:27.952748 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2232/4394] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:29:27 2022] POST /identity/v3/users => generated 290 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:27.954126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39528852-c743-4053-9ad7-b650a2d51893 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:27.972203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39528852-c743-4053-9ad7-b650a2d51893 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:27.986115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9d2b4-79ea-4b92-b327-67b478c75822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:27.987038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9d2b4-79ea-4b92-b327-67b478c75822 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:27.987578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9d2b4-79ea-4b92-b327-67b478c75822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:28.002500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9d2b4-79ea-4b92-b327-67b478c75822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:28.002500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9d2b4-79ea-4b92-b327-67b478c75822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:28.002500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce9d2b4-79ea-4b92-b327-67b478c75822 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:28.025911 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2163/4395] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:29:27 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:29:28.027114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378faa6-7f56-44d6-a4bd-0aaeeae5b075 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:28.049606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3378faa6-7f56-44d6-a4bd-0aaeeae5b075 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:28.057233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef549dec-532d-448a-9ee2-6de9f0d56584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:28.058302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef549dec-532d-448a-9ee2-6de9f0d56584 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:28.058620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef549dec-532d-448a-9ee2-6de9f0d56584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:28.058937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef549dec-532d-448a-9ee2-6de9f0d56584 admin admin] PATH_INFO: `/v3/projects/055a26ef4e2445f1876a797084627e3b/users/455597f7f879426985ea8d8af2caca95/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:28.098497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef549dec-532d-448a-9ee2-6de9f0d56584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=055a26ef4e2445f1876a797084627e3b, user_id=455597f7f879426985ea8d8af2caca95, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:28.101379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef549dec-532d-448a-9ee2-6de9f0d56584 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:28.183372 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2233/4396] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:29:28 2022] PUT /identity/v3/projects/055a26ef4e2445f1876a797084627e3b/users/455597f7f879426985ea8d8af2caca95/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:28.187569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9d2b4-79ea-4b92-b327-67b478c75822 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:28.201433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9d2b4-79ea-4b92-b327-67b478c75822 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:28.425507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd1baa-ceae-4d56-96ce-85460b337bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:28.426253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd1baa-ceae-4d56-96ce-85460b337bbf admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:28.426553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd1baa-ceae-4d56-96ce-85460b337bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:28.426850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd1baa-ceae-4d56-96ce-85460b337bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:28.427606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd1baa-ceae-4d56-96ce-85460b337bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:28.429294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd1baa-ceae-4d56-96ce-85460b337bbf admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:28.472446 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2164/4397] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:29:28.488783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef549dec-532d-448a-9ee2-6de9f0d56584 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:28.504768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef549dec-532d-448a-9ee2-6de9f0d56584 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:28.517657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35bd63-a7fd-46fe-8625-abf0a8d7b00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:28.518922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35bd63-a7fd-46fe-8625-abf0a8d7b00d admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:28.519385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35bd63-a7fd-46fe-8625-abf0a8d7b00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:28.519810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b35bd63-a7fd-46fe-8625-abf0a8d7b00d admin admin] PATH_INFO: `/v3/projects/055a26ef4e2445f1876a797084627e3b/users/455597f7f879426985ea8d8af2caca95/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:28.527532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35bd63-a7fd-46fe-8625-abf0a8d7b00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=055a26ef4e2445f1876a797084627e3b, user_id=455597f7f879426985ea8d8af2caca95, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:28.530518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b35bd63-a7fd-46fe-8625-abf0a8d7b00d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:28.573721 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2234/4398] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:29:28 2022] PUT /identity/v3/projects/055a26ef4e2445f1876a797084627e3b/users/455597f7f879426985ea8d8af2caca95/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:28.583865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521f039-2b1a-4e53-a3cf-e2f7027bda07 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:28.584431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521f039-2b1a-4e53-a3cf-e2f7027bda07 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:28.584867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521f039-2b1a-4e53-a3cf-e2f7027bda07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:28.626564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5521f039-2b1a-4e53-a3cf-e2f7027bda07 None None] MFA Rules not processed for user `455597f7f879426985ea8d8af2caca95`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:28.627908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5521f039-2b1a-4e53-a3cf-e2f7027bda07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:28.714917 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2165/4399] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:28 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:28.719350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35bd63-a7fd-46fe-8625-abf0a8d7b00d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:28.733750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b35bd63-a7fd-46fe-8625-abf0a8d7b00d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:28.739662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ad93e-036a-4a13-ad0d-78670396162f tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:28.740408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ad93e-036a-4a13-ad0d-78670396162f tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:28.740798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ad93e-036a-4a13-ad0d-78670396162f tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:28.741199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ad93e-036a-4a13-ad0d-78670396162f tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:28.743580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ad93e-036a-4a13-ad0d-78670396162f tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:28.744860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98ad93e-036a-4a13-ad0d-78670396162f tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:28.879112 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2235/4400] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:29:28 2022] POST /identity/v3/domains => generated 277 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:28.886609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521f039-2b1a-4e53-a3cf-e2f7027bda07 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:28.905050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521f039-2b1a-4e53-a3cf-e2f7027bda07 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:29.007890 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:29.020198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbe18b-76a3-4564-a13a-184f384a1516 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:29.024009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbe18b-76a3-4564-a13a-184f384a1516 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:29.024009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbe18b-76a3-4564-a13a-184f384a1516 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:29.024009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acbe18b-76a3-4564-a13a-184f384a1516 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:29.024009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbe18b-76a3-4564-a13a-184f384a1516 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:29.024396 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-2acbe18b-76a3-4564-a13a-184f384a1516 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:29:29.024396 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:29:29.024396 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:29:29.025683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acbe18b-76a3-4564-a13a-184f384a1516 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:29.119973 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2166/4401] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jul 19 14:29:28 2022] POST /identity/v3/groups => generated 280 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:29.125773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ad93e-036a-4a13-ad0d-78670396162f tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:29.143396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98ad93e-036a-4a13-ad0d-78670396162f tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:29.165670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2ceba-44f5-45c2-bc46-4adbfa15045b tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:29.166877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2ceba-44f5-45c2-bc46-4adbfa15045b tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:29.170373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2ceba-44f5-45c2-bc46-4adbfa15045b tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:29.170373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2ceba-44f5-45c2-bc46-4adbfa15045b tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/b81be197e4dc44c5becd6dfeb269b05e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:29.192341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2ceba-44f5-45c2-bc46-4adbfa15045b tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:update_group(group_id=b81be197e4dc44c5becd6dfeb269b05e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:29.197878 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-16d2ceba-44f5-45c2-bc46-4adbfa15045b tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:29:29.197878 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:29:29.197878 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:29:29.200680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2ceba-44f5-45c2-bc46-4adbfa15045b tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:29.374848 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2236/4402] 10.222.0.43 () {60 vars in 1246 bytes} [Tue Jul 19 14:29:29 2022] PATCH /identity/v3/groups/b81be197e4dc44c5becd6dfeb269b05e => generated 293 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:29:29.379302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbe18b-76a3-4564-a13a-184f384a1516 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:29.423878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acbe18b-76a3-4564-a13a-184f384a1516 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:29.460440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cef08c-827a-4940-a161-12970f22570c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:29.463984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cef08c-827a-4940-a161-12970f22570c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:29.467310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cef08c-827a-4940-a161-12970f22570c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:29.468630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cef08c-827a-4940-a161-12970f22570c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/b81be197e4dc44c5becd6dfeb269b05e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:29.486848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cef08c-827a-4940-a161-12970f22570c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:get_group(group_id=b81be197e4dc44c5becd6dfeb269b05e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:29.489087 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-d9cef08c-827a-4940-a161-12970f22570c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:29:29.489087 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:29:29.489087 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:29:29.496924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cef08c-827a-4940-a161-12970f22570c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:29.502083 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2167/4403] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:29:29 2022] GET /identity/v3/groups/b81be197e4dc44c5becd6dfeb269b05e => generated 293 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:29:29.505557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2ceba-44f5-45c2-bc46-4adbfa15045b tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:29.526543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2ceba-44f5-45c2-bc46-4adbfa15045b tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:29.555884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a171f6-2ffd-4b71-80dd-5cec189e34ff tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:29.564169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a171f6-2ffd-4b71-80dd-5cec189e34ff tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:29.564480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a171f6-2ffd-4b71-80dd-5cec189e34ff tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:29.564764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a171f6-2ffd-4b71-80dd-5cec189e34ff tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/b81be197e4dc44c5becd6dfeb269b05e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:29.571975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a171f6-2ffd-4b71-80dd-5cec189e34ff tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:update_group(group_id=b81be197e4dc44c5becd6dfeb269b05e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:29.581135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a171f6-2ffd-4b71-80dd-5cec189e34ff tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:29.733485 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2237/4404] 10.222.0.43 () {60 vars in 1245 bytes} [Tue Jul 19 14:29:29 2022] PATCH /identity/v3/groups/b81be197e4dc44c5becd6dfeb269b05e => generated 309 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:29:29.737792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cef08c-827a-4940-a161-12970f22570c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:29.753711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cef08c-827a-4940-a161-12970f22570c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:29.765776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d976010f-8142-48ca-9f43-930b0392284e tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:29.767287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976010f-8142-48ca-9f43-930b0392284e tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:29.768893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976010f-8142-48ca-9f43-930b0392284e tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:29.769871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d976010f-8142-48ca-9f43-930b0392284e tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/b81be197e4dc44c5becd6dfeb269b05e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:29.785688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976010f-8142-48ca-9f43-930b0392284e tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:delete_group(group_id=b81be197e4dc44c5becd6dfeb269b05e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:29.786979 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-d976010f-8142-48ca-9f43-930b0392284e tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:29:29.786979 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:29:29.786979 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:29:29.792343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d976010f-8142-48ca-9f43-930b0392284e tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:29.961040 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2168/4405] 10.222.0.43 () {58 vars in 1226 bytes} [Tue Jul 19 14:29:29 2022] DELETE /identity/v3/groups/b81be197e4dc44c5becd6dfeb269b05e => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:29.967622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a171f6-2ffd-4b71-80dd-5cec189e34ff tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:30.015980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a171f6-2ffd-4b71-80dd-5cec189e34ff tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:30.113203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f35bd-ba88-4789-9408-6c860f2ddd88 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:30.113845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f35bd-ba88-4789-9408-6c860f2ddd88 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:30.114254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f35bd-ba88-4789-9408-6c860f2ddd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:30.155964 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:UPDATE=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:30.188096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-aa0f35bd-ba88-4789-9408-6c860f2ddd88 None None] MFA Rules not processed for user `b9e1e7bf96f14aa69aafb39fd9caed59`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:30.205587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aa0f35bd-ba88-4789-9408-6c860f2ddd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:30.234421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43709723-261e-47f2-b89c-c1c3f9bc4aad tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:30.239074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43709723-261e-47f2-b89c-c1c3f9bc4aad tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:30.239074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43709723-261e-47f2-b89c-c1c3f9bc4aad tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:30.239074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43709723-261e-47f2-b89c-c1c3f9bc4aad tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:30.239074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43709723-261e-47f2-b89c-c1c3f9bc4aad tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:30.239670 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-43709723-261e-47f2-b89c-c1c3f9bc4aad tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:29:30.239670 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:29:30.239670 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:29:30.239670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43709723-261e-47f2-b89c-c1c3f9bc4aad tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:30.329472 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2238/4406] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jul 19 14:29:29 2022] POST /identity/v3/groups => generated 326 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:30.330547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43709723-261e-47f2-b89c-c1c3f9bc4aad tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:30.363181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43709723-261e-47f2-b89c-c1c3f9bc4aad tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:30.382088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb365da-0f99-4a94-94cb-83a4d5206e28 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:30.382842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb365da-0f99-4a94-94cb-83a4d5206e28 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:30.383940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb365da-0f99-4a94-94cb-83a4d5206e28 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:30.384899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb365da-0f99-4a94-94cb-83a4d5206e28 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:30.385611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb365da-0f99-4a94-94cb-83a4d5206e28 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:30.387749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb365da-0f99-4a94-94cb-83a4d5206e28 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:30.456834 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2169/4407] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:29:30.459396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f201460-0cc6-495f-9359-67db54db8f79 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:30.462569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f201460-0cc6-495f-9359-67db54db8f79 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:30.463106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f201460-0cc6-495f-9359-67db54db8f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:30.536975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0f201460-0cc6-495f-9359-67db54db8f79 None None] MFA Rules not processed for user `b9e1e7bf96f14aa69aafb39fd9caed59`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:30.541306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0f201460-0cc6-495f-9359-67db54db8f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:30.555379 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2239/4408] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:29:30 2022] POST /identity/v3/users => generated 321 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:30.556798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb365da-0f99-4a94-94cb-83a4d5206e28 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:30.576015 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2170/4409] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:30.588690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb365da-0f99-4a94-94cb-83a4d5206e28 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:30.603243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27187083-9e61-4a7f-bbef-d5d5e1a74684 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:30.604184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27187083-9e61-4a7f-bbef-d5d5e1a74684 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:30.604610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27187083-9e61-4a7f-bbef-d5d5e1a74684 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:30.604916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27187083-9e61-4a7f-bbef-d5d5e1a74684 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/df692132f6c543269a4f7d9131250599/users/d0b1fb19a74541369cc5de3402808dba` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:30.651014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27187083-9e61-4a7f-bbef-d5d5e1a74684 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=df692132f6c543269a4f7d9131250599, user_id=d0b1fb19a74541369cc5de3402808dba)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:30.652181 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-27187083-9e61-4a7f-bbef-d5d5e1a74684 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:29:30.652181 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:29:30.652181 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:29:30.653450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27187083-9e61-4a7f-bbef-d5d5e1a74684 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:30.816864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f201460-0cc6-495f-9359-67db54db8f79 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:30.816864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0f201460-0cc6-495f-9359-67db54db8f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:30.817332 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2240/4410] 10.222.0.43 () {60 vars in 1359 bytes} [Tue Jul 19 14:29:30 2022] PUT /identity/v3/groups/df692132f6c543269a4f7d9131250599/users/d0b1fb19a74541369cc5de3402808dba => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:30.818425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27187083-9e61-4a7f-bbef-d5d5e1a74684 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:30.913545 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:30.963985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f201460-0cc6-495f-9359-67db54db8f79 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:30.996576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27187083-9e61-4a7f-bbef-d5d5e1a74684 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:31.011595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68347bb8-c5ea-4f33-b96a-21129db2ef7d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:31.012882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68347bb8-c5ea-4f33-b96a-21129db2ef7d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:31.013322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68347bb8-c5ea-4f33-b96a-21129db2ef7d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:31.013762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68347bb8-c5ea-4f33-b96a-21129db2ef7d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:31.014685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68347bb8-c5ea-4f33-b96a-21129db2ef7d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:31.020596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68347bb8-c5ea-4f33-b96a-21129db2ef7d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:31.136057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73052eb4-6737-4b25-924d-f6e6469d2f24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:31.138360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73052eb4-6737-4b25-924d-f6e6469d2f24 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:31.138815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73052eb4-6737-4b25-924d-f6e6469d2f24 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:31.139200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73052eb4-6737-4b25-924d-f6e6469d2f24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:31.144858 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2241/4411] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:29:30 2022] POST /identity/v3/users => generated 323 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:31.149922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68347bb8-c5ea-4f33-b96a-21129db2ef7d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:31.175902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68347bb8-c5ea-4f33-b96a-21129db2ef7d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:31.190458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722407ef-436e-42f5-b10d-3f12c5d43786 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:31.192269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722407ef-436e-42f5-b10d-3f12c5d43786 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:31.195557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722407ef-436e-42f5-b10d-3f12c5d43786 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:31.195557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722407ef-436e-42f5-b10d-3f12c5d43786 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/df692132f6c543269a4f7d9131250599/users/f23b0fbd3f3a4151abeba8f68e574240` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:31.238618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722407ef-436e-42f5-b10d-3f12c5d43786 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=df692132f6c543269a4f7d9131250599, user_id=f23b0fbd3f3a4151abeba8f68e574240)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:31.241156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722407ef-436e-42f5-b10d-3f12c5d43786 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:31.300084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73052eb4-6737-4b25-924d-f6e6469d2f24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:31.301914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73052eb4-6737-4b25-924d-f6e6469d2f24 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:31.340000 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2171/4412] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:29:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:29:31.400737 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2242/4413] 10.222.0.43 () {60 vars in 1359 bytes} [Tue Jul 19 14:29:31 2022] PUT /identity/v3/groups/df692132f6c543269a4f7d9131250599/users/f23b0fbd3f3a4151abeba8f68e574240 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:31.405295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73052eb4-6737-4b25-924d-f6e6469d2f24 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:31.430658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73052eb4-6737-4b25-924d-f6e6469d2f24 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:31.545237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f590c7a-9759-48e1-b6fd-21b77b8d8503 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:31.546241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f590c7a-9759-48e1-b6fd-21b77b8d8503 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:31.546634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f590c7a-9759-48e1-b6fd-21b77b8d8503 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:31.547237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f590c7a-9759-48e1-b6fd-21b77b8d8503 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:31.549045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f590c7a-9759-48e1-b6fd-21b77b8d8503 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:31.552348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f590c7a-9759-48e1-b6fd-21b77b8d8503 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:31.671435 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2172/4414] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:29:31 2022] POST /identity/v3/users => generated 321 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:31.672573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722407ef-436e-42f5-b10d-3f12c5d43786 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:31.688840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722407ef-436e-42f5-b10d-3f12c5d43786 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:31.705653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5893a5-237f-487f-9b06-d79df03a7166 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:31.706615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5893a5-237f-487f-9b06-d79df03a7166 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:31.706907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5893a5-237f-487f-9b06-d79df03a7166 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:31.707191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5893a5-237f-487f-9b06-d79df03a7166 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/df692132f6c543269a4f7d9131250599/users/f94adc1699d24ca69248c435af707600` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:31.749526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5893a5-237f-487f-9b06-d79df03a7166 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=df692132f6c543269a4f7d9131250599, user_id=f94adc1699d24ca69248c435af707600)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:31.752151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5893a5-237f-487f-9b06-d79df03a7166 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:31.901890 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2243/4415] 10.222.0.43 () {60 vars in 1359 bytes} [Tue Jul 19 14:29:31 2022] PUT /identity/v3/groups/df692132f6c543269a4f7d9131250599/users/f94adc1699d24ca69248c435af707600 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:31.903458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f590c7a-9759-48e1-b6fd-21b77b8d8503 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:31.922165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f590c7a-9759-48e1-b6fd-21b77b8d8503 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:31.976846 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:32.087930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a3570-9ffe-4576-9069-660741cf6bdf tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:32.089339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a3570-9ffe-4576-9069-660741cf6bdf tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:32.090184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a3570-9ffe-4576-9069-660741cf6bdf tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:32.090806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a3570-9ffe-4576-9069-660741cf6bdf tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/df692132f6c543269a4f7d9131250599/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:32.092880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a3570-9ffe-4576-9069-660741cf6bdf tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=df692132f6c543269a4f7d9131250599)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:32.099630 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-b28a3570-9ffe-4576-9069-660741cf6bdf tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:29:32.099630 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:29:32.099630 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:29:32.101131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a3570-9ffe-4576-9069-660741cf6bdf tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:32.165563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5893a5-237f-487f-9b06-d79df03a7166 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:32.180426 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2173/4416] 10.222.0.43 () {58 vars in 1241 bytes} [Tue Jul 19 14:29:31 2022] GET /identity/v3/groups/df692132f6c543269a4f7d9131250599/users => generated 1081 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:29:32.188927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5893a5-237f-487f-9b06-d79df03a7166 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:32.199200 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:32.227405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced99b0-1696-47bc-abd7-ff2ea6166eaf tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:32.228591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced99b0-1696-47bc-abd7-ff2ea6166eaf tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:32.228889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced99b0-1696-47bc-abd7-ff2ea6166eaf tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:32.229178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced99b0-1696-47bc-abd7-ff2ea6166eaf tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/df692132f6c543269a4f7d9131250599/users/d0b1fb19a74541369cc5de3402808dba` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:32.237884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced99b0-1696-47bc-abd7-ff2ea6166eaf tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=df692132f6c543269a4f7d9131250599, user_id=d0b1fb19a74541369cc5de3402808dba)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:32.239041 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-2ced99b0-1696-47bc-abd7-ff2ea6166eaf tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:29:32.239041 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:29:32.239041 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:29:32.276330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced99b0-1696-47bc-abd7-ff2ea6166eaf tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:32.308540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a3570-9ffe-4576-9069-660741cf6bdf tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:32.310831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b28a3570-9ffe-4576-9069-660741cf6bdf tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:32.418841 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2244/4417] 10.222.0.43 () {58 vars in 1341 bytes} [Tue Jul 19 14:29:32 2022] HEAD /identity/v3/groups/df692132f6c543269a4f7d9131250599/users/d0b1fb19a74541369cc5de3402808dba => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:32.418841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced99b0-1696-47bc-abd7-ff2ea6166eaf tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:32.439007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced99b0-1696-47bc-abd7-ff2ea6166eaf tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:32.447807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff112b-22bd-4b84-ba06-e1d102b02191 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:32.448904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff112b-22bd-4b84-ba06-e1d102b02191 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:32.449837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff112b-22bd-4b84-ba06-e1d102b02191 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:32.450181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff112b-22bd-4b84-ba06-e1d102b02191 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/df692132f6c543269a4f7d9131250599/users/d0b1fb19a74541369cc5de3402808dba` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:32.456629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff112b-22bd-4b84-ba06-e1d102b02191 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=df692132f6c543269a4f7d9131250599, user_id=d0b1fb19a74541369cc5de3402808dba)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:32.458575 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-a3ff112b-22bd-4b84-ba06-e1d102b02191 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:29:32.458575 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:29:32.458575 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:29:32.460039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff112b-22bd-4b84-ba06-e1d102b02191 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:32.488600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a3570-9ffe-4576-9069-660741cf6bdf tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:32.499746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde0c77-120c-4ee6-94c8-98be16fee23c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:32.500504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde0c77-120c-4ee6-94c8-98be16fee23c service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:32.500819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde0c77-120c-4ee6-94c8-98be16fee23c service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:32.501133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddde0c77-120c-4ee6-94c8-98be16fee23c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:32.506001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ddde0c77-120c-4ee6-94c8-98be16fee23c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:32.532122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde0c77-120c-4ee6-94c8-98be16fee23c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:32.534708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddde0c77-120c-4ee6-94c8-98be16fee23c service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:32.562782 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2174/4418] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:29:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:29:32.565521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde0c77-120c-4ee6-94c8-98be16fee23c service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:32.570779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ddde0c77-120c-4ee6-94c8-98be16fee23c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:32.660942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a3ff112b-22bd-4b84-ba06-e1d102b02191 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd0b1fb19a74541369cc5de3402808dba'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:32.704491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddde0c77-120c-4ee6-94c8-98be16fee23c service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:32.710428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d01e0-1afa-4b15-bf41-f06118882f8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:32.711564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d01e0-1afa-4b15-bf41-f06118882f8e service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:32.712039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d01e0-1afa-4b15-bf41-f06118882f8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:32.712477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d01e0-1afa-4b15-bf41-f06118882f8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:32.714737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f93d01e0-1afa-4b15-bf41-f06118882f8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:32.731195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d01e0-1afa-4b15-bf41-f06118882f8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:32.734147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d01e0-1afa-4b15-bf41-f06118882f8e service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:32.753360 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2175/4419] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:29:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:29:32.778813 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2245/4420] 10.222.0.43 () {58 vars in 1343 bytes} [Tue Jul 19 14:29:32 2022] DELETE /identity/v3/groups/df692132f6c543269a4f7d9131250599/users/d0b1fb19a74541369cc5de3402808dba => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:32.783832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d01e0-1afa-4b15-bf41-f06118882f8e service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:32.809611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d01e0-1afa-4b15-bf41-f06118882f8e service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:32.946519 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:32.985171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35924e9-c7af-463c-8d3c-16fa793a98b1 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:32.989222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35924e9-c7af-463c-8d3c-16fa793a98b1 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:32.991789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35924e9-c7af-463c-8d3c-16fa793a98b1 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:32.991789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35924e9-c7af-463c-8d3c-16fa793a98b1 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/df692132f6c543269a4f7d9131250599/users/f23b0fbd3f3a4151abeba8f68e574240` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:32.997125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35924e9-c7af-463c-8d3c-16fa793a98b1 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=df692132f6c543269a4f7d9131250599, user_id=f23b0fbd3f3a4151abeba8f68e574240)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:33.000645 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-e35924e9-c7af-463c-8d3c-16fa793a98b1 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:29:33.000645 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:29:33.000645 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:29:33.002188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35924e9-c7af-463c-8d3c-16fa793a98b1 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:33.047084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff112b-22bd-4b84-ba06-e1d102b02191 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:33.047592 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2176/4421] 10.222.0.43 () {58 vars in 1341 bytes} [Tue Jul 19 14:29:32 2022] HEAD /identity/v3/groups/df692132f6c543269a4f7d9131250599/users/f23b0fbd3f3a4151abeba8f68e574240 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:33.063818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff112b-22bd-4b84-ba06-e1d102b02191 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:33.081555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbb308-493c-4de1-93f8-ac6aa3ba44ae tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:33.082642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbb308-493c-4de1-93f8-ac6aa3ba44ae tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:33.083010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbb308-493c-4de1-93f8-ac6aa3ba44ae tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:33.083370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dbb308-493c-4de1-93f8-ac6aa3ba44ae tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/df692132f6c543269a4f7d9131250599/users/f23b0fbd3f3a4151abeba8f68e574240` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:33.085656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dbb308-493c-4de1-93f8-ac6aa3ba44ae tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=df692132f6c543269a4f7d9131250599, user_id=f23b0fbd3f3a4151abeba8f68e574240)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:33.092159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dbb308-493c-4de1-93f8-ac6aa3ba44ae tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:33.248853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d4dbb308-493c-4de1-93f8-ac6aa3ba44ae tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f23b0fbd3f3a4151abeba8f68e574240'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:33.344369 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2246/4422] 10.222.0.43 () {58 vars in 1343 bytes} [Tue Jul 19 14:29:33 2022] DELETE /identity/v3/groups/df692132f6c543269a4f7d9131250599/users/f23b0fbd3f3a4151abeba8f68e574240 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:33.349622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35924e9-c7af-463c-8d3c-16fa793a98b1 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:33.366939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35924e9-c7af-463c-8d3c-16fa793a98b1 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:33.544019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623149cb-dde3-4178-8279-7363e6795efb tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:33.545618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623149cb-dde3-4178-8279-7363e6795efb tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:33.548462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623149cb-dde3-4178-8279-7363e6795efb tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:33.549023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623149cb-dde3-4178-8279-7363e6795efb tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/df692132f6c543269a4f7d9131250599/users/f94adc1699d24ca69248c435af707600` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:33.553684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623149cb-dde3-4178-8279-7363e6795efb tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=df692132f6c543269a4f7d9131250599, user_id=f94adc1699d24ca69248c435af707600)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:33.563719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623149cb-dde3-4178-8279-7363e6795efb tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:33.611111 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2177/4423] 10.222.0.43 () {58 vars in 1341 bytes} [Tue Jul 19 14:29:33 2022] HEAD /identity/v3/groups/df692132f6c543269a4f7d9131250599/users/f94adc1699d24ca69248c435af707600 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:33.615599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbb308-493c-4de1-93f8-ac6aa3ba44ae tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:33.644103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dbb308-493c-4de1-93f8-ac6aa3ba44ae tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:33.683246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380a4d8-be57-44eb-861d-17d5f07f3b53 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:33.685556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380a4d8-be57-44eb-861d-17d5f07f3b53 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:33.686025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380a4d8-be57-44eb-861d-17d5f07f3b53 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:33.686477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380a4d8-be57-44eb-861d-17d5f07f3b53 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/df692132f6c543269a4f7d9131250599/users/f94adc1699d24ca69248c435af707600` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:33.689131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380a4d8-be57-44eb-861d-17d5f07f3b53 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=df692132f6c543269a4f7d9131250599, user_id=f94adc1699d24ca69248c435af707600)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:33.693189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380a4d8-be57-44eb-861d-17d5f07f3b53 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:33.803983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1380a4d8-be57-44eb-861d-17d5f07f3b53 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f94adc1699d24ca69248c435af707600'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:33.908531 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2247/4424] 10.222.0.43 () {58 vars in 1343 bytes} [Tue Jul 19 14:29:33 2022] DELETE /identity/v3/groups/df692132f6c543269a4f7d9131250599/users/f94adc1699d24ca69248c435af707600 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:33.912997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623149cb-dde3-4178-8279-7363e6795efb tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:33.934329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623149cb-dde3-4178-8279-7363e6795efb tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:34.214490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f9b1a-4ba9-4485-a13e-4c5a9b288977 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:34.215280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f9b1a-4ba9-4485-a13e-4c5a9b288977 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:34.215570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f9b1a-4ba9-4485-a13e-4c5a9b288977 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:34.217361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f9b1a-4ba9-4485-a13e-4c5a9b288977 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/df692132f6c543269a4f7d9131250599/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:34.220543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f9b1a-4ba9-4485-a13e-4c5a9b288977 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=df692132f6c543269a4f7d9131250599)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:34.223435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f9b1a-4ba9-4485-a13e-4c5a9b288977 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:34.265906 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2178/4425] 10.222.0.43 () {58 vars in 1241 bytes} [Tue Jul 19 14:29:33 2022] GET /identity/v3/groups/df692132f6c543269a4f7d9131250599/users => generated 145 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:29:34.269074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380a4d8-be57-44eb-861d-17d5f07f3b53 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:34.293848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380a4d8-be57-44eb-861d-17d5f07f3b53 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:34.311520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75846bd3-bcee-4741-a6ad-25cf4356f125 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:34.312703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75846bd3-bcee-4741-a6ad-25cf4356f125 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:34.319575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75846bd3-bcee-4741-a6ad-25cf4356f125 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:34.319575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75846bd3-bcee-4741-a6ad-25cf4356f125 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/users/f94adc1699d24ca69248c435af707600` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:34.319575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75846bd3-bcee-4741-a6ad-25cf4356f125 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f94adc1699d24ca69248c435af707600)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:34.335792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75846bd3-bcee-4741-a6ad-25cf4356f125 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:34.547714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-75846bd3-bcee-4741-a6ad-25cf4356f125 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f94adc1699d24ca69248c435af707600'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:34.594631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-75846bd3-bcee-4741-a6ad-25cf4356f125 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f94adc1699d24ca69248c435af707600'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:34.616712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-75846bd3-bcee-4741-a6ad-25cf4356f125 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f94adc1699d24ca69248c435af707600'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:34.618454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-75846bd3-bcee-4741-a6ad-25cf4356f125 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f94adc1699d24ca69248c435af707600'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:34.696658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-75846bd3-bcee-4741-a6ad-25cf4356f125 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f94adc1699d24ca69248c435af707600'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:34.715277 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2248/4426] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:29:34 2022] DELETE /identity/v3/users/f94adc1699d24ca69248c435af707600 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:34.716316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f9b1a-4ba9-4485-a13e-4c5a9b288977 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:34.718132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-851f9b1a-4ba9-4485-a13e-4c5a9b288977 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:34.752014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f9b1a-4ba9-4485-a13e-4c5a9b288977 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:34.946380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb449e7-a6e7-4148-b6f5-b2c523ca8d82 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:34.947389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb449e7-a6e7-4148-b6f5-b2c523ca8d82 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:34.947680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb449e7-a6e7-4148-b6f5-b2c523ca8d82 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:34.947962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb449e7-a6e7-4148-b6f5-b2c523ca8d82 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/users/f23b0fbd3f3a4151abeba8f68e574240` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:34.951813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb449e7-a6e7-4148-b6f5-b2c523ca8d82 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f23b0fbd3f3a4151abeba8f68e574240)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:34.957086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb449e7-a6e7-4148-b6f5-b2c523ca8d82 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:34.990417 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:35.192305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7fb449e7-a6e7-4148-b6f5-b2c523ca8d82 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f23b0fbd3f3a4151abeba8f68e574240'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:35.232065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7fb449e7-a6e7-4148-b6f5-b2c523ca8d82 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f23b0fbd3f3a4151abeba8f68e574240'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:35.234485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7fb449e7-a6e7-4148-b6f5-b2c523ca8d82 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f23b0fbd3f3a4151abeba8f68e574240'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:35.235551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7fb449e7-a6e7-4148-b6f5-b2c523ca8d82 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f23b0fbd3f3a4151abeba8f68e574240'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:35.256003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7fb449e7-a6e7-4148-b6f5-b2c523ca8d82 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f23b0fbd3f3a4151abeba8f68e574240'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:35.425070 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2179/4427] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:29:34 2022] DELETE /identity/v3/users/f23b0fbd3f3a4151abeba8f68e574240 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:35.429386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75846bd3-bcee-4741-a6ad-25cf4356f125 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:35.451126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75846bd3-bcee-4741-a6ad-25cf4356f125 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:35.644975 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=80,keystone:DELETE=16,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:35.668477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a77aaf-5444-4ab4-9c63-ddb09ae6a569 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:35.669390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a77aaf-5444-4ab4-9c63-ddb09ae6a569 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:35.669685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a77aaf-5444-4ab4-9c63-ddb09ae6a569 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:35.669971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a77aaf-5444-4ab4-9c63-ddb09ae6a569 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/users/d0b1fb19a74541369cc5de3402808dba` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:35.671813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a77aaf-5444-4ab4-9c63-ddb09ae6a569 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d0b1fb19a74541369cc5de3402808dba)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:35.676984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a77aaf-5444-4ab4-9c63-ddb09ae6a569 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:35.874669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b6a77aaf-5444-4ab4-9c63-ddb09ae6a569 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0b1fb19a74541369cc5de3402808dba'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:35.899380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b6a77aaf-5444-4ab4-9c63-ddb09ae6a569 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0b1fb19a74541369cc5de3402808dba'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:35.909354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b6a77aaf-5444-4ab4-9c63-ddb09ae6a569 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0b1fb19a74541369cc5de3402808dba'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:35.910964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b6a77aaf-5444-4ab4-9c63-ddb09ae6a569 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0b1fb19a74541369cc5de3402808dba'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:35.999875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b6a77aaf-5444-4ab4-9c63-ddb09ae6a569 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0b1fb19a74541369cc5de3402808dba'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:36.009863 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2249/4428] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:29:35 2022] DELETE /identity/v3/users/d0b1fb19a74541369cc5de3402808dba => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:36.014586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb449e7-a6e7-4148-b6f5-b2c523ca8d82 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:36.017317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7fb449e7-a6e7-4148-b6f5-b2c523ca8d82 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:36.034518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb449e7-a6e7-4148-b6f5-b2c523ca8d82 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:36.153997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f5259-e1c6-4aa2-bcd8-05d8973970b6 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:36.154988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f5259-e1c6-4aa2-bcd8-05d8973970b6 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:36.156910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f5259-e1c6-4aa2-bcd8-05d8973970b6 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:36.157236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067f5259-e1c6-4aa2-bcd8-05d8973970b6 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/df692132f6c543269a4f7d9131250599` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:36.158934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f5259-e1c6-4aa2-bcd8-05d8973970b6 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:delete_group(group_id=df692132f6c543269a4f7d9131250599)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:36.162290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067f5259-e1c6-4aa2-bcd8-05d8973970b6 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:36.341451 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2180/4429] 10.222.0.43 () {58 vars in 1226 bytes} [Tue Jul 19 14:29:36 2022] DELETE /identity/v3/groups/df692132f6c543269a4f7d9131250599 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:29:36.342979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a77aaf-5444-4ab4-9c63-ddb09ae6a569 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:36.344664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b6a77aaf-5444-4ab4-9c63-ddb09ae6a569 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:36.388772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a77aaf-5444-4ab4-9c63-ddb09ae6a569 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:36.561449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fbd57-649b-43d2-af9c-65e0ee30cd06 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:36.562897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fbd57-649b-43d2-af9c-65e0ee30cd06 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:36.563499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fbd57-649b-43d2-af9c-65e0ee30cd06 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:36.563989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fbd57-649b-43d2-af9c-65e0ee30cd06 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:36.565034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fbd57-649b-43d2-af9c-65e0ee30cd06 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:36.567463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fbd57-649b-43d2-af9c-65e0ee30cd06 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:36.690272 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2250/4430] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jul 19 14:29:36 2022] POST /identity/v3/groups => generated 325 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:36.694147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f5259-e1c6-4aa2-bcd8-05d8973970b6 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:36.706595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067f5259-e1c6-4aa2-bcd8-05d8973970b6 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:36.732367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197c659-1ae7-444f-9019-2d5c789cfdd8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:36.735291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197c659-1ae7-444f-9019-2d5c789cfdd8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:36.735596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197c659-1ae7-444f-9019-2d5c789cfdd8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:36.735928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a197c659-1ae7-444f-9019-2d5c789cfdd8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:36.738901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197c659-1ae7-444f-9019-2d5c789cfdd8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:36.745369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a197c659-1ae7-444f-9019-2d5c789cfdd8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:36.839564 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2181/4431] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jul 19 14:29:36 2022] POST /identity/v3/groups => generated 327 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:36.843938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fbd57-649b-43d2-af9c-65e0ee30cd06 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:36.884274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fbd57-649b-43d2-af9c-65e0ee30cd06 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:36.903242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72086755-037a-4f98-8148-f067e083689d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:36.904884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72086755-037a-4f98-8148-f067e083689d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:36.905187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72086755-037a-4f98-8148-f067e083689d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:36.906942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72086755-037a-4f98-8148-f067e083689d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:36.908371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72086755-037a-4f98-8148-f067e083689d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:36.921061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72086755-037a-4f98-8148-f067e083689d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:37.051884 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2251/4432] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jul 19 14:29:36 2022] POST /identity/v3/groups => generated 327 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:37.054624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197c659-1ae7-444f-9019-2d5c789cfdd8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:37.072392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a197c659-1ae7-444f-9019-2d5c789cfdd8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:37.087046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a057a-45a1-4af9-828e-92d573bc1d35 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:37.087829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a057a-45a1-4af9-828e-92d573bc1d35 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:37.088209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a057a-45a1-4af9-828e-92d573bc1d35 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:37.089074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a057a-45a1-4af9-828e-92d573bc1d35 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:37.091024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a057a-45a1-4af9-828e-92d573bc1d35 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:37.094291 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-4e8a057a-45a1-4af9-828e-92d573bc1d35 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:29:37.094291 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:29:37.094291 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:29:37.095575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a057a-45a1-4af9-828e-92d573bc1d35 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:37.114849 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2182/4433] 10.222.0.43 () {58 vars in 1124 bytes} [Tue Jul 19 14:29:37 2022] GET /identity/v3/groups => generated 1489 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:29:37.122901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72086755-037a-4f98-8148-f067e083689d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:37.134226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72086755-037a-4f98-8148-f067e083689d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:37.157166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e5322-b8bd-46fc-a96b-95729f6f12a8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:37.159044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e5322-b8bd-46fc-a96b-95729f6f12a8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:37.165622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e5322-b8bd-46fc-a96b-95729f6f12a8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:37.165993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e5322-b8bd-46fc-a96b-95729f6f12a8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/6cab84e0f5a14944bf53506e8bf2519f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:37.194253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e5322-b8bd-46fc-a96b-95729f6f12a8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6cab84e0f5a14944bf53506e8bf2519f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:37.199627 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-ae2e5322-b8bd-46fc-a96b-95729f6f12a8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:29:37.199627 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:29:37.199627 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:29:37.236944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e5322-b8bd-46fc-a96b-95729f6f12a8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:37.429689 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:37.436695 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2252/4434] 10.222.0.43 () {58 vars in 1226 bytes} [Tue Jul 19 14:29:37 2022] DELETE /identity/v3/groups/6cab84e0f5a14944bf53506e8bf2519f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:37.441919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a057a-45a1-4af9-828e-92d573bc1d35 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:37.462328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a057a-45a1-4af9-828e-92d573bc1d35 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:37.540839 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:37.650495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0afc6a-e7c7-412c-8066-3f596644c1ca tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:37.653307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0afc6a-e7c7-412c-8066-3f596644c1ca tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:37.653754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0afc6a-e7c7-412c-8066-3f596644c1ca tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:37.654205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0afc6a-e7c7-412c-8066-3f596644c1ca tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/e0f23847e8d04ab38f1b26b7fe092c81` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:37.663463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0afc6a-e7c7-412c-8066-3f596644c1ca tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e0f23847e8d04ab38f1b26b7fe092c81)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:37.664956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e5322-b8bd-46fc-a96b-95729f6f12a8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:37.666835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ae2e5322-b8bd-46fc-a96b-95729f6f12a8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:37.668138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0afc6a-e7c7-412c-8066-3f596644c1ca tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:37.851595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e5322-b8bd-46fc-a96b-95729f6f12a8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:37.862244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269b210-7cc0-4954-b572-40b075bb4408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:37.864247 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2183/4435] 10.222.0.43 () {58 vars in 1226 bytes} [Tue Jul 19 14:29:37 2022] DELETE /identity/v3/groups/e0f23847e8d04ab38f1b26b7fe092c81 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:37.864839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269b210-7cc0-4954-b572-40b075bb4408 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:37.865597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269b210-7cc0-4954-b572-40b075bb4408 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:37.868428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269b210-7cc0-4954-b572-40b075bb4408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:37.869278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0afc6a-e7c7-412c-8066-3f596644c1ca tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:37.871320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1269b210-7cc0-4954-b572-40b075bb4408 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:38.047172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0afc6a-e7c7-412c-8066-3f596644c1ca tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:38.052245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d772f-8bba-4e66-ad95-a63e6a2111aa tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:38.053188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d772f-8bba-4e66-ad95-a63e6a2111aa tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:38.053482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d772f-8bba-4e66-ad95-a63e6a2111aa tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:38.053771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d772f-8bba-4e66-ad95-a63e6a2111aa tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/26c039e82e294903b3a10eaca4c7bec1` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:38.066337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d772f-8bba-4e66-ad95-a63e6a2111aa tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:delete_group(group_id=26c039e82e294903b3a10eaca4c7bec1)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:38.081085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269b210-7cc0-4954-b572-40b075bb4408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:38.082584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1269b210-7cc0-4954-b572-40b075bb4408 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:38.085155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d772f-8bba-4e66-ad95-a63e6a2111aa tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:38.160901 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2253/4436] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:29:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:29:38.284977 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2184/4437] 10.222.0.43 () {58 vars in 1226 bytes} [Tue Jul 19 14:29:37 2022] DELETE /identity/v3/groups/26c039e82e294903b3a10eaca4c7bec1 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:38.289167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269b210-7cc0-4954-b572-40b075bb4408 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:38.314036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1269b210-7cc0-4954-b572-40b075bb4408 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:38.455639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52bdc5-b224-45bd-81c0-e5b6effa115d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:38.456384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52bdc5-b224-45bd-81c0-e5b6effa115d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:38.456689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52bdc5-b224-45bd-81c0-e5b6effa115d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:38.456969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d52bdc5-b224-45bd-81c0-e5b6effa115d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:38.457694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52bdc5-b224-45bd-81c0-e5b6effa115d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:38.459775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d52bdc5-b224-45bd-81c0-e5b6effa115d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:38.593989 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2254/4438] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:29:38 2022] POST /identity/v3/users => generated 323 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:38.598337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d772f-8bba-4e66-ad95-a63e6a2111aa tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:38.613324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d772f-8bba-4e66-ad95-a63e6a2111aa tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:38.638068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efd392-f35b-4ab3-9666-3cc8d21e4ce2 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:38.638801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efd392-f35b-4ab3-9666-3cc8d21e4ce2 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:38.639105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efd392-f35b-4ab3-9666-3cc8d21e4ce2 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:38.639388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4efd392-f35b-4ab3-9666-3cc8d21e4ce2 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:38.640113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efd392-f35b-4ab3-9666-3cc8d21e4ce2 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:38.642563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4efd392-f35b-4ab3-9666-3cc8d21e4ce2 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:38.732009 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2185/4439] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jul 19 14:29:38 2022] POST /identity/v3/groups => generated 326 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:29:38.733406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52bdc5-b224-45bd-81c0-e5b6effa115d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:38.753047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d52bdc5-b224-45bd-81c0-e5b6effa115d tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:38.759607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60781c04-f140-4682-a515-06ea7b4ccbc2 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:38.766567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60781c04-f140-4682-a515-06ea7b4ccbc2 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:38.767078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60781c04-f140-4682-a515-06ea7b4ccbc2 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:38.767553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60781c04-f140-4682-a515-06ea7b4ccbc2 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/abdc2814a07c46078a2d30773421c2d8/users/665ab3971f4b41dab46af9673af81321` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:38.798534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60781c04-f140-4682-a515-06ea7b4ccbc2 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=abdc2814a07c46078a2d30773421c2d8, user_id=665ab3971f4b41dab46af9673af81321)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:38.800770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60781c04-f140-4682-a515-06ea7b4ccbc2 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:38.859741 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:38.956127 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2255/4440] 10.222.0.43 () {60 vars in 1359 bytes} [Tue Jul 19 14:29:38 2022] PUT /identity/v3/groups/abdc2814a07c46078a2d30773421c2d8/users/665ab3971f4b41dab46af9673af81321 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:29:38.960337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efd392-f35b-4ab3-9666-3cc8d21e4ce2 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:38.973050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4efd392-f35b-4ab3-9666-3cc8d21e4ce2 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:39.046407 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:39.163788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4d0b8-f81b-4346-b69e-a33d9ed247e8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:39.164545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4d0b8-f81b-4346-b69e-a33d9ed247e8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:39.165043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4d0b8-f81b-4346-b69e-a33d9ed247e8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:39.165326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4d0b8-f81b-4346-b69e-a33d9ed247e8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:39.166042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4d0b8-f81b-4346-b69e-a33d9ed247e8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:39.181292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4d0b8-f81b-4346-b69e-a33d9ed247e8 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:39.362972 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2186/4441] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jul 19 14:29:38 2022] POST /identity/v3/groups => generated 324 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:29:39.363177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60781c04-f140-4682-a515-06ea7b4ccbc2 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:39.376376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60781c04-f140-4682-a515-06ea7b4ccbc2 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:39.398145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494b839-7bef-4d60-9546-f1b5e97a48ed tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:39.398145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494b839-7bef-4d60-9546-f1b5e97a48ed tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:39.398145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494b839-7bef-4d60-9546-f1b5e97a48ed tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:39.399131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494b839-7bef-4d60-9546-f1b5e97a48ed tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/281215e4fdeb424db7115340bf53c658/users/665ab3971f4b41dab46af9673af81321` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:39.409212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc4a57-de76-4321-b966-854834245cb9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:39.410121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc4a57-de76-4321-b966-854834245cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:39.410463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc4a57-de76-4321-b966-854834245cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:39.415870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494b839-7bef-4d60-9546-f1b5e97a48ed tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=281215e4fdeb424db7115340bf53c658, user_id=665ab3971f4b41dab46af9673af81321)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:39.417507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3494b839-7bef-4d60-9546-f1b5e97a48ed tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:39.449409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e1cc4a57-de76-4321-b966-854834245cb9 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:39.452750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e1cc4a57-de76-4321-b966-854834245cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:39.572022 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2256/4442] 10.222.0.43 () {60 vars in 1359 bytes} [Tue Jul 19 14:29:39 2022] PUT /identity/v3/groups/281215e4fdeb424db7115340bf53c658/users/665ab3971f4b41dab46af9673af81321 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:39.576056 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494b839-7bef-4d60-9546-f1b5e97a48ed tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:39.618391 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2187/4443] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:29:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:39.632421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc4a57-de76-4321-b966-854834245cb9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:39.633957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e1cc4a57-de76-4321-b966-854834245cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:39.784258 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494b839-7bef-4d60-9546-f1b5e97a48ed tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:39.796194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955772a-3bfe-43b6-9333-ec865e3306dd tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:39.797195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955772a-3bfe-43b6-9333-ec865e3306dd tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:39.797700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955772a-3bfe-43b6-9333-ec865e3306dd tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:39.798158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955772a-3bfe-43b6-9333-ec865e3306dd tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/users/665ab3971f4b41dab46af9673af81321/groups` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:39.802180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955772a-3bfe-43b6-9333-ec865e3306dd tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=665ab3971f4b41dab46af9673af81321)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:39.806204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955772a-3bfe-43b6-9333-ec865e3306dd tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:39.838339 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2257/4444] 10.222.0.43 () {58 vars in 1241 bytes} [Tue Jul 19 14:29:39 2022] GET /identity/v3/users/665ab3971f4b41dab46af9673af81321/groups => generated 836 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:29:40.128247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc4a57-de76-4321-b966-854834245cb9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:40.128247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3620578-dae3-40c8-ba6b-7390299bd888 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:40.128247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3620578-dae3-40c8-ba6b-7390299bd888 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:40.128247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3620578-dae3-40c8-ba6b-7390299bd888 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:40.129469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3620578-dae3-40c8-ba6b-7390299bd888 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:40.129469 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:40.129469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3620578-dae3-40c8-ba6b-7390299bd888 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:40.129469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3620578-dae3-40c8-ba6b-7390299bd888 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:40.129469 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2188/4445] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:29:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 14:29:40.130226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955772a-3bfe-43b6-9333-ec865e3306dd tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:40.136683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955772a-3bfe-43b6-9333-ec865e3306dd tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:40.154871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd3794-1295-43a8-9c57-c18296dc1975 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:40.155776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3794-1295-43a8-9c57-c18296dc1975 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:40.161737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3794-1295-43a8-9c57-c18296dc1975 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:40.161737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd3794-1295-43a8-9c57-c18296dc1975 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/281215e4fdeb424db7115340bf53c658` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:40.176140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd3794-1295-43a8-9c57-c18296dc1975 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:delete_group(group_id=281215e4fdeb424db7115340bf53c658)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:40.188157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd3794-1295-43a8-9c57-c18296dc1975 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:40.822423 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2258/4446] 10.222.0.43 () {58 vars in 1226 bytes} [Tue Jul 19 14:29:40 2022] DELETE /identity/v3/groups/281215e4fdeb424db7115340bf53c658 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:40.830385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3620578-dae3-40c8-ba6b-7390299bd888 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:40.850378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3620578-dae3-40c8-ba6b-7390299bd888 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:40.954203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb827f51-e8dc-4cf9-bbf9-b26c87638315 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:40.955100 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb827f51-e8dc-4cf9-bbf9-b26c87638315 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:40.955391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb827f51-e8dc-4cf9-bbf9-b26c87638315 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:40.955678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb827f51-e8dc-4cf9-bbf9-b26c87638315 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/groups/abdc2814a07c46078a2d30773421c2d8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:40.956971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb827f51-e8dc-4cf9-bbf9-b26c87638315 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:delete_group(group_id=abdc2814a07c46078a2d30773421c2d8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:40.960428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb827f51-e8dc-4cf9-bbf9-b26c87638315 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:41.291524 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2189/4447] 10.222.0.43 () {58 vars in 1226 bytes} [Tue Jul 19 14:29:40 2022] DELETE /identity/v3/groups/abdc2814a07c46078a2d30773421c2d8 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:41.297520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd3794-1295-43a8-9c57-c18296dc1975 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:41.316391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd3794-1295-43a8-9c57-c18296dc1975 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:41.502358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bce92-2a0a-4efa-8dbe-4ac36580398f tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:41.503525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bce92-2a0a-4efa-8dbe-4ac36580398f tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:41.503976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bce92-2a0a-4efa-8dbe-4ac36580398f tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:41.504408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bce92-2a0a-4efa-8dbe-4ac36580398f tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/users/665ab3971f4b41dab46af9673af81321` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:41.505822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bce92-2a0a-4efa-8dbe-4ac36580398f tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:delete_user(user_id=665ab3971f4b41dab46af9673af81321)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:41.508635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bce92-2a0a-4efa-8dbe-4ac36580398f tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:41.521314 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:INSERT=2,keystone:SELECT=94,keystone:DELETE=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:41.668078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-300bce92-2a0a-4efa-8dbe-4ac36580398f tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '665ab3971f4b41dab46af9673af81321'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:41.728071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-300bce92-2a0a-4efa-8dbe-4ac36580398f tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '665ab3971f4b41dab46af9673af81321'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:41.757480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-300bce92-2a0a-4efa-8dbe-4ac36580398f tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '665ab3971f4b41dab46af9673af81321'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:41.776462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-300bce92-2a0a-4efa-8dbe-4ac36580398f tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '665ab3971f4b41dab46af9673af81321'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:41.868803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-300bce92-2a0a-4efa-8dbe-4ac36580398f tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '665ab3971f4b41dab46af9673af81321'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:41.876555 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2259/4448] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:29:41 2022] DELETE /identity/v3/users/665ab3971f4b41dab46af9673af81321 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:41.883790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb827f51-e8dc-4cf9-bbf9-b26c87638315 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:41.887278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fb827f51-e8dc-4cf9-bbf9-b26c87638315 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:41.918531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb827f51-e8dc-4cf9-bbf9-b26c87638315 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:42.075362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4827e3b-9dde-4ec4-af5e-7b93901ecd86 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:42.076835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4827e3b-9dde-4ec4-af5e-7b93901ecd86 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:42.078499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4827e3b-9dde-4ec4-af5e-7b93901ecd86 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:42.079036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4827e3b-9dde-4ec4-af5e-7b93901ecd86 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/domains/688673af4dfd44f2b06c3c97f2929dc3` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:42.084025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4827e3b-9dde-4ec4-af5e-7b93901ecd86 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=688673af4dfd44f2b06c3c97f2929dc3)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:42.104522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4827e3b-9dde-4ec4-af5e-7b93901ecd86 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:42.104522 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:42.149804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c4827e3b-9dde-4ec4-af5e-7b93901ecd86 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '688673af4dfd44f2b06c3c97f2929dc3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:42.150805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c4827e3b-9dde-4ec4-af5e-7b93901ecd86 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '688673af4dfd44f2b06c3c97f2929dc3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:42.282348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c4827e3b-9dde-4ec4-af5e-7b93901ecd86 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '688673af4dfd44f2b06c3c97f2929dc3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:42.286171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c4827e3b-9dde-4ec4-af5e-7b93901ecd86 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '688673af4dfd44f2b06c3c97f2929dc3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:42.292776 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2190/4449] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:29:41 2022] PATCH /identity/v3/domains/688673af4dfd44f2b06c3c97f2929dc3 => generated 278 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:29:42.294008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bce92-2a0a-4efa-8dbe-4ac36580398f tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:42.311749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bce92-2a0a-4efa-8dbe-4ac36580398f tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:42.455121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b045acf7-b86c-459c-9260-24584ab6483c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '455597f7f879426985ea8d8af2caca95', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '055a26ef4e2445f1876a797084627e3b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:42.457561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045acf7-b86c-459c-9260-24584ab6483c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:42.457875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045acf7-b86c-459c-9260-24584ab6483c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:42.458327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b045acf7-b86c-459c-9260-24584ab6483c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] PATH_INFO: `/v3/domains/688673af4dfd44f2b06c3c97f2929dc3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:42.490870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045acf7-b86c-459c-9260-24584ab6483c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=688673af4dfd44f2b06c3c97f2929dc3)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:42.493078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b045acf7-b86c-459c-9260-24584ab6483c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:42.619586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b045acf7-b86c-459c-9260-24584ab6483c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '688673af4dfd44f2b06c3c97f2929dc3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:42.667995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b045acf7-b86c-459c-9260-24584ab6483c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '688673af4dfd44f2b06c3c97f2929dc3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:42.873555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b045acf7-b86c-459c-9260-24584ab6483c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688673af4dfd44f2b06c3c97f2929dc3', 'request_id': 'req-b045acf7-b86c-459c-9260-24584ab6483c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:42.904406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b045acf7-b86c-459c-9260-24584ab6483c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688673af4dfd44f2b06c3c97f2929dc3', 'request_id': 'req-b045acf7-b86c-459c-9260-24584ab6483c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:42.934826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b045acf7-b86c-459c-9260-24584ab6483c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688673af4dfd44f2b06c3c97f2929dc3', 'request_id': 'req-b045acf7-b86c-459c-9260-24584ab6483c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:43.049123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b045acf7-b86c-459c-9260-24584ab6483c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] The token cache is being invalidate because project 688673af4dfd44f2b06c3c97f2929dc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:29:43.049479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b045acf7-b86c-459c-9260-24584ab6483c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:43.055953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b045acf7-b86c-459c-9260-24584ab6483c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:43.076641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b045acf7-b86c-459c-9260-24584ab6483c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '688673af4dfd44f2b06c3c97f2929dc3', 'request_id': 'req-b045acf7-b86c-459c-9260-24584ab6483c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:43.079597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b045acf7-b86c-459c-9260-24584ab6483c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '688673af4dfd44f2b06c3c97f2929dc3', 'request_id': 'req-b045acf7-b86c-459c-9260-24584ab6483c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:43.082619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b045acf7-b86c-459c-9260-24584ab6483c tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '688673af4dfd44f2b06c3c97f2929dc3', 'request_id': 'req-b045acf7-b86c-459c-9260-24584ab6483c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:43.105256 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2260/4450] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:29:42 2022] DELETE /identity/v3/domains/688673af4dfd44f2b06c3c97f2929dc3 => generated 0 bytes in 812 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:43.123552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4827e3b-9dde-4ec4-af5e-7b93901ecd86 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:43.125155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c4827e3b-9dde-4ec4-af5e-7b93901ecd86 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:43.210690 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=16,keystone:SELECT=83,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:43.462696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4827e3b-9dde-4ec4-af5e-7b93901ecd86 tempest-GroupsV3TestJSON-845271777 tempest-GroupsV3TestJSON-845271777-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:43.611612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d5427-2d99-47b6-afca-a9256412e804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:43.615317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d5427-2d99-47b6-afca-a9256412e804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:43.618132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d5427-2d99-47b6-afca-a9256412e804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:43.620044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d5427-2d99-47b6-afca-a9256412e804 admin admin] PATH_INFO: `/v3/users/c8c9b5de15bc4febb3edc2e3b4f7fad6` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:43.624963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d5427-2d99-47b6-afca-a9256412e804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8c9b5de15bc4febb3edc2e3b4f7fad6)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:43.634144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19d5427-2d99-47b6-afca-a9256412e804 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:44.013366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a19d5427-2d99-47b6-afca-a9256412e804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8c9b5de15bc4febb3edc2e3b4f7fad6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:44.033456 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=8 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:44.043993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a19d5427-2d99-47b6-afca-a9256412e804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8c9b5de15bc4febb3edc2e3b4f7fad6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:44.049674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a19d5427-2d99-47b6-afca-a9256412e804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8c9b5de15bc4febb3edc2e3b4f7fad6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:44.049674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a19d5427-2d99-47b6-afca-a9256412e804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8c9b5de15bc4febb3edc2e3b4f7fad6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:44.063761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a19d5427-2d99-47b6-afca-a9256412e804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8c9b5de15bc4febb3edc2e3b4f7fad6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:44.163315 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2191/4451] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:29:43 2022] DELETE /identity/v3/users/c8c9b5de15bc4febb3edc2e3b4f7fad6 => generated 0 bytes in 1052 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:44.166209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c984ac-4741-47c7-a558-2174adcdce45 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:44.166621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c984ac-4741-47c7-a558-2174adcdce45 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:44.166833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c984ac-4741-47c7-a558-2174adcdce45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:44.230627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-72c984ac-4741-47c7-a558-2174adcdce45 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:44.242772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-72c984ac-4741-47c7-a558-2174adcdce45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:44.501934 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2261/4452] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:44.549085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d5427-2d99-47b6-afca-a9256412e804 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:44.549085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a19d5427-2d99-47b6-afca-a9256412e804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:44.787214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d5427-2d99-47b6-afca-a9256412e804 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:44.813894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc679c-7e1a-4242-9b44-899e2a48587c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:44.816079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc679c-7e1a-4242-9b44-899e2a48587c service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:44.816400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc679c-7e1a-4242-9b44-899e2a48587c service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:44.818661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc679c-7e1a-4242-9b44-899e2a48587c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:44.853038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc679c-7e1a-4242-9b44-899e2a48587c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:44.853038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc679c-7e1a-4242-9b44-899e2a48587c service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:44.894260 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2192/4453] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:29:45.432822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c984ac-4741-47c7-a558-2174adcdce45 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:45.444474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c984ac-4741-47c7-a558-2174adcdce45 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:45.470950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e981ac2-e687-47fb-a0f3-3091be0751bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:45.471757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e981ac2-e687-47fb-a0f3-3091be0751bc service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:45.472018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e981ac2-e687-47fb-a0f3-3091be0751bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:45.472303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e981ac2-e687-47fb-a0f3-3091be0751bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:45.474464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0e981ac2-e687-47fb-a0f3-3091be0751bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:45.529270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e981ac2-e687-47fb-a0f3-3091be0751bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:45.531189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e981ac2-e687-47fb-a0f3-3091be0751bc service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:45.549399 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2262/4454] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:29:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:29:46.016723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc679c-7e1a-4242-9b44-899e2a48587c service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:46.016723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c3bc679c-7e1a-4242-9b44-899e2a48587c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:46.051723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc679c-7e1a-4242-9b44-899e2a48587c service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:46.071638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c789cb9-b010-4bb2-81b8-d034a329a1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:46.072544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c789cb9-b010-4bb2-81b8-d034a329a1f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:46.072834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c789cb9-b010-4bb2-81b8-d034a329a1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:46.073120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c789cb9-b010-4bb2-81b8-d034a329a1f2 admin admin] PATH_INFO: `/v3/projects/48e6f1a95ee940b280d4ae92caa839e0` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:46.093206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c789cb9-b010-4bb2-81b8-d034a329a1f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e6f1a95ee940b280d4ae92caa839e0)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:46.097075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c789cb9-b010-4bb2-81b8-d034a329a1f2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:46.354890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c789cb9-b010-4bb2-81b8-d034a329a1f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e6f1a95ee940b280d4ae92caa839e0', 'request_id': 'req-4c789cb9-b010-4bb2-81b8-d034a329a1f2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:46.436077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c789cb9-b010-4bb2-81b8-d034a329a1f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e6f1a95ee940b280d4ae92caa839e0', 'request_id': 'req-4c789cb9-b010-4bb2-81b8-d034a329a1f2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:46.449055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c789cb9-b010-4bb2-81b8-d034a329a1f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e6f1a95ee940b280d4ae92caa839e0', 'request_id': 'req-4c789cb9-b010-4bb2-81b8-d034a329a1f2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:46.484732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c789cb9-b010-4bb2-81b8-d034a329a1f2 admin admin] The token cache is being invalidate because project 48e6f1a95ee940b280d4ae92caa839e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:29:46.485321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c789cb9-b010-4bb2-81b8-d034a329a1f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:46.486262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c789cb9-b010-4bb2-81b8-d034a329a1f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:46.489392 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2193/4455] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:29:46 2022] DELETE /identity/v3/projects/48e6f1a95ee940b280d4ae92caa839e0 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:46.494256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e981ac2-e687-47fb-a0f3-3091be0751bc service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:46.510938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e981ac2-e687-47fb-a0f3-3091be0751bc service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:46.706662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68ef91-8fd0-48b3-acf2-55026df47318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:46.707601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68ef91-8fd0-48b3-acf2-55026df47318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:46.707895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68ef91-8fd0-48b3-acf2-55026df47318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:46.708182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68ef91-8fd0-48b3-acf2-55026df47318 admin admin] PATH_INFO: `/v3/users/455597f7f879426985ea8d8af2caca95` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:46.711632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68ef91-8fd0-48b3-acf2-55026df47318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=455597f7f879426985ea8d8af2caca95)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:46.713712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68ef91-8fd0-48b3-acf2-55026df47318 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:47.013930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fe68ef91-8fd0-48b3-acf2-55026df47318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '455597f7f879426985ea8d8af2caca95'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:47.015919 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:INSERT=1,keystone:DELETE=12 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:47.058283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fe68ef91-8fd0-48b3-acf2-55026df47318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '455597f7f879426985ea8d8af2caca95'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:47.077844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fe68ef91-8fd0-48b3-acf2-55026df47318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '455597f7f879426985ea8d8af2caca95'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:47.078649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fe68ef91-8fd0-48b3-acf2-55026df47318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '455597f7f879426985ea8d8af2caca95'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:47.169559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fe68ef91-8fd0-48b3-acf2-55026df47318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '455597f7f879426985ea8d8af2caca95'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:47.183602 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2263/4456] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:29:46 2022] DELETE /identity/v3/users/455597f7f879426985ea8d8af2caca95 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:48.828369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c789cb9-b010-4bb2-81b8-d034a329a1f2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:48.830985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4c789cb9-b010-4bb2-81b8-d034a329a1f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:48.864507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c789cb9-b010-4bb2-81b8-d034a329a1f2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:48.994423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954842c8-4928-4743-b70e-2e4cb014978c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:48.995482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954842c8-4928-4743-b70e-2e4cb014978c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:48.995882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954842c8-4928-4743-b70e-2e4cb014978c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:48.996259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954842c8-4928-4743-b70e-2e4cb014978c admin admin] PATH_INFO: `/v3/projects/055a26ef4e2445f1876a797084627e3b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:49.000836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954842c8-4928-4743-b70e-2e4cb014978c admin admin] RBAC: Authorizing `identity:delete_project(project_id=055a26ef4e2445f1876a797084627e3b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:49.003039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954842c8-4928-4743-b70e-2e4cb014978c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:49.015813 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:49.154965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-954842c8-4928-4743-b70e-2e4cb014978c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '055a26ef4e2445f1876a797084627e3b', 'request_id': 'req-954842c8-4928-4743-b70e-2e4cb014978c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:49.233116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-954842c8-4928-4743-b70e-2e4cb014978c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '055a26ef4e2445f1876a797084627e3b', 'request_id': 'req-954842c8-4928-4743-b70e-2e4cb014978c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:49.242374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-954842c8-4928-4743-b70e-2e4cb014978c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '055a26ef4e2445f1876a797084627e3b', 'request_id': 'req-954842c8-4928-4743-b70e-2e4cb014978c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:49.266969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-954842c8-4928-4743-b70e-2e4cb014978c admin admin] The token cache is being invalidate because project 055a26ef4e2445f1876a797084627e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:29:49.269793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-954842c8-4928-4743-b70e-2e4cb014978c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:49.275780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-954842c8-4928-4743-b70e-2e4cb014978c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:49.283037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99092aa5-4605-4ee2-b652-0d638e268fd6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:49.284023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99092aa5-4605-4ee2-b652-0d638e268fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:49.284514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99092aa5-4605-4ee2-b652-0d638e268fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:49.286845 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2194/4457] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:29:48 2022] DELETE /identity/v3/projects/055a26ef4e2445f1876a797084627e3b => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:49.397301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-99092aa5-4605-4ee2-b652-0d638e268fd6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:49.399416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-99092aa5-4605-4ee2-b652-0d638e268fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:49.498177 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2264/4458] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:49.506203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516edd3b-66d6-4eb0-89d3-2142732b8697 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:49.506916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516edd3b-66d6-4eb0-89d3-2142732b8697 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:49.506916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516edd3b-66d6-4eb0-89d3-2142732b8697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:49.548209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-516edd3b-66d6-4eb0-89d3-2142732b8697 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:49.549671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-516edd3b-66d6-4eb0-89d3-2142732b8697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:49.572615 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2195/4459] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:49.575293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99092aa5-4605-4ee2-b652-0d638e268fd6 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:49.589839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99092aa5-4605-4ee2-b652-0d638e268fd6 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:49.599637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d752e-c1d7-494c-914d-2e07b8ac974a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:49.602751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d752e-c1d7-494c-914d-2e07b8ac974a admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:49.603051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d752e-c1d7-494c-914d-2e07b8ac974a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:49.603331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d752e-c1d7-494c-914d-2e07b8ac974a admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:49.606080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d752e-c1d7-494c-914d-2e07b8ac974a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:29:49.606421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d752e-c1d7-494c-914d-2e07b8ac974a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:49.613783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d752e-c1d7-494c-914d-2e07b8ac974a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:49.644773 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2265/4460] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:29:49.649022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516edd3b-66d6-4eb0-89d3-2142732b8697 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:49.662663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516edd3b-66d6-4eb0-89d3-2142732b8697 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:49.672019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c567559-767d-4d2a-bff9-c3276439970c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:49.672716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c567559-767d-4d2a-bff9-c3276439970c admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:49.673007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c567559-767d-4d2a-bff9-c3276439970c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:49.673324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c567559-767d-4d2a-bff9-c3276439970c admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:49.674027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c567559-767d-4d2a-bff9-c3276439970c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:49.676630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c567559-767d-4d2a-bff9-c3276439970c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:49.785802 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2196/4461] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:29:49 2022] POST /identity/v3/projects => generated 397 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:49.788225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d752e-c1d7-494c-914d-2e07b8ac974a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:49.806076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d752e-c1d7-494c-914d-2e07b8ac974a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:49.955127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec67c42-386b-409b-904c-be6c69c68557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:49.957298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec67c42-386b-409b-904c-be6c69c68557 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:49.957784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec67c42-386b-409b-904c-be6c69c68557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:49.958254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec67c42-386b-409b-904c-be6c69c68557 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:49.962752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec67c42-386b-409b-904c-be6c69c68557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:49.968967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec67c42-386b-409b-904c-be6c69c68557 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:50.130786 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2266/4462] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:29:49 2022] POST /identity/v3/users => generated 299 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:50.135808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c567559-767d-4d2a-bff9-c3276439970c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:50.151646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c567559-767d-4d2a-bff9-c3276439970c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:50.160995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd165120-442e-4373-8fbf-5705c0e3a702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:50.161688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd165120-442e-4373-8fbf-5705c0e3a702 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:50.164918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd165120-442e-4373-8fbf-5705c0e3a702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:50.165409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd165120-442e-4373-8fbf-5705c0e3a702 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:50.167670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd165120-442e-4373-8fbf-5705c0e3a702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:50.169651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd165120-442e-4373-8fbf-5705c0e3a702 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:50.191045 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2197/4463] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:29:50.193637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec67c42-386b-409b-904c-be6c69c68557 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:50.213741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec67c42-386b-409b-904c-be6c69c68557 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:50.236206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1f7a7-e200-45b8-81cf-be30e39f41e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:50.236911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1f7a7-e200-45b8-81cf-be30e39f41e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:50.237200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1f7a7-e200-45b8-81cf-be30e39f41e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:50.237493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1f7a7-e200-45b8-81cf-be30e39f41e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:50.238517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1f7a7-e200-45b8-81cf-be30e39f41e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:50.240135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1f7a7-e200-45b8-81cf-be30e39f41e8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:50.264679 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2267/4464] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:29:50.266333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd165120-442e-4373-8fbf-5705c0e3a702 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:50.287231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd165120-442e-4373-8fbf-5705c0e3a702 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:50.294509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246c489-927f-4d66-8bfa-7c711f164504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:50.295795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246c489-927f-4d66-8bfa-7c711f164504 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:50.296242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246c489-927f-4d66-8bfa-7c711f164504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:50.299297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c246c489-927f-4d66-8bfa-7c711f164504 admin admin] PATH_INFO: `/v3/projects/2aed24fd0a2649f186ab9f0448284d44/users/cd0a37b552514b8a9d0f038508d58556/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:50.335031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246c489-927f-4d66-8bfa-7c711f164504 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aed24fd0a2649f186ab9f0448284d44, user_id=cd0a37b552514b8a9d0f038508d58556, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:50.338051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c246c489-927f-4d66-8bfa-7c711f164504 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:50.442480 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2198/4465] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:29:50 2022] PUT /identity/v3/projects/2aed24fd0a2649f186ab9f0448284d44/users/cd0a37b552514b8a9d0f038508d58556/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:50.452986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753d628-8d84-40db-b536-82a41cbf9cea None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:50.453864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753d628-8d84-40db-b536-82a41cbf9cea None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:50.454326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753d628-8d84-40db-b536-82a41cbf9cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:50.477427 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:50.514430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b753d628-8d84-40db-b536-82a41cbf9cea None None] MFA Rules not processed for user `cd0a37b552514b8a9d0f038508d58556`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:50.515931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b753d628-8d84-40db-b536-82a41cbf9cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:50.652455 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2268/4466] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:50.655910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246c489-927f-4d66-8bfa-7c711f164504 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:50.791534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c246c489-927f-4d66-8bfa-7c711f164504 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:50.813499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49488104-e237-40e9-a61a-b261da018337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:50.814141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49488104-e237-40e9-a61a-b261da018337 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:50.814451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49488104-e237-40e9-a61a-b261da018337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:50.819950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49488104-e237-40e9-a61a-b261da018337 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:50.819950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49488104-e237-40e9-a61a-b261da018337 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:50.819950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49488104-e237-40e9-a61a-b261da018337 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:50.926685 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2199/4467] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:29:50 2022] POST /identity/v3/projects => generated 397 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:50.931909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753d628-8d84-40db-b536-82a41cbf9cea None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:50.947541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753d628-8d84-40db-b536-82a41cbf9cea None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:51.057298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a9652-2620-4c3a-91a1-1868d4f159e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:51.059940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a9652-2620-4c3a-91a1-1868d4f159e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:51.060969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a9652-2620-4c3a-91a1-1868d4f159e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:51.062580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a9652-2620-4c3a-91a1-1868d4f159e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:51.065077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a9652-2620-4c3a-91a1-1868d4f159e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:51.069434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a9652-2620-4c3a-91a1-1868d4f159e6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:51.175744 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2269/4468] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:29:50 2022] POST /identity/v3/users => generated 305 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:51.175887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49488104-e237-40e9-a61a-b261da018337 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:51.194644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49488104-e237-40e9-a61a-b261da018337 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:51.215320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509d92e-1436-4590-b9e2-9085feb5fd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:51.229915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509d92e-1436-4590-b9e2-9085feb5fd32 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:51.230283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509d92e-1436-4590-b9e2-9085feb5fd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:51.230617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5509d92e-1436-4590-b9e2-9085feb5fd32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:51.233555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509d92e-1436-4590-b9e2-9085feb5fd32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:51.233642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5509d92e-1436-4590-b9e2-9085feb5fd32 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:51.250168 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:51.265024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a9652-2620-4c3a-91a1-1868d4f159e6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:51.270499 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2200/4469] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:29:51.277791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a9652-2620-4c3a-91a1-1868d4f159e6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:51.294304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d04a30-523f-4d24-a491-dc8eb8d44291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:51.294304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d04a30-523f-4d24-a491-dc8eb8d44291 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:51.294304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d04a30-523f-4d24-a491-dc8eb8d44291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:51.294304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d04a30-523f-4d24-a491-dc8eb8d44291 admin admin] PATH_INFO: `/v3/projects/ce35ca36f083443c93683cbaa12abd03/users/3938c248114842ad8e9ead0ebf0018d8/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:51.334334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d04a30-523f-4d24-a491-dc8eb8d44291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce35ca36f083443c93683cbaa12abd03, user_id=3938c248114842ad8e9ead0ebf0018d8, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:51.341495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d04a30-523f-4d24-a491-dc8eb8d44291 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:51.422155 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2270/4470] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:29:51 2022] PUT /identity/v3/projects/ce35ca36f083443c93683cbaa12abd03/users/3938c248114842ad8e9ead0ebf0018d8/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:51.426177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509d92e-1436-4590-b9e2-9085feb5fd32 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:51.460697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5509d92e-1436-4590-b9e2-9085feb5fd32 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:51.635669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee1c28-81b2-4150-a7c1-3e8e70a14cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:51.636782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee1c28-81b2-4150-a7c1-3e8e70a14cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:51.637267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee1c28-81b2-4150-a7c1-3e8e70a14cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:51.637715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee1c28-81b2-4150-a7c1-3e8e70a14cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:51.638791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee1c28-81b2-4150-a7c1-3e8e70a14cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:51.640624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ee1c28-81b2-4150-a7c1-3e8e70a14cd0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:51.660090 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2201/4471] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:29:51 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:29:51.666210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d04a30-523f-4d24-a491-dc8eb8d44291 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:51.696468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d04a30-523f-4d24-a491-dc8eb8d44291 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:51.704871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4781b5f1-ee8c-4f91-9f81-dfbb09b4d993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:51.706744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781b5f1-ee8c-4f91-9f81-dfbb09b4d993 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:51.707200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781b5f1-ee8c-4f91-9f81-dfbb09b4d993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:51.707483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781b5f1-ee8c-4f91-9f81-dfbb09b4d993 admin admin] PATH_INFO: `/v3/projects/ce35ca36f083443c93683cbaa12abd03/users/3938c248114842ad8e9ead0ebf0018d8/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:51.710124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781b5f1-ee8c-4f91-9f81-dfbb09b4d993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce35ca36f083443c93683cbaa12abd03, user_id=3938c248114842ad8e9ead0ebf0018d8, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:51.714794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4781b5f1-ee8c-4f91-9f81-dfbb09b4d993 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:51.716808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e80df-7a5d-41fc-81da-9b5a4166346e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:51.717352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e80df-7a5d-41fc-81da-9b5a4166346e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:51.717834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e80df-7a5d-41fc-81da-9b5a4166346e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:51.728814 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2271/4472] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:29:51 2022] PUT /identity/v3/projects/ce35ca36f083443c93683cbaa12abd03/users/3938c248114842ad8e9ead0ebf0018d8/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:29:51.739000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f77e80df-7a5d-41fc-81da-9b5a4166346e None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:51.740561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f77e80df-7a5d-41fc-81da-9b5a4166346e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:51.743441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39d075-140c-4582-88b7-ac0f1b307dd4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:51.743441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39d075-140c-4582-88b7-ac0f1b307dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:51.743441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f39d075-140c-4582-88b7-ac0f1b307dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:51.798486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8f39d075-140c-4582-88b7-ac0f1b307dd4 None None] MFA Rules not processed for user `3938c248114842ad8e9ead0ebf0018d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:51.800095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8f39d075-140c-4582-88b7-ac0f1b307dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:51.849298 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2202/4473] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:29:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:29:51.853184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e80df-7a5d-41fc-81da-9b5a4166346e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:51.857487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f77e80df-7a5d-41fc-81da-9b5a4166346e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:51.912070 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:51.973693 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2272/4474] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:51 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:29:51.975658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39d075-140c-4582-88b7-ac0f1b307dd4 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:52.001582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e80df-7a5d-41fc-81da-9b5a4166346e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:52.019124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9062f-32d2-4bff-9840-0ea18d4bc21f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:52.020036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9062f-32d2-4bff-9840-0ea18d4bc21f service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:52.020347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9062f-32d2-4bff-9840-0ea18d4bc21f service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:52.020728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e9062f-32d2-4bff-9840-0ea18d4bc21f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:52.035390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9062f-32d2-4bff-9840-0ea18d4bc21f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:52.037374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e9062f-32d2-4bff-9840-0ea18d4bc21f service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:52.068452 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2203/4475] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:29:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:29:52.109839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f39d075-140c-4582-88b7-ac0f1b307dd4 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:52.121752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41466c77-510c-40b2-a38f-4f3933475371 tempest-ProjectsNegativeStaticTestJSON-1783025602 tempest-ProjectsNegativeStaticTestJSON-1783025602-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0a37b552514b8a9d0f038508d58556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2aed24fd0a2649f186ab9f0448284d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:52.122494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41466c77-510c-40b2-a38f-4f3933475371 tempest-ProjectsNegativeStaticTestJSON-1783025602 tempest-ProjectsNegativeStaticTestJSON-1783025602-project] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:52.122787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41466c77-510c-40b2-a38f-4f3933475371 tempest-ProjectsNegativeStaticTestJSON-1783025602 tempest-ProjectsNegativeStaticTestJSON-1783025602-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:52.123076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41466c77-510c-40b2-a38f-4f3933475371 tempest-ProjectsNegativeStaticTestJSON-1783025602 tempest-ProjectsNegativeStaticTestJSON-1783025602-project] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:52.123839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41466c77-510c-40b2-a38f-4f3933475371 tempest-ProjectsNegativeStaticTestJSON-1783025602 tempest-ProjectsNegativeStaticTestJSON-1783025602-project] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:52.134498 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-41466c77-510c-40b2-a38f-4f3933475371 tempest-ProjectsNegativeStaticTestJSON-1783025602 tempest-ProjectsNegativeStaticTestJSON-1783025602-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jul 19 14:29:52.134498 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:29:52.134498 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:29:52.134498 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:29:52.134498 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:29:52.134498 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:29:52.134498 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:29:52.134498 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:29:52.134498 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:29:52.134498 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:29:52.134498 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:29:52.134498 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:29:52.134498 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Jul 19 14:29:52.134498 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 19 14:29:52.135641 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 19 14:29:52.135641 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 19 14:29:52.135641 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 19 14:29:52.135641 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 19 14:29:52.135641 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 14:29:52.135641 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 19 14:29:52.135641 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jul 19 14:29:52.135641 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:29:52.138684 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2273/4476] 10.222.0.43 () {60 vars in 1151 bytes} [Tue Jul 19 14:29:51 2022] POST /identity/v3/projects => generated 136 bytes in 163 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:29:52.149396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9062f-32d2-4bff-9840-0ea18d4bc21f service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:52.167990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e9062f-32d2-4bff-9840-0ea18d4bc21f service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:52.178955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c5801-e824-410e-a417-9b592a5d2982 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938c248114842ad8e9ead0ebf0018d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce35ca36f083443c93683cbaa12abd03', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:52.179456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c5801-e824-410e-a417-9b592a5d2982 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:52.180185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c5801-e824-410e-a417-9b592a5d2982 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:52.180525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35c5801-e824-410e-a417-9b592a5d2982 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:52.181637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c5801-e824-410e-a417-9b592a5d2982 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:52.183708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35c5801-e824-410e-a417-9b592a5d2982 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-c35c5801-e824-410e-a417-9b592a5d2982 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] Invalid input for field 'name': '' is too short Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: Failed validating 'minLength' in schema['properties']['name']: Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: On instance['name']: Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: Failed validating 'minLength' in schema['properties']['name']: Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: On instance['name']: Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: '' Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise error Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application On instance['name']: Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application '' Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:29:52.261746 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:29:52.263243 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:29:52.263243 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:29:52.263243 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:29:52.263243 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:29:52.263243 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:29:52.263243 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:29:52.263243 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:29:52.263243 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:29:52.263243 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:29:52.263243 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:29:52.263243 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:29:52.263243 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:29:52.263243 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jul 19 14:29:52.263243 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jul 19 14:29:52.263243 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 19 14:29:52.263243 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 19 14:29:52.263243 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 19 14:29:52.264271 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 19 14:29:52.264271 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 19 14:29:52.264271 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:29:52.264271 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 19 14:29:52.264271 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 14:29:52.264271 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:29:52.264271 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application On instance['name']: Jul 19 14:29:52.264271 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application '' Jul 19 14:29:52.264271 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:29:52.264271 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2204/4477] 10.222.0.43 () {60 vars in 1151 bytes} [Tue Jul 19 14:29:52 2022] POST /identity/v3/projects => generated 283 bytes in 115 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 19 14:29:52.270383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41466c77-510c-40b2-a38f-4f3933475371 tempest-ProjectsNegativeStaticTestJSON-1783025602 tempest-ProjectsNegativeStaticTestJSON-1783025602-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:52.298846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41466c77-510c-40b2-a38f-4f3933475371 tempest-ProjectsNegativeStaticTestJSON-1783025602 tempest-ProjectsNegativeStaticTestJSON-1783025602-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:52.344823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be8c47-92f7-4c61-bc37-fe496c93e4e6 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938c248114842ad8e9ead0ebf0018d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce35ca36f083443c93683cbaa12abd03', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:52.345572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be8c47-92f7-4c61-bc37-fe496c93e4e6 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:52.345873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be8c47-92f7-4c61-bc37-fe496c93e4e6 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:52.346182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be8c47-92f7-4c61-bc37-fe496c93e4e6 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:52.346896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be8c47-92f7-4c61-bc37-fe496c93e4e6 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:52.362202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be8c47-92f7-4c61-bc37-fe496c93e4e6 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:52.398770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-28be8c47-92f7-4c61-bc37-fe496c93e4e6 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 14:29:52.398770 n-d-master-1 devstack@keystone.service[80680]: Failed validating 'maxLength' in schema['properties']['name']: Jul 19 14:29:52.398770 n-d-master-1 devstack@keystone.service[80680]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 14:29:52.398770 n-d-master-1 devstack@keystone.service[80680]: On instance['name']: Jul 19 14:29:52.398770 n-d-master-1 devstack@keystone.service[80680]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 14:29:52.398770 n-d-master-1 devstack@keystone.service[80680]: Failed validating 'maxLength' in schema['properties']['name']: Jul 19 14:29:52.398770 n-d-master-1 devstack@keystone.service[80680]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 14:29:52.398770 n-d-master-1 devstack@keystone.service[80680]: On instance['name']: Jul 19 14:29:52.398770 n-d-master-1 devstack@keystone.service[80680]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 14:29:52.398770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:29:52.398770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 19 14:29:52.398770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 19 14:29:52.398770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 14:29:52.398770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise error Jul 19 14:29:52.398770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 14:29:52.398770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:29:52.398770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 19 14:29:52.398770 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 14:29:52.400038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:29:52.400038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application On instance['name']: Jul 19 14:29:52.400038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 14:29:52.400038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:29:52.400038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:29:52.400038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:29:52.400038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:29:52.400038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:29:52.400038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:29:52.400038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:29:52.400038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:29:52.400038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:29:52.400038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:29:52.400038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:29:52.400038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:29:52.400038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:29:52.400038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:29:52.400038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jul 19 14:29:52.401243 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jul 19 14:29:52.401243 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 19 14:29:52.401243 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 19 14:29:52.401243 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 19 14:29:52.401243 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 19 14:29:52.401243 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 14:29:52.401243 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:29:52.401243 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 19 14:29:52.401243 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 14:29:52.401243 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:29:52.401243 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application On instance['name']: Jul 19 14:29:52.401243 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 14:29:52.401243 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:29:52.418001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c5801-e824-410e-a417-9b592a5d2982 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:52.439253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35c5801-e824-410e-a417-9b592a5d2982 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:52.443204 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2274/4478] 10.222.0.43 () {60 vars in 1151 bytes} [Tue Jul 19 14:29:52 2022] POST /identity/v3/projects => generated 412 bytes in 171 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 19 14:29:52.481249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf130ca-b0ba-46b7-bba2-27ba73966daf tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938c248114842ad8e9ead0ebf0018d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce35ca36f083443c93683cbaa12abd03', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:52.482556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf130ca-b0ba-46b7-bba2-27ba73966daf tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:52.483058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf130ca-b0ba-46b7-bba2-27ba73966daf tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:52.483549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf130ca-b0ba-46b7-bba2-27ba73966daf tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] PATH_INFO: `/v3/projects/7bac192a01c644a1930c678cdffe7ceb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:52.519108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf130ca-b0ba-46b7-bba2-27ba73966daf tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7bac192a01c644a1930c678cdffe7ceb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:52.521274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf130ca-b0ba-46b7-bba2-27ba73966daf tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:52.579084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-ccf130ca-b0ba-46b7-bba2-27ba73966daf tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] Could not find project: 7bac192a01c644a1930c678cdffe7ceb.: keystone.exception.ProjectNotFound: Could not find project: 7bac192a01c644a1930c678cdffe7ceb. Jul 19 14:29:52.579084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:29:52.579084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:29:52.579084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:29:52.579084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:29:52.579084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:29:52.579084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:29:52.579084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:29:52.579084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:29:52.579084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:29:52.579084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:29:52.579084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:29:52.579084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 19 14:29:52.579084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 19 14:29:52.579994 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:29:52.579994 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:29:52.579994 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 19 14:29:52.579994 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 19 14:29:52.579994 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 14:29:52.579994 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 14:29:52.579994 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 14:29:52.579994 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 14:29:52.579994 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 7bac192a01c644a1930c678cdffe7ceb. Jul 19 14:29:52.579994 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:29:52.590694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be8c47-92f7-4c61-bc37-fe496c93e4e6 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:52.591285 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2205/4479] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:29:52 2022] DELETE /identity/v3/projects/7bac192a01c644a1930c678cdffe7ceb => generated 113 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:29:52.625986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be8c47-92f7-4c61-bc37-fe496c93e4e6 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:52.653126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0ac3a-e5c6-47b1-bce7-e3284911f637 tempest-ProjectsNegativeStaticTestJSON-1783025602 tempest-ProjectsNegativeStaticTestJSON-1783025602-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cd0a37b552514b8a9d0f038508d58556', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2aed24fd0a2649f186ab9f0448284d44', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:52.653837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ac3a-e5c6-47b1-bce7-e3284911f637 tempest-ProjectsNegativeStaticTestJSON-1783025602 tempest-ProjectsNegativeStaticTestJSON-1783025602-project] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:52.654240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ac3a-e5c6-47b1-bce7-e3284911f637 tempest-ProjectsNegativeStaticTestJSON-1783025602 tempest-ProjectsNegativeStaticTestJSON-1783025602-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:52.654989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0ac3a-e5c6-47b1-bce7-e3284911f637 tempest-ProjectsNegativeStaticTestJSON-1783025602 tempest-ProjectsNegativeStaticTestJSON-1783025602-project] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:52.655197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec0ac3a-e5c6-47b1-bce7-e3284911f637 tempest-ProjectsNegativeStaticTestJSON-1783025602 tempest-ProjectsNegativeStaticTestJSON-1783025602-project] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:52.681907 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-aec0ac3a-e5c6-47b1-bce7-e3284911f637 tempest-ProjectsNegativeStaticTestJSON-1783025602 tempest-ProjectsNegativeStaticTestJSON-1783025602-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jul 19 14:29:52.681907 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:29:52.681907 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:29:52.681907 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:29:52.681907 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:29:52.681907 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:29:52.681907 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:29:52.681907 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:29:52.681907 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:29:52.681907 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:29:52.681907 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:29:52.681907 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:29:52.681907 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Jul 19 14:29:52.681907 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._list_projects() Jul 19 14:29:52.683681 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Jul 19 14:29:52.683681 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Jul 19 14:29:52.683681 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 19 14:29:52.683681 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 19 14:29:52.683681 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 19 14:29:52.683681 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 19 14:29:52.683681 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 14:29:52.683681 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 19 14:29:52.683681 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jul 19 14:29:52.683681 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:29:52.708626 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2275/4480] 10.222.0.43 () {58 vars in 1130 bytes} [Tue Jul 19 14:29:52 2022] GET /identity/v3/projects => generated 135 bytes in 118 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:29:52.709344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf130ca-b0ba-46b7-bba2-27ba73966daf tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:52.725784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf130ca-b0ba-46b7-bba2-27ba73966daf tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:52.740064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0616197-b3c0-49d6-9df8-98392208b1df tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938c248114842ad8e9ead0ebf0018d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce35ca36f083443c93683cbaa12abd03', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:52.740582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616197-b3c0-49d6-9df8-98392208b1df tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:52.740890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616197-b3c0-49d6-9df8-98392208b1df tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:52.741223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0616197-b3c0-49d6-9df8-98392208b1df tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:52.741940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0616197-b3c0-49d6-9df8-98392208b1df tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:52.745560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0616197-b3c0-49d6-9df8-98392208b1df tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:52.755932 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:52.880045 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2206/4481] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:29:52 2022] POST /identity/v3/projects => generated 358 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:29:52.884729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0ac3a-e5c6-47b1-bce7-e3284911f637 tempest-ProjectsNegativeStaticTestJSON-1783025602 tempest-ProjectsNegativeStaticTestJSON-1783025602-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:52.904743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0ac3a-e5c6-47b1-bce7-e3284911f637 tempest-ProjectsNegativeStaticTestJSON-1783025602 tempest-ProjectsNegativeStaticTestJSON-1783025602-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:53.115215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc804c-60c4-4862-af7f-d2576622575a tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938c248114842ad8e9ead0ebf0018d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce35ca36f083443c93683cbaa12abd03', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:53.115905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc804c-60c4-4862-af7f-d2576622575a tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:53.116199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc804c-60c4-4862-af7f-d2576622575a tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:53.116483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc804c-60c4-4862-af7f-d2576622575a tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:53.117717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc804c-60c4-4862-af7f-d2576622575a tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:53.119743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc804c-60c4-4862-af7f-d2576622575a tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:53.246000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.sql.core [None req-09fc804c-60c4-4862-af7f-d2576622575a tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-845494832' for key 'project.ixu_project_name_domain_id'") Jul 19 14:29:53.246000 n-d-master-1 devstack@keystone.service[80680]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 19 14:29:53.246000 n-d-master-1 devstack@keystone.service[80680]: [parameters: {'id': 'dbad7654cab041a98f214ec870fc0f99', 'name': 'tempest-project-dup-845494832', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 19 14:29:53.246000 n-d-master-1 devstack@keystone.service[80680]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80680) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 14:29:53.254610 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-09fc804c-60c4-4862-af7f-d2576622575a tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-845494832, project id dbad7654cab041a98f214ec870fc0f99.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-845494832, project id dbad7654cab041a98f214ec870fc0f99. Jul 19 14:29:53.254610 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:29:53.254610 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 14:29:53.254610 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 14:29:53.254610 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 14:29:53.254610 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 14:29:53.254610 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 14:29:53.254610 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 14:29:53.254610 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 14:29:53.254610 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application conn.query(q) Jul 19 14:29:53.254610 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 14:29:53.254610 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 14:29:53.255387 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 14:29:53.255387 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application result.read() Jul 19 14:29:53.255387 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 14:29:53.255387 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 14:29:53.255387 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 14:29:53.255387 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 14:29:53.255387 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 14:29:53.255387 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 14:29:53.255387 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 14:29:53.255387 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 14:29:53.255387 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-845494832' for key 'project.ixu_project_name_domain_id'") Jul 19 14:29:53.255387 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:29:53.255387 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 14:29:53.255387 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:29:53.255387 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:29:53.255387 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 14:29:53.255387 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 14:29:53.256308 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 19 14:29:53.256308 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 19 14:29:53.256308 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 14:29:53.256308 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application next(self.gen) Jul 19 14:29:53.256308 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 14:29:53.256308 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application yield resource Jul 19 14:29:53.256308 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 14:29:53.256308 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application next(self.gen) Jul 19 14:29:53.256308 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 14:29:53.256308 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 14:29:53.256308 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 14:29:53.256308 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 14:29:53.256308 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 14:29:53.256308 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise self.value Jul 19 14:29:53.256308 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 14:29:53.256308 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 14:29:53.256308 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 14:29:53.256308 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application session.commit() Jul 19 14:29:53.257194 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 14:29:53.257194 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 14:29:53.257194 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 14:29:53.257194 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 14:29:53.257194 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 14:29:53.257194 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.session.flush() Jul 19 14:29:53.257194 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 14:29:53.257194 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 14:29:53.257194 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 14:29:53.257194 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 14:29:53.257194 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 14:29:53.257194 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application compat.raise_( Jul 19 14:29:53.257194 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 14:29:53.257194 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception Jul 19 14:29:53.257194 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 14:29:53.257194 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 14:29:53.257194 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 14:29:53.261138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 14:29:53.261138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 14:29:53.261138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 14:29:53.261138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 14:29:53.261138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 14:29:53.261138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 19 14:29:53.261138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 19 14:29:53.261138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 14:29:53.261138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 14:29:53.261138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 14:29:53.261138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 14:29:53.261138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 14:29:53.261138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 14:29:53.261138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 14:29:53.261138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 14:29:53.261138 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 14:29:53.262038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 14:29:53.262038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 14:29:53.262038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception Jul 19 14:29:53.262038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 14:29:53.262038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 14:29:53.262038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 14:29:53.262038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 14:29:53.262038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 14:29:53.262038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 14:29:53.262038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 14:29:53.262038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application conn.query(q) Jul 19 14:29:53.262038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 14:29:53.262038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 14:29:53.262038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 14:29:53.262038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application result.read() Jul 19 14:29:53.262038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 14:29:53.262038 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 14:29:53.264572 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 14:29:53.264572 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 14:29:53.264572 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 14:29:53.264572 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 14:29:53.264572 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 14:29:53.264572 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 14:29:53.264572 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-845494832' for key 'project.ixu_project_name_domain_id'") Jul 19 14:29:53.264572 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 19 14:29:53.264572 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [parameters: {'id': 'dbad7654cab041a98f214ec870fc0f99', 'name': 'tempest-project-dup-845494832', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 19 14:29:53.264572 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 14:29:53.264572 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:29:53.264572 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:29:53.264572 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:29:53.264572 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:29:53.264572 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 19 14:29:53.265318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 19 14:29:53.265318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 14:29:53.265318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 14:29:53.265318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-845494832 at domain ID default. Jul 19 14:29:53.265318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:29:53.265318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:29:53.265318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:29:53.265318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:29:53.265318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:29:53.265318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:29:53.265318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:29:53.265318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:29:53.265318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:29:53.265318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:29:53.265318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:29:53.265318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:29:53.265318 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:29:53.267894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:29:53.267894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 19 14:29:53.267894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 19 14:29:53.267894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:29:53.267894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:29:53.267894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 19 14:29:53.267894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 19 14:29:53.267894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-845494832, project id dbad7654cab041a98f214ec870fc0f99. Jul 19 14:29:53.267894 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:29:53.268816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0616197-b3c0-49d6-9df8-98392208b1df tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:53.269213 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2276/4482] 10.222.0.43 () {60 vars in 1151 bytes} [Tue Jul 19 14:29:52 2022] POST /identity/v3/projects => generated 284 bytes in 382 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 19 14:29:53.284646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0616197-b3c0-49d6-9df8-98392208b1df tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:53.337093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1267122-0922-4365-84a0-d19b16109387 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3938c248114842ad8e9ead0ebf0018d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce35ca36f083443c93683cbaa12abd03', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:53.338010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1267122-0922-4365-84a0-d19b16109387 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:53.338334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1267122-0922-4365-84a0-d19b16109387 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:53.338624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1267122-0922-4365-84a0-d19b16109387 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] PATH_INFO: `/v3/projects/c48bba717ba041b88bf37f0f4bb9cb80` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:53.346703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1267122-0922-4365-84a0-d19b16109387 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c48bba717ba041b88bf37f0f4bb9cb80)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:53.349368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1267122-0922-4365-84a0-d19b16109387 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:53.602922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c1267122-0922-4365-84a0-d19b16109387 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48bba717ba041b88bf37f0f4bb9cb80', 'request_id': 'req-c1267122-0922-4365-84a0-d19b16109387'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:53.714764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c1267122-0922-4365-84a0-d19b16109387 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48bba717ba041b88bf37f0f4bb9cb80', 'request_id': 'req-c1267122-0922-4365-84a0-d19b16109387'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:53.734159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c1267122-0922-4365-84a0-d19b16109387 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48bba717ba041b88bf37f0f4bb9cb80', 'request_id': 'req-c1267122-0922-4365-84a0-d19b16109387'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:53.765791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c1267122-0922-4365-84a0-d19b16109387 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] The token cache is being invalidate because project c48bba717ba041b88bf37f0f4bb9cb80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:29:53.766534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c1267122-0922-4365-84a0-d19b16109387 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:53.769444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c1267122-0922-4365-84a0-d19b16109387 tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:53.780418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc804c-60c4-4862-af7f-d2576622575a tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:53.780950 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2207/4483] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:29:53 2022] DELETE /identity/v3/projects/c48bba717ba041b88bf37f0f4bb9cb80 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:53.782969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-09fc804c-60c4-4862-af7f-d2576622575a tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:54.060014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc804c-60c4-4862-af7f-d2576622575a tempest-ProjectsNegativeStaticTestJSON-1172574268 tempest-ProjectsNegativeStaticTestJSON-1172574268-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:54.069795 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:54.182689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f5ce6-2d23-42a2-bc89-7d7badf23b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:54.184602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f5ce6-2d23-42a2-bc89-7d7badf23b3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:54.185116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f5ce6-2d23-42a2-bc89-7d7badf23b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:54.185856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f5ce6-2d23-42a2-bc89-7d7badf23b3f admin admin] PATH_INFO: `/v3/users/cd0a37b552514b8a9d0f038508d58556` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:54.187999 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f5ce6-2d23-42a2-bc89-7d7badf23b3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd0a37b552514b8a9d0f038508d58556)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:54.192206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f5ce6-2d23-42a2-bc89-7d7badf23b3f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:54.464266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fc9f5ce6-2d23-42a2-bc89-7d7badf23b3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd0a37b552514b8a9d0f038508d58556'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:54.509489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fc9f5ce6-2d23-42a2-bc89-7d7badf23b3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd0a37b552514b8a9d0f038508d58556'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:54.537770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fc9f5ce6-2d23-42a2-bc89-7d7badf23b3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd0a37b552514b8a9d0f038508d58556'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:54.545092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fc9f5ce6-2d23-42a2-bc89-7d7badf23b3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd0a37b552514b8a9d0f038508d58556'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:54.682626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fc9f5ce6-2d23-42a2-bc89-7d7badf23b3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd0a37b552514b8a9d0f038508d58556'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:54.690798 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2277/4484] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:29:53 2022] DELETE /identity/v3/users/cd0a37b552514b8a9d0f038508d58556 => generated 0 bytes in 911 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:29:54.698398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff96b4-a23f-4ef8-b44b-84abe402c6ea None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:54.698849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff96b4-a23f-4ef8-b44b-84abe402c6ea None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:54.701365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faff96b4-a23f-4ef8-b44b-84abe402c6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:54.754545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-faff96b4-a23f-4ef8-b44b-84abe402c6ea None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:29:54.756811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-faff96b4-a23f-4ef8-b44b-84abe402c6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:55.009030 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2208/4485] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:29:55.141524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f5ce6-2d23-42a2-bc89-7d7badf23b3f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:55.143874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fc9f5ce6-2d23-42a2-bc89-7d7badf23b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:55.320183 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f5ce6-2d23-42a2-bc89-7d7badf23b3f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:55.339055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a748eaa-b9f4-468a-a50f-71d2fa9bdd96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:55.339826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a748eaa-b9f4-468a-a50f-71d2fa9bdd96 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:55.340167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a748eaa-b9f4-468a-a50f-71d2fa9bdd96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:55.340455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a748eaa-b9f4-468a-a50f-71d2fa9bdd96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:55.360382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a748eaa-b9f4-468a-a50f-71d2fa9bdd96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:55.361867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a748eaa-b9f4-468a-a50f-71d2fa9bdd96 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:55.388721 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2278/4486] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:29:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:29:58.700052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff96b4-a23f-4ef8-b44b-84abe402c6ea None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:58.701686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-faff96b4-a23f-4ef8-b44b-84abe402c6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:58.743648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faff96b4-a23f-4ef8-b44b-84abe402c6ea None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:58.783275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f37ce-d0c2-4bee-8b75-00466df03559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:58.786568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f37ce-d0c2-4bee-8b75-00466df03559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:58.788448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f37ce-d0c2-4bee-8b75-00466df03559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:58.790568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f37ce-d0c2-4bee-8b75-00466df03559 admin admin] PATH_INFO: `/v3/projects/2aed24fd0a2649f186ab9f0448284d44` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:58.792605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f37ce-d0c2-4bee-8b75-00466df03559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aed24fd0a2649f186ab9f0448284d44)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:58.797791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09f37ce-d0c2-4bee-8b75-00466df03559 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:58.967460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c09f37ce-d0c2-4bee-8b75-00466df03559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aed24fd0a2649f186ab9f0448284d44', 'request_id': 'req-c09f37ce-d0c2-4bee-8b75-00466df03559'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:59.049482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c09f37ce-d0c2-4bee-8b75-00466df03559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aed24fd0a2649f186ab9f0448284d44', 'request_id': 'req-c09f37ce-d0c2-4bee-8b75-00466df03559'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:59.061462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c09f37ce-d0c2-4bee-8b75-00466df03559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aed24fd0a2649f186ab9f0448284d44', 'request_id': 'req-c09f37ce-d0c2-4bee-8b75-00466df03559'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:59.066854 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:DELETE=13 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:59.086567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c09f37ce-d0c2-4bee-8b75-00466df03559 admin admin] The token cache is being invalidate because project 2aed24fd0a2649f186ab9f0448284d44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:29:59.086878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c09f37ce-d0c2-4bee-8b75-00466df03559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:59.087677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c09f37ce-d0c2-4bee-8b75-00466df03559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:59.093262 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2209/4487] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:29:58 2022] DELETE /identity/v3/projects/2aed24fd0a2649f186ab9f0448284d44 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:59.094557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a748eaa-b9f4-468a-a50f-71d2fa9bdd96 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:59.122257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a748eaa-b9f4-468a-a50f-71d2fa9bdd96 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:59.159822 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:29:59.199951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f37ce-d0c2-4bee-8b75-00466df03559 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:59.203317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c09f37ce-d0c2-4bee-8b75-00466df03559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:59.341794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc93a1-84fa-49ef-ad08-9f5429731ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:59.343823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc93a1-84fa-49ef-ad08-9f5429731ade admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:59.344141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc93a1-84fa-49ef-ad08-9f5429731ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:59.344397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc93a1-84fa-49ef-ad08-9f5429731ade admin admin] PATH_INFO: `/v3/users/3938c248114842ad8e9ead0ebf0018d8` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:59.348774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc93a1-84fa-49ef-ad08-9f5429731ade admin admin] RBAC: Authorizing `identity:delete_user(user_id=3938c248114842ad8e9ead0ebf0018d8)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:59.354377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc93a1-84fa-49ef-ad08-9f5429731ade admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:59.458473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f37ce-d0c2-4bee-8b75-00466df03559 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:59.480585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cddaa-0fd4-4c04-aeac-e0f19bd9505a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:59.481681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cddaa-0fd4-4c04-aeac-e0f19bd9505a service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:59.482289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cddaa-0fd4-4c04-aeac-e0f19bd9505a service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:59.482995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cddaa-0fd4-4c04-aeac-e0f19bd9505a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:59.485710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3d8cddaa-0fd4-4c04-aeac-e0f19bd9505a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:59.505311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8cddaa-0fd4-4c04-aeac-e0f19bd9505a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:59.507796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8cddaa-0fd4-4c04-aeac-e0f19bd9505a service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:59.557311 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2210/4488] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:29:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:29:59.560137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cddaa-0fd4-4c04-aeac-e0f19bd9505a service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:29:59.563222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3d8cddaa-0fd4-4c04-aeac-e0f19bd9505a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:29:59.630128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cddaa-0fd4-4c04-aeac-e0f19bd9505a service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:29:59.652814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631e291-66c0-4732-a647-57dbaac56b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:29:59.654422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631e291-66c0-4732-a647-57dbaac56b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:29:59.654653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631e291-66c0-4732-a647-57dbaac56b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:29:59.656384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2631e291-66c0-4732-a647-57dbaac56b9e admin admin] PATH_INFO: `/v3/users/2928d7efad6a46d7b69df9644a6480b2` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:29:59.661137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2631e291-66c0-4732-a647-57dbaac56b9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2928d7efad6a46d7b69df9644a6480b2)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:29:59.682436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2631e291-66c0-4732-a647-57dbaac56b9e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:29:59.761172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-47cc93a1-84fa-49ef-ad08-9f5429731ade admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3938c248114842ad8e9ead0ebf0018d8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:59.789875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-47cc93a1-84fa-49ef-ad08-9f5429731ade admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3938c248114842ad8e9ead0ebf0018d8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:59.798580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-47cc93a1-84fa-49ef-ad08-9f5429731ade admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3938c248114842ad8e9ead0ebf0018d8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:59.799404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-47cc93a1-84fa-49ef-ad08-9f5429731ade admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3938c248114842ad8e9ead0ebf0018d8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:59.888078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-47cc93a1-84fa-49ef-ad08-9f5429731ade admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3938c248114842ad8e9ead0ebf0018d8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:59.898617 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2279/4489] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:29:59 2022] DELETE /identity/v3/users/3938c248114842ad8e9ead0ebf0018d8 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:29:59.960154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2631e291-66c0-4732-a647-57dbaac56b9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2928d7efad6a46d7b69df9644a6480b2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:59.992479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2631e291-66c0-4732-a647-57dbaac56b9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2928d7efad6a46d7b69df9644a6480b2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:59.993242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2631e291-66c0-4732-a647-57dbaac56b9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2928d7efad6a46d7b69df9644a6480b2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:29:59.994011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2631e291-66c0-4732-a647-57dbaac56b9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2928d7efad6a46d7b69df9644a6480b2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:00.016238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2631e291-66c0-4732-a647-57dbaac56b9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2928d7efad6a46d7b69df9644a6480b2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:00.120979 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2211/4490] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:29:59 2022] DELETE /identity/v3/users/2928d7efad6a46d7b69df9644a6480b2 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:01.264605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc93a1-84fa-49ef-ad08-9f5429731ade admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:01.266076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-47cc93a1-84fa-49ef-ad08-9f5429731ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:01.326452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631e291-66c0-4732-a647-57dbaac56b9e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:01.327979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2631e291-66c0-4732-a647-57dbaac56b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:01.456719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc93a1-84fa-49ef-ad08-9f5429731ade admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:01.456928 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:01.499162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2631e291-66c0-4732-a647-57dbaac56b9e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:01.510705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe88616-7a52-4d90-8792-430921a12699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:01.513356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe88616-7a52-4d90-8792-430921a12699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:01.513828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe88616-7a52-4d90-8792-430921a12699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:01.515467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe88616-7a52-4d90-8792-430921a12699 admin admin] PATH_INFO: `/v3/projects/ce35ca36f083443c93683cbaa12abd03` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:01.525715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe88616-7a52-4d90-8792-430921a12699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce35ca36f083443c93683cbaa12abd03)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:01.531297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe88616-7a52-4d90-8792-430921a12699 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:01.616419 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:01.658293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ff6087-03c1-4647-95cd-9baa3a65b84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:01.659715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff6087-03c1-4647-95cd-9baa3a65b84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:01.664688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff6087-03c1-4647-95cd-9baa3a65b84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:01.672145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ff6087-03c1-4647-95cd-9baa3a65b84a admin admin] PATH_INFO: `/v3/projects/5d909cbc18ab4bad931205a3c3a46512` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:01.674665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff6087-03c1-4647-95cd-9baa3a65b84a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d909cbc18ab4bad931205a3c3a46512)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:01.677202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ff6087-03c1-4647-95cd-9baa3a65b84a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:01.824192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8fe88616-7a52-4d90-8792-430921a12699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce35ca36f083443c93683cbaa12abd03', 'request_id': 'req-8fe88616-7a52-4d90-8792-430921a12699'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:01.835991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d5ff6087-03c1-4647-95cd-9baa3a65b84a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d909cbc18ab4bad931205a3c3a46512', 'request_id': 'req-d5ff6087-03c1-4647-95cd-9baa3a65b84a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:01.843125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d5ff6087-03c1-4647-95cd-9baa3a65b84a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d909cbc18ab4bad931205a3c3a46512', 'request_id': 'req-d5ff6087-03c1-4647-95cd-9baa3a65b84a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:01.855511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d5ff6087-03c1-4647-95cd-9baa3a65b84a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d909cbc18ab4bad931205a3c3a46512', 'request_id': 'req-d5ff6087-03c1-4647-95cd-9baa3a65b84a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:01.919996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8fe88616-7a52-4d90-8792-430921a12699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce35ca36f083443c93683cbaa12abd03', 'request_id': 'req-8fe88616-7a52-4d90-8792-430921a12699'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:01.937976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8fe88616-7a52-4d90-8792-430921a12699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce35ca36f083443c93683cbaa12abd03', 'request_id': 'req-8fe88616-7a52-4d90-8792-430921a12699'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:01.973055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8fe88616-7a52-4d90-8792-430921a12699 admin admin] The token cache is being invalidate because project ce35ca36f083443c93683cbaa12abd03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:30:01.973525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8fe88616-7a52-4d90-8792-430921a12699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:01.974863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8fe88616-7a52-4d90-8792-430921a12699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:01.987728 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2212/4491] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:30:01 2022] DELETE /identity/v3/projects/ce35ca36f083443c93683cbaa12abd03 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:01.994297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e883e85-9a26-47a2-a9bf-0644020d630d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:01.994728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e883e85-9a26-47a2-a9bf-0644020d630d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:01.995117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e883e85-9a26-47a2-a9bf-0644020d630d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:02.039636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d5ff6087-03c1-4647-95cd-9baa3a65b84a admin admin] The token cache is being invalidate because project 5d909cbc18ab4bad931205a3c3a46512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:30:02.040789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d5ff6087-03c1-4647-95cd-9baa3a65b84a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:02.042801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d5ff6087-03c1-4647-95cd-9baa3a65b84a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:02.045905 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2280/4492] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:30:01 2022] DELETE /identity/v3/projects/5d909cbc18ab4bad931205a3c3a46512 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:02.063563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de01445-a25d-4b1b-91ad-d1d1ee8e2e0d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:02.063563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de01445-a25d-4b1b-91ad-d1d1ee8e2e0d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:02.063563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de01445-a25d-4b1b-91ad-d1d1ee8e2e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:02.103211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4e883e85-9a26-47a2-a9bf-0644020d630d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:02.106986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4e883e85-9a26-47a2-a9bf-0644020d630d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:02.135223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4de01445-a25d-4b1b-91ad-d1d1ee8e2e0d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:02.138474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4de01445-a25d-4b1b-91ad-d1d1ee8e2e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:02.337468 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2213/4493] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:02.347759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2ee50-ee2f-47b2-899a-a6ea8cd7528e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:02.348347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2ee50-ee2f-47b2-899a-a6ea8cd7528e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:02.350141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2ee50-ee2f-47b2-899a-a6ea8cd7528e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:02.396426 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2281/4494] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:02.403856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd0000-1750-4388-bbb0-633a6caac916 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:02.404147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd0000-1750-4388-bbb0-633a6caac916 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:02.404437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd0000-1750-4388-bbb0-633a6caac916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:02.417277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-dab2ee50-ee2f-47b2-899a-a6ea8cd7528e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:02.419380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-dab2ee50-ee2f-47b2-899a-a6ea8cd7528e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:02.434025 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2214/4495] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:02.448899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2ee50-ee2f-47b2-899a-a6ea8cd7528e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:02.467856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2ee50-ee2f-47b2-899a-a6ea8cd7528e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:02.484007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a95834-1712-49a7-b370-304d2558e92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:02.484647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a95834-1712-49a7-b370-304d2558e92e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:02.484931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a95834-1712-49a7-b370-304d2558e92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:02.485209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a95834-1712-49a7-b370-304d2558e92e admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:02.485952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a95834-1712-49a7-b370-304d2558e92e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:30:02.486309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a95834-1712-49a7-b370-304d2558e92e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:02.489126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-abdd0000-1750-4388-bbb0-633a6caac916 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:02.490404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-abdd0000-1750-4388-bbb0-633a6caac916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:02.500162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a95834-1712-49a7-b370-304d2558e92e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:02.526967 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2282/4496] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:02.531018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd0000-1750-4388-bbb0-633a6caac916 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:02.531476 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2215/4497] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:30:02.537753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a95834-1712-49a7-b370-304d2558e92e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:02.560465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd0000-1750-4388-bbb0-633a6caac916 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:02.564477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a95834-1712-49a7-b370-304d2558e92e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:02.569460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0158bd-1087-47e9-af29-65c8e3eed599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:02.570210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0158bd-1087-47e9-af29-65c8e3eed599 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:02.570696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0158bd-1087-47e9-af29-65c8e3eed599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:02.571058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0158bd-1087-47e9-af29-65c8e3eed599 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:02.571714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d54bdb-19e7-4ac0-9598-bcb773045caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:02.571849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0158bd-1087-47e9-af29-65c8e3eed599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:02.573633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0158bd-1087-47e9-af29-65c8e3eed599 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:02.574612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d54bdb-19e7-4ac0-9598-bcb773045caa admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:02.575257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d54bdb-19e7-4ac0-9598-bcb773045caa admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:02.575782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d54bdb-19e7-4ac0-9598-bcb773045caa admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:02.580635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d54bdb-19e7-4ac0-9598-bcb773045caa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:30:02.581508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d54bdb-19e7-4ac0-9598-bcb773045caa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:02.583392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d54bdb-19e7-4ac0-9598-bcb773045caa admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:02.628990 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2283/4498] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:30:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:30:02.633646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d54bdb-19e7-4ac0-9598-bcb773045caa admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:02.663675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d54bdb-19e7-4ac0-9598-bcb773045caa admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:02.679249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf126b6d-da3a-4709-973b-05df62021c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:02.683405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf126b6d-da3a-4709-973b-05df62021c08 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:02.684331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf126b6d-da3a-4709-973b-05df62021c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:02.686439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf126b6d-da3a-4709-973b-05df62021c08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:02.689714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf126b6d-da3a-4709-973b-05df62021c08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:02.693810 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2216/4499] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:30:02 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:30:02.694707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf126b6d-da3a-4709-973b-05df62021c08 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:02.704100 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0158bd-1087-47e9-af29-65c8e3eed599 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:02.805544 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:02.838865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0158bd-1087-47e9-af29-65c8e3eed599 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:02.859415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8863bc3-ee62-48b1-b7bb-6b408da262e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:02.860251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8863bc3-ee62-48b1-b7bb-6b408da262e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:02.860639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8863bc3-ee62-48b1-b7bb-6b408da262e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:02.861015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8863bc3-ee62-48b1-b7bb-6b408da262e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:02.861915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8863bc3-ee62-48b1-b7bb-6b408da262e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:02.864476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8863bc3-ee62-48b1-b7bb-6b408da262e0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:02.870659 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2284/4500] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:30:02 2022] POST /identity/v3/projects => generated 379 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:30:02.875153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf126b6d-da3a-4709-973b-05df62021c08 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:02.974902 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:03.026695 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2217/4501] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:30:02 2022] POST /identity/v3/users => generated 287 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:30:03.027800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8863bc3-ee62-48b1-b7bb-6b408da262e0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:03.031021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf126b6d-da3a-4709-973b-05df62021c08 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:03.042890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a22d24-39cc-4106-a999-369d328a2cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:03.043661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a22d24-39cc-4106-a999-369d328a2cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:03.044948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a22d24-39cc-4106-a999-369d328a2cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:03.045248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a22d24-39cc-4106-a999-369d328a2cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:03.045959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a22d24-39cc-4106-a999-369d328a2cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:03.063043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a22d24-39cc-4106-a999-369d328a2cf0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:03.069979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8863bc3-ee62-48b1-b7bb-6b408da262e0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:03.094202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bc84d-c65d-4627-bd75-0e5f4f93afaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:03.097914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bc84d-c65d-4627-bd75-0e5f4f93afaf admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:03.101183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bc84d-c65d-4627-bd75-0e5f4f93afaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:03.102589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67bc84d-c65d-4627-bd75-0e5f4f93afaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:03.105916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bc84d-c65d-4627-bd75-0e5f4f93afaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:03.111129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67bc84d-c65d-4627-bd75-0e5f4f93afaf admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:03.154674 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2218/4502] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:30:03.159165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bc84d-c65d-4627-bd75-0e5f4f93afaf admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:03.183522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67bc84d-c65d-4627-bd75-0e5f4f93afaf admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:03.197546 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2285/4503] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:30:02 2022] POST /identity/v3/users => generated 290 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:30:03.198222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a22d24-39cc-4106-a999-369d328a2cf0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:03.199398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490adae-8762-4aa4-a5f3-9d0cce5c0930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:03.200323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490adae-8762-4aa4-a5f3-9d0cce5c0930 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:03.200761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490adae-8762-4aa4-a5f3-9d0cce5c0930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:03.201259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490adae-8762-4aa4-a5f3-9d0cce5c0930 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:03.202382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490adae-8762-4aa4-a5f3-9d0cce5c0930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:03.204226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490adae-8762-4aa4-a5f3-9d0cce5c0930 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:03.217249 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2219/4504] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:30:03.221836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490adae-8762-4aa4-a5f3-9d0cce5c0930 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:03.234578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490adae-8762-4aa4-a5f3-9d0cce5c0930 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:03.240231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e647e1-1ace-4ec5-b1e6-2fdeb8a447fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:03.241462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e647e1-1ace-4ec5-b1e6-2fdeb8a447fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:03.244625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e647e1-1ace-4ec5-b1e6-2fdeb8a447fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:03.244625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e647e1-1ace-4ec5-b1e6-2fdeb8a447fd admin admin] PATH_INFO: `/v3/projects/dc202dd586714ff684b64d9467d08bd0/users/affb907718a140e28239cd373fa9d493/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:03.247377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a22d24-39cc-4106-a999-369d328a2cf0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:03.271842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bb390-7eb9-4e49-8cec-dbe0b23bd51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:03.274146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e647e1-1ace-4ec5-b1e6-2fdeb8a447fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc202dd586714ff684b64d9467d08bd0, user_id=affb907718a140e28239cd373fa9d493, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:03.276975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bb390-7eb9-4e49-8cec-dbe0b23bd51d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:03.279300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bb390-7eb9-4e49-8cec-dbe0b23bd51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:03.279697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bb390-7eb9-4e49-8cec-dbe0b23bd51d admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:03.280578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182bb390-7eb9-4e49-8cec-dbe0b23bd51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:03.286330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e647e1-1ace-4ec5-b1e6-2fdeb8a447fd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:03.288186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182bb390-7eb9-4e49-8cec-dbe0b23bd51d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:03.306658 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2286/4505] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:30:03.314784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bb390-7eb9-4e49-8cec-dbe0b23bd51d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:03.327131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bb390-7eb9-4e49-8cec-dbe0b23bd51d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:03.333272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2432ca-9f43-4e73-b18b-1f70d934f493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:03.334031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2432ca-9f43-4e73-b18b-1f70d934f493 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:03.334491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2432ca-9f43-4e73-b18b-1f70d934f493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:03.334877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2432ca-9f43-4e73-b18b-1f70d934f493 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:03.335721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2432ca-9f43-4e73-b18b-1f70d934f493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:03.337760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2432ca-9f43-4e73-b18b-1f70d934f493 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:03.353406 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2287/4506] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:30:03.357548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2432ca-9f43-4e73-b18b-1f70d934f493 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:03.379776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2432ca-9f43-4e73-b18b-1f70d934f493 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:03.402299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3f0b0e-fafd-4e50-81b7-9aac6953dba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:03.404396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f0b0e-fafd-4e50-81b7-9aac6953dba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:03.405092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f0b0e-fafd-4e50-81b7-9aac6953dba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:03.405595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3f0b0e-fafd-4e50-81b7-9aac6953dba0 admin admin] PATH_INFO: `/v3/projects/5435f51af9664b14b10bf10a88f0c7c5/users/e6bc3137faaf44cbb477f55fd7bd2644/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:03.408178 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2220/4507] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:30:03 2022] PUT /identity/v3/projects/dc202dd586714ff684b64d9467d08bd0/users/affb907718a140e28239cd373fa9d493/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:30:03.420395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c636e-0164-48c6-95f7-968ae2104f0c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:03.420689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c636e-0164-48c6-95f7-968ae2104f0c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:03.421175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c636e-0164-48c6-95f7-968ae2104f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:03.452093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-305c636e-0164-48c6-95f7-968ae2104f0c None None] MFA Rules not processed for user `affb907718a140e28239cd373fa9d493`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:03.453439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f0b0e-fafd-4e50-81b7-9aac6953dba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5435f51af9664b14b10bf10a88f0c7c5, user_id=e6bc3137faaf44cbb477f55fd7bd2644, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:03.453675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-305c636e-0164-48c6-95f7-968ae2104f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:03.463566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3f0b0e-fafd-4e50-81b7-9aac6953dba0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:03.579702 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2288/4508] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:30:03 2022] PUT /identity/v3/projects/5435f51af9664b14b10bf10a88f0c7c5/users/e6bc3137faaf44cbb477f55fd7bd2644/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:03.587719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dafb4e-7ec7-4864-8f9d-e3893e1bc335 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:03.588336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dafb4e-7ec7-4864-8f9d-e3893e1bc335 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:03.588826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dafb4e-7ec7-4864-8f9d-e3893e1bc335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:03.608597 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2221/4509] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:03.609653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c636e-0164-48c6-95f7-968ae2104f0c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:03.620182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c636e-0164-48c6-95f7-968ae2104f0c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:03.622893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a8dafb4e-7ec7-4864-8f9d-e3893e1bc335 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:03.624624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a8dafb4e-7ec7-4864-8f9d-e3893e1bc335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:03.684834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f68e8-ffd6-4a62-bcfa-3a15b596b72f tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'affb907718a140e28239cd373fa9d493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc202dd586714ff684b64d9467d08bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:03.685854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f68e8-ffd6-4a62-bcfa-3a15b596b72f tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:03.686188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f68e8-ffd6-4a62-bcfa-3a15b596b72f tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:03.686469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f68e8-ffd6-4a62-bcfa-3a15b596b72f tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] PATH_INFO: `/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:03.687256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f68e8-ffd6-4a62-bcfa-3a15b596b72f tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=affb907718a140e28239cd373fa9d493)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:03.688819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f68e8-ffd6-4a62-bcfa-3a15b596b72f tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:03.750134 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2289/4510] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:03.769178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dafb4e-7ec7-4864-8f9d-e3893e1bc335 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:03.770677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a8dafb4e-7ec7-4864-8f9d-e3893e1bc335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:03.822331 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2222/4511] 10.222.0.43 () {60 vars in 1298 bytes} [Tue Jul 19 14:30:03 2022] POST /identity/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2 => generated 367 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:30:03.823300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f68e8-ffd6-4a62-bcfa-3a15b596b72f tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:03.870210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f68e8-ffd6-4a62-bcfa-3a15b596b72f tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:03.874078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c5673-cf59-4051-a140-67a6501416e7 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'affb907718a140e28239cd373fa9d493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc202dd586714ff684b64d9467d08bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:03.875193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c5673-cf59-4051-a140-67a6501416e7 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:03.876006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c5673-cf59-4051-a140-67a6501416e7 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:03.876436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c5673-cf59-4051-a140-67a6501416e7 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] PATH_INFO: `/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2/805c63f4d8094482b8dbb344e4f3f8da` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:03.878902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c5673-cf59-4051-a140-67a6501416e7 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=affb907718a140e28239cd373fa9d493, credential_id=805c63f4d8094482b8dbb344e4f3f8da)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:03.880789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c5673-cf59-4051-a140-67a6501416e7 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:03.911060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dafb4e-7ec7-4864-8f9d-e3893e1bc335 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:03.920739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ae969-2943-47f8-8489-fceb3e56c52a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:03.921805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ae969-2943-47f8-8489-fceb3e56c52a service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:03.922419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ae969-2943-47f8-8489-fceb3e56c52a service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:03.923052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54ae969-2943-47f8-8489-fceb3e56c52a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:03.949259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ae969-2943-47f8-8489-fceb3e56c52a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:03.949884 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:03.954194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54ae969-2943-47f8-8489-fceb3e56c52a service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:03.956241 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2223/4512] 10.222.0.43 () {58 vars in 1379 bytes} [Tue Jul 19 14:30:03 2022] DELETE /identity/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2/805c63f4d8094482b8dbb344e4f3f8da => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:03.968347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c5673-cf59-4051-a140-67a6501416e7 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:03.987468 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2290/4513] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:30:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:30:04.009836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c5673-cf59-4051-a140-67a6501416e7 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:04.029092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b4da8-2f06-4ee4-8ae3-41c1615c4716 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'affb907718a140e28239cd373fa9d493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc202dd586714ff684b64d9467d08bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:04.031122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b4da8-2f06-4ee4-8ae3-41c1615c4716 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:04.031428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b4da8-2f06-4ee4-8ae3-41c1615c4716 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:04.031700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b4da8-2f06-4ee4-8ae3-41c1615c4716 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] PATH_INFO: `/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:04.032394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b4da8-2f06-4ee4-8ae3-41c1615c4716 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=affb907718a140e28239cd373fa9d493)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:04.038121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1b4da8-2f06-4ee4-8ae3-41c1615c4716 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:04.165785 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2224/4514] 10.222.0.43 () {60 vars in 1298 bytes} [Tue Jul 19 14:30:03 2022] POST /identity/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2 => generated 367 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:30:04.170502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ae969-2943-47f8-8489-fceb3e56c52a service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:04.187334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54ae969-2943-47f8-8489-fceb3e56c52a service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:04.201055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54f424-fb4d-48dc-97ef-fcb76cbfe582 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'affb907718a140e28239cd373fa9d493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc202dd586714ff684b64d9467d08bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:04.202182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54f424-fb4d-48dc-97ef-fcb76cbfe582 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:04.210410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54f424-fb4d-48dc-97ef-fcb76cbfe582 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:04.210410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54f424-fb4d-48dc-97ef-fcb76cbfe582 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] PATH_INFO: `/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2/b92e3125ad3e457892bae29ebd636942` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:04.214775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54f424-fb4d-48dc-97ef-fcb76cbfe582 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=affb907718a140e28239cd373fa9d493, credential_id=b92e3125ad3e457892bae29ebd636942)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:04.216332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c54f424-fb4d-48dc-97ef-fcb76cbfe582 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:04.314116 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2291/4515] 10.222.0.43 () {58 vars in 1379 bytes} [Tue Jul 19 14:30:04 2022] DELETE /identity/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2/b92e3125ad3e457892bae29ebd636942 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:04.317956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b4da8-2f06-4ee4-8ae3-41c1615c4716 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:04.337954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1b4da8-2f06-4ee4-8ae3-41c1615c4716 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:04.350844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c150a-4346-4c1e-b9a8-4a4c8de135c7 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'affb907718a140e28239cd373fa9d493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc202dd586714ff684b64d9467d08bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:04.354823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c150a-4346-4c1e-b9a8-4a4c8de135c7 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:04.356312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c150a-4346-4c1e-b9a8-4a4c8de135c7 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:04.357651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c150a-4346-4c1e-b9a8-4a4c8de135c7 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] PATH_INFO: `/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2/b92e3125ad3e457892bae29ebd636942` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:04.418927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-ce8c150a-4346-4c1e-b9a8-4a4c8de135c7 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Could not find credential: 8effd67f77cf531d8f57883a97505548e3dcecd97bb004f7e2d121db8b5b6fd4.: keystone.exception.CredentialNotFound: Could not find credential: 8effd67f77cf531d8f57883a97505548e3dcecd97bb004f7e2d121db8b5b6fd4. Jul 19 14:30:04.418927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:30:04.418927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:30:04.418927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:30:04.418927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:30:04.418927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:30:04.418927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:30:04.418927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:30:04.418927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:30:04.418927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:30:04.418927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:30:04.418927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:30:04.418927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Jul 19 14:30:04.418927 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 19 14:30:04.420447 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 19 14:30:04.420447 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 19 14:30:04.420447 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Jul 19 14:30:04.420447 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Jul 19 14:30:04.420447 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:30:04.420447 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:30:04.420447 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Jul 19 14:30:04.420447 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Jul 19 14:30:04.420447 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:30:04.420447 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:30:04.420447 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:30:04.420447 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:30:04.420447 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:30:04.420447 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 14:30:04.420447 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:30:04.420447 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:30:04.421768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:30:04.421768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:30:04.421768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:30:04.421768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:30:04.421768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:30:04.421768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:30:04.421768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Jul 19 14:30:04.421768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Jul 19 14:30:04.421768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Jul 19 14:30:04.421768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Jul 19 14:30:04.421768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Jul 19 14:30:04.421768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Jul 19 14:30:04.421768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 8effd67f77cf531d8f57883a97505548e3dcecd97bb004f7e2d121db8b5b6fd4. Jul 19 14:30:04.421768 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:30:04.421768 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2225/4516] 10.222.0.43 () {58 vars in 1376 bytes} [Tue Jul 19 14:30:04 2022] GET /identity/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2/b92e3125ad3e457892bae29ebd636942 => generated 148 bytes in 103 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 19 14:30:04.427133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54f424-fb4d-48dc-97ef-fcb76cbfe582 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:04.450006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54f424-fb4d-48dc-97ef-fcb76cbfe582 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:04.477423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9645637-d31e-46a5-8244-adbab50bcc73 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'affb907718a140e28239cd373fa9d493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc202dd586714ff684b64d9467d08bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:04.478498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9645637-d31e-46a5-8244-adbab50bcc73 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:04.480931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9645637-d31e-46a5-8244-adbab50bcc73 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:04.516702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9645637-d31e-46a5-8244-adbab50bcc73 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] PATH_INFO: `/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:04.516702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9645637-d31e-46a5-8244-adbab50bcc73 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=affb907718a140e28239cd373fa9d493)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:04.516702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9645637-d31e-46a5-8244-adbab50bcc73 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:04.516702 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:04.612591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c150a-4346-4c1e-b9a8-4a4c8de135c7 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:04.615966 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2292/4517] 10.222.0.43 () {60 vars in 1298 bytes} [Tue Jul 19 14:30:04 2022] POST /identity/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2 => generated 367 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:30:04.625846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c150a-4346-4c1e-b9a8-4a4c8de135c7 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:04.639989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d5aa7-aa31-41f8-a290-3925ce867dbe tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'affb907718a140e28239cd373fa9d493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc202dd586714ff684b64d9467d08bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:04.641955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d5aa7-aa31-41f8-a290-3925ce867dbe tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:04.642963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d5aa7-aa31-41f8-a290-3925ce867dbe tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:04.643754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991d5aa7-aa31-41f8-a290-3925ce867dbe tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] PATH_INFO: `/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:04.648650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d5aa7-aa31-41f8-a290-3925ce867dbe tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=affb907718a140e28239cd373fa9d493)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:04.650394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991d5aa7-aa31-41f8-a290-3925ce867dbe tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:04.796053 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2226/4518] 10.222.0.43 () {60 vars in 1298 bytes} [Tue Jul 19 14:30:04 2022] POST /identity/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2 => generated 367 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:30:04.800026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9645637-d31e-46a5-8244-adbab50bcc73 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:04.812003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9645637-d31e-46a5-8244-adbab50bcc73 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:04.816817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff953b-914f-4a3e-835e-4bdee1a4ba88 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'affb907718a140e28239cd373fa9d493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc202dd586714ff684b64d9467d08bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:04.818647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff953b-914f-4a3e-835e-4bdee1a4ba88 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:04.819095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff953b-914f-4a3e-835e-4bdee1a4ba88 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:04.819639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cff953b-914f-4a3e-835e-4bdee1a4ba88 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] PATH_INFO: `/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:04.821893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff953b-914f-4a3e-835e-4bdee1a4ba88 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=affb907718a140e28239cd373fa9d493)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:04.825229 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cff953b-914f-4a3e-835e-4bdee1a4ba88 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:04.849626 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2293/4519] 10.222.0.43 () {58 vars in 1277 bytes} [Tue Jul 19 14:30:04 2022] GET /identity/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2 => generated 865 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:30:04.854752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d5aa7-aa31-41f8-a290-3925ce867dbe tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:04.870942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991d5aa7-aa31-41f8-a290-3925ce867dbe tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:04.878740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da33ed3-37a7-41a1-8951-a1ddc6d28bf3 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'affb907718a140e28239cd373fa9d493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc202dd586714ff684b64d9467d08bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:04.880283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da33ed3-37a7-41a1-8951-a1ddc6d28bf3 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:04.881020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da33ed3-37a7-41a1-8951-a1ddc6d28bf3 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:04.882050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da33ed3-37a7-41a1-8951-a1ddc6d28bf3 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] PATH_INFO: `/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2/e343a8427419419980f1d05ef4cf07c8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:04.888054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da33ed3-37a7-41a1-8951-a1ddc6d28bf3 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=affb907718a140e28239cd373fa9d493, credential_id=e343a8427419419980f1d05ef4cf07c8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:04.890236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da33ed3-37a7-41a1-8951-a1ddc6d28bf3 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:05.040393 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2227/4520] 10.222.0.43 () {58 vars in 1379 bytes} [Tue Jul 19 14:30:04 2022] DELETE /identity/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2/e343a8427419419980f1d05ef4cf07c8 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:30:05.044877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff953b-914f-4a3e-835e-4bdee1a4ba88 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:05.065011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cff953b-914f-4a3e-835e-4bdee1a4ba88 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:05.070833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1df62c-0104-4bb6-9c1d-48b90f6ffb13 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'affb907718a140e28239cd373fa9d493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc202dd586714ff684b64d9467d08bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:05.071070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1df62c-0104-4bb6-9c1d-48b90f6ffb13 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:05.071407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1df62c-0104-4bb6-9c1d-48b90f6ffb13 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:05.071666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1df62c-0104-4bb6-9c1d-48b90f6ffb13 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] PATH_INFO: `/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2/66059741ec2248d1afcd761bc05af417` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:05.073772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1df62c-0104-4bb6-9c1d-48b90f6ffb13 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=affb907718a140e28239cd373fa9d493, credential_id=66059741ec2248d1afcd761bc05af417)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:05.075294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1df62c-0104-4bb6-9c1d-48b90f6ffb13 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:05.154374 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2294/4521] 10.222.0.43 () {58 vars in 1379 bytes} [Tue Jul 19 14:30:05 2022] DELETE /identity/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2/66059741ec2248d1afcd761bc05af417 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:05.159745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da33ed3-37a7-41a1-8951-a1ddc6d28bf3 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:05.173415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da33ed3-37a7-41a1-8951-a1ddc6d28bf3 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:05.186289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b6423-d510-4bf8-87b4-3b53c723ace5 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'affb907718a140e28239cd373fa9d493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc202dd586714ff684b64d9467d08bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:05.187413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b6423-d510-4bf8-87b4-3b53c723ace5 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:05.188118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b6423-d510-4bf8-87b4-3b53c723ace5 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:05.188549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b6423-d510-4bf8-87b4-3b53c723ace5 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] PATH_INFO: `/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:05.189532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b6423-d510-4bf8-87b4-3b53c723ace5 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=affb907718a140e28239cd373fa9d493)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:05.194337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b6423-d510-4bf8-87b4-3b53c723ace5 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:05.293727 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2228/4522] 10.222.0.43 () {60 vars in 1298 bytes} [Tue Jul 19 14:30:05 2022] POST /identity/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2 => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:30:05.297647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1df62c-0104-4bb6-9c1d-48b90f6ffb13 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:05.313932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1df62c-0104-4bb6-9c1d-48b90f6ffb13 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:05.325499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993bbbf-e48a-44ca-9d03-27a64ed9b638 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'affb907718a140e28239cd373fa9d493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc202dd586714ff684b64d9467d08bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:05.326915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993bbbf-e48a-44ca-9d03-27a64ed9b638 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:05.327208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993bbbf-e48a-44ca-9d03-27a64ed9b638 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:05.327706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1993bbbf-e48a-44ca-9d03-27a64ed9b638 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] PATH_INFO: `/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2/a1fe4a62a1dd4206bc193d124b1ebc36` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:05.330397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993bbbf-e48a-44ca-9d03-27a64ed9b638 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=affb907718a140e28239cd373fa9d493, credential_id=a1fe4a62a1dd4206bc193d124b1ebc36)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:05.334626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1993bbbf-e48a-44ca-9d03-27a64ed9b638 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:05.342936 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2295/4523] 10.222.0.43 () {58 vars in 1376 bytes} [Tue Jul 19 14:30:05 2022] GET /identity/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2/a1fe4a62a1dd4206bc193d124b1ebc36 => generated 367 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:30:05.354718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b6423-d510-4bf8-87b4-3b53c723ace5 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:05.385353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b6423-d510-4bf8-87b4-3b53c723ace5 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:05.386989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5518a-02b8-4431-a9fd-961e0e651647 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'affb907718a140e28239cd373fa9d493', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc202dd586714ff684b64d9467d08bd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:05.388881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5518a-02b8-4431-a9fd-961e0e651647 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:05.389356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5518a-02b8-4431-a9fd-961e0e651647 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:05.389797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5518a-02b8-4431-a9fd-961e0e651647 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] PATH_INFO: `/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2/a1fe4a62a1dd4206bc193d124b1ebc36` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:05.396403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5518a-02b8-4431-a9fd-961e0e651647 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=affb907718a140e28239cd373fa9d493, credential_id=a1fe4a62a1dd4206bc193d124b1ebc36)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:05.403930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d5518a-02b8-4431-a9fd-961e0e651647 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:05.548847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993bbbf-e48a-44ca-9d03-27a64ed9b638 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:05.552311 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2229/4524] 10.222.0.43 () {58 vars in 1379 bytes} [Tue Jul 19 14:30:05 2022] DELETE /identity/v3/users/affb907718a140e28239cd373fa9d493/credentials/OS-EC2/a1fe4a62a1dd4206bc193d124b1ebc36 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:05.577526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1993bbbf-e48a-44ca-9d03-27a64ed9b638 tempest-EC2CredentialsTest-1024010869 tempest-EC2CredentialsTest-1024010869-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:05.601170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a77f86-9079-4c87-9183-16c7907ec905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:05.609237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a77f86-9079-4c87-9183-16c7907ec905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:05.609237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a77f86-9079-4c87-9183-16c7907ec905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:05.609237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a77f86-9079-4c87-9183-16c7907ec905 admin admin] PATH_INFO: `/v3/users/affb907718a140e28239cd373fa9d493` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:05.609637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a77f86-9079-4c87-9183-16c7907ec905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=affb907718a140e28239cd373fa9d493)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:05.612671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a77f86-9079-4c87-9183-16c7907ec905 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:05.833512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-98a77f86-9079-4c87-9183-16c7907ec905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'affb907718a140e28239cd373fa9d493'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:05.861409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-98a77f86-9079-4c87-9183-16c7907ec905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'affb907718a140e28239cd373fa9d493'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:05.884202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-98a77f86-9079-4c87-9183-16c7907ec905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'affb907718a140e28239cd373fa9d493'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:05.885899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-98a77f86-9079-4c87-9183-16c7907ec905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'affb907718a140e28239cd373fa9d493'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:05.988778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-98a77f86-9079-4c87-9183-16c7907ec905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'affb907718a140e28239cd373fa9d493'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:06.000345 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2296/4525] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:30:05 2022] DELETE /identity/v3/users/affb907718a140e28239cd373fa9d493 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:06.003333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cf1e3-9d92-4a0f-ab0b-78a42b4c072e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:06.003634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cf1e3-9d92-4a0f-ab0b-78a42b4c072e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:06.003921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5cf1e3-9d92-4a0f-ab0b-78a42b4c072e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:06.037981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1e5cf1e3-9d92-4a0f-ab0b-78a42b4c072e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:06.041357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1e5cf1e3-9d92-4a0f-ab0b-78a42b4c072e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:06.245344 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2230/4526] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:06.573456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a77f86-9079-4c87-9183-16c7907ec905 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:06.575976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-98a77f86-9079-4c87-9183-16c7907ec905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:06.821407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a77f86-9079-4c87-9183-16c7907ec905 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:06.838569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1d792-cda1-49a6-a683-64f22783eae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:06.844253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1d792-cda1-49a6-a683-64f22783eae6 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:06.844661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1d792-cda1-49a6-a683-64f22783eae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:06.844960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1d792-cda1-49a6-a683-64f22783eae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:06.895757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1d792-cda1-49a6-a683-64f22783eae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:06.897513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1d792-cda1-49a6-a683-64f22783eae6 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:06.918669 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2297/4527] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:30:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:30:09.315176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cf1e3-9d92-4a0f-ab0b-78a42b4c072e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:09.321188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1e5cf1e3-9d92-4a0f-ab0b-78a42b4c072e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:09.354395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5cf1e3-9d92-4a0f-ab0b-78a42b4c072e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:09.374149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba79277-02d3-4208-bed8-1f42393c3e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:09.381379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba79277-02d3-4208-bed8-1f42393c3e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:09.388942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba79277-02d3-4208-bed8-1f42393c3e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:09.389378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba79277-02d3-4208-bed8-1f42393c3e83 admin admin] PATH_INFO: `/v3/projects/dc202dd586714ff684b64d9467d08bd0` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:09.391399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba79277-02d3-4208-bed8-1f42393c3e83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc202dd586714ff684b64d9467d08bd0)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:09.402544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba79277-02d3-4208-bed8-1f42393c3e83 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:09.696621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fba79277-02d3-4208-bed8-1f42393c3e83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc202dd586714ff684b64d9467d08bd0', 'request_id': 'req-fba79277-02d3-4208-bed8-1f42393c3e83'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:09.813870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fba79277-02d3-4208-bed8-1f42393c3e83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc202dd586714ff684b64d9467d08bd0', 'request_id': 'req-fba79277-02d3-4208-bed8-1f42393c3e83'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:09.822399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fba79277-02d3-4208-bed8-1f42393c3e83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc202dd586714ff684b64d9467d08bd0', 'request_id': 'req-fba79277-02d3-4208-bed8-1f42393c3e83'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:09.879918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fba79277-02d3-4208-bed8-1f42393c3e83 admin admin] The token cache is being invalidate because project dc202dd586714ff684b64d9467d08bd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:30:09.880374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fba79277-02d3-4208-bed8-1f42393c3e83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:09.884015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fba79277-02d3-4208-bed8-1f42393c3e83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:09.893237 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2231/4528] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:30:09 2022] DELETE /identity/v3/projects/dc202dd586714ff684b64d9467d08bd0 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:09.897901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6d222-cad2-4406-8aff-882e960071c1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:09.898962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6d222-cad2-4406-8aff-882e960071c1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:09.904565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6d222-cad2-4406-8aff-882e960071c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:09.950645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-02d6d222-cad2-4406-8aff-882e960071c1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:09.951804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-02d6d222-cad2-4406-8aff-882e960071c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:10.043752 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:INSERT=2,keystone:SELECT=87,keystone:DELETE=11 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:10.109859 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2298/4529] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:10.121214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f081757-5d03-440b-adef-a632d5f91332 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:10.121214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f081757-5d03-440b-adef-a632d5f91332 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:10.121214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f081757-5d03-440b-adef-a632d5f91332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:10.225750 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:10.269016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5f081757-5d03-440b-adef-a632d5f91332 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:10.271238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5f081757-5d03-440b-adef-a632d5f91332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:10.346953 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2232/4530] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:10.349399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6d222-cad2-4406-8aff-882e960071c1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:10.368915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6d222-cad2-4406-8aff-882e960071c1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:10.375530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37663f-92e9-46ae-9d49-ccfb73d1ced5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:10.376431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37663f-92e9-46ae-9d49-ccfb73d1ced5 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:10.376887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37663f-92e9-46ae-9d49-ccfb73d1ced5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:10.377355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb37663f-92e9-46ae-9d49-ccfb73d1ced5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:10.378297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37663f-92e9-46ae-9d49-ccfb73d1ced5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:30:10.378772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37663f-92e9-46ae-9d49-ccfb73d1ced5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:10.381278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb37663f-92e9-46ae-9d49-ccfb73d1ced5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:10.436269 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2299/4531] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:30:10.440362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f081757-5d03-440b-adef-a632d5f91332 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:10.469877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f081757-5d03-440b-adef-a632d5f91332 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:10.501490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39ae90-2800-4da2-b612-37aa8d0f5d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:10.502307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39ae90-2800-4da2-b612-37aa8d0f5d02 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:10.502633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39ae90-2800-4da2-b612-37aa8d0f5d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:10.502941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39ae90-2800-4da2-b612-37aa8d0f5d02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:10.503791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39ae90-2800-4da2-b612-37aa8d0f5d02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:10.509098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39ae90-2800-4da2-b612-37aa8d0f5d02 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:10.865335 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2233/4532] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:30:10 2022] POST /identity/v3/projects => generated 361 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:30:10.871209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37663f-92e9-46ae-9d49-ccfb73d1ced5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:10.885205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb37663f-92e9-46ae-9d49-ccfb73d1ced5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:11.021942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45529f-58ae-4a77-95e5-4f81431f9423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:11.023579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45529f-58ae-4a77-95e5-4f81431f9423 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:11.024052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45529f-58ae-4a77-95e5-4f81431f9423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:11.024477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45529f-58ae-4a77-95e5-4f81431f9423 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:11.026664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45529f-58ae-4a77-95e5-4f81431f9423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:11.035575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45529f-58ae-4a77-95e5-4f81431f9423 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:11.138351 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2300/4533] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:30:10 2022] POST /identity/v3/users => generated 281 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:30:11.142557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39ae90-2800-4da2-b612-37aa8d0f5d02 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:11.159882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39ae90-2800-4da2-b612-37aa8d0f5d02 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:11.173357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904db1b-4a41-4a63-8805-9074504d51b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:11.174360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904db1b-4a41-4a63-8805-9074504d51b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:11.174792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904db1b-4a41-4a63-8805-9074504d51b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:11.175214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904db1b-4a41-4a63-8805-9074504d51b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:11.176284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904db1b-4a41-4a63-8805-9074504d51b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:11.178043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904db1b-4a41-4a63-8805-9074504d51b7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:11.266343 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2234/4534] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:30:11.278197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45529f-58ae-4a77-95e5-4f81431f9423 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:11.306607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45529f-58ae-4a77-95e5-4f81431f9423 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:11.376997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d01b092-0000-4669-b81f-ccab85eb18dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:11.376997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01b092-0000-4669-b81f-ccab85eb18dd admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:11.376997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01b092-0000-4669-b81f-ccab85eb18dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:11.376997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d01b092-0000-4669-b81f-ccab85eb18dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:11.377778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01b092-0000-4669-b81f-ccab85eb18dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:11.377778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d01b092-0000-4669-b81f-ccab85eb18dd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:11.413261 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2301/4535] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:30:11 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:30:11.429397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904db1b-4a41-4a63-8805-9074504d51b7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:11.444969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904db1b-4a41-4a63-8805-9074504d51b7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:11.474505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd824455-4fac-4970-a58a-e23df7e38946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:11.480520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd824455-4fac-4970-a58a-e23df7e38946 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:11.486542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd824455-4fac-4970-a58a-e23df7e38946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:11.491594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd824455-4fac-4970-a58a-e23df7e38946 admin admin] PATH_INFO: `/v3/projects/cfc0f3d1f7c3427c90f47884a8aa84f7/users/30affab141c94b4199c48244c2ac1b74/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:11.608796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd824455-4fac-4970-a58a-e23df7e38946 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc0f3d1f7c3427c90f47884a8aa84f7, user_id=30affab141c94b4199c48244c2ac1b74, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:11.611780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd824455-4fac-4970-a58a-e23df7e38946 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:11.766545 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2235/4536] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:30:11 2022] PUT /identity/v3/projects/cfc0f3d1f7c3427c90f47884a8aa84f7/users/30affab141c94b4199c48244c2ac1b74/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:11.777874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730a3d7-ab3b-46ed-9365-ae1e371431c5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:11.778461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730a3d7-ab3b-46ed-9365-ae1e371431c5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:11.778952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730a3d7-ab3b-46ed-9365-ae1e371431c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:11.875014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c730a3d7-ab3b-46ed-9365-ae1e371431c5 None None] MFA Rules not processed for user `30affab141c94b4199c48244c2ac1b74`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:11.876275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c730a3d7-ab3b-46ed-9365-ae1e371431c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:12.162944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f2433-416e-454a-ae99-e6a51c22912b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:12.163228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f2433-416e-454a-ae99-e6a51c22912b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:12.163692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f2433-416e-454a-ae99-e6a51c22912b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:12.167620 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2302/4537] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:12.202450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3b4f2433-416e-454a-ae99-e6a51c22912b None None] MFA Rules not processed for user `30affab141c94b4199c48244c2ac1b74`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:12.203773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3b4f2433-416e-454a-ae99-e6a51c22912b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:12.231750 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2236/4538] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:12 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 14:30:12.234448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df4e1d-37cc-44e5-b417-e1eebd3fcbaa None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:12.234726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df4e1d-37cc-44e5-b417-e1eebd3fcbaa None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:12.235009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df4e1d-37cc-44e5-b417-e1eebd3fcbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:12.281850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-24df4e1d-37cc-44e5-b417-e1eebd3fcbaa None None] MFA Rules not processed for user `30affab141c94b4199c48244c2ac1b74`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:12.283857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-24df4e1d-37cc-44e5-b417-e1eebd3fcbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:12.311281 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2303/4539] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:12 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 14:30:12.312885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f2433-416e-454a-ae99-e6a51c22912b None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:12.340097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f2433-416e-454a-ae99-e6a51c22912b None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:12.357370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f102f7-f93f-4fdc-9a5f-ef48ed1c9dbb tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30affab141c94b4199c48244c2ac1b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfc0f3d1f7c3427c90f47884a8aa84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:12.357370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f102f7-f93f-4fdc-9a5f-ef48ed1c9dbb tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] REQUEST_METHOD: `HEAD` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:12.357370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f102f7-f93f-4fdc-9a5f-ef48ed1c9dbb tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:12.357752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f102f7-f93f-4fdc-9a5f-ef48ed1c9dbb tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:12.401805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f102f7-f93f-4fdc-9a5f-ef48ed1c9dbb tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] RBAC: Authorizing `identity:check_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:12.405849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f102f7-f93f-4fdc-9a5f-ef48ed1c9dbb tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:12.423137 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2237/4540] 10.222.0.43 () {56 vars in 1263 bytes} [Tue Jul 19 14:30:12 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 14:30:12.427030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df4e1d-37cc-44e5-b417-e1eebd3fcbaa None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:12.449046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df4e1d-37cc-44e5-b417-e1eebd3fcbaa None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:12.455017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f44c7-1bc2-44b2-8017-e931c0ce50a7 tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30affab141c94b4199c48244c2ac1b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfc0f3d1f7c3427c90f47884a8aa84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:12.458759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f44c7-1bc2-44b2-8017-e931c0ce50a7 tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:12.459517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f44c7-1bc2-44b2-8017-e931c0ce50a7 tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:12.460147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f44c7-1bc2-44b2-8017-e931c0ce50a7 tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:12.474332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f44c7-1bc2-44b2-8017-e931c0ce50a7 tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:12.478768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f44c7-1bc2-44b2-8017-e931c0ce50a7 tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:12.494575 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2304/4541] 10.222.0.43 () {56 vars in 1262 bytes} [Tue Jul 19 14:30:12 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 14:30:12.501729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f102f7-f93f-4fdc-9a5f-ef48ed1c9dbb tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:12.540143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f102f7-f93f-4fdc-9a5f-ef48ed1c9dbb tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:12.576399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22f8aa-3ebd-40a5-a33d-e89443abbdf8 tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30affab141c94b4199c48244c2ac1b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfc0f3d1f7c3427c90f47884a8aa84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:12.576399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22f8aa-3ebd-40a5-a33d-e89443abbdf8 tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:12.576399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22f8aa-3ebd-40a5-a33d-e89443abbdf8 tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:12.576736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22f8aa-3ebd-40a5-a33d-e89443abbdf8 tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:12.595554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22f8aa-3ebd-40a5-a33d-e89443abbdf8 tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:12.602089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22f8aa-3ebd-40a5-a33d-e89443abbdf8 tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:12.696801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f44c7-1bc2-44b2-8017-e931c0ce50a7 tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:12.698994 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2238/4542] 10.222.0.43 () {56 vars in 1265 bytes} [Tue Jul 19 14:30:12 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:12.709050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f44c7-1bc2-44b2-8017-e931c0ce50a7 tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:12.718149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8b253-a811-48e5-847f-a1211c18a97e tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30affab141c94b4199c48244c2ac1b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfc0f3d1f7c3427c90f47884a8aa84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:12.718818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8b253-a811-48e5-847f-a1211c18a97e tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] REQUEST_METHOD: `HEAD` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:12.719105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8b253-a811-48e5-847f-a1211c18a97e tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:12.719384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc8b253-a811-48e5-847f-a1211c18a97e tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:12.724937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1fc8b253-a811-48e5-847f-a1211c18a97e tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:12.763846 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-1fc8b253-a811-48e5-847f-a1211c18a97e tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 19 14:30:12.763846 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:30:12.763846 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:30:12.763846 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:30:12.763846 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:30:12.763846 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:30:12.763846 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:30:12.763846 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:30:12.763846 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:30:12.763846 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:30:12.763846 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:30:12.763846 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:30:12.763846 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Jul 19 14:30:12.763846 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Jul 19 14:30:12.763846 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 19 14:30:12.770410 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 19 14:30:12.770410 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 19 14:30:12.770410 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 19 14:30:12.770410 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:30:12.770410 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:30:12.770410 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 19 14:30:12.770410 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 19 14:30:12.770410 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 19 14:30:12.770410 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 19 14:30:12.770410 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:30:12.770410 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:30:12.770410 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 19 14:30:12.770410 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 19 14:30:12.770410 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:30:12.770410 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:30:12.770410 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 19 14:30:12.770410 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 19 14:30:12.771813 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:30:12.771813 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:30:12.771813 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 19 14:30:12.771813 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 19 14:30:12.771813 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 19 14:30:12.771813 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:30:12.771813 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2305/4543] 10.222.0.43 () {56 vars in 1263 bytes} [Tue Jul 19 14:30:12 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Jul 19 14:30:12.772255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e9d9c-0ab1-4e1b-a6e1-31d75f0f72aa None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:12.772605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e9d9c-0ab1-4e1b-a6e1-31d75f0f72aa None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:12.773058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e9d9c-0ab1-4e1b-a6e1-31d75f0f72aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:12.890512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-918e9d9c-0ab1-4e1b-a6e1-31d75f0f72aa None None] MFA Rules not processed for user `30affab141c94b4199c48244c2ac1b74`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:12.890512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-918e9d9c-0ab1-4e1b-a6e1-31d75f0f72aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:12.923633 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2239/4544] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:12 2022] POST /identity/v3/auth/tokens => generated 346 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 14:30:12.927433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8b253-a811-48e5-847f-a1211c18a97e tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:12.938755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc8b253-a811-48e5-847f-a1211c18a97e tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:12.960297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a2c20-2056-470f-8feb-bd48d628f0f5 tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30affab141c94b4199c48244c2ac1b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfc0f3d1f7c3427c90f47884a8aa84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:12.961564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a2c20-2056-470f-8feb-bd48d628f0f5 tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:12.969690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a2c20-2056-470f-8feb-bd48d628f0f5 tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:12.973530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a2c20-2056-470f-8feb-bd48d628f0f5 tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:12.983451 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:12.996512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a2c20-2056-470f-8feb-bd48d628f0f5 tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:12.998660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a2c20-2056-470f-8feb-bd48d628f0f5 tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:13.028822 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2306/4545] 10.222.0.43 () {56 vars in 1262 bytes} [Tue Jul 19 14:30:12 2022] GET /identity/v3/auth/tokens => generated 346 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 14:30:13.046438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e9d9c-0ab1-4e1b-a6e1-31d75f0f72aa None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:13.138369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e9d9c-0ab1-4e1b-a6e1-31d75f0f72aa None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:13.169216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65de0e-115d-4c09-9dd2-19201205313d tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30affab141c94b4199c48244c2ac1b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfc0f3d1f7c3427c90f47884a8aa84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:13.169216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65de0e-115d-4c09-9dd2-19201205313d tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:13.169216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65de0e-115d-4c09-9dd2-19201205313d tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:13.169495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65de0e-115d-4c09-9dd2-19201205313d tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:13.217075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65de0e-115d-4c09-9dd2-19201205313d tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:13.219097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b65de0e-115d-4c09-9dd2-19201205313d tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:13.342438 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2240/4546] 10.222.0.43 () {56 vars in 1265 bytes} [Tue Jul 19 14:30:13 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:13.343206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a2c20-2056-470f-8feb-bd48d628f0f5 tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:13.372746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a2c20-2056-470f-8feb-bd48d628f0f5 tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:13.385506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf50c05-7228-4eaf-be0d-169d5e164d6d tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '30affab141c94b4199c48244c2ac1b74', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfc0f3d1f7c3427c90f47884a8aa84f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:13.388354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf50c05-7228-4eaf-be0d-169d5e164d6d tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:13.388865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf50c05-7228-4eaf-be0d-169d5e164d6d tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:13.389346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf50c05-7228-4eaf-be0d-169d5e164d6d tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:13.402947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-acf50c05-7228-4eaf-be0d-169d5e164d6d tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:13.421156 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-acf50c05-7228-4eaf-be0d-169d5e164d6d tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 19 14:30:13.421156 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:30:13.421156 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:30:13.421156 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:30:13.421156 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:30:13.421156 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:30:13.421156 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:30:13.421156 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:30:13.421156 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:30:13.421156 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:30:13.421156 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:30:13.421156 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:30:13.421156 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jul 19 14:30:13.421156 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jul 19 14:30:13.421156 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 19 14:30:13.425383 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 19 14:30:13.425383 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 19 14:30:13.425383 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 19 14:30:13.425383 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:30:13.425383 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:30:13.425383 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 19 14:30:13.425383 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 19 14:30:13.425383 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 19 14:30:13.425383 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 19 14:30:13.425383 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:30:13.425383 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:30:13.425383 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 19 14:30:13.425383 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 19 14:30:13.425383 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:30:13.425383 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:30:13.425383 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 19 14:30:13.425383 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 19 14:30:13.426789 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:30:13.426789 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:30:13.426789 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 19 14:30:13.426789 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 19 14:30:13.426789 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 19 14:30:13.426789 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:30:13.438829 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2307/4547] 10.222.0.43 () {56 vars in 1262 bytes} [Tue Jul 19 14:30:13 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 14:30:13.439560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65de0e-115d-4c09-9dd2-19201205313d tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:13.622000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b65de0e-115d-4c09-9dd2-19201205313d tempest-TokensV3Test-1504118720 tempest-TokensV3Test-1504118720-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:13.629006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c5595-fab2-4353-ac6b-1482858a2e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:13.630001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c5595-fab2-4353-ac6b-1482858a2e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:13.630263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c5595-fab2-4353-ac6b-1482858a2e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:13.630552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c5595-fab2-4353-ac6b-1482858a2e22 admin admin] PATH_INFO: `/v3/users/30affab141c94b4199c48244c2ac1b74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:13.632150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c5595-fab2-4353-ac6b-1482858a2e22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30affab141c94b4199c48244c2ac1b74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:13.635270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c5595-fab2-4353-ac6b-1482858a2e22 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:13.875976 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:13.895874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-459c5595-fab2-4353-ac6b-1482858a2e22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30affab141c94b4199c48244c2ac1b74'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:13.917802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-459c5595-fab2-4353-ac6b-1482858a2e22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30affab141c94b4199c48244c2ac1b74'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:13.919225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-459c5595-fab2-4353-ac6b-1482858a2e22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30affab141c94b4199c48244c2ac1b74'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:13.920976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-459c5595-fab2-4353-ac6b-1482858a2e22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30affab141c94b4199c48244c2ac1b74'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:13.939797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-459c5595-fab2-4353-ac6b-1482858a2e22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30affab141c94b4199c48244c2ac1b74'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:14.055688 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2241/4548] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:30:13 2022] DELETE /identity/v3/users/30affab141c94b4199c48244c2ac1b74 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:14.060254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc79d51-3d4a-47d9-84a4-8fc47825d879 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:14.061203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc79d51-3d4a-47d9-84a4-8fc47825d879 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:14.061918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc79d51-3d4a-47d9-84a4-8fc47825d879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:14.110087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-edc79d51-3d4a-47d9-84a4-8fc47825d879 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:14.118703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-edc79d51-3d4a-47d9-84a4-8fc47825d879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:14.341676 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2308/4549] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:14.374880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c5595-fab2-4353-ac6b-1482858a2e22 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:14.376547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-459c5595-fab2-4353-ac6b-1482858a2e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:14.662819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c5595-fab2-4353-ac6b-1482858a2e22 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:14.683859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3460255-7f72-4a28-a474-286c48abdeff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:14.684558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3460255-7f72-4a28-a474-286c48abdeff service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:14.684846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3460255-7f72-4a28-a474-286c48abdeff service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:14.685130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3460255-7f72-4a28-a474-286c48abdeff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:14.750559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3460255-7f72-4a28-a474-286c48abdeff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:14.752419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3460255-7f72-4a28-a474-286c48abdeff service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:14.797548 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2242/4550] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:30:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:30:18.321310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc79d51-3d4a-47d9-84a4-8fc47825d879 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:18.322957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-edc79d51-3d4a-47d9-84a4-8fc47825d879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:18.365353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc79d51-3d4a-47d9-84a4-8fc47825d879 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:18.414957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005de705-ca57-4ba8-be78-7536ad8bf47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:18.421730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005de705-ca57-4ba8-be78-7536ad8bf47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:18.422369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005de705-ca57-4ba8-be78-7536ad8bf47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:18.422881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005de705-ca57-4ba8-be78-7536ad8bf47b admin admin] PATH_INFO: `/v3/projects/cfc0f3d1f7c3427c90f47884a8aa84f7` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:18.435419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005de705-ca57-4ba8-be78-7536ad8bf47b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfc0f3d1f7c3427c90f47884a8aa84f7)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:18.437730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005de705-ca57-4ba8-be78-7536ad8bf47b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:18.674482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-005de705-ca57-4ba8-be78-7536ad8bf47b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfc0f3d1f7c3427c90f47884a8aa84f7', 'request_id': 'req-005de705-ca57-4ba8-be78-7536ad8bf47b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:18.698524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-005de705-ca57-4ba8-be78-7536ad8bf47b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfc0f3d1f7c3427c90f47884a8aa84f7', 'request_id': 'req-005de705-ca57-4ba8-be78-7536ad8bf47b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:18.708022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-005de705-ca57-4ba8-be78-7536ad8bf47b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfc0f3d1f7c3427c90f47884a8aa84f7', 'request_id': 'req-005de705-ca57-4ba8-be78-7536ad8bf47b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:18.795545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-005de705-ca57-4ba8-be78-7536ad8bf47b admin admin] The token cache is being invalidate because project cfc0f3d1f7c3427c90f47884a8aa84f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:30:18.795843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-005de705-ca57-4ba8-be78-7536ad8bf47b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:18.796940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-005de705-ca57-4ba8-be78-7536ad8bf47b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:18.805271 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2309/4551] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:30:18 2022] DELETE /identity/v3/projects/cfc0f3d1f7c3427c90f47884a8aa84f7 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:18.806154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a55203-7880-4ac2-9e3e-bf9da3a4d846 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:18.806652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a55203-7880-4ac2-9e3e-bf9da3a4d846 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:18.806739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a55203-7880-4ac2-9e3e-bf9da3a4d846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:18.846333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-16a55203-7880-4ac2-9e3e-bf9da3a4d846 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:18.846333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-16a55203-7880-4ac2-9e3e-bf9da3a4d846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:18.962211 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2243/4552] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:18.970085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018a1b2-8707-4294-9dbb-2b0480bf0285 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:18.970085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018a1b2-8707-4294-9dbb-2b0480bf0285 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:18.970085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018a1b2-8707-4294-9dbb-2b0480bf0285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:19.030648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a018a1b2-8707-4294-9dbb-2b0480bf0285 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:19.031873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a018a1b2-8707-4294-9dbb-2b0480bf0285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:19.057625 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2310/4553] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:19.061853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a55203-7880-4ac2-9e3e-bf9da3a4d846 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:19.073147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a55203-7880-4ac2-9e3e-bf9da3a4d846 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:19.091177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234bf9d-cb72-497e-a6ff-bdc8b542c2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:19.091694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234bf9d-cb72-497e-a6ff-bdc8b542c2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:19.091980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234bf9d-cb72-497e-a6ff-bdc8b542c2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:19.092259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234bf9d-cb72-497e-a6ff-bdc8b542c2e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:19.093003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234bf9d-cb72-497e-a6ff-bdc8b542c2e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:30:19.093309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234bf9d-cb72-497e-a6ff-bdc8b542c2e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:19.094987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234bf9d-cb72-497e-a6ff-bdc8b542c2e2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:19.113964 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2244/4554] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:30:19.114667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018a1b2-8707-4294-9dbb-2b0480bf0285 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:19.126993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018a1b2-8707-4294-9dbb-2b0480bf0285 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:19.134220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4b4e5-0b9b-4df0-9aec-c1071bf3c682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:19.135235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4b4e5-0b9b-4df0-9aec-c1071bf3c682 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:19.135689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4b4e5-0b9b-4df0-9aec-c1071bf3c682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:19.136144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4b4e5-0b9b-4df0-9aec-c1071bf3c682 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:19.137140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4b4e5-0b9b-4df0-9aec-c1071bf3c682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:19.140082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4b4e5-0b9b-4df0-9aec-c1071bf3c682 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:19.278363 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2311/4555] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:30:19 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:30:19.279474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234bf9d-cb72-497e-a6ff-bdc8b542c2e2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:19.298071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234bf9d-cb72-497e-a6ff-bdc8b542c2e2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:19.394696 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:19.420700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45280ba2-929c-4cc8-a457-c70c27d7eeab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:19.421482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45280ba2-929c-4cc8-a457-c70c27d7eeab admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:19.421905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45280ba2-929c-4cc8-a457-c70c27d7eeab admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:19.422230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45280ba2-929c-4cc8-a457-c70c27d7eeab admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:19.423455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45280ba2-929c-4cc8-a457-c70c27d7eeab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:19.426456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45280ba2-929c-4cc8-a457-c70c27d7eeab admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:19.535535 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2245/4556] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:30:19 2022] POST /identity/v3/users => generated 287 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:30:19.536776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4b4e5-0b9b-4df0-9aec-c1071bf3c682 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:19.558145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4b4e5-0b9b-4df0-9aec-c1071bf3c682 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:19.589956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53a80f-fda0-43ac-a314-8df0b96af4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:19.590917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53a80f-fda0-43ac-a314-8df0b96af4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:19.591386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53a80f-fda0-43ac-a314-8df0b96af4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:19.591660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53a80f-fda0-43ac-a314-8df0b96af4f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:19.592546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53a80f-fda0-43ac-a314-8df0b96af4f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:19.594202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53a80f-fda0-43ac-a314-8df0b96af4f7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:19.632036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45280ba2-929c-4cc8-a457-c70c27d7eeab admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:19.632218 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2312/4557] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:30:19.662639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45280ba2-929c-4cc8-a457-c70c27d7eeab admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:19.673848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a6694-0d3b-42f3-ab07-7e70b9e1df5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:19.676920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a6694-0d3b-42f3-ab07-7e70b9e1df5d admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:19.677985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a6694-0d3b-42f3-ab07-7e70b9e1df5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:19.678375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a6694-0d3b-42f3-ab07-7e70b9e1df5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:19.680964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a6694-0d3b-42f3-ab07-7e70b9e1df5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:19.682980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a6694-0d3b-42f3-ab07-7e70b9e1df5d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:19.706144 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2246/4558] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:30:19.708368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53a80f-fda0-43ac-a314-8df0b96af4f7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:19.720583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53a80f-fda0-43ac-a314-8df0b96af4f7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:19.726720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f5f70-3d52-4250-ae73-dd9728f607b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:19.728030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f5f70-3d52-4250-ae73-dd9728f607b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:19.728314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f5f70-3d52-4250-ae73-dd9728f607b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:19.728590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2f5f70-3d52-4250-ae73-dd9728f607b5 admin admin] PATH_INFO: `/v3/projects/5f9a08dcafd945f4b24367c3bc43f764/users/7794a38b003945ed983f6f5646e8d9d8/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:19.751153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f5f70-3d52-4250-ae73-dd9728f607b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f9a08dcafd945f4b24367c3bc43f764, user_id=7794a38b003945ed983f6f5646e8d9d8, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:19.754071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2f5f70-3d52-4250-ae73-dd9728f607b5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:19.855088 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2313/4559] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:30:19 2022] PUT /identity/v3/projects/5f9a08dcafd945f4b24367c3bc43f764/users/7794a38b003945ed983f6f5646e8d9d8/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:19.855766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92867d9f-101f-48a8-8808-c7010b53fe30 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:19.856209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92867d9f-101f-48a8-8808-c7010b53fe30 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:19.856503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92867d9f-101f-48a8-8808-c7010b53fe30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:19.935361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-92867d9f-101f-48a8-8808-c7010b53fe30 None None] MFA Rules not processed for user `7794a38b003945ed983f6f5646e8d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:19.936655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-92867d9f-101f-48a8-8808-c7010b53fe30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:20.135527 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2247/4560] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:30:20.140917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f5f70-3d52-4250-ae73-dd9728f607b5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:20.155975 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:20.163211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2f5f70-3d52-4250-ae73-dd9728f607b5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:20.184004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b769a126-b01b-4e8a-b028-95f52f21aeff tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7794a38b003945ed983f6f5646e8d9d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f9a08dcafd945f4b24367c3bc43f764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:20.187459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769a126-b01b-4e8a-b028-95f52f21aeff tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:20.187459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769a126-b01b-4e8a-b028-95f52f21aeff tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:20.187459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b769a126-b01b-4e8a-b028-95f52f21aeff tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] PATH_INFO: `/v3/users/7794a38b003945ed983f6f5646e8d9d8/password` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:20.528214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b769a126-b01b-4e8a-b028-95f52f21aeff tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7794a38b003945ed983f6f5646e8d9d8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:21.027829 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2314/4561] 10.222.0.43 () {60 vars in 1268 bytes} [Tue Jul 19 14:30:20 2022] POST /identity/v3/users/7794a38b003945ed983f6f5646e8d9d8/password => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:22.033276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55386e76-15f5-4285-90c6-d48ea177b117 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:22.033832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55386e76-15f5-4285-90c6-d48ea177b117 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:22.033832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55386e76-15f5-4285-90c6-d48ea177b117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:22.068768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-55386e76-15f5-4285-90c6-d48ea177b117 None None] MFA Rules not processed for user `7794a38b003945ed983f6f5646e8d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:22.071764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-55386e76-15f5-4285-90c6-d48ea177b117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:22.087046 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2248/4562] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:22 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 14:30:22.092691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17e02c-bd4a-4efd-951d-b9d1a971d350 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:22.092691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17e02c-bd4a-4efd-951d-b9d1a971d350 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:22.092691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17e02c-bd4a-4efd-951d-b9d1a971d350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:22.158392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0d17e02c-bd4a-4efd-951d-b9d1a971d350 None None] MFA Rules not processed for user `7794a38b003945ed983f6f5646e8d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:22.166659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0d17e02c-bd4a-4efd-951d-b9d1a971d350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:22.191960 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2315/4563] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:22.196376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55386e76-15f5-4285-90c6-d48ea177b117 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:22.232742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55386e76-15f5-4285-90c6-d48ea177b117 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:22.246478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f12c04-51b8-4968-8914-691ffe6015e3 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7794a38b003945ed983f6f5646e8d9d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f9a08dcafd945f4b24367c3bc43f764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:22.247308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f12c04-51b8-4968-8914-691ffe6015e3 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:22.248136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f12c04-51b8-4968-8914-691ffe6015e3 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:22.248482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f12c04-51b8-4968-8914-691ffe6015e3 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] PATH_INFO: `/v3/users/7794a38b003945ed983f6f5646e8d9d8/password` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:22.369020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-f9f12c04-51b8-4968-8914-691ffe6015e3 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 19 14:30:22.369020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:30:22.369020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:30:22.369020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:30:22.369020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:30:22.369020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:30:22.369020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:30:22.369020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:30:22.369020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:30:22.369020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:30:22.369020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:30:22.369020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:30:22.369020 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 19 14:30:22.370071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 19 14:30:22.370071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jul 19 14:30:22.370071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jul 19 14:30:22.370071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:30:22.370071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:30:22.370071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 14:30:22.370071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 14:30:22.370071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jul 19 14:30:22.370071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jul 19 14:30:22.370071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jul 19 14:30:22.370071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jul 19 14:30:22.370071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jul 19 14:30:22.370071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jul 19 14:30:22.370071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 19 14:30:22.370071 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:30:22.372037 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2249/4564] 10.222.0.43 () {60 vars in 1268 bytes} [Tue Jul 19 14:30:22 2022] POST /identity/v3/users/7794a38b003945ed983f6f5646e8d9d8/password => generated 188 bytes in 177 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 19 14:30:22.376115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17e02c-bd4a-4efd-951d-b9d1a971d350 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:22.394783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17e02c-bd4a-4efd-951d-b9d1a971d350 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:22.409987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c44083-d8a1-4ccb-b0a4-e88483715de0 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7794a38b003945ed983f6f5646e8d9d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f9a08dcafd945f4b24367c3bc43f764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:22.411271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c44083-d8a1-4ccb-b0a4-e88483715de0 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:22.411996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c44083-d8a1-4ccb-b0a4-e88483715de0 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:22.412936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c44083-d8a1-4ccb-b0a4-e88483715de0 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] PATH_INFO: `/v3/users/7794a38b003945ed983f6f5646e8d9d8/password` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:22.529028 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-99c44083-d8a1-4ccb-b0a4-e88483715de0 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 19 14:30:22.529028 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:30:22.529028 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:30:22.529028 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:30:22.529028 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:30:22.529028 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:30:22.529028 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:30:22.529028 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:30:22.529028 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:30:22.529028 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:30:22.529028 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:30:22.529028 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:30:22.529028 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 19 14:30:22.530047 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 19 14:30:22.530047 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jul 19 14:30:22.530047 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jul 19 14:30:22.530047 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:30:22.530047 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:30:22.530047 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 14:30:22.530047 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 14:30:22.530047 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jul 19 14:30:22.530047 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jul 19 14:30:22.530047 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jul 19 14:30:22.530047 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jul 19 14:30:22.530047 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jul 19 14:30:22.530047 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jul 19 14:30:22.530047 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 19 14:30:22.530047 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:30:22.538062 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2316/4565] 10.222.0.43 () {60 vars in 1268 bytes} [Tue Jul 19 14:30:22 2022] POST /identity/v3/users/7794a38b003945ed983f6f5646e8d9d8/password => generated 188 bytes in 162 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 19 14:30:22.542062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f12c04-51b8-4968-8914-691ffe6015e3 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:22.558355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f12c04-51b8-4968-8914-691ffe6015e3 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:22.571408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123a362-8ec6-41c9-be4e-bb57d4f9d8dd tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7794a38b003945ed983f6f5646e8d9d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f9a08dcafd945f4b24367c3bc43f764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:22.572464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123a362-8ec6-41c9-be4e-bb57d4f9d8dd tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:22.572988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123a362-8ec6-41c9-be4e-bb57d4f9d8dd tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:22.573422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123a362-8ec6-41c9-be4e-bb57d4f9d8dd tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] PATH_INFO: `/v3/users/7794a38b003945ed983f6f5646e8d9d8/password` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:22.734707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d123a362-8ec6-41c9-be4e-bb57d4f9d8dd tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7794a38b003945ed983f6f5646e8d9d8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:22.812351 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2250/4566] 10.222.0.43 () {60 vars in 1268 bytes} [Tue Jul 19 14:30:22 2022] POST /identity/v3/users/7794a38b003945ed983f6f5646e8d9d8/password => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:23.817129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcb16d-a50f-4397-ae77-62aa48fec972 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:23.818178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcb16d-a50f-4397-ae77-62aa48fec972 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:23.818788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcb16d-a50f-4397-ae77-62aa48fec972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:23.852207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d8bcb16d-a50f-4397-ae77-62aa48fec972 None None] MFA Rules not processed for user `7794a38b003945ed983f6f5646e8d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:23.855652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d8bcb16d-a50f-4397-ae77-62aa48fec972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:23.871289 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2317/4567] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:23 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 14:30:23.875879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c45bcd-f54b-428b-b3f5-8e0e1136f89d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:23.876334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c45bcd-f54b-428b-b3f5-8e0e1136f89d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:23.876334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c45bcd-f54b-428b-b3f5-8e0e1136f89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:23.908333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-00c45bcd-f54b-428b-b3f5-8e0e1136f89d None None] MFA Rules not processed for user `7794a38b003945ed983f6f5646e8d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:23.909553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-00c45bcd-f54b-428b-b3f5-8e0e1136f89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:23.928625 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2251/4568] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:23.930177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcb16d-a50f-4397-ae77-62aa48fec972 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:23.949711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcb16d-a50f-4397-ae77-62aa48fec972 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:23.963337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996a727-f0f6-43b4-8d59-3a5c234bc87d tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7794a38b003945ed983f6f5646e8d9d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f9a08dcafd945f4b24367c3bc43f764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:23.963930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996a727-f0f6-43b4-8d59-3a5c234bc87d tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:23.964476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996a727-f0f6-43b4-8d59-3a5c234bc87d tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:23.964888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c996a727-f0f6-43b4-8d59-3a5c234bc87d tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] PATH_INFO: `/v3/users/7794a38b003945ed983f6f5646e8d9d8/password` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:24.135868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c996a727-f0f6-43b4-8d59-3a5c234bc87d tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7794a38b003945ed983f6f5646e8d9d8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:24.217041 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2318/4569] 10.222.0.43 () {60 vars in 1268 bytes} [Tue Jul 19 14:30:23 2022] POST /identity/v3/users/7794a38b003945ed983f6f5646e8d9d8/password => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:30:24.753269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7497bc-d5d3-48f9-85f6-d34ac2ecb1d5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:24.754723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7497bc-d5d3-48f9-85f6-d34ac2ecb1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:24.754723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7497bc-d5d3-48f9-85f6-d34ac2ecb1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:24.797709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0d7497bc-d5d3-48f9-85f6-d34ac2ecb1d5 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:24.804014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0d7497bc-d5d3-48f9-85f6-d34ac2ecb1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:24.885444 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:24.938313 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2252/4570] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:30:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:30:24.946414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996a727-f0f6-43b4-8d59-3a5c234bc87d tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:24.951191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c996a727-f0f6-43b4-8d59-3a5c234bc87d tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:25.175531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c996a727-f0f6-43b4-8d59-3a5c234bc87d tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:25.186005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca3cae-eb19-4ef3-9404-779eaff22bae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:25.187065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca3cae-eb19-4ef3-9404-779eaff22bae service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:25.187457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca3cae-eb19-4ef3-9404-779eaff22bae service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:25.187840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca3cae-eb19-4ef3-9404-779eaff22bae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:25.222844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baad9a-6f50-4d33-bb09-ec2617842e46 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:25.223162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca3cae-eb19-4ef3-9404-779eaff22bae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:25.223484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baad9a-6f50-4d33-bb09-ec2617842e46 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:25.223834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baad9a-6f50-4d33-bb09-ec2617842e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:25.226080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca3cae-eb19-4ef3-9404-779eaff22bae service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:25.250273 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2319/4571] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:30:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:30:25.263153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-29baad9a-6f50-4d33-bb09-ec2617842e46 None None] MFA Rules not processed for user `7794a38b003945ed983f6f5646e8d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:25.264400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-29baad9a-6f50-4d33-bb09-ec2617842e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:25.282601 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2253/4572] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:25 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 14:30:25.287727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6a88a-200f-4a0c-b366-a31a63e68158 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:25.287970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6a88a-200f-4a0c-b366-a31a63e68158 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:25.288455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6a88a-200f-4a0c-b366-a31a63e68158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:25.329885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3cc6a88a-200f-4a0c-b366-a31a63e68158 None None] MFA Rules not processed for user `7794a38b003945ed983f6f5646e8d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:25.331388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3cc6a88a-200f-4a0c-b366-a31a63e68158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:25.357922 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2320/4573] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:25.362333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baad9a-6f50-4d33-bb09-ec2617842e46 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:25.382290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baad9a-6f50-4d33-bb09-ec2617842e46 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:25.393197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b53063d-08ee-4498-8a68-1c7bac1d1714 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7794a38b003945ed983f6f5646e8d9d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f9a08dcafd945f4b24367c3bc43f764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:25.394117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53063d-08ee-4498-8a68-1c7bac1d1714 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:25.394413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53063d-08ee-4498-8a68-1c7bac1d1714 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:25.394700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b53063d-08ee-4498-8a68-1c7bac1d1714 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] PATH_INFO: `/v3/users/7794a38b003945ed983f6f5646e8d9d8/password` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:25.596593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7b53063d-08ee-4498-8a68-1c7bac1d1714 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7794a38b003945ed983f6f5646e8d9d8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:25.724426 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2254/4574] 10.222.0.43 () {60 vars in 1268 bytes} [Tue Jul 19 14:30:25 2022] POST /identity/v3/users/7794a38b003945ed983f6f5646e8d9d8/password => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:26.730656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d47855-a457-427d-b7cb-53b8c04e8609 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:26.731532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d47855-a457-427d-b7cb-53b8c04e8609 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:26.731532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d47855-a457-427d-b7cb-53b8c04e8609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:26.788189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-46d47855-a457-427d-b7cb-53b8c04e8609 None None] MFA Rules not processed for user `7794a38b003945ed983f6f5646e8d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:26.790859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-46d47855-a457-427d-b7cb-53b8c04e8609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:26.807456 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2321/4575] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:26 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 14:30:26.809250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4ce75-9c52-48a5-a489-03c23a1a7c9e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:26.809762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4ce75-9c52-48a5-a489-03c23a1a7c9e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:26.810284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4ce75-9c52-48a5-a489-03c23a1a7c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:26.881628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2bf4ce75-9c52-48a5-a489-03c23a1a7c9e None None] MFA Rules not processed for user `7794a38b003945ed983f6f5646e8d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:26.883671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2bf4ce75-9c52-48a5-a489-03c23a1a7c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:26.913551 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2255/4576] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:26.917815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d47855-a457-427d-b7cb-53b8c04e8609 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:26.945215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d47855-a457-427d-b7cb-53b8c04e8609 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:26.956475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883fafc-5368-4fc2-9dbd-0f9e9c55b411 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7794a38b003945ed983f6f5646e8d9d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f9a08dcafd945f4b24367c3bc43f764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:26.957316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883fafc-5368-4fc2-9dbd-0f9e9c55b411 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:26.957594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883fafc-5368-4fc2-9dbd-0f9e9c55b411 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:26.958265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883fafc-5368-4fc2-9dbd-0f9e9c55b411 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] PATH_INFO: `/v3/users/7794a38b003945ed983f6f5646e8d9d8/password` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:27.159944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c883fafc-5368-4fc2-9dbd-0f9e9c55b411 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7794a38b003945ed983f6f5646e8d9d8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:27.263295 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2322/4577] 10.222.0.43 () {60 vars in 1268 bytes} [Tue Jul 19 14:30:26 2022] POST /identity/v3/users/7794a38b003945ed983f6f5646e8d9d8/password => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:28.266820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f09bf-4f99-4e49-9686-43e8f8ccdbe9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:28.267632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f09bf-4f99-4e49-9686-43e8f8ccdbe9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:28.268044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f09bf-4f99-4e49-9686-43e8f8ccdbe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:28.291575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9c1f09bf-4f99-4e49-9686-43e8f8ccdbe9 None None] MFA Rules not processed for user `7794a38b003945ed983f6f5646e8d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:28.293137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9c1f09bf-4f99-4e49-9686-43e8f8ccdbe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:28.301151 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2256/4578] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:28 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 14:30:28.921306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883fafc-5368-4fc2-9dbd-0f9e9c55b411 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:28.930774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c883fafc-5368-4fc2-9dbd-0f9e9c55b411 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:28.939553 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:UPDATE=3,keystone:INSERT=6,keystone:DELETE=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:29.053552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c883fafc-5368-4fc2-9dbd-0f9e9c55b411 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:29.079082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8922c2-7b4c-44c3-9eff-989ac5d32602 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:29.082208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8922c2-7b4c-44c3-9eff-989ac5d32602 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:29.082526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8922c2-7b4c-44c3-9eff-989ac5d32602 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:29.082814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8922c2-7b4c-44c3-9eff-989ac5d32602 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:29.087636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ae8922c2-7b4c-44c3-9eff-989ac5d32602 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:29.180398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81c44b-2262-4041-b0ac-05d8f11cb359 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:29.180835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81c44b-2262-4041-b0ac-05d8f11cb359 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:29.181306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81c44b-2262-4041-b0ac-05d8f11cb359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:29.186757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8922c2-7b4c-44c3-9eff-989ac5d32602 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:29.194029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8922c2-7b4c-44c3-9eff-989ac5d32602 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:29.205237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8b81c44b-2262-4041-b0ac-05d8f11cb359 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:29.206852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8b81c44b-2262-4041-b0ac-05d8f11cb359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:29.231581 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2323/4579] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:30:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:30:29.245321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8922c2-7b4c-44c3-9eff-989ac5d32602 service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:29.246037 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2257/4580] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:30:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:29.266832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8922c2-7b4c-44c3-9eff-989ac5d32602 service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:29.283217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980835e2-dbb9-437e-9288-931066bc0f8f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:29.283903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980835e2-dbb9-437e-9288-931066bc0f8f service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:29.284195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980835e2-dbb9-437e-9288-931066bc0f8f service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:29.284660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980835e2-dbb9-437e-9288-931066bc0f8f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:29.305346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff198f8-1f68-4bd4-9884-a186d511076b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:29.305769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff198f8-1f68-4bd4-9884-a186d511076b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:29.306864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff198f8-1f68-4bd4-9884-a186d511076b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:29.317898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980835e2-dbb9-437e-9288-931066bc0f8f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:29.319639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980835e2-dbb9-437e-9288-931066bc0f8f service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:29.335311 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2324/4581] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:30:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:30:29.365709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-bff198f8-1f68-4bd4-9884-a186d511076b None None] MFA Rules not processed for user `7794a38b003945ed983f6f5646e8d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:29.367492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bff198f8-1f68-4bd4-9884-a186d511076b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:29.392201 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2258/4582] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:30:29.392484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560301c8-6c09-4c53-a278-55eb3cc731b2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:29.392778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560301c8-6c09-4c53-a278-55eb3cc731b2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:29.393066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560301c8-6c09-4c53-a278-55eb3cc731b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:29.417845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-560301c8-6c09-4c53-a278-55eb3cc731b2 None None] MFA Rules not processed for user `7794a38b003945ed983f6f5646e8d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:29.419755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-560301c8-6c09-4c53-a278-55eb3cc731b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:29.425046 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2325/4583] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:29 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 14:30:29.428613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928671a-624a-41b1-9ef8-ba8939c6176e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:29.429077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928671a-624a-41b1-9ef8-ba8939c6176e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:29.429585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1928671a-624a-41b1-9ef8-ba8939c6176e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:29.586620 n-d-master-1 devstack@keystone.service[80679]: WARNING keystone.server.flask.application [None req-1928671a-624a-41b1-9ef8-ba8939c6176e None None] Authorization failed. The request you have made requires authentication. from 10.222.0.43: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 19 14:30:29.588868 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2259/4584] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:29 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 161 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 19 14:30:29.596043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311d46b-0742-4f97-a235-7a4be2fc4d31 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:29.596433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311d46b-0742-4f97-a235-7a4be2fc4d31 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:29.596782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9311d46b-0742-4f97-a235-7a4be2fc4d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:29.778235 n-d-master-1 devstack@keystone.service[80680]: WARNING keystone.server.flask.application [None req-9311d46b-0742-4f97-a235-7a4be2fc4d31 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.43: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 19 14:30:29.780216 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2326/4585] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:29 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 186 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 19 14:30:29.785049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860dc73-2808-4814-aaf9-9897900eb355 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:29.785341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860dc73-2808-4814-aaf9-9897900eb355 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:29.785790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b860dc73-2808-4814-aaf9-9897900eb355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:29.846852 n-d-master-1 devstack@keystone.service[80679]: WARNING keystone.server.flask.application [None req-b860dc73-2808-4814-aaf9-9897900eb355 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.43: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 19 14:30:29.850738 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2260/4586] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:29 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 66 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 19 14:30:30.718689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24184b-e67d-467d-ae7d-0b1e6f9971ed None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:30.719620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24184b-e67d-467d-ae7d-0b1e6f9971ed None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:30.720069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24184b-e67d-467d-ae7d-0b1e6f9971ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:30.764342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ef24184b-e67d-467d-ae7d-0b1e6f9971ed None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:30.770751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ef24184b-e67d-467d-ae7d-0b1e6f9971ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:30.792977 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2327/4587] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:30:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:30.812771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860dc73-2808-4814-aaf9-9897900eb355 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:30.841437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b860dc73-2808-4814-aaf9-9897900eb355 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:30.855546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39651025-af9c-4a38-868b-c036ffc269a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:30.856372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39651025-af9c-4a38-868b-c036ffc269a1 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:30.856668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39651025-af9c-4a38-868b-c036ffc269a1 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:30.856949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39651025-af9c-4a38-868b-c036ffc269a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:30.890228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39651025-af9c-4a38-868b-c036ffc269a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:30.892793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39651025-af9c-4a38-868b-c036ffc269a1 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:30.921590 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2261/4588] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:30:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:30:32.746409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc6056-cf5c-49e6-9cc8-65b491e894c6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:32.746881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc6056-cf5c-49e6-9cc8-65b491e894c6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:32.747177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc6056-cf5c-49e6-9cc8-65b491e894c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:32.841987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b3cc6056-cf5c-49e6-9cc8-65b491e894c6 None None] MFA Rules not processed for user `e6bc3137faaf44cbb477f55fd7bd2644`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:32.844241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b3cc6056-cf5c-49e6-9cc8-65b491e894c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:32.997435 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:33.009790 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2328/4589] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:33.014848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39651025-af9c-4a38-868b-c036ffc269a1 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:33.017266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-39651025-af9c-4a38-868b-c036ffc269a1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:33.192500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39651025-af9c-4a38-868b-c036ffc269a1 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:33.213154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5ee91-0276-43d2-baf2-ef6f2d82fad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:33.215957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5ee91-0276-43d2-baf2-ef6f2d82fad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:33.216468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5ee91-0276-43d2-baf2-ef6f2d82fad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:33.224706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5ee91-0276-43d2-baf2-ef6f2d82fad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:33.225840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5ee91-0276-43d2-baf2-ef6f2d82fad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:33.246553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf5ee91-0276-43d2-baf2-ef6f2d82fad6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:33.372827 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2262/4590] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:30:33 2022] POST /identity/v3/projects => generated 379 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:30:33.377025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc6056-cf5c-49e6-9cc8-65b491e894c6 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:33.400055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc6056-cf5c-49e6-9cc8-65b491e894c6 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:33.589373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c83c28-a2af-43d9-8122-c51ce80aef6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:33.593174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c83c28-a2af-43d9-8122-c51ce80aef6b admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:33.593518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c83c28-a2af-43d9-8122-c51ce80aef6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:33.593811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c83c28-a2af-43d9-8122-c51ce80aef6b admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:33.597895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c83c28-a2af-43d9-8122-c51ce80aef6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:33.606435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c83c28-a2af-43d9-8122-c51ce80aef6b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:33.768628 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2329/4591] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:30:33 2022] POST /identity/v3/users => generated 296 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:30:33.770008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5ee91-0276-43d2-baf2-ef6f2d82fad6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:33.822999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf5ee91-0276-43d2-baf2-ef6f2d82fad6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:33.836611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0c503-079f-42af-a537-c4c9eaa9bdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:33.837557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0c503-079f-42af-a537-c4c9eaa9bdad admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:33.838035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0c503-079f-42af-a537-c4c9eaa9bdad admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:33.838605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0c503-079f-42af-a537-c4c9eaa9bdad admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:33.839583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0c503-079f-42af-a537-c4c9eaa9bdad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:33.847931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0c503-079f-42af-a537-c4c9eaa9bdad admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:33.885764 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2263/4592] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:30:33 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:30:33.889739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c83c28-a2af-43d9-8122-c51ce80aef6b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:33.913501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c83c28-a2af-43d9-8122-c51ce80aef6b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:33.950476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23363bb-c2df-470b-b684-8d0dd49cc793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:33.954839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23363bb-c2df-470b-b684-8d0dd49cc793 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:33.955184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23363bb-c2df-470b-b684-8d0dd49cc793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:33.955466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23363bb-c2df-470b-b684-8d0dd49cc793 admin admin] PATH_INFO: `/v3/projects/2d5d7da1fd0e45f29e5c4d0546959a6d/users/3b2c539fb4064555a2ba7e63ae395bd8/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:33.989840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23363bb-c2df-470b-b684-8d0dd49cc793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5d7da1fd0e45f29e5c4d0546959a6d, user_id=3b2c539fb4064555a2ba7e63ae395bd8, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:33.995361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23363bb-c2df-470b-b684-8d0dd49cc793 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:34.087857 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2330/4593] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:30:33 2022] PUT /identity/v3/projects/2d5d7da1fd0e45f29e5c4d0546959a6d/users/3b2c539fb4064555a2ba7e63ae395bd8/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:34.089724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0c503-079f-42af-a537-c4c9eaa9bdad admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:34.103677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0c503-079f-42af-a537-c4c9eaa9bdad admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:34.128013 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:UPDATE=2,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:34.251280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1473b98-345a-49e0-92b7-3bd7c530b837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:34.252420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1473b98-345a-49e0-92b7-3bd7c530b837 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:34.252852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1473b98-345a-49e0-92b7-3bd7c530b837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:34.253278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1473b98-345a-49e0-92b7-3bd7c530b837 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:34.254248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1473b98-345a-49e0-92b7-3bd7c530b837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:34.258301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1473b98-345a-49e0-92b7-3bd7c530b837 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:34.276725 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2264/4594] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:30:34.281825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23363bb-c2df-470b-b684-8d0dd49cc793 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:34.303315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23363bb-c2df-470b-b684-8d0dd49cc793 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:34.313200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e5a55-b915-45c4-a22b-35d0a320c7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:34.315072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e5a55-b915-45c4-a22b-35d0a320c7b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:34.315756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e5a55-b915-45c4-a22b-35d0a320c7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:34.316051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e5a55-b915-45c4-a22b-35d0a320c7b3 admin admin] PATH_INFO: `/v3/projects/2d5d7da1fd0e45f29e5c4d0546959a6d/users/3b2c539fb4064555a2ba7e63ae395bd8/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:34.328079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e5a55-b915-45c4-a22b-35d0a320c7b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5d7da1fd0e45f29e5c4d0546959a6d, user_id=3b2c539fb4064555a2ba7e63ae395bd8, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:34.345785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e5a55-b915-45c4-a22b-35d0a320c7b3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:34.406854 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2331/4595] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:30:34 2022] PUT /identity/v3/projects/2d5d7da1fd0e45f29e5c4d0546959a6d/users/3b2c539fb4064555a2ba7e63ae395bd8/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:40.876839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6a8e9-5e49-486d-a779-6f6b323b4443 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:40.877352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6a8e9-5e49-486d-a779-6f6b323b4443 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:40.878543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6a8e9-5e49-486d-a779-6f6b323b4443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:41.037467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d7b6a8e9-5e49-486d-a779-6f6b323b4443 None None] MFA Rules not processed for user `7794a38b003945ed983f6f5646e8d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:41.049187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d7b6a8e9-5e49-486d-a779-6f6b323b4443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:41.056332 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2265/4596] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:40 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 14:30:41.061479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e5a55-b915-45c4-a22b-35d0a320c7b3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:41.306944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e5a55-b915-45c4-a22b-35d0a320c7b3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:41.315031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb5454-cfb3-4400-b25f-d3e11f6605c7 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7794a38b003945ed983f6f5646e8d9d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f9a08dcafd945f4b24367c3bc43f764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:41.315837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb5454-cfb3-4400-b25f-d3e11f6605c7 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:41.316162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb5454-cfb3-4400-b25f-d3e11f6605c7 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:41.316990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb5454-cfb3-4400-b25f-d3e11f6605c7 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] PATH_INFO: `/v3/users/7794a38b003945ed983f6f5646e8d9d8/password` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:41.513538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-90fb5454-cfb3-4400-b25f-d3e11f6605c7 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7794a38b003945ed983f6f5646e8d9d8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:41.589453 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2332/4597] 10.222.0.43 () {60 vars in 1268 bytes} [Tue Jul 19 14:30:41 2022] POST /identity/v3/users/7794a38b003945ed983f6f5646e8d9d8/password => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:42.594835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a6030-dab4-492b-8f09-67ce46541f16 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:42.596026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a6030-dab4-492b-8f09-67ce46541f16 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:42.596593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a6030-dab4-492b-8f09-67ce46541f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:42.654381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-984a6030-dab4-492b-8f09-67ce46541f16 None None] MFA Rules not processed for user `7794a38b003945ed983f6f5646e8d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:42.659280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-984a6030-dab4-492b-8f09-67ce46541f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:42.693940 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2266/4598] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:42 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 14:30:42.694640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66b525-5afc-4fd2-8970-dfa365aea12e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:42.695900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66b525-5afc-4fd2-8970-dfa365aea12e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:42.695900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66b525-5afc-4fd2-8970-dfa365aea12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:42.740899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-5e66b525-5afc-4fd2-8970-dfa365aea12e None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 19 14:30:42.740899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:30:42.740899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:30:42.740899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:30:42.740899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:30:42.740899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:30:42.740899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:30:42.740899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:30:42.740899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:30:42.740899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:30:42.740899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:30:42.740899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:30:42.740899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 19 14:30:42.740899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 19 14:30:42.740899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Jul 19 14:30:42.740899 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Jul 19 14:30:42.747720 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Jul 19 14:30:42.747720 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Jul 19 14:30:42.747720 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Jul 19 14:30:42.747720 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Jul 19 14:30:42.747720 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Jul 19 14:30:42.747720 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Jul 19 14:30:42.747720 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Jul 19 14:30:42.747720 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Jul 19 14:30:42.747720 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:30:42.747720 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:30:42.747720 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 19 14:30:42.747720 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 19 14:30:42.747720 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 19 14:30:42.747720 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 19 14:30:42.747720 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:30:42.747720 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:30:42.748692 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 19 14:30:42.748692 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 19 14:30:42.748692 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:30:42.748692 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:30:42.748692 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 19 14:30:42.748692 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 19 14:30:42.748692 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:30:42.748692 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:30:42.748692 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 19 14:30:42.748692 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 19 14:30:42.748692 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 19 14:30:42.748692 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:30:42.748692 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2333/4599] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:42 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 14:30:42.752335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811a638-a711-43b8-849b-5c1ddeb76d5c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:42.752975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811a638-a711-43b8-849b-5c1ddeb76d5c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:42.753444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811a638-a711-43b8-849b-5c1ddeb76d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:42.956779 n-d-master-1 devstack@keystone.service[80679]: WARNING keystone.server.flask.application [None req-0811a638-a711-43b8-849b-5c1ddeb76d5c None None] Authorization failed. The request you have made requires authentication. from 10.222.0.43: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 19 14:30:42.970149 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2267/4600] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:42 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 217 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 19 14:30:42.977520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f15b4-3159-4c8e-b745-c71b78d35557 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:42.979004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f15b4-3159-4c8e-b745-c71b78d35557 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:42.980237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7f15b4-3159-4c8e-b745-c71b78d35557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:43.199917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1e7f15b4-3159-4c8e-b745-c71b78d35557 None None] MFA Rules not processed for user `7794a38b003945ed983f6f5646e8d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:43.203175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1e7f15b4-3159-4c8e-b745-c71b78d35557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:43.227355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811a638-a711-43b8-849b-5c1ddeb76d5c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:43.237749 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2334/4601] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:43.257979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811a638-a711-43b8-849b-5c1ddeb76d5c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:43.305013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c3537-060c-4b42-b4c2-6d91456da69b tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7794a38b003945ed983f6f5646e8d9d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f9a08dcafd945f4b24367c3bc43f764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:43.309381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c3537-060c-4b42-b4c2-6d91456da69b tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:43.310054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c3537-060c-4b42-b4c2-6d91456da69b tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:43.310585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c3537-060c-4b42-b4c2-6d91456da69b tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] PATH_INFO: `/v3/users/7794a38b003945ed983f6f5646e8d9d8/password` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:43.473458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9e9c3537-060c-4b42-b4c2-6d91456da69b tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7794a38b003945ed983f6f5646e8d9d8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:43.586769 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2268/4602] 10.222.0.43 () {60 vars in 1268 bytes} [Tue Jul 19 14:30:43 2022] POST /identity/v3/users/7794a38b003945ed983f6f5646e8d9d8/password => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:44.592033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26894e6e-781a-4399-b4d4-858376bfc1c3 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:44.592658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26894e6e-781a-4399-b4d4-858376bfc1c3 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:44.593168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26894e6e-781a-4399-b4d4-858376bfc1c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:44.624650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-26894e6e-781a-4399-b4d4-858376bfc1c3 None None] MFA Rules not processed for user `7794a38b003945ed983f6f5646e8d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:44.635399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-26894e6e-781a-4399-b4d4-858376bfc1c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:44.649718 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2335/4603] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:44 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 14:30:44.655154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6e4c5-e568-460c-929d-0a05e5c58331 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:44.655637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6e4c5-e568-460c-929d-0a05e5c58331 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:44.657286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f6e4c5-e568-460c-929d-0a05e5c58331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:44.702397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-60f6e4c5-e568-460c-929d-0a05e5c58331 None None] MFA Rules not processed for user `7794a38b003945ed983f6f5646e8d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:44.705431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-60f6e4c5-e568-460c-929d-0a05e5c58331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:44.725963 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2269/4604] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:44.727564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26894e6e-781a-4399-b4d4-858376bfc1c3 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:44.734751 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:INSERT=7,keystone:UPDATE=2,keystone:DELETE=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:44.745128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26894e6e-781a-4399-b4d4-858376bfc1c3 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:44.753906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aaf303-2829-4001-b3c5-809a03b25e32 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7794a38b003945ed983f6f5646e8d9d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f9a08dcafd945f4b24367c3bc43f764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:44.755236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aaf303-2829-4001-b3c5-809a03b25e32 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:44.755711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aaf303-2829-4001-b3c5-809a03b25e32 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:44.756155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aaf303-2829-4001-b3c5-809a03b25e32 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] PATH_INFO: `/v3/users/7794a38b003945ed983f6f5646e8d9d8/password` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:44.983252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f2aaf303-2829-4001-b3c5-809a03b25e32 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7794a38b003945ed983f6f5646e8d9d8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:45.076090 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2336/4605] 10.222.0.43 () {60 vars in 1268 bytes} [Tue Jul 19 14:30:44 2022] POST /identity/v3/users/7794a38b003945ed983f6f5646e8d9d8/password => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:46.084485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f236d8d-8b73-49fd-937c-d07a40c366de None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:46.086906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f236d8d-8b73-49fd-937c-d07a40c366de None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:46.087943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f236d8d-8b73-49fd-937c-d07a40c366de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:46.165591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8f236d8d-8b73-49fd-937c-d07a40c366de None None] MFA Rules not processed for user `7794a38b003945ed983f6f5646e8d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:46.165591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8f236d8d-8b73-49fd-937c-d07a40c366de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:46.182330 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2270/4606] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:46 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 14:30:46.188610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf0e78-b271-4e42-9c23-f8a7ee8cb411 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:46.188610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf0e78-b271-4e42-9c23-f8a7ee8cb411 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:46.188610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf0e78-b271-4e42-9c23-f8a7ee8cb411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:46.235919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0cdf0e78-b271-4e42-9c23-f8a7ee8cb411 None None] MFA Rules not processed for user `7794a38b003945ed983f6f5646e8d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:46.237383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0cdf0e78-b271-4e42-9c23-f8a7ee8cb411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:46.253649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f236d8d-8b73-49fd-937c-d07a40c366de None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:46.253801 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2337/4607] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:46.268098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f236d8d-8b73-49fd-937c-d07a40c366de None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:46.277417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52176243-a92d-47e1-b997-882dea31b023 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7794a38b003945ed983f6f5646e8d9d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5f9a08dcafd945f4b24367c3bc43f764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:46.278741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52176243-a92d-47e1-b997-882dea31b023 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:46.279238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52176243-a92d-47e1-b997-882dea31b023 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:46.279751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52176243-a92d-47e1-b997-882dea31b023 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] PATH_INFO: `/v3/users/7794a38b003945ed983f6f5646e8d9d8/password` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:46.414831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-52176243-a92d-47e1-b997-882dea31b023 tempest-IdentityV3UsersTest-899624653 tempest-IdentityV3UsersTest-899624653-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7794a38b003945ed983f6f5646e8d9d8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:46.506882 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2271/4608] 10.222.0.43 () {60 vars in 1268 bytes} [Tue Jul 19 14:30:46 2022] POST /identity/v3/users/7794a38b003945ed983f6f5646e8d9d8/password => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:47.512851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da2d6a-2879-43ec-82f3-158454397ab2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:47.517686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da2d6a-2879-43ec-82f3-158454397ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:47.517686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da2d6a-2879-43ec-82f3-158454397ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:47.552712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-18da2d6a-2879-43ec-82f3-158454397ab2 None None] MFA Rules not processed for user `7794a38b003945ed983f6f5646e8d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:47.552712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-18da2d6a-2879-43ec-82f3-158454397ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:47.557721 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2338/4609] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:47 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 14:30:48.264981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21cd09-f41a-41e2-9d03-394769a88573 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:48.268829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21cd09-f41a-41e2-9d03-394769a88573 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:48.269324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21cd09-f41a-41e2-9d03-394769a88573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:48.303719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-aa21cd09-f41a-41e2-9d03-394769a88573 None None] MFA Rules not processed for user `013b13b6d741411a95806dce36c2bd20`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:48.306997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aa21cd09-f41a-41e2-9d03-394769a88573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:48.384358 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:UPDATE=4,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:48.439536 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2272/4610] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:48.561344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9c7ab-a981-414a-9e89-f9f0fc33fa44 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:48.562424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9c7ab-a981-414a-9e89-f9f0fc33fa44 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:48.562735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc9c7ab-a981-414a-9e89-f9f0fc33fa44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:48.590328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5dc9c7ab-a981-414a-9e89-f9f0fc33fa44 None None] MFA Rules not processed for user `7794a38b003945ed983f6f5646e8d9d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:48.591746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5dc9c7ab-a981-414a-9e89-f9f0fc33fa44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:48.599807 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2339/4611] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:48.607531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21cd09-f41a-41e2-9d03-394769a88573 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:48.701549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21cd09-f41a-41e2-9d03-394769a88573 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:48.709185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efd0b5-c23f-4b8e-a3c0-902b22d80082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:48.710866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efd0b5-c23f-4b8e-a3c0-902b22d80082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:48.711323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efd0b5-c23f-4b8e-a3c0-902b22d80082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:48.711750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efd0b5-c23f-4b8e-a3c0-902b22d80082 admin admin] PATH_INFO: `/v3/users/7794a38b003945ed983f6f5646e8d9d8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:48.713587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0efd0b5-c23f-4b8e-a3c0-902b22d80082 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7794a38b003945ed983f6f5646e8d9d8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:48.719450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0efd0b5-c23f-4b8e-a3c0-902b22d80082 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:48.990557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f0efd0b5-c23f-4b8e-a3c0-902b22d80082 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7794a38b003945ed983f6f5646e8d9d8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:49.024243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f0efd0b5-c23f-4b8e-a3c0-902b22d80082 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7794a38b003945ed983f6f5646e8d9d8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:49.025352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f0efd0b5-c23f-4b8e-a3c0-902b22d80082 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7794a38b003945ed983f6f5646e8d9d8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:49.026064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f0efd0b5-c23f-4b8e-a3c0-902b22d80082 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7794a38b003945ed983f6f5646e8d9d8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:49.034343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f0efd0b5-c23f-4b8e-a3c0-902b22d80082 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7794a38b003945ed983f6f5646e8d9d8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:49.159144 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2273/4612] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:30:48 2022] DELETE /identity/v3/users/7794a38b003945ed983f6f5646e8d9d8 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:49.160492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b149a-e24e-49b7-b0df-de229888d985 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:49.160793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b149a-e24e-49b7-b0df-de229888d985 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:49.161077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b149a-e24e-49b7-b0df-de229888d985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:49.185584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f61b149a-e24e-49b7-b0df-de229888d985 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:49.187246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f61b149a-e24e-49b7-b0df-de229888d985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:49.275301 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2340/4613] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:30:49.309161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efd0b5-c23f-4b8e-a3c0-902b22d80082 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:49.310961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f0efd0b5-c23f-4b8e-a3c0-902b22d80082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:49.380997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efd0b5-c23f-4b8e-a3c0-902b22d80082 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:49.389875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf6bec-63a1-46a6-929b-1809b6f7e1b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:49.390605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6bec-63a1-46a6-929b-1809b6f7e1b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:49.390930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6bec-63a1-46a6-929b-1809b6f7e1b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:49.391224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf6bec-63a1-46a6-929b-1809b6f7e1b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:49.401970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf6bec-63a1-46a6-929b-1809b6f7e1b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:49.403586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf6bec-63a1-46a6-929b-1809b6f7e1b1 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:49.409981 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:49.416756 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2274/4614] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:30:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:30:50.917966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b149a-e24e-49b7-b0df-de229888d985 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:50.919812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f61b149a-e24e-49b7-b0df-de229888d985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:50.946839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b149a-e24e-49b7-b0df-de229888d985 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:50.956107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9ca732-27ee-4249-908e-35073770f702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:50.958202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ca732-27ee-4249-908e-35073770f702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:50.959645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ca732-27ee-4249-908e-35073770f702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:50.963188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9ca732-27ee-4249-908e-35073770f702 admin admin] PATH_INFO: `/v3/projects/5f9a08dcafd945f4b24367c3bc43f764` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:50.974469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ca732-27ee-4249-908e-35073770f702 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f9a08dcafd945f4b24367c3bc43f764)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:50.986421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9ca732-27ee-4249-908e-35073770f702 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:51.161510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4b9ca732-27ee-4249-908e-35073770f702 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f9a08dcafd945f4b24367c3bc43f764', 'request_id': 'req-4b9ca732-27ee-4249-908e-35073770f702'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:51.185054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4b9ca732-27ee-4249-908e-35073770f702 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f9a08dcafd945f4b24367c3bc43f764', 'request_id': 'req-4b9ca732-27ee-4249-908e-35073770f702'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:51.206456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4b9ca732-27ee-4249-908e-35073770f702 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f9a08dcafd945f4b24367c3bc43f764', 'request_id': 'req-4b9ca732-27ee-4249-908e-35073770f702'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:51.304874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4b9ca732-27ee-4249-908e-35073770f702 admin admin] The token cache is being invalidate because project 5f9a08dcafd945f4b24367c3bc43f764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:30:51.305208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4b9ca732-27ee-4249-908e-35073770f702 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:51.316819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4b9ca732-27ee-4249-908e-35073770f702 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:51.321141 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2341/4615] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:30:50 2022] DELETE /identity/v3/projects/5f9a08dcafd945f4b24367c3bc43f764 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:51.325545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5001b-883e-4a11-8c43-7426f96e0a01 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:51.326764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5001b-883e-4a11-8c43-7426f96e0a01 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:51.327273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a5001b-883e-4a11-8c43-7426f96e0a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:51.370965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-41a5001b-883e-4a11-8c43-7426f96e0a01 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:51.372443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-41a5001b-883e-4a11-8c43-7426f96e0a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:51.497946 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2275/4616] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:30:51.505813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12521270-fb04-4e6b-8c8b-8d59c36d311c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:51.506066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12521270-fb04-4e6b-8c8b-8d59c36d311c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:51.506386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12521270-fb04-4e6b-8c8b-8d59c36d311c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:51.532825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-12521270-fb04-4e6b-8c8b-8d59c36d311c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:51.534440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-12521270-fb04-4e6b-8c8b-8d59c36d311c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:51.556637 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2342/4617] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:51.560930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5001b-883e-4a11-8c43-7426f96e0a01 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:51.584602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a5001b-883e-4a11-8c43-7426f96e0a01 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:51.599531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc76e38-afda-477a-83f1-6bcdb0e12b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:51.600497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc76e38-afda-477a-83f1-6bcdb0e12b45 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:51.601026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc76e38-afda-477a-83f1-6bcdb0e12b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:51.601523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc76e38-afda-477a-83f1-6bcdb0e12b45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:51.602888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc76e38-afda-477a-83f1-6bcdb0e12b45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:30:51.609899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc76e38-afda-477a-83f1-6bcdb0e12b45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:51.611697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc76e38-afda-477a-83f1-6bcdb0e12b45 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:51.641880 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2276/4618] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:30:51.643669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12521270-fb04-4e6b-8c8b-8d59c36d311c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:51.655705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12521270-fb04-4e6b-8c8b-8d59c36d311c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:51.673133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1ff35-e9ad-48be-91ef-bf56413d2469 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:51.673133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1ff35-e9ad-48be-91ef-bf56413d2469 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:51.673133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1ff35-e9ad-48be-91ef-bf56413d2469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:51.681473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c08af-09ce-4e32-aa89-01b779c17820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:51.684511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c08af-09ce-4e32-aa89-01b779c17820 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:51.686383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c08af-09ce-4e32-aa89-01b779c17820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:51.686910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c08af-09ce-4e32-aa89-01b779c17820 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:51.688535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c08af-09ce-4e32-aa89-01b779c17820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:51.692616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c08af-09ce-4e32-aa89-01b779c17820 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:51.719657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-63d1ff35-e9ad-48be-91ef-bf56413d2469 None None] MFA Rules not processed for user `eee0949ddc584dcfb866960cbfb2ce43`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:51.723122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-63d1ff35-e9ad-48be-91ef-bf56413d2469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:51.840313 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2343/4619] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:30:51 2022] POST /identity/v3/projects => generated 397 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:30:51.841748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c08af-09ce-4e32-aa89-01b779c17820 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:51.849517 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:UPDATE=1,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:51.898825 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2277/4620] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:51.945385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c08af-09ce-4e32-aa89-01b779c17820 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:51.953386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76978b-f8a4-40e5-8900-88c8f459a19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:51.954415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76978b-f8a4-40e5-8900-88c8f459a19c admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:51.954865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76978b-f8a4-40e5-8900-88c8f459a19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:51.955304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76978b-f8a4-40e5-8900-88c8f459a19c admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:51.956181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76978b-f8a4-40e5-8900-88c8f459a19c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:51.959026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76978b-f8a4-40e5-8900-88c8f459a19c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:52.144077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1ff35-e9ad-48be-91ef-bf56413d2469 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:52.146746 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2344/4621] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:30:51 2022] POST /identity/v3/users => generated 305 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:30:52.166820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1ff35-e9ad-48be-91ef-bf56413d2469 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:52.174401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9bdb3-dde0-4275-8e20-79c307acda48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:52.175720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9bdb3-dde0-4275-8e20-79c307acda48 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:52.176023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9bdb3-dde0-4275-8e20-79c307acda48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:52.176307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9bdb3-dde0-4275-8e20-79c307acda48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:52.177064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9bdb3-dde0-4275-8e20-79c307acda48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:52.178792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9bdb3-dde0-4275-8e20-79c307acda48 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:52.224862 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2278/4622] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:30:52.229074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76978b-f8a4-40e5-8900-88c8f459a19c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:52.241081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76978b-f8a4-40e5-8900-88c8f459a19c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:52.259717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c1e12-1497-4604-a4c5-983a4072ec60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:52.261877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c1e12-1497-4604-a4c5-983a4072ec60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:52.261877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c1e12-1497-4604-a4c5-983a4072ec60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:52.261877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c1e12-1497-4604-a4c5-983a4072ec60 admin admin] PATH_INFO: `/v3/projects/8a88ffbb15ff45bb917175f8372df66e/users/051627b43cc3400db328031e619fa362/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:52.299387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c1e12-1497-4604-a4c5-983a4072ec60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a88ffbb15ff45bb917175f8372df66e, user_id=051627b43cc3400db328031e619fa362, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:52.302274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c1e12-1497-4604-a4c5-983a4072ec60 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:52.434740 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2345/4623] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:30:52 2022] PUT /identity/v3/projects/8a88ffbb15ff45bb917175f8372df66e/users/051627b43cc3400db328031e619fa362/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:30:52.436017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9bdb3-dde0-4275-8e20-79c307acda48 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:52.452062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9bdb3-dde0-4275-8e20-79c307acda48 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:52.533577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40dfc9b-f5b6-4e62-9210-1bb84107c854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:52.539248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dfc9b-f5b6-4e62-9210-1bb84107c854 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:52.539248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dfc9b-f5b6-4e62-9210-1bb84107c854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:52.539248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dfc9b-f5b6-4e62-9210-1bb84107c854 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:52.539248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40dfc9b-f5b6-4e62-9210-1bb84107c854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:52.539248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40dfc9b-f5b6-4e62-9210-1bb84107c854 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:52.562635 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2279/4624] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:30:52.566949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c1e12-1497-4604-a4c5-983a4072ec60 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:52.583519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c1e12-1497-4604-a4c5-983a4072ec60 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:52.590158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bc533-89ef-454b-8d36-24d485a73ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:52.591107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bc533-89ef-454b-8d36-24d485a73ab7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:52.591455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bc533-89ef-454b-8d36-24d485a73ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:52.591733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505bc533-89ef-454b-8d36-24d485a73ab7 admin admin] PATH_INFO: `/v3/projects/8a88ffbb15ff45bb917175f8372df66e/users/051627b43cc3400db328031e619fa362/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:52.593908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505bc533-89ef-454b-8d36-24d485a73ab7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a88ffbb15ff45bb917175f8372df66e, user_id=051627b43cc3400db328031e619fa362, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:52.597014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505bc533-89ef-454b-8d36-24d485a73ab7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:52.614875 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2346/4625] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:30:52 2022] PUT /identity/v3/projects/8a88ffbb15ff45bb917175f8372df66e/users/051627b43cc3400db328031e619fa362/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:52.629100 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4989fbf-c5f8-4880-99b8-f519f0600ada None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:52.629493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4989fbf-c5f8-4880-99b8-f519f0600ada None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:52.629831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4989fbf-c5f8-4880-99b8-f519f0600ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:52.653274 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:52.668348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c4989fbf-c5f8-4880-99b8-f519f0600ada None None] MFA Rules not processed for user `051627b43cc3400db328031e619fa362`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:52.670509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c4989fbf-c5f8-4880-99b8-f519f0600ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:52.853372 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2280/4626] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:52.857854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bc533-89ef-454b-8d36-24d485a73ab7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:52.985017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505bc533-89ef-454b-8d36-24d485a73ab7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:52.990706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4296b4-92a3-4171-ac0b-8fc91140d795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:52.991641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4296b4-92a3-4171-ac0b-8fc91140d795 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:52.992080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4296b4-92a3-4171-ac0b-8fc91140d795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:52.996001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4296b4-92a3-4171-ac0b-8fc91140d795 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:52.996001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4296b4-92a3-4171-ac0b-8fc91140d795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:52.996001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4296b4-92a3-4171-ac0b-8fc91140d795 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:53.228726 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2347/4627] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:30:52 2022] POST /identity/v3/projects => generated 395 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:30:53.232676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4989fbf-c5f8-4880-99b8-f519f0600ada None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:53.262506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4989fbf-c5f8-4880-99b8-f519f0600ada None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:53.337185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed4822-d174-4322-99bf-a957af1fa781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:53.338356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed4822-d174-4322-99bf-a957af1fa781 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:53.345798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed4822-d174-4322-99bf-a957af1fa781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:53.345798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ed4822-d174-4322-99bf-a957af1fa781 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:53.345798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed4822-d174-4322-99bf-a957af1fa781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:53.345798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ed4822-d174-4322-99bf-a957af1fa781 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:53.455926 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2281/4628] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:30:53 2022] POST /identity/v3/users => generated 298 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:30:53.460255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4296b4-92a3-4171-ac0b-8fc91140d795 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:53.476186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4296b4-92a3-4171-ac0b-8fc91140d795 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:53.489019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bf076-295a-4806-b027-d9f24f9dd4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:53.489974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bf076-295a-4806-b027-d9f24f9dd4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:53.490289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bf076-295a-4806-b027-d9f24f9dd4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:53.490569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0bf076-295a-4806-b027-d9f24f9dd4c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:53.491321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0bf076-295a-4806-b027-d9f24f9dd4c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:53.499277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0bf076-295a-4806-b027-d9f24f9dd4c6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:53.529599 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2348/4629] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:30:53.529888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed4822-d174-4322-99bf-a957af1fa781 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:53.544643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ed4822-d174-4322-99bf-a957af1fa781 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:53.570904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b414c09-18f1-466f-b80e-43735e911ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:53.571833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b414c09-18f1-466f-b80e-43735e911ab1 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:53.572314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b414c09-18f1-466f-b80e-43735e911ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:53.572604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b414c09-18f1-466f-b80e-43735e911ab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:53.573365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b414c09-18f1-466f-b80e-43735e911ab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:53.578393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b414c09-18f1-466f-b80e-43735e911ab1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:53.631652 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2282/4630] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:30:53 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:30:53.636669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bf076-295a-4806-b027-d9f24f9dd4c6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:53.662440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0bf076-295a-4806-b027-d9f24f9dd4c6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:53.686863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c5e65-8e4a-4cb3-a314-83e5d4960b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:53.687848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c5e65-8e4a-4cb3-a314-83e5d4960b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:53.688136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c5e65-8e4a-4cb3-a314-83e5d4960b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:53.688415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c5e65-8e4a-4cb3-a314-83e5d4960b53 admin admin] PATH_INFO: `/v3/projects/446a7b60062a4831969b45e0141807b2/users/034c6bbb842741868c32345f8b08404e/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:53.764973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c5e65-8e4a-4cb3-a314-83e5d4960b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=446a7b60062a4831969b45e0141807b2, user_id=034c6bbb842741868c32345f8b08404e, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:53.770930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7c5e65-8e4a-4cb3-a314-83e5d4960b53 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:53.889188 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2349/4631] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:30:53 2022] PUT /identity/v3/projects/446a7b60062a4831969b45e0141807b2/users/034c6bbb842741868c32345f8b08404e/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:53.900233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11323d62-7e59-4426-8cbe-7ce58ff92913 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:53.900533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11323d62-7e59-4426-8cbe-7ce58ff92913 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:53.900816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11323d62-7e59-4426-8cbe-7ce58ff92913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:53.938938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-11323d62-7e59-4426-8cbe-7ce58ff92913 None None] MFA Rules not processed for user `034c6bbb842741868c32345f8b08404e`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:53.940460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-11323d62-7e59-4426-8cbe-7ce58ff92913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:54.070051 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2283/4632] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:30:54.084068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c5e65-8e4a-4cb3-a314-83e5d4960b53 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:54.088252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8b7c5e65-8e4a-4cb3-a314-83e5d4960b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:54.102378 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:54.206679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c5e65-8e4a-4cb3-a314-83e5d4960b53 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:54.235034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c018e71-933d-498e-8006-abbc4c4e7391 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:54.235890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c018e71-933d-498e-8006-abbc4c4e7391 service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:54.237262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c018e71-933d-498e-8006-abbc4c4e7391 service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:54.237548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c018e71-933d-498e-8006-abbc4c4e7391 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:54.332591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c018e71-933d-498e-8006-abbc4c4e7391 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:54.332591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c018e71-933d-498e-8006-abbc4c4e7391 service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:54.342133 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2350/4633] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:30:54 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:30:55.604099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11323d62-7e59-4426-8cbe-7ce58ff92913 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:55.607932 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:55.704750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11323d62-7e59-4426-8cbe-7ce58ff92913 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:55.716432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08e752-f616-4d12-b974-99a4564dbf9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:55.717766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08e752-f616-4d12-b974-99a4564dbf9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:55.719813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08e752-f616-4d12-b974-99a4564dbf9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:55.720109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08e752-f616-4d12-b974-99a4564dbf9d admin admin] PATH_INFO: `/v3/users/051627b43cc3400db328031e619fa362` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:55.721438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08e752-f616-4d12-b974-99a4564dbf9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=051627b43cc3400db328031e619fa362)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:55.723500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08e752-f616-4d12-b974-99a4564dbf9d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:55.979044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bd08e752-f616-4d12-b974-99a4564dbf9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '051627b43cc3400db328031e619fa362'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:56.001664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bd08e752-f616-4d12-b974-99a4564dbf9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '051627b43cc3400db328031e619fa362'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:56.004158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bd08e752-f616-4d12-b974-99a4564dbf9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '051627b43cc3400db328031e619fa362'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:56.005043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bd08e752-f616-4d12-b974-99a4564dbf9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '051627b43cc3400db328031e619fa362'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:56.016876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bd08e752-f616-4d12-b974-99a4564dbf9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '051627b43cc3400db328031e619fa362'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:56.107025 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2284/4634] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:30:55 2022] DELETE /identity/v3/users/051627b43cc3400db328031e619fa362 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:56.111724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684a251-eb1b-40e8-984c-0e4e9cfc33f9 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:56.112225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684a251-eb1b-40e8-984c-0e4e9cfc33f9 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:56.112344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0684a251-eb1b-40e8-984c-0e4e9cfc33f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:56.140085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0684a251-eb1b-40e8-984c-0e4e9cfc33f9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:56.141397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0684a251-eb1b-40e8-984c-0e4e9cfc33f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:56.258914 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2351/4635] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:30:56.289900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08e752-f616-4d12-b974-99a4564dbf9d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:56.291441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bd08e752-f616-4d12-b974-99a4564dbf9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:56.401067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08e752-f616-4d12-b974-99a4564dbf9d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:56.405264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768cfc3-5498-4709-80c8-217dae54741b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:56.406012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768cfc3-5498-4709-80c8-217dae54741b service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:56.406328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768cfc3-5498-4709-80c8-217dae54741b service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:56.406611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768cfc3-5498-4709-80c8-217dae54741b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:56.425543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768cfc3-5498-4709-80c8-217dae54741b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:56.427166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768cfc3-5498-4709-80c8-217dae54741b service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:56.439700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb850e-e770-4ba0-b553-c739fc414559 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:56.439700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb850e-e770-4ba0-b553-c739fc414559 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:56.440068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afb850e-e770-4ba0-b553-c739fc414559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:56.452241 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2285/4636] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:30:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:30:56.511420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4afb850e-e770-4ba0-b553-c739fc414559 None None] MFA Rules not processed for user `3b2c539fb4064555a2ba7e63ae395bd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:30:56.512688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4afb850e-e770-4ba0-b553-c739fc414559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:56.627651 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:56.701513 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2352/4637] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:30:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:30:56.709696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768cfc3-5498-4709-80c8-217dae54741b service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:56.712964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d768cfc3-5498-4709-80c8-217dae54741b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:56.808708 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:56.941622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768cfc3-5498-4709-80c8-217dae54741b service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:56.957508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192dbf0-13f0-4fab-a53d-d2fe0ad8d7ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:56.959573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192dbf0-13f0-4fab-a53d-d2fe0ad8d7ae service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:56.966758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192dbf0-13f0-4fab-a53d-d2fe0ad8d7ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:56.967233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b192dbf0-13f0-4fab-a53d-d2fe0ad8d7ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:56.972347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b192dbf0-13f0-4fab-a53d-d2fe0ad8d7ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:57.122245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192dbf0-13f0-4fab-a53d-d2fe0ad8d7ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:57.124130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b192dbf0-13f0-4fab-a53d-d2fe0ad8d7ae service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:57.148525 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2286/4638] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:30:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:30:58.602532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb850e-e770-4ba0-b553-c739fc414559 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:58.604549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4afb850e-e770-4ba0-b553-c739fc414559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:30:58.633763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afb850e-e770-4ba0-b553-c739fc414559 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:58.669350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ead50-da69-4528-a483-1e6b4a19ba8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:58.671399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ead50-da69-4528-a483-1e6b4a19ba8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:58.671862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ead50-da69-4528-a483-1e6b4a19ba8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:58.673217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ead50-da69-4528-a483-1e6b4a19ba8b admin admin] PATH_INFO: `/v3/projects/8a88ffbb15ff45bb917175f8372df66e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:58.681565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ead50-da69-4528-a483-1e6b4a19ba8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a88ffbb15ff45bb917175f8372df66e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:58.687675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ead50-da69-4528-a483-1e6b4a19ba8b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:58.886281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e53ead50-da69-4528-a483-1e6b4a19ba8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a88ffbb15ff45bb917175f8372df66e', 'request_id': 'req-e53ead50-da69-4528-a483-1e6b4a19ba8b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:58.897434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e53ead50-da69-4528-a483-1e6b4a19ba8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a88ffbb15ff45bb917175f8372df66e', 'request_id': 'req-e53ead50-da69-4528-a483-1e6b4a19ba8b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:58.921070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e53ead50-da69-4528-a483-1e6b4a19ba8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a88ffbb15ff45bb917175f8372df66e', 'request_id': 'req-e53ead50-da69-4528-a483-1e6b4a19ba8b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:59.057504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e53ead50-da69-4528-a483-1e6b4a19ba8b admin admin] The token cache is being invalidate because project 8a88ffbb15ff45bb917175f8372df66e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:30:59.058593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e53ead50-da69-4528-a483-1e6b4a19ba8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:59.061126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e53ead50-da69-4528-a483-1e6b4a19ba8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:59.067938 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2353/4639] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:30:58 2022] DELETE /identity/v3/projects/8a88ffbb15ff45bb917175f8372df66e => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:30:59.068820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192dbf0-13f0-4fab-a53d-d2fe0ad8d7ae service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:30:59.088630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b192dbf0-13f0-4fab-a53d-d2fe0ad8d7ae service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:30:59.322848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29eec25-52fb-4a6e-943d-69cd649876ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:30:59.323869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29eec25-52fb-4a6e-943d-69cd649876ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:30:59.324155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29eec25-52fb-4a6e-943d-69cd649876ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:30:59.324429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29eec25-52fb-4a6e-943d-69cd649876ae admin admin] PATH_INFO: `/v3/users/034c6bbb842741868c32345f8b08404e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:30:59.327681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29eec25-52fb-4a6e-943d-69cd649876ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=034c6bbb842741868c32345f8b08404e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:30:59.332440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29eec25-52fb-4a6e-943d-69cd649876ae admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:30:59.646495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a29eec25-52fb-4a6e-943d-69cd649876ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '034c6bbb842741868c32345f8b08404e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:59.676438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a29eec25-52fb-4a6e-943d-69cd649876ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '034c6bbb842741868c32345f8b08404e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:59.678880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a29eec25-52fb-4a6e-943d-69cd649876ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '034c6bbb842741868c32345f8b08404e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:59.678880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a29eec25-52fb-4a6e-943d-69cd649876ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '034c6bbb842741868c32345f8b08404e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:59.717236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a29eec25-52fb-4a6e-943d-69cd649876ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '034c6bbb842741868c32345f8b08404e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:30:59.825560 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:30:59.834368 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2287/4640] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:30:59 2022] DELETE /identity/v3/users/034c6bbb842741868c32345f8b08404e => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:31:00.655457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ead50-da69-4528-a483-1e6b4a19ba8b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:00.658001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e53ead50-da69-4528-a483-1e6b4a19ba8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:00.827506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ead50-da69-4528-a483-1e6b4a19ba8b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:01.006848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e32ae-9315-4cc4-ba23-487ce91a993d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:01.008255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e32ae-9315-4cc4-ba23-487ce91a993d service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:01.008813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e32ae-9315-4cc4-ba23-487ce91a993d service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:01.009367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e32ae-9315-4cc4-ba23-487ce91a993d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:01.012584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d50e32ae-9315-4cc4-ba23-487ce91a993d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:01.296598 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:31:01.296598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e32ae-9315-4cc4-ba23-487ce91a993d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:01.296598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e32ae-9315-4cc4-ba23-487ce91a993d service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:01.296598 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2354/4641] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:31:02.067730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29eec25-52fb-4a6e-943d-69cd649876ae admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:02.072202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a29eec25-52fb-4a6e-943d-69cd649876ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:02.114337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29eec25-52fb-4a6e-943d-69cd649876ae admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:02.133363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd1ac3d-020e-4da0-9802-7cfd6730166e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:02.135190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1ac3d-020e-4da0-9802-7cfd6730166e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:02.136556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1ac3d-020e-4da0-9802-7cfd6730166e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:02.148555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd1ac3d-020e-4da0-9802-7cfd6730166e admin admin] PATH_INFO: `/v3/projects/446a7b60062a4831969b45e0141807b2` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:02.152954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1ac3d-020e-4da0-9802-7cfd6730166e admin admin] RBAC: Authorizing `identity:delete_project(project_id=446a7b60062a4831969b45e0141807b2)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:02.157102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd1ac3d-020e-4da0-9802-7cfd6730166e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:02.392071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bdd1ac3d-020e-4da0-9802-7cfd6730166e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '446a7b60062a4831969b45e0141807b2', 'request_id': 'req-bdd1ac3d-020e-4da0-9802-7cfd6730166e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:02.515386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bdd1ac3d-020e-4da0-9802-7cfd6730166e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '446a7b60062a4831969b45e0141807b2', 'request_id': 'req-bdd1ac3d-020e-4da0-9802-7cfd6730166e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:02.527103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bdd1ac3d-020e-4da0-9802-7cfd6730166e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '446a7b60062a4831969b45e0141807b2', 'request_id': 'req-bdd1ac3d-020e-4da0-9802-7cfd6730166e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:02.547625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bdd1ac3d-020e-4da0-9802-7cfd6730166e admin admin] The token cache is being invalidate because project 446a7b60062a4831969b45e0141807b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:31:02.548080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bdd1ac3d-020e-4da0-9802-7cfd6730166e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:02.548935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bdd1ac3d-020e-4da0-9802-7cfd6730166e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:02.551772 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2288/4642] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:31:02 2022] DELETE /identity/v3/projects/446a7b60062a4831969b45e0141807b2 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:31:02.557010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66e297-c472-458c-bc87-bf96626f58b3 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:02.557469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66e297-c472-458c-bc87-bf96626f58b3 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:02.557570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66e297-c472-458c-bc87-bf96626f58b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:02.589103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5b66e297-c472-458c-bc87-bf96626f58b3 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:31:02.594169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5b66e297-c472-458c-bc87-bf96626f58b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:02.793209 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2355/4643] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:31:02.795161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00762eb2-c833-4ed3-bc91-2bd4d9214f07 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:02.795482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00762eb2-c833-4ed3-bc91-2bd4d9214f07 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:02.795786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00762eb2-c833-4ed3-bc91-2bd4d9214f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:02.843374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-00762eb2-c833-4ed3-bc91-2bd4d9214f07 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:31:02.852585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-00762eb2-c833-4ed3-bc91-2bd4d9214f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:02.874190 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2289/4644] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:31:02.878582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66e297-c472-458c-bc87-bf96626f58b3 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:02.891819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66e297-c472-458c-bc87-bf96626f58b3 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:02.909957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9197212-541b-4456-9272-b9109b2c5a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:02.911979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9197212-541b-4456-9272-b9109b2c5a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:02.912405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9197212-541b-4456-9272-b9109b2c5a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:02.915030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9197212-541b-4456-9272-b9109b2c5a9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:02.923171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9197212-541b-4456-9272-b9109b2c5a9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:31:02.923171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9197212-541b-4456-9272-b9109b2c5a9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:02.928003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9197212-541b-4456-9272-b9109b2c5a9c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:02.944648 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2356/4645] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:31:02.949077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00762eb2-c833-4ed3-bc91-2bd4d9214f07 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:02.966171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00762eb2-c833-4ed3-bc91-2bd4d9214f07 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:02.978523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527de529-7dc6-4172-b2ea-832258cf50eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:02.980649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527de529-7dc6-4172-b2ea-832258cf50eb admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:02.982396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527de529-7dc6-4172-b2ea-832258cf50eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:02.983004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527de529-7dc6-4172-b2ea-832258cf50eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:02.984242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527de529-7dc6-4172-b2ea-832258cf50eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:02.989629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527de529-7dc6-4172-b2ea-832258cf50eb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:03.085446 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2290/4646] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:31:02 2022] POST /identity/v3/projects => generated 359 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:31:03.089371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9197212-541b-4456-9272-b9109b2c5a9c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:03.107832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9197212-541b-4456-9272-b9109b2c5a9c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:03.217758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7444738-b6b8-4829-a0f9-8d43b4e6e525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:03.234205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7444738-b6b8-4829-a0f9-8d43b4e6e525 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:03.236829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7444738-b6b8-4829-a0f9-8d43b4e6e525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:03.237410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7444738-b6b8-4829-a0f9-8d43b4e6e525 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:03.239172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7444738-b6b8-4829-a0f9-8d43b4e6e525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:03.244893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7444738-b6b8-4829-a0f9-8d43b4e6e525 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:03.406684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527de529-7dc6-4172-b2ea-832258cf50eb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:03.414832 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2357/4647] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:31:03 2022] POST /identity/v3/users => generated 280 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:31:03.427123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527de529-7dc6-4172-b2ea-832258cf50eb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:03.439585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d84337-1242-4d90-88c7-d055fba5a8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:03.440622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d84337-1242-4d90-88c7-d055fba5a8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:03.441855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d84337-1242-4d90-88c7-d055fba5a8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:03.442321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d84337-1242-4d90-88c7-d055fba5a8d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:03.445485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d84337-1242-4d90-88c7-d055fba5a8d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:03.449233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d84337-1242-4d90-88c7-d055fba5a8d6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:03.466460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7444738-b6b8-4829-a0f9-8d43b4e6e525 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:03.467840 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2291/4648] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:31:03.484146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7444738-b6b8-4829-a0f9-8d43b4e6e525 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:03.493350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d52e55e-d184-45b5-bff8-9c2c904b6466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:03.497036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52e55e-d184-45b5-bff8-9c2c904b6466 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:03.497036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52e55e-d184-45b5-bff8-9c2c904b6466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:03.497036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d52e55e-d184-45b5-bff8-9c2c904b6466 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:03.497036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52e55e-d184-45b5-bff8-9c2c904b6466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:03.498025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d52e55e-d184-45b5-bff8-9c2c904b6466 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:03.535358 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2358/4649] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:31:03 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:31:03.540308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d84337-1242-4d90-88c7-d055fba5a8d6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:03.553340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d84337-1242-4d90-88c7-d055fba5a8d6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:03.576620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e70c0-8be3-4d08-96ea-dc5c71a24752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:03.577938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e70c0-8be3-4d08-96ea-dc5c71a24752 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:03.578356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e70c0-8be3-4d08-96ea-dc5c71a24752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:03.578738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e70c0-8be3-4d08-96ea-dc5c71a24752 admin admin] PATH_INFO: `/v3/projects/1ab1804d44cd425b85ee20cc32c9b0bf/users/889c9ae62d65446b8c2e88383941bade/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:03.613423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e70c0-8be3-4d08-96ea-dc5c71a24752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab1804d44cd425b85ee20cc32c9b0bf, user_id=889c9ae62d65446b8c2e88383941bade, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:03.623368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e70c0-8be3-4d08-96ea-dc5c71a24752 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:03.733267 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2292/4650] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:31:03 2022] PUT /identity/v3/projects/1ab1804d44cd425b85ee20cc32c9b0bf/users/889c9ae62d65446b8c2e88383941bade/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:31:03.750474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541f895-8ebc-47f2-8db4-bb1c4ddcbf09 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:03.750982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541f895-8ebc-47f2-8db4-bb1c4ddcbf09 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:03.751776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541f895-8ebc-47f2-8db4-bb1c4ddcbf09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:03.812637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d541f895-8ebc-47f2-8db4-bb1c4ddcbf09 None None] MFA Rules not processed for user `889c9ae62d65446b8c2e88383941bade`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:31:03.814740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d541f895-8ebc-47f2-8db4-bb1c4ddcbf09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:03.858957 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:31:03.909508 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2359/4651] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:31:03 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:31:03.927806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e70c0-8be3-4d08-96ea-dc5c71a24752 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:04.091566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e70c0-8be3-4d08-96ea-dc5c71a24752 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:04.108291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036cedc-1c8d-48b5-acd3-2e431159f848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:04.111953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036cedc-1c8d-48b5-acd3-2e431159f848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:04.111953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036cedc-1c8d-48b5-acd3-2e431159f848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:04.111953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a036cedc-1c8d-48b5-acd3-2e431159f848 admin admin] PATH_INFO: `/v3/users/889c9ae62d65446b8c2e88383941bade` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:04.111953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036cedc-1c8d-48b5-acd3-2e431159f848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=889c9ae62d65446b8c2e88383941bade)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:04.113018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a036cedc-1c8d-48b5-acd3-2e431159f848 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:04.147908 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:31:04.357521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a036cedc-1c8d-48b5-acd3-2e431159f848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '889c9ae62d65446b8c2e88383941bade'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:04.403531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a036cedc-1c8d-48b5-acd3-2e431159f848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '889c9ae62d65446b8c2e88383941bade'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:04.404550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a036cedc-1c8d-48b5-acd3-2e431159f848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '889c9ae62d65446b8c2e88383941bade'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:04.405175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a036cedc-1c8d-48b5-acd3-2e431159f848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '889c9ae62d65446b8c2e88383941bade'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:04.418778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a036cedc-1c8d-48b5-acd3-2e431159f848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '889c9ae62d65446b8c2e88383941bade'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:04.512957 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2293/4652] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:31:03 2022] DELETE /identity/v3/users/889c9ae62d65446b8c2e88383941bade => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:31:04.516583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0547c58-5ba2-4fa6-af5a-15bb7a12c884 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:04.517686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0547c58-5ba2-4fa6-af5a-15bb7a12c884 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:04.521086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0547c58-5ba2-4fa6-af5a-15bb7a12c884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:04.571752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a0547c58-5ba2-4fa6-af5a-15bb7a12c884 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:31:04.571752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a0547c58-5ba2-4fa6-af5a-15bb7a12c884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:04.678511 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2360/4653] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:31:04.703407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036cedc-1c8d-48b5-acd3-2e431159f848 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:04.709542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a036cedc-1c8d-48b5-acd3-2e431159f848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:04.814198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a036cedc-1c8d-48b5-acd3-2e431159f848 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:04.818688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e74b00-0033-4890-84cf-49d19fbc9085 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:04.819439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e74b00-0033-4890-84cf-49d19fbc9085 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:04.819903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e74b00-0033-4890-84cf-49d19fbc9085 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:04.820330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e74b00-0033-4890-84cf-49d19fbc9085 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:04.830963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e74b00-0033-4890-84cf-49d19fbc9085 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:04.832726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e74b00-0033-4890-84cf-49d19fbc9085 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:04.876098 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2294/4654] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:31:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:31:06.427388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0547c58-5ba2-4fa6-af5a-15bb7a12c884 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:06.430330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a0547c58-5ba2-4fa6-af5a-15bb7a12c884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:06.463275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0547c58-5ba2-4fa6-af5a-15bb7a12c884 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:06.496053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241049a4-807c-4ebb-873f-0b18a4db684c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:06.497073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241049a4-807c-4ebb-873f-0b18a4db684c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:06.497362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241049a4-807c-4ebb-873f-0b18a4db684c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:06.500869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241049a4-807c-4ebb-873f-0b18a4db684c admin admin] PATH_INFO: `/v3/projects/1ab1804d44cd425b85ee20cc32c9b0bf` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:06.509196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241049a4-807c-4ebb-873f-0b18a4db684c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ab1804d44cd425b85ee20cc32c9b0bf)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:06.512164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241049a4-807c-4ebb-873f-0b18a4db684c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:06.949534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-241049a4-807c-4ebb-873f-0b18a4db684c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ab1804d44cd425b85ee20cc32c9b0bf', 'request_id': 'req-241049a4-807c-4ebb-873f-0b18a4db684c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:06.956315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-241049a4-807c-4ebb-873f-0b18a4db684c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ab1804d44cd425b85ee20cc32c9b0bf', 'request_id': 'req-241049a4-807c-4ebb-873f-0b18a4db684c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:06.969892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-241049a4-807c-4ebb-873f-0b18a4db684c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ab1804d44cd425b85ee20cc32c9b0bf', 'request_id': 'req-241049a4-807c-4ebb-873f-0b18a4db684c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:07.074128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-241049a4-807c-4ebb-873f-0b18a4db684c admin admin] The token cache is being invalidate because project 1ab1804d44cd425b85ee20cc32c9b0bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:31:07.074128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-241049a4-807c-4ebb-873f-0b18a4db684c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:07.074128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-241049a4-807c-4ebb-873f-0b18a4db684c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:07.075210 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2361/4655] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:31:06 2022] DELETE /identity/v3/projects/1ab1804d44cd425b85ee20cc32c9b0bf => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:31:07.080240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832d2e3-a346-4ef7-8223-ddf1538ebaec None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:07.080787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832d2e3-a346-4ef7-8223-ddf1538ebaec None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:07.080787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832d2e3-a346-4ef7-8223-ddf1538ebaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:07.152816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f832d2e3-a346-4ef7-8223-ddf1538ebaec None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:31:07.154133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f832d2e3-a346-4ef7-8223-ddf1538ebaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:07.437494 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2295/4656] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:31:07.444472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa387e-a79c-4fb6-8fed-0a711483d2c3 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:07.445749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa387e-a79c-4fb6-8fed-0a711483d2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:07.446237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa387e-a79c-4fb6-8fed-0a711483d2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:07.488426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f3fa387e-a79c-4fb6-8fed-0a711483d2c3 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:31:07.490621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f3fa387e-a79c-4fb6-8fed-0a711483d2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:07.517300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832d2e3-a346-4ef7-8223-ddf1538ebaec None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:07.517840 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2362/4657] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:31:07.538855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832d2e3-a346-4ef7-8223-ddf1538ebaec None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:07.545814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd97fc-76a7-4457-8d5c-d45067aed974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:07.546889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd97fc-76a7-4457-8d5c-d45067aed974 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:07.547395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd97fc-76a7-4457-8d5c-d45067aed974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:07.547886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fd97fc-76a7-4457-8d5c-d45067aed974 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:07.548978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd97fc-76a7-4457-8d5c-d45067aed974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:31:07.549855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd97fc-76a7-4457-8d5c-d45067aed974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:07.553330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fd97fc-76a7-4457-8d5c-d45067aed974 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:07.596092 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2296/4658] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:31:07.599557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa387e-a79c-4fb6-8fed-0a711483d2c3 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:07.617116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa387e-a79c-4fb6-8fed-0a711483d2c3 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:07.633200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b29eac-d0d3-400b-95c2-a2654a8616ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:07.634349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b29eac-d0d3-400b-95c2-a2654a8616ba admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:07.634737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b29eac-d0d3-400b-95c2-a2654a8616ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:07.635117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b29eac-d0d3-400b-95c2-a2654a8616ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:07.636358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b29eac-d0d3-400b-95c2-a2654a8616ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:07.645646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b29eac-d0d3-400b-95c2-a2654a8616ba admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:07.832335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd97fc-76a7-4457-8d5c-d45067aed974 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:07.855602 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2363/4659] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:31:07 2022] POST /identity/v3/projects => generated 367 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:31:07.866342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fd97fc-76a7-4457-8d5c-d45067aed974 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:07.918449 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:31:07.981618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51f159-d78d-4f5f-bc03-1a5f9f340bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:07.982424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51f159-d78d-4f5f-bc03-1a5f9f340bda admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:07.982778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51f159-d78d-4f5f-bc03-1a5f9f340bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:07.983127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b51f159-d78d-4f5f-bc03-1a5f9f340bda admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:07.983899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51f159-d78d-4f5f-bc03-1a5f9f340bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:07.985940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b51f159-d78d-4f5f-bc03-1a5f9f340bda admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:08.087843 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2297/4660] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:31:07 2022] POST /identity/v3/users => generated 284 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:31:08.092053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b29eac-d0d3-400b-95c2-a2654a8616ba admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:08.122919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b29eac-d0d3-400b-95c2-a2654a8616ba admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:08.145692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9862f-206b-4dd9-9eef-c72dfa954b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:08.150701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9862f-206b-4dd9-9eef-c72dfa954b81 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:08.150701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9862f-206b-4dd9-9eef-c72dfa954b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:08.150701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9862f-206b-4dd9-9eef-c72dfa954b81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:08.150701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9862f-206b-4dd9-9eef-c72dfa954b81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:08.150701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9862f-206b-4dd9-9eef-c72dfa954b81 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:08.181695 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51f159-d78d-4f5f-bc03-1a5f9f340bda admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:08.189137 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2364/4661] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:31:08.192769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b51f159-d78d-4f5f-bc03-1a5f9f340bda admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:08.200920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d2a75-fde3-434a-9082-fef39d0a53e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:08.205310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d2a75-fde3-434a-9082-fef39d0a53e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:08.205310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d2a75-fde3-434a-9082-fef39d0a53e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:08.205310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d2a75-fde3-434a-9082-fef39d0a53e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:08.205310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d2a75-fde3-434a-9082-fef39d0a53e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:08.205310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d2a75-fde3-434a-9082-fef39d0a53e7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:08.232482 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2298/4662] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:31:08.237080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9862f-206b-4dd9-9eef-c72dfa954b81 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:08.255667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9862f-206b-4dd9-9eef-c72dfa954b81 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:08.266982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569732a-9d27-4c71-8f59-2c7c2e2970fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:08.267950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569732a-9d27-4c71-8f59-2c7c2e2970fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:08.268374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569732a-9d27-4c71-8f59-2c7c2e2970fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:08.268533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1569732a-9d27-4c71-8f59-2c7c2e2970fc admin admin] PATH_INFO: `/v3/projects/7d715ed5bbb34e03ad01c9038235d345/users/548555cc4c4447edbcffd44f52455bd0/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:08.285330 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:31:08.323775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569732a-9d27-4c71-8f59-2c7c2e2970fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d715ed5bbb34e03ad01c9038235d345, user_id=548555cc4c4447edbcffd44f52455bd0, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:08.326777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1569732a-9d27-4c71-8f59-2c7c2e2970fc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:08.464809 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2365/4663] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:31:08 2022] PUT /identity/v3/projects/7d715ed5bbb34e03ad01c9038235d345/users/548555cc4c4447edbcffd44f52455bd0/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:31:08.487145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa150984-1c67-43a3-9d01-fe4f258e250b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:08.487294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa150984-1c67-43a3-9d01-fe4f258e250b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:08.487595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa150984-1c67-43a3-9d01-fe4f258e250b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:08.596689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-fa150984-1c67-43a3-9d01-fe4f258e250b None None] MFA Rules not processed for user `548555cc4c4447edbcffd44f52455bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:31:08.598931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fa150984-1c67-43a3-9d01-fe4f258e250b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:08.765265 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2299/4664] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:31:08 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:31:08.770339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569732a-9d27-4c71-8f59-2c7c2e2970fc admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:08.996830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1569732a-9d27-4c71-8f59-2c7c2e2970fc admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:09.012178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7293b9-d942-44e4-bde2-407a21e65f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:09.013093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7293b9-d942-44e4-bde2-407a21e65f19 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:09.013390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7293b9-d942-44e4-bde2-407a21e65f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:09.013674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7293b9-d942-44e4-bde2-407a21e65f19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:09.014415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7293b9-d942-44e4-bde2-407a21e65f19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:09.019361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7293b9-d942-44e4-bde2-407a21e65f19 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:09.183303 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2366/4665] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:31:08 2022] POST /identity/v3/projects => generated 369 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:31:09.186614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa150984-1c67-43a3-9d01-fe4f258e250b None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:09.203397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa150984-1c67-43a3-9d01-fe4f258e250b None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:09.347366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f908b-fc47-4d49-8e96-ad203ee8139f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:09.347366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f908b-fc47-4d49-8e96-ad203ee8139f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:09.348158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f908b-fc47-4d49-8e96-ad203ee8139f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:09.348248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f908b-fc47-4d49-8e96-ad203ee8139f admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:09.348931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f908b-fc47-4d49-8e96-ad203ee8139f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:09.351443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f908b-fc47-4d49-8e96-ad203ee8139f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:09.466891 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2300/4666] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:31:09 2022] POST /identity/v3/users => generated 291 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:31:09.468019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7293b9-d942-44e4-bde2-407a21e65f19 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:09.489049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7293b9-d942-44e4-bde2-407a21e65f19 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:09.514524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277c667-9150-466c-b9df-95cf05742857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:09.514524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277c667-9150-466c-b9df-95cf05742857 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:09.514524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277c667-9150-466c-b9df-95cf05742857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:09.514524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4277c667-9150-466c-b9df-95cf05742857 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:09.516535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277c667-9150-466c-b9df-95cf05742857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:09.518509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4277c667-9150-466c-b9df-95cf05742857 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:09.547733 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2367/4667] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:31:09.549057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f908b-fc47-4d49-8e96-ad203ee8139f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:09.565465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f908b-fc47-4d49-8e96-ad203ee8139f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:09.574191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90dd5fa-44be-40ca-a535-fd8457e22a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:09.575418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dd5fa-44be-40ca-a535-fd8457e22a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:09.575897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dd5fa-44be-40ca-a535-fd8457e22a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:09.576355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dd5fa-44be-40ca-a535-fd8457e22a13 admin admin] PATH_INFO: `/v3/projects/217694b1ad134e87891fa7503720d90f/users/309e8f444f164d20a1fe8c982cfcf744/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:09.644015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90dd5fa-44be-40ca-a535-fd8457e22a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=217694b1ad134e87891fa7503720d90f, user_id=309e8f444f164d20a1fe8c982cfcf744, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:09.646411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90dd5fa-44be-40ca-a535-fd8457e22a13 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:09.727150 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:31:09.736672 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2301/4668] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:31:09 2022] PUT /identity/v3/projects/217694b1ad134e87891fa7503720d90f/users/309e8f444f164d20a1fe8c982cfcf744/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:31:09.740847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277c667-9150-466c-b9df-95cf05742857 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:09.756068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4277c667-9150-466c-b9df-95cf05742857 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:09.869317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4fe38-8664-4b69-b751-f1fb34f8390c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:09.870155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4fe38-8664-4b69-b751-f1fb34f8390c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:09.870451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4fe38-8664-4b69-b751-f1fb34f8390c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:09.870732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4fe38-8664-4b69-b751-f1fb34f8390c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:09.871742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4fe38-8664-4b69-b751-f1fb34f8390c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:09.873626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4fe38-8664-4b69-b751-f1fb34f8390c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:09.889650 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2368/4669] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:31:09.892199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90dd5fa-44be-40ca-a535-fd8457e22a13 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:09.925822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90dd5fa-44be-40ca-a535-fd8457e22a13 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:09.936522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e337c5e-d275-414f-bb13-a7978e234f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:09.937888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e337c5e-d275-414f-bb13-a7978e234f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:09.940340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e337c5e-d275-414f-bb13-a7978e234f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:09.940340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e337c5e-d275-414f-bb13-a7978e234f9a admin admin] PATH_INFO: `/v3/projects/217694b1ad134e87891fa7503720d90f/users/309e8f444f164d20a1fe8c982cfcf744/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:09.943207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e337c5e-d275-414f-bb13-a7978e234f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=217694b1ad134e87891fa7503720d90f, user_id=309e8f444f164d20a1fe8c982cfcf744, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:09.947780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e337c5e-d275-414f-bb13-a7978e234f9a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:09.979294 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2302/4670] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:31:09 2022] PUT /identity/v3/projects/217694b1ad134e87891fa7503720d90f/users/309e8f444f164d20a1fe8c982cfcf744/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:31:09.991014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b84167-e839-4f5f-a66e-8dd9bf869ce7 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:09.995772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b84167-e839-4f5f-a66e-8dd9bf869ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:09.995772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b84167-e839-4f5f-a66e-8dd9bf869ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:10.072210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-19b84167-e839-4f5f-a66e-8dd9bf869ce7 None None] MFA Rules not processed for user `309e8f444f164d20a1fe8c982cfcf744`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:31:10.073541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-19b84167-e839-4f5f-a66e-8dd9bf869ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:10.147557 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:31:10.195888 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2369/4671] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:31:09 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:31:10.244495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e337c5e-d275-414f-bb13-a7978e234f9a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:10.245561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6e337c5e-d275-414f-bb13-a7978e234f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:10.360734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e337c5e-d275-414f-bb13-a7978e234f9a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:10.367675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126f8dd-0c8d-4284-bd84-1600cd596937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:10.368633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126f8dd-0c8d-4284-bd84-1600cd596937 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:10.369223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126f8dd-0c8d-4284-bd84-1600cd596937 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:10.369723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126f8dd-0c8d-4284-bd84-1600cd596937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:10.383545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126f8dd-0c8d-4284-bd84-1600cd596937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:10.385260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8126f8dd-0c8d-4284-bd84-1600cd596937 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:10.418183 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2303/4672] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:31:10 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:31:11.613361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b84167-e839-4f5f-a66e-8dd9bf869ce7 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:11.615292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-19b84167-e839-4f5f-a66e-8dd9bf869ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:11.756255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b84167-e839-4f5f-a66e-8dd9bf869ce7 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:11.761622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43967d08-0329-4785-b0d9-0d072ec8b1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:11.762582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43967d08-0329-4785-b0d9-0d072ec8b1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:11.763284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43967d08-0329-4785-b0d9-0d072ec8b1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:11.763603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43967d08-0329-4785-b0d9-0d072ec8b1e8 admin admin] PATH_INFO: `/v3/users/b9e1e7bf96f14aa69aafb39fd9caed59` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:11.765148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43967d08-0329-4785-b0d9-0d072ec8b1e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9e1e7bf96f14aa69aafb39fd9caed59)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:11.767199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43967d08-0329-4785-b0d9-0d072ec8b1e8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:11.966161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-43967d08-0329-4785-b0d9-0d072ec8b1e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9e1e7bf96f14aa69aafb39fd9caed59'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:12.000779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-43967d08-0329-4785-b0d9-0d072ec8b1e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9e1e7bf96f14aa69aafb39fd9caed59'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:12.024661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-43967d08-0329-4785-b0d9-0d072ec8b1e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9e1e7bf96f14aa69aafb39fd9caed59'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:12.025827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-43967d08-0329-4785-b0d9-0d072ec8b1e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9e1e7bf96f14aa69aafb39fd9caed59'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:12.110394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-43967d08-0329-4785-b0d9-0d072ec8b1e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9e1e7bf96f14aa69aafb39fd9caed59'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:12.120094 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2370/4673] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:31:11 2022] DELETE /identity/v3/users/b9e1e7bf96f14aa69aafb39fd9caed59 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:31:12.651971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126f8dd-0c8d-4284-bd84-1600cd596937 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:12.675490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43967d08-0329-4785-b0d9-0d072ec8b1e8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:12.676884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8126f8dd-0c8d-4284-bd84-1600cd596937 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:12.677780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-43967d08-0329-4785-b0d9-0d072ec8b1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:12.813433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3344d4e-4d30-41df-955f-e489487a9d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:12.815658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3344d4e-4d30-41df-955f-e489487a9d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:12.816513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3344d4e-4d30-41df-955f-e489487a9d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:12.818671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3344d4e-4d30-41df-955f-e489487a9d5e admin admin] PATH_INFO: `/v3/projects/4c1243f7a75b4a16a5ed152af82e437a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:12.823998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3344d4e-4d30-41df-955f-e489487a9d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c1243f7a75b4a16a5ed152af82e437a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:12.826820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3344d4e-4d30-41df-955f-e489487a9d5e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:12.830557 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:31:12.837379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43967d08-0329-4785-b0d9-0d072ec8b1e8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:12.857803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30ab5f-571a-4332-a304-8059fdd40084 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:12.858539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30ab5f-571a-4332-a304-8059fdd40084 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:12.858825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30ab5f-571a-4332-a304-8059fdd40084 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:12.859115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30ab5f-571a-4332-a304-8059fdd40084 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:12.861411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3c30ab5f-571a-4332-a304-8059fdd40084 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:12.901167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30ab5f-571a-4332-a304-8059fdd40084 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:12.905044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c30ab5f-571a-4332-a304-8059fdd40084 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:12.935967 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2371/4674] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:31:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:31:13.034497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f3344d4e-4d30-41df-955f-e489487a9d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c1243f7a75b4a16a5ed152af82e437a', 'request_id': 'req-f3344d4e-4d30-41df-955f-e489487a9d5e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:13.108262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f3344d4e-4d30-41df-955f-e489487a9d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c1243f7a75b4a16a5ed152af82e437a', 'request_id': 'req-f3344d4e-4d30-41df-955f-e489487a9d5e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:13.118423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f3344d4e-4d30-41df-955f-e489487a9d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c1243f7a75b4a16a5ed152af82e437a', 'request_id': 'req-f3344d4e-4d30-41df-955f-e489487a9d5e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:13.145553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f3344d4e-4d30-41df-955f-e489487a9d5e admin admin] The token cache is being invalidate because project 4c1243f7a75b4a16a5ed152af82e437a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:31:13.146220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f3344d4e-4d30-41df-955f-e489487a9d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:13.149234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f3344d4e-4d30-41df-955f-e489487a9d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:13.152670 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2304/4675] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:31:12 2022] DELETE /identity/v3/projects/4c1243f7a75b4a16a5ed152af82e437a => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:31:13.157948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea583b-e0f5-4212-9ca2-8fb522525d74 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:13.158415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea583b-e0f5-4212-9ca2-8fb522525d74 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:13.158714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ea583b-e0f5-4212-9ca2-8fb522525d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:13.189787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b1ea583b-e0f5-4212-9ca2-8fb522525d74 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:31:13.191939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b1ea583b-e0f5-4212-9ca2-8fb522525d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:13.302442 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2372/4676] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:31:13.313415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9ea0d-2fcf-4aa1-9bf0-222366267564 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:13.313710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9ea0d-2fcf-4aa1-9bf0-222366267564 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:13.313998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9ea0d-2fcf-4aa1-9bf0-222366267564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:13.353937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f3c9ea0d-2fcf-4aa1-9bf0-222366267564 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:31:13.355420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f3c9ea0d-2fcf-4aa1-9bf0-222366267564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:13.379109 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2305/4677] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:31:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:31:13.380456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea583b-e0f5-4212-9ca2-8fb522525d74 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:13.392362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ea583b-e0f5-4212-9ca2-8fb522525d74 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:13.400485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e3540-ae08-4e43-b7e9-b5c159a1e44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:13.401783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e3540-ae08-4e43-b7e9-b5c159a1e44a admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:13.402320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e3540-ae08-4e43-b7e9-b5c159a1e44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:13.402821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63e3540-ae08-4e43-b7e9-b5c159a1e44a admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:13.403787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e3540-ae08-4e43-b7e9-b5c159a1e44a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:31:13.404330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e3540-ae08-4e43-b7e9-b5c159a1e44a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:13.407043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63e3540-ae08-4e43-b7e9-b5c159a1e44a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:13.449327 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2373/4678] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:31:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:31:13.453733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9ea0d-2fcf-4aa1-9bf0-222366267564 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:13.466766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9ea0d-2fcf-4aa1-9bf0-222366267564 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:13.476789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6441b43-5654-4e7a-96d7-e0774c507a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:13.478119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6441b43-5654-4e7a-96d7-e0774c507a72 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:13.478119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6441b43-5654-4e7a-96d7-e0774c507a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:13.478391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6441b43-5654-4e7a-96d7-e0774c507a72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:13.479048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6441b43-5654-4e7a-96d7-e0774c507a72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:13.484456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6441b43-5654-4e7a-96d7-e0774c507a72 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:13.524684 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:31:13.583337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e3540-ae08-4e43-b7e9-b5c159a1e44a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:13.585573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c63e3540-ae08-4e43-b7e9-b5c159a1e44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:13.620716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63e3540-ae08-4e43-b7e9-b5c159a1e44a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:13.631001 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2306/4679] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:31:13 2022] POST /identity/v3/projects => generated 403 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:31:13.632539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6441b43-5654-4e7a-96d7-e0774c507a72 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:13.639680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a672e-2437-4f9c-8765-e12af4cd96ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:13.641629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a672e-2437-4f9c-8765-e12af4cd96ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:13.642977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a672e-2437-4f9c-8765-e12af4cd96ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:13.643770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a672e-2437-4f9c-8765-e12af4cd96ce admin admin] PATH_INFO: `/v3/users/d5bd18a1135c4d1db18e9bf273cb0ea4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:13.645733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a672e-2437-4f9c-8765-e12af4cd96ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5bd18a1135c4d1db18e9bf273cb0ea4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:13.648263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a672e-2437-4f9c-8765-e12af4cd96ce admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:13.751882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6441b43-5654-4e7a-96d7-e0774c507a72 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:13.769537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7835c10-1bf3-4c98-a1b9-1e03e183c591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:13.770294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7835c10-1bf3-4c98-a1b9-1e03e183c591 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:13.770634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7835c10-1bf3-4c98-a1b9-1e03e183c591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:13.771190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7835c10-1bf3-4c98-a1b9-1e03e183c591 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:13.772307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7835c10-1bf3-4c98-a1b9-1e03e183c591 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:13.774813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7835c10-1bf3-4c98-a1b9-1e03e183c591 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:13.884658 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2307/4680] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:31:13 2022] POST /identity/v3/users => generated 302 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:31:13.886128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7835c10-1bf3-4c98-a1b9-1e03e183c591 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:13.904409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-047a672e-2437-4f9c-8765-e12af4cd96ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5bd18a1135c4d1db18e9bf273cb0ea4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:13.906413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7835c10-1bf3-4c98-a1b9-1e03e183c591 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:13.918637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95f4c2-20de-4faf-be42-1ef1ceddc1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:13.919519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95f4c2-20de-4faf-be42-1ef1ceddc1cf admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:13.920307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95f4c2-20de-4faf-be42-1ef1ceddc1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:13.920698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95f4c2-20de-4faf-be42-1ef1ceddc1cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:13.921490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95f4c2-20de-4faf-be42-1ef1ceddc1cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:13.923619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95f4c2-20de-4faf-be42-1ef1ceddc1cf admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:13.941116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-047a672e-2437-4f9c-8765-e12af4cd96ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5bd18a1135c4d1db18e9bf273cb0ea4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:13.962310 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2308/4681] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:31:13.969415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95f4c2-20de-4faf-be42-1ef1ceddc1cf admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:13.975123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-047a672e-2437-4f9c-8765-e12af4cd96ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5bd18a1135c4d1db18e9bf273cb0ea4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:13.976747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-047a672e-2437-4f9c-8765-e12af4cd96ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5bd18a1135c4d1db18e9bf273cb0ea4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:14.013477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95f4c2-20de-4faf-be42-1ef1ceddc1cf admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:14.031885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3428a-cf39-4a8e-bf35-b598446418ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:14.033363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3428a-cf39-4a8e-bf35-b598446418ac admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:14.034526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3428a-cf39-4a8e-bf35-b598446418ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:14.035594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb3428a-cf39-4a8e-bf35-b598446418ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:14.037873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3428a-cf39-4a8e-bf35-b598446418ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:14.042527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb3428a-cf39-4a8e-bf35-b598446418ac admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:14.089317 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2309/4682] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:31:13 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:31:14.090392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3428a-cf39-4a8e-bf35-b598446418ac admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:14.113664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb3428a-cf39-4a8e-bf35-b598446418ac admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:14.119241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-047a672e-2437-4f9c-8765-e12af4cd96ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5bd18a1135c4d1db18e9bf273cb0ea4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:14.133073 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2374/4683] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:31:13 2022] DELETE /identity/v3/users/d5bd18a1135c4d1db18e9bf273cb0ea4 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:31:14.247290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6ac7f-03d8-4286-9d8b-f16838ce5027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:14.250357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6ac7f-03d8-4286-9d8b-f16838ce5027 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:14.257452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6ac7f-03d8-4286-9d8b-f16838ce5027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:14.257819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded6ac7f-03d8-4286-9d8b-f16838ce5027 admin admin] PATH_INFO: `/v3/projects/d5775c7cad8e464d9e17729b021ef92b/users/cfc44d42881a4c81830b33885403ec4e/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:14.303975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6ac7f-03d8-4286-9d8b-f16838ce5027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5775c7cad8e464d9e17729b021ef92b, user_id=cfc44d42881a4c81830b33885403ec4e, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:14.306745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded6ac7f-03d8-4286-9d8b-f16838ce5027 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:14.399553 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2310/4684] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:31:14 2022] PUT /identity/v3/projects/d5775c7cad8e464d9e17729b021ef92b/users/cfc44d42881a4c81830b33885403ec4e/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:31:14.405533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a5b65-3423-4b11-8be4-825e5baca6bc None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:14.405830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a5b65-3423-4b11-8be4-825e5baca6bc None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:14.406144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932a5b65-3423-4b11-8be4-825e5baca6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:14.496112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-932a5b65-3423-4b11-8be4-825e5baca6bc None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:31:14.503023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-932a5b65-3423-4b11-8be4-825e5baca6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:14.645039 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:31:14.672270 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2375/4685] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:31:14.710030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6ac7f-03d8-4286-9d8b-f16838ce5027 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:14.713267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a5b65-3423-4b11-8be4-825e5baca6bc None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:14.713527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ded6ac7f-03d8-4286-9d8b-f16838ce5027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:14.715848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-932a5b65-3423-4b11-8be4-825e5baca6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:14.733926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932a5b65-3423-4b11-8be4-825e5baca6bc None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:14.741293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543536c8-99d5-45b6-8e09-19c67261e3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:14.744961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543536c8-99d5-45b6-8e09-19c67261e3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:14.745346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543536c8-99d5-45b6-8e09-19c67261e3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:14.745708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543536c8-99d5-45b6-8e09-19c67261e3f2 admin admin] PATH_INFO: `/v3/projects/7ea9920e4bd64d908f7312d30865f400` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:14.750814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543536c8-99d5-45b6-8e09-19c67261e3f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ea9920e4bd64d908f7312d30865f400)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:14.754785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543536c8-99d5-45b6-8e09-19c67261e3f2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:14.870203 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:31:14.884498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded6ac7f-03d8-4286-9d8b-f16838ce5027 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:14.888785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351045d0-5193-4cef-bd9b-db6992bf9e06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:14.889590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351045d0-5193-4cef-bd9b-db6992bf9e06 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:14.889878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351045d0-5193-4cef-bd9b-db6992bf9e06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:14.890259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351045d0-5193-4cef-bd9b-db6992bf9e06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:14.901879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351045d0-5193-4cef-bd9b-db6992bf9e06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:14.903640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351045d0-5193-4cef-bd9b-db6992bf9e06 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:14.921978 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2311/4686] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:31:14.950414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-543536c8-99d5-45b6-8e09-19c67261e3f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ea9920e4bd64d908f7312d30865f400', 'request_id': 'req-543536c8-99d5-45b6-8e09-19c67261e3f2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:14.966724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-543536c8-99d5-45b6-8e09-19c67261e3f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ea9920e4bd64d908f7312d30865f400', 'request_id': 'req-543536c8-99d5-45b6-8e09-19c67261e3f2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:14.978165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-543536c8-99d5-45b6-8e09-19c67261e3f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ea9920e4bd64d908f7312d30865f400', 'request_id': 'req-543536c8-99d5-45b6-8e09-19c67261e3f2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:15.131182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-543536c8-99d5-45b6-8e09-19c67261e3f2 admin admin] The token cache is being invalidate because project 7ea9920e4bd64d908f7312d30865f400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:31:15.131182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-543536c8-99d5-45b6-8e09-19c67261e3f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:15.131182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-543536c8-99d5-45b6-8e09-19c67261e3f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:15.131182 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2376/4687] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:31:14 2022] DELETE /identity/v3/projects/7ea9920e4bd64d908f7312d30865f400 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:31:15.136868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50491d0-bec5-4ec5-ae87-da80e55c7ae5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:15.137421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50491d0-bec5-4ec5-ae87-da80e55c7ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:15.137956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50491d0-bec5-4ec5-ae87-da80e55c7ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:15.170619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b50491d0-bec5-4ec5-ae87-da80e55c7ae5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:31:15.171985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b50491d0-bec5-4ec5-ae87-da80e55c7ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:15.279619 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2312/4688] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:31:15.290768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609fb10-567d-4253-a447-9d7feb48d543 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:15.291384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609fb10-567d-4253-a447-9d7feb48d543 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:15.291939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609fb10-567d-4253-a447-9d7feb48d543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:15.329578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a609fb10-567d-4253-a447-9d7feb48d543 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:31:15.331715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a609fb10-567d-4253-a447-9d7feb48d543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:15.346022 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2377/4689] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:31:15.349955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50491d0-bec5-4ec5-ae87-da80e55c7ae5 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:15.368159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50491d0-bec5-4ec5-ae87-da80e55c7ae5 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:15.385040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad60df-2dce-4b22-a8c9-9711919d7dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:15.385707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad60df-2dce-4b22-a8c9-9711919d7dd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:15.385950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad60df-2dce-4b22-a8c9-9711919d7dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:15.386283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abad60df-2dce-4b22-a8c9-9711919d7dd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:15.387039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad60df-2dce-4b22-a8c9-9711919d7dd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:31:15.387357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad60df-2dce-4b22-a8c9-9711919d7dd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:15.388981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abad60df-2dce-4b22-a8c9-9711919d7dd3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:15.410547 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2313/4690] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:31:15.420787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609fb10-567d-4253-a447-9d7feb48d543 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:15.446879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a609fb10-567d-4253-a447-9d7feb48d543 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:15.456920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353fc65-1496-4f6c-95de-f599c4ab6c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:15.459372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353fc65-1496-4f6c-95de-f599c4ab6c65 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:15.461328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353fc65-1496-4f6c-95de-f599c4ab6c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:15.463091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353fc65-1496-4f6c-95de-f599c4ab6c65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:15.464135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353fc65-1496-4f6c-95de-f599c4ab6c65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:15.467966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353fc65-1496-4f6c-95de-f599c4ab6c65 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:15.607488 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2378/4691] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:31:15 2022] POST /identity/v3/projects => generated 371 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:31:15.612323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad60df-2dce-4b22-a8c9-9711919d7dd3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:15.639608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abad60df-2dce-4b22-a8c9-9711919d7dd3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:15.771065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2701a-6bb9-4626-9e26-86347d7f2236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:15.771065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2701a-6bb9-4626-9e26-86347d7f2236 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:15.771065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2701a-6bb9-4626-9e26-86347d7f2236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:15.771065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d2701a-6bb9-4626-9e26-86347d7f2236 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:15.771708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2701a-6bb9-4626-9e26-86347d7f2236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:15.781765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d2701a-6bb9-4626-9e26-86347d7f2236 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:15.912749 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2314/4692] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:31:15 2022] POST /identity/v3/users => generated 286 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:31:15.917966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353fc65-1496-4f6c-95de-f599c4ab6c65 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:15.940925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353fc65-1496-4f6c-95de-f599c4ab6c65 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:15.965762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d121480-6b6a-4333-8520-a190e29fef58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:15.967854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d121480-6b6a-4333-8520-a190e29fef58 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:15.968980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d121480-6b6a-4333-8520-a190e29fef58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:15.969439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d121480-6b6a-4333-8520-a190e29fef58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:15.970545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d121480-6b6a-4333-8520-a190e29fef58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:15.972421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d121480-6b6a-4333-8520-a190e29fef58 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:15.998088 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2379/4693] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:31:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:31:16.004214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2701a-6bb9-4626-9e26-86347d7f2236 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:16.021995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d2701a-6bb9-4626-9e26-86347d7f2236 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:16.028381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5f6c7-19af-465b-a239-1199c128fac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:16.029425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5f6c7-19af-465b-a239-1199c128fac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:16.029928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5f6c7-19af-465b-a239-1199c128fac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:16.030475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5f6c7-19af-465b-a239-1199c128fac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:16.031463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5f6c7-19af-465b-a239-1199c128fac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:16.033872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5f6c7-19af-465b-a239-1199c128fac5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:16.059785 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2315/4694] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:31:16.063716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d121480-6b6a-4333-8520-a190e29fef58 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:16.083423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d121480-6b6a-4333-8520-a190e29fef58 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:16.092077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf24b9-5332-4977-b6fc-90e574710b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:16.093859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf24b9-5332-4977-b6fc-90e574710b74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:16.093859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf24b9-5332-4977-b6fc-90e574710b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:16.093859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf24b9-5332-4977-b6fc-90e574710b74 admin admin] PATH_INFO: `/v3/projects/dd166032112e4ecba0858709f271fa41/users/449cf19919884836989820930ce65fa7/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:16.135186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf24b9-5332-4977-b6fc-90e574710b74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd166032112e4ecba0858709f271fa41, user_id=449cf19919884836989820930ce65fa7, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:16.139023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf24b9-5332-4977-b6fc-90e574710b74 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:16.213954 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2380/4695] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:31:16 2022] PUT /identity/v3/projects/dd166032112e4ecba0858709f271fa41/users/449cf19919884836989820930ce65fa7/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:31:16.219761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373e7e0-f9bd-42c8-8ccf-4faa65a75813 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:16.220057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373e7e0-f9bd-42c8-8ccf-4faa65a75813 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:16.220405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d373e7e0-f9bd-42c8-8ccf-4faa65a75813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:16.288140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d373e7e0-f9bd-42c8-8ccf-4faa65a75813 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:31:16.291738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d373e7e0-f9bd-42c8-8ccf-4faa65a75813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:16.526720 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:31:16.598789 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2316/4696] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:31:16.677952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf24b9-5332-4977-b6fc-90e574710b74 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:16.681062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-afaf24b9-5332-4977-b6fc-90e574710b74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:16.853389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf24b9-5332-4977-b6fc-90e574710b74 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:16.857963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd3271-884d-4845-a826-d2ed1fb159e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:16.858622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd3271-884d-4845-a826-d2ed1fb159e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:16.858906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd3271-884d-4845-a826-d2ed1fb159e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:16.859184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd3271-884d-4845-a826-d2ed1fb159e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:16.900504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd3271-884d-4845-a826-d2ed1fb159e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:16.901962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd3271-884d-4845-a826-d2ed1fb159e9 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:16.945203 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2381/4697] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:31:26.922014 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:31:27.352821 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:31:27.641556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373e7e0-f9bd-42c8-8ccf-4faa65a75813 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:27.643081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d373e7e0-f9bd-42c8-8ccf-4faa65a75813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:27.723307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d373e7e0-f9bd-42c8-8ccf-4faa65a75813 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:27.737903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028ddfd-42f2-4630-9b0b-59076012ae62 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309e8f444f164d20a1fe8c982cfcf744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '217694b1ad134e87891fa7503720d90f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:27.738351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028ddfd-42f2-4630-9b0b-59076012ae62 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:27.738646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028ddfd-42f2-4630-9b0b-59076012ae62 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:27.738933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028ddfd-42f2-4630-9b0b-59076012ae62 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:27.739696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028ddfd-42f2-4630-9b0b-59076012ae62 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:31:27.740013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028ddfd-42f2-4630-9b0b-59076012ae62 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:27.742501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f028ddfd-42f2-4630-9b0b-59076012ae62 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:27.761290 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2317/4698] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:31:27.765262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd3271-884d-4845-a826-d2ed1fb159e9 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:27.782920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd3271-884d-4845-a826-d2ed1fb159e9 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:27.793002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a2b37-c1d1-4e0e-91c7-c94858063e59 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309e8f444f164d20a1fe8c982cfcf744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '217694b1ad134e87891fa7503720d90f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:27.794530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a2b37-c1d1-4e0e-91c7-c94858063e59 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:27.795015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a2b37-c1d1-4e0e-91c7-c94858063e59 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:27.795685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a2b37-c1d1-4e0e-91c7-c94858063e59 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:27.797684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a2b37-c1d1-4e0e-91c7-c94858063e59 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:27.800143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a2b37-c1d1-4e0e-91c7-c94858063e59 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:27.926574 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2382/4699] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:31:27 2022] POST /identity/v3/projects => generated 347 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:31:27.932073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028ddfd-42f2-4630-9b0b-59076012ae62 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:27.948083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f028ddfd-42f2-4630-9b0b-59076012ae62 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:28.117580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f0535-1a1e-4a38-b3ed-38a5e3a7da03 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309e8f444f164d20a1fe8c982cfcf744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '217694b1ad134e87891fa7503720d90f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:28.118784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f0535-1a1e-4a38-b3ed-38a5e3a7da03 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:28.121263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f0535-1a1e-4a38-b3ed-38a5e3a7da03 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:28.125305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9f0535-1a1e-4a38-b3ed-38a5e3a7da03 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:28.125305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f0535-1a1e-4a38-b3ed-38a5e3a7da03 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:31:28.125305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f0535-1a1e-4a38-b3ed-38a5e3a7da03 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:28.127557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9f0535-1a1e-4a38-b3ed-38a5e3a7da03 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:28.191258 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2318/4700] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:31:30.420117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a2b37-c1d1-4e0e-91c7-c94858063e59 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:30.443542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a2b37-c1d1-4e0e-91c7-c94858063e59 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:30.455778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917426e-3f11-4e82-a894-1c3749d352d0 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309e8f444f164d20a1fe8c982cfcf744', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '217694b1ad134e87891fa7503720d90f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:30.458451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917426e-3f11-4e82-a894-1c3749d352d0 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:30.459356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917426e-3f11-4e82-a894-1c3749d352d0 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:30.461957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917426e-3f11-4e82-a894-1c3749d352d0 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] PATH_INFO: `/v3/projects/723e5398172b424da9e2fb1a705ead11` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:30.465121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917426e-3f11-4e82-a894-1c3749d352d0 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] RBAC: Authorizing `identity:delete_project(project_id=723e5398172b424da9e2fb1a705ead11)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:30.471124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917426e-3f11-4e82-a894-1c3749d352d0 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:30.627474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f0535-1a1e-4a38-b3ed-38a5e3a7da03 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:30.752598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e917426e-3f11-4e82-a894-1c3749d352d0 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '723e5398172b424da9e2fb1a705ead11', 'request_id': 'req-e917426e-3f11-4e82-a894-1c3749d352d0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:30.776729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e917426e-3f11-4e82-a894-1c3749d352d0 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '723e5398172b424da9e2fb1a705ead11', 'request_id': 'req-e917426e-3f11-4e82-a894-1c3749d352d0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:30.795770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e917426e-3f11-4e82-a894-1c3749d352d0 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '723e5398172b424da9e2fb1a705ead11', 'request_id': 'req-e917426e-3f11-4e82-a894-1c3749d352d0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:30.843520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9f0535-1a1e-4a38-b3ed-38a5e3a7da03 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:30.931820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e917426e-3f11-4e82-a894-1c3749d352d0 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] The token cache is being invalidate because project 723e5398172b424da9e2fb1a705ead11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:31:30.932500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e917426e-3f11-4e82-a894-1c3749d352d0 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:30.933767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e917426e-3f11-4e82-a894-1c3749d352d0 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:31:30.950606 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2383/4701] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:31:30 2022] DELETE /identity/v3/projects/723e5398172b424da9e2fb1a705ead11 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:31:30.958990 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:31:30.965084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917426e-3f11-4e82-a894-1c3749d352d0 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:30.967628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e917426e-3f11-4e82-a894-1c3749d352d0 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:30.978800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c55fb5-eeab-4de2-a3a6-f77e7df5743e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:30.982598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c55fb5-eeab-4de2-a3a6-f77e7df5743e service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:30.982598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c55fb5-eeab-4de2-a3a6-f77e7df5743e service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:30.982598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c55fb5-eeab-4de2-a3a6-f77e7df5743e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:30.987643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b1c55fb5-eeab-4de2-a3a6-f77e7df5743e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:31.099743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917426e-3f11-4e82-a894-1c3749d352d0 tempest-RoutersAdminTest-2017793244 tempest-RoutersAdminTest-2017793244-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:31.105370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9611f1-b51f-479d-937a-4ab1cc123e3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:31.106420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9611f1-b51f-479d-937a-4ab1cc123e3c service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:31.106940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9611f1-b51f-479d-937a-4ab1cc123e3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:31.107273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9611f1-b51f-479d-937a-4ab1cc123e3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:31.115723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1a9611f1-b51f-479d-937a-4ab1cc123e3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:31.193857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c55fb5-eeab-4de2-a3a6-f77e7df5743e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:31.199544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c55fb5-eeab-4de2-a3a6-f77e7df5743e service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:31.256113 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2319/4702] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:31:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:31:31.276063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9611f1-b51f-479d-937a-4ab1cc123e3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:31.278282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9611f1-b51f-479d-937a-4ab1cc123e3c service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:31.298836 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2384/4703] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:31:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:31:31.921170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c55fb5-eeab-4de2-a3a6-f77e7df5743e service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:31.922711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b1c55fb5-eeab-4de2-a3a6-f77e7df5743e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:31.942503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c55fb5-eeab-4de2-a3a6-f77e7df5743e service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:31.958679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff8253-f37e-4d89-b2fc-6b0c3157deba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:31.959562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff8253-f37e-4d89-b2fc-6b0c3157deba service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:31.960290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff8253-f37e-4d89-b2fc-6b0c3157deba service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:31.960808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff8253-f37e-4d89-b2fc-6b0c3157deba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:31.964482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-56ff8253-f37e-4d89-b2fc-6b0c3157deba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:31.999005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff8253-f37e-4d89-b2fc-6b0c3157deba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:32.002378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff8253-f37e-4d89-b2fc-6b0c3157deba service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:32.017630 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2320/4704] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:31:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:31:34.374580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0f56e-1aa4-4128-a76b-726ca0641eb0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:34.375146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0f56e-1aa4-4128-a76b-726ca0641eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:34.375146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0f56e-1aa4-4128-a76b-726ca0641eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:34.408548 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:31:34.443202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3ec0f56e-1aa4-4128-a76b-726ca0641eb0 None None] MFA Rules not processed for user `cfc44d42881a4c81830b33885403ec4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:31:34.445400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3ec0f56e-1aa4-4128-a76b-726ca0641eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:34.591814 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2385/4705] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:31:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:31:34.596598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff8253-f37e-4d89-b2fc-6b0c3157deba service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:34.599316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-56ff8253-f37e-4d89-b2fc-6b0c3157deba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:34.747450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff8253-f37e-4d89-b2fc-6b0c3157deba service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:34.758854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd38a2-e621-40ba-b894-f6c59b69c445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:34.760545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd38a2-e621-40ba-b894-f6c59b69c445 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:34.760994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd38a2-e621-40ba-b894-f6c59b69c445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:34.761530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffd38a2-e621-40ba-b894-f6c59b69c445 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:34.762836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd38a2-e621-40ba-b894-f6c59b69c445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:34.765168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffd38a2-e621-40ba-b894-f6c59b69c445 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:35.003693 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2321/4706] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:31:34 2022] POST /identity/v3/projects => generated 405 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:31:35.007502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0f56e-1aa4-4128-a76b-726ca0641eb0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:35.024530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0f56e-1aa4-4128-a76b-726ca0641eb0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:35.256020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4718d9c-8b19-4ecd-ba08-bdca3648cf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:35.258193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4718d9c-8b19-4ecd-ba08-bdca3648cf66 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:35.258445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4718d9c-8b19-4ecd-ba08-bdca3648cf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:35.258732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4718d9c-8b19-4ecd-ba08-bdca3648cf66 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:35.259511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4718d9c-8b19-4ecd-ba08-bdca3648cf66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:35.267471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4718d9c-8b19-4ecd-ba08-bdca3648cf66 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:35.405059 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2386/4707] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:31:35 2022] POST /identity/v3/users => generated 303 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:31:35.409239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd38a2-e621-40ba-b894-f6c59b69c445 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:35.442628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffd38a2-e621-40ba-b894-f6c59b69c445 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:35.464948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c2a84-3f9a-45e6-b5d3-4bd84acec483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:35.465795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c2a84-3f9a-45e6-b5d3-4bd84acec483 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:35.466260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c2a84-3f9a-45e6-b5d3-4bd84acec483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:35.466644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c2a84-3f9a-45e6-b5d3-4bd84acec483 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:35.467691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c2a84-3f9a-45e6-b5d3-4bd84acec483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:35.470181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c2a84-3f9a-45e6-b5d3-4bd84acec483 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:35.499496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4718d9c-8b19-4ecd-ba08-bdca3648cf66 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:35.499783 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2322/4708] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:31:35.530329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4718d9c-8b19-4ecd-ba08-bdca3648cf66 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:35.539725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1c893-359f-46d4-8127-6a4dd294dbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:35.540619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1c893-359f-46d4-8127-6a4dd294dbae admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:35.541102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1c893-359f-46d4-8127-6a4dd294dbae admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:35.541603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1c893-359f-46d4-8127-6a4dd294dbae admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:35.542735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1c893-359f-46d4-8127-6a4dd294dbae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:35.545641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b1c893-359f-46d4-8127-6a4dd294dbae admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:35.579249 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2387/4709] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:31:35.581946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c2a84-3f9a-45e6-b5d3-4bd84acec483 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:35.623194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c2a84-3f9a-45e6-b5d3-4bd84acec483 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:35.650618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535d683-2de2-43cc-9071-3f3f9f3620f8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:35.651796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535d683-2de2-43cc-9071-3f3f9f3620f8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:35.652936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535d683-2de2-43cc-9071-3f3f9f3620f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:35.669493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e00ffc2-5edf-4bc1-834c-15563baf0acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:35.673950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00ffc2-5edf-4bc1-834c-15563baf0acc admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:35.674508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00ffc2-5edf-4bc1-834c-15563baf0acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:35.680049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e00ffc2-5edf-4bc1-834c-15563baf0acc admin admin] PATH_INFO: `/v3/projects/c2509dffb0784e36b2a1898f8e1a7430/users/b6c3ce3eec7749eb9490a7f786e4edff/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:35.725289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00ffc2-5edf-4bc1-834c-15563baf0acc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2509dffb0784e36b2a1898f8e1a7430, user_id=b6c3ce3eec7749eb9490a7f786e4edff, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:35.734576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e00ffc2-5edf-4bc1-834c-15563baf0acc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:35.746878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d535d683-2de2-43cc-9071-3f3f9f3620f8 None None] MFA Rules not processed for user `449cf19919884836989820930ce65fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:31:35.748125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d535d683-2de2-43cc-9071-3f3f9f3620f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:35.882856 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2323/4710] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:31:35 2022] PUT /identity/v3/projects/c2509dffb0784e36b2a1898f8e1a7430/users/b6c3ce3eec7749eb9490a7f786e4edff/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:31:35.927340 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2388/4711] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:31:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:31:35.929928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb5972-29e2-4a72-99e8-d5c52c0ce47a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:35.930264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb5972-29e2-4a72-99e8-d5c52c0ce47a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:35.930556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfb5972-29e2-4a72-99e8-d5c52c0ce47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:35.962220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4bfb5972-29e2-4a72-99e8-d5c52c0ce47a None None] MFA Rules not processed for user `449cf19919884836989820930ce65fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:31:35.963885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4bfb5972-29e2-4a72-99e8-d5c52c0ce47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:35.985719 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:31:36.074926 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2324/4712] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:31:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:31:36.088153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535d683-2de2-43cc-9071-3f3f9f3620f8 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:36.088889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d535d683-2de2-43cc-9071-3f3f9f3620f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:36.096720 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:31:36.308354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535d683-2de2-43cc-9071-3f3f9f3620f8 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:36.445214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8472f0-9111-4e62-834d-efc23cb820c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:36.446977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8472f0-9111-4e62-834d-efc23cb820c8 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:36.447449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8472f0-9111-4e62-834d-efc23cb820c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:36.448079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8472f0-9111-4e62-834d-efc23cb820c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:36.460441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8472f0-9111-4e62-834d-efc23cb820c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:36.463700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8472f0-9111-4e62-834d-efc23cb820c8 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:36.479352 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2389/4713] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:31:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:31:46.682327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4111d5-169c-4f83-a8c9-e42b03143686 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:46.682828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4111d5-169c-4f83-a8c9-e42b03143686 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:46.683361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4111d5-169c-4f83-a8c9-e42b03143686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:46.712163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6f4111d5-169c-4f83-a8c9-e42b03143686 None None] MFA Rules not processed for user `013b13b6d741411a95806dce36c2bd20`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:31:46.717340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6f4111d5-169c-4f83-a8c9-e42b03143686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:46.823698 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2325/4714] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:31:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:31:47.556507 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=60 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:31:47.775044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8472f0-9111-4e62-834d-efc23cb820c8 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:47.853734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8472f0-9111-4e62-834d-efc23cb820c8 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:47.880256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a7575-cb02-4ec0-aebf-67b9378dfaed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:47.881078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a7575-cb02-4ec0-aebf-67b9378dfaed service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:47.882218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a7575-cb02-4ec0-aebf-67b9378dfaed service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:47.882611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40a7575-cb02-4ec0-aebf-67b9378dfaed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:47.885506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c40a7575-cb02-4ec0-aebf-67b9378dfaed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:47.902525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a7575-cb02-4ec0-aebf-67b9378dfaed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:47.906978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40a7575-cb02-4ec0-aebf-67b9378dfaed service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:47.922159 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2390/4715] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:31:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:31:48.657362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4111d5-169c-4f83-a8c9-e42b03143686 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:48.660816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6f4111d5-169c-4f83-a8c9-e42b03143686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:48.805507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4111d5-169c-4f83-a8c9-e42b03143686 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:48.812005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecff490-7291-4f37-9a62-f21551b025f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:48.813148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecff490-7291-4f37-9a62-f21551b025f2 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:48.813436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecff490-7291-4f37-9a62-f21551b025f2 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:48.814133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecff490-7291-4f37-9a62-f21551b025f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:48.815721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7ecff490-7291-4f37-9a62-f21551b025f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:48.831774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecff490-7291-4f37-9a62-f21551b025f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:48.833453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecff490-7291-4f37-9a62-f21551b025f2 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:48.847155 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2326/4716] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:31:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:31:53.371862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a7575-cb02-4ec0-aebf-67b9378dfaed service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:53.396403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40a7575-cb02-4ec0-aebf-67b9378dfaed service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:53.404869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988877db-afdc-4d64-a8c4-e7dfdfdc521c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:53.413561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988877db-afdc-4d64-a8c4-e7dfdfdc521c service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:53.413561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988877db-afdc-4d64-a8c4-e7dfdfdc521c service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:53.413561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988877db-afdc-4d64-a8c4-e7dfdfdc521c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:53.413561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-988877db-afdc-4d64-a8c4-e7dfdfdc521c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:53.538325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988877db-afdc-4d64-a8c4-e7dfdfdc521c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:53.540881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988877db-afdc-4d64-a8c4-e7dfdfdc521c service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:53.557707 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2391/4717] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:31:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:31:55.053459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b87f45-c294-4cf6-b0f4-44bed57bac53 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:55.053998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b87f45-c294-4cf6-b0f4-44bed57bac53 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:55.054410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b87f45-c294-4cf6-b0f4-44bed57bac53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:55.116314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c7b87f45-c294-4cf6-b0f4-44bed57bac53 None None] MFA Rules not processed for user `b6c3ce3eec7749eb9490a7f786e4edff`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:31:55.118325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c7b87f45-c294-4cf6-b0f4-44bed57bac53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:55.190063 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:31:55.227209 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2327/4718] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:31:55 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:31:55.239113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cede72d-eee7-4e7c-8c06-79967714f168 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:55.239649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cede72d-eee7-4e7c-8c06-79967714f168 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:55.239649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cede72d-eee7-4e7c-8c06-79967714f168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:55.265671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4cede72d-eee7-4e7c-8c06-79967714f168 None None] MFA Rules not processed for user `cfc44d42881a4c81830b33885403ec4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:31:55.268385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4cede72d-eee7-4e7c-8c06-79967714f168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:31:55.346237 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2392/4719] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:31:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:31:55.361413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b87f45-c294-4cf6-b0f4-44bed57bac53 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:55.379195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b87f45-c294-4cf6-b0f4-44bed57bac53 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:55.389329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55959e1-c5ae-44ea-ad9d-611b0af47b6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:55.390527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55959e1-c5ae-44ea-ad9d-611b0af47b6a service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:55.391179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55959e1-c5ae-44ea-ad9d-611b0af47b6a service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:55.391609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55959e1-c5ae-44ea-ad9d-611b0af47b6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:55.403010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55959e1-c5ae-44ea-ad9d-611b0af47b6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:31:55.405840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55959e1-c5ae-44ea-ad9d-611b0af47b6a service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:31:55.424244 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2328/4720] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:31:55 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:31:59.911561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cede72d-eee7-4e7c-8c06-79967714f168 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:31:59.935176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cede72d-eee7-4e7c-8c06-79967714f168 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:31:59.958829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa822d-2a0f-4fa5-8710-fa345ce36dc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:31:59.960209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa822d-2a0f-4fa5-8710-fa345ce36dc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:31:59.960513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa822d-2a0f-4fa5-8710-fa345ce36dc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:31:59.960794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa822d-2a0f-4fa5-8710-fa345ce36dc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:31:59.965766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-33aa822d-2a0f-4fa5-8710-fa345ce36dc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:00.007521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa822d-2a0f-4fa5-8710-fa345ce36dc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:00.009147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa822d-2a0f-4fa5-8710-fa345ce36dc6 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:00.051175 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2393/4721] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:31:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:32:03.501924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55959e1-c5ae-44ea-ad9d-611b0af47b6a service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:03.528763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55959e1-c5ae-44ea-ad9d-611b0af47b6a service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:03.541871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe7a08-8490-4f5d-8f02-4926afec4d5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:03.544461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe7a08-8490-4f5d-8f02-4926afec4d5f service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:03.544461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe7a08-8490-4f5d-8f02-4926afec4d5f service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:03.545507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe7a08-8490-4f5d-8f02-4926afec4d5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:03.550265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-acfe7a08-8490-4f5d-8f02-4926afec4d5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:03.592990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe7a08-8490-4f5d-8f02-4926afec4d5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:03.598385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe7a08-8490-4f5d-8f02-4926afec4d5f service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:03.641001 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2329/4722] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:32:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:32:06.993997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fd723-46e9-47d5-9e13-1e0c14e05f06 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:06.993997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fd723-46e9-47d5-9e13-1e0c14e05f06 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:06.993997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813fd723-46e9-47d5-9e13-1e0c14e05f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:07.040561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-813fd723-46e9-47d5-9e13-1e0c14e05f06 None None] MFA Rules not processed for user `e6bc3137faaf44cbb477f55fd7bd2644`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:32:07.042085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-813fd723-46e9-47d5-9e13-1e0c14e05f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:07.109065 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:32:07.159938 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2394/4723] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:32:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:32:07.260176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5356da-9bae-4534-ac04-743acb6764be None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:07.260650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5356da-9bae-4534-ac04-743acb6764be None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:07.260754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5356da-9bae-4534-ac04-743acb6764be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:07.310695 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5d5356da-9bae-4534-ac04-743acb6764be None None] MFA Rules not processed for user `e6bc3137faaf44cbb477f55fd7bd2644`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:32:07.312152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5d5356da-9bae-4534-ac04-743acb6764be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:07.339070 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2330/4724] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:32:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:32:08.908655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813fd723-46e9-47d5-9e13-1e0c14e05f06 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:08.930964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813fd723-46e9-47d5-9e13-1e0c14e05f06 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:08.939227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecc044-c1cb-419a-bc18-6672acfe6dca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:08.939915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecc044-c1cb-419a-bc18-6672acfe6dca service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:08.940357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecc044-c1cb-419a-bc18-6672acfe6dca service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:08.941454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecc044-c1cb-419a-bc18-6672acfe6dca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:08.943551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c9ecc044-c1cb-419a-bc18-6672acfe6dca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:08.962913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecc044-c1cb-419a-bc18-6672acfe6dca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:08.965254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecc044-c1cb-419a-bc18-6672acfe6dca service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:08.984682 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2395/4725] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:32:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:32:09.027154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5356da-9bae-4534-ac04-743acb6764be None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:09.045672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5356da-9bae-4534-ac04-743acb6764be None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:09.051586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950818e-4aa2-4166-95ff-f46423950fd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:09.052261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950818e-4aa2-4166-95ff-f46423950fd0 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:09.052551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950818e-4aa2-4166-95ff-f46423950fd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:09.053012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950818e-4aa2-4166-95ff-f46423950fd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:09.055184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f950818e-4aa2-4166-95ff-f46423950fd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:09.073484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950818e-4aa2-4166-95ff-f46423950fd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:09.075130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950818e-4aa2-4166-95ff-f46423950fd0 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:09.086626 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2331/4726] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:32:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:32:17.962391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319e04c-f673-4cf3-8f02-1de534aaf2ce None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:17.963321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319e04c-f673-4cf3-8f02-1de534aaf2ce None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:17.963831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319e04c-f673-4cf3-8f02-1de534aaf2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:17.987227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0319e04c-f673-4cf3-8f02-1de534aaf2ce None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:32:17.989940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0319e04c-f673-4cf3-8f02-1de534aaf2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:18.090634 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2396/4727] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:32:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:32:18.277830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950818e-4aa2-4166-95ff-f46423950fd0 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:18.281453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f950818e-4aa2-4166-95ff-f46423950fd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:18.480630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950818e-4aa2-4166-95ff-f46423950fd0 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:18.493973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4387a-984f-4792-b4c7-58db83076c4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:18.495821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4387a-984f-4792-b4c7-58db83076c4d service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:18.495821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4387a-984f-4792-b4c7-58db83076c4d service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:18.497897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4387a-984f-4792-b4c7-58db83076c4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:18.510238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4387a-984f-4792-b4c7-58db83076c4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:18.512188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4387a-984f-4792-b4c7-58db83076c4d service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:18.544729 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2332/4728] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:32:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:32:19.237094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319e04c-f673-4cf3-8f02-1de534aaf2ce None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:19.242694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0319e04c-f673-4cf3-8f02-1de534aaf2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:19.265585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319e04c-f673-4cf3-8f02-1de534aaf2ce None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:19.281017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cad9ad-b73e-44c6-aca8-47201a090cd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:19.282599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cad9ad-b73e-44c6-aca8-47201a090cd3 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:19.283067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cad9ad-b73e-44c6-aca8-47201a090cd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:19.284326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cad9ad-b73e-44c6-aca8-47201a090cd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:19.304003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cad9ad-b73e-44c6-aca8-47201a090cd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:19.306520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cad9ad-b73e-44c6-aca8-47201a090cd3 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:19.332711 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2397/4729] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:32:19 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:32:28.519857 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=62 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:32:29.316568 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=47 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:32:30.506393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4387a-984f-4792-b4c7-58db83076c4d service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:30.509111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-edd4387a-984f-4792-b4c7-58db83076c4d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:30.736468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4387a-984f-4792-b4c7-58db83076c4d service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:30.746719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f03df-5a43-4fe8-b047-d856b6fa852f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:30.758047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f03df-5a43-4fe8-b047-d856b6fa852f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:30.758520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f03df-5a43-4fe8-b047-d856b6fa852f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:30.758808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1f03df-5a43-4fe8-b047-d856b6fa852f admin admin] PATH_INFO: `/v3/users/1fe2cc7547f24fff8c797088a326f918` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:30.760279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f03df-5a43-4fe8-b047-d856b6fa852f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fe2cc7547f24fff8c797088a326f918)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:30.762283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1f03df-5a43-4fe8-b047-d856b6fa852f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:31.010320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-df1f03df-5a43-4fe8-b047-d856b6fa852f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fe2cc7547f24fff8c797088a326f918'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:31.026703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-df1f03df-5a43-4fe8-b047-d856b6fa852f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fe2cc7547f24fff8c797088a326f918'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:31.031145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-df1f03df-5a43-4fe8-b047-d856b6fa852f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fe2cc7547f24fff8c797088a326f918'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:31.031591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-df1f03df-5a43-4fe8-b047-d856b6fa852f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fe2cc7547f24fff8c797088a326f918'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:31.047885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-df1f03df-5a43-4fe8-b047-d856b6fa852f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fe2cc7547f24fff8c797088a326f918'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:31.145300 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2333/4730] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:32:30 2022] DELETE /identity/v3/users/1fe2cc7547f24fff8c797088a326f918 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:32:31.150486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8d3d4-5f9d-47e3-b191-f0c88cdbc7a6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:31.151430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8d3d4-5f9d-47e3-b191-f0c88cdbc7a6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:31.151878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8d3d4-5f9d-47e3-b191-f0c88cdbc7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:31.179249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4bf8d3d4-5f9d-47e3-b191-f0c88cdbc7a6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:32:31.180922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4bf8d3d4-5f9d-47e3-b191-f0c88cdbc7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:31.287659 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2398/4731] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:32:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:32:31.380572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f03df-5a43-4fe8-b047-d856b6fa852f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:31.382514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-df1f03df-5a43-4fe8-b047-d856b6fa852f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:31.502523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1f03df-5a43-4fe8-b047-d856b6fa852f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:31.517908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452673f5-eaa4-45a1-b282-5ecda46ac598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:31.518650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452673f5-eaa4-45a1-b282-5ecda46ac598 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:31.518901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452673f5-eaa4-45a1-b282-5ecda46ac598 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:31.519183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452673f5-eaa4-45a1-b282-5ecda46ac598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:31.544899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452673f5-eaa4-45a1-b282-5ecda46ac598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:31.546307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452673f5-eaa4-45a1-b282-5ecda46ac598 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:31.572913 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2334/4732] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:32:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:32:33.355112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8d3d4-5f9d-47e3-b191-f0c88cdbc7a6 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:33.357163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4bf8d3d4-5f9d-47e3-b191-f0c88cdbc7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:33.380830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8d3d4-5f9d-47e3-b191-f0c88cdbc7a6 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:33.413662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead2748-363e-4955-a507-ba3336e72a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:33.415084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead2748-363e-4955-a507-ba3336e72a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:33.418417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead2748-363e-4955-a507-ba3336e72a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:33.418902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead2748-363e-4955-a507-ba3336e72a76 admin admin] PATH_INFO: `/v3/projects/f7560c1bc9604ce18122728044cee65b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:33.420708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead2748-363e-4955-a507-ba3336e72a76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7560c1bc9604ce18122728044cee65b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:33.425455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead2748-363e-4955-a507-ba3336e72a76 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:33.664133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5ead2748-363e-4955-a507-ba3336e72a76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7560c1bc9604ce18122728044cee65b', 'request_id': 'req-5ead2748-363e-4955-a507-ba3336e72a76'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:33.685107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5ead2748-363e-4955-a507-ba3336e72a76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7560c1bc9604ce18122728044cee65b', 'request_id': 'req-5ead2748-363e-4955-a507-ba3336e72a76'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:33.701988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5ead2748-363e-4955-a507-ba3336e72a76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7560c1bc9604ce18122728044cee65b', 'request_id': 'req-5ead2748-363e-4955-a507-ba3336e72a76'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:33.795532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5ead2748-363e-4955-a507-ba3336e72a76 admin admin] The token cache is being invalidate because project f7560c1bc9604ce18122728044cee65b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:32:33.795903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5ead2748-363e-4955-a507-ba3336e72a76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:33.796537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5ead2748-363e-4955-a507-ba3336e72a76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:33.802231 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2399/4733] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:32:33 2022] DELETE /identity/v3/projects/f7560c1bc9604ce18122728044cee65b => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:32:33.807969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6faa9f-1ac2-4cfd-b9cd-662e70f24113 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:33.809644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6faa9f-1ac2-4cfd-b9cd-662e70f24113 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:33.810125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6faa9f-1ac2-4cfd-b9cd-662e70f24113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:33.845545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2f6faa9f-1ac2-4cfd-b9cd-662e70f24113 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:32:33.847531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2f6faa9f-1ac2-4cfd-b9cd-662e70f24113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:33.901562 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:32:34.068016 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2335/4734] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:32:34.072163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddff928-17c7-4078-8051-1af2f30435f1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:34.072924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddff928-17c7-4078-8051-1af2f30435f1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:34.073414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddff928-17c7-4078-8051-1af2f30435f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:34.095060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-dddff928-17c7-4078-8051-1af2f30435f1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:32:34.096688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dddff928-17c7-4078-8051-1af2f30435f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:34.113766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6faa9f-1ac2-4cfd-b9cd-662e70f24113 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:34.114130 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2400/4735] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:32:34.152550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6faa9f-1ac2-4cfd-b9cd-662e70f24113 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:34.183253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275e957-5e97-4467-8eed-32649aaf2908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:34.184236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275e957-5e97-4467-8eed-32649aaf2908 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:34.184528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275e957-5e97-4467-8eed-32649aaf2908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:34.184812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275e957-5e97-4467-8eed-32649aaf2908 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:34.185570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275e957-5e97-4467-8eed-32649aaf2908 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:32:34.185880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275e957-5e97-4467-8eed-32649aaf2908 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:34.187633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275e957-5e97-4467-8eed-32649aaf2908 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:34.223701 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2336/4736] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:32:34.227116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddff928-17c7-4078-8051-1af2f30435f1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:34.243463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddff928-17c7-4078-8051-1af2f30435f1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:34.263722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e19284-14e1-47a3-80fb-236ffba394f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:34.265393 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e19284-14e1-47a3-80fb-236ffba394f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:34.267012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e19284-14e1-47a3-80fb-236ffba394f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:34.267463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e19284-14e1-47a3-80fb-236ffba394f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:34.270059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e19284-14e1-47a3-80fb-236ffba394f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:34.275563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e19284-14e1-47a3-80fb-236ffba394f6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:34.448715 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2401/4737] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:32:34 2022] POST /identity/v3/projects => generated 385 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:32:34.453216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275e957-5e97-4467-8eed-32649aaf2908 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:34.472872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275e957-5e97-4467-8eed-32649aaf2908 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:34.722798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e66ee7-85a3-495a-a2c5-25802d0cb87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:34.723900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e66ee7-85a3-495a-a2c5-25802d0cb87f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:34.724190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e66ee7-85a3-495a-a2c5-25802d0cb87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:34.724472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e66ee7-85a3-495a-a2c5-25802d0cb87f admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:34.725243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e66ee7-85a3-495a-a2c5-25802d0cb87f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:34.728631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e66ee7-85a3-495a-a2c5-25802d0cb87f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:34.899227 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2337/4738] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:32:34 2022] POST /identity/v3/users => generated 293 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:32:34.903371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e19284-14e1-47a3-80fb-236ffba394f6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:34.921512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e19284-14e1-47a3-80fb-236ffba394f6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:34.941336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6a24a-b20f-4e8c-a591-60c5c822ad3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:34.942337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6a24a-b20f-4e8c-a591-60c5c822ad3a admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:34.942778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6a24a-b20f-4e8c-a591-60c5c822ad3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:34.943210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6a24a-b20f-4e8c-a591-60c5c822ad3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:34.945876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6a24a-b20f-4e8c-a591-60c5c822ad3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:34.949542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6a24a-b20f-4e8c-a591-60c5c822ad3a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:34.974192 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2402/4739] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:32:34.978686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e66ee7-85a3-495a-a2c5-25802d0cb87f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:34.997747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e66ee7-85a3-495a-a2c5-25802d0cb87f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:35.021606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d787c4-f0a3-40be-8363-4ca03a8b7e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:35.023779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d787c4-f0a3-40be-8363-4ca03a8b7e5d admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:35.024250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d787c4-f0a3-40be-8363-4ca03a8b7e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:35.025435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d787c4-f0a3-40be-8363-4ca03a8b7e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:35.026936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d787c4-f0a3-40be-8363-4ca03a8b7e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:35.031874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d787c4-f0a3-40be-8363-4ca03a8b7e5d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:35.062816 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2338/4740] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:32:34 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:32:35.067112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6a24a-b20f-4e8c-a591-60c5c822ad3a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:35.089406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6a24a-b20f-4e8c-a591-60c5c822ad3a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:35.106956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dad043-37c0-4cd0-aca2-c916709f6e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:35.107881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dad043-37c0-4cd0-aca2-c916709f6e3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:35.108167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dad043-37c0-4cd0-aca2-c916709f6e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:35.108450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dad043-37c0-4cd0-aca2-c916709f6e3d admin admin] PATH_INFO: `/v3/projects/5d182677f7664b01b2e905934a1d90b8/users/ba86d748d8224ff5a7cb575b28a03479/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:35.147386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dad043-37c0-4cd0-aca2-c916709f6e3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d182677f7664b01b2e905934a1d90b8, user_id=ba86d748d8224ff5a7cb575b28a03479, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:35.150345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dad043-37c0-4cd0-aca2-c916709f6e3d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:35.250169 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2403/4741] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:32:35 2022] PUT /identity/v3/projects/5d182677f7664b01b2e905934a1d90b8/users/ba86d748d8224ff5a7cb575b28a03479/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:32:35.264720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b1bcd-013c-4f12-920d-104fa87cb586 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:35.264981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b1bcd-013c-4f12-920d-104fa87cb586 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:35.265219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b1bcd-013c-4f12-920d-104fa87cb586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:35.322193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b49b1bcd-013c-4f12-920d-104fa87cb586 None None] MFA Rules not processed for user `ba86d748d8224ff5a7cb575b28a03479`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:32:35.323574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b49b1bcd-013c-4f12-920d-104fa87cb586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:35.480999 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2339/4742] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:32:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:32:35.562046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dad043-37c0-4cd0-aca2-c916709f6e3d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:35.563916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-36dad043-37c0-4cd0-aca2-c916709f6e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:35.625906 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:32:35.722675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dad043-37c0-4cd0-aca2-c916709f6e3d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:35.734985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f3e13-58aa-4be4-bc64-1c4a069bfa91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:35.734985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f3e13-58aa-4be4-bc64-1c4a069bfa91 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:35.734985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f3e13-58aa-4be4-bc64-1c4a069bfa91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:35.734985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f3e13-58aa-4be4-bc64-1c4a069bfa91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:35.760107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f3e13-58aa-4be4-bc64-1c4a069bfa91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:35.761837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f3e13-58aa-4be4-bc64-1c4a069bfa91 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:35.783510 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2404/4743] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:32:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:32:37.342358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b1bcd-013c-4f12-920d-104fa87cb586 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:37.346033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b49b1bcd-013c-4f12-920d-104fa87cb586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:37.405882 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:32:37.490544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b1bcd-013c-4f12-920d-104fa87cb586 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:37.496251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f51da6-e502-49a5-916b-535481ceb972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:37.497294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f51da6-e502-49a5-916b-535481ceb972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:37.497587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f51da6-e502-49a5-916b-535481ceb972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:37.497870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f51da6-e502-49a5-916b-535481ceb972 admin admin] PATH_INFO: `/v3/users/449cf19919884836989820930ce65fa7` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:37.499135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f51da6-e502-49a5-916b-535481ceb972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=449cf19919884836989820930ce65fa7)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:37.501425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f51da6-e502-49a5-916b-535481ceb972 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:37.758361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-85f51da6-e502-49a5-916b-535481ceb972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '449cf19919884836989820930ce65fa7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:37.781644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-85f51da6-e502-49a5-916b-535481ceb972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '449cf19919884836989820930ce65fa7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:37.783118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-85f51da6-e502-49a5-916b-535481ceb972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '449cf19919884836989820930ce65fa7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:37.783941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-85f51da6-e502-49a5-916b-535481ceb972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '449cf19919884836989820930ce65fa7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:37.796939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-85f51da6-e502-49a5-916b-535481ceb972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '449cf19919884836989820930ce65fa7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:37.942736 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2340/4744] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:32:37 2022] DELETE /identity/v3/users/449cf19919884836989820930ce65fa7 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:32:38.627272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f3e13-58aa-4be4-bc64-1c4a069bfa91 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:38.696051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f3e13-58aa-4be4-bc64-1c4a069bfa91 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:38.844540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5553c-5313-41c0-87cc-1ab032b291a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:38.845762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5553c-5313-41c0-87cc-1ab032b291a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:38.846054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5553c-5313-41c0-87cc-1ab032b291a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:38.846368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5553c-5313-41c0-87cc-1ab032b291a6 admin admin] PATH_INFO: `/v3/projects/dd166032112e4ecba0858709f271fa41` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:38.848696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5553c-5313-41c0-87cc-1ab032b291a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd166032112e4ecba0858709f271fa41)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:38.850973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5553c-5313-41c0-87cc-1ab032b291a6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:39.103920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-07b5553c-5313-41c0-87cc-1ab032b291a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd166032112e4ecba0858709f271fa41', 'request_id': 'req-07b5553c-5313-41c0-87cc-1ab032b291a6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:39.119827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-07b5553c-5313-41c0-87cc-1ab032b291a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd166032112e4ecba0858709f271fa41', 'request_id': 'req-07b5553c-5313-41c0-87cc-1ab032b291a6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:39.145432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-07b5553c-5313-41c0-87cc-1ab032b291a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd166032112e4ecba0858709f271fa41', 'request_id': 'req-07b5553c-5313-41c0-87cc-1ab032b291a6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:39.251977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f51da6-e502-49a5-916b-535481ceb972 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:39.253511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-85f51da6-e502-49a5-916b-535481ceb972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:39.263384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-07b5553c-5313-41c0-87cc-1ab032b291a6 admin admin] The token cache is being invalidate because project dd166032112e4ecba0858709f271fa41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:32:39.263876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-07b5553c-5313-41c0-87cc-1ab032b291a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:39.264650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-07b5553c-5313-41c0-87cc-1ab032b291a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:39.271296 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2405/4745] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:32:38 2022] DELETE /identity/v3/projects/dd166032112e4ecba0858709f271fa41 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:32:39.284744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e610768-7319-4d9d-9d47-331145723e38 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:39.289803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e610768-7319-4d9d-9d47-331145723e38 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:39.290821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e610768-7319-4d9d-9d47-331145723e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:39.451842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3e610768-7319-4d9d-9d47-331145723e38 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:32:39.458136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3e610768-7319-4d9d-9d47-331145723e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:39.517937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f51da6-e502-49a5-916b-535481ceb972 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:39.596225 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:32:39.606299 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:32:39.640593 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2406/4746] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:32:39.649426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5c0e0-8936-4115-97d8-46cc76dcf99b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:39.650001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5c0e0-8936-4115-97d8-46cc76dcf99b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:39.650524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5c0e0-8936-4115-97d8-46cc76dcf99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:39.653302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b9ea1-082b-4d4b-a1c0-c0ec75ad3bbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:39.653984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b9ea1-082b-4d4b-a1c0-c0ec75ad3bbe service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:39.654328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b9ea1-082b-4d4b-a1c0-c0ec75ad3bbe service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:39.654630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b9ea1-082b-4d4b-a1c0-c0ec75ad3bbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:39.659358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0e7b9ea1-082b-4d4b-a1c0-c0ec75ad3bbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:39.686339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b9ea1-082b-4d4b-a1c0-c0ec75ad3bbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:39.689238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b9ea1-082b-4d4b-a1c0-c0ec75ad3bbe service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:39.697178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a9c5c0e0-8936-4115-97d8-46cc76dcf99b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:32:39.700677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a9c5c0e0-8936-4115-97d8-46cc76dcf99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:39.718484 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2341/4747] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:32:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:32:39.720888 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2407/4748] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:32:39.722234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b9ea1-082b-4d4b-a1c0-c0ec75ad3bbe service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:39.751637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b9ea1-082b-4d4b-a1c0-c0ec75ad3bbe service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:39.757261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae69f2-7376-4cd1-a4b1-98580f9dccf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:39.757982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae69f2-7376-4cd1-a4b1-98580f9dccf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:39.758300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae69f2-7376-4cd1-a4b1-98580f9dccf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:39.758736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae69f2-7376-4cd1-a4b1-98580f9dccf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:39.759340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae69f2-7376-4cd1-a4b1-98580f9dccf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:32:39.759651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae69f2-7376-4cd1-a4b1-98580f9dccf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:39.761410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae69f2-7376-4cd1-a4b1-98580f9dccf1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:39.798068 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2342/4749] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:32:39.805438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5c0e0-8936-4115-97d8-46cc76dcf99b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:39.837125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5c0e0-8936-4115-97d8-46cc76dcf99b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:39.851178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30cbcd-a475-4b4d-bc4b-e227dacc5b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:39.852147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30cbcd-a475-4b4d-bc4b-e227dacc5b88 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:39.852558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30cbcd-a475-4b4d-bc4b-e227dacc5b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:39.852983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de30cbcd-a475-4b4d-bc4b-e227dacc5b88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:39.854588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30cbcd-a475-4b4d-bc4b-e227dacc5b88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:39.859371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de30cbcd-a475-4b4d-bc4b-e227dacc5b88 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:40.005103 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2408/4750] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:32:39 2022] POST /identity/v3/projects => generated 373 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:32:40.006381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae69f2-7376-4cd1-a4b1-98580f9dccf1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:40.021921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae69f2-7376-4cd1-a4b1-98580f9dccf1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:40.248029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b94c3-1ec4-4699-aa16-2b484a6b359e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:40.248888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b94c3-1ec4-4699-aa16-2b484a6b359e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:40.249769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b94c3-1ec4-4699-aa16-2b484a6b359e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:40.250138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9b94c3-1ec4-4699-aa16-2b484a6b359e admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:40.251131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b94c3-1ec4-4699-aa16-2b484a6b359e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:40.254209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9b94c3-1ec4-4699-aa16-2b484a6b359e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:40.349880 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2343/4751] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:32:40 2022] POST /identity/v3/users => generated 287 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:32:40.350959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30cbcd-a475-4b4d-bc4b-e227dacc5b88 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:40.365142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de30cbcd-a475-4b4d-bc4b-e227dacc5b88 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:40.383017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad19abc-9dbd-407e-bd0e-320bb82df093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:40.383725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad19abc-9dbd-407e-bd0e-320bb82df093 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:40.384022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad19abc-9dbd-407e-bd0e-320bb82df093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:40.384308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad19abc-9dbd-407e-bd0e-320bb82df093 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:40.385066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad19abc-9dbd-407e-bd0e-320bb82df093 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:40.386757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad19abc-9dbd-407e-bd0e-320bb82df093 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:40.432329 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2409/4752] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:32:40.433566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b94c3-1ec4-4699-aa16-2b484a6b359e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:40.451036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9b94c3-1ec4-4699-aa16-2b484a6b359e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:40.469618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78bddf1-46dd-4fc6-ae35-5b1d10605f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:40.470629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bddf1-46dd-4fc6-ae35-5b1d10605f7e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:40.476518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bddf1-46dd-4fc6-ae35-5b1d10605f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:40.485260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78bddf1-46dd-4fc6-ae35-5b1d10605f7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:40.485260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bddf1-46dd-4fc6-ae35-5b1d10605f7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:40.485260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78bddf1-46dd-4fc6-ae35-5b1d10605f7e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:40.523418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad19abc-9dbd-407e-bd0e-320bb82df093 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:40.524996 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2344/4753] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:32:40.547391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad19abc-9dbd-407e-bd0e-320bb82df093 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:40.560510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1415ede-5a36-4a75-a81d-33e9482d0837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:40.561416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1415ede-5a36-4a75-a81d-33e9482d0837 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:40.561704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1415ede-5a36-4a75-a81d-33e9482d0837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:40.561986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1415ede-5a36-4a75-a81d-33e9482d0837 admin admin] PATH_INFO: `/v3/projects/818a39ea1dcc459c897afce58c902df2/users/37622a8ba0dd4cc2b1e19a319d61ad95/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:40.590778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1415ede-5a36-4a75-a81d-33e9482d0837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=818a39ea1dcc459c897afce58c902df2, user_id=37622a8ba0dd4cc2b1e19a319d61ad95, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:40.593389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1415ede-5a36-4a75-a81d-33e9482d0837 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:40.754739 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2410/4754] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:32:40 2022] PUT /identity/v3/projects/818a39ea1dcc459c897afce58c902df2/users/37622a8ba0dd4cc2b1e19a319d61ad95/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:32:40.766874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8227e-d259-409f-a977-995ea5d12a20 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:40.767170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8227e-d259-409f-a977-995ea5d12a20 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:40.767455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8227e-d259-409f-a977-995ea5d12a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:40.822256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-caf8227e-d259-409f-a977-995ea5d12a20 None None] MFA Rules not processed for user `37622a8ba0dd4cc2b1e19a319d61ad95`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:32:40.824830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-caf8227e-d259-409f-a977-995ea5d12a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:41.025463 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2345/4755] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:32:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:32:41.025668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b15e4-4d16-43c2-a9c2-b12639a21fdf None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:41.025668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b15e4-4d16-43c2-a9c2-b12639a21fdf None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:41.025668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b15e4-4d16-43c2-a9c2-b12639a21fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:41.038407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-464b15e4-4d16-43c2-a9c2-b12639a21fdf None None] MFA Rules not processed for user `37622a8ba0dd4cc2b1e19a319d61ad95`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:32:41.040837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-464b15e4-4d16-43c2-a9c2-b12639a21fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:41.051847 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2411/4756] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:32:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:32:41.066338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8227e-d259-409f-a977-995ea5d12a20 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:41.069017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-caf8227e-d259-409f-a977-995ea5d12a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:41.109583 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:32:41.224479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8227e-d259-409f-a977-995ea5d12a20 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:41.232375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b043ab-b6be-4f9c-9b98-263d5cf00a53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:41.233936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b043ab-b6be-4f9c-9b98-263d5cf00a53 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:41.235322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b043ab-b6be-4f9c-9b98-263d5cf00a53 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:41.236134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b043ab-b6be-4f9c-9b98-263d5cf00a53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:41.262191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b043ab-b6be-4f9c-9b98-263d5cf00a53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:41.267756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b043ab-b6be-4f9c-9b98-263d5cf00a53 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:41.287375 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2346/4757] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:32:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:32:51.019330 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=33,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:32:52.062677 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=27 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:32:54.460929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b15e4-4d16-43c2-a9c2-b12639a21fdf None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:54.463501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-464b15e4-4d16-43c2-a9c2-b12639a21fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:54.614019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b15e4-4d16-43c2-a9c2-b12639a21fdf None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:54.621206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d71fbd-5c4d-420c-9e61-df3fe4c64cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:54.623982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d71fbd-5c4d-420c-9e61-df3fe4c64cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:54.624524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d71fbd-5c4d-420c-9e61-df3fe4c64cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:54.624979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d71fbd-5c4d-420c-9e61-df3fe4c64cb8 admin admin] PATH_INFO: `/v3/users/cfc44d42881a4c81830b33885403ec4e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:54.626876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d71fbd-5c4d-420c-9e61-df3fe4c64cb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfc44d42881a4c81830b33885403ec4e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:54.630362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d71fbd-5c4d-420c-9e61-df3fe4c64cb8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:54.903067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-44d71fbd-5c4d-420c-9e61-df3fe4c64cb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfc44d42881a4c81830b33885403ec4e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:54.952415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-44d71fbd-5c4d-420c-9e61-df3fe4c64cb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfc44d42881a4c81830b33885403ec4e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:54.970863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-44d71fbd-5c4d-420c-9e61-df3fe4c64cb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfc44d42881a4c81830b33885403ec4e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:54.971634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-44d71fbd-5c4d-420c-9e61-df3fe4c64cb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfc44d42881a4c81830b33885403ec4e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:55.076170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-44d71fbd-5c4d-420c-9e61-df3fe4c64cb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfc44d42881a4c81830b33885403ec4e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:55.083757 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2412/4758] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:32:54 2022] DELETE /identity/v3/users/cfc44d42881a4c81830b33885403ec4e => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:32:55.761701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b043ab-b6be-4f9c-9b98-263d5cf00a53 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:55.785127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b043ab-b6be-4f9c-9b98-263d5cf00a53 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:55.810456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d71fbd-5c4d-420c-9e61-df3fe4c64cb8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:55.812166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-44d71fbd-5c4d-420c-9e61-df3fe4c64cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:55.930056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86c34c-01be-4f0d-9be2-0217af294ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:55.932954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86c34c-01be-4f0d-9be2-0217af294ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:55.934412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86c34c-01be-4f0d-9be2-0217af294ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:55.934915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86c34c-01be-4f0d-9be2-0217af294ea6 admin admin] PATH_INFO: `/v3/projects/d5775c7cad8e464d9e17729b021ef92b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:55.937545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86c34c-01be-4f0d-9be2-0217af294ea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5775c7cad8e464d9e17729b021ef92b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:55.943916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86c34c-01be-4f0d-9be2-0217af294ea6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:55.969915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d71fbd-5c4d-420c-9e61-df3fe4c64cb8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:55.974559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9aa148-8427-4e13-9f18-eb9cd5c1d60e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:55.977431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9aa148-8427-4e13-9f18-eb9cd5c1d60e service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:55.977957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9aa148-8427-4e13-9f18-eb9cd5c1d60e service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:55.978560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9aa148-8427-4e13-9f18-eb9cd5c1d60e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:55.981067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-de9aa148-8427-4e13-9f18-eb9cd5c1d60e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:56.010846 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:32:56.136770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9aa148-8427-4e13-9f18-eb9cd5c1d60e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:56.141843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9aa148-8427-4e13-9f18-eb9cd5c1d60e service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:56.145696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3c86c34c-01be-4f0d-9be2-0217af294ea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5775c7cad8e464d9e17729b021ef92b', 'request_id': 'req-3c86c34c-01be-4f0d-9be2-0217af294ea6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:56.160154 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2413/4759] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:32:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:32:56.258871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3c86c34c-01be-4f0d-9be2-0217af294ea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5775c7cad8e464d9e17729b021ef92b', 'request_id': 'req-3c86c34c-01be-4f0d-9be2-0217af294ea6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:56.269129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3c86c34c-01be-4f0d-9be2-0217af294ea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5775c7cad8e464d9e17729b021ef92b', 'request_id': 'req-3c86c34c-01be-4f0d-9be2-0217af294ea6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:56.292833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3c86c34c-01be-4f0d-9be2-0217af294ea6 admin admin] The token cache is being invalidate because project d5775c7cad8e464d9e17729b021ef92b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:32:56.293363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3c86c34c-01be-4f0d-9be2-0217af294ea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:56.294032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3c86c34c-01be-4f0d-9be2-0217af294ea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:56.295961 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2347/4760] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:32:55 2022] DELETE /identity/v3/projects/d5775c7cad8e464d9e17729b021ef92b => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:32:56.300664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9aa148-8427-4e13-9f18-eb9cd5c1d60e service glance] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:56.302226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-de9aa148-8427-4e13-9f18-eb9cd5c1d60e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:56.312081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86c34c-01be-4f0d-9be2-0217af294ea6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:56.314249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3c86c34c-01be-4f0d-9be2-0217af294ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:56.324963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9aa148-8427-4e13-9f18-eb9cd5c1d60e service glance] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:56.425022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8960987-30f2-4586-a09c-821e03829363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:56.426315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8960987-30f2-4586-a09c-821e03829363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:56.426606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8960987-30f2-4586-a09c-821e03829363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:56.426885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8960987-30f2-4586-a09c-821e03829363 admin admin] PATH_INFO: `/v3/users/b6c3ce3eec7749eb9490a7f786e4edff` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:56.428764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8960987-30f2-4586-a09c-821e03829363 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6c3ce3eec7749eb9490a7f786e4edff)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:56.440318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8960987-30f2-4586-a09c-821e03829363 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:56.456865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86c34c-01be-4f0d-9be2-0217af294ea6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:56.464025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa47c27-ec5b-4d93-8b80-fe1883ada244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:56.465107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa47c27-ec5b-4d93-8b80-fe1883ada244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:56.465755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa47c27-ec5b-4d93-8b80-fe1883ada244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:56.466828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa47c27-ec5b-4d93-8b80-fe1883ada244 admin admin] PATH_INFO: `/v3/users/ba86d748d8224ff5a7cb575b28a03479` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:56.468344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa47c27-ec5b-4d93-8b80-fe1883ada244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba86d748d8224ff5a7cb575b28a03479)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:56.470626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa47c27-ec5b-4d93-8b80-fe1883ada244 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:56.643731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b8960987-30f2-4586-a09c-821e03829363 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6c3ce3eec7749eb9490a7f786e4edff'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:56.659101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b8960987-30f2-4586-a09c-821e03829363 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6c3ce3eec7749eb9490a7f786e4edff'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:56.666554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b8960987-30f2-4586-a09c-821e03829363 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6c3ce3eec7749eb9490a7f786e4edff'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:56.667286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b8960987-30f2-4586-a09c-821e03829363 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6c3ce3eec7749eb9490a7f786e4edff'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:56.768272 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:32:56.780835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3fa47c27-ec5b-4d93-8b80-fe1883ada244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba86d748d8224ff5a7cb575b28a03479'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:56.794756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3fa47c27-ec5b-4d93-8b80-fe1883ada244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba86d748d8224ff5a7cb575b28a03479'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:56.795502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3fa47c27-ec5b-4d93-8b80-fe1883ada244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba86d748d8224ff5a7cb575b28a03479'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:56.796139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3fa47c27-ec5b-4d93-8b80-fe1883ada244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba86d748d8224ff5a7cb575b28a03479'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:56.813314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b8960987-30f2-4586-a09c-821e03829363 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6c3ce3eec7749eb9490a7f786e4edff'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:56.823757 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2414/4761] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:32:56 2022] DELETE /identity/v3/users/b6c3ce3eec7749eb9490a7f786e4edff => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:32:56.828547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8960987-30f2-4586-a09c-821e03829363 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:56.831053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b8960987-30f2-4586-a09c-821e03829363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:56.833438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3fa47c27-ec5b-4d93-8b80-fe1883ada244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba86d748d8224ff5a7cb575b28a03479'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:56.917423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8960987-30f2-4586-a09c-821e03829363 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:56.922559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f09ec-c337-4764-98ce-b356596c7eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:56.923329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f09ec-c337-4764-98ce-b356596c7eae service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:56.923688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f09ec-c337-4764-98ce-b356596c7eae service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:56.924038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f09ec-c337-4764-98ce-b356596c7eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:56.926658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8b7f09ec-c337-4764-98ce-b356596c7eae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:56.945885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f09ec-c337-4764-98ce-b356596c7eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:56.945885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f09ec-c337-4764-98ce-b356596c7eae service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:56.953411 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2348/4762] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:32:56 2022] DELETE /identity/v3/users/ba86d748d8224ff5a7cb575b28a03479 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:32:56.957941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44eac3-7a42-4c81-b7fc-8415aa00360f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:56.958310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44eac3-7a42-4c81-b7fc-8415aa00360f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:56.958601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44eac3-7a42-4c81-b7fc-8415aa00360f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:56.963481 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2415/4763] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:32:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:32:56.996111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-bc44eac3-7a42-4c81-b7fc-8415aa00360f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:32:56.998389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bc44eac3-7a42-4c81-b7fc-8415aa00360f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:57.075227 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2349/4764] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:32:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:32:57.127538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f09ec-c337-4764-98ce-b356596c7eae service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:57.138791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f09ec-c337-4764-98ce-b356596c7eae service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:57.214676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee991a-7c10-4065-9711-d70f2112ca4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:57.215945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee991a-7c10-4065-9711-d70f2112ca4d service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:57.215945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee991a-7c10-4065-9711-d70f2112ca4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:57.215945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee991a-7c10-4065-9711-d70f2112ca4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:57.232894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee991a-7c10-4065-9711-d70f2112ca4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:57.235097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee991a-7c10-4065-9711-d70f2112ca4d service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:57.248309 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2416/4765] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:32:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:32:57.591604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44eac3-7a42-4c81-b7fc-8415aa00360f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:57.593370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bc44eac3-7a42-4c81-b7fc-8415aa00360f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:57.623071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44eac3-7a42-4c81-b7fc-8415aa00360f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:57.628422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aaf17c-3597-4af7-b294-9710b3316037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:57.629645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaf17c-3597-4af7-b294-9710b3316037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:57.630249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaf17c-3597-4af7-b294-9710b3316037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:57.630736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aaf17c-3597-4af7-b294-9710b3316037 admin admin] PATH_INFO: `/v3/projects/c2509dffb0784e36b2a1898f8e1a7430` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:57.632278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aaf17c-3597-4af7-b294-9710b3316037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2509dffb0784e36b2a1898f8e1a7430)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:57.634851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aaf17c-3597-4af7-b294-9710b3316037 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:57.795619 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:32:57.817870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d2aaf17c-3597-4af7-b294-9710b3316037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2509dffb0784e36b2a1898f8e1a7430', 'request_id': 'req-d2aaf17c-3597-4af7-b294-9710b3316037'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:57.919111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee991a-7c10-4065-9711-d70f2112ca4d service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:57.921254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-70ee991a-7c10-4065-9711-d70f2112ca4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:57.936536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee991a-7c10-4065-9711-d70f2112ca4d service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:57.944336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d2aaf17c-3597-4af7-b294-9710b3316037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2509dffb0784e36b2a1898f8e1a7430', 'request_id': 'req-d2aaf17c-3597-4af7-b294-9710b3316037'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:57.949584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d2aaf17c-3597-4af7-b294-9710b3316037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2509dffb0784e36b2a1898f8e1a7430', 'request_id': 'req-d2aaf17c-3597-4af7-b294-9710b3316037'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:57.968868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d2aaf17c-3597-4af7-b294-9710b3316037 admin admin] The token cache is being invalidate because project c2509dffb0784e36b2a1898f8e1a7430 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:32:57.969416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d2aaf17c-3597-4af7-b294-9710b3316037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:57.970669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d2aaf17c-3597-4af7-b294-9710b3316037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:57.972963 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2350/4766] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:32:57 2022] DELETE /identity/v3/projects/c2509dffb0784e36b2a1898f8e1a7430 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:32:57.978491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6e7cd-9e1d-4e60-8efa-4ce72cb5aadf None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:57.979226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6e7cd-9e1d-4e60-8efa-4ce72cb5aadf None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:57.979716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda6e7cd-9e1d-4e60-8efa-4ce72cb5aadf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:58.020280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-fda6e7cd-9e1d-4e60-8efa-4ce72cb5aadf None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:32:58.022547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fda6e7cd-9e1d-4e60-8efa-4ce72cb5aadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:58.077283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f626a5e0-21e5-4319-bbe3-252ec0788d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:58.078292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626a5e0-21e5-4319-bbe3-252ec0788d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:58.078782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626a5e0-21e5-4319-bbe3-252ec0788d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:58.082482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f626a5e0-21e5-4319-bbe3-252ec0788d11 admin admin] PATH_INFO: `/v3/projects/5d182677f7664b01b2e905934a1d90b8` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:58.084274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626a5e0-21e5-4319-bbe3-252ec0788d11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d182677f7664b01b2e905934a1d90b8)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:58.087336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f626a5e0-21e5-4319-bbe3-252ec0788d11 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:58.159565 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2351/4767] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:32:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:32:58.170441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f78cca-2afe-48db-9665-598c1596db44 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:58.170871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f78cca-2afe-48db-9665-598c1596db44 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:58.171182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f78cca-2afe-48db-9665-598c1596db44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:58.195203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-69f78cca-2afe-48db-9665-598c1596db44 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:32:58.196484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-69f78cca-2afe-48db-9665-598c1596db44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:58.227103 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2352/4768] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:32:58.228174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f78cca-2afe-48db-9665-598c1596db44 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:58.239371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f78cca-2afe-48db-9665-598c1596db44 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:58.246855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119309b3-ee83-4a8b-b224-e35e2f94543f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:58.251435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119309b3-ee83-4a8b-b224-e35e2f94543f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:58.251435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119309b3-ee83-4a8b-b224-e35e2f94543f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:58.251435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119309b3-ee83-4a8b-b224-e35e2f94543f admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:58.251435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119309b3-ee83-4a8b-b224-e35e2f94543f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:32:58.251435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119309b3-ee83-4a8b-b224-e35e2f94543f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:58.251435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119309b3-ee83-4a8b-b224-e35e2f94543f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:58.267925 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2353/4769] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:32:58.282758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119309b3-ee83-4a8b-b224-e35e2f94543f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:58.294792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119309b3-ee83-4a8b-b224-e35e2f94543f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:58.301219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072310af-f7f2-413e-af0f-35937f56e4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:58.301219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072310af-f7f2-413e-af0f-35937f56e4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:58.301219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072310af-f7f2-413e-af0f-35937f56e4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:58.301593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072310af-f7f2-413e-af0f-35937f56e4f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:58.302028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072310af-f7f2-413e-af0f-35937f56e4f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:58.304077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072310af-f7f2-413e-af0f-35937f56e4f3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:58.324222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f626a5e0-21e5-4319-bbe3-252ec0788d11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d182677f7664b01b2e905934a1d90b8', 'request_id': 'req-f626a5e0-21e5-4319-bbe3-252ec0788d11'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:58.331751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f626a5e0-21e5-4319-bbe3-252ec0788d11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d182677f7664b01b2e905934a1d90b8', 'request_id': 'req-f626a5e0-21e5-4319-bbe3-252ec0788d11'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:58.339680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f626a5e0-21e5-4319-bbe3-252ec0788d11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d182677f7664b01b2e905934a1d90b8', 'request_id': 'req-f626a5e0-21e5-4319-bbe3-252ec0788d11'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:58.384367 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2354/4770] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:32:58 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:32:58.388459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072310af-f7f2-413e-af0f-35937f56e4f3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:58.402265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f626a5e0-21e5-4319-bbe3-252ec0788d11 admin admin] The token cache is being invalidate because project 5d182677f7664b01b2e905934a1d90b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:32:58.402729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f626a5e0-21e5-4319-bbe3-252ec0788d11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:58.406737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f626a5e0-21e5-4319-bbe3-252ec0788d11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:58.406737 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2417/4771] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:32:57 2022] DELETE /identity/v3/projects/5d182677f7664b01b2e905934a1d90b8 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:32:58.411677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e8f17-3891-461a-9173-ada0a36775a8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:58.412212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e8f17-3891-461a-9173-ada0a36775a8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:58.413691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e8f17-3891-461a-9173-ada0a36775a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:58.450195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-527e8f17-3891-461a-9173-ada0a36775a8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:32:58.451817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-527e8f17-3891-461a-9173-ada0a36775a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:58.560069 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2418/4772] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:32:58.560419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072310af-f7f2-413e-af0f-35937f56e4f3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:58.563021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c46dc3-7dfd-4156-838e-9e0e30b919a6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:58.563504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c46dc3-7dfd-4156-838e-9e0e30b919a6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:58.563940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c46dc3-7dfd-4156-838e-9e0e30b919a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:58.571983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f56e6-af79-49b0-987d-eb13bdffc9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:58.572676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f56e6-af79-49b0-987d-eb13bdffc9ab admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:58.573005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f56e6-af79-49b0-987d-eb13bdffc9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:58.573252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9f56e6-af79-49b0-987d-eb13bdffc9ab admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:58.573959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f56e6-af79-49b0-987d-eb13bdffc9ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:58.578806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9f56e6-af79-49b0-987d-eb13bdffc9ab admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:58.625724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-46c46dc3-7dfd-4156-838e-9e0e30b919a6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:32:58.629113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-46c46dc3-7dfd-4156-838e-9e0e30b919a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:58.647709 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2419/4773] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:32:58.649491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c46dc3-7dfd-4156-838e-9e0e30b919a6 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:58.664351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c46dc3-7dfd-4156-838e-9e0e30b919a6 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:58.672067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35e379-3413-4d42-9e11-7bf83d589e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:58.672894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35e379-3413-4d42-9e11-7bf83d589e7c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:58.673191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35e379-3413-4d42-9e11-7bf83d589e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:58.673622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35e379-3413-4d42-9e11-7bf83d589e7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:58.674435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35e379-3413-4d42-9e11-7bf83d589e7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:32:58.679233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35e379-3413-4d42-9e11-7bf83d589e7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:58.679233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35e379-3413-4d42-9e11-7bf83d589e7c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:58.697823 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2420/4774] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:32:58.702979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35e379-3413-4d42-9e11-7bf83d589e7c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:58.716766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35e379-3413-4d42-9e11-7bf83d589e7c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:58.722311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f27c8-8f09-454d-b33f-d8ea91e41e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:58.723446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f27c8-8f09-454d-b33f-d8ea91e41e72 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:58.723446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f27c8-8f09-454d-b33f-d8ea91e41e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:58.723862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f27c8-8f09-454d-b33f-d8ea91e41e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:58.724851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f27c8-8f09-454d-b33f-d8ea91e41e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:58.727011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f27c8-8f09-454d-b33f-d8ea91e41e72 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:58.756008 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2355/4775] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:32:58 2022] POST /identity/v3/users => generated 294 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:32:58.762643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f56e6-af79-49b0-987d-eb13bdffc9ab admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:58.765030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fa9f56e6-af79-49b0-987d-eb13bdffc9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:58.779731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9f56e6-af79-49b0-987d-eb13bdffc9ab admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:58.784906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a544a0-a47b-495e-8d5e-b19638f608be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:58.788405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a544a0-a47b-495e-8d5e-b19638f608be admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:58.788405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a544a0-a47b-495e-8d5e-b19638f608be admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:58.788405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a544a0-a47b-495e-8d5e-b19638f608be admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:58.788405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a544a0-a47b-495e-8d5e-b19638f608be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:58.789503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a544a0-a47b-495e-8d5e-b19638f608be admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:58.800467 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2356/4776] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:32:58.807069 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:32:58.813720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a544a0-a47b-495e-8d5e-b19638f608be admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:58.824386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a544a0-a47b-495e-8d5e-b19638f608be admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:58.830515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eafec5-03ca-4ad2-a116-fdcf97b87452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:58.831484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eafec5-03ca-4ad2-a116-fdcf97b87452 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:58.832076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eafec5-03ca-4ad2-a116-fdcf97b87452 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:58.832358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eafec5-03ca-4ad2-a116-fdcf97b87452 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:58.833577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eafec5-03ca-4ad2-a116-fdcf97b87452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:58.836994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eafec5-03ca-4ad2-a116-fdcf97b87452 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:58.856062 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2357/4777] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:32:58.860712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eafec5-03ca-4ad2-a116-fdcf97b87452 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:58.874158 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2421/4778] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:32:58 2022] POST /identity/v3/projects => generated 361 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:32:58.874158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f27c8-8f09-454d-b33f-d8ea91e41e72 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:58.886540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eafec5-03ca-4ad2-a116-fdcf97b87452 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:58.966969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce77334-8fb3-4dee-9106-57633a8ef68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:58.968014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce77334-8fb3-4dee-9106-57633a8ef68e admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:58.968308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce77334-8fb3-4dee-9106-57633a8ef68e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:58.968588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce77334-8fb3-4dee-9106-57633a8ef68e admin admin] PATH_INFO: `/v3/projects/99ef7e23f70b4fdaaec62abd12c35fc6/users/48e0dd424eea4656aad4992a7c3ee65b/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:58.969725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f27c8-8f09-454d-b33f-d8ea91e41e72 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:58.975161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25690d59-ec5e-44b3-9b0a-b94be2857dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:58.975966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25690d59-ec5e-44b3-9b0a-b94be2857dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:58.976464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25690d59-ec5e-44b3-9b0a-b94be2857dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:58.980571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25690d59-ec5e-44b3-9b0a-b94be2857dd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:58.980571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25690d59-ec5e-44b3-9b0a-b94be2857dd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:58.980571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25690d59-ec5e-44b3-9b0a-b94be2857dd3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:59.004056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce77334-8fb3-4dee-9106-57633a8ef68e admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ef7e23f70b4fdaaec62abd12c35fc6, user_id=48e0dd424eea4656aad4992a7c3ee65b, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:59.008186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce77334-8fb3-4dee-9106-57633a8ef68e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:59.092327 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2422/4779] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:32:58 2022] POST /identity/v3/users => generated 281 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:32:59.098360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25690d59-ec5e-44b3-9b0a-b94be2857dd3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:59.109050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25690d59-ec5e-44b3-9b0a-b94be2857dd3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:59.116472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212cdab-2e38-46ee-911c-87b473159cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:59.117168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212cdab-2e38-46ee-911c-87b473159cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:59.117478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212cdab-2e38-46ee-911c-87b473159cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:59.117732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212cdab-2e38-46ee-911c-87b473159cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:59.119344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212cdab-2e38-46ee-911c-87b473159cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:59.124307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212cdab-2e38-46ee-911c-87b473159cc2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:59.136780 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2423/4781] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:32:59.138454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5deb80-3c3b-4407-9997-aaa460c33a97 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:59.139140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5deb80-3c3b-4407-9997-aaa460c33a97 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:59.139801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5deb80-3c3b-4407-9997-aaa460c33a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:59.141799 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2358/4780] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:32:58 2022] PUT /identity/v3/projects/99ef7e23f70b4fdaaec62abd12c35fc6/users/48e0dd424eea4656aad4992a7c3ee65b/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:32:59.143198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce77334-8fb3-4dee-9106-57633a8ef68e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:59.167882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ad5deb80-3c3b-4407-9997-aaa460c33a97 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:32:59.169750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ad5deb80-3c3b-4407-9997-aaa460c33a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:59.245757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce77334-8fb3-4dee-9106-57633a8ef68e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:59.247026 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2424/4782] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:32:59.255582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baa5fb-9484-407d-b28f-59a8631b9216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:59.257269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baa5fb-9484-407d-b28f-59a8631b9216 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:59.257558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baa5fb-9484-407d-b28f-59a8631b9216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:59.257840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94baa5fb-9484-407d-b28f-59a8631b9216 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:59.258620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baa5fb-9484-407d-b28f-59a8631b9216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:59.260232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94baa5fb-9484-407d-b28f-59a8631b9216 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:59.272699 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2359/4783] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:32:59.276736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5deb80-3c3b-4407-9997-aaa460c33a97 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:59.281546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baa5fb-9484-407d-b28f-59a8631b9216 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:59.283485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-94baa5fb-9484-407d-b28f-59a8631b9216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:59.288687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5deb80-3c3b-4407-9997-aaa460c33a97 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:59.295936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ecc04-7160-4308-9cbd-3a2483ed6208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:59.297384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ecc04-7160-4308-9cbd-3a2483ed6208 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:59.297950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ecc04-7160-4308-9cbd-3a2483ed6208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:59.298290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ecc04-7160-4308-9cbd-3a2483ed6208 admin admin] PATH_INFO: `/v3/projects/d5f50fc8bc5c4ec9a37a09359144a146/users/1757f193cde04293aa2747373f83910a/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:59.319151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ecc04-7160-4308-9cbd-3a2483ed6208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5f50fc8bc5c4ec9a37a09359144a146, user_id=1757f193cde04293aa2747373f83910a, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:59.322385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ecc04-7160-4308-9cbd-3a2483ed6208 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:59.359823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94baa5fb-9484-407d-b28f-59a8631b9216 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:59.366139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f9bf4-9a2a-44c1-bb00-48ac353e7144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:59.366139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f9bf4-9a2a-44c1-bb00-48ac353e7144 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:59.366139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f9bf4-9a2a-44c1-bb00-48ac353e7144 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:59.366139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f9bf4-9a2a-44c1-bb00-48ac353e7144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:59.378714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f9bf4-9a2a-44c1-bb00-48ac353e7144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:59.380165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f9bf4-9a2a-44c1-bb00-48ac353e7144 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:59.392097 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2360/4784] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:32:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:32:59.413092 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2425/4785] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:32:59 2022] PUT /identity/v3/projects/d5f50fc8bc5c4ec9a37a09359144a146/users/1757f193cde04293aa2747373f83910a/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:32:59.479884 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:32:59.509588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14efee-722b-470d-bbe9-1672281356d3 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:59.509971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14efee-722b-470d-bbe9-1672281356d3 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:59.510240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14efee-722b-470d-bbe9-1672281356d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:59.521368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ecc04-7160-4308-9cbd-3a2483ed6208 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:59.524741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3c6ecc04-7160-4308-9cbd-3a2483ed6208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:59.550403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ab14efee-722b-470d-bbe9-1672281356d3 None None] MFA Rules not processed for user `1757f193cde04293aa2747373f83910a`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:32:59.553822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ab14efee-722b-470d-bbe9-1672281356d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:59.616593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ecc04-7160-4308-9cbd-3a2483ed6208 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:59.623398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b5279-1f28-4f9c-8a5d-0587de4b0fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:59.624395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b5279-1f28-4f9c-8a5d-0587de4b0fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:59.625133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b5279-1f28-4f9c-8a5d-0587de4b0fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:59.625498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b5279-1f28-4f9c-8a5d-0587de4b0fc7 admin admin] PATH_INFO: `/v3/users/548555cc4c4447edbcffd44f52455bd0` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:59.626858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b5279-1f28-4f9c-8a5d-0587de4b0fc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=548555cc4c4447edbcffd44f52455bd0)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:59.630420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b5279-1f28-4f9c-8a5d-0587de4b0fc7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:59.660397 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2361/4786] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:32:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:32:59.684859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14efee-722b-470d-bbe9-1672281356d3 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:32:59.686770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ab14efee-722b-470d-bbe9-1672281356d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:32:59.776496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14efee-722b-470d-bbe9-1672281356d3 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:32:59.781149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4a06f-b54d-47b1-ada0-8bd65e552fd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:32:59.781845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4a06f-b54d-47b1-ada0-8bd65e552fd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:59.782156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4a06f-b54d-47b1-ada0-8bd65e552fd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:59.782442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4a06f-b54d-47b1-ada0-8bd65e552fd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:59.794588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4a06f-b54d-47b1-ada0-8bd65e552fd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:32:59.796200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4a06f-b54d-47b1-ada0-8bd65e552fd3 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:32:59.809962 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2362/4787] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:32:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:32:59.821982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-034b5279-1f28-4f9c-8a5d-0587de4b0fc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548555cc4c4447edbcffd44f52455bd0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:59.841134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-034b5279-1f28-4f9c-8a5d-0587de4b0fc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548555cc4c4447edbcffd44f52455bd0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:59.853918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-034b5279-1f28-4f9c-8a5d-0587de4b0fc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548555cc4c4447edbcffd44f52455bd0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:59.855475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-034b5279-1f28-4f9c-8a5d-0587de4b0fc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548555cc4c4447edbcffd44f52455bd0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:59.920991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-034b5279-1f28-4f9c-8a5d-0587de4b0fc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548555cc4c4447edbcffd44f52455bd0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:32:59.928779 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2426/4788] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:32:59 2022] DELETE /identity/v3/users/548555cc4c4447edbcffd44f52455bd0 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:32:59.940270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a0a13-0320-4fa0-af2f-58d6e65c5484 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:32:59.940848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a0a13-0320-4fa0-af2f-58d6e65c5484 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:32:59.940848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a0a13-0320-4fa0-af2f-58d6e65c5484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:32:59.963468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ef3a0a13-0320-4fa0-af2f-58d6e65c5484 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:32:59.964943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ef3a0a13-0320-4fa0-af2f-58d6e65c5484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:00.041076 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2363/4789] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:32:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:00.070635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b5279-1f28-4f9c-8a5d-0587de4b0fc7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:00.072998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-034b5279-1f28-4f9c-8a5d-0587de4b0fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:00.094307 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:00.152993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b5279-1f28-4f9c-8a5d-0587de4b0fc7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:00.158041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a3922-2882-4ceb-aa29-b773cefe4b36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:00.158843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a3922-2882-4ceb-aa29-b773cefe4b36 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:00.159139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a3922-2882-4ceb-aa29-b773cefe4b36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:00.159423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a3922-2882-4ceb-aa29-b773cefe4b36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:00.172281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a3922-2882-4ceb-aa29-b773cefe4b36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:00.173609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a3922-2882-4ceb-aa29-b773cefe4b36 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:00.185712 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2427/4790] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:33:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:33:00.527873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f81ce-1e81-429e-8c91-7dcefec93324 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:00.528220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f81ce-1e81-429e-8c91-7dcefec93324 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:00.528581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f81ce-1e81-429e-8c91-7dcefec93324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:00.559944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-210f81ce-1e81-429e-8c91-7dcefec93324 None None] MFA Rules not processed for user `48e0dd424eea4656aad4992a7c3ee65b`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:00.561276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-210f81ce-1e81-429e-8c91-7dcefec93324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:00.671248 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2364/4791] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:00.675369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a538a-d84d-43f7-a3f6-3be691fe322d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:00.675722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a538a-d84d-43f7-a3f6-3be691fe322d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:00.676072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a538a-d84d-43f7-a3f6-3be691fe322d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:00.699867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3d8a538a-d84d-43f7-a3f6-3be691fe322d None None] MFA Rules not processed for user `48e0dd424eea4656aad4992a7c3ee65b`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:00.701210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3d8a538a-d84d-43f7-a3f6-3be691fe322d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:00.715097 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2428/4792] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:00.730969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f81ce-1e81-429e-8c91-7dcefec93324 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:00.732842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-210f81ce-1e81-429e-8c91-7dcefec93324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:00.745551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbf6b2-9362-4dba-9861-a3c7ae4c50e0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:00.745850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbf6b2-9362-4dba-9861-a3c7ae4c50e0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:00.746155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bbf6b2-9362-4dba-9861-a3c7ae4c50e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:00.821629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-55bbf6b2-9362-4dba-9861-a3c7ae4c50e0 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:00.822883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-55bbf6b2-9362-4dba-9861-a3c7ae4c50e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:00.851097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f81ce-1e81-429e-8c91-7dcefec93324 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:00.858330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358bbc8-ea1e-46dd-a4e0-dc9f5b90fab3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:00.859009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358bbc8-ea1e-46dd-a4e0-dc9f5b90fab3 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:00.859284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358bbc8-ea1e-46dd-a4e0-dc9f5b90fab3 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:00.859564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358bbc8-ea1e-46dd-a4e0-dc9f5b90fab3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:00.869262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358bbc8-ea1e-46dd-a4e0-dc9f5b90fab3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:00.873581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358bbc8-ea1e-46dd-a4e0-dc9f5b90fab3 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:00.882375 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2365/4793] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:33:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:33:00.893912 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:00.907857 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2429/4794] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:33:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:00.921159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358bbc8-ea1e-46dd-a4e0-dc9f5b90fab3 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:00.922657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c358bbc8-ea1e-46dd-a4e0-dc9f5b90fab3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:00.933225 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:00.952437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbf6b2-9362-4dba-9861-a3c7ae4c50e0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:00.952437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-55bbf6b2-9362-4dba-9861-a3c7ae4c50e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:00.966571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bbf6b2-9362-4dba-9861-a3c7ae4c50e0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:00.981253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b9e18-4d1d-44ef-944a-ec2a726897e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:00.981635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b9e18-4d1d-44ef-944a-ec2a726897e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:00.982140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b9e18-4d1d-44ef-944a-ec2a726897e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:00.982140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b9e18-4d1d-44ef-944a-ec2a726897e4 admin admin] PATH_INFO: `/v3/projects/7d715ed5bbb34e03ad01c9038235d345` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:00.988785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b9e18-4d1d-44ef-944a-ec2a726897e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d715ed5bbb34e03ad01c9038235d345)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:00.992065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b9e18-4d1d-44ef-944a-ec2a726897e4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:01.047446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358bbc8-ea1e-46dd-a4e0-dc9f5b90fab3 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:01.055654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67892db0-a2ff-45a0-b96b-ee4a3f38fde8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:01.056499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67892db0-a2ff-45a0-b96b-ee4a3f38fde8 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:01.056889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67892db0-a2ff-45a0-b96b-ee4a3f38fde8 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:01.057723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67892db0-a2ff-45a0-b96b-ee4a3f38fde8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:01.067933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67892db0-a2ff-45a0-b96b-ee4a3f38fde8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:01.070350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67892db0-a2ff-45a0-b96b-ee4a3f38fde8 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:01.080182 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2366/4795] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:33:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:33:01.162255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1c8b9e18-4d1d-44ef-944a-ec2a726897e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d715ed5bbb34e03ad01c9038235d345', 'request_id': 'req-1c8b9e18-4d1d-44ef-944a-ec2a726897e4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:01.171675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1c8b9e18-4d1d-44ef-944a-ec2a726897e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d715ed5bbb34e03ad01c9038235d345', 'request_id': 'req-1c8b9e18-4d1d-44ef-944a-ec2a726897e4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:01.178892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1c8b9e18-4d1d-44ef-944a-ec2a726897e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d715ed5bbb34e03ad01c9038235d345', 'request_id': 'req-1c8b9e18-4d1d-44ef-944a-ec2a726897e4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:01.260107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1c8b9e18-4d1d-44ef-944a-ec2a726897e4 admin admin] The token cache is being invalidate because project 7d715ed5bbb34e03ad01c9038235d345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:33:01.260510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1c8b9e18-4d1d-44ef-944a-ec2a726897e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:01.261513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1c8b9e18-4d1d-44ef-944a-ec2a726897e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:01.264098 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2430/4796] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:33:00 2022] DELETE /identity/v3/projects/7d715ed5bbb34e03ad01c9038235d345 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:33:01.268250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67892db0-a2ff-45a0-b96b-ee4a3f38fde8 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:01.288754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67892db0-a2ff-45a0-b96b-ee4a3f38fde8 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:01.361228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379217b-3adb-4619-9070-cfc5de2694ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:01.362432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379217b-3adb-4619-9070-cfc5de2694ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:01.362818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379217b-3adb-4619-9070-cfc5de2694ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:01.363316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b379217b-3adb-4619-9070-cfc5de2694ef admin admin] PATH_INFO: `/v3/users/309e8f444f164d20a1fe8c982cfcf744` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:01.365197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379217b-3adb-4619-9070-cfc5de2694ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=309e8f444f164d20a1fe8c982cfcf744)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:01.367583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b379217b-3adb-4619-9070-cfc5de2694ef admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:01.647643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b379217b-3adb-4619-9070-cfc5de2694ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '309e8f444f164d20a1fe8c982cfcf744'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:01.686444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b379217b-3adb-4619-9070-cfc5de2694ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '309e8f444f164d20a1fe8c982cfcf744'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:01.687364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b379217b-3adb-4619-9070-cfc5de2694ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '309e8f444f164d20a1fe8c982cfcf744'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:01.688013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b379217b-3adb-4619-9070-cfc5de2694ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '309e8f444f164d20a1fe8c982cfcf744'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:01.716470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b379217b-3adb-4619-9070-cfc5de2694ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '309e8f444f164d20a1fe8c982cfcf744'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:01.849231 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2367/4797] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:33:01 2022] DELETE /identity/v3/users/309e8f444f164d20a1fe8c982cfcf744 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:33:01.864731 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:01.961379 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:02.280985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b9e18-4d1d-44ef-944a-ec2a726897e4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:02.282965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1c8b9e18-4d1d-44ef-944a-ec2a726897e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:02.304472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b9e18-4d1d-44ef-944a-ec2a726897e4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:02.376650 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:02.436712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152faa8c-056a-4cff-abcf-5f928610a51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:02.442553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152faa8c-056a-4cff-abcf-5f928610a51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:02.444087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152faa8c-056a-4cff-abcf-5f928610a51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:02.445575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152faa8c-056a-4cff-abcf-5f928610a51f admin admin] PATH_INFO: `/v3/users/48e0dd424eea4656aad4992a7c3ee65b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:02.449384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152faa8c-056a-4cff-abcf-5f928610a51f admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e0dd424eea4656aad4992a7c3ee65b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:02.452401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152faa8c-056a-4cff-abcf-5f928610a51f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:02.559225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379217b-3adb-4619-9070-cfc5de2694ef admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:02.561146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b379217b-3adb-4619-9070-cfc5de2694ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:02.577984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b379217b-3adb-4619-9070-cfc5de2694ef admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:02.585172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb4305-25c2-4441-a638-98b59d5e267c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:02.586772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb4305-25c2-4441-a638-98b59d5e267c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:02.587244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb4305-25c2-4441-a638-98b59d5e267c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:02.587772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb4305-25c2-4441-a638-98b59d5e267c admin admin] PATH_INFO: `/v3/projects/217694b1ad134e87891fa7503720d90f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:02.589499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb4305-25c2-4441-a638-98b59d5e267c admin admin] RBAC: Authorizing `identity:delete_project(project_id=217694b1ad134e87891fa7503720d90f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:02.592281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abb4305-25c2-4441-a638-98b59d5e267c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:02.686221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-152faa8c-056a-4cff-abcf-5f928610a51f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e0dd424eea4656aad4992a7c3ee65b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:02.706249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-152faa8c-056a-4cff-abcf-5f928610a51f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e0dd424eea4656aad4992a7c3ee65b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:02.718737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-152faa8c-056a-4cff-abcf-5f928610a51f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e0dd424eea4656aad4992a7c3ee65b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:02.719755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-152faa8c-056a-4cff-abcf-5f928610a51f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e0dd424eea4656aad4992a7c3ee65b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:02.802757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1abb4305-25c2-4441-a638-98b59d5e267c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217694b1ad134e87891fa7503720d90f', 'request_id': 'req-1abb4305-25c2-4441-a638-98b59d5e267c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:02.858409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-152faa8c-056a-4cff-abcf-5f928610a51f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e0dd424eea4656aad4992a7c3ee65b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:02.867514 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2431/4798] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:33:02 2022] DELETE /identity/v3/users/48e0dd424eea4656aad4992a7c3ee65b => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:33:02.938312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1abb4305-25c2-4441-a638-98b59d5e267c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217694b1ad134e87891fa7503720d90f', 'request_id': 'req-1abb4305-25c2-4441-a638-98b59d5e267c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:02.948195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1abb4305-25c2-4441-a638-98b59d5e267c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217694b1ad134e87891fa7503720d90f', 'request_id': 'req-1abb4305-25c2-4441-a638-98b59d5e267c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:02.975387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1abb4305-25c2-4441-a638-98b59d5e267c admin admin] The token cache is being invalidate because project 217694b1ad134e87891fa7503720d90f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:33:02.975851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1abb4305-25c2-4441-a638-98b59d5e267c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:02.978802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1abb4305-25c2-4441-a638-98b59d5e267c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:02.981676 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2368/4799] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:33:02 2022] DELETE /identity/v3/projects/217694b1ad134e87891fa7503720d90f => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:33:02.986604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c792ab2-97ac-4959-8bc3-79d9571af826 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:02.986981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c792ab2-97ac-4959-8bc3-79d9571af826 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:02.987475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c792ab2-97ac-4959-8bc3-79d9571af826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:03.043607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9c792ab2-97ac-4959-8bc3-79d9571af826 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:03.045128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9c792ab2-97ac-4959-8bc3-79d9571af826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:03.209805 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2432/4800] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:03.219464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec56629-59d1-4018-bdda-36fbdfb92421 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:03.220315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec56629-59d1-4018-bdda-36fbdfb92421 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:03.220700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec56629-59d1-4018-bdda-36fbdfb92421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:03.268893 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:03.272215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5ec56629-59d1-4018-bdda-36fbdfb92421 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:03.283386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5ec56629-59d1-4018-bdda-36fbdfb92421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:03.305649 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2369/4801] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:03.310943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c792ab2-97ac-4959-8bc3-79d9571af826 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:03.330152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c792ab2-97ac-4959-8bc3-79d9571af826 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:03.342896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a04a3c-cfbc-42dc-af26-fdddf6c2e62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:03.343648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a04a3c-cfbc-42dc-af26-fdddf6c2e62c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:03.343979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a04a3c-cfbc-42dc-af26-fdddf6c2e62c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:03.344313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a04a3c-cfbc-42dc-af26-fdddf6c2e62c admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:03.348549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a04a3c-cfbc-42dc-af26-fdddf6c2e62c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:33:03.349141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a04a3c-cfbc-42dc-af26-fdddf6c2e62c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:03.351648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a04a3c-cfbc-42dc-af26-fdddf6c2e62c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:03.376300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec56629-59d1-4018-bdda-36fbdfb92421 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:03.376300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5ec56629-59d1-4018-bdda-36fbdfb92421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:03.388808 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2433/4802] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:33:03.398887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec56629-59d1-4018-bdda-36fbdfb92421 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:03.404667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a04a3c-cfbc-42dc-af26-fdddf6c2e62c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:03.412990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c758805-78f3-40f4-9c43-74fa08f2fe4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:03.414431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c758805-78f3-40f4-9c43-74fa08f2fe4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:03.414960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c758805-78f3-40f4-9c43-74fa08f2fe4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:03.415620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c758805-78f3-40f4-9c43-74fa08f2fe4d admin admin] PATH_INFO: `/v3/projects/99ef7e23f70b4fdaaec62abd12c35fc6` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:03.417476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c758805-78f3-40f4-9c43-74fa08f2fe4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=99ef7e23f70b4fdaaec62abd12c35fc6)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:03.422758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c758805-78f3-40f4-9c43-74fa08f2fe4d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:03.454750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a04a3c-cfbc-42dc-af26-fdddf6c2e62c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:03.473196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccae19-a1ef-4c38-9272-a900661aa305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:03.474334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccae19-a1ef-4c38-9272-a900661aa305 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:03.476997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccae19-a1ef-4c38-9272-a900661aa305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:03.477530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ccae19-a1ef-4c38-9272-a900661aa305 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:03.478530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ccae19-a1ef-4c38-9272-a900661aa305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:03.482548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ccae19-a1ef-4c38-9272-a900661aa305 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:03.574947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5c758805-78f3-40f4-9c43-74fa08f2fe4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99ef7e23f70b4fdaaec62abd12c35fc6', 'request_id': 'req-5c758805-78f3-40f4-9c43-74fa08f2fe4d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:03.620843 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2434/4803] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:33:03 2022] POST /identity/v3/projects => generated 377 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:33:03.622254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccae19-a1ef-4c38-9272-a900661aa305 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:03.694362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ccae19-a1ef-4c38-9272-a900661aa305 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:03.700336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a52e5-d5f5-47c4-a69b-f7c67289e5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:03.701326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a52e5-d5f5-47c4-a69b-f7c67289e5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:03.701874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a52e5-d5f5-47c4-a69b-f7c67289e5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:03.702365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a52e5-d5f5-47c4-a69b-f7c67289e5b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:03.703390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a52e5-d5f5-47c4-a69b-f7c67289e5b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:03.705517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a52e5-d5f5-47c4-a69b-f7c67289e5b7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:03.709258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5c758805-78f3-40f4-9c43-74fa08f2fe4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99ef7e23f70b4fdaaec62abd12c35fc6', 'request_id': 'req-5c758805-78f3-40f4-9c43-74fa08f2fe4d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:03.726753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5c758805-78f3-40f4-9c43-74fa08f2fe4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99ef7e23f70b4fdaaec62abd12c35fc6', 'request_id': 'req-5c758805-78f3-40f4-9c43-74fa08f2fe4d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:03.758406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5c758805-78f3-40f4-9c43-74fa08f2fe4d admin admin] The token cache is being invalidate because project 99ef7e23f70b4fdaaec62abd12c35fc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:33:03.758947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5c758805-78f3-40f4-9c43-74fa08f2fe4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:03.762386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5c758805-78f3-40f4-9c43-74fa08f2fe4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:03.766814 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2370/4804] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:33:03 2022] DELETE /identity/v3/projects/99ef7e23f70b4fdaaec62abd12c35fc6 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:33:03.773176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c32ea1-9b98-4812-a20a-bb2e594b0f76 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:03.773600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c32ea1-9b98-4812-a20a-bb2e594b0f76 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:03.774117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c32ea1-9b98-4812-a20a-bb2e594b0f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:03.799159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-41c32ea1-9b98-4812-a20a-bb2e594b0f76 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:03.800806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-41c32ea1-9b98-4812-a20a-bb2e594b0f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:03.815193 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2371/4805] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:33:03.820927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149c4b1-eaa3-4c12-84d0-8d9ac79981c8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:03.821201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149c4b1-eaa3-4c12-84d0-8d9ac79981c8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:03.821560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7149c4b1-eaa3-4c12-84d0-8d9ac79981c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:03.835951 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2435/4806] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:33:03 2022] POST /identity/v3/users => generated 289 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:33:03.840355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a52e5-d5f5-47c4-a69b-f7c67289e5b7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:03.842366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fa4a52e5-d5f5-47c4-a69b-f7c67289e5b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:03.862728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7149c4b1-eaa3-4c12-84d0-8d9ac79981c8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:03.866433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7149c4b1-eaa3-4c12-84d0-8d9ac79981c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:03.869177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a52e5-d5f5-47c4-a69b-f7c67289e5b7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:03.881898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544235d-3def-443f-9417-30f552eb1349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:03.882814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544235d-3def-443f-9417-30f552eb1349 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:03.883225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544235d-3def-443f-9417-30f552eb1349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:03.883612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5544235d-3def-443f-9417-30f552eb1349 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:03.884473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544235d-3def-443f-9417-30f552eb1349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:03.886345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5544235d-3def-443f-9417-30f552eb1349 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:03.892207 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2372/4807] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:03.896204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149c4b1-eaa3-4c12-84d0-8d9ac79981c8 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:03.909425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7149c4b1-eaa3-4c12-84d0-8d9ac79981c8 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:03.916134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac4f42-eb76-4908-b0c1-ef9e4f53c46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:03.917252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac4f42-eb76-4908-b0c1-ef9e4f53c46d admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:03.917778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac4f42-eb76-4908-b0c1-ef9e4f53c46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:03.918318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac4f42-eb76-4908-b0c1-ef9e4f53c46d admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:03.919036 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2436/4808] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:33:03.919958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544235d-3def-443f-9417-30f552eb1349 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:03.920441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac4f42-eb76-4908-b0c1-ef9e4f53c46d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:33:03.921038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac4f42-eb76-4908-b0c1-ef9e4f53c46d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:03.923297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac4f42-eb76-4908-b0c1-ef9e4f53c46d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:03.939031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5544235d-3def-443f-9417-30f552eb1349 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:03.941682 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:03.946063 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2373/4809] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:33:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:33:03.950732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c979dbb-3494-4018-b601-5fc9ec32e64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:03.951564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c979dbb-3494-4018-b601-5fc9ec32e64e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:03.951922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c979dbb-3494-4018-b601-5fc9ec32e64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:03.952366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c979dbb-3494-4018-b601-5fc9ec32e64e admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:03.953177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c979dbb-3494-4018-b601-5fc9ec32e64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:03.955335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac4f42-eb76-4908-b0c1-ef9e4f53c46d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:03.958021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c979dbb-3494-4018-b601-5fc9ec32e64e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:03.982764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac4f42-eb76-4908-b0c1-ef9e4f53c46d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:03.992121 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2437/4810] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:33:03 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:33:03.996748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c979dbb-3494-4018-b601-5fc9ec32e64e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:03.997894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aac4a9-e3b3-468d-9d26-6e4007b2702e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:04.002335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aac4a9-e3b3-468d-9d26-6e4007b2702e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:04.002538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aac4a9-e3b3-468d-9d26-6e4007b2702e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:04.004626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aac4a9-e3b3-468d-9d26-6e4007b2702e admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:04.005917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aac4a9-e3b3-468d-9d26-6e4007b2702e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:04.012840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aac4a9-e3b3-468d-9d26-6e4007b2702e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:04.016310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c979dbb-3494-4018-b601-5fc9ec32e64e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:04.025295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44346ce9-83eb-495f-90d7-b92d7f95a27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:04.028255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44346ce9-83eb-495f-90d7-b92d7f95a27e admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:04.029540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44346ce9-83eb-495f-90d7-b92d7f95a27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:04.030056 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44346ce9-83eb-495f-90d7-b92d7f95a27e admin admin] PATH_INFO: `/v3/projects/60fe47076ab44bd89121dc47dd619f49/users/e64202aaad0642e9b9c8db84891bc074/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:04.052208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44346ce9-83eb-495f-90d7-b92d7f95a27e admin admin] RBAC: Authorizing `identity:create_grant(project_id=60fe47076ab44bd89121dc47dd619f49, user_id=e64202aaad0642e9b9c8db84891bc074, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:04.059290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44346ce9-83eb-495f-90d7-b92d7f95a27e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:04.162983 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2438/4811] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:33:03 2022] PUT /identity/v3/projects/60fe47076ab44bd89121dc47dd619f49/users/e64202aaad0642e9b9c8db84891bc074/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:33:04.171846 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2374/4812] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:33:03 2022] POST /identity/v3/projects => generated 375 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:33:04.173173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aac4a9-e3b3-468d-9d26-6e4007b2702e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:04.173667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8acb0-8ffc-4f93-8915-35f1aa6f3441 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:04.174244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8acb0-8ffc-4f93-8915-35f1aa6f3441 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:04.174531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8acb0-8ffc-4f93-8915-35f1aa6f3441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:04.237306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-54d8acb0-8ffc-4f93-8915-35f1aa6f3441 None None] MFA Rules not processed for user `e64202aaad0642e9b9c8db84891bc074`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:04.237306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-54d8acb0-8ffc-4f93-8915-35f1aa6f3441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:04.372008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aac4a9-e3b3-468d-9d26-6e4007b2702e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:04.378355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c6ccb-0ce7-41fe-84ce-57676ebc7d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:04.379444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c6ccb-0ce7-41fe-84ce-57676ebc7d4e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:04.380216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c6ccb-0ce7-41fe-84ce-57676ebc7d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:04.380570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c6ccb-0ce7-41fe-84ce-57676ebc7d4e admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:04.382923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c6ccb-0ce7-41fe-84ce-57676ebc7d4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:04.385797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c6ccb-0ce7-41fe-84ce-57676ebc7d4e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:04.395584 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2439/4813] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:33:04.400225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8acb0-8ffc-4f93-8915-35f1aa6f3441 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:04.414570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8acb0-8ffc-4f93-8915-35f1aa6f3441 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:04.421071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e4b05-bc86-4a49-8544-f7778e33ec48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:04.421890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e4b05-bc86-4a49-8544-f7778e33ec48 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:04.422257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e4b05-bc86-4a49-8544-f7778e33ec48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:04.422544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2e4b05-bc86-4a49-8544-f7778e33ec48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:04.423293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e4b05-bc86-4a49-8544-f7778e33ec48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:04.425493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2e4b05-bc86-4a49-8544-f7778e33ec48 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:04.512623 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2375/4814] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:33:04 2022] POST /identity/v3/users => generated 288 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:33:04.514594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c6ccb-0ce7-41fe-84ce-57676ebc7d4e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:04.525951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c6ccb-0ce7-41fe-84ce-57676ebc7d4e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:04.531891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4396196-e27b-4d09-b8a6-83b8068e5fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:04.532940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4396196-e27b-4d09-b8a6-83b8068e5fad admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:04.533468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4396196-e27b-4d09-b8a6-83b8068e5fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:04.533960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4396196-e27b-4d09-b8a6-83b8068e5fad admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:04.535010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4396196-e27b-4d09-b8a6-83b8068e5fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:04.537146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4396196-e27b-4d09-b8a6-83b8068e5fad admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:04.548401 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:04.563518 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2440/4815] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:33:04 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:33:04.566882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e4b05-bc86-4a49-8544-f7778e33ec48 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:04.593029 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2376/4816] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:33:04.596633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4396196-e27b-4d09-b8a6-83b8068e5fad admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:04.622465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4396196-e27b-4d09-b8a6-83b8068e5fad admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:04.747282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea45a08-5e51-4b5f-9254-6fd0e93028b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:04.748528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea45a08-5e51-4b5f-9254-6fd0e93028b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:04.749031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea45a08-5e51-4b5f-9254-6fd0e93028b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:04.749513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea45a08-5e51-4b5f-9254-6fd0e93028b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:04.750648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea45a08-5e51-4b5f-9254-6fd0e93028b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:04.752713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea45a08-5e51-4b5f-9254-6fd0e93028b3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:04.765464 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2377/4817] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:33:04.768149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2e4b05-bc86-4a49-8544-f7778e33ec48 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:04.770305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea45a08-5e51-4b5f-9254-6fd0e93028b3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:04.782721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59584730-cced-4bba-bebe-bf57d5637a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:04.784809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59584730-cced-4bba-bebe-bf57d5637a89 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:04.785655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59584730-cced-4bba-bebe-bf57d5637a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:04.786323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59584730-cced-4bba-bebe-bf57d5637a89 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:04.788707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59584730-cced-4bba-bebe-bf57d5637a89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:04.794112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea45a08-5e51-4b5f-9254-6fd0e93028b3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:04.794853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59584730-cced-4bba-bebe-bf57d5637a89 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:04.806843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6ba72c-20c4-4891-9448-8e6bd46b05e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:04.809202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ba72c-20c4-4891-9448-8e6bd46b05e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:04.810471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ba72c-20c4-4891-9448-8e6bd46b05e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:04.811916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6ba72c-20c4-4891-9448-8e6bd46b05e0 admin admin] PATH_INFO: `/v3/projects/10c09f0d060847f7b79e4e9c432d757a/users/4dd7c55c8952488685691a07de3207a8/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:04.844344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ba72c-20c4-4891-9448-8e6bd46b05e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10c09f0d060847f7b79e4e9c432d757a, user_id=4dd7c55c8952488685691a07de3207a8, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:04.847513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6ba72c-20c4-4891-9448-8e6bd46b05e0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:04.869207 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2441/4818] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:33:04 2022] POST /identity/v3/users => generated 294 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:33:04.871868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59584730-cced-4bba-bebe-bf57d5637a89 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:04.892829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59584730-cced-4bba-bebe-bf57d5637a89 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:04.895492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afa22a-d402-46e4-a653-29b77cabf7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:04.896387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afa22a-d402-46e4-a653-29b77cabf7ba admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:04.897669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afa22a-d402-46e4-a653-29b77cabf7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:04.897987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8afa22a-d402-46e4-a653-29b77cabf7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:04.898967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8afa22a-d402-46e4-a653-29b77cabf7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:04.901221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8afa22a-d402-46e4-a653-29b77cabf7ba admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:04.917430 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2442/4819] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:33:04.921826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afa22a-d402-46e4-a653-29b77cabf7ba admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:04.930690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8afa22a-d402-46e4-a653-29b77cabf7ba admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:04.936236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc2201-a9c0-40d9-a0e9-c4cbead32987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:04.937781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc2201-a9c0-40d9-a0e9-c4cbead32987 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:04.938190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc2201-a9c0-40d9-a0e9-c4cbead32987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:04.938437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffc2201-a9c0-40d9-a0e9-c4cbead32987 admin admin] PATH_INFO: `/v3/projects/78a4e065a8364f1e94c65fe150342694/users/2eaf5061c92a415e84cc641c01c0261f/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:04.950963 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2378/4820] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:33:04 2022] PUT /identity/v3/projects/10c09f0d060847f7b79e4e9c432d757a/users/4dd7c55c8952488685691a07de3207a8/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:33:04.952652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e412e4-2c48-46ab-9617-8b50b30cc4a6 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:04.952955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e412e4-2c48-46ab-9617-8b50b30cc4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:04.953238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e412e4-2c48-46ab-9617-8b50b30cc4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:04.968790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc2201-a9c0-40d9-a0e9-c4cbead32987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a4e065a8364f1e94c65fe150342694, user_id=2eaf5061c92a415e84cc641c01c0261f, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:04.972798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffc2201-a9c0-40d9-a0e9-c4cbead32987 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:04.976460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b5e412e4-2c48-46ab-9617-8b50b30cc4a6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:04.977689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b5e412e4-2c48-46ab-9617-8b50b30cc4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:05.010417 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:05.088709 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2443/4821] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:33:04 2022] PUT /identity/v3/projects/78a4e065a8364f1e94c65fe150342694/users/2eaf5061c92a415e84cc641c01c0261f/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:33:05.090170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc2201-a9c0-40d9-a0e9-c4cbead32987 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:05.092517 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2379/4822] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:05.103720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e412e4-2c48-46ab-9617-8b50b30cc4a6 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:05.105207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b5e412e4-2c48-46ab-9617-8b50b30cc4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:05.189687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffc2201-a9c0-40d9-a0e9-c4cbead32987 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:05.203524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e412e4-2c48-46ab-9617-8b50b30cc4a6 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:05.211186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee36ef4-653b-444b-9539-c028baf6b558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:05.212615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee36ef4-653b-444b-9539-c028baf6b558 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:05.212898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee36ef4-653b-444b-9539-c028baf6b558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:05.213304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee36ef4-653b-444b-9539-c028baf6b558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:05.214727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee36ef4-653b-444b-9539-c028baf6b558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:05.218218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee36ef4-653b-444b-9539-c028baf6b558 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:05.243288 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2444/4823] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:33:05.246944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee36ef4-653b-444b-9539-c028baf6b558 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:05.260164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee36ef4-653b-444b-9539-c028baf6b558 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:05.268848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073f706-1aa6-4c0d-a886-e242e92d1a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:05.270709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073f706-1aa6-4c0d-a886-e242e92d1a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:05.271353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073f706-1aa6-4c0d-a886-e242e92d1a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:05.272429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073f706-1aa6-4c0d-a886-e242e92d1a1c admin admin] PATH_INFO: `/v3/projects/78a4e065a8364f1e94c65fe150342694/users/2eaf5061c92a415e84cc641c01c0261f/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:05.276884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073f706-1aa6-4c0d-a886-e242e92d1a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a4e065a8364f1e94c65fe150342694, user_id=2eaf5061c92a415e84cc641c01c0261f, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:05.280039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073f706-1aa6-4c0d-a886-e242e92d1a1c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:05.283642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acb755-5de9-4d97-a326-ae78697b140e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:05.284308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acb755-5de9-4d97-a326-ae78697b140e service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:05.284594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acb755-5de9-4d97-a326-ae78697b140e service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:05.284874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25acb755-5de9-4d97-a326-ae78697b140e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:05.296504 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2445/4824] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:33:05 2022] PUT /identity/v3/projects/78a4e065a8364f1e94c65fe150342694/users/2eaf5061c92a415e84cc641c01c0261f/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:33:05.306500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acb755-5de9-4d97-a326-ae78697b140e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:05.307997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25acb755-5de9-4d97-a326-ae78697b140e service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:05.373009 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2380/4825] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:33:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:33:05.400740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be6a5a-b02a-4195-af71-30d85862ba17 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:05.401252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be6a5a-b02a-4195-af71-30d85862ba17 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:05.401252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be6a5a-b02a-4195-af71-30d85862ba17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:05.432574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e1be6a5a-b02a-4195-af71-30d85862ba17 None None] MFA Rules not processed for user `2eaf5061c92a415e84cc641c01c0261f`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:05.433792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e1be6a5a-b02a-4195-af71-30d85862ba17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:05.528027 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2446/4826] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:05.534847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acb755-5de9-4d97-a326-ae78697b140e service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:05.559393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25acb755-5de9-4d97-a326-ae78697b140e service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:05.653627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea59fd7-7ab5-4a63-b825-7d540871ec3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:05.654835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea59fd7-7ab5-4a63-b825-7d540871ec3f service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:05.655284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea59fd7-7ab5-4a63-b825-7d540871ec3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:05.655746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea59fd7-7ab5-4a63-b825-7d540871ec3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:05.672810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea59fd7-7ab5-4a63-b825-7d540871ec3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:05.675364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea59fd7-7ab5-4a63-b825-7d540871ec3f service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:05.689855 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2381/4827] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:33:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:33:05.800667 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:06.474045 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:15.851362 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:17.065112 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:18.080684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a18fa9-f09c-40b6-b262-e5c9b77f72ec None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:18.081270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a18fa9-f09c-40b6-b262-e5c9b77f72ec None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:18.081406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a18fa9-f09c-40b6-b262-e5c9b77f72ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:18.194378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d0a18fa9-f09c-40b6-b262-e5c9b77f72ec None None] MFA Rules not processed for user `4dd7c55c8952488685691a07de3207a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:18.197709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d0a18fa9-f09c-40b6-b262-e5c9b77f72ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:18.341879 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2447/4828] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:33:18.351510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea59fd7-7ab5-4a63-b825-7d540871ec3f service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:18.353591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3ea59fd7-7ab5-4a63-b825-7d540871ec3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:18.532625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea59fd7-7ab5-4a63-b825-7d540871ec3f service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:18.541892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea9ccd-6f0a-4b35-a6cd-cbf3781c5da4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:18.542605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea9ccd-6f0a-4b35-a6cd-cbf3781c5da4 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:18.542945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea9ccd-6f0a-4b35-a6cd-cbf3781c5da4 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:18.544113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aea9ccd-6f0a-4b35-a6cd-cbf3781c5da4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:18.562121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea9ccd-6f0a-4b35-a6cd-cbf3781c5da4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:18.565697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aea9ccd-6f0a-4b35-a6cd-cbf3781c5da4 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:18.582991 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2382/4829] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:33:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:33:20.815840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a18fa9-f09c-40b6-b262-e5c9b77f72ec None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:20.827983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a18fa9-f09c-40b6-b262-e5c9b77f72ec None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:20.834085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cefcf72-61fb-4601-a994-5d903c2df25a tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eaf5061c92a415e84cc641c01c0261f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78a4e065a8364f1e94c65fe150342694', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:20.835116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefcf72-61fb-4601-a994-5d903c2df25a tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:20.835637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefcf72-61fb-4601-a994-5d903c2df25a tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:20.836079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cefcf72-61fb-4601-a994-5d903c2df25a tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:20.837306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cefcf72-61fb-4601-a994-5d903c2df25a tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:33:20.837832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cefcf72-61fb-4601-a994-5d903c2df25a tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:20.840042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cefcf72-61fb-4601-a994-5d903c2df25a tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:20.857779 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2448/4830] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:33:20.859121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea9ccd-6f0a-4b35-a6cd-cbf3781c5da4 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:20.879539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aea9ccd-6f0a-4b35-a6cd-cbf3781c5da4 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:20.884933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78f5cc-a68a-49bd-8f29-e0346d887ca6 tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eaf5061c92a415e84cc641c01c0261f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78a4e065a8364f1e94c65fe150342694', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:20.886720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78f5cc-a68a-49bd-8f29-e0346d887ca6 tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:20.887175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78f5cc-a68a-49bd-8f29-e0346d887ca6 tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:20.887614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78f5cc-a68a-49bd-8f29-e0346d887ca6 tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:20.888560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78f5cc-a68a-49bd-8f29-e0346d887ca6 tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:20.890770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb78f5cc-a68a-49bd-8f29-e0346d887ca6 tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:21.002514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cefcf72-61fb-4601-a994-5d903c2df25a tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:21.012305 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2383/4831] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:33:20 2022] POST /identity/v3/projects => generated 348 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:33:21.016852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78f5cc-a68a-49bd-8f29-e0346d887ca6 tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:21.022263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cefcf72-61fb-4601-a994-5d903c2df25a tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:21.134867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1b580-08ac-4aa2-9735-a9f3e00b0d34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:21.135546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1b580-08ac-4aa2-9735-a9f3e00b0d34 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:21.135835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1b580-08ac-4aa2-9735-a9f3e00b0d34 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:21.136140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1b580-08ac-4aa2-9735-a9f3e00b0d34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:21.145931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-07f1b580-08ac-4aa2-9735-a9f3e00b0d34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:21.200962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78f5cc-a68a-49bd-8f29-e0346d887ca6 tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:21.223723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9effc03-1522-42d7-afcf-06cd1275b6bc tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eaf5061c92a415e84cc641c01c0261f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78a4e065a8364f1e94c65fe150342694', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:21.227668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9effc03-1522-42d7-afcf-06cd1275b6bc tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:21.228803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9effc03-1522-42d7-afcf-06cd1275b6bc tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:21.231039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9effc03-1522-42d7-afcf-06cd1275b6bc tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:21.235763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9effc03-1522-42d7-afcf-06cd1275b6bc tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:33:21.236655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9effc03-1522-42d7-afcf-06cd1275b6bc tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:21.254424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9effc03-1522-42d7-afcf-06cd1275b6bc tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:21.290634 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2384/4832] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:33:21.293693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1b580-08ac-4aa2-9735-a9f3e00b0d34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:21.295410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1b580-08ac-4aa2-9735-a9f3e00b0d34 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:21.326465 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2449/4833] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:33:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:33:21.462644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49ebb4-9b34-44d3-a7c8-269f0c0f74e9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:21.463256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49ebb4-9b34-44d3-a7c8-269f0c0f74e9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:21.463939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49ebb4-9b34-44d3-a7c8-269f0c0f74e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:21.524087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-aa49ebb4-9b34-44d3-a7c8-269f0c0f74e9 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:21.526443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aa49ebb4-9b34-44d3-a7c8-269f0c0f74e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:21.630181 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2385/4834] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:33:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:21.656243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1b580-08ac-4aa2-9735-a9f3e00b0d34 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:21.657920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-07f1b580-08ac-4aa2-9735-a9f3e00b0d34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:21.705220 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:21.832182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1b580-08ac-4aa2-9735-a9f3e00b0d34 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:21.848892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079a83f-6843-4934-ae77-ac3cece788c2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:21.850706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079a83f-6843-4934-ae77-ac3cece788c2 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:21.851321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079a83f-6843-4934-ae77-ac3cece788c2 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:21.851861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079a83f-6843-4934-ae77-ac3cece788c2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:21.863545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079a83f-6843-4934-ae77-ac3cece788c2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:21.866967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079a83f-6843-4934-ae77-ac3cece788c2 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:21.888966 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2450/4835] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:33:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:33:23.239831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49ebb4-9b34-44d3-a7c8-269f0c0f74e9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:23.251261 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:23.266681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49ebb4-9b34-44d3-a7c8-269f0c0f74e9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:23.277171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbbe67-51b1-4a21-96d6-c95a9ba069b1 tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2eaf5061c92a415e84cc641c01c0261f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '78a4e065a8364f1e94c65fe150342694', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:23.280670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbbe67-51b1-4a21-96d6-c95a9ba069b1 tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:23.281089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbbe67-51b1-4a21-96d6-c95a9ba069b1 tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:23.281618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbbe67-51b1-4a21-96d6-c95a9ba069b1 tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] PATH_INFO: `/v3/projects/fd4b9e6f11424a4bbf762a39528a3ce4` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:23.292035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbbe67-51b1-4a21-96d6-c95a9ba069b1 tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fd4b9e6f11424a4bbf762a39528a3ce4)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:23.294028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbbe67-51b1-4a21-96d6-c95a9ba069b1 tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:23.514951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6dfbbe67-51b1-4a21-96d6-c95a9ba069b1 tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd4b9e6f11424a4bbf762a39528a3ce4', 'request_id': 'req-6dfbbe67-51b1-4a21-96d6-c95a9ba069b1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:23.647209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6dfbbe67-51b1-4a21-96d6-c95a9ba069b1 tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd4b9e6f11424a4bbf762a39528a3ce4', 'request_id': 'req-6dfbbe67-51b1-4a21-96d6-c95a9ba069b1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:23.659857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6dfbbe67-51b1-4a21-96d6-c95a9ba069b1 tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd4b9e6f11424a4bbf762a39528a3ce4', 'request_id': 'req-6dfbbe67-51b1-4a21-96d6-c95a9ba069b1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:23.691780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6dfbbe67-51b1-4a21-96d6-c95a9ba069b1 tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] The token cache is being invalidate because project fd4b9e6f11424a4bbf762a39528a3ce4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:33:23.692535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6dfbbe67-51b1-4a21-96d6-c95a9ba069b1 tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:23.694077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6dfbbe67-51b1-4a21-96d6-c95a9ba069b1 tempest-RoutersIpV6AdminTest-699246093 tempest-RoutersIpV6AdminTest-699246093-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:23.697438 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2386/4836] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:33:23 2022] DELETE /identity/v3/projects/fd4b9e6f11424a4bbf762a39528a3ce4 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:33:23.711518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079a83f-6843-4934-ae77-ac3cece788c2 service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:23.713540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4079a83f-6843-4934-ae77-ac3cece788c2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:23.811267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079a83f-6843-4934-ae77-ac3cece788c2 service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:23.893005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566646a-c030-409f-b3ca-15d2acbc1253 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:23.895108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566646a-c030-409f-b3ca-15d2acbc1253 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:23.895748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566646a-c030-409f-b3ca-15d2acbc1253 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:23.898276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566646a-c030-409f-b3ca-15d2acbc1253 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:23.898608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b566646a-c030-409f-b3ca-15d2acbc1253 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:24.051120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566646a-c030-409f-b3ca-15d2acbc1253 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:24.053553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b566646a-c030-409f-b3ca-15d2acbc1253 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:24.069219 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2451/4837] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:33:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:33:24.549691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777b792-7eb3-4fbe-944b-56c08bf70093 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:24.553510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777b792-7eb3-4fbe-944b-56c08bf70093 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:24.553510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d777b792-7eb3-4fbe-944b-56c08bf70093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:24.598550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d777b792-7eb3-4fbe-944b-56c08bf70093 None None] MFA Rules not processed for user `4dd7c55c8952488685691a07de3207a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:24.605279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d777b792-7eb3-4fbe-944b-56c08bf70093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:24.712400 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2387/4838] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:25.210167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d19bb-4c59-4586-a0a8-05d2b8ba746b None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:25.211256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d19bb-4c59-4586-a0a8-05d2b8ba746b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:25.211697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d19bb-4c59-4586-a0a8-05d2b8ba746b None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:25.213643 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2452/4839] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:33:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:33:25.227916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dec92-3d11-4039-9f13-f4d387231431 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:25.228211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dec92-3d11-4039-9f13-f4d387231431 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:25.229020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5dec92-3d11-4039-9f13-f4d387231431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:25.319449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-bf5dec92-3d11-4039-9f13-f4d387231431 None None] MFA Rules not processed for user `e997b70d7158446daa1dfa225eb7afca`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:25.320754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bf5dec92-3d11-4039-9f13-f4d387231431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:25.348034 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2388/4840] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:33:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:25.404553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d19bb-4c59-4586-a0a8-05d2b8ba746b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:25.406905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-797d19bb-4c59-4586-a0a8-05d2b8ba746b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:25.431616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d19bb-4c59-4586-a0a8-05d2b8ba746b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:25.438276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313168f-e1a8-4fda-b255-d983e9d0e58c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:25.443634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313168f-e1a8-4fda-b255-d983e9d0e58c service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:25.443634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313168f-e1a8-4fda-b255-d983e9d0e58c service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:25.443634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313168f-e1a8-4fda-b255-d983e9d0e58c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:25.451045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313168f-e1a8-4fda-b255-d983e9d0e58c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:25.452687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3313168f-e1a8-4fda-b255-d983e9d0e58c service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:25.458227 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:25.464828 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2453/4841] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:33:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:33:27.184872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5dec92-3d11-4039-9f13-f4d387231431 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:27.186328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bf5dec92-3d11-4039-9f13-f4d387231431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:27.274924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5dec92-3d11-4039-9f13-f4d387231431 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:27.284017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6eebf-6b88-4a3e-b53a-d2f448ff9a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:27.284923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6eebf-6b88-4a3e-b53a-d2f448ff9a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:27.285444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6eebf-6b88-4a3e-b53a-d2f448ff9a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:27.285887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6eebf-6b88-4a3e-b53a-d2f448ff9a4e admin admin] PATH_INFO: `/v3/users/37622a8ba0dd4cc2b1e19a319d61ad95` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:27.288447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6eebf-6b88-4a3e-b53a-d2f448ff9a4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=37622a8ba0dd4cc2b1e19a319d61ad95)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:27.290637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6eebf-6b88-4a3e-b53a-d2f448ff9a4e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:27.312415 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:27.528333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ee6eebf-6b88-4a3e-b53a-d2f448ff9a4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37622a8ba0dd4cc2b1e19a319d61ad95'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:27.545064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ee6eebf-6b88-4a3e-b53a-d2f448ff9a4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37622a8ba0dd4cc2b1e19a319d61ad95'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:27.545913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ee6eebf-6b88-4a3e-b53a-d2f448ff9a4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37622a8ba0dd4cc2b1e19a319d61ad95'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:27.546612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ee6eebf-6b88-4a3e-b53a-d2f448ff9a4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37622a8ba0dd4cc2b1e19a319d61ad95'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:27.555201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ee6eebf-6b88-4a3e-b53a-d2f448ff9a4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37622a8ba0dd4cc2b1e19a319d61ad95'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:27.692695 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2389/4842] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:33:27 2022] DELETE /identity/v3/users/37622a8ba0dd4cc2b1e19a319d61ad95 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:33:27.697689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316c433-8993-4eab-b397-e08025e8d710 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:27.698286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316c433-8993-4eab-b397-e08025e8d710 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:27.698286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316c433-8993-4eab-b397-e08025e8d710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:27.719767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a316c433-8993-4eab-b397-e08025e8d710 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:27.722657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a316c433-8993-4eab-b397-e08025e8d710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:27.803711 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2454/4843] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:27.821808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6eebf-6b88-4a3e-b53a-d2f448ff9a4e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:27.824460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7ee6eebf-6b88-4a3e-b53a-d2f448ff9a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:27.929873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6eebf-6b88-4a3e-b53a-d2f448ff9a4e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:27.934170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be86b65-fd09-4d83-b723-514afaebf022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:27.935855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be86b65-fd09-4d83-b723-514afaebf022 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:27.936233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be86b65-fd09-4d83-b723-514afaebf022 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:27.936524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be86b65-fd09-4d83-b723-514afaebf022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:27.951339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be86b65-fd09-4d83-b723-514afaebf022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:27.952955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be86b65-fd09-4d83-b723-514afaebf022 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:27.974689 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2390/4844] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:33:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:33:29.679318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316c433-8993-4eab-b397-e08025e8d710 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:29.681179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a316c433-8993-4eab-b397-e08025e8d710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:29.694296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316c433-8993-4eab-b397-e08025e8d710 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:29.700064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675b81a-12c0-4a1b-b7d7-238f25137a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:29.701107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675b81a-12c0-4a1b-b7d7-238f25137a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:29.701570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675b81a-12c0-4a1b-b7d7-238f25137a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:29.702002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675b81a-12c0-4a1b-b7d7-238f25137a44 admin admin] PATH_INFO: `/v3/projects/818a39ea1dcc459c897afce58c902df2` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:29.703510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675b81a-12c0-4a1b-b7d7-238f25137a44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=818a39ea1dcc459c897afce58c902df2)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:29.706047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675b81a-12c0-4a1b-b7d7-238f25137a44 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:29.818064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e675b81a-12c0-4a1b-b7d7-238f25137a44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818a39ea1dcc459c897afce58c902df2', 'request_id': 'req-e675b81a-12c0-4a1b-b7d7-238f25137a44'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:29.827965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e675b81a-12c0-4a1b-b7d7-238f25137a44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818a39ea1dcc459c897afce58c902df2', 'request_id': 'req-e675b81a-12c0-4a1b-b7d7-238f25137a44'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:29.836455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e675b81a-12c0-4a1b-b7d7-238f25137a44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818a39ea1dcc459c897afce58c902df2', 'request_id': 'req-e675b81a-12c0-4a1b-b7d7-238f25137a44'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:29.903372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e675b81a-12c0-4a1b-b7d7-238f25137a44 admin admin] The token cache is being invalidate because project 818a39ea1dcc459c897afce58c902df2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:33:29.903659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e675b81a-12c0-4a1b-b7d7-238f25137a44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:29.905779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e675b81a-12c0-4a1b-b7d7-238f25137a44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:29.908794 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2455/4845] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:33:29 2022] DELETE /identity/v3/projects/818a39ea1dcc459c897afce58c902df2 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:33:29.917020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077eab8-febb-410f-b612-0d258a6113a8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:29.917646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077eab8-febb-410f-b612-0d258a6113a8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:29.920168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077eab8-febb-410f-b612-0d258a6113a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:29.968794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2077eab8-febb-410f-b612-0d258a6113a8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:29.971375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2077eab8-febb-410f-b612-0d258a6113a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:30.095270 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2391/4846] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:30.102879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d5b34-f98e-4091-97c5-e74507c3801d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:30.103169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d5b34-f98e-4091-97c5-e74507c3801d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:30.103914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d5b34-f98e-4091-97c5-e74507c3801d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:30.134131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-684d5b34-f98e-4091-97c5-e74507c3801d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:30.135405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-684d5b34-f98e-4091-97c5-e74507c3801d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:30.147390 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2456/4847] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:30.152696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077eab8-febb-410f-b612-0d258a6113a8 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:30.164045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077eab8-febb-410f-b612-0d258a6113a8 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:30.169302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae42fe0-d9e8-473d-9769-b0f19a971d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:30.170142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae42fe0-d9e8-473d-9769-b0f19a971d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:30.170527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae42fe0-d9e8-473d-9769-b0f19a971d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:30.170880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae42fe0-d9e8-473d-9769-b0f19a971d07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:30.171967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae42fe0-d9e8-473d-9769-b0f19a971d07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:33:30.172425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae42fe0-d9e8-473d-9769-b0f19a971d07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:30.174529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae42fe0-d9e8-473d-9769-b0f19a971d07 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:30.190174 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2392/4848] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:33:30.194814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d5b34-f98e-4091-97c5-e74507c3801d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:30.208843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d5b34-f98e-4091-97c5-e74507c3801d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:30.231019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4de342-12e0-48a0-bba4-354c9efea17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:30.231845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4de342-12e0-48a0-bba4-354c9efea17b admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:30.232240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4de342-12e0-48a0-bba4-354c9efea17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:30.232620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4de342-12e0-48a0-bba4-354c9efea17b admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:30.233567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4de342-12e0-48a0-bba4-354c9efea17b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:30.235849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4de342-12e0-48a0-bba4-354c9efea17b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:30.312445 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2457/4849] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:33:30 2022] POST /identity/v3/projects => generated 401 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:33:30.313690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae42fe0-d9e8-473d-9769-b0f19a971d07 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:30.329343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae42fe0-d9e8-473d-9769-b0f19a971d07 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:30.352874 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:30.411559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658dda5a-aae6-4a76-a83a-519ac3c014a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:30.412802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658dda5a-aae6-4a76-a83a-519ac3c014a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:30.413261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658dda5a-aae6-4a76-a83a-519ac3c014a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:30.413710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658dda5a-aae6-4a76-a83a-519ac3c014a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:30.414788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658dda5a-aae6-4a76-a83a-519ac3c014a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:30.424132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658dda5a-aae6-4a76-a83a-519ac3c014a5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:30.495417 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2393/4850] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:33:30 2022] POST /identity/v3/users => generated 301 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:33:30.498701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4de342-12e0-48a0-bba4-354c9efea17b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:30.513608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4de342-12e0-48a0-bba4-354c9efea17b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:30.519197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345b3a6-ab40-4743-9a24-f1517ceeb281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:30.519882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345b3a6-ab40-4743-9a24-f1517ceeb281 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:30.520200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345b3a6-ab40-4743-9a24-f1517ceeb281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:30.520479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345b3a6-ab40-4743-9a24-f1517ceeb281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:30.521246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345b3a6-ab40-4743-9a24-f1517ceeb281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:30.523577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345b3a6-ab40-4743-9a24-f1517ceeb281 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:30.536783 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2458/4851] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:33:30.541845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658dda5a-aae6-4a76-a83a-519ac3c014a5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:30.554653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658dda5a-aae6-4a76-a83a-519ac3c014a5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:30.561502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04562be-211a-4b59-b9da-7bca2da7ceba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:30.562294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04562be-211a-4b59-b9da-7bca2da7ceba admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:30.562638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04562be-211a-4b59-b9da-7bca2da7ceba admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:30.562864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04562be-211a-4b59-b9da-7bca2da7ceba admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:30.563856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04562be-211a-4b59-b9da-7bca2da7ceba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:30.565549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04562be-211a-4b59-b9da-7bca2da7ceba admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:30.580682 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2394/4852] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:33:30.585662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345b3a6-ab40-4743-9a24-f1517ceeb281 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:30.597176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345b3a6-ab40-4743-9a24-f1517ceeb281 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:30.603223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3b4b3-eb5a-4e18-bfa6-04a7836a744f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:30.604138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3b4b3-eb5a-4e18-bfa6-04a7836a744f admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:30.604419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3b4b3-eb5a-4e18-bfa6-04a7836a744f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:30.604773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3b4b3-eb5a-4e18-bfa6-04a7836a744f admin admin] PATH_INFO: `/v3/projects/7aec2e81d2f441b1b0700c44308c411b/users/2a596fc12842405cbf14c2162317263e/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:30.624925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3b4b3-eb5a-4e18-bfa6-04a7836a744f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aec2e81d2f441b1b0700c44308c411b, user_id=2a596fc12842405cbf14c2162317263e, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:30.628367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3b4b3-eb5a-4e18-bfa6-04a7836a744f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:30.707560 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2459/4853] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:33:30 2022] PUT /identity/v3/projects/7aec2e81d2f441b1b0700c44308c411b/users/2a596fc12842405cbf14c2162317263e/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:33:30.719330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983e2fa-8eb3-4fd7-99df-1ea6acec8a83 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:30.720041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983e2fa-8eb3-4fd7-99df-1ea6acec8a83 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:30.720471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a983e2fa-8eb3-4fd7-99df-1ea6acec8a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:30.763226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a983e2fa-8eb3-4fd7-99df-1ea6acec8a83 None None] MFA Rules not processed for user `2a596fc12842405cbf14c2162317263e`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:30.766756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a983e2fa-8eb3-4fd7-99df-1ea6acec8a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:30.872866 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2395/4854] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:30.877983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3b4b3-eb5a-4e18-bfa6-04a7836a744f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:30.903470 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:30.960638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3b4b3-eb5a-4e18-bfa6-04a7836a744f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:30.965886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e92cb-8512-4b58-b7e1-a1fdfcfa577e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:30.967376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e92cb-8512-4b58-b7e1-a1fdfcfa577e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:30.967503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e92cb-8512-4b58-b7e1-a1fdfcfa577e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:30.967957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e92cb-8512-4b58-b7e1-a1fdfcfa577e admin admin] PATH_INFO: `/v3/users/2a596fc12842405cbf14c2162317263e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:30.969557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e92cb-8512-4b58-b7e1-a1fdfcfa577e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a596fc12842405cbf14c2162317263e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:30.971911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e92cb-8512-4b58-b7e1-a1fdfcfa577e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:31.181421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7a2e92cb-8512-4b58-b7e1-a1fdfcfa577e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a596fc12842405cbf14c2162317263e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:31.197478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7a2e92cb-8512-4b58-b7e1-a1fdfcfa577e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a596fc12842405cbf14c2162317263e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:31.206123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7a2e92cb-8512-4b58-b7e1-a1fdfcfa577e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a596fc12842405cbf14c2162317263e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:31.207029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7a2e92cb-8512-4b58-b7e1-a1fdfcfa577e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a596fc12842405cbf14c2162317263e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:31.326453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7a2e92cb-8512-4b58-b7e1-a1fdfcfa577e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a596fc12842405cbf14c2162317263e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:31.333670 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2460/4855] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:33:30 2022] DELETE /identity/v3/users/2a596fc12842405cbf14c2162317263e => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:33:31.338601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863df46-bbc1-4682-ac01-776a352a343c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:31.339079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863df46-bbc1-4682-ac01-776a352a343c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:31.339161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5863df46-bbc1-4682-ac01-776a352a343c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:31.365291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5863df46-bbc1-4682-ac01-776a352a343c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:31.368192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5863df46-bbc1-4682-ac01-776a352a343c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:31.437976 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2396/4856] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:31.451950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e92cb-8512-4b58-b7e1-a1fdfcfa577e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:31.454590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7a2e92cb-8512-4b58-b7e1-a1fdfcfa577e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:31.550286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e92cb-8512-4b58-b7e1-a1fdfcfa577e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:31.554625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddab770-2638-4a0c-b9a5-90acff43198c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:31.555432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddab770-2638-4a0c-b9a5-90acff43198c service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:31.555694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddab770-2638-4a0c-b9a5-90acff43198c service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:31.555978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddab770-2638-4a0c-b9a5-90acff43198c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:31.567731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddab770-2638-4a0c-b9a5-90acff43198c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:31.569310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddab770-2638-4a0c-b9a5-90acff43198c service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:31.580913 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2461/4857] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:33:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:33:32.532713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863df46-bbc1-4682-ac01-776a352a343c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:32.535107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5863df46-bbc1-4682-ac01-776a352a343c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:32.552215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5863df46-bbc1-4682-ac01-776a352a343c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:32.558550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee53b3-c0cd-43d8-be99-23e1e68fdef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:32.559565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee53b3-c0cd-43d8-be99-23e1e68fdef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:32.563798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee53b3-c0cd-43d8-be99-23e1e68fdef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:32.563798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee53b3-c0cd-43d8-be99-23e1e68fdef0 admin admin] PATH_INFO: `/v3/projects/7aec2e81d2f441b1b0700c44308c411b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:32.563798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee53b3-c0cd-43d8-be99-23e1e68fdef0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aec2e81d2f441b1b0700c44308c411b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:32.563798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee53b3-c0cd-43d8-be99-23e1e68fdef0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:32.605218 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:32.751319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4dee53b3-c0cd-43d8-be99-23e1e68fdef0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aec2e81d2f441b1b0700c44308c411b', 'request_id': 'req-4dee53b3-c0cd-43d8-be99-23e1e68fdef0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:32.822972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4dee53b3-c0cd-43d8-be99-23e1e68fdef0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aec2e81d2f441b1b0700c44308c411b', 'request_id': 'req-4dee53b3-c0cd-43d8-be99-23e1e68fdef0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:32.834711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4dee53b3-c0cd-43d8-be99-23e1e68fdef0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aec2e81d2f441b1b0700c44308c411b', 'request_id': 'req-4dee53b3-c0cd-43d8-be99-23e1e68fdef0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:32.849155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4dee53b3-c0cd-43d8-be99-23e1e68fdef0 admin admin] The token cache is being invalidate because project 7aec2e81d2f441b1b0700c44308c411b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:33:32.850299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4dee53b3-c0cd-43d8-be99-23e1e68fdef0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:32.852004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4dee53b3-c0cd-43d8-be99-23e1e68fdef0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:32.853839 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2397/4858] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:33:32 2022] DELETE /identity/v3/projects/7aec2e81d2f441b1b0700c44308c411b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:33:32.860170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdb6b9-d1c9-4dd9-84fd-1b276268d6f7 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:32.860678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdb6b9-d1c9-4dd9-84fd-1b276268d6f7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:32.860760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfdb6b9-d1c9-4dd9-84fd-1b276268d6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:32.884067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-bcfdb6b9-d1c9-4dd9-84fd-1b276268d6f7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:32.885814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bcfdb6b9-d1c9-4dd9-84fd-1b276268d6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:32.933473 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:32.958231 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2462/4859] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:33:32.966302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9eccf9-18d9-41d5-bfa4-88e57584668c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:32.966610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9eccf9-18d9-41d5-bfa4-88e57584668c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:32.970642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9eccf9-18d9-41d5-bfa4-88e57584668c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:32.995016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-db9eccf9-18d9-41d5-bfa4-88e57584668c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:32.999298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-db9eccf9-18d9-41d5-bfa4-88e57584668c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:33.007747 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2398/4860] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:33.011075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdb6b9-d1c9-4dd9-84fd-1b276268d6f7 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:33.021067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfdb6b9-d1c9-4dd9-84fd-1b276268d6f7 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:33.026447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39faeaec-68a7-4e59-be56-0db4ae4d3847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:33.027130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39faeaec-68a7-4e59-be56-0db4ae4d3847 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:33.027410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39faeaec-68a7-4e59-be56-0db4ae4d3847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:33.027998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39faeaec-68a7-4e59-be56-0db4ae4d3847 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:33.028987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39faeaec-68a7-4e59-be56-0db4ae4d3847 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:33:33.029765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39faeaec-68a7-4e59-be56-0db4ae4d3847 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:33.031406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39faeaec-68a7-4e59-be56-0db4ae4d3847 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:33.044905 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2463/4861] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:33:33.049366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9eccf9-18d9-41d5-bfa4-88e57584668c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:33.059772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9eccf9-18d9-41d5-bfa4-88e57584668c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:33.065945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c105e8e-fac4-4f84-a1a7-fd181542d372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:33.066725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c105e8e-fac4-4f84-a1a7-fd181542d372 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:33.067211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c105e8e-fac4-4f84-a1a7-fd181542d372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:33.067557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c105e8e-fac4-4f84-a1a7-fd181542d372 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:33.068995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c105e8e-fac4-4f84-a1a7-fd181542d372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:33.071046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c105e8e-fac4-4f84-a1a7-fd181542d372 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:33.177537 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2399/4862] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:33:33 2022] POST /identity/v3/projects => generated 359 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:33:33.177687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39faeaec-68a7-4e59-be56-0db4ae4d3847 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:33.187544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39faeaec-68a7-4e59-be56-0db4ae4d3847 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:33.260942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa40d3-8e18-4af8-8742-8f0ccc3675fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:33.262577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa40d3-8e18-4af8-8742-8f0ccc3675fe admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:33.262577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa40d3-8e18-4af8-8742-8f0ccc3675fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:33.262577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa40d3-8e18-4af8-8742-8f0ccc3675fe admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:33.263536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa40d3-8e18-4af8-8742-8f0ccc3675fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:33.265615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa40d3-8e18-4af8-8742-8f0ccc3675fe admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:33.371775 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2464/4863] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:33:33 2022] POST /identity/v3/users => generated 280 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:33:33.374137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c105e8e-fac4-4f84-a1a7-fd181542d372 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:33.386272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c105e8e-fac4-4f84-a1a7-fd181542d372 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:33.393117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62b119-3c2c-4b01-b200-0a9591a20189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:33.394169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62b119-3c2c-4b01-b200-0a9591a20189 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:33.394483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62b119-3c2c-4b01-b200-0a9591a20189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:33.394761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62b119-3c2c-4b01-b200-0a9591a20189 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:33.396040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62b119-3c2c-4b01-b200-0a9591a20189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:33.398265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62b119-3c2c-4b01-b200-0a9591a20189 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:33.410143 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2400/4864] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:33:33.417287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa40d3-8e18-4af8-8742-8f0ccc3675fe admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:33.429652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa40d3-8e18-4af8-8742-8f0ccc3675fe admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:33.436074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d62559b-346e-4bc0-b6ab-7da676dc72a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:33.437143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62559b-346e-4bc0-b6ab-7da676dc72a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:33.437270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62559b-346e-4bc0-b6ab-7da676dc72a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:33.437919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d62559b-346e-4bc0-b6ab-7da676dc72a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:33.438541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62559b-346e-4bc0-b6ab-7da676dc72a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:33.440378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d62559b-346e-4bc0-b6ab-7da676dc72a3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:33.456969 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2465/4865] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:33:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:33:33.463888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62b119-3c2c-4b01-b200-0a9591a20189 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:33.486530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62b119-3c2c-4b01-b200-0a9591a20189 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:33.494016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f2bf7-cfff-48e7-9815-5ceef3622c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:33.495355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f2bf7-cfff-48e7-9815-5ceef3622c6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:33.495869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f2bf7-cfff-48e7-9815-5ceef3622c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:33.496316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451f2bf7-cfff-48e7-9815-5ceef3622c6e admin admin] PATH_INFO: `/v3/projects/fc4373aa0fd04ad1a8799f9b3e911df7/users/1a2e1fe38d334cc8ac9f52793d3a2d2f/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:33.515324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f2bf7-cfff-48e7-9815-5ceef3622c6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc4373aa0fd04ad1a8799f9b3e911df7, user_id=1a2e1fe38d334cc8ac9f52793d3a2d2f, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:33.518464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451f2bf7-cfff-48e7-9815-5ceef3622c6e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:33.643346 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2401/4866] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:33:33 2022] PUT /identity/v3/projects/fc4373aa0fd04ad1a8799f9b3e911df7/users/1a2e1fe38d334cc8ac9f52793d3a2d2f/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:33:33.655499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30906402-126b-4070-becd-12db73aa188b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:33.667327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30906402-126b-4070-becd-12db73aa188b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:33.667327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30906402-126b-4070-becd-12db73aa188b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:33.702779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-30906402-126b-4070-becd-12db73aa188b None None] MFA Rules not processed for user `1a2e1fe38d334cc8ac9f52793d3a2d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:33.704200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-30906402-126b-4070-becd-12db73aa188b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:33.786459 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2466/4867] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:33 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:33.838946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f2bf7-cfff-48e7-9815-5ceef3622c6e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:33.947228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451f2bf7-cfff-48e7-9815-5ceef3622c6e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:33.954249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6536b35-a642-48a5-89a6-76ddc2dacaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:33.955410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6536b35-a642-48a5-89a6-76ddc2dacaca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:33.955696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6536b35-a642-48a5-89a6-76ddc2dacaca admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:33.956147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6536b35-a642-48a5-89a6-76ddc2dacaca admin admin] PATH_INFO: `/v3/users/1a2e1fe38d334cc8ac9f52793d3a2d2f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:33.957874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6536b35-a642-48a5-89a6-76ddc2dacaca admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a2e1fe38d334cc8ac9f52793d3a2d2f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:33.960591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6536b35-a642-48a5-89a6-76ddc2dacaca admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:34.152321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e6536b35-a642-48a5-89a6-76ddc2dacaca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a2e1fe38d334cc8ac9f52793d3a2d2f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:34.154265 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:34.165588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e6536b35-a642-48a5-89a6-76ddc2dacaca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a2e1fe38d334cc8ac9f52793d3a2d2f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:34.167919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e6536b35-a642-48a5-89a6-76ddc2dacaca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a2e1fe38d334cc8ac9f52793d3a2d2f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:34.167919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e6536b35-a642-48a5-89a6-76ddc2dacaca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a2e1fe38d334cc8ac9f52793d3a2d2f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:34.173987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e6536b35-a642-48a5-89a6-76ddc2dacaca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a2e1fe38d334cc8ac9f52793d3a2d2f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:34.250884 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2402/4868] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:33:33 2022] DELETE /identity/v3/users/1a2e1fe38d334cc8ac9f52793d3a2d2f => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:33:34.255786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9198b-d189-4c10-a582-3c09fa8e7a06 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:34.256503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9198b-d189-4c10-a582-3c09fa8e7a06 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:34.256503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b9198b-d189-4c10-a582-3c09fa8e7a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:34.277501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b4b9198b-d189-4c10-a582-3c09fa8e7a06 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:34.278813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b4b9198b-d189-4c10-a582-3c09fa8e7a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:34.315630 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:34.344269 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2467/4869] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:33:34.354931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6536b35-a642-48a5-89a6-76ddc2dacaca admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:34.356451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e6536b35-a642-48a5-89a6-76ddc2dacaca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:34.418898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6536b35-a642-48a5-89a6-76ddc2dacaca admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:34.422794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc90053-35b1-41a3-8903-1154e40e486f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:34.423468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc90053-35b1-41a3-8903-1154e40e486f service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:34.423752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc90053-35b1-41a3-8903-1154e40e486f service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:34.424030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc90053-35b1-41a3-8903-1154e40e486f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:34.435234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc90053-35b1-41a3-8903-1154e40e486f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:34.436715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc90053-35b1-41a3-8903-1154e40e486f service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:34.447465 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2403/4870] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:33:34.911700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9198b-d189-4c10-a582-3c09fa8e7a06 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:34.917425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b4b9198b-d189-4c10-a582-3c09fa8e7a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:34.929749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b9198b-d189-4c10-a582-3c09fa8e7a06 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:34.937494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bf9ae-109b-4394-893e-0bb4ce9f6b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:34.939478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bf9ae-109b-4394-893e-0bb4ce9f6b33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:34.939909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bf9ae-109b-4394-893e-0bb4ce9f6b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:34.940355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bf9ae-109b-4394-893e-0bb4ce9f6b33 admin admin] PATH_INFO: `/v3/projects/fc4373aa0fd04ad1a8799f9b3e911df7` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:34.941954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994bf9ae-109b-4394-893e-0bb4ce9f6b33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc4373aa0fd04ad1a8799f9b3e911df7)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:34.944961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994bf9ae-109b-4394-893e-0bb4ce9f6b33 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:35.065226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-994bf9ae-109b-4394-893e-0bb4ce9f6b33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc4373aa0fd04ad1a8799f9b3e911df7', 'request_id': 'req-994bf9ae-109b-4394-893e-0bb4ce9f6b33'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:35.075483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-994bf9ae-109b-4394-893e-0bb4ce9f6b33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc4373aa0fd04ad1a8799f9b3e911df7', 'request_id': 'req-994bf9ae-109b-4394-893e-0bb4ce9f6b33'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:35.089890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-994bf9ae-109b-4394-893e-0bb4ce9f6b33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc4373aa0fd04ad1a8799f9b3e911df7', 'request_id': 'req-994bf9ae-109b-4394-893e-0bb4ce9f6b33'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:35.216321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-994bf9ae-109b-4394-893e-0bb4ce9f6b33 admin admin] The token cache is being invalidate because project fc4373aa0fd04ad1a8799f9b3e911df7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:33:35.216624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-994bf9ae-109b-4394-893e-0bb4ce9f6b33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:35.217292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-994bf9ae-109b-4394-893e-0bb4ce9f6b33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:33:35.222156 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2468/4871] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:33:34 2022] DELETE /identity/v3/projects/fc4373aa0fd04ad1a8799f9b3e911df7 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:33:35.224758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4311c4-230f-492b-88ba-ef9b636050d4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:35.225357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4311c4-230f-492b-88ba-ef9b636050d4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:35.225720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4311c4-230f-492b-88ba-ef9b636050d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:35.245475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1b4311c4-230f-492b-88ba-ef9b636050d4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:35.254786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1b4311c4-230f-492b-88ba-ef9b636050d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:35.320772 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2404/4872] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:35.399800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c500e-63e1-47bf-ba50-ab4f2f1dade8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:35.400350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c500e-63e1-47bf-ba50-ab4f2f1dade8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:35.400350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c500e-63e1-47bf-ba50-ab4f2f1dade8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:35.419688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-758c500e-63e1-47bf-ba50-ab4f2f1dade8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:35.420923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-758c500e-63e1-47bf-ba50-ab4f2f1dade8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:35.429410 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2469/4873] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:35.434012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4311c4-230f-492b-88ba-ef9b636050d4 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:35.444404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4311c4-230f-492b-88ba-ef9b636050d4 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:35.449651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57b796-0e8e-4806-b4ee-68d450a221ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:35.450376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57b796-0e8e-4806-b4ee-68d450a221ea admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:35.450776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57b796-0e8e-4806-b4ee-68d450a221ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:35.451061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f57b796-0e8e-4806-b4ee-68d450a221ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:35.451807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57b796-0e8e-4806-b4ee-68d450a221ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:33:35.452119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57b796-0e8e-4806-b4ee-68d450a221ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:35.453719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f57b796-0e8e-4806-b4ee-68d450a221ea admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:35.467205 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2405/4874] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:33:35.471363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c500e-63e1-47bf-ba50-ab4f2f1dade8 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:35.481324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c500e-63e1-47bf-ba50-ab4f2f1dade8 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:35.487883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda977e7-6596-4d5c-a445-45ec5370092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:35.487883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda977e7-6596-4d5c-a445-45ec5370092a admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:35.487883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda977e7-6596-4d5c-a445-45ec5370092a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:35.487883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda977e7-6596-4d5c-a445-45ec5370092a admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:35.496204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda977e7-6596-4d5c-a445-45ec5370092a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:35.496204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda977e7-6596-4d5c-a445-45ec5370092a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:35.580091 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2470/4875] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:33:35 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:33:35.584442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57b796-0e8e-4806-b4ee-68d450a221ea admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:35.594553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f57b796-0e8e-4806-b4ee-68d450a221ea admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:35.672321 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:35.686996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1307121-a076-47bb-a330-908ddc238074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:35.688198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1307121-a076-47bb-a330-908ddc238074 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:35.688198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1307121-a076-47bb-a330-908ddc238074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:35.688390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1307121-a076-47bb-a330-908ddc238074 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:35.688958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1307121-a076-47bb-a330-908ddc238074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:35.692346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1307121-a076-47bb-a330-908ddc238074 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:35.783974 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2406/4876] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:33:35 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:33:35.785275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda977e7-6596-4d5c-a445-45ec5370092a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:35.799313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda977e7-6596-4d5c-a445-45ec5370092a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:35.804062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ffd7a-c168-491d-bc7e-b2175ecb988d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:35.804742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ffd7a-c168-491d-bc7e-b2175ecb988d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:35.805026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ffd7a-c168-491d-bc7e-b2175ecb988d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:35.805311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ffd7a-c168-491d-bc7e-b2175ecb988d admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:35.806295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ffd7a-c168-491d-bc7e-b2175ecb988d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:35.808058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301ffd7a-c168-491d-bc7e-b2175ecb988d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:35.820202 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2471/4877] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:33:35.823857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1307121-a076-47bb-a330-908ddc238074 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:35.835509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1307121-a076-47bb-a330-908ddc238074 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:35.840547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281cb74-3c3b-4cb4-8880-8e46c2482917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:35.841254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281cb74-3c3b-4cb4-8880-8e46c2482917 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:35.841542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281cb74-3c3b-4cb4-8880-8e46c2482917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:35.841824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281cb74-3c3b-4cb4-8880-8e46c2482917 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:35.842595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281cb74-3c3b-4cb4-8880-8e46c2482917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:35.844286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281cb74-3c3b-4cb4-8880-8e46c2482917 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:35.858179 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2407/4878] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:33:35.862403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ffd7a-c168-491d-bc7e-b2175ecb988d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:35.874419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ffd7a-c168-491d-bc7e-b2175ecb988d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:35.880261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9fffd-5a85-4bb7-9b05-86ec07be5ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:35.881289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9fffd-5a85-4bb7-9b05-86ec07be5ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:35.881476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9fffd-5a85-4bb7-9b05-86ec07be5ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:35.882036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b9fffd-5a85-4bb7-9b05-86ec07be5ca0 admin admin] PATH_INFO: `/v3/projects/eb94ff13b1bd45be89521c4983a579d2/users/2cb5060535f440a5b822500807c10688/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:35.899696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9fffd-5a85-4bb7-9b05-86ec07be5ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb94ff13b1bd45be89521c4983a579d2, user_id=2cb5060535f440a5b822500807c10688, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:35.902698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b9fffd-5a85-4bb7-9b05-86ec07be5ca0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:36.020630 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2472/4879] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:33:35 2022] PUT /identity/v3/projects/eb94ff13b1bd45be89521c4983a579d2/users/2cb5060535f440a5b822500807c10688/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:33:36.025929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c36cc3-f685-49e9-87bd-e840ecc9b6fe None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:36.026723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c36cc3-f685-49e9-87bd-e840ecc9b6fe None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:36.027248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c36cc3-f685-49e9-87bd-e840ecc9b6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:36.050456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-47c36cc3-f685-49e9-87bd-e840ecc9b6fe None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:36.052298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-47c36cc3-f685-49e9-87bd-e840ecc9b6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:36.137402 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2408/4880] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:36.154798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9fffd-5a85-4bb7-9b05-86ec07be5ca0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:36.157990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-18b9fffd-5a85-4bb7-9b05-86ec07be5ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:36.265663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b9fffd-5a85-4bb7-9b05-86ec07be5ca0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:36.277075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01561638-7665-4056-9b54-629eb389bcb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:36.277785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01561638-7665-4056-9b54-629eb389bcb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:36.278077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01561638-7665-4056-9b54-629eb389bcb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:36.278393 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01561638-7665-4056-9b54-629eb389bcb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:36.290945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01561638-7665-4056-9b54-629eb389bcb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:36.292568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01561638-7665-4056-9b54-629eb389bcb8 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:36.299696 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:36.307171 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2473/4881] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:33:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:33:47.437642 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=35,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:33:48.472920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874216e-1fff-4ec7-907c-29edc3711fda None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:48.473918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874216e-1fff-4ec7-907c-29edc3711fda None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:48.475340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874216e-1fff-4ec7-907c-29edc3711fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:48.568572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7874216e-1fff-4ec7-907c-29edc3711fda None None] MFA Rules not processed for user `2cb5060535f440a5b822500807c10688`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:48.569802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7874216e-1fff-4ec7-907c-29edc3711fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:48.735958 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2409/4882] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:48.743848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01561638-7665-4056-9b54-629eb389bcb8 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:48.746327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-01561638-7665-4056-9b54-629eb389bcb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:48.905003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01561638-7665-4056-9b54-629eb389bcb8 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:48.913823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8980ab-cec1-481a-984d-feff4eb5dcc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:48.914941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8980ab-cec1-481a-984d-feff4eb5dcc5 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:48.915282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8980ab-cec1-481a-984d-feff4eb5dcc5 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:48.915569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8980ab-cec1-481a-984d-feff4eb5dcc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:48.934636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8980ab-cec1-481a-984d-feff4eb5dcc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:48.936399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8980ab-cec1-481a-984d-feff4eb5dcc5 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:48.949958 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2474/4883] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:33:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:33:53.066978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d6a17-1e59-475a-809a-92289ab8d9fb None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:53.067545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d6a17-1e59-475a-809a-92289ab8d9fb None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:53.067644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75d6a17-1e59-475a-809a-92289ab8d9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:53.091085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b75d6a17-1e59-475a-809a-92289ab8d9fb None None] MFA Rules not processed for user `2cb5060535f440a5b822500807c10688`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:33:53.092626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b75d6a17-1e59-475a-809a-92289ab8d9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:53.101792 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2410/4884] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:33:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:33:53.548789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8980ab-cec1-481a-984d-feff4eb5dcc5 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:33:53.550360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6a8980ab-cec1-481a-984d-feff4eb5dcc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:53.563690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8980ab-cec1-481a-984d-feff4eb5dcc5 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:33:53.567551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de01992-6fd5-47b9-aa31-36a49401b8ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:33:53.568790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de01992-6fd5-47b9-aa31-36a49401b8ce service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:33:53.569551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de01992-6fd5-47b9-aa31-36a49401b8ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:33:53.569719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de01992-6fd5-47b9-aa31-36a49401b8ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:33:53.571875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1de01992-6fd5-47b9-aa31-36a49401b8ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:33:53.584778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de01992-6fd5-47b9-aa31-36a49401b8ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:33:53.586320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de01992-6fd5-47b9-aa31-36a49401b8ce service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:33:53.596847 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2475/4885] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:33:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:34:03.082360 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=35 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:03.593560 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=40 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:04.921020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb23a1-ae14-4db5-8742-fd7642c4cbd9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:04.921572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb23a1-ae14-4db5-8742-fd7642c4cbd9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:04.921572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb23a1-ae14-4db5-8742-fd7642c4cbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:04.941442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-02bb23a1-ae14-4db5-8742-fd7642c4cbd9 None None] MFA Rules not processed for user `013b13b6d741411a95806dce36c2bd20`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:04.942930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-02bb23a1-ae14-4db5-8742-fd7642c4cbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:05.017079 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2411/4886] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:34:14.041589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de01992-6fd5-47b9-aa31-36a49401b8ce service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:14.057837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de01992-6fd5-47b9-aa31-36a49401b8ce service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:14.070779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa63943-e060-413f-b608-c326271f6d0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:14.070779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa63943-e060-413f-b608-c326271f6d0f service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:14.070779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa63943-e060-413f-b608-c326271f6d0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:14.070779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa63943-e060-413f-b608-c326271f6d0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:14.071186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ffa63943-e060-413f-b608-c326271f6d0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:14.089863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa63943-e060-413f-b608-c326271f6d0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:14.092710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa63943-e060-413f-b608-c326271f6d0f service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:14.114752 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2476/4887] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:34:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:34:15.009290 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=25 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:20.524045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb23a1-ae14-4db5-8742-fd7642c4cbd9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:20.528246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-02bb23a1-ae14-4db5-8742-fd7642c4cbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:20.553660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb23a1-ae14-4db5-8742-fd7642c4cbd9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:20.563058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d8614-08a4-4739-9da3-25fdfee1b3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:20.565697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d8614-08a4-4739-9da3-25fdfee1b3ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:20.566217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d8614-08a4-4739-9da3-25fdfee1b3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:20.566919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d8614-08a4-4739-9da3-25fdfee1b3ef admin admin] PATH_INFO: `/v3/users/eee0949ddc584dcfb866960cbfb2ce43` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:20.569531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d8614-08a4-4739-9da3-25fdfee1b3ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=eee0949ddc584dcfb866960cbfb2ce43)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:20.571907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d8614-08a4-4739-9da3-25fdfee1b3ef admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:20.792889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-590d8614-08a4-4739-9da3-25fdfee1b3ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eee0949ddc584dcfb866960cbfb2ce43'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:20.816445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-590d8614-08a4-4739-9da3-25fdfee1b3ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eee0949ddc584dcfb866960cbfb2ce43'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:20.817715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-590d8614-08a4-4739-9da3-25fdfee1b3ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eee0949ddc584dcfb866960cbfb2ce43'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:20.818955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-590d8614-08a4-4739-9da3-25fdfee1b3ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eee0949ddc584dcfb866960cbfb2ce43'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:20.827332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-590d8614-08a4-4739-9da3-25fdfee1b3ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eee0949ddc584dcfb866960cbfb2ce43'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:20.888393 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2412/4888] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:20 2022] DELETE /identity/v3/users/eee0949ddc584dcfb866960cbfb2ce43 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:21.116510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa63943-e060-413f-b608-c326271f6d0f service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:21.118403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ffa63943-e060-413f-b608-c326271f6d0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:21.131865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa63943-e060-413f-b608-c326271f6d0f service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:21.226067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559399ec-bc49-4455-8e18-f7a9cb393197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:21.227721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559399ec-bc49-4455-8e18-f7a9cb393197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:21.227721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559399ec-bc49-4455-8e18-f7a9cb393197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:21.227995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559399ec-bc49-4455-8e18-f7a9cb393197 admin admin] PATH_INFO: `/v3/users/e64202aaad0642e9b9c8db84891bc074` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:21.229380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559399ec-bc49-4455-8e18-f7a9cb393197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e64202aaad0642e9b9c8db84891bc074)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:21.231447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559399ec-bc49-4455-8e18-f7a9cb393197 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:21.379355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d8614-08a4-4739-9da3-25fdfee1b3ef admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:21.381359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-590d8614-08a4-4739-9da3-25fdfee1b3ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:21.396786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d8614-08a4-4739-9da3-25fdfee1b3ef admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:21.401778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dee646-6674-421c-baf4-b2db9de2126b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:21.402955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dee646-6674-421c-baf4-b2db9de2126b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:21.403940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dee646-6674-421c-baf4-b2db9de2126b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:21.403940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dee646-6674-421c-baf4-b2db9de2126b admin admin] PATH_INFO: `/v3/projects/f4ffc3f062c04bf9a64175f1d4829c0f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:21.404833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dee646-6674-421c-baf4-b2db9de2126b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4ffc3f062c04bf9a64175f1d4829c0f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:21.406838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dee646-6674-421c-baf4-b2db9de2126b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:21.540692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-559399ec-bc49-4455-8e18-f7a9cb393197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e64202aaad0642e9b9c8db84891bc074'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:21.581290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-559399ec-bc49-4455-8e18-f7a9cb393197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e64202aaad0642e9b9c8db84891bc074'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:21.582330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a9dee646-6674-421c-baf4-b2db9de2126b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4ffc3f062c04bf9a64175f1d4829c0f', 'request_id': 'req-a9dee646-6674-421c-baf4-b2db9de2126b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:21.596977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-559399ec-bc49-4455-8e18-f7a9cb393197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e64202aaad0642e9b9c8db84891bc074'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:21.599986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-559399ec-bc49-4455-8e18-f7a9cb393197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e64202aaad0642e9b9c8db84891bc074'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:21.651969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a9dee646-6674-421c-baf4-b2db9de2126b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4ffc3f062c04bf9a64175f1d4829c0f', 'request_id': 'req-a9dee646-6674-421c-baf4-b2db9de2126b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:21.660471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a9dee646-6674-421c-baf4-b2db9de2126b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4ffc3f062c04bf9a64175f1d4829c0f', 'request_id': 'req-a9dee646-6674-421c-baf4-b2db9de2126b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:21.688011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a9dee646-6674-421c-baf4-b2db9de2126b admin admin] The token cache is being invalidate because project f4ffc3f062c04bf9a64175f1d4829c0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:21.688734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a9dee646-6674-421c-baf4-b2db9de2126b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:21.689802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a9dee646-6674-421c-baf4-b2db9de2126b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:21.692407 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2413/4889] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:34:21 2022] DELETE /identity/v3/projects/f4ffc3f062c04bf9a64175f1d4829c0f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:21.707337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e92487-b400-4390-a29e-bc90a73357c5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:21.707689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e92487-b400-4390-a29e-bc90a73357c5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:21.707914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e92487-b400-4390-a29e-bc90a73357c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:21.749723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-03e92487-b400-4390-a29e-bc90a73357c5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:21.751163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-03e92487-b400-4390-a29e-bc90a73357c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:21.796106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-559399ec-bc49-4455-8e18-f7a9cb393197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e64202aaad0642e9b9c8db84891bc074'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:21.802135 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2477/4890] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:21 2022] DELETE /identity/v3/users/e64202aaad0642e9b9c8db84891bc074 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:21.807840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ac987-1f76-4777-8bdc-ff2d256cda0b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:21.809939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ac987-1f76-4777-8bdc-ff2d256cda0b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:21.810340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988ac987-1f76-4777-8bdc-ff2d256cda0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:21.821687 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:21.831686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-988ac987-1f76-4777-8bdc-ff2d256cda0b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:21.833072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-988ac987-1f76-4777-8bdc-ff2d256cda0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:21.837666 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2414/4891] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:34:21.849619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b675b9-4b27-49cd-b4ab-a2358eddf676 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:21.849981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b675b9-4b27-49cd-b4ab-a2358eddf676 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:21.850300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b675b9-4b27-49cd-b4ab-a2358eddf676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:21.869947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a1b675b9-4b27-49cd-b4ab-a2358eddf676 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:21.871443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a1b675b9-4b27-49cd-b4ab-a2358eddf676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:21.917957 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2478/4892] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:34:21.930254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ac987-1f76-4777-8bdc-ff2d256cda0b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:21.931973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-988ac987-1f76-4777-8bdc-ff2d256cda0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:21.942074 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:21.952646 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2415/4893] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:34:21.956668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b675b9-4b27-49cd-b4ab-a2358eddf676 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:21.968833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b675b9-4b27-49cd-b4ab-a2358eddf676 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:21.975142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cbc02-1e5e-471e-8ac2-b64e2d7e0a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:21.975713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cbc02-1e5e-471e-8ac2-b64e2d7e0a51 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:21.976062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cbc02-1e5e-471e-8ac2-b64e2d7e0a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:21.976413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0cbc02-1e5e-471e-8ac2-b64e2d7e0a51 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:21.978223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0cbc02-1e5e-471e-8ac2-b64e2d7e0a51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:34:21.978362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0cbc02-1e5e-471e-8ac2-b64e2d7e0a51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:21.979990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0cbc02-1e5e-471e-8ac2-b64e2d7e0a51 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:21.994451 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2416/4894] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:34:21.998929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cbc02-1e5e-471e-8ac2-b64e2d7e0a51 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:22.007063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988ac987-1f76-4777-8bdc-ff2d256cda0b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:22.010292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0cbc02-1e5e-471e-8ac2-b64e2d7e0a51 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:22.014708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d97c4-2407-4f0c-abcd-1ec873b1a037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:22.014708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d97c4-2407-4f0c-abcd-1ec873b1a037 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:22.014708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d97c4-2407-4f0c-abcd-1ec873b1a037 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:22.014708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d97c4-2407-4f0c-abcd-1ec873b1a037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:22.015273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c076e59-d461-4d0e-9a95-1cd764eea9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:22.015861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c076e59-d461-4d0e-9a95-1cd764eea9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:22.016148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c076e59-d461-4d0e-9a95-1cd764eea9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:22.016478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c076e59-d461-4d0e-9a95-1cd764eea9f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:22.017128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c076e59-d461-4d0e-9a95-1cd764eea9f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:22.019095 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c076e59-d461-4d0e-9a95-1cd764eea9f9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:22.023444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d97c4-2407-4f0c-abcd-1ec873b1a037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:22.024968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d97c4-2407-4f0c-abcd-1ec873b1a037 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:22.038427 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2479/4895] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:34:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:34:22.151354 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2417/4896] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:34:21 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:22.157371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d97c4-2407-4f0c-abcd-1ec873b1a037 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:22.173432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d97c4-2407-4f0c-abcd-1ec873b1a037 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:22.251731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaeecc-1ad1-4b20-a001-2ef89d370c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:22.252449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaeecc-1ad1-4b20-a001-2ef89d370c2b admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:22.252735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaeecc-1ad1-4b20-a001-2ef89d370c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:22.253130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aaeecc-1ad1-4b20-a001-2ef89d370c2b admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:22.253690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aaeecc-1ad1-4b20-a001-2ef89d370c2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:22.255860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aaeecc-1ad1-4b20-a001-2ef89d370c2b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:22.337016 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2480/4897] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:34:22 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:22.339961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c076e59-d461-4d0e-9a95-1cd764eea9f9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:22.353280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c076e59-d461-4d0e-9a95-1cd764eea9f9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:22.359027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a48d3-f317-4fe0-b5e0-edda0a8cb9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:22.359713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a48d3-f317-4fe0-b5e0-edda0a8cb9b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:22.360000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a48d3-f317-4fe0-b5e0-edda0a8cb9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:22.360954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a48d3-f317-4fe0-b5e0-edda0a8cb9b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:22.361257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a48d3-f317-4fe0-b5e0-edda0a8cb9b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:22.362955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7a48d3-f317-4fe0-b5e0-edda0a8cb9b8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:22.375368 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2418/4898] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:34:22.379363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaeecc-1ad1-4b20-a001-2ef89d370c2b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:22.398862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aaeecc-1ad1-4b20-a001-2ef89d370c2b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:22.398862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3219062-1cd1-4290-9754-f969f77cd7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:22.398862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3219062-1cd1-4290-9754-f969f77cd7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:22.398862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3219062-1cd1-4290-9754-f969f77cd7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:22.399300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3219062-1cd1-4290-9754-f969f77cd7c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:22.399637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3219062-1cd1-4290-9754-f969f77cd7c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:22.401249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3219062-1cd1-4290-9754-f969f77cd7c7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:22.413464 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2481/4899] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:34:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:34:22.417336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a48d3-f317-4fe0-b5e0-edda0a8cb9b8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:22.427985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a48d3-f317-4fe0-b5e0-edda0a8cb9b8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:22.433174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2bd9b-ca44-4499-830b-b6ccdbc54f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:22.434069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2bd9b-ca44-4499-830b-b6ccdbc54f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:22.434677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2bd9b-ca44-4499-830b-b6ccdbc54f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:22.434956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c2bd9b-ca44-4499-830b-b6ccdbc54f3b admin admin] PATH_INFO: `/v3/projects/208ce7f261a04fdeb686b4a00eae5e51/users/1e4c8550741546a3bb16ffdb5f551759/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:22.450861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2bd9b-ca44-4499-830b-b6ccdbc54f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=208ce7f261a04fdeb686b4a00eae5e51, user_id=1e4c8550741546a3bb16ffdb5f551759, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:22.453484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c2bd9b-ca44-4499-830b-b6ccdbc54f3b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:22.548664 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2419/4900] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:34:22 2022] PUT /identity/v3/projects/208ce7f261a04fdeb686b4a00eae5e51/users/1e4c8550741546a3bb16ffdb5f551759/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:22.559725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465e7bd-d36c-423d-a34a-58c2482e7303 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:22.560073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465e7bd-d36c-423d-a34a-58c2482e7303 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:22.560511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465e7bd-d36c-423d-a34a-58c2482e7303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:22.592075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0465e7bd-d36c-423d-a34a-58c2482e7303 None None] MFA Rules not processed for user `1e4c8550741546a3bb16ffdb5f551759`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:22.594242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0465e7bd-d36c-423d-a34a-58c2482e7303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:22.595717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2bd9b-ca44-4499-830b-b6ccdbc54f3b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:22.598118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-65c2bd9b-ca44-4499-830b-b6ccdbc54f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:22.711622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c2bd9b-ca44-4499-830b-b6ccdbc54f3b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:22.717930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ff22a-8584-4c52-81c7-56721197539d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:22.719258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ff22a-8584-4c52-81c7-56721197539d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:22.719796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ff22a-8584-4c52-81c7-56721197539d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:22.720161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ff22a-8584-4c52-81c7-56721197539d admin admin] PATH_INFO: `/v3/projects/60fe47076ab44bd89121dc47dd619f49` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:22.722067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ff22a-8584-4c52-81c7-56721197539d admin admin] RBAC: Authorizing `identity:delete_project(project_id=60fe47076ab44bd89121dc47dd619f49)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:22.726581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ff22a-8584-4c52-81c7-56721197539d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:22.775404 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2482/4901] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:22 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:34:22.778914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465e7bd-d36c-423d-a34a-58c2482e7303 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:22.795064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465e7bd-d36c-423d-a34a-58c2482e7303 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:22.800566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94eaf75-ecec-4c3e-970e-4707a84e5b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:22.801251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94eaf75-ecec-4c3e-970e-4707a84e5b63 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:22.801548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94eaf75-ecec-4c3e-970e-4707a84e5b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:22.801837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94eaf75-ecec-4c3e-970e-4707a84e5b63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:22.802729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94eaf75-ecec-4c3e-970e-4707a84e5b63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:22.804925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94eaf75-ecec-4c3e-970e-4707a84e5b63 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:22.822686 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:22.837062 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:22.861030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f41ff22a-8584-4c52-81c7-56721197539d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60fe47076ab44bd89121dc47dd619f49', 'request_id': 'req-f41ff22a-8584-4c52-81c7-56721197539d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:22.944079 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2483/4902] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:34:22 2022] POST /identity/v3/projects => generated 365 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:34:22.945555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94eaf75-ecec-4c3e-970e-4707a84e5b63 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:22.957061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f41ff22a-8584-4c52-81c7-56721197539d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60fe47076ab44bd89121dc47dd619f49', 'request_id': 'req-f41ff22a-8584-4c52-81c7-56721197539d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:22.966155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f41ff22a-8584-4c52-81c7-56721197539d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60fe47076ab44bd89121dc47dd619f49', 'request_id': 'req-f41ff22a-8584-4c52-81c7-56721197539d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:22.978821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f41ff22a-8584-4c52-81c7-56721197539d admin admin] The token cache is being invalidate because project 60fe47076ab44bd89121dc47dd619f49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:22.979515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f41ff22a-8584-4c52-81c7-56721197539d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:22.980369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f41ff22a-8584-4c52-81c7-56721197539d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:22.982466 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2420/4903] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:34:22 2022] DELETE /identity/v3/projects/60fe47076ab44bd89121dc47dd619f49 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:22.986455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ff22a-8584-4c52-81c7-56721197539d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:22.988116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f41ff22a-8584-4c52-81c7-56721197539d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:23.055084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94eaf75-ecec-4c3e-970e-4707a84e5b63 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:23.060215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c374b7-6721-4fbb-bcbf-42fa846e332e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:23.060929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c374b7-6721-4fbb-bcbf-42fa846e332e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:23.061217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c374b7-6721-4fbb-bcbf-42fa846e332e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:23.061666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c374b7-6721-4fbb-bcbf-42fa846e332e admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:23.062716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c374b7-6721-4fbb-bcbf-42fa846e332e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:23.067564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c374b7-6721-4fbb-bcbf-42fa846e332e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:23.087812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ff22a-8584-4c52-81c7-56721197539d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:23.093493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0afb44-8b1d-4e85-8865-34c59f59a843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:23.094661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0afb44-8b1d-4e85-8865-34c59f59a843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:23.095073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0afb44-8b1d-4e85-8865-34c59f59a843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:23.095459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0afb44-8b1d-4e85-8865-34c59f59a843 admin admin] PATH_INFO: `/v3/users/2eaf5061c92a415e84cc641c01c0261f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:23.103586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0afb44-8b1d-4e85-8865-34c59f59a843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eaf5061c92a415e84cc641c01c0261f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:23.108548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0afb44-8b1d-4e85-8865-34c59f59a843 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:23.163372 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2484/4904] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:34:22 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:34:23.167664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c374b7-6721-4fbb-bcbf-42fa846e332e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:23.169967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-21c374b7-6721-4fbb-bcbf-42fa846e332e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:23.185398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c374b7-6721-4fbb-bcbf-42fa846e332e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:23.194752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d795a-9c02-4ad1-af60-0372493b30f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:23.195460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d795a-9c02-4ad1-af60-0372493b30f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:23.195751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d795a-9c02-4ad1-af60-0372493b30f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:23.196029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d795a-9c02-4ad1-af60-0372493b30f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:23.196774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d795a-9c02-4ad1-af60-0372493b30f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:23.206517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6d795a-9c02-4ad1-af60-0372493b30f8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:23.222448 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2485/4905] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:34:23.229363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d795a-9c02-4ad1-af60-0372493b30f8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:23.240498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6d795a-9c02-4ad1-af60-0372493b30f8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:23.248033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a13a0-9c1d-4789-8e07-f07fd2aebf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:23.248985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a13a0-9c1d-4789-8e07-f07fd2aebf82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:23.249243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a13a0-9c1d-4789-8e07-f07fd2aebf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:23.249519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a13a0-9c1d-4789-8e07-f07fd2aebf82 admin admin] PATH_INFO: `/v3/projects/654dd1df680645a6812662aec16d3394/users/dd8fa1cfabea450d921cb04d315db369/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:23.266962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a13a0-9c1d-4789-8e07-f07fd2aebf82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=654dd1df680645a6812662aec16d3394, user_id=dd8fa1cfabea450d921cb04d315db369, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:23.271855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a13a0-9c1d-4789-8e07-f07fd2aebf82 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:23.390257 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2486/4906] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:34:23 2022] PUT /identity/v3/projects/654dd1df680645a6812662aec16d3394/users/dd8fa1cfabea450d921cb04d315db369/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:23.394667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a13a0-9c1d-4789-8e07-f07fd2aebf82 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:23.403672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4d0afb44-8b1d-4e85-8865-34c59f59a843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eaf5061c92a415e84cc641c01c0261f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:23.464576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4d0afb44-8b1d-4e85-8865-34c59f59a843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eaf5061c92a415e84cc641c01c0261f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:23.467531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4d0afb44-8b1d-4e85-8865-34c59f59a843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eaf5061c92a415e84cc641c01c0261f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:23.470453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4d0afb44-8b1d-4e85-8865-34c59f59a843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eaf5061c92a415e84cc641c01c0261f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:23.490428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4d0afb44-8b1d-4e85-8865-34c59f59a843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eaf5061c92a415e84cc641c01c0261f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:23.512994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a13a0-9c1d-4789-8e07-f07fd2aebf82 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:23.518847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92843412-44fb-4d6c-8e6c-ba233f1e4fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:23.519734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92843412-44fb-4d6c-8e6c-ba233f1e4fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:23.520027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92843412-44fb-4d6c-8e6c-ba233f1e4fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:23.524948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92843412-44fb-4d6c-8e6c-ba233f1e4fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:23.524948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92843412-44fb-4d6c-8e6c-ba233f1e4fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:23.524948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92843412-44fb-4d6c-8e6c-ba233f1e4fc7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:23.534637 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2487/4907] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:34:23 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:34:23.538867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92843412-44fb-4d6c-8e6c-ba233f1e4fc7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:23.540882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-92843412-44fb-4d6c-8e6c-ba233f1e4fc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:23.554271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92843412-44fb-4d6c-8e6c-ba233f1e4fc7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:23.559337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae447c74-b9e8-4ce2-a227-4574c13e31a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:23.560206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae447c74-b9e8-4ce2-a227-4574c13e31a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:23.560489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae447c74-b9e8-4ce2-a227-4574c13e31a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:23.560773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae447c74-b9e8-4ce2-a227-4574c13e31a1 admin admin] PATH_INFO: `/v3/projects/654dd1df680645a6812662aec16d3394/users/dd8fa1cfabea450d921cb04d315db369/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:23.562838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae447c74-b9e8-4ce2-a227-4574c13e31a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=654dd1df680645a6812662aec16d3394, user_id=dd8fa1cfabea450d921cb04d315db369, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:23.565527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae447c74-b9e8-4ce2-a227-4574c13e31a1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:23.573481 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2421/4908] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:22 2022] DELETE /identity/v3/users/2eaf5061c92a415e84cc641c01c0261f => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:23.580846 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2488/4909] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:34:23 2022] PUT /identity/v3/projects/654dd1df680645a6812662aec16d3394/users/dd8fa1cfabea450d921cb04d315db369/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:23.592002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a869540-fdc5-4f0a-95df-660aedcef38d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:23.592195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a869540-fdc5-4f0a-95df-660aedcef38d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:23.592480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a869540-fdc5-4f0a-95df-660aedcef38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:23.644153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4a869540-fdc5-4f0a-95df-660aedcef38d None None] MFA Rules not processed for user `dd8fa1cfabea450d921cb04d315db369`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:23.645441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4a869540-fdc5-4f0a-95df-660aedcef38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:23.688460 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:23.755251 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2422/4910] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:23 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:34:23.758898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae447c74-b9e8-4ce2-a227-4574c13e31a1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:23.812434 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:23.866490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae447c74-b9e8-4ce2-a227-4574c13e31a1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:23.867791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a869540-fdc5-4f0a-95df-660aedcef38d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:23.869188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4a869540-fdc5-4f0a-95df-660aedcef38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:23.869306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47feba8a-1fdb-4b5e-8587-58bc37dbcebc tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8fa1cfabea450d921cb04d315db369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '654dd1df680645a6812662aec16d3394', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:23.869952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feba8a-1fdb-4b5e-8587-58bc37dbcebc tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:23.870605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feba8a-1fdb-4b5e-8587-58bc37dbcebc tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:23.870838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47feba8a-1fdb-4b5e-8587-58bc37dbcebc tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:23.871591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47feba8a-1fdb-4b5e-8587-58bc37dbcebc tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:23.873213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47feba8a-1fdb-4b5e-8587-58bc37dbcebc tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:23.993667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a869540-fdc5-4f0a-95df-660aedcef38d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:24.001127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33833b7-82b1-41ea-b5d0-b2136f2d8e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:24.003034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33833b7-82b1-41ea-b5d0-b2136f2d8e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:24.005147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33833b7-82b1-41ea-b5d0-b2136f2d8e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:24.005147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33833b7-82b1-41ea-b5d0-b2136f2d8e1a admin admin] PATH_INFO: `/v3/projects/78a4e065a8364f1e94c65fe150342694` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:24.006967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33833b7-82b1-41ea-b5d0-b2136f2d8e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=78a4e065a8364f1e94c65fe150342694)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:24.009887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33833b7-82b1-41ea-b5d0-b2136f2d8e1a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:24.014363 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2489/4911] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:34:23 2022] POST /identity/v3/domains => generated 276 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:24.017066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47feba8a-1fdb-4b5e-8587-58bc37dbcebc tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:24.141726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47feba8a-1fdb-4b5e-8587-58bc37dbcebc tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:24.151710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05897da4-510f-4810-af56-89eefa7abcf8 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8fa1cfabea450d921cb04d315db369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '654dd1df680645a6812662aec16d3394', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:24.158397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05897da4-510f-4810-af56-89eefa7abcf8 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:24.160130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05897da4-510f-4810-af56-89eefa7abcf8 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:24.164852 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05897da4-510f-4810-af56-89eefa7abcf8 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:24.167593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05897da4-510f-4810-af56-89eefa7abcf8 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:24.174581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05897da4-510f-4810-af56-89eefa7abcf8 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:24.192006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c33833b7-82b1-41ea-b5d0-b2136f2d8e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78a4e065a8364f1e94c65fe150342694', 'request_id': 'req-c33833b7-82b1-41ea-b5d0-b2136f2d8e1a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:24.313732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c33833b7-82b1-41ea-b5d0-b2136f2d8e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78a4e065a8364f1e94c65fe150342694', 'request_id': 'req-c33833b7-82b1-41ea-b5d0-b2136f2d8e1a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:24.321979 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2490/4912] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:34:24 2022] POST /identity/v3/users => generated 346 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:24.326089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05897da4-510f-4810-af56-89eefa7abcf8 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:24.327562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c33833b7-82b1-41ea-b5d0-b2136f2d8e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78a4e065a8364f1e94c65fe150342694', 'request_id': 'req-c33833b7-82b1-41ea-b5d0-b2136f2d8e1a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:24.342412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05897da4-510f-4810-af56-89eefa7abcf8 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:24.349547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c33833b7-82b1-41ea-b5d0-b2136f2d8e1a admin admin] The token cache is being invalidate because project 78a4e065a8364f1e94c65fe150342694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:24.350030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c33833b7-82b1-41ea-b5d0-b2136f2d8e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:24.351003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c33833b7-82b1-41ea-b5d0-b2136f2d8e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:24.356099 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2423/4913] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:34:23 2022] DELETE /identity/v3/projects/78a4e065a8364f1e94c65fe150342694 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:24.363369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0e662-5672-43cc-8473-7714e2a7dafa None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:24.364119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0e662-5672-43cc-8473-7714e2a7dafa None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:24.365947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe0e662-5672-43cc-8473-7714e2a7dafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:24.394018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-bbe0e662-5672-43cc-8473-7714e2a7dafa None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:24.395783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bbe0e662-5672-43cc-8473-7714e2a7dafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:24.452617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af4835-3018-4da4-95c0-3a7bc8d7a2d2 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8fa1cfabea450d921cb04d315db369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '654dd1df680645a6812662aec16d3394', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:24.456288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af4835-3018-4da4-95c0-3a7bc8d7a2d2 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:24.457027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af4835-3018-4da4-95c0-3a7bc8d7a2d2 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:24.457352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af4835-3018-4da4-95c0-3a7bc8d7a2d2 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:24.459486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af4835-3018-4da4-95c0-3a7bc8d7a2d2 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:24.463447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af4835-3018-4da4-95c0-3a7bc8d7a2d2 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:24.481672 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2424/4914] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:34:24.489297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abecd35-6803-4042-b482-f88937930553 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:24.490252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abecd35-6803-4042-b482-f88937930553 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:24.490890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abecd35-6803-4042-b482-f88937930553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:24.515625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1abecd35-6803-4042-b482-f88937930553 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:24.515625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1abecd35-6803-4042-b482-f88937930553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:24.521215 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2425/4915] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:34:24.525513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abecd35-6803-4042-b482-f88937930553 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:24.534830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abecd35-6803-4042-b482-f88937930553 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:24.539765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643b366-0e2b-4d0a-a49b-49a795e618fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:24.540428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643b366-0e2b-4d0a-a49b-49a795e618fa admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:24.540720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643b366-0e2b-4d0a-a49b-49a795e618fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:24.541005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a643b366-0e2b-4d0a-a49b-49a795e618fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:24.541888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643b366-0e2b-4d0a-a49b-49a795e618fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:34:24.542232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643b366-0e2b-4d0a-a49b-49a795e618fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:24.543827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a643b366-0e2b-4d0a-a49b-49a795e618fa admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:24.560093 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2426/4916] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:34:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:34:24.561119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643b366-0e2b-4d0a-a49b-49a795e618fa admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:24.574408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a643b366-0e2b-4d0a-a49b-49a795e618fa admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:24.577929 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:24.582339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1738dd-5c57-4317-922e-9a3a791a23ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:24.583655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1738dd-5c57-4317-922e-9a3a791a23ad admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:24.583900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1738dd-5c57-4317-922e-9a3a791a23ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:24.584363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1738dd-5c57-4317-922e-9a3a791a23ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:24.585086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1738dd-5c57-4317-922e-9a3a791a23ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:24.590682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1738dd-5c57-4317-922e-9a3a791a23ad admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:24.637749 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2491/4917] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:34:24 2022] POST /identity/v3/users => generated 322 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:24.638921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af4835-3018-4da4-95c0-3a7bc8d7a2d2 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:24.641724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-03af4835-3018-4da4-95c0-3a7bc8d7a2d2 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:24.656295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af4835-3018-4da4-95c0-3a7bc8d7a2d2 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:24.661046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21127e-983e-4879-bccf-575573d9ea1c tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8fa1cfabea450d921cb04d315db369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '654dd1df680645a6812662aec16d3394', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:24.666245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21127e-983e-4879-bccf-575573d9ea1c tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:24.666245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21127e-983e-4879-bccf-575573d9ea1c tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:24.666245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab21127e-983e-4879-bccf-575573d9ea1c tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] PATH_INFO: `/v3/users/3570553b51014438bf6c17d7d0c2db8a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:24.686293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21127e-983e-4879-bccf-575573d9ea1c tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorizing `identity:get_user(user_id=3570553b51014438bf6c17d7d0c2db8a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:24.688680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab21127e-983e-4879-bccf-575573d9ea1c tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:24.694917 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2492/4918] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Jul 19 14:34:24 2022] GET /identity/v3/users/3570553b51014438bf6c17d7d0c2db8a => generated 346 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:34:24.696352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21127e-983e-4879-bccf-575573d9ea1c tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:24.716013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab21127e-983e-4879-bccf-575573d9ea1c tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:24.722410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d3548-7c00-4a66-a39b-58d312d0efa9 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8fa1cfabea450d921cb04d315db369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '654dd1df680645a6812662aec16d3394', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:24.725856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d3548-7c00-4a66-a39b-58d312d0efa9 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:24.728659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d3548-7c00-4a66-a39b-58d312d0efa9 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:24.730209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124d3548-7c00-4a66-a39b-58d312d0efa9 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:24.731423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d3548-7c00-4a66-a39b-58d312d0efa9 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Adding query filter params (domain_id=0b2a861ffe4840c5b202f64c1292c3d7) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:34:24.731869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d3548-7c00-4a66-a39b-58d312d0efa9 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:24.734280 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-124d3548-7c00-4a66-a39b-58d312d0efa9 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:24.734280 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:34:24.734280 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:34:24.735498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124d3548-7c00-4a66-a39b-58d312d0efa9 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:24.738684 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2427/4919] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:34:24 2022] POST /identity/v3/projects => generated 391 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:24.740264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1738dd-5c57-4317-922e-9a3a791a23ad admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:24.759377 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2493/4920] 10.222.0.43 () {58 vars in 1206 bytes} [Tue Jul 19 14:34:24 2022] GET /identity/v3/users?domain_id=0b2a861ffe4840c5b202f64c1292c3d7 => generated 483 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:34:24.764557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d3548-7c00-4a66-a39b-58d312d0efa9 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:24.783513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124d3548-7c00-4a66-a39b-58d312d0efa9 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:24.801804 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:24.848820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1738dd-5c57-4317-922e-9a3a791a23ad admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:24.856863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a270a46-b7bc-4e63-844b-b716b68fd946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:24.857843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a270a46-b7bc-4e63-844b-b716b68fd946 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:24.857843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a270a46-b7bc-4e63-844b-b716b68fd946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:24.858133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a270a46-b7bc-4e63-844b-b716b68fd946 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:24.859024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a270a46-b7bc-4e63-844b-b716b68fd946 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:24.861233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a270a46-b7bc-4e63-844b-b716b68fd946 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:24.889212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28109076-fc83-4026-947e-e5192cd69d27 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8fa1cfabea450d921cb04d315db369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '654dd1df680645a6812662aec16d3394', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:24.890022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28109076-fc83-4026-947e-e5192cd69d27 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:24.891430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28109076-fc83-4026-947e-e5192cd69d27 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:24.891816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28109076-fc83-4026-947e-e5192cd69d27 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:24.892928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28109076-fc83-4026-947e-e5192cd69d27 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:24.896931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28109076-fc83-4026-947e-e5192cd69d27 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:24.952143 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2494/4921] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:34:24 2022] GET /identity/v3/users => generated 8581 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:34:24.960060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28109076-fc83-4026-947e-e5192cd69d27 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:24.973034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28109076-fc83-4026-947e-e5192cd69d27 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:24.980102 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2428/4922] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:34:24 2022] POST /identity/v3/users => generated 296 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:24.985300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a270a46-b7bc-4e63-844b-b716b68fd946 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:24.998775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d0afa-a260-4d25-ad5b-2b09ca1cd43d tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8fa1cfabea450d921cb04d315db369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '654dd1df680645a6812662aec16d3394', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:24.999714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d0afa-a260-4d25-ad5b-2b09ca1cd43d tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:25.000049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d0afa-a260-4d25-ad5b-2b09ca1cd43d tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:25.000929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d0afa-a260-4d25-ad5b-2b09ca1cd43d tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:25.003615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d0afa-a260-4d25-ad5b-2b09ca1cd43d tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Adding query filter params (name=tempest-test_user-1640986203) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:34:25.005069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d0afa-a260-4d25-ad5b-2b09ca1cd43d tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:25.019547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d0afa-a260-4d25-ad5b-2b09ca1cd43d tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:25.026115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a270a46-b7bc-4e63-844b-b716b68fd946 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:25.042571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713ae26-19ff-4e4b-a489-045f30919547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:25.044209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713ae26-19ff-4e4b-a489-045f30919547 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:25.044768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713ae26-19ff-4e4b-a489-045f30919547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:25.045318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713ae26-19ff-4e4b-a489-045f30919547 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:25.046270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713ae26-19ff-4e4b-a489-045f30919547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:25.051454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713ae26-19ff-4e4b-a489-045f30919547 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:25.089940 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2429/4923] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:34:24 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:34:25.095052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713ae26-19ff-4e4b-a489-045f30919547 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:25.148403 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2495/4924] 10.222.0.43 () {58 vars in 1188 bytes} [Tue Jul 19 14:34:24 2022] GET /identity/v3/users?name=tempest-test_user-1640986203 => generated 474 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:34:25.150947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d0afa-a260-4d25-ad5b-2b09ca1cd43d tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:25.151164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713ae26-19ff-4e4b-a489-045f30919547 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:25.169456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1451f34-a55a-40b7-9ec5-b371073925a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:25.170213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1451f34-a55a-40b7-9ec5-b371073925a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:25.170475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1451f34-a55a-40b7-9ec5-b371073925a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:25.170766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1451f34-a55a-40b7-9ec5-b371073925a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:25.171515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1451f34-a55a-40b7-9ec5-b371073925a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:25.177910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1451f34-a55a-40b7-9ec5-b371073925a8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:25.178903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d0afa-a260-4d25-ad5b-2b09ca1cd43d tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:25.186701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19762d-33d9-4aab-9d54-eaacaa0c7a26 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8fa1cfabea450d921cb04d315db369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '654dd1df680645a6812662aec16d3394', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:25.187936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19762d-33d9-4aab-9d54-eaacaa0c7a26 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:25.188457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19762d-33d9-4aab-9d54-eaacaa0c7a26 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:25.188946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19762d-33d9-4aab-9d54-eaacaa0c7a26 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:25.190853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19762d-33d9-4aab-9d54-eaacaa0c7a26 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:34:25.191385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19762d-33d9-4aab-9d54-eaacaa0c7a26 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:25.196148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19762d-33d9-4aab-9d54-eaacaa0c7a26 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:25.230380 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2430/4925] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:34:25 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:34:25.235933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1451f34-a55a-40b7-9ec5-b371073925a8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:25.252535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1451f34-a55a-40b7-9ec5-b371073925a8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:25.258634 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2496/4926] 10.222.0.43 () {58 vars in 1148 bytes} [Tue Jul 19 14:34:25 2022] GET /identity/v3/users?enabled=False => generated 430 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:34:25.259773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19762d-33d9-4aab-9d54-eaacaa0c7a26 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:25.266489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6080a5-37b0-442e-8413-bb2ded68b3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:25.268721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6080a5-37b0-442e-8413-bb2ded68b3b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:25.269415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6080a5-37b0-442e-8413-bb2ded68b3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:25.269850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6080a5-37b0-442e-8413-bb2ded68b3b1 admin admin] PATH_INFO: `/v3/projects/c124224330cc4a52a2093dd2c166f4e7/users/b44128631a744682949505541e25fe8c/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:25.277215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19762d-33d9-4aab-9d54-eaacaa0c7a26 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:25.287666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be663f84-f177-4d90-844d-7619d6f8d13e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8fa1cfabea450d921cb04d315db369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '654dd1df680645a6812662aec16d3394', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:25.288783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be663f84-f177-4d90-844d-7619d6f8d13e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:25.289074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be663f84-f177-4d90-844d-7619d6f8d13e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:25.289358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be663f84-f177-4d90-844d-7619d6f8d13e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] PATH_INFO: `/v3/users/ecf5676bf59541a4b0c71c3e7d4f50f9` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:25.294144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6080a5-37b0-442e-8413-bb2ded68b3b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c124224330cc4a52a2093dd2c166f4e7, user_id=b44128631a744682949505541e25fe8c, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:25.297282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6080a5-37b0-442e-8413-bb2ded68b3b1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:25.312051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be663f84-f177-4d90-844d-7619d6f8d13e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ecf5676bf59541a4b0c71c3e7d4f50f9)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:25.314727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be663f84-f177-4d90-844d-7619d6f8d13e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:25.469802 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2431/4927] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:34:25 2022] PUT /identity/v3/projects/c124224330cc4a52a2093dd2c166f4e7/users/b44128631a744682949505541e25fe8c/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:25.484279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d4ca7-a608-4a3c-8c68-65b2747d0a04 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:25.485004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d4ca7-a608-4a3c-8c68-65b2747d0a04 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:25.485289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d4ca7-a608-4a3c-8c68-65b2747d0a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:25.502947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-be663f84-f177-4d90-844d-7619d6f8d13e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecf5676bf59541a4b0c71c3e7d4f50f9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:25.532160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8b4d4ca7-a608-4a3c-8c68-65b2747d0a04 None None] MFA Rules not processed for user `b44128631a744682949505541e25fe8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:25.533652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8b4d4ca7-a608-4a3c-8c68-65b2747d0a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:25.539047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-be663f84-f177-4d90-844d-7619d6f8d13e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecf5676bf59541a4b0c71c3e7d4f50f9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:25.553847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-be663f84-f177-4d90-844d-7619d6f8d13e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecf5676bf59541a4b0c71c3e7d4f50f9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:25.554623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-be663f84-f177-4d90-844d-7619d6f8d13e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecf5676bf59541a4b0c71c3e7d4f50f9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:25.628453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-be663f84-f177-4d90-844d-7619d6f8d13e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecf5676bf59541a4b0c71c3e7d4f50f9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:25.637330 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2497/4928] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:25 2022] DELETE /identity/v3/users/ecf5676bf59541a4b0c71c3e7d4f50f9 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:25.639604 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2432/4929] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:34:25.642842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be663f84-f177-4d90-844d-7619d6f8d13e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:25.649868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-be663f84-f177-4d90-844d-7619d6f8d13e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:25.665760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d4ca7-a608-4a3c-8c68-65b2747d0a04 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:25.667273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8b4d4ca7-a608-4a3c-8c68-65b2747d0a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:25.805779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d4ca7-a608-4a3c-8c68-65b2747d0a04 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:25.820345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be663f84-f177-4d90-844d-7619d6f8d13e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:25.826811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f893494-fa93-4ad9-90fd-b99c45f76d6e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8fa1cfabea450d921cb04d315db369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '654dd1df680645a6812662aec16d3394', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:25.827956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f893494-fa93-4ad9-90fd-b99c45f76d6e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:25.828428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f893494-fa93-4ad9-90fd-b99c45f76d6e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:25.829001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f893494-fa93-4ad9-90fd-b99c45f76d6e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] PATH_INFO: `/v3/users/3570553b51014438bf6c17d7d0c2db8a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:25.830490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f893494-fa93-4ad9-90fd-b99c45f76d6e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3570553b51014438bf6c17d7d0c2db8a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:25.835337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f893494-fa93-4ad9-90fd-b99c45f76d6e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:25.900802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2a54a-f4e2-41aa-918b-870420bc621b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:25.901775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2a54a-f4e2-41aa-918b-870420bc621b service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:25.902329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2a54a-f4e2-41aa-918b-870420bc621b service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:25.902986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2a54a-f4e2-41aa-918b-870420bc621b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:25.905415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cad2a54a-f4e2-41aa-918b-870420bc621b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:26.014904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2a54a-f4e2-41aa-918b-870420bc621b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:26.015534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9f893494-fa93-4ad9-90fd-b99c45f76d6e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3570553b51014438bf6c17d7d0c2db8a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.019032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2a54a-f4e2-41aa-918b-870420bc621b service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:26.028326 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:26.042124 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2433/4930] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:34:25 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:34:26.057614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9f893494-fa93-4ad9-90fd-b99c45f76d6e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3570553b51014438bf6c17d7d0c2db8a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.071575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9f893494-fa93-4ad9-90fd-b99c45f76d6e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3570553b51014438bf6c17d7d0c2db8a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.072845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9f893494-fa93-4ad9-90fd-b99c45f76d6e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3570553b51014438bf6c17d7d0c2db8a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.121984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9f893494-fa93-4ad9-90fd-b99c45f76d6e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3570553b51014438bf6c17d7d0c2db8a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.133381 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2498/4931] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:25 2022] DELETE /identity/v3/users/3570553b51014438bf6c17d7d0c2db8a => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:26.138338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2a54a-f4e2-41aa-918b-870420bc621b service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:26.151797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f893494-fa93-4ad9-90fd-b99c45f76d6e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:26.155457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9f893494-fa93-4ad9-90fd-b99c45f76d6e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:26.159871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2a54a-f4e2-41aa-918b-870420bc621b service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:26.256342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f87887-3818-4ddc-a3b7-cbdee644ba5d tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8fa1cfabea450d921cb04d315db369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '654dd1df680645a6812662aec16d3394', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:26.257055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87887-3818-4ddc-a3b7-cbdee644ba5d tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:26.257347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87887-3818-4ddc-a3b7-cbdee644ba5d tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:26.257633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f87887-3818-4ddc-a3b7-cbdee644ba5d tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] PATH_INFO: `/v3/domains/0b2a861ffe4840c5b202f64c1292c3d7` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:26.259125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f87887-3818-4ddc-a3b7-cbdee644ba5d tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0b2a861ffe4840c5b202f64c1292c3d7)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:26.261066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f87887-3818-4ddc-a3b7-cbdee644ba5d tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:26.284639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-11f87887-3818-4ddc-a3b7-cbdee644ba5d tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0b2a861ffe4840c5b202f64c1292c3d7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.285494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-11f87887-3818-4ddc-a3b7-cbdee644ba5d tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0b2a861ffe4840c5b202f64c1292c3d7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.298872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f893494-fa93-4ad9-90fd-b99c45f76d6e tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:26.320375 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:26.358873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862e6ad-5b49-4d0a-a6b3-d8cee61daffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:26.360106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862e6ad-5b49-4d0a-a6b3-d8cee61daffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:26.360106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862e6ad-5b49-4d0a-a6b3-d8cee61daffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:26.360348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862e6ad-5b49-4d0a-a6b3-d8cee61daffa admin admin] PATH_INFO: `/v3/users/b44128631a744682949505541e25fe8c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:26.361496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862e6ad-5b49-4d0a-a6b3-d8cee61daffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=b44128631a744682949505541e25fe8c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:26.375988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862e6ad-5b49-4d0a-a6b3-d8cee61daffa admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:26.405401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-11f87887-3818-4ddc-a3b7-cbdee644ba5d tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0b2a861ffe4840c5b202f64c1292c3d7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.406974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-11f87887-3818-4ddc-a3b7-cbdee644ba5d tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0b2a861ffe4840c5b202f64c1292c3d7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.410550 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2434/4932] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:34:26 2022] PATCH /identity/v3/domains/0b2a861ffe4840c5b202f64c1292c3d7 => generated 277 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:34:26.417091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f87887-3818-4ddc-a3b7-cbdee644ba5d tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:26.418957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-11f87887-3818-4ddc-a3b7-cbdee644ba5d tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:26.508950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f87887-3818-4ddc-a3b7-cbdee644ba5d tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:26.516909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d16991-9126-4515-b046-509cef6e73b5 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd8fa1cfabea450d921cb04d315db369', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '654dd1df680645a6812662aec16d3394', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:26.518388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d16991-9126-4515-b046-509cef6e73b5 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:26.518935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d16991-9126-4515-b046-509cef6e73b5 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:26.519379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d16991-9126-4515-b046-509cef6e73b5 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] PATH_INFO: `/v3/domains/0b2a861ffe4840c5b202f64c1292c3d7` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:26.545255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d16991-9126-4515-b046-509cef6e73b5 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0b2a861ffe4840c5b202f64c1292c3d7)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:26.548162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d16991-9126-4515-b046-509cef6e73b5 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:26.593567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9862e6ad-5b49-4d0a-a6b3-d8cee61daffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b44128631a744682949505541e25fe8c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.622547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-77d16991-9126-4515-b046-509cef6e73b5 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0b2a861ffe4840c5b202f64c1292c3d7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.622868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9862e6ad-5b49-4d0a-a6b3-d8cee61daffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b44128631a744682949505541e25fe8c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.643597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9862e6ad-5b49-4d0a-a6b3-d8cee61daffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b44128631a744682949505541e25fe8c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.650129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-77d16991-9126-4515-b046-509cef6e73b5 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0b2a861ffe4840c5b202f64c1292c3d7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.650379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9862e6ad-5b49-4d0a-a6b3-d8cee61daffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b44128631a744682949505541e25fe8c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.765835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9862e6ad-5b49-4d0a-a6b3-d8cee61daffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b44128631a744682949505541e25fe8c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.775733 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2499/4933] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:26 2022] DELETE /identity/v3/users/b44128631a744682949505541e25fe8c => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:26.780515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6f813-4858-4062-bc07-cdbf1380a781 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:26.780661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6f813-4858-4062-bc07-cdbf1380a781 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:26.780857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6f813-4858-4062-bc07-cdbf1380a781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:26.821764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-80f6f813-4858-4062-bc07-cdbf1380a781 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:26.823706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-80f6f813-4858-4062-bc07-cdbf1380a781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:26.826876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-77d16991-9126-4515-b046-509cef6e73b5 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2a861ffe4840c5b202f64c1292c3d7', 'request_id': 'req-77d16991-9126-4515-b046-509cef6e73b5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.910494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-77d16991-9126-4515-b046-509cef6e73b5 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2a861ffe4840c5b202f64c1292c3d7', 'request_id': 'req-77d16991-9126-4515-b046-509cef6e73b5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.921417 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2500/4934] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:34:26.922039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-77d16991-9126-4515-b046-509cef6e73b5 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2a861ffe4840c5b202f64c1292c3d7', 'request_id': 'req-77d16991-9126-4515-b046-509cef6e73b5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.923068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22b77d-e1a5-4917-bdef-edfeee1cc520 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:26.923814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22b77d-e1a5-4917-bdef-edfeee1cc520 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:26.932304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae22b77d-e1a5-4917-bdef-edfeee1cc520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:26.944155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-77d16991-9126-4515-b046-509cef6e73b5 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] The token cache is being invalidate because project 0b2a861ffe4840c5b202f64c1292c3d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:26.944458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-77d16991-9126-4515-b046-509cef6e73b5 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.945139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-77d16991-9126-4515-b046-509cef6e73b5 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.956996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-77d16991-9126-4515-b046-509cef6e73b5 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0b2a861ffe4840c5b202f64c1292c3d7', 'request_id': 'req-77d16991-9126-4515-b046-509cef6e73b5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.961851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-77d16991-9126-4515-b046-509cef6e73b5 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0b2a861ffe4840c5b202f64c1292c3d7', 'request_id': 'req-77d16991-9126-4515-b046-509cef6e73b5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.962521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ae22b77d-e1a5-4917-bdef-edfeee1cc520 None None] MFA Rules not processed for user `013b13b6d741411a95806dce36c2bd20`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:26.962995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-77d16991-9126-4515-b046-509cef6e73b5 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0b2a861ffe4840c5b202f64c1292c3d7', 'request_id': 'req-77d16991-9126-4515-b046-509cef6e73b5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:26.963101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ae22b77d-e1a5-4917-bdef-edfeee1cc520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:26.972723 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2435/4935] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:34:26 2022] DELETE /identity/v3/domains/0b2a861ffe4840c5b202f64c1292c3d7 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:26.973816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d16991-9126-4515-b046-509cef6e73b5 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:26.977485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-77d16991-9126-4515-b046-509cef6e73b5 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:27.062496 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2501/4936] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:34:27.063840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22b77d-e1a5-4917-bdef-edfeee1cc520 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:27.064723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d16991-9126-4515-b046-509cef6e73b5 tempest-UsersV3TestJSON-634831712 tempest-UsersV3TestJSON-634831712-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:27.066261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ae22b77d-e1a5-4917-bdef-edfeee1cc520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:27.072635 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe4261b-9305-4127-8632-01080b3a7d6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:27.073443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4261b-9305-4127-8632-01080b3a7d6f service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:27.073808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4261b-9305-4127-8632-01080b3a7d6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:27.074190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe4261b-9305-4127-8632-01080b3a7d6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:27.076253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3fe4261b-9305-4127-8632-01080b3a7d6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:27.088020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae22b77d-e1a5-4917-bdef-edfeee1cc520 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:27.097331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2ef91-8e8e-4856-b9c8-3edeec8449ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:27.098763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4261b-9305-4127-8632-01080b3a7d6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:27.100165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2ef91-8e8e-4856-b9c8-3edeec8449ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:27.101879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2ef91-8e8e-4856-b9c8-3edeec8449ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:27.102428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2ef91-8e8e-4856-b9c8-3edeec8449ce admin admin] PATH_INFO: `/v3/users/1e4c8550741546a3bb16ffdb5f551759` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:27.103496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe4261b-9305-4127-8632-01080b3a7d6f service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:27.105194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2ef91-8e8e-4856-b9c8-3edeec8449ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e4c8550741546a3bb16ffdb5f551759)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:27.109285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2ef91-8e8e-4856-b9c8-3edeec8449ce admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:27.188468 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2436/4937] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:34:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:34:27.350158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bfd2ef91-8e8e-4856-b9c8-3edeec8449ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e4c8550741546a3bb16ffdb5f551759'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:27.382425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bfd2ef91-8e8e-4856-b9c8-3edeec8449ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e4c8550741546a3bb16ffdb5f551759'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:27.397013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bfd2ef91-8e8e-4856-b9c8-3edeec8449ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e4c8550741546a3bb16ffdb5f551759'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:27.401517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bfd2ef91-8e8e-4856-b9c8-3edeec8449ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e4c8550741546a3bb16ffdb5f551759'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:27.487073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bfd2ef91-8e8e-4856-b9c8-3edeec8449ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e4c8550741546a3bb16ffdb5f551759'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:27.497318 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2502/4938] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:27 2022] DELETE /identity/v3/users/1e4c8550741546a3bb16ffdb5f551759 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:27.502211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecc3fa-64a1-4bd0-8224-d05e25e1f1bd None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:27.502511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecc3fa-64a1-4bd0-8224-d05e25e1f1bd None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:27.502853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecc3fa-64a1-4bd0-8224-d05e25e1f1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:27.525956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1aecc3fa-64a1-4bd0-8224-d05e25e1f1bd None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:27.527256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1aecc3fa-64a1-4bd0-8224-d05e25e1f1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:27.615860 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2437/4939] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:34:27.627165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2ef91-8e8e-4856-b9c8-3edeec8449ce admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:27.629030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bfd2ef91-8e8e-4856-b9c8-3edeec8449ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:27.710230 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:27.726231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2ef91-8e8e-4856-b9c8-3edeec8449ce admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:27.730673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0059966-eba0-4bff-80e9-756c8fe9f2e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:27.732130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0059966-eba0-4bff-80e9-756c8fe9f2e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:27.732438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0059966-eba0-4bff-80e9-756c8fe9f2e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:27.732707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0059966-eba0-4bff-80e9-756c8fe9f2e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:27.754020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0059966-eba0-4bff-80e9-756c8fe9f2e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:27.756263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0059966-eba0-4bff-80e9-756c8fe9f2e8 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:27.785149 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2503/4940] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:34:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:34:27.938858 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:28.100723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecc3fa-64a1-4bd0-8224-d05e25e1f1bd None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:28.102986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1aecc3fa-64a1-4bd0-8224-d05e25e1f1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:28.123339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecc3fa-64a1-4bd0-8224-d05e25e1f1bd None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:28.128850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7d259f-b835-4d39-85bf-dd60cd682dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:28.129739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d259f-b835-4d39-85bf-dd60cd682dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:28.130053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d259f-b835-4d39-85bf-dd60cd682dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:28.130978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7d259f-b835-4d39-85bf-dd60cd682dc1 admin admin] PATH_INFO: `/v3/projects/c124224330cc4a52a2093dd2c166f4e7` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:28.134947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d259f-b835-4d39-85bf-dd60cd682dc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c124224330cc4a52a2093dd2c166f4e7)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:28.137164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7d259f-b835-4d39-85bf-dd60cd682dc1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:28.322690 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:28.360983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ac7d259f-b835-4d39-85bf-dd60cd682dc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c124224330cc4a52a2093dd2c166f4e7', 'request_id': 'req-ac7d259f-b835-4d39-85bf-dd60cd682dc1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:28.431215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0059966-eba0-4bff-80e9-756c8fe9f2e8 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:28.433344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d0059966-eba0-4bff-80e9-756c8fe9f2e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:28.457478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ac7d259f-b835-4d39-85bf-dd60cd682dc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c124224330cc4a52a2093dd2c166f4e7', 'request_id': 'req-ac7d259f-b835-4d39-85bf-dd60cd682dc1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:28.462958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0059966-eba0-4bff-80e9-756c8fe9f2e8 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:28.472428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ac7d259f-b835-4d39-85bf-dd60cd682dc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c124224330cc4a52a2093dd2c166f4e7', 'request_id': 'req-ac7d259f-b835-4d39-85bf-dd60cd682dc1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:28.503598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ac7d259f-b835-4d39-85bf-dd60cd682dc1 admin admin] The token cache is being invalidate because project c124224330cc4a52a2093dd2c166f4e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:28.504918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ac7d259f-b835-4d39-85bf-dd60cd682dc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:28.508271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ac7d259f-b835-4d39-85bf-dd60cd682dc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:28.518016 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2438/4941] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:34:28 2022] DELETE /identity/v3/projects/c124224330cc4a52a2093dd2c166f4e7 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:28.520332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6664a-ab50-4f62-bf24-c17fca2247a2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:28.521108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6664a-ab50-4f62-bf24-c17fca2247a2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:28.522010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b6664a-ab50-4f62-bf24-c17fca2247a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:28.560941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b05ca0-bbaf-475a-9a20-59eb6695a04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:28.560941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b05ca0-bbaf-475a-9a20-59eb6695a04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:28.560941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b05ca0-bbaf-475a-9a20-59eb6695a04e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:28.560941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b05ca0-bbaf-475a-9a20-59eb6695a04e admin admin] PATH_INFO: `/v3/projects/208ce7f261a04fdeb686b4a00eae5e51` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:28.561396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b05ca0-bbaf-475a-9a20-59eb6695a04e admin admin] RBAC: Authorizing `identity:delete_project(project_id=208ce7f261a04fdeb686b4a00eae5e51)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:28.561396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b05ca0-bbaf-475a-9a20-59eb6695a04e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:28.565839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-65b6664a-ab50-4f62-bf24-c17fca2247a2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:28.573491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-65b6664a-ab50-4f62-bf24-c17fca2247a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:28.596134 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2439/4942] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:34:28.610326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9a8ec-5d56-48b5-87b0-d52e78e1a8c9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:28.610326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9a8ec-5d56-48b5-87b0-d52e78e1a8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:28.610326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9a8ec-5d56-48b5-87b0-d52e78e1a8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:28.665092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c2b9a8ec-5d56-48b5-87b0-d52e78e1a8c9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:28.671412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c2b9a8ec-5d56-48b5-87b0-d52e78e1a8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:28.689895 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2440/4943] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:34:28.694966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9a8ec-5d56-48b5-87b0-d52e78e1a8c9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:28.714301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9a8ec-5d56-48b5-87b0-d52e78e1a8c9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:28.732251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba07c8b-5747-4026-b98f-302857fea3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:28.733094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba07c8b-5747-4026-b98f-302857fea3ca admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:28.733487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba07c8b-5747-4026-b98f-302857fea3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:28.733859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba07c8b-5747-4026-b98f-302857fea3ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:28.734738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba07c8b-5747-4026-b98f-302857fea3ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:34:28.735144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba07c8b-5747-4026-b98f-302857fea3ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:28.737140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba07c8b-5747-4026-b98f-302857fea3ca admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:28.783404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a0b05ca0-bbaf-475a-9a20-59eb6695a04e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '208ce7f261a04fdeb686b4a00eae5e51', 'request_id': 'req-a0b05ca0-bbaf-475a-9a20-59eb6695a04e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:28.796449 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2441/4944] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:34:28.800463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba07c8b-5747-4026-b98f-302857fea3ca admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:28.817145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba07c8b-5747-4026-b98f-302857fea3ca admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:28.826460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a0b05ca0-bbaf-475a-9a20-59eb6695a04e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '208ce7f261a04fdeb686b4a00eae5e51', 'request_id': 'req-a0b05ca0-bbaf-475a-9a20-59eb6695a04e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:28.862945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a0b05ca0-bbaf-475a-9a20-59eb6695a04e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '208ce7f261a04fdeb686b4a00eae5e51', 'request_id': 'req-a0b05ca0-bbaf-475a-9a20-59eb6695a04e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:28.925757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc1c7f-1be4-4295-9375-04dc6ebe4725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:28.926480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc1c7f-1be4-4295-9375-04dc6ebe4725 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:28.926960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc1c7f-1be4-4295-9375-04dc6ebe4725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:28.927935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc1c7f-1be4-4295-9375-04dc6ebe4725 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:28.929554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc1c7f-1be4-4295-9375-04dc6ebe4725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:28.931723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc1c7f-1be4-4295-9375-04dc6ebe4725 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:28.952855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a0b05ca0-bbaf-475a-9a20-59eb6695a04e admin admin] The token cache is being invalidate because project 208ce7f261a04fdeb686b4a00eae5e51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:28.953346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a0b05ca0-bbaf-475a-9a20-59eb6695a04e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:28.954677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a0b05ca0-bbaf-475a-9a20-59eb6695a04e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:28.957029 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2504/4945] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:34:28 2022] DELETE /identity/v3/projects/208ce7f261a04fdeb686b4a00eae5e51 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:28.970588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b05ca0-bbaf-475a-9a20-59eb6695a04e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:28.973606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a0b05ca0-bbaf-475a-9a20-59eb6695a04e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:29.009937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b05ca0-bbaf-475a-9a20-59eb6695a04e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:29.018829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc118e-e2a7-43ce-95d2-cfbb570ab01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:29.049680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc118e-e2a7-43ce-95d2-cfbb570ab01c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:29.049878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc118e-e2a7-43ce-95d2-cfbb570ab01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:29.064639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc118e-e2a7-43ce-95d2-cfbb570ab01c admin admin] PATH_INFO: `/v3/users/dd8fa1cfabea450d921cb04d315db369` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:29.069568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc118e-e2a7-43ce-95d2-cfbb570ab01c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd8fa1cfabea450d921cb04d315db369)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:29.073921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc118e-e2a7-43ce-95d2-cfbb570ab01c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:29.077588 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2442/4946] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:34:28 2022] POST /identity/v3/projects => generated 391 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:34:29.081748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc1c7f-1be4-4295-9375-04dc6ebe4725 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:29.089652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2edc1c7f-1be4-4295-9375-04dc6ebe4725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:29.232154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc1c7f-1be4-4295-9375-04dc6ebe4725 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:29.246754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1cbfd-62a4-4751-b5ba-219283392d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:29.247496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1cbfd-62a4-4751-b5ba-219283392d38 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:29.247865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1cbfd-62a4-4751-b5ba-219283392d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:29.248796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1cbfd-62a4-4751-b5ba-219283392d38 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:29.249515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1cbfd-62a4-4751-b5ba-219283392d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:29.251589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a1cbfd-62a4-4751-b5ba-219283392d38 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:29.347428 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2443/4947] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:34:29 2022] POST /identity/v3/users => generated 296 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:29.348046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1cbfd-62a4-4751-b5ba-219283392d38 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:29.353203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-37dc118e-e2a7-43ce-95d2-cfbb570ab01c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd8fa1cfabea450d921cb04d315db369'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:29.370945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1cbfd-62a4-4751-b5ba-219283392d38 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:29.378456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-37dc118e-e2a7-43ce-95d2-cfbb570ab01c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd8fa1cfabea450d921cb04d315db369'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:29.384819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a522624-3614-4244-b698-27fa0d0561ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:29.385931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a522624-3614-4244-b698-27fa0d0561ff admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:29.386306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a522624-3614-4244-b698-27fa0d0561ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:29.389224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a522624-3614-4244-b698-27fa0d0561ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:29.389224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a522624-3614-4244-b698-27fa0d0561ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:29.391781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a522624-3614-4244-b698-27fa0d0561ff admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:29.395353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-37dc118e-e2a7-43ce-95d2-cfbb570ab01c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd8fa1cfabea450d921cb04d315db369'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:29.397449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-37dc118e-e2a7-43ce-95d2-cfbb570ab01c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd8fa1cfabea450d921cb04d315db369'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:29.410296 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2444/4948] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:34:29.414465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a522624-3614-4244-b698-27fa0d0561ff admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:29.426428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a522624-3614-4244-b698-27fa0d0561ff admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:29.436328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee047c-9a99-4715-9809-b6698f4bd3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:29.437473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee047c-9a99-4715-9809-b6698f4bd3dc admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:29.439466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee047c-9a99-4715-9809-b6698f4bd3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:29.439870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee047c-9a99-4715-9809-b6698f4bd3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:29.441667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee047c-9a99-4715-9809-b6698f4bd3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:29.444078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee047c-9a99-4715-9809-b6698f4bd3dc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:29.467434 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2445/4949] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:34:29.471141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee047c-9a99-4715-9809-b6698f4bd3dc admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:29.500750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee047c-9a99-4715-9809-b6698f4bd3dc admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:29.520237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-37dc118e-e2a7-43ce-95d2-cfbb570ab01c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd8fa1cfabea450d921cb04d315db369'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:29.521671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950c488-fa8f-4406-b5f3-e950c4ff1d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:29.529296 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2505/4950] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:28 2022] DELETE /identity/v3/users/dd8fa1cfabea450d921cb04d315db369 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:29.531728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950c488-fa8f-4406-b5f3-e950c4ff1d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:29.532038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950c488-fa8f-4406-b5f3-e950c4ff1d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:29.532327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950c488-fa8f-4406-b5f3-e950c4ff1d91 admin admin] PATH_INFO: `/v3/projects/8c3588deddaf4b45ace6cb1e979e2ff8/users/df13382c8aa448d0a6d967296d88c33b/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:29.580471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950c488-fa8f-4406-b5f3-e950c4ff1d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3588deddaf4b45ace6cb1e979e2ff8, user_id=df13382c8aa448d0a6d967296d88c33b, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:29.584194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950c488-fa8f-4406-b5f3-e950c4ff1d91 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:29.715603 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2446/4951] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:34:29 2022] PUT /identity/v3/projects/8c3588deddaf4b45ace6cb1e979e2ff8/users/df13382c8aa448d0a6d967296d88c33b/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:29.727460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32749c10-9fd1-48fc-a8a7-5d61e06acd7e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:29.728177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32749c10-9fd1-48fc-a8a7-5d61e06acd7e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:29.728650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32749c10-9fd1-48fc-a8a7-5d61e06acd7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:29.775109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-32749c10-9fd1-48fc-a8a7-5d61e06acd7e None None] MFA Rules not processed for user `df13382c8aa448d0a6d967296d88c33b`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:29.776864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-32749c10-9fd1-48fc-a8a7-5d61e06acd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:29.882001 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2506/4952] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:34:29.902206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950c488-fa8f-4406-b5f3-e950c4ff1d91 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:29.903501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e950c488-fa8f-4406-b5f3-e950c4ff1d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:29.977555 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:30.044318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950c488-fa8f-4406-b5f3-e950c4ff1d91 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:30.057087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea01527-8cb8-4b53-b097-7564786fb7be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:30.058057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea01527-8cb8-4b53-b097-7564786fb7be service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:30.058595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea01527-8cb8-4b53-b097-7564786fb7be service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:30.059007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea01527-8cb8-4b53-b097-7564786fb7be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:30.069942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea01527-8cb8-4b53-b097-7564786fb7be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:30.072987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea01527-8cb8-4b53-b097-7564786fb7be service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:30.085013 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2447/4953] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:34:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:34:30.262551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32749c10-9fd1-48fc-a8a7-5d61e06acd7e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:30.264473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-32749c10-9fd1-48fc-a8a7-5d61e06acd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:30.408645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32749c10-9fd1-48fc-a8a7-5d61e06acd7e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:30.414458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bdc32-a1e2-42eb-8106-1752c49effc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:30.415489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bdc32-a1e2-42eb-8106-1752c49effc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:30.415884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bdc32-a1e2-42eb-8106-1752c49effc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:30.416291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bdc32-a1e2-42eb-8106-1752c49effc5 admin admin] PATH_INFO: `/v3/projects/654dd1df680645a6812662aec16d3394` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:30.418335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bdc32-a1e2-42eb-8106-1752c49effc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=654dd1df680645a6812662aec16d3394)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:30.420453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bdc32-a1e2-42eb-8106-1752c49effc5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:30.597421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd1bdc32-a1e2-42eb-8106-1752c49effc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '654dd1df680645a6812662aec16d3394', 'request_id': 'req-dd1bdc32-a1e2-42eb-8106-1752c49effc5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:30.616415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd1bdc32-a1e2-42eb-8106-1752c49effc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '654dd1df680645a6812662aec16d3394', 'request_id': 'req-dd1bdc32-a1e2-42eb-8106-1752c49effc5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:30.627922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd1bdc32-a1e2-42eb-8106-1752c49effc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '654dd1df680645a6812662aec16d3394', 'request_id': 'req-dd1bdc32-a1e2-42eb-8106-1752c49effc5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:30.749742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd1bdc32-a1e2-42eb-8106-1752c49effc5 admin admin] The token cache is being invalidate because project 654dd1df680645a6812662aec16d3394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:30.750380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd1bdc32-a1e2-42eb-8106-1752c49effc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:30.751226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd1bdc32-a1e2-42eb-8106-1752c49effc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:30.753611 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2507/4954] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:34:30 2022] DELETE /identity/v3/projects/654dd1df680645a6812662aec16d3394 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:30.759208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b262dd-975a-430c-909d-134ff6d310b6 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:30.759667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b262dd-975a-430c-909d-134ff6d310b6 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:30.759667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b262dd-975a-430c-909d-134ff6d310b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:30.791683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-24b262dd-975a-430c-909d-134ff6d310b6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:30.793148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-24b262dd-975a-430c-909d-134ff6d310b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:30.924430 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2448/4955] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:34:30.926082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bed32-3a9a-492e-91ba-158049f67d32 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:30.926403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bed32-3a9a-492e-91ba-158049f67d32 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:30.926691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5bed32-3a9a-492e-91ba-158049f67d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:30.966768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8f5bed32-3a9a-492e-91ba-158049f67d32 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:30.968036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8f5bed32-3a9a-492e-91ba-158049f67d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:30.972144 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:30.991369 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2508/4956] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:34:30.995636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b262dd-975a-430c-909d-134ff6d310b6 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:31.011246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b262dd-975a-430c-909d-134ff6d310b6 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:31.022745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963d036-549c-4923-87ae-e2db0c04f7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:31.023449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963d036-549c-4923-87ae-e2db0c04f7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:31.023743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963d036-549c-4923-87ae-e2db0c04f7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:31.024029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c963d036-549c-4923-87ae-e2db0c04f7d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:31.024780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963d036-549c-4923-87ae-e2db0c04f7d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:34:31.025089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963d036-549c-4923-87ae-e2db0c04f7d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:31.027567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c963d036-549c-4923-87ae-e2db0c04f7d9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:31.057089 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2449/4957] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:34:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:34:31.061144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bed32-3a9a-492e-91ba-158049f67d32 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:31.073560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5bed32-3a9a-492e-91ba-158049f67d32 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:31.090688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f98eb-8f1b-48b5-9fc1-4fc841c5e4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:31.091387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f98eb-8f1b-48b5-9fc1-4fc841c5e4e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:31.091674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f98eb-8f1b-48b5-9fc1-4fc841c5e4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:31.091957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f98eb-8f1b-48b5-9fc1-4fc841c5e4e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:31.092671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f98eb-8f1b-48b5-9fc1-4fc841c5e4e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:31.094641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f98eb-8f1b-48b5-9fc1-4fc841c5e4e9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:31.277743 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2509/4958] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:34:31 2022] POST /identity/v3/projects => generated 367 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:31.282257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963d036-549c-4923-87ae-e2db0c04f7d9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:31.299324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c963d036-549c-4923-87ae-e2db0c04f7d9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:31.443688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078366b9-ed31-4a45-a12c-a969571849b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:31.443688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078366b9-ed31-4a45-a12c-a969571849b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:31.444062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078366b9-ed31-4a45-a12c-a969571849b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:31.444322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078366b9-ed31-4a45-a12c-a969571849b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:31.445017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078366b9-ed31-4a45-a12c-a969571849b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:31.447226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078366b9-ed31-4a45-a12c-a969571849b9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:31.681107 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2450/4959] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:34:31 2022] POST /identity/v3/users => generated 284 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:31.682684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f98eb-8f1b-48b5-9fc1-4fc841c5e4e9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:31.694171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f98eb-8f1b-48b5-9fc1-4fc841c5e4e9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:31.699420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c0198-dbef-43c0-99f8-bf8c965f83a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:31.700177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c0198-dbef-43c0-99f8-bf8c965f83a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:31.700537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c0198-dbef-43c0-99f8-bf8c965f83a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:31.701049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c0198-dbef-43c0-99f8-bf8c965f83a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:31.701974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c0198-dbef-43c0-99f8-bf8c965f83a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:31.704157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749c0198-dbef-43c0-99f8-bf8c965f83a1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:31.720357 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2510/4960] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:34:31.722640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078366b9-ed31-4a45-a12c-a969571849b9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:31.769634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078366b9-ed31-4a45-a12c-a969571849b9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:31.791888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0992588-c104-4e5b-8a44-07763f217b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:31.792864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0992588-c104-4e5b-8a44-07763f217b74 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:31.795008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0992588-c104-4e5b-8a44-07763f217b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:31.795636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0992588-c104-4e5b-8a44-07763f217b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:31.798168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0992588-c104-4e5b-8a44-07763f217b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:31.808934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0992588-c104-4e5b-8a44-07763f217b74 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:31.857318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c0198-dbef-43c0-99f8-bf8c965f83a1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:31.875117 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2451/4961] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:34:31 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:34:31.882277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749c0198-dbef-43c0-99f8-bf8c965f83a1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:31.898150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37011674-f083-4863-a5f1-25395d63c374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:31.898150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37011674-f083-4863-a5f1-25395d63c374 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:31.898150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37011674-f083-4863-a5f1-25395d63c374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:31.898150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37011674-f083-4863-a5f1-25395d63c374 admin admin] PATH_INFO: `/v3/projects/f0ea1dcbb5a6410b81d4190a1a86a501/users/5b8ba5a7a00d4a1d9d22ad08fe61980a/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:31.928669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37011674-f083-4863-a5f1-25395d63c374 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0ea1dcbb5a6410b81d4190a1a86a501, user_id=5b8ba5a7a00d4a1d9d22ad08fe61980a, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:31.932445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37011674-f083-4863-a5f1-25395d63c374 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:32.050426 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2511/4962] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:34:31 2022] PUT /identity/v3/projects/f0ea1dcbb5a6410b81d4190a1a86a501/users/5b8ba5a7a00d4a1d9d22ad08fe61980a/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:32.054085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85ee78-05c5-4698-a9be-5a9a58bb75f5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:32.054635 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85ee78-05c5-4698-a9be-5a9a58bb75f5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:32.055090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b85ee78-05c5-4698-a9be-5a9a58bb75f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:32.096615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2b85ee78-05c5-4698-a9be-5a9a58bb75f5 None None] MFA Rules not processed for user `5b8ba5a7a00d4a1d9d22ad08fe61980a`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:32.098113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2b85ee78-05c5-4698-a9be-5a9a58bb75f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:32.114982 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:32.195763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37011674-f083-4863-a5f1-25395d63c374 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:32.200567 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2452/4963] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:34:32.350185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37011674-f083-4863-a5f1-25395d63c374 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:32.355835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436436e9-4e32-4925-b891-56f652e5c5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:32.356837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436436e9-4e32-4925-b891-56f652e5c5b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:32.357959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436436e9-4e32-4925-b891-56f652e5c5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:32.358521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436436e9-4e32-4925-b891-56f652e5c5b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:32.359443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436436e9-4e32-4925-b891-56f652e5c5b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:32.361992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436436e9-4e32-4925-b891-56f652e5c5b5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:32.500324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85ee78-05c5-4698-a9be-5a9a58bb75f5 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:32.509456 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2512/4964] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:34:32 2022] POST /identity/v3/projects => generated 367 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:32.519994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b85ee78-05c5-4698-a9be-5a9a58bb75f5 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:32.622465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51eed92-c13e-42b5-bc58-1e74d9337cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:32.623520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eed92-c13e-42b5-bc58-1e74d9337cd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:32.623741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eed92-c13e-42b5-bc58-1e74d9337cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:32.624114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51eed92-c13e-42b5-bc58-1e74d9337cd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:32.626783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51eed92-c13e-42b5-bc58-1e74d9337cd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:32.629903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51eed92-c13e-42b5-bc58-1e74d9337cd2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:32.767855 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2453/4965] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:34:32 2022] POST /identity/v3/users => generated 290 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:34:32.774383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436436e9-4e32-4925-b891-56f652e5c5b5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:32.791916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436436e9-4e32-4925-b891-56f652e5c5b5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:32.799297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88da07d-adf8-407e-8bd6-aab5be9627e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:32.800149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88da07d-adf8-407e-8bd6-aab5be9627e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:32.801275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88da07d-adf8-407e-8bd6-aab5be9627e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:32.801665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88da07d-adf8-407e-8bd6-aab5be9627e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:32.802603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88da07d-adf8-407e-8bd6-aab5be9627e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:32.806215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88da07d-adf8-407e-8bd6-aab5be9627e6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:32.823222 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2513/4966] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:34:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:34:32.827771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51eed92-c13e-42b5-bc58-1e74d9337cd2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:32.840675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51eed92-c13e-42b5-bc58-1e74d9337cd2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:32.847054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0c305-464e-4f30-a33d-48bb45395655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:32.848461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0c305-464e-4f30-a33d-48bb45395655 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:32.848947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0c305-464e-4f30-a33d-48bb45395655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:32.850252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0c305-464e-4f30-a33d-48bb45395655 admin admin] PATH_INFO: `/v3/projects/fc6b942fc94d4e34a92b4f8f093fd6ca/users/9172ab1ac8db4fbdb8f84f9cea0c9678/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:32.868639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0c305-464e-4f30-a33d-48bb45395655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6b942fc94d4e34a92b4f8f093fd6ca, user_id=9172ab1ac8db4fbdb8f84f9cea0c9678, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:32.872085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0c305-464e-4f30-a33d-48bb45395655 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:32.927610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88da07d-adf8-407e-8bd6-aab5be9627e6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:32.929914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d88da07d-adf8-407e-8bd6-aab5be9627e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:33.038381 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2454/4967] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:34:32 2022] PUT /identity/v3/projects/fc6b942fc94d4e34a92b4f8f093fd6ca/users/9172ab1ac8db4fbdb8f84f9cea0c9678/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:33.059862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0c305-464e-4f30-a33d-48bb45395655 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:33.104513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88da07d-adf8-407e-8bd6-aab5be9627e6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:33.295227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0c305-464e-4f30-a33d-48bb45395655 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:33.298136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392039d-60a8-470f-9fe4-a9d2b3840b52 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:33.298809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392039d-60a8-470f-9fe4-a9d2b3840b52 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:33.299093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392039d-60a8-470f-9fe4-a9d2b3840b52 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:33.299373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392039d-60a8-470f-9fe4-a9d2b3840b52 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:33.303635 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92016ef5-b28f-46bd-9d72-2406455cbb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:33.305186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92016ef5-b28f-46bd-9d72-2406455cbb87 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:33.305721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92016ef5-b28f-46bd-9d72-2406455cbb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:33.306274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92016ef5-b28f-46bd-9d72-2406455cbb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:33.307129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e392039d-60a8-470f-9fe4-a9d2b3840b52 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:33.308093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92016ef5-b28f-46bd-9d72-2406455cbb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:33.310362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92016ef5-b28f-46bd-9d72-2406455cbb87 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:33.330181 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2455/4968] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:34:33 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:34:33.331387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92016ef5-b28f-46bd-9d72-2406455cbb87 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:33.350189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392039d-60a8-470f-9fe4-a9d2b3840b52 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:33.361463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392039d-60a8-470f-9fe4-a9d2b3840b52 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:33.374867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92016ef5-b28f-46bd-9d72-2406455cbb87 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:33.390618 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2514/4969] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:34:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:34:33.398592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7aea6-0063-4fa7-9b85-7a2c194a5f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:33.400054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7aea6-0063-4fa7-9b85-7a2c194a5f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:33.400746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7aea6-0063-4fa7-9b85-7a2c194a5f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:33.401236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d7aea6-0063-4fa7-9b85-7a2c194a5f7c admin admin] PATH_INFO: `/v3/projects/fc6b942fc94d4e34a92b4f8f093fd6ca/users/9172ab1ac8db4fbdb8f84f9cea0c9678/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:33.405489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7aea6-0063-4fa7-9b85-7a2c194a5f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6b942fc94d4e34a92b4f8f093fd6ca, user_id=9172ab1ac8db4fbdb8f84f9cea0c9678, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:33.414436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d7aea6-0063-4fa7-9b85-7a2c194a5f7c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:33.459012 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2456/4970] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:34:33 2022] PUT /identity/v3/projects/fc6b942fc94d4e34a92b4f8f093fd6ca/users/9172ab1ac8db4fbdb8f84f9cea0c9678/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:33.460436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1656791-11e6-4491-8559-806348cc541e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:33.460738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1656791-11e6-4491-8559-806348cc541e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:33.461023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1656791-11e6-4491-8559-806348cc541e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:33.555130 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:33.584878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d1656791-11e6-4491-8559-806348cc541e None None] MFA Rules not processed for user `9172ab1ac8db4fbdb8f84f9cea0c9678`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:33.597414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d1656791-11e6-4491-8559-806348cc541e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:33.673055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7aea6-0063-4fa7-9b85-7a2c194a5f7c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:33.676471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-38d7aea6-0063-4fa7-9b85-7a2c194a5f7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:33.780219 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2515/4971] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:33 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:34:33.784787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1656791-11e6-4491-8559-806348cc541e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:33.805409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1656791-11e6-4491-8559-806348cc541e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:33.820372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabef2c9-dfd2-4110-9a49-e7f5cc1572d4 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:33.821072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabef2c9-dfd2-4110-9a49-e7f5cc1572d4 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:33.821365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabef2c9-dfd2-4110-9a49-e7f5cc1572d4 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:33.821649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabef2c9-dfd2-4110-9a49-e7f5cc1572d4 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:33.822438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabef2c9-dfd2-4110-9a49-e7f5cc1572d4 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:33.825980 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-dabef2c9-dfd2-4110-9a49-e7f5cc1572d4 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:33.825980 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:34:33.825980 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:34:33.830244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabef2c9-dfd2-4110-9a49-e7f5cc1572d4 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:33.898328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d7aea6-0063-4fa7-9b85-7a2c194a5f7c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:33.905123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9ffb6-b68c-44ac-82f1-a118039139d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:33.905848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9ffb6-b68c-44ac-82f1-a118039139d5 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:33.906453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9ffb6-b68c-44ac-82f1-a118039139d5 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:33.906453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9ffb6-b68c-44ac-82f1-a118039139d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:33.914430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-38a9ffb6-b68c-44ac-82f1-a118039139d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:33.936517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9ffb6-b68c-44ac-82f1-a118039139d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:33.938132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9ffb6-b68c-44ac-82f1-a118039139d5 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:33.950515 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2457/4972] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:34:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:34:33.967310 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2516/4973] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:34:33 2022] POST /identity/v3/roles => generated 234 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:33.968333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9ffb6-b68c-44ac-82f1-a118039139d5 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:33.987559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9ffb6-b68c-44ac-82f1-a118039139d5 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:33.994480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e94059-f77b-4228-a2d8-457c061bf194 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:33.995760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e94059-f77b-4228-a2d8-457c061bf194 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:33.996373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e94059-f77b-4228-a2d8-457c061bf194 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:33.996859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e94059-f77b-4228-a2d8-457c061bf194 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:33.997626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e94059-f77b-4228-a2d8-457c061bf194 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:33.998754 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-31e94059-f77b-4228-a2d8-457c061bf194 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:33.998754 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:34:33.998754 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:34:34.002244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e94059-f77b-4228-a2d8-457c061bf194 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:34.139328 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2458/4974] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:34:33 2022] POST /identity/v3/roles => generated 233 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:34:34.143610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabef2c9-dfd2-4110-9a49-e7f5cc1572d4 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:34.155378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabef2c9-dfd2-4110-9a49-e7f5cc1572d4 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:34.172933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568d1e9-3294-4dc0-804b-a3591070aff3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:34.172933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568d1e9-3294-4dc0-804b-a3591070aff3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:34.172933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568d1e9-3294-4dc0-804b-a3591070aff3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:34.173391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568d1e9-3294-4dc0-804b-a3591070aff3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:34.173391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568d1e9-3294-4dc0-804b-a3591070aff3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:34.173391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568d1e9-3294-4dc0-804b-a3591070aff3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:34.251121 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2517/4975] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:34:34 2022] POST /identity/v3/roles => generated 235 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:34.254226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e94059-f77b-4228-a2d8-457c061bf194 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:34.268548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e94059-f77b-4228-a2d8-457c061bf194 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:34.288059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349efb43-8739-4c29-a717-5d98378e36ec tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:34.288316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349efb43-8739-4c29-a717-5d98378e36ec tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:34.288771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349efb43-8739-4c29-a717-5d98378e36ec tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:34.289210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349efb43-8739-4c29-a717-5d98378e36ec tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:34.290584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349efb43-8739-4c29-a717-5d98378e36ec tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:34.293057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349efb43-8739-4c29-a717-5d98378e36ec tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:34.400976 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2459/4976] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:34:34 2022] POST /identity/v3/domains => generated 275 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:34:34.407529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568d1e9-3294-4dc0-804b-a3591070aff3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:34.424497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568d1e9-3294-4dc0-804b-a3591070aff3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:34.476224 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:34.567356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee53bb-538b-4afc-b9ed-6fdfd6a6a414 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:34.569044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee53bb-538b-4afc-b9ed-6fdfd6a6a414 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:34.569368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee53bb-538b-4afc-b9ed-6fdfd6a6a414 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:34.569908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee53bb-538b-4afc-b9ed-6fdfd6a6a414 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:34.570940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee53bb-538b-4afc-b9ed-6fdfd6a6a414 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:34.573363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee53bb-538b-4afc-b9ed-6fdfd6a6a414 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:34.735989 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2518/4977] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:34:34 2022] POST /identity/v3/projects => generated 399 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:34.741094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349efb43-8739-4c29-a717-5d98378e36ec tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:34.753676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349efb43-8739-4c29-a717-5d98378e36ec tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:34.859635 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3eaf5-07ca-48f9-a7e0-d98491bb44b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:34.861841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3eaf5-07ca-48f9-a7e0-d98491bb44b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:34.862362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3eaf5-07ca-48f9-a7e0-d98491bb44b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:34.869214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a3eaf5-07ca-48f9-a7e0-d98491bb44b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/groups` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:34.870632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3eaf5-07ca-48f9-a7e0-d98491bb44b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:34.873471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a3eaf5-07ca-48f9-a7e0-d98491bb44b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:35.015274 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2460/4978] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jul 19 14:34:34 2022] POST /identity/v3/groups => generated 300 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:35.019502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee53bb-538b-4afc-b9ed-6fdfd6a6a414 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:35.043511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee53bb-538b-4afc-b9ed-6fdfd6a6a414 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:35.049304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6da9ab-8a05-4925-b536-1a578f1d466b tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:35.050536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6da9ab-8a05-4925-b536-1a578f1d466b tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:35.051041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6da9ab-8a05-4925-b536-1a578f1d466b tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:35.051518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6da9ab-8a05-4925-b536-1a578f1d466b tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:35.053149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6da9ab-8a05-4925-b536-1a578f1d466b tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:35.055876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6da9ab-8a05-4925-b536-1a578f1d466b tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:35.144726 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:35.215947 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2519/4979] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:34:35 2022] POST /identity/v3/roles => generated 234 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:35.220033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3eaf5-07ca-48f9-a7e0-d98491bb44b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:35.234402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a3eaf5-07ca-48f9-a7e0-d98491bb44b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:35.239702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82419cbc-085a-4301-bad0-ea100ad8d6c8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:35.240602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82419cbc-085a-4301-bad0-ea100ad8d6c8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:35.240958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82419cbc-085a-4301-bad0-ea100ad8d6c8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:35.241294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82419cbc-085a-4301-bad0-ea100ad8d6c8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:35.242143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82419cbc-085a-4301-bad0-ea100ad8d6c8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:35.246083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82419cbc-085a-4301-bad0-ea100ad8d6c8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:35.438954 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2461/4980] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:34:35 2022] POST /identity/v3/users => generated 439 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:35.440317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6da9ab-8a05-4925-b536-1a578f1d466b tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:35.453896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6da9ab-8a05-4925-b536-1a578f1d466b tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:35.460815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd489c-418b-43d1-9bb8-432319df2d60 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:35.461583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd489c-418b-43d1-9bb8-432319df2d60 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:35.461877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd489c-418b-43d1-9bb8-432319df2d60 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:35.462194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd489c-418b-43d1-9bb8-432319df2d60 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:35.462966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd489c-418b-43d1-9bb8-432319df2d60 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:35.464007 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-63bd489c-418b-43d1-9bb8-432319df2d60 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:35.464007 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:34:35.464007 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:34:35.464912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bd489c-418b-43d1-9bb8-432319df2d60 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:35.538183 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2520/4981] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:34:35 2022] POST /identity/v3/roles => generated 270 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:35.539586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82419cbc-085a-4301-bad0-ea100ad8d6c8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:35.555224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82419cbc-085a-4301-bad0-ea100ad8d6c8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:35.562408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964ecd1-8ed3-448c-a4b9-c5467bdcf438 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:35.563511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964ecd1-8ed3-448c-a4b9-c5467bdcf438 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:35.563614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964ecd1-8ed3-448c-a4b9-c5467bdcf438 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:35.563869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964ecd1-8ed3-448c-a4b9-c5467bdcf438 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/users/f8a3857e478e43b892349a205ee22fe2/roles/aceec88614b04e10bce2ed2b7d7305a0` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:35.596759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964ecd1-8ed3-448c-a4b9-c5467bdcf438 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fd3fc98505d64511a4a55f1ce9bc0c3f, user_id=f8a3857e478e43b892349a205ee22fe2, role_id=aceec88614b04e10bce2ed2b7d7305a0)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:35.600997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964ecd1-8ed3-448c-a4b9-c5467bdcf438 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:35.695269 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2462/4982] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:34:35 2022] PUT /identity/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/users/f8a3857e478e43b892349a205ee22fe2/roles/aceec88614b04e10bce2ed2b7d7305a0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:35.701357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd489c-418b-43d1-9bb8-432319df2d60 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:35.721608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd489c-418b-43d1-9bb8-432319df2d60 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:35.802920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcddcea2-0a32-48bb-8b40-3763a301866a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:35.803602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddcea2-0a32-48bb-8b40-3763a301866a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:35.803915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddcea2-0a32-48bb-8b40-3763a301866a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:35.804318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcddcea2-0a32-48bb-8b40-3763a301866a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:35.805169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcddcea2-0a32-48bb-8b40-3763a301866a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Adding query filter params (scope.project.id=fd3fc98505d64511a4a55f1ce9bc0c3f, user.id=f8a3857e478e43b892349a205ee22fe2) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:34:35.805483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcddcea2-0a32-48bb-8b40-3763a301866a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:35.806541 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-dcddcea2-0a32-48bb-8b40-3763a301866a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:35.806541 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:34:35.806541 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:34:35.807845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcddcea2-0a32-48bb-8b40-3763a301866a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:36.086954 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2521/4983] 10.222.0.43 () {58 vars in 1355 bytes} [Tue Jul 19 14:34:35 2022] GET /identity/v3/role_assignments?scope.project.id=fd3fc98505d64511a4a55f1ce9bc0c3f&user.id=f8a3857e478e43b892349a205ee22fe2&effective => generated 228 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:34:36.087650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964ecd1-8ed3-448c-a4b9-c5467bdcf438 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:36.109247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964ecd1-8ed3-448c-a4b9-c5467bdcf438 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:36.125154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63616d-f0d2-42e3-9c89-dd625acda395 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:36.131410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63616d-f0d2-42e3-9c89-dd625acda395 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:36.134922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63616d-f0d2-42e3-9c89-dd625acda395 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:36.135586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d63616d-f0d2-42e3-9c89-dd625acda395 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/users/f8a3857e478e43b892349a205ee22fe2/roles/aceec88614b04e10bce2ed2b7d7305a0` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:36.142907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63616d-f0d2-42e3-9c89-dd625acda395 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=fd3fc98505d64511a4a55f1ce9bc0c3f, user_id=f8a3857e478e43b892349a205ee22fe2, role_id=aceec88614b04e10bce2ed2b7d7305a0)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:36.149434 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-8d63616d-f0d2-42e3-9c89-dd625acda395 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:36.149434 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:34:36.149434 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:34:36.161095 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d63616d-f0d2-42e3-9c89-dd625acda395 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:36.184435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8d63616d-f0d2-42e3-9c89-dd625acda395 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invalidating the token cache because role aceec88614b04e10bce2ed2b7d7305a0 was removed from user f8a3857e478e43b892349a205ee22fe2 on project fd3fc98505d64511a4a55f1ce9bc0c3f. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:36.184736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8d63616d-f0d2-42e3-9c89-dd625acda395 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:36.186967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8d63616d-f0d2-42e3-9c89-dd625acda395 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:36.329261 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2463/4984] 10.222.0.43 () {58 vars in 1466 bytes} [Tue Jul 19 14:34:36 2022] DELETE /identity/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/users/f8a3857e478e43b892349a205ee22fe2/roles/aceec88614b04e10bce2ed2b7d7305a0 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:36.331976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcddcea2-0a32-48bb-8b40-3763a301866a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:36.334221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dcddcea2-0a32-48bb-8b40-3763a301866a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:36.352626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcddcea2-0a32-48bb-8b40-3763a301866a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:36.399934 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:36.464056 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:36.468262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82d88c-0ddc-4d53-918c-74be6b15a495 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:36.469405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82d88c-0ddc-4d53-918c-74be6b15a495 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:36.469548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82d88c-0ddc-4d53-918c-74be6b15a495 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:36.470131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c82d88c-0ddc-4d53-918c-74be6b15a495 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/aceec88614b04e10bce2ed2b7d7305a0` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:36.471498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82d88c-0ddc-4d53-918c-74be6b15a495 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=aceec88614b04e10bce2ed2b7d7305a0)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:36.472977 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-7c82d88c-0ddc-4d53-918c-74be6b15a495 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:36.472977 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:34:36.472977 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:34:36.473848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c82d88c-0ddc-4d53-918c-74be6b15a495 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:36.657624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7c82d88c-0ddc-4d53-918c-74be6b15a495 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invalidating the token cache because role aceec88614b04e10bce2ed2b7d7305a0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:36.660510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7c82d88c-0ddc-4d53-918c-74be6b15a495 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:36.661111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7c82d88c-0ddc-4d53-918c-74be6b15a495 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:36.671492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63616d-f0d2-42e3-9c89-dd625acda395 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:36.671744 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2522/4985] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:36 2022] DELETE /identity/v3/roles/aceec88614b04e10bce2ed2b7d7305a0 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:36.702721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d63616d-f0d2-42e3-9c89-dd625acda395 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:36.867074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc46173-f4dc-481d-94bd-c0a2ef2f3ad5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:36.868178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc46173-f4dc-481d-94bd-c0a2ef2f3ad5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:36.868575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc46173-f4dc-481d-94bd-c0a2ef2f3ad5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:36.869061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc46173-f4dc-481d-94bd-c0a2ef2f3ad5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/users/f8a3857e478e43b892349a205ee22fe2/roles/210827ffdeb241fa9fda087163fd9e40` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:36.871943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc46173-f4dc-481d-94bd-c0a2ef2f3ad5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fd3fc98505d64511a4a55f1ce9bc0c3f, user_id=f8a3857e478e43b892349a205ee22fe2, role_id=210827ffdeb241fa9fda087163fd9e40)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:36.875184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc46173-f4dc-481d-94bd-c0a2ef2f3ad5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:36.929567 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:36.936529 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2464/4986] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:34:36 2022] PUT /identity/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/users/f8a3857e478e43b892349a205ee22fe2/roles/210827ffdeb241fa9fda087163fd9e40 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:36.942179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82d88c-0ddc-4d53-918c-74be6b15a495 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:36.944444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7c82d88c-0ddc-4d53-918c-74be6b15a495 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:36.961484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c82d88c-0ddc-4d53-918c-74be6b15a495 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:37.043848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e1c86-040e-4aa0-8523-46b522df9af6 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:37.044990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e1c86-040e-4aa0-8523-46b522df9af6 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:37.045468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e1c86-040e-4aa0-8523-46b522df9af6 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:37.046713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e1c86-040e-4aa0-8523-46b522df9af6 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:37.048872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e1c86-040e-4aa0-8523-46b522df9af6 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=210827ffdeb241fa9fda087163fd9e40, implied_role_id=32cbe40f99244f1094e81e50721377d3)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:37.050751 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-c08e1c86-040e-4aa0-8523-46b522df9af6 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:37.050751 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:34:37.050751 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:34:37.052255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e1c86-040e-4aa0-8523-46b522df9af6 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:37.150782 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2523/4987] 10.222.0.43 () {60 vars in 1362 bytes} [Tue Jul 19 14:34:36 2022] PUT /identity/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3 => generated 518 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:37.151482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc46173-f4dc-481d-94bd-c0a2ef2f3ad5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:37.163685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc46173-f4dc-481d-94bd-c0a2ef2f3ad5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:37.252759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5f7ed-3de5-4531-a22a-b1670af7e8bc tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:37.253919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5f7ed-3de5-4531-a22a-b1670af7e8bc tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:37.254434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5f7ed-3de5-4531-a22a-b1670af7e8bc tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:37.254915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5f7ed-3de5-4531-a22a-b1670af7e8bc tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:37.256903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5f7ed-3de5-4531-a22a-b1670af7e8bc tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Adding query filter params (scope.project.id=fd3fc98505d64511a4a55f1ce9bc0c3f, user.id=f8a3857e478e43b892349a205ee22fe2) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:34:37.257519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5f7ed-3de5-4531-a22a-b1670af7e8bc tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:37.258894 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-96f5f7ed-3de5-4531-a22a-b1670af7e8bc tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:37.258894 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:34:37.258894 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:34:37.262630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5f7ed-3de5-4531-a22a-b1670af7e8bc tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:37.344360 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2465/4988] 10.222.0.43 () {58 vars in 1355 bytes} [Tue Jul 19 14:34:37 2022] GET /identity/v3/role_assignments?scope.project.id=fd3fc98505d64511a4a55f1ce9bc0c3f&user.id=f8a3857e478e43b892349a205ee22fe2&effective => generated 1061 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:34:37.345901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e1c86-040e-4aa0-8523-46b522df9af6 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:37.359509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e1c86-040e-4aa0-8523-46b522df9af6 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:37.366522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4bb75-e42f-4123-a375-c7fefbe953b3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:37.367902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4bb75-e42f-4123-a375-c7fefbe953b3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:37.368742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4bb75-e42f-4123-a375-c7fefbe953b3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:37.369039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4bb75-e42f-4123-a375-c7fefbe953b3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:37.373059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4bb75-e42f-4123-a375-c7fefbe953b3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=210827ffdeb241fa9fda087163fd9e40, implied_role_id=32cbe40f99244f1094e81e50721377d3)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:37.374204 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-6ae4bb75-e42f-4123-a375-c7fefbe953b3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:37.374204 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:34:37.374204 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:34:37.375400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4bb75-e42f-4123-a375-c7fefbe953b3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:37.504315 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2524/4989] 10.222.0.43 () {58 vars in 1346 bytes} [Tue Jul 19 14:34:37 2022] DELETE /identity/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:37.505965 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:37.508994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5f7ed-3de5-4531-a22a-b1670af7e8bc tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:37.520464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5f7ed-3de5-4531-a22a-b1670af7e8bc tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:37.677317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802680c-547c-4250-b5a8-b65d021fa377 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:37.678671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802680c-547c-4250-b5a8-b65d021fa377 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:37.679264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802680c-547c-4250-b5a8-b65d021fa377 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:37.679759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802680c-547c-4250-b5a8-b65d021fa377 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:37.681796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802680c-547c-4250-b5a8-b65d021fa377 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Adding query filter params (scope.project.id=fd3fc98505d64511a4a55f1ce9bc0c3f, user.id=f8a3857e478e43b892349a205ee22fe2) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:34:37.682371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802680c-547c-4250-b5a8-b65d021fa377 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:37.685575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802680c-547c-4250-b5a8-b65d021fa377 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:37.789891 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2466/4990] 10.222.0.43 () {58 vars in 1355 bytes} [Tue Jul 19 14:34:37 2022] GET /identity/v3/role_assignments?scope.project.id=fd3fc98505d64511a4a55f1ce9bc0c3f&user.id=f8a3857e478e43b892349a205ee22fe2&effective => generated 577 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:34:37.794072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4bb75-e42f-4123-a375-c7fefbe953b3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:37.809345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4bb75-e42f-4123-a375-c7fefbe953b3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:37.824619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72237e-65ff-447e-8f63-282ce21f42e5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:37.825596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72237e-65ff-447e-8f63-282ce21f42e5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:37.825894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72237e-65ff-447e-8f63-282ce21f42e5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:37.826218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72237e-65ff-447e-8f63-282ce21f42e5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:37.832259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72237e-65ff-447e-8f63-282ce21f42e5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=210827ffdeb241fa9fda087163fd9e40, implied_role_id=32cbe40f99244f1094e81e50721377d3)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:37.835687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72237e-65ff-447e-8f63-282ce21f42e5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:37.872905 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-cc72237e-65ff-447e-8f63-282ce21f42e5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] 210827ffdeb241fa9fda087163fd9e40 does not imply 32cbe40f99244f1094e81e50721377d3.: keystone.exception.ImpliedRoleNotFound: 210827ffdeb241fa9fda087163fd9e40 does not imply 32cbe40f99244f1094e81e50721377d3. Jul 19 14:34:37.872905 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:34:37.872905 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 19 14:34:37.872905 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = query.one() Jul 19 14:34:37.872905 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 19 14:34:37.872905 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._iter().one() Jul 19 14:34:37.872905 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 19 14:34:37.872905 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._only_one_row( Jul 19 14:34:37.872905 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 19 14:34:37.872905 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 19 14:34:37.872905 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 19 14:34:37.872905 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:34:37.872905 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:34:37.872905 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:34:37.872905 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:34:37.872905 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:34:37.874135 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:34:37.874135 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:34:37.874135 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:34:37.874135 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:34:37.874135 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:34:37.874135 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:34:37.874135 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:34:37.874135 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:34:37.874135 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:34:37.874135 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jul 19 14:34:37.874135 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jul 19 14:34:37.874135 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:34:37.874135 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:34:37.874135 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jul 19 14:34:37.874135 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jul 19 14:34:37.874135 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jul 19 14:34:37.879184 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 19 14:34:37.879184 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 19 14:34:37.879184 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 19 14:34:37.879184 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 210827ffdeb241fa9fda087163fd9e40 does not imply 32cbe40f99244f1094e81e50721377d3. Jul 19 14:34:37.879184 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:34:37.879184 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2525/4991] 10.222.0.43 () {58 vars in 1346 bytes} [Tue Jul 19 14:34:37 2022] DELETE /identity/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3 => generated 137 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:34:37.879594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802680c-547c-4250-b5a8-b65d021fa377 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:37.891102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802680c-547c-4250-b5a8-b65d021fa377 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:37.897412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245b07a-060c-4c17-922d-d99aa3215dc5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:37.898508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245b07a-060c-4c17-922d-d99aa3215dc5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:37.898969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245b07a-060c-4c17-922d-d99aa3215dc5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:37.899265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245b07a-060c-4c17-922d-d99aa3215dc5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/users/f8a3857e478e43b892349a205ee22fe2/roles/210827ffdeb241fa9fda087163fd9e40` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:37.901678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245b07a-060c-4c17-922d-d99aa3215dc5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=fd3fc98505d64511a4a55f1ce9bc0c3f, user_id=f8a3857e478e43b892349a205ee22fe2, role_id=210827ffdeb241fa9fda087163fd9e40)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:37.905539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c245b07a-060c-4c17-922d-d99aa3215dc5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:37.915353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c245b07a-060c-4c17-922d-d99aa3215dc5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invalidating the token cache because role 210827ffdeb241fa9fda087163fd9e40 was removed from user f8a3857e478e43b892349a205ee22fe2 on project fd3fc98505d64511a4a55f1ce9bc0c3f. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:37.915684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c245b07a-060c-4c17-922d-d99aa3215dc5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:37.916866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c245b07a-060c-4c17-922d-d99aa3215dc5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:38.031191 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2467/4992] 10.222.0.43 () {58 vars in 1466 bytes} [Tue Jul 19 14:34:37 2022] DELETE /identity/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/users/f8a3857e478e43b892349a205ee22fe2/roles/210827ffdeb241fa9fda087163fd9e40 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:38.032787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72237e-65ff-447e-8f63-282ce21f42e5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:38.034670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cc72237e-65ff-447e-8f63-282ce21f42e5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:38.066661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72237e-65ff-447e-8f63-282ce21f42e5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:38.137974 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:38.167635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1c61d-e7d4-4007-997e-b87da42b318a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:38.168380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1c61d-e7d4-4007-997e-b87da42b318a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:38.168714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1c61d-e7d4-4007-997e-b87da42b318a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:38.169037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1c61d-e7d4-4007-997e-b87da42b318a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:38.169826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1c61d-e7d4-4007-997e-b87da42b318a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:38.171611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc1c61d-e7d4-4007-997e-b87da42b318a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:38.183634 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:38.329357 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2526/4993] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:34:38 2022] POST /identity/v3/roles => generated 272 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:38.334568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245b07a-060c-4c17-922d-d99aa3215dc5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:38.346975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c245b07a-060c-4c17-922d-d99aa3215dc5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:38.353629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af49f0-1a17-4262-842c-81253710067c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:38.355120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af49f0-1a17-4262-842c-81253710067c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:38.355608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af49f0-1a17-4262-842c-81253710067c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:38.356099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af49f0-1a17-4262-842c-81253710067c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:38.357310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af49f0-1a17-4262-842c-81253710067c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Adding query filter params (domain_id=6a14b1ecc8c743f09dfa68486e59b36c) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:34:38.357841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af49f0-1a17-4262-842c-81253710067c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:38.359930 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-32af49f0-1a17-4262-842c-81253710067c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:38.359930 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:34:38.359930 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:34:38.361317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af49f0-1a17-4262-842c-81253710067c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:38.374330 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2468/4994] 10.222.0.43 () {58 vars in 1206 bytes} [Tue Jul 19 14:34:38 2022] GET /identity/v3/roles?domain_id=6a14b1ecc8c743f09dfa68486e59b36c => generated 409 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:34:38.377992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1c61d-e7d4-4007-997e-b87da42b318a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:38.393451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc1c61d-e7d4-4007-997e-b87da42b318a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:38.402892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4373c-1fbf-475a-ac25-20d2e52f8366 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:38.403710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4373c-1fbf-475a-ac25-20d2e52f8366 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:38.404064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4373c-1fbf-475a-ac25-20d2e52f8366 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:38.404353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4373c-1fbf-475a-ac25-20d2e52f8366 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/eb246e8608524bc3bf4958027c5b16e3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:38.406675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4373c-1fbf-475a-ac25-20d2e52f8366 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=eb246e8608524bc3bf4958027c5b16e3)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:38.410829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4373c-1fbf-475a-ac25-20d2e52f8366 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:38.554998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-73f4373c-1fbf-475a-ac25-20d2e52f8366 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invalidating the token cache because role eb246e8608524bc3bf4958027c5b16e3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:38.556048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-73f4373c-1fbf-475a-ac25-20d2e52f8366 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:38.558344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-73f4373c-1fbf-475a-ac25-20d2e52f8366 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:38.561829 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2527/4995] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:38 2022] DELETE /identity/v3/roles/eb246e8608524bc3bf4958027c5b16e3 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:38.566292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af49f0-1a17-4262-842c-81253710067c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:38.568528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-32af49f0-1a17-4262-842c-81253710067c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:38.589761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af49f0-1a17-4262-842c-81253710067c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:38.705411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15501b08-437f-41a8-a456-c4a035e54e6e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:38.705411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15501b08-437f-41a8-a456-c4a035e54e6e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:38.705411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15501b08-437f-41a8-a456-c4a035e54e6e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:38.705791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15501b08-437f-41a8-a456-c4a035e54e6e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:38.705791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15501b08-437f-41a8-a456-c4a035e54e6e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Adding query filter params (domain_id=6a14b1ecc8c743f09dfa68486e59b36c) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:34:38.705791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15501b08-437f-41a8-a456-c4a035e54e6e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:38.707214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15501b08-437f-41a8-a456-c4a035e54e6e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:38.718623 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2469/4996] 10.222.0.43 () {58 vars in 1206 bytes} [Tue Jul 19 14:34:38 2022] GET /identity/v3/roles?domain_id=6a14b1ecc8c743f09dfa68486e59b36c => generated 148 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:34:38.722526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4373c-1fbf-475a-ac25-20d2e52f8366 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:38.735558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4373c-1fbf-475a-ac25-20d2e52f8366 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:38.741394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b5c33-90da-45fd-9b95-285acfd5635d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:38.742328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b5c33-90da-45fd-9b95-285acfd5635d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:38.742621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b5c33-90da-45fd-9b95-285acfd5635d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:38.742903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b5c33-90da-45fd-9b95-285acfd5635d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/eb246e8608524bc3bf4958027c5b16e3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:38.766291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b5c33-90da-45fd-9b95-285acfd5635d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 14:34:38.778165 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-350b5c33-90da-45fd-9b95-285acfd5635d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Could not find role: eb246e8608524bc3bf4958027c5b16e3.: keystone.exception.RoleNotFound: Could not find role: eb246e8608524bc3bf4958027c5b16e3. Jul 19 14:34:38.778165 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:34:38.778165 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:34:38.778165 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:34:38.778165 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:34:38.778165 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:34:38.778165 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:34:38.778165 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:34:38.778165 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:34:38.778165 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:34:38.778165 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:34:38.778165 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:34:38.778165 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Jul 19 14:34:38.778165 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Jul 19 14:34:38.779205 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 14:34:38.779205 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 14:34:38.779205 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 14:34:38.779205 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 14:34:38.779205 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:34:38.779205 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:34:38.779205 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:34:38.779205 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:34:38.779205 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:34:38.779205 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:34:38.779205 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:34:38.779205 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 14:34:38.779205 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:34:38.779205 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:34:38.779205 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:34:38.779205 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:34:38.780174 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:34:38.780174 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:34:38.780174 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:34:38.780174 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:34:38.780174 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 14:34:38.780174 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 14:34:38.780174 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 14:34:38.780174 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 14:34:38.780174 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 14:34:38.780174 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 14:34:38.780174 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: eb246e8608524bc3bf4958027c5b16e3. Jul 19 14:34:38.780174 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:34:38.785553 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2528/4997] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:38 2022] DELETE /identity/v3/roles/eb246e8608524bc3bf4958027c5b16e3 => generated 110 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:34:38.791149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15501b08-437f-41a8-a456-c4a035e54e6e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:38.805074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15501b08-437f-41a8-a456-c4a035e54e6e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:38.813509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de75793-b707-4c84-be3d-6d031821f31d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:38.814767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de75793-b707-4c84-be3d-6d031821f31d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:38.815061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de75793-b707-4c84-be3d-6d031821f31d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:38.815781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de75793-b707-4c84-be3d-6d031821f31d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/domains/6a14b1ecc8c743f09dfa68486e59b36c/groups/150b5a7b57164bc4a26fcf69638506af/roles/86b57ba33993496293ee99b11284cb6c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:38.825116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de75793-b707-4c84-be3d-6d031821f31d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=6a14b1ecc8c743f09dfa68486e59b36c, group_id=150b5a7b57164bc4a26fcf69638506af, role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:38.829287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de75793-b707-4c84-be3d-6d031821f31d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:38.951635 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2470/4998] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:34:38 2022] PUT /identity/v3/domains/6a14b1ecc8c743f09dfa68486e59b36c/groups/150b5a7b57164bc4a26fcf69638506af/roles/86b57ba33993496293ee99b11284cb6c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:38.954556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b5c33-90da-45fd-9b95-285acfd5635d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:38.966490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b5c33-90da-45fd-9b95-285acfd5635d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:39.041663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f8936-f869-4ec6-b654-17c9ec3460ab tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:39.042868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f8936-f869-4ec6-b654-17c9ec3460ab tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:39.043366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f8936-f869-4ec6-b654-17c9ec3460ab tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:39.043882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145f8936-f869-4ec6-b654-17c9ec3460ab tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/domains/6a14b1ecc8c743f09dfa68486e59b36c/groups/150b5a7b57164bc4a26fcf69638506af/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:39.047241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f8936-f869-4ec6-b654-17c9ec3460ab tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=6a14b1ecc8c743f09dfa68486e59b36c, group_id=150b5a7b57164bc4a26fcf69638506af)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:39.048538 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-145f8936-f869-4ec6-b654-17c9ec3460ab tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:39.048538 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:34:39.048538 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:34:39.050558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145f8936-f869-4ec6-b654-17c9ec3460ab tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:39.071064 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2529/4999] 10.222.0.43 () {58 vars in 1364 bytes} [Tue Jul 19 14:34:38 2022] GET /identity/v3/domains/6a14b1ecc8c743f09dfa68486e59b36c/groups/150b5a7b57164bc4a26fcf69638506af/roles => generated 409 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:34:39.075549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de75793-b707-4c84-be3d-6d031821f31d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:39.092652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de75793-b707-4c84-be3d-6d031821f31d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:39.103450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226fb8f-0cc0-41f7-a9bb-0750b47893d9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:39.104358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226fb8f-0cc0-41f7-a9bb-0750b47893d9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:39.104698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226fb8f-0cc0-41f7-a9bb-0750b47893d9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:39.104984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226fb8f-0cc0-41f7-a9bb-0750b47893d9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/domains/6a14b1ecc8c743f09dfa68486e59b36c/groups/150b5a7b57164bc4a26fcf69638506af/roles/86b57ba33993496293ee99b11284cb6c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:39.108353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226fb8f-0cc0-41f7-a9bb-0750b47893d9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=6a14b1ecc8c743f09dfa68486e59b36c, group_id=150b5a7b57164bc4a26fcf69638506af, role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:39.110025 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-f226fb8f-0cc0-41f7-a9bb-0750b47893d9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:39.110025 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:34:39.110025 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:34:39.112469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226fb8f-0cc0-41f7-a9bb-0750b47893d9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:39.120956 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2471/5000] 10.222.0.43 () {58 vars in 1464 bytes} [Tue Jul 19 14:34:39 2022] HEAD /identity/v3/domains/6a14b1ecc8c743f09dfa68486e59b36c/groups/150b5a7b57164bc4a26fcf69638506af/roles/86b57ba33993496293ee99b11284cb6c => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:39.125561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f8936-f869-4ec6-b654-17c9ec3460ab tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:39.140487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145f8936-f869-4ec6-b654-17c9ec3460ab tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:39.146048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f3298-defb-4896-bb1b-e0438672a3c3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:39.147427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f3298-defb-4896-bb1b-e0438672a3c3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:39.147980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f3298-defb-4896-bb1b-e0438672a3c3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:39.148496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f3298-defb-4896-bb1b-e0438672a3c3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/domains/6a14b1ecc8c743f09dfa68486e59b36c/groups/150b5a7b57164bc4a26fcf69638506af/roles/86b57ba33993496293ee99b11284cb6c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:39.151072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f3298-defb-4896-bb1b-e0438672a3c3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=6a14b1ecc8c743f09dfa68486e59b36c, group_id=150b5a7b57164bc4a26fcf69638506af, role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:39.152213 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-e52f3298-defb-4896-bb1b-e0438672a3c3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:39.152213 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:34:39.152213 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:34:39.154592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f3298-defb-4896-bb1b-e0438672a3c3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:39.164949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e52f3298-defb-4896-bb1b-e0438672a3c3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invalidating the token cache because role 86b57ba33993496293ee99b11284cb6c was removed from group 150b5a7b57164bc4a26fcf69638506af on domain 6a14b1ecc8c743f09dfa68486e59b36c. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:39.165340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e52f3298-defb-4896-bb1b-e0438672a3c3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:39.166275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e52f3298-defb-4896-bb1b-e0438672a3c3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:39.258061 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2530/5001] 10.222.0.43 () {58 vars in 1466 bytes} [Tue Jul 19 14:34:39 2022] DELETE /identity/v3/domains/6a14b1ecc8c743f09dfa68486e59b36c/groups/150b5a7b57164bc4a26fcf69638506af/roles/86b57ba33993496293ee99b11284cb6c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:39.265709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226fb8f-0cc0-41f7-a9bb-0750b47893d9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:39.269979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f226fb8f-0cc0-41f7-a9bb-0750b47893d9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:39.291846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226fb8f-0cc0-41f7-a9bb-0750b47893d9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:39.314744 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:39.406868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3017500-e31e-40b7-ae55-1e6b4a298296 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:39.409942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3017500-e31e-40b7-ae55-1e6b4a298296 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:39.410284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3017500-e31e-40b7-ae55-1e6b4a298296 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:39.410630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3017500-e31e-40b7-ae55-1e6b4a298296 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/groups/150b5a7b57164bc4a26fcf69638506af/roles/86b57ba33993496293ee99b11284cb6c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:39.414136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3017500-e31e-40b7-ae55-1e6b4a298296 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fd3fc98505d64511a4a55f1ce9bc0c3f, group_id=150b5a7b57164bc4a26fcf69638506af, role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:39.417485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3017500-e31e-40b7-ae55-1e6b4a298296 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:39.423761 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:39.506115 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2472/5002] 10.222.0.43 () {60 vars in 1485 bytes} [Tue Jul 19 14:34:39 2022] PUT /identity/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/groups/150b5a7b57164bc4a26fcf69638506af/roles/86b57ba33993496293ee99b11284cb6c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:39.510164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f3298-defb-4896-bb1b-e0438672a3c3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:39.523017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f3298-defb-4896-bb1b-e0438672a3c3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:39.591015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633ac15-1eb3-48c9-9654-52ffe92b26c0 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:39.591859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633ac15-1eb3-48c9-9654-52ffe92b26c0 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:39.592144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633ac15-1eb3-48c9-9654-52ffe92b26c0 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:39.592423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633ac15-1eb3-48c9-9654-52ffe92b26c0 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/groups/150b5a7b57164bc4a26fcf69638506af/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:39.594602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633ac15-1eb3-48c9-9654-52ffe92b26c0 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:list_grants(project_id=fd3fc98505d64511a4a55f1ce9bc0c3f, group_id=150b5a7b57164bc4a26fcf69638506af)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:39.598548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633ac15-1eb3-48c9-9654-52ffe92b26c0 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:39.614039 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2531/5003] 10.222.0.43 () {58 vars in 1367 bytes} [Tue Jul 19 14:34:39 2022] GET /identity/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/groups/150b5a7b57164bc4a26fcf69638506af/roles => generated 410 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:34:39.617634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3017500-e31e-40b7-ae55-1e6b4a298296 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:39.628710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3017500-e31e-40b7-ae55-1e6b4a298296 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:39.637137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f028022-ed47-4bec-9db7-97eb32d208bf tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:39.637137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f028022-ed47-4bec-9db7-97eb32d208bf tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:39.637137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f028022-ed47-4bec-9db7-97eb32d208bf tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:39.637425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f028022-ed47-4bec-9db7-97eb32d208bf tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/groups/150b5a7b57164bc4a26fcf69638506af/users/f8a3857e478e43b892349a205ee22fe2` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:39.638261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f028022-ed47-4bec-9db7-97eb32d208bf tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=150b5a7b57164bc4a26fcf69638506af, user_id=f8a3857e478e43b892349a205ee22fe2)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:39.639200 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-7f028022-ed47-4bec-9db7-97eb32d208bf tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:39.639200 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:34:39.639200 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:34:39.640624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f028022-ed47-4bec-9db7-97eb32d208bf tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:39.766995 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2473/5004] 10.222.0.43 () {60 vars in 1359 bytes} [Tue Jul 19 14:34:39 2022] PUT /identity/v3/groups/150b5a7b57164bc4a26fcf69638506af/users/f8a3857e478e43b892349a205ee22fe2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:39.772955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87507f-a979-4970-b676-72d6e39a2484 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:39.773252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87507f-a979-4970-b676-72d6e39a2484 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:39.773560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee87507f-a979-4970-b676-72d6e39a2484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:39.825877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ee87507f-a979-4970-b676-72d6e39a2484 None None] MFA Rules not processed for user `f8a3857e478e43b892349a205ee22fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:39.831144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ee87507f-a979-4970-b676-72d6e39a2484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:39.941495 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2532/5005] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:39 2022] POST /identity/v3/auth/tokens => generated 3253 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:34:39.946653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f028022-ed47-4bec-9db7-97eb32d208bf tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:40.025754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f028022-ed47-4bec-9db7-97eb32d208bf tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:40.030596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1afa98-18f8-4fa2-a799-dcfda77232c8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:40.031488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1afa98-18f8-4fa2-a799-dcfda77232c8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:40.031774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1afa98-18f8-4fa2-a799-dcfda77232c8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:40.032051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1afa98-18f8-4fa2-a799-dcfda77232c8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/groups/150b5a7b57164bc4a26fcf69638506af/roles/86b57ba33993496293ee99b11284cb6c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:40.035172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1afa98-18f8-4fa2-a799-dcfda77232c8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:check_grant(project_id=fd3fc98505d64511a4a55f1ce9bc0c3f, group_id=150b5a7b57164bc4a26fcf69638506af, role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:40.037952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1afa98-18f8-4fa2-a799-dcfda77232c8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:40.044675 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2474/5006] 10.222.0.43 () {58 vars in 1467 bytes} [Tue Jul 19 14:34:39 2022] HEAD /identity/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/groups/150b5a7b57164bc4a26fcf69638506af/roles/86b57ba33993496293ee99b11284cb6c => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:40.051218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87507f-a979-4970-b676-72d6e39a2484 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:40.062179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee87507f-a979-4970-b676-72d6e39a2484 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:40.074895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b15977-a56f-4a05-8b82-6502c378826f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:40.076068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b15977-a56f-4a05-8b82-6502c378826f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:40.076363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b15977-a56f-4a05-8b82-6502c378826f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:40.076701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b15977-a56f-4a05-8b82-6502c378826f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/groups/150b5a7b57164bc4a26fcf69638506af/roles/86b57ba33993496293ee99b11284cb6c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:40.079149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b15977-a56f-4a05-8b82-6502c378826f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=fd3fc98505d64511a4a55f1ce9bc0c3f, group_id=150b5a7b57164bc4a26fcf69638506af, role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:40.082060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b15977-a56f-4a05-8b82-6502c378826f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:40.088991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77b15977-a56f-4a05-8b82-6502c378826f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invalidating the token cache because role 86b57ba33993496293ee99b11284cb6c was removed from group 150b5a7b57164bc4a26fcf69638506af on project fd3fc98505d64511a4a55f1ce9bc0c3f. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:40.090716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77b15977-a56f-4a05-8b82-6502c378826f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:40.091563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77b15977-a56f-4a05-8b82-6502c378826f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:40.236149 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2533/5007] 10.222.0.43 () {58 vars in 1469 bytes} [Tue Jul 19 14:34:40 2022] DELETE /identity/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/groups/150b5a7b57164bc4a26fcf69638506af/roles/86b57ba33993496293ee99b11284cb6c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:40.240704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1afa98-18f8-4fa2-a799-dcfda77232c8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:40.247799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8e1afa98-18f8-4fa2-a799-dcfda77232c8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:40.264782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1afa98-18f8-4fa2-a799-dcfda77232c8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:40.335224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233fc51-5993-4987-abac-25b839cc8b4f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:40.336214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233fc51-5993-4987-abac-25b839cc8b4f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:40.336509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233fc51-5993-4987-abac-25b839cc8b4f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:40.337445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233fc51-5993-4987-abac-25b839cc8b4f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/groups/150b5a7b57164bc4a26fcf69638506af/users/f8a3857e478e43b892349a205ee22fe2` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:40.339414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233fc51-5993-4987-abac-25b839cc8b4f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=150b5a7b57164bc4a26fcf69638506af, user_id=f8a3857e478e43b892349a205ee22fe2)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:40.340451 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-7233fc51-5993-4987-abac-25b839cc8b4f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:40.340451 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:34:40.340451 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:34:40.341694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233fc51-5993-4987-abac-25b839cc8b4f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:40.462677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7233fc51-5993-4987-abac-25b839cc8b4f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'f8a3857e478e43b892349a205ee22fe2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:40.556614 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2475/5008] 10.222.0.43 () {58 vars in 1343 bytes} [Tue Jul 19 14:34:40 2022] DELETE /identity/v3/groups/150b5a7b57164bc4a26fcf69638506af/users/f8a3857e478e43b892349a205ee22fe2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:40.561922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b15977-a56f-4a05-8b82-6502c378826f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:40.575445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b15977-a56f-4a05-8b82-6502c378826f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:40.662019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897d912-4929-418c-9e63-a14ec0741a4d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:40.662019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897d912-4929-418c-9e63-a14ec0741a4d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:40.662448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897d912-4929-418c-9e63-a14ec0741a4d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:40.662662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897d912-4929-418c-9e63-a14ec0741a4d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/system/groups/150b5a7b57164bc4a26fcf69638506af/roles/86b57ba33993496293ee99b11284cb6c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:40.664558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897d912-4929-418c-9e63-a14ec0741a4d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=150b5a7b57164bc4a26fcf69638506af, role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:40.665583 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-4897d912-4929-418c-9e63-a14ec0741a4d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:40.665583 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:34:40.665583 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:34:40.666504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897d912-4929-418c-9e63-a14ec0741a4d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:40.705807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233fc51-5993-4987-abac-25b839cc8b4f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:40.707668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7233fc51-5993-4987-abac-25b839cc8b4f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:40.782034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233fc51-5993-4987-abac-25b839cc8b4f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:40.786452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c9d48-96bb-45f5-9aab-02d77ad603c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:40.787624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c9d48-96bb-45f5-9aab-02d77ad603c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:40.787992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c9d48-96bb-45f5-9aab-02d77ad603c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:40.788275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c9d48-96bb-45f5-9aab-02d77ad603c9 admin admin] PATH_INFO: `/v3/users/df13382c8aa448d0a6d967296d88c33b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:40.789534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c9d48-96bb-45f5-9aab-02d77ad603c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df13382c8aa448d0a6d967296d88c33b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:40.793018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c9d48-96bb-45f5-9aab-02d77ad603c9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:40.794305 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2534/5009] 10.222.0.43 () {60 vars in 1380 bytes} [Tue Jul 19 14:34:40 2022] PUT /identity/v3/system/groups/150b5a7b57164bc4a26fcf69638506af/roles/86b57ba33993496293ee99b11284cb6c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:40.795797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897d912-4929-418c-9e63-a14ec0741a4d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:40.808257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897d912-4929-418c-9e63-a14ec0741a4d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:40.821288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9e640-393c-4474-b51f-05ab788e03f7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:40.822025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9e640-393c-4474-b51f-05ab788e03f7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:40.822350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9e640-393c-4474-b51f-05ab788e03f7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:40.822635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9e640-393c-4474-b51f-05ab788e03f7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/system/groups/150b5a7b57164bc4a26fcf69638506af/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:40.823864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9e640-393c-4474-b51f-05ab788e03f7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=150b5a7b57164bc4a26fcf69638506af)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:40.825039 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-12c9e640-393c-4474-b51f-05ab788e03f7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:40.825039 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:34:40.825039 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:34:40.825928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9e640-393c-4474-b51f-05ab788e03f7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:40.841184 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2535/5010] 10.222.0.43 () {58 vars in 1262 bytes} [Tue Jul 19 14:34:40 2022] GET /identity/v3/system/groups/150b5a7b57164bc4a26fcf69638506af/roles => generated 375 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:34:40.852067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9e640-393c-4474-b51f-05ab788e03f7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:40.870829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9e640-393c-4474-b51f-05ab788e03f7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:40.879378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0651ebc-9e01-4d03-8940-38d7cf8b3737 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:40.879378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0651ebc-9e01-4d03-8940-38d7cf8b3737 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:40.879378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0651ebc-9e01-4d03-8940-38d7cf8b3737 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:40.879667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0651ebc-9e01-4d03-8940-38d7cf8b3737 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/system/groups/150b5a7b57164bc4a26fcf69638506af/roles/86b57ba33993496293ee99b11284cb6c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:40.882190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0651ebc-9e01-4d03-8940-38d7cf8b3737 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=150b5a7b57164bc4a26fcf69638506af, role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:40.883216 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-e0651ebc-9e01-4d03-8940-38d7cf8b3737 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:40.883216 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:34:40.883216 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:34:40.884555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0651ebc-9e01-4d03-8940-38d7cf8b3737 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:40.893026 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2536/5011] 10.222.0.43 () {58 vars in 1362 bytes} [Tue Jul 19 14:34:40 2022] HEAD /identity/v3/system/groups/150b5a7b57164bc4a26fcf69638506af/roles/86b57ba33993496293ee99b11284cb6c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:40.897785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0651ebc-9e01-4d03-8940-38d7cf8b3737 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:40.908437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0651ebc-9e01-4d03-8940-38d7cf8b3737 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:40.913704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89647015-fd4e-4255-9dec-6f00d65ba893 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:40.914647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89647015-fd4e-4255-9dec-6f00d65ba893 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:40.914943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89647015-fd4e-4255-9dec-6f00d65ba893 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:40.915950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89647015-fd4e-4255-9dec-6f00d65ba893 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/system/groups/150b5a7b57164bc4a26fcf69638506af/roles/86b57ba33993496293ee99b11284cb6c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:40.917120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89647015-fd4e-4255-9dec-6f00d65ba893 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=150b5a7b57164bc4a26fcf69638506af, role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:40.918677 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-89647015-fd4e-4255-9dec-6f00d65ba893 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:40.918677 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:34:40.918677 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:34:40.925495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89647015-fd4e-4255-9dec-6f00d65ba893 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:41.029873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-294c9d48-96bb-45f5-9aab-02d77ad603c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df13382c8aa448d0a6d967296d88c33b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:41.047988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-294c9d48-96bb-45f5-9aab-02d77ad603c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df13382c8aa448d0a6d967296d88c33b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:41.048861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-294c9d48-96bb-45f5-9aab-02d77ad603c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df13382c8aa448d0a6d967296d88c33b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:41.049645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-294c9d48-96bb-45f5-9aab-02d77ad603c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df13382c8aa448d0a6d967296d88c33b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:41.063106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-294c9d48-96bb-45f5-9aab-02d77ad603c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df13382c8aa448d0a6d967296d88c33b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:41.080627 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2537/5012] 10.222.0.43 () {58 vars in 1364 bytes} [Tue Jul 19 14:34:40 2022] DELETE /identity/v3/system/groups/150b5a7b57164bc4a26fcf69638506af/roles/86b57ba33993496293ee99b11284cb6c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:41.086267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89647015-fd4e-4255-9dec-6f00d65ba893 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:41.087871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-89647015-fd4e-4255-9dec-6f00d65ba893 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:41.101218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89647015-fd4e-4255-9dec-6f00d65ba893 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:41.107244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cf59a-fdf7-44ba-8f7e-1a03e252b611 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:41.109774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cf59a-fdf7-44ba-8f7e-1a03e252b611 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:41.110070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cf59a-fdf7-44ba-8f7e-1a03e252b611 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:41.115390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cf59a-fdf7-44ba-8f7e-1a03e252b611 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/domains/6a14b1ecc8c743f09dfa68486e59b36c/users/f8a3857e478e43b892349a205ee22fe2/roles/86b57ba33993496293ee99b11284cb6c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:41.117994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cf59a-fdf7-44ba-8f7e-1a03e252b611 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=6a14b1ecc8c743f09dfa68486e59b36c, user_id=f8a3857e478e43b892349a205ee22fe2, role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:41.121130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048cf59a-fdf7-44ba-8f7e-1a03e252b611 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:41.201890 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2476/5013] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:40 2022] DELETE /identity/v3/users/df13382c8aa448d0a6d967296d88c33b => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:41.206532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e2992-b29a-4840-a0f0-60f73ecc91a9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:41.206852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e2992-b29a-4840-a0f0-60f73ecc91a9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:41.207185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e2992-b29a-4840-a0f0-60f73ecc91a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:41.226146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-896e2992-b29a-4840-a0f0-60f73ecc91a9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:41.227249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-896e2992-b29a-4840-a0f0-60f73ecc91a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:41.287980 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2477/5014] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:34:41.298582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e2992-b29a-4840-a0f0-60f73ecc91a9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:41.300105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-896e2992-b29a-4840-a0f0-60f73ecc91a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:41.301650 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2538/5015] 10.222.0.43 () {60 vars in 1479 bytes} [Tue Jul 19 14:34:41 2022] PUT /identity/v3/domains/6a14b1ecc8c743f09dfa68486e59b36c/users/f8a3857e478e43b892349a205ee22fe2/roles/86b57ba33993496293ee99b11284cb6c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:41.307826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cf59a-fdf7-44ba-8f7e-1a03e252b611 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:41.369105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e2992-b29a-4840-a0f0-60f73ecc91a9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:41.379433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cf59a-fdf7-44ba-8f7e-1a03e252b611 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:41.384582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27978b38-12a7-413f-a2c8-d667f35081b8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:41.385851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27978b38-12a7-413f-a2c8-d667f35081b8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:41.385851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27978b38-12a7-413f-a2c8-d667f35081b8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:41.386141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27978b38-12a7-413f-a2c8-d667f35081b8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/domains/6a14b1ecc8c743f09dfa68486e59b36c/users/f8a3857e478e43b892349a205ee22fe2/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:41.388068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27978b38-12a7-413f-a2c8-d667f35081b8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=6a14b1ecc8c743f09dfa68486e59b36c, user_id=f8a3857e478e43b892349a205ee22fe2)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:41.390650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27978b38-12a7-413f-a2c8-d667f35081b8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:41.403923 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2539/5016] 10.222.0.43 () {58 vars in 1361 bytes} [Tue Jul 19 14:34:41 2022] GET /identity/v3/domains/6a14b1ecc8c743f09dfa68486e59b36c/users/f8a3857e478e43b892349a205ee22fe2/roles => generated 408 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:34:41.408702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27978b38-12a7-413f-a2c8-d667f35081b8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:41.421644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27978b38-12a7-413f-a2c8-d667f35081b8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:41.422020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54496840-2852-47fe-ac3e-a0d928fdbafa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:41.422732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54496840-2852-47fe-ac3e-a0d928fdbafa service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:41.423024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54496840-2852-47fe-ac3e-a0d928fdbafa service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:41.423307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54496840-2852-47fe-ac3e-a0d928fdbafa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:41.428539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62ae77-036f-4772-8f4b-2358d96a6f0f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:41.429838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62ae77-036f-4772-8f4b-2358d96a6f0f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:41.430381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62ae77-036f-4772-8f4b-2358d96a6f0f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:41.430874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62ae77-036f-4772-8f4b-2358d96a6f0f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/domains/6a14b1ecc8c743f09dfa68486e59b36c/users/f8a3857e478e43b892349a205ee22fe2/roles/86b57ba33993496293ee99b11284cb6c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:41.433622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62ae77-036f-4772-8f4b-2358d96a6f0f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=6a14b1ecc8c743f09dfa68486e59b36c, user_id=f8a3857e478e43b892349a205ee22fe2, role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:41.441808 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-fd62ae77-036f-4772-8f4b-2358d96a6f0f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:41.441808 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:34:41.441808 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:34:41.441808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62ae77-036f-4772-8f4b-2358d96a6f0f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:41.445552 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2540/5017] 10.222.0.43 () {58 vars in 1461 bytes} [Tue Jul 19 14:34:41 2022] HEAD /identity/v3/domains/6a14b1ecc8c743f09dfa68486e59b36c/users/f8a3857e478e43b892349a205ee22fe2/roles/86b57ba33993496293ee99b11284cb6c => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:41.449727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62ae77-036f-4772-8f4b-2358d96a6f0f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:41.460179 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:41.464252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62ae77-036f-4772-8f4b-2358d96a6f0f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:41.469283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9497b9f-008d-41e4-94f9-9895f0f74bb2 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:41.470490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9497b9f-008d-41e4-94f9-9895f0f74bb2 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:41.471036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9497b9f-008d-41e4-94f9-9895f0f74bb2 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:41.471411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9497b9f-008d-41e4-94f9-9895f0f74bb2 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/domains/6a14b1ecc8c743f09dfa68486e59b36c/users/f8a3857e478e43b892349a205ee22fe2/roles/86b57ba33993496293ee99b11284cb6c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:41.473926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9497b9f-008d-41e4-94f9-9895f0f74bb2 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=6a14b1ecc8c743f09dfa68486e59b36c, user_id=f8a3857e478e43b892349a205ee22fe2, role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:41.477457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9497b9f-008d-41e4-94f9-9895f0f74bb2 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:41.484100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b9497b9f-008d-41e4-94f9-9895f0f74bb2 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invalidating the token cache because role 86b57ba33993496293ee99b11284cb6c was removed from user f8a3857e478e43b892349a205ee22fe2 on domain 6a14b1ecc8c743f09dfa68486e59b36c. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:41.484612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b9497b9f-008d-41e4-94f9-9895f0f74bb2 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:41.485405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b9497b9f-008d-41e4-94f9-9895f0f74bb2 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:41.495096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54496840-2852-47fe-ac3e-a0d928fdbafa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:41.496937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54496840-2852-47fe-ac3e-a0d928fdbafa service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:41.511315 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2478/5018] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:34:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:34:41.577877 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2541/5019] 10.222.0.43 () {58 vars in 1463 bytes} [Tue Jul 19 14:34:41 2022] DELETE /identity/v3/domains/6a14b1ecc8c743f09dfa68486e59b36c/users/f8a3857e478e43b892349a205ee22fe2/roles/86b57ba33993496293ee99b11284cb6c => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:41.587911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54496840-2852-47fe-ac3e-a0d928fdbafa service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:41.601798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54496840-2852-47fe-ac3e-a0d928fdbafa service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:41.668771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d8bf5-827f-4d5f-a3f1-e08e3c69a8f5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:41.669673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d8bf5-827f-4d5f-a3f1-e08e3c69a8f5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:41.669958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d8bf5-827f-4d5f-a3f1-e08e3c69a8f5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:41.670278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d8bf5-827f-4d5f-a3f1-e08e3c69a8f5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/users/f8a3857e478e43b892349a205ee22fe2/roles/86b57ba33993496293ee99b11284cb6c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:41.672877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d8bf5-827f-4d5f-a3f1-e08e3c69a8f5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_grant(project_id=fd3fc98505d64511a4a55f1ce9bc0c3f, user_id=f8a3857e478e43b892349a205ee22fe2, role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:41.676547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d8bf5-827f-4d5f-a3f1-e08e3c69a8f5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:41.782826 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2479/5020] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:34:41 2022] PUT /identity/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/users/f8a3857e478e43b892349a205ee22fe2/roles/86b57ba33993496293ee99b11284cb6c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:41.787711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9497b9f-008d-41e4-94f9-9895f0f74bb2 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:41.789220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b9497b9f-008d-41e4-94f9-9895f0f74bb2 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:41.801982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9497b9f-008d-41e4-94f9-9895f0f74bb2 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:41.813602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d8bf5-827f-4d5f-a3f1-e08e3c69a8f5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:41.815667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ab8d8bf5-827f-4d5f-a3f1-e08e3c69a8f5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:41.889820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f87652-e869-4aa4-a137-6c3d7d6afb12 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:41.890823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f87652-e869-4aa4-a137-6c3d7d6afb12 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:41.891119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f87652-e869-4aa4-a137-6c3d7d6afb12 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:41.891538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f87652-e869-4aa4-a137-6c3d7d6afb12 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/users/f8a3857e478e43b892349a205ee22fe2/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:41.891927 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:INSERT=3,keystone:SELECT=95,keystone:DELETE=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:41.893678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f87652-e869-4aa4-a137-6c3d7d6afb12 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:list_grants(project_id=fd3fc98505d64511a4a55f1ce9bc0c3f, user_id=f8a3857e478e43b892349a205ee22fe2)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:41.897021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f87652-e869-4aa4-a137-6c3d7d6afb12 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:41.899851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d8bf5-827f-4d5f-a3f1-e08e3c69a8f5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:41.906058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a5feb-284f-41ed-97c8-bf3c7f03e8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:41.907286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a5feb-284f-41ed-97c8-bf3c7f03e8fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:41.907768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a5feb-284f-41ed-97c8-bf3c7f03e8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:41.908239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a5feb-284f-41ed-97c8-bf3c7f03e8fc admin admin] PATH_INFO: `/v3/projects/8c3588deddaf4b45ace6cb1e979e2ff8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:41.909712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a5feb-284f-41ed-97c8-bf3c7f03e8fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c3588deddaf4b45ace6cb1e979e2ff8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:41.913406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a5feb-284f-41ed-97c8-bf3c7f03e8fc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:41.917958 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2542/5021] 10.222.0.43 () {58 vars in 1364 bytes} [Tue Jul 19 14:34:41 2022] GET /identity/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/users/f8a3857e478e43b892349a205ee22fe2/roles => generated 409 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:34:41.921857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f87652-e869-4aa4-a137-6c3d7d6afb12 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:41.940501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f87652-e869-4aa4-a137-6c3d7d6afb12 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:41.949850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa53fc8-7284-4b24-a533-9c8124ab5212 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:41.949850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa53fc8-7284-4b24-a533-9c8124ab5212 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:41.949850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa53fc8-7284-4b24-a533-9c8124ab5212 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:41.950279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa53fc8-7284-4b24-a533-9c8124ab5212 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/users/f8a3857e478e43b892349a205ee22fe2/roles/86b57ba33993496293ee99b11284cb6c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:41.956138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa53fc8-7284-4b24-a533-9c8124ab5212 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:check_grant(project_id=fd3fc98505d64511a4a55f1ce9bc0c3f, user_id=f8a3857e478e43b892349a205ee22fe2, role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:41.961145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa53fc8-7284-4b24-a533-9c8124ab5212 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:41.971028 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2543/5022] 10.222.0.43 () {58 vars in 1464 bytes} [Tue Jul 19 14:34:41 2022] HEAD /identity/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/users/f8a3857e478e43b892349a205ee22fe2/roles/86b57ba33993496293ee99b11284cb6c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:41.975833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa53fc8-7284-4b24-a533-9c8124ab5212 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:41.987407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa53fc8-7284-4b24-a533-9c8124ab5212 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:41.992607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648300e-e54c-48cb-b2ab-8c020ac3a8fc tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:41.993571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648300e-e54c-48cb-b2ab-8c020ac3a8fc tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:41.994062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648300e-e54c-48cb-b2ab-8c020ac3a8fc tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:41.994382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648300e-e54c-48cb-b2ab-8c020ac3a8fc tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/users/f8a3857e478e43b892349a205ee22fe2/roles/86b57ba33993496293ee99b11284cb6c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:41.996988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648300e-e54c-48cb-b2ab-8c020ac3a8fc tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=fd3fc98505d64511a4a55f1ce9bc0c3f, user_id=f8a3857e478e43b892349a205ee22fe2, role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:41.999803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a648300e-e54c-48cb-b2ab-8c020ac3a8fc tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:42.006832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a648300e-e54c-48cb-b2ab-8c020ac3a8fc tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invalidating the token cache because role 86b57ba33993496293ee99b11284cb6c was removed from user f8a3857e478e43b892349a205ee22fe2 on project fd3fc98505d64511a4a55f1ce9bc0c3f. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:42.009099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a648300e-e54c-48cb-b2ab-8c020ac3a8fc tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:42.009099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a648300e-e54c-48cb-b2ab-8c020ac3a8fc tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:42.143822 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2544/5023] 10.222.0.43 () {58 vars in 1466 bytes} [Tue Jul 19 14:34:41 2022] DELETE /identity/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f/users/f8a3857e478e43b892349a205ee22fe2/roles/86b57ba33993496293ee99b11284cb6c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:42.149726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648300e-e54c-48cb-b2ab-8c020ac3a8fc tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:42.152239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a648300e-e54c-48cb-b2ab-8c020ac3a8fc tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:42.156532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a90a5feb-284f-41ed-97c8-bf3c7f03e8fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c3588deddaf4b45ace6cb1e979e2ff8', 'request_id': 'req-a90a5feb-284f-41ed-97c8-bf3c7f03e8fc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:42.218270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a90a5feb-284f-41ed-97c8-bf3c7f03e8fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c3588deddaf4b45ace6cb1e979e2ff8', 'request_id': 'req-a90a5feb-284f-41ed-97c8-bf3c7f03e8fc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:42.228696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a90a5feb-284f-41ed-97c8-bf3c7f03e8fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c3588deddaf4b45ace6cb1e979e2ff8', 'request_id': 'req-a90a5feb-284f-41ed-97c8-bf3c7f03e8fc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:42.231493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a648300e-e54c-48cb-b2ab-8c020ac3a8fc tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:42.252842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a90a5feb-284f-41ed-97c8-bf3c7f03e8fc admin admin] The token cache is being invalidate because project 8c3588deddaf4b45ace6cb1e979e2ff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:42.253253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a90a5feb-284f-41ed-97c8-bf3c7f03e8fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:42.254125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a90a5feb-284f-41ed-97c8-bf3c7f03e8fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:42.256975 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2480/5024] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:34:41 2022] DELETE /identity/v3/projects/8c3588deddaf4b45ace6cb1e979e2ff8 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:42.262061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8633a3-1342-4a93-b283-a2ade534d9c6 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:42.262508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8633a3-1342-4a93-b283-a2ade534d9c6 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:42.262891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8633a3-1342-4a93-b283-a2ade534d9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:42.284041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6c8633a3-1342-4a93-b283-a2ade534d9c6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:42.285664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6c8633a3-1342-4a93-b283-a2ade534d9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:42.306464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ab315-8c8e-4486-abc7-1be67b8e9ec4 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:42.307682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ab315-8c8e-4486-abc7-1be67b8e9ec4 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:42.308077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ab315-8c8e-4486-abc7-1be67b8e9ec4 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:42.308596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ab315-8c8e-4486-abc7-1be67b8e9ec4 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/system/users/f8a3857e478e43b892349a205ee22fe2/roles/86b57ba33993496293ee99b11284cb6c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:42.310539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ab315-8c8e-4486-abc7-1be67b8e9ec4 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f8a3857e478e43b892349a205ee22fe2, role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:42.311781 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-370ab315-8c8e-4486-abc7-1be67b8e9ec4 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:42.311781 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:34:42.311781 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:34:42.312922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ab315-8c8e-4486-abc7-1be67b8e9ec4 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:42.351627 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2481/5025] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:34:42.361133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e03dbf-ffb5-49ce-9776-1218b172c987 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:42.361434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e03dbf-ffb5-49ce-9776-1218b172c987 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:42.361718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e03dbf-ffb5-49ce-9776-1218b172c987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:42.383540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-45e03dbf-ffb5-49ce-9776-1218b172c987 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:42.384905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-45e03dbf-ffb5-49ce-9776-1218b172c987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:42.389763 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2545/5026] 10.222.0.43 () {60 vars in 1377 bytes} [Tue Jul 19 14:34:42 2022] PUT /identity/v3/system/users/f8a3857e478e43b892349a205ee22fe2/roles/86b57ba33993496293ee99b11284cb6c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:42.393931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ab315-8c8e-4486-abc7-1be67b8e9ec4 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:42.395827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-370ab315-8c8e-4486-abc7-1be67b8e9ec4 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:42.409165 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2482/5027] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:34:42.410396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e03dbf-ffb5-49ce-9776-1218b172c987 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:42.411283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ab315-8c8e-4486-abc7-1be67b8e9ec4 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:42.421586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e03dbf-ffb5-49ce-9776-1218b172c987 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:42.427002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e0b95-5696-4e89-a483-55de3ca08212 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:42.427002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e0b95-5696-4e89-a483-55de3ca08212 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:42.427918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e0b95-5696-4e89-a483-55de3ca08212 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:42.428175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e0b95-5696-4e89-a483-55de3ca08212 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/system/users/f8a3857e478e43b892349a205ee22fe2/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:42.429538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e0b95-5696-4e89-a483-55de3ca08212 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=f8a3857e478e43b892349a205ee22fe2)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:42.430604 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-2e6e0b95-5696-4e89-a483-55de3ca08212 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:42.430604 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:34:42.430604 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:34:42.431490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6e0b95-5696-4e89-a483-55de3ca08212 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:42.435741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e54439-4a8c-4560-849b-4e86129633aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:42.436713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e54439-4a8c-4560-849b-4e86129633aa admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:42.437213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e54439-4a8c-4560-849b-4e86129633aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:42.437962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e54439-4a8c-4560-849b-4e86129633aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:42.439430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e54439-4a8c-4560-849b-4e86129633aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:34:42.440070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e54439-4a8c-4560-849b-4e86129633aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:42.441910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e54439-4a8c-4560-849b-4e86129633aa admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:42.445956 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2546/5028] 10.222.0.43 () {58 vars in 1259 bytes} [Tue Jul 19 14:34:42 2022] GET /identity/v3/system/users/f8a3857e478e43b892349a205ee22fe2/roles => generated 374 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:34:42.454792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e0b95-5696-4e89-a483-55de3ca08212 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:42.459378 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2483/5029] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:34:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:34:42.463897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e54439-4a8c-4560-849b-4e86129633aa admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:42.468953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e0b95-5696-4e89-a483-55de3ca08212 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:42.479165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e54439-4a8c-4560-849b-4e86129633aa admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:42.483939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55a17f-5ac1-474a-8081-516714a34307 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:42.485242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55a17f-5ac1-474a-8081-516714a34307 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:42.486231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55a17f-5ac1-474a-8081-516714a34307 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:42.486602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55a17f-5ac1-474a-8081-516714a34307 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/system/users/f8a3857e478e43b892349a205ee22fe2/roles/86b57ba33993496293ee99b11284cb6c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:42.489082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55a17f-5ac1-474a-8081-516714a34307 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=f8a3857e478e43b892349a205ee22fe2, role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:42.490958 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-db55a17f-5ac1-474a-8081-516714a34307 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:42.490958 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:34:42.490958 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:34:42.496189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55a17f-5ac1-474a-8081-516714a34307 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:42.496272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69467038-2843-4b50-b92f-c70bd8ae1b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:42.496272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69467038-2843-4b50-b92f-c70bd8ae1b72 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:42.496272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69467038-2843-4b50-b92f-c70bd8ae1b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:42.496862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69467038-2843-4b50-b92f-c70bd8ae1b72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:42.497173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69467038-2843-4b50-b92f-c70bd8ae1b72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:42.499667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69467038-2843-4b50-b92f-c70bd8ae1b72 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:42.501297 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2547/5030] 10.222.0.43 () {58 vars in 1359 bytes} [Tue Jul 19 14:34:42 2022] HEAD /identity/v3/system/users/f8a3857e478e43b892349a205ee22fe2/roles/86b57ba33993496293ee99b11284cb6c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:42.504134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55a17f-5ac1-474a-8081-516714a34307 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:42.517657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55a17f-5ac1-474a-8081-516714a34307 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:42.523641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e075c-3497-467e-9436-ce3a29b37aaa tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:42.524619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e075c-3497-467e-9436-ce3a29b37aaa tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:42.524913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e075c-3497-467e-9436-ce3a29b37aaa tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:42.526008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e075c-3497-467e-9436-ce3a29b37aaa tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/system/users/f8a3857e478e43b892349a205ee22fe2/roles/86b57ba33993496293ee99b11284cb6c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:42.527412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e075c-3497-467e-9436-ce3a29b37aaa tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=f8a3857e478e43b892349a205ee22fe2, role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:42.528514 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-d66e075c-3497-467e-9436-ce3a29b37aaa tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:42.528514 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:34:42.528514 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:34:42.529480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e075c-3497-467e-9436-ce3a29b37aaa tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:42.620944 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2484/5031] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:34:42 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:42.624624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69467038-2843-4b50-b92f-c70bd8ae1b72 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:42.636738 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2548/5032] 10.222.0.43 () {58 vars in 1361 bytes} [Tue Jul 19 14:34:42 2022] DELETE /identity/v3/system/users/f8a3857e478e43b892349a205ee22fe2/roles/86b57ba33993496293ee99b11284cb6c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:42.641784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e075c-3497-467e-9436-ce3a29b37aaa tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:42.660498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e075c-3497-467e-9436-ce3a29b37aaa tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:42.738579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69467038-2843-4b50-b92f-c70bd8ae1b72 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:42.745992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb55bd7-5331-43fc-af6d-93f255f6551c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:42.746834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb55bd7-5331-43fc-af6d-93f255f6551c admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:42.747571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb55bd7-5331-43fc-af6d-93f255f6551c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:42.747904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb55bd7-5331-43fc-af6d-93f255f6551c admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:42.748620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb55bd7-5331-43fc-af6d-93f255f6551c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:42.751405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb55bd7-5331-43fc-af6d-93f255f6551c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:42.775087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7856f9-8939-40bc-9ea5-feb46d174561 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:42.775734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7856f9-8939-40bc-9ea5-feb46d174561 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:42.776086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7856f9-8939-40bc-9ea5-feb46d174561 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:42.776438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7856f9-8939-40bc-9ea5-feb46d174561 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:42.778074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7856f9-8939-40bc-9ea5-feb46d174561 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:42.779757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7856f9-8939-40bc-9ea5-feb46d174561 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:42.852812 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2485/5033] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:34:42 2022] POST /identity/v3/users => generated 281 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:42.857071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb55bd7-5331-43fc-af6d-93f255f6551c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:42.868991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb55bd7-5331-43fc-af6d-93f255f6551c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:42.878288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d95fcb-64bd-4a10-a558-23570cd8825f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:42.878288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d95fcb-64bd-4a10-a558-23570cd8825f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:42.878288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d95fcb-64bd-4a10-a558-23570cd8825f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:42.879125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d95fcb-64bd-4a10-a558-23570cd8825f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:42.879882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d95fcb-64bd-4a10-a558-23570cd8825f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:42.883178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d95fcb-64bd-4a10-a558-23570cd8825f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:42.884726 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2549/5034] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:34:42 2022] POST /identity/v3/roles => generated 270 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:34:42.885669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7856f9-8939-40bc-9ea5-feb46d174561 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:42.902372 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2486/5035] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:34:42 2022] GET /identity/v3/roles => generated 2320 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:34:42.902576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7856f9-8939-40bc-9ea5-feb46d174561 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:42.903440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d95fcb-64bd-4a10-a558-23570cd8825f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:42.910393 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0eb290-3565-4f81-87a9-3f674ce5d3a3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:42.911366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0eb290-3565-4f81-87a9-3f674ce5d3a3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:42.912219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0eb290-3565-4f81-87a9-3f674ce5d3a3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:42.912918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0eb290-3565-4f81-87a9-3f674ce5d3a3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:42.913636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0eb290-3565-4f81-87a9-3f674ce5d3a3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:42.915689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d95fcb-64bd-4a10-a558-23570cd8825f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:42.915961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0eb290-3565-4f81-87a9-3f674ce5d3a3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:42.920706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc36199-555f-4148-97c3-e326f12a7f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:42.921619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc36199-555f-4148-97c3-e326f12a7f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:42.921619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc36199-555f-4148-97c3-e326f12a7f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:42.922729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc36199-555f-4148-97c3-e326f12a7f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:42.922729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc36199-555f-4148-97c3-e326f12a7f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:42.924162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc36199-555f-4148-97c3-e326f12a7f8a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:42.937457 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2487/5036] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:34:42 2022] GET /identity/v3/roles => generated 2320 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:34:42.941868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc36199-555f-4148-97c3-e326f12a7f8a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:42.952401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc36199-555f-4148-97c3-e326f12a7f8a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:42.957437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dc5ca6-4925-48ee-a487-dd5c4188da21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:42.958474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc5ca6-4925-48ee-a487-dd5c4188da21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:42.959146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc5ca6-4925-48ee-a487-dd5c4188da21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:42.959146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc5ca6-4925-48ee-a487-dd5c4188da21 admin admin] PATH_INFO: `/v3/projects/260730c735c74f6da5b39e6f8f5783c7/users/df144d2d8cc041958b4b659f4232d762/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:42.973848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc5ca6-4925-48ee-a487-dd5c4188da21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=260730c735c74f6da5b39e6f8f5783c7, user_id=df144d2d8cc041958b4b659f4232d762, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:42.977695 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dc5ca6-4925-48ee-a487-dd5c4188da21 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:43.017117 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2550/5037] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:34:42 2022] POST /identity/v3/roles => generated 270 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:43.021205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0eb290-3565-4f81-87a9-3f674ce5d3a3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:43.031270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0eb290-3565-4f81-87a9-3f674ce5d3a3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:43.037379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ee22b-6780-40fd-9464-5942fc20a196 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:43.038475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ee22b-6780-40fd-9464-5942fc20a196 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:43.038814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ee22b-6780-40fd-9464-5942fc20a196 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:43.039031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ee22b-6780-40fd-9464-5942fc20a196 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/8d16d1eb8d9f448b833caa899afe025e/implies/15ac572f35cc414089c6c57d34c1325a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:43.040823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ee22b-6780-40fd-9464-5942fc20a196 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8d16d1eb8d9f448b833caa899afe025e, implied_role_id=15ac572f35cc414089c6c57d34c1325a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:43.042496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ee22b-6780-40fd-9464-5942fc20a196 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:43.109710 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2488/5038] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:34:42 2022] PUT /identity/v3/projects/260730c735c74f6da5b39e6f8f5783c7/users/df144d2d8cc041958b4b659f4232d762/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:43.123742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425327d-52b0-4ab5-b7ff-401294c3065d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:43.124816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425327d-52b0-4ab5-b7ff-401294c3065d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:43.128292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425327d-52b0-4ab5-b7ff-401294c3065d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:43.160704 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2551/5039] 10.222.0.43 () {60 vars in 1362 bytes} [Tue Jul 19 14:34:43 2022] PUT /identity/v3/roles/8d16d1eb8d9f448b833caa899afe025e/implies/15ac572f35cc414089c6c57d34c1325a => generated 531 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:34:43.168144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ee22b-6780-40fd-9464-5942fc20a196 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:43.211771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c425327d-52b0-4ab5-b7ff-401294c3065d None None] MFA Rules not processed for user `df144d2d8cc041958b4b659f4232d762`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:43.213554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c425327d-52b0-4ab5-b7ff-401294c3065d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:43.322198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ee22b-6780-40fd-9464-5942fc20a196 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:43.328107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301f752-086e-45d3-a1af-a1d12c6ad227 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:43.328790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301f752-086e-45d3-a1af-a1d12c6ad227 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:43.329086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301f752-086e-45d3-a1af-a1d12c6ad227 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:43.329412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301f752-086e-45d3-a1af-a1d12c6ad227 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:43.330453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301f752-086e-45d3-a1af-a1d12c6ad227 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:43.332092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301f752-086e-45d3-a1af-a1d12c6ad227 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:43.376182 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2489/5040] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:34:43.398237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425327d-52b0-4ab5-b7ff-401294c3065d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:43.398237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c425327d-52b0-4ab5-b7ff-401294c3065d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:43.463041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425327d-52b0-4ab5-b7ff-401294c3065d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:43.467535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d79c2-5c92-477f-b656-37c73afcb227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:43.472647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d79c2-5c92-477f-b656-37c73afcb227 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:43.472647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d79c2-5c92-477f-b656-37c73afcb227 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:43.472647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33d79c2-5c92-477f-b656-37c73afcb227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:43.476333 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2552/5041] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:34:43 2022] POST /identity/v3/domains => generated 277 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:43.482341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301f752-086e-45d3-a1af-a1d12c6ad227 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:43.483555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d79c2-5c92-477f-b656-37c73afcb227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:43.485250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33d79c2-5c92-477f-b656-37c73afcb227 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:43.497425 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2490/5042] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:34:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:34:43.586322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301f752-086e-45d3-a1af-a1d12c6ad227 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:43.592169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3868416-2626-474c-b6a5-66cbbc10a1a5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:43.593299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3868416-2626-474c-b6a5-66cbbc10a1a5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:43.593656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3868416-2626-474c-b6a5-66cbbc10a1a5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:43.605252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3868416-2626-474c-b6a5-66cbbc10a1a5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:43.605252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3868416-2626-474c-b6a5-66cbbc10a1a5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:43.605252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3868416-2626-474c-b6a5-66cbbc10a1a5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:43.707467 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2553/5043] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:34:43 2022] POST /identity/v3/roles => generated 270 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:43.711556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d79c2-5c92-477f-b656-37c73afcb227 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:43.723622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33d79c2-5c92-477f-b656-37c73afcb227 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:43.732234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960fdb4-5c64-4d80-9c29-851d190b55a9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:43.736999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960fdb4-5c64-4d80-9c29-851d190b55a9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:43.736999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960fdb4-5c64-4d80-9c29-851d190b55a9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:43.736999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960fdb4-5c64-4d80-9c29-851d190b55a9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/8d16d1eb8d9f448b833caa899afe025e/implies/7858334782ef4f1ca5b026b3dc6d3a99` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:43.736999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960fdb4-5c64-4d80-9c29-851d190b55a9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8d16d1eb8d9f448b833caa899afe025e, implied_role_id=7858334782ef4f1ca5b026b3dc6d3a99)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:43.737339 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-a960fdb4-5c64-4d80-9c29-851d190b55a9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:43.737339 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:34:43.737339 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:34:43.737593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960fdb4-5c64-4d80-9c29-851d190b55a9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:43.846654 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:43.914150 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2491/5044] 10.222.0.43 () {60 vars in 1362 bytes} [Tue Jul 19 14:34:43 2022] PUT /identity/v3/roles/8d16d1eb8d9f448b833caa899afe025e/implies/7858334782ef4f1ca5b026b3dc6d3a99 => generated 531 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:43.917901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3868416-2626-474c-b6a5-66cbbc10a1a5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:43.934570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3868416-2626-474c-b6a5-66cbbc10a1a5 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:44.025791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1dc1a8-3900-4c5f-a26a-efb4081b19cd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:44.026783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1dc1a8-3900-4c5f-a26a-efb4081b19cd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:44.027221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1dc1a8-3900-4c5f-a26a-efb4081b19cd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:44.027513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1dc1a8-3900-4c5f-a26a-efb4081b19cd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/8d16d1eb8d9f448b833caa899afe025e/implies/86b57ba33993496293ee99b11284cb6c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:44.030957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1dc1a8-3900-4c5f-a26a-efb4081b19cd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8d16d1eb8d9f448b833caa899afe025e, implied_role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:44.033847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1dc1a8-3900-4c5f-a26a-efb4081b19cd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:44.191844 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2554/5045] 10.222.0.43 () {60 vars in 1362 bytes} [Tue Jul 19 14:34:43 2022] PUT /identity/v3/roles/8d16d1eb8d9f448b833caa899afe025e/implies/86b57ba33993496293ee99b11284cb6c => generated 525 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:44.193393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960fdb4-5c64-4d80-9c29-851d190b55a9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:44.204987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960fdb4-5c64-4d80-9c29-851d190b55a9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:44.324779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8850eb-44d5-4e58-af72-af87a7f8fa99 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:44.324779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8850eb-44d5-4e58-af72-af87a7f8fa99 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:44.325551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8850eb-44d5-4e58-af72-af87a7f8fa99 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:44.327202 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:44.327800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8850eb-44d5-4e58-af72-af87a7f8fa99 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/86b57ba33993496293ee99b11284cb6c/implies/8d16d1eb8d9f448b833caa899afe025e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:44.331562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8850eb-44d5-4e58-af72-af87a7f8fa99 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=86b57ba33993496293ee99b11284cb6c, implied_role_id=8d16d1eb8d9f448b833caa899afe025e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:44.334551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8850eb-44d5-4e58-af72-af87a7f8fa99 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:44.377605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-5b8850eb-44d5-4e58-af72-af87a7f8fa99 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] 8d16d1eb8d9f448b833caa899afe025e cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 8d16d1eb8d9f448b833caa899afe025e cannot be an implied roles. Jul 19 14:34:44.377605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:34:44.377605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:34:44.377605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:34:44.377605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:34:44.377605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:34:44.377605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:34:44.377605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:34:44.377605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:34:44.377605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:34:44.377605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:34:44.377605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:34:44.377605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Jul 19 14:34:44.377605 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Jul 19 14:34:44.378752 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:34:44.378752 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:34:44.378752 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Jul 19 14:34:44.378752 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Jul 19 14:34:44.378752 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 8d16d1eb8d9f448b833caa899afe025e cannot be an implied roles. Jul 19 14:34:44.378752 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:34:44.389464 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2492/5046] 10.222.0.43 () {60 vars in 1362 bytes} [Tue Jul 19 14:34:44 2022] PUT /identity/v3/roles/86b57ba33993496293ee99b11284cb6c/implies/8d16d1eb8d9f448b833caa899afe025e => generated 116 bytes in 197 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:34:44.396778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1dc1a8-3900-4c5f-a26a-efb4081b19cd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:44.409069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1dc1a8-3900-4c5f-a26a-efb4081b19cd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:44.415493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc2e5a-622a-4df9-b511-e55f6363f4fd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:44.416541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc2e5a-622a-4df9-b511-e55f6363f4fd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:44.416929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc2e5a-622a-4df9-b511-e55f6363f4fd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:44.424515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc2e5a-622a-4df9-b511-e55f6363f4fd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/8d16d1eb8d9f448b833caa899afe025e/implies/86b57ba33993496293ee99b11284cb6c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:44.424515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc2e5a-622a-4df9-b511-e55f6363f4fd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8d16d1eb8d9f448b833caa899afe025e, implied_role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:44.424515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc2e5a-622a-4df9-b511-e55f6363f4fd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:44.501766 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2555/5047] 10.222.0.43 () {58 vars in 1346 bytes} [Tue Jul 19 14:34:44 2022] DELETE /identity/v3/roles/8d16d1eb8d9f448b833caa899afe025e/implies/86b57ba33993496293ee99b11284cb6c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:44.503273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8850eb-44d5-4e58-af72-af87a7f8fa99 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:44.518138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8850eb-44d5-4e58-af72-af87a7f8fa99 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:44.681527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f5301-c6f6-45ba-8261-678c1048301c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:44.681527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f5301-c6f6-45ba-8261-678c1048301c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:44.681527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f5301-c6f6-45ba-8261-678c1048301c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:44.681892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f5301-c6f6-45ba-8261-678c1048301c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/8d16d1eb8d9f448b833caa899afe025e/implies/7858334782ef4f1ca5b026b3dc6d3a99` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:44.681892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f5301-c6f6-45ba-8261-678c1048301c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8d16d1eb8d9f448b833caa899afe025e, implied_role_id=7858334782ef4f1ca5b026b3dc6d3a99)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:44.683789 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-4e8f5301-c6f6-45ba-8261-678c1048301c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:44.683789 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:34:44.683789 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:34:44.685280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8f5301-c6f6-45ba-8261-678c1048301c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:44.806981 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2493/5048] 10.222.0.43 () {58 vars in 1346 bytes} [Tue Jul 19 14:34:44 2022] DELETE /identity/v3/roles/8d16d1eb8d9f448b833caa899afe025e/implies/7858334782ef4f1ca5b026b3dc6d3a99 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:44.811175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc2e5a-622a-4df9-b511-e55f6363f4fd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:44.824926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc2e5a-622a-4df9-b511-e55f6363f4fd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:44.902680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1f43c-f789-48c3-9c93-b7f894e6c4ef tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:44.904302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1f43c-f789-48c3-9c93-b7f894e6c4ef tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:44.904671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1f43c-f789-48c3-9c93-b7f894e6c4ef tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:44.904964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1f43c-f789-48c3-9c93-b7f894e6c4ef tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/7858334782ef4f1ca5b026b3dc6d3a99` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:44.906532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1f43c-f789-48c3-9c93-b7f894e6c4ef tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=7858334782ef4f1ca5b026b3dc6d3a99)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:44.908299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1f43c-f789-48c3-9c93-b7f894e6c4ef tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:45.153595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-83d1f43c-f789-48c3-9c93-b7f894e6c4ef tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invalidating the token cache because role 7858334782ef4f1ca5b026b3dc6d3a99 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:45.153937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-83d1f43c-f789-48c3-9c93-b7f894e6c4ef tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:45.154663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-83d1f43c-f789-48c3-9c93-b7f894e6c4ef tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:45.156571 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2556/5049] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:44 2022] DELETE /identity/v3/roles/7858334782ef4f1ca5b026b3dc6d3a99 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:45.160752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f5301-c6f6-45ba-8261-678c1048301c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:45.163553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4e8f5301-c6f6-45ba-8261-678c1048301c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:45.176545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8f5301-c6f6-45ba-8261-678c1048301c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:45.254519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4727c-d68a-4fc7-8eed-d35f2c53eb71 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:45.254519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4727c-d68a-4fc7-8eed-d35f2c53eb71 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:45.254741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4727c-d68a-4fc7-8eed-d35f2c53eb71 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:45.255136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e4727c-d68a-4fc7-8eed-d35f2c53eb71 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/domains/e50d81351fc142e78a847dc34879fc53` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:45.268654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4727c-d68a-4fc7-8eed-d35f2c53eb71 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e50d81351fc142e78a847dc34879fc53)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:45.270883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e4727c-d68a-4fc7-8eed-d35f2c53eb71 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:45.296005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-67e4727c-d68a-4fc7-8eed-d35f2c53eb71 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e50d81351fc142e78a847dc34879fc53'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:45.300517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-67e4727c-d68a-4fc7-8eed-d35f2c53eb71 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e50d81351fc142e78a847dc34879fc53'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:45.455312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-67e4727c-d68a-4fc7-8eed-d35f2c53eb71 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e50d81351fc142e78a847dc34879fc53'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:45.455942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-67e4727c-d68a-4fc7-8eed-d35f2c53eb71 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e50d81351fc142e78a847dc34879fc53'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:45.458929 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2494/5050] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:34:45 2022] PATCH /identity/v3/domains/e50d81351fc142e78a847dc34879fc53 => generated 278 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:34:45.463053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1f43c-f789-48c3-9c93-b7f894e6c4ef tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:45.470765 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:45.475081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1f43c-f789-48c3-9c93-b7f894e6c4ef tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:45.535243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:45.535243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:45.535243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:45.535660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/domains/e50d81351fc142e78a847dc34879fc53` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:45.545070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e50d81351fc142e78a847dc34879fc53)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:45.546752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:45.570755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e50d81351fc142e78a847dc34879fc53'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:45.581211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e50d81351fc142e78a847dc34879fc53'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:45.699188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e50d81351fc142e78a847dc34879fc53', 'request_id': 'req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:45.705602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e50d81351fc142e78a847dc34879fc53', 'request_id': 'req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:45.713537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e50d81351fc142e78a847dc34879fc53', 'request_id': 'req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:45.858240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] The token cache is being invalidate because project e50d81351fc142e78a847dc34879fc53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:45.858957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:45.859662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:45.873656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e50d81351fc142e78a847dc34879fc53', 'request_id': 'req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:45.874912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e50d81351fc142e78a847dc34879fc53', 'request_id': 'req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:45.876219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e50d81351fc142e78a847dc34879fc53', 'request_id': 'req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:45.890213 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2557/5051] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:34:45 2022] DELETE /identity/v3/domains/e50d81351fc142e78a847dc34879fc53 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:45.893911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4727c-d68a-4fc7-8eed-d35f2c53eb71 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:45.895628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-67e4727c-d68a-4fc7-8eed-d35f2c53eb71 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:45.911101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e4727c-d68a-4fc7-8eed-d35f2c53eb71 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:46.028503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1e840-b22a-450f-9cd8-5bee972ee534 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:46.029447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1e840-b22a-450f-9cd8-5bee972ee534 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:46.029740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1e840-b22a-450f-9cd8-5bee972ee534 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:46.030027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1e840-b22a-450f-9cd8-5bee972ee534 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/8d16d1eb8d9f448b833caa899afe025e/implies/15ac572f35cc414089c6c57d34c1325a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:46.031860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1e840-b22a-450f-9cd8-5bee972ee534 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8d16d1eb8d9f448b833caa899afe025e, implied_role_id=15ac572f35cc414089c6c57d34c1325a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:46.033494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1e840-b22a-450f-9cd8-5bee972ee534 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:46.133080 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2495/5052] 10.222.0.43 () {58 vars in 1346 bytes} [Tue Jul 19 14:34:45 2022] DELETE /identity/v3/roles/8d16d1eb8d9f448b833caa899afe025e/implies/15ac572f35cc414089c6c57d34c1325a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:46.138184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:46.139850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:46.154781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008f0a1-7d81-4ef1-97b9-e560f96b6bd7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:46.237352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669877e-d77f-4f6e-8a3e-ea78073b0b50 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:46.238432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669877e-d77f-4f6e-8a3e-ea78073b0b50 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:46.238813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669877e-d77f-4f6e-8a3e-ea78073b0b50 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:46.239205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669877e-d77f-4f6e-8a3e-ea78073b0b50 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/15ac572f35cc414089c6c57d34c1325a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:46.241916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669877e-d77f-4f6e-8a3e-ea78073b0b50 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=15ac572f35cc414089c6c57d34c1325a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:46.244477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669877e-d77f-4f6e-8a3e-ea78073b0b50 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:46.438229 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e669877e-d77f-4f6e-8a3e-ea78073b0b50 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invalidating the token cache because role 15ac572f35cc414089c6c57d34c1325a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:46.439649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e669877e-d77f-4f6e-8a3e-ea78073b0b50 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:46.441411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e669877e-d77f-4f6e-8a3e-ea78073b0b50 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:46.445139 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2558/5053] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:46 2022] DELETE /identity/v3/roles/15ac572f35cc414089c6c57d34c1325a => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:46.449173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1e840-b22a-450f-9cd8-5bee972ee534 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:46.452040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-35b1e840-b22a-450f-9cd8-5bee972ee534 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:46.483231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1e840-b22a-450f-9cd8-5bee972ee534 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:46.592798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b0630-c35c-4b60-8031-4218427ad4f9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:46.593691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b0630-c35c-4b60-8031-4218427ad4f9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:46.593980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b0630-c35c-4b60-8031-4218427ad4f9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:46.594302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958b0630-c35c-4b60-8031-4218427ad4f9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/8d16d1eb8d9f448b833caa899afe025e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:46.595525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b0630-c35c-4b60-8031-4218427ad4f9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=8d16d1eb8d9f448b833caa899afe025e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:46.596554 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-958b0630-c35c-4b60-8031-4218427ad4f9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:46.596554 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:34:46.596554 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:34:46.597424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958b0630-c35c-4b60-8031-4218427ad4f9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:46.754816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-958b0630-c35c-4b60-8031-4218427ad4f9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invalidating the token cache because role 8d16d1eb8d9f448b833caa899afe025e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:46.755226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-958b0630-c35c-4b60-8031-4218427ad4f9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:46.756700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-958b0630-c35c-4b60-8031-4218427ad4f9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:46.760340 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2496/5054] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:46 2022] DELETE /identity/v3/roles/8d16d1eb8d9f448b833caa899afe025e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:46.765796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669877e-d77f-4f6e-8a3e-ea78073b0b50 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:46.792469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669877e-d77f-4f6e-8a3e-ea78073b0b50 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:46.903429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65932ec0-bbae-4b85-947d-292f7c5427e2 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:46.905374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65932ec0-bbae-4b85-947d-292f7c5427e2 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:46.905873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65932ec0-bbae-4b85-947d-292f7c5427e2 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:46.906236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65932ec0-bbae-4b85-947d-292f7c5427e2 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:46.908213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65932ec0-bbae-4b85-947d-292f7c5427e2 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=210827ffdeb241fa9fda087163fd9e40, implied_role_id=32cbe40f99244f1094e81e50721377d3)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:46.910223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65932ec0-bbae-4b85-947d-292f7c5427e2 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:47.118679 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:47.125525 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2559/5055] 10.222.0.43 () {60 vars in 1362 bytes} [Tue Jul 19 14:34:46 2022] PUT /identity/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3 => generated 518 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:34:47.132075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b0630-c35c-4b60-8031-4218427ad4f9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:47.137034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-958b0630-c35c-4b60-8031-4218427ad4f9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:47.180473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958b0630-c35c-4b60-8031-4218427ad4f9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:47.330859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faac9b-1aa6-4236-b95f-cf3d79b04772 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:47.334427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faac9b-1aa6-4236-b95f-cf3d79b04772 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:47.334427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faac9b-1aa6-4236-b95f-cf3d79b04772 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:47.334427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faac9b-1aa6-4236-b95f-cf3d79b04772 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:47.335993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7faac9b-1aa6-4236-b95f-cf3d79b04772 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=210827ffdeb241fa9fda087163fd9e40, implied_role_id=32cbe40f99244f1094e81e50721377d3)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:47.337228 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-a7faac9b-1aa6-4236-b95f-cf3d79b04772 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:47.337228 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:34:47.337228 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:34:47.338812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7faac9b-1aa6-4236-b95f-cf3d79b04772 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:47.340132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7faac9b-1aa6-4236-b95f-cf3d79b04772 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=210827ffdeb241fa9fda087163fd9e40, implied_role_id=32cbe40f99244f1094e81e50721377d3)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:47.342141 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-a7faac9b-1aa6-4236-b95f-cf3d79b04772 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:47.342141 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:34:47.342141 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:34:47.343522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7faac9b-1aa6-4236-b95f-cf3d79b04772 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:47.355679 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2497/5056] 10.222.0.43 () {58 vars in 1344 bytes} [Tue Jul 19 14:34:47 2022] HEAD /identity/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:47.359641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65932ec0-bbae-4b85-947d-292f7c5427e2 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:47.375063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65932ec0-bbae-4b85-947d-292f7c5427e2 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:47.381152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74781c-5d76-4cd9-b3bb-3aa26606540f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:47.381499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74781c-5d76-4cd9-b3bb-3aa26606540f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:47.381756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74781c-5d76-4cd9-b3bb-3aa26606540f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:47.382171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74781c-5d76-4cd9-b3bb-3aa26606540f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:47.384195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74781c-5d76-4cd9-b3bb-3aa26606540f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=210827ffdeb241fa9fda087163fd9e40, implied_role_id=32cbe40f99244f1094e81e50721377d3)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:47.385832 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-4b74781c-5d76-4cd9-b3bb-3aa26606540f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:47.385832 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:34:47.385832 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:34:47.387254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b74781c-5d76-4cd9-b3bb-3aa26606540f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:47.396882 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2560/5057] 10.222.0.43 () {58 vars in 1343 bytes} [Tue Jul 19 14:34:47 2022] GET /identity/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3 => generated 518 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:34:47.401042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faac9b-1aa6-4236-b95f-cf3d79b04772 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:47.412584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faac9b-1aa6-4236-b95f-cf3d79b04772 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:47.421846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfd000-1f7b-466d-96d5-f95d753c6c43 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:47.422921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfd000-1f7b-466d-96d5-f95d753c6c43 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:47.423303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfd000-1f7b-466d-96d5-f95d753c6c43 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:47.423674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bfd000-1f7b-466d-96d5-f95d753c6c43 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:47.425445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfd000-1f7b-466d-96d5-f95d753c6c43 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=210827ffdeb241fa9fda087163fd9e40, implied_role_id=32cbe40f99244f1094e81e50721377d3)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:47.427800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bfd000-1f7b-466d-96d5-f95d753c6c43 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:47.561766 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2498/5058] 10.222.0.43 () {58 vars in 1346 bytes} [Tue Jul 19 14:34:47 2022] DELETE /identity/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:47.569906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74781c-5d76-4cd9-b3bb-3aa26606540f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:47.579725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b74781c-5d76-4cd9-b3bb-3aa26606540f tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:47.718133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b10dad-c00e-4186-9ccd-cb5efd920f32 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:47.726060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b10dad-c00e-4186-9ccd-cb5efd920f32 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:47.728212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b10dad-c00e-4186-9ccd-cb5efd920f32 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:47.730160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b10dad-c00e-4186-9ccd-cb5efd920f32 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:47.732943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b10dad-c00e-4186-9ccd-cb5efd920f32 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=210827ffdeb241fa9fda087163fd9e40, implied_role_id=32cbe40f99244f1094e81e50721377d3)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:47.735010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b10dad-c00e-4186-9ccd-cb5efd920f32 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:47.774714 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-d2b10dad-c00e-4186-9ccd-cb5efd920f32 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] 210827ffdeb241fa9fda087163fd9e40 does not imply 32cbe40f99244f1094e81e50721377d3.: keystone.exception.ImpliedRoleNotFound: 210827ffdeb241fa9fda087163fd9e40 does not imply 32cbe40f99244f1094e81e50721377d3. Jul 19 14:34:47.774714 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:34:47.774714 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 19 14:34:47.774714 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = query.one() Jul 19 14:34:47.774714 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 19 14:34:47.774714 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._iter().one() Jul 19 14:34:47.774714 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 19 14:34:47.774714 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._only_one_row( Jul 19 14:34:47.774714 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 19 14:34:47.774714 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 19 14:34:47.774714 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 19 14:34:47.774714 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:34:47.774714 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:34:47.774714 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:34:47.774714 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:34:47.774714 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:34:47.776103 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:34:47.776103 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:34:47.776103 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:34:47.776103 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:34:47.776103 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:34:47.776103 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:34:47.776103 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:34:47.776103 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:34:47.776103 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:34:47.776103 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Jul 19 14:34:47.776103 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Jul 19 14:34:47.776103 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Jul 19 14:34:47.776103 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Jul 19 14:34:47.776103 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Jul 19 14:34:47.776103 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 19 14:34:47.776103 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 19 14:34:47.777496 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 19 14:34:47.777496 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 210827ffdeb241fa9fda087163fd9e40 does not imply 32cbe40f99244f1094e81e50721377d3. Jul 19 14:34:47.777496 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:34:47.789127 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2561/5059] 10.222.0.43 () {58 vars in 1343 bytes} [Tue Jul 19 14:34:47 2022] GET /identity/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3 => generated 137 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:34:47.792433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfd000-1f7b-466d-96d5-f95d753c6c43 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:47.810039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bfd000-1f7b-466d-96d5-f95d753c6c43 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:47.815026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2faac-f384-4a65-a39c-c555912f7f57 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:47.816201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2faac-f384-4a65-a39c-c555912f7f57 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:47.816487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2faac-f384-4a65-a39c-c555912f7f57 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:47.816768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2faac-f384-4a65-a39c-c555912f7f57 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:47.827689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2faac-f384-4a65-a39c-c555912f7f57 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=210827ffdeb241fa9fda087163fd9e40, implied_role_id=32cbe40f99244f1094e81e50721377d3)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:47.829296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2faac-f384-4a65-a39c-c555912f7f57 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:47.867800 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-e3c2faac-f384-4a65-a39c-c555912f7f57 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] 210827ffdeb241fa9fda087163fd9e40 does not imply 32cbe40f99244f1094e81e50721377d3.: keystone.exception.ImpliedRoleNotFound: 210827ffdeb241fa9fda087163fd9e40 does not imply 32cbe40f99244f1094e81e50721377d3. Jul 19 14:34:47.867800 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:34:47.867800 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 19 14:34:47.867800 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = query.one() Jul 19 14:34:47.867800 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 19 14:34:47.867800 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._iter().one() Jul 19 14:34:47.867800 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 19 14:34:47.867800 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._only_one_row( Jul 19 14:34:47.867800 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 19 14:34:47.867800 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 19 14:34:47.867800 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 19 14:34:47.867800 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:34:47.867800 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:34:47.867800 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:34:47.867800 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:34:47.867800 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:34:47.869082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:34:47.869082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:34:47.869082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:34:47.869082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:34:47.869082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:34:47.869082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:34:47.869082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:34:47.869082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:34:47.869082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:34:47.869082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jul 19 14:34:47.869082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jul 19 14:34:47.869082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:34:47.869082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:34:47.869082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jul 19 14:34:47.869082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jul 19 14:34:47.869082 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jul 19 14:34:47.870052 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 19 14:34:47.870052 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 19 14:34:47.870052 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 19 14:34:47.870052 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 210827ffdeb241fa9fda087163fd9e40 does not imply 32cbe40f99244f1094e81e50721377d3. Jul 19 14:34:47.870052 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:34:47.890947 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2499/5060] 10.222.0.43 () {58 vars in 1346 bytes} [Tue Jul 19 14:34:47 2022] DELETE /identity/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3 => generated 137 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:34:47.898398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b10dad-c00e-4186-9ccd-cb5efd920f32 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:47.917460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b10dad-c00e-4186-9ccd-cb5efd920f32 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:47.939361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088b0b8-9a15-44fb-b2f8-ce97600793ed tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:47.950049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088b0b8-9a15-44fb-b2f8-ce97600793ed tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:47.950701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088b0b8-9a15-44fb-b2f8-ce97600793ed tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:47.951176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088b0b8-9a15-44fb-b2f8-ce97600793ed tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:47.954443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088b0b8-9a15-44fb-b2f8-ce97600793ed tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=210827ffdeb241fa9fda087163fd9e40, implied_role_id=32cbe40f99244f1094e81e50721377d3)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:47.960586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7088b0b8-9a15-44fb-b2f8-ce97600793ed tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:48.107598 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2562/5061] 10.222.0.43 () {60 vars in 1362 bytes} [Tue Jul 19 14:34:47 2022] PUT /identity/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3 => generated 518 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:48.112847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2faac-f384-4a65-a39c-c555912f7f57 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:48.133361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2faac-f384-4a65-a39c-c555912f7f57 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:48.266417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab85cc1-7f91-406b-85b0-89117509562e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:48.266417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab85cc1-7f91-406b-85b0-89117509562e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:48.266417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab85cc1-7f91-406b-85b0-89117509562e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:48.267289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab85cc1-7f91-406b-85b0-89117509562e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/4d4374e182f04200bc351ffd5c1d5f43` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:48.268716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab85cc1-7f91-406b-85b0-89117509562e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=210827ffdeb241fa9fda087163fd9e40, implied_role_id=4d4374e182f04200bc351ffd5c1d5f43)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:48.274197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab85cc1-7f91-406b-85b0-89117509562e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:48.337767 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:48.479946 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2500/5062] 10.222.0.43 () {60 vars in 1362 bytes} [Tue Jul 19 14:34:48 2022] PUT /identity/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/4d4374e182f04200bc351ffd5c1d5f43 => generated 520 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:48.481587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088b0b8-9a15-44fb-b2f8-ce97600793ed tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:48.499102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088b0b8-9a15-44fb-b2f8-ce97600793ed tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:48.590051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939e499-4842-4330-952f-87d17bcb679c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:48.590051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939e499-4842-4330-952f-87d17bcb679c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:48.590051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939e499-4842-4330-952f-87d17bcb679c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:48.590554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939e499-4842-4330-952f-87d17bcb679c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/4d4374e182f04200bc351ffd5c1d5f43/implies/86b57ba33993496293ee99b11284cb6c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:48.592162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939e499-4842-4330-952f-87d17bcb679c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4d4374e182f04200bc351ffd5c1d5f43, implied_role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:48.593732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939e499-4842-4330-952f-87d17bcb679c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:48.772257 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:48.783623 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2563/5063] 10.222.0.43 () {60 vars in 1362 bytes} [Tue Jul 19 14:34:48 2022] PUT /identity/v3/roles/4d4374e182f04200bc351ffd5c1d5f43/implies/86b57ba33993496293ee99b11284cb6c => generated 520 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:48.783783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab85cc1-7f91-406b-85b0-89117509562e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:48.794662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab85cc1-7f91-406b-85b0-89117509562e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:48.919011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511d348-d200-4948-b964-5b6bd8a3c79e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:48.919981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d348-d200-4948-b964-5b6bd8a3c79e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:48.923516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d348-d200-4948-b964-5b6bd8a3c79e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:48.923516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7511d348-d200-4948-b964-5b6bd8a3c79e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:48.923516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511d348-d200-4948-b964-5b6bd8a3c79e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:48.923516 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-7511d348-d200-4948-b964-5b6bd8a3c79e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:48.923516 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:34:48.923516 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:34:48.924236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7511d348-d200-4948-b964-5b6bd8a3c79e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:48.954621 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2501/5064] 10.222.0.43 () {58 vars in 1151 bytes} [Tue Jul 19 14:34:48 2022] GET /identity/v3/role_inferences => generated 1604 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:34:48.959784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939e499-4842-4330-952f-87d17bcb679c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:48.975531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939e499-4842-4330-952f-87d17bcb679c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:48.986949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7ad5c-09d9-42b2-a6ef-8cdb8e9211da tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:48.988865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7ad5c-09d9-42b2-a6ef-8cdb8e9211da tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:48.989168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7ad5c-09d9-42b2-a6ef-8cdb8e9211da tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:48.989456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7ad5c-09d9-42b2-a6ef-8cdb8e9211da tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/4d4374e182f04200bc351ffd5c1d5f43/implies/86b57ba33993496293ee99b11284cb6c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:48.996870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7ad5c-09d9-42b2-a6ef-8cdb8e9211da tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4d4374e182f04200bc351ffd5c1d5f43, implied_role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:49.001504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7ad5c-09d9-42b2-a6ef-8cdb8e9211da tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:49.149884 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2564/5065] 10.222.0.43 () {58 vars in 1346 bytes} [Tue Jul 19 14:34:48 2022] DELETE /identity/v3/roles/4d4374e182f04200bc351ffd5c1d5f43/implies/86b57ba33993496293ee99b11284cb6c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:49.154843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511d348-d200-4948-b964-5b6bd8a3c79e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:49.202773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7511d348-d200-4948-b964-5b6bd8a3c79e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:49.339666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a9c8a-c0eb-49cc-abf1-81ba85b524b7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:49.342776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a9c8a-c0eb-49cc-abf1-81ba85b524b7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:49.343086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a9c8a-c0eb-49cc-abf1-81ba85b524b7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:49.344908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a9c8a-c0eb-49cc-abf1-81ba85b524b7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/4d4374e182f04200bc351ffd5c1d5f43` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:49.351632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a9c8a-c0eb-49cc-abf1-81ba85b524b7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=210827ffdeb241fa9fda087163fd9e40, implied_role_id=4d4374e182f04200bc351ffd5c1d5f43)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:49.353322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a9c8a-c0eb-49cc-abf1-81ba85b524b7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:49.487413 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2502/5066] 10.222.0.43 () {58 vars in 1346 bytes} [Tue Jul 19 14:34:49 2022] DELETE /identity/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/4d4374e182f04200bc351ffd5c1d5f43 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:49.492518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7ad5c-09d9-42b2-a6ef-8cdb8e9211da tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:49.511916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7ad5c-09d9-42b2-a6ef-8cdb8e9211da tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:49.625462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ac583-2e7e-4239-af0b-f7221e822feb tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:49.626440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ac583-2e7e-4239-af0b-f7221e822feb tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:49.626733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ac583-2e7e-4239-af0b-f7221e822feb tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:49.627017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ac583-2e7e-4239-af0b-f7221e822feb tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:49.635642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ac583-2e7e-4239-af0b-f7221e822feb tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=210827ffdeb241fa9fda087163fd9e40, implied_role_id=32cbe40f99244f1094e81e50721377d3)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:49.637477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ac583-2e7e-4239-af0b-f7221e822feb tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:49.720641 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2565/5067] 10.222.0.43 () {58 vars in 1346 bytes} [Tue Jul 19 14:34:49 2022] DELETE /identity/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:49.726595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a9c8a-c0eb-49cc-abf1-81ba85b524b7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:49.742782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a9c8a-c0eb-49cc-abf1-81ba85b524b7 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:49.863574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2677a89-cb82-4481-8679-bc8c6a326cdd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:49.864366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2677a89-cb82-4481-8679-bc8c6a326cdd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:49.865172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2677a89-cb82-4481-8679-bc8c6a326cdd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:49.866200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2677a89-cb82-4481-8679-bc8c6a326cdd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:49.866959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2677a89-cb82-4481-8679-bc8c6a326cdd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:49.869340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2677a89-cb82-4481-8679-bc8c6a326cdd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:49.884346 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2503/5068] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:34:49 2022] GET /identity/v3/roles => generated 2320 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:34:49.893057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ac583-2e7e-4239-af0b-f7221e822feb tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:49.915774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ac583-2e7e-4239-af0b-f7221e822feb tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:49.922549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6d4be-46d8-406b-b4b9-d2473de88786 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:49.924070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6d4be-46d8-406b-b4b9-d2473de88786 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:49.924701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6d4be-46d8-406b-b4b9-d2473de88786 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:49.925174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed6d4be-46d8-406b-b4b9-d2473de88786 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:49.927891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6d4be-46d8-406b-b4b9-d2473de88786 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:49.932185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed6d4be-46d8-406b-b4b9-d2473de88786 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:50.053825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2677a89-cb82-4481-8679-bc8c6a326cdd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:50.055803 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2566/5069] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:34:49 2022] POST /identity/v3/roles => generated 234 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:50.064851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2677a89-cb82-4481-8679-bc8c6a326cdd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:50.070963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79867ab-0770-40cf-8b99-be118f754431 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:50.072315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79867ab-0770-40cf-8b99-be118f754431 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:50.072824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79867ab-0770-40cf-8b99-be118f754431 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:50.073279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79867ab-0770-40cf-8b99-be118f754431 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/2754a5ccaded4add9afd2511bd471a57` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:50.080730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79867ab-0770-40cf-8b99-be118f754431 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:update_role(role_id=2754a5ccaded4add9afd2511bd471a57)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:50.080730 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-b79867ab-0770-40cf-8b99-be118f754431 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:50.080730 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:34:50.080730 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:34:50.080730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79867ab-0770-40cf-8b99-be118f754431 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:50.203834 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2504/5070] 10.222.0.43 () {60 vars in 1242 bytes} [Tue Jul 19 14:34:50 2022] PATCH /identity/v3/roles/2754a5ccaded4add9afd2511bd471a57 => generated 237 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:34:50.207980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6d4be-46d8-406b-b4b9-d2473de88786 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:50.228023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed6d4be-46d8-406b-b4b9-d2473de88786 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:50.233592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf7109-6655-4164-b392-8fe222f7c9dd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:50.237002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf7109-6655-4164-b392-8fe222f7c9dd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:50.237002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf7109-6655-4164-b392-8fe222f7c9dd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:50.237002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cf7109-6655-4164-b392-8fe222f7c9dd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/2754a5ccaded4add9afd2511bd471a57` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:50.247130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf7109-6655-4164-b392-8fe222f7c9dd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:get_role(role_id=2754a5ccaded4add9afd2511bd471a57)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:50.248324 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-40cf7109-6655-4164-b392-8fe222f7c9dd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:50.248324 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:34:50.248324 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:34:50.249552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cf7109-6655-4164-b392-8fe222f7c9dd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:50.252233 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2567/5071] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Jul 19 14:34:50 2022] GET /identity/v3/roles/2754a5ccaded4add9afd2511bd471a57 => generated 237 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:34:50.257195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79867ab-0770-40cf-8b99-be118f754431 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:50.270288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79867ab-0770-40cf-8b99-be118f754431 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:50.280713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d1341-f685-4d2a-964a-5a994d4c3e8c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:50.282770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d1341-f685-4d2a-964a-5a994d4c3e8c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:50.284381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d1341-f685-4d2a-964a-5a994d4c3e8c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:50.284921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31d1341-f685-4d2a-964a-5a994d4c3e8c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:50.286204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d1341-f685-4d2a-964a-5a994d4c3e8c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:50.289373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31d1341-f685-4d2a-964a-5a994d4c3e8c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:50.334645 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2505/5072] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:34:50 2022] GET /identity/v3/roles => generated 2548 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:34:50.338580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf7109-6655-4164-b392-8fe222f7c9dd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:50.355328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cf7109-6655-4164-b392-8fe222f7c9dd tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:50.362216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bae6e-1e24-4866-b802-5fc9a8bc931d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:50.363099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bae6e-1e24-4866-b802-5fc9a8bc931d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:50.363692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bae6e-1e24-4866-b802-5fc9a8bc931d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:50.364224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bae6e-1e24-4866-b802-5fc9a8bc931d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/2754a5ccaded4add9afd2511bd471a57` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:50.366747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bae6e-1e24-4866-b802-5fc9a8bc931d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2754a5ccaded4add9afd2511bd471a57)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:50.368032 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-8d5bae6e-1e24-4866-b802-5fc9a8bc931d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:50.368032 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:34:50.368032 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:34:50.368952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bae6e-1e24-4866-b802-5fc9a8bc931d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:50.514033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8d5bae6e-1e24-4866-b802-5fc9a8bc931d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invalidating the token cache because role 2754a5ccaded4add9afd2511bd471a57 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:50.514436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8d5bae6e-1e24-4866-b802-5fc9a8bc931d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:50.517202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8d5bae6e-1e24-4866-b802-5fc9a8bc931d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:50.519632 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2568/5073] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:50 2022] DELETE /identity/v3/roles/2754a5ccaded4add9afd2511bd471a57 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:50.526567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d1341-f685-4d2a-964a-5a994d4c3e8c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:50.528617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c31d1341-f685-4d2a-964a-5a994d4c3e8c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:50.545422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31d1341-f685-4d2a-964a-5a994d4c3e8c tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:50.639212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89eaeec-897c-40f5-95dc-577fb9a0a0d3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:50.639212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89eaeec-897c-40f5-95dc-577fb9a0a0d3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:50.639212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89eaeec-897c-40f5-95dc-577fb9a0a0d3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:50.639481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89eaeec-897c-40f5-95dc-577fb9a0a0d3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:50.639481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89eaeec-897c-40f5-95dc-577fb9a0a0d3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=210827ffdeb241fa9fda087163fd9e40, implied_role_id=32cbe40f99244f1094e81e50721377d3)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:50.639481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89eaeec-897c-40f5-95dc-577fb9a0a0d3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:50.857853 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2506/5074] 10.222.0.43 () {60 vars in 1362 bytes} [Tue Jul 19 14:34:50 2022] PUT /identity/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3 => generated 518 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:50.861986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bae6e-1e24-4866-b802-5fc9a8bc931d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:50.875840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bae6e-1e24-4866-b802-5fc9a8bc931d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:50.988022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f07609-faac-4413-8aa1-75b4edd11635 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:50.989251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f07609-faac-4413-8aa1-75b4edd11635 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:50.990482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f07609-faac-4413-8aa1-75b4edd11635 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:50.991034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f07609-faac-4413-8aa1-75b4edd11635 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/4d4374e182f04200bc351ffd5c1d5f43` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:50.994189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f07609-faac-4413-8aa1-75b4edd11635 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=210827ffdeb241fa9fda087163fd9e40, implied_role_id=4d4374e182f04200bc351ffd5c1d5f43)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:50.997828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f07609-faac-4413-8aa1-75b4edd11635 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:51.219296 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:51.226855 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2569/5075] 10.222.0.43 () {60 vars in 1362 bytes} [Tue Jul 19 14:34:50 2022] PUT /identity/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/4d4374e182f04200bc351ffd5c1d5f43 => generated 520 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:34:51.231445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89eaeec-897c-40f5-95dc-577fb9a0a0d3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:51.246263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89eaeec-897c-40f5-95dc-577fb9a0a0d3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:51.274781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f07609-faac-4413-8aa1-75b4edd11635 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:51.276855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-86f07609-faac-4413-8aa1-75b4edd11635 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:51.404467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f07609-faac-4413-8aa1-75b4edd11635 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:51.413223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0fa65-b4b7-4d11-8234-829b87f77f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:51.414878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0fa65-b4b7-4d11-8234-829b87f77f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:51.415520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0fa65-b4b7-4d11-8234-829b87f77f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:51.416279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0fa65-b4b7-4d11-8234-829b87f77f58 admin admin] PATH_INFO: `/v3/users/1757f193cde04293aa2747373f83910a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:51.417934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0fa65-b4b7-4d11-8234-829b87f77f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1757f193cde04293aa2747373f83910a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:51.421370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0fa65-b4b7-4d11-8234-829b87f77f58 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:51.446018 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:51.497311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5373697-602e-4455-aca1-8c36fd55bb9d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:51.504287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5373697-602e-4455-aca1-8c36fd55bb9d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:51.504287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5373697-602e-4455-aca1-8c36fd55bb9d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:51.504287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5373697-602e-4455-aca1-8c36fd55bb9d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/4d4374e182f04200bc351ffd5c1d5f43/implies/86b57ba33993496293ee99b11284cb6c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:51.504287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5373697-602e-4455-aca1-8c36fd55bb9d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=4d4374e182f04200bc351ffd5c1d5f43, implied_role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:51.504732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5373697-602e-4455-aca1-8c36fd55bb9d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:51.650323 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2507/5076] 10.222.0.43 () {60 vars in 1362 bytes} [Tue Jul 19 14:34:51 2022] PUT /identity/v3/roles/4d4374e182f04200bc351ffd5c1d5f43/implies/86b57ba33993496293ee99b11284cb6c => generated 520 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:34:51.651683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5373697-602e-4455-aca1-8c36fd55bb9d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:51.655085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9cf0fa65-b4b7-4d11-8234-829b87f77f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1757f193cde04293aa2747373f83910a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:51.669522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9cf0fa65-b4b7-4d11-8234-829b87f77f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1757f193cde04293aa2747373f83910a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:51.680457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9cf0fa65-b4b7-4d11-8234-829b87f77f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1757f193cde04293aa2747373f83910a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:51.681215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9cf0fa65-b4b7-4d11-8234-829b87f77f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1757f193cde04293aa2747373f83910a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:51.727229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5373697-602e-4455-aca1-8c36fd55bb9d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:51.731861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9a342-d769-4c1f-bf29-62e4d8206c1d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:51.732767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9a342-d769-4c1f-bf29-62e4d8206c1d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:51.733055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9a342-d769-4c1f-bf29-62e4d8206c1d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:51.733330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef9a342-d769-4c1f-bf29-62e4d8206c1d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/4d4374e182f04200bc351ffd5c1d5f43/implies` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:51.734587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9a342-d769-4c1f-bf29-62e4d8206c1d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=4d4374e182f04200bc351ffd5c1d5f43)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:51.736142 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-fef9a342-d769-4c1f-bf29-62e4d8206c1d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:51.736142 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:34:51.736142 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:34:51.736512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef9a342-d769-4c1f-bf29-62e4d8206c1d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:51.743124 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2508/5077] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jul 19 14:34:51 2022] GET /identity/v3/roles/4d4374e182f04200bc351ffd5c1d5f43/implies => generated 489 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:34:51.747179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9a342-d769-4c1f-bf29-62e4d8206c1d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:51.757235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef9a342-d769-4c1f-bf29-62e4d8206c1d tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:51.762405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fa7d1-f1e4-4ad3-bc34-4efbde5783da tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:51.763266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fa7d1-f1e4-4ad3-bc34-4efbde5783da tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:51.770647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fa7d1-f1e4-4ad3-bc34-4efbde5783da tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:51.770647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fa7d1-f1e4-4ad3-bc34-4efbde5783da tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:51.770647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fa7d1-f1e4-4ad3-bc34-4efbde5783da tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=210827ffdeb241fa9fda087163fd9e40)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:51.770647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fa7d1-f1e4-4ad3-bc34-4efbde5783da tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:51.774597 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2509/5078] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jul 19 14:34:51 2022] GET /identity/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies => generated 658 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:34:51.778659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fa7d1-f1e4-4ad3-bc34-4efbde5783da tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:51.788851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fa7d1-f1e4-4ad3-bc34-4efbde5783da tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:51.793734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62258a73-4f7c-47ab-96d7-e65e58298729 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:51.794687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62258a73-4f7c-47ab-96d7-e65e58298729 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:51.795000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62258a73-4f7c-47ab-96d7-e65e58298729 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:51.795282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62258a73-4f7c-47ab-96d7-e65e58298729 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/4d4374e182f04200bc351ffd5c1d5f43/implies/86b57ba33993496293ee99b11284cb6c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:51.796982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62258a73-4f7c-47ab-96d7-e65e58298729 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=4d4374e182f04200bc351ffd5c1d5f43, implied_role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:51.798584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62258a73-4f7c-47ab-96d7-e65e58298729 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:51.818367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9cf0fa65-b4b7-4d11-8234-829b87f77f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1757f193cde04293aa2747373f83910a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:51.828329 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2570/5079] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:51 2022] DELETE /identity/v3/users/1757f193cde04293aa2747373f83910a => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:51.833915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30f77b-d906-40d1-b4a4-53b87fd4840f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:51.834696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30f77b-d906-40d1-b4a4-53b87fd4840f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:51.834696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30f77b-d906-40d1-b4a4-53b87fd4840f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:51.857088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2f30f77b-d906-40d1-b4a4-53b87fd4840f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:51.862275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2f30f77b-d906-40d1-b4a4-53b87fd4840f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:51.911124 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2510/5080] 10.222.0.43 () {58 vars in 1346 bytes} [Tue Jul 19 14:34:51 2022] DELETE /identity/v3/roles/4d4374e182f04200bc351ffd5c1d5f43/implies/86b57ba33993496293ee99b11284cb6c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:51.916255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62258a73-4f7c-47ab-96d7-e65e58298729 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:51.918222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-62258a73-4f7c-47ab-96d7-e65e58298729 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:51.950035 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2571/5081] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:34:51.962997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30f77b-d906-40d1-b4a4-53b87fd4840f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:51.964927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2f30f77b-d906-40d1-b4a4-53b87fd4840f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:52.017535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62258a73-4f7c-47ab-96d7-e65e58298729 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:52.047592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba32aa-e714-4991-ad43-5c58a6c4a1b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:52.048559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba32aa-e714-4991-ad43-5c58a6c4a1b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:52.048848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba32aa-e714-4991-ad43-5c58a6c4a1b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:52.050087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeba32aa-e714-4991-ad43-5c58a6c4a1b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/4d4374e182f04200bc351ffd5c1d5f43` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:52.051960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba32aa-e714-4991-ad43-5c58a6c4a1b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=210827ffdeb241fa9fda087163fd9e40, implied_role_id=4d4374e182f04200bc351ffd5c1d5f43)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:52.053753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeba32aa-e714-4991-ad43-5c58a6c4a1b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:52.061343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30f77b-d906-40d1-b4a4-53b87fd4840f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:52.138890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314805e-08b1-41c1-adfa-d83d2a0b8344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:52.139559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314805e-08b1-41c1-adfa-d83d2a0b8344 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:52.139859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314805e-08b1-41c1-adfa-d83d2a0b8344 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:52.140127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314805e-08b1-41c1-adfa-d83d2a0b8344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:52.150783 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2511/5082] 10.222.0.43 () {58 vars in 1346 bytes} [Tue Jul 19 14:34:51 2022] DELETE /identity/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/4d4374e182f04200bc351ffd5c1d5f43 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:52.160044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba32aa-e714-4991-ad43-5c58a6c4a1b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:52.246878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeba32aa-e714-4991-ad43-5c58a6c4a1b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:52.255055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f4748-5466-403a-bde8-c92db20a20a3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:52.255055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f4748-5466-403a-bde8-c92db20a20a3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:52.255055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f4748-5466-403a-bde8-c92db20a20a3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:52.256525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f4748-5466-403a-bde8-c92db20a20a3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:52.259449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f4748-5466-403a-bde8-c92db20a20a3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=210827ffdeb241fa9fda087163fd9e40, implied_role_id=32cbe40f99244f1094e81e50721377d3)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:52.262178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f4748-5466-403a-bde8-c92db20a20a3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:52.308434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314805e-08b1-41c1-adfa-d83d2a0b8344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:52.310784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314805e-08b1-41c1-adfa-d83d2a0b8344 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:52.326828 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2512/5083] 10.222.0.43 () {58 vars in 1346 bytes} [Tue Jul 19 14:34:52 2022] DELETE /identity/v3/roles/210827ffdeb241fa9fda087163fd9e40/implies/32cbe40f99244f1094e81e50721377d3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:52.331780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f4748-5466-403a-bde8-c92db20a20a3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:52.334777 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2572/5084] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:34:52.417267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f4748-5466-403a-bde8-c92db20a20a3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:52.422212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16588da2-5963-4c00-ab61-86f64af1b9d8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:52.426348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16588da2-5963-4c00-ab61-86f64af1b9d8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:52.426348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16588da2-5963-4c00-ab61-86f64af1b9d8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:52.426348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16588da2-5963-4c00-ab61-86f64af1b9d8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/domains/e50d81351fc142e78a847dc34879fc53` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:52.432751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16588da2-5963-4c00-ab61-86f64af1b9d8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 14:34:52.443500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-16588da2-5963-4c00-ab61-86f64af1b9d8 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Could not find domain: e50d81351fc142e78a847dc34879fc53.: keystone.exception.DomainNotFound: Could not find domain: e50d81351fc142e78a847dc34879fc53. Jul 19 14:34:52.443500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:34:52.443500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 14:34:52.443500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 14:34:52.443500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 14:34:52.443500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 14:34:52.443500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 14:34:52.443500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 14:34:52.443500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e50d81351fc142e78a847dc34879fc53. Jul 19 14:34:52.443500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:34:52.443500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:34:52.443500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:34:52.443500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:34:52.443500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:34:52.443500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:34:52.443500 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:34:52.445244 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:34:52.445244 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:34:52.445244 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:34:52.445244 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:34:52.445244 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:34:52.445244 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:34:52.445244 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:34:52.445244 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 14:34:52.445244 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 14:34:52.445244 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 14:34:52.445244 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 14:34:52.445244 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 14:34:52.445244 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 14:34:52.445244 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:34:52.445244 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:34:52.445244 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:34:52.449890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:34:52.449890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:34:52.449890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:34:52.449890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:34:52.449890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 14:34:52.449890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:34:52.449890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:34:52.449890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:34:52.449890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:34:52.449890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:34:52.449890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:34:52.449890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:34:52.449890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:34:52.449890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 14:34:52.449890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 14:34:52.449890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e50d81351fc142e78a847dc34879fc53. Jul 19 14:34:52.449890 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:34:52.451197 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2513/5085] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:34:52 2022] PATCH /identity/v3/domains/e50d81351fc142e78a847dc34879fc53 => generated 112 bytes in 114 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:34:52.451286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314805e-08b1-41c1-adfa-d83d2a0b8344 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:52.461864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314805e-08b1-41c1-adfa-d83d2a0b8344 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:52.466599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045ef12-6a72-4a22-96b5-202c6393230e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:52.467851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045ef12-6a72-4a22-96b5-202c6393230e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:52.468408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045ef12-6a72-4a22-96b5-202c6393230e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:52.468760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045ef12-6a72-4a22-96b5-202c6393230e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/users/f8a3857e478e43b892349a205ee22fe2` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:52.470159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045ef12-6a72-4a22-96b5-202c6393230e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f8a3857e478e43b892349a205ee22fe2)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:52.472145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045ef12-6a72-4a22-96b5-202c6393230e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:52.556140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb07d7-c65f-4750-a2af-90f5daec92c5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:52.556756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb07d7-c65f-4750-a2af-90f5daec92c5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:52.557218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cb07d7-c65f-4750-a2af-90f5daec92c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:52.578553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-60cb07d7-c65f-4750-a2af-90f5daec92c5 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:52.579768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-60cb07d7-c65f-4750-a2af-90f5daec92c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:52.642145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2045ef12-6a72-4a22-96b5-202c6393230e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a3857e478e43b892349a205ee22fe2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:52.657442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2045ef12-6a72-4a22-96b5-202c6393230e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a3857e478e43b892349a205ee22fe2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:52.658162 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2514/5086] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:34:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:34:52.665371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2045ef12-6a72-4a22-96b5-202c6393230e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a3857e478e43b892349a205ee22fe2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:52.666171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2045ef12-6a72-4a22-96b5-202c6393230e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a3857e478e43b892349a205ee22fe2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:52.780698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb07d7-c65f-4750-a2af-90f5daec92c5 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:52.782798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2045ef12-6a72-4a22-96b5-202c6393230e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a3857e478e43b892349a205ee22fe2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:52.785503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-60cb07d7-c65f-4750-a2af-90f5daec92c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:52.810548 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2573/5087] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:52 2022] DELETE /identity/v3/users/f8a3857e478e43b892349a205ee22fe2 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:52.812142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045ef12-6a72-4a22-96b5-202c6393230e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:52.814042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2045ef12-6a72-4a22-96b5-202c6393230e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:52.880085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cb07d7-c65f-4750-a2af-90f5daec92c5 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:52.887449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045ef12-6a72-4a22-96b5-202c6393230e tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:52.892661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8c476-fadb-48b3-b90d-b037530848b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:52.893528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8c476-fadb-48b3-b90d-b037530848b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:52.893815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8c476-fadb-48b3-b90d-b037530848b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:52.894125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8c476-fadb-48b3-b90d-b037530848b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/86b57ba33993496293ee99b11284cb6c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:52.896370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8c476-fadb-48b3-b90d-b037530848b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_role(role_id=86b57ba33993496293ee99b11284cb6c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:52.898055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8c476-fadb-48b3-b90d-b037530848b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:52.951887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce382d5f-6bdc-44ef-83e8-682bc54cf7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:52.952882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce382d5f-6bdc-44ef-83e8-682bc54cf7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:52.953473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce382d5f-6bdc-44ef-83e8-682bc54cf7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:52.953981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce382d5f-6bdc-44ef-83e8-682bc54cf7bd admin admin] PATH_INFO: `/v3/projects/d5f50fc8bc5c4ec9a37a09359144a146` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:52.955619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce382d5f-6bdc-44ef-83e8-682bc54cf7bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5f50fc8bc5c4ec9a37a09359144a146)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:52.957928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce382d5f-6bdc-44ef-83e8-682bc54cf7bd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:52.982213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c5d8c476-fadb-48b3-b90d-b037530848b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invalidating the token cache because role 86b57ba33993496293ee99b11284cb6c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:52.984731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c5d8c476-fadb-48b3-b90d-b037530848b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:52.984731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c5d8c476-fadb-48b3-b90d-b037530848b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:52.985143 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2574/5088] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:52 2022] DELETE /identity/v3/roles/86b57ba33993496293ee99b11284cb6c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:52.986212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8c476-fadb-48b3-b90d-b037530848b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:52.989057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c5d8c476-fadb-48b3-b90d-b037530848b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:53.076817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8c476-fadb-48b3-b90d-b037530848b9 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:53.084114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139ced9-c6ba-4b0b-888c-5ade203afbde service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:53.085248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139ced9-c6ba-4b0b-888c-5ade203afbde service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:53.085618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139ced9-c6ba-4b0b-888c-5ade203afbde service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:53.088026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c139ced9-c6ba-4b0b-888c-5ade203afbde service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:53.088660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c139ced9-c6ba-4b0b-888c-5ade203afbde service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:53.140863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce382d5f-6bdc-44ef-83e8-682bc54cf7bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5f50fc8bc5c4ec9a37a09359144a146', 'request_id': 'req-ce382d5f-6bdc-44ef-83e8-682bc54cf7bd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:53.168201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139ced9-c6ba-4b0b-888c-5ade203afbde service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:53.170995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c139ced9-c6ba-4b0b-888c-5ade203afbde service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:53.193537 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2575/5089] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:34:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:34:53.194571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139ced9-c6ba-4b0b-888c-5ade203afbde service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:53.196116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c139ced9-c6ba-4b0b-888c-5ade203afbde service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:53.251545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce382d5f-6bdc-44ef-83e8-682bc54cf7bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5f50fc8bc5c4ec9a37a09359144a146', 'request_id': 'req-ce382d5f-6bdc-44ef-83e8-682bc54cf7bd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:53.261747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce382d5f-6bdc-44ef-83e8-682bc54cf7bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5f50fc8bc5c4ec9a37a09359144a146', 'request_id': 'req-ce382d5f-6bdc-44ef-83e8-682bc54cf7bd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:53.285560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce382d5f-6bdc-44ef-83e8-682bc54cf7bd admin admin] The token cache is being invalidate because project d5f50fc8bc5c4ec9a37a09359144a146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:53.285868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce382d5f-6bdc-44ef-83e8-682bc54cf7bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:53.288235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce382d5f-6bdc-44ef-83e8-682bc54cf7bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:53.294813 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2515/5090] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:34:52 2022] DELETE /identity/v3/projects/d5f50fc8bc5c4ec9a37a09359144a146 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:53.296407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288c1c0-8065-440d-8be4-e8852b41bbde None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:53.296760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288c1c0-8065-440d-8be4-e8852b41bbde None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:53.297097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288c1c0-8065-440d-8be4-e8852b41bbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:53.336665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c139ced9-c6ba-4b0b-888c-5ade203afbde service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:53.349583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5288c1c0-8065-440d-8be4-e8852b41bbde None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:53.353038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5288c1c0-8065-440d-8be4-e8852b41bbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:53.413449 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:53.422560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51c13a-48e9-4665-ab0f-2f2d11058cf3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:53.424077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51c13a-48e9-4665-ab0f-2f2d11058cf3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:53.424520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51c13a-48e9-4665-ab0f-2f2d11058cf3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:53.424949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51c13a-48e9-4665-ab0f-2f2d11058cf3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/groups/150b5a7b57164bc4a26fcf69638506af` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:53.428899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51c13a-48e9-4665-ab0f-2f2d11058cf3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_group(group_id=150b5a7b57164bc4a26fcf69638506af)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:53.431149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51c13a-48e9-4665-ab0f-2f2d11058cf3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:53.492976 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2516/5091] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:34:53.498218 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:53.501878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0377c16-c370-4ec5-9197-324019cfb709 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:53.504722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0377c16-c370-4ec5-9197-324019cfb709 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:53.506190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0377c16-c370-4ec5-9197-324019cfb709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:53.563814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b0377c16-c370-4ec5-9197-324019cfb709 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:53.570191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b0377c16-c370-4ec5-9197-324019cfb709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:53.580178 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2576/5092] 10.222.0.43 () {58 vars in 1226 bytes} [Tue Jul 19 14:34:53 2022] DELETE /identity/v3/groups/150b5a7b57164bc4a26fcf69638506af => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:53.586617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51c13a-48e9-4665-ab0f-2f2d11058cf3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:53.592488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9c51c13a-48e9-4665-ab0f-2f2d11058cf3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:53.749572 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2517/5093] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:34:53.752680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0377c16-c370-4ec5-9197-324019cfb709 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:53.758553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51c13a-48e9-4665-ab0f-2f2d11058cf3 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:53.765295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0377c16-c370-4ec5-9197-324019cfb709 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:53.773740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52523882-da7a-4d4b-86f4-b6e3fca8edae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:53.776393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52523882-da7a-4d4b-86f4-b6e3fca8edae admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:53.776393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52523882-da7a-4d4b-86f4-b6e3fca8edae admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:53.776393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52523882-da7a-4d4b-86f4-b6e3fca8edae admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:53.776393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52523882-da7a-4d4b-86f4-b6e3fca8edae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:34:53.776908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52523882-da7a-4d4b-86f4-b6e3fca8edae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:53.779110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52523882-da7a-4d4b-86f4-b6e3fca8edae admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:53.800784 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2518/5094] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:34:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:34:53.803201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52523882-da7a-4d4b-86f4-b6e3fca8edae admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:53.809202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ae062-fdc5-4eaf-bbae-58b3d2b4001a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:53.811386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ae062-fdc5-4eaf-bbae-58b3d2b4001a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:53.817164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ae062-fdc5-4eaf-bbae-58b3d2b4001a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:53.817542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ae062-fdc5-4eaf-bbae-58b3d2b4001a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:53.818731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52523882-da7a-4d4b-86f4-b6e3fca8edae admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:53.823488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ae062-fdc5-4eaf-bbae-58b3d2b4001a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fd3fc98505d64511a4a55f1ce9bc0c3f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:53.825266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a43bf4-77ec-4e09-9f97-32e272b16cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:53.826222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a43bf4-77ec-4e09-9f97-32e272b16cec admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:53.826620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a43bf4-77ec-4e09-9f97-32e272b16cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:53.826970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a43bf4-77ec-4e09-9f97-32e272b16cec admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:53.827688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a43bf4-77ec-4e09-9f97-32e272b16cec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:53.829214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998ae062-fdc5-4eaf-bbae-58b3d2b4001a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:53.831575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a43bf4-77ec-4e09-9f97-32e272b16cec admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:54.011598 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2519/5095] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:34:53 2022] POST /identity/v3/projects => generated 367 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:54.015504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a43bf4-77ec-4e09-9f97-32e272b16cec admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:54.028369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-998ae062-fdc5-4eaf-bbae-58b3d2b4001a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd3fc98505d64511a4a55f1ce9bc0c3f', 'request_id': 'req-998ae062-fdc5-4eaf-bbae-58b3d2b4001a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:54.035374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-998ae062-fdc5-4eaf-bbae-58b3d2b4001a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd3fc98505d64511a4a55f1ce9bc0c3f', 'request_id': 'req-998ae062-fdc5-4eaf-bbae-58b3d2b4001a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:54.043845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-998ae062-fdc5-4eaf-bbae-58b3d2b4001a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd3fc98505d64511a4a55f1ce9bc0c3f', 'request_id': 'req-998ae062-fdc5-4eaf-bbae-58b3d2b4001a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:54.115079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a43bf4-77ec-4e09-9f97-32e272b16cec admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:54.121560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49edb90-a296-4fb8-8ac8-4e7e86ca5ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:54.122588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49edb90-a296-4fb8-8ac8-4e7e86ca5ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:54.124069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49edb90-a296-4fb8-8ac8-4e7e86ca5ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:54.129195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49edb90-a296-4fb8-8ac8-4e7e86ca5ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:54.129195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49edb90-a296-4fb8-8ac8-4e7e86ca5ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:54.129195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49edb90-a296-4fb8-8ac8-4e7e86ca5ee0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:54.132856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-998ae062-fdc5-4eaf-bbae-58b3d2b4001a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] The token cache is being invalidate because project fd3fc98505d64511a4a55f1ce9bc0c3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:54.133213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-998ae062-fdc5-4eaf-bbae-58b3d2b4001a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:54.134484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-998ae062-fdc5-4eaf-bbae-58b3d2b4001a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:54.139026 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2577/5096] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:34:53 2022] DELETE /identity/v3/projects/fd3fc98505d64511a4a55f1ce9bc0c3f => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:54.140232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ae062-fdc5-4eaf-bbae-58b3d2b4001a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:54.143111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-998ae062-fdc5-4eaf-bbae-58b3d2b4001a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:54.243787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ae062-fdc5-4eaf-bbae-58b3d2b4001a tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:54.250229 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2520/5097] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:34:54 2022] POST /identity/v3/users => generated 284 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:34:54.263356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49edb90-a296-4fb8-8ac8-4e7e86ca5ee0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:54.265678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b49edb90-a296-4fb8-8ac8-4e7e86ca5ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:54.284111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49edb90-a296-4fb8-8ac8-4e7e86ca5ee0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:54.293760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839ad21-1ed0-4d26-a4f8-444c9a48ab35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:54.294825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839ad21-1ed0-4d26-a4f8-444c9a48ab35 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:54.295215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839ad21-1ed0-4d26-a4f8-444c9a48ab35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:54.295594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839ad21-1ed0-4d26-a4f8-444c9a48ab35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:54.296439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839ad21-1ed0-4d26-a4f8-444c9a48ab35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:54.298838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839ad21-1ed0-4d26-a4f8-444c9a48ab35 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:54.316615 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2521/5098] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:34:54 2022] GET /identity/v3/roles => generated 2095 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:34:54.321763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839ad21-1ed0-4d26-a4f8-444c9a48ab35 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:54.338845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839ad21-1ed0-4d26-a4f8-444c9a48ab35 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:54.348877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232bcb08-4369-4eb7-9aed-06f287fffe05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:54.349637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bcb08-4369-4eb7-9aed-06f287fffe05 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:54.350387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bcb08-4369-4eb7-9aed-06f287fffe05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:54.351293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232bcb08-4369-4eb7-9aed-06f287fffe05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:54.352570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232bcb08-4369-4eb7-9aed-06f287fffe05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:54.354657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232bcb08-4369-4eb7-9aed-06f287fffe05 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:54.376649 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2522/5099] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:34:54 2022] GET /identity/v3/roles => generated 2095 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:34:54.380847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232bcb08-4369-4eb7-9aed-06f287fffe05 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:54.390194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f1042-ce12-4979-aff4-72cc0d3cfaea tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:54.391821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f1042-ce12-4979-aff4-72cc0d3cfaea tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:54.392271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f1042-ce12-4979-aff4-72cc0d3cfaea tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:54.392818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07f1042-ce12-4979-aff4-72cc0d3cfaea tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/domains/6a14b1ecc8c743f09dfa68486e59b36c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:54.394427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f1042-ce12-4979-aff4-72cc0d3cfaea tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6a14b1ecc8c743f09dfa68486e59b36c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:54.396931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07f1042-ce12-4979-aff4-72cc0d3cfaea tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:54.404594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232bcb08-4369-4eb7-9aed-06f287fffe05 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:54.419391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39255c3b-44f4-44d7-a4f8-223b51f781c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:54.420997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39255c3b-44f4-44d7-a4f8-223b51f781c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:54.420997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39255c3b-44f4-44d7-a4f8-223b51f781c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:54.421200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39255c3b-44f4-44d7-a4f8-223b51f781c5 admin admin] PATH_INFO: `/v3/projects/ee66cb37b9184d6496624455ef8a56f5/users/d6ef8be2796d4491b8a93afe7e10846e/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:54.439385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e07f1042-ce12-4979-aff4-72cc0d3cfaea tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6a14b1ecc8c743f09dfa68486e59b36c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:54.443302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e07f1042-ce12-4979-aff4-72cc0d3cfaea tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6a14b1ecc8c743f09dfa68486e59b36c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:54.467225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39255c3b-44f4-44d7-a4f8-223b51f781c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee66cb37b9184d6496624455ef8a56f5, user_id=d6ef8be2796d4491b8a93afe7e10846e, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:54.470268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39255c3b-44f4-44d7-a4f8-223b51f781c5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:54.574752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e07f1042-ce12-4979-aff4-72cc0d3cfaea tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6a14b1ecc8c743f09dfa68486e59b36c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:54.576003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e07f1042-ce12-4979-aff4-72cc0d3cfaea tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6a14b1ecc8c743f09dfa68486e59b36c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:54.583526 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2578/5100] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:34:54 2022] PATCH /identity/v3/domains/6a14b1ecc8c743f09dfa68486e59b36c => generated 276 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:34:54.584648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f1042-ce12-4979-aff4-72cc0d3cfaea tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:54.585876 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2523/5101] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:34:54 2022] PUT /identity/v3/projects/ee66cb37b9184d6496624455ef8a56f5/users/d6ef8be2796d4491b8a93afe7e10846e/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:54.597194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e07f1042-ce12-4979-aff4-72cc0d3cfaea tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:54.597771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6781669-60ab-4050-9342-357bfc9da50f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:54.598609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6781669-60ab-4050-9342-357bfc9da50f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:54.602189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6781669-60ab-4050-9342-357bfc9da50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:54.652540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c6781669-60ab-4050-9342-357bfc9da50f None None] MFA Rules not processed for user `d6ef8be2796d4491b8a93afe7e10846e`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:54.654214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c6781669-60ab-4050-9342-357bfc9da50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:54.778500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07f1042-ce12-4979-aff4-72cc0d3cfaea tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:54.812515 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2524/5102] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:34:54.854592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6781669-60ab-4050-9342-357bfc9da50f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:54.869313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c6781669-60ab-4050-9342-357bfc9da50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:54.956465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580d18f-789e-482c-aaec-d71202d02c75 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:54.957649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580d18f-789e-482c-aaec-d71202d02c75 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:54.957944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580d18f-789e-482c-aaec-d71202d02c75 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:54.958284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580d18f-789e-482c-aaec-d71202d02c75 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/domains/6a14b1ecc8c743f09dfa68486e59b36c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:54.998221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580d18f-789e-482c-aaec-d71202d02c75 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6a14b1ecc8c743f09dfa68486e59b36c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:55.000079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580d18f-789e-482c-aaec-d71202d02c75 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:55.062379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a580d18f-789e-482c-aaec-d71202d02c75 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6a14b1ecc8c743f09dfa68486e59b36c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:55.088454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a580d18f-789e-482c-aaec-d71202d02c75 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6a14b1ecc8c743f09dfa68486e59b36c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:55.151286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6781669-60ab-4050-9342-357bfc9da50f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:55.159893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dedba5-4055-4118-b5b1-8437dff0db1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:55.163382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dedba5-4055-4118-b5b1-8437dff0db1d service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:55.163904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dedba5-4055-4118-b5b1-8437dff0db1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:55.164342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dedba5-4055-4118-b5b1-8437dff0db1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:55.176545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dedba5-4055-4118-b5b1-8437dff0db1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:55.179566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dedba5-4055-4118-b5b1-8437dff0db1d service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:55.228570 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2525/5103] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:34:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:34:55.243591 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:55.280257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a580d18f-789e-482c-aaec-d71202d02c75 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a14b1ecc8c743f09dfa68486e59b36c', 'request_id': 'req-a580d18f-789e-482c-aaec-d71202d02c75'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:55.288289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a580d18f-789e-482c-aaec-d71202d02c75 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a14b1ecc8c743f09dfa68486e59b36c', 'request_id': 'req-a580d18f-789e-482c-aaec-d71202d02c75'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:55.297738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a580d18f-789e-482c-aaec-d71202d02c75 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a14b1ecc8c743f09dfa68486e59b36c', 'request_id': 'req-a580d18f-789e-482c-aaec-d71202d02c75'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:55.398568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a580d18f-789e-482c-aaec-d71202d02c75 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] The token cache is being invalidate because project 6a14b1ecc8c743f09dfa68486e59b36c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:55.400083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a580d18f-789e-482c-aaec-d71202d02c75 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:55.401133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a580d18f-789e-482c-aaec-d71202d02c75 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:55.415822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a580d18f-789e-482c-aaec-d71202d02c75 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6a14b1ecc8c743f09dfa68486e59b36c', 'request_id': 'req-a580d18f-789e-482c-aaec-d71202d02c75'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:55.417288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a580d18f-789e-482c-aaec-d71202d02c75 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6a14b1ecc8c743f09dfa68486e59b36c', 'request_id': 'req-a580d18f-789e-482c-aaec-d71202d02c75'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:55.419503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a580d18f-789e-482c-aaec-d71202d02c75 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6a14b1ecc8c743f09dfa68486e59b36c', 'request_id': 'req-a580d18f-789e-482c-aaec-d71202d02c75'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:55.436639 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2579/5104] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:34:54 2022] DELETE /identity/v3/domains/6a14b1ecc8c743f09dfa68486e59b36c => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:55.437355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dedba5-4055-4118-b5b1-8437dff0db1d service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:55.460130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dedba5-4055-4118-b5b1-8437dff0db1d service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:55.507365 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:55.627943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a25d34-67da-46c0-8a7f-23375755eb96 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:55.628780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a25d34-67da-46c0-8a7f-23375755eb96 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:55.629069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a25d34-67da-46c0-8a7f-23375755eb96 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:55.629352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a25d34-67da-46c0-8a7f-23375755eb96 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/4d4374e182f04200bc351ffd5c1d5f43` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:55.630996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a25d34-67da-46c0-8a7f-23375755eb96 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4d4374e182f04200bc351ffd5c1d5f43)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:55.632158 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-64a25d34-67da-46c0-8a7f-23375755eb96 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:34:55.632158 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:34:55.632158 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:34:55.633050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a25d34-67da-46c0-8a7f-23375755eb96 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:55.823798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-64a25d34-67da-46c0-8a7f-23375755eb96 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invalidating the token cache because role 4d4374e182f04200bc351ffd5c1d5f43 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:55.824584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-64a25d34-67da-46c0-8a7f-23375755eb96 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:55.825293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-64a25d34-67da-46c0-8a7f-23375755eb96 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:55.832125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580d18f-789e-482c-aaec-d71202d02c75 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:55.832928 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2526/5105] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:55 2022] DELETE /identity/v3/roles/4d4374e182f04200bc351ffd5c1d5f43 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:34:55.838977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a580d18f-789e-482c-aaec-d71202d02c75 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:55.857008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580d18f-789e-482c-aaec-d71202d02c75 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:56.023106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86726b-5df3-41cd-9151-2f8348a14836 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:56.024015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86726b-5df3-41cd-9151-2f8348a14836 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:56.024311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86726b-5df3-41cd-9151-2f8348a14836 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:56.027146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86726b-5df3-41cd-9151-2f8348a14836 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/32cbe40f99244f1094e81e50721377d3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:56.032517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb86726b-5df3-41cd-9151-2f8348a14836 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_role(role_id=32cbe40f99244f1094e81e50721377d3)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:56.034849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb86726b-5df3-41cd-9151-2f8348a14836 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:56.168462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fb86726b-5df3-41cd-9151-2f8348a14836 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invalidating the token cache because role 32cbe40f99244f1094e81e50721377d3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:56.168702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fb86726b-5df3-41cd-9151-2f8348a14836 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:56.169406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fb86726b-5df3-41cd-9151-2f8348a14836 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:56.171770 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2580/5106] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:55 2022] DELETE /identity/v3/roles/32cbe40f99244f1094e81e50721377d3 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:56.176439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a25d34-67da-46c0-8a7f-23375755eb96 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:56.179054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-64a25d34-67da-46c0-8a7f-23375755eb96 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:56.199477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a25d34-67da-46c0-8a7f-23375755eb96 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:56.286607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa27af-a0c6-43a1-bc18-b08900b9ef36 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9172ab1ac8db4fbdb8f84f9cea0c9678', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:56.288117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa27af-a0c6-43a1-bc18-b08900b9ef36 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:56.289034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa27af-a0c6-43a1-bc18-b08900b9ef36 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:56.289694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa27af-a0c6-43a1-bc18-b08900b9ef36 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] PATH_INFO: `/v3/roles/210827ffdeb241fa9fda087163fd9e40` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:56.296053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa27af-a0c6-43a1-bc18-b08900b9ef36 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorizing `identity:delete_role(role_id=210827ffdeb241fa9fda087163fd9e40)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:56.298380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa27af-a0c6-43a1-bc18-b08900b9ef36 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:56.518451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1dfa27af-a0c6-43a1-bc18-b08900b9ef36 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invalidating the token cache because role 210827ffdeb241fa9fda087163fd9e40 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:56.521550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1dfa27af-a0c6-43a1-bc18-b08900b9ef36 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:56.523005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1dfa27af-a0c6-43a1-bc18-b08900b9ef36 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:56.528103 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2527/5107] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:56 2022] DELETE /identity/v3/roles/210827ffdeb241fa9fda087163fd9e40 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:56.529649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86726b-5df3-41cd-9151-2f8348a14836 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:56.531694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fb86726b-5df3-41cd-9151-2f8348a14836 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:56.697101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86726b-5df3-41cd-9151-2f8348a14836 tempest-RolesV3TestJSON-1918494037 tempest-RolesV3TestJSON-1918494037-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:56.798789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb317301-8086-49da-b9d2-f0da26347464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:56.799913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb317301-8086-49da-b9d2-f0da26347464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:56.800053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb317301-8086-49da-b9d2-f0da26347464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:56.800329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb317301-8086-49da-b9d2-f0da26347464 admin admin] PATH_INFO: `/v3/users/5b8ba5a7a00d4a1d9d22ad08fe61980a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:56.801578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb317301-8086-49da-b9d2-f0da26347464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b8ba5a7a00d4a1d9d22ad08fe61980a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:56.804121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb317301-8086-49da-b9d2-f0da26347464 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:56.817096 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:57.103737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-eb317301-8086-49da-b9d2-f0da26347464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b8ba5a7a00d4a1d9d22ad08fe61980a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:57.120132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-eb317301-8086-49da-b9d2-f0da26347464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b8ba5a7a00d4a1d9d22ad08fe61980a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:57.142691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-eb317301-8086-49da-b9d2-f0da26347464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b8ba5a7a00d4a1d9d22ad08fe61980a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:57.144339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-eb317301-8086-49da-b9d2-f0da26347464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b8ba5a7a00d4a1d9d22ad08fe61980a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:57.234467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-eb317301-8086-49da-b9d2-f0da26347464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b8ba5a7a00d4a1d9d22ad08fe61980a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:57.246552 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2581/5108] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:56 2022] DELETE /identity/v3/users/5b8ba5a7a00d4a1d9d22ad08fe61980a => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:57.251108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0c3d9-0dbe-4682-913e-c1267591c82c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:57.251407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0c3d9-0dbe-4682-913e-c1267591c82c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:57.251692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0c3d9-0dbe-4682-913e-c1267591c82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:57.263223 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:57.276090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-07f0c3d9-0dbe-4682-913e-c1267591c82c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:34:57.279069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-07f0c3d9-0dbe-4682-913e-c1267591c82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:57.435508 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2528/5109] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:34:57.442478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb317301-8086-49da-b9d2-f0da26347464 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:57.446186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-eb317301-8086-49da-b9d2-f0da26347464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:57.582567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb317301-8086-49da-b9d2-f0da26347464 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:57.588136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95df5c-acb0-4d72-84b3-42ecc7d330f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:57.589895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95df5c-acb0-4d72-84b3-42ecc7d330f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:57.590315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95df5c-acb0-4d72-84b3-42ecc7d330f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:57.590842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b95df5c-acb0-4d72-84b3-42ecc7d330f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:57.607823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95df5c-acb0-4d72-84b3-42ecc7d330f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:57.611211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b95df5c-acb0-4d72-84b3-42ecc7d330f2 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:57.628318 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2582/5110] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:34:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:34:58.346855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0c3d9-0dbe-4682-913e-c1267591c82c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:58.349329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-07f0c3d9-0dbe-4682-913e-c1267591c82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:34:58.372513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0c3d9-0dbe-4682-913e-c1267591c82c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:58.386202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2b2f7-d810-4394-a6ab-2238925a37ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:58.388604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2b2f7-d810-4394-a6ab-2238925a37ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:58.388604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2b2f7-d810-4394-a6ab-2238925a37ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:58.388604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b2b2f7-d810-4394-a6ab-2238925a37ea admin admin] PATH_INFO: `/v3/projects/f0ea1dcbb5a6410b81d4190a1a86a501` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:58.389235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2b2f7-d810-4394-a6ab-2238925a37ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0ea1dcbb5a6410b81d4190a1a86a501)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:58.394160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b2b2f7-d810-4394-a6ab-2238925a37ea admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:58.451993 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:58.572502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-99b2b2f7-d810-4394-a6ab-2238925a37ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ea1dcbb5a6410b81d4190a1a86a501', 'request_id': 'req-99b2b2f7-d810-4394-a6ab-2238925a37ea'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:58.629687 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:34:58.667898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-99b2b2f7-d810-4394-a6ab-2238925a37ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ea1dcbb5a6410b81d4190a1a86a501', 'request_id': 'req-99b2b2f7-d810-4394-a6ab-2238925a37ea'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:58.679379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-99b2b2f7-d810-4394-a6ab-2238925a37ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ea1dcbb5a6410b81d4190a1a86a501', 'request_id': 'req-99b2b2f7-d810-4394-a6ab-2238925a37ea'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:58.720295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-99b2b2f7-d810-4394-a6ab-2238925a37ea admin admin] The token cache is being invalidate because project f0ea1dcbb5a6410b81d4190a1a86a501 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:34:58.720949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-99b2b2f7-d810-4394-a6ab-2238925a37ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:58.723847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-99b2b2f7-d810-4394-a6ab-2238925a37ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:58.727203 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2529/5111] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:34:58 2022] DELETE /identity/v3/projects/f0ea1dcbb5a6410b81d4190a1a86a501 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:58.731186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95df5c-acb0-4d72-84b3-42ecc7d330f2 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:58.747147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b95df5c-acb0-4d72-84b3-42ecc7d330f2 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:34:58.888744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f16c2-f185-4122-9d83-26ffbcd9a0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:34:58.891521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f16c2-f185-4122-9d83-26ffbcd9a0f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:34:58.892780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f16c2-f185-4122-9d83-26ffbcd9a0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:34:58.893273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9f16c2-f185-4122-9d83-26ffbcd9a0f6 admin admin] PATH_INFO: `/v3/users/9172ab1ac8db4fbdb8f84f9cea0c9678` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:34:58.895007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f16c2-f185-4122-9d83-26ffbcd9a0f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9172ab1ac8db4fbdb8f84f9cea0c9678)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:34:58.897963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9f16c2-f185-4122-9d83-26ffbcd9a0f6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:34:59.443227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1f9f16c2-f185-4122-9d83-26ffbcd9a0f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9172ab1ac8db4fbdb8f84f9cea0c9678'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:59.491797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1f9f16c2-f185-4122-9d83-26ffbcd9a0f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9172ab1ac8db4fbdb8f84f9cea0c9678'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:59.516633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1f9f16c2-f185-4122-9d83-26ffbcd9a0f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9172ab1ac8db4fbdb8f84f9cea0c9678'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:59.516633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1f9f16c2-f185-4122-9d83-26ffbcd9a0f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9172ab1ac8db4fbdb8f84f9cea0c9678'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:59.633980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1f9f16c2-f185-4122-9d83-26ffbcd9a0f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9172ab1ac8db4fbdb8f84f9cea0c9678'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:34:59.642224 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2583/5112] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:34:58 2022] DELETE /identity/v3/users/9172ab1ac8db4fbdb8f84f9cea0c9678 => generated 0 bytes in 911 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:34:59.927822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2b2f7-d810-4394-a6ab-2238925a37ea admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:34:59.930578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-99b2b2f7-d810-4394-a6ab-2238925a37ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:00.129591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b2b2f7-d810-4394-a6ab-2238925a37ea admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:00.208130 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:00.354684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0542aec-6777-44b8-9b52-ab65ed265b37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:00.360029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0542aec-6777-44b8-9b52-ab65ed265b37 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:00.360645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0542aec-6777-44b8-9b52-ab65ed265b37 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:00.362524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0542aec-6777-44b8-9b52-ab65ed265b37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:00.368286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c0542aec-6777-44b8-9b52-ab65ed265b37 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:00.407556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0542aec-6777-44b8-9b52-ab65ed265b37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:00.409967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0542aec-6777-44b8-9b52-ab65ed265b37 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:00.444606 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2530/5113] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:34:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:35:00.866534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f16c2-f185-4122-9d83-26ffbcd9a0f6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:00.868793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1f9f16c2-f185-4122-9d83-26ffbcd9a0f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:00.909829 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:01.115761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9f16c2-f185-4122-9d83-26ffbcd9a0f6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:01.121754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032547f-baf1-4189-99e4-d12a76d0d0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:01.123056 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032547f-baf1-4189-99e4-d12a76d0d0e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:01.123355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032547f-baf1-4189-99e4-d12a76d0d0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:01.124081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032547f-baf1-4189-99e4-d12a76d0d0e1 admin admin] PATH_INFO: `/v3/projects/fc6b942fc94d4e34a92b4f8f093fd6ca` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:01.125440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032547f-baf1-4189-99e4-d12a76d0d0e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc6b942fc94d4e34a92b4f8f093fd6ca)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:01.127401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032547f-baf1-4189-99e4-d12a76d0d0e1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:01.284622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5032547f-baf1-4189-99e4-d12a76d0d0e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'request_id': 'req-5032547f-baf1-4189-99e4-d12a76d0d0e1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:01.299190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5032547f-baf1-4189-99e4-d12a76d0d0e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'request_id': 'req-5032547f-baf1-4189-99e4-d12a76d0d0e1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:01.313129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5032547f-baf1-4189-99e4-d12a76d0d0e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc6b942fc94d4e34a92b4f8f093fd6ca', 'request_id': 'req-5032547f-baf1-4189-99e4-d12a76d0d0e1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:01.441272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5032547f-baf1-4189-99e4-d12a76d0d0e1 admin admin] The token cache is being invalidate because project fc6b942fc94d4e34a92b4f8f093fd6ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:35:01.441635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5032547f-baf1-4189-99e4-d12a76d0d0e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:01.448144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5032547f-baf1-4189-99e4-d12a76d0d0e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:01.455316 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2584/5114] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:35:00 2022] DELETE /identity/v3/projects/fc6b942fc94d4e34a92b4f8f093fd6ca => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:01.457514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f788a6-ad6d-4178-bc06-4b0f1d6037f5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:01.457974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f788a6-ad6d-4178-bc06-4b0f1d6037f5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:01.458460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f788a6-ad6d-4178-bc06-4b0f1d6037f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:01.512335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-89f788a6-ad6d-4178-bc06-4b0f1d6037f5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:01.514167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-89f788a6-ad6d-4178-bc06-4b0f1d6037f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:01.585295 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:01.673823 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2531/5115] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:35:01.683089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaa509-34fb-4e40-bfda-0f0eb68d32c8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:01.683717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaa509-34fb-4e40-bfda-0f0eb68d32c8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:01.684102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaa509-34fb-4e40-bfda-0f0eb68d32c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:01.726085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9afaa509-34fb-4e40-bfda-0f0eb68d32c8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:01.727389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9afaa509-34fb-4e40-bfda-0f0eb68d32c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:01.765935 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2585/5116] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:01.766034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f788a6-ad6d-4178-bc06-4b0f1d6037f5 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:01.775391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f788a6-ad6d-4178-bc06-4b0f1d6037f5 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:01.793801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce580ec-87f9-4e97-9994-dc43c633c5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:01.793801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce580ec-87f9-4e97-9994-dc43c633c5e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:01.793801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce580ec-87f9-4e97-9994-dc43c633c5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:01.793801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce580ec-87f9-4e97-9994-dc43c633c5e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:01.794258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce580ec-87f9-4e97-9994-dc43c633c5e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:35:01.794258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce580ec-87f9-4e97-9994-dc43c633c5e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:01.795869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce580ec-87f9-4e97-9994-dc43c633c5e6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:01.837013 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2532/5117] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:35:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:35:01.837974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaa509-34fb-4e40-bfda-0f0eb68d32c8 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:01.851636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaa509-34fb-4e40-bfda-0f0eb68d32c8 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:01.863118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4718d20-9393-48c8-8aac-45a67eb94544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:01.863916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4718d20-9393-48c8-8aac-45a67eb94544 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:01.864261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4718d20-9393-48c8-8aac-45a67eb94544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:01.864621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4718d20-9393-48c8-8aac-45a67eb94544 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:01.865404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4718d20-9393-48c8-8aac-45a67eb94544 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:01.874396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4718d20-9393-48c8-8aac-45a67eb94544 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:02.031147 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2586/5118] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:35:01 2022] POST /identity/v3/projects => generated 367 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:35:02.032006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce580ec-87f9-4e97-9994-dc43c633c5e6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:02.050785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce580ec-87f9-4e97-9994-dc43c633c5e6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:02.190670 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:02.231474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef5bd3-d292-4074-8e2c-a66c767f5007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:02.233157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef5bd3-d292-4074-8e2c-a66c767f5007 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:02.238932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef5bd3-d292-4074-8e2c-a66c767f5007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:02.238932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef5bd3-d292-4074-8e2c-a66c767f5007 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:02.238932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef5bd3-d292-4074-8e2c-a66c767f5007 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:02.238932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef5bd3-d292-4074-8e2c-a66c767f5007 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:02.372992 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2533/5119] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:35:02 2022] POST /identity/v3/users => generated 284 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:35:02.377642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4718d20-9393-48c8-8aac-45a67eb94544 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:02.389393 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4718d20-9393-48c8-8aac-45a67eb94544 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:02.396199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324f5f0-68fd-4d35-b6fe-e5aeab9d743c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:02.397121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324f5f0-68fd-4d35-b6fe-e5aeab9d743c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:02.397799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324f5f0-68fd-4d35-b6fe-e5aeab9d743c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:02.398749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324f5f0-68fd-4d35-b6fe-e5aeab9d743c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:02.400530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324f5f0-68fd-4d35-b6fe-e5aeab9d743c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:02.403352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7324f5f0-68fd-4d35-b6fe-e5aeab9d743c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:02.417025 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2587/5120] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:35:02.421159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef5bd3-d292-4074-8e2c-a66c767f5007 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:02.452003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef5bd3-d292-4074-8e2c-a66c767f5007 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:02.452327 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:02.477854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3256c-f400-4203-9a1d-45a3a2143312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:02.479549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3256c-f400-4203-9a1d-45a3a2143312 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:02.479853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3256c-f400-4203-9a1d-45a3a2143312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:02.480135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3256c-f400-4203-9a1d-45a3a2143312 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:02.480901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3256c-f400-4203-9a1d-45a3a2143312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:02.484345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3256c-f400-4203-9a1d-45a3a2143312 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:02.503801 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2534/5121] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:35:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:35:02.509402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324f5f0-68fd-4d35-b6fe-e5aeab9d743c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:02.542178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324f5f0-68fd-4d35-b6fe-e5aeab9d743c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:02.572196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8a30e-bc41-4842-b01b-7c0fccc5d742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:02.576095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8a30e-bc41-4842-b01b-7c0fccc5d742 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:02.576095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8a30e-bc41-4842-b01b-7c0fccc5d742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:02.576095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8a30e-bc41-4842-b01b-7c0fccc5d742 admin admin] PATH_INFO: `/v3/projects/d75f722c6487429993afa88dc268d3c3/users/54b861c2fa64477295b3b3506c43d5ad/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:02.623667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8a30e-bc41-4842-b01b-7c0fccc5d742 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d75f722c6487429993afa88dc268d3c3, user_id=54b861c2fa64477295b3b3506c43d5ad, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:02.626935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8a30e-bc41-4842-b01b-7c0fccc5d742 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:02.781465 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2588/5122] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:35:02 2022] PUT /identity/v3/projects/d75f722c6487429993afa88dc268d3c3/users/54b861c2fa64477295b3b3506c43d5ad/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:02.800815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4f54c-87b6-48b7-afce-674c25fad2c1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:02.801141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4f54c-87b6-48b7-afce-674c25fad2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:02.801396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4f54c-87b6-48b7-afce-674c25fad2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:02.936481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3fa4f54c-87b6-48b7-afce-674c25fad2c1 None None] MFA Rules not processed for user `54b861c2fa64477295b3b3506c43d5ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:02.937801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3fa4f54c-87b6-48b7-afce-674c25fad2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:03.233141 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2535/5123] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:03.235336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8a30e-bc41-4842-b01b-7c0fccc5d742 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:03.260202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8a30e-bc41-4842-b01b-7c0fccc5d742 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:03.275154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168d10f-be7d-4fae-8a4f-95fb85d61192 tempest-TestApiDiscovery-314849656 tempest-TestApiDiscovery-314849656-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b861c2fa64477295b3b3506c43d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75f722c6487429993afa88dc268d3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:03.277398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168d10f-be7d-4fae-8a4f-95fb85d61192 tempest-TestApiDiscovery-314849656 tempest-TestApiDiscovery-314849656-project] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:03.281836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168d10f-be7d-4fae-8a4f-95fb85d61192 tempest-TestApiDiscovery-314849656 tempest-TestApiDiscovery-314849656-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:03.282464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5168d10f-be7d-4fae-8a4f-95fb85d61192 tempest-TestApiDiscovery-314849656 tempest-TestApiDiscovery-314849656-project] PATH_INFO: `/v3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:03.289580 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2589/5124] 10.222.0.43 () {58 vars in 1103 bytes} [Tue Jul 19 14:35:03 2022] GET /identity/v3 => generated 255 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:35:03.294345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4f54c-87b6-48b7-afce-674c25fad2c1 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:03.332180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4f54c-87b6-48b7-afce-674c25fad2c1 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:03.332764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addb933d-6de3-4b2c-9c8e-d53e74b58893 tempest-TestApiDiscovery-314849656 tempest-TestApiDiscovery-314849656-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b861c2fa64477295b3b3506c43d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75f722c6487429993afa88dc268d3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:03.333519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb933d-6de3-4b2c-9c8e-d53e74b58893 tempest-TestApiDiscovery-314849656 tempest-TestApiDiscovery-314849656-project] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:03.333812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb933d-6de3-4b2c-9c8e-d53e74b58893 tempest-TestApiDiscovery-314849656 tempest-TestApiDiscovery-314849656-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:03.334121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addb933d-6de3-4b2c-9c8e-d53e74b58893 tempest-TestApiDiscovery-314849656 tempest-TestApiDiscovery-314849656-project] PATH_INFO: `/v3` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:03.336318 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2536/5125] 10.222.0.43 () {58 vars in 1103 bytes} [Tue Jul 19 14:35:03 2022] GET /identity/v3 => generated 255 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:35:03.340559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168d10f-be7d-4fae-8a4f-95fb85d61192 tempest-TestApiDiscovery-314849656 tempest-TestApiDiscovery-314849656-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:03.355549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5168d10f-be7d-4fae-8a4f-95fb85d61192 tempest-TestApiDiscovery-314849656 tempest-TestApiDiscovery-314849656-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:03.366585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acd6af-ffc7-4800-a642-0cd8b524df38 tempest-TestApiDiscovery-314849656 tempest-TestApiDiscovery-314849656-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54b861c2fa64477295b3b3506c43d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd75f722c6487429993afa88dc268d3c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:03.367394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acd6af-ffc7-4800-a642-0cd8b524df38 tempest-TestApiDiscovery-314849656 tempest-TestApiDiscovery-314849656-project] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:03.367761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acd6af-ffc7-4800-a642-0cd8b524df38 tempest-TestApiDiscovery-314849656 tempest-TestApiDiscovery-314849656-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:03.368118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acd6af-ffc7-4800-a642-0cd8b524df38 tempest-TestApiDiscovery-314849656 tempest-TestApiDiscovery-314849656-project] PATH_INFO: `/v3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:03.372106 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:03.375500 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2590/5126] 10.222.0.43 () {58 vars in 1103 bytes} [Tue Jul 19 14:35:03 2022] GET /identity/v3 => generated 255 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:35:03.379120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7433f-1067-4bf8-99ca-2cd651e6a5ff None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:03.379420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7433f-1067-4bf8-99ca-2cd651e6a5ff None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:03.379702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c7433f-1067-4bf8-99ca-2cd651e6a5ff None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:03.382635 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2537/5127] 10.222.0.43 () {56 vars in 894 bytes} [Tue Jul 19 14:35:03 2022] GET /identity/ => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:35:03.387924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b74c20-eb85-42a4-9084-ed2bf0fcc8d7 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:03.388420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b74c20-eb85-42a4-9084-ed2bf0fcc8d7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:03.388651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b74c20-eb85-42a4-9084-ed2bf0fcc8d7 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:03.390339 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2591/5128] 10.222.0.43 () {56 vars in 894 bytes} [Tue Jul 19 14:35:03 2022] GET /identity/ => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 14:35:03.398748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7433f-1067-4bf8-99ca-2cd651e6a5ff None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:03.526605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c7433f-1067-4bf8-99ca-2cd651e6a5ff None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:03.547711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa7fca-0916-4e57-9a5c-dc27e01dd9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:03.548873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa7fca-0916-4e57-9a5c-dc27e01dd9c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:03.549501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa7fca-0916-4e57-9a5c-dc27e01dd9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:03.549943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa7fca-0916-4e57-9a5c-dc27e01dd9c9 admin admin] PATH_INFO: `/v3/users/54b861c2fa64477295b3b3506c43d5ad` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:03.551541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa7fca-0916-4e57-9a5c-dc27e01dd9c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54b861c2fa64477295b3b3506c43d5ad)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:03.554323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa7fca-0916-4e57-9a5c-dc27e01dd9c9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:03.832264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-45aa7fca-0916-4e57-9a5c-dc27e01dd9c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54b861c2fa64477295b3b3506c43d5ad'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:03.863953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-45aa7fca-0916-4e57-9a5c-dc27e01dd9c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54b861c2fa64477295b3b3506c43d5ad'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:03.865954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-45aa7fca-0916-4e57-9a5c-dc27e01dd9c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54b861c2fa64477295b3b3506c43d5ad'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:03.867032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-45aa7fca-0916-4e57-9a5c-dc27e01dd9c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54b861c2fa64477295b3b3506c43d5ad'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:03.884898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-45aa7fca-0916-4e57-9a5c-dc27e01dd9c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54b861c2fa64477295b3b3506c43d5ad'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:03.998146 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2538/5129] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:35:03 2022] DELETE /identity/v3/users/54b861c2fa64477295b3b3506c43d5ad => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:04.002443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074d090-c95c-4138-94e6-d862b02779f5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:04.003406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074d090-c95c-4138-94e6-d862b02779f5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:04.003698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074d090-c95c-4138-94e6-d862b02779f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:04.044259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1074d090-c95c-4138-94e6-d862b02779f5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:04.047294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1074d090-c95c-4138-94e6-d862b02779f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:04.074610 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:04.227928 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2592/5130] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:04.254985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa7fca-0916-4e57-9a5c-dc27e01dd9c9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:04.256895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-45aa7fca-0916-4e57-9a5c-dc27e01dd9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:04.443191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa7fca-0916-4e57-9a5c-dc27e01dd9c9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:04.461594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61582f0a-b297-43e6-b13b-b2a723080481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:04.462450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61582f0a-b297-43e6-b13b-b2a723080481 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:04.464801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61582f0a-b297-43e6-b13b-b2a723080481 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:04.465204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61582f0a-b297-43e6-b13b-b2a723080481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:04.491793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61582f0a-b297-43e6-b13b-b2a723080481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:04.503153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61582f0a-b297-43e6-b13b-b2a723080481 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:04.547216 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2539/5131] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:35:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:35:04.877940 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:05.051347 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:05.865089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074d090-c95c-4138-94e6-d862b02779f5 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:05.865257 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:05.868542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1074d090-c95c-4138-94e6-d862b02779f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:05.896209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074d090-c95c-4138-94e6-d862b02779f5 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:05.907946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35358e75-6af2-4a83-b4c5-ac760d391a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:05.909266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35358e75-6af2-4a83-b4c5-ac760d391a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:05.910722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35358e75-6af2-4a83-b4c5-ac760d391a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:05.911267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35358e75-6af2-4a83-b4c5-ac760d391a80 admin admin] PATH_INFO: `/v3/projects/d75f722c6487429993afa88dc268d3c3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:05.913275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35358e75-6af2-4a83-b4c5-ac760d391a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d75f722c6487429993afa88dc268d3c3)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:05.918937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35358e75-6af2-4a83-b4c5-ac760d391a80 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:06.106250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-35358e75-6af2-4a83-b4c5-ac760d391a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd75f722c6487429993afa88dc268d3c3', 'request_id': 'req-35358e75-6af2-4a83-b4c5-ac760d391a80'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:06.121882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-35358e75-6af2-4a83-b4c5-ac760d391a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd75f722c6487429993afa88dc268d3c3', 'request_id': 'req-35358e75-6af2-4a83-b4c5-ac760d391a80'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:06.136364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-35358e75-6af2-4a83-b4c5-ac760d391a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd75f722c6487429993afa88dc268d3c3', 'request_id': 'req-35358e75-6af2-4a83-b4c5-ac760d391a80'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:06.251690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-35358e75-6af2-4a83-b4c5-ac760d391a80 admin admin] The token cache is being invalidate because project d75f722c6487429993afa88dc268d3c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:35:06.252654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-35358e75-6af2-4a83-b4c5-ac760d391a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:06.254684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-35358e75-6af2-4a83-b4c5-ac760d391a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:06.258062 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2593/5132] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:35:05 2022] DELETE /identity/v3/projects/d75f722c6487429993afa88dc268d3c3 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:06.267190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69f9da-99db-4904-b7c4-9fb407954495 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:06.267497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69f9da-99db-4904-b7c4-9fb407954495 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:06.267829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e69f9da-99db-4904-b7c4-9fb407954495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:06.311845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7e69f9da-99db-4904-b7c4-9fb407954495 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:06.315420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7e69f9da-99db-4904-b7c4-9fb407954495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:06.493486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef279916-f8b9-4822-958a-3815a7fabb05 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:06.494053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef279916-f8b9-4822-958a-3815a7fabb05 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:06.494503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef279916-f8b9-4822-958a-3815a7fabb05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:06.496015 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2540/5133] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:35:06.522603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ef279916-f8b9-4822-958a-3815a7fabb05 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:06.524250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ef279916-f8b9-4822-958a-3815a7fabb05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:06.556405 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2594/5134] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:35:06.559647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69f9da-99db-4904-b7c4-9fb407954495 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:06.571594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e69f9da-99db-4904-b7c4-9fb407954495 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:06.577442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0cfa1-35c1-4eb3-a741-54b76146a2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:06.578394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0cfa1-35c1-4eb3-a741-54b76146a2ec admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:06.578876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0cfa1-35c1-4eb3-a741-54b76146a2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:06.579361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b0cfa1-35c1-4eb3-a741-54b76146a2ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:06.580744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0cfa1-35c1-4eb3-a741-54b76146a2ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:35:06.581262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0cfa1-35c1-4eb3-a741-54b76146a2ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:06.584321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b0cfa1-35c1-4eb3-a741-54b76146a2ec admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:06.610382 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2541/5135] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:35:06.611167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef279916-f8b9-4822-958a-3815a7fabb05 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:06.622976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef279916-f8b9-4822-958a-3815a7fabb05 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:06.629557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb3277-fef9-4765-8a70-971fd509e28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:06.630765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb3277-fef9-4765-8a70-971fd509e28c admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:06.631313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb3277-fef9-4765-8a70-971fd509e28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:06.631830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeb3277-fef9-4765-8a70-971fd509e28c admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:06.633279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb3277-fef9-4765-8a70-971fd509e28c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:06.636377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeeb3277-fef9-4765-8a70-971fd509e28c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:06.913490 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2595/5136] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:35:06 2022] POST /identity/v3/projects => generated 397 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:35:06.915930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0cfa1-35c1-4eb3-a741-54b76146a2ec admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:06.937865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b0cfa1-35c1-4eb3-a741-54b76146a2ec admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:06.999601 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:DELETE=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:07.075322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a92ba4-fb1b-4ae5-9a6b-d7e18486a8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:07.078273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a92ba4-fb1b-4ae5-9a6b-d7e18486a8f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:07.078844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a92ba4-fb1b-4ae5-9a6b-d7e18486a8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:07.079175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a92ba4-fb1b-4ae5-9a6b-d7e18486a8f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:07.081106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a92ba4-fb1b-4ae5-9a6b-d7e18486a8f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:07.086177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a92ba4-fb1b-4ae5-9a6b-d7e18486a8f9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:07.237624 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2542/5137] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:35:06 2022] POST /identity/v3/users => generated 305 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:35:07.238572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb3277-fef9-4765-8a70-971fd509e28c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:07.258792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeb3277-fef9-4765-8a70-971fd509e28c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:07.272437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81823f85-4add-4822-99d1-c161aa5833d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:07.272437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81823f85-4add-4822-99d1-c161aa5833d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:07.272437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81823f85-4add-4822-99d1-c161aa5833d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:07.272437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81823f85-4add-4822-99d1-c161aa5833d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:07.273023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81823f85-4add-4822-99d1-c161aa5833d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:07.273023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81823f85-4add-4822-99d1-c161aa5833d3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:07.275366 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:07.297933 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2596/5138] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:35:07.303958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a92ba4-fb1b-4ae5-9a6b-d7e18486a8f9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:07.326233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a92ba4-fb1b-4ae5-9a6b-d7e18486a8f9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:07.336947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08556c-9cb2-488c-b751-35da1cfb153f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:07.339126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08556c-9cb2-488c-b751-35da1cfb153f admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:07.341229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08556c-9cb2-488c-b751-35da1cfb153f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:07.341836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de08556c-9cb2-488c-b751-35da1cfb153f admin admin] PATH_INFO: `/v3/projects/66e2f87fda4a4fd9a3866f6ed87c0f87/users/fd200921a1af40978b13d0d817b2ee12/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:07.384044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08556c-9cb2-488c-b751-35da1cfb153f admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e2f87fda4a4fd9a3866f6ed87c0f87, user_id=fd200921a1af40978b13d0d817b2ee12, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:07.387529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de08556c-9cb2-488c-b751-35da1cfb153f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:07.492811 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2543/5139] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:35:07 2022] PUT /identity/v3/projects/66e2f87fda4a4fd9a3866f6ed87c0f87/users/fd200921a1af40978b13d0d817b2ee12/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:07.499360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81823f85-4add-4822-99d1-c161aa5833d3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:07.510754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81823f85-4add-4822-99d1-c161aa5833d3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:07.732946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a77f4-4a7e-4974-8c37-dbc678530fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:07.733424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a77f4-4a7e-4974-8c37-dbc678530fb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:07.734355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a77f4-4a7e-4974-8c37-dbc678530fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:07.734490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a77f4-4a7e-4974-8c37-dbc678530fb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:07.735356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a77f4-4a7e-4974-8c37-dbc678530fb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:07.737246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a77f4-4a7e-4974-8c37-dbc678530fb5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:07.770297 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2597/5140] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:35:07.772444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08556c-9cb2-488c-b751-35da1cfb153f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:07.794236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de08556c-9cb2-488c-b751-35da1cfb153f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:07.809813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace63a3-bd28-4251-915a-5945531ec78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:07.812730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace63a3-bd28-4251-915a-5945531ec78e admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:07.813900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace63a3-bd28-4251-915a-5945531ec78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:07.815334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace63a3-bd28-4251-915a-5945531ec78e admin admin] PATH_INFO: `/v3/projects/66e2f87fda4a4fd9a3866f6ed87c0f87/users/fd200921a1af40978b13d0d817b2ee12/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:07.822925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace63a3-bd28-4251-915a-5945531ec78e admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e2f87fda4a4fd9a3866f6ed87c0f87, user_id=fd200921a1af40978b13d0d817b2ee12, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:07.838488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace63a3-bd28-4251-915a-5945531ec78e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:07.878205 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2544/5141] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:35:07 2022] PUT /identity/v3/projects/66e2f87fda4a4fd9a3866f6ed87c0f87/users/fd200921a1af40978b13d0d817b2ee12/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:07.893089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de8ea1-b015-4b74-8983-6a9b42032f24 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:07.894224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de8ea1-b015-4b74-8983-6a9b42032f24 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:07.894738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de8ea1-b015-4b74-8983-6a9b42032f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:08.004172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-60de8ea1-b015-4b74-8983-6a9b42032f24 None None] MFA Rules not processed for user `fd200921a1af40978b13d0d817b2ee12`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:08.013650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-60de8ea1-b015-4b74-8983-6a9b42032f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:08.177718 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2598/5142] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:08.179910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace63a3-bd28-4251-915a-5945531ec78e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:08.308063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace63a3-bd28-4251-915a-5945531ec78e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:08.315138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d016f-e36b-4e80-91c2-7c6845da7057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:08.316210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d016f-e36b-4e80-91c2-7c6845da7057 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:08.316661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d016f-e36b-4e80-91c2-7c6845da7057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:08.317185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08d016f-e36b-4e80-91c2-7c6845da7057 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:08.318824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d016f-e36b-4e80-91c2-7c6845da7057 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:08.321007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08d016f-e36b-4e80-91c2-7c6845da7057 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:08.421403 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2545/5143] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:35:08 2022] POST /identity/v3/projects => generated 397 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:35:08.425723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de8ea1-b015-4b74-8983-6a9b42032f24 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:08.448895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de8ea1-b015-4b74-8983-6a9b42032f24 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:08.572239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734e33e-60e8-458e-9f7a-7be20839a169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:08.573316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734e33e-60e8-458e-9f7a-7be20839a169 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:08.574636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734e33e-60e8-458e-9f7a-7be20839a169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:08.575532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734e33e-60e8-458e-9f7a-7be20839a169 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:08.576603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734e33e-60e8-458e-9f7a-7be20839a169 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:08.578987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734e33e-60e8-458e-9f7a-7be20839a169 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:08.673553 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2599/5144] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:35:08 2022] POST /identity/v3/users => generated 299 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:35:08.677906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d016f-e36b-4e80-91c2-7c6845da7057 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:08.702831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08d016f-e36b-4e80-91c2-7c6845da7057 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:08.728579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441114f-c4c6-41f2-96a3-7982ba18f304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:08.730082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441114f-c4c6-41f2-96a3-7982ba18f304 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:08.730552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441114f-c4c6-41f2-96a3-7982ba18f304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:08.733071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441114f-c4c6-41f2-96a3-7982ba18f304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:08.734063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441114f-c4c6-41f2-96a3-7982ba18f304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:08.738199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f441114f-c4c6-41f2-96a3-7982ba18f304 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:08.757099 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2546/5145] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:35:08.761572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734e33e-60e8-458e-9f7a-7be20839a169 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:08.777898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734e33e-60e8-458e-9f7a-7be20839a169 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:08.785843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f62aa1d-0835-4e49-8d61-4a7b99bcfa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:08.787257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62aa1d-0835-4e49-8d61-4a7b99bcfa4b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:08.787748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62aa1d-0835-4e49-8d61-4a7b99bcfa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:08.788205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62aa1d-0835-4e49-8d61-4a7b99bcfa4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:08.789442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62aa1d-0835-4e49-8d61-4a7b99bcfa4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:08.791512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f62aa1d-0835-4e49-8d61-4a7b99bcfa4b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:08.811140 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2600/5146] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:35:08.815756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441114f-c4c6-41f2-96a3-7982ba18f304 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:08.835489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441114f-c4c6-41f2-96a3-7982ba18f304 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:08.850548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d2872-e0d1-46f0-a240-ff33525e2459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:08.850548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d2872-e0d1-46f0-a240-ff33525e2459 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:08.850548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d2872-e0d1-46f0-a240-ff33525e2459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:08.850548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d2872-e0d1-46f0-a240-ff33525e2459 admin admin] PATH_INFO: `/v3/projects/e3ce150f99924db8ab9a648f7d53ee54/users/f5fbfc7acd7647ceb32f56c162133db5/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:08.885867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d2872-e0d1-46f0-a240-ff33525e2459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ce150f99924db8ab9a648f7d53ee54, user_id=f5fbfc7acd7647ceb32f56c162133db5, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:08.890226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d2872-e0d1-46f0-a240-ff33525e2459 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:09.008744 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2547/5147] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:35:08 2022] PUT /identity/v3/projects/e3ce150f99924db8ab9a648f7d53ee54/users/f5fbfc7acd7647ceb32f56c162133db5/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:09.010610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f112c-f6fa-4113-bdcc-2e7bfebc237a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:09.012653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f112c-f6fa-4113-bdcc-2e7bfebc237a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:09.012969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f112c-f6fa-4113-bdcc-2e7bfebc237a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:09.071593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-cd7f112c-f6fa-4113-bdcc-2e7bfebc237a None None] MFA Rules not processed for user `f5fbfc7acd7647ceb32f56c162133db5`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:09.072836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cd7f112c-f6fa-4113-bdcc-2e7bfebc237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:09.131016 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:09.207686 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:09.250941 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2601/5148] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:09.264869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d2872-e0d1-46f0-a240-ff33525e2459 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:09.264869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cc9d2872-e0d1-46f0-a240-ff33525e2459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:09.414024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d2872-e0d1-46f0-a240-ff33525e2459 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:09.425717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c8126-a886-492d-92ae-e6acb67102fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:09.426833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c8126-a886-492d-92ae-e6acb67102fc service glance] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:09.427536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c8126-a886-492d-92ae-e6acb67102fc service glance] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:09.448276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c8126-a886-492d-92ae-e6acb67102fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:09.578674 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:09.594487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c8126-a886-492d-92ae-e6acb67102fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:09.596456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10c8126-a886-492d-92ae-e6acb67102fc service glance] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:09.609221 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2548/5149] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:35:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:35:10.341004 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:10.783837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f112c-f6fa-4113-bdcc-2e7bfebc237a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:10.932595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f112c-f6fa-4113-bdcc-2e7bfebc237a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:10.940100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdebf73-5eba-4804-8a4e-9a14ccea781a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:10.941814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdebf73-5eba-4804-8a4e-9a14ccea781a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:10.941814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdebf73-5eba-4804-8a4e-9a14ccea781a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:10.942011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdebf73-5eba-4804-8a4e-9a14ccea781a admin admin] PATH_INFO: `/v3/users/fd200921a1af40978b13d0d817b2ee12` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:10.943772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdebf73-5eba-4804-8a4e-9a14ccea781a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd200921a1af40978b13d0d817b2ee12)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:10.946071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdebf73-5eba-4804-8a4e-9a14ccea781a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:10.977621 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:11.246969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6cdebf73-5eba-4804-8a4e-9a14ccea781a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd200921a1af40978b13d0d817b2ee12'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:11.272593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6cdebf73-5eba-4804-8a4e-9a14ccea781a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd200921a1af40978b13d0d817b2ee12'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:11.290032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6cdebf73-5eba-4804-8a4e-9a14ccea781a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd200921a1af40978b13d0d817b2ee12'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:11.291082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6cdebf73-5eba-4804-8a4e-9a14ccea781a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd200921a1af40978b13d0d817b2ee12'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:11.359864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6cdebf73-5eba-4804-8a4e-9a14ccea781a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd200921a1af40978b13d0d817b2ee12'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:11.373113 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2602/5150] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:35:10 2022] DELETE /identity/v3/users/fd200921a1af40978b13d0d817b2ee12 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:11.375403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11796a8d-1809-4935-874e-089065203c46 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:11.375701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11796a8d-1809-4935-874e-089065203c46 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:11.376102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11796a8d-1809-4935-874e-089065203c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:11.415343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-11796a8d-1809-4935-874e-089065203c46 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:11.416908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-11796a8d-1809-4935-874e-089065203c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:11.565093 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2549/5151] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:35:11.579864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdebf73-5eba-4804-8a4e-9a14ccea781a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:11.582341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6cdebf73-5eba-4804-8a4e-9a14ccea781a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:11.702482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdebf73-5eba-4804-8a4e-9a14ccea781a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:11.706933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b86022-c9a5-49f8-a399-ca666348411c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:11.707735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b86022-c9a5-49f8-a399-ca666348411c service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:11.708194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b86022-c9a5-49f8-a399-ca666348411c service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:11.708616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b86022-c9a5-49f8-a399-ca666348411c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:11.722448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b86022-c9a5-49f8-a399-ca666348411c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:11.729940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b86022-c9a5-49f8-a399-ca666348411c service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:11.753168 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2603/5152] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:35:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:35:11.863253 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:12.556597 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:12.859064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11796a8d-1809-4935-874e-089065203c46 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:12.864211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-11796a8d-1809-4935-874e-089065203c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:12.881106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11796a8d-1809-4935-874e-089065203c46 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:12.897811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472eec8-a964-4e75-96ec-a10f1d25030e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:12.898742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472eec8-a964-4e75-96ec-a10f1d25030e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:12.899029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472eec8-a964-4e75-96ec-a10f1d25030e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:12.899309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472eec8-a964-4e75-96ec-a10f1d25030e admin admin] PATH_INFO: `/v3/projects/66e2f87fda4a4fd9a3866f6ed87c0f87` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:12.901626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472eec8-a964-4e75-96ec-a10f1d25030e admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e2f87fda4a4fd9a3866f6ed87c0f87)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:12.903559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472eec8-a964-4e75-96ec-a10f1d25030e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:13.053632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9fbd0-ce63-49f5-9038-82829fd00f8f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:13.057872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9fbd0-ce63-49f5-9038-82829fd00f8f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:13.057872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9fbd0-ce63-49f5-9038-82829fd00f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:13.081929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4ed9fbd0-ce63-49f5-9038-82829fd00f8f None None] MFA Rules not processed for user `2cb5060535f440a5b822500807c10688`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:13.084784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4ed9fbd0-ce63-49f5-9038-82829fd00f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:13.150800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a472eec8-a964-4e75-96ec-a10f1d25030e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e2f87fda4a4fd9a3866f6ed87c0f87', 'request_id': 'req-a472eec8-a964-4e75-96ec-a10f1d25030e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:13.191763 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2604/5153] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:13.446861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a472eec8-a964-4e75-96ec-a10f1d25030e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e2f87fda4a4fd9a3866f6ed87c0f87', 'request_id': 'req-a472eec8-a964-4e75-96ec-a10f1d25030e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:13.455484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a472eec8-a964-4e75-96ec-a10f1d25030e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e2f87fda4a4fd9a3866f6ed87c0f87', 'request_id': 'req-a472eec8-a964-4e75-96ec-a10f1d25030e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:13.460212 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:13.471314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a472eec8-a964-4e75-96ec-a10f1d25030e admin admin] The token cache is being invalidate because project 66e2f87fda4a4fd9a3866f6ed87c0f87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:35:13.471705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a472eec8-a964-4e75-96ec-a10f1d25030e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:13.473162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a472eec8-a964-4e75-96ec-a10f1d25030e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:13.475686 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2550/5154] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:35:12 2022] DELETE /identity/v3/projects/66e2f87fda4a4fd9a3866f6ed87c0f87 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:13.480194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9fbd0-ce63-49f5-9038-82829fd00f8f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:13.508922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9fbd0-ce63-49f5-9038-82829fd00f8f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:13.625234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261977aa-1690-455b-84fa-1efd5ee7571d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:13.625234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261977aa-1690-455b-84fa-1efd5ee7571d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:13.625234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261977aa-1690-455b-84fa-1efd5ee7571d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:13.625234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261977aa-1690-455b-84fa-1efd5ee7571d admin admin] PATH_INFO: `/v3/users/f5fbfc7acd7647ceb32f56c162133db5` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:13.629625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261977aa-1690-455b-84fa-1efd5ee7571d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5fbfc7acd7647ceb32f56c162133db5)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:13.632717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261977aa-1690-455b-84fa-1efd5ee7571d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:13.642222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472eec8-a964-4e75-96ec-a10f1d25030e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:13.644208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a472eec8-a964-4e75-96ec-a10f1d25030e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:13.750940 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:13.765430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472eec8-a964-4e75-96ec-a10f1d25030e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:13.776376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3c617-bf11-46b4-9d7f-aced59c02b0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:13.777063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3c617-bf11-46b4-9d7f-aced59c02b0e service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:13.777354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3c617-bf11-46b4-9d7f-aced59c02b0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:13.777638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e3c617-bf11-46b4-9d7f-aced59c02b0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:13.779532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b5e3c617-bf11-46b4-9d7f-aced59c02b0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:13.793811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3c617-bf11-46b4-9d7f-aced59c02b0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:13.795425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e3c617-bf11-46b4-9d7f-aced59c02b0e service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:13.805409 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2551/5155] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:35:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:35:13.911073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-261977aa-1690-455b-84fa-1efd5ee7571d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5fbfc7acd7647ceb32f56c162133db5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:13.935785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-261977aa-1690-455b-84fa-1efd5ee7571d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5fbfc7acd7647ceb32f56c162133db5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:13.947275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-261977aa-1690-455b-84fa-1efd5ee7571d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5fbfc7acd7647ceb32f56c162133db5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:13.949414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-261977aa-1690-455b-84fa-1efd5ee7571d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5fbfc7acd7647ceb32f56c162133db5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:14.040175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-261977aa-1690-455b-84fa-1efd5ee7571d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5fbfc7acd7647ceb32f56c162133db5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:14.047662 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2605/5156] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:35:13 2022] DELETE /identity/v3/users/f5fbfc7acd7647ceb32f56c162133db5 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:14.742168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3c617-bf11-46b4-9d7f-aced59c02b0e service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:14.744398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b5e3c617-bf11-46b4-9d7f-aced59c02b0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:14.767487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e3c617-bf11-46b4-9d7f-aced59c02b0e service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:14.817778 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:14.850260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2cdb2-b0bc-477e-9373-d3af94fba701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:14.851469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2cdb2-b0bc-477e-9373-d3af94fba701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:14.851938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2cdb2-b0bc-477e-9373-d3af94fba701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:14.854567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2cdb2-b0bc-477e-9373-d3af94fba701 admin admin] PATH_INFO: `/v3/projects/e3ce150f99924db8ab9a648f7d53ee54` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:14.856406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2cdb2-b0bc-477e-9373-d3af94fba701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ce150f99924db8ab9a648f7d53ee54)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:14.858673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2cdb2-b0bc-477e-9373-d3af94fba701 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:14.975101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-90d2cdb2-b0bc-477e-9373-d3af94fba701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ce150f99924db8ab9a648f7d53ee54', 'request_id': 'req-90d2cdb2-b0bc-477e-9373-d3af94fba701'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:15.045721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-90d2cdb2-b0bc-477e-9373-d3af94fba701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ce150f99924db8ab9a648f7d53ee54', 'request_id': 'req-90d2cdb2-b0bc-477e-9373-d3af94fba701'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:15.063653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-90d2cdb2-b0bc-477e-9373-d3af94fba701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ce150f99924db8ab9a648f7d53ee54', 'request_id': 'req-90d2cdb2-b0bc-477e-9373-d3af94fba701'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:15.080722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-90d2cdb2-b0bc-477e-9373-d3af94fba701 admin admin] The token cache is being invalidate because project e3ce150f99924db8ab9a648f7d53ee54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:35:15.082564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-90d2cdb2-b0bc-477e-9373-d3af94fba701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:15.082564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-90d2cdb2-b0bc-477e-9373-d3af94fba701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:15.084369 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2552/5157] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:35:14 2022] DELETE /identity/v3/projects/e3ce150f99924db8ab9a648f7d53ee54 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:15.089296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dd921-482a-4fdf-9cbb-7e6d1e6885da None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:15.089589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dd921-482a-4fdf-9cbb-7e6d1e6885da None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:15.089872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829dd921-482a-4fdf-9cbb-7e6d1e6885da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:15.113994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-829dd921-482a-4fdf-9cbb-7e6d1e6885da None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:15.115940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-829dd921-482a-4fdf-9cbb-7e6d1e6885da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:15.243772 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2606/5158] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:15.245697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311fde3-f04c-402e-be39-f2e309aaadaa None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:15.246029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311fde3-f04c-402e-be39-f2e309aaadaa None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:15.246315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311fde3-f04c-402e-be39-f2e309aaadaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:15.273920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8311fde3-f04c-402e-be39-f2e309aaadaa None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:15.276153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8311fde3-f04c-402e-be39-f2e309aaadaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:15.296400 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2553/5159] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:15.300480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dd921-482a-4fdf-9cbb-7e6d1e6885da None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:15.314047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829dd921-482a-4fdf-9cbb-7e6d1e6885da None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:15.319977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c08cf-0070-492b-8807-5e034a8045fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:15.320745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c08cf-0070-492b-8807-5e034a8045fc admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:15.321101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c08cf-0070-492b-8807-5e034a8045fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:15.321482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c08cf-0070-492b-8807-5e034a8045fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:15.322367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c08cf-0070-492b-8807-5e034a8045fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:35:15.322765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c08cf-0070-492b-8807-5e034a8045fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:15.324828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c08cf-0070-492b-8807-5e034a8045fc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:15.339964 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2607/5160] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:35:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:35:15.345112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311fde3-f04c-402e-be39-f2e309aaadaa None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:15.359270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311fde3-f04c-402e-be39-f2e309aaadaa None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:15.366628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1a4bf-6389-4835-8af1-d650b1ad06c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:15.367563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1a4bf-6389-4835-8af1-d650b1ad06c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:15.368171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1a4bf-6389-4835-8af1-d650b1ad06c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:15.368911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec1a4bf-6389-4835-8af1-d650b1ad06c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:15.369983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1a4bf-6389-4835-8af1-d650b1ad06c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:15.372341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec1a4bf-6389-4835-8af1-d650b1ad06c3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:15.488371 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2554/5161] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:35:15 2022] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:35:15.493104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c08cf-0070-492b-8807-5e034a8045fc admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:15.504469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c08cf-0070-492b-8807-5e034a8045fc admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:15.581516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7e4f4-24d4-4777-bdb7-8413a93d163d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:15.582342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7e4f4-24d4-4777-bdb7-8413a93d163d admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:15.582705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7e4f4-24d4-4777-bdb7-8413a93d163d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:15.583566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7e4f4-24d4-4777-bdb7-8413a93d163d admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:15.584447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7e4f4-24d4-4777-bdb7-8413a93d163d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:15.586937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7e4f4-24d4-4777-bdb7-8413a93d163d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:15.728710 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2608/5162] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:35:15 2022] POST /identity/v3/users => generated 289 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:35:15.730062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1a4bf-6389-4835-8af1-d650b1ad06c3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:15.751815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec1a4bf-6389-4835-8af1-d650b1ad06c3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:15.772889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d69e2b-168f-4632-9359-57da519841d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:15.774368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d69e2b-168f-4632-9359-57da519841d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:15.774821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d69e2b-168f-4632-9359-57da519841d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:15.775171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d69e2b-168f-4632-9359-57da519841d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:15.776271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d69e2b-168f-4632-9359-57da519841d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:15.778587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d69e2b-168f-4632-9359-57da519841d8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:15.794277 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2555/5163] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:35:15.795562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7e4f4-24d4-4777-bdb7-8413a93d163d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:15.807990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7e4f4-24d4-4777-bdb7-8413a93d163d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:15.813054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a0886-e48a-4aeb-bca4-b00a6c51deb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:15.814604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a0886-e48a-4aeb-bca4-b00a6c51deb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:15.814893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a0886-e48a-4aeb-bca4-b00a6c51deb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:15.815184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a0886-e48a-4aeb-bca4-b00a6c51deb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:15.816136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a0886-e48a-4aeb-bca4-b00a6c51deb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:15.819142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a0886-e48a-4aeb-bca4-b00a6c51deb0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:15.846617 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2609/5164] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:35:15 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:35:15.851802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d69e2b-168f-4632-9359-57da519841d8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:15.870668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d69e2b-168f-4632-9359-57da519841d8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:15.876124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02039aaf-d631-4851-8918-0235361ba723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:15.877195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02039aaf-d631-4851-8918-0235361ba723 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:15.877489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02039aaf-d631-4851-8918-0235361ba723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:15.877777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02039aaf-d631-4851-8918-0235361ba723 admin admin] PATH_INFO: `/v3/projects/a7e5304d473e4f6bb67ccf55fad45bf0/users/b764d2e972f14360b89e50d765355205/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:15.906042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02039aaf-d631-4851-8918-0235361ba723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7e5304d473e4f6bb67ccf55fad45bf0, user_id=b764d2e972f14360b89e50d765355205, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:15.909120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02039aaf-d631-4851-8918-0235361ba723 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:16.115306 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:16.121412 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2556/5165] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:35:15 2022] PUT /identity/v3/projects/a7e5304d473e4f6bb67ccf55fad45bf0/users/b764d2e972f14360b89e50d765355205/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:16.136182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78034424-8d2a-47f4-83ce-99757812b07a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:16.136472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78034424-8d2a-47f4-83ce-99757812b07a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:16.136990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78034424-8d2a-47f4-83ce-99757812b07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:16.167494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-78034424-8d2a-47f4-83ce-99757812b07a None None] MFA Rules not processed for user `b764d2e972f14360b89e50d765355205`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:16.169380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-78034424-8d2a-47f4-83ce-99757812b07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:16.260627 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2610/5166] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:16.265046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02039aaf-d631-4851-8918-0235361ba723 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:16.288234 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:16.339175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02039aaf-d631-4851-8918-0235361ba723 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:16.343888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c55e48-bff8-45dd-8847-a465ff7b8180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:16.347324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c55e48-bff8-45dd-8847-a465ff7b8180 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:16.347324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c55e48-bff8-45dd-8847-a465ff7b8180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:16.347324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c55e48-bff8-45dd-8847-a465ff7b8180 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:16.347324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c55e48-bff8-45dd-8847-a465ff7b8180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:16.348588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c55e48-bff8-45dd-8847-a465ff7b8180 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:16.496791 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2557/5167] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:35:16 2022] POST /identity/v3/projects => generated 375 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:35:16.508614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78034424-8d2a-47f4-83ce-99757812b07a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:16.512871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78034424-8d2a-47f4-83ce-99757812b07a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:16.594041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c447d0d-e607-4180-9861-b51e836a7cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:16.595048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c447d0d-e607-4180-9861-b51e836a7cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:16.595507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c447d0d-e607-4180-9861-b51e836a7cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:16.595963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c447d0d-e607-4180-9861-b51e836a7cf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:16.597758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c447d0d-e607-4180-9861-b51e836a7cf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:16.600334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c447d0d-e607-4180-9861-b51e836a7cf1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:16.742620 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2611/5168] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:35:16 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:35:16.746843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c55e48-bff8-45dd-8847-a465ff7b8180 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:16.765101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c55e48-bff8-45dd-8847-a465ff7b8180 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:16.770437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0489d0b-9c69-4955-8713-9942db0715d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:16.772306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0489d0b-9c69-4955-8713-9942db0715d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:16.772825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0489d0b-9c69-4955-8713-9942db0715d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:16.773340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0489d0b-9c69-4955-8713-9942db0715d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:16.775103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0489d0b-9c69-4955-8713-9942db0715d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:16.777284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0489d0b-9c69-4955-8713-9942db0715d9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:16.790792 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2558/5169] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:35:16.795327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c447d0d-e607-4180-9861-b51e836a7cf1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:16.808738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c447d0d-e607-4180-9861-b51e836a7cf1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:16.817243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4118587-e8f6-4bca-a5d0-001b8544d3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:16.819775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4118587-e8f6-4bca-a5d0-001b8544d3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:16.820711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4118587-e8f6-4bca-a5d0-001b8544d3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:16.821202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4118587-e8f6-4bca-a5d0-001b8544d3f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:16.822313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4118587-e8f6-4bca-a5d0-001b8544d3f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:16.825029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4118587-e8f6-4bca-a5d0-001b8544d3f6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:16.839724 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2612/5170] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:35:16 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:35:16.843653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0489d0b-9c69-4955-8713-9942db0715d9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:16.858406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0489d0b-9c69-4955-8713-9942db0715d9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:16.867079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a77aa-20ed-4efc-b67b-aaee10bc424d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:16.868270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a77aa-20ed-4efc-b67b-aaee10bc424d admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:16.869409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a77aa-20ed-4efc-b67b-aaee10bc424d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:16.870217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a77aa-20ed-4efc-b67b-aaee10bc424d admin admin] PATH_INFO: `/v3/projects/dbe941dce0504b618b431ea801bd84a9/users/327585beca994d34b3d58cea5a1d725d/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:16.914385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a77aa-20ed-4efc-b67b-aaee10bc424d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbe941dce0504b618b431ea801bd84a9, user_id=327585beca994d34b3d58cea5a1d725d, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:16.917078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a77aa-20ed-4efc-b67b-aaee10bc424d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:17.029424 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2559/5171] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:35:16 2022] PUT /identity/v3/projects/dbe941dce0504b618b431ea801bd84a9/users/327585beca994d34b3d58cea5a1d725d/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:17.037188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5889150-814d-4ef9-9ea1-bb80b93f6e35 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:17.037887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5889150-814d-4ef9-9ea1-bb80b93f6e35 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:17.037887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5889150-814d-4ef9-9ea1-bb80b93f6e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:17.077094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d5889150-814d-4ef9-9ea1-bb80b93f6e35 None None] MFA Rules not processed for user `327585beca994d34b3d58cea5a1d725d`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:17.078476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d5889150-814d-4ef9-9ea1-bb80b93f6e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:17.183539 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2613/5172] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:17.200758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a77aa-20ed-4efc-b67b-aaee10bc424d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:17.202696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d41a77aa-20ed-4efc-b67b-aaee10bc424d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:17.368943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a77aa-20ed-4efc-b67b-aaee10bc424d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:17.374612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd546a-03bb-4f86-9c96-775fcac3f0a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:17.375813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd546a-03bb-4f86-9c96-775fcac3f0a9 service glance] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:17.376331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd546a-03bb-4f86-9c96-775fcac3f0a9 service glance] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:17.376824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd546a-03bb-4f86-9c96-775fcac3f0a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:17.470680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd546a-03bb-4f86-9c96-775fcac3f0a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:17.472149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd546a-03bb-4f86-9c96-775fcac3f0a9 service glance] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:17.484949 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2560/5173] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:35:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:35:17.864013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77d7b6-1d0a-4cf3-adef-16a625b67760 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:17.864959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77d7b6-1d0a-4cf3-adef-16a625b67760 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:17.864959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77d7b6-1d0a-4cf3-adef-16a625b67760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:17.890394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0a77d7b6-1d0a-4cf3-adef-16a625b67760 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:17.893404 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=7,keystone:SELECT=93 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:17.894620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0a77d7b6-1d0a-4cf3-adef-16a625b67760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:18.011009 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2614/5174] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:35:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:35:18.030756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd546a-03bb-4f86-9c96-775fcac3f0a9 service glance] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:18.033611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-59dd546a-03bb-4f86-9c96-775fcac3f0a9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:18.175524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd546a-03bb-4f86-9c96-775fcac3f0a9 service glance] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:18.187795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc9a993-b54e-4ab0-b0c9-2c76fbc737aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:18.189733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9a993-b54e-4ab0-b0c9-2c76fbc737aa service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:18.190219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9a993-b54e-4ab0-b0c9-2c76fbc737aa service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:18.190664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc9a993-b54e-4ab0-b0c9-2c76fbc737aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:18.204646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9a993-b54e-4ab0-b0c9-2c76fbc737aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:18.206633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc9a993-b54e-4ab0-b0c9-2c76fbc737aa service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:18.229484 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2561/5175] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:35:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:35:18.284156 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:18.909695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77d7b6-1d0a-4cf3-adef-16a625b67760 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:18.913913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0a77d7b6-1d0a-4cf3-adef-16a625b67760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:18.926273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77d7b6-1d0a-4cf3-adef-16a625b67760 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:18.931527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f7d5f-c19b-40b2-aa51-4c2ceebd8edd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:18.936098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f7d5f-c19b-40b2-aa51-4c2ceebd8edd service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:18.936098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f7d5f-c19b-40b2-aa51-4c2ceebd8edd service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:18.936098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7f7d5f-c19b-40b2-aa51-4c2ceebd8edd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:18.944870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f7d5f-c19b-40b2-aa51-4c2ceebd8edd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:18.946770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7f7d5f-c19b-40b2-aa51-4c2ceebd8edd service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:18.959377 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2615/5176] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:35:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:35:19.052647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae58c6-a16e-4367-845b-b5a936546528 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:19.053468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae58c6-a16e-4367-845b-b5a936546528 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:19.053935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffae58c6-a16e-4367-845b-b5a936546528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:19.079428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ffae58c6-a16e-4367-845b-b5a936546528 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:19.081929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ffae58c6-a16e-4367-845b-b5a936546528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:19.107927 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2562/5177] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:35:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:19.124291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f7d5f-c19b-40b2-aa51-4c2ceebd8edd service glance] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:19.142444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7f7d5f-c19b-40b2-aa51-4c2ceebd8edd service glance] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:19.155494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d6726-8407-488d-a608-bfbbd81c1c5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:19.156155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d6726-8407-488d-a608-bfbbd81c1c5a service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:19.156439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d6726-8407-488d-a608-bfbbd81c1c5a service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:19.156716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d6726-8407-488d-a608-bfbbd81c1c5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:19.167516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d6726-8407-488d-a608-bfbbd81c1c5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:19.169506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d6726-8407-488d-a608-bfbbd81c1c5a service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:19.192137 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2616/5178] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:35:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:35:19.228753 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:19.725919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae58c6-a16e-4367-845b-b5a936546528 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:19.832114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffae58c6-a16e-4367-845b-b5a936546528 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:19.838395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bb0dd-b049-468c-a578-d52992b20a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:19.862417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bb0dd-b049-468c-a578-d52992b20a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:19.862709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bb0dd-b049-468c-a578-d52992b20a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:19.865332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3bb0dd-b049-468c-a578-d52992b20a57 admin admin] PATH_INFO: `/v3/users/b764d2e972f14360b89e50d765355205` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:19.868492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bb0dd-b049-468c-a578-d52992b20a57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b764d2e972f14360b89e50d765355205)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:19.872194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3bb0dd-b049-468c-a578-d52992b20a57 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:20.126919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3b3bb0dd-b049-468c-a578-d52992b20a57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b764d2e972f14360b89e50d765355205'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:20.154788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3b3bb0dd-b049-468c-a578-d52992b20a57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b764d2e972f14360b89e50d765355205'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:20.156245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3b3bb0dd-b049-468c-a578-d52992b20a57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b764d2e972f14360b89e50d765355205'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:20.157490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3b3bb0dd-b049-468c-a578-d52992b20a57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b764d2e972f14360b89e50d765355205'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:20.185879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3b3bb0dd-b049-468c-a578-d52992b20a57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b764d2e972f14360b89e50d765355205'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:20.282090 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2563/5179] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:35:19 2022] DELETE /identity/v3/users/b764d2e972f14360b89e50d765355205 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:20.289159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd10fa-5785-4b8c-b2e8-53d3d80b1e76 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:20.295838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd10fa-5785-4b8c-b2e8-53d3d80b1e76 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:20.295838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd10fa-5785-4b8c-b2e8-53d3d80b1e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:20.340953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-fafd10fa-5785-4b8c-b2e8-53d3d80b1e76 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:20.349005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fafd10fa-5785-4b8c-b2e8-53d3d80b1e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:20.450429 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2617/5180] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:20.461655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bb0dd-b049-468c-a578-d52992b20a57 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:20.463215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3b3bb0dd-b049-468c-a578-d52992b20a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:20.500449 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:20.571252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3bb0dd-b049-468c-a578-d52992b20a57 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:20.576768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33273-5ca3-48a6-9e7e-9884312b520f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:20.577904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33273-5ca3-48a6-9e7e-9884312b520f service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:20.578424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33273-5ca3-48a6-9e7e-9884312b520f service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:20.578923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33273-5ca3-48a6-9e7e-9884312b520f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:20.592124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd33273-5ca3-48a6-9e7e-9884312b520f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:20.594448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd33273-5ca3-48a6-9e7e-9884312b520f service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:20.610717 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2564/5181] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:35:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:35:21.377814 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:21.838777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd10fa-5785-4b8c-b2e8-53d3d80b1e76 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:21.838777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fafd10fa-5785-4b8c-b2e8-53d3d80b1e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:21.850075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafd10fa-5785-4b8c-b2e8-53d3d80b1e76 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:21.859079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2291ef9-79cc-4558-b2a3-508efe2f322e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:21.861854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2291ef9-79cc-4558-b2a3-508efe2f322e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:21.870168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2291ef9-79cc-4558-b2a3-508efe2f322e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:21.870168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2291ef9-79cc-4558-b2a3-508efe2f322e admin admin] PATH_INFO: `/v3/projects/a7e5304d473e4f6bb67ccf55fad45bf0` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:21.870168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2291ef9-79cc-4558-b2a3-508efe2f322e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7e5304d473e4f6bb67ccf55fad45bf0)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:21.870168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2291ef9-79cc-4558-b2a3-508efe2f322e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:22.033421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b2291ef9-79cc-4558-b2a3-508efe2f322e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7e5304d473e4f6bb67ccf55fad45bf0', 'request_id': 'req-b2291ef9-79cc-4558-b2a3-508efe2f322e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:22.045870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b2291ef9-79cc-4558-b2a3-508efe2f322e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7e5304d473e4f6bb67ccf55fad45bf0', 'request_id': 'req-b2291ef9-79cc-4558-b2a3-508efe2f322e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:22.055190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b2291ef9-79cc-4558-b2a3-508efe2f322e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7e5304d473e4f6bb67ccf55fad45bf0', 'request_id': 'req-b2291ef9-79cc-4558-b2a3-508efe2f322e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:22.135146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b2291ef9-79cc-4558-b2a3-508efe2f322e admin admin] The token cache is being invalidate because project a7e5304d473e4f6bb67ccf55fad45bf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:35:22.135597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b2291ef9-79cc-4558-b2a3-508efe2f322e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:22.136459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b2291ef9-79cc-4558-b2a3-508efe2f322e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:22.138057 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2618/5182] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:35:21 2022] DELETE /identity/v3/projects/a7e5304d473e4f6bb67ccf55fad45bf0 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:22.142152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33273-5ca3-48a6-9e7e-9884312b520f service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:22.153169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33273-5ca3-48a6-9e7e-9884312b520f service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:22.216274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b41dc6-205e-45bd-8bbe-200f42400983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:22.217077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b41dc6-205e-45bd-8bbe-200f42400983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:22.217359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b41dc6-205e-45bd-8bbe-200f42400983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:22.217631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b41dc6-205e-45bd-8bbe-200f42400983 admin admin] PATH_INFO: `/v3/users/327585beca994d34b3d58cea5a1d725d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:22.218886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b41dc6-205e-45bd-8bbe-200f42400983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=327585beca994d34b3d58cea5a1d725d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:22.220999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b41dc6-205e-45bd-8bbe-200f42400983 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:22.610995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6b41dc6-205e-45bd-8bbe-200f42400983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '327585beca994d34b3d58cea5a1d725d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:22.631133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6b41dc6-205e-45bd-8bbe-200f42400983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '327585beca994d34b3d58cea5a1d725d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:22.632571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6b41dc6-205e-45bd-8bbe-200f42400983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '327585beca994d34b3d58cea5a1d725d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:22.633610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6b41dc6-205e-45bd-8bbe-200f42400983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '327585beca994d34b3d58cea5a1d725d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:22.644607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6b41dc6-205e-45bd-8bbe-200f42400983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '327585beca994d34b3d58cea5a1d725d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:22.857247 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2565/5183] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:35:22 2022] DELETE /identity/v3/users/327585beca994d34b3d58cea5a1d725d => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:24.004614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2291ef9-79cc-4558-b2a3-508efe2f322e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:24.007608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b2291ef9-79cc-4558-b2a3-508efe2f322e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:24.040549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2291ef9-79cc-4558-b2a3-508efe2f322e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:24.114296 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:24.168624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb923f8-41e2-442d-a4fc-672dfac5fd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:24.169854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb923f8-41e2-442d-a4fc-672dfac5fd8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:24.170421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb923f8-41e2-442d-a4fc-672dfac5fd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:24.170883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb923f8-41e2-442d-a4fc-672dfac5fd8a admin admin] PATH_INFO: `/v3/projects/dbe941dce0504b618b431ea801bd84a9` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:24.174205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb923f8-41e2-442d-a4fc-672dfac5fd8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbe941dce0504b618b431ea801bd84a9)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:24.177423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb923f8-41e2-442d-a4fc-672dfac5fd8a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:24.328807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1bb923f8-41e2-442d-a4fc-672dfac5fd8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbe941dce0504b618b431ea801bd84a9', 'request_id': 'req-1bb923f8-41e2-442d-a4fc-672dfac5fd8a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:24.338072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1bb923f8-41e2-442d-a4fc-672dfac5fd8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbe941dce0504b618b431ea801bd84a9', 'request_id': 'req-1bb923f8-41e2-442d-a4fc-672dfac5fd8a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:24.346993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1bb923f8-41e2-442d-a4fc-672dfac5fd8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbe941dce0504b618b431ea801bd84a9', 'request_id': 'req-1bb923f8-41e2-442d-a4fc-672dfac5fd8a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:24.436345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1bb923f8-41e2-442d-a4fc-672dfac5fd8a admin admin] The token cache is being invalidate because project dbe941dce0504b618b431ea801bd84a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:35:24.436888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1bb923f8-41e2-442d-a4fc-672dfac5fd8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:24.442708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1bb923f8-41e2-442d-a4fc-672dfac5fd8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:24.446257 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2619/5184] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:35:24 2022] DELETE /identity/v3/projects/dbe941dce0504b618b431ea801bd84a9 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:24.453959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c969c-cd2d-4b9b-b9cf-b93821e1a29d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:24.455479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c969c-cd2d-4b9b-b9cf-b93821e1a29d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:24.455479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c969c-cd2d-4b9b-b9cf-b93821e1a29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:24.485156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-465c969c-cd2d-4b9b-b9cf-b93821e1a29d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:24.486427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-465c969c-cd2d-4b9b-b9cf-b93821e1a29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:24.543069 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:24.583861 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2566/5185] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:24.592044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7a400-be38-4880-bcaf-2c174e7a55c8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:24.592340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7a400-be38-4880-bcaf-2c174e7a55c8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:24.592626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7a400-be38-4880-bcaf-2c174e7a55c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:24.616358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-35f7a400-be38-4880-bcaf-2c174e7a55c8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:24.617989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-35f7a400-be38-4880-bcaf-2c174e7a55c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:24.632010 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2620/5186] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:24.636218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c969c-cd2d-4b9b-b9cf-b93821e1a29d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:24.648312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c969c-cd2d-4b9b-b9cf-b93821e1a29d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:24.654792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b185831-f8d2-4f1b-ad6c-902fa2ab8487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:24.657977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b185831-f8d2-4f1b-ad6c-902fa2ab8487 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:24.658320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b185831-f8d2-4f1b-ad6c-902fa2ab8487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:24.658611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b185831-f8d2-4f1b-ad6c-902fa2ab8487 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:24.662546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b185831-f8d2-4f1b-ad6c-902fa2ab8487 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:35:24.662875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b185831-f8d2-4f1b-ad6c-902fa2ab8487 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:24.666025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b185831-f8d2-4f1b-ad6c-902fa2ab8487 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:24.684991 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2567/5187] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:35:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:35:24.689281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7a400-be38-4880-bcaf-2c174e7a55c8 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:24.714041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7a400-be38-4880-bcaf-2c174e7a55c8 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:24.720246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed91664-2567-4834-88e1-037623d9cbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:24.721268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed91664-2567-4834-88e1-037623d9cbe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:24.727658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed91664-2567-4834-88e1-037623d9cbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:24.727658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed91664-2567-4834-88e1-037623d9cbe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:24.727658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed91664-2567-4834-88e1-037623d9cbe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:24.727658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed91664-2567-4834-88e1-037623d9cbe8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:24.863695 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b185831-f8d2-4f1b-ad6c-902fa2ab8487 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:24.865368 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2621/5188] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:35:24 2022] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:35:24.876045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b185831-f8d2-4f1b-ad6c-902fa2ab8487 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:24.990450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e350350-f4c0-44c7-9ff2-f04633be0900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:24.991654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e350350-f4c0-44c7-9ff2-f04633be0900 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:24.992605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e350350-f4c0-44c7-9ff2-f04633be0900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:24.993055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e350350-f4c0-44c7-9ff2-f04633be0900 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:24.994091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e350350-f4c0-44c7-9ff2-f04633be0900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:24.997249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e350350-f4c0-44c7-9ff2-f04633be0900 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:25.139354 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2568/5189] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:35:24 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:35:25.140760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed91664-2567-4834-88e1-037623d9cbe8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:25.153619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed91664-2567-4834-88e1-037623d9cbe8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:25.161882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ee225-4115-41b2-9a66-a2b751adfe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:25.163681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ee225-4115-41b2-9a66-a2b751adfe7e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:25.164199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ee225-4115-41b2-9a66-a2b751adfe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:25.164755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ee225-4115-41b2-9a66-a2b751adfe7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:25.165758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ee225-4115-41b2-9a66-a2b751adfe7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:25.167864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1ee225-4115-41b2-9a66-a2b751adfe7e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:25.182644 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2622/5190] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:35:25.186932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e350350-f4c0-44c7-9ff2-f04633be0900 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:25.229085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e350350-f4c0-44c7-9ff2-f04633be0900 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:25.234381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ed31d4-3e58-41bd-acf2-a82dd867ec28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:25.236150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed31d4-3e58-41bd-acf2-a82dd867ec28 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:25.236450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed31d4-3e58-41bd-acf2-a82dd867ec28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:25.236800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ed31d4-3e58-41bd-acf2-a82dd867ec28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:25.237747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed31d4-3e58-41bd-acf2-a82dd867ec28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:25.240165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ed31d4-3e58-41bd-acf2-a82dd867ec28 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:25.261919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ee225-4115-41b2-9a66-a2b751adfe7e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:25.262290 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2569/5191] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:35:25 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:35:25.274686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1ee225-4115-41b2-9a66-a2b751adfe7e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:25.285397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847cee9-2669-413f-910e-7664997b0623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:25.287070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847cee9-2669-413f-910e-7664997b0623 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:25.287692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847cee9-2669-413f-910e-7664997b0623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:25.288144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d847cee9-2669-413f-910e-7664997b0623 admin admin] PATH_INFO: `/v3/projects/9066e1849e1047098f7f0d7dd57f418c/users/00f75850df404626bab06f20f9faee87/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:25.307542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847cee9-2669-413f-910e-7664997b0623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9066e1849e1047098f7f0d7dd57f418c, user_id=00f75850df404626bab06f20f9faee87, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:25.310515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d847cee9-2669-413f-910e-7664997b0623 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:25.412034 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2623/5192] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:35:25 2022] PUT /identity/v3/projects/9066e1849e1047098f7f0d7dd57f418c/users/00f75850df404626bab06f20f9faee87/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:25.424573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded667dd-c9ff-465a-b7b3-bc6299890035 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:25.431748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded667dd-c9ff-465a-b7b3-bc6299890035 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:25.431748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded667dd-c9ff-465a-b7b3-bc6299890035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:25.493515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ded667dd-c9ff-465a-b7b3-bc6299890035 None None] MFA Rules not processed for user `00f75850df404626bab06f20f9faee87`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:25.495055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ded667dd-c9ff-465a-b7b3-bc6299890035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:25.599680 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2570/5193] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:25.604574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847cee9-2669-413f-910e-7664997b0623 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:25.669917 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:25.683595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d847cee9-2669-413f-910e-7664997b0623 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:25.690483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec3c3a-8fa3-41be-b6e6-9dc072944123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:25.691291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec3c3a-8fa3-41be-b6e6-9dc072944123 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:25.691648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec3c3a-8fa3-41be-b6e6-9dc072944123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:25.692433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec3c3a-8fa3-41be-b6e6-9dc072944123 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:25.693163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec3c3a-8fa3-41be-b6e6-9dc072944123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:25.695959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec3c3a-8fa3-41be-b6e6-9dc072944123 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:25.788718 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2624/5194] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:35:25 2022] POST /identity/v3/projects => generated 385 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:35:25.794277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded667dd-c9ff-465a-b7b3-bc6299890035 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:25.811332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded667dd-c9ff-465a-b7b3-bc6299890035 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:25.883768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83bd33-c859-46d6-91fb-93fdf95f24d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:25.884490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83bd33-c859-46d6-91fb-93fdf95f24d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:25.884781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83bd33-c859-46d6-91fb-93fdf95f24d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:25.885065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83bd33-c859-46d6-91fb-93fdf95f24d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:25.885824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83bd33-c859-46d6-91fb-93fdf95f24d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:25.887798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83bd33-c859-46d6-91fb-93fdf95f24d0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:26.024856 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2571/5195] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:35:25 2022] POST /identity/v3/users => generated 299 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:35:26.029121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec3c3a-8fa3-41be-b6e6-9dc072944123 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:26.043214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec3c3a-8fa3-41be-b6e6-9dc072944123 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:26.049881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526d1b9-aca9-4593-a353-9b871c37bc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:26.050608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526d1b9-aca9-4593-a353-9b871c37bc72 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:26.050900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526d1b9-aca9-4593-a353-9b871c37bc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:26.051181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526d1b9-aca9-4593-a353-9b871c37bc72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:26.052390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526d1b9-aca9-4593-a353-9b871c37bc72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:26.053723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526d1b9-aca9-4593-a353-9b871c37bc72 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:26.069055 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2625/5196] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:35:26.071296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83bd33-c859-46d6-91fb-93fdf95f24d0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:26.082712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83bd33-c859-46d6-91fb-93fdf95f24d0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:26.089874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdc4d8-045d-40c0-94b7-ea07a6ef3c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:26.090970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdc4d8-045d-40c0-94b7-ea07a6ef3c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:26.091268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdc4d8-045d-40c0-94b7-ea07a6ef3c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:26.091544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdc4d8-045d-40c0-94b7-ea07a6ef3c0d admin admin] PATH_INFO: `/v3/projects/9b9d6bc19f594ba892654885fd56ddcb/users/9228a48794b745f185f4104dd7a79219/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:26.118777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdc4d8-045d-40c0-94b7-ea07a6ef3c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9d6bc19f594ba892654885fd56ddcb, user_id=9228a48794b745f185f4104dd7a79219, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:26.123019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdc4d8-045d-40c0-94b7-ea07a6ef3c0d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:26.228925 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2572/5197] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:35:26 2022] PUT /identity/v3/projects/9b9d6bc19f594ba892654885fd56ddcb/users/9228a48794b745f185f4104dd7a79219/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:26.233216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526d1b9-aca9-4593-a353-9b871c37bc72 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:26.245097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526d1b9-aca9-4593-a353-9b871c37bc72 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:26.310604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d1504b-1a3d-4a08-bb82-b8d99d6146fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:26.311270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1504b-1a3d-4a08-bb82-b8d99d6146fc admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:26.311553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1504b-1a3d-4a08-bb82-b8d99d6146fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:26.311831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d1504b-1a3d-4a08-bb82-b8d99d6146fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:26.312606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1504b-1a3d-4a08-bb82-b8d99d6146fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:26.314225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d1504b-1a3d-4a08-bb82-b8d99d6146fc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:26.330290 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2626/5198] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:35:26 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:35:26.334465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdc4d8-045d-40c0-94b7-ea07a6ef3c0d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:26.347000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdc4d8-045d-40c0-94b7-ea07a6ef3c0d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:26.352763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2121ab-2bc6-438d-a60f-097415973ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:26.353679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2121ab-2bc6-438d-a60f-097415973ecf admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:26.353973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2121ab-2bc6-438d-a60f-097415973ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:26.354540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2121ab-2bc6-438d-a60f-097415973ecf admin admin] PATH_INFO: `/v3/projects/9b9d6bc19f594ba892654885fd56ddcb/users/9228a48794b745f185f4104dd7a79219/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:26.356816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2121ab-2bc6-438d-a60f-097415973ecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9d6bc19f594ba892654885fd56ddcb, user_id=9228a48794b745f185f4104dd7a79219, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:26.361276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2121ab-2bc6-438d-a60f-097415973ecf admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:26.376374 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2573/5199] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:35:26 2022] PUT /identity/v3/projects/9b9d6bc19f594ba892654885fd56ddcb/users/9228a48794b745f185f4104dd7a79219/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:26.389242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317397fb-4f08-4168-a434-3735a197e77a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:26.389544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317397fb-4f08-4168-a434-3735a197e77a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:26.389903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317397fb-4f08-4168-a434-3735a197e77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:26.428218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-317397fb-4f08-4168-a434-3735a197e77a None None] MFA Rules not processed for user `9228a48794b745f185f4104dd7a79219`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:26.429804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-317397fb-4f08-4168-a434-3735a197e77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:26.542990 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:26.564817 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2627/5200] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:26.613593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2121ab-2bc6-438d-a60f-097415973ecf admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:26.615925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3d2121ab-2bc6-438d-a60f-097415973ecf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:26.725513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2121ab-2bc6-438d-a60f-097415973ecf admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:26.729721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf3817-fa15-4485-9ead-d7c8610fa3cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:26.730434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf3817-fa15-4485-9ead-d7c8610fa3cb service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:26.730727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf3817-fa15-4485-9ead-d7c8610fa3cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:26.731008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf3817-fa15-4485-9ead-d7c8610fa3cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:26.799077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf3817-fa15-4485-9ead-d7c8610fa3cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:26.800535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf3817-fa15-4485-9ead-d7c8610fa3cb service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:26.811753 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2574/5201] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:35:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:35:27.697976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317397fb-4f08-4168-a434-3735a197e77a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:27.700315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-317397fb-4f08-4168-a434-3735a197e77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:27.716191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317397fb-4f08-4168-a434-3735a197e77a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:27.721359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0253d9a7-35b7-48bf-a2d1-ace41dd9421e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:27.722297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253d9a7-35b7-48bf-a2d1-ace41dd9421e service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:27.722766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253d9a7-35b7-48bf-a2d1-ace41dd9421e service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:27.723286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0253d9a7-35b7-48bf-a2d1-ace41dd9421e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:27.738918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253d9a7-35b7-48bf-a2d1-ace41dd9421e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:27.741716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0253d9a7-35b7-48bf-a2d1-ace41dd9421e service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:27.756191 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2628/5202] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:35:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:35:31.495760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f8ef1-9332-463a-afc0-89fd43818609 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:31.499838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f8ef1-9332-463a-afc0-89fd43818609 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:31.499838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f8ef1-9332-463a-afc0-89fd43818609 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:31.499838 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2575/5203] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 14:35:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:35:31.508399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd293dc5-8481-428b-80f7-4421107004e0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:31.508883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd293dc5-8481-428b-80f7-4421107004e0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:31.509147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd293dc5-8481-428b-80f7-4421107004e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:31.538252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-cd293dc5-8481-428b-80f7-4421107004e0 None None] MFA Rules not processed for user `e997b70d7158446daa1dfa225eb7afca`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:31.541161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cd293dc5-8481-428b-80f7-4421107004e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:31.566824 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2629/5204] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:35:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:31.585009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f8ef1-9332-463a-afc0-89fd43818609 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:31.606968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f8ef1-9332-463a-afc0-89fd43818609 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:31.616721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afdfcf-0104-4daa-a2b6-6fd64a0b8fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:31.617392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afdfcf-0104-4daa-a2b6-6fd64a0b8fdf service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:31.617865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afdfcf-0104-4daa-a2b6-6fd64a0b8fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:31.618342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afdfcf-0104-4daa-a2b6-6fd64a0b8fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:31.635213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afdfcf-0104-4daa-a2b6-6fd64a0b8fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:31.636856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afdfcf-0104-4daa-a2b6-6fd64a0b8fdf service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:31.648288 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2576/5205] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:35:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:35:41.530765 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:41.644352 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=81,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:47.422967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd293dc5-8481-428b-80f7-4421107004e0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:47.591206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd293dc5-8481-428b-80f7-4421107004e0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:47.596298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358ede9-b405-4f12-a276-0623dcff71a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:47.597970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358ede9-b405-4f12-a276-0623dcff71a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:47.597970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358ede9-b405-4f12-a276-0623dcff71a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:47.599043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358ede9-b405-4f12-a276-0623dcff71a4 admin admin] PATH_INFO: `/v3/users/00f75850df404626bab06f20f9faee87` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:47.600695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358ede9-b405-4f12-a276-0623dcff71a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00f75850df404626bab06f20f9faee87)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:47.602928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358ede9-b405-4f12-a276-0623dcff71a4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:47.868090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b358ede9-b405-4f12-a276-0623dcff71a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00f75850df404626bab06f20f9faee87'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:47.890134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b358ede9-b405-4f12-a276-0623dcff71a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00f75850df404626bab06f20f9faee87'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:47.896638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b358ede9-b405-4f12-a276-0623dcff71a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00f75850df404626bab06f20f9faee87'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:47.898601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b358ede9-b405-4f12-a276-0623dcff71a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00f75850df404626bab06f20f9faee87'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:47.966575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b358ede9-b405-4f12-a276-0623dcff71a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00f75850df404626bab06f20f9faee87'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:47.980556 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2630/5206] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:35:47 2022] DELETE /identity/v3/users/00f75850df404626bab06f20f9faee87 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:47.985124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38c62c-175c-44f0-94b9-9a1e202be097 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:47.986022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38c62c-175c-44f0-94b9-9a1e202be097 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:47.986590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38c62c-175c-44f0-94b9-9a1e202be097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:48.027572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-fd38c62c-175c-44f0-94b9-9a1e202be097 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:48.029623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fd38c62c-175c-44f0-94b9-9a1e202be097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:48.073879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a3128-4213-4815-9e63-90cb503fcbf1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:48.074277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a3128-4213-4815-9e63-90cb503fcbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:48.074563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a3128-4213-4815-9e63-90cb503fcbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:48.098443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-cd1a3128-4213-4815-9e63-90cb503fcbf1 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:48.100547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cd1a3128-4213-4815-9e63-90cb503fcbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:48.124028 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2577/5207] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:48.154844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38c62c-175c-44f0-94b9-9a1e202be097 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:48.158617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fd38c62c-175c-44f0-94b9-9a1e202be097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:48.254637 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2631/5208] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:35:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:35:48.271436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a3128-4213-4815-9e63-90cb503fcbf1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:48.273112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cd1a3128-4213-4815-9e63-90cb503fcbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:48.329496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38c62c-175c-44f0-94b9-9a1e202be097 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:48.335381 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:48.339393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d44df-0f41-41b5-b3bb-6bd91c9cb6ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:48.340070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d44df-0f41-41b5-b3bb-6bd91c9cb6ef service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:48.340357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d44df-0f41-41b5-b3bb-6bd91c9cb6ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:48.340638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982d44df-0f41-41b5-b3bb-6bd91c9cb6ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:48.379302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d44df-0f41-41b5-b3bb-6bd91c9cb6ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:48.386723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982d44df-0f41-41b5-b3bb-6bd91c9cb6ef service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:48.421834 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2578/5209] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:35:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:35:48.453536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a3128-4213-4815-9e63-90cb503fcbf1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:48.462809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f2ded-51e1-4e10-b530-6237e34c66ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:48.470643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f2ded-51e1-4e10-b530-6237e34c66ab service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:48.470643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f2ded-51e1-4e10-b530-6237e34c66ab service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:48.470643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2f2ded-51e1-4e10-b530-6237e34c66ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:48.477080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f2ded-51e1-4e10-b530-6237e34c66ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:48.479121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2f2ded-51e1-4e10-b530-6237e34c66ab service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:48.502501 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2632/5210] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:35:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 14:35:48.991076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d44df-0f41-41b5-b3bb-6bd91c9cb6ef service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:48.993575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-982d44df-0f41-41b5-b3bb-6bd91c9cb6ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:49.016259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982d44df-0f41-41b5-b3bb-6bd91c9cb6ef service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:49.023964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66ba8e-9b41-4ddc-969a-86e7d44229af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:49.025055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66ba8e-9b41-4ddc-969a-86e7d44229af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:49.025999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66ba8e-9b41-4ddc-969a-86e7d44229af admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:49.026457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66ba8e-9b41-4ddc-969a-86e7d44229af admin admin] PATH_INFO: `/v3/projects/9066e1849e1047098f7f0d7dd57f418c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:49.027863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66ba8e-9b41-4ddc-969a-86e7d44229af admin admin] RBAC: Authorizing `identity:delete_project(project_id=9066e1849e1047098f7f0d7dd57f418c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:49.029945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c66ba8e-9b41-4ddc-969a-86e7d44229af admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:49.185585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9c66ba8e-9b41-4ddc-969a-86e7d44229af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9066e1849e1047098f7f0d7dd57f418c', 'request_id': 'req-9c66ba8e-9b41-4ddc-969a-86e7d44229af'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:49.279608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9c66ba8e-9b41-4ddc-969a-86e7d44229af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9066e1849e1047098f7f0d7dd57f418c', 'request_id': 'req-9c66ba8e-9b41-4ddc-969a-86e7d44229af'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:49.286949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9c66ba8e-9b41-4ddc-969a-86e7d44229af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9066e1849e1047098f7f0d7dd57f418c', 'request_id': 'req-9c66ba8e-9b41-4ddc-969a-86e7d44229af'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:49.299661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9c66ba8e-9b41-4ddc-969a-86e7d44229af admin admin] The token cache is being invalidate because project 9066e1849e1047098f7f0d7dd57f418c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:35:49.300201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9c66ba8e-9b41-4ddc-969a-86e7d44229af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:49.301055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9c66ba8e-9b41-4ddc-969a-86e7d44229af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:49.315415 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2579/5211] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:35:48 2022] DELETE /identity/v3/projects/9066e1849e1047098f7f0d7dd57f418c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:49.319912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f2ded-51e1-4e10-b530-6237e34c66ab service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:49.332084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2f2ded-51e1-4e10-b530-6237e34c66ab service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:49.425546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18cd7b3-3669-4332-b3cf-b56caaff0178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:49.427446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cd7b3-3669-4332-b3cf-b56caaff0178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:49.428066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cd7b3-3669-4332-b3cf-b56caaff0178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:49.428796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18cd7b3-3669-4332-b3cf-b56caaff0178 admin admin] PATH_INFO: `/v3/users/9228a48794b745f185f4104dd7a79219` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:49.430719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18cd7b3-3669-4332-b3cf-b56caaff0178 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9228a48794b745f185f4104dd7a79219)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:49.433804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18cd7b3-3669-4332-b3cf-b56caaff0178 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:49.602054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e18cd7b3-3669-4332-b3cf-b56caaff0178 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9228a48794b745f185f4104dd7a79219'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:49.623279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e18cd7b3-3669-4332-b3cf-b56caaff0178 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9228a48794b745f185f4104dd7a79219'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:49.634970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e18cd7b3-3669-4332-b3cf-b56caaff0178 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9228a48794b745f185f4104dd7a79219'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:49.635800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e18cd7b3-3669-4332-b3cf-b56caaff0178 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9228a48794b745f185f4104dd7a79219'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:49.702661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e18cd7b3-3669-4332-b3cf-b56caaff0178 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9228a48794b745f185f4104dd7a79219'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:49.712020 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2633/5212] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:35:49 2022] DELETE /identity/v3/users/9228a48794b745f185f4104dd7a79219 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:50.575642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66ba8e-9b41-4ddc-969a-86e7d44229af admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:50.577390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9c66ba8e-9b41-4ddc-969a-86e7d44229af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:50.607081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66ba8e-9b41-4ddc-969a-86e7d44229af admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:50.699155 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:50.809966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df431349-a870-4a7f-9811-c85112059252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:50.822604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df431349-a870-4a7f-9811-c85112059252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:50.822940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df431349-a870-4a7f-9811-c85112059252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:50.824355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df431349-a870-4a7f-9811-c85112059252 admin admin] PATH_INFO: `/v3/projects/9b9d6bc19f594ba892654885fd56ddcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:50.834568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df431349-a870-4a7f-9811-c85112059252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9d6bc19f594ba892654885fd56ddcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:50.837933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df431349-a870-4a7f-9811-c85112059252 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:51.011719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-df431349-a870-4a7f-9811-c85112059252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9d6bc19f594ba892654885fd56ddcb', 'request_id': 'req-df431349-a870-4a7f-9811-c85112059252'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:51.081364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-df431349-a870-4a7f-9811-c85112059252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9d6bc19f594ba892654885fd56ddcb', 'request_id': 'req-df431349-a870-4a7f-9811-c85112059252'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:51.091888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-df431349-a870-4a7f-9811-c85112059252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9d6bc19f594ba892654885fd56ddcb', 'request_id': 'req-df431349-a870-4a7f-9811-c85112059252'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:51.115498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-df431349-a870-4a7f-9811-c85112059252 admin admin] The token cache is being invalidate because project 9b9d6bc19f594ba892654885fd56ddcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:35:51.116719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-df431349-a870-4a7f-9811-c85112059252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:51.118296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-df431349-a870-4a7f-9811-c85112059252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:51.133657 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2580/5213] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:35:50 2022] DELETE /identity/v3/projects/9b9d6bc19f594ba892654885fd56ddcb => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:51.138357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896d1ef-ed06-4862-9971-1a7b7695bad6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:51.139236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896d1ef-ed06-4862-9971-1a7b7695bad6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:51.140658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896d1ef-ed06-4862-9971-1a7b7695bad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:51.172402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df431349-a870-4a7f-9811-c85112059252 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:51.174411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-df431349-a870-4a7f-9811-c85112059252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:51.189988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4896d1ef-ed06-4862-9971-1a7b7695bad6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:51.194302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4896d1ef-ed06-4862-9971-1a7b7695bad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:51.257431 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:51.340840 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2634/5214] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:51.341070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df431349-a870-4a7f-9811-c85112059252 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:51.346486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc8ce3-9c18-48ea-a0c8-8e624843597b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:51.347250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc8ce3-9c18-48ea-a0c8-8e624843597b service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:51.347545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc8ce3-9c18-48ea-a0c8-8e624843597b service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:51.347829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc8ce3-9c18-48ea-a0c8-8e624843597b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:51.349683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4e1fc-0794-4bc6-8fcf-f183f5f15253 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:51.350178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4e1fc-0794-4bc6-8fcf-f183f5f15253 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:51.350596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2ecc8ce3-9c18-48ea-a0c8-8e624843597b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:51.350804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4e1fc-0794-4bc6-8fcf-f183f5f15253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:51.382873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc8ce3-9c18-48ea-a0c8-8e624843597b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:51.384810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc8ce3-9c18-48ea-a0c8-8e624843597b service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:51.397758 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2581/5215] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:35:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:35:51.399662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-44d4e1fc-0794-4bc6-8fcf-f183f5f15253 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:51.400899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-44d4e1fc-0794-4bc6-8fcf-f183f5f15253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:51.429533 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2635/5216] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:51.438145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc8ce3-9c18-48ea-a0c8-8e624843597b service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:51.455009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc8ce3-9c18-48ea-a0c8-8e624843597b service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:51.461166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7564a6-39d5-4803-a86c-e363343a6305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:51.461960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7564a6-39d5-4803-a86c-e363343a6305 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:51.462328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7564a6-39d5-4803-a86c-e363343a6305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:51.462672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7564a6-39d5-4803-a86c-e363343a6305 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:51.463652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7564a6-39d5-4803-a86c-e363343a6305 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:35:51.464027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7564a6-39d5-4803-a86c-e363343a6305 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:51.465691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7564a6-39d5-4803-a86c-e363343a6305 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:51.486237 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2582/5217] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:35:51.494947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4e1fc-0794-4bc6-8fcf-f183f5f15253 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:51.518733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4e1fc-0794-4bc6-8fcf-f183f5f15253 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:51.527375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce972eb-3288-41a9-97ee-349243ab2d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:51.528041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce972eb-3288-41a9-97ee-349243ab2d03 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:51.528328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce972eb-3288-41a9-97ee-349243ab2d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:51.528612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce972eb-3288-41a9-97ee-349243ab2d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:51.532040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce972eb-3288-41a9-97ee-349243ab2d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:51.532040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce972eb-3288-41a9-97ee-349243ab2d03 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:51.644441 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2636/5218] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:35:51 2022] POST /identity/v3/projects => generated 407 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:35:51.646154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7564a6-39d5-4803-a86c-e363343a6305 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:51.667275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7564a6-39d5-4803-a86c-e363343a6305 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:51.714524 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:51.785075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba845e9-c1bb-46e7-bfc2-4457cca90073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:51.787066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba845e9-c1bb-46e7-bfc2-4457cca90073 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:51.791682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba845e9-c1bb-46e7-bfc2-4457cca90073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:51.791682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba845e9-c1bb-46e7-bfc2-4457cca90073 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:51.791682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba845e9-c1bb-46e7-bfc2-4457cca90073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:51.797922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba845e9-c1bb-46e7-bfc2-4457cca90073 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:51.933672 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2583/5219] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:35:51 2022] POST /identity/v3/users => generated 304 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:35:51.943598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce972eb-3288-41a9-97ee-349243ab2d03 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:51.964673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce972eb-3288-41a9-97ee-349243ab2d03 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:51.971471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23191f8b-ab7c-434e-98ae-d23cdf0e6aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:51.972234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23191f8b-ab7c-434e-98ae-d23cdf0e6aa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:51.972528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23191f8b-ab7c-434e-98ae-d23cdf0e6aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:51.972804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23191f8b-ab7c-434e-98ae-d23cdf0e6aa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:51.974075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23191f8b-ab7c-434e-98ae-d23cdf0e6aa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:51.975705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23191f8b-ab7c-434e-98ae-d23cdf0e6aa7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:52.000081 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2637/5220] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:35:51 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:35:52.005970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba845e9-c1bb-46e7-bfc2-4457cca90073 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:52.024296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba845e9-c1bb-46e7-bfc2-4457cca90073 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:52.037089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cfba08-1b2b-4661-bd96-ca70caa537aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:52.037844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfba08-1b2b-4661-bd96-ca70caa537aa admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:52.043157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfba08-1b2b-4661-bd96-ca70caa537aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:52.043157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cfba08-1b2b-4661-bd96-ca70caa537aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:52.043157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfba08-1b2b-4661-bd96-ca70caa537aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:52.043157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cfba08-1b2b-4661-bd96-ca70caa537aa admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:52.061433 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2584/5221] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:35:52.065665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23191f8b-ab7c-434e-98ae-d23cdf0e6aa7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:52.077532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23191f8b-ab7c-434e-98ae-d23cdf0e6aa7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:52.082279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a63b2-c56d-4598-b26c-57a48e860fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:52.083239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a63b2-c56d-4598-b26c-57a48e860fc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:52.083532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a63b2-c56d-4598-b26c-57a48e860fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:52.084013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a63b2-c56d-4598-b26c-57a48e860fc4 admin admin] PATH_INFO: `/v3/projects/9e36e4d1c9f14581adacd985f9145e4c/users/fcd49c4825e9449791931fc71f840ffb/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:52.103771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a63b2-c56d-4598-b26c-57a48e860fc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e36e4d1c9f14581adacd985f9145e4c, user_id=fcd49c4825e9449791931fc71f840ffb, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:52.107249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a63b2-c56d-4598-b26c-57a48e860fc4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:52.196425 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2638/5222] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:35:52 2022] PUT /identity/v3/projects/9e36e4d1c9f14581adacd985f9145e4c/users/fcd49c4825e9449791931fc71f840ffb/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:52.204431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb64a19-edac-4542-88a3-692e655eacc7 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:52.204727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb64a19-edac-4542-88a3-692e655eacc7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:52.205011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb64a19-edac-4542-88a3-692e655eacc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:52.245596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-bdb64a19-edac-4542-88a3-692e655eacc7 None None] MFA Rules not processed for user `fcd49c4825e9449791931fc71f840ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:52.247047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bdb64a19-edac-4542-88a3-692e655eacc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:52.330398 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2585/5223] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:52 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:52.335718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a63b2-c56d-4598-b26c-57a48e860fc4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:52.438856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a63b2-c56d-4598-b26c-57a48e860fc4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:52.445770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914c44d-ba76-44b1-84d2-ec34c01b1106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:52.446797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914c44d-ba76-44b1-84d2-ec34c01b1106 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:52.447262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914c44d-ba76-44b1-84d2-ec34c01b1106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:52.447741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914c44d-ba76-44b1-84d2-ec34c01b1106 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:52.448691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914c44d-ba76-44b1-84d2-ec34c01b1106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:52.453195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914c44d-ba76-44b1-84d2-ec34c01b1106 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:52.559254 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2639/5224] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:35:52 2022] POST /identity/v3/projects => generated 407 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:35:52.560200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb64a19-edac-4542-88a3-692e655eacc7 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:52.574963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb64a19-edac-4542-88a3-692e655eacc7 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:52.689798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa877e-34c7-4bf2-b2cb-df2b0324e359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:52.690508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa877e-34c7-4bf2-b2cb-df2b0324e359 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:52.690886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa877e-34c7-4bf2-b2cb-df2b0324e359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:52.691579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa877e-34c7-4bf2-b2cb-df2b0324e359 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:52.691999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa877e-34c7-4bf2-b2cb-df2b0324e359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:52.698478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa877e-34c7-4bf2-b2cb-df2b0324e359 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:52.798325 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2586/5225] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:35:52 2022] POST /identity/v3/users => generated 310 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:35:52.799807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914c44d-ba76-44b1-84d2-ec34c01b1106 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:52.810814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914c44d-ba76-44b1-84d2-ec34c01b1106 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:52.815570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594ad5c-4abe-4da7-8e11-c56bace30d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:52.816244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594ad5c-4abe-4da7-8e11-c56bace30d34 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:52.816534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594ad5c-4abe-4da7-8e11-c56bace30d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:52.816822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5594ad5c-4abe-4da7-8e11-c56bace30d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:52.818114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594ad5c-4abe-4da7-8e11-c56bace30d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:52.819734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5594ad5c-4abe-4da7-8e11-c56bace30d34 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:52.834173 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2640/5226] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:35:52.837398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa877e-34c7-4bf2-b2cb-df2b0324e359 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:52.848091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa877e-34c7-4bf2-b2cb-df2b0324e359 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:52.853033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d166c38-049c-4e1b-887d-201800bdf365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:52.854046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d166c38-049c-4e1b-887d-201800bdf365 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:52.854367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d166c38-049c-4e1b-887d-201800bdf365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:52.854651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d166c38-049c-4e1b-887d-201800bdf365 admin admin] PATH_INFO: `/v3/projects/7a63ccf27825405e8fc9803a3b30c699/users/e8cd45ef2284430589485b04d468f118/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:52.873525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d166c38-049c-4e1b-887d-201800bdf365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a63ccf27825405e8fc9803a3b30c699, user_id=e8cd45ef2284430589485b04d468f118, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:52.876537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d166c38-049c-4e1b-887d-201800bdf365 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:52.961306 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2587/5227] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:35:52 2022] PUT /identity/v3/projects/7a63ccf27825405e8fc9803a3b30c699/users/e8cd45ef2284430589485b04d468f118/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:52.963858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594ad5c-4abe-4da7-8e11-c56bace30d34 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:52.978549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5594ad5c-4abe-4da7-8e11-c56bace30d34 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:53.071615 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:53.092814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5b72c-6eef-471c-bead-5d042ecb15cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:53.093359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5b72c-6eef-471c-bead-5d042ecb15cc admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:53.094130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5b72c-6eef-471c-bead-5d042ecb15cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:53.094130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5b72c-6eef-471c-bead-5d042ecb15cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:53.094872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5b72c-6eef-471c-bead-5d042ecb15cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:53.102340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5b72c-6eef-471c-bead-5d042ecb15cc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:53.125821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d166c38-049c-4e1b-887d-201800bdf365 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:53.138447 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2641/5228] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:35:52 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:35:53.140462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d166c38-049c-4e1b-887d-201800bdf365 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:53.147874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e08f2-dae0-4136-b37d-f76f2192c204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:53.149108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e08f2-dae0-4136-b37d-f76f2192c204 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:53.149464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e08f2-dae0-4136-b37d-f76f2192c204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:53.149820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e08f2-dae0-4136-b37d-f76f2192c204 admin admin] PATH_INFO: `/v3/projects/7a63ccf27825405e8fc9803a3b30c699/users/e8cd45ef2284430589485b04d468f118/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:53.159078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e08f2-dae0-4136-b37d-f76f2192c204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a63ccf27825405e8fc9803a3b30c699, user_id=e8cd45ef2284430589485b04d468f118, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:53.164491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e08f2-dae0-4136-b37d-f76f2192c204 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:53.176097 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:53.214835 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2588/5229] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:35:53 2022] PUT /identity/v3/projects/7a63ccf27825405e8fc9803a3b30c699/users/e8cd45ef2284430589485b04d468f118/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:53.216985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72aa50-425e-4175-99e5-57e0562233a1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:53.218606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72aa50-425e-4175-99e5-57e0562233a1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:53.218606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72aa50-425e-4175-99e5-57e0562233a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:53.307224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3c72aa50-425e-4175-99e5-57e0562233a1 None None] MFA Rules not processed for user `e8cd45ef2284430589485b04d468f118`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:53.307224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3c72aa50-425e-4175-99e5-57e0562233a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:53.420082 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2642/5230] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:53 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:53.459143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e08f2-dae0-4136-b37d-f76f2192c204 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:53.461756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-876e08f2-dae0-4136-b37d-f76f2192c204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:53.580568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e08f2-dae0-4136-b37d-f76f2192c204 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:53.588997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e0d5c-197c-4cb1-b95d-2b9bbf5a6237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:53.589881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e0d5c-197c-4cb1-b95d-2b9bbf5a6237 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:53.590467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e0d5c-197c-4cb1-b95d-2b9bbf5a6237 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:53.591039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e0d5c-197c-4cb1-b95d-2b9bbf5a6237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:53.692879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e0d5c-197c-4cb1-b95d-2b9bbf5a6237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:53.694307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e0d5c-197c-4cb1-b95d-2b9bbf5a6237 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:53.705071 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2589/5231] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:35:53 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:35:54.230346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72aa50-425e-4175-99e5-57e0562233a1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:54.232438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3c72aa50-425e-4175-99e5-57e0562233a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:54.321329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72aa50-425e-4175-99e5-57e0562233a1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:54.327027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19f0b2-9da9-437d-bbe2-48e7d5497fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:54.328275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19f0b2-9da9-437d-bbe2-48e7d5497fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:54.328803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19f0b2-9da9-437d-bbe2-48e7d5497fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:54.329888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19f0b2-9da9-437d-bbe2-48e7d5497fe4 admin admin] PATH_INFO: `/v3/users/df144d2d8cc041958b4b659f4232d762` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:54.331430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19f0b2-9da9-437d-bbe2-48e7d5497fe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df144d2d8cc041958b4b659f4232d762)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:54.335824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19f0b2-9da9-437d-bbe2-48e7d5497fe4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:54.574154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3c19f0b2-9da9-437d-bbe2-48e7d5497fe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df144d2d8cc041958b4b659f4232d762'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:54.591251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3c19f0b2-9da9-437d-bbe2-48e7d5497fe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df144d2d8cc041958b4b659f4232d762'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:54.594176 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:54.618512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3c19f0b2-9da9-437d-bbe2-48e7d5497fe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df144d2d8cc041958b4b659f4232d762'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:54.620400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3c19f0b2-9da9-437d-bbe2-48e7d5497fe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df144d2d8cc041958b4b659f4232d762'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:54.668554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e0d5c-197c-4cb1-b95d-2b9bbf5a6237 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:54.670887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7f3e0d5c-197c-4cb1-b95d-2b9bbf5a6237 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:54.749745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3c19f0b2-9da9-437d-bbe2-48e7d5497fe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df144d2d8cc041958b4b659f4232d762'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:54.759365 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2643/5232] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:35:54 2022] DELETE /identity/v3/users/df144d2d8cc041958b4b659f4232d762 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:54.765156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30351e67-9cbd-4165-ac27-64abe2494bdd None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:54.765557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30351e67-9cbd-4165-ac27-64abe2494bdd None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:54.765939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30351e67-9cbd-4165-ac27-64abe2494bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:54.797651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-30351e67-9cbd-4165-ac27-64abe2494bdd None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:54.799159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-30351e67-9cbd-4165-ac27-64abe2494bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:54.804430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e0d5c-197c-4cb1-b95d-2b9bbf5a6237 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:54.896484 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:54.920363 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2644/5233] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:54.933589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30351e67-9cbd-4165-ac27-64abe2494bdd None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:54.935946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-30351e67-9cbd-4165-ac27-64abe2494bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:54.936088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222836d4-a7ce-4b2c-9ac1-10d5945770e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:54.936227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222836d4-a7ce-4b2c-9ac1-10d5945770e0 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:54.936737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222836d4-a7ce-4b2c-9ac1-10d5945770e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:54.937035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222836d4-a7ce-4b2c-9ac1-10d5945770e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:54.939235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-222836d4-a7ce-4b2c-9ac1-10d5945770e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:55.043618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30351e67-9cbd-4165-ac27-64abe2494bdd None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:55.048753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee7505-5825-4a53-8653-822a193e6234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:55.049402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee7505-5825-4a53-8653-822a193e6234 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:55.049694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee7505-5825-4a53-8653-822a193e6234 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:55.049977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee7505-5825-4a53-8653-822a193e6234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:55.054350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222836d4-a7ce-4b2c-9ac1-10d5945770e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:55.057064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222836d4-a7ce-4b2c-9ac1-10d5945770e0 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:55.063583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee7505-5825-4a53-8653-822a193e6234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:55.065398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee7505-5825-4a53-8653-822a193e6234 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:55.082974 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2590/5234] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:35:54 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:35:55.087393 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2645/5235] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:35:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:35:55.382298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222836d4-a7ce-4b2c-9ac1-10d5945770e0 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:55.383162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-222836d4-a7ce-4b2c-9ac1-10d5945770e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:55.408211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222836d4-a7ce-4b2c-9ac1-10d5945770e0 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:55.419715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2a324d-26c9-4a88-9d97-93b556e65c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:55.420925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a324d-26c9-4a88-9d97-93b556e65c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:55.421162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a324d-26c9-4a88-9d97-93b556e65c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:55.428347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2a324d-26c9-4a88-9d97-93b556e65c9e admin admin] PATH_INFO: `/v3/projects/260730c735c74f6da5b39e6f8f5783c7` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:55.428347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a324d-26c9-4a88-9d97-93b556e65c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=260730c735c74f6da5b39e6f8f5783c7)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:55.428347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2a324d-26c9-4a88-9d97-93b556e65c9e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:55.557609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1b2a324d-26c9-4a88-9d97-93b556e65c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '260730c735c74f6da5b39e6f8f5783c7', 'request_id': 'req-1b2a324d-26c9-4a88-9d97-93b556e65c9e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:55.648922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1b2a324d-26c9-4a88-9d97-93b556e65c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '260730c735c74f6da5b39e6f8f5783c7', 'request_id': 'req-1b2a324d-26c9-4a88-9d97-93b556e65c9e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:55.663132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1b2a324d-26c9-4a88-9d97-93b556e65c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '260730c735c74f6da5b39e6f8f5783c7', 'request_id': 'req-1b2a324d-26c9-4a88-9d97-93b556e65c9e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:55.703922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1b2a324d-26c9-4a88-9d97-93b556e65c9e admin admin] The token cache is being invalidate because project 260730c735c74f6da5b39e6f8f5783c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:35:55.704562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1b2a324d-26c9-4a88-9d97-93b556e65c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:55.706153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1b2a324d-26c9-4a88-9d97-93b556e65c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:35:55.708888 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2591/5236] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:35:55 2022] DELETE /identity/v3/projects/260730c735c74f6da5b39e6f8f5783c7 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:35:55.713938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607a738-564a-4fa2-94e9-edaab262a27b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:55.714484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607a738-564a-4fa2-94e9-edaab262a27b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:55.714706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607a738-564a-4fa2-94e9-edaab262a27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:55.741682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3607a738-564a-4fa2-94e9-edaab262a27b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:55.743808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3607a738-564a-4fa2-94e9-edaab262a27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:55.834525 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2646/5237] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:35:55.836432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b3606-e2d9-4bee-86fa-1aa456f5edeb None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:55.836939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b3606-e2d9-4bee-86fa-1aa456f5edeb None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:55.837041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b3606-e2d9-4bee-86fa-1aa456f5edeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:55.882468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6f2b3606-e2d9-4bee-86fa-1aa456f5edeb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:55.884314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6f2b3606-e2d9-4bee-86fa-1aa456f5edeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:55.893546 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2592/5238] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:55.903220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607a738-564a-4fa2-94e9-edaab262a27b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:55.908209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607a738-564a-4fa2-94e9-edaab262a27b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:55.923016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be6364-5a4f-429c-abea-8286511c3469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:55.923660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be6364-5a4f-429c-abea-8286511c3469 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:55.923949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be6364-5a4f-429c-abea-8286511c3469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:55.924241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be6364-5a4f-429c-abea-8286511c3469 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:55.925034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be6364-5a4f-429c-abea-8286511c3469 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:35:55.925350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be6364-5a4f-429c-abea-8286511c3469 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:55.928167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be6364-5a4f-429c-abea-8286511c3469 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:55.941719 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2647/5239] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:35:55.946754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b3606-e2d9-4bee-86fa-1aa456f5edeb None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:55.956211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b3606-e2d9-4bee-86fa-1aa456f5edeb None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:55.961406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb282fca-95f2-40c6-9a98-3c5f36738b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:55.962212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb282fca-95f2-40c6-9a98-3c5f36738b0e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:55.962568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb282fca-95f2-40c6-9a98-3c5f36738b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:55.962943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb282fca-95f2-40c6-9a98-3c5f36738b0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:55.964198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb282fca-95f2-40c6-9a98-3c5f36738b0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:55.966302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb282fca-95f2-40c6-9a98-3c5f36738b0e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:56.062805 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2593/5240] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:35:55 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:35:56.066830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be6364-5a4f-429c-abea-8286511c3469 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:56.083487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be6364-5a4f-429c-abea-8286511c3469 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:56.103658 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:56.169730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755645c-4667-45db-9d99-4f38fff2424a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:56.170514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755645c-4667-45db-9d99-4f38fff2424a admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:56.170786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755645c-4667-45db-9d99-4f38fff2424a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:56.171059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2755645c-4667-45db-9d99-4f38fff2424a admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:56.171762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755645c-4667-45db-9d99-4f38fff2424a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:56.173867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2755645c-4667-45db-9d99-4f38fff2424a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:56.305108 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2648/5241] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:35:56 2022] POST /identity/v3/users => generated 283 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:35:56.308075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb282fca-95f2-40c6-9a98-3c5f36738b0e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:56.344860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb282fca-95f2-40c6-9a98-3c5f36738b0e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:56.358200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18008e71-55d4-4809-a336-4a0045f68b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:56.359826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18008e71-55d4-4809-a336-4a0045f68b16 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:56.361011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18008e71-55d4-4809-a336-4a0045f68b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:56.361304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18008e71-55d4-4809-a336-4a0045f68b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:56.362080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18008e71-55d4-4809-a336-4a0045f68b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:56.369811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18008e71-55d4-4809-a336-4a0045f68b16 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:56.396578 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2594/5242] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:35:56.400313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755645c-4667-45db-9d99-4f38fff2424a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:56.418691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2755645c-4667-45db-9d99-4f38fff2424a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:56.437466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1405e-df35-41fa-90ff-46907462a8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:56.438218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1405e-df35-41fa-90ff-46907462a8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:56.438516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1405e-df35-41fa-90ff-46907462a8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:56.439583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1405e-df35-41fa-90ff-46907462a8c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:56.440346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1405e-df35-41fa-90ff-46907462a8c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:56.443036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1405e-df35-41fa-90ff-46907462a8c9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:56.486570 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2649/5243] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:35:56 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:35:56.490468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18008e71-55d4-4809-a336-4a0045f68b16 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:56.505032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18008e71-55d4-4809-a336-4a0045f68b16 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:56.530994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea80ed-3b72-45fc-9a6a-84c01d84b996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:56.532235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea80ed-3b72-45fc-9a6a-84c01d84b996 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:56.534629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea80ed-3b72-45fc-9a6a-84c01d84b996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:56.535039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea80ed-3b72-45fc-9a6a-84c01d84b996 admin admin] PATH_INFO: `/v3/projects/0cc518a66a524366b1d67cfd674f3b15/users/223011fd5d72453793f1175e9a38360b/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:56.584034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea80ed-3b72-45fc-9a6a-84c01d84b996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cc518a66a524366b1d67cfd674f3b15, user_id=223011fd5d72453793f1175e9a38360b, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:56.592304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea80ed-3b72-45fc-9a6a-84c01d84b996 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:56.694070 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:56.701539 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2595/5244] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:35:56 2022] PUT /identity/v3/projects/0cc518a66a524366b1d67cfd674f3b15/users/223011fd5d72453793f1175e9a38360b/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:56.712818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bad1e-b0d6-4644-b91a-808282e63f52 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:56.713125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bad1e-b0d6-4644-b91a-808282e63f52 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:56.713424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839bad1e-b0d6-4644-b91a-808282e63f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:56.743937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-839bad1e-b0d6-4644-b91a-808282e63f52 None None] MFA Rules not processed for user `223011fd5d72453793f1175e9a38360b`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:56.745259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-839bad1e-b0d6-4644-b91a-808282e63f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:56.814252 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2650/5245] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:56.820955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea80ed-3b72-45fc-9a6a-84c01d84b996 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:56.890705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea80ed-3b72-45fc-9a6a-84c01d84b996 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:56.898492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811872b1-82fc-4d76-9aa4-516d93e0706f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:56.899267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811872b1-82fc-4d76-9aa4-516d93e0706f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:56.899562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811872b1-82fc-4d76-9aa4-516d93e0706f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:56.899873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811872b1-82fc-4d76-9aa4-516d93e0706f admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:56.900736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811872b1-82fc-4d76-9aa4-516d93e0706f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:56.903066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811872b1-82fc-4d76-9aa4-516d93e0706f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:57.029612 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2596/5246] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:35:56 2022] POST /identity/v3/projects => generated 365 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:35:57.031009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bad1e-b0d6-4644-b91a-808282e63f52 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:57.044360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839bad1e-b0d6-4644-b91a-808282e63f52 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:57.188874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9522c61-ed50-4d84-8f64-05977c69526c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:57.189974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9522c61-ed50-4d84-8f64-05977c69526c admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:57.190526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9522c61-ed50-4d84-8f64-05977c69526c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:57.191015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9522c61-ed50-4d84-8f64-05977c69526c admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:57.194003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9522c61-ed50-4d84-8f64-05977c69526c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:57.196244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9522c61-ed50-4d84-8f64-05977c69526c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:57.294433 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2651/5247] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:35:57 2022] POST /identity/v3/users => generated 289 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:35:57.299362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811872b1-82fc-4d76-9aa4-516d93e0706f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:57.320898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811872b1-82fc-4d76-9aa4-516d93e0706f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:57.349388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5aa5b-8d1e-4f3f-b758-e5f1724271c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:57.349388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5aa5b-8d1e-4f3f-b758-e5f1724271c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:57.349388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5aa5b-8d1e-4f3f-b758-e5f1724271c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:57.349388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5aa5b-8d1e-4f3f-b758-e5f1724271c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:57.349782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5aa5b-8d1e-4f3f-b758-e5f1724271c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:57.349782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a5aa5b-8d1e-4f3f-b758-e5f1724271c7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:57.378631 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2597/5248] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:35:57.380246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9522c61-ed50-4d84-8f64-05977c69526c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:57.392720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9522c61-ed50-4d84-8f64-05977c69526c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:57.400363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905cd1e-2c0a-43e0-9217-504a0f610bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:57.401521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905cd1e-2c0a-43e0-9217-504a0f610bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:57.401805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905cd1e-2c0a-43e0-9217-504a0f610bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:57.402483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905cd1e-2c0a-43e0-9217-504a0f610bb9 admin admin] PATH_INFO: `/v3/projects/ee80ee65c7544bb3a0188f4ae1d4ac9e/users/d6ac960360a14fe9ac384a932c3082c6/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:57.417224 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:57.421958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905cd1e-2c0a-43e0-9217-504a0f610bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee80ee65c7544bb3a0188f4ae1d4ac9e, user_id=d6ac960360a14fe9ac384a932c3082c6, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:57.424795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905cd1e-2c0a-43e0-9217-504a0f610bb9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:57.535912 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2652/5249] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:35:57 2022] PUT /identity/v3/projects/ee80ee65c7544bb3a0188f4ae1d4ac9e/users/d6ac960360a14fe9ac384a932c3082c6/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:57.541976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5aa5b-8d1e-4f3f-b758-e5f1724271c7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:57.555599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5aa5b-8d1e-4f3f-b758-e5f1724271c7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:57.664182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ab082-fa2d-4f01-9516-d06c431b31ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:57.664879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ab082-fa2d-4f01-9516-d06c431b31ba admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:57.665630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ab082-fa2d-4f01-9516-d06c431b31ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:57.665916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ab082-fa2d-4f01-9516-d06c431b31ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:57.666700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ab082-fa2d-4f01-9516-d06c431b31ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:57.668476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ab082-fa2d-4f01-9516-d06c431b31ba admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:57.681429 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2598/5250] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:35:57 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:35:57.685703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905cd1e-2c0a-43e0-9217-504a0f610bb9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:57.702933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905cd1e-2c0a-43e0-9217-504a0f610bb9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:57.717240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f89090-1e2c-4340-92c3-f445b29ea44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:57.718209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f89090-1e2c-4340-92c3-f445b29ea44b admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:57.718502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f89090-1e2c-4340-92c3-f445b29ea44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:57.718780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f89090-1e2c-4340-92c3-f445b29ea44b admin admin] PATH_INFO: `/v3/projects/ee80ee65c7544bb3a0188f4ae1d4ac9e/users/d6ac960360a14fe9ac384a932c3082c6/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:57.723092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f89090-1e2c-4340-92c3-f445b29ea44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee80ee65c7544bb3a0188f4ae1d4ac9e, user_id=d6ac960360a14fe9ac384a932c3082c6, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:57.731464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f89090-1e2c-4340-92c3-f445b29ea44b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:57.775112 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2653/5251] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:35:57 2022] PUT /identity/v3/projects/ee80ee65c7544bb3a0188f4ae1d4ac9e/users/d6ac960360a14fe9ac384a932c3082c6/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:35:57.777123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d9de0-c912-434d-a39e-93b9dd04fb3f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:57.777283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d9de0-c912-434d-a39e-93b9dd04fb3f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:57.778308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d9de0-c912-434d-a39e-93b9dd04fb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:57.825453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-872d9de0-c912-434d-a39e-93b9dd04fb3f None None] MFA Rules not processed for user `d6ac960360a14fe9ac384a932c3082c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:35:57.827025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-872d9de0-c912-434d-a39e-93b9dd04fb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:57.978081 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:35:58.012659 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2599/5252] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:35:57 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:35:58.013351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f89090-1e2c-4340-92c3-f445b29ea44b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:58.015148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-16f89090-1e2c-4340-92c3-f445b29ea44b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:35:58.110656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f89090-1e2c-4340-92c3-f445b29ea44b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:58.115260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fec1e3-2194-4a0d-82da-6f322f53a36f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:58.116188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fec1e3-2194-4a0d-82da-6f322f53a36f service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:58.116548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fec1e3-2194-4a0d-82da-6f322f53a36f service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:58.116901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fec1e3-2194-4a0d-82da-6f322f53a36f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:58.147319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fec1e3-2194-4a0d-82da-6f322f53a36f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:58.149275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fec1e3-2194-4a0d-82da-6f322f53a36f service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:58.180440 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2654/5253] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:35:58 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:35:58.501050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d9de0-c912-434d-a39e-93b9dd04fb3f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:35:58.522593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d9de0-c912-434d-a39e-93b9dd04fb3f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:35:58.538834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b9fe56-a58c-481c-957d-8d5adb525749 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:35:58.539905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9fe56-a58c-481c-957d-8d5adb525749 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:35:58.540542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9fe56-a58c-481c-957d-8d5adb525749 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:35:58.541136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b9fe56-a58c-481c-957d-8d5adb525749 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:35:58.664842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9fe56-a58c-481c-957d-8d5adb525749 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:35:58.668332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b9fe56-a58c-481c-957d-8d5adb525749 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:35:58.683339 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2600/5254] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:35:58 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:36:07.026389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fec1e3-2194-4a0d-82da-6f322f53a36f service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:07.028091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-57fec1e3-2194-4a0d-82da-6f322f53a36f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:07.210163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fec1e3-2194-4a0d-82da-6f322f53a36f service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:07.223188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91076c95-356c-495f-9dd5-cc53730be46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:07.223188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91076c95-356c-495f-9dd5-cc53730be46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:07.223188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91076c95-356c-495f-9dd5-cc53730be46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:07.223188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91076c95-356c-495f-9dd5-cc53730be46f admin admin] PATH_INFO: `/v3/users/fcd49c4825e9449791931fc71f840ffb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:07.225117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91076c95-356c-495f-9dd5-cc53730be46f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcd49c4825e9449791931fc71f840ffb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:07.226791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91076c95-356c-495f-9dd5-cc53730be46f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:07.505457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-91076c95-356c-495f-9dd5-cc53730be46f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcd49c4825e9449791931fc71f840ffb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:07.529460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-91076c95-356c-495f-9dd5-cc53730be46f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcd49c4825e9449791931fc71f840ffb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:07.556619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-91076c95-356c-495f-9dd5-cc53730be46f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcd49c4825e9449791931fc71f840ffb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:07.558495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-91076c95-356c-495f-9dd5-cc53730be46f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcd49c4825e9449791931fc71f840ffb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:07.709266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-91076c95-356c-495f-9dd5-cc53730be46f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcd49c4825e9449791931fc71f840ffb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:07.713358 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:07.727999 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2655/5255] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:36:07 2022] DELETE /identity/v3/users/fcd49c4825e9449791931fc71f840ffb => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:07.732689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d497996-7471-40c9-a20b-a82acbcf6f4e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:07.733254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d497996-7471-40c9-a20b-a82acbcf6f4e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:07.733254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d497996-7471-40c9-a20b-a82acbcf6f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:07.773543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7d497996-7471-40c9-a20b-a82acbcf6f4e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:07.775729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7d497996-7471-40c9-a20b-a82acbcf6f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:07.927337 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2601/5256] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:07.934529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91076c95-356c-495f-9dd5-cc53730be46f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:07.936101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-91076c95-356c-495f-9dd5-cc53730be46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:08.083829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91076c95-356c-495f-9dd5-cc53730be46f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:08.089794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a56dbf-5057-40f6-b4ba-297650ec2156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:08.089794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a56dbf-5057-40f6-b4ba-297650ec2156 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:08.090538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a56dbf-5057-40f6-b4ba-297650ec2156 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:08.090538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a56dbf-5057-40f6-b4ba-297650ec2156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:08.109377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a56dbf-5057-40f6-b4ba-297650ec2156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:08.111115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a56dbf-5057-40f6-b4ba-297650ec2156 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:08.134796 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2656/5257] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:36:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:36:08.399821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d497996-7471-40c9-a20b-a82acbcf6f4e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:08.401520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7d497996-7471-40c9-a20b-a82acbcf6f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:08.423698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d497996-7471-40c9-a20b-a82acbcf6f4e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:08.438128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94f35b-32c4-44e3-9730-39745ddf91e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:08.439201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94f35b-32c4-44e3-9730-39745ddf91e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:08.441531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94f35b-32c4-44e3-9730-39745ddf91e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:08.441885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a94f35b-32c4-44e3-9730-39745ddf91e6 admin admin] PATH_INFO: `/v3/projects/9e36e4d1c9f14581adacd985f9145e4c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:08.445306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94f35b-32c4-44e3-9730-39745ddf91e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e36e4d1c9f14581adacd985f9145e4c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:08.455447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a94f35b-32c4-44e3-9730-39745ddf91e6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:08.609480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8a94f35b-32c4-44e3-9730-39745ddf91e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e36e4d1c9f14581adacd985f9145e4c', 'request_id': 'req-8a94f35b-32c4-44e3-9730-39745ddf91e6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:08.702821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8a94f35b-32c4-44e3-9730-39745ddf91e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e36e4d1c9f14581adacd985f9145e4c', 'request_id': 'req-8a94f35b-32c4-44e3-9730-39745ddf91e6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:08.711138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8a94f35b-32c4-44e3-9730-39745ddf91e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e36e4d1c9f14581adacd985f9145e4c', 'request_id': 'req-8a94f35b-32c4-44e3-9730-39745ddf91e6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:08.722969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8a94f35b-32c4-44e3-9730-39745ddf91e6 admin admin] The token cache is being invalidate because project 9e36e4d1c9f14581adacd985f9145e4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:36:08.724053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8a94f35b-32c4-44e3-9730-39745ddf91e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:08.724949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8a94f35b-32c4-44e3-9730-39745ddf91e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:08.726672 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2602/5258] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:36:08 2022] DELETE /identity/v3/projects/9e36e4d1c9f14581adacd985f9145e4c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:08.730728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a56dbf-5057-40f6-b4ba-297650ec2156 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:08.742119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a56dbf-5057-40f6-b4ba-297650ec2156 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:08.853230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755946d-eeb1-49c6-9c27-f5fd4e268f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:08.855676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755946d-eeb1-49c6-9c27-f5fd4e268f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:08.855797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755946d-eeb1-49c6-9c27-f5fd4e268f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:08.856030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755946d-eeb1-49c6-9c27-f5fd4e268f15 admin admin] PATH_INFO: `/v3/users/e8cd45ef2284430589485b04d468f118` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:08.861711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755946d-eeb1-49c6-9c27-f5fd4e268f15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8cd45ef2284430589485b04d468f118)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:08.865107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8755946d-eeb1-49c6-9c27-f5fd4e268f15 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:09.140286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8755946d-eeb1-49c6-9c27-f5fd4e268f15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8cd45ef2284430589485b04d468f118'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:09.177666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8755946d-eeb1-49c6-9c27-f5fd4e268f15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8cd45ef2284430589485b04d468f118'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:09.198933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8755946d-eeb1-49c6-9c27-f5fd4e268f15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8cd45ef2284430589485b04d468f118'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:09.201352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8755946d-eeb1-49c6-9c27-f5fd4e268f15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8cd45ef2284430589485b04d468f118'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:09.303173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8755946d-eeb1-49c6-9c27-f5fd4e268f15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8cd45ef2284430589485b04d468f118'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:09.323094 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2657/5259] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:36:08 2022] DELETE /identity/v3/users/e8cd45ef2284430589485b04d468f118 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:09.819804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94f35b-32c4-44e3-9730-39745ddf91e6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:09.821715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8a94f35b-32c4-44e3-9730-39745ddf91e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:09.842557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a94f35b-32c4-44e3-9730-39745ddf91e6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:09.859752 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:09.953072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856e9b80-3845-40fe-8016-05dccc82a88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:09.954074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e9b80-3845-40fe-8016-05dccc82a88a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:09.954452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e9b80-3845-40fe-8016-05dccc82a88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:09.955389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856e9b80-3845-40fe-8016-05dccc82a88a admin admin] PATH_INFO: `/v3/projects/7a63ccf27825405e8fc9803a3b30c699` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:09.957463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e9b80-3845-40fe-8016-05dccc82a88a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a63ccf27825405e8fc9803a3b30c699)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:09.959803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856e9b80-3845-40fe-8016-05dccc82a88a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:10.169819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-856e9b80-3845-40fe-8016-05dccc82a88a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a63ccf27825405e8fc9803a3b30c699', 'request_id': 'req-856e9b80-3845-40fe-8016-05dccc82a88a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:10.272822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-856e9b80-3845-40fe-8016-05dccc82a88a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a63ccf27825405e8fc9803a3b30c699', 'request_id': 'req-856e9b80-3845-40fe-8016-05dccc82a88a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:10.286232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-856e9b80-3845-40fe-8016-05dccc82a88a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a63ccf27825405e8fc9803a3b30c699', 'request_id': 'req-856e9b80-3845-40fe-8016-05dccc82a88a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:10.323209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-856e9b80-3845-40fe-8016-05dccc82a88a admin admin] The token cache is being invalidate because project 7a63ccf27825405e8fc9803a3b30c699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:36:10.323459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-856e9b80-3845-40fe-8016-05dccc82a88a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:10.324130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-856e9b80-3845-40fe-8016-05dccc82a88a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:10.331467 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2603/5260] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:36:09 2022] DELETE /identity/v3/projects/7a63ccf27825405e8fc9803a3b30c699 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:10.335018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1fe92-bdf2-498c-a7d9-a28b8465b478 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:10.337047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1fe92-bdf2-498c-a7d9-a28b8465b478 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:10.339315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1fe92-bdf2-498c-a7d9-a28b8465b478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:10.374728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-13f1fe92-bdf2-498c-a7d9-a28b8465b478 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:10.377296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-13f1fe92-bdf2-498c-a7d9-a28b8465b478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:10.418736 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:10.499892 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2658/5261] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:10.503528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ed9a0-efbf-491f-add1-b60ebab8ee96 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:10.503827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ed9a0-efbf-491f-add1-b60ebab8ee96 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:10.504112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6ed9a0-efbf-491f-add1-b60ebab8ee96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:10.549978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0b6ed9a0-efbf-491f-add1-b60ebab8ee96 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:10.560054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0b6ed9a0-efbf-491f-add1-b60ebab8ee96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:10.572802 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2604/5262] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:10.577225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1fe92-bdf2-498c-a7d9-a28b8465b478 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:10.596903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1fe92-bdf2-498c-a7d9-a28b8465b478 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:10.615576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41decc7-a1a8-4baf-8636-3fa61ac10125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:10.616633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41decc7-a1a8-4baf-8636-3fa61ac10125 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:10.617159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41decc7-a1a8-4baf-8636-3fa61ac10125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:10.617676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41decc7-a1a8-4baf-8636-3fa61ac10125 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:10.618627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41decc7-a1a8-4baf-8636-3fa61ac10125 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:36:10.619114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41decc7-a1a8-4baf-8636-3fa61ac10125 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:10.621458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41decc7-a1a8-4baf-8636-3fa61ac10125 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:10.637767 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2659/5263] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:36:10.642262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ed9a0-efbf-491f-add1-b60ebab8ee96 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:10.653562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6ed9a0-efbf-491f-add1-b60ebab8ee96 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:10.676374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca656169-cb2f-4d9f-b768-5870df9a2f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:10.677665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca656169-cb2f-4d9f-b768-5870df9a2f40 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:10.678038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca656169-cb2f-4d9f-b768-5870df9a2f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:10.678324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca656169-cb2f-4d9f-b768-5870df9a2f40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:10.685924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca656169-cb2f-4d9f-b768-5870df9a2f40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:10.687928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca656169-cb2f-4d9f-b768-5870df9a2f40 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:10.840516 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2605/5264] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:36:10 2022] POST /identity/v3/projects => generated 391 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:36:10.842643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41decc7-a1a8-4baf-8636-3fa61ac10125 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:10.861047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41decc7-a1a8-4baf-8636-3fa61ac10125 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:11.001422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea9a7e-9539-46c4-b785-363f2f8b4e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:11.002316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea9a7e-9539-46c4-b785-363f2f8b4e6b admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:11.002667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea9a7e-9539-46c4-b785-363f2f8b4e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:11.003007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea9a7e-9539-46c4-b785-363f2f8b4e6b admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:11.005161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea9a7e-9539-46c4-b785-363f2f8b4e6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:11.007941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea9a7e-9539-46c4-b785-363f2f8b4e6b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:11.126985 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2660/5265] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:36:10 2022] POST /identity/v3/users => generated 296 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:36:11.132166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca656169-cb2f-4d9f-b768-5870df9a2f40 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:11.147840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca656169-cb2f-4d9f-b768-5870df9a2f40 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:11.164012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608a6af-09cc-4b67-9143-474bc187c5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:11.164725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608a6af-09cc-4b67-9143-474bc187c5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:11.165011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608a6af-09cc-4b67-9143-474bc187c5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:11.165288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608a6af-09cc-4b67-9143-474bc187c5e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:11.166043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608a6af-09cc-4b67-9143-474bc187c5e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:11.168946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608a6af-09cc-4b67-9143-474bc187c5e9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:11.197927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea9a7e-9539-46c4-b785-363f2f8b4e6b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:11.211508 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2606/5266] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:36:11.222172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea9a7e-9539-46c4-b785-363f2f8b4e6b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:11.240604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676afa62-e362-4686-9d88-a1fd7ce66255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:11.240604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676afa62-e362-4686-9d88-a1fd7ce66255 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:11.240604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676afa62-e362-4686-9d88-a1fd7ce66255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:11.240604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676afa62-e362-4686-9d88-a1fd7ce66255 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:11.240926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676afa62-e362-4686-9d88-a1fd7ce66255 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:11.251582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676afa62-e362-4686-9d88-a1fd7ce66255 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:11.306444 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2661/5267] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:36:11.310887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608a6af-09cc-4b67-9143-474bc187c5e9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:11.331032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608a6af-09cc-4b67-9143-474bc187c5e9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:11.344975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bee7a9-80ba-4505-8a64-55ea16e51607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:11.345898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bee7a9-80ba-4505-8a64-55ea16e51607 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:11.347006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bee7a9-80ba-4505-8a64-55ea16e51607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:11.347309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bee7a9-80ba-4505-8a64-55ea16e51607 admin admin] PATH_INFO: `/v3/projects/65c0e5fd844b4a90acc731909a8eb471/users/17b5ff2a4f2d48329aaddaf685637060/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:11.390040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bee7a9-80ba-4505-8a64-55ea16e51607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c0e5fd844b4a90acc731909a8eb471, user_id=17b5ff2a4f2d48329aaddaf685637060, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:11.393157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bee7a9-80ba-4505-8a64-55ea16e51607 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:11.483266 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2607/5268] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:36:11 2022] PUT /identity/v3/projects/65c0e5fd844b4a90acc731909a8eb471/users/17b5ff2a4f2d48329aaddaf685637060/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:36:11.498422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e8a5a-56e6-44fe-abae-91b6c3582fbd None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:11.499908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e8a5a-56e6-44fe-abae-91b6c3582fbd None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:11.500380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e8a5a-56e6-44fe-abae-91b6c3582fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:11.547208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1e2e8a5a-56e6-44fe-abae-91b6c3582fbd None None] MFA Rules not processed for user `17b5ff2a4f2d48329aaddaf685637060`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:11.549033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1e2e8a5a-56e6-44fe-abae-91b6c3582fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:11.668457 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2662/5269] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:11.672613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bee7a9-80ba-4505-8a64-55ea16e51607 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:11.805650 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:11.850211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bee7a9-80ba-4505-8a64-55ea16e51607 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:11.861933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c583081-5448-46f0-8e2a-4d9497b384ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:11.865630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c583081-5448-46f0-8e2a-4d9497b384ff admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:11.871832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c583081-5448-46f0-8e2a-4d9497b384ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:11.871832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c583081-5448-46f0-8e2a-4d9497b384ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:11.871832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c583081-5448-46f0-8e2a-4d9497b384ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:11.876416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c583081-5448-46f0-8e2a-4d9497b384ff admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:12.015000 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2608/5270] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:36:11 2022] POST /identity/v3/projects => generated 393 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:36:12.017451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e8a5a-56e6-44fe-abae-91b6c3582fbd None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:12.037610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e8a5a-56e6-44fe-abae-91b6c3582fbd None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:12.064763 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:12.149856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22886a68-f861-4a13-b3d4-0382feb666d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:12.150656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22886a68-f861-4a13-b3d4-0382feb666d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:12.151461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22886a68-f861-4a13-b3d4-0382feb666d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:12.151461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22886a68-f861-4a13-b3d4-0382feb666d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:12.153919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22886a68-f861-4a13-b3d4-0382feb666d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:12.162596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22886a68-f861-4a13-b3d4-0382feb666d2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:12.315443 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2663/5271] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:36:12 2022] POST /identity/v3/users => generated 303 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:36:12.320646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c583081-5448-46f0-8e2a-4d9497b384ff admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:12.350530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c583081-5448-46f0-8e2a-4d9497b384ff admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:12.367652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bd838-2bc7-405d-aa90-3e33a7153fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:12.376083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bd838-2bc7-405d-aa90-3e33a7153fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:12.376627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bd838-2bc7-405d-aa90-3e33a7153fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:12.376911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667bd838-2bc7-405d-aa90-3e33a7153fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:12.382718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bd838-2bc7-405d-aa90-3e33a7153fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:12.384970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667bd838-2bc7-405d-aa90-3e33a7153fa4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:12.435413 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2609/5272] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:36:12.436408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22886a68-f861-4a13-b3d4-0382feb666d2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:12.452172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22886a68-f861-4a13-b3d4-0382feb666d2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:12.463370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34691444-b6d1-4144-b8dd-3783bafb831c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:12.464851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34691444-b6d1-4144-b8dd-3783bafb831c admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:12.465376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34691444-b6d1-4144-b8dd-3783bafb831c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:12.465856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34691444-b6d1-4144-b8dd-3783bafb831c admin admin] PATH_INFO: `/v3/projects/2a0f78119a284ca08965b50c3d8f495a/users/b0273a191d434adcb0abb80f2536d84d/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:12.536660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34691444-b6d1-4144-b8dd-3783bafb831c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0f78119a284ca08965b50c3d8f495a, user_id=b0273a191d434adcb0abb80f2536d84d, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:12.539670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34691444-b6d1-4144-b8dd-3783bafb831c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:12.691192 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2664/5273] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:36:12 2022] PUT /identity/v3/projects/2a0f78119a284ca08965b50c3d8f495a/users/b0273a191d434adcb0abb80f2536d84d/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:12.698576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bd838-2bc7-405d-aa90-3e33a7153fa4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:12.712046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667bd838-2bc7-405d-aa90-3e33a7153fa4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:12.913862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bc1d27-23be-4b57-811e-d409fd67f866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:12.913862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc1d27-23be-4b57-811e-d409fd67f866 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:12.913862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc1d27-23be-4b57-811e-d409fd67f866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:12.913862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bc1d27-23be-4b57-811e-d409fd67f866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:12.915144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc1d27-23be-4b57-811e-d409fd67f866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:12.915584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bc1d27-23be-4b57-811e-d409fd67f866 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:12.989638 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2610/5274] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:36:12.992878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34691444-b6d1-4144-b8dd-3783bafb831c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:13.014039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34691444-b6d1-4144-b8dd-3783bafb831c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:13.026613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0994d-a7f7-4667-9e1a-2fadddc312a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:13.028751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0994d-a7f7-4667-9e1a-2fadddc312a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:13.028751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0994d-a7f7-4667-9e1a-2fadddc312a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:13.028751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0994d-a7f7-4667-9e1a-2fadddc312a6 admin admin] PATH_INFO: `/v3/projects/2a0f78119a284ca08965b50c3d8f495a/users/b0273a191d434adcb0abb80f2536d84d/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:13.050590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0994d-a7f7-4667-9e1a-2fadddc312a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a0f78119a284ca08965b50c3d8f495a, user_id=b0273a191d434adcb0abb80f2536d84d, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:13.076797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0994d-a7f7-4667-9e1a-2fadddc312a6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:13.117523 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2665/5275] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:36:12 2022] PUT /identity/v3/projects/2a0f78119a284ca08965b50c3d8f495a/users/b0273a191d434adcb0abb80f2536d84d/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:36:13.133269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2331e-d849-4a20-9fa1-15764ae0b3bf None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:13.133869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2331e-d849-4a20-9fa1-15764ae0b3bf None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:13.134286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d2331e-d849-4a20-9fa1-15764ae0b3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:13.206184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-42d2331e-d849-4a20-9fa1-15764ae0b3bf None None] MFA Rules not processed for user `b0273a191d434adcb0abb80f2536d84d`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:13.208716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-42d2331e-d849-4a20-9fa1-15764ae0b3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:13.323840 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2611/5276] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:13.380634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0994d-a7f7-4667-9e1a-2fadddc312a6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:13.382646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-30a0994d-a7f7-4667-9e1a-2fadddc312a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:13.545369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0994d-a7f7-4667-9e1a-2fadddc312a6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:13.557097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea86310-b1c8-4432-9d05-9fb799d491d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:13.559913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea86310-b1c8-4432-9d05-9fb799d491d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:13.562330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea86310-b1c8-4432-9d05-9fb799d491d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:13.562802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea86310-b1c8-4432-9d05-9fb799d491d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:13.599110 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea86310-b1c8-4432-9d05-9fb799d491d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:13.602467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea86310-b1c8-4432-9d05-9fb799d491d8 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:13.629667 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2666/5277] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:36:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:36:17.577812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2331e-d849-4a20-9fa1-15764ae0b3bf None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:17.602753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d2331e-d849-4a20-9fa1-15764ae0b3bf None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:17.608183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe93d7e-14f3-4fb2-8760-550e7ff63be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:17.608183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe93d7e-14f3-4fb2-8760-550e7ff63be7 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:17.608183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe93d7e-14f3-4fb2-8760-550e7ff63be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:17.608183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe93d7e-14f3-4fb2-8760-550e7ff63be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:17.613584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-efe93d7e-14f3-4fb2-8760-550e7ff63be7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:17.823788 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:18.037397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe93d7e-14f3-4fb2-8760-550e7ff63be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:18.040455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe93d7e-14f3-4fb2-8760-550e7ff63be7 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:18.093137 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2612/5278] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:36:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:36:22.934771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea86310-b1c8-4432-9d05-9fb799d491d8 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:22.957240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea86310-b1c8-4432-9d05-9fb799d491d8 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:22.969395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61df34-01ca-492d-a07c-12620d5c478d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:22.971053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61df34-01ca-492d-a07c-12620d5c478d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:22.977980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61df34-01ca-492d-a07c-12620d5c478d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:22.978555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab61df34-01ca-492d-a07c-12620d5c478d admin admin] PATH_INFO: `/v3/users/17b5ff2a4f2d48329aaddaf685637060` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:22.980883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61df34-01ca-492d-a07c-12620d5c478d admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b5ff2a4f2d48329aaddaf685637060)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:22.983430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab61df34-01ca-492d-a07c-12620d5c478d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:23.299395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ab61df34-01ca-492d-a07c-12620d5c478d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b5ff2a4f2d48329aaddaf685637060'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:23.340673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ab61df34-01ca-492d-a07c-12620d5c478d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b5ff2a4f2d48329aaddaf685637060'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:23.342860 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:23.376753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ab61df34-01ca-492d-a07c-12620d5c478d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b5ff2a4f2d48329aaddaf685637060'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:23.376753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ab61df34-01ca-492d-a07c-12620d5c478d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b5ff2a4f2d48329aaddaf685637060'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:23.472242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ab61df34-01ca-492d-a07c-12620d5c478d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b5ff2a4f2d48329aaddaf685637060'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:23.491866 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2667/5279] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:36:22 2022] DELETE /identity/v3/users/17b5ff2a4f2d48329aaddaf685637060 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:23.496578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bb0ee-6676-43fd-bc3f-d67f6db4b056 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:23.497435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bb0ee-6676-43fd-bc3f-d67f6db4b056 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:23.497888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bb0ee-6676-43fd-bc3f-d67f6db4b056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:23.527006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7d4bb0ee-6676-43fd-bc3f-d67f6db4b056 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:23.532626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7d4bb0ee-6676-43fd-bc3f-d67f6db4b056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:23.701996 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2613/5280] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:23.714294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61df34-01ca-492d-a07c-12620d5c478d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:23.716113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ab61df34-01ca-492d-a07c-12620d5c478d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:23.894802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab61df34-01ca-492d-a07c-12620d5c478d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:23.907838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8510ab-f8cc-471d-b5da-183e317ca2c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:23.909936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8510ab-f8cc-471d-b5da-183e317ca2c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:23.910283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8510ab-f8cc-471d-b5da-183e317ca2c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:23.910580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8510ab-f8cc-471d-b5da-183e317ca2c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:23.940814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8510ab-f8cc-471d-b5da-183e317ca2c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:23.954468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8510ab-f8cc-471d-b5da-183e317ca2c5 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:23.983082 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2668/5281] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:36:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:36:24.763513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bb0ee-6676-43fd-bc3f-d67f6db4b056 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:24.765097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7d4bb0ee-6676-43fd-bc3f-d67f6db4b056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:24.798355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bb0ee-6676-43fd-bc3f-d67f6db4b056 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:24.806594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110e5cd-5ca0-4265-b9f4-3bb32b2c1104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:24.808098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110e5cd-5ca0-4265-b9f4-3bb32b2c1104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:24.809213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110e5cd-5ca0-4265-b9f4-3bb32b2c1104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:24.810034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110e5cd-5ca0-4265-b9f4-3bb32b2c1104 admin admin] PATH_INFO: `/v3/projects/65c0e5fd844b4a90acc731909a8eb471` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:24.812245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110e5cd-5ca0-4265-b9f4-3bb32b2c1104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c0e5fd844b4a90acc731909a8eb471)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:24.815956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a110e5cd-5ca0-4265-b9f4-3bb32b2c1104 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:24.964424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a110e5cd-5ca0-4265-b9f4-3bb32b2c1104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c0e5fd844b4a90acc731909a8eb471', 'request_id': 'req-a110e5cd-5ca0-4265-b9f4-3bb32b2c1104'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:25.099421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a110e5cd-5ca0-4265-b9f4-3bb32b2c1104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c0e5fd844b4a90acc731909a8eb471', 'request_id': 'req-a110e5cd-5ca0-4265-b9f4-3bb32b2c1104'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:25.124944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a110e5cd-5ca0-4265-b9f4-3bb32b2c1104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c0e5fd844b4a90acc731909a8eb471', 'request_id': 'req-a110e5cd-5ca0-4265-b9f4-3bb32b2c1104'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:25.143033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a110e5cd-5ca0-4265-b9f4-3bb32b2c1104 admin admin] The token cache is being invalidate because project 65c0e5fd844b4a90acc731909a8eb471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:36:25.154821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a110e5cd-5ca0-4265-b9f4-3bb32b2c1104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:25.154821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a110e5cd-5ca0-4265-b9f4-3bb32b2c1104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:25.154821 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2614/5282] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:36:24 2022] DELETE /identity/v3/projects/65c0e5fd844b4a90acc731909a8eb471 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:25.155378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8510ab-f8cc-471d-b5da-183e317ca2c5 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:25.161978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8510ab-f8cc-471d-b5da-183e317ca2c5 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:25.296139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2de40f-1c6e-43d9-83a5-310975b33dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:25.297092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2de40f-1c6e-43d9-83a5-310975b33dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:25.297450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2de40f-1c6e-43d9-83a5-310975b33dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:25.297939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2de40f-1c6e-43d9-83a5-310975b33dec admin admin] PATH_INFO: `/v3/users/b0273a191d434adcb0abb80f2536d84d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:25.299303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2de40f-1c6e-43d9-83a5-310975b33dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0273a191d434adcb0abb80f2536d84d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:25.303135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2de40f-1c6e-43d9-83a5-310975b33dec admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:25.542787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4c2de40f-1c6e-43d9-83a5-310975b33dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0273a191d434adcb0abb80f2536d84d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:25.575141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4c2de40f-1c6e-43d9-83a5-310975b33dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0273a191d434adcb0abb80f2536d84d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:25.594509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4c2de40f-1c6e-43d9-83a5-310975b33dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0273a191d434adcb0abb80f2536d84d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:25.595390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4c2de40f-1c6e-43d9-83a5-310975b33dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0273a191d434adcb0abb80f2536d84d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:25.725623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4c2de40f-1c6e-43d9-83a5-310975b33dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0273a191d434adcb0abb80f2536d84d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:25.733224 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2669/5283] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:36:25 2022] DELETE /identity/v3/users/b0273a191d434adcb0abb80f2536d84d => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:26.383671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110e5cd-5ca0-4265-b9f4-3bb32b2c1104 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:26.388009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a110e5cd-5ca0-4265-b9f4-3bb32b2c1104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:26.421049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110e5cd-5ca0-4265-b9f4-3bb32b2c1104 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:26.554499 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:26.568682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd0978-cb86-4d73-a90c-4ec1288a06b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:26.569857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd0978-cb86-4d73-a90c-4ec1288a06b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:26.570298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd0978-cb86-4d73-a90c-4ec1288a06b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:26.570695 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd0978-cb86-4d73-a90c-4ec1288a06b0 admin admin] PATH_INFO: `/v3/projects/2a0f78119a284ca08965b50c3d8f495a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:26.573436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd0978-cb86-4d73-a90c-4ec1288a06b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a0f78119a284ca08965b50c3d8f495a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:26.575704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bd0978-cb86-4d73-a90c-4ec1288a06b0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:26.762718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-92bd0978-cb86-4d73-a90c-4ec1288a06b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a0f78119a284ca08965b50c3d8f495a', 'request_id': 'req-92bd0978-cb86-4d73-a90c-4ec1288a06b0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:26.885571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-92bd0978-cb86-4d73-a90c-4ec1288a06b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a0f78119a284ca08965b50c3d8f495a', 'request_id': 'req-92bd0978-cb86-4d73-a90c-4ec1288a06b0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:26.900133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-92bd0978-cb86-4d73-a90c-4ec1288a06b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a0f78119a284ca08965b50c3d8f495a', 'request_id': 'req-92bd0978-cb86-4d73-a90c-4ec1288a06b0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:26.920352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-92bd0978-cb86-4d73-a90c-4ec1288a06b0 admin admin] The token cache is being invalidate because project 2a0f78119a284ca08965b50c3d8f495a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:36:26.920693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-92bd0978-cb86-4d73-a90c-4ec1288a06b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:26.921547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-92bd0978-cb86-4d73-a90c-4ec1288a06b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:26.924332 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2615/5284] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:36:26 2022] DELETE /identity/v3/projects/2a0f78119a284ca08965b50c3d8f495a => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:26.931123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe905915-655d-4ca0-9c75-7efd77817c50 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:26.932117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe905915-655d-4ca0-9c75-7efd77817c50 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:26.932558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe905915-655d-4ca0-9c75-7efd77817c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:26.962630 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:27.009436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-fe905915-655d-4ca0-9c75-7efd77817c50 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:27.010861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fe905915-655d-4ca0-9c75-7efd77817c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:27.165390 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2670/5285] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:27.167828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd52b8d-bcf5-44dd-a165-c36bf49806c8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:27.168232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd52b8d-bcf5-44dd-a165-c36bf49806c8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:27.168622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd52b8d-bcf5-44dd-a165-c36bf49806c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:27.201548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2dd52b8d-bcf5-44dd-a165-c36bf49806c8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:27.210041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2dd52b8d-bcf5-44dd-a165-c36bf49806c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:27.256594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe905915-655d-4ca0-9c75-7efd77817c50 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:27.263867 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2616/5286] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:27.275322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe905915-655d-4ca0-9c75-7efd77817c50 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:27.290691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c146aae-37d0-44cb-9263-4e376f5ffb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:27.291548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c146aae-37d0-44cb-9263-4e376f5ffb96 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:27.297284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c146aae-37d0-44cb-9263-4e376f5ffb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:27.297740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c146aae-37d0-44cb-9263-4e376f5ffb96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:27.299588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c146aae-37d0-44cb-9263-4e376f5ffb96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:36:27.300024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c146aae-37d0-44cb-9263-4e376f5ffb96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:27.304315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c146aae-37d0-44cb-9263-4e376f5ffb96 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:27.357400 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2671/5287] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:36:27.359445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd52b8d-bcf5-44dd-a165-c36bf49806c8 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:27.371545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd52b8d-bcf5-44dd-a165-c36bf49806c8 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:27.377409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fa3f7-7805-4a3f-b602-fb39ebc33e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:27.378338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fa3f7-7805-4a3f-b602-fb39ebc33e42 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:27.380576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fa3f7-7805-4a3f-b602-fb39ebc33e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:27.381464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fa3f7-7805-4a3f-b602-fb39ebc33e42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:27.383586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fa3f7-7805-4a3f-b602-fb39ebc33e42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:27.387085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48fa3f7-7805-4a3f-b602-fb39ebc33e42 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:27.506698 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2617/5288] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:36:27 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:36:27.510892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c146aae-37d0-44cb-9263-4e376f5ffb96 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:27.527658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c146aae-37d0-44cb-9263-4e376f5ffb96 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:27.746566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6a37a-6ef4-4006-a8de-58fb5b544535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:27.746566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6a37a-6ef4-4006-a8de-58fb5b544535 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:27.747832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6a37a-6ef4-4006-a8de-58fb5b544535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:27.748225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6a37a-6ef4-4006-a8de-58fb5b544535 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:27.750970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6a37a-6ef4-4006-a8de-58fb5b544535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:27.762273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f6a37a-6ef4-4006-a8de-58fb5b544535 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:27.866347 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2672/5289] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:36:27 2022] POST /identity/v3/users => generated 293 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:36:27.870264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fa3f7-7805-4a3f-b602-fb39ebc33e42 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:27.889506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48fa3f7-7805-4a3f-b602-fb39ebc33e42 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:27.900408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66342f-44cc-4d51-9271-8da5f9268d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:27.902578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66342f-44cc-4d51-9271-8da5f9268d38 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:27.903652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66342f-44cc-4d51-9271-8da5f9268d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:27.906697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf66342f-44cc-4d51-9271-8da5f9268d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:27.908149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66342f-44cc-4d51-9271-8da5f9268d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:27.914926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf66342f-44cc-4d51-9271-8da5f9268d38 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:27.957465 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2618/5290] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:36:27.962328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6a37a-6ef4-4006-a8de-58fb5b544535 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:27.988158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6a37a-6ef4-4006-a8de-58fb5b544535 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:28.021783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2f4d2-5c8e-4cb9-97d3-9070ed90fe34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:28.024686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2f4d2-5c8e-4cb9-97d3-9070ed90fe34 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:28.025642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2f4d2-5c8e-4cb9-97d3-9070ed90fe34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:28.027418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2f4d2-5c8e-4cb9-97d3-9070ed90fe34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:28.031123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2f4d2-5c8e-4cb9-97d3-9070ed90fe34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:28.035351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd2f4d2-5c8e-4cb9-97d3-9070ed90fe34 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:28.080045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66342f-44cc-4d51-9271-8da5f9268d38 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:28.097674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf66342f-44cc-4d51-9271-8da5f9268d38 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:28.099560 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2673/5291] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:36:28.121755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64eb90-4a12-4bdc-814b-24b6603df664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:28.126080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64eb90-4a12-4bdc-814b-24b6603df664 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:28.127626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64eb90-4a12-4bdc-814b-24b6603df664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:28.128705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64eb90-4a12-4bdc-814b-24b6603df664 admin admin] PATH_INFO: `/v3/projects/308b52e8030945f58256db43e0675d4b/users/5112f1a034d8484e9379cfc1adf29d01/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:28.161080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64eb90-4a12-4bdc-814b-24b6603df664 admin admin] RBAC: Authorizing `identity:create_grant(project_id=308b52e8030945f58256db43e0675d4b, user_id=5112f1a034d8484e9379cfc1adf29d01, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:28.164872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64eb90-4a12-4bdc-814b-24b6603df664 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:28.251150 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2619/5292] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:36:28 2022] PUT /identity/v3/projects/308b52e8030945f58256db43e0675d4b/users/5112f1a034d8484e9379cfc1adf29d01/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:36:28.262859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcd03d-f1e8-4f4a-b56b-6aef46fb5670 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:28.263657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcd03d-f1e8-4f4a-b56b-6aef46fb5670 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:28.264394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bcd03d-f1e8-4f4a-b56b-6aef46fb5670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:28.343236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a3bcd03d-f1e8-4f4a-b56b-6aef46fb5670 None None] MFA Rules not processed for user `5112f1a034d8484e9379cfc1adf29d01`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:28.344480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a3bcd03d-f1e8-4f4a-b56b-6aef46fb5670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:28.394188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64eb90-4a12-4bdc-814b-24b6603df664 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:28.397473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-df64eb90-4a12-4bdc-814b-24b6603df664 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:28.588361 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:28.601014 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2674/5293] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:28.608497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcd03d-f1e8-4f4a-b56b-6aef46fb5670 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:28.630711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64eb90-4a12-4bdc-814b-24b6603df664 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:28.637952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bcd03d-f1e8-4f4a-b56b-6aef46fb5670 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:28.642837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55cb1d-6976-4119-8558-530430edaee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:28.643603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99e3aa-d851-47d0-9fb2-b13c4e2bb151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:28.643773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55cb1d-6976-4119-8558-530430edaee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:28.644289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99e3aa-d851-47d0-9fb2-b13c4e2bb151 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:28.644730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99e3aa-d851-47d0-9fb2-b13c4e2bb151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:28.645070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99e3aa-d851-47d0-9fb2-b13c4e2bb151 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:28.645914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99e3aa-d851-47d0-9fb2-b13c4e2bb151 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:28.646282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55cb1d-6976-4119-8558-530430edaee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:28.646569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e55cb1d-6976-4119-8558-530430edaee9 admin admin] PATH_INFO: `/v3/users/013b13b6d741411a95806dce36c2bd20` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:28.647871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99e3aa-d851-47d0-9fb2-b13c4e2bb151 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:28.652176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55cb1d-6976-4119-8558-530430edaee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=013b13b6d741411a95806dce36c2bd20)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:28.654181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e55cb1d-6976-4119-8558-530430edaee9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:28.720358 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:28.784231 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2675/5294] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:36:28 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:36:28.788562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99e3aa-d851-47d0-9fb2-b13c4e2bb151 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:28.964113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6e55cb1d-6976-4119-8558-530430edaee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '013b13b6d741411a95806dce36c2bd20'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:29.006509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6e55cb1d-6976-4119-8558-530430edaee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '013b13b6d741411a95806dce36c2bd20'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:29.008359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99e3aa-d851-47d0-9fb2-b13c4e2bb151 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:29.009539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6e55cb1d-6976-4119-8558-530430edaee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '013b13b6d741411a95806dce36c2bd20'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:29.015824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6e55cb1d-6976-4119-8558-530430edaee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '013b13b6d741411a95806dce36c2bd20'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:29.025208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6e55cb1d-6976-4119-8558-530430edaee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '013b13b6d741411a95806dce36c2bd20'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:29.027912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b964a-0ea7-4575-a42f-6c7fae29970a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:29.028640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b964a-0ea7-4575-a42f-6c7fae29970a admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:29.028929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b964a-0ea7-4575-a42f-6c7fae29970a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:29.029209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b964a-0ea7-4575-a42f-6c7fae29970a admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:29.030127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b964a-0ea7-4575-a42f-6c7fae29970a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:29.032274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b964a-0ea7-4575-a42f-6c7fae29970a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:29.163581 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2620/5295] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:36:28 2022] DELETE /identity/v3/users/013b13b6d741411a95806dce36c2bd20 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:29.195656 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2676/5296] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:36:28 2022] POST /identity/v3/users => generated 298 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:36:29.200274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55cb1d-6976-4119-8558-530430edaee9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:29.201965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6e55cb1d-6976-4119-8558-530430edaee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:29.478023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e55cb1d-6976-4119-8558-530430edaee9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:29.493046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba09cbe-ea91-4225-bdeb-4be06d4c8674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:29.494731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba09cbe-ea91-4225-bdeb-4be06d4c8674 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:29.497693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba09cbe-ea91-4225-bdeb-4be06d4c8674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:29.498070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba09cbe-ea91-4225-bdeb-4be06d4c8674 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:29.504948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba09cbe-ea91-4225-bdeb-4be06d4c8674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:29.506860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba09cbe-ea91-4225-bdeb-4be06d4c8674 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:29.541865 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2621/5297] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:36:29.543519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b964a-0ea7-4575-a42f-6c7fae29970a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:29.555082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b964a-0ea7-4575-a42f-6c7fae29970a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:29.575977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59220618-d1eb-48c7-ac7a-e0c4f7f50603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:29.576833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59220618-d1eb-48c7-ac7a-e0c4f7f50603 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:29.577125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59220618-d1eb-48c7-ac7a-e0c4f7f50603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:29.577411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59220618-d1eb-48c7-ac7a-e0c4f7f50603 admin admin] PATH_INFO: `/v3/projects/f1ab19824b6b4c50ad81581adee05d58/users/e28be97da5ed48929662e6d203f5521c/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:29.616806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59220618-d1eb-48c7-ac7a-e0c4f7f50603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1ab19824b6b4c50ad81581adee05d58, user_id=e28be97da5ed48929662e6d203f5521c, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:29.621153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59220618-d1eb-48c7-ac7a-e0c4f7f50603 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:29.736329 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2677/5298] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:36:29 2022] PUT /identity/v3/projects/f1ab19824b6b4c50ad81581adee05d58/users/e28be97da5ed48929662e6d203f5521c/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:29.742479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba09cbe-ea91-4225-bdeb-4be06d4c8674 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:29.787941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba09cbe-ea91-4225-bdeb-4be06d4c8674 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:29.925845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec24410-6813-45fa-94ee-b26e0cd70671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:29.927124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec24410-6813-45fa-94ee-b26e0cd70671 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:29.927614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec24410-6813-45fa-94ee-b26e0cd70671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:29.928056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec24410-6813-45fa-94ee-b26e0cd70671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:29.929093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec24410-6813-45fa-94ee-b26e0cd70671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:29.935395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec24410-6813-45fa-94ee-b26e0cd70671 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:29.997805 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2622/5299] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:36:29 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:36:30.002503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59220618-d1eb-48c7-ac7a-e0c4f7f50603 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:30.029300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59220618-d1eb-48c7-ac7a-e0c4f7f50603 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:30.067191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b38940-5ca3-47bb-9678-84a0d955839c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:30.068213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b38940-5ca3-47bb-9678-84a0d955839c admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:30.068680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b38940-5ca3-47bb-9678-84a0d955839c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:30.069135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b38940-5ca3-47bb-9678-84a0d955839c admin admin] PATH_INFO: `/v3/projects/f1ab19824b6b4c50ad81581adee05d58/users/e28be97da5ed48929662e6d203f5521c/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:30.083981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b38940-5ca3-47bb-9678-84a0d955839c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1ab19824b6b4c50ad81581adee05d58, user_id=e28be97da5ed48929662e6d203f5521c, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:30.095002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b38940-5ca3-47bb-9678-84a0d955839c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:30.137265 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2678/5300] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:36:30 2022] PUT /identity/v3/projects/f1ab19824b6b4c50ad81581adee05d58/users/e28be97da5ed48929662e6d203f5521c/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:30.148854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a1b03-d9f9-4809-9a01-93f0cf715983 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:30.149973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a1b03-d9f9-4809-9a01-93f0cf715983 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:30.150565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a1b03-d9f9-4809-9a01-93f0cf715983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:30.270250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-141a1b03-d9f9-4809-9a01-93f0cf715983 None None] MFA Rules not processed for user `e28be97da5ed48929662e6d203f5521c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:30.271773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-141a1b03-d9f9-4809-9a01-93f0cf715983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:30.309995 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:30.385299 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2623/5301] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:30.465081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b38940-5ca3-47bb-9678-84a0d955839c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:30.467108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-78b38940-5ca3-47bb-9678-84a0d955839c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:30.619196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b38940-5ca3-47bb-9678-84a0d955839c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:30.635258 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51652830-4f67-4e89-835e-d464a8097b53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:30.636142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51652830-4f67-4e89-835e-d464a8097b53 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:30.636647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51652830-4f67-4e89-835e-d464a8097b53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:30.637266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51652830-4f67-4e89-835e-d464a8097b53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:30.667973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51652830-4f67-4e89-835e-d464a8097b53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:30.669552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51652830-4f67-4e89-835e-d464a8097b53 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:30.720616 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2679/5302] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:36:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:36:30.908994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a1b03-d9f9-4809-9a01-93f0cf715983 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:30.911770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-141a1b03-d9f9-4809-9a01-93f0cf715983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:31.149153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a1b03-d9f9-4809-9a01-93f0cf715983 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:31.162684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eeb62-19bf-4234-8372-276fa0df1986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:31.167690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eeb62-19bf-4234-8372-276fa0df1986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:31.167690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eeb62-19bf-4234-8372-276fa0df1986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:31.167690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eeb62-19bf-4234-8372-276fa0df1986 admin admin] PATH_INFO: `/v3/projects/8826c62db018440db0f796a863d674c6` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:31.169739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659eeb62-19bf-4234-8372-276fa0df1986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8826c62db018440db0f796a863d674c6)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:31.172284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659eeb62-19bf-4234-8372-276fa0df1986 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:31.401985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-659eeb62-19bf-4234-8372-276fa0df1986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8826c62db018440db0f796a863d674c6', 'request_id': 'req-659eeb62-19bf-4234-8372-276fa0df1986'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:31.462860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-659eeb62-19bf-4234-8372-276fa0df1986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8826c62db018440db0f796a863d674c6', 'request_id': 'req-659eeb62-19bf-4234-8372-276fa0df1986'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:31.474310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-659eeb62-19bf-4234-8372-276fa0df1986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8826c62db018440db0f796a863d674c6', 'request_id': 'req-659eeb62-19bf-4234-8372-276fa0df1986'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:31.498171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-659eeb62-19bf-4234-8372-276fa0df1986 admin admin] The token cache is being invalidate because project 8826c62db018440db0f796a863d674c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:36:31.498795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-659eeb62-19bf-4234-8372-276fa0df1986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:31.500591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-659eeb62-19bf-4234-8372-276fa0df1986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:31.508245 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2624/5303] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:36:30 2022] DELETE /identity/v3/projects/8826c62db018440db0f796a863d674c6 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:31.511345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f6b5c-62ea-4aeb-9fc1-f6c5c8cb54e0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:31.511345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f6b5c-62ea-4aeb-9fc1-f6c5c8cb54e0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:31.511345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f6b5c-62ea-4aeb-9fc1-f6c5c8cb54e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:31.542816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-fd2f6b5c-62ea-4aeb-9fc1-f6c5c8cb54e0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:31.550022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fd2f6b5c-62ea-4aeb-9fc1-f6c5c8cb54e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:31.642035 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:31.713206 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2680/5304] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:31.720744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae50637-c95b-4f65-8f0e-91becd8e65fa None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:31.721344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae50637-c95b-4f65-8f0e-91becd8e65fa None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:31.721909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae50637-c95b-4f65-8f0e-91becd8e65fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:31.759336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9ae50637-c95b-4f65-8f0e-91becd8e65fa None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:31.760499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9ae50637-c95b-4f65-8f0e-91becd8e65fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:31.776137 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2625/5305] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:31.779867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f6b5c-62ea-4aeb-9fc1-f6c5c8cb54e0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:31.794586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f6b5c-62ea-4aeb-9fc1-f6c5c8cb54e0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:31.822977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb806d6-bb72-4a0b-a5d1-f86ec510b695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:31.825313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb806d6-bb72-4a0b-a5d1-f86ec510b695 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:31.825313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb806d6-bb72-4a0b-a5d1-f86ec510b695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:31.825313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb806d6-bb72-4a0b-a5d1-f86ec510b695 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:31.825313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb806d6-bb72-4a0b-a5d1-f86ec510b695 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:36:31.828944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb806d6-bb72-4a0b-a5d1-f86ec510b695 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:31.830762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb806d6-bb72-4a0b-a5d1-f86ec510b695 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:31.894014 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2681/5306] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:36:31.899130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae50637-c95b-4f65-8f0e-91becd8e65fa None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:31.911558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae50637-c95b-4f65-8f0e-91becd8e65fa None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:31.951263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142e2f8-bc98-4193-be67-0d4383fbdb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:31.951970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142e2f8-bc98-4193-be67-0d4383fbdb28 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:31.952258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142e2f8-bc98-4193-be67-0d4383fbdb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:31.952644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142e2f8-bc98-4193-be67-0d4383fbdb28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:31.953360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142e2f8-bc98-4193-be67-0d4383fbdb28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:31.969786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9142e2f8-bc98-4193-be67-0d4383fbdb28 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:32.142645 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2626/5307] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:36:31 2022] POST /identity/v3/projects => generated 381 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:36:32.147321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb806d6-bb72-4a0b-a5d1-f86ec510b695 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:32.168611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb806d6-bb72-4a0b-a5d1-f86ec510b695 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:32.409354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970a797-06c3-4ac1-9fd8-b7e501f32b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:32.409354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970a797-06c3-4ac1-9fd8-b7e501f32b80 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:32.409354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970a797-06c3-4ac1-9fd8-b7e501f32b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:32.409354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970a797-06c3-4ac1-9fd8-b7e501f32b80 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:32.410062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970a797-06c3-4ac1-9fd8-b7e501f32b80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:32.416862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970a797-06c3-4ac1-9fd8-b7e501f32b80 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:32.567311 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2682/5308] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:36:32 2022] POST /identity/v3/users => generated 291 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:36:32.575244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142e2f8-bc98-4193-be67-0d4383fbdb28 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:32.601025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9142e2f8-bc98-4193-be67-0d4383fbdb28 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:32.624609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af3bfe-43b1-4eea-a0ad-6af1de7a17b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:32.625270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af3bfe-43b1-4eea-a0ad-6af1de7a17b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:32.625594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af3bfe-43b1-4eea-a0ad-6af1de7a17b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:32.625881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af3bfe-43b1-4eea-a0ad-6af1de7a17b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:32.626681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af3bfe-43b1-4eea-a0ad-6af1de7a17b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:32.628378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af3bfe-43b1-4eea-a0ad-6af1de7a17b6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:32.686265 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2627/5309] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:36:32.690329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970a797-06c3-4ac1-9fd8-b7e501f32b80 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:32.709852 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970a797-06c3-4ac1-9fd8-b7e501f32b80 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:32.742090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0497d75-7070-4241-9be9-85ef8d7c1ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:32.742825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0497d75-7070-4241-9be9-85ef8d7c1ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:32.743120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0497d75-7070-4241-9be9-85ef8d7c1ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:32.743621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0497d75-7070-4241-9be9-85ef8d7c1ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:32.744173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0497d75-7070-4241-9be9-85ef8d7c1ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:32.748838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0497d75-7070-4241-9be9-85ef8d7c1ec1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:32.784385 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2683/5310] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:36:32.786853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af3bfe-43b1-4eea-a0ad-6af1de7a17b6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:32.808863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af3bfe-43b1-4eea-a0ad-6af1de7a17b6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:32.831525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e4d03-7430-49fe-a94a-b31a6a1d3889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:32.833346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e4d03-7430-49fe-a94a-b31a6a1d3889 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:32.833816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e4d03-7430-49fe-a94a-b31a6a1d3889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:32.834295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684e4d03-7430-49fe-a94a-b31a6a1d3889 admin admin] PATH_INFO: `/v3/projects/5cca6a73e6304254a04f6e1166f161a4/users/bf94666b7381478d8426c7f4f9e7cb13/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:32.851085 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:32.896320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e4d03-7430-49fe-a94a-b31a6a1d3889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cca6a73e6304254a04f6e1166f161a4, user_id=bf94666b7381478d8426c7f4f9e7cb13, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:32.899127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684e4d03-7430-49fe-a94a-b31a6a1d3889 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:33.016642 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2628/5311] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:36:32 2022] PUT /identity/v3/projects/5cca6a73e6304254a04f6e1166f161a4/users/bf94666b7381478d8426c7f4f9e7cb13/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:33.018414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febd131-afeb-4675-a329-0dcc387f1c0d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:33.018716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febd131-afeb-4675-a329-0dcc387f1c0d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:33.019005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febd131-afeb-4675-a329-0dcc387f1c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:33.060161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8febd131-afeb-4675-a329-0dcc387f1c0d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:33.061693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8febd131-afeb-4675-a329-0dcc387f1c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:33.297583 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2684/5312] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:33.369411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e4d03-7430-49fe-a94a-b31a6a1d3889 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:33.373567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-684e4d03-7430-49fe-a94a-b31a6a1d3889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:33.568949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684e4d03-7430-49fe-a94a-b31a6a1d3889 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:33.594957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7d4a0-ccc8-4d6e-9177-d4d97bfa7c07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:33.595667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7d4a0-ccc8-4d6e-9177-d4d97bfa7c07 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:33.595963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7d4a0-ccc8-4d6e-9177-d4d97bfa7c07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:33.596253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7d4a0-ccc8-4d6e-9177-d4d97bfa7c07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:33.636279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7d4a0-ccc8-4d6e-9177-d4d97bfa7c07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:33.637763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7d4a0-ccc8-4d6e-9177-d4d97bfa7c07 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:33.676722 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2629/5313] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:36:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:36:39.143326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febd131-afeb-4675-a329-0dcc387f1c0d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:39.145138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8febd131-afeb-4675-a329-0dcc387f1c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:39.171622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8febd131-afeb-4675-a329-0dcc387f1c0d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:39.184459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2df125-fa7f-489b-96dc-19e81dd7ad9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:39.185571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2df125-fa7f-489b-96dc-19e81dd7ad9a service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:39.188378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2df125-fa7f-489b-96dc-19e81dd7ad9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:39.188888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2df125-fa7f-489b-96dc-19e81dd7ad9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:39.195435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9d2df125-fa7f-489b-96dc-19e81dd7ad9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:39.320836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7d4a0-ccc8-4d6e-9177-d4d97bfa7c07 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:39.322395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-71d7d4a0-ccc8-4d6e-9177-d4d97bfa7c07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:39.330495 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:39.352649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7d4a0-ccc8-4d6e-9177-d4d97bfa7c07 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:39.374931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c986e5-dead-44b6-ae5a-59fa07b126e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:39.375842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c986e5-dead-44b6-ae5a-59fa07b126e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:39.376175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c986e5-dead-44b6-ae5a-59fa07b126e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:39.376408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c986e5-dead-44b6-ae5a-59fa07b126e6 admin admin] PATH_INFO: `/v3/users/223011fd5d72453793f1175e9a38360b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:39.379835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c986e5-dead-44b6-ae5a-59fa07b126e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=223011fd5d72453793f1175e9a38360b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:39.386782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c986e5-dead-44b6-ae5a-59fa07b126e6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:39.410088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2df125-fa7f-489b-96dc-19e81dd7ad9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:39.414675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2df125-fa7f-489b-96dc-19e81dd7ad9a service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:39.446927 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2685/5314] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:36:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:36:39.667186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-67c986e5-dead-44b6-ae5a-59fa07b126e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '223011fd5d72453793f1175e9a38360b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:39.706624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-67c986e5-dead-44b6-ae5a-59fa07b126e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '223011fd5d72453793f1175e9a38360b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:39.710623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-67c986e5-dead-44b6-ae5a-59fa07b126e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '223011fd5d72453793f1175e9a38360b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:39.712449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-67c986e5-dead-44b6-ae5a-59fa07b126e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '223011fd5d72453793f1175e9a38360b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:39.731925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-67c986e5-dead-44b6-ae5a-59fa07b126e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '223011fd5d72453793f1175e9a38360b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:39.831506 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2630/5315] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:36:39 2022] DELETE /identity/v3/users/223011fd5d72453793f1175e9a38360b => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:39.840165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed7a79-2065-4592-b49c-059f7a38e893 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:39.840611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed7a79-2065-4592-b49c-059f7a38e893 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:39.840903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed7a79-2065-4592-b49c-059f7a38e893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:39.906497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-00ed7a79-2065-4592-b49c-059f7a38e893 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:39.907748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-00ed7a79-2065-4592-b49c-059f7a38e893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:40.072714 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2686/5316] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:40.101841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c986e5-dead-44b6-ae5a-59fa07b126e6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:40.104090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-67c986e5-dead-44b6-ae5a-59fa07b126e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:40.300587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c986e5-dead-44b6-ae5a-59fa07b126e6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:40.300958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfadaf-e3ad-4c4a-8adb-bbae3079092a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:40.302317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfadaf-e3ad-4c4a-8adb-bbae3079092a service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:40.302607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfadaf-e3ad-4c4a-8adb-bbae3079092a service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:40.302882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babfadaf-e3ad-4c4a-8adb-bbae3079092a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:40.333117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfadaf-e3ad-4c4a-8adb-bbae3079092a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:40.336073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babfadaf-e3ad-4c4a-8adb-bbae3079092a service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:40.354675 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2631/5317] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:36:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:36:40.935382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed7a79-2065-4592-b49c-059f7a38e893 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:40.937459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-00ed7a79-2065-4592-b49c-059f7a38e893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:40.961001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed7a79-2065-4592-b49c-059f7a38e893 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:40.982724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a585e-a2fc-408e-84c0-c3e6c3f1ec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:40.983743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a585e-a2fc-408e-84c0-c3e6c3f1ec6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:40.984043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a585e-a2fc-408e-84c0-c3e6c3f1ec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:40.984327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a585e-a2fc-408e-84c0-c3e6c3f1ec6e admin admin] PATH_INFO: `/v3/users/5112f1a034d8484e9379cfc1adf29d01` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:40.995125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a585e-a2fc-408e-84c0-c3e6c3f1ec6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5112f1a034d8484e9379cfc1adf29d01)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:40.997188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a585e-a2fc-408e-84c0-c3e6c3f1ec6e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:41.263142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-685a585e-a2fc-408e-84c0-c3e6c3f1ec6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5112f1a034d8484e9379cfc1adf29d01'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:41.297796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-685a585e-a2fc-408e-84c0-c3e6c3f1ec6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5112f1a034d8484e9379cfc1adf29d01'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:41.323070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-685a585e-a2fc-408e-84c0-c3e6c3f1ec6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5112f1a034d8484e9379cfc1adf29d01'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:41.326513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-685a585e-a2fc-408e-84c0-c3e6c3f1ec6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5112f1a034d8484e9379cfc1adf29d01'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:41.392721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfadaf-e3ad-4c4a-8adb-bbae3079092a service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:41.394731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-babfadaf-e3ad-4c4a-8adb-bbae3079092a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:41.403532 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:41.416283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babfadaf-e3ad-4c4a-8adb-bbae3079092a service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:41.432673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-685a585e-a2fc-408e-84c0-c3e6c3f1ec6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5112f1a034d8484e9379cfc1adf29d01'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:41.432834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc28ab-8560-4280-ad30-98668ad037b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:41.432834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc28ab-8560-4280-ad30-98668ad037b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:41.432834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc28ab-8560-4280-ad30-98668ad037b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:41.435198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dc28ab-8560-4280-ad30-98668ad037b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:41.439578 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2687/5318] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:36:40 2022] DELETE /identity/v3/users/5112f1a034d8484e9379cfc1adf29d01 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:41.440651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-55dc28ab-8560-4280-ad30-98668ad037b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:41.444908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bba797-1ab6-42e7-b9f6-fff6a4a41e34 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:41.445213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bba797-1ab6-42e7-b9f6-fff6a4a41e34 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:41.445494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bba797-1ab6-42e7-b9f6-fff6a4a41e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:41.495961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-08bba797-1ab6-42e7-b9f6-fff6a4a41e34 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:41.503139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-08bba797-1ab6-42e7-b9f6-fff6a4a41e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:41.595932 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:41.653098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc28ab-8560-4280-ad30-98668ad037b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:41.654544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dc28ab-8560-4280-ad30-98668ad037b1 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:41.655139 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2688/5319] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:36:41.692076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bba797-1ab6-42e7-b9f6-fff6a4a41e34 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:41.694031 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2632/5320] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:36:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:36:41.694308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-08bba797-1ab6-42e7-b9f6-fff6a4a41e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:41.810392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bba797-1ab6-42e7-b9f6-fff6a4a41e34 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:41.814706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f294c-cffc-4db3-a72e-b3988b7ae4b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:41.815607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f294c-cffc-4db3-a72e-b3988b7ae4b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:41.816037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f294c-cffc-4db3-a72e-b3988b7ae4b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:41.816533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f294c-cffc-4db3-a72e-b3988b7ae4b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:41.828506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f294c-cffc-4db3-a72e-b3988b7ae4b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:41.830531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03f294c-cffc-4db3-a72e-b3988b7ae4b4 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:41.882087 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2689/5321] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:36:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:36:42.615484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc28ab-8560-4280-ad30-98668ad037b1 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:42.617737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-55dc28ab-8560-4280-ad30-98668ad037b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:42.649047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dc28ab-8560-4280-ad30-98668ad037b1 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:42.659970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37786ffa-d6a3-474e-b1ce-1da62cea5b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:42.661562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37786ffa-d6a3-474e-b1ce-1da62cea5b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:42.662190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37786ffa-d6a3-474e-b1ce-1da62cea5b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:42.662647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37786ffa-d6a3-474e-b1ce-1da62cea5b67 admin admin] PATH_INFO: `/v3/projects/0cc518a66a524366b1d67cfd674f3b15` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:42.664339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37786ffa-d6a3-474e-b1ce-1da62cea5b67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cc518a66a524366b1d67cfd674f3b15)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:42.679292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37786ffa-d6a3-474e-b1ce-1da62cea5b67 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:42.903857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37786ffa-d6a3-474e-b1ce-1da62cea5b67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cc518a66a524366b1d67cfd674f3b15', 'request_id': 'req-37786ffa-d6a3-474e-b1ce-1da62cea5b67'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:43.011057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37786ffa-d6a3-474e-b1ce-1da62cea5b67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cc518a66a524366b1d67cfd674f3b15', 'request_id': 'req-37786ffa-d6a3-474e-b1ce-1da62cea5b67'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:43.023083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37786ffa-d6a3-474e-b1ce-1da62cea5b67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cc518a66a524366b1d67cfd674f3b15', 'request_id': 'req-37786ffa-d6a3-474e-b1ce-1da62cea5b67'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:43.044547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37786ffa-d6a3-474e-b1ce-1da62cea5b67 admin admin] The token cache is being invalidate because project 0cc518a66a524366b1d67cfd674f3b15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:36:43.044834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37786ffa-d6a3-474e-b1ce-1da62cea5b67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:43.045669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37786ffa-d6a3-474e-b1ce-1da62cea5b67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:43.050519 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2633/5322] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:36:42 2022] DELETE /identity/v3/projects/0cc518a66a524366b1d67cfd674f3b15 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:43.054236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f294c-cffc-4db3-a72e-b3988b7ae4b4 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:43.084803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f294c-cffc-4db3-a72e-b3988b7ae4b4 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:43.292750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0efff-3ba5-4cb9-a9c7-66871f4b1906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:43.295310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0efff-3ba5-4cb9-a9c7-66871f4b1906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:43.295601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0efff-3ba5-4cb9-a9c7-66871f4b1906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:43.295880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f0efff-3ba5-4cb9-a9c7-66871f4b1906 admin admin] PATH_INFO: `/v3/users/d6ac960360a14fe9ac384a932c3082c6` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:43.299635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0efff-3ba5-4cb9-a9c7-66871f4b1906 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6ac960360a14fe9ac384a932c3082c6)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:43.304827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f0efff-3ba5-4cb9-a9c7-66871f4b1906 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:43.576311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-97f0efff-3ba5-4cb9-a9c7-66871f4b1906 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6ac960360a14fe9ac384a932c3082c6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:43.606909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-97f0efff-3ba5-4cb9-a9c7-66871f4b1906 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6ac960360a14fe9ac384a932c3082c6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:43.634932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-97f0efff-3ba5-4cb9-a9c7-66871f4b1906 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6ac960360a14fe9ac384a932c3082c6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:43.638386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-97f0efff-3ba5-4cb9-a9c7-66871f4b1906 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6ac960360a14fe9ac384a932c3082c6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:43.756631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-97f0efff-3ba5-4cb9-a9c7-66871f4b1906 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6ac960360a14fe9ac384a932c3082c6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:43.759983 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:43.767862 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2690/5323] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:36:43 2022] DELETE /identity/v3/users/d6ac960360a14fe9ac384a932c3082c6 => generated 0 bytes in 717 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:36:43.897572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37786ffa-d6a3-474e-b1ce-1da62cea5b67 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:43.899301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-37786ffa-d6a3-474e-b1ce-1da62cea5b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:43.932708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37786ffa-d6a3-474e-b1ce-1da62cea5b67 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:44.158370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f328cf-60c9-46f3-a5a7-4eb4a7e1c1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:44.160258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f328cf-60c9-46f3-a5a7-4eb4a7e1c1af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:44.160609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f328cf-60c9-46f3-a5a7-4eb4a7e1c1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:44.164367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f328cf-60c9-46f3-a5a7-4eb4a7e1c1af admin admin] PATH_INFO: `/v3/projects/308b52e8030945f58256db43e0675d4b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:44.166396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f328cf-60c9-46f3-a5a7-4eb4a7e1c1af admin admin] RBAC: Authorizing `identity:delete_project(project_id=308b52e8030945f58256db43e0675d4b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:44.171339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f328cf-60c9-46f3-a5a7-4eb4a7e1c1af admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:44.211760 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:44.464671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c2f328cf-60c9-46f3-a5a7-4eb4a7e1c1af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '308b52e8030945f58256db43e0675d4b', 'request_id': 'req-c2f328cf-60c9-46f3-a5a7-4eb4a7e1c1af'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:44.596403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c2f328cf-60c9-46f3-a5a7-4eb4a7e1c1af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '308b52e8030945f58256db43e0675d4b', 'request_id': 'req-c2f328cf-60c9-46f3-a5a7-4eb4a7e1c1af'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:44.606531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c2f328cf-60c9-46f3-a5a7-4eb4a7e1c1af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '308b52e8030945f58256db43e0675d4b', 'request_id': 'req-c2f328cf-60c9-46f3-a5a7-4eb4a7e1c1af'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:44.625162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c2f328cf-60c9-46f3-a5a7-4eb4a7e1c1af admin admin] The token cache is being invalidate because project 308b52e8030945f58256db43e0675d4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:36:44.625535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c2f328cf-60c9-46f3-a5a7-4eb4a7e1c1af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:44.627984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c2f328cf-60c9-46f3-a5a7-4eb4a7e1c1af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:44.634564 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2634/5324] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:36:43 2022] DELETE /identity/v3/projects/308b52e8030945f58256db43e0675d4b => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:44.639350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0efff-3ba5-4cb9-a9c7-66871f4b1906 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:44.639350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-97f0efff-3ba5-4cb9-a9c7-66871f4b1906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:44.679723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f0efff-3ba5-4cb9-a9c7-66871f4b1906 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:44.905288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f328cf-60c9-46f3-a5a7-4eb4a7e1c1af admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:44.907647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c2f328cf-60c9-46f3-a5a7-4eb4a7e1c1af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:44.914310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d0f85-e47f-4afc-b6bd-4c3437abbf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:44.915219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d0f85-e47f-4afc-b6bd-4c3437abbf86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:44.915509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d0f85-e47f-4afc-b6bd-4c3437abbf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:44.915790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d0f85-e47f-4afc-b6bd-4c3437abbf86 admin admin] PATH_INFO: `/v3/users/e28be97da5ed48929662e6d203f5521c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:44.920134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d0f85-e47f-4afc-b6bd-4c3437abbf86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e28be97da5ed48929662e6d203f5521c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:44.926708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d0f85-e47f-4afc-b6bd-4c3437abbf86 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:44.959532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f328cf-60c9-46f3-a5a7-4eb4a7e1c1af admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:44.964801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb994d97-3db8-435f-8f86-58875af726d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:44.965901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb994d97-3db8-435f-8f86-58875af726d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:44.966368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb994d97-3db8-435f-8f86-58875af726d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:44.966920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb994d97-3db8-435f-8f86-58875af726d2 admin admin] PATH_INFO: `/v3/projects/ee80ee65c7544bb3a0188f4ae1d4ac9e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:44.968725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb994d97-3db8-435f-8f86-58875af726d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee80ee65c7544bb3a0188f4ae1d4ac9e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:44.970965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb994d97-3db8-435f-8f86-58875af726d2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:45.251722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fb994d97-3db8-435f-8f86-58875af726d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee80ee65c7544bb3a0188f4ae1d4ac9e', 'request_id': 'req-fb994d97-3db8-435f-8f86-58875af726d2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:45.349034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8f5d0f85-e47f-4afc-b6bd-4c3437abbf86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e28be97da5ed48929662e6d203f5521c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:45.383925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8f5d0f85-e47f-4afc-b6bd-4c3437abbf86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e28be97da5ed48929662e6d203f5521c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:45.390458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fb994d97-3db8-435f-8f86-58875af726d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee80ee65c7544bb3a0188f4ae1d4ac9e', 'request_id': 'req-fb994d97-3db8-435f-8f86-58875af726d2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:45.402077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fb994d97-3db8-435f-8f86-58875af726d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee80ee65c7544bb3a0188f4ae1d4ac9e', 'request_id': 'req-fb994d97-3db8-435f-8f86-58875af726d2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:45.407199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8f5d0f85-e47f-4afc-b6bd-4c3437abbf86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e28be97da5ed48929662e6d203f5521c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:45.410420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8f5d0f85-e47f-4afc-b6bd-4c3437abbf86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e28be97da5ed48929662e6d203f5521c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:45.445299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fb994d97-3db8-435f-8f86-58875af726d2 admin admin] The token cache is being invalidate because project ee80ee65c7544bb3a0188f4ae1d4ac9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:36:45.445631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fb994d97-3db8-435f-8f86-58875af726d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:45.450902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fb994d97-3db8-435f-8f86-58875af726d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:45.450902 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2635/5325] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:36:44 2022] DELETE /identity/v3/projects/ee80ee65c7544bb3a0188f4ae1d4ac9e => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:36:45.454504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f232ff9-03f0-493a-8dd2-dba2083861f9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:45.455230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f232ff9-03f0-493a-8dd2-dba2083861f9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:45.455742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f232ff9-03f0-493a-8dd2-dba2083861f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:45.500153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8f5d0f85-e47f-4afc-b6bd-4c3437abbf86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e28be97da5ed48929662e6d203f5521c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:45.512827 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2691/5326] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:36:44 2022] DELETE /identity/v3/users/e28be97da5ed48929662e6d203f5521c => generated 0 bytes in 878 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:36:45.557074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0f232ff9-03f0-493a-8dd2-dba2083861f9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:45.561935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0f232ff9-03f0-493a-8dd2-dba2083861f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:45.756934 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2636/5327] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:45.767762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50d494-7391-4ef4-bdde-a26ceb38614b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:45.769626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50d494-7391-4ef4-bdde-a26ceb38614b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:45.770907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50d494-7391-4ef4-bdde-a26ceb38614b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:45.835569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-fd50d494-7391-4ef4-bdde-a26ceb38614b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:45.836980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fd50d494-7391-4ef4-bdde-a26ceb38614b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:45.864554 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2692/5328] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:45.869516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f232ff9-03f0-493a-8dd2-dba2083861f9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:45.892118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f232ff9-03f0-493a-8dd2-dba2083861f9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:45.915613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb6406-0b83-4b13-86b9-921da35057d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:45.917075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb6406-0b83-4b13-86b9-921da35057d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:45.923575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb6406-0b83-4b13-86b9-921da35057d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:45.928499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb6406-0b83-4b13-86b9-921da35057d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:45.929535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb6406-0b83-4b13-86b9-921da35057d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:36:45.931017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb6406-0b83-4b13-86b9-921da35057d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:45.937481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bb6406-0b83-4b13-86b9-921da35057d3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:45.966977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50d494-7391-4ef4-bdde-a26ceb38614b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:45.972216 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2637/5329] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:36:45.986385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50d494-7391-4ef4-bdde-a26ceb38614b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:45.993353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe5267-b3d6-452e-9542-3e0619695f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:45.994316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe5267-b3d6-452e-9542-3e0619695f55 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:45.995915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe5267-b3d6-452e-9542-3e0619695f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:45.996379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fe5267-b3d6-452e-9542-3e0619695f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:45.998309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe5267-b3d6-452e-9542-3e0619695f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:46.003484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fe5267-b3d6-452e-9542-3e0619695f55 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:46.160941 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2693/5330] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:36:45 2022] POST /identity/v3/projects => generated 363 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:36:46.162590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb6406-0b83-4b13-86b9-921da35057d3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:46.182591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb6406-0b83-4b13-86b9-921da35057d3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:46.196203 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:46.307887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e755b-6b22-4ba9-8ed1-83a9657bff45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:46.308940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e755b-6b22-4ba9-8ed1-83a9657bff45 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:46.309455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e755b-6b22-4ba9-8ed1-83a9657bff45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:46.309978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e755b-6b22-4ba9-8ed1-83a9657bff45 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:46.311095 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e755b-6b22-4ba9-8ed1-83a9657bff45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:46.313553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e755b-6b22-4ba9-8ed1-83a9657bff45 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:46.422738 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2638/5331] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:36:46 2022] POST /identity/v3/users => generated 282 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:36:46.436369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe5267-b3d6-452e-9542-3e0619695f55 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:46.445085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fe5267-b3d6-452e-9542-3e0619695f55 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:46.456453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3effb2-7ace-47c1-a483-981694c25bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:46.460788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3effb2-7ace-47c1-a483-981694c25bda admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:46.460788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3effb2-7ace-47c1-a483-981694c25bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:46.460788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3effb2-7ace-47c1-a483-981694c25bda admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:46.462391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3effb2-7ace-47c1-a483-981694c25bda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:46.464132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3effb2-7ace-47c1-a483-981694c25bda admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:46.499842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e755b-6b22-4ba9-8ed1-83a9657bff45 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:46.502548 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2694/5332] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:36:46.515850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e755b-6b22-4ba9-8ed1-83a9657bff45 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:46.533127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f83499-93f6-4f25-ab0b-3ab8f9c3aaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:46.538065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f83499-93f6-4f25-ab0b-3ab8f9c3aaad admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:46.538413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f83499-93f6-4f25-ab0b-3ab8f9c3aaad admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:46.538709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f83499-93f6-4f25-ab0b-3ab8f9c3aaad admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:46.543659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f83499-93f6-4f25-ab0b-3ab8f9c3aaad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:46.547105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f83499-93f6-4f25-ab0b-3ab8f9c3aaad admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:46.589823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3effb2-7ace-47c1-a483-981694c25bda admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:46.590492 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2639/5333] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:36:46.602832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3effb2-7ace-47c1-a483-981694c25bda admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:46.614747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15555bd6-089b-43f0-a4d8-e460c71c28cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:46.615852 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15555bd6-089b-43f0-a4d8-e460c71c28cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:46.621962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15555bd6-089b-43f0-a4d8-e460c71c28cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:46.621962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15555bd6-089b-43f0-a4d8-e460c71c28cf admin admin] PATH_INFO: `/v3/projects/2005561d511b44a1a9d98366a68688f6/users/26834d6139c647ab982d9b9c0ea3b166/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:46.654277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15555bd6-089b-43f0-a4d8-e460c71c28cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2005561d511b44a1a9d98366a68688f6, user_id=26834d6139c647ab982d9b9c0ea3b166, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:46.657098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15555bd6-089b-43f0-a4d8-e460c71c28cf admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:46.807553 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2695/5334] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:36:46 2022] PUT /identity/v3/projects/2005561d511b44a1a9d98366a68688f6/users/26834d6139c647ab982d9b9c0ea3b166/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:36:46.820275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7b6d4-c417-499a-80b9-7a2cf42d5fd9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:46.821534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7b6d4-c417-499a-80b9-7a2cf42d5fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:46.826954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7b6d4-c417-499a-80b9-7a2cf42d5fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:46.842596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15555bd6-089b-43f0-a4d8-e460c71c28cf admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:46.846039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-15555bd6-089b-43f0-a4d8-e460c71c28cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:46.885393 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:46.893374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-58b7b6d4-c417-499a-80b9-7a2cf42d5fd9 None None] MFA Rules not processed for user `26834d6139c647ab982d9b9c0ea3b166`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:46.896654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-58b7b6d4-c417-499a-80b9-7a2cf42d5fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:46.996057 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2640/5335] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:46 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:46.997471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7b6d4-c417-499a-80b9-7a2cf42d5fd9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:47.005411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15555bd6-089b-43f0-a4d8-e460c71c28cf admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:47.010443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7b6d4-c417-499a-80b9-7a2cf42d5fd9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:47.018131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274c026-9b3c-438c-b123-a987955fb958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:47.018836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274c026-9b3c-438c-b123-a987955fb958 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:47.019132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274c026-9b3c-438c-b123-a987955fb958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:47.019506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274c026-9b3c-438c-b123-a987955fb958 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:47.020786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eb4808-fc6c-4a37-8fba-0f3c2ccf20aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:47.021675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274c026-9b3c-438c-b123-a987955fb958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:47.022489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb4808-fc6c-4a37-8fba-0f3c2ccf20aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:47.022788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb4808-fc6c-4a37-8fba-0f3c2ccf20aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:47.023080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eb4808-fc6c-4a37-8fba-0f3c2ccf20aa admin admin] PATH_INFO: `/v3/projects/f1ab19824b6b4c50ad81581adee05d58` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:47.023741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274c026-9b3c-438c-b123-a987955fb958 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:47.024350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb4808-fc6c-4a37-8fba-0f3c2ccf20aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1ab19824b6b4c50ad81581adee05d58)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:47.026326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eb4808-fc6c-4a37-8fba-0f3c2ccf20aa admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:47.224718 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2641/5336] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:36:46 2022] POST /identity/v3/projects => generated 365 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:36:47.228233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274c026-9b3c-438c-b123-a987955fb958 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:47.257338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-68eb4808-fc6c-4a37-8fba-0f3c2ccf20aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1ab19824b6b4c50ad81581adee05d58', 'request_id': 'req-68eb4808-fc6c-4a37-8fba-0f3c2ccf20aa'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:47.277718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-68eb4808-fc6c-4a37-8fba-0f3c2ccf20aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1ab19824b6b4c50ad81581adee05d58', 'request_id': 'req-68eb4808-fc6c-4a37-8fba-0f3c2ccf20aa'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:47.300303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-68eb4808-fc6c-4a37-8fba-0f3c2ccf20aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1ab19824b6b4c50ad81581adee05d58', 'request_id': 'req-68eb4808-fc6c-4a37-8fba-0f3c2ccf20aa'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:47.360891 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:47.365210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274c026-9b3c-438c-b123-a987955fb958 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:47.447768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-68eb4808-fc6c-4a37-8fba-0f3c2ccf20aa admin admin] The token cache is being invalidate because project f1ab19824b6b4c50ad81581adee05d58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:36:47.448189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-68eb4808-fc6c-4a37-8fba-0f3c2ccf20aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:47.449399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-68eb4808-fc6c-4a37-8fba-0f3c2ccf20aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:47.454563 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2696/5337] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:36:46 2022] DELETE /identity/v3/projects/f1ab19824b6b4c50ad81581adee05d58 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:36:47.456504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67751294-4743-4254-aaa0-46c03324edc9 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:47.456862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67751294-4743-4254-aaa0-46c03324edc9 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:47.457145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67751294-4743-4254-aaa0-46c03324edc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:47.490142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d6318-b257-468a-abb4-ee4695f6bc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:47.491517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d6318-b257-468a-abb4-ee4695f6bc89 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:47.491826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d6318-b257-468a-abb4-ee4695f6bc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:47.492109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0d6318-b257-468a-abb4-ee4695f6bc89 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:47.492827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d6318-b257-468a-abb4-ee4695f6bc89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:47.496731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0d6318-b257-468a-abb4-ee4695f6bc89 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:47.523459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-67751294-4743-4254-aaa0-46c03324edc9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:47.523459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-67751294-4743-4254-aaa0-46c03324edc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:47.550934 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2697/5338] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:47.551867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d2826-b755-45e7-a020-51b3b22f8a80 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:47.552213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d2826-b755-45e7-a020-51b3b22f8a80 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:47.552489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d2826-b755-45e7-a020-51b3b22f8a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:47.584398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-332d2826-b755-45e7-a020-51b3b22f8a80 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:47.585134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-332d2826-b755-45e7-a020-51b3b22f8a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:47.612758 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2698/5339] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:36:47.622270 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2642/5340] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:36:47 2022] POST /identity/v3/users => generated 289 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:36:47.622270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d6318-b257-468a-abb4-ee4695f6bc89 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:47.623159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d2826-b755-45e7-a020-51b3b22f8a80 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:47.623159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-332d2826-b755-45e7-a020-51b3b22f8a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:47.654947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d2826-b755-45e7-a020-51b3b22f8a80 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:47.657056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0d6318-b257-468a-abb4-ee4695f6bc89 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:47.662973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911644eb-1120-4c5c-ac4f-44ab250a312a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:47.664027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911644eb-1120-4c5c-ac4f-44ab250a312a admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:47.664558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911644eb-1120-4c5c-ac4f-44ab250a312a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:47.665061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911644eb-1120-4c5c-ac4f-44ab250a312a admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:47.666345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911644eb-1120-4c5c-ac4f-44ab250a312a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:47.670404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e714f05-6f5a-4932-8320-7e9b778af7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:47.671180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e714f05-6f5a-4932-8320-7e9b778af7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:47.671468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e714f05-6f5a-4932-8320-7e9b778af7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:47.671678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911644eb-1120-4c5c-ac4f-44ab250a312a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:47.671791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e714f05-6f5a-4932-8320-7e9b778af7d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:47.672548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e714f05-6f5a-4932-8320-7e9b778af7d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:36:47.672859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e714f05-6f5a-4932-8320-7e9b778af7d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:47.674531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e714f05-6f5a-4932-8320-7e9b778af7d4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:47.688078 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2699/5341] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:36:47.693460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911644eb-1120-4c5c-ac4f-44ab250a312a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:47.709144 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2643/5342] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:36:47.713795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e714f05-6f5a-4932-8320-7e9b778af7d4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:47.727231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911644eb-1120-4c5c-ac4f-44ab250a312a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:47.735252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e714f05-6f5a-4932-8320-7e9b778af7d4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:47.742907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf200a-2d2e-4d19-b670-9f1bee411142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:47.747301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf200a-2d2e-4d19-b670-9f1bee411142 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:47.748493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf200a-2d2e-4d19-b670-9f1bee411142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:47.748493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf200a-2d2e-4d19-b670-9f1bee411142 admin admin] PATH_INFO: `/v3/projects/3acae81cc2e64dd6822f00dd0e700b14/users/a4dc5afb77b34a349ce7bbcae703f67f/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:47.749430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a354b0-2e51-4bee-845b-190c3a7cc2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:47.750164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a354b0-2e51-4bee-845b-190c3a7cc2ae admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:47.750428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a354b0-2e51-4bee-845b-190c3a7cc2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:47.750709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a354b0-2e51-4bee-845b-190c3a7cc2ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:47.751590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a354b0-2e51-4bee-845b-190c3a7cc2ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:47.753338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a354b0-2e51-4bee-845b-190c3a7cc2ae admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:47.790433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf200a-2d2e-4d19-b670-9f1bee411142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3acae81cc2e64dd6822f00dd0e700b14, user_id=a4dc5afb77b34a349ce7bbcae703f67f, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:47.795890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cf200a-2d2e-4d19-b670-9f1bee411142 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:47.894132 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2700/5343] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:36:47 2022] PUT /identity/v3/projects/3acae81cc2e64dd6822f00dd0e700b14/users/a4dc5afb77b34a349ce7bbcae703f67f/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:47.894767 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2644/5344] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:36:47 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:36:47.897621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf200a-2d2e-4d19-b670-9f1bee411142 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:47.900024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a354b0-2e51-4bee-845b-190c3a7cc2ae admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:48.028731 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:48.033740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf200a-2d2e-4d19-b670-9f1bee411142 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:48.061326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a354b0-2e51-4bee-845b-190c3a7cc2ae admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:48.078561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c0b4b-2337-42ff-a2f7-66dc0f70ee69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:48.079557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c0b4b-2337-42ff-a2f7-66dc0f70ee69 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:48.080000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c0b4b-2337-42ff-a2f7-66dc0f70ee69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:48.080460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06c0b4b-2337-42ff-a2f7-66dc0f70ee69 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:48.083424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c0b4b-2337-42ff-a2f7-66dc0f70ee69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:48.089607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06c0b4b-2337-42ff-a2f7-66dc0f70ee69 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:48.133321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828db11-08cd-45c9-acb2-a953dc9bb793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:48.134021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828db11-08cd-45c9-acb2-a953dc9bb793 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:48.134337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828db11-08cd-45c9-acb2-a953dc9bb793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:48.135010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2828db11-08cd-45c9-acb2-a953dc9bb793 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:48.135512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828db11-08cd-45c9-acb2-a953dc9bb793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:48.137143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2828db11-08cd-45c9-acb2-a953dc9bb793 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:48.158375 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2701/5345] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:36:48.163666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828db11-08cd-45c9-acb2-a953dc9bb793 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:48.189831 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2645/5346] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:36:47 2022] POST /identity/v3/users => generated 290 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:36:48.193114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2828db11-08cd-45c9-acb2-a953dc9bb793 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:48.194810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c0b4b-2337-42ff-a2f7-66dc0f70ee69 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:48.198569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe6361-b281-41d6-a915-7ac6f79aa3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:48.199554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe6361-b281-41d6-a915-7ac6f79aa3a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:48.199945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe6361-b281-41d6-a915-7ac6f79aa3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:48.200128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe6361-b281-41d6-a915-7ac6f79aa3a7 admin admin] PATH_INFO: `/v3/projects/3acae81cc2e64dd6822f00dd0e700b14/users/a4dc5afb77b34a349ce7bbcae703f67f/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:48.204900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe6361-b281-41d6-a915-7ac6f79aa3a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3acae81cc2e64dd6822f00dd0e700b14, user_id=a4dc5afb77b34a349ce7bbcae703f67f, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:48.207845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe6361-b281-41d6-a915-7ac6f79aa3a7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:48.230574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06c0b4b-2337-42ff-a2f7-66dc0f70ee69 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:48.244506 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2702/5347] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:36:48 2022] PUT /identity/v3/projects/3acae81cc2e64dd6822f00dd0e700b14/users/a4dc5afb77b34a349ce7bbcae703f67f/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:48.257651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc072c5-b154-42ad-a598-61ca59653561 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:48.257950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc072c5-b154-42ad-a598-61ca59653561 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:48.258268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc072c5-b154-42ad-a598-61ca59653561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:48.312481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-dbc072c5-b154-42ad-a598-61ca59653561 None None] MFA Rules not processed for user `a4dc5afb77b34a349ce7bbcae703f67f`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:48.312481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dbc072c5-b154-42ad-a598-61ca59653561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:48.364710 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:48.411150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b589b-300e-4b6c-97df-8346f3bf5b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:48.412579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b589b-300e-4b6c-97df-8346f3bf5b53 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:48.412902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b589b-300e-4b6c-97df-8346f3bf5b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:48.413283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b589b-300e-4b6c-97df-8346f3bf5b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:48.414523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b589b-300e-4b6c-97df-8346f3bf5b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:48.418522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b589b-300e-4b6c-97df-8346f3bf5b53 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:48.445679 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2646/5348] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:36:48.449787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b589b-300e-4b6c-97df-8346f3bf5b53 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:48.470003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b589b-300e-4b6c-97df-8346f3bf5b53 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:48.487064 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2703/5349] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:48 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:36:48.489490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc1664-f718-4de9-9312-1d878f5435ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:48.490291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc1664-f718-4de9-9312-1d878f5435ff admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:48.490680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc1664-f718-4de9-9312-1d878f5435ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:48.491056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc1664-f718-4de9-9312-1d878f5435ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:48.500368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc1664-f718-4de9-9312-1d878f5435ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:48.500591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc072c5-b154-42ad-a598-61ca59653561 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:48.501878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dbc072c5-b154-42ad-a598-61ca59653561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:48.501999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc1664-f718-4de9-9312-1d878f5435ff admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:48.531677 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2647/5350] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:36:48.535866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc1664-f718-4de9-9312-1d878f5435ff admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:48.557276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc1664-f718-4de9-9312-1d878f5435ff admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:48.573869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfa2f7-872f-4192-97be-242cee216ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:48.574742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfa2f7-872f-4192-97be-242cee216ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:48.575028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfa2f7-872f-4192-97be-242cee216ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:48.575307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfa2f7-872f-4192-97be-242cee216ce3 admin admin] PATH_INFO: `/v3/projects/79a0036b73604d3cbc08d08b8293c4a5/users/761a8c8cfce6441a8eea1cbc349a382d/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:48.600620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfa2f7-872f-4192-97be-242cee216ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79a0036b73604d3cbc08d08b8293c4a5, user_id=761a8c8cfce6441a8eea1cbc349a382d, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:48.603649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfa2f7-872f-4192-97be-242cee216ce3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:48.687284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc072c5-b154-42ad-a598-61ca59653561 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:48.700040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7946d-371c-4259-bb2d-ab347ae0ee3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:48.701061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7946d-371c-4259-bb2d-ab347ae0ee3c service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:48.701374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7946d-371c-4259-bb2d-ab347ae0ee3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:48.701770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7946d-371c-4259-bb2d-ab347ae0ee3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:48.704494 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2648/5351] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:36:48 2022] PUT /identity/v3/projects/79a0036b73604d3cbc08d08b8293c4a5/users/761a8c8cfce6441a8eea1cbc349a382d/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:36:48.715620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d524cdd-8c3e-426b-903c-157f0dfad79b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:48.717762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d524cdd-8c3e-426b-903c-157f0dfad79b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:48.718469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d524cdd-8c3e-426b-903c-157f0dfad79b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:48.733095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7946d-371c-4259-bb2d-ab347ae0ee3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:48.735693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7946d-371c-4259-bb2d-ab347ae0ee3c service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:48.755991 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2704/5352] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:36:48 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:36:48.798863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9d524cdd-8c3e-426b-903c-157f0dfad79b None None] MFA Rules not processed for user `761a8c8cfce6441a8eea1cbc349a382d`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:48.801893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9d524cdd-8c3e-426b-903c-157f0dfad79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:49.013003 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2649/5353] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:49.025738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7946d-371c-4259-bb2d-ab347ae0ee3c service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:49.027675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-12d7946d-371c-4259-bb2d-ab347ae0ee3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:49.078773 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:49.162212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7946d-371c-4259-bb2d-ab347ae0ee3c service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:49.229740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d04fc-bfbf-43f9-abf3-4ce474a972c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:49.230480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d04fc-bfbf-43f9-abf3-4ce474a972c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:49.230740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d04fc-bfbf-43f9-abf3-4ce474a972c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:49.231022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d04fc-bfbf-43f9-abf3-4ce474a972c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:49.242363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d04fc-bfbf-43f9-abf3-4ce474a972c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:49.244267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d04fc-bfbf-43f9-abf3-4ce474a972c0 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:49.270668 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2705/5354] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:36:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:36:49.426036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d524cdd-8c3e-426b-903c-157f0dfad79b None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:49.597578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d524cdd-8c3e-426b-903c-157f0dfad79b None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:49.628086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4bcc90-478c-487e-be4f-d63253a3b647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:49.629212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bcc90-478c-487e-be4f-d63253a3b647 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:49.629678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bcc90-478c-487e-be4f-d63253a3b647 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:49.630176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4bcc90-478c-487e-be4f-d63253a3b647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:49.636504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8a4bcc90-478c-487e-be4f-d63253a3b647 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:49.797288 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:49.808186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bcc90-478c-487e-be4f-d63253a3b647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:49.810200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4bcc90-478c-487e-be4f-d63253a3b647 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:49.835742 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2650/5355] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:36:49 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:36:50.150627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d04fc-bfbf-43f9-abf3-4ce474a972c0 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:50.153051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-db9d04fc-bfbf-43f9-abf3-4ce474a972c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:50.175701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d04fc-bfbf-43f9-abf3-4ce474a972c0 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:50.185687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30ff00-c455-481a-9f49-7a18e27dbd0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:50.189292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30ff00-c455-481a-9f49-7a18e27dbd0b service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:50.189935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30ff00-c455-481a-9f49-7a18e27dbd0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:50.190624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30ff00-c455-481a-9f49-7a18e27dbd0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:50.197649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9f30ff00-c455-481a-9f49-7a18e27dbd0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:50.401253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30ff00-c455-481a-9f49-7a18e27dbd0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:50.403293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f30ff00-c455-481a-9f49-7a18e27dbd0b service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:50.435213 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2706/5356] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:36:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:36:51.955935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47081704-15f0-42dd-b8fa-aef4d5bb70de None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:51.956511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47081704-15f0-42dd-b8fa-aef4d5bb70de None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:51.956663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47081704-15f0-42dd-b8fa-aef4d5bb70de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:52.023915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-47081704-15f0-42dd-b8fa-aef4d5bb70de None None] MFA Rules not processed for user `bf94666b7381478d8426c7f4f9e7cb13`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:52.028305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-47081704-15f0-42dd-b8fa-aef4d5bb70de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:52.170158 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2651/5357] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:52.184018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2fb68-399a-4bda-8654-fe3b5eada9ba None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:52.188813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2fb68-399a-4bda-8654-fe3b5eada9ba None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:52.188813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d2fb68-399a-4bda-8654-fe3b5eada9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:52.253905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-07d2fb68-399a-4bda-8654-fe3b5eada9ba None None] MFA Rules not processed for user `bf94666b7381478d8426c7f4f9e7cb13`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:52.255523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-07d2fb68-399a-4bda-8654-fe3b5eada9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:52.289748 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2707/5358] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:52.302922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47081704-15f0-42dd-b8fa-aef4d5bb70de None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:52.305041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-47081704-15f0-42dd-b8fa-aef4d5bb70de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:52.483641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47081704-15f0-42dd-b8fa-aef4d5bb70de None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:52.499652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fcd57-cd28-4c8d-8e48-ae0d70a11931 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:52.501927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fcd57-cd28-4c8d-8e48-ae0d70a11931 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:52.501927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fcd57-cd28-4c8d-8e48-ae0d70a11931 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:52.501927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fcd57-cd28-4c8d-8e48-ae0d70a11931 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:52.514514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fcd57-cd28-4c8d-8e48-ae0d70a11931 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:52.516559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0fcd57-cd28-4c8d-8e48-ae0d70a11931 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:52.532195 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2652/5359] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:36:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:36:52.992566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2fb68-399a-4bda-8654-fe3b5eada9ba None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:52.993992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-07d2fb68-399a-4bda-8654-fe3b5eada9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:53.144648 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:53.183222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d2fb68-399a-4bda-8654-fe3b5eada9ba None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:53.200858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449a86d-8772-4bad-aec7-9b8722c951bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:53.202288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449a86d-8772-4bad-aec7-9b8722c951bc service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:53.202750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449a86d-8772-4bad-aec7-9b8722c951bc service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:53.203218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449a86d-8772-4bad-aec7-9b8722c951bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:53.215658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e449a86d-8772-4bad-aec7-9b8722c951bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:53.268181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449a86d-8772-4bad-aec7-9b8722c951bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:53.273882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449a86d-8772-4bad-aec7-9b8722c951bc service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:53.303999 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2708/5360] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:36:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:36:54.464551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fcd57-cd28-4c8d-8e48-ae0d70a11931 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:54.479452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fcd57-cd28-4c8d-8e48-ae0d70a11931 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:54.504883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca8ff9-4e75-4079-ac48-d7e0b4ea5454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:54.504883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca8ff9-4e75-4079-ac48-d7e0b4ea5454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:54.504883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca8ff9-4e75-4079-ac48-d7e0b4ea5454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:54.504883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca8ff9-4e75-4079-ac48-d7e0b4ea5454 admin admin] PATH_INFO: `/v3/users/26834d6139c647ab982d9b9c0ea3b166` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:54.507001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca8ff9-4e75-4079-ac48-d7e0b4ea5454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26834d6139c647ab982d9b9c0ea3b166)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:54.514020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca8ff9-4e75-4079-ac48-d7e0b4ea5454 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:54.589011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449a86d-8772-4bad-aec7-9b8722c951bc service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:54.590613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e449a86d-8772-4bad-aec7-9b8722c951bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:54.628220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449a86d-8772-4bad-aec7-9b8722c951bc service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:54.656902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ab7ce-7991-4220-8569-49676bf9e758 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:54.656902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ab7ce-7991-4220-8569-49676bf9e758 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:54.656902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ab7ce-7991-4220-8569-49676bf9e758 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:54.656902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ab7ce-7991-4220-8569-49676bf9e758 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:54.657248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6b7ab7ce-7991-4220-8569-49676bf9e758 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:54.688916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ab7ce-7991-4220-8569-49676bf9e758 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:54.695036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ab7ce-7991-4220-8569-49676bf9e758 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:54.731941 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2709/5361] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:36:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:36:54.789820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a9ca8ff9-4e75-4079-ac48-d7e0b4ea5454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26834d6139c647ab982d9b9c0ea3b166'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:54.828381 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:54.834348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a9ca8ff9-4e75-4079-ac48-d7e0b4ea5454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26834d6139c647ab982d9b9c0ea3b166'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:54.836669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a9ca8ff9-4e75-4079-ac48-d7e0b4ea5454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26834d6139c647ab982d9b9c0ea3b166'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:54.837285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a9ca8ff9-4e75-4079-ac48-d7e0b4ea5454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26834d6139c647ab982d9b9c0ea3b166'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:54.859807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a9ca8ff9-4e75-4079-ac48-d7e0b4ea5454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26834d6139c647ab982d9b9c0ea3b166'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:54.989344 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2653/5362] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:36:54 2022] DELETE /identity/v3/users/26834d6139c647ab982d9b9c0ea3b166 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:54.991062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba78cd-e5b5-49dc-af61-4161af1dd588 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:54.991304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba78cd-e5b5-49dc-af61-4161af1dd588 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:54.991762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba78cd-e5b5-49dc-af61-4161af1dd588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:55.023040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-50ba78cd-e5b5-49dc-af61-4161af1dd588 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:55.028327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-50ba78cd-e5b5-49dc-af61-4161af1dd588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:55.206697 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2710/5363] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:55.354427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca8ff9-4e75-4079-ac48-d7e0b4ea5454 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:55.357157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a9ca8ff9-4e75-4079-ac48-d7e0b4ea5454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:55.499654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca8ff9-4e75-4079-ac48-d7e0b4ea5454 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:55.521981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe5e6a-9aef-47e3-b0fe-ee7491e8a5a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:55.522715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe5e6a-9aef-47e3-b0fe-ee7491e8a5a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:55.523011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe5e6a-9aef-47e3-b0fe-ee7491e8a5a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:55.523298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe5e6a-9aef-47e3-b0fe-ee7491e8a5a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:55.575650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe5e6a-9aef-47e3-b0fe-ee7491e8a5a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:55.584115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe5e6a-9aef-47e3-b0fe-ee7491e8a5a7 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:55.630657 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2654/5364] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:36:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:36:56.198367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54d859-13cb-44ac-b77e-362062c032d2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:56.198855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54d859-13cb-44ac-b77e-362062c032d2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:56.199349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54d859-13cb-44ac-b77e-362062c032d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:56.224481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-cf54d859-13cb-44ac-b77e-362062c032d2 None None] MFA Rules not processed for user `2cb5060535f440a5b822500807c10688`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:56.225731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cf54d859-13cb-44ac-b77e-362062c032d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:56.309487 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2711/5365] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:57.294509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe5e6a-9aef-47e3-b0fe-ee7491e8a5a7 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:57.296759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-55fe5e6a-9aef-47e3-b0fe-ee7491e8a5a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:57.314355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe5e6a-9aef-47e3-b0fe-ee7491e8a5a7 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:57.322026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7cac6-34d8-4bdb-8b5e-cb48bc6aeed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:57.323366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7cac6-34d8-4bdb-8b5e-cb48bc6aeed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:57.323872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7cac6-34d8-4bdb-8b5e-cb48bc6aeed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:57.324343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7cac6-34d8-4bdb-8b5e-cb48bc6aeed9 admin admin] PATH_INFO: `/v3/projects/2005561d511b44a1a9d98366a68688f6` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:57.326791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7cac6-34d8-4bdb-8b5e-cb48bc6aeed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2005561d511b44a1a9d98366a68688f6)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:57.329385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7cac6-34d8-4bdb-8b5e-cb48bc6aeed9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:57.485375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6ee7cac6-34d8-4bdb-8b5e-cb48bc6aeed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2005561d511b44a1a9d98366a68688f6', 'request_id': 'req-6ee7cac6-34d8-4bdb-8b5e-cb48bc6aeed9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:57.589277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6ee7cac6-34d8-4bdb-8b5e-cb48bc6aeed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2005561d511b44a1a9d98366a68688f6', 'request_id': 'req-6ee7cac6-34d8-4bdb-8b5e-cb48bc6aeed9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:57.597087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6ee7cac6-34d8-4bdb-8b5e-cb48bc6aeed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2005561d511b44a1a9d98366a68688f6', 'request_id': 'req-6ee7cac6-34d8-4bdb-8b5e-cb48bc6aeed9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:57.609173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6ee7cac6-34d8-4bdb-8b5e-cb48bc6aeed9 admin admin] The token cache is being invalidate because project 2005561d511b44a1a9d98366a68688f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:36:57.609416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6ee7cac6-34d8-4bdb-8b5e-cb48bc6aeed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:57.615148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6ee7cac6-34d8-4bdb-8b5e-cb48bc6aeed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:57.615531 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2655/5366] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:36:57 2022] DELETE /identity/v3/projects/2005561d511b44a1a9d98366a68688f6 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:57.616620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54d859-13cb-44ac-b77e-362062c032d2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:57.630573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54d859-13cb-44ac-b77e-362062c032d2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:57.724929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86aec6-aa43-44ff-a746-167c6659f6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:57.726063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86aec6-aa43-44ff-a746-167c6659f6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:57.726622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86aec6-aa43-44ff-a746-167c6659f6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:57.726960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86aec6-aa43-44ff-a746-167c6659f6c2 admin admin] PATH_INFO: `/v3/users/a4dc5afb77b34a349ce7bbcae703f67f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:57.728614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86aec6-aa43-44ff-a746-167c6659f6c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4dc5afb77b34a349ce7bbcae703f67f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:57.730627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86aec6-aa43-44ff-a746-167c6659f6c2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:57.752588 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:57.945288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-be86aec6-aa43-44ff-a746-167c6659f6c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4dc5afb77b34a349ce7bbcae703f67f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:57.958162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-be86aec6-aa43-44ff-a746-167c6659f6c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4dc5afb77b34a349ce7bbcae703f67f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:57.966377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-be86aec6-aa43-44ff-a746-167c6659f6c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4dc5afb77b34a349ce7bbcae703f67f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:57.967185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-be86aec6-aa43-44ff-a746-167c6659f6c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4dc5afb77b34a349ce7bbcae703f67f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:58.039038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-be86aec6-aa43-44ff-a746-167c6659f6c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4dc5afb77b34a349ce7bbcae703f67f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:58.045654 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2712/5367] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:36:57 2022] DELETE /identity/v3/users/a4dc5afb77b34a349ce7bbcae703f67f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:58.499526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7cac6-34d8-4bdb-8b5e-cb48bc6aeed9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:58.501461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6ee7cac6-34d8-4bdb-8b5e-cb48bc6aeed9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:58.523246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7cac6-34d8-4bdb-8b5e-cb48bc6aeed9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:58.589260 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:58.595785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16186584-1caf-4080-8035-ff9da5021ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:58.596775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16186584-1caf-4080-8035-ff9da5021ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:58.597250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16186584-1caf-4080-8035-ff9da5021ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:58.597420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16186584-1caf-4080-8035-ff9da5021ca8 admin admin] PATH_INFO: `/v3/projects/3acae81cc2e64dd6822f00dd0e700b14` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:58.599025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16186584-1caf-4080-8035-ff9da5021ca8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3acae81cc2e64dd6822f00dd0e700b14)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:58.601657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16186584-1caf-4080-8035-ff9da5021ca8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:58.727362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-16186584-1caf-4080-8035-ff9da5021ca8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3acae81cc2e64dd6822f00dd0e700b14', 'request_id': 'req-16186584-1caf-4080-8035-ff9da5021ca8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:58.867995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-16186584-1caf-4080-8035-ff9da5021ca8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3acae81cc2e64dd6822f00dd0e700b14', 'request_id': 'req-16186584-1caf-4080-8035-ff9da5021ca8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:58.875055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-16186584-1caf-4080-8035-ff9da5021ca8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3acae81cc2e64dd6822f00dd0e700b14', 'request_id': 'req-16186584-1caf-4080-8035-ff9da5021ca8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:58.887513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-16186584-1caf-4080-8035-ff9da5021ca8 admin admin] The token cache is being invalidate because project 3acae81cc2e64dd6822f00dd0e700b14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:36:58.887804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-16186584-1caf-4080-8035-ff9da5021ca8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:58.888481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-16186584-1caf-4080-8035-ff9da5021ca8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:36:58.890035 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2656/5368] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:36:58 2022] DELETE /identity/v3/projects/3acae81cc2e64dd6822f00dd0e700b14 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:58.895832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df2274-706c-4085-9ddd-b2c96380fb90 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:58.901168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df2274-706c-4085-9ddd-b2c96380fb90 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:58.901168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36df2274-706c-4085-9ddd-b2c96380fb90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:58.915815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-36df2274-706c-4085-9ddd-b2c96380fb90 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:58.917033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-36df2274-706c-4085-9ddd-b2c96380fb90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:58.984111 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2713/5369] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:58.992922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003fcb89-7e5d-4ba4-9338-531d47b0b955 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:58.993195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003fcb89-7e5d-4ba4-9338-531d47b0b955 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:58.993482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003fcb89-7e5d-4ba4-9338-531d47b0b955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:59.032388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-003fcb89-7e5d-4ba4-9338-531d47b0b955 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:59.033626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-003fcb89-7e5d-4ba4-9338-531d47b0b955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:36:59.055684 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2657/5370] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:36:59.060223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df2274-706c-4085-9ddd-b2c96380fb90 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:59.072563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36df2274-706c-4085-9ddd-b2c96380fb90 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:59.077696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf52df9-aedf-4e32-87ec-0e7ba8f28948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:59.078647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf52df9-aedf-4e32-87ec-0e7ba8f28948 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:59.079009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf52df9-aedf-4e32-87ec-0e7ba8f28948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:59.079360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf52df9-aedf-4e32-87ec-0e7ba8f28948 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:59.080207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf52df9-aedf-4e32-87ec-0e7ba8f28948 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:36:59.080587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf52df9-aedf-4e32-87ec-0e7ba8f28948 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:59.082717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf52df9-aedf-4e32-87ec-0e7ba8f28948 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:59.097184 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2714/5371] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:36:59.102466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003fcb89-7e5d-4ba4-9338-531d47b0b955 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:59.119328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003fcb89-7e5d-4ba4-9338-531d47b0b955 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:59.128354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb340f-1c5b-475d-99f9-b2c273521b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:59.130382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb340f-1c5b-475d-99f9-b2c273521b4c admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:59.130681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb340f-1c5b-475d-99f9-b2c273521b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:59.130963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb340f-1c5b-475d-99f9-b2c273521b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:59.132188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb340f-1c5b-475d-99f9-b2c273521b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:59.134808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb340f-1c5b-475d-99f9-b2c273521b4c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:59.241951 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2658/5372] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:36:59 2022] POST /identity/v3/projects => generated 369 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:36:59.243055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf52df9-aedf-4e32-87ec-0e7ba8f28948 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:59.258142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf52df9-aedf-4e32-87ec-0e7ba8f28948 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:59.400170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0264ea3-a56e-4d65-95d6-31bedb4d7757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:59.410583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0264ea3-a56e-4d65-95d6-31bedb4d7757 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:59.410583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0264ea3-a56e-4d65-95d6-31bedb4d7757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:59.410583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0264ea3-a56e-4d65-95d6-31bedb4d7757 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:59.410583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0264ea3-a56e-4d65-95d6-31bedb4d7757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:59.410583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0264ea3-a56e-4d65-95d6-31bedb4d7757 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:59.501399 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2715/5373] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:36:59 2022] POST /identity/v3/users => generated 285 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:36:59.507911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb340f-1c5b-475d-99f9-b2c273521b4c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:59.531155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb340f-1c5b-475d-99f9-b2c273521b4c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:59.547718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ead4e-89df-4b59-b30b-071d416a2686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:59.549354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ead4e-89df-4b59-b30b-071d416a2686 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:59.549886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ead4e-89df-4b59-b30b-071d416a2686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:59.550435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ead4e-89df-4b59-b30b-071d416a2686 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:59.552543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ead4e-89df-4b59-b30b-071d416a2686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:59.554697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ead4e-89df-4b59-b30b-071d416a2686 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:59.573450 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2659/5374] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:36:59.577724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0264ea3-a56e-4d65-95d6-31bedb4d7757 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:59.592919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0264ea3-a56e-4d65-95d6-31bedb4d7757 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:59.605539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a363431e-ec8a-41db-990f-911dcd1231c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:59.606262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363431e-ec8a-41db-990f-911dcd1231c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:59.606547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363431e-ec8a-41db-990f-911dcd1231c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:59.606826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a363431e-ec8a-41db-990f-911dcd1231c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:59.607565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363431e-ec8a-41db-990f-911dcd1231c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:59.614060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a363431e-ec8a-41db-990f-911dcd1231c8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:59.626716 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:36:59.640349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ead4e-89df-4b59-b30b-071d416a2686 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:36:59.651163 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2716/5375] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:36:59.655478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ead4e-89df-4b59-b30b-071d416a2686 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:36:59.666399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92346fa7-18b2-4eb7-a10a-73f8fa932958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:36:59.667487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92346fa7-18b2-4eb7-a10a-73f8fa932958 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:59.668824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92346fa7-18b2-4eb7-a10a-73f8fa932958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:59.668824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92346fa7-18b2-4eb7-a10a-73f8fa932958 admin admin] PATH_INFO: `/v3/projects/86085e1b1825490c861f57cf835f598f/users/6da7d8ce6e304cd89e31d9a62d076fb7/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:59.709359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92346fa7-18b2-4eb7-a10a-73f8fa932958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86085e1b1825490c861f57cf835f598f, user_id=6da7d8ce6e304cd89e31d9a62d076fb7, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:36:59.712564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92346fa7-18b2-4eb7-a10a-73f8fa932958 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:36:59.865662 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2660/5376] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:36:59 2022] PUT /identity/v3/projects/86085e1b1825490c861f57cf835f598f/users/6da7d8ce6e304cd89e31d9a62d076fb7/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:36:59.867876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa937bb-43e1-4cc2-aa7c-d4bbd36a5806 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:36:59.868796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa937bb-43e1-4cc2-aa7c-d4bbd36a5806 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:36:59.869088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa937bb-43e1-4cc2-aa7c-d4bbd36a5806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:36:59.931266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ffa937bb-43e1-4cc2-aa7c-d4bbd36a5806 None None] MFA Rules not processed for user `6da7d8ce6e304cd89e31d9a62d076fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:36:59.933698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ffa937bb-43e1-4cc2-aa7c-d4bbd36a5806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:00.046672 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2717/5377] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:36:59 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:00.051583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92346fa7-18b2-4eb7-a10a-73f8fa932958 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:00.125262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92346fa7-18b2-4eb7-a10a-73f8fa932958 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:00.130979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37b75f-6f01-4a8b-b467-e2c30895ad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:00.131727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37b75f-6f01-4a8b-b467-e2c30895ad49 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:00.132028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37b75f-6f01-4a8b-b467-e2c30895ad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:00.132305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd37b75f-6f01-4a8b-b467-e2c30895ad49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:00.133364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37b75f-6f01-4a8b-b467-e2c30895ad49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:00.135406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd37b75f-6f01-4a8b-b467-e2c30895ad49 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:00.269036 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2661/5378] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:37:00 2022] POST /identity/v3/projects => generated 367 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:37:00.273901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa937bb-43e1-4cc2-aa7c-d4bbd36a5806 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:00.285758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa937bb-43e1-4cc2-aa7c-d4bbd36a5806 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:00.382635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44cdf1-fe48-4a62-a3ca-34c0898f8e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:00.383446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44cdf1-fe48-4a62-a3ca-34c0898f8e4c admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:00.383744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44cdf1-fe48-4a62-a3ca-34c0898f8e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:00.384028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d44cdf1-fe48-4a62-a3ca-34c0898f8e4c admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:00.389462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44cdf1-fe48-4a62-a3ca-34c0898f8e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:00.390744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d44cdf1-fe48-4a62-a3ca-34c0898f8e4c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:00.492266 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2718/5379] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:37:00 2022] POST /identity/v3/users => generated 290 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:37:00.496641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37b75f-6f01-4a8b-b467-e2c30895ad49 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:00.510117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd37b75f-6f01-4a8b-b467-e2c30895ad49 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:00.522525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcc7da-4ec6-4d93-af43-6499d744fca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:00.523234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcc7da-4ec6-4d93-af43-6499d744fca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:00.523531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcc7da-4ec6-4d93-af43-6499d744fca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:00.523817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dcc7da-4ec6-4d93-af43-6499d744fca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:00.524576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcc7da-4ec6-4d93-af43-6499d744fca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:00.526233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dcc7da-4ec6-4d93-af43-6499d744fca3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:00.529039 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:00.590679 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2662/5380] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:37:00.594510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44cdf1-fe48-4a62-a3ca-34c0898f8e4c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:00.613372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d44cdf1-fe48-4a62-a3ca-34c0898f8e4c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:00.620041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b77127-7ebc-49d6-bbab-0b81c0cd1d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:00.621037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b77127-7ebc-49d6-bbab-0b81c0cd1d90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:00.621326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b77127-7ebc-49d6-bbab-0b81c0cd1d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:00.621609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b77127-7ebc-49d6-bbab-0b81c0cd1d90 admin admin] PATH_INFO: `/v3/projects/3a8d9fe73e8b401089c0f654d99a0d8d/users/4b678578a20742d0ae49ea5b85756567/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:00.656269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b77127-7ebc-49d6-bbab-0b81c0cd1d90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a8d9fe73e8b401089c0f654d99a0d8d, user_id=4b678578a20742d0ae49ea5b85756567, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:00.659123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b77127-7ebc-49d6-bbab-0b81c0cd1d90 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:00.763702 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2719/5381] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:37:00 2022] PUT /identity/v3/projects/3a8d9fe73e8b401089c0f654d99a0d8d/users/4b678578a20742d0ae49ea5b85756567/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:00.767579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcc7da-4ec6-4d93-af43-6499d744fca3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:00.784213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dcc7da-4ec6-4d93-af43-6499d744fca3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:00.894491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ef249-9dd2-4b87-a28b-7235bfb68afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:00.894969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ef249-9dd2-4b87-a28b-7235bfb68afe admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:00.895267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ef249-9dd2-4b87-a28b-7235bfb68afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:00.895585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ef249-9dd2-4b87-a28b-7235bfb68afe admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:00.896656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ef249-9dd2-4b87-a28b-7235bfb68afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:00.900714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ef249-9dd2-4b87-a28b-7235bfb68afe admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:00.925366 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2663/5382] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:37:00.926811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b77127-7ebc-49d6-bbab-0b81c0cd1d90 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:00.946614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b77127-7ebc-49d6-bbab-0b81c0cd1d90 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:00.957160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184abff-f993-4ed1-a878-d2facb6d7fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:00.958679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184abff-f993-4ed1-a878-d2facb6d7fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:00.962536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184abff-f993-4ed1-a878-d2facb6d7fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:00.962833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e184abff-f993-4ed1-a878-d2facb6d7fcb admin admin] PATH_INFO: `/v3/projects/3a8d9fe73e8b401089c0f654d99a0d8d/users/4b678578a20742d0ae49ea5b85756567/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:00.966963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184abff-f993-4ed1-a878-d2facb6d7fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a8d9fe73e8b401089c0f654d99a0d8d, user_id=4b678578a20742d0ae49ea5b85756567, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:00.975404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e184abff-f993-4ed1-a878-d2facb6d7fcb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:00.996942 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2720/5383] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:37:00 2022] PUT /identity/v3/projects/3a8d9fe73e8b401089c0f654d99a0d8d/users/4b678578a20742d0ae49ea5b85756567/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:37:01.010616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2bccd-231b-4a61-b64a-412a88c85061 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:01.011391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2bccd-231b-4a61-b64a-412a88c85061 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:01.012219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2bccd-231b-4a61-b64a-412a88c85061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:01.070303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-cad2bccd-231b-4a61-b64a-412a88c85061 None None] MFA Rules not processed for user `4b678578a20742d0ae49ea5b85756567`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:01.071965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cad2bccd-231b-4a61-b64a-412a88c85061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:01.123373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184abff-f993-4ed1-a878-d2facb6d7fcb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:01.126512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e184abff-f993-4ed1-a878-d2facb6d7fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:01.208593 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:01.212542 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2664/5384] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:01.220385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2bccd-231b-4a61-b64a-412a88c85061 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:01.222582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cad2bccd-231b-4a61-b64a-412a88c85061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:01.246377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e184abff-f993-4ed1-a878-d2facb6d7fcb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:01.257556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e13d72-6e29-4d6e-aa49-e1034686d9c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:01.284856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e13d72-6e29-4d6e-aa49-e1034686d9c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:01.285211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e13d72-6e29-4d6e-aa49-e1034686d9c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:01.286526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e13d72-6e29-4d6e-aa49-e1034686d9c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:01.291049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-13e13d72-6e29-4d6e-aa49-e1034686d9c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:01.322818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e13d72-6e29-4d6e-aa49-e1034686d9c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:01.326442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e13d72-6e29-4d6e-aa49-e1034686d9c5 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:01.345854 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2721/5385] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:37:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:37:01.421499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2bccd-231b-4a61-b64a-412a88c85061 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:01.427617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5df9d6-cb75-4b47-8d0e-6435fc13e9c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:01.428526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5df9d6-cb75-4b47-8d0e-6435fc13e9c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:01.428910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5df9d6-cb75-4b47-8d0e-6435fc13e9c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:01.429317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5df9d6-cb75-4b47-8d0e-6435fc13e9c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:01.443271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5df9d6-cb75-4b47-8d0e-6435fc13e9c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:01.445622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5df9d6-cb75-4b47-8d0e-6435fc13e9c9 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:01.461603 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2665/5386] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:37:01 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:37:05.178792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e13d72-6e29-4d6e-aa49-e1034686d9c5 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:05.298055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e13d72-6e29-4d6e-aa49-e1034686d9c5 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:05.307102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab1201-2747-4043-80e1-300300e6b489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:05.308325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab1201-2747-4043-80e1-300300e6b489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:05.308708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab1201-2747-4043-80e1-300300e6b489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:05.309650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bab1201-2747-4043-80e1-300300e6b489 admin admin] PATH_INFO: `/v3/users/6da7d8ce6e304cd89e31d9a62d076fb7` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:05.311156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab1201-2747-4043-80e1-300300e6b489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da7d8ce6e304cd89e31d9a62d076fb7)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:05.313452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bab1201-2747-4043-80e1-300300e6b489 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:05.443609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5df9d6-cb75-4b47-8d0e-6435fc13e9c9 service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:05.459444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5df9d6-cb75-4b47-8d0e-6435fc13e9c9 service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:05.473314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d81dd-b66b-4426-8da2-ad6776e0d292 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:05.474439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d81dd-b66b-4426-8da2-ad6776e0d292 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:05.478534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d81dd-b66b-4426-8da2-ad6776e0d292 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:05.478534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d81dd-b66b-4426-8da2-ad6776e0d292 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:05.478534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-852d81dd-b66b-4426-8da2-ad6776e0d292 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:05.497469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d81dd-b66b-4426-8da2-ad6776e0d292 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:05.521194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d81dd-b66b-4426-8da2-ad6776e0d292 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:05.548250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2bab1201-2747-4043-80e1-300300e6b489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da7d8ce6e304cd89e31d9a62d076fb7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:05.559151 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2666/5387] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:37:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:37:05.600516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2bab1201-2747-4043-80e1-300300e6b489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da7d8ce6e304cd89e31d9a62d076fb7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:05.623838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2bab1201-2747-4043-80e1-300300e6b489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da7d8ce6e304cd89e31d9a62d076fb7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:05.623838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2bab1201-2747-4043-80e1-300300e6b489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da7d8ce6e304cd89e31d9a62d076fb7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:05.709314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2bab1201-2747-4043-80e1-300300e6b489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da7d8ce6e304cd89e31d9a62d076fb7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:05.719481 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2722/5388] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:37:05 2022] DELETE /identity/v3/users/6da7d8ce6e304cd89e31d9a62d076fb7 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:05.724172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcef62c-4dbd-49a3-b3cd-6c5911ba4efe None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:05.724505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcef62c-4dbd-49a3-b3cd-6c5911ba4efe None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:05.724773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcef62c-4dbd-49a3-b3cd-6c5911ba4efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:05.758203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2fcef62c-4dbd-49a3-b3cd-6c5911ba4efe None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:05.759479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2fcef62c-4dbd-49a3-b3cd-6c5911ba4efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:05.770787 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:05.847101 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2667/5389] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:05.881802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab1201-2747-4043-80e1-300300e6b489 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:05.885644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2bab1201-2747-4043-80e1-300300e6b489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:06.026719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bab1201-2747-4043-80e1-300300e6b489 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:06.030666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfd1ea-9aa3-4305-8698-d88213daf3cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:06.031954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfd1ea-9aa3-4305-8698-d88213daf3cb service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:06.032608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfd1ea-9aa3-4305-8698-d88213daf3cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:06.033114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bfd1ea-9aa3-4305-8698-d88213daf3cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:06.046829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfd1ea-9aa3-4305-8698-d88213daf3cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:06.054995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bfd1ea-9aa3-4305-8698-d88213daf3cb service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:06.065655 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2723/5390] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:37:07.345579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcef62c-4dbd-49a3-b3cd-6c5911ba4efe None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:07.347299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2fcef62c-4dbd-49a3-b3cd-6c5911ba4efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:07.361111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcef62c-4dbd-49a3-b3cd-6c5911ba4efe None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:07.367315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0ec92-c1a6-412d-9960-a93f4e3d9372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:07.368731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0ec92-c1a6-412d-9960-a93f4e3d9372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:07.369180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0ec92-c1a6-412d-9960-a93f4e3d9372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:07.369762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0ec92-c1a6-412d-9960-a93f4e3d9372 admin admin] PATH_INFO: `/v3/projects/86085e1b1825490c861f57cf835f598f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:07.371473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0ec92-c1a6-412d-9960-a93f4e3d9372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86085e1b1825490c861f57cf835f598f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:07.374138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb0ec92-c1a6-412d-9960-a93f4e3d9372 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:07.574162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dcb0ec92-c1a6-412d-9960-a93f4e3d9372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86085e1b1825490c861f57cf835f598f', 'request_id': 'req-dcb0ec92-c1a6-412d-9960-a93f4e3d9372'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:07.676612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dcb0ec92-c1a6-412d-9960-a93f4e3d9372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86085e1b1825490c861f57cf835f598f', 'request_id': 'req-dcb0ec92-c1a6-412d-9960-a93f4e3d9372'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:07.693892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dcb0ec92-c1a6-412d-9960-a93f4e3d9372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86085e1b1825490c861f57cf835f598f', 'request_id': 'req-dcb0ec92-c1a6-412d-9960-a93f4e3d9372'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:07.715417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dcb0ec92-c1a6-412d-9960-a93f4e3d9372 admin admin] The token cache is being invalidate because project 86085e1b1825490c861f57cf835f598f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:37:07.716514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dcb0ec92-c1a6-412d-9960-a93f4e3d9372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:07.717476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dcb0ec92-c1a6-412d-9960-a93f4e3d9372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:07.727969 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2668/5391] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:37:07 2022] DELETE /identity/v3/projects/86085e1b1825490c861f57cf835f598f => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:07.728407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfd1ea-9aa3-4305-8698-d88213daf3cb service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:07.739813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bfd1ea-9aa3-4305-8698-d88213daf3cb service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:07.756738 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:07.847395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f541998-1f8d-4cab-864a-154f579c0292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:07.849177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f541998-1f8d-4cab-864a-154f579c0292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:07.850807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f541998-1f8d-4cab-864a-154f579c0292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:07.851709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f541998-1f8d-4cab-864a-154f579c0292 admin admin] PATH_INFO: `/v3/users/4b678578a20742d0ae49ea5b85756567` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:07.855705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f541998-1f8d-4cab-864a-154f579c0292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b678578a20742d0ae49ea5b85756567)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:07.856988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f541998-1f8d-4cab-864a-154f579c0292 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:08.105233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7f541998-1f8d-4cab-864a-154f579c0292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b678578a20742d0ae49ea5b85756567'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:08.136023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7f541998-1f8d-4cab-864a-154f579c0292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b678578a20742d0ae49ea5b85756567'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:08.154805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7f541998-1f8d-4cab-864a-154f579c0292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b678578a20742d0ae49ea5b85756567'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:08.156653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7f541998-1f8d-4cab-864a-154f579c0292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b678578a20742d0ae49ea5b85756567'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:08.232022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7f541998-1f8d-4cab-864a-154f579c0292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b678578a20742d0ae49ea5b85756567'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:08.243033 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2724/5392] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:37:07 2022] DELETE /identity/v3/users/4b678578a20742d0ae49ea5b85756567 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:09.011763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ea669-ee14-4454-9f20-9ba9f4fa345b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:09.012364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ea669-ee14-4454-9f20-9ba9f4fa345b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:09.012364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ea669-ee14-4454-9f20-9ba9f4fa345b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:09.038238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-642ea669-ee14-4454-9f20-9ba9f4fa345b None None] MFA Rules not processed for user `4dd7c55c8952488685691a07de3207a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:09.041898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-642ea669-ee14-4454-9f20-9ba9f4fa345b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:09.197814 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2669/5393] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:10.222902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f541998-1f8d-4cab-864a-154f579c0292 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:10.224534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7f541998-1f8d-4cab-864a-154f579c0292 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:10.265792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ea669-ee14-4454-9f20-9ba9f4fa345b None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:10.267451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-642ea669-ee14-4454-9f20-9ba9f4fa345b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:10.398402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f541998-1f8d-4cab-864a-154f579c0292 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:10.428652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b03e3-75a0-4ffd-b6a1-ccf1c8359159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:10.429673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b03e3-75a0-4ffd-b6a1-ccf1c8359159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:10.429970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b03e3-75a0-4ffd-b6a1-ccf1c8359159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:10.430314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b03e3-75a0-4ffd-b6a1-ccf1c8359159 admin admin] PATH_INFO: `/v3/users/505a5026c10a49a893e04d45a011167d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:10.432769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b03e3-75a0-4ffd-b6a1-ccf1c8359159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=505a5026c10a49a893e04d45a011167d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:10.434804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b03e3-75a0-4ffd-b6a1-ccf1c8359159 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:10.452339 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:10.591356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ea669-ee14-4454-9f20-9ba9f4fa345b None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:10.608363 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:10.616655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fc292-ad5c-4040-b453-e0ad6ba5b7b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:10.617716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fc292-ad5c-4040-b453-e0ad6ba5b7b4 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:10.618159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fc292-ad5c-4040-b453-e0ad6ba5b7b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:10.618544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fc292-ad5c-4040-b453-e0ad6ba5b7b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:10.620735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-621fc292-ad5c-4040-b453-e0ad6ba5b7b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:10.651498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fc292-ad5c-4040-b453-e0ad6ba5b7b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:10.654404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621fc292-ad5c-4040-b453-e0ad6ba5b7b4 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:10.687581 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2670/5394] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:37:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:37:10.787871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e59b03e3-75a0-4ffd-b6a1-ccf1c8359159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '505a5026c10a49a893e04d45a011167d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:10.839551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e59b03e3-75a0-4ffd-b6a1-ccf1c8359159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '505a5026c10a49a893e04d45a011167d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:10.848905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e59b03e3-75a0-4ffd-b6a1-ccf1c8359159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '505a5026c10a49a893e04d45a011167d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:10.850446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e59b03e3-75a0-4ffd-b6a1-ccf1c8359159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '505a5026c10a49a893e04d45a011167d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:10.925603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e59b03e3-75a0-4ffd-b6a1-ccf1c8359159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '505a5026c10a49a893e04d45a011167d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:10.942967 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2725/5395] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:37:10 2022] DELETE /identity/v3/users/505a5026c10a49a893e04d45a011167d => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:11.034606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fc292-ad5c-4040-b453-e0ad6ba5b7b4 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:11.037997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-621fc292-ad5c-4040-b453-e0ad6ba5b7b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:11.067790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fc292-ad5c-4040-b453-e0ad6ba5b7b4 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:11.165866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c8127-2b0a-4bcc-89b4-3b9b2fe5991d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:11.167017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c8127-2b0a-4bcc-89b4-3b9b2fe5991d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:11.167486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c8127-2b0a-4bcc-89b4-3b9b2fe5991d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:11.167943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90c8127-2b0a-4bcc-89b4-3b9b2fe5991d admin admin] PATH_INFO: `/v3/projects/3a8d9fe73e8b401089c0f654d99a0d8d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:11.169368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c8127-2b0a-4bcc-89b4-3b9b2fe5991d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a8d9fe73e8b401089c0f654d99a0d8d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:11.171783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90c8127-2b0a-4bcc-89b4-3b9b2fe5991d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:11.354549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c90c8127-2b0a-4bcc-89b4-3b9b2fe5991d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a8d9fe73e8b401089c0f654d99a0d8d', 'request_id': 'req-c90c8127-2b0a-4bcc-89b4-3b9b2fe5991d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:11.553041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c90c8127-2b0a-4bcc-89b4-3b9b2fe5991d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a8d9fe73e8b401089c0f654d99a0d8d', 'request_id': 'req-c90c8127-2b0a-4bcc-89b4-3b9b2fe5991d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:11.590267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c90c8127-2b0a-4bcc-89b4-3b9b2fe5991d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a8d9fe73e8b401089c0f654d99a0d8d', 'request_id': 'req-c90c8127-2b0a-4bcc-89b4-3b9b2fe5991d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:11.605694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c90c8127-2b0a-4bcc-89b4-3b9b2fe5991d admin admin] The token cache is being invalidate because project 3a8d9fe73e8b401089c0f654d99a0d8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:37:11.606058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c90c8127-2b0a-4bcc-89b4-3b9b2fe5991d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:11.606884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c90c8127-2b0a-4bcc-89b4-3b9b2fe5991d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:11.610175 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2671/5396] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:37:11 2022] DELETE /identity/v3/projects/3a8d9fe73e8b401089c0f654d99a0d8d => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:11.616343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c849860-9e1d-49c9-a0a9-860b829a7949 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:11.617308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c849860-9e1d-49c9-a0a9-860b829a7949 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:11.618206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c849860-9e1d-49c9-a0a9-860b829a7949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:11.648333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c8127-2b0a-4bcc-89b4-3b9b2fe5991d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:11.650043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c90c8127-2b0a-4bcc-89b4-3b9b2fe5991d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:11.662598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5c849860-9e1d-49c9-a0a9-860b829a7949 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:11.666127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5c849860-9e1d-49c9-a0a9-860b829a7949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:11.773993 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:11.818334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90c8127-2b0a-4bcc-89b4-3b9b2fe5991d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:11.830343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c226139-bd1a-470f-834c-6c711b8b64b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:11.831242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c226139-bd1a-470f-834c-6c711b8b64b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:11.831529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c226139-bd1a-470f-834c-6c711b8b64b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:11.831855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c226139-bd1a-470f-834c-6c711b8b64b7 admin admin] PATH_INFO: `/v3/projects/473c994c21b742abae0e11b0ab033921` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:11.838843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c226139-bd1a-470f-834c-6c711b8b64b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=473c994c21b742abae0e11b0ab033921)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:11.840805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c226139-bd1a-470f-834c-6c711b8b64b7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:11.878004 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2726/5397] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:11.880814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2705bb8-be33-4706-a0e7-e1bd0e279f8d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:11.881791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2705bb8-be33-4706-a0e7-e1bd0e279f8d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:11.882217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2705bb8-be33-4706-a0e7-e1bd0e279f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:11.923798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e2705bb8-be33-4706-a0e7-e1bd0e279f8d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:11.925056 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e2705bb8-be33-4706-a0e7-e1bd0e279f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:11.940975 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2727/5398] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:11.946935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2705bb8-be33-4706-a0e7-e1bd0e279f8d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:11.949107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e2705bb8-be33-4706-a0e7-e1bd0e279f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:12.051107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1c226139-bd1a-470f-834c-6c711b8b64b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '473c994c21b742abae0e11b0ab033921', 'request_id': 'req-1c226139-bd1a-470f-834c-6c711b8b64b7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:12.092267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2705bb8-be33-4706-a0e7-e1bd0e279f8d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:12.127064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1c226139-bd1a-470f-834c-6c711b8b64b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '473c994c21b742abae0e11b0ab033921', 'request_id': 'req-1c226139-bd1a-470f-834c-6c711b8b64b7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:12.136782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1c226139-bd1a-470f-834c-6c711b8b64b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '473c994c21b742abae0e11b0ab033921', 'request_id': 'req-1c226139-bd1a-470f-834c-6c711b8b64b7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:12.138479 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:12.151233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1c226139-bd1a-470f-834c-6c711b8b64b7 admin admin] The token cache is being invalidate because project 473c994c21b742abae0e11b0ab033921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:37:12.154531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1c226139-bd1a-470f-834c-6c711b8b64b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:12.157074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1c226139-bd1a-470f-834c-6c711b8b64b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:12.168332 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2672/5399] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:37:11 2022] DELETE /identity/v3/projects/473c994c21b742abae0e11b0ab033921 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:37:12.168332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c226139-bd1a-470f-834c-6c711b8b64b7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:12.168332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1c226139-bd1a-470f-834c-6c711b8b64b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:12.202888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205b01e-b514-4502-b8a6-c21f105ab1dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:12.211367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205b01e-b514-4502-b8a6-c21f105ab1dd service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:12.211367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205b01e-b514-4502-b8a6-c21f105ab1dd service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:12.211367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8205b01e-b514-4502-b8a6-c21f105ab1dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:12.216180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8205b01e-b514-4502-b8a6-c21f105ab1dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:12.235811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205b01e-b514-4502-b8a6-c21f105ab1dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:12.239205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8205b01e-b514-4502-b8a6-c21f105ab1dd service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:12.259969 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2728/5400] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:37:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:37:12.275524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c226139-bd1a-470f-834c-6c711b8b64b7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:12.277296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205b01e-b514-4502-b8a6-c21f105ab1dd service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:12.281815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a886ec-5c5d-431f-ab39-44e883af188a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:12.282681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a886ec-5c5d-431f-ab39-44e883af188a admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:12.283040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a886ec-5c5d-431f-ab39-44e883af188a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:12.283403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a886ec-5c5d-431f-ab39-44e883af188a admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:12.284280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a886ec-5c5d-431f-ab39-44e883af188a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:37:12.284681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a886ec-5c5d-431f-ab39-44e883af188a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:12.284972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8205b01e-b514-4502-b8a6-c21f105ab1dd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:12.286869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a886ec-5c5d-431f-ab39-44e883af188a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:12.311567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8205b01e-b514-4502-b8a6-c21f105ab1dd service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:12.317217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042ae13-bb5f-4063-8d36-578a3b6666f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:12.318225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042ae13-bb5f-4063-8d36-578a3b6666f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:12.318347 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2673/5401] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:37:12.318468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042ae13-bb5f-4063-8d36-578a3b6666f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:12.318840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042ae13-bb5f-4063-8d36-578a3b6666f8 admin admin] PATH_INFO: `/v3/users/31b1550fecb642b4823088a513938e65` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:12.320075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042ae13-bb5f-4063-8d36-578a3b6666f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31b1550fecb642b4823088a513938e65)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:12.322249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2042ae13-bb5f-4063-8d36-578a3b6666f8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:12.322839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a886ec-5c5d-431f-ab39-44e883af188a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:12.337769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a886ec-5c5d-431f-ab39-44e883af188a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:12.345265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30893754-19c5-4a39-b291-114c5ec8a414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:12.346359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30893754-19c5-4a39-b291-114c5ec8a414 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:12.349072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30893754-19c5-4a39-b291-114c5ec8a414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:12.349072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30893754-19c5-4a39-b291-114c5ec8a414 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:12.349072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30893754-19c5-4a39-b291-114c5ec8a414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:12.352024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30893754-19c5-4a39-b291-114c5ec8a414 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:12.449301 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2674/5402] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:37:12 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:37:12.454028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30893754-19c5-4a39-b291-114c5ec8a414 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:12.538960 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:12.565752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2042ae13-bb5f-4063-8d36-578a3b6666f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31b1550fecb642b4823088a513938e65'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:12.584486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30893754-19c5-4a39-b291-114c5ec8a414 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:12.596435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2042ae13-bb5f-4063-8d36-578a3b6666f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31b1550fecb642b4823088a513938e65'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:12.601603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16385afe-f984-4e8a-9302-7d57a02b6a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:12.602321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16385afe-f984-4e8a-9302-7d57a02b6a8a admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:12.603822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16385afe-f984-4e8a-9302-7d57a02b6a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:12.604459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16385afe-f984-4e8a-9302-7d57a02b6a8a admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:12.606588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16385afe-f984-4e8a-9302-7d57a02b6a8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:12.609711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16385afe-f984-4e8a-9302-7d57a02b6a8a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:12.614581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2042ae13-bb5f-4063-8d36-578a3b6666f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31b1550fecb642b4823088a513938e65'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:12.617504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2042ae13-bb5f-4063-8d36-578a3b6666f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31b1550fecb642b4823088a513938e65'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:12.709183 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2042ae13-bb5f-4063-8d36-578a3b6666f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31b1550fecb642b4823088a513938e65'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:12.719185 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2729/5403] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:37:12 2022] DELETE /identity/v3/users/31b1550fecb642b4823088a513938e65 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:12.744701 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2675/5404] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:37:12 2022] POST /identity/v3/users => generated 294 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:37:12.748530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042ae13-bb5f-4063-8d36-578a3b6666f8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:12.750276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2042ae13-bb5f-4063-8d36-578a3b6666f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:12.911991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042ae13-bb5f-4063-8d36-578a3b6666f8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:12.923896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fad5f2-8881-4c5a-a0c4-eab52397eca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:12.924487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fad5f2-8881-4c5a-a0c4-eab52397eca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:12.924773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fad5f2-8881-4c5a-a0c4-eab52397eca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:12.925051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fad5f2-8881-4c5a-a0c4-eab52397eca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:12.925796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fad5f2-8881-4c5a-a0c4-eab52397eca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:12.928289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fad5f2-8881-4c5a-a0c4-eab52397eca9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:12.947889 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2730/5405] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:37:12.951754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16385afe-f984-4e8a-9302-7d57a02b6a8a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:12.968036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16385afe-f984-4e8a-9302-7d57a02b6a8a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:12.974896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48ef12-cafe-4775-96e7-bd5fcc281421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:12.975758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48ef12-cafe-4775-96e7-bd5fcc281421 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:12.976470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48ef12-cafe-4775-96e7-bd5fcc281421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:12.976470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48ef12-cafe-4775-96e7-bd5fcc281421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:12.977132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48ef12-cafe-4775-96e7-bd5fcc281421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:12.978819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48ef12-cafe-4775-96e7-bd5fcc281421 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:12.991332 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2676/5406] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:37:12.995292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fad5f2-8881-4c5a-a0c4-eab52397eca9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:13.022423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fad5f2-8881-4c5a-a0c4-eab52397eca9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:13.037423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3ab6a-4e58-4c80-8a81-8c4f887fd787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:13.039687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3ab6a-4e58-4c80-8a81-8c4f887fd787 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:13.040321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3ab6a-4e58-4c80-8a81-8c4f887fd787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:13.041269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3ab6a-4e58-4c80-8a81-8c4f887fd787 admin admin] PATH_INFO: `/v3/projects/1bf95a444f2c466c998644e274f76c40/users/2813cbf12c0045cfbf9c928751c42499/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:13.094653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3ab6a-4e58-4c80-8a81-8c4f887fd787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf95a444f2c466c998644e274f76c40, user_id=2813cbf12c0045cfbf9c928751c42499, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:13.094653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3ab6a-4e58-4c80-8a81-8c4f887fd787 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:13.174866 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2731/5407] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:37:12 2022] PUT /identity/v3/projects/1bf95a444f2c466c998644e274f76c40/users/2813cbf12c0045cfbf9c928751c42499/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:13.193169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3bb2d-4ea5-4ee7-b209-1fd557e25674 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:13.193471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3bb2d-4ea5-4ee7-b209-1fd557e25674 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:13.193763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3bb2d-4ea5-4ee7-b209-1fd557e25674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:13.252755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-98e3bb2d-4ea5-4ee7-b209-1fd557e25674 None None] MFA Rules not processed for user `2813cbf12c0045cfbf9c928751c42499`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:13.254586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-98e3bb2d-4ea5-4ee7-b209-1fd557e25674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:13.339581 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2677/5408] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:13.349607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3ab6a-4e58-4c80-8a81-8c4f887fd787 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:13.361947 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:13.460005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3ab6a-4e58-4c80-8a81-8c4f887fd787 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:13.462047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd03a5-d1f7-4930-9991-f070a2c84f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:13.463381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd03a5-d1f7-4930-9991-f070a2c84f99 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:13.463808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd03a5-d1f7-4930-9991-f070a2c84f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:13.464394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd03a5-d1f7-4930-9991-f070a2c84f99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:13.465668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd03a5-d1f7-4930-9991-f070a2c84f99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:13.467805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdd03a5-d1f7-4930-9991-f070a2c84f99 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:13.575428 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2732/5409] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:37:13 2022] POST /identity/v3/projects => generated 385 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:37:13.579765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3bb2d-4ea5-4ee7-b209-1fd557e25674 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:13.604615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3bb2d-4ea5-4ee7-b209-1fd557e25674 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:13.614554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd03a5-d1f7-4930-9991-f070a2c84f99 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:13.616687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ecdd03a5-d1f7-4930-9991-f070a2c84f99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:13.703741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eee870-9fbf-4822-8234-186bb5192c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:13.704977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eee870-9fbf-4822-8234-186bb5192c4f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:13.705505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eee870-9fbf-4822-8234-186bb5192c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:13.706038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eee870-9fbf-4822-8234-186bb5192c4f admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:13.707890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eee870-9fbf-4822-8234-186bb5192c4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:13.711160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eee870-9fbf-4822-8234-186bb5192c4f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:13.801797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd03a5-d1f7-4930-9991-f070a2c84f99 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:13.814907 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2678/5410] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:37:13 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:37:13.816068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eee870-9fbf-4822-8234-186bb5192c4f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:13.823673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba23f2-9303-4f1a-b79b-904ee5070042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:13.827321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba23f2-9303-4f1a-b79b-904ee5070042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:13.827791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba23f2-9303-4f1a-b79b-904ee5070042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:13.827999 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba23f2-9303-4f1a-b79b-904ee5070042 admin admin] PATH_INFO: `/v3/projects/e813e300219e4d54b8ef3b4d1e932df5` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:13.831213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba23f2-9303-4f1a-b79b-904ee5070042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e813e300219e4d54b8ef3b4d1e932df5)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:13.844222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba23f2-9303-4f1a-b79b-904ee5070042 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:13.850886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eee870-9fbf-4822-8234-186bb5192c4f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:13.864940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7f063-3b4f-4383-9dd8-370e4e2123e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:13.867015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7f063-3b4f-4383-9dd8-370e4e2123e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:13.869125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7f063-3b4f-4383-9dd8-370e4e2123e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:13.869501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a7f063-3b4f-4383-9dd8-370e4e2123e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:13.870654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7f063-3b4f-4383-9dd8-370e4e2123e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:13.874157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a7f063-3b4f-4383-9dd8-370e4e2123e4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:13.900794 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2679/5411] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:37:13.914286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7f063-3b4f-4383-9dd8-370e4e2123e4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:13.933497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a7f063-3b4f-4383-9dd8-370e4e2123e4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:13.939366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54603b-7039-406f-9dd6-29cc95a5778f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:13.940062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54603b-7039-406f-9dd6-29cc95a5778f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:13.940360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54603b-7039-406f-9dd6-29cc95a5778f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:13.940648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54603b-7039-406f-9dd6-29cc95a5778f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:13.941397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54603b-7039-406f-9dd6-29cc95a5778f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:13.943536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54603b-7039-406f-9dd6-29cc95a5778f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:13.981355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4eba23f2-9303-4f1a-b79b-904ee5070042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e813e300219e4d54b8ef3b4d1e932df5', 'request_id': 'req-4eba23f2-9303-4f1a-b79b-904ee5070042'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:13.982049 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2680/5412] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:37:13.986141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54603b-7039-406f-9dd6-29cc95a5778f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:13.998238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4eba23f2-9303-4f1a-b79b-904ee5070042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e813e300219e4d54b8ef3b4d1e932df5', 'request_id': 'req-4eba23f2-9303-4f1a-b79b-904ee5070042'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:14.006067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54603b-7039-406f-9dd6-29cc95a5778f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:14.010963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4eba23f2-9303-4f1a-b79b-904ee5070042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e813e300219e4d54b8ef3b4d1e932df5', 'request_id': 'req-4eba23f2-9303-4f1a-b79b-904ee5070042'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:14.050158 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:14.133569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4eba23f2-9303-4f1a-b79b-904ee5070042 admin admin] The token cache is being invalidate because project e813e300219e4d54b8ef3b4d1e932df5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:37:14.135006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4eba23f2-9303-4f1a-b79b-904ee5070042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:14.135006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4eba23f2-9303-4f1a-b79b-904ee5070042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:14.137320 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2733/5413] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:37:13 2022] DELETE /identity/v3/projects/e813e300219e4d54b8ef3b4d1e932df5 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:14.142726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492581f-5ab6-4425-b5f1-2700efc951a9 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:14.143144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492581f-5ab6-4425-b5f1-2700efc951a9 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:14.143610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1492581f-5ab6-4425-b5f1-2700efc951a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:14.174322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a1074-f2ef-4621-b8d7-4911647dbc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:14.176409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a1074-f2ef-4621-b8d7-4911647dbc62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:14.176409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a1074-f2ef-4621-b8d7-4911647dbc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:14.176650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a1074-f2ef-4621-b8d7-4911647dbc62 admin admin] PATH_INFO: `/v3/projects/e4093c7f2bb24fd490230d6f44196925/users/9799d892a2bc4a3bbb23363beeaebe68/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:14.186493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1492581f-5ab6-4425-b5f1-2700efc951a9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:14.189288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1492581f-5ab6-4425-b5f1-2700efc951a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:14.209249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a1074-f2ef-4621-b8d7-4911647dbc62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4093c7f2bb24fd490230d6f44196925, user_id=9799d892a2bc4a3bbb23363beeaebe68, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:14.211837 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2734/5414] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:14.213168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a1074-f2ef-4621-b8d7-4911647dbc62 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:14.221102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242fc3c-be2c-4dc3-8b35-52bcfbf80384 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:14.221770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242fc3c-be2c-4dc3-8b35-52bcfbf80384 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:14.222601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e242fc3c-be2c-4dc3-8b35-52bcfbf80384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:14.251400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e242fc3c-be2c-4dc3-8b35-52bcfbf80384 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:14.252760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e242fc3c-be2c-4dc3-8b35-52bcfbf80384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:14.285977 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2735/5415] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:37:14.288064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242fc3c-be2c-4dc3-8b35-52bcfbf80384 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:14.305373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e242fc3c-be2c-4dc3-8b35-52bcfbf80384 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:14.310832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1199c-b45b-4e2d-ada9-b092d08417a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:14.311519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1199c-b45b-4e2d-ada9-b092d08417a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:14.312002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1199c-b45b-4e2d-ada9-b092d08417a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:14.313549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1199c-b45b-4e2d-ada9-b092d08417a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:14.314042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1199c-b45b-4e2d-ada9-b092d08417a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:37:14.314464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1199c-b45b-4e2d-ada9-b092d08417a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:14.317661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1199c-b45b-4e2d-ada9-b092d08417a6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:14.321248 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:14.341178 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2681/5416] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:37:13 2022] PUT /identity/v3/projects/e4093c7f2bb24fd490230d6f44196925/users/9799d892a2bc4a3bbb23363beeaebe68/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:14.342995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2947496-8c8e-472a-8d2a-5bbaa1a6bc0c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:14.343293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2947496-8c8e-472a-8d2a-5bbaa1a6bc0c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:14.343581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2947496-8c8e-472a-8d2a-5bbaa1a6bc0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:14.370348 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2736/5417] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:37:14.375782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1199c-b45b-4e2d-ada9-b092d08417a6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:14.388762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1199c-b45b-4e2d-ada9-b092d08417a6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:14.396580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e2947496-8c8e-472a-8d2a-5bbaa1a6bc0c None None] MFA Rules not processed for user `9799d892a2bc4a3bbb23363beeaebe68`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:14.397901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e2947496-8c8e-472a-8d2a-5bbaa1a6bc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:14.494690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d23f1d-8919-4a21-81bf-33c4848316f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:14.495438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d23f1d-8919-4a21-81bf-33c4848316f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:14.500776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d23f1d-8919-4a21-81bf-33c4848316f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:14.500776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d23f1d-8919-4a21-81bf-33c4848316f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:14.500776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d23f1d-8919-4a21-81bf-33c4848316f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:14.500776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d23f1d-8919-4a21-81bf-33c4848316f5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:14.562418 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2682/5418] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:14.565562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2947496-8c8e-472a-8d2a-5bbaa1a6bc0c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:14.567799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e2947496-8c8e-472a-8d2a-5bbaa1a6bc0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:14.587990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2947496-8c8e-472a-8d2a-5bbaa1a6bc0c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:14.595806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1b061-6f4d-4482-8bf1-13367f5274ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:14.596776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1b061-6f4d-4482-8bf1-13367f5274ff admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:14.597263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1b061-6f4d-4482-8bf1-13367f5274ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:14.597710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1b061-6f4d-4482-8bf1-13367f5274ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:14.598700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1b061-6f4d-4482-8bf1-13367f5274ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:14.606231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1b061-6f4d-4482-8bf1-13367f5274ff admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:14.636707 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2737/5419] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:37:14 2022] POST /identity/v3/projects => generated 399 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:37:14.637722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d23f1d-8919-4a21-81bf-33c4848316f5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:14.712537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d23f1d-8919-4a21-81bf-33c4848316f5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:14.717987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fb207-d925-47b0-a50f-ba780683b077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:14.718747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fb207-d925-47b0-a50f-ba780683b077 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:14.719034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fb207-d925-47b0-a50f-ba780683b077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:14.719312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fb207-d925-47b0-a50f-ba780683b077 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:14.720030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fb207-d925-47b0-a50f-ba780683b077 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:14.722760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fb207-d925-47b0-a50f-ba780683b077 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:14.767430 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2683/5420] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:37:14 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:37:14.768595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1b061-6f4d-4482-8bf1-13367f5274ff admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:14.876259 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2738/5421] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:37:14 2022] POST /identity/v3/users => generated 300 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:37:14.881669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fb207-d925-47b0-a50f-ba780683b077 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:14.905210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fb207-d925-47b0-a50f-ba780683b077 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:14.919991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1b061-6f4d-4482-8bf1-13367f5274ff admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:14.922224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758329cf-a7bb-44ca-aa06-fca14acd2a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:14.923006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758329cf-a7bb-44ca-aa06-fca14acd2a4b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:14.924466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758329cf-a7bb-44ca-aa06-fca14acd2a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:14.924466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758329cf-a7bb-44ca-aa06-fca14acd2a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:14.926549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758329cf-a7bb-44ca-aa06-fca14acd2a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:14.929365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758329cf-a7bb-44ca-aa06-fca14acd2a4b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:14.934879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7f06b-e454-4e15-94dc-52f3273670de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:14.935793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7f06b-e454-4e15-94dc-52f3273670de admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:14.937885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7f06b-e454-4e15-94dc-52f3273670de admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:14.937885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef7f06b-e454-4e15-94dc-52f3273670de admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:14.938876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7f06b-e454-4e15-94dc-52f3273670de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:14.945599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef7f06b-e454-4e15-94dc-52f3273670de admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:14.960120 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2739/5422] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:37:14.963863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758329cf-a7bb-44ca-aa06-fca14acd2a4b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:14.992435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758329cf-a7bb-44ca-aa06-fca14acd2a4b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:14.997991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eaaff8-0b53-4083-b961-57e964761344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:14.998910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eaaff8-0b53-4083-b961-57e964761344 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:14.999263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eaaff8-0b53-4083-b961-57e964761344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:14.999626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eaaff8-0b53-4083-b961-57e964761344 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:15.002269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eaaff8-0b53-4083-b961-57e964761344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:15.004122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eaaff8-0b53-4083-b961-57e964761344 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:15.022830 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2740/5423] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:37:15.023995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eaaff8-0b53-4083-b961-57e964761344 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:15.036764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eaaff8-0b53-4083-b961-57e964761344 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:15.044561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecaaed7-39b9-4779-9ecf-b29417cd76df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:15.045545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecaaed7-39b9-4779-9ecf-b29417cd76df admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:15.045837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecaaed7-39b9-4779-9ecf-b29417cd76df admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:15.046315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecaaed7-39b9-4779-9ecf-b29417cd76df admin admin] PATH_INFO: `/v3/projects/ee10ec89efbc49eab5c3dddc3aa346ca/users/ef22032f2d47431889b5cd81d23f14ae/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:15.068994 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2684/5424] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:37:14 2022] POST /identity/v3/users => generated 299 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:37:15.070763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7f06b-e454-4e15-94dc-52f3273670de admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:15.086348 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:15.110323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef7f06b-e454-4e15-94dc-52f3273670de admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:15.114456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecaaed7-39b9-4779-9ecf-b29417cd76df admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee10ec89efbc49eab5c3dddc3aa346ca, user_id=ef22032f2d47431889b5cd81d23f14ae, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:15.120781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b5f0b-4df7-47b7-9aed-2a478094fd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:15.121128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecaaed7-39b9-4779-9ecf-b29417cd76df admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:15.123715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b5f0b-4df7-47b7-9aed-2a478094fd5a admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:15.125400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b5f0b-4df7-47b7-9aed-2a478094fd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:15.126014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b5f0b-4df7-47b7-9aed-2a478094fd5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:15.130349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b5f0b-4df7-47b7-9aed-2a478094fd5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:15.130349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b5f0b-4df7-47b7-9aed-2a478094fd5a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:15.149479 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2685/5425] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:37:15.150510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b5f0b-4df7-47b7-9aed-2a478094fd5a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:15.164651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b5f0b-4df7-47b7-9aed-2a478094fd5a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:15.170336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3d329-664e-4ca4-9a60-e1f99ff2d007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:15.171680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3d329-664e-4ca4-9a60-e1f99ff2d007 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:15.172023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3d329-664e-4ca4-9a60-e1f99ff2d007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:15.172312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d3d329-664e-4ca4-9a60-e1f99ff2d007 admin admin] PATH_INFO: `/v3/projects/ae3462002fec4b529240ea053ca8cb4c/users/dfa5c7de41d8441b99155406746436b4/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:15.216493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3d329-664e-4ca4-9a60-e1f99ff2d007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3462002fec4b529240ea053ca8cb4c, user_id=dfa5c7de41d8441b99155406746436b4, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:15.219463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d3d329-664e-4ca4-9a60-e1f99ff2d007 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:15.232498 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2741/5426] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:37:15 2022] PUT /identity/v3/projects/ee10ec89efbc49eab5c3dddc3aa346ca/users/ef22032f2d47431889b5cd81d23f14ae/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:15.233615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5e3ed-6e47-4437-a0d3-edb863e98443 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:15.247357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5e3ed-6e47-4437-a0d3-edb863e98443 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:15.248047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5e3ed-6e47-4437-a0d3-edb863e98443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:15.278020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-eca5e3ed-6e47-4437-a0d3-edb863e98443 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:15.279497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-eca5e3ed-6e47-4437-a0d3-edb863e98443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:15.344745 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2686/5427] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:37:15 2022] PUT /identity/v3/projects/ae3462002fec4b529240ea053ca8cb4c/users/dfa5c7de41d8441b99155406746436b4/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:15.349393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3d329-664e-4ca4-9a60-e1f99ff2d007 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:15.430943 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2742/5428] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:15.473372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5e3ed-6e47-4437-a0d3-edb863e98443 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:15.475877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-eca5e3ed-6e47-4437-a0d3-edb863e98443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:15.544233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d3d329-664e-4ca4-9a60-e1f99ff2d007 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:15.559721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cbf54-5b35-4447-977c-db3d29381437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:15.560432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cbf54-5b35-4447-977c-db3d29381437 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:15.560729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cbf54-5b35-4447-977c-db3d29381437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:15.561013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cbf54-5b35-4447-977c-db3d29381437 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:15.561770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5cbf54-5b35-4447-977c-db3d29381437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:15.563502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5cbf54-5b35-4447-977c-db3d29381437 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:15.586559 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2687/5429] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:37:15.589938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cbf54-5b35-4447-977c-db3d29381437 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:15.598024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca5e3ed-6e47-4437-a0d3-edb863e98443 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:15.611991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5cbf54-5b35-4447-977c-db3d29381437 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:15.626820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c415410-3878-4ddd-9091-fe9db90add89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:15.631913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c415410-3878-4ddd-9091-fe9db90add89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:15.631913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c415410-3878-4ddd-9091-fe9db90add89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:15.631913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c415410-3878-4ddd-9091-fe9db90add89 admin admin] PATH_INFO: `/v3/projects/ae3462002fec4b529240ea053ca8cb4c/users/dfa5c7de41d8441b99155406746436b4/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:15.639206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c415410-3878-4ddd-9091-fe9db90add89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae3462002fec4b529240ea053ca8cb4c, user_id=dfa5c7de41d8441b99155406746436b4, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:15.649231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c415410-3878-4ddd-9091-fe9db90add89 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:15.685657 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2688/5430] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:37:15 2022] PUT /identity/v3/projects/ae3462002fec4b529240ea053ca8cb4c/users/dfa5c7de41d8441b99155406746436b4/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:15.697237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45809dbf-31c2-487c-af10-b23fbfd42ee1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:15.697534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45809dbf-31c2-487c-af10-b23fbfd42ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:15.697825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45809dbf-31c2-487c-af10-b23fbfd42ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:15.746941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6af86-e8c2-4251-b2e3-e68e936c3267 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:15.747774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6af86-e8c2-4251-b2e3-e68e936c3267 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:15.748194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6af86-e8c2-4251-b2e3-e68e936c3267 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:15.748573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6af86-e8c2-4251-b2e3-e68e936c3267 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:15.760616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-45809dbf-31c2-487c-af10-b23fbfd42ee1 None None] MFA Rules not processed for user `dfa5c7de41d8441b99155406746436b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:15.761884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-45809dbf-31c2-487c-af10-b23fbfd42ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:15.763981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6af86-e8c2-4251-b2e3-e68e936c3267 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:15.767387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6af86-e8c2-4251-b2e3-e68e936c3267 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:15.786795 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2743/5431] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:37:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:37:15.858158 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2689/5432] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:15 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:37:15.868750 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:15.873457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6af86-e8c2-4251-b2e3-e68e936c3267 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:15.876318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e2e6af86-e8c2-4251-b2e3-e68e936c3267 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:15.950518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6af86-e8c2-4251-b2e3-e68e936c3267 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:16.020995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fd067-9ebc-4f6a-a7ae-0b4be939662e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:16.021741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fd067-9ebc-4f6a-a7ae-0b4be939662e service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:16.022038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fd067-9ebc-4f6a-a7ae-0b4be939662e service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:16.023425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800fd067-9ebc-4f6a-a7ae-0b4be939662e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:16.058084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fd067-9ebc-4f6a-a7ae-0b4be939662e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:16.061429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800fd067-9ebc-4f6a-a7ae-0b4be939662e service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:16.100132 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2744/5433] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:37:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:37:17.235119 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:17.835616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45809dbf-31c2-487c-af10-b23fbfd42ee1 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:17.837056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-45809dbf-31c2-487c-af10-b23fbfd42ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:17.866507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45809dbf-31c2-487c-af10-b23fbfd42ee1 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:17.878467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c41e510-261c-4743-86ec-a32c2038baf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:17.879651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41e510-261c-4743-86ec-a32c2038baf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:17.882259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41e510-261c-4743-86ec-a32c2038baf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:17.882654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41e510-261c-4743-86ec-a32c2038baf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:17.886919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0c41e510-261c-4743-86ec-a32c2038baf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:17.983669 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:18.028761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41e510-261c-4743-86ec-a32c2038baf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:18.030601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c41e510-261c-4743-86ec-a32c2038baf9 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:18.061526 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2690/5434] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:37:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:37:23.235187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fd067-9ebc-4f6a-a7ae-0b4be939662e service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:23.236764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-800fd067-9ebc-4f6a-a7ae-0b4be939662e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:23.317872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800fd067-9ebc-4f6a-a7ae-0b4be939662e service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:23.338253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f1275-1bfd-4a17-9878-4d80d7cc68c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:23.339919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f1275-1bfd-4a17-9878-4d80d7cc68c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:23.343501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f1275-1bfd-4a17-9878-4d80d7cc68c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:23.343501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251f1275-1bfd-4a17-9878-4d80d7cc68c4 admin admin] PATH_INFO: `/v3/users/761a8c8cfce6441a8eea1cbc349a382d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:23.343501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f1275-1bfd-4a17-9878-4d80d7cc68c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=761a8c8cfce6441a8eea1cbc349a382d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:23.373388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251f1275-1bfd-4a17-9878-4d80d7cc68c4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:23.623191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-251f1275-1bfd-4a17-9878-4d80d7cc68c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '761a8c8cfce6441a8eea1cbc349a382d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:23.658663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-251f1275-1bfd-4a17-9878-4d80d7cc68c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '761a8c8cfce6441a8eea1cbc349a382d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:23.691207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-251f1275-1bfd-4a17-9878-4d80d7cc68c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '761a8c8cfce6441a8eea1cbc349a382d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:23.693024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-251f1275-1bfd-4a17-9878-4d80d7cc68c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '761a8c8cfce6441a8eea1cbc349a382d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:23.822869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-251f1275-1bfd-4a17-9878-4d80d7cc68c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '761a8c8cfce6441a8eea1cbc349a382d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:23.833487 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2745/5435] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:37:23 2022] DELETE /identity/v3/users/761a8c8cfce6441a8eea1cbc349a382d => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:23.838708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261bebb-e3a1-4ede-92d0-cb23b4cccde6 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:23.839272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261bebb-e3a1-4ede-92d0-cb23b4cccde6 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:23.839384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261bebb-e3a1-4ede-92d0-cb23b4cccde6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:23.872372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4261bebb-e3a1-4ede-92d0-cb23b4cccde6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:23.873935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4261bebb-e3a1-4ede-92d0-cb23b4cccde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:24.029676 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2691/5436] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:24.048061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f1275-1bfd-4a17-9878-4d80d7cc68c4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:24.053549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-251f1275-1bfd-4a17-9878-4d80d7cc68c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:24.259487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251f1275-1bfd-4a17-9878-4d80d7cc68c4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:24.270752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50df0d5-3c76-411a-b47c-9ec6edfc5ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:24.271841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50df0d5-3c76-411a-b47c-9ec6edfc5ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:24.272332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50df0d5-3c76-411a-b47c-9ec6edfc5ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:24.274147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50df0d5-3c76-411a-b47c-9ec6edfc5ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:24.295107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50df0d5-3c76-411a-b47c-9ec6edfc5ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:24.299281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50df0d5-3c76-411a-b47c-9ec6edfc5ee8 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:24.327111 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2746/5437] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:37:25.240656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261bebb-e3a1-4ede-92d0-cb23b4cccde6 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:25.242084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4261bebb-e3a1-4ede-92d0-cb23b4cccde6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:25.267355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261bebb-e3a1-4ede-92d0-cb23b4cccde6 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:25.284132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7179488-1deb-4933-a796-ea9c182d945f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:25.284132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7179488-1deb-4933-a796-ea9c182d945f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:25.284132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7179488-1deb-4933-a796-ea9c182d945f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:25.284132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7179488-1deb-4933-a796-ea9c182d945f admin admin] PATH_INFO: `/v3/projects/79a0036b73604d3cbc08d08b8293c4a5` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:25.286908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7179488-1deb-4933-a796-ea9c182d945f admin admin] RBAC: Authorizing `identity:delete_project(project_id=79a0036b73604d3cbc08d08b8293c4a5)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:25.289171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7179488-1deb-4933-a796-ea9c182d945f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:25.503813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d7179488-1deb-4933-a796-ea9c182d945f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79a0036b73604d3cbc08d08b8293c4a5', 'request_id': 'req-d7179488-1deb-4933-a796-ea9c182d945f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:25.605635 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d7179488-1deb-4933-a796-ea9c182d945f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79a0036b73604d3cbc08d08b8293c4a5', 'request_id': 'req-d7179488-1deb-4933-a796-ea9c182d945f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:25.614251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d7179488-1deb-4933-a796-ea9c182d945f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79a0036b73604d3cbc08d08b8293c4a5', 'request_id': 'req-d7179488-1deb-4933-a796-ea9c182d945f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:25.640553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d7179488-1deb-4933-a796-ea9c182d945f admin admin] The token cache is being invalidate because project 79a0036b73604d3cbc08d08b8293c4a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:37:25.640882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d7179488-1deb-4933-a796-ea9c182d945f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:25.652660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d7179488-1deb-4933-a796-ea9c182d945f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:25.654836 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2692/5438] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:37:25 2022] DELETE /identity/v3/projects/79a0036b73604d3cbc08d08b8293c4a5 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:25.664921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318579e1-8e5f-49cc-a993-76ec4397665f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:25.665487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318579e1-8e5f-49cc-a993-76ec4397665f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:25.665685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318579e1-8e5f-49cc-a993-76ec4397665f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:25.675247 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:25.706572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-318579e1-8e5f-49cc-a993-76ec4397665f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:25.708667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-318579e1-8e5f-49cc-a993-76ec4397665f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:25.799859 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2747/5439] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:25.808166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b9ba1-b116-4797-a37f-f7ab64ca4ab4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:25.808716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b9ba1-b116-4797-a37f-f7ab64ca4ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:25.809219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b9ba1-b116-4797-a37f-f7ab64ca4ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:25.836123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-777b9ba1-b116-4797-a37f-f7ab64ca4ab4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:25.837558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-777b9ba1-b116-4797-a37f-f7ab64ca4ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:25.864739 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2693/5440] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:37:25.866063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318579e1-8e5f-49cc-a993-76ec4397665f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:25.880220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318579e1-8e5f-49cc-a993-76ec4397665f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:25.896996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8ff59-19cc-4234-b3dc-4261a21f7c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:25.897841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8ff59-19cc-4234-b3dc-4261a21f7c73 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:25.898266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8ff59-19cc-4234-b3dc-4261a21f7c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:25.898673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8ff59-19cc-4234-b3dc-4261a21f7c73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:25.899539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8ff59-19cc-4234-b3dc-4261a21f7c73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:37:25.899980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8ff59-19cc-4234-b3dc-4261a21f7c73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:25.901708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8ff59-19cc-4234-b3dc-4261a21f7c73 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:25.936137 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2748/5441] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:37:25.939682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b9ba1-b116-4797-a37f-f7ab64ca4ab4 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:25.956195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b9ba1-b116-4797-a37f-f7ab64ca4ab4 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:25.985591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d23b3-9fd2-4186-8a00-04c077252f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:25.986317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d23b3-9fd2-4186-8a00-04c077252f11 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:25.986606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d23b3-9fd2-4186-8a00-04c077252f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:25.986889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d23b3-9fd2-4186-8a00-04c077252f11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:25.987977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d23b3-9fd2-4186-8a00-04c077252f11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:25.989945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d23b3-9fd2-4186-8a00-04c077252f11 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:26.139455 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2694/5442] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:37:25 2022] POST /identity/v3/projects => generated 371 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:37:26.144777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8ff59-19cc-4234-b3dc-4261a21f7c73 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:26.164010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8ff59-19cc-4234-b3dc-4261a21f7c73 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:26.336975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ca744-8282-4e8d-a40b-0d5accae5a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:26.337525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ca744-8282-4e8d-a40b-0d5accae5a7a admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:26.337912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ca744-8282-4e8d-a40b-0d5accae5a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:26.338323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61ca744-8282-4e8d-a40b-0d5accae5a7a admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:26.339892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ca744-8282-4e8d-a40b-0d5accae5a7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:26.342903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61ca744-8282-4e8d-a40b-0d5accae5a7a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:26.455318 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2749/5443] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:37:26 2022] POST /identity/v3/users => generated 286 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:37:26.460243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d23b3-9fd2-4186-8a00-04c077252f11 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:26.471811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d23b3-9fd2-4186-8a00-04c077252f11 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:26.478317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb57d53-3c79-4355-89ae-3747a7b2a6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:26.479269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb57d53-3c79-4355-89ae-3747a7b2a6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:26.479754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb57d53-3c79-4355-89ae-3747a7b2a6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:26.480209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb57d53-3c79-4355-89ae-3747a7b2a6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:26.481162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb57d53-3c79-4355-89ae-3747a7b2a6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:26.482787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb57d53-3c79-4355-89ae-3747a7b2a6f5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:26.495903 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2695/5444] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:37:26.499585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ca744-8282-4e8d-a40b-0d5accae5a7a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:26.513298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61ca744-8282-4e8d-a40b-0d5accae5a7a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:26.536199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb85d1-f86c-4749-85f5-7b716d3fb488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:26.537070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb85d1-f86c-4749-85f5-7b716d3fb488 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:26.537365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb85d1-f86c-4749-85f5-7b716d3fb488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:26.537731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb85d1-f86c-4749-85f5-7b716d3fb488 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:26.538529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb85d1-f86c-4749-85f5-7b716d3fb488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:26.543127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb85d1-f86c-4749-85f5-7b716d3fb488 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:26.556453 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2750/5445] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:37:26.561247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb57d53-3c79-4355-89ae-3747a7b2a6f5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:26.577541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb57d53-3c79-4355-89ae-3747a7b2a6f5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:26.583357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11784dd7-7b9d-47f3-ae5b-3b485dca405f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:26.584298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11784dd7-7b9d-47f3-ae5b-3b485dca405f admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:26.584597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11784dd7-7b9d-47f3-ae5b-3b485dca405f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:26.584879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11784dd7-7b9d-47f3-ae5b-3b485dca405f admin admin] PATH_INFO: `/v3/projects/a98ed9ab578142daa0cfbfc9635633dc/users/2992d8eadd82443db1d841301b5ccdba/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:26.606230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11784dd7-7b9d-47f3-ae5b-3b485dca405f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98ed9ab578142daa0cfbfc9635633dc, user_id=2992d8eadd82443db1d841301b5ccdba, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:26.609164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11784dd7-7b9d-47f3-ae5b-3b485dca405f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:26.612382 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:26.663912 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2696/5446] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:37:26 2022] PUT /identity/v3/projects/a98ed9ab578142daa0cfbfc9635633dc/users/2992d8eadd82443db1d841301b5ccdba/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:26.674657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d5a18-7f78-4a48-a804-e00b84fc9771 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:26.675256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d5a18-7f78-4a48-a804-e00b84fc9771 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:26.675256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d5a18-7f78-4a48-a804-e00b84fc9771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:26.706045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e25d5a18-7f78-4a48-a804-e00b84fc9771 None None] MFA Rules not processed for user `2992d8eadd82443db1d841301b5ccdba`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:26.707696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e25d5a18-7f78-4a48-a804-e00b84fc9771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:26.805839 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:26.810202 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2751/5447] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:26.830363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11784dd7-7b9d-47f3-ae5b-3b485dca405f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:26.833087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-11784dd7-7b9d-47f3-ae5b-3b485dca405f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:26.929715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11784dd7-7b9d-47f3-ae5b-3b485dca405f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:26.949243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dbcc2-030e-4a0f-acef-8b07be667330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:26.950567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dbcc2-030e-4a0f-acef-8b07be667330 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:26.951029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dbcc2-030e-4a0f-acef-8b07be667330 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:26.951537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dbcc2-030e-4a0f-acef-8b07be667330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:26.979414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25dbcc2-030e-4a0f-acef-8b07be667330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:26.981510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25dbcc2-030e-4a0f-acef-8b07be667330 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:26.999879 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2697/5448] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:37:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:37:28.141596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d5a18-7f78-4a48-a804-e00b84fc9771 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:28.143825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e25d5a18-7f78-4a48-a804-e00b84fc9771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:28.265459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d5a18-7f78-4a48-a804-e00b84fc9771 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:28.272208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec6f2e-8246-4a9c-8f14-dc1149ad32e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:28.273201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec6f2e-8246-4a9c-8f14-dc1149ad32e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:28.273674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec6f2e-8246-4a9c-8f14-dc1149ad32e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:28.274443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec6f2e-8246-4a9c-8f14-dc1149ad32e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:28.285672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bbec6f2e-8246-4a9c-8f14-dc1149ad32e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:28.413370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec6f2e-8246-4a9c-8f14-dc1149ad32e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:28.414943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec6f2e-8246-4a9c-8f14-dc1149ad32e5 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:28.426530 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2752/5449] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:37:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:37:29.315868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dbcc2-030e-4a0f-acef-8b07be667330 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:29.318145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f25dbcc2-030e-4a0f-acef-8b07be667330 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:29.454562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dbcc2-030e-4a0f-acef-8b07be667330 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:29.465811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba42c99-e40f-4007-b951-537c684d0c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:29.466766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba42c99-e40f-4007-b951-537c684d0c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:29.467055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba42c99-e40f-4007-b951-537c684d0c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:29.467338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba42c99-e40f-4007-b951-537c684d0c52 admin admin] PATH_INFO: `/v3/users/d6ef8be2796d4491b8a93afe7e10846e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:29.469570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba42c99-e40f-4007-b951-537c684d0c52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6ef8be2796d4491b8a93afe7e10846e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:29.471753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba42c99-e40f-4007-b951-537c684d0c52 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:29.708805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0ba42c99-e40f-4007-b951-537c684d0c52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6ef8be2796d4491b8a93afe7e10846e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:29.726832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0ba42c99-e40f-4007-b951-537c684d0c52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6ef8be2796d4491b8a93afe7e10846e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:29.727824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0ba42c99-e40f-4007-b951-537c684d0c52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6ef8be2796d4491b8a93afe7e10846e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:29.728773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0ba42c99-e40f-4007-b951-537c684d0c52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6ef8be2796d4491b8a93afe7e10846e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:29.738190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0ba42c99-e40f-4007-b951-537c684d0c52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6ef8be2796d4491b8a93afe7e10846e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:29.886350 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2698/5450] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:37:29 2022] DELETE /identity/v3/users/d6ef8be2796d4491b8a93afe7e10846e => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:29.891619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfc0b7-bc0b-4f88-84f6-a1d9fe4f4525 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:29.892115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfc0b7-bc0b-4f88-84f6-a1d9fe4f4525 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:29.893119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfc0b7-bc0b-4f88-84f6-a1d9fe4f4525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:29.920489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b3cfc0b7-bc0b-4f88-84f6-a1d9fe4f4525 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:29.922137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b3cfc0b7-bc0b-4f88-84f6-a1d9fe4f4525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:30.011237 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2753/5451] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:30.040930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba42c99-e40f-4007-b951-537c684d0c52 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:30.045478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0ba42c99-e40f-4007-b951-537c684d0c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:30.093966 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:30.184431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba42c99-e40f-4007-b951-537c684d0c52 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:30.189158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688930b-ce2a-4401-bb60-0d498a742d9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:30.190583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688930b-ce2a-4401-bb60-0d498a742d9a service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:30.191158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688930b-ce2a-4401-bb60-0d498a742d9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:30.192350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688930b-ce2a-4401-bb60-0d498a742d9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:30.211783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688930b-ce2a-4401-bb60-0d498a742d9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:30.213592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688930b-ce2a-4401-bb60-0d498a742d9a service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:30.229110 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2699/5452] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:37:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:37:31.127036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfc0b7-bc0b-4f88-84f6-a1d9fe4f4525 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:31.131027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b3cfc0b7-bc0b-4f88-84f6-a1d9fe4f4525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:31.151324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfc0b7-bc0b-4f88-84f6-a1d9fe4f4525 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:31.167750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9bfa8-7de7-4701-8dfa-6cfe802bee34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:31.169747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9bfa8-7de7-4701-8dfa-6cfe802bee34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:31.170258 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9bfa8-7de7-4701-8dfa-6cfe802bee34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:31.170864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9bfa8-7de7-4701-8dfa-6cfe802bee34 admin admin] PATH_INFO: `/v3/users/bf94666b7381478d8426c7f4f9e7cb13` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:31.172907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9bfa8-7de7-4701-8dfa-6cfe802bee34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf94666b7381478d8426c7f4f9e7cb13)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:31.175603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9bfa8-7de7-4701-8dfa-6cfe802bee34 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:31.198634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688930b-ce2a-4401-bb60-0d498a742d9a service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:31.200617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1688930b-ce2a-4401-bb60-0d498a742d9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:31.230082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688930b-ce2a-4401-bb60-0d498a742d9a service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:31.240596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c5495-3586-48a2-96f4-157c82fea40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:31.243437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c5495-3586-48a2-96f4-157c82fea40f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:31.244228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c5495-3586-48a2-96f4-157c82fea40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:31.244792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c5495-3586-48a2-96f4-157c82fea40f admin admin] PATH_INFO: `/v3/projects/ee66cb37b9184d6496624455ef8a56f5` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:31.247423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c5495-3586-48a2-96f4-157c82fea40f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee66cb37b9184d6496624455ef8a56f5)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:31.249742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c5495-3586-48a2-96f4-157c82fea40f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:31.445896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-48e9bfa8-7de7-4701-8dfa-6cfe802bee34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf94666b7381478d8426c7f4f9e7cb13'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:31.449507 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:31.466457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-48e9bfa8-7de7-4701-8dfa-6cfe802bee34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf94666b7381478d8426c7f4f9e7cb13'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:31.475425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-808c5495-3586-48a2-96f4-157c82fea40f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee66cb37b9184d6496624455ef8a56f5', 'request_id': 'req-808c5495-3586-48a2-96f4-157c82fea40f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:31.482558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-48e9bfa8-7de7-4701-8dfa-6cfe802bee34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf94666b7381478d8426c7f4f9e7cb13'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:31.483726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-48e9bfa8-7de7-4701-8dfa-6cfe802bee34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf94666b7381478d8426c7f4f9e7cb13'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:31.554486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-808c5495-3586-48a2-96f4-157c82fea40f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee66cb37b9184d6496624455ef8a56f5', 'request_id': 'req-808c5495-3586-48a2-96f4-157c82fea40f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:31.568431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-808c5495-3586-48a2-96f4-157c82fea40f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee66cb37b9184d6496624455ef8a56f5', 'request_id': 'req-808c5495-3586-48a2-96f4-157c82fea40f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:31.591983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-808c5495-3586-48a2-96f4-157c82fea40f admin admin] The token cache is being invalidate because project ee66cb37b9184d6496624455ef8a56f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:37:31.591983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-808c5495-3586-48a2-96f4-157c82fea40f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:31.591983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-808c5495-3586-48a2-96f4-157c82fea40f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:31.594459 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2700/5453] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:37:31 2022] DELETE /identity/v3/projects/ee66cb37b9184d6496624455ef8a56f5 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:37:31.600129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d23f69-e553-4242-a239-43a50c5d651e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:31.600755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d23f69-e553-4242-a239-43a50c5d651e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:31.602076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d23f69-e553-4242-a239-43a50c5d651e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:31.612101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-48e9bfa8-7de7-4701-8dfa-6cfe802bee34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf94666b7381478d8426c7f4f9e7cb13'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:31.620833 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2754/5454] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:37:31 2022] DELETE /identity/v3/users/bf94666b7381478d8426c7f4f9e7cb13 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:31.653822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-78d23f69-e553-4242-a239-43a50c5d651e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:31.655315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-78d23f69-e553-4242-a239-43a50c5d651e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:31.795488 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2701/5455] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:37:31.797278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddea1b-2571-4fba-a63e-08e222c44f9a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:31.797577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddea1b-2571-4fba-a63e-08e222c44f9a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:31.797863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddea1b-2571-4fba-a63e-08e222c44f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:31.838832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-02ddea1b-2571-4fba-a63e-08e222c44f9a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:31.840176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-02ddea1b-2571-4fba-a63e-08e222c44f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:31.856412 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2755/5456] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:31.860563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d23f69-e553-4242-a239-43a50c5d651e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:31.876167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d23f69-e553-4242-a239-43a50c5d651e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:31.904143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fd9bd-2653-431f-90ef-fbf94f1c97df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:31.905562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fd9bd-2653-431f-90ef-fbf94f1c97df admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:31.911863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fd9bd-2653-431f-90ef-fbf94f1c97df admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:31.912510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351fd9bd-2653-431f-90ef-fbf94f1c97df admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:31.915910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fd9bd-2653-431f-90ef-fbf94f1c97df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:37:31.918041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fd9bd-2653-431f-90ef-fbf94f1c97df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:31.924777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351fd9bd-2653-431f-90ef-fbf94f1c97df admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:31.982680 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2702/5457] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:37:31.984717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddea1b-2571-4fba-a63e-08e222c44f9a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:32.004624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddea1b-2571-4fba-a63e-08e222c44f9a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:32.021247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244cbc1-83d9-487d-b8f7-54e5c209c145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:32.022258 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244cbc1-83d9-487d-b8f7-54e5c209c145 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:32.022258 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244cbc1-83d9-487d-b8f7-54e5c209c145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:32.022758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244cbc1-83d9-487d-b8f7-54e5c209c145 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:32.023526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244cbc1-83d9-487d-b8f7-54e5c209c145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:32.025397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244cbc1-83d9-487d-b8f7-54e5c209c145 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:32.168642 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2756/5458] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:37:31 2022] POST /identity/v3/projects => generated 373 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:37:32.176791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fd9bd-2653-431f-90ef-fbf94f1c97df admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:32.192977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351fd9bd-2653-431f-90ef-fbf94f1c97df admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:32.302809 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:32.334130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244cbc1-83d9-487d-b8f7-54e5c209c145 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:32.335992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8244cbc1-83d9-487d-b8f7-54e5c209c145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:32.462952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1890ab-da9f-4e45-9228-d0d3f45d334f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:32.467730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1890ab-da9f-4e45-9228-d0d3f45d334f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:32.467730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1890ab-da9f-4e45-9228-d0d3f45d334f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:32.467730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1890ab-da9f-4e45-9228-d0d3f45d334f admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:32.467730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1890ab-da9f-4e45-9228-d0d3f45d334f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:32.475306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1890ab-da9f-4e45-9228-d0d3f45d334f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:32.568944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244cbc1-83d9-487d-b8f7-54e5c209c145 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:32.574672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead1294-763c-45c1-aef9-dc7aa422c9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:32.575649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead1294-763c-45c1-aef9-dc7aa422c9d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:32.575934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead1294-763c-45c1-aef9-dc7aa422c9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:32.576427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead1294-763c-45c1-aef9-dc7aa422c9d5 admin admin] PATH_INFO: `/v3/projects/5cca6a73e6304254a04f6e1166f161a4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:32.578138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead1294-763c-45c1-aef9-dc7aa422c9d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cca6a73e6304254a04f6e1166f161a4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:32.580258 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead1294-763c-45c1-aef9-dc7aa422c9d5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:32.590616 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2703/5459] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:37:32 2022] POST /identity/v3/users => generated 287 bytes in 419 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:37:32.592295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9d9c4-3d63-461a-bfad-9de05da19c9a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:32.592963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9d9c4-3d63-461a-bfad-9de05da19c9a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:32.593404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9d9c4-3d63-461a-bfad-9de05da19c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:32.640314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-12f9d9c4-3d63-461a-bfad-9de05da19c9a None None] MFA Rules not processed for user `ef22032f2d47431889b5cd81d23f14ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:32.641647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-12f9d9c4-3d63-461a-bfad-9de05da19c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:32.731671 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2704/5460] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:32.733167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9d9c4-3d63-461a-bfad-9de05da19c9a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:32.793145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cead1294-763c-45c1-aef9-dc7aa422c9d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cca6a73e6304254a04f6e1166f161a4', 'request_id': 'req-cead1294-763c-45c1-aef9-dc7aa422c9d5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:32.797240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9d9c4-3d63-461a-bfad-9de05da19c9a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:32.811679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cead1294-763c-45c1-aef9-dc7aa422c9d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cca6a73e6304254a04f6e1166f161a4', 'request_id': 'req-cead1294-763c-45c1-aef9-dc7aa422c9d5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:32.834205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cead1294-763c-45c1-aef9-dc7aa422c9d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cca6a73e6304254a04f6e1166f161a4', 'request_id': 'req-cead1294-763c-45c1-aef9-dc7aa422c9d5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:32.912908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66450dfb-683e-4c4d-9553-b896918f355c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:32.913639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66450dfb-683e-4c4d-9553-b896918f355c admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:32.913930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66450dfb-683e-4c4d-9553-b896918f355c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:32.914255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66450dfb-683e-4c4d-9553-b896918f355c admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:32.915014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66450dfb-683e-4c4d-9553-b896918f355c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:32.916788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66450dfb-683e-4c4d-9553-b896918f355c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:32.932469 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2705/5461] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:37:32.933889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed291e3e-9395-41ff-9a4b-3c8a5d221d5a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:32.934311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed291e3e-9395-41ff-9a4b-3c8a5d221d5a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:32.934511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed291e3e-9395-41ff-9a4b-3c8a5d221d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:32.949004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cead1294-763c-45c1-aef9-dc7aa422c9d5 admin admin] The token cache is being invalidate because project 5cca6a73e6304254a04f6e1166f161a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:37:32.958406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cead1294-763c-45c1-aef9-dc7aa422c9d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:32.958406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cead1294-763c-45c1-aef9-dc7aa422c9d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:32.958406 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2757/5462] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:37:32 2022] DELETE /identity/v3/projects/5cca6a73e6304254a04f6e1166f161a4 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:37:32.958406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead1294-763c-45c1-aef9-dc7aa422c9d5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:32.958406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cead1294-763c-45c1-aef9-dc7aa422c9d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:32.959481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ed291e3e-9395-41ff-9a4b-3c8a5d221d5a None None] MFA Rules not processed for user `ef22032f2d47431889b5cd81d23f14ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:32.960688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ed291e3e-9395-41ff-9a4b-3c8a5d221d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:32.973629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead1294-763c-45c1-aef9-dc7aa422c9d5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:32.978942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5619324d-ddb4-4e59-9c62-ffabd9b47315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:32.980238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619324d-ddb4-4e59-9c62-ffabd9b47315 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:32.980537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619324d-ddb4-4e59-9c62-ffabd9b47315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:32.980877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5619324d-ddb4-4e59-9c62-ffabd9b47315 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:32.981672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619324d-ddb4-4e59-9c62-ffabd9b47315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:32.983949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5619324d-ddb4-4e59-9c62-ffabd9b47315 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:32.995679 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2758/5463] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:37:33.001764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24436f-7fbd-4d72-8254-b05d2fe195c1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:33.002059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24436f-7fbd-4d72-8254-b05d2fe195c1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:33.002370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac24436f-7fbd-4d72-8254-b05d2fe195c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:33.026519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ac24436f-7fbd-4d72-8254-b05d2fe195c1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:33.029101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ac24436f-7fbd-4d72-8254-b05d2fe195c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:33.042826 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2706/5464] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:33.046283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed291e3e-9395-41ff-9a4b-3c8a5d221d5a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:33.052290 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2759/5465] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:33.057816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24436f-7fbd-4d72-8254-b05d2fe195c1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:33.060230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ac24436f-7fbd-4d72-8254-b05d2fe195c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:33.066297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed291e3e-9395-41ff-9a4b-3c8a5d221d5a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:33.072666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30be9513-98f4-42f1-bf3f-9cd30b118d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:33.073613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be9513-98f4-42f1-bf3f-9cd30b118d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:33.073897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be9513-98f4-42f1-bf3f-9cd30b118d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:33.074215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30be9513-98f4-42f1-bf3f-9cd30b118d54 admin admin] PATH_INFO: `/v3/projects/3e2377de7b0a47c9a8b1010f33210dad/users/71108fef34004221843a3c6a3881f241/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:33.105412 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:33.120667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be9513-98f4-42f1-bf3f-9cd30b118d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e2377de7b0a47c9a8b1010f33210dad, user_id=71108fef34004221843a3c6a3881f241, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:33.124177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30be9513-98f4-42f1-bf3f-9cd30b118d54 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:33.154748 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:33.217285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac24436f-7fbd-4d72-8254-b05d2fe195c1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:33.224058 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2707/5466] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:37:33 2022] PUT /identity/v3/projects/3e2377de7b0a47c9a8b1010f33210dad/users/71108fef34004221843a3c6a3881f241/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:33.225657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938411a8-70c2-4eae-a504-bd117276ff98 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:33.225987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938411a8-70c2-4eae-a504-bd117276ff98 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:33.226622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938411a8-70c2-4eae-a504-bd117276ff98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:33.265882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-938411a8-70c2-4eae-a504-bd117276ff98 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:33.267143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-938411a8-70c2-4eae-a504-bd117276ff98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:33.353367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157b1f2-2098-4d47-93c8-e2a6e4833522 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:33.356063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157b1f2-2098-4d47-93c8-e2a6e4833522 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:33.356580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157b1f2-2098-4d47-93c8-e2a6e4833522 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:33.357483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157b1f2-2098-4d47-93c8-e2a6e4833522 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:33.360968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a157b1f2-2098-4d47-93c8-e2a6e4833522 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:33.378654 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2708/5467] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:33.383649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4c8c8-f13d-4342-a901-e36cc1126a5f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:33.383944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4c8c8-f13d-4342-a901-e36cc1126a5f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:33.384252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4c8c8-f13d-4342-a901-e36cc1126a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:33.428316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-aca4c8c8-f13d-4342-a901-e36cc1126a5f None None] MFA Rules not processed for user `71108fef34004221843a3c6a3881f241`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:33.429628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aca4c8c8-f13d-4342-a901-e36cc1126a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:33.471644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157b1f2-2098-4d47-93c8-e2a6e4833522 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:33.473828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157b1f2-2098-4d47-93c8-e2a6e4833522 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:33.485945 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2760/5468] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:37:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:37:33.487468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157b1f2-2098-4d47-93c8-e2a6e4833522 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:33.502249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157b1f2-2098-4d47-93c8-e2a6e4833522 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:33.509517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb639508-23b3-44b7-9981-7d5d0adbab72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:33.511177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb639508-23b3-44b7-9981-7d5d0adbab72 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:33.511716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb639508-23b3-44b7-9981-7d5d0adbab72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:33.512185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb639508-23b3-44b7-9981-7d5d0adbab72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:33.513261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb639508-23b3-44b7-9981-7d5d0adbab72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:37:33.513743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb639508-23b3-44b7-9981-7d5d0adbab72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:33.515787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb639508-23b3-44b7-9981-7d5d0adbab72 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:33.539800 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2709/5469] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:33.572282 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2761/5470] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:37:33.575139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4c8c8-f13d-4342-a901-e36cc1126a5f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:33.591601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4c8c8-f13d-4342-a901-e36cc1126a5f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:33.606048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca90fbb-f793-42bf-913f-c229cb054062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:33.606784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca90fbb-f793-42bf-913f-c229cb054062 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:33.607111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca90fbb-f793-42bf-913f-c229cb054062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:33.607389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca90fbb-f793-42bf-913f-c229cb054062 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:33.609284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca90fbb-f793-42bf-913f-c229cb054062 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:33.615529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb639508-23b3-44b7-9981-7d5d0adbab72 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:33.615788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fb639508-23b3-44b7-9981-7d5d0adbab72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:33.620231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca90fbb-f793-42bf-913f-c229cb054062 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:33.716641 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:33.732378 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2710/5471] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:37:33 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:37:33.733888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca90fbb-f793-42bf-913f-c229cb054062 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:33.818881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb639508-23b3-44b7-9981-7d5d0adbab72 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:33.830113 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:33.906358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca90fbb-f793-42bf-913f-c229cb054062 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:33.912318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281dec5-e91b-4eb7-96c7-ccb4643ba2a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:33.913823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281dec5-e91b-4eb7-96c7-ccb4643ba2a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:33.914395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281dec5-e91b-4eb7-96c7-ccb4643ba2a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:33.914863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281dec5-e91b-4eb7-96c7-ccb4643ba2a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:33.915773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281dec5-e91b-4eb7-96c7-ccb4643ba2a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:33.918084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281dec5-e91b-4eb7-96c7-ccb4643ba2a7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:33.967348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bd8d0-6f6e-4278-b774-d02f703504ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:33.968929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bd8d0-6f6e-4278-b774-d02f703504ad service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:33.969587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bd8d0-6f6e-4278-b774-d02f703504ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:33.971410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bd8d0-6f6e-4278-b774-d02f703504ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:34.018839 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2711/5472] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:37:33 2022] POST /identity/v3/users => generated 287 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:37:34.020818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281dec5-e91b-4eb7-96c7-ccb4643ba2a7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:34.024261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5281dec5-e91b-4eb7-96c7-ccb4643ba2a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:34.138358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bd8d0-6f6e-4278-b774-d02f703504ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:34.139809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bd8d0-6f6e-4278-b774-d02f703504ad service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:34.157326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281dec5-e91b-4eb7-96c7-ccb4643ba2a7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:34.165405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59ca63-4044-4100-86fa-e1da5ea6ec61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:34.173552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59ca63-4044-4100-86fa-e1da5ea6ec61 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:34.173552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59ca63-4044-4100-86fa-e1da5ea6ec61 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:34.173552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59ca63-4044-4100-86fa-e1da5ea6ec61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:34.173552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ef59ca63-4044-4100-86fa-e1da5ea6ec61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:34.176690 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2762/5473] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:37:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:37:34.177483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bd8d0-6f6e-4278-b774-d02f703504ad service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:34.195167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bd8d0-6f6e-4278-b774-d02f703504ad service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:34.224144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cec2d-b7b7-401f-a7e9-bba606908162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:34.224847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cec2d-b7b7-401f-a7e9-bba606908162 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:34.225135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cec2d-b7b7-401f-a7e9-bba606908162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:34.225420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cec2d-b7b7-401f-a7e9-bba606908162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:34.226199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cec2d-b7b7-401f-a7e9-bba606908162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:34.228623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cec2d-b7b7-401f-a7e9-bba606908162 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:34.250607 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2763/5474] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:37:34.254924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cec2d-b7b7-401f-a7e9-bba606908162 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:34.276296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cec2d-b7b7-401f-a7e9-bba606908162 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:34.284128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59ca63-4044-4100-86fa-e1da5ea6ec61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:34.287143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59ca63-4044-4100-86fa-e1da5ea6ec61 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:34.293264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f209a-e5fc-4c49-a1f5-cb0d8f7a53f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:34.293977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f209a-e5fc-4c49-a1f5-cb0d8f7a53f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:34.294314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f209a-e5fc-4c49-a1f5-cb0d8f7a53f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:34.294608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f209a-e5fc-4c49-a1f5-cb0d8f7a53f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:34.295366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f209a-e5fc-4c49-a1f5-cb0d8f7a53f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:34.297022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f209a-e5fc-4c49-a1f5-cb0d8f7a53f8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:34.300363 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2712/5475] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:37:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:37:34.318556 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2764/5476] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:37:34.323063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59ca63-4044-4100-86fa-e1da5ea6ec61 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:34.344223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59ca63-4044-4100-86fa-e1da5ea6ec61 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:34.360042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef7b66-fe64-4cea-b970-8bc87cf96610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:34.361311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef7b66-fe64-4cea-b970-8bc87cf96610 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:34.361778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef7b66-fe64-4cea-b970-8bc87cf96610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:34.362601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef7b66-fe64-4cea-b970-8bc87cf96610 admin admin] PATH_INFO: `/v3/projects/c1ac9d3e81934cc483670fd846d1fa86/users/ea346f1c71964cc99cfe33d8fb81179a/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:34.399107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef7b66-fe64-4cea-b970-8bc87cf96610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ac9d3e81934cc483670fd846d1fa86, user_id=ea346f1c71964cc99cfe33d8fb81179a, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:34.402666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef7b66-fe64-4cea-b970-8bc87cf96610 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:34.524737 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2713/5477] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:37:34 2022] PUT /identity/v3/projects/c1ac9d3e81934cc483670fd846d1fa86/users/ea346f1c71964cc99cfe33d8fb81179a/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:34.526569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bae09-138b-4a37-b76c-ebd19b6b47ef None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:34.527127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bae09-138b-4a37-b76c-ebd19b6b47ef None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:34.527758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02bae09-138b-4a37-b76c-ebd19b6b47ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:34.578192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c02bae09-138b-4a37-b76c-ebd19b6b47ef None None] MFA Rules not processed for user `ea346f1c71964cc99cfe33d8fb81179a`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:34.579443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c02bae09-138b-4a37-b76c-ebd19b6b47ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:34.704838 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2765/5478] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:37:34.717731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac821cc-ea22-46ed-9f7a-42c74cc38071 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:34.718575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac821cc-ea22-46ed-9f7a-42c74cc38071 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:34.719034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac821cc-ea22-46ed-9f7a-42c74cc38071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:34.746089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0ac821cc-ea22-46ed-9f7a-42c74cc38071 None None] MFA Rules not processed for user `ea346f1c71964cc99cfe33d8fb81179a`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:34.748066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0ac821cc-ea22-46ed-9f7a-42c74cc38071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:34.762001 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2714/5479] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:34.815902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bae09-138b-4a37-b76c-ebd19b6b47ef None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:34.831103 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:34.941033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02bae09-138b-4a37-b76c-ebd19b6b47ef None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:34.958897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2f5c2-8232-450b-9616-d265befa1ada service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:34.959701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2f5c2-8232-450b-9616-d265befa1ada service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:34.960069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2f5c2-8232-450b-9616-d265befa1ada service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:34.961124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2f5c2-8232-450b-9616-d265befa1ada service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:34.982401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2f5c2-8232-450b-9616-d265befa1ada service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:34.985843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2f5c2-8232-450b-9616-d265befa1ada service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:34.998528 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2766/5480] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:37:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:37:36.100996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc02c4-76e7-41ee-bada-067a4d18ea0e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:36.101503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc02c4-76e7-41ee-bada-067a4d18ea0e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:36.102011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dc02c4-76e7-41ee-bada-067a4d18ea0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:36.134773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-33dc02c4-76e7-41ee-bada-067a4d18ea0e None None] MFA Rules not processed for user `ea346f1c71964cc99cfe33d8fb81179a`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:36.137899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-33dc02c4-76e7-41ee-bada-067a4d18ea0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:36.151647 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2715/5481] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:37.274986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2f5c2-8232-450b-9616-d265befa1ada service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:37.276832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-16d2f5c2-8232-450b-9616-d265befa1ada service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:37.410696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2f5c2-8232-450b-9616-d265befa1ada service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:37.419593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94089227-b23d-4e5b-9ec7-08b10fbbba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:37.420823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94089227-b23d-4e5b-9ec7-08b10fbbba58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:37.421326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94089227-b23d-4e5b-9ec7-08b10fbbba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:37.421615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94089227-b23d-4e5b-9ec7-08b10fbbba58 admin admin] PATH_INFO: `/v3/users/2813cbf12c0045cfbf9c928751c42499` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:37.422882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94089227-b23d-4e5b-9ec7-08b10fbbba58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2813cbf12c0045cfbf9c928751c42499)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:37.426872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94089227-b23d-4e5b-9ec7-08b10fbbba58 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:37.842641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-94089227-b23d-4e5b-9ec7-08b10fbbba58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2813cbf12c0045cfbf9c928751c42499'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:37.873386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-94089227-b23d-4e5b-9ec7-08b10fbbba58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2813cbf12c0045cfbf9c928751c42499'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:37.886593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-94089227-b23d-4e5b-9ec7-08b10fbbba58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2813cbf12c0045cfbf9c928751c42499'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:37.887791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-94089227-b23d-4e5b-9ec7-08b10fbbba58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2813cbf12c0045cfbf9c928751c42499'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:37.983443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-94089227-b23d-4e5b-9ec7-08b10fbbba58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2813cbf12c0045cfbf9c928751c42499'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:37.992820 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2767/5482] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:37:37 2022] DELETE /identity/v3/users/2813cbf12c0045cfbf9c928751c42499 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:37.997870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b0a7c-b3bc-4adb-b0ac-ed17175f3466 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:37.998415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b0a7c-b3bc-4adb-b0ac-ed17175f3466 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:37.998622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b0a7c-b3bc-4adb-b0ac-ed17175f3466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:38.070996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-174b0a7c-b3bc-4adb-b0ac-ed17175f3466 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:38.074853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-174b0a7c-b3bc-4adb-b0ac-ed17175f3466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:38.142222 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:38.297107 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2716/5483] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:38.328177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94089227-b23d-4e5b-9ec7-08b10fbbba58 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:38.337427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-94089227-b23d-4e5b-9ec7-08b10fbbba58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:38.375721 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:38.484770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94089227-b23d-4e5b-9ec7-08b10fbbba58 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:38.496564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd1fab-a4eb-41b7-8941-bb37a1de7991 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:38.497430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd1fab-a4eb-41b7-8941-bb37a1de7991 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:38.497900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd1fab-a4eb-41b7-8941-bb37a1de7991 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:38.498315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bd1fab-a4eb-41b7-8941-bb37a1de7991 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:38.518313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd1fab-a4eb-41b7-8941-bb37a1de7991 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:38.520210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bd1fab-a4eb-41b7-8941-bb37a1de7991 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:38.539240 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2768/5484] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:37:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:37:39.868099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b0a7c-b3bc-4adb-b0ac-ed17175f3466 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:39.873965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-174b0a7c-b3bc-4adb-b0ac-ed17175f3466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:39.907568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b0a7c-b3bc-4adb-b0ac-ed17175f3466 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:39.922000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba4cfb-4d78-4fc6-bcd1-cc269c48c6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:39.927762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba4cfb-4d78-4fc6-bcd1-cc269c48c6f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:39.927762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba4cfb-4d78-4fc6-bcd1-cc269c48c6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:39.927762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba4cfb-4d78-4fc6-bcd1-cc269c48c6f5 admin admin] PATH_INFO: `/v3/projects/1bf95a444f2c466c998644e274f76c40` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:39.928724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba4cfb-4d78-4fc6-bcd1-cc269c48c6f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bf95a444f2c466c998644e274f76c40)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:39.935441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba4cfb-4d78-4fc6-bcd1-cc269c48c6f5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:40.103385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e0ba4cfb-4d78-4fc6-bcd1-cc269c48c6f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bf95a444f2c466c998644e274f76c40', 'request_id': 'req-e0ba4cfb-4d78-4fc6-bcd1-cc269c48c6f5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:40.194633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e0ba4cfb-4d78-4fc6-bcd1-cc269c48c6f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bf95a444f2c466c998644e274f76c40', 'request_id': 'req-e0ba4cfb-4d78-4fc6-bcd1-cc269c48c6f5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:40.204825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e0ba4cfb-4d78-4fc6-bcd1-cc269c48c6f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bf95a444f2c466c998644e274f76c40', 'request_id': 'req-e0ba4cfb-4d78-4fc6-bcd1-cc269c48c6f5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:40.239022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e0ba4cfb-4d78-4fc6-bcd1-cc269c48c6f5 admin admin] The token cache is being invalidate because project 1bf95a444f2c466c998644e274f76c40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:37:40.239327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e0ba4cfb-4d78-4fc6-bcd1-cc269c48c6f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:40.239979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e0ba4cfb-4d78-4fc6-bcd1-cc269c48c6f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:40.245014 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2717/5485] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:37:39 2022] DELETE /identity/v3/projects/1bf95a444f2c466c998644e274f76c40 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:40.249094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd1fab-a4eb-41b7-8941-bb37a1de7991 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:40.259588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bd1fab-a4eb-41b7-8941-bb37a1de7991 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:40.366292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc3796-142a-4909-9f5e-27c2e8a9b96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:40.367947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc3796-142a-4909-9f5e-27c2e8a9b96a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:40.368282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc3796-142a-4909-9f5e-27c2e8a9b96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:40.368636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc3796-142a-4909-9f5e-27c2e8a9b96a admin admin] PATH_INFO: `/v3/users/9799d892a2bc4a3bbb23363beeaebe68` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:40.382556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc3796-142a-4909-9f5e-27c2e8a9b96a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9799d892a2bc4a3bbb23363beeaebe68)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:40.382556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc3796-142a-4909-9f5e-27c2e8a9b96a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:40.665862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-61cc3796-142a-4909-9f5e-27c2e8a9b96a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9799d892a2bc4a3bbb23363beeaebe68'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:40.687535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-61cc3796-142a-4909-9f5e-27c2e8a9b96a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9799d892a2bc4a3bbb23363beeaebe68'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:40.697491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-61cc3796-142a-4909-9f5e-27c2e8a9b96a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9799d892a2bc4a3bbb23363beeaebe68'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:40.698404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-61cc3796-142a-4909-9f5e-27c2e8a9b96a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9799d892a2bc4a3bbb23363beeaebe68'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:40.803206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-61cc3796-142a-4909-9f5e-27c2e8a9b96a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9799d892a2bc4a3bbb23363beeaebe68'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:40.821484 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2769/5486] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:37:40 2022] DELETE /identity/v3/users/9799d892a2bc4a3bbb23363beeaebe68 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:41.759378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba4cfb-4d78-4fc6-bcd1-cc269c48c6f5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:41.763602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e0ba4cfb-4d78-4fc6-bcd1-cc269c48c6f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:41.796353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba4cfb-4d78-4fc6-bcd1-cc269c48c6f5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:41.996063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32f0e5-e1df-4da8-a594-5c276ca96ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:41.997070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32f0e5-e1df-4da8-a594-5c276ca96ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:41.997238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32f0e5-e1df-4da8-a594-5c276ca96ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:41.997526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32f0e5-e1df-4da8-a594-5c276ca96ee9 admin admin] PATH_INFO: `/v3/projects/e4093c7f2bb24fd490230d6f44196925` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:42.001161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32f0e5-e1df-4da8-a594-5c276ca96ee9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4093c7f2bb24fd490230d6f44196925)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:42.003185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32f0e5-e1df-4da8-a594-5c276ca96ee9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:42.165240 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:42.167132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9a32f0e5-e1df-4da8-a594-5c276ca96ee9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4093c7f2bb24fd490230d6f44196925', 'request_id': 'req-9a32f0e5-e1df-4da8-a594-5c276ca96ee9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:42.233780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9a32f0e5-e1df-4da8-a594-5c276ca96ee9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4093c7f2bb24fd490230d6f44196925', 'request_id': 'req-9a32f0e5-e1df-4da8-a594-5c276ca96ee9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:42.248860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9a32f0e5-e1df-4da8-a594-5c276ca96ee9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4093c7f2bb24fd490230d6f44196925', 'request_id': 'req-9a32f0e5-e1df-4da8-a594-5c276ca96ee9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:42.268788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9a32f0e5-e1df-4da8-a594-5c276ca96ee9 admin admin] The token cache is being invalidate because project e4093c7f2bb24fd490230d6f44196925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:37:42.268788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9a32f0e5-e1df-4da8-a594-5c276ca96ee9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:42.276975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9a32f0e5-e1df-4da8-a594-5c276ca96ee9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:42.280351 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2718/5487] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:37:41 2022] DELETE /identity/v3/projects/e4093c7f2bb24fd490230d6f44196925 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:42.286904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc3796-142a-4909-9f5e-27c2e8a9b96a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:42.292346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-61cc3796-142a-4909-9f5e-27c2e8a9b96a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:42.308978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc3796-142a-4909-9f5e-27c2e8a9b96a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:42.395126 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:42.476866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925478ae-194a-426c-8aee-d9248a7fb3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:42.478893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925478ae-194a-426c-8aee-d9248a7fb3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:42.479385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925478ae-194a-426c-8aee-d9248a7fb3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:42.480779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925478ae-194a-426c-8aee-d9248a7fb3ee admin admin] PATH_INFO: `/v3/users/dfa5c7de41d8441b99155406746436b4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:42.481794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925478ae-194a-426c-8aee-d9248a7fb3ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfa5c7de41d8441b99155406746436b4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:42.484014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925478ae-194a-426c-8aee-d9248a7fb3ee admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:42.686458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-925478ae-194a-426c-8aee-d9248a7fb3ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfa5c7de41d8441b99155406746436b4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:42.708528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-925478ae-194a-426c-8aee-d9248a7fb3ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfa5c7de41d8441b99155406746436b4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:42.719304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-925478ae-194a-426c-8aee-d9248a7fb3ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfa5c7de41d8441b99155406746436b4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:42.720791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-925478ae-194a-426c-8aee-d9248a7fb3ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfa5c7de41d8441b99155406746436b4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:42.836662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-925478ae-194a-426c-8aee-d9248a7fb3ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfa5c7de41d8441b99155406746436b4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:42.882389 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2770/5488] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:37:42 2022] DELETE /identity/v3/users/dfa5c7de41d8441b99155406746436b4 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:44.617596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32f0e5-e1df-4da8-a594-5c276ca96ee9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:44.619740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9a32f0e5-e1df-4da8-a594-5c276ca96ee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:44.636530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32f0e5-e1df-4da8-a594-5c276ca96ee9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:44.764324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ef2194-5467-44f1-9fc0-b7ddf092af6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:44.764324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef2194-5467-44f1-9fc0-b7ddf092af6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:44.764324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef2194-5467-44f1-9fc0-b7ddf092af6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:44.764324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ef2194-5467-44f1-9fc0-b7ddf092af6d admin admin] PATH_INFO: `/v3/projects/ae3462002fec4b529240ea053ca8cb4c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:44.764831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef2194-5467-44f1-9fc0-b7ddf092af6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae3462002fec4b529240ea053ca8cb4c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:44.764831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ef2194-5467-44f1-9fc0-b7ddf092af6d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:44.953846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-94ef2194-5467-44f1-9fc0-b7ddf092af6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae3462002fec4b529240ea053ca8cb4c', 'request_id': 'req-94ef2194-5467-44f1-9fc0-b7ddf092af6d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:45.085342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-94ef2194-5467-44f1-9fc0-b7ddf092af6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae3462002fec4b529240ea053ca8cb4c', 'request_id': 'req-94ef2194-5467-44f1-9fc0-b7ddf092af6d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:45.098467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-94ef2194-5467-44f1-9fc0-b7ddf092af6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae3462002fec4b529240ea053ca8cb4c', 'request_id': 'req-94ef2194-5467-44f1-9fc0-b7ddf092af6d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:45.112653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-94ef2194-5467-44f1-9fc0-b7ddf092af6d admin admin] The token cache is being invalidate because project ae3462002fec4b529240ea053ca8cb4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:37:45.113797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-94ef2194-5467-44f1-9fc0-b7ddf092af6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:45.114869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-94ef2194-5467-44f1-9fc0-b7ddf092af6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:45.116921 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2719/5489] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:37:44 2022] DELETE /identity/v3/projects/ae3462002fec4b529240ea053ca8cb4c => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:45.127509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687fbf2-2ce4-4611-8f07-1d2423b4c504 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:45.128254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687fbf2-2ce4-4611-8f07-1d2423b4c504 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:45.128254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687fbf2-2ce4-4611-8f07-1d2423b4c504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:45.167643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9687fbf2-2ce4-4611-8f07-1d2423b4c504 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:45.170235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9687fbf2-2ce4-4611-8f07-1d2423b4c504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:45.273669 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2771/5490] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:45.282225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7eb2e-1854-4167-a0ee-d7540a110047 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:45.283239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7eb2e-1854-4167-a0ee-d7540a110047 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:45.284338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7eb2e-1854-4167-a0ee-d7540a110047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:45.308528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-eeb7eb2e-1854-4167-a0ee-d7540a110047 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:45.310132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eeb7eb2e-1854-4167-a0ee-d7540a110047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:45.323542 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2720/5491] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:45.328518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687fbf2-2ce4-4611-8f07-1d2423b4c504 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:45.350327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687fbf2-2ce4-4611-8f07-1d2423b4c504 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:45.359005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd7d06-f434-4652-aaeb-aa5fd3d86a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:45.360108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd7d06-f434-4652-aaeb-aa5fd3d86a8c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:45.368014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd7d06-f434-4652-aaeb-aa5fd3d86a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:45.368014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd7d06-f434-4652-aaeb-aa5fd3d86a8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:45.368014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd7d06-f434-4652-aaeb-aa5fd3d86a8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:37:45.368014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd7d06-f434-4652-aaeb-aa5fd3d86a8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:45.368014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd7d06-f434-4652-aaeb-aa5fd3d86a8c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:45.390017 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2772/5492] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:37:45.396365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7eb2e-1854-4167-a0ee-d7540a110047 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:45.410748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7eb2e-1854-4167-a0ee-d7540a110047 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:45.419073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fc740-fbb2-4f0d-967f-c17868f6f5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:45.420507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fc740-fbb2-4f0d-967f-c17868f6f5a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:45.421137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fc740-fbb2-4f0d-967f-c17868f6f5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:45.422667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fc740-fbb2-4f0d-967f-c17868f6f5a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:45.423763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fc740-fbb2-4f0d-967f-c17868f6f5a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:45.427773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fc740-fbb2-4f0d-967f-c17868f6f5a3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:45.547391 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2721/5493] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:37:45 2022] POST /identity/v3/projects => generated 385 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:37:45.552353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd7d06-f434-4652-aaeb-aa5fd3d86a8c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:45.563126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd7d06-f434-4652-aaeb-aa5fd3d86a8c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:45.639716 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:45.667965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81e8f1-71c1-495e-8642-dccf19edc600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:45.669537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81e8f1-71c1-495e-8642-dccf19edc600 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:45.669913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81e8f1-71c1-495e-8642-dccf19edc600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:45.670299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81e8f1-71c1-495e-8642-dccf19edc600 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:45.672015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81e8f1-71c1-495e-8642-dccf19edc600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:45.674087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81e8f1-71c1-495e-8642-dccf19edc600 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:45.809348 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2773/5494] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:37:45 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:37:45.811175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fc740-fbb2-4f0d-967f-c17868f6f5a3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:45.844734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fc740-fbb2-4f0d-967f-c17868f6f5a3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:45.859791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77192c-e60a-4838-80aa-7a9fdb16946b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:45.861352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77192c-e60a-4838-80aa-7a9fdb16946b admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:45.862611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77192c-e60a-4838-80aa-7a9fdb16946b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:45.863227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77192c-e60a-4838-80aa-7a9fdb16946b admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:45.864704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77192c-e60a-4838-80aa-7a9fdb16946b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:45.867994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77192c-e60a-4838-80aa-7a9fdb16946b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:45.912077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81e8f1-71c1-495e-8642-dccf19edc600 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:45.913582 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2722/5495] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:37:45.928573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81e8f1-71c1-495e-8642-dccf19edc600 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:45.941669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5264d388-8d77-42b9-8077-39dbefb2d286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:45.942524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264d388-8d77-42b9-8077-39dbefb2d286 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:45.943395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264d388-8d77-42b9-8077-39dbefb2d286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:45.943695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5264d388-8d77-42b9-8077-39dbefb2d286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:45.944530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264d388-8d77-42b9-8077-39dbefb2d286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:45.946319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5264d388-8d77-42b9-8077-39dbefb2d286 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:45.968267 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2774/5496] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:37:45.970799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77192c-e60a-4838-80aa-7a9fdb16946b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:45.995748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77192c-e60a-4838-80aa-7a9fdb16946b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:46.018307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469034c-9efa-4897-b3de-e916aecf7404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:46.020116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469034c-9efa-4897-b3de-e916aecf7404 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:46.021014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469034c-9efa-4897-b3de-e916aecf7404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:46.021458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0469034c-9efa-4897-b3de-e916aecf7404 admin admin] PATH_INFO: `/v3/projects/9be0195ed0384728b2ebc12d57ab4345/users/8ae7931d9de44d859699d54d26970590/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:46.055099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469034c-9efa-4897-b3de-e916aecf7404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be0195ed0384728b2ebc12d57ab4345, user_id=8ae7931d9de44d859699d54d26970590, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:46.059051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0469034c-9efa-4897-b3de-e916aecf7404 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:46.146259 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2723/5497] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:37:45 2022] PUT /identity/v3/projects/9be0195ed0384728b2ebc12d57ab4345/users/8ae7931d9de44d859699d54d26970590/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:37:46.157299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da5ed5-d497-4c1e-902b-8c0b1b6f9eb4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:46.158174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da5ed5-d497-4c1e-902b-8c0b1b6f9eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:46.158174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da5ed5-d497-4c1e-902b-8c0b1b6f9eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:46.188266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-45da5ed5-d497-4c1e-902b-8c0b1b6f9eb4 None None] MFA Rules not processed for user `8ae7931d9de44d859699d54d26970590`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:46.189553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-45da5ed5-d497-4c1e-902b-8c0b1b6f9eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:46.310332 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2775/5498] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:46.315258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469034c-9efa-4897-b3de-e916aecf7404 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:46.321495 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:46.474803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0469034c-9efa-4897-b3de-e916aecf7404 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:46.495338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7a38a-5753-4c6e-809b-488b304a2bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:46.498870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7a38a-5753-4c6e-809b-488b304a2bbc admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:46.502145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7a38a-5753-4c6e-809b-488b304a2bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:46.502526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7a38a-5753-4c6e-809b-488b304a2bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:46.503328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7a38a-5753-4c6e-809b-488b304a2bbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:46.513459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7a38a-5753-4c6e-809b-488b304a2bbc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:46.670419 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2724/5499] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:37:46 2022] POST /identity/v3/projects => generated 383 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:37:46.671733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da5ed5-d497-4c1e-902b-8c0b1b6f9eb4 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:46.690510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da5ed5-d497-4c1e-902b-8c0b1b6f9eb4 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:46.812437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bf922-3324-499f-9191-0c56beb9a4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:46.813142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bf922-3324-499f-9191-0c56beb9a4f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:46.813429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bf922-3324-499f-9191-0c56beb9a4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:46.813710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bf922-3324-499f-9191-0c56beb9a4f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:46.814459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bf922-3324-499f-9191-0c56beb9a4f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:46.816587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bf922-3324-499f-9191-0c56beb9a4f1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:46.898147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7a38a-5753-4c6e-809b-488b304a2bbc admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:46.898705 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2776/5500] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:37:46 2022] POST /identity/v3/users => generated 298 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:37:46.914944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7a38a-5753-4c6e-809b-488b304a2bbc admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:46.921342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae6ffe-edce-4d51-97ab-45002730a935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:46.923585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae6ffe-edce-4d51-97ab-45002730a935 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:46.923585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae6ffe-edce-4d51-97ab-45002730a935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:46.923585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ae6ffe-edce-4d51-97ab-45002730a935 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:46.924008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae6ffe-edce-4d51-97ab-45002730a935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:46.930023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ae6ffe-edce-4d51-97ab-45002730a935 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:46.963844 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2725/5501] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:37:46.964092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bf922-3324-499f-9191-0c56beb9a4f1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:46.987552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bf922-3324-499f-9191-0c56beb9a4f1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:47.002806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41435180-0600-4d8a-b8b5-c62e3dc7a245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:47.010045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41435180-0600-4d8a-b8b5-c62e3dc7a245 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:47.010045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41435180-0600-4d8a-b8b5-c62e3dc7a245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:47.010045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41435180-0600-4d8a-b8b5-c62e3dc7a245 admin admin] PATH_INFO: `/v3/projects/e847b188f2a64b75993e5f77e2301aa7/users/9cdd6ce2301049d994db8f1da58feba4/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:47.044951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41435180-0600-4d8a-b8b5-c62e3dc7a245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e847b188f2a64b75993e5f77e2301aa7, user_id=9cdd6ce2301049d994db8f1da58feba4, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:47.047861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41435180-0600-4d8a-b8b5-c62e3dc7a245 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:47.161842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae6ffe-edce-4d51-97ab-45002730a935 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:47.163277 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2777/5502] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:37:46 2022] PUT /identity/v3/projects/e847b188f2a64b75993e5f77e2301aa7/users/9cdd6ce2301049d994db8f1da58feba4/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:47.189502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ae6ffe-edce-4d51-97ab-45002730a935 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:47.295919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c99348-45dd-4e90-9a43-f902e3e58c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:47.297170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c99348-45dd-4e90-9a43-f902e3e58c48 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:47.297464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c99348-45dd-4e90-9a43-f902e3e58c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:47.297750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c99348-45dd-4e90-9a43-f902e3e58c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:47.299168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c99348-45dd-4e90-9a43-f902e3e58c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:47.301522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c99348-45dd-4e90-9a43-f902e3e58c48 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:47.325893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41435180-0600-4d8a-b8b5-c62e3dc7a245 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:47.326213 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2726/5503] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:37:47.347272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41435180-0600-4d8a-b8b5-c62e3dc7a245 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:47.360933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4200bbd-4258-4da4-ae8b-596516c635de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:47.362877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4200bbd-4258-4da4-ae8b-596516c635de admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:47.363721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4200bbd-4258-4da4-ae8b-596516c635de admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:47.364981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4200bbd-4258-4da4-ae8b-596516c635de admin admin] PATH_INFO: `/v3/projects/e847b188f2a64b75993e5f77e2301aa7/users/9cdd6ce2301049d994db8f1da58feba4/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:47.367619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4200bbd-4258-4da4-ae8b-596516c635de admin admin] RBAC: Authorizing `identity:create_grant(project_id=e847b188f2a64b75993e5f77e2301aa7, user_id=9cdd6ce2301049d994db8f1da58feba4, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:47.372002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4200bbd-4258-4da4-ae8b-596516c635de admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:47.386975 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2778/5504] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:37:47 2022] PUT /identity/v3/projects/e847b188f2a64b75993e5f77e2301aa7/users/9cdd6ce2301049d994db8f1da58feba4/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:47.400890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22564fcb-0ca1-4d56-91eb-1a752e11c8e1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:47.401245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22564fcb-0ca1-4d56-91eb-1a752e11c8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:47.401496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22564fcb-0ca1-4d56-91eb-1a752e11c8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:47.451310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-22564fcb-0ca1-4d56-91eb-1a752e11c8e1 None None] MFA Rules not processed for user `9cdd6ce2301049d994db8f1da58feba4`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:47.454032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-22564fcb-0ca1-4d56-91eb-1a752e11c8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:47.631371 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2727/5505] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:47.642674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4200bbd-4258-4da4-ae8b-596516c635de admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:47.648301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e4200bbd-4258-4da4-ae8b-596516c635de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:47.655447 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:47.761652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4200bbd-4258-4da4-ae8b-596516c635de admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:47.766710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc33f58-5ca6-4428-ae80-18b227111003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:47.767712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc33f58-5ca6-4428-ae80-18b227111003 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:47.768216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc33f58-5ca6-4428-ae80-18b227111003 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:47.768708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc33f58-5ca6-4428-ae80-18b227111003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:47.912893 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:47.930466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc33f58-5ca6-4428-ae80-18b227111003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:47.932061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc33f58-5ca6-4428-ae80-18b227111003 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:47.962004 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2779/5506] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:37:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:37:54.558824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22564fcb-0ca1-4d56-91eb-1a752e11c8e1 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:54.560832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-22564fcb-0ca1-4d56-91eb-1a752e11c8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:54.645101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22564fcb-0ca1-4d56-91eb-1a752e11c8e1 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:54.651029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbf4ae-8963-4675-bf65-30ebb2bed397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:54.651953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbf4ae-8963-4675-bf65-30ebb2bed397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:54.652296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbf4ae-8963-4675-bf65-30ebb2bed397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:54.652576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dbf4ae-8963-4675-bf65-30ebb2bed397 admin admin] PATH_INFO: `/v3/users/2992d8eadd82443db1d841301b5ccdba` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:54.653875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbf4ae-8963-4675-bf65-30ebb2bed397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2992d8eadd82443db1d841301b5ccdba)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:54.655962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dbf4ae-8963-4675-bf65-30ebb2bed397 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:54.924407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f2dbf4ae-8963-4675-bf65-30ebb2bed397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2992d8eadd82443db1d841301b5ccdba'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:54.950212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f2dbf4ae-8963-4675-bf65-30ebb2bed397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2992d8eadd82443db1d841301b5ccdba'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:54.951228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f2dbf4ae-8963-4675-bf65-30ebb2bed397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2992d8eadd82443db1d841301b5ccdba'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:54.952066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f2dbf4ae-8963-4675-bf65-30ebb2bed397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2992d8eadd82443db1d841301b5ccdba'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:54.968802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f2dbf4ae-8963-4675-bf65-30ebb2bed397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2992d8eadd82443db1d841301b5ccdba'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:55.074973 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2728/5507] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:37:54 2022] DELETE /identity/v3/users/2992d8eadd82443db1d841301b5ccdba => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:55.079295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596530f5-4833-4d81-90ad-a2f819d0b625 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:55.079859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596530f5-4833-4d81-90ad-a2f819d0b625 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:55.079976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596530f5-4833-4d81-90ad-a2f819d0b625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:55.101860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-596530f5-4833-4d81-90ad-a2f819d0b625 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:55.103231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-596530f5-4833-4d81-90ad-a2f819d0b625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:55.202809 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2780/5508] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:55.215306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbf4ae-8963-4675-bf65-30ebb2bed397 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:55.225991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f2dbf4ae-8963-4675-bf65-30ebb2bed397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:55.296746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dbf4ae-8963-4675-bf65-30ebb2bed397 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:55.301485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359adfc-e01d-45c0-8544-5d9f1ed942a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:55.302182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359adfc-e01d-45c0-8544-5d9f1ed942a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:55.302535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359adfc-e01d-45c0-8544-5d9f1ed942a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:55.302819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359adfc-e01d-45c0-8544-5d9f1ed942a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:55.312957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359adfc-e01d-45c0-8544-5d9f1ed942a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:55.314581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359adfc-e01d-45c0-8544-5d9f1ed942a3 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:55.334318 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2729/5509] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:37:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:37:55.929814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596530f5-4833-4d81-90ad-a2f819d0b625 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:55.929814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-596530f5-4833-4d81-90ad-a2f819d0b625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:55.942012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596530f5-4833-4d81-90ad-a2f819d0b625 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:55.947227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd7f21-e714-48e5-afbf-d28e4072d258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:55.948287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd7f21-e714-48e5-afbf-d28e4072d258 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:55.948655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd7f21-e714-48e5-afbf-d28e4072d258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:55.948846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd7f21-e714-48e5-afbf-d28e4072d258 admin admin] PATH_INFO: `/v3/projects/a98ed9ab578142daa0cfbfc9635633dc` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:55.950775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd7f21-e714-48e5-afbf-d28e4072d258 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a98ed9ab578142daa0cfbfc9635633dc)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:55.952416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd7f21-e714-48e5-afbf-d28e4072d258 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:56.097317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d7bd7f21-e714-48e5-afbf-d28e4072d258 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a98ed9ab578142daa0cfbfc9635633dc', 'request_id': 'req-d7bd7f21-e714-48e5-afbf-d28e4072d258'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:56.102986 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:56.123075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d7bd7f21-e714-48e5-afbf-d28e4072d258 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a98ed9ab578142daa0cfbfc9635633dc', 'request_id': 'req-d7bd7f21-e714-48e5-afbf-d28e4072d258'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:56.136185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d7bd7f21-e714-48e5-afbf-d28e4072d258 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a98ed9ab578142daa0cfbfc9635633dc', 'request_id': 'req-d7bd7f21-e714-48e5-afbf-d28e4072d258'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:56.229307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d7bd7f21-e714-48e5-afbf-d28e4072d258 admin admin] The token cache is being invalidate because project a98ed9ab578142daa0cfbfc9635633dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:37:56.229704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d7bd7f21-e714-48e5-afbf-d28e4072d258 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:56.230489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d7bd7f21-e714-48e5-afbf-d28e4072d258 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:37:56.232515 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2781/5510] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:37:55 2022] DELETE /identity/v3/projects/a98ed9ab578142daa0cfbfc9635633dc => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:56.237049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647d7b-5457-4b05-8f5a-7c6e07656b54 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:56.237728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647d7b-5457-4b05-8f5a-7c6e07656b54 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:56.238747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11647d7b-5457-4b05-8f5a-7c6e07656b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:56.260778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-11647d7b-5457-4b05-8f5a-7c6e07656b54 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:56.262159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-11647d7b-5457-4b05-8f5a-7c6e07656b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:56.284380 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:56.362522 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2730/5511] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:37:56.371876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65e826-3501-45ff-a6bf-ca362bb67d74 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:56.372316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65e826-3501-45ff-a6bf-ca362bb67d74 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:56.372715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65e826-3501-45ff-a6bf-ca362bb67d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:56.398078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-cf65e826-3501-45ff-a6bf-ca362bb67d74 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:56.400059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cf65e826-3501-45ff-a6bf-ca362bb67d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:56.412754 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2782/5512] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:56.414196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11647d7b-5457-4b05-8f5a-7c6e07656b54 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:56.426364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11647d7b-5457-4b05-8f5a-7c6e07656b54 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:56.435450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c899a0-86d4-42b3-8ec0-b9359eb04bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:56.437481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c899a0-86d4-42b3-8ec0-b9359eb04bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:56.438127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c899a0-86d4-42b3-8ec0-b9359eb04bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:56.438648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c899a0-86d4-42b3-8ec0-b9359eb04bf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:56.445065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c899a0-86d4-42b3-8ec0-b9359eb04bf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:37:56.445065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c899a0-86d4-42b3-8ec0-b9359eb04bf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:56.445065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c899a0-86d4-42b3-8ec0-b9359eb04bf7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:56.465853 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2731/5513] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:37:56.467047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65e826-3501-45ff-a6bf-ca362bb67d74 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:56.479515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65e826-3501-45ff-a6bf-ca362bb67d74 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:56.483708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275a0e7-d0e4-464f-84e8-3bab1a54562c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:56.484598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275a0e7-d0e4-464f-84e8-3bab1a54562c admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:56.484977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275a0e7-d0e4-464f-84e8-3bab1a54562c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:56.485392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275a0e7-d0e4-464f-84e8-3bab1a54562c admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:56.486920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275a0e7-d0e4-464f-84e8-3bab1a54562c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:56.490592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275a0e7-d0e4-464f-84e8-3bab1a54562c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:56.629673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c899a0-86d4-42b3-8ec0-b9359eb04bf7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:56.642828 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2783/5514] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:37:56 2022] POST /identity/v3/projects => generated 369 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:37:56.658503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c899a0-86d4-42b3-8ec0-b9359eb04bf7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:56.782871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a869254-07a3-4de3-965d-fa1e47085260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:56.783822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a869254-07a3-4de3-965d-fa1e47085260 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:56.798515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a869254-07a3-4de3-965d-fa1e47085260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:56.798738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a869254-07a3-4de3-965d-fa1e47085260 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:56.799520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a869254-07a3-4de3-965d-fa1e47085260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:56.802411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a869254-07a3-4de3-965d-fa1e47085260 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:56.881299 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2732/5515] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:37:56 2022] POST /identity/v3/users => generated 285 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:37:56.885481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275a0e7-d0e4-464f-84e8-3bab1a54562c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:56.899098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275a0e7-d0e4-464f-84e8-3bab1a54562c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:56.904369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca42de-c55f-4ddb-9ecd-e5e4dc28187b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:56.905253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca42de-c55f-4ddb-9ecd-e5e4dc28187b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:56.905752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca42de-c55f-4ddb-9ecd-e5e4dc28187b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:56.906202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca42de-c55f-4ddb-9ecd-e5e4dc28187b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:56.907046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca42de-c55f-4ddb-9ecd-e5e4dc28187b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:56.908932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca42de-c55f-4ddb-9ecd-e5e4dc28187b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:56.926211 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2784/5516] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:37:56.927603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a869254-07a3-4de3-965d-fa1e47085260 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:56.952681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a869254-07a3-4de3-965d-fa1e47085260 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:56.971321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608566b2-2a36-4b64-a7eb-d9a6662e217f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:56.972012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608566b2-2a36-4b64-a7eb-d9a6662e217f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:56.972308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608566b2-2a36-4b64-a7eb-d9a6662e217f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:56.980487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608566b2-2a36-4b64-a7eb-d9a6662e217f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:56.980487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608566b2-2a36-4b64-a7eb-d9a6662e217f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:56.980487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608566b2-2a36-4b64-a7eb-d9a6662e217f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:57.010894 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2733/5517] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:37:57.012523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca42de-c55f-4ddb-9ecd-e5e4dc28187b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:57.027262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca42de-c55f-4ddb-9ecd-e5e4dc28187b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:57.041848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf5d85-ad4e-4258-a28c-bf6cb5b523f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:57.042805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf5d85-ad4e-4258-a28c-bf6cb5b523f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:57.043238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf5d85-ad4e-4258-a28c-bf6cb5b523f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:57.043531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf5d85-ad4e-4258-a28c-bf6cb5b523f6 admin admin] PATH_INFO: `/v3/projects/1cfd4acda92c4d93aa175443cae8e1e0/users/4a91252b604a402a8760f7b553606c40/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:57.068620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf5d85-ad4e-4258-a28c-bf6cb5b523f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cfd4acda92c4d93aa175443cae8e1e0, user_id=4a91252b604a402a8760f7b553606c40, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:57.071427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf5d85-ad4e-4258-a28c-bf6cb5b523f6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:57.182671 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2785/5518] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:37:57 2022] PUT /identity/v3/projects/1cfd4acda92c4d93aa175443cae8e1e0/users/4a91252b604a402a8760f7b553606c40/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:37:57.194473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33740db1-a862-4419-b5a6-8248e1f03447 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:57.195416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33740db1-a862-4419-b5a6-8248e1f03447 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:57.196345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33740db1-a862-4419-b5a6-8248e1f03447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:57.265457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-33740db1-a862-4419-b5a6-8248e1f03447 None None] MFA Rules not processed for user `4a91252b604a402a8760f7b553606c40`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:37:57.267061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-33740db1-a862-4419-b5a6-8248e1f03447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:57.491885 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2734/5519] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:37:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:37:57.494895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf5d85-ad4e-4258-a28c-bf6cb5b523f6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:57.498727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2bbf5d85-ad4e-4258-a28c-bf6cb5b523f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:57.589939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf5d85-ad4e-4258-a28c-bf6cb5b523f6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:57.594217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb705e-4bb1-42af-9d23-eea4899e9451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:57.594914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb705e-4bb1-42af-9d23-eea4899e9451 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:57.595165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb705e-4bb1-42af-9d23-eea4899e9451 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:57.595461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eb705e-4bb1-42af-9d23-eea4899e9451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:57.605938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb705e-4bb1-42af-9d23-eea4899e9451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:57.607425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eb705e-4bb1-42af-9d23-eea4899e9451 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:57.618620 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2786/5520] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:37:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:37:58.517647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33740db1-a862-4419-b5a6-8248e1f03447 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:37:58.519040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-33740db1-a862-4419-b5a6-8248e1f03447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:58.581173 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:37:58.665343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33740db1-a862-4419-b5a6-8248e1f03447 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:37:58.685667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630108e2-daf3-478a-9fae-3df152066bb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:37:58.686688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630108e2-daf3-478a-9fae-3df152066bb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:37:58.687756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630108e2-daf3-478a-9fae-3df152066bb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:37:58.688348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630108e2-daf3-478a-9fae-3df152066bb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:37:58.702252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-630108e2-daf3-478a-9fae-3df152066bb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:37:58.823423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630108e2-daf3-478a-9fae-3df152066bb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:37:58.825763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630108e2-daf3-478a-9fae-3df152066bb3 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:37:58.845723 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2735/5521] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:37:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:38:07.613698 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=2,keystone:SELECT=58,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:08.835303 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=43 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:11.028979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb705e-4bb1-42af-9d23-eea4899e9451 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:11.031708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e0eb705e-4bb1-42af-9d23-eea4899e9451 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:11.132862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630108e2-daf3-478a-9fae-3df152066bb3 service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:11.135216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-630108e2-daf3-478a-9fae-3df152066bb3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:11.171105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eb705e-4bb1-42af-9d23-eea4899e9451 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:11.184570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a954fba8-84b8-4ed3-8db6-b6e31ff965e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:11.186914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954fba8-84b8-4ed3-8db6-b6e31ff965e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:11.188430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954fba8-84b8-4ed3-8db6-b6e31ff965e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:11.188826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a954fba8-84b8-4ed3-8db6-b6e31ff965e2 admin admin] PATH_INFO: `/v3/users/ef22032f2d47431889b5cd81d23f14ae` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:11.190736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954fba8-84b8-4ed3-8db6-b6e31ff965e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef22032f2d47431889b5cd81d23f14ae)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:11.201034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a954fba8-84b8-4ed3-8db6-b6e31ff965e2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:11.322342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630108e2-daf3-478a-9fae-3df152066bb3 service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:11.328223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5662d9-4169-477f-bdf2-c09804f36aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:11.330386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5662d9-4169-477f-bdf2-c09804f36aa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:11.330905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5662d9-4169-477f-bdf2-c09804f36aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:11.331407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5662d9-4169-477f-bdf2-c09804f36aa4 admin admin] PATH_INFO: `/v3/users/71108fef34004221843a3c6a3881f241` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:11.333576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5662d9-4169-477f-bdf2-c09804f36aa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71108fef34004221843a3c6a3881f241)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:11.341465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5662d9-4169-477f-bdf2-c09804f36aa4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:11.487549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a954fba8-84b8-4ed3-8db6-b6e31ff965e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef22032f2d47431889b5cd81d23f14ae'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:11.518459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a954fba8-84b8-4ed3-8db6-b6e31ff965e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef22032f2d47431889b5cd81d23f14ae'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:11.528714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a954fba8-84b8-4ed3-8db6-b6e31ff965e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef22032f2d47431889b5cd81d23f14ae'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:11.529514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a954fba8-84b8-4ed3-8db6-b6e31ff965e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef22032f2d47431889b5cd81d23f14ae'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:11.560242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3d5662d9-4169-477f-bdf2-c09804f36aa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71108fef34004221843a3c6a3881f241'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:11.581632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3d5662d9-4169-477f-bdf2-c09804f36aa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71108fef34004221843a3c6a3881f241'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:11.583467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3d5662d9-4169-477f-bdf2-c09804f36aa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71108fef34004221843a3c6a3881f241'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:11.584415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3d5662d9-4169-477f-bdf2-c09804f36aa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71108fef34004221843a3c6a3881f241'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:11.595096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a954fba8-84b8-4ed3-8db6-b6e31ff965e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef22032f2d47431889b5cd81d23f14ae'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:11.606220 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2787/5522] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:38:11 2022] DELETE /identity/v3/users/ef22032f2d47431889b5cd81d23f14ae => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:11.622640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3d5662d9-4169-477f-bdf2-c09804f36aa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71108fef34004221843a3c6a3881f241'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:11.723856 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2736/5523] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:38:11 2022] DELETE /identity/v3/users/71108fef34004221843a3c6a3881f241 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:38:11.730474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca55b7-05b7-4812-b097-d141e0444f8e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:11.731114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca55b7-05b7-4812-b097-d141e0444f8e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:11.731604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca55b7-05b7-4812-b097-d141e0444f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:11.767131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8aca55b7-05b7-4812-b097-d141e0444f8e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:11.773157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8aca55b7-05b7-4812-b097-d141e0444f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:11.917712 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2788/5524] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:11.929505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5662d9-4169-477f-bdf2-c09804f36aa4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:11.931065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3d5662d9-4169-477f-bdf2-c09804f36aa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:11.967469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca55b7-05b7-4812-b097-d141e0444f8e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:11.968951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8aca55b7-05b7-4812-b097-d141e0444f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:12.009570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca55b7-05b7-4812-b097-d141e0444f8e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:12.020949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60b801-52cc-477b-9e22-c628b6e057fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:12.021847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60b801-52cc-477b-9e22-c628b6e057fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:12.022157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60b801-52cc-477b-9e22-c628b6e057fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:12.022440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60b801-52cc-477b-9e22-c628b6e057fb admin admin] PATH_INFO: `/v3/projects/ee10ec89efbc49eab5c3dddc3aa346ca` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:12.023849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60b801-52cc-477b-9e22-c628b6e057fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee10ec89efbc49eab5c3dddc3aa346ca)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:12.025880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60b801-52cc-477b-9e22-c628b6e057fb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:12.069530 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:12.101977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5662d9-4169-477f-bdf2-c09804f36aa4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:12.107304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff493e3a-c0ae-4b7e-9009-d9819555869f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:12.109062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff493e3a-c0ae-4b7e-9009-d9819555869f service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:12.111388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff493e3a-c0ae-4b7e-9009-d9819555869f service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:12.111388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff493e3a-c0ae-4b7e-9009-d9819555869f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:12.122727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff493e3a-c0ae-4b7e-9009-d9819555869f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:12.124373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff493e3a-c0ae-4b7e-9009-d9819555869f service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:12.141990 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2737/5525] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:38:12.293243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-af60b801-52cc-477b-9e22-c628b6e057fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee10ec89efbc49eab5c3dddc3aa346ca', 'request_id': 'req-af60b801-52cc-477b-9e22-c628b6e057fb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:12.308900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-af60b801-52cc-477b-9e22-c628b6e057fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee10ec89efbc49eab5c3dddc3aa346ca', 'request_id': 'req-af60b801-52cc-477b-9e22-c628b6e057fb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:12.317828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-af60b801-52cc-477b-9e22-c628b6e057fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee10ec89efbc49eab5c3dddc3aa346ca', 'request_id': 'req-af60b801-52cc-477b-9e22-c628b6e057fb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:12.401998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-af60b801-52cc-477b-9e22-c628b6e057fb admin admin] The token cache is being invalidate because project ee10ec89efbc49eab5c3dddc3aa346ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:38:12.407053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-af60b801-52cc-477b-9e22-c628b6e057fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:12.407053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-af60b801-52cc-477b-9e22-c628b6e057fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:12.407053 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2789/5526] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:38:11 2022] DELETE /identity/v3/projects/ee10ec89efbc49eab5c3dddc3aa346ca => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:38:12.411491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c14ef-7726-4459-b1ce-11f718ab5217 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:12.412029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c14ef-7726-4459-b1ce-11f718ab5217 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:12.412567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c14ef-7726-4459-b1ce-11f718ab5217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:12.442882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ce5c14ef-7726-4459-b1ce-11f718ab5217 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:12.444925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ce5c14ef-7726-4459-b1ce-11f718ab5217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:12.465785 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:12.525689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60b801-52cc-477b-9e22-c628b6e057fb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:12.527319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-af60b801-52cc-477b-9e22-c628b6e057fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:12.547383 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2738/5527] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:12.563114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cd7a7-353a-4b4e-b0c9-d89bbe34fced None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:12.563421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cd7a7-353a-4b4e-b0c9-d89bbe34fced None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:12.563709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cd7a7-353a-4b4e-b0c9-d89bbe34fced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:12.592313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4b6cd7a7-353a-4b4e-b0c9-d89bbe34fced None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:12.593851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4b6cd7a7-353a-4b4e-b0c9-d89bbe34fced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:12.606144 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2739/5528] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:12.609334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cd7a7-353a-4b4e-b0c9-d89bbe34fced None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:12.620193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cd7a7-353a-4b4e-b0c9-d89bbe34fced None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:12.626137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb4d8a-a564-4c00-8388-7eed31186928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:12.627631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb4d8a-a564-4c00-8388-7eed31186928 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:12.627631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb4d8a-a564-4c00-8388-7eed31186928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:12.627818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb4d8a-a564-4c00-8388-7eed31186928 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:12.629403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb4d8a-a564-4c00-8388-7eed31186928 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:38:12.629403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb4d8a-a564-4c00-8388-7eed31186928 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:12.631157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb4d8a-a564-4c00-8388-7eed31186928 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:12.645085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60b801-52cc-477b-9e22-c628b6e057fb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:12.650521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548ea31e-e32b-4639-bbd7-fd7f8a49463d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:12.650718 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2740/5529] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:38:12.651510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ea31e-e32b-4639-bbd7-fd7f8a49463d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:12.651645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb4d8a-a564-4c00-8388-7eed31186928 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:12.651977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ea31e-e32b-4639-bbd7-fd7f8a49463d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:12.652357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548ea31e-e32b-4639-bbd7-fd7f8a49463d admin admin] PATH_INFO: `/v3/projects/3e2377de7b0a47c9a8b1010f33210dad` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:12.653734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ea31e-e32b-4639-bbd7-fd7f8a49463d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e2377de7b0a47c9a8b1010f33210dad)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:12.656213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548ea31e-e32b-4639-bbd7-fd7f8a49463d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:12.664638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb4d8a-a564-4c00-8388-7eed31186928 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:12.670995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2218a-5146-471e-bbbb-341c1cf90086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:12.671962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2218a-5146-471e-bbbb-341c1cf90086 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:12.672353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2218a-5146-471e-bbbb-341c1cf90086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:12.672726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2218a-5146-471e-bbbb-341c1cf90086 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:12.673387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2218a-5146-471e-bbbb-341c1cf90086 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:12.676557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2218a-5146-471e-bbbb-341c1cf90086 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:12.817247 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2741/5530] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:38:12 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:38:12.821508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2218a-5146-471e-bbbb-341c1cf90086 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:12.827280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-548ea31e-e32b-4639-bbd7-fd7f8a49463d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e2377de7b0a47c9a8b1010f33210dad', 'request_id': 'req-548ea31e-e32b-4639-bbd7-fd7f8a49463d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:12.833954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-548ea31e-e32b-4639-bbd7-fd7f8a49463d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e2377de7b0a47c9a8b1010f33210dad', 'request_id': 'req-548ea31e-e32b-4639-bbd7-fd7f8a49463d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:12.841840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-548ea31e-e32b-4639-bbd7-fd7f8a49463d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e2377de7b0a47c9a8b1010f33210dad', 'request_id': 'req-548ea31e-e32b-4639-bbd7-fd7f8a49463d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:12.907473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2218a-5146-471e-bbbb-341c1cf90086 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:12.920570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-548ea31e-e32b-4639-bbd7-fd7f8a49463d admin admin] The token cache is being invalidate because project 3e2377de7b0a47c9a8b1010f33210dad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:38:12.923497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-548ea31e-e32b-4639-bbd7-fd7f8a49463d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:12.923497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-548ea31e-e32b-4639-bbd7-fd7f8a49463d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:12.923686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5df3f-45bc-478a-86b5-59f7a641867e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:12.923936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5df3f-45bc-478a-86b5-59f7a641867e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:12.924192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5df3f-45bc-478a-86b5-59f7a641867e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:12.924459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da5df3f-45bc-478a-86b5-59f7a641867e admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:12.925163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5df3f-45bc-478a-86b5-59f7a641867e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:12.927739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da5df3f-45bc-478a-86b5-59f7a641867e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:12.933382 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2790/5531] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:38:12 2022] DELETE /identity/v3/projects/3e2377de7b0a47c9a8b1010f33210dad => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:12.935024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08e78a-e5f5-4070-a214-4958b95e5564 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:12.935354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08e78a-e5f5-4070-a214-4958b95e5564 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:12.935606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08e78a-e5f5-4070-a214-4958b95e5564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:12.958406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0b08e78a-e5f5-4070-a214-4958b95e5564 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:12.958406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0b08e78a-e5f5-4070-a214-4958b95e5564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:12.974220 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2791/5532] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:38:12.976882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ea8d7-2c47-4592-af4d-6e909c6e17e1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:12.978967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ea8d7-2c47-4592-af4d-6e909c6e17e1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:12.979529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ea8d7-2c47-4592-af4d-6e909c6e17e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:13.000583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-971ea8d7-2c47-4592-af4d-6e909c6e17e1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:13.002502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-971ea8d7-2c47-4592-af4d-6e909c6e17e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:13.019279 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2792/5533] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:13.024264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ea8d7-2c47-4592-af4d-6e909c6e17e1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:13.039739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ea8d7-2c47-4592-af4d-6e909c6e17e1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:13.053992 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2742/5534] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:38:12 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:38:13.054775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373756b-773e-40bd-862a-a97fde46e1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:13.055828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373756b-773e-40bd-862a-a97fde46e1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:13.056176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373756b-773e-40bd-862a-a97fde46e1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:13.056634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373756b-773e-40bd-862a-a97fde46e1c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:13.059836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5df3f-45bc-478a-86b5-59f7a641867e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:13.065782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5da5df3f-45bc-478a-86b5-59f7a641867e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:13.065917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373756b-773e-40bd-862a-a97fde46e1c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:38:13.065917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373756b-773e-40bd-862a-a97fde46e1c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:13.065917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f373756b-773e-40bd-862a-a97fde46e1c6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:13.079345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da5df3f-45bc-478a-86b5-59f7a641867e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:13.083684 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2793/5535] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:38:13.084850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373756b-773e-40bd-862a-a97fde46e1c6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:13.085315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252292f-1344-4d64-8cd9-39d0ea5dd66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:13.086226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252292f-1344-4d64-8cd9-39d0ea5dd66a admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:13.086584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252292f-1344-4d64-8cd9-39d0ea5dd66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:13.086931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252292f-1344-4d64-8cd9-39d0ea5dd66a admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:13.087736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252292f-1344-4d64-8cd9-39d0ea5dd66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:13.089438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f252292f-1344-4d64-8cd9-39d0ea5dd66a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:13.098972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373756b-773e-40bd-862a-a97fde46e1c6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:13.104207 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2743/5536] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:38:13.108193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c9c88-b2e4-4cab-be86-a8545600ce03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:13.108193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c9c88-b2e4-4cab-be86-a8545600ce03 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:13.108193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c9c88-b2e4-4cab-be86-a8545600ce03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:13.108193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192c9c88-b2e4-4cab-be86-a8545600ce03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:13.108652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c9c88-b2e4-4cab-be86-a8545600ce03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:13.109591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192c9c88-b2e4-4cab-be86-a8545600ce03 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:13.110902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252292f-1344-4d64-8cd9-39d0ea5dd66a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:13.117235 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:13.122670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f252292f-1344-4d64-8cd9-39d0ea5dd66a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:13.130428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7923e-3288-42db-93a1-2e382af4f1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:13.131260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7923e-3288-42db-93a1-2e382af4f1ea admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:13.131863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7923e-3288-42db-93a1-2e382af4f1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:13.132256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be7923e-3288-42db-93a1-2e382af4f1ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:13.133184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7923e-3288-42db-93a1-2e382af4f1ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:13.135042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be7923e-3288-42db-93a1-2e382af4f1ea admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:13.149625 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2744/5537] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:38:13.153820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7923e-3288-42db-93a1-2e382af4f1ea admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:13.168138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be7923e-3288-42db-93a1-2e382af4f1ea admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:13.172477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b8d0d-d10d-4bf7-bbd7-488b986b698c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:13.173532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b8d0d-d10d-4bf7-bbd7-488b986b698c admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:13.176625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b8d0d-d10d-4bf7-bbd7-488b986b698c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:13.176625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b8d0d-d10d-4bf7-bbd7-488b986b698c admin admin] PATH_INFO: `/v3/projects/f77a40c726f042848654cb8e3c3dc983/users/946a406858114cce8f4c9de45103f68a/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:13.193620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b8d0d-d10d-4bf7-bbd7-488b986b698c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77a40c726f042848654cb8e3c3dc983, user_id=946a406858114cce8f4c9de45103f68a, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:13.197267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9b8d0d-d10d-4bf7-bbd7-488b986b698c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:13.242628 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2794/5538] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:38:13 2022] POST /identity/v3/projects => generated 403 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:38:13.244381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c9c88-b2e4-4cab-be86-a8545600ce03 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:13.294287 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2745/5539] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:38:13 2022] PUT /identity/v3/projects/f77a40c726f042848654cb8e3c3dc983/users/946a406858114cce8f4c9de45103f68a/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:13.305904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6050699-f7f5-468f-b36e-a8feea01164e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:13.306252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6050699-f7f5-468f-b36e-a8feea01164e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:13.306543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6050699-f7f5-468f-b36e-a8feea01164e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:13.342414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a6050699-f7f5-468f-b36e-a8feea01164e None None] MFA Rules not processed for user `946a406858114cce8f4c9de45103f68a`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:13.343661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a6050699-f7f5-468f-b36e-a8feea01164e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:13.348499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192c9c88-b2e4-4cab-be86-a8545600ce03 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:13.366961 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:13.431035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a9dbf-92f2-4b95-a98d-a34feaaef342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:13.431870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a9dbf-92f2-4b95-a98d-a34feaaef342 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:13.432181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a9dbf-92f2-4b95-a98d-a34feaaef342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:13.432536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a9dbf-92f2-4b95-a98d-a34feaaef342 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:13.433500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a9dbf-92f2-4b95-a98d-a34feaaef342 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:13.435570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a9dbf-92f2-4b95-a98d-a34feaaef342 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:13.447237 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2746/5540] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:38:13.461258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bf9a2-d53d-4f1b-9080-db8699b8a354 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:13.461840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bf9a2-d53d-4f1b-9080-db8699b8a354 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:13.462163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bf9a2-d53d-4f1b-9080-db8699b8a354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:13.481282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-518bf9a2-d53d-4f1b-9080-db8699b8a354 None None] MFA Rules not processed for user `946a406858114cce8f4c9de45103f68a`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:13.482601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-518bf9a2-d53d-4f1b-9080-db8699b8a354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:13.496333 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2747/5541] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:13.505413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bf9a2-d53d-4f1b-9080-db8699b8a354 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:13.507937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-518bf9a2-d53d-4f1b-9080-db8699b8a354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:13.526542 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2795/5542] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:38:13 2022] POST /identity/v3/users => generated 302 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:38:13.527829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a9dbf-92f2-4b95-a98d-a34feaaef342 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:13.540589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a9dbf-92f2-4b95-a98d-a34feaaef342 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:13.546428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946b38b-06f5-40e2-a3cf-3ee07741f515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:13.547707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946b38b-06f5-40e2-a3cf-3ee07741f515 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:13.548181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946b38b-06f5-40e2-a3cf-3ee07741f515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:13.548638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9946b38b-06f5-40e2-a3cf-3ee07741f515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:13.549495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946b38b-06f5-40e2-a3cf-3ee07741f515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:13.551199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9946b38b-06f5-40e2-a3cf-3ee07741f515 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:13.568404 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2796/5543] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:38:13.569865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946b38b-06f5-40e2-a3cf-3ee07741f515 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:13.581245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9946b38b-06f5-40e2-a3cf-3ee07741f515 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:13.588115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45c177-7982-4219-88f9-de8f86c9857b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:13.588916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45c177-7982-4219-88f9-de8f86c9857b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:13.589652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45c177-7982-4219-88f9-de8f86c9857b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:13.589652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba45c177-7982-4219-88f9-de8f86c9857b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:13.590503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45c177-7982-4219-88f9-de8f86c9857b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:13.592176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba45c177-7982-4219-88f9-de8f86c9857b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:13.606185 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2797/5544] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:38:13.608954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45c177-7982-4219-88f9-de8f86c9857b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:13.622538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bf9a2-d53d-4f1b-9080-db8699b8a354 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:13.624216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba45c177-7982-4219-88f9-de8f86c9857b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:13.626008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab17479-24dd-44fc-b92e-bb8ba5339a69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:13.627461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab17479-24dd-44fc-b92e-bb8ba5339a69 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:13.628027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab17479-24dd-44fc-b92e-bb8ba5339a69 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:13.628506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab17479-24dd-44fc-b92e-bb8ba5339a69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:13.630713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a523b-73ef-4f7c-9d3b-cd37c88e02f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:13.631695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a523b-73ef-4f7c-9d3b-cd37c88e02f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:13.632018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a523b-73ef-4f7c-9d3b-cd37c88e02f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:13.632380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a523b-73ef-4f7c-9d3b-cd37c88e02f4 admin admin] PATH_INFO: `/v3/projects/4229ab569b3b4c0c940096457eeff191/users/5c7b2669a0bd42f9b829abebfca0063c/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:13.641717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab17479-24dd-44fc-b92e-bb8ba5339a69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:13.645191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab17479-24dd-44fc-b92e-bb8ba5339a69 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:13.652824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a523b-73ef-4f7c-9d3b-cd37c88e02f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4229ab569b3b4c0c940096457eeff191, user_id=5c7b2669a0bd42f9b829abebfca0063c, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:13.655611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a523b-73ef-4f7c-9d3b-cd37c88e02f4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:13.658504 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2748/5545] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:38:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:38:13.748408 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2798/5546] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:38:13 2022] PUT /identity/v3/projects/4229ab569b3b4c0c940096457eeff191/users/5c7b2669a0bd42f9b829abebfca0063c/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:38:13.749902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c8680-68b0-4b61-9ddd-395242ed9280 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:13.750247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c8680-68b0-4b61-9ddd-395242ed9280 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:13.750536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c8680-68b0-4b61-9ddd-395242ed9280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:13.820700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7b9c8680-68b0-4b61-9ddd-395242ed9280 None None] MFA Rules not processed for user `5c7b2669a0bd42f9b829abebfca0063c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:13.822890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7b9c8680-68b0-4b61-9ddd-395242ed9280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:13.930320 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2749/5547] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:38:13.934760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a523b-73ef-4f7c-9d3b-cd37c88e02f4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:14.010394 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:14.049365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a523b-73ef-4f7c-9d3b-cd37c88e02f4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:14.070582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447be4c-8348-4c30-8c82-01271de5515e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:14.072631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447be4c-8348-4c30-8c82-01271de5515e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:14.073834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447be4c-8348-4c30-8c82-01271de5515e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:14.074372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5447be4c-8348-4c30-8c82-01271de5515e admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:14.075820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447be4c-8348-4c30-8c82-01271de5515e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:14.094426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5447be4c-8348-4c30-8c82-01271de5515e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:14.237108 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2799/5548] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:38:13 2022] POST /identity/v3/projects => generated 405 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:38:14.241547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c8680-68b0-4b61-9ddd-395242ed9280 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:14.258252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c8680-68b0-4b61-9ddd-395242ed9280 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:14.333933 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:14.434711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320a3af-a264-4e79-a697-29c1d47baa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:14.435615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320a3af-a264-4e79-a697-29c1d47baa7c admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:14.436067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320a3af-a264-4e79-a697-29c1d47baa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:14.436508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5320a3af-a264-4e79-a697-29c1d47baa7c admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:14.437420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320a3af-a264-4e79-a697-29c1d47baa7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:14.440483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5320a3af-a264-4e79-a697-29c1d47baa7c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:14.539727 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2750/5549] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:38:14 2022] POST /identity/v3/users => generated 309 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:38:14.549000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447be4c-8348-4c30-8c82-01271de5515e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:14.571327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5447be4c-8348-4c30-8c82-01271de5515e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:14.592527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581c467-90c5-47e4-a7b8-b46ad4b160b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:14.592527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581c467-90c5-47e4-a7b8-b46ad4b160b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:14.592527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581c467-90c5-47e4-a7b8-b46ad4b160b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:14.592527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581c467-90c5-47e4-a7b8-b46ad4b160b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:14.593400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581c467-90c5-47e4-a7b8-b46ad4b160b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:14.593400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581c467-90c5-47e4-a7b8-b46ad4b160b4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:14.612048 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2800/5550] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:38:14.616700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320a3af-a264-4e79-a697-29c1d47baa7c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:14.628281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5320a3af-a264-4e79-a697-29c1d47baa7c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:14.633418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cca5a-dd82-4d3f-bf4b-6c6ca7437cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:14.634588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cca5a-dd82-4d3f-bf4b-6c6ca7437cf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:14.635950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cca5a-dd82-4d3f-bf4b-6c6ca7437cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:14.636110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cca5a-dd82-4d3f-bf4b-6c6ca7437cf5 admin admin] PATH_INFO: `/v3/projects/2ce91c5714f3454ab9650174f26c69be/users/973da774b59f412e92889cdb447089e7/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:14.661643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cca5a-dd82-4d3f-bf4b-6c6ca7437cf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce91c5714f3454ab9650174f26c69be, user_id=973da774b59f412e92889cdb447089e7, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:14.664788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cca5a-dd82-4d3f-bf4b-6c6ca7437cf5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:14.771504 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2751/5551] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:38:14 2022] PUT /identity/v3/projects/2ce91c5714f3454ab9650174f26c69be/users/973da774b59f412e92889cdb447089e7/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:14.772467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581c467-90c5-47e4-a7b8-b46ad4b160b4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:14.789923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581c467-90c5-47e4-a7b8-b46ad4b160b4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:14.927660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5519dba-1ec6-40de-8ad3-4dd604f2656c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:14.928476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5519dba-1ec6-40de-8ad3-4dd604f2656c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:14.928868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5519dba-1ec6-40de-8ad3-4dd604f2656c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:14.929264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5519dba-1ec6-40de-8ad3-4dd604f2656c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:14.930355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5519dba-1ec6-40de-8ad3-4dd604f2656c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:14.934421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5519dba-1ec6-40de-8ad3-4dd604f2656c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:14.947796 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2801/5552] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:38:14.948807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cca5a-dd82-4d3f-bf4b-6c6ca7437cf5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:14.961111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cca5a-dd82-4d3f-bf4b-6c6ca7437cf5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:14.966479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66284a3-9071-46ce-bc8b-527bc9fb24c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:14.967452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66284a3-9071-46ce-bc8b-527bc9fb24c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:14.967811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66284a3-9071-46ce-bc8b-527bc9fb24c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:14.968163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66284a3-9071-46ce-bc8b-527bc9fb24c5 admin admin] PATH_INFO: `/v3/projects/2ce91c5714f3454ab9650174f26c69be/users/973da774b59f412e92889cdb447089e7/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:14.970310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66284a3-9071-46ce-bc8b-527bc9fb24c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce91c5714f3454ab9650174f26c69be, user_id=973da774b59f412e92889cdb447089e7, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:14.973788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66284a3-9071-46ce-bc8b-527bc9fb24c5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:14.988583 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2752/5553] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:38:14 2022] PUT /identity/v3/projects/2ce91c5714f3454ab9650174f26c69be/users/973da774b59f412e92889cdb447089e7/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:38:15.004570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba133ef-387e-4d47-b59d-57acee7d7d75 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:15.004863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba133ef-387e-4d47-b59d-57acee7d7d75 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:15.005145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba133ef-387e-4d47-b59d-57acee7d7d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:15.041749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-cba133ef-387e-4d47-b59d-57acee7d7d75 None None] MFA Rules not processed for user `973da774b59f412e92889cdb447089e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:15.043031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cba133ef-387e-4d47-b59d-57acee7d7d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:15.167075 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2802/5554] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:15 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:17.025964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66284a3-9071-46ce-bc8b-527bc9fb24c5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:17.028373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f66284a3-9071-46ce-bc8b-527bc9fb24c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:17.255563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66284a3-9071-46ce-bc8b-527bc9fb24c5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:17.264421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37816e89-01b2-4041-8c08-7aa9e3f9cc7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:17.265443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37816e89-01b2-4041-8c08-7aa9e3f9cc7e service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:17.266011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37816e89-01b2-4041-8c08-7aa9e3f9cc7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:17.266154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37816e89-01b2-4041-8c08-7aa9e3f9cc7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:17.291304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37816e89-01b2-4041-8c08-7aa9e3f9cc7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:17.292785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37816e89-01b2-4041-8c08-7aa9e3f9cc7e service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:17.320037 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2753/5555] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:38:17 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:38:18.053849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba133ef-387e-4d47-b59d-57acee7d7d75 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:18.180661 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:18.259260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba133ef-387e-4d47-b59d-57acee7d7d75 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:18.270740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995eb905-4e0a-4f6f-8c55-bca93c66a864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:18.271919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eb905-4e0a-4f6f-8c55-bca93c66a864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:18.272407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eb905-4e0a-4f6f-8c55-bca93c66a864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:18.272900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995eb905-4e0a-4f6f-8c55-bca93c66a864 admin admin] PATH_INFO: `/v3/users/5c7b2669a0bd42f9b829abebfca0063c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:18.275477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995eb905-4e0a-4f6f-8c55-bca93c66a864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c7b2669a0bd42f9b829abebfca0063c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:18.280569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995eb905-4e0a-4f6f-8c55-bca93c66a864 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:18.572845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-995eb905-4e0a-4f6f-8c55-bca93c66a864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c7b2669a0bd42f9b829abebfca0063c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:18.597685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-995eb905-4e0a-4f6f-8c55-bca93c66a864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c7b2669a0bd42f9b829abebfca0063c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:18.614741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-995eb905-4e0a-4f6f-8c55-bca93c66a864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c7b2669a0bd42f9b829abebfca0063c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:18.616325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-995eb905-4e0a-4f6f-8c55-bca93c66a864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c7b2669a0bd42f9b829abebfca0063c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:18.746017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37816e89-01b2-4041-8c08-7aa9e3f9cc7e service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:18.763573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37816e89-01b2-4041-8c08-7aa9e3f9cc7e service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:18.768152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfd40b-3bba-4c26-9e03-61f32a4ee109 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:18.769044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfd40b-3bba-4c26-9e03-61f32a4ee109 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:18.771456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfd40b-3bba-4c26-9e03-61f32a4ee109 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:18.771456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfd40b-3bba-4c26-9e03-61f32a4ee109 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:18.772590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-995eb905-4e0a-4f6f-8c55-bca93c66a864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c7b2669a0bd42f9b829abebfca0063c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:18.773738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-50cfd40b-3bba-4c26-9e03-61f32a4ee109 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:18.782797 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2803/5556] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:38:18 2022] DELETE /identity/v3/users/5c7b2669a0bd42f9b829abebfca0063c => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:38:18.788839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3f39a-7f5a-441e-9bf2-82de452d3354 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:18.789131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3f39a-7f5a-441e-9bf2-82de452d3354 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:18.789894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3f39a-7f5a-441e-9bf2-82de452d3354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:18.848677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-70e3f39a-7f5a-441e-9bf2-82de452d3354 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:18.850558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-70e3f39a-7f5a-441e-9bf2-82de452d3354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:18.936349 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:18.944939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfd40b-3bba-4c26-9e03-61f32a4ee109 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:18.946717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfd40b-3bba-4c26-9e03-61f32a4ee109 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:18.982192 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2754/5557] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:38:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:38:19.010783 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2804/5558] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:19.028987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfd40b-3bba-4c26-9e03-61f32a4ee109 service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:19.030517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-50cfd40b-3bba-4c26-9e03-61f32a4ee109 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:19.169578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfd40b-3bba-4c26-9e03-61f32a4ee109 service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:19.256423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a3d07-32f8-476d-99df-54470996b67a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:19.257341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a3d07-32f8-476d-99df-54470996b67a service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:19.257693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a3d07-32f8-476d-99df-54470996b67a service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:19.258049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9a3d07-32f8-476d-99df-54470996b67a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:19.269767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a3d07-32f8-476d-99df-54470996b67a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:19.271613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9a3d07-32f8-476d-99df-54470996b67a service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:19.284696 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2755/5559] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:38:19.999064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3f39a-7f5a-441e-9bf2-82de452d3354 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:20.001204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-70e3f39a-7f5a-441e-9bf2-82de452d3354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:20.040521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3f39a-7f5a-441e-9bf2-82de452d3354 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:20.058639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a45cc-aef9-449b-8791-adc0a7627cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:20.059831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a45cc-aef9-449b-8791-adc0a7627cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:20.060218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a45cc-aef9-449b-8791-adc0a7627cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:20.060653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3a45cc-aef9-449b-8791-adc0a7627cb4 admin admin] PATH_INFO: `/v3/projects/4229ab569b3b4c0c940096457eeff191` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:20.062903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a45cc-aef9-449b-8791-adc0a7627cb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4229ab569b3b4c0c940096457eeff191)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:20.070333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3a45cc-aef9-449b-8791-adc0a7627cb4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:20.226272 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:20.236283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-af3a45cc-aef9-449b-8791-adc0a7627cb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4229ab569b3b4c0c940096457eeff191', 'request_id': 'req-af3a45cc-aef9-449b-8791-adc0a7627cb4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:20.258589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-af3a45cc-aef9-449b-8791-adc0a7627cb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4229ab569b3b4c0c940096457eeff191', 'request_id': 'req-af3a45cc-aef9-449b-8791-adc0a7627cb4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:20.269425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-af3a45cc-aef9-449b-8791-adc0a7627cb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4229ab569b3b4c0c940096457eeff191', 'request_id': 'req-af3a45cc-aef9-449b-8791-adc0a7627cb4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:20.392369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-af3a45cc-aef9-449b-8791-adc0a7627cb4 admin admin] The token cache is being invalidate because project 4229ab569b3b4c0c940096457eeff191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:38:20.392867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-af3a45cc-aef9-449b-8791-adc0a7627cb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:20.394050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-af3a45cc-aef9-449b-8791-adc0a7627cb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:20.396380 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2805/5560] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:38:19 2022] DELETE /identity/v3/projects/4229ab569b3b4c0c940096457eeff191 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:20.400607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a3d07-32f8-476d-99df-54470996b67a service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:20.411193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9a3d07-32f8-476d-99df-54470996b67a service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:20.489452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657fb091-9398-4e88-b63d-7cea6c5b338a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:20.490534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fb091-9398-4e88-b63d-7cea6c5b338a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:20.490917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fb091-9398-4e88-b63d-7cea6c5b338a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:20.491444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657fb091-9398-4e88-b63d-7cea6c5b338a admin admin] PATH_INFO: `/v3/users/973da774b59f412e92889cdb447089e7` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:20.493331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fb091-9398-4e88-b63d-7cea6c5b338a admin admin] RBAC: Authorizing `identity:delete_user(user_id=973da774b59f412e92889cdb447089e7)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:20.497035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657fb091-9398-4e88-b63d-7cea6c5b338a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:20.750323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-657fb091-9398-4e88-b63d-7cea6c5b338a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '973da774b59f412e92889cdb447089e7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:20.760813 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:20.767035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-657fb091-9398-4e88-b63d-7cea6c5b338a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '973da774b59f412e92889cdb447089e7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:20.767728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-657fb091-9398-4e88-b63d-7cea6c5b338a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '973da774b59f412e92889cdb447089e7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:20.768401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-657fb091-9398-4e88-b63d-7cea6c5b338a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '973da774b59f412e92889cdb447089e7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:20.776683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-657fb091-9398-4e88-b63d-7cea6c5b338a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '973da774b59f412e92889cdb447089e7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:20.898563 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2756/5561] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:38:20 2022] DELETE /identity/v3/users/973da774b59f412e92889cdb447089e7 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:22.182462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a45cc-aef9-449b-8791-adc0a7627cb4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:22.185502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-af3a45cc-aef9-449b-8791-adc0a7627cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:22.243170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3a45cc-aef9-449b-8791-adc0a7627cb4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:22.410641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141dbe99-a6cd-4943-b53a-9a77a164ddd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:22.419530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141dbe99-a6cd-4943-b53a-9a77a164ddd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:22.419949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141dbe99-a6cd-4943-b53a-9a77a164ddd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:22.420322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141dbe99-a6cd-4943-b53a-9a77a164ddd3 admin admin] PATH_INFO: `/v3/projects/2ce91c5714f3454ab9650174f26c69be` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:22.423360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141dbe99-a6cd-4943-b53a-9a77a164ddd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ce91c5714f3454ab9650174f26c69be)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:22.426073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141dbe99-a6cd-4943-b53a-9a77a164ddd3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:22.667599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-141dbe99-a6cd-4943-b53a-9a77a164ddd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ce91c5714f3454ab9650174f26c69be', 'request_id': 'req-141dbe99-a6cd-4943-b53a-9a77a164ddd3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:22.740187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-141dbe99-a6cd-4943-b53a-9a77a164ddd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ce91c5714f3454ab9650174f26c69be', 'request_id': 'req-141dbe99-a6cd-4943-b53a-9a77a164ddd3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:22.771259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-141dbe99-a6cd-4943-b53a-9a77a164ddd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ce91c5714f3454ab9650174f26c69be', 'request_id': 'req-141dbe99-a6cd-4943-b53a-9a77a164ddd3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:22.892460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-141dbe99-a6cd-4943-b53a-9a77a164ddd3 admin admin] The token cache is being invalidate because project 2ce91c5714f3454ab9650174f26c69be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:38:22.893067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-141dbe99-a6cd-4943-b53a-9a77a164ddd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:22.894270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-141dbe99-a6cd-4943-b53a-9a77a164ddd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:22.900875 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2806/5562] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:38:22 2022] DELETE /identity/v3/projects/2ce91c5714f3454ab9650174f26c69be => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:22.907223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b187b-0d1c-45ba-a1b7-e14970aa4526 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:22.907223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b187b-0d1c-45ba-a1b7-e14970aa4526 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:22.907885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b187b-0d1c-45ba-a1b7-e14970aa4526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:22.982561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b00b187b-0d1c-45ba-a1b7-e14970aa4526 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:22.992912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b00b187b-0d1c-45ba-a1b7-e14970aa4526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:23.186482 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2757/5563] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:23.194613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdae9a2-6029-453c-86b3-831b70bd6588 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:23.195211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdae9a2-6029-453c-86b3-831b70bd6588 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:23.195211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdae9a2-6029-453c-86b3-831b70bd6588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:23.253140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0bdae9a2-6029-453c-86b3-831b70bd6588 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:23.255004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0bdae9a2-6029-453c-86b3-831b70bd6588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:23.283112 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2807/5564] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:23.285883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b187b-0d1c-45ba-a1b7-e14970aa4526 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:23.307484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b187b-0d1c-45ba-a1b7-e14970aa4526 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:23.327894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac834592-eb86-4bdc-a09f-494fa0ce1207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:23.328599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac834592-eb86-4bdc-a09f-494fa0ce1207 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:23.328890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac834592-eb86-4bdc-a09f-494fa0ce1207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:23.329169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac834592-eb86-4bdc-a09f-494fa0ce1207 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:23.329922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac834592-eb86-4bdc-a09f-494fa0ce1207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:38:23.330264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac834592-eb86-4bdc-a09f-494fa0ce1207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:23.331909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac834592-eb86-4bdc-a09f-494fa0ce1207 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:23.370720 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2758/5565] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:38:23.375498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdae9a2-6029-453c-86b3-831b70bd6588 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:23.385934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdae9a2-6029-453c-86b3-831b70bd6588 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:23.408469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e776a6-c141-494e-bb06-5f53830fcbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:23.410496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e776a6-c141-494e-bb06-5f53830fcbd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:23.414621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e776a6-c141-494e-bb06-5f53830fcbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:23.415229 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e776a6-c141-494e-bb06-5f53830fcbd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:23.416197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e776a6-c141-494e-bb06-5f53830fcbd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:23.429315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e776a6-c141-494e-bb06-5f53830fcbd1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:23.584776 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2808/5566] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:38:23 2022] POST /identity/v3/projects => generated 373 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:38:23.588854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac834592-eb86-4bdc-a09f-494fa0ce1207 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:23.609058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac834592-eb86-4bdc-a09f-494fa0ce1207 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:23.846532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51548b03-b6ab-4304-a29a-b7d80c211fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:23.847268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51548b03-b6ab-4304-a29a-b7d80c211fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:23.847665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51548b03-b6ab-4304-a29a-b7d80c211fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:23.848207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51548b03-b6ab-4304-a29a-b7d80c211fb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:23.848835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51548b03-b6ab-4304-a29a-b7d80c211fb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:23.853215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51548b03-b6ab-4304-a29a-b7d80c211fb7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:23.995794 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2759/5567] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:38:23 2022] POST /identity/v3/users => generated 287 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:38:24.000430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e776a6-c141-494e-bb06-5f53830fcbd1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:24.021673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e776a6-c141-494e-bb06-5f53830fcbd1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:24.037741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f4ba6-76eb-4cc7-9886-6afb125b3ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:24.038675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f4ba6-76eb-4cc7-9886-6afb125b3ceb admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:24.044577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f4ba6-76eb-4cc7-9886-6afb125b3ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:24.044577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f4ba6-76eb-4cc7-9886-6afb125b3ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:24.044577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f4ba6-76eb-4cc7-9886-6afb125b3ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:24.044577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f4ba6-76eb-4cc7-9886-6afb125b3ceb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:24.071673 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2809/5568] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:38:24.075534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51548b03-b6ab-4304-a29a-b7d80c211fb7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:24.108790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51548b03-b6ab-4304-a29a-b7d80c211fb7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:24.109085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f4ba6-76eb-4cc7-9886-6afb125b3ceb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:24.109685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9b7f4ba6-76eb-4cc7-9886-6afb125b3ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:24.110932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b57f0a-14c2-4a76-b926-c7d07d0de684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:24.111972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b57f0a-14c2-4a76-b926-c7d07d0de684 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:24.112766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b57f0a-14c2-4a76-b926-c7d07d0de684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:24.112766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b57f0a-14c2-4a76-b926-c7d07d0de684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:24.114167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b57f0a-14c2-4a76-b926-c7d07d0de684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:24.115356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b57f0a-14c2-4a76-b926-c7d07d0de684 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:24.134328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f4ba6-76eb-4cc7-9886-6afb125b3ceb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:24.157730 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2760/5569] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:38:24 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:38:24.159635 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b57f0a-14c2-4a76-b926-c7d07d0de684 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:24.163771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2827c6-fd06-4d9e-8b6b-96787bb84b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:24.165846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2827c6-fd06-4d9e-8b6b-96787bb84b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:24.167353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2827c6-fd06-4d9e-8b6b-96787bb84b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:24.167834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2827c6-fd06-4d9e-8b6b-96787bb84b38 admin admin] PATH_INFO: `/v3/users/ea346f1c71964cc99cfe33d8fb81179a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:24.171598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2827c6-fd06-4d9e-8b6b-96787bb84b38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea346f1c71964cc99cfe33d8fb81179a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:24.177508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2827c6-fd06-4d9e-8b6b-96787bb84b38 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:24.184301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b57f0a-14c2-4a76-b926-c7d07d0de684 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:24.198850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f6750-2ab1-43d8-9212-d7d01a319869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:24.199919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f6750-2ab1-43d8-9212-d7d01a319869 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:24.200540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f6750-2ab1-43d8-9212-d7d01a319869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:24.201876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f6750-2ab1-43d8-9212-d7d01a319869 admin admin] PATH_INFO: `/v3/projects/673161871d6c452089cf06cba51ca39f/users/3d92fb491ef34777bcf90d811355f6f8/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:24.221521 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:24.241183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f6750-2ab1-43d8-9212-d7d01a319869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=673161871d6c452089cf06cba51ca39f, user_id=3d92fb491ef34777bcf90d811355f6f8, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:24.245970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f6750-2ab1-43d8-9212-d7d01a319869 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:24.440850 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2761/5570] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:38:24 2022] PUT /identity/v3/projects/673161871d6c452089cf06cba51ca39f/users/3d92fb491ef34777bcf90d811355f6f8/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:38:24.451972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107bcea-c9ec-4ac7-8a12-b619aef83fe5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:24.452523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107bcea-c9ec-4ac7-8a12-b619aef83fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:24.452978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5107bcea-c9ec-4ac7-8a12-b619aef83fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:24.512153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5107bcea-c9ec-4ac7-8a12-b619aef83fe5 None None] MFA Rules not processed for user `3d92fb491ef34777bcf90d811355f6f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:24.513980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5107bcea-c9ec-4ac7-8a12-b619aef83fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:24.519786 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:24.674461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ac2827c6-fd06-4d9e-8b6b-96787bb84b38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea346f1c71964cc99cfe33d8fb81179a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:24.676393 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2762/5571] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:24.677460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107bcea-c9ec-4ac7-8a12-b619aef83fe5 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:24.693046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ac2827c6-fd06-4d9e-8b6b-96787bb84b38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea346f1c71964cc99cfe33d8fb81179a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:24.704206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ac2827c6-fd06-4d9e-8b6b-96787bb84b38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea346f1c71964cc99cfe33d8fb81179a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:24.706853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ac2827c6-fd06-4d9e-8b6b-96787bb84b38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea346f1c71964cc99cfe33d8fb81179a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:24.824578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5107bcea-c9ec-4ac7-8a12-b619aef83fe5 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:24.844957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8f600-3152-4368-b52e-1827ddd3612a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:24.846002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8f600-3152-4368-b52e-1827ddd3612a admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:24.848089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8f600-3152-4368-b52e-1827ddd3612a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:24.851818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8f600-3152-4368-b52e-1827ddd3612a admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:24.856125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8f600-3152-4368-b52e-1827ddd3612a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:24.858684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8f600-3152-4368-b52e-1827ddd3612a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:25.194804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ac2827c6-fd06-4d9e-8b6b-96787bb84b38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea346f1c71964cc99cfe33d8fb81179a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:25.202388 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2810/5572] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:38:24 2022] DELETE /identity/v3/users/ea346f1c71964cc99cfe33d8fb81179a => generated 0 bytes in 1096 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:25.208585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e55cf-b615-4406-a5f5-7d892a418225 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:25.209200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e55cf-b615-4406-a5f5-7d892a418225 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:25.209660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e55cf-b615-4406-a5f5-7d892a418225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:25.268451 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2763/5573] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:38:24 2022] POST /identity/v3/projects => generated 373 bytes in 591 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:38:25.270110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8f600-3152-4368-b52e-1827ddd3612a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:25.273826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a9b8f600-3152-4368-b52e-1827ddd3612a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:25.280143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-482e55cf-b615-4406-a5f5-7d892a418225 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:25.283741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-482e55cf-b615-4406-a5f5-7d892a418225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:25.485695 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2811/5574] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:25.514825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e55cf-b615-4406-a5f5-7d892a418225 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:25.517095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-482e55cf-b615-4406-a5f5-7d892a418225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:25.551298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8f600-3152-4368-b52e-1827ddd3612a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:25.571109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ddf82-0355-44b4-9ce7-81808c1fb1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:25.576438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ddf82-0355-44b4-9ce7-81808c1fb1fd admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:25.576438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ddf82-0355-44b4-9ce7-81808c1fb1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:25.576438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ddf82-0355-44b4-9ce7-81808c1fb1fd admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:25.576438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ddf82-0355-44b4-9ce7-81808c1fb1fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:25.576438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620ddf82-0355-44b4-9ce7-81808c1fb1fd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:25.653764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e55cf-b615-4406-a5f5-7d892a418225 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:25.659014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f7017-2784-4914-84b9-c3c9db8a4928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:25.665157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f7017-2784-4914-84b9-c3c9db8a4928 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:25.665157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f7017-2784-4914-84b9-c3c9db8a4928 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:25.665157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f7017-2784-4914-84b9-c3c9db8a4928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:25.680277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f7017-2784-4914-84b9-c3c9db8a4928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:25.682807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8f7017-2784-4914-84b9-c3c9db8a4928 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:25.695569 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2812/5575] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:38:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:38:25.761674 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2764/5576] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:38:25 2022] POST /identity/v3/users => generated 293 bytes in 492 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:38:25.765789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f7017-2784-4914-84b9-c3c9db8a4928 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:25.787487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f7017-2784-4914-84b9-c3c9db8a4928 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:25.799240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbed63a-ba7f-4ab3-bd0c-3f69557e6c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:25.801085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbed63a-ba7f-4ab3-bd0c-3f69557e6c92 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:25.802802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbed63a-ba7f-4ab3-bd0c-3f69557e6c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:25.804395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbed63a-ba7f-4ab3-bd0c-3f69557e6c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:25.805505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbed63a-ba7f-4ab3-bd0c-3f69557e6c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:25.810465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbed63a-ba7f-4ab3-bd0c-3f69557e6c92 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:25.866296 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2813/5577] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:38:25.869024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ddf82-0355-44b4-9ce7-81808c1fb1fd admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:25.891953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ddf82-0355-44b4-9ce7-81808c1fb1fd admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:25.910941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187d5e6-7acd-48b9-bffe-98b6bf7d2f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:25.911870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187d5e6-7acd-48b9-bffe-98b6bf7d2f29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:25.912164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187d5e6-7acd-48b9-bffe-98b6bf7d2f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:25.912430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187d5e6-7acd-48b9-bffe-98b6bf7d2f29 admin admin] PATH_INFO: `/v3/projects/ddcc5ca2b12940f8a770d6e9cae5ad1f/users/b07aee4252cf44c38a21b71c448e5caf/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:25.964886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187d5e6-7acd-48b9-bffe-98b6bf7d2f29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddcc5ca2b12940f8a770d6e9cae5ad1f, user_id=b07aee4252cf44c38a21b71c448e5caf, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:25.967592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187d5e6-7acd-48b9-bffe-98b6bf7d2f29 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:26.088102 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2765/5578] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:38:25 2022] PUT /identity/v3/projects/ddcc5ca2b12940f8a770d6e9cae5ad1f/users/b07aee4252cf44c38a21b71c448e5caf/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:26.092415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbed63a-ba7f-4ab3-bd0c-3f69557e6c92 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:26.110157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbed63a-ba7f-4ab3-bd0c-3f69557e6c92 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:26.293002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dda134-4e50-4ad7-8a9c-3e01393d479b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:26.295658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dda134-4e50-4ad7-8a9c-3e01393d479b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:26.296763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dda134-4e50-4ad7-8a9c-3e01393d479b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:26.298793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dda134-4e50-4ad7-8a9c-3e01393d479b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:26.302250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dda134-4e50-4ad7-8a9c-3e01393d479b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:26.304143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dda134-4e50-4ad7-8a9c-3e01393d479b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:26.344753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187d5e6-7acd-48b9-bffe-98b6bf7d2f29 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:26.352693 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2814/5579] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:38:26.362082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187d5e6-7acd-48b9-bffe-98b6bf7d2f29 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:26.383712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4728b70-01e0-4ed2-bfe1-38cd0912e4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:26.385233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4728b70-01e0-4ed2-bfe1-38cd0912e4db admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:26.385644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4728b70-01e0-4ed2-bfe1-38cd0912e4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:26.386034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4728b70-01e0-4ed2-bfe1-38cd0912e4db admin admin] PATH_INFO: `/v3/projects/ddcc5ca2b12940f8a770d6e9cae5ad1f/users/b07aee4252cf44c38a21b71c448e5caf/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:26.388306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4728b70-01e0-4ed2-bfe1-38cd0912e4db admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddcc5ca2b12940f8a770d6e9cae5ad1f, user_id=b07aee4252cf44c38a21b71c448e5caf, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:26.391155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4728b70-01e0-4ed2-bfe1-38cd0912e4db admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:26.414257 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2766/5580] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:38:26 2022] PUT /identity/v3/projects/ddcc5ca2b12940f8a770d6e9cae5ad1f/users/b07aee4252cf44c38a21b71c448e5caf/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:38:26.415564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51818982-d0fa-4ea9-ab44-80b9cf142e38 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:26.416122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51818982-d0fa-4ea9-ab44-80b9cf142e38 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:26.416520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51818982-d0fa-4ea9-ab44-80b9cf142e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:26.449705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-51818982-d0fa-4ea9-ab44-80b9cf142e38 None None] MFA Rules not processed for user `b07aee4252cf44c38a21b71c448e5caf`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:26.451145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-51818982-d0fa-4ea9-ab44-80b9cf142e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:26.500215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4728b70-01e0-4ed2-bfe1-38cd0912e4db admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:26.502310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c4728b70-01e0-4ed2-bfe1-38cd0912e4db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:26.624461 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2815/5581] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:26.628364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51818982-d0fa-4ea9-ab44-80b9cf142e38 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:26.630697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-51818982-d0fa-4ea9-ab44-80b9cf142e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:26.681280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4728b70-01e0-4ed2-bfe1-38cd0912e4db admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:26.689848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522735f-bd16-4c96-a177-19ccf7b8772b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:26.691796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522735f-bd16-4c96-a177-19ccf7b8772b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:26.693373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522735f-bd16-4c96-a177-19ccf7b8772b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:26.694446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522735f-bd16-4c96-a177-19ccf7b8772b admin admin] PATH_INFO: `/v3/projects/c1ac9d3e81934cc483670fd846d1fa86` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:26.697589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5522735f-bd16-4c96-a177-19ccf7b8772b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ac9d3e81934cc483670fd846d1fa86)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:26.700661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5522735f-bd16-4c96-a177-19ccf7b8772b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:26.774051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51818982-d0fa-4ea9-ab44-80b9cf142e38 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:26.788877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6879710-69a7-462b-93b6-5b4ef7747d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:26.789456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6879710-69a7-462b-93b6-5b4ef7747d87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:26.789751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6879710-69a7-462b-93b6-5b4ef7747d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:26.790029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6879710-69a7-462b-93b6-5b4ef7747d87 admin admin] PATH_INFO: `/v3/users/8ae7931d9de44d859699d54d26970590` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:26.791844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6879710-69a7-462b-93b6-5b4ef7747d87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ae7931d9de44d859699d54d26970590)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:26.797368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6879710-69a7-462b-93b6-5b4ef7747d87 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:26.867912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5522735f-bd16-4c96-a177-19ccf7b8772b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ac9d3e81934cc483670fd846d1fa86', 'request_id': 'req-5522735f-bd16-4c96-a177-19ccf7b8772b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:26.971590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5522735f-bd16-4c96-a177-19ccf7b8772b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ac9d3e81934cc483670fd846d1fa86', 'request_id': 'req-5522735f-bd16-4c96-a177-19ccf7b8772b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:26.981274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5522735f-bd16-4c96-a177-19ccf7b8772b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ac9d3e81934cc483670fd846d1fa86', 'request_id': 'req-5522735f-bd16-4c96-a177-19ccf7b8772b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:27.001693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5522735f-bd16-4c96-a177-19ccf7b8772b admin admin] The token cache is being invalidate because project c1ac9d3e81934cc483670fd846d1fa86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:38:27.002272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5522735f-bd16-4c96-a177-19ccf7b8772b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:27.002949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5522735f-bd16-4c96-a177-19ccf7b8772b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:27.008288 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2767/5582] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:38:26 2022] DELETE /identity/v3/projects/c1ac9d3e81934cc483670fd846d1fa86 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:27.009138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522735f-bd16-4c96-a177-19ccf7b8772b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:27.012931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5522735f-bd16-4c96-a177-19ccf7b8772b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:27.054856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e6879710-69a7-462b-93b6-5b4ef7747d87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ae7931d9de44d859699d54d26970590'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:27.087748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e6879710-69a7-462b-93b6-5b4ef7747d87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ae7931d9de44d859699d54d26970590'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:27.096507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e6879710-69a7-462b-93b6-5b4ef7747d87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ae7931d9de44d859699d54d26970590'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:27.097360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e6879710-69a7-462b-93b6-5b4ef7747d87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ae7931d9de44d859699d54d26970590'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:27.133290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522735f-bd16-4c96-a177-19ccf7b8772b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:27.141091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e460b795-19e8-4d48-9553-598f140dffe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:27.142203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460b795-19e8-4d48-9553-598f140dffe1 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:27.142974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460b795-19e8-4d48-9553-598f140dffe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:27.143324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e460b795-19e8-4d48-9553-598f140dffe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:27.146710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e460b795-19e8-4d48-9553-598f140dffe1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:27.189159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e6879710-69a7-462b-93b6-5b4ef7747d87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ae7931d9de44d859699d54d26970590'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:27.196719 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2816/5583] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:38:26 2022] DELETE /identity/v3/users/8ae7931d9de44d859699d54d26970590 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:27.198397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe820b-2da1-4c73-ae18-4aeaa859b446 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:27.198866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe820b-2da1-4c73-ae18-4aeaa859b446 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:27.199305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabe820b-2da1-4c73-ae18-4aeaa859b446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:27.218425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-dabe820b-2da1-4c73-ae18-4aeaa859b446 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:27.219887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dabe820b-2da1-4c73-ae18-4aeaa859b446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:27.248577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460b795-19e8-4d48-9553-598f140dffe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:27.250285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e460b795-19e8-4d48-9553-598f140dffe1 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:27.264590 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2768/5584] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:38:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:38:27.266942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03d0d1-0019-4782-9f34-ec843e1b962d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:27.267066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03d0d1-0019-4782-9f34-ec843e1b962d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:27.267337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef03d0d1-0019-4782-9f34-ec843e1b962d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:27.318872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ef03d0d1-0019-4782-9f34-ec843e1b962d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:27.320137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ef03d0d1-0019-4782-9f34-ec843e1b962d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:27.346847 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2817/5585] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:27.356984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8d894-f222-4981-a2df-669aca4aa52e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:27.357565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8d894-f222-4981-a2df-669aca4aa52e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:27.365702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8d894-f222-4981-a2df-669aca4aa52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:27.424938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b6c8d894-f222-4981-a2df-669aca4aa52e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:27.427461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b6c8d894-f222-4981-a2df-669aca4aa52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:27.455993 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2818/5586] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:27.462762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8d894-f222-4981-a2df-669aca4aa52e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:27.475824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8d894-f222-4981-a2df-669aca4aa52e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:27.483708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d4190-9d40-46fa-96b5-443c5a195fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:27.484589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d4190-9d40-46fa-96b5-443c5a195fcc admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:27.484946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d4190-9d40-46fa-96b5-443c5a195fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:27.485491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d4190-9d40-46fa-96b5-443c5a195fcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:27.486470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d4190-9d40-46fa-96b5-443c5a195fcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:38:27.487179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d4190-9d40-46fa-96b5-443c5a195fcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:27.492351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d4190-9d40-46fa-96b5-443c5a195fcc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:27.510866 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2769/5587] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:27.515182 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:27.518356 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2819/5588] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:38:27.522016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03d0d1-0019-4782-9f34-ec843e1b962d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:27.524623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d4190-9d40-46fa-96b5-443c5a195fcc admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:27.524775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ef03d0d1-0019-4782-9f34-ec843e1b962d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:27.547197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d4190-9d40-46fa-96b5-443c5a195fcc admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:27.563951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6d21f-0b5c-4d1e-b0a2-f4b9182cac05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:27.564640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6d21f-0b5c-4d1e-b0a2-f4b9182cac05 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:27.564922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6d21f-0b5c-4d1e-b0a2-f4b9182cac05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:27.565207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf6d21f-0b5c-4d1e-b0a2-f4b9182cac05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:27.566857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6d21f-0b5c-4d1e-b0a2-f4b9182cac05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:27.568550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf6d21f-0b5c-4d1e-b0a2-f4b9182cac05 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:27.619569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef03d0d1-0019-4782-9f34-ec843e1b962d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:27.624315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af900c01-4e19-4cd1-ac76-e7bed4186b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:27.625570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af900c01-4e19-4cd1-ac76-e7bed4186b70 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:27.626021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af900c01-4e19-4cd1-ac76-e7bed4186b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:27.628112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af900c01-4e19-4cd1-ac76-e7bed4186b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:27.641224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af900c01-4e19-4cd1-ac76-e7bed4186b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:27.643126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af900c01-4e19-4cd1-ac76-e7bed4186b70 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:27.659333 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2770/5589] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:38:27.692608 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2820/5590] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:38:27 2022] POST /identity/v3/projects => generated 367 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:38:27.696804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af900c01-4e19-4cd1-ac76-e7bed4186b70 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:27.708855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af900c01-4e19-4cd1-ac76-e7bed4186b70 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:27.815722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7773006-c250-4497-8070-8e2f61117e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:27.817446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7773006-c250-4497-8070-8e2f61117e30 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:27.818252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7773006-c250-4497-8070-8e2f61117e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:27.818779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7773006-c250-4497-8070-8e2f61117e30 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:27.820263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7773006-c250-4497-8070-8e2f61117e30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:27.822738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7773006-c250-4497-8070-8e2f61117e30 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:27.860212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6d21f-0b5c-4d1e-b0a2-f4b9182cac05 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:27.862023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fcf6d21f-0b5c-4d1e-b0a2-f4b9182cac05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:27.941883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf6d21f-0b5c-4d1e-b0a2-f4b9182cac05 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:27.948761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065337d-766e-492b-8198-3e7c49977557 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:27.949485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065337d-766e-492b-8198-3e7c49977557 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:27.949935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065337d-766e-492b-8198-3e7c49977557 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:27.950351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065337d-766e-492b-8198-3e7c49977557 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:27.952628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8065337d-766e-492b-8198-3e7c49977557 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:27.968890 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2771/5591] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:38:27 2022] POST /identity/v3/users => generated 284 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:38:27.969889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7773006-c250-4497-8070-8e2f61117e30 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:27.996571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7773006-c250-4497-8070-8e2f61117e30 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:28.030751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec3add-e182-4faf-9d91-dde6641937ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:28.031666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec3add-e182-4faf-9d91-dde6641937ca admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:28.032131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec3add-e182-4faf-9d91-dde6641937ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:28.033089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec3add-e182-4faf-9d91-dde6641937ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:28.034491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec3add-e182-4faf-9d91-dde6641937ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:28.044282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec3add-e182-4faf-9d91-dde6641937ca admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:28.087329 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2772/5592] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:38:28.091497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec3add-e182-4faf-9d91-dde6641937ca admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:28.101442 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:28.120582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec3add-e182-4faf-9d91-dde6641937ca admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:28.141702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b4887-c550-43b0-abd4-49df2356abf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:28.142491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b4887-c550-43b0-abd4-49df2356abf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:28.142841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b4887-c550-43b0-abd4-49df2356abf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:28.143126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9b4887-c550-43b0-abd4-49df2356abf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:28.143875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b4887-c550-43b0-abd4-49df2356abf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:28.146280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9b4887-c550-43b0-abd4-49df2356abf9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:28.177430 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2773/5593] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:38:28.183322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b4887-c550-43b0-abd4-49df2356abf9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:28.185587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065337d-766e-492b-8198-3e7c49977557 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:28.187705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8065337d-766e-492b-8198-3e7c49977557 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:28.231221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9b4887-c550-43b0-abd4-49df2356abf9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:28.232254 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2821/5594] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:38:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:38:28.237261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ff954-b1ca-43f9-b877-fe2d82522eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:28.238722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ff954-b1ca-43f9-b877-fe2d82522eff admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:28.239009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ff954-b1ca-43f9-b877-fe2d82522eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:28.239289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508ff954-b1ca-43f9-b877-fe2d82522eff admin admin] PATH_INFO: `/v3/projects/987892c9b9ca479989700a7e77ad369e/users/d1cbf58d0cf8440aae63bf31387948f3/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:28.262800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ff954-b1ca-43f9-b877-fe2d82522eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=987892c9b9ca479989700a7e77ad369e, user_id=d1cbf58d0cf8440aae63bf31387948f3, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:28.279964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508ff954-b1ca-43f9-b877-fe2d82522eff admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:28.397125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72a10d-8de1-48cf-b193-291f5689e6ba None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:28.397693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72a10d-8de1-48cf-b193-291f5689e6ba None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:28.397693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72a10d-8de1-48cf-b193-291f5689e6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:28.399133 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2774/5595] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:38:28 2022] PUT /identity/v3/projects/987892c9b9ca479989700a7e77ad369e/users/d1cbf58d0cf8440aae63bf31387948f3/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:28.434466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0a72a10d-8de1-48cf-b193-291f5689e6ba None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:28.436594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0a72a10d-8de1-48cf-b193-291f5689e6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:28.546057 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2822/5596] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:28.557055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ff954-b1ca-43f9-b877-fe2d82522eff admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:28.559665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-508ff954-b1ca-43f9-b877-fe2d82522eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:28.599774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72a10d-8de1-48cf-b193-291f5689e6ba None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:28.601860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0a72a10d-8de1-48cf-b193-291f5689e6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:28.631172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72a10d-8de1-48cf-b193-291f5689e6ba None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:28.642909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85e8c5-8399-45e6-bec0-5c6b95a5e723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:28.645791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85e8c5-8399-45e6-bec0-5c6b95a5e723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:28.647037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85e8c5-8399-45e6-bec0-5c6b95a5e723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:28.649344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a85e8c5-8399-45e6-bec0-5c6b95a5e723 admin admin] PATH_INFO: `/v3/projects/9be0195ed0384728b2ebc12d57ab4345` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:28.651681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85e8c5-8399-45e6-bec0-5c6b95a5e723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9be0195ed0384728b2ebc12d57ab4345)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:28.662080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a85e8c5-8399-45e6-bec0-5c6b95a5e723 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:28.685196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508ff954-b1ca-43f9-b877-fe2d82522eff admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:28.689666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee434fc-acd1-4b58-869c-16c3f3319c60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:28.690613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee434fc-acd1-4b58-869c-16c3f3319c60 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:28.693070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee434fc-acd1-4b58-869c-16c3f3319c60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:28.693070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee434fc-acd1-4b58-869c-16c3f3319c60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:28.703065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee434fc-acd1-4b58-869c-16c3f3319c60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:28.705001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee434fc-acd1-4b58-869c-16c3f3319c60 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:28.727419 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2775/5597] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:38:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:38:28.830184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2a85e8c5-8399-45e6-bec0-5c6b95a5e723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be0195ed0384728b2ebc12d57ab4345', 'request_id': 'req-2a85e8c5-8399-45e6-bec0-5c6b95a5e723'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:28.840760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2a85e8c5-8399-45e6-bec0-5c6b95a5e723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be0195ed0384728b2ebc12d57ab4345', 'request_id': 'req-2a85e8c5-8399-45e6-bec0-5c6b95a5e723'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:28.849623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2a85e8c5-8399-45e6-bec0-5c6b95a5e723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be0195ed0384728b2ebc12d57ab4345', 'request_id': 'req-2a85e8c5-8399-45e6-bec0-5c6b95a5e723'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:28.943584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2a85e8c5-8399-45e6-bec0-5c6b95a5e723 admin admin] The token cache is being invalidate because project 9be0195ed0384728b2ebc12d57ab4345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:38:28.945948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2a85e8c5-8399-45e6-bec0-5c6b95a5e723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:28.945948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2a85e8c5-8399-45e6-bec0-5c6b95a5e723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:28.946620 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2823/5598] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:38:28 2022] DELETE /identity/v3/projects/9be0195ed0384728b2ebc12d57ab4345 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:38:28.950226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee434fc-acd1-4b58-869c-16c3f3319c60 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:28.960236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee434fc-acd1-4b58-869c-16c3f3319c60 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:29.078852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91805455-c957-4720-be79-f838a4c47919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:29.079769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91805455-c957-4720-be79-f838a4c47919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:29.080053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91805455-c957-4720-be79-f838a4c47919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:29.080513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91805455-c957-4720-be79-f838a4c47919 admin admin] PATH_INFO: `/v3/users/9cdd6ce2301049d994db8f1da58feba4` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:29.084544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91805455-c957-4720-be79-f838a4c47919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cdd6ce2301049d994db8f1da58feba4)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:29.088309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91805455-c957-4720-be79-f838a4c47919 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:29.328630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-91805455-c957-4720-be79-f838a4c47919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cdd6ce2301049d994db8f1da58feba4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:29.364121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-91805455-c957-4720-be79-f838a4c47919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cdd6ce2301049d994db8f1da58feba4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:29.364121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-91805455-c957-4720-be79-f838a4c47919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cdd6ce2301049d994db8f1da58feba4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:29.364451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-91805455-c957-4720-be79-f838a4c47919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cdd6ce2301049d994db8f1da58feba4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:29.375941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-91805455-c957-4720-be79-f838a4c47919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cdd6ce2301049d994db8f1da58feba4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:29.391102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85e8c5-8399-45e6-bec0-5c6b95a5e723 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:29.392575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2a85e8c5-8399-45e6-bec0-5c6b95a5e723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:29.414445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a85e8c5-8399-45e6-bec0-5c6b95a5e723 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:29.423253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9aa11-93ef-4d95-b9f9-cd1e3ddc9cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:29.424557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9aa11-93ef-4d95-b9f9-cd1e3ddc9cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:29.426423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9aa11-93ef-4d95-b9f9-cd1e3ddc9cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:29.427159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a9aa11-93ef-4d95-b9f9-cd1e3ddc9cd6 admin admin] PATH_INFO: `/v3/users/946a406858114cce8f4c9de45103f68a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:29.428890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9aa11-93ef-4d95-b9f9-cd1e3ddc9cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=946a406858114cce8f4c9de45103f68a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:29.432727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a9aa11-93ef-4d95-b9f9-cd1e3ddc9cd6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:29.497716 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2776/5599] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:38:28 2022] DELETE /identity/v3/users/9cdd6ce2301049d994db8f1da58feba4 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:29.734299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c5a9aa11-93ef-4d95-b9f9-cd1e3ddc9cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '946a406858114cce8f4c9de45103f68a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:29.749825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c5a9aa11-93ef-4d95-b9f9-cd1e3ddc9cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '946a406858114cce8f4c9de45103f68a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:29.762392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c5a9aa11-93ef-4d95-b9f9-cd1e3ddc9cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '946a406858114cce8f4c9de45103f68a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:29.765165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c5a9aa11-93ef-4d95-b9f9-cd1e3ddc9cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '946a406858114cce8f4c9de45103f68a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:29.851850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c5a9aa11-93ef-4d95-b9f9-cd1e3ddc9cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '946a406858114cce8f4c9de45103f68a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:29.860741 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2824/5600] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:38:29 2022] DELETE /identity/v3/users/946a406858114cce8f4c9de45103f68a => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:29.865347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d271e1-59d7-408a-8ada-dd202a3fdfbb None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:29.866374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d271e1-59d7-408a-8ada-dd202a3fdfbb None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:29.866857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d271e1-59d7-408a-8ada-dd202a3fdfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:29.901981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-12d271e1-59d7-408a-8ada-dd202a3fdfbb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:29.911151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-12d271e1-59d7-408a-8ada-dd202a3fdfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:30.002643 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:30.101127 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2777/5601] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:30.225155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9aa11-93ef-4d95-b9f9-cd1e3ddc9cd6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:30.226707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c5a9aa11-93ef-4d95-b9f9-cd1e3ddc9cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:30.330443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a9aa11-93ef-4d95-b9f9-cd1e3ddc9cd6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:30.331351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d271e1-59d7-408a-8ada-dd202a3fdfbb None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:30.333021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-12d271e1-59d7-408a-8ada-dd202a3fdfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:30.338359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdc578-19e2-4d62-a5ff-af613354a303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:30.340000 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:30.340953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdc578-19e2-4d62-a5ff-af613354a303 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:30.342031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdc578-19e2-4d62-a5ff-af613354a303 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:30.342869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdc578-19e2-4d62-a5ff-af613354a303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:30.357447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdc578-19e2-4d62-a5ff-af613354a303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:30.359205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d271e1-59d7-408a-8ada-dd202a3fdfbb None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:30.359643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdc578-19e2-4d62-a5ff-af613354a303 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:30.375837 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2825/5602] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:38:30.385874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3515c512-b8e4-4357-ab51-733d82e746b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:30.386896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515c512-b8e4-4357-ab51-733d82e746b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:30.387101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515c512-b8e4-4357-ab51-733d82e746b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:30.387384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3515c512-b8e4-4357-ab51-733d82e746b7 admin admin] PATH_INFO: `/v3/projects/e847b188f2a64b75993e5f77e2301aa7` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:30.392234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515c512-b8e4-4357-ab51-733d82e746b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e847b188f2a64b75993e5f77e2301aa7)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:30.402490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3515c512-b8e4-4357-ab51-733d82e746b7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:30.531179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3515c512-b8e4-4357-ab51-733d82e746b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e847b188f2a64b75993e5f77e2301aa7', 'request_id': 'req-3515c512-b8e4-4357-ab51-733d82e746b7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:30.622583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3515c512-b8e4-4357-ab51-733d82e746b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e847b188f2a64b75993e5f77e2301aa7', 'request_id': 'req-3515c512-b8e4-4357-ab51-733d82e746b7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:30.632536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3515c512-b8e4-4357-ab51-733d82e746b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e847b188f2a64b75993e5f77e2301aa7', 'request_id': 'req-3515c512-b8e4-4357-ab51-733d82e746b7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:30.655527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3515c512-b8e4-4357-ab51-733d82e746b7 admin admin] The token cache is being invalidate because project e847b188f2a64b75993e5f77e2301aa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:38:30.658638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3515c512-b8e4-4357-ab51-733d82e746b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:30.663462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3515c512-b8e4-4357-ab51-733d82e746b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:30.663462 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2778/5603] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:38:30 2022] DELETE /identity/v3/projects/e847b188f2a64b75993e5f77e2301aa7 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:30.674245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8fa53-ee44-45a3-bb63-439952e6bb47 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:30.674245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8fa53-ee44-45a3-bb63-439952e6bb47 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:30.674245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8fa53-ee44-45a3-bb63-439952e6bb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:30.711865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-daf8fa53-ee44-45a3-bb63-439952e6bb47 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:30.716177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-daf8fa53-ee44-45a3-bb63-439952e6bb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:30.859191 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2826/5604] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:30.861365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dbc95-3506-4118-b6c9-8231c4c3dbc5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:30.861715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dbc95-3506-4118-b6c9-8231c4c3dbc5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:30.862004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340dbc95-3506-4118-b6c9-8231c4c3dbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:30.888957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8fa53-ee44-45a3-bb63-439952e6bb47 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:30.890388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-daf8fa53-ee44-45a3-bb63-439952e6bb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:30.907446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-340dbc95-3506-4118-b6c9-8231c4c3dbc5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:30.917137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-340dbc95-3506-4118-b6c9-8231c4c3dbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:30.926006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8fa53-ee44-45a3-bb63-439952e6bb47 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:30.937063 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2779/5605] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:30.942310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10582b2-5a81-4759-8c88-2b0c16fdaa90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:30.946565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10582b2-5a81-4759-8c88-2b0c16fdaa90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:30.947462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340dbc95-3506-4118-b6c9-8231c4c3dbc5 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:30.947563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10582b2-5a81-4759-8c88-2b0c16fdaa90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:30.947563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10582b2-5a81-4759-8c88-2b0c16fdaa90 admin admin] PATH_INFO: `/v3/projects/f77a40c726f042848654cb8e3c3dc983` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:30.947563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10582b2-5a81-4759-8c88-2b0c16fdaa90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f77a40c726f042848654cb8e3c3dc983)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:30.961144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340dbc95-3506-4118-b6c9-8231c4c3dbc5 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:30.970923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10582b2-5a81-4759-8c88-2b0c16fdaa90 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:30.984101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3f6ab-b054-45ff-9fe3-bb641300399e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:30.984984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3f6ab-b054-45ff-9fe3-bb641300399e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:30.985317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3f6ab-b054-45ff-9fe3-bb641300399e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:30.985668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d3f6ab-b054-45ff-9fe3-bb641300399e admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:30.986521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3f6ab-b054-45ff-9fe3-bb641300399e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:38:30.988755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3f6ab-b054-45ff-9fe3-bb641300399e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:30.991522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d3f6ab-b054-45ff-9fe3-bb641300399e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:31.021387 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2780/5606] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:38:31.025058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3f6ab-b054-45ff-9fe3-bb641300399e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:31.041802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d3f6ab-b054-45ff-9fe3-bb641300399e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:31.047899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cc8f1-f961-434f-a385-9f4e21829245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:31.048614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cc8f1-f961-434f-a385-9f4e21829245 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:31.049037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cc8f1-f961-434f-a385-9f4e21829245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:31.049415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48cc8f1-f961-434f-a385-9f4e21829245 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:31.052309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cc8f1-f961-434f-a385-9f4e21829245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:31.055367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48cc8f1-f961-434f-a385-9f4e21829245 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:31.145248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d10582b2-5a81-4759-8c88-2b0c16fdaa90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f77a40c726f042848654cb8e3c3dc983', 'request_id': 'req-d10582b2-5a81-4759-8c88-2b0c16fdaa90'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:31.163394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d10582b2-5a81-4759-8c88-2b0c16fdaa90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f77a40c726f042848654cb8e3c3dc983', 'request_id': 'req-d10582b2-5a81-4759-8c88-2b0c16fdaa90'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:31.174624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d10582b2-5a81-4759-8c88-2b0c16fdaa90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f77a40c726f042848654cb8e3c3dc983', 'request_id': 'req-d10582b2-5a81-4759-8c88-2b0c16fdaa90'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:31.237363 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2781/5607] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:38:31 2022] POST /identity/v3/projects => generated 381 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:38:31.242907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cc8f1-f961-434f-a385-9f4e21829245 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:31.268467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d10582b2-5a81-4759-8c88-2b0c16fdaa90 admin admin] The token cache is being invalidate because project f77a40c726f042848654cb8e3c3dc983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:38:31.268890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d10582b2-5a81-4759-8c88-2b0c16fdaa90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:31.271901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d10582b2-5a81-4759-8c88-2b0c16fdaa90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:31.273879 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2827/5608] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:38:30 2022] DELETE /identity/v3/projects/f77a40c726f042848654cb8e3c3dc983 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:38:31.278576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfdd35-e6a0-4ca4-bf39-aaece69ceda1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:31.278978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfdd35-e6a0-4ca4-bf39-aaece69ceda1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:31.279360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abfdd35-e6a0-4ca4-bf39-aaece69ceda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:31.317250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8abfdd35-e6a0-4ca4-bf39-aaece69ceda1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:31.321159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8abfdd35-e6a0-4ca4-bf39-aaece69ceda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:31.368764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48cc8f1-f961-434f-a385-9f4e21829245 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:31.383548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff7fd3-9dba-43da-9357-98774bd92d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:31.396859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff7fd3-9dba-43da-9357-98774bd92d65 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:31.399444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff7fd3-9dba-43da-9357-98774bd92d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:31.399775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff7fd3-9dba-43da-9357-98774bd92d65 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:31.402856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff7fd3-9dba-43da-9357-98774bd92d65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:31.409274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff7fd3-9dba-43da-9357-98774bd92d65 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:31.502313 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2828/5609] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:38:31.511744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6df7-4c36-4773-994d-6949aeab0a54 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:31.512300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6df7-4c36-4773-994d-6949aeab0a54 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:31.512782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77f6df7-4c36-4773-994d-6949aeab0a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:31.547171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d77f6df7-4c36-4773-994d-6949aeab0a54 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:31.547171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d77f6df7-4c36-4773-994d-6949aeab0a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:31.547402 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2782/5610] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:38:31 2022] POST /identity/v3/users => generated 291 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:38:31.549705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff7fd3-9dba-43da-9357-98774bd92d65 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:31.557978 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2829/5611] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:31.558249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d3ff7fd3-9dba-43da-9357-98774bd92d65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:31.559198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f6df7-4c36-4773-994d-6949aeab0a54 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:31.572653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77f6df7-4c36-4773-994d-6949aeab0a54 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:31.578185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edfae0-8520-4419-bbed-9546ca66ccf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:31.578844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edfae0-8520-4419-bbed-9546ca66ccf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:31.579131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edfae0-8520-4419-bbed-9546ca66ccf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:31.579414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edfae0-8520-4419-bbed-9546ca66ccf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:31.579538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff7fd3-9dba-43da-9357-98774bd92d65 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:31.580300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6edfae0-8520-4419-bbed-9546ca66ccf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:38:31.580639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6edfae0-8520-4419-bbed-9546ca66ccf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:31.583228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6edfae0-8520-4419-bbed-9546ca66ccf8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:31.593937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95597a36-3668-47d4-92b9-7bba9b265f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:31.594666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95597a36-3668-47d4-92b9-7bba9b265f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:31.594957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95597a36-3668-47d4-92b9-7bba9b265f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:31.595242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95597a36-3668-47d4-92b9-7bba9b265f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:31.595994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95597a36-3668-47d4-92b9-7bba9b265f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:31.599633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95597a36-3668-47d4-92b9-7bba9b265f91 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:31.615222 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2830/5612] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:38:31.617476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edfae0-8520-4419-bbed-9546ca66ccf8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:31.630870 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2783/5613] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:38:31.631083 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:31.633968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95597a36-3668-47d4-92b9-7bba9b265f91 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:31.643928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edfae0-8520-4419-bbed-9546ca66ccf8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:31.648850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95597a36-3668-47d4-92b9-7bba9b265f91 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:31.659015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34010af5-2937-4126-8d2a-7016733a72f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:31.665607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81588788-2671-4654-9ac9-c13527574808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:31.665761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34010af5-2937-4126-8d2a-7016733a72f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:31.665761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34010af5-2937-4126-8d2a-7016733a72f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:31.665982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81588788-2671-4654-9ac9-c13527574808 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:31.665982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81588788-2671-4654-9ac9-c13527574808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:31.666215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34010af5-2937-4126-8d2a-7016733a72f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:31.666332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81588788-2671-4654-9ac9-c13527574808 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:31.666452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34010af5-2937-4126-8d2a-7016733a72f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:31.666569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81588788-2671-4654-9ac9-c13527574808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:31.666569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81588788-2671-4654-9ac9-c13527574808 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:31.668352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34010af5-2937-4126-8d2a-7016733a72f3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:31.679642 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2784/5614] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:38:31.685173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81588788-2671-4654-9ac9-c13527574808 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:31.705363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81588788-2671-4654-9ac9-c13527574808 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:31.712873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846976d2-2347-4a58-ac43-8bc33ed16582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:31.714777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846976d2-2347-4a58-ac43-8bc33ed16582 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:31.715249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846976d2-2347-4a58-ac43-8bc33ed16582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:31.717978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846976d2-2347-4a58-ac43-8bc33ed16582 admin admin] PATH_INFO: `/v3/projects/227629482fef4bd28e68bf3574b1154c/users/20cc5d36e4004359903122049a88079f/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:31.746523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846976d2-2347-4a58-ac43-8bc33ed16582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=227629482fef4bd28e68bf3574b1154c, user_id=20cc5d36e4004359903122049a88079f, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:31.753397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846976d2-2347-4a58-ac43-8bc33ed16582 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:31.835059 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2831/5615] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:38:31 2022] POST /identity/v3/projects => generated 371 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:38:31.838686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34010af5-2937-4126-8d2a-7016733a72f3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:31.886792 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2785/5616] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:38:31 2022] PUT /identity/v3/projects/227629482fef4bd28e68bf3574b1154c/users/20cc5d36e4004359903122049a88079f/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:31.892046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81163b06-b0ad-4c9b-996b-40a39a0c2864 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:31.892506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81163b06-b0ad-4c9b-996b-40a39a0c2864 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:31.892969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81163b06-b0ad-4c9b-996b-40a39a0c2864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:31.922676 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:31.952870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34010af5-2937-4126-8d2a-7016733a72f3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:31.956281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-81163b06-b0ad-4c9b-996b-40a39a0c2864 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:31.958378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-81163b06-b0ad-4c9b-996b-40a39a0c2864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:32.094219 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2786/5617] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:32.101178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81163b06-b0ad-4c9b-996b-40a39a0c2864 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:32.101595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246d69d-c974-410e-9858-c0b8c78a1f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:32.102430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246d69d-c974-410e-9858-c0b8c78a1f01 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:32.102817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246d69d-c974-410e-9858-c0b8c78a1f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:32.103206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246d69d-c974-410e-9858-c0b8c78a1f01 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:32.103334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-81163b06-b0ad-4c9b-996b-40a39a0c2864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:32.104229 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246d69d-c974-410e-9858-c0b8c78a1f01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:32.107632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246d69d-c974-410e-9858-c0b8c78a1f01 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:32.196870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81163b06-b0ad-4c9b-996b-40a39a0c2864 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:32.201651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e86dc-4ff0-41a2-ab36-e203b4404432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:32.203070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e86dc-4ff0-41a2-ab36-e203b4404432 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:32.203070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e86dc-4ff0-41a2-ab36-e203b4404432 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:32.203738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525e86dc-4ff0-41a2-ab36-e203b4404432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:32.220622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e86dc-4ff0-41a2-ab36-e203b4404432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:32.223996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525e86dc-4ff0-41a2-ab36-e203b4404432 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:32.246889 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2832/5618] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:38:31 2022] POST /identity/v3/users => generated 286 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:38:32.248264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246d69d-c974-410e-9858-c0b8c78a1f01 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:32.258715 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2787/5619] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:38:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:38:32.263329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246d69d-c974-410e-9858-c0b8c78a1f01 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:32.268939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc1b09-f99c-4822-a60a-cb245a0a9ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:32.271448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc1b09-f99c-4822-a60a-cb245a0a9ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:32.273164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc1b09-f99c-4822-a60a-cb245a0a9ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:32.273164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcc1b09-f99c-4822-a60a-cb245a0a9ad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:32.273164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc1b09-f99c-4822-a60a-cb245a0a9ad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:32.275104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcc1b09-f99c-4822-a60a-cb245a0a9ad1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:32.287811 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2833/5620] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:38:32.291720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e86dc-4ff0-41a2-ab36-e203b4404432 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:32.307010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525e86dc-4ff0-41a2-ab36-e203b4404432 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:32.322503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86b847-757f-4412-807e-5686bbf73585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:32.323219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86b847-757f-4412-807e-5686bbf73585 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:32.323499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86b847-757f-4412-807e-5686bbf73585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:32.323781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86b847-757f-4412-807e-5686bbf73585 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:32.324626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86b847-757f-4412-807e-5686bbf73585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:32.326284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a86b847-757f-4412-807e-5686bbf73585 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:32.346191 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2788/5621] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:38:32.349613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc1b09-f99c-4822-a60a-cb245a0a9ad1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:32.365139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcc1b09-f99c-4822-a60a-cb245a0a9ad1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:32.371856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3d4a8-6f74-4bab-80c6-0e1bf4d51880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:32.372852 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3d4a8-6f74-4bab-80c6-0e1bf4d51880 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:32.373232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3d4a8-6f74-4bab-80c6-0e1bf4d51880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:32.373424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e3d4a8-6f74-4bab-80c6-0e1bf4d51880 admin admin] PATH_INFO: `/v3/projects/93ce06d9931941ecbc06cf0718159afa/users/d6f83b1d8fb7439fba00e4d1bbaad695/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:32.402918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3d4a8-6f74-4bab-80c6-0e1bf4d51880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93ce06d9931941ecbc06cf0718159afa, user_id=d6f83b1d8fb7439fba00e4d1bbaad695, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:32.405736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e3d4a8-6f74-4bab-80c6-0e1bf4d51880 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:32.484247 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2834/5622] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:38:32 2022] PUT /identity/v3/projects/93ce06d9931941ecbc06cf0718159afa/users/d6f83b1d8fb7439fba00e4d1bbaad695/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:32.579082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a7a15-f325-41a4-8545-2db80cb74f3c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:32.579364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a7a15-f325-41a4-8545-2db80cb74f3c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:32.579653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a7a15-f325-41a4-8545-2db80cb74f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:32.612754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d88a7a15-f325-41a4-8545-2db80cb74f3c None None] MFA Rules not processed for user `d6f83b1d8fb7439fba00e4d1bbaad695`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:32.614813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d88a7a15-f325-41a4-8545-2db80cb74f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:32.740279 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2789/5623] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:38:32.751030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3d4a8-6f74-4bab-80c6-0e1bf4d51880 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:32.753248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b2e3d4a8-6f74-4bab-80c6-0e1bf4d51880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:32.910061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e3d4a8-6f74-4bab-80c6-0e1bf4d51880 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:32.918920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b5225-ec3c-4ace-a641-ca672858ff23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:32.919652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b5225-ec3c-4ace-a641-ca672858ff23 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:32.919942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b5225-ec3c-4ace-a641-ca672858ff23 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:32.920705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b5225-ec3c-4ace-a641-ca672858ff23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:32.938268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b5225-ec3c-4ace-a641-ca672858ff23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:32.938268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b5225-ec3c-4ace-a641-ca672858ff23 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:32.955137 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2835/5624] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:38:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:38:32.996137 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:33.607246 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:34.158376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09c727-09f3-494a-9c6d-89801aaebe1a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:34.159342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09c727-09f3-494a-9c6d-89801aaebe1a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:34.159875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e09c727-09f3-494a-9c6d-89801aaebe1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:34.255204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2e09c727-09f3-494a-9c6d-89801aaebe1a None None] MFA Rules not processed for user `20cc5d36e4004359903122049a88079f`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:34.256457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2e09c727-09f3-494a-9c6d-89801aaebe1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:34.456208 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2790/5625] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:35.549419 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:35.645348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b5225-ec3c-4ace-a641-ca672858ff23 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:35.646849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-620b5225-ec3c-4ace-a641-ca672858ff23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:35.743246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b5225-ec3c-4ace-a641-ca672858ff23 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:35.766561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9caa2bd-d727-44f9-961b-759c4fdd9da9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:35.766930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9caa2bd-d727-44f9-961b-759c4fdd9da9 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:35.769652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9caa2bd-d727-44f9-961b-759c4fdd9da9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:35.770762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9caa2bd-d727-44f9-961b-759c4fdd9da9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:35.854580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9caa2bd-d727-44f9-961b-759c4fdd9da9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:35.880652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9caa2bd-d727-44f9-961b-759c4fdd9da9 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:35.930607 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2836/5626] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:38:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:38:36.223302 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:37.757525 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:38.252032 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:41.664825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a2572-64a7-4194-8d3c-093b166556b5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:41.665424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a2572-64a7-4194-8d3c-093b166556b5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:41.665424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558a2572-64a7-4194-8d3c-093b166556b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:41.782143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-558a2572-64a7-4194-8d3c-093b166556b5 None None] MFA Rules not processed for user `d1cbf58d0cf8440aae63bf31387948f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:41.791299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-558a2572-64a7-4194-8d3c-093b166556b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:42.049836 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:42.079386 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2791/5627] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:42.080701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e67d8c-3dd2-4642-a4c0-23f2683e81bd None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:42.081546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e67d8c-3dd2-4642-a4c0-23f2683e81bd None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:42.082798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e67d8c-3dd2-4642-a4c0-23f2683e81bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:42.161939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-97e67d8c-3dd2-4642-a4c0-23f2683e81bd None None] MFA Rules not processed for user `d1cbf58d0cf8440aae63bf31387948f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:42.163658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-97e67d8c-3dd2-4642-a4c0-23f2683e81bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:42.178088 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2837/5628] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:42 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:38:42.188265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a2572-64a7-4194-8d3c-093b166556b5 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:42.191471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-558a2572-64a7-4194-8d3c-093b166556b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:42.233186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558a2572-64a7-4194-8d3c-093b166556b5 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:42.252892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e91fea0-64bc-48c5-a30e-82fb706e659f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:42.256312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91fea0-64bc-48c5-a30e-82fb706e659f service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:42.256852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91fea0-64bc-48c5-a30e-82fb706e659f service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:42.257330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e91fea0-64bc-48c5-a30e-82fb706e659f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:42.300636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e91fea0-64bc-48c5-a30e-82fb706e659f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:42.308751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e91fea0-64bc-48c5-a30e-82fb706e659f service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:42.337640 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2792/5629] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:38:42 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:38:45.054652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e67d8c-3dd2-4642-a4c0-23f2683e81bd None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:45.341335 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:45.395789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e67d8c-3dd2-4642-a4c0-23f2683e81bd None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:45.399844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ffcd9-d467-4b2b-bcd6-fba9c69110a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:45.401619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ffcd9-d467-4b2b-bcd6-fba9c69110a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:45.402006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ffcd9-d467-4b2b-bcd6-fba9c69110a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:45.402851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ffcd9-d467-4b2b-bcd6-fba9c69110a5 admin admin] PATH_INFO: `/v3/users/d6f83b1d8fb7439fba00e4d1bbaad695` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:45.411194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ffcd9-d467-4b2b-bcd6-fba9c69110a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6f83b1d8fb7439fba00e4d1bbaad695)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:45.413526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ffcd9-d467-4b2b-bcd6-fba9c69110a5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:45.737387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-872ffcd9-d467-4b2b-bcd6-fba9c69110a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6f83b1d8fb7439fba00e4d1bbaad695'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:45.787552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-872ffcd9-d467-4b2b-bcd6-fba9c69110a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6f83b1d8fb7439fba00e4d1bbaad695'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:45.808923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-872ffcd9-d467-4b2b-bcd6-fba9c69110a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6f83b1d8fb7439fba00e4d1bbaad695'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:45.810420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-872ffcd9-d467-4b2b-bcd6-fba9c69110a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6f83b1d8fb7439fba00e4d1bbaad695'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:45.937729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-872ffcd9-d467-4b2b-bcd6-fba9c69110a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6f83b1d8fb7439fba00e4d1bbaad695'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:45.947383 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2838/5630] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:38:45 2022] DELETE /identity/v3/users/d6f83b1d8fb7439fba00e4d1bbaad695 => generated 0 bytes in 893 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:45.951527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4f3ca-3734-4198-a00d-b132fd8cdbc9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:45.952353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4f3ca-3734-4198-a00d-b132fd8cdbc9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:45.952796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4f3ca-3734-4198-a00d-b132fd8cdbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:46.058701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-33f4f3ca-3734-4198-a00d-b132fd8cdbc9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:46.065747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-33f4f3ca-3734-4198-a00d-b132fd8cdbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:46.276104 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2793/5631] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:46.306727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ffcd9-d467-4b2b-bcd6-fba9c69110a5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:46.308754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-872ffcd9-d467-4b2b-bcd6-fba9c69110a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:46.455350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ffcd9-d467-4b2b-bcd6-fba9c69110a5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:46.460782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221745c-4f2d-4e1f-84d4-1cf7a6d6bc65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:46.461464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221745c-4f2d-4e1f-84d4-1cf7a6d6bc65 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:46.461942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221745c-4f2d-4e1f-84d4-1cf7a6d6bc65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:46.462430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221745c-4f2d-4e1f-84d4-1cf7a6d6bc65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:46.494464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221745c-4f2d-4e1f-84d4-1cf7a6d6bc65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:46.495935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221745c-4f2d-4e1f-84d4-1cf7a6d6bc65 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:46.555892 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2839/5632] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:38:49.456963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4f3ca-3734-4198-a00d-b132fd8cdbc9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:49.457578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221745c-4f2d-4e1f-84d4-1cf7a6d6bc65 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:49.459660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2221745c-4f2d-4e1f-84d4-1cf7a6d6bc65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:49.460967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-33f4f3ca-3734-4198-a00d-b132fd8cdbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:49.523379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221745c-4f2d-4e1f-84d4-1cf7a6d6bc65 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:49.544021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b58378-89c1-440b-a70a-fc2b9b50667d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:49.547125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b58378-89c1-440b-a70a-fc2b9b50667d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:49.547453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b58378-89c1-440b-a70a-fc2b9b50667d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:49.553405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b58378-89c1-440b-a70a-fc2b9b50667d admin admin] PATH_INFO: `/v3/projects/93ce06d9931941ecbc06cf0718159afa` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:49.557618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b58378-89c1-440b-a70a-fc2b9b50667d admin admin] RBAC: Authorizing `identity:delete_project(project_id=93ce06d9931941ecbc06cf0718159afa)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:49.563831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b58378-89c1-440b-a70a-fc2b9b50667d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:49.720312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4f3ca-3734-4198-a00d-b132fd8cdbc9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:49.754318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a2b58378-89c1-440b-a70a-fc2b9b50667d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93ce06d9931941ecbc06cf0718159afa', 'request_id': 'req-a2b58378-89c1-440b-a70a-fc2b9b50667d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:49.778346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a2b58378-89c1-440b-a70a-fc2b9b50667d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93ce06d9931941ecbc06cf0718159afa', 'request_id': 'req-a2b58378-89c1-440b-a70a-fc2b9b50667d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:49.801800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a2b58378-89c1-440b-a70a-fc2b9b50667d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93ce06d9931941ecbc06cf0718159afa', 'request_id': 'req-a2b58378-89c1-440b-a70a-fc2b9b50667d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:49.807723 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:49.864311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c5dcda-ed09-4498-b6a7-f822e34109e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:49.864997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5dcda-ed09-4498-b6a7-f822e34109e1 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:49.865291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5dcda-ed09-4498-b6a7-f822e34109e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:49.865580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c5dcda-ed09-4498-b6a7-f822e34109e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:49.867665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-95c5dcda-ed09-4498-b6a7-f822e34109e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:49.897244 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:49.926027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a2b58378-89c1-440b-a70a-fc2b9b50667d admin admin] The token cache is being invalidate because project 93ce06d9931941ecbc06cf0718159afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:38:49.926641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a2b58378-89c1-440b-a70a-fc2b9b50667d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:49.928720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a2b58378-89c1-440b-a70a-fc2b9b50667d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:49.931146 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2840/5633] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:38:49 2022] DELETE /identity/v3/projects/93ce06d9931941ecbc06cf0718159afa => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:49.938208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891830f-3991-42d1-bb9a-fcd33052a05f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:49.938773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891830f-3991-42d1-bb9a-fcd33052a05f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:49.939236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891830f-3991-42d1-bb9a-fcd33052a05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:50.016986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5dcda-ed09-4498-b6a7-f822e34109e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:50.017559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6891830f-3991-42d1-bb9a-fcd33052a05f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:50.019163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6891830f-3991-42d1-bb9a-fcd33052a05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:50.020027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c5dcda-ed09-4498-b6a7-f822e34109e1 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:50.035382 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2794/5634] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:38:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:38:50.250144 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2841/5635] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:38:50.265573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad29567-34aa-498b-9ec9-2c8c5080390a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:50.265971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad29567-34aa-498b-9ec9-2c8c5080390a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:50.266365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad29567-34aa-498b-9ec9-2c8c5080390a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:50.322202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-cad29567-34aa-498b-9ec9-2c8c5080390a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:50.329613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cad29567-34aa-498b-9ec9-2c8c5080390a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:50.360649 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2795/5636] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:50.365254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891830f-3991-42d1-bb9a-fcd33052a05f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:50.388550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891830f-3991-42d1-bb9a-fcd33052a05f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:50.400230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe29674-d5c2-4ed6-8b4e-d893f16fbf46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:50.401683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe29674-d5c2-4ed6-8b4e-d893f16fbf46 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:50.402257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe29674-d5c2-4ed6-8b4e-d893f16fbf46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:50.402799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe29674-d5c2-4ed6-8b4e-d893f16fbf46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:50.403988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe29674-d5c2-4ed6-8b4e-d893f16fbf46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:38:50.405029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe29674-d5c2-4ed6-8b4e-d893f16fbf46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:50.418528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe29674-d5c2-4ed6-8b4e-d893f16fbf46 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:50.469602 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2842/5637] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:38:50.474598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad29567-34aa-498b-9ec9-2c8c5080390a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:50.491101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad29567-34aa-498b-9ec9-2c8c5080390a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:50.544708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f203f-87cd-4de8-87fa-6a02af479538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:50.547787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f203f-87cd-4de8-87fa-6a02af479538 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:50.548087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f203f-87cd-4de8-87fa-6a02af479538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:50.548380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f203f-87cd-4de8-87fa-6a02af479538 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:50.556388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f203f-87cd-4de8-87fa-6a02af479538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:50.567562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f203f-87cd-4de8-87fa-6a02af479538 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:50.744619 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2796/5638] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:38:50 2022] POST /identity/v3/projects => generated 377 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:38:50.745867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe29674-d5c2-4ed6-8b4e-d893f16fbf46 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:50.773193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe29674-d5c2-4ed6-8b4e-d893f16fbf46 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:51.023050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ed56b-d409-4818-bb1b-4a1f86b9dc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:51.023752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ed56b-d409-4818-bb1b-4a1f86b9dc1b admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:51.024061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ed56b-d409-4818-bb1b-4a1f86b9dc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:51.024322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35ed56b-d409-4818-bb1b-4a1f86b9dc1b admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:51.025146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ed56b-d409-4818-bb1b-4a1f86b9dc1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:51.026991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35ed56b-d409-4818-bb1b-4a1f86b9dc1b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:51.130125 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2843/5639] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:38:50 2022] POST /identity/v3/users => generated 289 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:38:51.132391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f203f-87cd-4de8-87fa-6a02af479538 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:51.162870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f203f-87cd-4de8-87fa-6a02af479538 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:51.210841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf23f21-8e1f-4553-b203-32c8f6065ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:51.213967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf23f21-8e1f-4553-b203-32c8f6065ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:51.215238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf23f21-8e1f-4553-b203-32c8f6065ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:51.215238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf23f21-8e1f-4553-b203-32c8f6065ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:51.217504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf23f21-8e1f-4553-b203-32c8f6065ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:51.226571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf23f21-8e1f-4553-b203-32c8f6065ee1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:51.258468 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2797/5640] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:38:51.262588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ed56b-d409-4818-bb1b-4a1f86b9dc1b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:51.300007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35ed56b-d409-4818-bb1b-4a1f86b9dc1b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:51.313670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcbe05-a5b5-4aed-a6c3-a345f659f10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:51.314417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcbe05-a5b5-4aed-a6c3-a345f659f10e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:51.314707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcbe05-a5b5-4aed-a6c3-a345f659f10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:51.314988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcbe05-a5b5-4aed-a6c3-a345f659f10e admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:51.315741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcbe05-a5b5-4aed-a6c3-a345f659f10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:51.317923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fcbe05-a5b5-4aed-a6c3-a345f659f10e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:51.358018 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2844/5641] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:38:51.362055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf23f21-8e1f-4553-b203-32c8f6065ee1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:51.392057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf23f21-8e1f-4553-b203-32c8f6065ee1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:51.413113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c685f0-d38c-439a-abd1-c98deadc490a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:51.420693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c685f0-d38c-439a-abd1-c98deadc490a admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:51.421433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c685f0-d38c-439a-abd1-c98deadc490a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:51.423053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c685f0-d38c-439a-abd1-c98deadc490a admin admin] PATH_INFO: `/v3/projects/cee605f55caf446aa18ee09804c8d642/users/ec6fa160df4f46149c527682c3c779b7/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:51.506885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c685f0-d38c-439a-abd1-c98deadc490a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee605f55caf446aa18ee09804c8d642, user_id=ec6fa160df4f46149c527682c3c779b7, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:51.516546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c685f0-d38c-439a-abd1-c98deadc490a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:51.634473 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2798/5642] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:38:51 2022] PUT /identity/v3/projects/cee605f55caf446aa18ee09804c8d642/users/ec6fa160df4f46149c527682c3c779b7/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:51.646726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1deba-7c6e-404f-bc61-ea1ab5ed6fd5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:51.647271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1deba-7c6e-404f-bc61-ea1ab5ed6fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:51.647450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1deba-7c6e-404f-bc61-ea1ab5ed6fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:51.732265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-68e1deba-7c6e-404f-bc61-ea1ab5ed6fd5 None None] MFA Rules not processed for user `ec6fa160df4f46149c527682c3c779b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:51.732265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-68e1deba-7c6e-404f-bc61-ea1ab5ed6fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:51.875932 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:51.930440 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2845/5643] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:51.936186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c685f0-d38c-439a-abd1-c98deadc490a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:52.216531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c685f0-d38c-439a-abd1-c98deadc490a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:52.230324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7a121-a0d6-4c6c-b436-d292add66fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:52.231029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7a121-a0d6-4c6c-b436-d292add66fef admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:52.231317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7a121-a0d6-4c6c-b436-d292add66fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:52.231598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7a121-a0d6-4c6c-b436-d292add66fef admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:52.232315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7a121-a0d6-4c6c-b436-d292add66fef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:52.238896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7a121-a0d6-4c6c-b436-d292add66fef admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:52.355744 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2799/5644] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:38:51 2022] POST /identity/v3/projects => generated 377 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:38:52.359528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1deba-7c6e-404f-bc61-ea1ab5ed6fd5 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:52.395867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1deba-7c6e-404f-bc61-ea1ab5ed6fd5 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:52.662717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feafe73-36c6-4d4d-be92-dfdbf2be08bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:52.663541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feafe73-36c6-4d4d-be92-dfdbf2be08bc admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:52.663837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feafe73-36c6-4d4d-be92-dfdbf2be08bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:52.666174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feafe73-36c6-4d4d-be92-dfdbf2be08bc admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:52.667748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feafe73-36c6-4d4d-be92-dfdbf2be08bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:52.676817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feafe73-36c6-4d4d-be92-dfdbf2be08bc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:53.043365 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2846/5645] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:38:52 2022] POST /identity/v3/users => generated 295 bytes in 684 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:38:53.047230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7a121-a0d6-4c6c-b436-d292add66fef admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:53.067729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7a121-a0d6-4c6c-b436-d292add66fef admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:53.084543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68798c1d-5008-4d17-89c8-f8b14a96f03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:53.085108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68798c1d-5008-4d17-89c8-f8b14a96f03f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:53.085593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68798c1d-5008-4d17-89c8-f8b14a96f03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:53.086065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68798c1d-5008-4d17-89c8-f8b14a96f03f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:53.087114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68798c1d-5008-4d17-89c8-f8b14a96f03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:53.088902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68798c1d-5008-4d17-89c8-f8b14a96f03f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:53.132922 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2800/5646] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:38:53.137357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feafe73-36c6-4d4d-be92-dfdbf2be08bc admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:53.155055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feafe73-36c6-4d4d-be92-dfdbf2be08bc admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:53.181684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747651ef-fd23-4da1-a784-cb59ae411f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:53.184606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747651ef-fd23-4da1-a784-cb59ae411f31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:53.184899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747651ef-fd23-4da1-a784-cb59ae411f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:53.188027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747651ef-fd23-4da1-a784-cb59ae411f31 admin admin] PATH_INFO: `/v3/projects/01c2ed192e6143cca4895e55c8255bf5/users/24f33af9cc9f4a51af07379e66ffb60f/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:53.263386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747651ef-fd23-4da1-a784-cb59ae411f31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c2ed192e6143cca4895e55c8255bf5, user_id=24f33af9cc9f4a51af07379e66ffb60f, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:53.266144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747651ef-fd23-4da1-a784-cb59ae411f31 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:53.364146 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2847/5647] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:38:53 2022] PUT /identity/v3/projects/01c2ed192e6143cca4895e55c8255bf5/users/24f33af9cc9f4a51af07379e66ffb60f/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:53.364813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68798c1d-5008-4d17-89c8-f8b14a96f03f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:53.379785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68798c1d-5008-4d17-89c8-f8b14a96f03f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:53.443654 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:53.522295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f34a8df-fcec-404b-b34d-df7088cbba7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:53.523250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34a8df-fcec-404b-b34d-df7088cbba7b admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:53.523546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34a8df-fcec-404b-b34d-df7088cbba7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:53.523830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f34a8df-fcec-404b-b34d-df7088cbba7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:53.524583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34a8df-fcec-404b-b34d-df7088cbba7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:53.528699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f34a8df-fcec-404b-b34d-df7088cbba7b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:53.566849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747651ef-fd23-4da1-a784-cb59ae411f31 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:53.570141 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2801/5648] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:38:53.583108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747651ef-fd23-4da1-a784-cb59ae411f31 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:53.601431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a48ed-baab-4737-bb5d-48310e86a1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:53.611878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a48ed-baab-4737-bb5d-48310e86a1d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:53.612189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a48ed-baab-4737-bb5d-48310e86a1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:53.612725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a48ed-baab-4737-bb5d-48310e86a1d6 admin admin] PATH_INFO: `/v3/projects/01c2ed192e6143cca4895e55c8255bf5/users/24f33af9cc9f4a51af07379e66ffb60f/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:53.620372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a48ed-baab-4737-bb5d-48310e86a1d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01c2ed192e6143cca4895e55c8255bf5, user_id=24f33af9cc9f4a51af07379e66ffb60f, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:53.623705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a48ed-baab-4737-bb5d-48310e86a1d6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:53.639891 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2848/5649] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:38:53 2022] PUT /identity/v3/projects/01c2ed192e6143cca4895e55c8255bf5/users/24f33af9cc9f4a51af07379e66ffb60f/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:38:53.650910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff55aa-57b5-48cd-b560-a77c57839be8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:53.651178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff55aa-57b5-48cd-b560-a77c57839be8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:53.651474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aff55aa-57b5-48cd-b560-a77c57839be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:53.711134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7aff55aa-57b5-48cd-b560-a77c57839be8 None None] MFA Rules not processed for user `24f33af9cc9f4a51af07379e66ffb60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:53.712465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7aff55aa-57b5-48cd-b560-a77c57839be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:53.893139 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2802/5650] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:53.899064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a48ed-baab-4737-bb5d-48310e86a1d6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:53.916811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a48ed-baab-4737-bb5d-48310e86a1d6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:53.927832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc79b4-f858-424d-856e-2c8bb09d97a1 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f33af9cc9f4a51af07379e66ffb60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01c2ed192e6143cca4895e55c8255bf5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:53.928824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc79b4-f858-424d-856e-2c8bb09d97a1 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:53.929426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc79b4-f858-424d-856e-2c8bb09d97a1 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:53.929901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fc79b4-f858-424d-856e-2c8bb09d97a1 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:53.930918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc79b4-f858-424d-856e-2c8bb09d97a1 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:53.934534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fc79b4-f858-424d-856e-2c8bb09d97a1 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:54.018715 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2849/5651] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:38:53 2022] POST /identity/v3/domains => generated 245 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:38:54.022749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff55aa-57b5-48cd-b560-a77c57839be8 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:54.041955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aff55aa-57b5-48cd-b560-a77c57839be8 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:54.239408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09addb6f-7ffa-4c8d-8da4-993c14ee6e1e tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f33af9cc9f4a51af07379e66ffb60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01c2ed192e6143cca4895e55c8255bf5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:54.242337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09addb6f-7ffa-4c8d-8da4-993c14ee6e1e tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:54.242750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09addb6f-7ffa-4c8d-8da4-993c14ee6e1e tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:54.244300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09addb6f-7ffa-4c8d-8da4-993c14ee6e1e tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:54.245245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09addb6f-7ffa-4c8d-8da4-993c14ee6e1e tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:54.248098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09addb6f-7ffa-4c8d-8da4-993c14ee6e1e tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:54.416498 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2803/5652] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:38:54 2022] POST /identity/v3/projects => generated 410 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:38:54.417657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc79b4-f858-424d-856e-2c8bb09d97a1 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:54.441426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fc79b4-f858-424d-856e-2c8bb09d97a1 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:54.534762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7caa42-4f3e-4933-a983-08e062cf2777 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f33af9cc9f4a51af07379e66ffb60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01c2ed192e6143cca4895e55c8255bf5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:54.535351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7caa42-4f3e-4933-a983-08e062cf2777 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:54.535646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7caa42-4f3e-4933-a983-08e062cf2777 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:54.535935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7caa42-4f3e-4933-a983-08e062cf2777 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:54.536664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7caa42-4f3e-4933-a983-08e062cf2777 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:54.539275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7caa42-4f3e-4933-a983-08e062cf2777 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:54.652101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09addb6f-7ffa-4c8d-8da4-993c14ee6e1e tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:54.661735 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2850/5653] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:38:54 2022] POST /identity/v3/users => generated 348 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:38:54.668049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09addb6f-7ffa-4c8d-8da4-993c14ee6e1e tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:54.691981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6763605-75d2-4983-a43e-03f1a644f5b2 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f33af9cc9f4a51af07379e66ffb60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01c2ed192e6143cca4895e55c8255bf5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:54.693125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6763605-75d2-4983-a43e-03f1a644f5b2 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:54.697405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6763605-75d2-4983-a43e-03f1a644f5b2 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:54.698258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6763605-75d2-4983-a43e-03f1a644f5b2 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:54.699396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6763605-75d2-4983-a43e-03f1a644f5b2 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:54.701274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6763605-75d2-4983-a43e-03f1a644f5b2 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:54.746591 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2804/5654] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:38:54.752970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7caa42-4f3e-4933-a983-08e062cf2777 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:54.789876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7caa42-4f3e-4933-a983-08e062cf2777 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:54.815485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36be7d-f09a-4008-a41b-43e624cd5ab7 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f33af9cc9f4a51af07379e66ffb60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01c2ed192e6143cca4895e55c8255bf5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:54.822227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36be7d-f09a-4008-a41b-43e624cd5ab7 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:54.825449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36be7d-f09a-4008-a41b-43e624cd5ab7 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:54.825449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36be7d-f09a-4008-a41b-43e624cd5ab7 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] PATH_INFO: `/v3/projects/5cae11462f5d429e8f48aebdd698787b/users/5a9bf70191dc4c4dba6f4f0ae5cb6eec/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:54.894080 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:54.897038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36be7d-f09a-4008-a41b-43e624cd5ab7 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5cae11462f5d429e8f48aebdd698787b, user_id=5a9bf70191dc4c4dba6f4f0ae5cb6eec, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:54.900525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36be7d-f09a-4008-a41b-43e624cd5ab7 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:55.019956 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2851/5655] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:38:54 2022] PUT /identity/v3/projects/5cae11462f5d429e8f48aebdd698787b/users/5a9bf70191dc4c4dba6f4f0ae5cb6eec/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:55.033912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67f3fa-fce7-4fe7-b101-45ef9968d469 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:55.034207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67f3fa-fce7-4fe7-b101-45ef9968d469 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:55.034494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a67f3fa-fce7-4fe7-b101-45ef9968d469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:55.133968 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:55.376863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5a67f3fa-fce7-4fe7-b101-45ef9968d469 None None] MFA Rules not processed for user `5a9bf70191dc4c4dba6f4f0ae5cb6eec`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:55.378396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5a67f3fa-fce7-4fe7-b101-45ef9968d469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:55.420806 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2805/5656] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:55 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:55.433739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c4640-005e-44dc-a0ec-ccc7b7d42953 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:55.434148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c4640-005e-44dc-a0ec-ccc7b7d42953 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:55.435718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c4640-005e-44dc-a0ec-ccc7b7d42953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:55.478374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f77c4640-005e-44dc-a0ec-ccc7b7d42953 None None] MFA Rules not processed for user `5a9bf70191dc4c4dba6f4f0ae5cb6eec`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:55.484564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f77c4640-005e-44dc-a0ec-ccc7b7d42953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:55.507519 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2852/5657] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:55 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:38:55.516418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67f3fa-fce7-4fe7-b101-45ef9968d469 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:55.528211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a67f3fa-fce7-4fe7-b101-45ef9968d469 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:55.539939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352f5f0-7258-47c0-9b21-27c1e84f492f tempest-test_project-1653213578 tempest-user-1994623770] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a9bf70191dc4c4dba6f4f0ae5cb6eec', 'user_domain_id': '87a85dcf1d034790b79abd6b53bad7d3', 'system_scope': None, 'project_id': '5cae11462f5d429e8f48aebdd698787b', 'project_domain_id': '87a85dcf1d034790b79abd6b53bad7d3', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:55.540799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352f5f0-7258-47c0-9b21-27c1e84f492f tempest-test_project-1653213578 tempest-user-1994623770] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:55.542839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352f5f0-7258-47c0-9b21-27c1e84f492f tempest-test_project-1653213578 tempest-user-1994623770] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:55.542839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352f5f0-7258-47c0-9b21-27c1e84f492f tempest-test_project-1653213578 tempest-user-1994623770] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:55.562804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352f5f0-7258-47c0-9b21-27c1e84f492f tempest-test_project-1653213578 tempest-user-1994623770] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:55.567510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352f5f0-7258-47c0-9b21-27c1e84f492f tempest-test_project-1653213578 tempest-user-1994623770] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:55.604679 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2806/5658] 10.222.0.43 () {56 vars in 1283 bytes} [Tue Jul 19 14:38:55 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:38:55.609274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c4640-005e-44dc-a0ec-ccc7b7d42953 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:55.915740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c4640-005e-44dc-a0ec-ccc7b7d42953 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:55.967864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a8325-d45e-4a3d-98da-d64aa5a64c69 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f33af9cc9f4a51af07379e66ffb60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01c2ed192e6143cca4895e55c8255bf5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:55.967864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a8325-d45e-4a3d-98da-d64aa5a64c69 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:55.967864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a8325-d45e-4a3d-98da-d64aa5a64c69 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:55.968364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5a8325-d45e-4a3d-98da-d64aa5a64c69 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] PATH_INFO: `/v3/users/5a9bf70191dc4c4dba6f4f0ae5cb6eec` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:55.978991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a8325-d45e-4a3d-98da-d64aa5a64c69 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: Authorizing `identity:delete_user(user_id=5a9bf70191dc4c4dba6f4f0ae5cb6eec)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:55.995277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5a8325-d45e-4a3d-98da-d64aa5a64c69 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:56.302138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9c5a8325-d45e-4a3d-98da-d64aa5a64c69 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a9bf70191dc4c4dba6f4f0ae5cb6eec'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:56.340564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9c5a8325-d45e-4a3d-98da-d64aa5a64c69 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a9bf70191dc4c4dba6f4f0ae5cb6eec'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:56.359915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9c5a8325-d45e-4a3d-98da-d64aa5a64c69 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a9bf70191dc4c4dba6f4f0ae5cb6eec'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:56.361973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9c5a8325-d45e-4a3d-98da-d64aa5a64c69 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a9bf70191dc4c4dba6f4f0ae5cb6eec'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:56.460809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9c5a8325-d45e-4a3d-98da-d64aa5a64c69 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a9bf70191dc4c4dba6f4f0ae5cb6eec'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:56.507988 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2853/5659] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:38:55 2022] DELETE /identity/v3/users/5a9bf70191dc4c4dba6f4f0ae5cb6eec => generated 0 bytes in 896 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:56.509966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352f5f0-7258-47c0-9b21-27c1e84f492f tempest-test_project-1653213578 tempest-user-1994623770] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:56.534421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352f5f0-7258-47c0-9b21-27c1e84f492f tempest-test_project-1653213578 tempest-user-1994623770] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:56.600141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a8325-d45e-4a3d-98da-d64aa5a64c69 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:56.603575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9c5a8325-d45e-4a3d-98da-d64aa5a64c69 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:56.856330 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:56.876603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5a8325-d45e-4a3d-98da-d64aa5a64c69 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:56.895882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad52ef2-38a7-4ace-a63e-d70de95959f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:56.898481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad52ef2-38a7-4ace-a63e-d70de95959f8 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:56.898769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad52ef2-38a7-4ace-a63e-d70de95959f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:56.899055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad52ef2-38a7-4ace-a63e-d70de95959f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:56.907409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4ad52ef2-38a7-4ace-a63e-d70de95959f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:56.926059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053e97d-bdab-4fca-b25e-04afdfec5de4 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f33af9cc9f4a51af07379e66ffb60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01c2ed192e6143cca4895e55c8255bf5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:56.927075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053e97d-bdab-4fca-b25e-04afdfec5de4 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:56.927555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053e97d-bdab-4fca-b25e-04afdfec5de4 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:56.928135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2053e97d-bdab-4fca-b25e-04afdfec5de4 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] PATH_INFO: `/v3/projects/5cae11462f5d429e8f48aebdd698787b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:56.930464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053e97d-bdab-4fca-b25e-04afdfec5de4 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5cae11462f5d429e8f48aebdd698787b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:56.936352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2053e97d-bdab-4fca-b25e-04afdfec5de4 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:56.936744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad52ef2-38a7-4ace-a63e-d70de95959f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:56.936744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad52ef2-38a7-4ace-a63e-d70de95959f8 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:56.966310 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2854/5660] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:38:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:38:57.253465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2053e97d-bdab-4fca-b25e-04afdfec5de4 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cae11462f5d429e8f48aebdd698787b', 'request_id': 'req-2053e97d-bdab-4fca-b25e-04afdfec5de4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:57.318667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2053e97d-bdab-4fca-b25e-04afdfec5de4 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cae11462f5d429e8f48aebdd698787b', 'request_id': 'req-2053e97d-bdab-4fca-b25e-04afdfec5de4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:57.327292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2053e97d-bdab-4fca-b25e-04afdfec5de4 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cae11462f5d429e8f48aebdd698787b', 'request_id': 'req-2053e97d-bdab-4fca-b25e-04afdfec5de4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:57.363820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2053e97d-bdab-4fca-b25e-04afdfec5de4 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] The token cache is being invalidate because project 5cae11462f5d429e8f48aebdd698787b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:38:57.374475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2053e97d-bdab-4fca-b25e-04afdfec5de4 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:57.378079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2053e97d-bdab-4fca-b25e-04afdfec5de4 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:57.393654 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2807/5661] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:38:56 2022] DELETE /identity/v3/projects/5cae11462f5d429e8f48aebdd698787b => generated 0 bytes in 881 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:57.396113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad52ef2-38a7-4ace-a63e-d70de95959f8 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:57.397679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4ad52ef2-38a7-4ace-a63e-d70de95959f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:57.428118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad52ef2-38a7-4ace-a63e-d70de95959f8 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:57.603147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130667d-50bd-4ebd-82a2-ef9b8fc82c86 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f33af9cc9f4a51af07379e66ffb60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01c2ed192e6143cca4895e55c8255bf5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:57.604578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130667d-50bd-4ebd-82a2-ef9b8fc82c86 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:57.605121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130667d-50bd-4ebd-82a2-ef9b8fc82c86 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:57.605676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8130667d-50bd-4ebd-82a2-ef9b8fc82c86 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] PATH_INFO: `/v3/domains/87a85dcf1d034790b79abd6b53bad7d3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:57.607497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130667d-50bd-4ebd-82a2-ef9b8fc82c86 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=87a85dcf1d034790b79abd6b53bad7d3)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:57.609457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8130667d-50bd-4ebd-82a2-ef9b8fc82c86 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:57.682227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8130667d-50bd-4ebd-82a2-ef9b8fc82c86 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '87a85dcf1d034790b79abd6b53bad7d3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:57.692867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8130667d-50bd-4ebd-82a2-ef9b8fc82c86 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '87a85dcf1d034790b79abd6b53bad7d3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:57.864450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8130667d-50bd-4ebd-82a2-ef9b8fc82c86 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '87a85dcf1d034790b79abd6b53bad7d3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:57.865493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8130667d-50bd-4ebd-82a2-ef9b8fc82c86 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '87a85dcf1d034790b79abd6b53bad7d3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:57.881775 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2855/5662] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:38:57 2022] PATCH /identity/v3/domains/87a85dcf1d034790b79abd6b53bad7d3 => generated 246 bytes in 488 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:38:57.886299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053e97d-bdab-4fca-b25e-04afdfec5de4 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:57.897869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2053e97d-bdab-4fca-b25e-04afdfec5de4 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:57.918665 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:57.925887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2053e97d-bdab-4fca-b25e-04afdfec5de4 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:58.093084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24f33af9cc9f4a51af07379e66ffb60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '01c2ed192e6143cca4895e55c8255bf5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:58.106219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:58.106957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:58.107070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] PATH_INFO: `/v3/domains/87a85dcf1d034790b79abd6b53bad7d3` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:58.199263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=87a85dcf1d034790b79abd6b53bad7d3)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:58.202385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:58.317579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '87a85dcf1d034790b79abd6b53bad7d3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:58.366879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '87a85dcf1d034790b79abd6b53bad7d3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:58.587669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87a85dcf1d034790b79abd6b53bad7d3', 'request_id': 'req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:58.689881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87a85dcf1d034790b79abd6b53bad7d3', 'request_id': 'req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:58.710793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87a85dcf1d034790b79abd6b53bad7d3', 'request_id': 'req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:58.755647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] The token cache is being invalidate because project 87a85dcf1d034790b79abd6b53bad7d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:38:58.755946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:58.758537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:58.782778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '87a85dcf1d034790b79abd6b53bad7d3', 'request_id': 'req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:58.783920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '87a85dcf1d034790b79abd6b53bad7d3', 'request_id': 'req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:58.788861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '87a85dcf1d034790b79abd6b53bad7d3', 'request_id': 'req-2e4b21e5-83ef-4e1b-8636-b25b72fe36e0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:58.812953 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2808/5663] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:38:57 2022] DELETE /identity/v3/domains/87a85dcf1d034790b79abd6b53bad7d3 => generated 0 bytes in 923 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:58.819750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130667d-50bd-4ebd-82a2-ef9b8fc82c86 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:38:58.825210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8130667d-50bd-4ebd-82a2-ef9b8fc82c86 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:38:59.138742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8130667d-50bd-4ebd-82a2-ef9b8fc82c86 tempest-TestDefaultProjectId-1419849815 tempest-TestDefaultProjectId-1419849815-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:38:59.287382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974c083-cdd2-473d-96a8-d6254b8ac536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:38:59.288565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974c083-cdd2-473d-96a8-d6254b8ac536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:59.288839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974c083-cdd2-473d-96a8-d6254b8ac536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:59.289295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d974c083-cdd2-473d-96a8-d6254b8ac536 admin admin] PATH_INFO: `/v3/users/ec6fa160df4f46149c527682c3c779b7` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:59.293398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974c083-cdd2-473d-96a8-d6254b8ac536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec6fa160df4f46149c527682c3c779b7)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:38:59.295577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d974c083-cdd2-473d-96a8-d6254b8ac536 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:38:59.301888 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:38:59.687592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d974c083-cdd2-473d-96a8-d6254b8ac536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec6fa160df4f46149c527682c3c779b7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:59.773707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d974c083-cdd2-473d-96a8-d6254b8ac536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec6fa160df4f46149c527682c3c779b7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:59.801204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d974c083-cdd2-473d-96a8-d6254b8ac536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec6fa160df4f46149c527682c3c779b7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:59.802465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d974c083-cdd2-473d-96a8-d6254b8ac536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec6fa160df4f46149c527682c3c779b7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:59.907010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d974c083-cdd2-473d-96a8-d6254b8ac536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec6fa160df4f46149c527682c3c779b7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:38:59.915077 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2856/5664] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:38:58 2022] DELETE /identity/v3/users/ec6fa160df4f46149c527682c3c779b7 => generated 0 bytes in 1096 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:38:59.920265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfacaf-39eb-454a-a9ea-49181ab83768 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:38:59.921078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfacaf-39eb-454a-a9ea-49181ab83768 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:38:59.921532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacfacaf-39eb-454a-a9ea-49181ab83768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:38:59.963420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-aacfacaf-39eb-454a-a9ea-49181ab83768 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:38:59.968263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aacfacaf-39eb-454a-a9ea-49181ab83768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:00.074748 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:00.137172 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2809/5665] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:00.157284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974c083-cdd2-473d-96a8-d6254b8ac536 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:00.158804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d974c083-cdd2-473d-96a8-d6254b8ac536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:00.429061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d974c083-cdd2-473d-96a8-d6254b8ac536 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:00.436399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd1bca-de89-4226-9327-5480a14a03de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:00.437634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd1bca-de89-4226-9327-5480a14a03de service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:00.440555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd1bca-de89-4226-9327-5480a14a03de service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:00.443824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd1bca-de89-4226-9327-5480a14a03de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:00.541224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd1bca-de89-4226-9327-5480a14a03de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:00.543455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd1bca-de89-4226-9327-5480a14a03de service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:00.592352 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2857/5666] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:39:03.519402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfacaf-39eb-454a-a9ea-49181ab83768 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:03.519402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aacfacaf-39eb-454a-a9ea-49181ab83768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:03.537236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacfacaf-39eb-454a-a9ea-49181ab83768 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:03.543192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50155171-857f-4ba9-8db0-0a40b0cb52d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:03.543847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50155171-857f-4ba9-8db0-0a40b0cb52d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:03.544127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50155171-857f-4ba9-8db0-0a40b0cb52d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:03.544460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50155171-857f-4ba9-8db0-0a40b0cb52d8 admin admin] PATH_INFO: `/v3/projects/cee605f55caf446aa18ee09804c8d642` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:03.546474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50155171-857f-4ba9-8db0-0a40b0cb52d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee605f55caf446aa18ee09804c8d642)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:03.548552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50155171-857f-4ba9-8db0-0a40b0cb52d8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:03.819700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-50155171-857f-4ba9-8db0-0a40b0cb52d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee605f55caf446aa18ee09804c8d642', 'request_id': 'req-50155171-857f-4ba9-8db0-0a40b0cb52d8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:03.856813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40546101-aabc-4f77-9b40-c13061ff2cfa None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:03.857325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40546101-aabc-4f77-9b40-c13061ff2cfa None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:03.857437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40546101-aabc-4f77-9b40-c13061ff2cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:03.877333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-40546101-aabc-4f77-9b40-c13061ff2cfa None None] MFA Rules not processed for user `2cb5060535f440a5b822500807c10688`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:03.878420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-40546101-aabc-4f77-9b40-c13061ff2cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:03.948630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-50155171-857f-4ba9-8db0-0a40b0cb52d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee605f55caf446aa18ee09804c8d642', 'request_id': 'req-50155171-857f-4ba9-8db0-0a40b0cb52d8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:03.966712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-50155171-857f-4ba9-8db0-0a40b0cb52d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee605f55caf446aa18ee09804c8d642', 'request_id': 'req-50155171-857f-4ba9-8db0-0a40b0cb52d8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:03.988291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-50155171-857f-4ba9-8db0-0a40b0cb52d8 admin admin] The token cache is being invalidate because project cee605f55caf446aa18ee09804c8d642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:03.989586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-50155171-857f-4ba9-8db0-0a40b0cb52d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:03.990499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-50155171-857f-4ba9-8db0-0a40b0cb52d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:03.996245 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2810/5667] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:39:03 2022] DELETE /identity/v3/projects/cee605f55caf446aa18ee09804c8d642 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:04.008002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50155171-857f-4ba9-8db0-0a40b0cb52d8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:04.017421 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2858/5668] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:04.020325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-50155171-857f-4ba9-8db0-0a40b0cb52d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:04.134321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50155171-857f-4ba9-8db0-0a40b0cb52d8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:04.151369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb027ea1-c735-492b-89f2-07d781bc25b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:04.152235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb027ea1-c735-492b-89f2-07d781bc25b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:04.152482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb027ea1-c735-492b-89f2-07d781bc25b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:04.152759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb027ea1-c735-492b-89f2-07d781bc25b4 admin admin] PATH_INFO: `/v3/users/24f33af9cc9f4a51af07379e66ffb60f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:04.188873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb027ea1-c735-492b-89f2-07d781bc25b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24f33af9cc9f4a51af07379e66ffb60f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:04.195776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb027ea1-c735-492b-89f2-07d781bc25b4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:04.504198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bb027ea1-c735-492b-89f2-07d781bc25b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24f33af9cc9f4a51af07379e66ffb60f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:04.546305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bb027ea1-c735-492b-89f2-07d781bc25b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24f33af9cc9f4a51af07379e66ffb60f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:04.547085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bb027ea1-c735-492b-89f2-07d781bc25b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24f33af9cc9f4a51af07379e66ffb60f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:04.551848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bb027ea1-c735-492b-89f2-07d781bc25b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24f33af9cc9f4a51af07379e66ffb60f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:04.554825 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:04.576549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bb027ea1-c735-492b-89f2-07d781bc25b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24f33af9cc9f4a51af07379e66ffb60f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:04.581611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40546101-aabc-4f77-9b40-c13061ff2cfa None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:04.583161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-40546101-aabc-4f77-9b40-c13061ff2cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:04.663217 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:04.720447 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2811/5669] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:39:04 2022] DELETE /identity/v3/users/24f33af9cc9f4a51af07379e66ffb60f => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:04.799791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40546101-aabc-4f77-9b40-c13061ff2cfa None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:04.851961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb027ea1-c735-492b-89f2-07d781bc25b4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:04.853668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bb027ea1-c735-492b-89f2-07d781bc25b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:04.976993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91594843-d635-4323-9fa7-c3869be283ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:04.982592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91594843-d635-4323-9fa7-c3869be283ab service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:04.982592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91594843-d635-4323-9fa7-c3869be283ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:04.982592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91594843-d635-4323-9fa7-c3869be283ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:04.990159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-91594843-d635-4323-9fa7-c3869be283ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:05.042238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb027ea1-c735-492b-89f2-07d781bc25b4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:05.042238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb875ea-4f25-4bd8-a1a9-99d912b64da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:05.042238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb875ea-4f25-4bd8-a1a9-99d912b64da9 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:05.042238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb875ea-4f25-4bd8-a1a9-99d912b64da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:05.043946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb875ea-4f25-4bd8-a1a9-99d912b64da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:05.043946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cfb875ea-4f25-4bd8-a1a9-99d912b64da9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:05.043946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb875ea-4f25-4bd8-a1a9-99d912b64da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:05.043946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb875ea-4f25-4bd8-a1a9-99d912b64da9 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:05.085107 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2812/5670] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:39:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:39:05.210539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91594843-d635-4323-9fa7-c3869be283ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:05.213330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91594843-d635-4323-9fa7-c3869be283ab service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:05.241667 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2859/5671] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:39:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:39:05.951999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb875ea-4f25-4bd8-a1a9-99d912b64da9 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:05.954061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cfb875ea-4f25-4bd8-a1a9-99d912b64da9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:05.982319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb875ea-4f25-4bd8-a1a9-99d912b64da9 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:05.993433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860543e4-fddc-4589-a30a-78f3d6a98504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:05.994639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860543e4-fddc-4589-a30a-78f3d6a98504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:05.995467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860543e4-fddc-4589-a30a-78f3d6a98504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:05.996465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860543e4-fddc-4589-a30a-78f3d6a98504 admin admin] PATH_INFO: `/v3/projects/01c2ed192e6143cca4895e55c8255bf5` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:06.001543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860543e4-fddc-4589-a30a-78f3d6a98504 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01c2ed192e6143cca4895e55c8255bf5)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:06.007966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860543e4-fddc-4589-a30a-78f3d6a98504 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:06.239889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-860543e4-fddc-4589-a30a-78f3d6a98504 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01c2ed192e6143cca4895e55c8255bf5', 'request_id': 'req-860543e4-fddc-4589-a30a-78f3d6a98504'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:06.347891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-860543e4-fddc-4589-a30a-78f3d6a98504 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01c2ed192e6143cca4895e55c8255bf5', 'request_id': 'req-860543e4-fddc-4589-a30a-78f3d6a98504'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:06.354695 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-860543e4-fddc-4589-a30a-78f3d6a98504 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01c2ed192e6143cca4895e55c8255bf5', 'request_id': 'req-860543e4-fddc-4589-a30a-78f3d6a98504'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:06.406340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-860543e4-fddc-4589-a30a-78f3d6a98504 admin admin] The token cache is being invalidate because project 01c2ed192e6143cca4895e55c8255bf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:06.406340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-860543e4-fddc-4589-a30a-78f3d6a98504 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:06.412487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-860543e4-fddc-4589-a30a-78f3d6a98504 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:06.423585 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2813/5672] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:39:05 2022] DELETE /identity/v3/projects/01c2ed192e6143cca4895e55c8255bf5 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:06.430878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a9c57-69fd-4827-95b8-83c05bde63bd None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:06.430878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a9c57-69fd-4827-95b8-83c05bde63bd None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:06.430878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a9c57-69fd-4827-95b8-83c05bde63bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:06.486933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-bc1a9c57-69fd-4827-95b8-83c05bde63bd None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:06.495066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bc1a9c57-69fd-4827-95b8-83c05bde63bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:06.743020 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2860/5673] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:06.747142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf45b4e-7d37-49f6-a5b2-46982a9b2727 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:06.747444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf45b4e-7d37-49f6-a5b2-46982a9b2727 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:06.747729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf45b4e-7d37-49f6-a5b2-46982a9b2727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:06.828870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-cbf45b4e-7d37-49f6-a5b2-46982a9b2727 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:06.833458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cbf45b4e-7d37-49f6-a5b2-46982a9b2727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:06.865432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a9c57-69fd-4827-95b8-83c05bde63bd None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:06.865829 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2814/5674] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:06.881924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a9c57-69fd-4827-95b8-83c05bde63bd None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:06.902742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab802d2b-553a-44ba-a8a4-2be2ebc79c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:06.903778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab802d2b-553a-44ba-a8a4-2be2ebc79c62 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:06.904182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab802d2b-553a-44ba-a8a4-2be2ebc79c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:06.904580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab802d2b-553a-44ba-a8a4-2be2ebc79c62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:06.905692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab802d2b-553a-44ba-a8a4-2be2ebc79c62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:39:06.906218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab802d2b-553a-44ba-a8a4-2be2ebc79c62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:06.908712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab802d2b-553a-44ba-a8a4-2be2ebc79c62 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:06.915385 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:06.938746 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2861/5675] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:39:06.949257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf45b4e-7d37-49f6-a5b2-46982a9b2727 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:06.952840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68e93b-1d0f-4163-97ed-017db908bcb0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:06.953335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68e93b-1d0f-4163-97ed-017db908bcb0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:06.953830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68e93b-1d0f-4163-97ed-017db908bcb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:06.956160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf45b4e-7d37-49f6-a5b2-46982a9b2727 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:06.980601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc34c8-d405-4e7f-90de-34a662f27b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:06.982331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc34c8-d405-4e7f-90de-34a662f27b6f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:06.982732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc34c8-d405-4e7f-90de-34a662f27b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:06.983420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc34c8-d405-4e7f-90de-34a662f27b6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:06.984350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc34c8-d405-4e7f-90de-34a662f27b6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:06.991205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc34c8-d405-4e7f-90de-34a662f27b6f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:06.994223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6f68e93b-1d0f-4163-97ed-017db908bcb0 None None] MFA Rules not processed for user `d1cbf58d0cf8440aae63bf31387948f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:06.996162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6f68e93b-1d0f-4163-97ed-017db908bcb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:07.110754 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2862/5676] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:39:07.133337 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2815/5677] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:39:06 2022] POST /identity/v3/projects => generated 365 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:07.136888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68e93b-1d0f-4163-97ed-017db908bcb0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:07.160944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68e93b-1d0f-4163-97ed-017db908bcb0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:07.322201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07772d-de70-4cef-9aae-5805e9c06c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:07.323022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07772d-de70-4cef-9aae-5805e9c06c8f admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:07.324478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07772d-de70-4cef-9aae-5805e9c06c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:07.325879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a07772d-de70-4cef-9aae-5805e9c06c8f admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:07.327424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07772d-de70-4cef-9aae-5805e9c06c8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:07.332428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a07772d-de70-4cef-9aae-5805e9c06c8f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:07.466596 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2863/5678] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:39:07 2022] POST /identity/v3/users => generated 283 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:07.467266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc34c8-d405-4e7f-90de-34a662f27b6f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:07.491313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc34c8-d405-4e7f-90de-34a662f27b6f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:07.509198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b0845-c6b9-4185-8343-4e1f4da884ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:07.519488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b0845-c6b9-4185-8343-4e1f4da884ba admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:07.523124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b0845-c6b9-4185-8343-4e1f4da884ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:07.523546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b0845-c6b9-4185-8343-4e1f4da884ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:07.524831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b0845-c6b9-4185-8343-4e1f4da884ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:07.530025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b0845-c6b9-4185-8343-4e1f4da884ba admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:07.585516 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2816/5679] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:39:07.590469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07772d-de70-4cef-9aae-5805e9c06c8f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:07.606684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a07772d-de70-4cef-9aae-5805e9c06c8f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:07.614943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15805f-d4fd-46e9-b6cb-d25977b75895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:07.615799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15805f-d4fd-46e9-b6cb-d25977b75895 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:07.616121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15805f-d4fd-46e9-b6cb-d25977b75895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:07.616635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15805f-d4fd-46e9-b6cb-d25977b75895 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:07.617592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15805f-d4fd-46e9-b6cb-d25977b75895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:07.619971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15805f-d4fd-46e9-b6cb-d25977b75895 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:07.645360 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2864/5680] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:07.645780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b0845-c6b9-4185-8343-4e1f4da884ba admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:07.678523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b0845-c6b9-4185-8343-4e1f4da884ba admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:07.692978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b3528-5020-43df-866f-875efbaeb800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:07.710868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b3528-5020-43df-866f-875efbaeb800 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:07.712100 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b3528-5020-43df-866f-875efbaeb800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:07.712570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b3528-5020-43df-866f-875efbaeb800 admin admin] PATH_INFO: `/v3/projects/395f0128d8b1460b875c181ca9fa3e90/users/be2eedf495be4599bea3b07c4de1e7d5/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:07.755823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b3528-5020-43df-866f-875efbaeb800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=395f0128d8b1460b875c181ca9fa3e90, user_id=be2eedf495be4599bea3b07c4de1e7d5, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:07.761047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b3528-5020-43df-866f-875efbaeb800 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:07.886959 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2817/5681] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:39:07 2022] PUT /identity/v3/projects/395f0128d8b1460b875c181ca9fa3e90/users/be2eedf495be4599bea3b07c4de1e7d5/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:07.889281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0581ae-e56a-416b-bd7e-acfd486b9bc4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:07.889665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0581ae-e56a-416b-bd7e-acfd486b9bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:07.889959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0581ae-e56a-416b-bd7e-acfd486b9bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:07.967798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0e0581ae-e56a-416b-bd7e-acfd486b9bc4 None None] MFA Rules not processed for user `be2eedf495be4599bea3b07c4de1e7d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:07.972964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0e0581ae-e56a-416b-bd7e-acfd486b9bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:08.117990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b3528-5020-43df-866f-875efbaeb800 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:08.123350 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2865/5682] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:39:08.123588 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:08.256055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b3528-5020-43df-866f-875efbaeb800 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:08.285504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055f5f9-857d-4be8-9138-8a81029b91fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:08.286643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055f5f9-857d-4be8-9138-8a81029b91fb admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:08.287120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055f5f9-857d-4be8-9138-8a81029b91fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:08.287589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055f5f9-857d-4be8-9138-8a81029b91fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:08.288484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055f5f9-857d-4be8-9138-8a81029b91fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:08.296289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055f5f9-857d-4be8-9138-8a81029b91fb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:08.464993 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2818/5683] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:39:08 2022] POST /identity/v3/projects => generated 367 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:08.466723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0581ae-e56a-416b-bd7e-acfd486b9bc4 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:08.504087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0581ae-e56a-416b-bd7e-acfd486b9bc4 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:08.534547 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:08.713126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fe6ad-43df-4291-862f-80fb58de6be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:08.713869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fe6ad-43df-4291-862f-80fb58de6be4 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:08.716893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fe6ad-43df-4291-862f-80fb58de6be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:08.717206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fe6ad-43df-4291-862f-80fb58de6be4 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:08.717941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fe6ad-43df-4291-862f-80fb58de6be4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:08.739479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fe6ad-43df-4291-862f-80fb58de6be4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:08.902407 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2866/5684] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:39:08 2022] POST /identity/v3/users => generated 290 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:08.903069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055f5f9-857d-4be8-9138-8a81029b91fb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:08.947823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055f5f9-857d-4be8-9138-8a81029b91fb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:08.972991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330a320-f960-4c9d-b7be-92d0c0647fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:08.974997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330a320-f960-4c9d-b7be-92d0c0647fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:08.979865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330a320-f960-4c9d-b7be-92d0c0647fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:08.980226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330a320-f960-4c9d-b7be-92d0c0647fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:08.984507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4330a320-f960-4c9d-b7be-92d0c0647fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:09.004962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4330a320-f960-4c9d-b7be-92d0c0647fb4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:09.061637 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2819/5685] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:09.064268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fe6ad-43df-4291-862f-80fb58de6be4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:09.080216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fe6ad-43df-4291-862f-80fb58de6be4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:09.113692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c228902-0851-48c1-a296-9bdffc181cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:09.120811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c228902-0851-48c1-a296-9bdffc181cc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:09.120811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c228902-0851-48c1-a296-9bdffc181cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:09.120811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c228902-0851-48c1-a296-9bdffc181cc4 admin admin] PATH_INFO: `/v3/projects/b80ef7a71f3c461db609a0722392aa28/users/a75fdef858564dc1b6f340fb7490d305/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:09.155106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c228902-0851-48c1-a296-9bdffc181cc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b80ef7a71f3c461db609a0722392aa28, user_id=a75fdef858564dc1b6f340fb7490d305, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:09.158004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c228902-0851-48c1-a296-9bdffc181cc4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:09.263229 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2867/5686] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:39:09 2022] PUT /identity/v3/projects/b80ef7a71f3c461db609a0722392aa28/users/a75fdef858564dc1b6f340fb7490d305/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:09.264190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330a320-f960-4c9d-b7be-92d0c0647fb4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:09.281470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4330a320-f960-4c9d-b7be-92d0c0647fb4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:09.477233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5f1f6-06bb-4e20-9b49-9445e04ab47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:09.479139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5f1f6-06bb-4e20-9b49-9445e04ab47a admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:09.483383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5f1f6-06bb-4e20-9b49-9445e04ab47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:09.483894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5f1f6-06bb-4e20-9b49-9445e04ab47a admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:09.484895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5f1f6-06bb-4e20-9b49-9445e04ab47a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:09.490203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5f1f6-06bb-4e20-9b49-9445e04ab47a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:09.525526 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2820/5687] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:09.529585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c228902-0851-48c1-a296-9bdffc181cc4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:09.545389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c228902-0851-48c1-a296-9bdffc181cc4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:09.572243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701aa35-ae3f-4cd9-a673-6c8f4522bfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:09.576322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701aa35-ae3f-4cd9-a673-6c8f4522bfa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:09.576623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701aa35-ae3f-4cd9-a673-6c8f4522bfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:09.577904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701aa35-ae3f-4cd9-a673-6c8f4522bfa8 admin admin] PATH_INFO: `/v3/projects/b80ef7a71f3c461db609a0722392aa28/users/a75fdef858564dc1b6f340fb7490d305/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:09.583376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701aa35-ae3f-4cd9-a673-6c8f4522bfa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b80ef7a71f3c461db609a0722392aa28, user_id=a75fdef858564dc1b6f340fb7490d305, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:09.595963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701aa35-ae3f-4cd9-a673-6c8f4522bfa8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:09.640138 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2868/5688] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:39:09 2022] PUT /identity/v3/projects/b80ef7a71f3c461db609a0722392aa28/users/a75fdef858564dc1b6f340fb7490d305/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:09.651460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c11621-6c9a-4b21-a224-88b6d72962e7 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:09.652819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c11621-6c9a-4b21-a224-88b6d72962e7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:09.653333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c11621-6c9a-4b21-a224-88b6d72962e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:09.719922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-79c11621-6c9a-4b21-a224-88b6d72962e7 None None] MFA Rules not processed for user `a75fdef858564dc1b6f340fb7490d305`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:09.721370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-79c11621-6c9a-4b21-a224-88b6d72962e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:09.825307 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:09.835097 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2821/5689] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:09.839599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701aa35-ae3f-4cd9-a673-6c8f4522bfa8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:09.874881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701aa35-ae3f-4cd9-a673-6c8f4522bfa8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:09.886546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00568f9d-80f5-4bd9-a4ad-ab5273eb4067 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:09.886902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00568f9d-80f5-4bd9-a4ad-ab5273eb4067 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:09.887289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00568f9d-80f5-4bd9-a4ad-ab5273eb4067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:09.905814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cbdc3-eace-4a85-a297-c8249661ebc2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:09.908445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cbdc3-eace-4a85-a297-c8249661ebc2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:09.908445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cbdc3-eace-4a85-a297-c8249661ebc2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:09.916123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16cbdc3-eace-4a85-a297-c8249661ebc2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:09.916123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16cbdc3-eace-4a85-a297-c8249661ebc2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:09.926692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-00568f9d-80f5-4bd9-a4ad-ab5273eb4067 None None] MFA Rules not processed for user `d1cbf58d0cf8440aae63bf31387948f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:09.928067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-00568f9d-80f5-4bd9-a4ad-ab5273eb4067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:09.934325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16cbdc3-eace-4a85-a297-c8249661ebc2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:10.055672 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2869/5690] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Jul 19 14:39:09 2022] POST /identity/v3/domains => generated 277 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:10.060501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cbdc3-eace-4a85-a297-c8249661ebc2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:10.095046 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2822/5691] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:09 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:10.138513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00568f9d-80f5-4bd9-a4ad-ab5273eb4067 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:10.140326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-00568f9d-80f5-4bd9-a4ad-ab5273eb4067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:10.168128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16cbdc3-eace-4a85-a297-c8249661ebc2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:10.179636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6e30f-f17f-456d-956a-62f520882eec tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:10.180794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6e30f-f17f-456d-956a-62f520882eec tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:10.181383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6e30f-f17f-456d-956a-62f520882eec tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:10.181855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6e30f-f17f-456d-956a-62f520882eec tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:10.182924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6e30f-f17f-456d-956a-62f520882eec tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:10.188580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6e30f-f17f-456d-956a-62f520882eec tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:10.312548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00568f9d-80f5-4bd9-a4ad-ab5273eb4067 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:10.325102 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2870/5692] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Jul 19 14:39:10 2022] POST /identity/v3/domains => generated 276 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:10.331256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6e30f-f17f-456d-956a-62f520882eec tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:10.401553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fde08-e9ea-4b56-b6f3-0cae990c24c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:10.403532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fde08-e9ea-4b56-b6f3-0cae990c24c0 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:10.404453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fde08-e9ea-4b56-b6f3-0cae990c24c0 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:10.406125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fde08-e9ea-4b56-b6f3-0cae990c24c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:10.408942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f58fde08-e9ea-4b56-b6f3-0cae990c24c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:10.429718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58fde08-e9ea-4b56-b6f3-0cae990c24c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:10.431993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58fde08-e9ea-4b56-b6f3-0cae990c24c0 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:10.437053 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:10.468975 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2823/5693] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:39:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:39:10.490715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6e30f-f17f-456d-956a-62f520882eec tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:10.500418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8621017-5428-452c-8d62-88759c1fab11 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:10.500418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8621017-5428-452c-8d62-88759c1fab11 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:10.500418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8621017-5428-452c-8d62-88759c1fab11 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:10.500895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8621017-5428-452c-8d62-88759c1fab11 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:10.501287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8621017-5428-452c-8d62-88759c1fab11 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:10.504568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8621017-5428-452c-8d62-88759c1fab11 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:10.660850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fde08-e9ea-4b56-b6f3-0cae990c24c0 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:10.663160 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2871/5694] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Jul 19 14:39:10 2022] POST /identity/v3/domains => generated 277 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:10.674563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fde08-e9ea-4b56-b6f3-0cae990c24c0 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:10.744012 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:10.870329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa29271-bfce-4f3a-a00f-607f65c75027 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:10.871172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa29271-bfce-4f3a-a00f-607f65c75027 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:10.872070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa29271-bfce-4f3a-a00f-607f65c75027 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:10.873189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa29271-bfce-4f3a-a00f-607f65c75027 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:10.874975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa29271-bfce-4f3a-a00f-607f65c75027 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:10.877052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa29271-bfce-4f3a-a00f-607f65c75027 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:10.964329 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2824/5695] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Jul 19 14:39:10 2022] POST /identity/v3/domains => generated 279 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:10.968599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8621017-5428-452c-8d62-88759c1fab11 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:10.998863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8621017-5428-452c-8d62-88759c1fab11 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:11.137178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1807c-10a0-478e-a043-3ac4f0513000 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:11.138088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1807c-10a0-478e-a043-3ac4f0513000 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:11.138403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1807c-10a0-478e-a043-3ac4f0513000 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:11.138683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c1807c-10a0-478e-a043-3ac4f0513000 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains/45639930e8454be787577db5f0f6867a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:11.183624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1807c-10a0-478e-a043-3ac4f0513000 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=45639930e8454be787577db5f0f6867a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:11.185204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c1807c-10a0-478e-a043-3ac4f0513000 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:11.250948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-99c1807c-10a0-478e-a043-3ac4f0513000 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '45639930e8454be787577db5f0f6867a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:11.282473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-99c1807c-10a0-478e-a043-3ac4f0513000 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '45639930e8454be787577db5f0f6867a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:11.433295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-99c1807c-10a0-478e-a043-3ac4f0513000 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45639930e8454be787577db5f0f6867a', 'request_id': 'req-99c1807c-10a0-478e-a043-3ac4f0513000'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:11.445480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-99c1807c-10a0-478e-a043-3ac4f0513000 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45639930e8454be787577db5f0f6867a', 'request_id': 'req-99c1807c-10a0-478e-a043-3ac4f0513000'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:11.459949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-99c1807c-10a0-478e-a043-3ac4f0513000 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45639930e8454be787577db5f0f6867a', 'request_id': 'req-99c1807c-10a0-478e-a043-3ac4f0513000'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:11.542924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-99c1807c-10a0-478e-a043-3ac4f0513000 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] The token cache is being invalidate because project 45639930e8454be787577db5f0f6867a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:11.543226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-99c1807c-10a0-478e-a043-3ac4f0513000 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:11.543887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-99c1807c-10a0-478e-a043-3ac4f0513000 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:11.561738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-99c1807c-10a0-478e-a043-3ac4f0513000 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '45639930e8454be787577db5f0f6867a', 'request_id': 'req-99c1807c-10a0-478e-a043-3ac4f0513000'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:11.562557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-99c1807c-10a0-478e-a043-3ac4f0513000 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '45639930e8454be787577db5f0f6867a', 'request_id': 'req-99c1807c-10a0-478e-a043-3ac4f0513000'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:11.563611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-99c1807c-10a0-478e-a043-3ac4f0513000 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '45639930e8454be787577db5f0f6867a', 'request_id': 'req-99c1807c-10a0-478e-a043-3ac4f0513000'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:11.586427 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2872/5696] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:39:10 2022] DELETE /identity/v3/domains/45639930e8454be787577db5f0f6867a => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:11.587967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa29271-bfce-4f3a-a00f-607f65c75027 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:11.590851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8aa29271-bfce-4f3a-a00f-607f65c75027 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:11.629768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa29271-bfce-4f3a-a00f-607f65c75027 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:12.059963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602f9a2-e53b-49dc-8c56-b32b78937d9f tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:12.059963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602f9a2-e53b-49dc-8c56-b32b78937d9f tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:12.059963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602f9a2-e53b-49dc-8c56-b32b78937d9f tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:12.061595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7602f9a2-e53b-49dc-8c56-b32b78937d9f tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:12.061595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602f9a2-e53b-49dc-8c56-b32b78937d9f tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:12.061595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7602f9a2-e53b-49dc-8c56-b32b78937d9f tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:12.061595 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2825/5697] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:39:11 2022] POST /identity/v3/domains => generated 249 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:39:12.062002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1807c-10a0-478e-a043-3ac4f0513000 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:12.062002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c1807c-10a0-478e-a043-3ac4f0513000 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:12.062002 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:12.104709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff088a8-e5ea-45e3-bda8-a59dd4c86df9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:12.106923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff088a8-e5ea-45e3-bda8-a59dd4c86df9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:12.107224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff088a8-e5ea-45e3-bda8-a59dd4c86df9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:12.109685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff088a8-e5ea-45e3-bda8-a59dd4c86df9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains/1339f01c530c4f49bf2ed9cec7e99369` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:12.157480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff088a8-e5ea-45e3-bda8-a59dd4c86df9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1339f01c530c4f49bf2ed9cec7e99369)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:12.166976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff088a8-e5ea-45e3-bda8-a59dd4c86df9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:12.227722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9ff088a8-e5ea-45e3-bda8-a59dd4c86df9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1339f01c530c4f49bf2ed9cec7e99369'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:12.229541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9ff088a8-e5ea-45e3-bda8-a59dd4c86df9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1339f01c530c4f49bf2ed9cec7e99369'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:12.397385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9ff088a8-e5ea-45e3-bda8-a59dd4c86df9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1339f01c530c4f49bf2ed9cec7e99369'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:12.398530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9ff088a8-e5ea-45e3-bda8-a59dd4c86df9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1339f01c530c4f49bf2ed9cec7e99369'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:12.406058 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2873/5698] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:39:11 2022] PATCH /identity/v3/domains/1339f01c530c4f49bf2ed9cec7e99369 => generated 250 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:12.411325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602f9a2-e53b-49dc-8c56-b32b78937d9f tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:12.413229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7602f9a2-e53b-49dc-8c56-b32b78937d9f tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:12.474391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7602f9a2-e53b-49dc-8c56-b32b78937d9f tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:12.627416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff088a8-e5ea-45e3-bda8-a59dd4c86df9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:12.630668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9ff088a8-e5ea-45e3-bda8-a59dd4c86df9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:12.762849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:12.769646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:12.770017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:12.770345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains/1339f01c530c4f49bf2ed9cec7e99369` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:12.817860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1339f01c530c4f49bf2ed9cec7e99369)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:12.824836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:12.913461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1339f01c530c4f49bf2ed9cec7e99369'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:12.950597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff088a8-e5ea-45e3-bda8-a59dd4c86df9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:12.957745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1339f01c530c4f49bf2ed9cec7e99369'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:12.988415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c561e9-93a2-46eb-801d-7e5bf7932f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:12.990059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c561e9-93a2-46eb-801d-7e5bf7932f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:12.990541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c561e9-93a2-46eb-801d-7e5bf7932f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:12.990955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c561e9-93a2-46eb-801d-7e5bf7932f5d admin admin] PATH_INFO: `/v3/users/4a91252b604a402a8760f7b553606c40` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:12.992398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c561e9-93a2-46eb-801d-7e5bf7932f5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a91252b604a402a8760f7b553606c40)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:12.994947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c561e9-93a2-46eb-801d-7e5bf7932f5d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:13.044457 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:13.271164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1339f01c530c4f49bf2ed9cec7e99369', 'request_id': 'req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:13.272071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-45c561e9-93a2-46eb-801d-7e5bf7932f5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a91252b604a402a8760f7b553606c40'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:13.301520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-45c561e9-93a2-46eb-801d-7e5bf7932f5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a91252b604a402a8760f7b553606c40'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:13.309715 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:UPDATE=1,keystone:DELETE=9 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:13.314360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-45c561e9-93a2-46eb-801d-7e5bf7932f5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a91252b604a402a8760f7b553606c40'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:13.315129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-45c561e9-93a2-46eb-801d-7e5bf7932f5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a91252b604a402a8760f7b553606c40'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:13.341837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1339f01c530c4f49bf2ed9cec7e99369', 'request_id': 'req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:13.368626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1339f01c530c4f49bf2ed9cec7e99369', 'request_id': 'req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:13.413019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] The token cache is being invalidate because project 1339f01c530c4f49bf2ed9cec7e99369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:13.413299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:13.413999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:13.421141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-45c561e9-93a2-46eb-801d-7e5bf7932f5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a91252b604a402a8760f7b553606c40'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:13.430711 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2874/5699] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:39:12 2022] DELETE /identity/v3/users/4a91252b604a402a8760f7b553606c40 => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:39:13.435110 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d23b3-6e72-4c52-9907-97c4a8e96200 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:13.435403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d23b3-6e72-4c52-9907-97c4a8e96200 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:13.435684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d23b3-6e72-4c52-9907-97c4a8e96200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:13.442724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1339f01c530c4f49bf2ed9cec7e99369', 'request_id': 'req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:13.443986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1339f01c530c4f49bf2ed9cec7e99369', 'request_id': 'req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:13.445352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1339f01c530c4f49bf2ed9cec7e99369', 'request_id': 'req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:13.471749 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2826/5700] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:39:12 2022] DELETE /identity/v3/domains/1339f01c530c4f49bf2ed9cec7e99369 => generated 0 bytes in 1062 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:13.478001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:13.479860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:13.496812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3f6d23b3-6e72-4c52-9907-97c4a8e96200 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:13.498044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3f6d23b3-6e72-4c52-9907-97c4a8e96200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:13.686504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f918a4e0-aeb0-42d7-8fb3-01232d6fb2b5 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:13.700002 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2875/5701] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:39:13.850490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355bbc5-0e35-4b3a-b4ff-70b3a621ba7b tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:13.856741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355bbc5-0e35-4b3a-b4ff-70b3a621ba7b tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:13.856741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355bbc5-0e35-4b3a-b4ff-70b3a621ba7b tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:13.856741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355bbc5-0e35-4b3a-b4ff-70b3a621ba7b tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:13.856741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355bbc5-0e35-4b3a-b4ff-70b3a621ba7b tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:13.860948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355bbc5-0e35-4b3a-b4ff-70b3a621ba7b tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:13.938353 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2827/5702] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:39:13 2022] POST /identity/v3/domains => generated 278 bytes in 461 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:39:13.943365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d23b3-6e72-4c52-9907-97c4a8e96200 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:13.959380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d23b3-6e72-4c52-9907-97c4a8e96200 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:14.133539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355bbc5-0e35-4b3a-b4ff-70b3a621ba7b tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:14.135456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f355bbc5-0e35-4b3a-b4ff-70b3a621ba7b tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:14.144896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4db980-107d-4921-a1a0-674c1f9e745e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:14.145855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4db980-107d-4921-a1a0-674c1f9e745e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:14.146171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4db980-107d-4921-a1a0-674c1f9e745e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:14.146466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4db980-107d-4921-a1a0-674c1f9e745e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains/13e5e05a1d4542a39088a43da7782932` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:14.224108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4db980-107d-4921-a1a0-674c1f9e745e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=13e5e05a1d4542a39088a43da7782932)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:14.236034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4db980-107d-4921-a1a0-674c1f9e745e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:14.314326 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:14.332379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ff4db980-107d-4921-a1a0-674c1f9e745e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '13e5e05a1d4542a39088a43da7782932'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:14.334069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ff4db980-107d-4921-a1a0-674c1f9e745e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '13e5e05a1d4542a39088a43da7782932'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:14.380336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355bbc5-0e35-4b3a-b4ff-70b3a621ba7b tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:14.486575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ff4db980-107d-4921-a1a0-674c1f9e745e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '13e5e05a1d4542a39088a43da7782932'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:14.487398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ff4db980-107d-4921-a1a0-674c1f9e745e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '13e5e05a1d4542a39088a43da7782932'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:14.495398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8face16b-f5cb-4203-8b74-3eac645b1277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:14.501109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8face16b-f5cb-4203-8b74-3eac645b1277 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:14.501554 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2876/5703] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Jul 19 14:39:13 2022] PATCH /identity/v3/domains/13e5e05a1d4542a39088a43da7782932 => generated 279 bytes in 559 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:14.501774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8face16b-f5cb-4203-8b74-3eac645b1277 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:14.503030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4db980-107d-4921-a1a0-674c1f9e745e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:14.506809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8face16b-f5cb-4203-8b74-3eac645b1277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:14.507035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ff4db980-107d-4921-a1a0-674c1f9e745e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:14.507688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8face16b-f5cb-4203-8b74-3eac645b1277 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:14.684312 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:14.744341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4db980-107d-4921-a1a0-674c1f9e745e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:14.755025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928eb368-739e-48a1-8219-04fc99439d6c tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:14.757214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928eb368-739e-48a1-8219-04fc99439d6c tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:14.757437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8face16b-f5cb-4203-8b74-3eac645b1277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:14.762266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928eb368-739e-48a1-8219-04fc99439d6c tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:14.762266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928eb368-739e-48a1-8219-04fc99439d6c tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains/13e5e05a1d4542a39088a43da7782932` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:14.762553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8face16b-f5cb-4203-8b74-3eac645b1277 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:14.779841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928eb368-739e-48a1-8219-04fc99439d6c tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=13e5e05a1d4542a39088a43da7782932)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:14.783244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928eb368-739e-48a1-8219-04fc99439d6c tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:14.786650 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2828/5704] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:39:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:39:14.788865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8face16b-f5cb-4203-8b74-3eac645b1277 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:14.794334 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2877/5705] 10.222.0.43 () {58 vars in 1226 bytes} [Tue Jul 19 14:39:14 2022] GET /identity/v3/domains/13e5e05a1d4542a39088a43da7782932 => generated 279 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:14.827427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8face16b-f5cb-4203-8b74-3eac645b1277 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:14.842214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fabe0-67cf-4122-99aa-f089c77d1db2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:14.843660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fabe0-67cf-4122-99aa-f089c77d1db2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:14.844394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fabe0-67cf-4122-99aa-f089c77d1db2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:14.845110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fabe0-67cf-4122-99aa-f089c77d1db2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains/13e5e05a1d4542a39088a43da7782932` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:14.848181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fabe0-67cf-4122-99aa-f089c77d1db2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=13e5e05a1d4542a39088a43da7782932)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:14.853748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197fabe0-67cf-4122-99aa-f089c77d1db2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:14.950156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-197fabe0-67cf-4122-99aa-f089c77d1db2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '13e5e05a1d4542a39088a43da7782932'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:14.966749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-197fabe0-67cf-4122-99aa-f089c77d1db2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '13e5e05a1d4542a39088a43da7782932'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:15.152077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-197fabe0-67cf-4122-99aa-f089c77d1db2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e5e05a1d4542a39088a43da7782932', 'request_id': 'req-197fabe0-67cf-4122-99aa-f089c77d1db2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:15.235540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-197fabe0-67cf-4122-99aa-f089c77d1db2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e5e05a1d4542a39088a43da7782932', 'request_id': 'req-197fabe0-67cf-4122-99aa-f089c77d1db2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:15.246655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-197fabe0-67cf-4122-99aa-f089c77d1db2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e5e05a1d4542a39088a43da7782932', 'request_id': 'req-197fabe0-67cf-4122-99aa-f089c77d1db2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:15.274590 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:15.276315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-197fabe0-67cf-4122-99aa-f089c77d1db2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] The token cache is being invalidate because project 13e5e05a1d4542a39088a43da7782932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:15.276731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-197fabe0-67cf-4122-99aa-f089c77d1db2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:15.277793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-197fabe0-67cf-4122-99aa-f089c77d1db2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:15.292125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-197fabe0-67cf-4122-99aa-f089c77d1db2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '13e5e05a1d4542a39088a43da7782932', 'request_id': 'req-197fabe0-67cf-4122-99aa-f089c77d1db2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:15.293053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-197fabe0-67cf-4122-99aa-f089c77d1db2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '13e5e05a1d4542a39088a43da7782932', 'request_id': 'req-197fabe0-67cf-4122-99aa-f089c77d1db2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:15.293782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-197fabe0-67cf-4122-99aa-f089c77d1db2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '13e5e05a1d4542a39088a43da7782932', 'request_id': 'req-197fabe0-67cf-4122-99aa-f089c77d1db2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:15.297725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928eb368-739e-48a1-8219-04fc99439d6c tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:15.299814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-928eb368-739e-48a1-8219-04fc99439d6c tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:15.306635 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2829/5706] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:39:14 2022] DELETE /identity/v3/domains/13e5e05a1d4542a39088a43da7782932 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:15.310862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fabe0-67cf-4122-99aa-f089c77d1db2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:15.312674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-197fabe0-67cf-4122-99aa-f089c77d1db2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:15.327123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928eb368-739e-48a1-8219-04fc99439d6c tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:15.435226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10b2cd-02b2-4703-87cc-220cef205967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:15.436450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10b2cd-02b2-4703-87cc-220cef205967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:15.436745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10b2cd-02b2-4703-87cc-220cef205967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:15.437033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10b2cd-02b2-4703-87cc-220cef205967 admin admin] PATH_INFO: `/v3/projects/1cfd4acda92c4d93aa175443cae8e1e0` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:15.438548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10b2cd-02b2-4703-87cc-220cef205967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cfd4acda92c4d93aa175443cae8e1e0)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:15.441618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10b2cd-02b2-4703-87cc-220cef205967 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:15.466696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fabe0-67cf-4122-99aa-f089c77d1db2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:15.478360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60ed66-4ca6-439e-9574-72065535dc70 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:15.479139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60ed66-4ca6-439e-9574-72065535dc70 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:15.479437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60ed66-4ca6-439e-9574-72065535dc70 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:15.479719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60ed66-4ca6-439e-9574-72065535dc70 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:15.482336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60ed66-4ca6-439e-9574-72065535dc70 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:15.483973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60ed66-4ca6-439e-9574-72065535dc70 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:15.514146 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2830/5707] 10.222.0.43 () {58 vars in 1127 bytes} [Tue Jul 19 14:39:15 2022] GET /identity/v3/domains => generated 1348 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:15.516586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60ed66-4ca6-439e-9574-72065535dc70 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:15.530122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60ed66-4ca6-439e-9574-72065535dc70 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:15.537538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870ffb7-8a33-4a91-ab4b-964224f8e03f tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:15.538575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870ffb7-8a33-4a91-ab4b-964224f8e03f tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:15.539025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870ffb7-8a33-4a91-ab4b-964224f8e03f tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:15.539414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9870ffb7-8a33-4a91-ab4b-964224f8e03f tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains/13e5e05a1d4542a39088a43da7782932` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:15.557262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9870ffb7-8a33-4a91-ab4b-964224f8e03f tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 14:39:15.582837 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-9870ffb7-8a33-4a91-ab4b-964224f8e03f tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Could not find domain: 13e5e05a1d4542a39088a43da7782932.: keystone.exception.DomainNotFound: Could not find domain: 13e5e05a1d4542a39088a43da7782932. Jul 19 14:39:15.582837 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:15.582837 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 14:39:15.582837 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 14:39:15.582837 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 14:39:15.582837 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 14:39:15.582837 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 14:39:15.582837 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 14:39:15.582837 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 13e5e05a1d4542a39088a43da7782932. Jul 19 14:39:15.582837 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:15.582837 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:39:15.582837 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:15.582837 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:15.582837 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:39:15.582837 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:39:15.582837 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:39:15.593895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:39:15.593895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:39:15.593895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:39:15.593895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:39:15.593895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:39:15.593895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:39:15.593895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:39:15.593895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 14:39:15.593895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 14:39:15.593895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 14:39:15.593895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 14:39:15.593895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 14:39:15.593895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 14:39:15.593895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:39:15.593895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:39:15.593895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:39:15.594917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:39:15.594917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:39:15.594917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:39:15.594917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:39:15.594917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 14:39:15.594917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:39:15.594917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:39:15.594917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:39:15.594917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:39:15.594917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:39:15.594917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:39:15.594917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:39:15.594917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:39:15.594917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 14:39:15.594917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 14:39:15.594917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 13e5e05a1d4542a39088a43da7782932. Jul 19 14:39:15.594917 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:15.595692 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2831/5708] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:39:15 2022] PATCH /identity/v3/domains/13e5e05a1d4542a39088a43da7782932 => generated 112 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:39:15.595692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870ffb7-8a33-4a91-ab4b-964224f8e03f tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:15.608404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9870ffb7-8a33-4a91-ab4b-964224f8e03f tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:15.616166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110af749-5771-4a21-b164-244d8a64c36a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:15.621749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110af749-5771-4a21-b164-244d8a64c36a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:15.621749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110af749-5771-4a21-b164-244d8a64c36a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:15.621749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110af749-5771-4a21-b164-244d8a64c36a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:15.621749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110af749-5771-4a21-b164-244d8a64c36a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:15.621749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110af749-5771-4a21-b164-244d8a64c36a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:15.672996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b10b2cd-02b2-4703-87cc-220cef205967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cfd4acda92c4d93aa175443cae8e1e0', 'request_id': 'req-7b10b2cd-02b2-4703-87cc-220cef205967'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:15.683803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b10b2cd-02b2-4703-87cc-220cef205967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cfd4acda92c4d93aa175443cae8e1e0', 'request_id': 'req-7b10b2cd-02b2-4703-87cc-220cef205967'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:15.699716 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2832/5709] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:39:15 2022] POST /identity/v3/domains => generated 274 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:15.700876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110af749-5771-4a21-b164-244d8a64c36a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:15.704408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b10b2cd-02b2-4703-87cc-220cef205967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cfd4acda92c4d93aa175443cae8e1e0', 'request_id': 'req-7b10b2cd-02b2-4703-87cc-220cef205967'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:15.813749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110af749-5771-4a21-b164-244d8a64c36a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:15.840035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472d9ba-1cd2-44f2-93d7-3a466533c6da tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:15.840992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472d9ba-1cd2-44f2-93d7-3a466533c6da tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:15.841287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472d9ba-1cd2-44f2-93d7-3a466533c6da tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:15.842893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472d9ba-1cd2-44f2-93d7-3a466533c6da tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:15.853003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b10b2cd-02b2-4703-87cc-220cef205967 admin admin] The token cache is being invalidate because project 1cfd4acda92c4d93aa175443cae8e1e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:15.853003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b10b2cd-02b2-4703-87cc-220cef205967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:15.853003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b10b2cd-02b2-4703-87cc-220cef205967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:15.856716 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2878/5710] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:39:15 2022] DELETE /identity/v3/projects/1cfd4acda92c4d93aa175443cae8e1e0 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:39:15.856798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472d9ba-1cd2-44f2-93d7-3a466533c6da tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:15.861215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d548edc-109d-491d-aab7-686bbd3d1609 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:15.861511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d548edc-109d-491d-aab7-686bbd3d1609 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:15.861796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d548edc-109d-491d-aab7-686bbd3d1609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:15.865806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472d9ba-1cd2-44f2-93d7-3a466533c6da tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:15.945881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2d548edc-109d-491d-aab7-686bbd3d1609 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:15.950373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2d548edc-109d-491d-aab7-686bbd3d1609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:16.033168 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2879/5711] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:16.053476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c43a0-30c0-44af-9b70-cb2081db34eb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:16.055885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c43a0-30c0-44af-9b70-cb2081db34eb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:16.055885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c43a0-30c0-44af-9b70-cb2081db34eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:16.056022 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2833/5712] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:39:15 2022] POST /identity/v3/users => generated 348 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:16.058757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472d9ba-1cd2-44f2-93d7-3a466533c6da tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:16.065343 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:16.066472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7472d9ba-1cd2-44f2-93d7-3a466533c6da tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:16.078818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0a7c43a0-30c0-44af-9b70-cb2081db34eb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:16.088905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0a7c43a0-30c0-44af-9b70-cb2081db34eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:16.096432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472d9ba-1cd2-44f2-93d7-3a466533c6da tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:16.104243 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2880/5713] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:16.105886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c43a0-30c0-44af-9b70-cb2081db34eb None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:16.118481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c43a0-30c0-44af-9b70-cb2081db34eb None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:16.122230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd332d71-ef36-4824-9d69-8cbf35530a33 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:16.122979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd332d71-ef36-4824-9d69-8cbf35530a33 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:16.123273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd332d71-ef36-4824-9d69-8cbf35530a33 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:16.123559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd332d71-ef36-4824-9d69-8cbf35530a33 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/groups` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:16.124280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd332d71-ef36-4824-9d69-8cbf35530a33 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:16.126266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd332d71-ef36-4824-9d69-8cbf35530a33 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:16.133664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b3762-eb44-48f9-8119-a8a30e6dba92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:16.134476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b3762-eb44-48f9-8119-a8a30e6dba92 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:16.134851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b3762-eb44-48f9-8119-a8a30e6dba92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:16.135135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004b3762-eb44-48f9-8119-a8a30e6dba92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:16.136915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b3762-eb44-48f9-8119-a8a30e6dba92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:39:16.137235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b3762-eb44-48f9-8119-a8a30e6dba92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:16.139670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004b3762-eb44-48f9-8119-a8a30e6dba92 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:16.169029 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2881/5714] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:16.185768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b3762-eb44-48f9-8119-a8a30e6dba92 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:16.203444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004b3762-eb44-48f9-8119-a8a30e6dba92 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:16.210899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e8411-c36e-40aa-b2e8-bb47176fa873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:16.211689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8411-c36e-40aa-b2e8-bb47176fa873 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:16.212053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8411-c36e-40aa-b2e8-bb47176fa873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:16.212449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8411-c36e-40aa-b2e8-bb47176fa873 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:16.213224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e8411-c36e-40aa-b2e8-bb47176fa873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:16.215982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e8411-c36e-40aa-b2e8-bb47176fa873 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:16.233538 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2834/5715] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jul 19 14:39:16 2022] POST /identity/v3/groups => generated 325 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:16.239936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd332d71-ef36-4824-9d69-8cbf35530a33 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:16.262332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd332d71-ef36-4824-9d69-8cbf35530a33 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:16.280868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daef0e9-03ce-4914-8f65-b3cbb3857c9a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:16.282038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daef0e9-03ce-4914-8f65-b3cbb3857c9a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:16.282535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daef0e9-03ce-4914-8f65-b3cbb3857c9a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:16.283221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daef0e9-03ce-4914-8f65-b3cbb3857c9a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains/16af174d0fbe4f3fbdb9b7f6e584c185` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:16.288047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daef0e9-03ce-4914-8f65-b3cbb3857c9a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=16af174d0fbe4f3fbdb9b7f6e584c185)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:16.290005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daef0e9-03ce-4914-8f65-b3cbb3857c9a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:16.323227 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:16.341647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3daef0e9-03ce-4914-8f65-b3cbb3857c9a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '16af174d0fbe4f3fbdb9b7f6e584c185'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:16.342571 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2882/5716] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:39:16 2022] POST /identity/v3/projects => generated 369 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:16.342814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3daef0e9-03ce-4914-8f65-b3cbb3857c9a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '16af174d0fbe4f3fbdb9b7f6e584c185'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:16.344654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e8411-c36e-40aa-b2e8-bb47176fa873 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:16.346642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-622e8411-c36e-40aa-b2e8-bb47176fa873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:16.469162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3daef0e9-03ce-4914-8f65-b3cbb3857c9a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '16af174d0fbe4f3fbdb9b7f6e584c185'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:16.469798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3daef0e9-03ce-4914-8f65-b3cbb3857c9a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '16af174d0fbe4f3fbdb9b7f6e584c185'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:16.476367 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2835/5717] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:39:16 2022] PATCH /identity/v3/domains/16af174d0fbe4f3fbdb9b7f6e584c185 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:39:16.478143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e8411-c36e-40aa-b2e8-bb47176fa873 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:16.489464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daef0e9-03ce-4914-8f65-b3cbb3857c9a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:16.494938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3daef0e9-03ce-4914-8f65-b3cbb3857c9a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:16.596784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced00b43-8d6a-4b29-a388-996a746380f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:16.599734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced00b43-8d6a-4b29-a388-996a746380f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:16.600252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced00b43-8d6a-4b29-a388-996a746380f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:16.601470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced00b43-8d6a-4b29-a388-996a746380f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:16.602622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced00b43-8d6a-4b29-a388-996a746380f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:16.605411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced00b43-8d6a-4b29-a388-996a746380f9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:16.725524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daef0e9-03ce-4914-8f65-b3cbb3857c9a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:16.734896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:16.736175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:16.736624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:16.738581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains/16af174d0fbe4f3fbdb9b7f6e584c185` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:16.738723 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2883/5718] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:39:16 2022] POST /identity/v3/users => generated 285 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:16.739829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced00b43-8d6a-4b29-a388-996a746380f9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:16.741884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ced00b43-8d6a-4b29-a388-996a746380f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:16.772189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced00b43-8d6a-4b29-a388-996a746380f9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:16.782362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=16af174d0fbe4f3fbdb9b7f6e584c185)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:16.785342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:16.788210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a471568-de13-4894-af6f-2efc174c580f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:16.789428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a471568-de13-4894-af6f-2efc174c580f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:16.789728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a471568-de13-4894-af6f-2efc174c580f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:16.790273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a471568-de13-4894-af6f-2efc174c580f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:16.791146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a471568-de13-4894-af6f-2efc174c580f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:16.792712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a471568-de13-4894-af6f-2efc174c580f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:16.811011 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2884/5719] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:16.812004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a471568-de13-4894-af6f-2efc174c580f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:16.824412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '16af174d0fbe4f3fbdb9b7f6e584c185'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:16.828954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a471568-de13-4894-af6f-2efc174c580f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:16.854354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a08b0-79df-432e-be34-fdf8def1c46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:16.857594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a08b0-79df-432e-be34-fdf8def1c46f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:16.858057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a08b0-79df-432e-be34-fdf8def1c46f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:16.858373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a08b0-79df-432e-be34-fdf8def1c46f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:16.859233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a08b0-79df-432e-be34-fdf8def1c46f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:16.868065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a08b0-79df-432e-be34-fdf8def1c46f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:16.902086 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2885/5720] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:16.906325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a08b0-79df-432e-be34-fdf8def1c46f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:16.922654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a08b0-79df-432e-be34-fdf8def1c46f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:16.930221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f761ff8-7859-4aa3-bac9-397f6547ac75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:16.931442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f761ff8-7859-4aa3-bac9-397f6547ac75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:16.931905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f761ff8-7859-4aa3-bac9-397f6547ac75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:16.932820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f761ff8-7859-4aa3-bac9-397f6547ac75 admin admin] PATH_INFO: `/v3/projects/a1f41b65b26941559288c78974af3c28/users/90501d0a7a7a40719b9c72e865282a57/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:16.984838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f761ff8-7859-4aa3-bac9-397f6547ac75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f41b65b26941559288c78974af3c28, user_id=90501d0a7a7a40719b9c72e865282a57, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:16.991942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f761ff8-7859-4aa3-bac9-397f6547ac75 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:17.104098 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2886/5721] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:39:16 2022] PUT /identity/v3/projects/a1f41b65b26941559288c78974af3c28/users/90501d0a7a7a40719b9c72e865282a57/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:17.110498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abffb44-3813-4795-b742-288ecfda95ec None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:17.112188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abffb44-3813-4795-b742-288ecfda95ec None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:17.114468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abffb44-3813-4795-b742-288ecfda95ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:17.148984 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:17.154035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9abffb44-3813-4795-b742-288ecfda95ec None None] MFA Rules not processed for user `90501d0a7a7a40719b9c72e865282a57`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:17.156100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9abffb44-3813-4795-b742-288ecfda95ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:17.200112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9464bec92c21435883e974b083cc8a6c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:17.234926 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:UPDATE=1,keystone:DELETE=10 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:17.251315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9464bec92c21435883e974b083cc8a6c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:17.252430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9464bec92c21435883e974b083cc8a6c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:17.254057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9464bec92c21435883e974b083cc8a6c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:17.275075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9464bec92c21435883e974b083cc8a6c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:17.356704 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2887/5722] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:17.368999 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abffb44-3813-4795-b742-288ecfda95ec None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:17.382647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '16af174d0fbe4f3fbdb9b7f6e584c185'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:17.394808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9abffb44-3813-4795-b742-288ecfda95ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:17.479126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abffb44-3813-4795-b742-288ecfda95ec None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:17.528739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16af174d0fbe4f3fbdb9b7f6e584c185', 'request_id': 'req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:17.574737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e670ac-5387-4ff5-871a-eabfd70c8200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:17.575754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e670ac-5387-4ff5-871a-eabfd70c8200 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:17.576256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e670ac-5387-4ff5-871a-eabfd70c8200 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:17.576728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e670ac-5387-4ff5-871a-eabfd70c8200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:17.623656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16af174d0fbe4f3fbdb9b7f6e584c185', 'request_id': 'req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:17.633436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16af174d0fbe4f3fbdb9b7f6e584c185', 'request_id': 'req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:17.660345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] The token cache is being invalidate because project 16af174d0fbe4f3fbdb9b7f6e584c185 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:17.661755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:17.664289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:17.680218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e670ac-5387-4ff5-871a-eabfd70c8200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:17.682135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e670ac-5387-4ff5-871a-eabfd70c8200 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:17.685115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '16af174d0fbe4f3fbdb9b7f6e584c185', 'request_id': 'req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:17.698128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '16af174d0fbe4f3fbdb9b7f6e584c185', 'request_id': 'req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:17.702029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '16af174d0fbe4f3fbdb9b7f6e584c185', 'request_id': 'req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:17.717414 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2888/5723] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:39:17 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:39:17.725346 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2836/5724] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:39:16 2022] DELETE /identity/v3/domains/16af174d0fbe4f3fbdb9b7f6e584c185 => generated 0 bytes in 1235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:17.726377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e670ac-5387-4ff5-871a-eabfd70c8200 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:17.727835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b2e670ac-5387-4ff5-871a-eabfd70c8200 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:17.863866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e670ac-5387-4ff5-871a-eabfd70c8200 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:17.914912 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:17.966885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42efa70-ffd2-4a62-8d37-ceec86a9d3b1 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:17.969139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42efa70-ffd2-4a62-8d37-ceec86a9d3b1 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:17.970504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42efa70-ffd2-4a62-8d37-ceec86a9d3b1 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:17.972327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42efa70-ffd2-4a62-8d37-ceec86a9d3b1 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains/16af174d0fbe4f3fbdb9b7f6e584c185` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:17.982829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42efa70-ffd2-4a62-8d37-ceec86a9d3b1 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=16af174d0fbe4f3fbdb9b7f6e584c185)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:17.985302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42efa70-ffd2-4a62-8d37-ceec86a9d3b1 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:18.008059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-c42efa70-ffd2-4a62-8d37-ceec86a9d3b1 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Could not find domain: 16af174d0fbe4f3fbdb9b7f6e584c185.: keystone.exception.DomainNotFound: Could not find domain: 16af174d0fbe4f3fbdb9b7f6e584c185. Jul 19 14:39:18.008059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:18.008059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 14:39:18.008059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 14:39:18.008059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 14:39:18.008059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 14:39:18.008059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 14:39:18.008059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 14:39:18.008059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 16af174d0fbe4f3fbdb9b7f6e584c185. Jul 19 14:39:18.008059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:18.008059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:39:18.008059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:18.008059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:18.008059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:39:18.008059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:39:18.008059 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:39:18.008969 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:39:18.008969 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:39:18.008969 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:39:18.008969 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:39:18.008969 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:39:18.008969 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:39:18.008969 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:39:18.008969 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 14:39:18.008969 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 14:39:18.008969 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 14:39:18.008969 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 14:39:18.008969 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:39:18.008969 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:39:18.008969 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:39:18.008969 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:39:18.008969 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:39:18.008969 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:39:18.009831 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:39:18.009831 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 14:39:18.009831 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:39:18.009831 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:39:18.009831 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:39:18.009831 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:39:18.009831 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:39:18.009831 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:39:18.009831 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:39:18.009831 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:39:18.009831 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 14:39:18.009831 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 14:39:18.009831 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 16af174d0fbe4f3fbdb9b7f6e584c185. Jul 19 14:39:18.009831 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:18.014149 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2889/5725] 10.222.0.43 () {58 vars in 1226 bytes} [Tue Jul 19 14:39:17 2022] GET /identity/v3/domains/16af174d0fbe4f3fbdb9b7f6e584c185 => generated 112 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:39:18.018737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:18.020934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:18.040774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aed2ca-bc78-4ee9-a4b5-eb480d295c6e tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:18.048850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9622044-4bd5-4683-99ff-09047224bd22 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:18.050999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9622044-4bd5-4683-99ff-09047224bd22 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:18.051664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9622044-4bd5-4683-99ff-09047224bd22 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:18.052598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9622044-4bd5-4683-99ff-09047224bd22 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/users/9464bec92c21435883e974b083cc8a6c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:18.068295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9622044-4bd5-4683-99ff-09047224bd22 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:get_user(user_id=9464bec92c21435883e974b083cc8a6c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:18.071755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9622044-4bd5-4683-99ff-09047224bd22 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:18.101004 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-b9622044-4bd5-4683-99ff-09047224bd22 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Could not find user: 9464bec92c21435883e974b083cc8a6c.: keystone.exception.UserNotFound: Could not find user: 9464bec92c21435883e974b083cc8a6c. Jul 19 14:39:18.101004 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:18.101004 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:39:18.101004 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:39:18.101004 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:39:18.101004 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:39:18.101004 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:39:18.101004 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:39:18.101004 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:39:18.101004 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:39:18.101004 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:39:18.101004 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:39:18.101004 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 14:39:18.101004 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 14:39:18.101903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 14:39:18.101903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 14:39:18.101903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:39:18.101903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:39:18.101903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 14:39:18.101903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 14:39:18.101903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 14:39:18.101903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 14:39:18.101903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:39:18.101903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:39:18.101903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:39:18.101903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:39:18.101903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:39:18.101903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 14:39:18.101903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:39:18.101903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:39:18.101903 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:39:18.102820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:39:18.102820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:39:18.102820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:39:18.102820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:39:18.102820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:39:18.102820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 14:39:18.102820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 14:39:18.102820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 14:39:18.102820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 14:39:18.102820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 14:39:18.102820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 14:39:18.102820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 9464bec92c21435883e974b083cc8a6c. Jul 19 14:39:18.102820 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:18.106631 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2837/5726] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Jul 19 14:39:18 2022] GET /identity/v3/users/9464bec92c21435883e974b083cc8a6c => generated 110 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 19 14:39:18.110158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42efa70-ffd2-4a62-8d37-ceec86a9d3b1 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:18.127357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42efa70-ffd2-4a62-8d37-ceec86a9d3b1 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:18.134266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a3c7b-25d2-44a9-9afe-ed26d876c8b9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:18.135370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a3c7b-25d2-44a9-9afe-ed26d876c8b9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:18.136014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a3c7b-25d2-44a9-9afe-ed26d876c8b9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:18.136866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995a3c7b-25d2-44a9-9afe-ed26d876c8b9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/groups/92ec85f848704cf9a62a88f90c33abe9` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:18.144640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a3c7b-25d2-44a9-9afe-ed26d876c8b9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:get_group(group_id=92ec85f848704cf9a62a88f90c33abe9)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:18.146201 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-995a3c7b-25d2-44a9-9afe-ed26d876c8b9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:39:18.146201 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:39:18.146201 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:39:18.148510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995a3c7b-25d2-44a9-9afe-ed26d876c8b9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:18.171086 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-995a3c7b-25d2-44a9-9afe-ed26d876c8b9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Could not find group: 92ec85f848704cf9a62a88f90c33abe9.: keystone.exception.GroupNotFound: Could not find group: 92ec85f848704cf9a62a88f90c33abe9. Jul 19 14:39:18.171086 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:18.171086 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:39:18.171086 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:39:18.171086 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:39:18.171086 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:39:18.171086 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:39:18.171086 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:39:18.171086 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:39:18.171086 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:39:18.171086 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:39:18.171086 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:39:18.171086 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Jul 19 14:39:18.171086 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_group(group_id) Jul 19 14:39:18.176968 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Jul 19 14:39:18.176968 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Jul 19 14:39:18.176968 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:39:18.176968 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:39:18.176968 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 14:39:18.176968 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 14:39:18.176968 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 14:39:18.176968 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 14:39:18.176968 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:39:18.176968 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:39:18.176968 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:39:18.176968 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:39:18.176968 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:39:18.176968 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 14:39:18.176968 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:39:18.176968 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:39:18.176968 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:39:18.177900 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:39:18.177900 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:39:18.177900 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:39:18.177900 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:39:18.177900 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:39:18.177900 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jul 19 14:39:18.177900 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jul 19 14:39:18.177900 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jul 19 14:39:18.177900 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jul 19 14:39:18.177900 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jul 19 14:39:18.177900 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jul 19 14:39:18.177900 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 92ec85f848704cf9a62a88f90c33abe9. Jul 19 14:39:18.177900 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:18.177900 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2890/5727] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:39:18 2022] GET /identity/v3/groups/92ec85f848704cf9a62a88f90c33abe9 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 19 14:39:18.179179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9622044-4bd5-4683-99ff-09047224bd22 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:18.193376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9622044-4bd5-4683-99ff-09047224bd22 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:18.213734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59ec52-cfbd-4aa2-82eb-16828f7f63dc tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:18.214655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59ec52-cfbd-4aa2-82eb-16828f7f63dc tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:18.214952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59ec52-cfbd-4aa2-82eb-16828f7f63dc tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:18.215244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea59ec52-cfbd-4aa2-82eb-16828f7f63dc tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/groups/92ec85f848704cf9a62a88f90c33abe9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:18.239427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea59ec52-cfbd-4aa2-82eb-16828f7f63dc tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 14:39:18.251645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-ea59ec52-cfbd-4aa2-82eb-16828f7f63dc tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Could not find group: 92ec85f848704cf9a62a88f90c33abe9.: keystone.exception.GroupNotFound: Could not find group: 92ec85f848704cf9a62a88f90c33abe9. Jul 19 14:39:18.251645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:18.251645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:39:18.251645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:39:18.251645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:39:18.251645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:39:18.251645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:39:18.251645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:39:18.251645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:39:18.251645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:39:18.251645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:39:18.251645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:39:18.251645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Jul 19 14:39:18.251645 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Jul 19 14:39:18.252618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 14:39:18.252618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 14:39:18.252618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 14:39:18.252618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 14:39:18.252618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:39:18.252618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:39:18.252618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 14:39:18.252618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 14:39:18.252618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 14:39:18.252618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 14:39:18.252618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:39:18.252618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:39:18.252618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:39:18.252618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:39:18.252618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:39:18.252618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 14:39:18.252618 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:39:18.254733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:39:18.254733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:39:18.254733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:39:18.254733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:39:18.254733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:39:18.254733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:39:18.254733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:39:18.254733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jul 19 14:39:18.254733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jul 19 14:39:18.254733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jul 19 14:39:18.254733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jul 19 14:39:18.254733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jul 19 14:39:18.254733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jul 19 14:39:18.254733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 92ec85f848704cf9a62a88f90c33abe9. Jul 19 14:39:18.254733 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:18.261060 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2838/5728] 10.222.0.43 () {58 vars in 1226 bytes} [Tue Jul 19 14:39:18 2022] DELETE /identity/v3/groups/92ec85f848704cf9a62a88f90c33abe9 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:39:18.261810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a3c7b-25d2-44a9-9afe-ed26d876c8b9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:18.276847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995a3c7b-25d2-44a9-9afe-ed26d876c8b9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:18.283001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f9377-54e5-4c3e-ace4-30360212a5bf tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:18.283955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f9377-54e5-4c3e-ace4-30360212a5bf tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:18.284305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f9377-54e5-4c3e-ace4-30360212a5bf tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:18.284627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f9377-54e5-4c3e-ace4-30360212a5bf tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/users/9464bec92c21435883e974b083cc8a6c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:18.294383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f9377-54e5-4c3e-ace4-30360212a5bf tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9464bec92c21435883e974b083cc8a6c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:18.297372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f9377-54e5-4c3e-ace4-30360212a5bf tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:18.326718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-dd1f9377-54e5-4c3e-ace4-30360212a5bf tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Could not find user: 9464bec92c21435883e974b083cc8a6c.: keystone.exception.UserNotFound: Could not find user: 9464bec92c21435883e974b083cc8a6c. Jul 19 14:39:18.326718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:18.326718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:39:18.326718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:39:18.326718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:39:18.326718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:39:18.326718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:39:18.326718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:39:18.326718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:39:18.326718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:39:18.326718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:39:18.326718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:39:18.326718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Jul 19 14:39:18.326718 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Jul 19 14:39:18.327713 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:39:18.327713 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:39:18.327713 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 14:39:18.327713 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 14:39:18.327713 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 14:39:18.327713 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 14:39:18.327713 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Jul 19 14:39:18.327713 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Jul 19 14:39:18.327713 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:39:18.327713 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:39:18.327713 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 14:39:18.327713 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 14:39:18.327713 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 14:39:18.327713 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 14:39:18.327713 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:39:18.327713 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:39:18.327713 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:39:18.327713 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:39:18.328750 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:39:18.328750 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 14:39:18.328750 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:39:18.328750 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:39:18.328750 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:39:18.328750 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:39:18.328750 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:39:18.328750 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:39:18.328750 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:39:18.328750 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:39:18.328750 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 14:39:18.328750 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 14:39:18.328750 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 14:39:18.328750 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 14:39:18.328750 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 14:39:18.328750 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 14:39:18.328750 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 9464bec92c21435883e974b083cc8a6c. Jul 19 14:39:18.328750 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:18.331956 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2891/5729] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:39:18 2022] DELETE /identity/v3/users/9464bec92c21435883e974b083cc8a6c => generated 110 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:39:18.332890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59ec52-cfbd-4aa2-82eb-16828f7f63dc tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:18.347975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea59ec52-cfbd-4aa2-82eb-16828f7f63dc tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:18.359527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f2ed5-048c-4f09-9599-80e815daaa50 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:18.360421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f2ed5-048c-4f09-9599-80e815daaa50 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:18.360716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f2ed5-048c-4f09-9599-80e815daaa50 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:18.361002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f2ed5-048c-4f09-9599-80e815daaa50 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains/16af174d0fbe4f3fbdb9b7f6e584c185` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:18.382662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f2ed5-048c-4f09-9599-80e815daaa50 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 14:39:18.400147 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-f11f2ed5-048c-4f09-9599-80e815daaa50 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Could not find domain: 16af174d0fbe4f3fbdb9b7f6e584c185.: keystone.exception.DomainNotFound: Could not find domain: 16af174d0fbe4f3fbdb9b7f6e584c185. Jul 19 14:39:18.400147 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:18.400147 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 14:39:18.400147 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 14:39:18.400147 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 14:39:18.400147 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 14:39:18.400147 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 14:39:18.400147 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 14:39:18.400147 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 16af174d0fbe4f3fbdb9b7f6e584c185. Jul 19 14:39:18.400147 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:18.400147 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:39:18.400147 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:18.400147 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:18.400147 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:39:18.400147 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:39:18.400147 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:39:18.400993 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:39:18.400993 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:39:18.400993 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:39:18.400993 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:39:18.400993 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:39:18.400993 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:39:18.400993 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:39:18.400993 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 14:39:18.400993 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 14:39:18.400993 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 14:39:18.400993 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 14:39:18.400993 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 14:39:18.400993 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 14:39:18.400993 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:39:18.400993 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:39:18.400993 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:39:18.407066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:39:18.407066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:39:18.407066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:39:18.407066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:39:18.407066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 14:39:18.407066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:39:18.407066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:39:18.407066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:39:18.407066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:39:18.407066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:39:18.407066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:39:18.407066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:39:18.407066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:39:18.407066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 14:39:18.407066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 14:39:18.407066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 16af174d0fbe4f3fbdb9b7f6e584c185. Jul 19 14:39:18.407066 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:18.408092 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2839/5730] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:39:18 2022] PATCH /identity/v3/domains/16af174d0fbe4f3fbdb9b7f6e584c185 => generated 112 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 19 14:39:18.410979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f9377-54e5-4c3e-ace4-30360212a5bf tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:18.428980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f9377-54e5-4c3e-ace4-30360212a5bf tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:18.440502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651d3d7-d1aa-4b3e-9a5e-a14c13014d47 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:18.441325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651d3d7-d1aa-4b3e-9a5e-a14c13014d47 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:18.441768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651d3d7-d1aa-4b3e-9a5e-a14c13014d47 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:18.442194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5651d3d7-d1aa-4b3e-9a5e-a14c13014d47 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:18.443188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651d3d7-d1aa-4b3e-9a5e-a14c13014d47 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:18.444977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5651d3d7-d1aa-4b3e-9a5e-a14c13014d47 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:18.466735 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2892/5731] 10.222.0.43 () {58 vars in 1127 bytes} [Tue Jul 19 14:39:18 2022] GET /identity/v3/domains => generated 1348 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:18.467480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f2ed5-048c-4f09-9599-80e815daaa50 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:18.484572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f2ed5-048c-4f09-9599-80e815daaa50 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:18.499322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c32b48-7870-42d0-9648-25bbc468dba2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:18.500024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c32b48-7870-42d0-9648-25bbc468dba2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:18.500320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c32b48-7870-42d0-9648-25bbc468dba2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:18.500605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c32b48-7870-42d0-9648-25bbc468dba2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:18.501494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c32b48-7870-42d0-9648-25bbc468dba2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:39:18.502008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c32b48-7870-42d0-9648-25bbc468dba2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:18.503969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c32b48-7870-42d0-9648-25bbc468dba2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:18.566746 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2840/5732] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:39:18 2022] GET /identity/v3/domains?enabled=True => generated 1095 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:39:18.567211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651d3d7-d1aa-4b3e-9a5e-a14c13014d47 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:18.580197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5651d3d7-d1aa-4b3e-9a5e-a14c13014d47 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:18.594524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc9fc9-dbbb-42b9-bfb2-008a807fd5a9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:18.595511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc9fc9-dbbb-42b9-bfb2-008a807fd5a9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:18.598360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc9fc9-dbbb-42b9-bfb2-008a807fd5a9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:18.601280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc9fc9-dbbb-42b9-bfb2-008a807fd5a9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:18.602336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc9fc9-dbbb-42b9-bfb2-008a807fd5a9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-1435564094) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:39:18.602889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc9fc9-dbbb-42b9-bfb2-008a807fd5a9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:18.606899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecc9fc9-dbbb-42b9-bfb2-008a807fd5a9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:18.642894 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2893/5733] 10.222.0.43 () {58 vars in 1198 bytes} [Tue Jul 19 14:39:18 2022] GET /identity/v3/domains?name=tempest-test_domain-1435564094 => generated 409 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:18.643064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c32b48-7870-42d0-9648-25bbc468dba2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:18.655492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c32b48-7870-42d0-9648-25bbc468dba2 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:18.661764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a5815-dc63-4016-a339-0d3e24274a71 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:18.662895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a5815-dc63-4016-a339-0d3e24274a71 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:18.663203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a5815-dc63-4016-a339-0d3e24274a71 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:18.663490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a5815-dc63-4016-a339-0d3e24274a71 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains/16af174d0fbe4f3fbdb9b7f6e584c185` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:18.672410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a5815-dc63-4016-a339-0d3e24274a71 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 14:39:18.684353 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-c79a5815-dc63-4016-a339-0d3e24274a71 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Could not find domain: 16af174d0fbe4f3fbdb9b7f6e584c185.: keystone.exception.DomainNotFound: Could not find domain: 16af174d0fbe4f3fbdb9b7f6e584c185. Jul 19 14:39:18.684353 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:18.684353 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 14:39:18.684353 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 14:39:18.684353 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 14:39:18.684353 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 14:39:18.684353 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 14:39:18.684353 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 14:39:18.684353 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 16af174d0fbe4f3fbdb9b7f6e584c185. Jul 19 14:39:18.684353 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:18.684353 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:39:18.684353 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:18.684353 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:18.684353 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:39:18.684353 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:39:18.684353 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:39:18.685323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:39:18.685323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:39:18.685323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:39:18.685323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:39:18.685323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:39:18.685323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:39:18.685323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:39:18.685323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 14:39:18.685323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 14:39:18.685323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 14:39:18.685323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 14:39:18.685323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 14:39:18.685323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 14:39:18.685323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:39:18.685323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:39:18.685323 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:39:18.686073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:39:18.686073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:39:18.686073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:39:18.686073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:39:18.686073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 14:39:18.686073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:39:18.686073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:39:18.686073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:39:18.686073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:39:18.686073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:39:18.686073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:39:18.686073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:39:18.686073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:39:18.686073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 14:39:18.686073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 14:39:18.686073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 16af174d0fbe4f3fbdb9b7f6e584c185. Jul 19 14:39:18.686073 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:18.686917 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2841/5734] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:39:18 2022] PATCH /identity/v3/domains/16af174d0fbe4f3fbdb9b7f6e584c185 => generated 112 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:39:18.690149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc9fc9-dbbb-42b9-bfb2-008a807fd5a9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:18.702924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc9fc9-dbbb-42b9-bfb2-008a807fd5a9 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:18.716972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8383f-3cbd-4b13-958d-3053141a7302 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:18.717886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8383f-3cbd-4b13-958d-3053141a7302 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:18.719944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8383f-3cbd-4b13-958d-3053141a7302 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:18.720240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8383f-3cbd-4b13-958d-3053141a7302 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains/4ac437000c55439c83f18b672765977e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:18.762354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8383f-3cbd-4b13-958d-3053141a7302 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4ac437000c55439c83f18b672765977e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:18.764029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8383f-3cbd-4b13-958d-3053141a7302 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:18.882419 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2894/5735] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:39:18 2022] PATCH /identity/v3/domains/4ac437000c55439c83f18b672765977e => generated 277 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:18.886392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a5815-dc63-4016-a339-0d3e24274a71 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:18.900874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a5815-dc63-4016-a339-0d3e24274a71 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:18.908068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e099f08-cded-41d5-9788-b120c8478f52 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:18.909469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e099f08-cded-41d5-9788-b120c8478f52 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:18.909978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e099f08-cded-41d5-9788-b120c8478f52 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:18.910588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e099f08-cded-41d5-9788-b120c8478f52 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains/4ac437000c55439c83f18b672765977e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:18.929777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e099f08-cded-41d5-9788-b120c8478f52 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4ac437000c55439c83f18b672765977e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:18.931614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e099f08-cded-41d5-9788-b120c8478f52 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:18.964120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e099f08-cded-41d5-9788-b120c8478f52 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4ac437000c55439c83f18b672765977e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:18.972186 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:18.980687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e099f08-cded-41d5-9788-b120c8478f52 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4ac437000c55439c83f18b672765977e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:19.138882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e099f08-cded-41d5-9788-b120c8478f52 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac437000c55439c83f18b672765977e', 'request_id': 'req-0e099f08-cded-41d5-9788-b120c8478f52'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:19.280682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e099f08-cded-41d5-9788-b120c8478f52 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac437000c55439c83f18b672765977e', 'request_id': 'req-0e099f08-cded-41d5-9788-b120c8478f52'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:19.291774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e099f08-cded-41d5-9788-b120c8478f52 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac437000c55439c83f18b672765977e', 'request_id': 'req-0e099f08-cded-41d5-9788-b120c8478f52'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:19.318601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e099f08-cded-41d5-9788-b120c8478f52 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] The token cache is being invalidate because project 4ac437000c55439c83f18b672765977e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:19.318601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e099f08-cded-41d5-9788-b120c8478f52 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:19.320528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e099f08-cded-41d5-9788-b120c8478f52 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:19.348987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e099f08-cded-41d5-9788-b120c8478f52 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4ac437000c55439c83f18b672765977e', 'request_id': 'req-0e099f08-cded-41d5-9788-b120c8478f52'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:19.351149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e099f08-cded-41d5-9788-b120c8478f52 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4ac437000c55439c83f18b672765977e', 'request_id': 'req-0e099f08-cded-41d5-9788-b120c8478f52'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:19.353041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e099f08-cded-41d5-9788-b120c8478f52 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4ac437000c55439c83f18b672765977e', 'request_id': 'req-0e099f08-cded-41d5-9788-b120c8478f52'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:19.372907 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2842/5736] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:39:18 2022] DELETE /identity/v3/domains/4ac437000c55439c83f18b672765977e => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:39:19.376293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8383f-3cbd-4b13-958d-3053141a7302 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:19.378485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dce8383f-3cbd-4b13-958d-3053141a7302 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:19.404844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8383f-3cbd-4b13-958d-3053141a7302 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:19.427263 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:19.603084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dc8e2-5744-49ce-887d-675814a41a03 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:19.604179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dc8e2-5744-49ce-887d-675814a41a03 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:19.604580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dc8e2-5744-49ce-887d-675814a41a03 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:19.604973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2dc8e2-5744-49ce-887d-675814a41a03 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains/29555dec4a4c490ea9c7f636d25b15ac` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:19.632151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2dc8e2-5744-49ce-887d-675814a41a03 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=29555dec4a4c490ea9c7f636d25b15ac)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:19.633990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2dc8e2-5744-49ce-887d-675814a41a03 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:19.683165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b2dc8e2-5744-49ce-887d-675814a41a03 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '29555dec4a4c490ea9c7f636d25b15ac'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:19.683165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b2dc8e2-5744-49ce-887d-675814a41a03 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '29555dec4a4c490ea9c7f636d25b15ac'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:19.802380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b2dc8e2-5744-49ce-887d-675814a41a03 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '29555dec4a4c490ea9c7f636d25b15ac'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:19.804844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b2dc8e2-5744-49ce-887d-675814a41a03 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '29555dec4a4c490ea9c7f636d25b15ac'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:19.841467 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2895/5737] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:39:19 2022] PATCH /identity/v3/domains/29555dec4a4c490ea9c7f636d25b15ac => generated 277 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:19.842364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e099f08-cded-41d5-9788-b120c8478f52 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:19.857998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e099f08-cded-41d5-9788-b120c8478f52 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:19.976501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e087e30-7353-4d1a-97b7-e65fb3a14908 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:19.977536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e087e30-7353-4d1a-97b7-e65fb3a14908 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:19.977886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e087e30-7353-4d1a-97b7-e65fb3a14908 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:19.978295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e087e30-7353-4d1a-97b7-e65fb3a14908 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains/29555dec4a4c490ea9c7f636d25b15ac` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:19.991807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e087e30-7353-4d1a-97b7-e65fb3a14908 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=29555dec4a4c490ea9c7f636d25b15ac)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:19.993625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e087e30-7353-4d1a-97b7-e65fb3a14908 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:20.032213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8e087e30-7353-4d1a-97b7-e65fb3a14908 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '29555dec4a4c490ea9c7f636d25b15ac'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:20.049645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8e087e30-7353-4d1a-97b7-e65fb3a14908 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '29555dec4a4c490ea9c7f636d25b15ac'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:20.227748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8e087e30-7353-4d1a-97b7-e65fb3a14908 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29555dec4a4c490ea9c7f636d25b15ac', 'request_id': 'req-8e087e30-7353-4d1a-97b7-e65fb3a14908'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:20.229957 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:20.337537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8e087e30-7353-4d1a-97b7-e65fb3a14908 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29555dec4a4c490ea9c7f636d25b15ac', 'request_id': 'req-8e087e30-7353-4d1a-97b7-e65fb3a14908'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:20.348547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8e087e30-7353-4d1a-97b7-e65fb3a14908 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29555dec4a4c490ea9c7f636d25b15ac', 'request_id': 'req-8e087e30-7353-4d1a-97b7-e65fb3a14908'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:20.369247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8e087e30-7353-4d1a-97b7-e65fb3a14908 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] The token cache is being invalidate because project 29555dec4a4c490ea9c7f636d25b15ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:20.369595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8e087e30-7353-4d1a-97b7-e65fb3a14908 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:20.376404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8e087e30-7353-4d1a-97b7-e65fb3a14908 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:20.387497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8e087e30-7353-4d1a-97b7-e65fb3a14908 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '29555dec4a4c490ea9c7f636d25b15ac', 'request_id': 'req-8e087e30-7353-4d1a-97b7-e65fb3a14908'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:20.388323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8e087e30-7353-4d1a-97b7-e65fb3a14908 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '29555dec4a4c490ea9c7f636d25b15ac', 'request_id': 'req-8e087e30-7353-4d1a-97b7-e65fb3a14908'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:20.388958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8e087e30-7353-4d1a-97b7-e65fb3a14908 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '29555dec4a4c490ea9c7f636d25b15ac', 'request_id': 'req-8e087e30-7353-4d1a-97b7-e65fb3a14908'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:20.405934 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2843/5738] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:39:19 2022] DELETE /identity/v3/domains/29555dec4a4c490ea9c7f636d25b15ac => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:20.410947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dc8e2-5744-49ce-887d-675814a41a03 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:20.412821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6b2dc8e2-5744-49ce-887d-675814a41a03 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:20.431102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2dc8e2-5744-49ce-887d-675814a41a03 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:20.576899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a3a3f-f037-4eb0-9d68-4ac535b1412a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:20.577976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a3a3f-f037-4eb0-9d68-4ac535b1412a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:20.578298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a3a3f-f037-4eb0-9d68-4ac535b1412a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:20.578676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a3a3f-f037-4eb0-9d68-4ac535b1412a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains/d56a03d06159449b8f936a7916d15687` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:20.621326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a3a3f-f037-4eb0-9d68-4ac535b1412a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d56a03d06159449b8f936a7916d15687)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:20.624702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a3a3f-f037-4eb0-9d68-4ac535b1412a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:20.682896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-217a3a3f-f037-4eb0-9d68-4ac535b1412a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd56a03d06159449b8f936a7916d15687'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:20.686832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-217a3a3f-f037-4eb0-9d68-4ac535b1412a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd56a03d06159449b8f936a7916d15687'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:20.840502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-217a3a3f-f037-4eb0-9d68-4ac535b1412a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd56a03d06159449b8f936a7916d15687'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:20.841407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-217a3a3f-f037-4eb0-9d68-4ac535b1412a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd56a03d06159449b8f936a7916d15687'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:20.846460 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2896/5739] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:39:20 2022] PATCH /identity/v3/domains/d56a03d06159449b8f936a7916d15687 => generated 278 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:20.852169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e087e30-7353-4d1a-97b7-e65fb3a14908 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:20.854803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8e087e30-7353-4d1a-97b7-e65fb3a14908 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:20.885479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e087e30-7353-4d1a-97b7-e65fb3a14908 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:21.008379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed113bb9-6355-4154-a0d5-7a427a067d84 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a75fdef858564dc1b6f340fb7490d305', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b80ef7a71f3c461db609a0722392aa28', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:21.010023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed113bb9-6355-4154-a0d5-7a427a067d84 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:21.010576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed113bb9-6355-4154-a0d5-7a427a067d84 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:21.011258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed113bb9-6355-4154-a0d5-7a427a067d84 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] PATH_INFO: `/v3/domains/d56a03d06159449b8f936a7916d15687` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:21.030765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed113bb9-6355-4154-a0d5-7a427a067d84 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d56a03d06159449b8f936a7916d15687)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:21.032783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed113bb9-6355-4154-a0d5-7a427a067d84 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:21.061427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed113bb9-6355-4154-a0d5-7a427a067d84 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd56a03d06159449b8f936a7916d15687'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:21.075367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed113bb9-6355-4154-a0d5-7a427a067d84 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd56a03d06159449b8f936a7916d15687'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:21.233074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed113bb9-6355-4154-a0d5-7a427a067d84 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd56a03d06159449b8f936a7916d15687', 'request_id': 'req-ed113bb9-6355-4154-a0d5-7a427a067d84'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:21.306929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed113bb9-6355-4154-a0d5-7a427a067d84 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd56a03d06159449b8f936a7916d15687', 'request_id': 'req-ed113bb9-6355-4154-a0d5-7a427a067d84'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:21.319806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed113bb9-6355-4154-a0d5-7a427a067d84 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd56a03d06159449b8f936a7916d15687', 'request_id': 'req-ed113bb9-6355-4154-a0d5-7a427a067d84'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:21.333565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed113bb9-6355-4154-a0d5-7a427a067d84 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] The token cache is being invalidate because project d56a03d06159449b8f936a7916d15687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:21.333941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed113bb9-6355-4154-a0d5-7a427a067d84 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:21.335006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed113bb9-6355-4154-a0d5-7a427a067d84 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:21.342563 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:21.356012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed113bb9-6355-4154-a0d5-7a427a067d84 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd56a03d06159449b8f936a7916d15687', 'request_id': 'req-ed113bb9-6355-4154-a0d5-7a427a067d84'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:21.356012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed113bb9-6355-4154-a0d5-7a427a067d84 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd56a03d06159449b8f936a7916d15687', 'request_id': 'req-ed113bb9-6355-4154-a0d5-7a427a067d84'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:21.356012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed113bb9-6355-4154-a0d5-7a427a067d84 tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd56a03d06159449b8f936a7916d15687', 'request_id': 'req-ed113bb9-6355-4154-a0d5-7a427a067d84'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:21.367539 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2844/5740] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:39:20 2022] DELETE /identity/v3/domains/d56a03d06159449b8f936a7916d15687 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:21.371385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a3a3f-f037-4eb0-9d68-4ac535b1412a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:21.373548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-217a3a3f-f037-4eb0-9d68-4ac535b1412a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:21.417937 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:UPDATE=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:21.475335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a3a3f-f037-4eb0-9d68-4ac535b1412a tempest-DomainsTestJSON-1056628887 tempest-DomainsTestJSON-1056628887-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:21.724494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a10302-0255-43ec-8014-ebe3d96ac019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:21.725398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a10302-0255-43ec-8014-ebe3d96ac019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:21.725707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a10302-0255-43ec-8014-ebe3d96ac019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:21.725973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a10302-0255-43ec-8014-ebe3d96ac019 admin admin] PATH_INFO: `/v3/users/be2eedf495be4599bea3b07c4de1e7d5` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:21.728036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a10302-0255-43ec-8014-ebe3d96ac019 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be2eedf495be4599bea3b07c4de1e7d5)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:21.730236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a10302-0255-43ec-8014-ebe3d96ac019 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:21.971730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-64a10302-0255-43ec-8014-ebe3d96ac019 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be2eedf495be4599bea3b07c4de1e7d5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:21.990843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-64a10302-0255-43ec-8014-ebe3d96ac019 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be2eedf495be4599bea3b07c4de1e7d5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:22.011904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-64a10302-0255-43ec-8014-ebe3d96ac019 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be2eedf495be4599bea3b07c4de1e7d5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:22.014288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-64a10302-0255-43ec-8014-ebe3d96ac019 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be2eedf495be4599bea3b07c4de1e7d5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:22.120389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-64a10302-0255-43ec-8014-ebe3d96ac019 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be2eedf495be4599bea3b07c4de1e7d5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:22.127247 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2897/5741] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:39:21 2022] DELETE /identity/v3/users/be2eedf495be4599bea3b07c4de1e7d5 => generated 0 bytes in 756 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:22.133503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcf2aa-477e-41c6-a822-13e75dfd7566 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:22.134148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcf2aa-477e-41c6-a822-13e75dfd7566 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:22.134647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcf2aa-477e-41c6-a822-13e75dfd7566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:22.164737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-dbfcf2aa-477e-41c6-a822-13e75dfd7566 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:22.166359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-dbfcf2aa-477e-41c6-a822-13e75dfd7566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:22.293621 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2845/5742] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:22.302654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a10302-0255-43ec-8014-ebe3d96ac019 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:22.304753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-64a10302-0255-43ec-8014-ebe3d96ac019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:22.374590 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:22.399918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a10302-0255-43ec-8014-ebe3d96ac019 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:22.404510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34759c-36f1-4895-98a0-7dcbe9dc7ba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:22.410737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34759c-36f1-4895-98a0-7dcbe9dc7ba0 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:22.410737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34759c-36f1-4895-98a0-7dcbe9dc7ba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:22.410737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34759c-36f1-4895-98a0-7dcbe9dc7ba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:22.451647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34759c-36f1-4895-98a0-7dcbe9dc7ba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:22.453390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34759c-36f1-4895-98a0-7dcbe9dc7ba0 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:22.476731 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2898/5743] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:39:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:39:23.736669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcf2aa-477e-41c6-a822-13e75dfd7566 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:23.739127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-dbfcf2aa-477e-41c6-a822-13e75dfd7566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:23.764816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcf2aa-477e-41c6-a822-13e75dfd7566 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:23.775607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611effd3-5ef0-4062-a1f6-6ca428a602ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:23.776922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611effd3-5ef0-4062-a1f6-6ca428a602ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:23.777689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611effd3-5ef0-4062-a1f6-6ca428a602ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:23.783680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611effd3-5ef0-4062-a1f6-6ca428a602ce admin admin] PATH_INFO: `/v3/projects/395f0128d8b1460b875c181ca9fa3e90` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:23.783680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611effd3-5ef0-4062-a1f6-6ca428a602ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=395f0128d8b1460b875c181ca9fa3e90)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:23.783680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611effd3-5ef0-4062-a1f6-6ca428a602ce admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:23.963648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-611effd3-5ef0-4062-a1f6-6ca428a602ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '395f0128d8b1460b875c181ca9fa3e90', 'request_id': 'req-611effd3-5ef0-4062-a1f6-6ca428a602ce'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:24.096131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-611effd3-5ef0-4062-a1f6-6ca428a602ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '395f0128d8b1460b875c181ca9fa3e90', 'request_id': 'req-611effd3-5ef0-4062-a1f6-6ca428a602ce'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:24.110036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-611effd3-5ef0-4062-a1f6-6ca428a602ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '395f0128d8b1460b875c181ca9fa3e90', 'request_id': 'req-611effd3-5ef0-4062-a1f6-6ca428a602ce'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:24.147001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-611effd3-5ef0-4062-a1f6-6ca428a602ce admin admin] The token cache is being invalidate because project 395f0128d8b1460b875c181ca9fa3e90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:24.147001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-611effd3-5ef0-4062-a1f6-6ca428a602ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:24.147657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-611effd3-5ef0-4062-a1f6-6ca428a602ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:24.150005 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2846/5744] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:39:23 2022] DELETE /identity/v3/projects/395f0128d8b1460b875c181ca9fa3e90 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:24.154225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34759c-36f1-4895-98a0-7dcbe9dc7ba0 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:24.172368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34759c-36f1-4895-98a0-7dcbe9dc7ba0 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:24.330509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554a48f-83ea-46ba-a7c0-2776697b19cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:24.332383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554a48f-83ea-46ba-a7c0-2776697b19cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:24.333826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554a48f-83ea-46ba-a7c0-2776697b19cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:24.334904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554a48f-83ea-46ba-a7c0-2776697b19cd admin admin] PATH_INFO: `/v3/users/a75fdef858564dc1b6f340fb7490d305` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:24.336470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554a48f-83ea-46ba-a7c0-2776697b19cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a75fdef858564dc1b6f340fb7490d305)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:24.339245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554a48f-83ea-46ba-a7c0-2776697b19cd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:24.607864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6554a48f-83ea-46ba-a7c0-2776697b19cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a75fdef858564dc1b6f340fb7490d305'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:24.624931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6554a48f-83ea-46ba-a7c0-2776697b19cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a75fdef858564dc1b6f340fb7490d305'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:24.658475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6554a48f-83ea-46ba-a7c0-2776697b19cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a75fdef858564dc1b6f340fb7490d305'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:24.658475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6554a48f-83ea-46ba-a7c0-2776697b19cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a75fdef858564dc1b6f340fb7490d305'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:24.742014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6554a48f-83ea-46ba-a7c0-2776697b19cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a75fdef858564dc1b6f340fb7490d305'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:24.750795 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2899/5745] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:39:24 2022] DELETE /identity/v3/users/a75fdef858564dc1b6f340fb7490d305 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:25.679412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611effd3-5ef0-4062-a1f6-6ca428a602ce admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:25.681427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-611effd3-5ef0-4062-a1f6-6ca428a602ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:25.711527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611effd3-5ef0-4062-a1f6-6ca428a602ce admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:25.840990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbde84c-c9b5-4099-89ea-ec709c68ad8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:25.842519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbde84c-c9b5-4099-89ea-ec709c68ad8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:25.843090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbde84c-c9b5-4099-89ea-ec709c68ad8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:25.844553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbde84c-c9b5-4099-89ea-ec709c68ad8c admin admin] PATH_INFO: `/v3/projects/b80ef7a71f3c461db609a0722392aa28` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:25.847900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbde84c-c9b5-4099-89ea-ec709c68ad8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b80ef7a71f3c461db609a0722392aa28)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:25.851496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbde84c-c9b5-4099-89ea-ec709c68ad8c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:25.876393 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:26.068764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-efbde84c-c9b5-4099-89ea-ec709c68ad8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b80ef7a71f3c461db609a0722392aa28', 'request_id': 'req-efbde84c-c9b5-4099-89ea-ec709c68ad8c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:26.165745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-efbde84c-c9b5-4099-89ea-ec709c68ad8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b80ef7a71f3c461db609a0722392aa28', 'request_id': 'req-efbde84c-c9b5-4099-89ea-ec709c68ad8c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:26.196140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-efbde84c-c9b5-4099-89ea-ec709c68ad8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b80ef7a71f3c461db609a0722392aa28', 'request_id': 'req-efbde84c-c9b5-4099-89ea-ec709c68ad8c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:26.224501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-efbde84c-c9b5-4099-89ea-ec709c68ad8c admin admin] The token cache is being invalidate because project b80ef7a71f3c461db609a0722392aa28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:26.224821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-efbde84c-c9b5-4099-89ea-ec709c68ad8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:26.231397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-efbde84c-c9b5-4099-89ea-ec709c68ad8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:26.240494 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2847/5746] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:39:25 2022] DELETE /identity/v3/projects/b80ef7a71f3c461db609a0722392aa28 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:26.241742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b052343-87d7-459a-8f0b-4622a410cde0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:26.242210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b052343-87d7-459a-8f0b-4622a410cde0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:26.243975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b052343-87d7-459a-8f0b-4622a410cde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:26.291204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9b052343-87d7-459a-8f0b-4622a410cde0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:26.292462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9b052343-87d7-459a-8f0b-4622a410cde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:26.437849 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:26.464362 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2900/5747] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:26.475575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644b6e6-3525-4555-8358-3f164f955dba None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:26.475866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644b6e6-3525-4555-8358-3f164f955dba None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:26.476150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644b6e6-3525-4555-8358-3f164f955dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:26.541826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5644b6e6-3525-4555-8358-3f164f955dba None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:26.543994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5644b6e6-3525-4555-8358-3f164f955dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:26.579460 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2848/5748] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:26.581016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b052343-87d7-459a-8f0b-4622a410cde0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:26.596221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b052343-87d7-459a-8f0b-4622a410cde0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:26.607613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc8b44-2d0f-4324-8c07-a7b60daf6fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:26.608666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc8b44-2d0f-4324-8c07-a7b60daf6fcc admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:26.609253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc8b44-2d0f-4324-8c07-a7b60daf6fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:26.609744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc8b44-2d0f-4324-8c07-a7b60daf6fcc admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:26.610798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc8b44-2d0f-4324-8c07-a7b60daf6fcc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:39:26.611302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc8b44-2d0f-4324-8c07-a7b60daf6fcc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:26.613263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc8b44-2d0f-4324-8c07-a7b60daf6fcc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:26.630181 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2901/5749] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:26.634506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644b6e6-3525-4555-8358-3f164f955dba None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:26.646397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644b6e6-3525-4555-8358-3f164f955dba None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:26.652350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29dde1b-94c2-4e6e-83ed-e21589eeb4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:26.653338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dde1b-94c2-4e6e-83ed-e21589eeb4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:26.653947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dde1b-94c2-4e6e-83ed-e21589eeb4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:26.654588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29dde1b-94c2-4e6e-83ed-e21589eeb4c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:26.656250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29dde1b-94c2-4e6e-83ed-e21589eeb4c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:26.658926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29dde1b-94c2-4e6e-83ed-e21589eeb4c3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:26.762615 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2849/5750] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:39:26 2022] POST /identity/v3/projects => generated 369 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:39:26.766602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc8b44-2d0f-4324-8c07-a7b60daf6fcc admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:26.778048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc8b44-2d0f-4324-8c07-a7b60daf6fcc admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:26.859336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165b65e-4b25-4a44-b83a-5e66f21e499e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:26.860045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165b65e-4b25-4a44-b83a-5e66f21e499e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:26.860336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165b65e-4b25-4a44-b83a-5e66f21e499e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:26.860620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b165b65e-4b25-4a44-b83a-5e66f21e499e admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:26.861350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165b65e-4b25-4a44-b83a-5e66f21e499e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:26.863486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b165b65e-4b25-4a44-b83a-5e66f21e499e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:26.999404 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2902/5751] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:39:26 2022] POST /identity/v3/users => generated 285 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:39:27.004740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29dde1b-94c2-4e6e-83ed-e21589eeb4c3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:27.016763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29dde1b-94c2-4e6e-83ed-e21589eeb4c3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:27.023193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763b911-d14e-44b8-a317-f3be6050656d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:27.023893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763b911-d14e-44b8-a317-f3be6050656d admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:27.024180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763b911-d14e-44b8-a317-f3be6050656d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:27.024460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5763b911-d14e-44b8-a317-f3be6050656d admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:27.025205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763b911-d14e-44b8-a317-f3be6050656d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:27.027092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5763b911-d14e-44b8-a317-f3be6050656d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:27.046411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165b65e-4b25-4a44-b83a-5e66f21e499e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:27.055914 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2850/5752] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:27.060080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b165b65e-4b25-4a44-b83a-5e66f21e499e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:27.080613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0717e1-a10b-452a-8a0f-2b0801a97f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:27.081947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0717e1-a10b-452a-8a0f-2b0801a97f69 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:27.082565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0717e1-a10b-452a-8a0f-2b0801a97f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:27.083917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0717e1-a10b-452a-8a0f-2b0801a97f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:27.085163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0717e1-a10b-452a-8a0f-2b0801a97f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:27.087209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0717e1-a10b-452a-8a0f-2b0801a97f69 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:27.105995 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2903/5753] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:27.110796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763b911-d14e-44b8-a317-f3be6050656d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:27.130924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5763b911-d14e-44b8-a317-f3be6050656d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:27.137346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c5910-5d72-4106-89c5-aab54de6a113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:27.139398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c5910-5d72-4106-89c5-aab54de6a113 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:27.140094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c5910-5d72-4106-89c5-aab54de6a113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:27.140577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c5910-5d72-4106-89c5-aab54de6a113 admin admin] PATH_INFO: `/v3/projects/802874b61c6746a5ba4a05bdcd244fde/users/6dee1e9f3b1e498aba0f3115ca2ec1e6/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:27.180047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c5910-5d72-4106-89c5-aab54de6a113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=802874b61c6746a5ba4a05bdcd244fde, user_id=6dee1e9f3b1e498aba0f3115ca2ec1e6, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:27.183769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c5910-5d72-4106-89c5-aab54de6a113 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:27.270966 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2851/5754] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:39:27 2022] PUT /identity/v3/projects/802874b61c6746a5ba4a05bdcd244fde/users/6dee1e9f3b1e498aba0f3115ca2ec1e6/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:27.280871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf9be3-e072-45b0-9c19-15d59eb94f8b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:27.281326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf9be3-e072-45b0-9c19-15d59eb94f8b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:27.281450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf9be3-e072-45b0-9c19-15d59eb94f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:27.351972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-75cf9be3-e072-45b0-9c19-15d59eb94f8b None None] MFA Rules not processed for user `6dee1e9f3b1e498aba0f3115ca2ec1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:27.353267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-75cf9be3-e072-45b0-9c19-15d59eb94f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:27.520903 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2904/5755] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:27 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:27.526183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c5910-5d72-4106-89c5-aab54de6a113 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:27.613329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf9be3-e072-45b0-9c19-15d59eb94f8b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:27.615098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-75cf9be3-e072-45b0-9c19-15d59eb94f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:27.752733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c5910-5d72-4106-89c5-aab54de6a113 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:27.785493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45806833-2ca9-4dee-8910-10311753cb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:27.786310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45806833-2ca9-4dee-8910-10311753cb46 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:27.786564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45806833-2ca9-4dee-8910-10311753cb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:27.786846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45806833-2ca9-4dee-8910-10311753cb46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:27.791422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45806833-2ca9-4dee-8910-10311753cb46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:27.797440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45806833-2ca9-4dee-8910-10311753cb46 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:27.866359 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:27.882973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf9be3-e072-45b0-9c19-15d59eb94f8b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:27.895372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f99c6-8e54-468a-81be-6e0a231584ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:27.896868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f99c6-8e54-468a-81be-6e0a231584ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:27.897198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f99c6-8e54-468a-81be-6e0a231584ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:27.897430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f99c6-8e54-468a-81be-6e0a231584ec admin admin] PATH_INFO: `/v3/users/e6bc3137faaf44cbb477f55fd7bd2644` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:27.909369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f99c6-8e54-468a-81be-6e0a231584ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6bc3137faaf44cbb477f55fd7bd2644)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:27.912939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f99c6-8e54-468a-81be-6e0a231584ec admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:27.969284 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2852/5756] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:39:27 2022] POST /identity/v3/projects => generated 369 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:27.970289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45806833-2ca9-4dee-8910-10311753cb46 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:28.026792 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:28.106949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45806833-2ca9-4dee-8910-10311753cb46 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:28.113321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf88e29-7959-4007-ad7d-b359a051fbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:28.114406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf88e29-7959-4007-ad7d-b359a051fbc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:28.114763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf88e29-7959-4007-ad7d-b359a051fbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:28.115272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf88e29-7959-4007-ad7d-b359a051fbc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:28.116056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf88e29-7959-4007-ad7d-b359a051fbc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:28.118133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf88e29-7959-4007-ad7d-b359a051fbc6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:28.186572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-864f99c6-8e54-468a-81be-6e0a231584ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6bc3137faaf44cbb477f55fd7bd2644'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:28.203098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-864f99c6-8e54-468a-81be-6e0a231584ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6bc3137faaf44cbb477f55fd7bd2644'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:28.234771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-864f99c6-8e54-468a-81be-6e0a231584ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6bc3137faaf44cbb477f55fd7bd2644'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:28.236052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-864f99c6-8e54-468a-81be-6e0a231584ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6bc3137faaf44cbb477f55fd7bd2644'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:28.280211 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2853/5757] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:39:27 2022] POST /identity/v3/users => generated 291 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:28.281540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf88e29-7959-4007-ad7d-b359a051fbc6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:28.283798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3cf88e29-7959-4007-ad7d-b359a051fbc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:28.360723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-864f99c6-8e54-468a-81be-6e0a231584ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6bc3137faaf44cbb477f55fd7bd2644'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:28.380047 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2905/5758] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:39:27 2022] DELETE /identity/v3/users/e6bc3137faaf44cbb477f55fd7bd2644 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:28.382949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f99c6-8e54-468a-81be-6e0a231584ec admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:28.385785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-864f99c6-8e54-468a-81be-6e0a231584ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:28.387439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf88e29-7959-4007-ad7d-b359a051fbc6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:28.487771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b1569-f68f-4caa-ac37-5ffc6af01732 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:28.488891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b1569-f68f-4caa-ac37-5ffc6af01732 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:28.489363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b1569-f68f-4caa-ac37-5ffc6af01732 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:28.489925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b1569-f68f-4caa-ac37-5ffc6af01732 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:28.492405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-545b1569-f68f-4caa-ac37-5ffc6af01732 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:28.544059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f99c6-8e54-468a-81be-6e0a231584ec admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:28.558182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038cbee-2bef-47ea-b50d-f7ca4ca61a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:28.559179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038cbee-2bef-47ea-b50d-f7ca4ca61a91 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:28.559615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038cbee-2bef-47ea-b50d-f7ca4ca61a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:28.560031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038cbee-2bef-47ea-b50d-f7ca4ca61a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:28.560921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038cbee-2bef-47ea-b50d-f7ca4ca61a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:28.564093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038cbee-2bef-47ea-b50d-f7ca4ca61a91 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:28.578847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b1569-f68f-4caa-ac37-5ffc6af01732 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:28.580753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b1569-f68f-4caa-ac37-5ffc6af01732 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:28.585320 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2906/5759] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:28.589570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038cbee-2bef-47ea-b50d-f7ca4ca61a91 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:28.593137 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2854/5760] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:39:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:39:28.622646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038cbee-2bef-47ea-b50d-f7ca4ca61a91 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:28.636304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdcc28-931a-4b2b-bf99-b2cf7a83adfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:28.637047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdcc28-931a-4b2b-bf99-b2cf7a83adfe admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:28.637336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdcc28-931a-4b2b-bf99-b2cf7a83adfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:28.637681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdcc28-931a-4b2b-bf99-b2cf7a83adfe admin admin] PATH_INFO: `/v3/projects/6990df7e286e4329b1c37d708e2837e8/users/d820ba5c977643d0b937b88f2f81871c/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:28.667659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdcc28-931a-4b2b-bf99-b2cf7a83adfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=6990df7e286e4329b1c37d708e2837e8, user_id=d820ba5c977643d0b937b88f2f81871c, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:28.673001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdcc28-931a-4b2b-bf99-b2cf7a83adfe admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:28.802194 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2907/5761] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:39:28 2022] PUT /identity/v3/projects/6990df7e286e4329b1c37d708e2837e8/users/d820ba5c977643d0b937b88f2f81871c/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:28.806642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b1569-f68f-4caa-ac37-5ffc6af01732 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:28.830592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b1569-f68f-4caa-ac37-5ffc6af01732 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:28.903965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361f3a34-0040-45ca-b7ee-549a8ac7cb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:28.905157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f3a34-0040-45ca-b7ee-549a8ac7cb94 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:28.905745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f3a34-0040-45ca-b7ee-549a8ac7cb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:28.906496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361f3a34-0040-45ca-b7ee-549a8ac7cb94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:28.907616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f3a34-0040-45ca-b7ee-549a8ac7cb94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:28.911280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361f3a34-0040-45ca-b7ee-549a8ac7cb94 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:28.928729 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2855/5762] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:39:28.936877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdcc28-931a-4b2b-bf99-b2cf7a83adfe admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:28.976872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdcc28-931a-4b2b-bf99-b2cf7a83adfe admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:28.986631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d65ef-5869-4b39-920d-6ce1b284e24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:28.987737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d65ef-5869-4b39-920d-6ce1b284e24e admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:28.988072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d65ef-5869-4b39-920d-6ce1b284e24e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:28.991576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d65ef-5869-4b39-920d-6ce1b284e24e admin admin] PATH_INFO: `/v3/projects/6990df7e286e4329b1c37d708e2837e8/users/d820ba5c977643d0b937b88f2f81871c/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:28.995053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d65ef-5869-4b39-920d-6ce1b284e24e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6990df7e286e4329b1c37d708e2837e8, user_id=d820ba5c977643d0b937b88f2f81871c, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:29.001349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d65ef-5869-4b39-920d-6ce1b284e24e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:29.042365 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2908/5763] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:39:28 2022] PUT /identity/v3/projects/6990df7e286e4329b1c37d708e2837e8/users/d820ba5c977643d0b937b88f2f81871c/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:29.061546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8d1c1-dc20-448e-b1bc-11375a53478f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:29.061850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8d1c1-dc20-448e-b1bc-11375a53478f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:29.062254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8d1c1-dc20-448e-b1bc-11375a53478f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:29.103723 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:29.133124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-20e8d1c1-dc20-448e-b1bc-11375a53478f None None] MFA Rules not processed for user `d820ba5c977643d0b937b88f2f81871c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:29.135204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-20e8d1c1-dc20-448e-b1bc-11375a53478f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:29.151948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d65ef-5869-4b39-920d-6ce1b284e24e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:29.154414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f97d65ef-5869-4b39-920d-6ce1b284e24e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:29.338962 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:29.343174 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2856/5764] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:29 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:29.348258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8d1c1-dc20-448e-b1bc-11375a53478f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:29.359651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8d1c1-dc20-448e-b1bc-11375a53478f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:29.381366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d029ba-246c-4c74-98d0-12e9428c1b16 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:29.382207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d029ba-246c-4c74-98d0-12e9428c1b16 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:29.382580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d029ba-246c-4c74-98d0-12e9428c1b16 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:29.382947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d029ba-246c-4c74-98d0-12e9428c1b16 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:29.383777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d029ba-246c-4c74-98d0-12e9428c1b16 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:29.385525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d029ba-246c-4c74-98d0-12e9428c1b16 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:29.481803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d65ef-5869-4b39-920d-6ce1b284e24e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:29.506732 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2857/5765] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:39:29 2022] POST /identity/v3/services => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:39:29.511952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d029ba-246c-4c74-98d0-12e9428c1b16 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:29.541262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28d817-4052-4613-885e-bbfd2ff72384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:29.542414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28d817-4052-4613-885e-bbfd2ff72384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:29.542875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28d817-4052-4613-885e-bbfd2ff72384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:29.543718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28d817-4052-4613-885e-bbfd2ff72384 admin admin] PATH_INFO: `/v3/projects/5435f51af9664b14b10bf10a88f0c7c5` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:29.547644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28d817-4052-4613-885e-bbfd2ff72384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5435f51af9664b14b10bf10a88f0c7c5)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:29.554437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28d817-4052-4613-885e-bbfd2ff72384 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:29.575906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d029ba-246c-4c74-98d0-12e9428c1b16 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:29.587719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c6baf-9e30-4f3b-9c11-50f2779ad4bb tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:29.588417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c6baf-9e30-4f3b-9c11-50f2779ad4bb tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:29.588762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c6baf-9e30-4f3b-9c11-50f2779ad4bb tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:29.589103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c6baf-9e30-4f3b-9c11-50f2779ad4bb tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:29.589837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c6baf-9e30-4f3b-9c11-50f2779ad4bb tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:29.592050 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-a61c6baf-9e30-4f3b-9c11-50f2779ad4bb tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:39:29.592050 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:39:29.592050 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:39:29.592917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c6baf-9e30-4f3b-9c11-50f2779ad4bb tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:29.762766 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-a61c6baf-9e30-4f3b-9c11-50f2779ad4bb tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1959172941. To ensure interoperability, identifiers should be a valid uuid. Jul 19 14:39:29.762766 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 14:39:29.762766 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:39:29.782451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5f28d817-4052-4613-885e-bbfd2ff72384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5435f51af9664b14b10bf10a88f0c7c5', 'request_id': 'req-5f28d817-4052-4613-885e-bbfd2ff72384'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:29.795373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5f28d817-4052-4613-885e-bbfd2ff72384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5435f51af9664b14b10bf10a88f0c7c5', 'request_id': 'req-5f28d817-4052-4613-885e-bbfd2ff72384'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:29.824105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5f28d817-4052-4613-885e-bbfd2ff72384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5435f51af9664b14b10bf10a88f0c7c5', 'request_id': 'req-5f28d817-4052-4613-885e-bbfd2ff72384'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:29.897799 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2858/5766] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Jul 19 14:39:29 2022] POST /identity/v3/endpoints => generated 361 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:29.897799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c6baf-9e30-4f3b-9c11-50f2779ad4bb tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:29.941278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c6baf-9e30-4f3b-9c11-50f2779ad4bb tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:29.950795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5f28d817-4052-4613-885e-bbfd2ff72384 admin admin] The token cache is being invalidate because project 5435f51af9664b14b10bf10a88f0c7c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:29.952601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5f28d817-4052-4613-885e-bbfd2ff72384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:29.953699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5f28d817-4052-4613-885e-bbfd2ff72384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:29.955707 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2909/5767] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:39:29 2022] DELETE /identity/v3/projects/5435f51af9664b14b10bf10a88f0c7c5 => generated 0 bytes in 805 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:29.973409 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:29.975213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28d817-4052-4613-885e-bbfd2ff72384 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:29.995602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5f28d817-4052-4613-885e-bbfd2ff72384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:30.062498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e74ae-b051-498c-bfae-e87cb3ea06f3 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:30.063381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e74ae-b051-498c-bfae-e87cb3ea06f3 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:30.063674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e74ae-b051-498c-bfae-e87cb3ea06f3 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:30.063959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e74ae-b051-498c-bfae-e87cb3ea06f3 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/regions/tempest-region-1959172941` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:30.064640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e74ae-b051-498c-bfae-e87cb3ea06f3 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1959172941)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:30.065866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e74ae-b051-498c-bfae-e87cb3ea06f3 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:30.072124 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2859/5768] 10.222.0.43 () {58 vars in 1205 bytes} [Tue Jul 19 14:39:29 2022] GET /identity/v3/regions/tempest-region-1959172941 => generated 180 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:39:30.074062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e74ae-b051-498c-bfae-e87cb3ea06f3 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:30.082380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f20e74ae-b051-498c-bfae-e87cb3ea06f3 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:30.113321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e74ae-b051-498c-bfae-e87cb3ea06f3 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:30.126293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a34fee-6c53-419d-b0ca-1c15eb9be49f tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:30.127226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a34fee-6c53-419d-b0ca-1c15eb9be49f tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:30.127504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a34fee-6c53-419d-b0ca-1c15eb9be49f tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:30.127801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a34fee-6c53-419d-b0ca-1c15eb9be49f tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:30.128932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a34fee-6c53-419d-b0ca-1c15eb9be49f tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:30.130638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a34fee-6c53-419d-b0ca-1c15eb9be49f tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:30.182596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28d817-4052-4613-885e-bbfd2ff72384 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:30.239259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc83c0-ea65-43a0-bcfd-fad47a8e056d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:30.240899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc83c0-ea65-43a0-bcfd-fad47a8e056d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:30.241395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc83c0-ea65-43a0-bcfd-fad47a8e056d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:30.241897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc83c0-ea65-43a0-bcfd-fad47a8e056d admin admin] PATH_INFO: `/v3/users/3b2c539fb4064555a2ba7e63ae395bd8` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:30.244649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc83c0-ea65-43a0-bcfd-fad47a8e056d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b2c539fb4064555a2ba7e63ae395bd8)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:30.250064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bc83c0-ea65-43a0-bcfd-fad47a8e056d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:30.254659 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2860/5769] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:39:30 2022] POST /identity/v3/services => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:30.258305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a34fee-6c53-419d-b0ca-1c15eb9be49f tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:30.311330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a34fee-6c53-419d-b0ca-1c15eb9be49f tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:30.324906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f582d-cc29-476a-acd3-e937dc1e8b8e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:30.325593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f582d-cc29-476a-acd3-e937dc1e8b8e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:30.325890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f582d-cc29-476a-acd3-e937dc1e8b8e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:30.326206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f582d-cc29-476a-acd3-e937dc1e8b8e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:30.326984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f582d-cc29-476a-acd3-e937dc1e8b8e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:30.328618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f582d-cc29-476a-acd3-e937dc1e8b8e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:30.508870 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-e97f582d-cc29-476a-acd3-e937dc1e8b8e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1035759193. To ensure interoperability, identifiers should be a valid uuid. Jul 19 14:39:30.508870 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 14:39:30.508870 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:39:30.566374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-91bc83c0-ea65-43a0-bcfd-fad47a8e056d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b2c539fb4064555a2ba7e63ae395bd8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:30.571557 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:30.615082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-91bc83c0-ea65-43a0-bcfd-fad47a8e056d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b2c539fb4064555a2ba7e63ae395bd8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:30.641845 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2861/5770] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Jul 19 14:39:30 2022] POST /identity/v3/endpoints => generated 362 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:39:30.643161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f582d-cc29-476a-acd3-e937dc1e8b8e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:30.663383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-91bc83c0-ea65-43a0-bcfd-fad47a8e056d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b2c539fb4064555a2ba7e63ae395bd8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:30.666013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-91bc83c0-ea65-43a0-bcfd-fad47a8e056d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b2c539fb4064555a2ba7e63ae395bd8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:30.716941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f582d-cc29-476a-acd3-e937dc1e8b8e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:30.737211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3d250-c072-4a5e-90fa-7e063339060c tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:30.738547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3d250-c072-4a5e-90fa-7e063339060c tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:30.739232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3d250-c072-4a5e-90fa-7e063339060c tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:30.739529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3d250-c072-4a5e-90fa-7e063339060c tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/regions/tempest-region-1035759193` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:30.740437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3d250-c072-4a5e-90fa-7e063339060c tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1035759193)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:30.743486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3d250-c072-4a5e-90fa-7e063339060c tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:30.750537 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2862/5771] 10.222.0.43 () {58 vars in 1205 bytes} [Tue Jul 19 14:39:30 2022] GET /identity/v3/regions/tempest-region-1035759193 => generated 180 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:30.756746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3d250-c072-4a5e-90fa-7e063339060c tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:30.771122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3d250-c072-4a5e-90fa-7e063339060c tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:30.789424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41247cbf-c56a-42df-b33f-e9f7fc773cc6 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:30.790197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41247cbf-c56a-42df-b33f-e9f7fc773cc6 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:30.790495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41247cbf-c56a-42df-b33f-e9f7fc773cc6 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:30.790781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41247cbf-c56a-42df-b33f-e9f7fc773cc6 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:30.791553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41247cbf-c56a-42df-b33f-e9f7fc773cc6 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:30.798138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41247cbf-c56a-42df-b33f-e9f7fc773cc6 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:30.803652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-91bc83c0-ea65-43a0-bcfd-fad47a8e056d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b2c539fb4064555a2ba7e63ae395bd8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:30.819051 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2910/5772] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:39:29 2022] DELETE /identity/v3/users/3b2c539fb4064555a2ba7e63ae395bd8 => generated 0 bytes in 847 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:30.935725 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-41247cbf-c56a-42df-b33f-e9f7fc773cc6 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1439449480. To ensure interoperability, identifiers should be a valid uuid. Jul 19 14:39:30.935725 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 14:39:30.935725 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:39:31.030626 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2863/5773] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Jul 19 14:39:30 2022] POST /identity/v3/endpoints => generated 361 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:31.036191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc83c0-ea65-43a0-bcfd-fad47a8e056d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:31.037984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-91bc83c0-ea65-43a0-bcfd-fad47a8e056d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:31.219170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc83c0-ea65-43a0-bcfd-fad47a8e056d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:31.252893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090a512-e0fe-4c3e-bb55-bbcac9523f89 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:31.254624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090a512-e0fe-4c3e-bb55-bbcac9523f89 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:31.255059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090a512-e0fe-4c3e-bb55-bbcac9523f89 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:31.255358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090a512-e0fe-4c3e-bb55-bbcac9523f89 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/regions/tempest-region-1439449480` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:31.256071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090a512-e0fe-4c3e-bb55-bbcac9523f89 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1439449480)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:31.260500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090a512-e0fe-4c3e-bb55-bbcac9523f89 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:31.262556 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2911/5774] 10.222.0.43 () {58 vars in 1205 bytes} [Tue Jul 19 14:39:31 2022] GET /identity/v3/regions/tempest-region-1439449480 => generated 180 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:31.267522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41247cbf-c56a-42df-b33f-e9f7fc773cc6 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:31.281635 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41247cbf-c56a-42df-b33f-e9f7fc773cc6 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:31.291702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98af3d3-8d9a-4fae-ac14-cc56d127493d tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:31.292487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98af3d3-8d9a-4fae-ac14-cc56d127493d tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:31.292852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98af3d3-8d9a-4fae-ac14-cc56d127493d tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:31.293206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98af3d3-8d9a-4fae-ac14-cc56d127493d tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:31.294209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98af3d3-8d9a-4fae-ac14-cc56d127493d tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:31.295436 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-d98af3d3-8d9a-4fae-ac14-cc56d127493d tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:39:31.295436 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:39:31.295436 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:39:31.296407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98af3d3-8d9a-4fae-ac14-cc56d127493d tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:31.310472 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2864/5775] 10.222.0.43 () {58 vars in 1133 bytes} [Tue Jul 19 14:39:31 2022] GET /identity/v3/endpoints => generated 4388 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:31.320763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090a512-e0fe-4c3e-bb55-bbcac9523f89 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:31.321247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98af3d3-8d9a-4fae-ac14-cc56d127493d tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:31.323181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d98af3d3-8d9a-4fae-ac14-cc56d127493d tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:31.336687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090a512-e0fe-4c3e-bb55-bbcac9523f89 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:31.353445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6b63d-cc0f-41ff-82f5-2bbe67432783 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:31.357910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6b63d-cc0f-41ff-82f5-2bbe67432783 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:31.357910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6b63d-cc0f-41ff-82f5-2bbe67432783 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:31.357910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6b63d-cc0f-41ff-82f5-2bbe67432783 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/endpoints/65fd8c453b404afeb9ef9d705204cb51` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:31.398440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6b63d-cc0f-41ff-82f5-2bbe67432783 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=65fd8c453b404afeb9ef9d705204cb51)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:31.399669 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-48e6b63d-cc0f-41ff-82f5-2bbe67432783 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:39:31.399669 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:39:31.399669 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:39:31.400704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6b63d-cc0f-41ff-82f5-2bbe67432783 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:31.407579 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2912/5776] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:39:31 2022] GET /identity/v3/endpoints/65fd8c453b404afeb9ef9d705204cb51 => generated 361 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:31.415138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6b63d-cc0f-41ff-82f5-2bbe67432783 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:31.425640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6b63d-cc0f-41ff-82f5-2bbe67432783 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:31.437535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47837a2-20b7-44bc-bcd8-e05dc7d72119 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:31.437535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47837a2-20b7-44bc-bcd8-e05dc7d72119 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:31.437535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47837a2-20b7-44bc-bcd8-e05dc7d72119 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:31.437881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47837a2-20b7-44bc-bcd8-e05dc7d72119 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/endpoints/65fd8c453b404afeb9ef9d705204cb51` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:31.437881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47837a2-20b7-44bc-bcd8-e05dc7d72119 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=65fd8c453b404afeb9ef9d705204cb51)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:31.439229 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-b47837a2-20b7-44bc-bcd8-e05dc7d72119 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:39:31.439229 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:39:31.439229 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:39:31.440413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47837a2-20b7-44bc-bcd8-e05dc7d72119 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:31.465431 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:31.540294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98af3d3-8d9a-4fae-ac14-cc56d127493d tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:31.547974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc59a41-e040-4bd1-b7e2-6edff0600589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:31.552431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b47837a2-20b7-44bc-bcd8-e05dc7d72119 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '65fd8c453b404afeb9ef9d705204cb51', 'request_id': 'req-b47837a2-20b7-44bc-bcd8-e05dc7d72119'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:31.562066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc59a41-e040-4bd1-b7e2-6edff0600589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:31.562428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc59a41-e040-4bd1-b7e2-6edff0600589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:31.562722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc59a41-e040-4bd1-b7e2-6edff0600589 admin admin] PATH_INFO: `/v3/projects/2d5d7da1fd0e45f29e5c4d0546959a6d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:31.572232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc59a41-e040-4bd1-b7e2-6edff0600589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d5d7da1fd0e45f29e5c4d0546959a6d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:31.577779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc59a41-e040-4bd1-b7e2-6edff0600589 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:31.587013 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2913/5777] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jul 19 14:39:31 2022] DELETE /identity/v3/endpoints/65fd8c453b404afeb9ef9d705204cb51 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:39:31.590806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47837a2-20b7-44bc-bcd8-e05dc7d72119 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:31.660027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47837a2-20b7-44bc-bcd8-e05dc7d72119 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:31.679371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9370d95-5454-45e0-b00c-3db6af11a947 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:31.680172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9370d95-5454-45e0-b00c-3db6af11a947 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:31.680389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9370d95-5454-45e0-b00c-3db6af11a947 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:31.680677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9370d95-5454-45e0-b00c-3db6af11a947 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:31.681879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9370d95-5454-45e0-b00c-3db6af11a947 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:31.686021 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-b9370d95-5454-45e0-b00c-3db6af11a947 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:39:31.686021 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:39:31.686021 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:39:31.686021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9370d95-5454-45e0-b00c-3db6af11a947 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:31.716626 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2914/5778] 10.222.0.43 () {58 vars in 1133 bytes} [Tue Jul 19 14:39:31 2022] GET /identity/v3/endpoints => generated 4040 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:31.717868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9370d95-5454-45e0-b00c-3db6af11a947 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:31.739105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9370d95-5454-45e0-b00c-3db6af11a947 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:31.760038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181f40b-f913-46be-8135-e0f7dda4cde2 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:31.762043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181f40b-f913-46be-8135-e0f7dda4cde2 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:31.762363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181f40b-f913-46be-8135-e0f7dda4cde2 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:31.762650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181f40b-f913-46be-8135-e0f7dda4cde2 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/endpoints/65fd8c453b404afeb9ef9d705204cb51` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:31.779104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181f40b-f913-46be-8135-e0f7dda4cde2 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 14:39:31.795932 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-2181f40b-f913-46be-8135-e0f7dda4cde2 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Could not find endpoint: 65fd8c453b404afeb9ef9d705204cb51.: keystone.exception.EndpointNotFound: Could not find endpoint: 65fd8c453b404afeb9ef9d705204cb51. Jul 19 14:39:31.795932 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:31.795932 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Jul 19 14:39:31.795932 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Jul 19 14:39:31.795932 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 19 14:39:31.795932 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._iter().one() Jul 19 14:39:31.795932 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 19 14:39:31.795932 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._only_one_row( Jul 19 14:39:31.795932 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 19 14:39:31.795932 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 19 14:39:31.795932 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 19 14:39:31.795932 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:31.795932 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:39:31.795932 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:31.795932 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:31.795932 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Jul 19 14:39:31.799791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Jul 19 14:39:31.799791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Jul 19 14:39:31.799791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Jul 19 14:39:31.799791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Jul 19 14:39:31.799791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jul 19 14:39:31.799791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 65fd8c453b404afeb9ef9d705204cb51. Jul 19 14:39:31.799791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:31.799791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:39:31.799791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:31.799791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:31.799791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:39:31.799791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:39:31.799791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:39:31.799791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:39:31.799791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:39:31.799791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:39:31.799791 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:39:31.801627 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:39:31.801627 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:39:31.801627 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:39:31.801627 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Jul 19 14:39:31.801627 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Jul 19 14:39:31.801627 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 14:39:31.801627 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 14:39:31.801627 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 14:39:31.801627 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 14:39:31.801627 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:39:31.801627 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:39:31.801627 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:39:31.801627 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:39:31.801627 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:39:31.801627 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:39:31.801627 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:39:31.802461 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 14:39:31.802461 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:39:31.802461 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:39:31.802461 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:39:31.802461 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:39:31.802461 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:39:31.802461 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:39:31.802461 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:39:31.802461 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:39:31.802461 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Jul 19 14:39:31.802461 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jul 19 14:39:31.802461 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 65fd8c453b404afeb9ef9d705204cb51. Jul 19 14:39:31.802461 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:31.802461 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2915/5779] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jul 19 14:39:31 2022] DELETE /identity/v3/endpoints/65fd8c453b404afeb9ef9d705204cb51 => generated 114 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:39:31.808292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181f40b-f913-46be-8135-e0f7dda4cde2 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:31.850815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181f40b-f913-46be-8135-e0f7dda4cde2 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:31.851050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0bc59a41-e040-4bd1-b7e2-6edff0600589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d5d7da1fd0e45f29e5c4d0546959a6d', 'request_id': 'req-0bc59a41-e040-4bd1-b7e2-6edff0600589'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:31.937748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0bc59a41-e040-4bd1-b7e2-6edff0600589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d5d7da1fd0e45f29e5c4d0546959a6d', 'request_id': 'req-0bc59a41-e040-4bd1-b7e2-6edff0600589'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:31.948258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0bc59a41-e040-4bd1-b7e2-6edff0600589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d5d7da1fd0e45f29e5c4d0546959a6d', 'request_id': 'req-0bc59a41-e040-4bd1-b7e2-6edff0600589'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:31.964753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0bc59a41-e040-4bd1-b7e2-6edff0600589 admin admin] The token cache is being invalidate because project 2d5d7da1fd0e45f29e5c4d0546959a6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:31.965410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0bc59a41-e040-4bd1-b7e2-6edff0600589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:31.966353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0bc59a41-e040-4bd1-b7e2-6edff0600589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:31.973727 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2865/5780] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:39:31 2022] DELETE /identity/v3/projects/2d5d7da1fd0e45f29e5c4d0546959a6d => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:39:31.975779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dfc4b-8998-4172-a229-b09f240d2db8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:31.976643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dfc4b-8998-4172-a229-b09f240d2db8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:31.977331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dfc4b-8998-4172-a229-b09f240d2db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:32.011098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0c2dfc4b-8998-4172-a229-b09f240d2db8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:32.012639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0c2dfc4b-8998-4172-a229-b09f240d2db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:32.080616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f7524-a2a5-4ce5-b7f2-6ba5593b6590 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:32.091793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f7524-a2a5-4ce5-b7f2-6ba5593b6590 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:32.091954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f7524-a2a5-4ce5-b7f2-6ba5593b6590 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:32.092209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f7524-a2a5-4ce5-b7f2-6ba5593b6590 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/regions/tempest-region-1439449480` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:32.093554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f7524-a2a5-4ce5-b7f2-6ba5593b6590 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1439449480)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:32.094650 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-741f7524-a2a5-4ce5-b7f2-6ba5593b6590 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:39:32.094650 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:39:32.094650 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:39:32.095554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f7524-a2a5-4ce5-b7f2-6ba5593b6590 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:32.122324 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:32.235007 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-741f7524-a2a5-4ce5-b7f2-6ba5593b6590 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1439449480. To ensure interoperability, identifiers should be a valid uuid. Jul 19 14:39:32.235007 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 14:39:32.235007 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:39:32.244291 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2916/5781] 10.222.0.43 () {58 vars in 1208 bytes} [Tue Jul 19 14:39:31 2022] DELETE /identity/v3/regions/tempest-region-1439449480 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:32.248409 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2866/5782] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:31 2022] POST /identity/v3/auth/tokens => generated 3861 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:32.251276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f7524-a2a5-4ce5-b7f2-6ba5593b6590 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:32.258624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699ecd6-7ee1-4f27-8af9-8548e3ca2cd1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:32.258926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699ecd6-7ee1-4f27-8af9-8548e3ca2cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:32.259219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1699ecd6-7ee1-4f27-8af9-8548e3ca2cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:32.260387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-741f7524-a2a5-4ce5-b7f2-6ba5593b6590 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:32.308086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1699ecd6-7ee1-4f27-8af9-8548e3ca2cd1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:32.309297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1699ecd6-7ee1-4f27-8af9-8548e3ca2cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:32.318926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f7524-a2a5-4ce5-b7f2-6ba5593b6590 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:32.330734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28e2bc-1577-4ff4-84f5-0e2b7ab96013 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:32.331982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28e2bc-1577-4ff4-84f5-0e2b7ab96013 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:32.332225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28e2bc-1577-4ff4-84f5-0e2b7ab96013 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:32.332498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28e2bc-1577-4ff4-84f5-0e2b7ab96013 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:32.333238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28e2bc-1577-4ff4-84f5-0e2b7ab96013 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:32.338136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e28e2bc-1577-4ff4-84f5-0e2b7ab96013 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:32.361731 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2917/5783] 10.222.0.43 () {58 vars in 1133 bytes} [Tue Jul 19 14:39:32 2022] GET /identity/v3/endpoints => generated 4040 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:32.363343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28e2bc-1577-4ff4-84f5-0e2b7ab96013 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:32.363576 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2867/5784] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:32 2022] POST /identity/v3/auth/tokens => generated 3861 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:32.369608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699ecd6-7ee1-4f27-8af9-8548e3ca2cd1 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:32.386192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28e2bc-1577-4ff4-84f5-0e2b7ab96013 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:32.387484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1699ecd6-7ee1-4f27-8af9-8548e3ca2cd1 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:32.397720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee0d61-fe6c-4bf2-9656-270eb2503276 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:32.398556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee0d61-fe6c-4bf2-9656-270eb2503276 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:32.398923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee0d61-fe6c-4bf2-9656-270eb2503276 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:32.399204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee0d61-fe6c-4bf2-9656-270eb2503276 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:32.399536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a58d5-ff89-4029-a2f3-e832a565913b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:32.399949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee0d61-fe6c-4bf2-9656-270eb2503276 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Adding query filter params (service_id=027e20133ea44ad992d387c4bbd6eb2e) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:39:32.400264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee0d61-fe6c-4bf2-9656-270eb2503276 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:32.400812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a58d5-ff89-4029-a2f3-e832a565913b admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:32.401281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a58d5-ff89-4029-a2f3-e832a565913b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:32.401741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765a58d5-ff89-4029-a2f3-e832a565913b admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:32.402675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee0d61-fe6c-4bf2-9656-270eb2503276 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:32.403298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a58d5-ff89-4029-a2f3-e832a565913b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:39:32.403808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a58d5-ff89-4029-a2f3-e832a565913b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:32.405952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765a58d5-ff89-4029-a2f3-e832a565913b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:32.419314 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2918/5785] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Jul 19 14:39:32 2022] GET /identity/v3/endpoints?service_id=027e20133ea44ad992d387c4bbd6eb2e => generated 503 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:32.426835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee0d61-fe6c-4bf2-9656-270eb2503276 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:32.432978 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2868/5786] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:39:32.437758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a58d5-ff89-4029-a2f3-e832a565913b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:32.439197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee0d61-fe6c-4bf2-9656-270eb2503276 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:32.446727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8b664-316a-4bbf-8c5e-f0ca6192b72e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:32.450809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8b664-316a-4bbf-8c5e-f0ca6192b72e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:32.450809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8b664-316a-4bbf-8c5e-f0ca6192b72e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:32.450809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8b664-316a-4bbf-8c5e-f0ca6192b72e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:32.450809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8b664-316a-4bbf-8c5e-f0ca6192b72e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Adding query filter params (service_id=3e0b6182c514416f8194f50299ed06e0) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:39:32.450809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8b664-316a-4bbf-8c5e-f0ca6192b72e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:32.451210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765a58d5-ff89-4029-a2f3-e832a565913b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:32.452082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8b664-316a-4bbf-8c5e-f0ca6192b72e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:32.457263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5648b-b563-4d87-b397-88328bd00475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:32.458197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5648b-b563-4d87-b397-88328bd00475 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:32.458850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5648b-b563-4d87-b397-88328bd00475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:32.459710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5648b-b563-4d87-b397-88328bd00475 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:32.460541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5648b-b563-4d87-b397-88328bd00475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:32.461249 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2919/5787] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Jul 19 14:39:32 2022] GET /identity/v3/endpoints?service_id=3e0b6182c514416f8194f50299ed06e0 => generated 504 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:32.464166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5648b-b563-4d87-b397-88328bd00475 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:32.465251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8b664-316a-4bbf-8c5e-f0ca6192b72e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:32.482165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8b664-316a-4bbf-8c5e-f0ca6192b72e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:32.488379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5156b4-37e9-4db3-b20f-de5a6c426724 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:32.489279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5156b4-37e9-4db3-b20f-de5a6c426724 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:32.489381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5156b4-37e9-4db3-b20f-de5a6c426724 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:32.489879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5156b4-37e9-4db3-b20f-de5a6c426724 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:32.490610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5156b4-37e9-4db3-b20f-de5a6c426724 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:39:32.490934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5156b4-37e9-4db3-b20f-de5a6c426724 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:32.492620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5156b4-37e9-4db3-b20f-de5a6c426724 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:32.504836 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2920/5788] 10.222.0.43 () {58 vars in 1166 bytes} [Tue Jul 19 14:39:32 2022] GET /identity/v3/endpoints?interface=public => generated 3396 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:32.521057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5156b4-37e9-4db3-b20f-de5a6c426724 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:32.533048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5156b4-37e9-4db3-b20f-de5a6c426724 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:32.539203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70f9a6-44a3-448d-8962-337c241c8960 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:32.539990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70f9a6-44a3-448d-8962-337c241c8960 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:32.540730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70f9a6-44a3-448d-8962-337c241c8960 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:32.541115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70f9a6-44a3-448d-8962-337c241c8960 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:32.542054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70f9a6-44a3-448d-8962-337c241c8960 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:39:32.542458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70f9a6-44a3-448d-8962-337c241c8960 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:32.544940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70f9a6-44a3-448d-8962-337c241c8960 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:32.552819 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2921/5789] 10.222.0.43 () {58 vars in 1170 bytes} [Tue Jul 19 14:39:32 2022] GET /identity/v3/endpoints?interface=internal => generated 479 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:32.567934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70f9a6-44a3-448d-8962-337c241c8960 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:32.580934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70f9a6-44a3-448d-8962-337c241c8960 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:32.582998 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2869/5790] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:39:32 2022] POST /identity/v3/projects => generated 395 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:32.586248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5648b-b563-4d87-b397-88328bd00475 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:32.594037 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:32.678435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1190175-924e-4fec-95b6-7cc88b602952 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:32.679789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1190175-924e-4fec-95b6-7cc88b602952 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:32.680093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1190175-924e-4fec-95b6-7cc88b602952 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:32.680434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1190175-924e-4fec-95b6-7cc88b602952 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:32.681555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1190175-924e-4fec-95b6-7cc88b602952 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:32.683581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1190175-924e-4fec-95b6-7cc88b602952 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:32.684242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5648b-b563-4d87-b397-88328bd00475 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:32.699021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95376f77-0e49-4a32-9112-51873e87bebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:32.699859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95376f77-0e49-4a32-9112-51873e87bebc admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:32.700216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95376f77-0e49-4a32-9112-51873e87bebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:32.700565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95376f77-0e49-4a32-9112-51873e87bebc admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:32.701354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95376f77-0e49-4a32-9112-51873e87bebc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:32.703608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95376f77-0e49-4a32-9112-51873e87bebc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:32.828659 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2922/5791] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:39:32 2022] POST /identity/v3/services => generated 289 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:32.834897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1190175-924e-4fec-95b6-7cc88b602952 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:32.864525 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2870/5792] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:39:32 2022] POST /identity/v3/users => generated 298 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:39:32.866085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95376f77-0e49-4a32-9112-51873e87bebc admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:32.866553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1190175-924e-4fec-95b6-7cc88b602952 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:32.872546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ac2ae-f0f7-4752-9601-017ab20820f9 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:32.874368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ac2ae-f0f7-4752-9601-017ab20820f9 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:32.874965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ac2ae-f0f7-4752-9601-017ab20820f9 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:32.875686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ac2ae-f0f7-4752-9601-017ab20820f9 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:32.876765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ac2ae-f0f7-4752-9601-017ab20820f9 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:32.878316 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-844ac2ae-f0f7-4752-9601-017ab20820f9 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:39:32.878316 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:39:32.878316 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:39:32.879947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ac2ae-f0f7-4752-9601-017ab20820f9 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:32.881353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95376f77-0e49-4a32-9112-51873e87bebc admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:32.900327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62271d7e-a6f0-40e2-842d-cbe9576396c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:32.901305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62271d7e-a6f0-40e2-842d-cbe9576396c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:32.905358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62271d7e-a6f0-40e2-842d-cbe9576396c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:32.905358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62271d7e-a6f0-40e2-842d-cbe9576396c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:32.905358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62271d7e-a6f0-40e2-842d-cbe9576396c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:32.905358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62271d7e-a6f0-40e2-842d-cbe9576396c5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:32.916884 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2871/5793] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:32.920706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62271d7e-a6f0-40e2-842d-cbe9576396c5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:32.932552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62271d7e-a6f0-40e2-842d-cbe9576396c5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:32.938326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfb523-f11d-41ad-9f39-ac3574e86766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:32.939052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfb523-f11d-41ad-9f39-ac3574e86766 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:32.939313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfb523-f11d-41ad-9f39-ac3574e86766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:32.939669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfb523-f11d-41ad-9f39-ac3574e86766 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:32.940433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bfb523-f11d-41ad-9f39-ac3574e86766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:32.943336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bfb523-f11d-41ad-9f39-ac3574e86766 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:32.958678 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2872/5794] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:39:32.959731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfb523-f11d-41ad-9f39-ac3574e86766 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:32.974671 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-844ac2ae-f0f7-4752-9601-017ab20820f9 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1436952652. To ensure interoperability, identifiers should be a valid uuid. Jul 19 14:39:32.974671 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 14:39:32.974671 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:39:32.975532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfb523-f11d-41ad-9f39-ac3574e86766 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:32.983547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fcc39a-89f3-4a57-bea3-214abb8732b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:32.984505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcc39a-89f3-4a57-bea3-214abb8732b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:32.984797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcc39a-89f3-4a57-bea3-214abb8732b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:32.985071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fcc39a-89f3-4a57-bea3-214abb8732b0 admin admin] PATH_INFO: `/v3/projects/8165247863074adba70c7e953a39e7bd/users/0f8c9779df5b43a69cebe4af33243c00/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:33.010885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fcc39a-89f3-4a57-bea3-214abb8732b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8165247863074adba70c7e953a39e7bd, user_id=0f8c9779df5b43a69cebe4af33243c00, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:33.013852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fcc39a-89f3-4a57-bea3-214abb8732b0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:33.096645 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2923/5795] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Jul 19 14:39:32 2022] POST /identity/v3/endpoints => generated 361 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:33.100526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ac2ae-f0f7-4752-9601-017ab20820f9 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:33.124004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ac2ae-f0f7-4752-9601-017ab20820f9 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:33.129779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414052d4-9dd9-48d0-b50b-031db822a5a1 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:33.130731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414052d4-9dd9-48d0-b50b-031db822a5a1 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:33.131028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414052d4-9dd9-48d0-b50b-031db822a5a1 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:33.131314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414052d4-9dd9-48d0-b50b-031db822a5a1 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/regions/tempest-region-1436952652` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:33.131980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414052d4-9dd9-48d0-b50b-031db822a5a1 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1436952652)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:33.133068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414052d4-9dd9-48d0-b50b-031db822a5a1 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:33.135006 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2924/5796] 10.222.0.43 () {58 vars in 1205 bytes} [Tue Jul 19 14:39:33 2022] GET /identity/v3/regions/tempest-region-1436952652 => generated 180 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:39:33.138949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414052d4-9dd9-48d0-b50b-031db822a5a1 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:33.149001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414052d4-9dd9-48d0-b50b-031db822a5a1 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:33.156729 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2873/5797] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:39:32 2022] PUT /identity/v3/projects/8165247863074adba70c7e953a39e7bd/users/0f8c9779df5b43a69cebe4af33243c00/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:39:33.179195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68ffbc-16d8-4a48-a7d3-74e64cc191e5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:33.179195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68ffbc-16d8-4a48-a7d3-74e64cc191e5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:33.183608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68ffbc-16d8-4a48-a7d3-74e64cc191e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:33.183724 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:33.218992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d2ad8-e3cd-4be6-9224-b10ca2353725 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:33.219850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d2ad8-e3cd-4be6-9224-b10ca2353725 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:33.226081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d2ad8-e3cd-4be6-9224-b10ca2353725 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:33.226081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d2ad8-e3cd-4be6-9224-b10ca2353725 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/endpoints/6a3fce3915b04b8fa0dfa357ff307477` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:33.228514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5b68ffbc-16d8-4a48-a7d3-74e64cc191e5 None None] MFA Rules not processed for user `0f8c9779df5b43a69cebe4af33243c00`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:33.229726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5b68ffbc-16d8-4a48-a7d3-74e64cc191e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:33.231712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d2ad8-e3cd-4be6-9224-b10ca2353725 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=6a3fce3915b04b8fa0dfa357ff307477)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:33.232753 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-0d1d2ad8-e3cd-4be6-9224-b10ca2353725 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:39:33.232753 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:39:33.232753 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:39:33.233938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d2ad8-e3cd-4be6-9224-b10ca2353725 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:33.338955 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-0d1d2ad8-e3cd-4be6-9224-b10ca2353725 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-125102548. To ensure interoperability, identifiers should be a valid uuid. Jul 19 14:39:33.338955 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 14:39:33.338955 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:39:33.358331 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2874/5798] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:33 2022] POST /identity/v3/auth/tokens => generated 4213 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:33.371849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad678713-5cbf-4bcb-88c2-0a5bfd506703 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:33.372212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad678713-5cbf-4bcb-88c2-0a5bfd506703 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:33.372559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad678713-5cbf-4bcb-88c2-0a5bfd506703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:33.404308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ad678713-5cbf-4bcb-88c2-0a5bfd506703 None None] MFA Rules not processed for user `0f8c9779df5b43a69cebe4af33243c00`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:33.405914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ad678713-5cbf-4bcb-88c2-0a5bfd506703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:33.431066 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2925/5799] 10.222.0.43 () {60 vars in 1255 bytes} [Tue Jul 19 14:39:33 2022] PATCH /identity/v3/endpoints/6a3fce3915b04b8fa0dfa357ff307477 => generated 362 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:39:33.431802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d2ad8-e3cd-4be6-9224-b10ca2353725 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:33.458705 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2875/5800] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:33 2022] POST /identity/v3/auth/tokens => generated 4028 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:33.472303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad678713-5cbf-4bcb-88c2-0a5bfd506703 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:33.475342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ad678713-5cbf-4bcb-88c2-0a5bfd506703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:33.507019 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:33.530699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d2ad8-e3cd-4be6-9224-b10ca2353725 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:33.563778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cd6da-eff3-4a5b-9bac-806a0f1d822e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:33.564711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cd6da-eff3-4a5b-9bac-806a0f1d822e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:33.565097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cd6da-eff3-4a5b-9bac-806a0f1d822e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:33.566242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3cd6da-eff3-4a5b-9bac-806a0f1d822e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/regions/tempest-region-125102548` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:33.566941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cd6da-eff3-4a5b-9bac-806a0f1d822e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-125102548)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:33.568053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3cd6da-eff3-4a5b-9bac-806a0f1d822e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:33.581841 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2926/5801] 10.222.0.43 () {58 vars in 1202 bytes} [Tue Jul 19 14:39:33 2022] GET /identity/v3/regions/tempest-region-125102548 => generated 178 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:33.583369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cd6da-eff3-4a5b-9bac-806a0f1d822e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:33.604745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3cd6da-eff3-4a5b-9bac-806a0f1d822e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:33.612111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a54304-dae7-43b2-bf7a-bde26b647f4e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:33.613869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a54304-dae7-43b2-bf7a-bde26b647f4e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:33.614376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a54304-dae7-43b2-bf7a-bde26b647f4e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:33.615249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a54304-dae7-43b2-bf7a-bde26b647f4e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/endpoints/6a3fce3915b04b8fa0dfa357ff307477` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:33.624790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a54304-dae7-43b2-bf7a-bde26b647f4e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=6a3fce3915b04b8fa0dfa357ff307477)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:33.627034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a54304-dae7-43b2-bf7a-bde26b647f4e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:33.664673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad678713-5cbf-4bcb-88c2-0a5bfd506703 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:33.686361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037dcc30-2295-4da8-8230-734cd83d3bdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:33.687759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dcc30-2295-4da8-8230-734cd83d3bdc service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:33.687759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dcc30-2295-4da8-8230-734cd83d3bdc service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:33.687759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037dcc30-2295-4da8-8230-734cd83d3bdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:33.696422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037dcc30-2295-4da8-8230-734cd83d3bdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:33.698024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037dcc30-2295-4da8-8230-734cd83d3bdc service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:33.705765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-08a54304-dae7-43b2-bf7a-bde26b647f4e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '6a3fce3915b04b8fa0dfa357ff307477', 'request_id': 'req-08a54304-dae7-43b2-bf7a-bde26b647f4e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:33.722331 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2876/5802] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:39:33 2022] GET /identity/v3/auth/tokens => generated 4028 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:39:33.743807 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2927/5803] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jul 19 14:39:33 2022] DELETE /identity/v3/endpoints/6a3fce3915b04b8fa0dfa357ff307477 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:33.744264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037dcc30-2295-4da8-8230-734cd83d3bdc service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:33.745758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21facd19-1254-4482-a6ba-55ac900af3cb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:33.746078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21facd19-1254-4482-a6ba-55ac900af3cb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:33.747035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21facd19-1254-4482-a6ba-55ac900af3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:33.764607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037dcc30-2295-4da8-8230-734cd83d3bdc service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:33.778343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-21facd19-1254-4482-a6ba-55ac900af3cb None None] MFA Rules not processed for user `0f8c9779df5b43a69cebe4af33243c00`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:33.779924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-21facd19-1254-4482-a6ba-55ac900af3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:33.802065 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2928/5804] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:33 2022] POST /identity/v3/auth/tokens => generated 4028 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:33.824282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149b1fc-b259-4d4c-babc-0588fcfa80c8 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:33.825204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149b1fc-b259-4d4c-babc-0588fcfa80c8 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:33.825497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149b1fc-b259-4d4c-babc-0588fcfa80c8 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:33.825779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149b1fc-b259-4d4c-babc-0588fcfa80c8 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/regions/tempest-region-125102548` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:33.826478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149b1fc-b259-4d4c-babc-0588fcfa80c8 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-125102548)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:33.828811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ef892-dcc2-4fba-9974-06cd119b8d86 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:33.829102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ef892-dcc2-4fba-9974-06cd119b8d86 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:33.829379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14ef892-dcc2-4fba-9974-06cd119b8d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:33.836320 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-a149b1fc-b259-4d4c-babc-0588fcfa80c8 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:39:33.836320 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:39:33.836320 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:39:33.838214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149b1fc-b259-4d4c-babc-0588fcfa80c8 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:33.865138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b14ef892-dcc2-4fba-9974-06cd119b8d86 None None] MFA Rules not processed for user `0f8c9779df5b43a69cebe4af33243c00`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:33.866268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b14ef892-dcc2-4fba-9974-06cd119b8d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:33.894996 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2929/5805] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:33 2022] POST /identity/v3/auth/tokens => generated 4028 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:39:33.921135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0375e16-df2f-45da-9ad4-9b900ffff45f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:33.921424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0375e16-df2f-45da-9ad4-9b900ffff45f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:33.921702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0375e16-df2f-45da-9ad4-9b900ffff45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:33.936862 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-a149b1fc-b259-4d4c-babc-0588fcfa80c8 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-125102548. To ensure interoperability, identifiers should be a valid uuid. Jul 19 14:39:33.936862 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 14:39:33.936862 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:39:33.952034 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2877/5806] 10.222.0.43 () {58 vars in 1205 bytes} [Tue Jul 19 14:39:33 2022] DELETE /identity/v3/regions/tempest-region-125102548 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:33.953147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149b1fc-b259-4d4c-babc-0588fcfa80c8 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:33.957684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d0375e16-df2f-45da-9ad4-9b900ffff45f None None] MFA Rules not processed for user `0f8c9779df5b43a69cebe4af33243c00`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:33.959530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d0375e16-df2f-45da-9ad4-9b900ffff45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:33.978965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149b1fc-b259-4d4c-babc-0588fcfa80c8 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:33.984086 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2930/5807] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:33 2022] POST /identity/v3/auth/tokens => generated 4028 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:33.993073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732dd53-e4ed-4e2a-b6f9-e44b589214e7 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:33.999119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732dd53-e4ed-4e2a-b6f9-e44b589214e7 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:33.999119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732dd53-e4ed-4e2a-b6f9-e44b589214e7 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:33.999119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732dd53-e4ed-4e2a-b6f9-e44b589214e7 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/regions/tempest-region-1436952652` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:33.999119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732dd53-e4ed-4e2a-b6f9-e44b589214e7 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1436952652)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:33.999119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732dd53-e4ed-4e2a-b6f9-e44b589214e7 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:34.018951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba739465-cdb3-41f8-a8f2-5f995967cf36 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:34.022912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba739465-cdb3-41f8-a8f2-5f995967cf36 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:34.022912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba739465-cdb3-41f8-a8f2-5f995967cf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:34.055201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ba739465-cdb3-41f8-a8f2-5f995967cf36 None None] MFA Rules not processed for user `0f8c9779df5b43a69cebe4af33243c00`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:34.058591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ba739465-cdb3-41f8-a8f2-5f995967cf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:34.082300 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2931/5808] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:34 2022] POST /identity/v3/auth/tokens => generated 4028 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:39:34.086319 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-1732dd53-e4ed-4e2a-b6f9-e44b589214e7 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1436952652. To ensure interoperability, identifiers should be a valid uuid. Jul 19 14:39:34.086319 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 14:39:34.086319 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:39:34.103192 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2878/5809] 10.222.0.43 () {58 vars in 1208 bytes} [Tue Jul 19 14:39:33 2022] DELETE /identity/v3/regions/tempest-region-1436952652 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:39:34.106490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba739465-cdb3-41f8-a8f2-5f995967cf36 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:34.106879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732dd53-e4ed-4e2a-b6f9-e44b589214e7 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:34.124132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba739465-cdb3-41f8-a8f2-5f995967cf36 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:34.149683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d59ae-fed0-4a2e-a67d-c21c57813f4e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:34.150614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d59ae-fed0-4a2e-a67d-c21c57813f4e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:34.150897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d59ae-fed0-4a2e-a67d-c21c57813f4e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:34.156281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d59ae-fed0-4a2e-a67d-c21c57813f4e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/services/d500ea18f5b345a7b34d7b018f0ba070` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:34.156281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d59ae-fed0-4a2e-a67d-c21c57813f4e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:delete_service(service_id=d500ea18f5b345a7b34d7b018f0ba070)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:34.156281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d59ae-fed0-4a2e-a67d-c21c57813f4e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:34.218508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732dd53-e4ed-4e2a-b6f9-e44b589214e7 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:34.254675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd468855-b2db-41db-b6a4-27626ebe1d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:34.255662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd468855-b2db-41db-b6a4-27626ebe1d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:34.255893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd468855-b2db-41db-b6a4-27626ebe1d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:34.256176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd468855-b2db-41db-b6a4-27626ebe1d22 admin admin] PATH_INFO: `/v3/users/0f8c9779df5b43a69cebe4af33243c00` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:34.261415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd468855-b2db-41db-b6a4-27626ebe1d22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f8c9779df5b43a69cebe4af33243c00)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:34.266772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd468855-b2db-41db-b6a4-27626ebe1d22 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:34.269738 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:34.280895 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2932/5810] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:39:34 2022] DELETE /identity/v3/services/d500ea18f5b345a7b34d7b018f0ba070 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:34.286442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d59ae-fed0-4a2e-a67d-c21c57813f4e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:34.351425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d59ae-fed0-4a2e-a67d-c21c57813f4e tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:34.363525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475671b-c534-443c-82b8-b8c067795c34 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:34.366290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475671b-c534-443c-82b8-b8c067795c34 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:34.366613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475671b-c534-443c-82b8-b8c067795c34 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:34.366941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475671b-c534-443c-82b8-b8c067795c34 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/endpoints/d062b109d30b4a4d9b08daa6b64adfb7` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:34.386056 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475671b-c534-443c-82b8-b8c067795c34 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=d062b109d30b4a4d9b08daa6b64adfb7)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:34.387918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475671b-c534-443c-82b8-b8c067795c34 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:34.494630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b475671b-c534-443c-82b8-b8c067795c34 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'd062b109d30b4a4d9b08daa6b64adfb7', 'request_id': 'req-b475671b-c534-443c-82b8-b8c067795c34'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:34.510332 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2933/5811] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jul 19 14:39:34 2022] DELETE /identity/v3/endpoints/d062b109d30b4a4d9b08daa6b64adfb7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:34.511347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475671b-c534-443c-82b8-b8c067795c34 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:34.565627 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:34.601842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bd468855-b2db-41db-b6a4-27626ebe1d22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f8c9779df5b43a69cebe4af33243c00'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:34.605685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475671b-c534-443c-82b8-b8c067795c34 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:34.626898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc06614-ca37-4976-8934-af1fdaf4f09d tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:34.639012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc06614-ca37-4976-8934-af1fdaf4f09d tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:34.639012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc06614-ca37-4976-8934-af1fdaf4f09d tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:34.639012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc06614-ca37-4976-8934-af1fdaf4f09d tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/regions/tempest-region-1035759193` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:34.639012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc06614-ca37-4976-8934-af1fdaf4f09d tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1035759193)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:34.639012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc06614-ca37-4976-8934-af1fdaf4f09d tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:34.666736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bd468855-b2db-41db-b6a4-27626ebe1d22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f8c9779df5b43a69cebe4af33243c00'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:34.668107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bd468855-b2db-41db-b6a4-27626ebe1d22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f8c9779df5b43a69cebe4af33243c00'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:34.669001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bd468855-b2db-41db-b6a4-27626ebe1d22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f8c9779df5b43a69cebe4af33243c00'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:34.678485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bd468855-b2db-41db-b6a4-27626ebe1d22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f8c9779df5b43a69cebe4af33243c00'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:34.738310 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-4dc06614-ca37-4976-8934-af1fdaf4f09d tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1035759193. To ensure interoperability, identifiers should be a valid uuid. Jul 19 14:39:34.738310 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 14:39:34.738310 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:39:34.748299 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2934/5812] 10.222.0.43 () {58 vars in 1208 bytes} [Tue Jul 19 14:39:34 2022] DELETE /identity/v3/regions/tempest-region-1035759193 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:34.752225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc06614-ca37-4976-8934-af1fdaf4f09d tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:34.755155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4dc06614-ca37-4976-8934-af1fdaf4f09d tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:34.778316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc06614-ca37-4976-8934-af1fdaf4f09d tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:34.783112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e1063-9ad3-4493-a8b2-7bda11c7fba1 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:34.783979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e1063-9ad3-4493-a8b2-7bda11c7fba1 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:34.784340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e1063-9ad3-4493-a8b2-7bda11c7fba1 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:34.784817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10e1063-9ad3-4493-a8b2-7bda11c7fba1 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/services/3e0b6182c514416f8194f50299ed06e0` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:34.785512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e1063-9ad3-4493-a8b2-7bda11c7fba1 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:delete_service(service_id=3e0b6182c514416f8194f50299ed06e0)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:34.787193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10e1063-9ad3-4493-a8b2-7bda11c7fba1 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:34.799115 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2879/5813] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:39:34 2022] DELETE /identity/v3/users/0f8c9779df5b43a69cebe4af33243c00 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:34.808157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01162df9-63e9-43e7-8997-8f30ffe4a90f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:34.808460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01162df9-63e9-43e7-8997-8f30ffe4a90f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:34.808744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01162df9-63e9-43e7-8997-8f30ffe4a90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:34.835059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-01162df9-63e9-43e7-8997-8f30ffe4a90f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:34.836281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-01162df9-63e9-43e7-8997-8f30ffe4a90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:34.910087 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2935/5814] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:39:34 2022] DELETE /identity/v3/services/3e0b6182c514416f8194f50299ed06e0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:39:34.910987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e1063-9ad3-4493-a8b2-7bda11c7fba1 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:34.916330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d10e1063-9ad3-4493-a8b2-7bda11c7fba1 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:35.054153 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2880/5815] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:34 2022] POST /identity/v3/auth/tokens => generated 3545 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:35.054153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01162df9-63e9-43e7-8997-8f30ffe4a90f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:35.139448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10e1063-9ad3-4493-a8b2-7bda11c7fba1 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:35.196565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01162df9-63e9-43e7-8997-8f30ffe4a90f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:35.210293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5acf8-83db-4f3f-a273-ad486be85295 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:35.210293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5acf8-83db-4f3f-a273-ad486be85295 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:35.210293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5acf8-83db-4f3f-a273-ad486be85295 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:35.210646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e5acf8-83db-4f3f-a273-ad486be85295 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/endpoints/2f08614c4554408fa8c12776609e3407` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:35.211712 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:35.219986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5acf8-83db-4f3f-a273-ad486be85295 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=2f08614c4554408fa8c12776609e3407)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:35.219986 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-97e5acf8-83db-4f3f-a273-ad486be85295 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:39:35.219986 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:39:35.219986 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:39:35.220323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7557eb-2909-4f82-896d-65390430b9b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:35.220323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7557eb-2909-4f82-896d-65390430b9b9 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:35.220323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7557eb-2909-4f82-896d-65390430b9b9 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:35.220323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7557eb-2909-4f82-896d-65390430b9b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:35.220656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e5acf8-83db-4f3f-a273-ad486be85295 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:35.225099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-da7557eb-2909-4f82-896d-65390430b9b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:35.236441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7557eb-2909-4f82-896d-65390430b9b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:35.238647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7557eb-2909-4f82-896d-65390430b9b9 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:35.249573 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2936/5816] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:39:34 2022] GET /identity/v3/auth/tokens => generated 3614 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:39:35.250549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7557eb-2909-4f82-896d-65390430b9b9 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:35.251947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-da7557eb-2909-4f82-896d-65390430b9b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:35.296525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-97e5acf8-83db-4f3f-a273-ad486be85295 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '2f08614c4554408fa8c12776609e3407', 'request_id': 'req-97e5acf8-83db-4f3f-a273-ad486be85295'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:35.336203 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2881/5817] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jul 19 14:39:35 2022] DELETE /identity/v3/endpoints/2f08614c4554408fa8c12776609e3407 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:35.340885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5acf8-83db-4f3f-a273-ad486be85295 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:35.342887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7557eb-2909-4f82-896d-65390430b9b9 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:35.364271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b0ae6-83a2-40fb-b99e-70d9366a1904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:35.364716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b0ae6-83a2-40fb-b99e-70d9366a1904 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:35.365011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b0ae6-83a2-40fb-b99e-70d9366a1904 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:35.369393 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5b0ae6-83a2-40fb-b99e-70d9366a1904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:35.380882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e5acf8-83db-4f3f-a273-ad486be85295 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:35.389030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d355879-9de2-46be-8ac1-68e188240f34 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:35.389258 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b0ae6-83a2-40fb-b99e-70d9366a1904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:35.390431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d355879-9de2-46be-8ac1-68e188240f34 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:35.390877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d355879-9de2-46be-8ac1-68e188240f34 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:35.391370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d355879-9de2-46be-8ac1-68e188240f34 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/regions/tempest-region-1959172941` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:35.392106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5b0ae6-83a2-40fb-b99e-70d9366a1904 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:35.393046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d355879-9de2-46be-8ac1-68e188240f34 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1959172941)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:35.395959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d355879-9de2-46be-8ac1-68e188240f34 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:35.420320 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2937/5818] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:39:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:39:35.510148 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2882/5819] 10.222.0.43 () {58 vars in 1208 bytes} [Tue Jul 19 14:39:35 2022] DELETE /identity/v3/regions/tempest-region-1959172941 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:39:35.513961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b0ae6-83a2-40fb-b99e-70d9366a1904 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:35.525911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5b0ae6-83a2-40fb-b99e-70d9366a1904 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:35.542201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7beafb0-1457-4b45-9867-50140b1d1b5f tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd820ba5c977643d0b937b88f2f81871c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6990df7e286e4329b1c37d708e2837e8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:35.543067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7beafb0-1457-4b45-9867-50140b1d1b5f tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:35.543360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7beafb0-1457-4b45-9867-50140b1d1b5f tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:35.543679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7beafb0-1457-4b45-9867-50140b1d1b5f tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] PATH_INFO: `/v3/services/027e20133ea44ad992d387c4bbd6eb2e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:35.544340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7beafb0-1457-4b45-9867-50140b1d1b5f tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorizing `identity:delete_service(service_id=027e20133ea44ad992d387c4bbd6eb2e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:35.545965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7beafb0-1457-4b45-9867-50140b1d1b5f tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:35.664830 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2938/5820] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:39:35 2022] DELETE /identity/v3/services/027e20133ea44ad992d387c4bbd6eb2e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:35.668578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d355879-9de2-46be-8ac1-68e188240f34 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:35.670623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4d355879-9de2-46be-8ac1-68e188240f34 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:35.710906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d355879-9de2-46be-8ac1-68e188240f34 tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:35.746172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c0ca6-ccc9-4e87-b672-99c0b688be00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:35.747202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c0ca6-ccc9-4e87-b672-99c0b688be00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:35.747598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c0ca6-ccc9-4e87-b672-99c0b688be00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:35.747960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c0ca6-ccc9-4e87-b672-99c0b688be00 admin admin] PATH_INFO: `/v3/users/6dee1e9f3b1e498aba0f3115ca2ec1e6` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:35.749388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c0ca6-ccc9-4e87-b672-99c0b688be00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dee1e9f3b1e498aba0f3115ca2ec1e6)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:35.751453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c0ca6-ccc9-4e87-b672-99c0b688be00 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:35.818411 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:35.990582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7beafb0-1457-4b45-9867-50140b1d1b5f tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:35.992864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e7beafb0-1457-4b45-9867-50140b1d1b5f tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:36.010871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec6c0ca6-ccc9-4e87-b672-99c0b688be00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dee1e9f3b1e498aba0f3115ca2ec1e6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:36.011439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7beafb0-1457-4b45-9867-50140b1d1b5f tempest-EndPointsTestJSON-135646571 tempest-EndPointsTestJSON-135646571-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:36.017849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a53131-959d-450b-931a-f8b709a882e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:36.019748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a53131-959d-450b-931a-f8b709a882e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:36.020248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a53131-959d-450b-931a-f8b709a882e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:36.020518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a53131-959d-450b-931a-f8b709a882e2 admin admin] PATH_INFO: `/v3/projects/8165247863074adba70c7e953a39e7bd` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:36.022038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a53131-959d-450b-931a-f8b709a882e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8165247863074adba70c7e953a39e7bd)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:36.026673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a53131-959d-450b-931a-f8b709a882e2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:36.034170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec6c0ca6-ccc9-4e87-b672-99c0b688be00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dee1e9f3b1e498aba0f3115ca2ec1e6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:36.034170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec6c0ca6-ccc9-4e87-b672-99c0b688be00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dee1e9f3b1e498aba0f3115ca2ec1e6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:36.034170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec6c0ca6-ccc9-4e87-b672-99c0b688be00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dee1e9f3b1e498aba0f3115ca2ec1e6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:36.043834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec6c0ca6-ccc9-4e87-b672-99c0b688be00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dee1e9f3b1e498aba0f3115ca2ec1e6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:36.155256 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2883/5821] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:39:35 2022] DELETE /identity/v3/users/6dee1e9f3b1e498aba0f3115ca2ec1e6 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:36.160599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfb814-d915-4875-a90d-f66ba206c72d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:36.161160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfb814-d915-4875-a90d-f66ba206c72d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:36.161451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfb814-d915-4875-a90d-f66ba206c72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:36.186348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-badfb814-d915-4875-a90d-f66ba206c72d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:36.187669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-badfb814-d915-4875-a90d-f66ba206c72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:36.270463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-48a53131-959d-450b-931a-f8b709a882e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8165247863074adba70c7e953a39e7bd', 'request_id': 'req-48a53131-959d-450b-931a-f8b709a882e2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:36.279434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-48a53131-959d-450b-931a-f8b709a882e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8165247863074adba70c7e953a39e7bd', 'request_id': 'req-48a53131-959d-450b-931a-f8b709a882e2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:36.295319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-48a53131-959d-450b-931a-f8b709a882e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8165247863074adba70c7e953a39e7bd', 'request_id': 'req-48a53131-959d-450b-931a-f8b709a882e2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:36.355247 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2884/5822] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:39:36.366835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfb814-d915-4875-a90d-f66ba206c72d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:36.368927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-badfb814-d915-4875-a90d-f66ba206c72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:36.392427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-48a53131-959d-450b-931a-f8b709a882e2 admin admin] The token cache is being invalidate because project 8165247863074adba70c7e953a39e7bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:36.392724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-48a53131-959d-450b-931a-f8b709a882e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:36.394415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-48a53131-959d-450b-931a-f8b709a882e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:36.399777 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2939/5823] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:39:35 2022] DELETE /identity/v3/projects/8165247863074adba70c7e953a39e7bd => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:39:36.410366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fa36f-0311-4f79-b1f2-c558bf8a04d8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:36.420205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fa36f-0311-4f79-b1f2-c558bf8a04d8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:36.420205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2fa36f-0311-4f79-b1f2-c558bf8a04d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:36.430962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3d2fa36f-0311-4f79-b1f2-c558bf8a04d8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:36.432165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3d2fa36f-0311-4f79-b1f2-c558bf8a04d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:36.469327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfb814-d915-4875-a90d-f66ba206c72d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:36.521761 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2940/5824] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:39:36.528864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f89d3a-6233-41a6-8729-2c3b2aa89b02 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:36.529304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f89d3a-6233-41a6-8729-2c3b2aa89b02 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:36.529604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f89d3a-6233-41a6-8729-2c3b2aa89b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:36.534857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef839b-f4f8-4e62-821e-c679ffb7d11c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:36.535514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef839b-f4f8-4e62-821e-c679ffb7d11c service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:36.535809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef839b-f4f8-4e62-821e-c679ffb7d11c service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:36.536083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef839b-f4f8-4e62-821e-c679ffb7d11c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:36.537912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fbef839b-f4f8-4e62-821e-c679ffb7d11c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:36.549272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d4f89d3a-6233-41a6-8729-2c3b2aa89b02 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:36.550543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef839b-f4f8-4e62-821e-c679ffb7d11c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:36.551259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d4f89d3a-6233-41a6-8729-2c3b2aa89b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:36.552137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef839b-f4f8-4e62-821e-c679ffb7d11c service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:36.559938 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2941/5825] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:36.564164 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2885/5826] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:39:36.564295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f89d3a-6233-41a6-8729-2c3b2aa89b02 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:36.574324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f89d3a-6233-41a6-8729-2c3b2aa89b02 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:36.583374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dfe49-d1dc-488d-8846-7f75afc91088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:36.583374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dfe49-d1dc-488d-8846-7f75afc91088 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:36.583374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dfe49-d1dc-488d-8846-7f75afc91088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:36.583374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789dfe49-d1dc-488d-8846-7f75afc91088 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:36.584079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789dfe49-d1dc-488d-8846-7f75afc91088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:39:36.584465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789dfe49-d1dc-488d-8846-7f75afc91088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:36.587069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789dfe49-d1dc-488d-8846-7f75afc91088 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:36.599021 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:36.610190 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2942/5827] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:39:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:36.611310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef839b-f4f8-4e62-821e-c679ffb7d11c service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:36.636059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef839b-f4f8-4e62-821e-c679ffb7d11c service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:36.645691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47eb07-219c-401e-833c-f3ae7ea722a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:36.646712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47eb07-219c-401e-833c-f3ae7ea722a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:36.647070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47eb07-219c-401e-833c-f3ae7ea722a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:36.648298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47eb07-219c-401e-833c-f3ae7ea722a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:36.654377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47eb07-219c-401e-833c-f3ae7ea722a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:36.661164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47eb07-219c-401e-833c-f3ae7ea722a6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:36.834485 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2886/5828] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:39:36 2022] POST /identity/v3/projects => generated 387 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:36.837601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dfe49-d1dc-488d-8846-7f75afc91088 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:36.863213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789dfe49-d1dc-488d-8846-7f75afc91088 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:36.988163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ce472-c99e-4295-8372-3290b77ff2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:36.991549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ce472-c99e-4295-8372-3290b77ff2cd admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:36.991549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ce472-c99e-4295-8372-3290b77ff2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:36.991549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ce472-c99e-4295-8372-3290b77ff2cd admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:36.991549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ce472-c99e-4295-8372-3290b77ff2cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:36.994054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ce472-c99e-4295-8372-3290b77ff2cd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:37.147951 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:37.171677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47eb07-219c-401e-833c-f3ae7ea722a6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:37.172652 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2943/5829] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:39:36 2022] POST /identity/v3/users => generated 294 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:37.185674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47eb07-219c-401e-833c-f3ae7ea722a6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:37.192256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d3bdd-14ff-4904-8d61-62b4d6a80fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:37.193158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d3bdd-14ff-4904-8d61-62b4d6a80fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:37.193594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d3bdd-14ff-4904-8d61-62b4d6a80fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:37.194020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d3bdd-14ff-4904-8d61-62b4d6a80fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:37.195013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d3bdd-14ff-4904-8d61-62b4d6a80fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:37.196849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d3bdd-14ff-4904-8d61-62b4d6a80fa4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:37.240342 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2887/5830] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:37.247937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ce472-c99e-4295-8372-3290b77ff2cd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:37.262774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d3bdd-14ff-4904-8d61-62b4d6a80fa4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:37.264167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ce472-c99e-4295-8372-3290b77ff2cd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:37.277529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c57d3bdd-14ff-4904-8d61-62b4d6a80fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:37.297433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e201ada-e946-492e-ba66-a5b77effd48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:37.298158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e201ada-e946-492e-ba66-a5b77effd48d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:37.300671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e201ada-e946-492e-ba66-a5b77effd48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:37.300671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e201ada-e946-492e-ba66-a5b77effd48d admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:37.300671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e201ada-e946-492e-ba66-a5b77effd48d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:37.302354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e201ada-e946-492e-ba66-a5b77effd48d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:37.323538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d3bdd-14ff-4904-8d61-62b4d6a80fa4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:37.351954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e375a9-3051-4faa-8e58-410658beb0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:37.353597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e375a9-3051-4faa-8e58-410658beb0d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:37.353597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e375a9-3051-4faa-8e58-410658beb0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:37.353732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e375a9-3051-4faa-8e58-410658beb0d7 admin admin] PATH_INFO: `/v3/projects/802874b61c6746a5ba4a05bdcd244fde` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:37.354222 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2944/5831] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:37.355693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed1a5e-3b1a-46f2-b6eb-ca961225a36f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:37.355980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed1a5e-3b1a-46f2-b6eb-ca961225a36f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:37.356261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed1a5e-3b1a-46f2-b6eb-ca961225a36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:37.358264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e375a9-3051-4faa-8e58-410658beb0d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=802874b61c6746a5ba4a05bdcd244fde)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:37.360158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e375a9-3051-4faa-8e58-410658beb0d7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:37.419069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6bed1a5e-3b1a-46f2-b6eb-ca961225a36f None None] MFA Rules not processed for user `d1cbf58d0cf8440aae63bf31387948f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:37.420319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6bed1a5e-3b1a-46f2-b6eb-ca961225a36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:37.545706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c6e375a9-3051-4faa-8e58-410658beb0d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '802874b61c6746a5ba4a05bdcd244fde', 'request_id': 'req-c6e375a9-3051-4faa-8e58-410658beb0d7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:37.553059 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2945/5832] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:37.554084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed1a5e-3b1a-46f2-b6eb-ca961225a36f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:37.571163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed1a5e-3b1a-46f2-b6eb-ca961225a36f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:37.652772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136cac96-f22c-4fda-8c9d-52677e1b9d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:37.654726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cac96-f22c-4fda-8c9d-52677e1b9d4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:37.655274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cac96-f22c-4fda-8c9d-52677e1b9d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:37.655866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136cac96-f22c-4fda-8c9d-52677e1b9d4d admin admin] PATH_INFO: `/v3/projects/32b2de5620e14005a26adedc2007c3f5/users/8d6a446bad394101915eead3b141d077/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:37.672808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c6e375a9-3051-4faa-8e58-410658beb0d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '802874b61c6746a5ba4a05bdcd244fde', 'request_id': 'req-c6e375a9-3051-4faa-8e58-410658beb0d7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:37.681744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cac96-f22c-4fda-8c9d-52677e1b9d4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b2de5620e14005a26adedc2007c3f5, user_id=8d6a446bad394101915eead3b141d077, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:37.682401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c6e375a9-3051-4faa-8e58-410658beb0d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '802874b61c6746a5ba4a05bdcd244fde', 'request_id': 'req-c6e375a9-3051-4faa-8e58-410658beb0d7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:37.689910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136cac96-f22c-4fda-8c9d-52677e1b9d4d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:37.698214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c6e375a9-3051-4faa-8e58-410658beb0d7 admin admin] The token cache is being invalidate because project 802874b61c6746a5ba4a05bdcd244fde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:37.698679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c6e375a9-3051-4faa-8e58-410658beb0d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:37.699646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c6e375a9-3051-4faa-8e58-410658beb0d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:37.702035 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2888/5833] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:39:37 2022] DELETE /identity/v3/projects/802874b61c6746a5ba4a05bdcd244fde => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:37.707813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e375a9-3051-4faa-8e58-410658beb0d7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:37.721086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c6e375a9-3051-4faa-8e58-410658beb0d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:37.733519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e375a9-3051-4faa-8e58-410658beb0d7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:37.739601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e565de2-7aca-49bc-8398-dfd6ee0b0aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:37.740782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e565de2-7aca-49bc-8398-dfd6ee0b0aa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:37.741073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e565de2-7aca-49bc-8398-dfd6ee0b0aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:37.741353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e565de2-7aca-49bc-8398-dfd6ee0b0aa5 admin admin] PATH_INFO: `/v3/users/d820ba5c977643d0b937b88f2f81871c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:37.742699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e565de2-7aca-49bc-8398-dfd6ee0b0aa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d820ba5c977643d0b937b88f2f81871c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:37.744653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e565de2-7aca-49bc-8398-dfd6ee0b0aa5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:37.835593 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2946/5834] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:39:37 2022] PUT /identity/v3/projects/32b2de5620e14005a26adedc2007c3f5/users/8d6a446bad394101915eead3b141d077/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:37.837829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c7db2-9a90-423f-ba7f-b61f59c4dec2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:37.838411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c7db2-9a90-423f-ba7f-b61f59c4dec2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:37.838654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c7db2-9a90-423f-ba7f-b61f59c4dec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:37.861754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ad9c7db2-9a90-423f-ba7f-b61f59c4dec2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:37.861754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ad9c7db2-9a90-423f-ba7f-b61f59c4dec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:37.977050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7e565de2-7aca-49bc-8398-dfd6ee0b0aa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd820ba5c977643d0b937b88f2f81871c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:37.981144 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2947/5835] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:39:38.001195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c7db2-9a90-423f-ba7f-b61f59c4dec2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:38.008680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ad9c7db2-9a90-423f-ba7f-b61f59c4dec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:38.032796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7e565de2-7aca-49bc-8398-dfd6ee0b0aa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd820ba5c977643d0b937b88f2f81871c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:38.038737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7e565de2-7aca-49bc-8398-dfd6ee0b0aa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd820ba5c977643d0b937b88f2f81871c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:38.041965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7e565de2-7aca-49bc-8398-dfd6ee0b0aa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd820ba5c977643d0b937b88f2f81871c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:38.068253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7e565de2-7aca-49bc-8398-dfd6ee0b0aa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd820ba5c977643d0b937b88f2f81871c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:38.130231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9c7db2-9a90-423f-ba7f-b61f59c4dec2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:38.135385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505daef9-1624-4f4d-afb4-bb462fb3035a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:38.136255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505daef9-1624-4f4d-afb4-bb462fb3035a service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:38.136715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505daef9-1624-4f4d-afb4-bb462fb3035a service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:38.137288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505daef9-1624-4f4d-afb4-bb462fb3035a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:38.141837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-505daef9-1624-4f4d-afb4-bb462fb3035a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:38.162081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505daef9-1624-4f4d-afb4-bb462fb3035a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:38.164416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505daef9-1624-4f4d-afb4-bb462fb3035a service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:38.178454 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2948/5836] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:39:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:39:38.201268 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2889/5837] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:39:37 2022] DELETE /identity/v3/users/d820ba5c977643d0b937b88f2f81871c => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:38.269331 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:38.421413 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:39.039093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505daef9-1624-4f4d-afb4-bb462fb3035a service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:39.041362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-505daef9-1624-4f4d-afb4-bb462fb3035a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:39.239496 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:39.249172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505daef9-1624-4f4d-afb4-bb462fb3035a service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:39.494879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e1aa3-ade0-48a8-81d3-4a066d1474eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:39.495577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e1aa3-ade0-48a8-81d3-4a066d1474eb service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:39.496130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e1aa3-ade0-48a8-81d3-4a066d1474eb service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:39.496245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e1aa3-ade0-48a8-81d3-4a066d1474eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:39.500494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-781e1aa3-ade0-48a8-81d3-4a066d1474eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:39.530358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e1aa3-ade0-48a8-81d3-4a066d1474eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:39.532086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e1aa3-ade0-48a8-81d3-4a066d1474eb service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:39.554122 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2949/5838] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:39:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:39:39.709220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e565de2-7aca-49bc-8398-dfd6ee0b0aa5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:39.709220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7e565de2-7aca-49bc-8398-dfd6ee0b0aa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:40.034837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e565de2-7aca-49bc-8398-dfd6ee0b0aa5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:40.044272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b4dbf5-3998-4bf9-9bf5-8938a96ee7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:40.045692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4dbf5-3998-4bf9-9bf5-8938a96ee7b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:40.048311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4dbf5-3998-4bf9-9bf5-8938a96ee7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:40.048742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b4dbf5-3998-4bf9-9bf5-8938a96ee7b1 admin admin] PATH_INFO: `/v3/projects/6990df7e286e4329b1c37d708e2837e8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:40.051881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4dbf5-3998-4bf9-9bf5-8938a96ee7b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6990df7e286e4329b1c37d708e2837e8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:40.054412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b4dbf5-3998-4bf9-9bf5-8938a96ee7b1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:40.267774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-40b4dbf5-3998-4bf9-9bf5-8938a96ee7b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6990df7e286e4329b1c37d708e2837e8', 'request_id': 'req-40b4dbf5-3998-4bf9-9bf5-8938a96ee7b1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:40.369726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-40b4dbf5-3998-4bf9-9bf5-8938a96ee7b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6990df7e286e4329b1c37d708e2837e8', 'request_id': 'req-40b4dbf5-3998-4bf9-9bf5-8938a96ee7b1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:40.389057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-40b4dbf5-3998-4bf9-9bf5-8938a96ee7b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6990df7e286e4329b1c37d708e2837e8', 'request_id': 'req-40b4dbf5-3998-4bf9-9bf5-8938a96ee7b1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:40.411064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-40b4dbf5-3998-4bf9-9bf5-8938a96ee7b1 admin admin] The token cache is being invalidate because project 6990df7e286e4329b1c37d708e2837e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:40.411250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-40b4dbf5-3998-4bf9-9bf5-8938a96ee7b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:40.413179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-40b4dbf5-3998-4bf9-9bf5-8938a96ee7b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:40.416104 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2890/5839] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:39:39 2022] DELETE /identity/v3/projects/6990df7e286e4329b1c37d708e2837e8 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:40.421261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf2e4c-6419-461c-becb-08c9f405c6a8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:40.422138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf2e4c-6419-461c-becb-08c9f405c6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:40.422645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf2e4c-6419-461c-becb-08c9f405c6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:40.465565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7bcf2e4c-6419-461c-becb-08c9f405c6a8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:40.467321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7bcf2e4c-6419-461c-becb-08c9f405c6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:40.672388 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2950/5840] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:39:40.682166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00505300-f838-4a1d-ae21-bd81fb74e113 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:40.682476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00505300-f838-4a1d-ae21-bd81fb74e113 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:40.682757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00505300-f838-4a1d-ae21-bd81fb74e113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:40.714331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-00505300-f838-4a1d-ae21-bd81fb74e113 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:40.716362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-00505300-f838-4a1d-ae21-bd81fb74e113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:40.733351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf2e4c-6419-461c-becb-08c9f405c6a8 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:40.734365 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2891/5841] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:40.746506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf2e4c-6419-461c-becb-08c9f405c6a8 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:40.753197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a6104-a600-4a42-8b7d-a22e528e739b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:40.758642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a6104-a600-4a42-8b7d-a22e528e739b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:40.758642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a6104-a600-4a42-8b7d-a22e528e739b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:40.758642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0a6104-a600-4a42-8b7d-a22e528e739b admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:40.758642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a6104-a600-4a42-8b7d-a22e528e739b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:39:40.758642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a6104-a600-4a42-8b7d-a22e528e739b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:40.758642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0a6104-a600-4a42-8b7d-a22e528e739b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:40.788063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00505300-f838-4a1d-ae21-bd81fb74e113 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:40.794297 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:40.803931 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2951/5842] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:40.807017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00505300-f838-4a1d-ae21-bd81fb74e113 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:40.825476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a6afc-3865-478b-a84c-d22591b86faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:40.825968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a6afc-3865-478b-a84c-d22591b86faa admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:40.826303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a6afc-3865-478b-a84c-d22591b86faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:40.826637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a6afc-3865-478b-a84c-d22591b86faa admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:40.827441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a6afc-3865-478b-a84c-d22591b86faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:40.829558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a6afc-3865-478b-a84c-d22591b86faa admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:40.965154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a6104-a600-4a42-8b7d-a22e528e739b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:40.966387 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2892/5843] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:39:40 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:40.977280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0a6104-a600-4a42-8b7d-a22e528e739b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:41.052115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786d590-bd1f-4554-bba1-8a99afdd1d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:41.052874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786d590-bd1f-4554-bba1-8a99afdd1d81 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:41.053251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786d590-bd1f-4554-bba1-8a99afdd1d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:41.053605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f786d590-bd1f-4554-bba1-8a99afdd1d81 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:41.054457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786d590-bd1f-4554-bba1-8a99afdd1d81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:41.056883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f786d590-bd1f-4554-bba1-8a99afdd1d81 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:41.189901 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2952/5844] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:39:40 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:39:41.194783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a6afc-3865-478b-a84c-d22591b86faa admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:41.235432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a6afc-3865-478b-a84c-d22591b86faa admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:41.241857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167307c-48f7-4e34-82a5-13a89f09bb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:41.250878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167307c-48f7-4e34-82a5-13a89f09bb96 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:41.250878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167307c-48f7-4e34-82a5-13a89f09bb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:41.250878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167307c-48f7-4e34-82a5-13a89f09bb96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:41.250878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167307c-48f7-4e34-82a5-13a89f09bb96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:41.250878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167307c-48f7-4e34-82a5-13a89f09bb96 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:41.261697 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2893/5845] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:41.265926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786d590-bd1f-4554-bba1-8a99afdd1d81 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:41.273067 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:41.279627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f786d590-bd1f-4554-bba1-8a99afdd1d81 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:41.295568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536bfaa-25b1-4153-b06b-732f9b159054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:41.296612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536bfaa-25b1-4153-b06b-732f9b159054 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:41.296974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536bfaa-25b1-4153-b06b-732f9b159054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:41.297262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536bfaa-25b1-4153-b06b-732f9b159054 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:41.298014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536bfaa-25b1-4153-b06b-732f9b159054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:41.303988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536bfaa-25b1-4153-b06b-732f9b159054 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:41.331869 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2953/5846] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:41.336248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167307c-48f7-4e34-82a5-13a89f09bb96 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:41.347771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167307c-48f7-4e34-82a5-13a89f09bb96 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:41.372579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ae840-afac-44ab-84f2-82432b8418ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:41.373762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ae840-afac-44ab-84f2-82432b8418ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:41.377017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ae840-afac-44ab-84f2-82432b8418ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:41.377506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064ae840-afac-44ab-84f2-82432b8418ea admin admin] PATH_INFO: `/v3/projects/35168c8484b84965b9450cdf2af3d72f/users/fdc1ddca8c614b048708d2a01561aede/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:41.417010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ae840-afac-44ab-84f2-82432b8418ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=35168c8484b84965b9450cdf2af3d72f, user_id=fdc1ddca8c614b048708d2a01561aede, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:41.423055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064ae840-afac-44ab-84f2-82432b8418ea admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:41.557563 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2894/5847] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:39:41 2022] PUT /identity/v3/projects/35168c8484b84965b9450cdf2af3d72f/users/fdc1ddca8c614b048708d2a01561aede/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:39:41.572981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63d03e-7416-47fd-828f-7db020134394 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:41.573519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63d03e-7416-47fd-828f-7db020134394 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:41.573519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af63d03e-7416-47fd-828f-7db020134394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:41.641768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-af63d03e-7416-47fd-828f-7db020134394 None None] MFA Rules not processed for user `fdc1ddca8c614b048708d2a01561aede`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:41.646010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-af63d03e-7416-47fd-828f-7db020134394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:41.815161 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2954/5848] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:41.819680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ae840-afac-44ab-84f2-82432b8418ea admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:42.081783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064ae840-afac-44ab-84f2-82432b8418ea admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:42.101294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2dd04-26a1-46bb-86cb-1e428e93c25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:42.105836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2dd04-26a1-46bb-86cb-1e428e93c25d admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:42.106234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2dd04-26a1-46bb-86cb-1e428e93c25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:42.106529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2dd04-26a1-46bb-86cb-1e428e93c25d admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:42.107278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2dd04-26a1-46bb-86cb-1e428e93c25d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:42.110073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2dd04-26a1-46bb-86cb-1e428e93c25d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:42.223034 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2895/5849] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:39:41 2022] POST /identity/v3/projects => generated 387 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:42.227439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63d03e-7416-47fd-828f-7db020134394 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:42.264507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af63d03e-7416-47fd-828f-7db020134394 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:42.389877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248f2a8-bb68-4542-b243-2d41bf481e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:42.390597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248f2a8-bb68-4542-b243-2d41bf481e5c admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:42.391723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248f2a8-bb68-4542-b243-2d41bf481e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:42.392181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248f2a8-bb68-4542-b243-2d41bf481e5c admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:42.392932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248f2a8-bb68-4542-b243-2d41bf481e5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:42.395544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248f2a8-bb68-4542-b243-2d41bf481e5c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:42.486855 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2955/5850] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:39:42 2022] POST /identity/v3/users => generated 300 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:42.487455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2dd04-26a1-46bb-86cb-1e428e93c25d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:42.502244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2dd04-26a1-46bb-86cb-1e428e93c25d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:42.510452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d0b0a-df8a-40cc-be4f-e6a2a955b2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:42.511746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d0b0a-df8a-40cc-be4f-e6a2a955b2bf admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:42.512387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d0b0a-df8a-40cc-be4f-e6a2a955b2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:42.512832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d0b0a-df8a-40cc-be4f-e6a2a955b2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:42.514614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d0b0a-df8a-40cc-be4f-e6a2a955b2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:42.517165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d0b0a-df8a-40cc-be4f-e6a2a955b2bf admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:42.533637 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2896/5851] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:42.538260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248f2a8-bb68-4542-b243-2d41bf481e5c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:42.551922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248f2a8-bb68-4542-b243-2d41bf481e5c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:42.567721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6eaeb-b44c-4201-a860-097035081d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:42.568659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6eaeb-b44c-4201-a860-097035081d56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:42.569219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6eaeb-b44c-4201-a860-097035081d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:42.569512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6eaeb-b44c-4201-a860-097035081d56 admin admin] PATH_INFO: `/v3/projects/d8f9373c97864db199b761c6f9271c41/users/0a2153f63af449be828633fc3283f83f/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:42.614851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6eaeb-b44c-4201-a860-097035081d56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f9373c97864db199b761c6f9271c41, user_id=0a2153f63af449be828633fc3283f83f, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:42.618513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6eaeb-b44c-4201-a860-097035081d56 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:42.725642 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2956/5852] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:39:42 2022] PUT /identity/v3/projects/d8f9373c97864db199b761c6f9271c41/users/0a2153f63af449be828633fc3283f83f/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:42.729813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d0b0a-df8a-40cc-be4f-e6a2a955b2bf admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:42.742601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d0b0a-df8a-40cc-be4f-e6a2a955b2bf admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:42.895509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7491c493-73f2-4bf6-877b-b6912204a42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:42.896425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491c493-73f2-4bf6-877b-b6912204a42d admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:42.902082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491c493-73f2-4bf6-877b-b6912204a42d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:42.902082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491c493-73f2-4bf6-877b-b6912204a42d admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:42.902082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491c493-73f2-4bf6-877b-b6912204a42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:42.902082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7491c493-73f2-4bf6-877b-b6912204a42d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:42.917009 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2897/5853] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:42.920825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6eaeb-b44c-4201-a860-097035081d56 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:42.934381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6eaeb-b44c-4201-a860-097035081d56 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:42.939608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f612c2-8a67-42cd-9226-d7884609f650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:42.940164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f612c2-8a67-42cd-9226-d7884609f650 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:42.940531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f612c2-8a67-42cd-9226-d7884609f650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:42.941039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f612c2-8a67-42cd-9226-d7884609f650 admin admin] PATH_INFO: `/v3/projects/d8f9373c97864db199b761c6f9271c41/users/0a2153f63af449be828633fc3283f83f/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:42.944652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f612c2-8a67-42cd-9226-d7884609f650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f9373c97864db199b761c6f9271c41, user_id=0a2153f63af449be828633fc3283f83f, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:42.948063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f612c2-8a67-42cd-9226-d7884609f650 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:42.972450 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2957/5854] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:39:42 2022] PUT /identity/v3/projects/d8f9373c97864db199b761c6f9271c41/users/0a2153f63af449be828633fc3283f83f/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:42.975017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad56219-019d-4af0-80d5-c2a63e3e6b41 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:42.975544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad56219-019d-4af0-80d5-c2a63e3e6b41 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:42.976137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad56219-019d-4af0-80d5-c2a63e3e6b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:43.044864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1ad56219-019d-4af0-80d5-c2a63e3e6b41 None None] MFA Rules not processed for user `0a2153f63af449be828633fc3283f83f`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:43.046519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1ad56219-019d-4af0-80d5-c2a63e3e6b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:43.056132 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:43.158040 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2898/5855] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:42 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:43.162799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f612c2-8a67-42cd-9226-d7884609f650 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:43.175096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f612c2-8a67-42cd-9226-d7884609f650 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:43.180746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675d53c-ac3d-48d6-9e5c-8694cd80fe29 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2153f63af449be828633fc3283f83f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f9373c97864db199b761c6f9271c41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:43.181669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675d53c-ac3d-48d6-9e5c-8694cd80fe29 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:43.182196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675d53c-ac3d-48d6-9e5c-8694cd80fe29 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:43.187986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675d53c-ac3d-48d6-9e5c-8694cd80fe29 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:43.189225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675d53c-ac3d-48d6-9e5c-8694cd80fe29 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:43.193805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675d53c-ac3d-48d6-9e5c-8694cd80fe29 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:43.282619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad56219-019d-4af0-80d5-c2a63e3e6b41 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:43.291220 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2958/5856] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:39:43 2022] POST /identity/v3/services => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:43.301384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad56219-019d-4af0-80d5-c2a63e3e6b41 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:43.327362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4621e2-b0ef-44a8-ba74-bac51365a7d8 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2153f63af449be828633fc3283f83f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f9373c97864db199b761c6f9271c41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:43.328207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4621e2-b0ef-44a8-ba74-bac51365a7d8 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:43.328590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4621e2-b0ef-44a8-ba74-bac51365a7d8 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:43.329583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4621e2-b0ef-44a8-ba74-bac51365a7d8 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:43.329807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4621e2-b0ef-44a8-ba74-bac51365a7d8 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:43.334593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4621e2-b0ef-44a8-ba74-bac51365a7d8 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-0d4621e2-b0ef-44a8-ba74-bac51365a7d8 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: Failed validating 'type' in schema['properties']['enabled']: Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: {'enum': [True, False, None], 'type': 'boolean'} Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: On instance['enabled']: Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: Failed validating 'type' in schema['properties']['enabled']: Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: {'enum': [True, False, None], 'type': 'boolean'} Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: On instance['enabled']: Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: 'False' Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise error Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application On instance['enabled']: Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application 'False' Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:43.341744 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:39:43.343077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:43.343077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:43.343077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:39:43.343077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:39:43.343077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:39:43.343077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:39:43.343077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:39:43.343077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:39:43.343077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:39:43.343077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:39:43.343077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:39:43.343077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:39:43.343077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jul 19 14:39:43.343077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jul 19 14:39:43.343077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 19 14:39:43.343077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 19 14:39:43.343077 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 19 14:39:43.343965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 19 14:39:43.343965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 19 14:39:43.343965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:43.343965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 19 14:39:43.343965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 19 14:39:43.343965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:43.343965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application On instance['enabled']: Jul 19 14:39:43.343965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application 'False' Jul 19 14:39:43.343965 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:43.356448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675d53c-ac3d-48d6-9e5c-8694cd80fe29 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:43.356655 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2899/5857] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Jul 19 14:39:43 2022] POST /identity/v3/endpoints => generated 283 bytes in 68 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 19 14:39:43.387093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675d53c-ac3d-48d6-9e5c-8694cd80fe29 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:43.398845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad7582-0086-47b5-8499-1051cb0c68eb tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2153f63af449be828633fc3283f83f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f9373c97864db199b761c6f9271c41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:43.399660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7582-0086-47b5-8499-1051cb0c68eb tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:43.400056 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7582-0086-47b5-8499-1051cb0c68eb tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:43.406912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad7582-0086-47b5-8499-1051cb0c68eb tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:43.407589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad7582-0086-47b5-8499-1051cb0c68eb tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:43.410898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad7582-0086-47b5-8499-1051cb0c68eb tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-1dad7582-0086-47b5-8499-1051cb0c68eb tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: Failed validating 'type' in schema['properties']['enabled']: Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: {'enum': [True, False, None], 'type': 'boolean'} Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: On instance['enabled']: Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: Failed validating 'type' in schema['properties']['enabled']: Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: {'enum': [True, False, None], 'type': 'boolean'} Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: On instance['enabled']: Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: 'True' Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise error Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application On instance['enabled']: Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application 'True' Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:43.458231 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:39:43.459673 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:43.459673 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:43.459673 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:39:43.459673 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:39:43.459673 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:39:43.459673 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:39:43.459673 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:39:43.459673 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:39:43.459673 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:39:43.459673 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:39:43.459673 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:39:43.459673 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:39:43.459673 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jul 19 14:39:43.459673 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jul 19 14:39:43.459673 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 19 14:39:43.459673 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 19 14:39:43.459673 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 19 14:39:43.460636 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 19 14:39:43.460636 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 19 14:39:43.460636 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:43.460636 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 19 14:39:43.460636 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 19 14:39:43.460636 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:43.460636 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application On instance['enabled']: Jul 19 14:39:43.460636 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application 'True' Jul 19 14:39:43.460636 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:43.467930 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2959/5858] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Jul 19 14:39:43 2022] POST /identity/v3/endpoints => generated 281 bytes in 113 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jul 19 14:39:43.469218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4621e2-b0ef-44a8-ba74-bac51365a7d8 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:43.480174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4621e2-b0ef-44a8-ba74-bac51365a7d8 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:43.485590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabfa2e-8902-4083-9bba-a250cd2e8527 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2153f63af449be828633fc3283f83f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f9373c97864db199b761c6f9271c41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:43.486332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabfa2e-8902-4083-9bba-a250cd2e8527 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:43.486633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabfa2e-8902-4083-9bba-a250cd2e8527 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:43.486918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabfa2e-8902-4083-9bba-a250cd2e8527 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:43.488584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabfa2e-8902-4083-9bba-a250cd2e8527 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:43.489942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabfa2e-8902-4083-9bba-a250cd2e8527 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:43.615437 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-2cabfa2e-8902-4083-9bba-a250cd2e8527 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-187424510. To ensure interoperability, identifiers should be a valid uuid. Jul 19 14:39:43.615437 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 14:39:43.615437 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:39:43.767299 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2900/5859] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Jul 19 14:39:43 2022] POST /identity/v3/endpoints => generated 359 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:43.771743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad7582-0086-47b5-8499-1051cb0c68eb tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:43.782989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad7582-0086-47b5-8499-1051cb0c68eb tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:43.800691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b6b40-d172-4c0c-9ea9-ec34b3130fdb tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2153f63af449be828633fc3283f83f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f9373c97864db199b761c6f9271c41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:43.801748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b6b40-d172-4c0c-9ea9-ec34b3130fdb tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:43.801859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b6b40-d172-4c0c-9ea9-ec34b3130fdb tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:43.802223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b6b40-d172-4c0c-9ea9-ec34b3130fdb tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] PATH_INFO: `/v3/regions/tempest-region-187424510` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:43.802908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b6b40-d172-4c0c-9ea9-ec34b3130fdb tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-187424510)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:43.804006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b6b40-d172-4c0c-9ea9-ec34b3130fdb tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:43.806173 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2960/5860] 10.222.0.43 () {58 vars in 1202 bytes} [Tue Jul 19 14:39:43 2022] GET /identity/v3/regions/tempest-region-187424510 => generated 178 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:43.811400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabfa2e-8902-4083-9bba-a250cd2e8527 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:43.823056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabfa2e-8902-4083-9bba-a250cd2e8527 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:43.828540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93552a62-7730-48aa-a965-8aeb3e3f3224 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2153f63af449be828633fc3283f83f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f9373c97864db199b761c6f9271c41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:43.829624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93552a62-7730-48aa-a965-8aeb3e3f3224 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:43.829906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93552a62-7730-48aa-a965-8aeb3e3f3224 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:43.830224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93552a62-7730-48aa-a965-8aeb3e3f3224 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] PATH_INFO: `/v3/endpoints/a695d526f23345318b85bc4769408e53` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:43.836977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93552a62-7730-48aa-a965-8aeb3e3f3224 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=a695d526f23345318b85bc4769408e53)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:43.838019 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-93552a62-7730-48aa-a965-8aeb3e3f3224 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:39:43.838019 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:39:43.838019 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:39:43.838960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93552a62-7730-48aa-a965-8aeb3e3f3224 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-93552a62-7730-48aa-a965-8aeb3e3f3224 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: Failed validating 'type' in schema['properties']['enabled']: Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: {'enum': [True, False, None], 'type': 'boolean'} Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: On instance['enabled']: Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: Failed validating 'type' in schema['properties']['enabled']: Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: {'enum': [True, False, None], 'type': 'boolean'} Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: On instance['enabled']: Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: 'False' Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise error Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application On instance['enabled']: Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application 'False' Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:43.850895 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:39:43.852157 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:43.852157 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:43.852157 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:39:43.852157 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:39:43.852157 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:39:43.852157 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:39:43.852157 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:39:43.852157 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:39:43.852157 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:39:43.852157 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:39:43.852157 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:39:43.852157 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:39:43.852157 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jul 19 14:39:43.852157 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jul 19 14:39:43.852157 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 19 14:39:43.852157 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 19 14:39:43.852157 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 19 14:39:43.852992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 19 14:39:43.852992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 19 14:39:43.852992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:43.852992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 19 14:39:43.852992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 19 14:39:43.852992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:43.852992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application On instance['enabled']: Jul 19 14:39:43.852992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application 'False' Jul 19 14:39:43.852992 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:39:43.852992 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2901/5861] 10.222.0.43 () {60 vars in 1254 bytes} [Tue Jul 19 14:39:43 2022] PATCH /identity/v3/endpoints/a695d526f23345318b85bc4769408e53 => generated 283 bytes in 41 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 19 14:39:43.857875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b6b40-d172-4c0c-9ea9-ec34b3130fdb tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:43.864623 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:43.872879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b6b40-d172-4c0c-9ea9-ec34b3130fdb tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:43.879644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902afaae-0bfa-47f5-8481-ebc38f67ba6f tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2153f63af449be828633fc3283f83f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f9373c97864db199b761c6f9271c41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:43.880729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902afaae-0bfa-47f5-8481-ebc38f67ba6f tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:43.881082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902afaae-0bfa-47f5-8481-ebc38f67ba6f tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:43.881431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902afaae-0bfa-47f5-8481-ebc38f67ba6f tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] PATH_INFO: `/v3/endpoints/a695d526f23345318b85bc4769408e53` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:43.883000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902afaae-0bfa-47f5-8481-ebc38f67ba6f tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=a695d526f23345318b85bc4769408e53)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:43.884678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902afaae-0bfa-47f5-8481-ebc38f67ba6f tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:44.012228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-902afaae-0bfa-47f5-8481-ebc38f67ba6f tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'a695d526f23345318b85bc4769408e53', 'request_id': 'req-902afaae-0bfa-47f5-8481-ebc38f67ba6f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:44.067615 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2961/5862] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jul 19 14:39:43 2022] DELETE /identity/v3/endpoints/a695d526f23345318b85bc4769408e53 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:44.072240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93552a62-7730-48aa-a965-8aeb3e3f3224 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:44.097211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93552a62-7730-48aa-a965-8aeb3e3f3224 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:44.349195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664beea-b48d-4990-ad27-5af1c7f12092 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2153f63af449be828633fc3283f83f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f9373c97864db199b761c6f9271c41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:44.349195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664beea-b48d-4990-ad27-5af1c7f12092 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:44.349195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664beea-b48d-4990-ad27-5af1c7f12092 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:44.355380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664beea-b48d-4990-ad27-5af1c7f12092 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] PATH_INFO: `/v3/regions/tempest-region-187424510` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:44.355380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664beea-b48d-4990-ad27-5af1c7f12092 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-187424510)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:44.355380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664beea-b48d-4990-ad27-5af1c7f12092 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:44.503149 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2902/5863] 10.222.0.43 () {58 vars in 1205 bytes} [Tue Jul 19 14:39:44 2022] DELETE /identity/v3/regions/tempest-region-187424510 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:44.508240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902afaae-0bfa-47f5-8481-ebc38f67ba6f tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:44.524208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902afaae-0bfa-47f5-8481-ebc38f67ba6f tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:44.565527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfd97f-cc03-4ca4-b982-6474a94cff74 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2153f63af449be828633fc3283f83f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f9373c97864db199b761c6f9271c41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:44.566461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfd97f-cc03-4ca4-b982-6474a94cff74 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:44.566938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfd97f-cc03-4ca4-b982-6474a94cff74 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:44.567410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dfd97f-cc03-4ca4-b982-6474a94cff74 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:44.568462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfd97f-cc03-4ca4-b982-6474a94cff74 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:44.570395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dfd97f-cc03-4ca4-b982-6474a94cff74 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:44.748789 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-65dfd97f-cc03-4ca4-b982-6474a94cff74 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1144964610. To ensure interoperability, identifiers should be a valid uuid. Jul 19 14:39:44.748789 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 14:39:44.748789 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:39:44.838611 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2962/5864] 10.222.0.43 () {60 vars in 1155 bytes} [Tue Jul 19 14:39:44 2022] POST /identity/v3/endpoints => generated 360 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:44.843175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664beea-b48d-4990-ad27-5af1c7f12092 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:44.872543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664beea-b48d-4990-ad27-5af1c7f12092 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:44.924340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f0c9b-ab6a-45ce-a5f4-8f7a6b8d72d0 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2153f63af449be828633fc3283f83f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f9373c97864db199b761c6f9271c41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:44.928947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f0c9b-ab6a-45ce-a5f4-8f7a6b8d72d0 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:44.929273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f0c9b-ab6a-45ce-a5f4-8f7a6b8d72d0 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:44.929834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f0c9b-ab6a-45ce-a5f4-8f7a6b8d72d0 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] PATH_INFO: `/v3/regions/tempest-region-1144964610` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:44.930757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f0c9b-ab6a-45ce-a5f4-8f7a6b8d72d0 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1144964610)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:44.932040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33f0c9b-ab6a-45ce-a5f4-8f7a6b8d72d0 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:44.938442 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2903/5865] 10.222.0.43 () {58 vars in 1205 bytes} [Tue Jul 19 14:39:44 2022] GET /identity/v3/regions/tempest-region-1144964610 => generated 180 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:44.942050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfd97f-cc03-4ca4-b982-6474a94cff74 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:44.963544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dfd97f-cc03-4ca4-b982-6474a94cff74 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:44.980671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698df997-4500-4a3a-a4f8-89f9eddbe10d tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2153f63af449be828633fc3283f83f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f9373c97864db199b761c6f9271c41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:44.981672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698df997-4500-4a3a-a4f8-89f9eddbe10d tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:44.982626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698df997-4500-4a3a-a4f8-89f9eddbe10d tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:44.986337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698df997-4500-4a3a-a4f8-89f9eddbe10d tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] PATH_INFO: `/v3/endpoints/67c1755ba4894c0db07b86600feb759d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:44.995740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698df997-4500-4a3a-a4f8-89f9eddbe10d tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=67c1755ba4894c0db07b86600feb759d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:44.998037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698df997-4500-4a3a-a4f8-89f9eddbe10d tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-698df997-4500-4a3a-a4f8-89f9eddbe10d tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: Failed validating 'type' in schema['properties']['enabled']: Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: {'enum': [True, False, None], 'type': 'boolean'} Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: On instance['enabled']: Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: Failed validating 'type' in schema['properties']['enabled']: Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: {'enum': [True, False, None], 'type': 'boolean'} Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: On instance['enabled']: Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: 'True' Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise error Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application On instance['enabled']: Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application 'True' Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:45.039386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:39:45.040768 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:45.040768 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:39:45.040768 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:39:45.040768 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:39:45.040768 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:39:45.040768 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:39:45.040768 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:39:45.040768 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:39:45.040768 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:39:45.040768 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:39:45.040768 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:39:45.040768 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:39:45.040768 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jul 19 14:39:45.040768 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jul 19 14:39:45.040768 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 19 14:39:45.040768 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 19 14:39:45.040768 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 19 14:39:45.041708 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 19 14:39:45.041708 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 19 14:39:45.041708 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:45.041708 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 19 14:39:45.041708 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 19 14:39:45.041708 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:45.041708 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application On instance['enabled']: Jul 19 14:39:45.041708 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application 'True' Jul 19 14:39:45.041708 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:39:45.043601 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2963/5866] 10.222.0.43 () {60 vars in 1254 bytes} [Tue Jul 19 14:39:44 2022] PATCH /identity/v3/endpoints/67c1755ba4894c0db07b86600feb759d => generated 281 bytes in 102 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jul 19 14:39:45.048155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f0c9b-ab6a-45ce-a5f4-8f7a6b8d72d0 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:45.063555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33f0c9b-ab6a-45ce-a5f4-8f7a6b8d72d0 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:45.079311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2816485-b937-4fa0-9caf-ca9bb845b4e1 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2153f63af449be828633fc3283f83f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f9373c97864db199b761c6f9271c41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:45.080224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2816485-b937-4fa0-9caf-ca9bb845b4e1 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:45.080518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2816485-b937-4fa0-9caf-ca9bb845b4e1 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:45.080803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2816485-b937-4fa0-9caf-ca9bb845b4e1 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] PATH_INFO: `/v3/endpoints/67c1755ba4894c0db07b86600feb759d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:45.084887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2816485-b937-4fa0-9caf-ca9bb845b4e1 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=67c1755ba4894c0db07b86600feb759d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:45.089514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2816485-b937-4fa0-9caf-ca9bb845b4e1 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:45.213517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d2816485-b937-4fa0-9caf-ca9bb845b4e1 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '67c1755ba4894c0db07b86600feb759d', 'request_id': 'req-d2816485-b937-4fa0-9caf-ca9bb845b4e1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:45.237908 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2904/5867] 10.222.0.43 () {58 vars in 1235 bytes} [Tue Jul 19 14:39:45 2022] DELETE /identity/v3/endpoints/67c1755ba4894c0db07b86600feb759d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:45.243827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698df997-4500-4a3a-a4f8-89f9eddbe10d tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:45.290265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698df997-4500-4a3a-a4f8-89f9eddbe10d tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:45.330241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a19cf-380b-4470-9212-748f877a1439 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2153f63af449be828633fc3283f83f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f9373c97864db199b761c6f9271c41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:45.332256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a19cf-380b-4470-9212-748f877a1439 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:45.332916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a19cf-380b-4470-9212-748f877a1439 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:45.333391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a19cf-380b-4470-9212-748f877a1439 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] PATH_INFO: `/v3/regions/tempest-region-1144964610` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:45.335044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a19cf-380b-4470-9212-748f877a1439 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1144964610)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:45.336892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a19cf-380b-4470-9212-748f877a1439 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:45.445009 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2964/5868] 10.222.0.43 () {58 vars in 1208 bytes} [Tue Jul 19 14:39:45 2022] DELETE /identity/v3/regions/tempest-region-1144964610 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:45.452255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2816485-b937-4fa0-9caf-ca9bb845b4e1 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:45.471828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2816485-b937-4fa0-9caf-ca9bb845b4e1 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:45.515144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60b5bd-1561-4535-ad0c-625d2d1176e3 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0a2153f63af449be828633fc3283f83f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd8f9373c97864db199b761c6f9271c41', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:45.515144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60b5bd-1561-4535-ad0c-625d2d1176e3 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:45.515144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60b5bd-1561-4535-ad0c-625d2d1176e3 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:45.515610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60b5bd-1561-4535-ad0c-625d2d1176e3 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] PATH_INFO: `/v3/services/dbde63c0634845488a4bea87f355d82c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:45.516062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60b5bd-1561-4535-ad0c-625d2d1176e3 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorizing `identity:delete_service(service_id=dbde63c0634845488a4bea87f355d82c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:45.519513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a60b5bd-1561-4535-ad0c-625d2d1176e3 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:45.705248 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2905/5869] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:39:45 2022] DELETE /identity/v3/services/dbde63c0634845488a4bea87f355d82c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:45.709745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a19cf-380b-4470-9212-748f877a1439 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:45.985703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a19cf-380b-4470-9212-748f877a1439 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:46.020032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c159a6d4-aecf-44e4-8fac-fe4bfee2a515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:46.021051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159a6d4-aecf-44e4-8fac-fe4bfee2a515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:46.021345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159a6d4-aecf-44e4-8fac-fe4bfee2a515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:46.021687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c159a6d4-aecf-44e4-8fac-fe4bfee2a515 admin admin] PATH_INFO: `/v3/users/fdc1ddca8c614b048708d2a01561aede` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:46.025527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159a6d4-aecf-44e4-8fac-fe4bfee2a515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc1ddca8c614b048708d2a01561aede)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:46.027771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c159a6d4-aecf-44e4-8fac-fe4bfee2a515 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:46.261363 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:46.279526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c159a6d4-aecf-44e4-8fac-fe4bfee2a515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc1ddca8c614b048708d2a01561aede'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:46.307312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c159a6d4-aecf-44e4-8fac-fe4bfee2a515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc1ddca8c614b048708d2a01561aede'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:46.324214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c159a6d4-aecf-44e4-8fac-fe4bfee2a515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc1ddca8c614b048708d2a01561aede'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:46.325600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c159a6d4-aecf-44e4-8fac-fe4bfee2a515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc1ddca8c614b048708d2a01561aede'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:46.378557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60b5bd-1561-4535-ad0c-625d2d1176e3 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:46.404943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8a60b5bd-1561-4535-ad0c-625d2d1176e3 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:46.430550 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:46.463524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c159a6d4-aecf-44e4-8fac-fe4bfee2a515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc1ddca8c614b048708d2a01561aede'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:46.470801 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2965/5870] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:39:45 2022] DELETE /identity/v3/users/fdc1ddca8c614b048708d2a01561aede => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:46.477600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8fce1-3527-41ac-9883-63d10b6ea00a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:46.477899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8fce1-3527-41ac-9883-63d10b6ea00a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:46.478276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8fce1-3527-41ac-9883-63d10b6ea00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:46.487811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a60b5bd-1561-4535-ad0c-625d2d1176e3 tempest-EndpointsNegativeTestJSON-1090384088 tempest-EndpointsNegativeTestJSON-1090384088-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:46.554320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-abc8fce1-3527-41ac-9883-63d10b6ea00a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:46.555893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-abc8fce1-3527-41ac-9883-63d10b6ea00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:46.687791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0ecd1-ed7f-4e6e-a6ab-91be12db5edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:46.689122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0ecd1-ed7f-4e6e-a6ab-91be12db5edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:46.689770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0ecd1-ed7f-4e6e-a6ab-91be12db5edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:46.701734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0ecd1-ed7f-4e6e-a6ab-91be12db5edf admin admin] PATH_INFO: `/v3/users/90501d0a7a7a40719b9c72e865282a57` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:46.703681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0ecd1-ed7f-4e6e-a6ab-91be12db5edf admin admin] RBAC: Authorizing `identity:delete_user(user_id=90501d0a7a7a40719b9c72e865282a57)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:46.713808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0ecd1-ed7f-4e6e-a6ab-91be12db5edf admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:46.779234 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2966/5871] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:46.901383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8fce1-3527-41ac-9883-63d10b6ea00a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:46.902985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-abc8fce1-3527-41ac-9883-63d10b6ea00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:47.000826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-12d0ecd1-ed7f-4e6e-a6ab-91be12db5edf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90501d0a7a7a40719b9c72e865282a57'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:47.037701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-12d0ecd1-ed7f-4e6e-a6ab-91be12db5edf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90501d0a7a7a40719b9c72e865282a57'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:47.039182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-12d0ecd1-ed7f-4e6e-a6ab-91be12db5edf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90501d0a7a7a40719b9c72e865282a57'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:47.040282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-12d0ecd1-ed7f-4e6e-a6ab-91be12db5edf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90501d0a7a7a40719b9c72e865282a57'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:47.051654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-12d0ecd1-ed7f-4e6e-a6ab-91be12db5edf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90501d0a7a7a40719b9c72e865282a57'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:47.110761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8fce1-3527-41ac-9883-63d10b6ea00a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:47.124858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93798eec-1f8b-4e08-81a0-80d757a5d303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:47.125552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93798eec-1f8b-4e08-81a0-80d757a5d303 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:47.125843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93798eec-1f8b-4e08-81a0-80d757a5d303 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:47.126179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93798eec-1f8b-4e08-81a0-80d757a5d303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:47.133663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-93798eec-1f8b-4e08-81a0-80d757a5d303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:47.149260 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2906/5872] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:39:46 2022] DELETE /identity/v3/users/90501d0a7a7a40719b9c72e865282a57 => generated 0 bytes in 769 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:47.151502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e79166-248a-492f-a56c-dcf38f847f33 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:47.151797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e79166-248a-492f-a56c-dcf38f847f33 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:47.152086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e79166-248a-492f-a56c-dcf38f847f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:47.212896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93798eec-1f8b-4e08-81a0-80d757a5d303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:47.212896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93798eec-1f8b-4e08-81a0-80d757a5d303 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:47.239580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-07e79166-248a-492f-a56c-dcf38f847f33 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:47.240592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-07e79166-248a-492f-a56c-dcf38f847f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:47.253413 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2967/5873] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:39:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:39:47.476187 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2907/5874] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:47.480614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93798eec-1f8b-4e08-81a0-80d757a5d303 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:47.482064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-93798eec-1f8b-4e08-81a0-80d757a5d303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:47.498829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93798eec-1f8b-4e08-81a0-80d757a5d303 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:47.631727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab96ee3-6a08-4bb2-bea6-306c3db80a57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:47.632614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab96ee3-6a08-4bb2-bea6-306c3db80a57 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:47.633242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab96ee3-6a08-4bb2-bea6-306c3db80a57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:47.633529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab96ee3-6a08-4bb2-bea6-306c3db80a57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:47.684331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab96ee3-6a08-4bb2-bea6-306c3db80a57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:47.685814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab96ee3-6a08-4bb2-bea6-306c3db80a57 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:47.733316 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2968/5875] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:39:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:39:47.758998 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:48.666392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e79166-248a-492f-a56c-dcf38f847f33 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:48.666392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-07e79166-248a-492f-a56c-dcf38f847f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:48.693636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e79166-248a-492f-a56c-dcf38f847f33 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:48.717809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339067b6-5108-4934-bfbf-09a53ca12e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:48.718936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339067b6-5108-4934-bfbf-09a53ca12e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:48.719375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339067b6-5108-4934-bfbf-09a53ca12e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:48.719833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339067b6-5108-4934-bfbf-09a53ca12e9d admin admin] PATH_INFO: `/v3/projects/a1f41b65b26941559288c78974af3c28` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:48.732005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339067b6-5108-4934-bfbf-09a53ca12e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1f41b65b26941559288c78974af3c28)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:48.732870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339067b6-5108-4934-bfbf-09a53ca12e9d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:48.783368 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:48.969326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-339067b6-5108-4934-bfbf-09a53ca12e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1f41b65b26941559288c78974af3c28', 'request_id': 'req-339067b6-5108-4934-bfbf-09a53ca12e9d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:49.067080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-339067b6-5108-4934-bfbf-09a53ca12e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1f41b65b26941559288c78974af3c28', 'request_id': 'req-339067b6-5108-4934-bfbf-09a53ca12e9d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:49.086632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-339067b6-5108-4934-bfbf-09a53ca12e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1f41b65b26941559288c78974af3c28', 'request_id': 'req-339067b6-5108-4934-bfbf-09a53ca12e9d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:49.112755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-339067b6-5108-4934-bfbf-09a53ca12e9d admin admin] The token cache is being invalidate because project a1f41b65b26941559288c78974af3c28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:49.113050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-339067b6-5108-4934-bfbf-09a53ca12e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:49.115980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-339067b6-5108-4934-bfbf-09a53ca12e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:49.122749 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2908/5876] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:39:48 2022] DELETE /identity/v3/projects/a1f41b65b26941559288c78974af3c28 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:49.125940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22728181-2052-476f-b606-143f499ba433 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:49.125940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22728181-2052-476f-b606-143f499ba433 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:49.125940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22728181-2052-476f-b606-143f499ba433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:49.158551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-22728181-2052-476f-b606-143f499ba433 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:49.160424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-22728181-2052-476f-b606-143f499ba433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:49.353073 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2969/5877] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:49.354798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11191c5c-bb97-430a-876c-1f0398daf723 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:49.355094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11191c5c-bb97-430a-876c-1f0398daf723 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:49.355379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11191c5c-bb97-430a-876c-1f0398daf723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:49.462746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-11191c5c-bb97-430a-876c-1f0398daf723 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:49.466635 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-11191c5c-bb97-430a-876c-1f0398daf723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:49.473028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22728181-2052-476f-b606-143f499ba433 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:49.474762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-22728181-2052-476f-b606-143f499ba433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:49.498307 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2909/5878] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:49.499474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11191c5c-bb97-430a-876c-1f0398daf723 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:49.510051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22728181-2052-476f-b606-143f499ba433 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:49.550757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc9836-4674-40bd-b986-56642c40a3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:49.555816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11191c5c-bb97-430a-876c-1f0398daf723 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:49.558437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc9836-4674-40bd-b986-56642c40a3e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:49.558727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc9836-4674-40bd-b986-56642c40a3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:49.559011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cc9836-4674-40bd-b986-56642c40a3e2 admin admin] PATH_INFO: `/v3/projects/35168c8484b84965b9450cdf2af3d72f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:49.568439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc9836-4674-40bd-b986-56642c40a3e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35168c8484b84965b9450cdf2af3d72f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:49.576400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cc9836-4674-40bd-b986-56642c40a3e2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:49.584999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6370e-383a-49f6-94af-259251870079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:49.586140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6370e-383a-49f6-94af-259251870079 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:49.586685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6370e-383a-49f6-94af-259251870079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:49.587192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6370e-383a-49f6-94af-259251870079 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:49.588153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6370e-383a-49f6-94af-259251870079 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:39:49.589489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6370e-383a-49f6-94af-259251870079 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:49.595335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6370e-383a-49f6-94af-259251870079 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:49.655158 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2910/5879] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:39:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:49.655158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6370e-383a-49f6-94af-259251870079 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:49.679513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6370e-383a-49f6-94af-259251870079 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:49.691023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ed65b-66bd-4d86-b273-6eb697ce0cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:49.691818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ed65b-66bd-4d86-b273-6eb697ce0cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:49.692217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ed65b-66bd-4d86-b273-6eb697ce0cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:49.692816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ed65b-66bd-4d86-b273-6eb697ce0cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:49.693673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ed65b-66bd-4d86-b273-6eb697ce0cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:49.709564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ed65b-66bd-4d86-b273-6eb697ce0cf5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:49.799033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-06cc9836-4674-40bd-b986-56642c40a3e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35168c8484b84965b9450cdf2af3d72f', 'request_id': 'req-06cc9836-4674-40bd-b986-56642c40a3e2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:49.805275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-06cc9836-4674-40bd-b986-56642c40a3e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35168c8484b84965b9450cdf2af3d72f', 'request_id': 'req-06cc9836-4674-40bd-b986-56642c40a3e2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:49.815068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-06cc9836-4674-40bd-b986-56642c40a3e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35168c8484b84965b9450cdf2af3d72f', 'request_id': 'req-06cc9836-4674-40bd-b986-56642c40a3e2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:49.887760 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2911/5880] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:39:49 2022] POST /identity/v3/projects => generated 375 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:49.889123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ed65b-66bd-4d86-b273-6eb697ce0cf5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:49.927561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-06cc9836-4674-40bd-b986-56642c40a3e2 admin admin] The token cache is being invalidate because project 35168c8484b84965b9450cdf2af3d72f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:49.928007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-06cc9836-4674-40bd-b986-56642c40a3e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:49.929003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-06cc9836-4674-40bd-b986-56642c40a3e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:49.931269 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2970/5881] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:39:49 2022] DELETE /identity/v3/projects/35168c8484b84965b9450cdf2af3d72f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:49.935339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc9836-4674-40bd-b986-56642c40a3e2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:49.936943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-06cc9836-4674-40bd-b986-56642c40a3e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:50.012414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ed65b-66bd-4d86-b273-6eb697ce0cf5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:50.017828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d38e28-2dad-42d2-8708-438117cb5384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:50.019477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d38e28-2dad-42d2-8708-438117cb5384 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:50.020064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d38e28-2dad-42d2-8708-438117cb5384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:50.020589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d38e28-2dad-42d2-8708-438117cb5384 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:50.021448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d38e28-2dad-42d2-8708-438117cb5384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:50.023941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d38e28-2dad-42d2-8708-438117cb5384 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:50.033622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cc9836-4674-40bd-b986-56642c40a3e2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:50.040428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc1a2d-ab26-4573-b482-a6860e652483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:50.041714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc1a2d-ab26-4573-b482-a6860e652483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:50.042013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc1a2d-ab26-4573-b482-a6860e652483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:50.042367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc1a2d-ab26-4573-b482-a6860e652483 admin admin] PATH_INFO: `/v3/users/0a2153f63af449be828633fc3283f83f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:50.044240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc1a2d-ab26-4573-b482-a6860e652483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a2153f63af449be828633fc3283f83f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:50.049826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc1a2d-ab26-4573-b482-a6860e652483 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:50.061004 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:50.174249 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2912/5882] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:39:49 2022] POST /identity/v3/users => generated 288 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:50.178839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d38e28-2dad-42d2-8708-438117cb5384 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:50.181738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-65d38e28-2dad-42d2-8708-438117cb5384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:50.211860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d38e28-2dad-42d2-8708-438117cb5384 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:50.227013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345be3-ae99-41d6-ab0f-7841f4fd74f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:50.227803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345be3-ae99-41d6-ab0f-7841f4fd74f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:50.228181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345be3-ae99-41d6-ab0f-7841f4fd74f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:50.228530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8345be3-ae99-41d6-ab0f-7841f4fd74f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:50.229435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8345be3-ae99-41d6-ab0f-7841f4fd74f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:50.231335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8345be3-ae99-41d6-ab0f-7841f4fd74f7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:50.246151 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2913/5883] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:50.251050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345be3-ae99-41d6-ab0f-7841f4fd74f7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:50.278919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8345be3-ae99-41d6-ab0f-7841f4fd74f7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:50.291795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c5bc1a2d-ab26-4573-b482-a6860e652483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a2153f63af449be828633fc3283f83f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:50.296174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaa687-270c-43b0-a6ea-4c423a5f5a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:50.298883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaa687-270c-43b0-a6ea-4c423a5f5a88 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:50.299181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaa687-270c-43b0-a6ea-4c423a5f5a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:50.299467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaa687-270c-43b0-a6ea-4c423a5f5a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:50.302892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afaa687-270c-43b0-a6ea-4c423a5f5a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:50.306821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afaa687-270c-43b0-a6ea-4c423a5f5a88 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:50.323798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c5bc1a2d-ab26-4573-b482-a6860e652483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a2153f63af449be828633fc3283f83f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:50.330289 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2914/5884] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:50.332000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaa687-270c-43b0-a6ea-4c423a5f5a88 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:50.352883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c5bc1a2d-ab26-4573-b482-a6860e652483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a2153f63af449be828633fc3283f83f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:50.352883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c5bc1a2d-ab26-4573-b482-a6860e652483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a2153f63af449be828633fc3283f83f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:50.353403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaa687-270c-43b0-a6ea-4c423a5f5a88 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:50.358471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b8a17-79a1-44c7-8803-1a6e7f3f62af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:50.359148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b8a17-79a1-44c7-8803-1a6e7f3f62af admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:50.359440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b8a17-79a1-44c7-8803-1a6e7f3f62af admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:50.359720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16b8a17-79a1-44c7-8803-1a6e7f3f62af admin admin] PATH_INFO: `/v3/projects/6d722630cf08410dbe70e0b4df123c00/users/c8272c654f6e4db8b7c4283367f7d3b4/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:50.377628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b8a17-79a1-44c7-8803-1a6e7f3f62af admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d722630cf08410dbe70e0b4df123c00, user_id=c8272c654f6e4db8b7c4283367f7d3b4, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:50.382520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16b8a17-79a1-44c7-8803-1a6e7f3f62af admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:50.458407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c5bc1a2d-ab26-4573-b482-a6860e652483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a2153f63af449be828633fc3283f83f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:50.470609 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2971/5885] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:39:49 2022] DELETE /identity/v3/users/0a2153f63af449be828633fc3283f83f => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:50.497442 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2915/5886] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:39:50 2022] PUT /identity/v3/projects/6d722630cf08410dbe70e0b4df123c00/users/c8272c654f6e4db8b7c4283367f7d3b4/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:50.508647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971f64a-b30b-4dc3-b092-5e248c8b421d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:50.509019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971f64a-b30b-4dc3-b092-5e248c8b421d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:50.509399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6971f64a-b30b-4dc3-b092-5e248c8b421d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:50.554371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6971f64a-b30b-4dc3-b092-5e248c8b421d None None] MFA Rules not processed for user `c8272c654f6e4db8b7c4283367f7d3b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:50.554371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6971f64a-b30b-4dc3-b092-5e248c8b421d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:50.688323 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2972/5887] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:50.697909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b8a17-79a1-44c7-8803-1a6e7f3f62af admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:50.701070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d16b8a17-79a1-44c7-8803-1a6e7f3f62af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:50.727764 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:50.839696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16b8a17-79a1-44c7-8803-1a6e7f3f62af admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:50.857113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca4602-b590-4e6e-90d0-6433fe8d8602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:50.858978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca4602-b590-4e6e-90d0-6433fe8d8602 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:50.859272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca4602-b590-4e6e-90d0-6433fe8d8602 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:50.863997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ca4602-b590-4e6e-90d0-6433fe8d8602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:50.911652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca4602-b590-4e6e-90d0-6433fe8d8602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:50.913138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ca4602-b590-4e6e-90d0-6433fe8d8602 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:50.949771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62708cc5-67eb-402f-9f1c-01b1b8e408fc None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:50.950068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62708cc5-67eb-402f-9f1c-01b1b8e408fc None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:50.956224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62708cc5-67eb-402f-9f1c-01b1b8e408fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:50.986450 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2916/5888] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:39:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:39:51.009959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-62708cc5-67eb-402f-9f1c-01b1b8e408fc None None] MFA Rules not processed for user `8d6a446bad394101915eead3b141d077`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:51.011450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-62708cc5-67eb-402f-9f1c-01b1b8e408fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:51.108678 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2973/5889] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:51.475884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca4602-b590-4e6e-90d0-6433fe8d8602 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:51.479037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b2ca4602-b590-4e6e-90d0-6433fe8d8602 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:51.650464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ca4602-b590-4e6e-90d0-6433fe8d8602 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:51.658478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b79f09-793b-414d-bccb-0a1a23b534a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:51.659721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b79f09-793b-414d-bccb-0a1a23b534a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:51.659961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b79f09-793b-414d-bccb-0a1a23b534a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:51.660341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b79f09-793b-414d-bccb-0a1a23b534a9 admin admin] PATH_INFO: `/v3/projects/d8f9373c97864db199b761c6f9271c41` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:51.661582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b79f09-793b-414d-bccb-0a1a23b534a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8f9373c97864db199b761c6f9271c41)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:51.663582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b79f09-793b-414d-bccb-0a1a23b534a9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:51.840742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37b79f09-793b-414d-bccb-0a1a23b534a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8f9373c97864db199b761c6f9271c41', 'request_id': 'req-37b79f09-793b-414d-bccb-0a1a23b534a9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:51.909517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37b79f09-793b-414d-bccb-0a1a23b534a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8f9373c97864db199b761c6f9271c41', 'request_id': 'req-37b79f09-793b-414d-bccb-0a1a23b534a9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:51.916555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37b79f09-793b-414d-bccb-0a1a23b534a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8f9373c97864db199b761c6f9271c41', 'request_id': 'req-37b79f09-793b-414d-bccb-0a1a23b534a9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:51.930979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37b79f09-793b-414d-bccb-0a1a23b534a9 admin admin] The token cache is being invalidate because project d8f9373c97864db199b761c6f9271c41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:51.931652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37b79f09-793b-414d-bccb-0a1a23b534a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:51.932520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37b79f09-793b-414d-bccb-0a1a23b534a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:51.938364 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2917/5890] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:39:51 2022] DELETE /identity/v3/projects/d8f9373c97864db199b761c6f9271c41 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:51.939752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae662cce-75e1-467f-af05-3b527e22c406 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:51.940190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae662cce-75e1-467f-af05-3b527e22c406 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:51.941217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae662cce-75e1-467f-af05-3b527e22c406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:51.978034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ae662cce-75e1-467f-af05-3b527e22c406 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:51.979459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ae662cce-75e1-467f-af05-3b527e22c406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:52.155595 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2974/5891] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:39:52.171494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39cd1b-0b39-4c6e-a15f-7791392b9465 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:52.171494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39cd1b-0b39-4c6e-a15f-7791392b9465 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:52.171494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39cd1b-0b39-4c6e-a15f-7791392b9465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:52.218220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-cd39cd1b-0b39-4c6e-a15f-7791392b9465 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:52.227709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cd39cd1b-0b39-4c6e-a15f-7791392b9465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:52.250613 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2918/5892] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:52.252684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae662cce-75e1-467f-af05-3b527e22c406 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:52.277795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae662cce-75e1-467f-af05-3b527e22c406 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:52.289914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39cd1b-0b39-4c6e-a15f-7791392b9465 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:52.290608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8c219-bd96-4b2d-9a9d-eb8bcac48c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:52.291518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8c219-bd96-4b2d-9a9d-eb8bcac48c05 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:52.291636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cd39cd1b-0b39-4c6e-a15f-7791392b9465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:52.292103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8c219-bd96-4b2d-9a9d-eb8bcac48c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:52.292561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f8c219-bd96-4b2d-9a9d-eb8bcac48c05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:52.294004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8c219-bd96-4b2d-9a9d-eb8bcac48c05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:39:52.294517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8c219-bd96-4b2d-9a9d-eb8bcac48c05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:52.300428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f8c219-bd96-4b2d-9a9d-eb8bcac48c05 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:52.322078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39cd1b-0b39-4c6e-a15f-7791392b9465 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:52.333780 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2975/5893] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:52.338137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de437149-0fec-4911-b327-215aa7f7a926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:52.338758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8c219-bd96-4b2d-9a9d-eb8bcac48c05 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:52.340118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de437149-0fec-4911-b327-215aa7f7a926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:52.340583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de437149-0fec-4911-b327-215aa7f7a926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:52.341090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de437149-0fec-4911-b327-215aa7f7a926 admin admin] PATH_INFO: `/v3/users/c8272c654f6e4db8b7c4283367f7d3b4` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:52.346414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de437149-0fec-4911-b327-215aa7f7a926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8272c654f6e4db8b7c4283367f7d3b4)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:52.349686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de437149-0fec-4911-b327-215aa7f7a926 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:52.356019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f8c219-bd96-4b2d-9a9d-eb8bcac48c05 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:52.368394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85073654-4963-4402-8069-9d919e17285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:52.371610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85073654-4963-4402-8069-9d919e17285e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:52.371610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85073654-4963-4402-8069-9d919e17285e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:52.371610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85073654-4963-4402-8069-9d919e17285e admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:52.371610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85073654-4963-4402-8069-9d919e17285e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:52.373912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85073654-4963-4402-8069-9d919e17285e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:52.509354 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2976/5894] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:39:52 2022] POST /identity/v3/projects => generated 371 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:39:52.515209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85073654-4963-4402-8069-9d919e17285e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:52.619661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85073654-4963-4402-8069-9d919e17285e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:52.626078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986acce-2ecc-402f-9ecb-41277cd131b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:52.626935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986acce-2ecc-402f-9ecb-41277cd131b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:52.627626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986acce-2ecc-402f-9ecb-41277cd131b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:52.628075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986acce-2ecc-402f-9ecb-41277cd131b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:52.629382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986acce-2ecc-402f-9ecb-41277cd131b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:52.631883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986acce-2ecc-402f-9ecb-41277cd131b8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:52.680176 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:52.745243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-de437149-0fec-4911-b327-215aa7f7a926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8272c654f6e4db8b7c4283367f7d3b4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:52.755485 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2977/5895] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:39:52 2022] POST /identity/v3/users => generated 286 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:52.759594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986acce-2ecc-402f-9ecb-41277cd131b8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:52.780828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986acce-2ecc-402f-9ecb-41277cd131b8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:52.794724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44eb0d6-7de4-4cf9-8634-4119ff21db2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:52.797485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eb0d6-7de4-4cf9-8634-4119ff21db2e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:52.797895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eb0d6-7de4-4cf9-8634-4119ff21db2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:52.803188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44eb0d6-7de4-4cf9-8634-4119ff21db2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:52.804317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44eb0d6-7de4-4cf9-8634-4119ff21db2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:52.807251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44eb0d6-7de4-4cf9-8634-4119ff21db2e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:52.824833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-de437149-0fec-4911-b327-215aa7f7a926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8272c654f6e4db8b7c4283367f7d3b4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:52.827999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-de437149-0fec-4911-b327-215aa7f7a926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8272c654f6e4db8b7c4283367f7d3b4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:52.832789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-de437149-0fec-4911-b327-215aa7f7a926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8272c654f6e4db8b7c4283367f7d3b4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:52.837080 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2978/5896] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:39:52.839353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44eb0d6-7de4-4cf9-8634-4119ff21db2e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:52.845159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d44eb0d6-7de4-4cf9-8634-4119ff21db2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:52.881050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44eb0d6-7de4-4cf9-8634-4119ff21db2e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:52.886163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-de437149-0fec-4911-b327-215aa7f7a926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8272c654f6e4db8b7c4283367f7d3b4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:52.906287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4431e1-76b1-439c-a26f-1ba902ae9d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:52.909725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4431e1-76b1-439c-a26f-1ba902ae9d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:52.913366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4431e1-76b1-439c-a26f-1ba902ae9d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:52.916379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4431e1-76b1-439c-a26f-1ba902ae9d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:52.916379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4431e1-76b1-439c-a26f-1ba902ae9d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:52.921584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4431e1-76b1-439c-a26f-1ba902ae9d7d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:52.950341 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2979/5897] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:52.952378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4431e1-76b1-439c-a26f-1ba902ae9d7d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:52.960997 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:52.976722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4431e1-76b1-439c-a26f-1ba902ae9d7d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:52.992823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da6d33-243e-4a63-866e-9cb9ef93283e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:52.994502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da6d33-243e-4a63-866e-9cb9ef93283e admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:52.994817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da6d33-243e-4a63-866e-9cb9ef93283e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:52.995157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da6d33-243e-4a63-866e-9cb9ef93283e admin admin] PATH_INFO: `/v3/projects/90245facf464421fb58224c06596b809/users/b392dfca826d4919811fcebf56061878/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:52.998458 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2919/5898] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:39:52 2022] DELETE /identity/v3/users/c8272c654f6e4db8b7c4283367f7d3b4 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:39:53.003527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78ad76-a923-4144-ab36-6f05cc5df85f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:53.003808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78ad76-a923-4144-ab36-6f05cc5df85f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:53.004547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78ad76-a923-4144-ab36-6f05cc5df85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:53.031150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da6d33-243e-4a63-866e-9cb9ef93283e admin admin] RBAC: Authorizing `identity:create_grant(project_id=90245facf464421fb58224c06596b809, user_id=b392dfca826d4919811fcebf56061878, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:53.038738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da6d33-243e-4a63-866e-9cb9ef93283e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:53.071651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3d78ad76-a923-4144-ab36-6f05cc5df85f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:53.077038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3d78ad76-a923-4144-ab36-6f05cc5df85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:53.137856 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2980/5899] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:39:52 2022] PUT /identity/v3/projects/90245facf464421fb58224c06596b809/users/b392dfca826d4919811fcebf56061878/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:53.158235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93914cc-4022-42fd-8beb-c79f5d9234c2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:53.167326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93914cc-4022-42fd-8beb-c79f5d9234c2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:53.167771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93914cc-4022-42fd-8beb-c79f5d9234c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:53.202133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a93914cc-4022-42fd-8beb-c79f5d9234c2 None None] MFA Rules not processed for user `b392dfca826d4919811fcebf56061878`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:53.203761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a93914cc-4022-42fd-8beb-c79f5d9234c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:53.278340 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2920/5900] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:39:53.289284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78ad76-a923-4144-ab36-6f05cc5df85f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:53.291148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3d78ad76-a923-4144-ab36-6f05cc5df85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:53.462087 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2981/5901] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:53.463027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93914cc-4022-42fd-8beb-c79f5d9234c2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:53.473793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78ad76-a923-4144-ab36-6f05cc5df85f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:53.613381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363279dd-5849-4428-9ac1-f19179e7691e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:53.614367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363279dd-5849-4428-9ac1-f19179e7691e service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:53.614803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363279dd-5849-4428-9ac1-f19179e7691e service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:53.615265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363279dd-5849-4428-9ac1-f19179e7691e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:53.623210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93914cc-4022-42fd-8beb-c79f5d9234c2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:53.635950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd7788-8d85-43dc-b62a-e91da3caf13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:53.636641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd7788-8d85-43dc-b62a-e91da3caf13e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:53.636926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd7788-8d85-43dc-b62a-e91da3caf13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:53.637302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd7788-8d85-43dc-b62a-e91da3caf13e admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:53.637563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363279dd-5849-4428-9ac1-f19179e7691e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:53.637916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd7788-8d85-43dc-b62a-e91da3caf13e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:53.639366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363279dd-5849-4428-9ac1-f19179e7691e service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:53.639865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd7788-8d85-43dc-b62a-e91da3caf13e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:53.646820 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:53.666671 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2921/5902] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:39:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:39:53.773849 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2982/5903] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:39:53 2022] POST /identity/v3/projects => generated 373 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:53.777874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363279dd-5849-4428-9ac1-f19179e7691e service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:53.789077 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:53.795577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363279dd-5849-4428-9ac1-f19179e7691e service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:53.938644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27450864-5c5c-43bb-96f5-9d29d9d45ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:53.939425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27450864-5c5c-43bb-96f5-9d29d9d45ffc admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:53.941480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27450864-5c5c-43bb-96f5-9d29d9d45ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:53.941962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27450864-5c5c-43bb-96f5-9d29d9d45ffc admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:53.943680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27450864-5c5c-43bb-96f5-9d29d9d45ffc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:53.947181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27450864-5c5c-43bb-96f5-9d29d9d45ffc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:54.081437 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2922/5904] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:39:53 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:54.084812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd7788-8d85-43dc-b62a-e91da3caf13e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:54.104974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd7788-8d85-43dc-b62a-e91da3caf13e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:54.124060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae88cd8-bdca-469e-977d-db0a6f974502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:54.124761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae88cd8-bdca-469e-977d-db0a6f974502 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:54.125046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae88cd8-bdca-469e-977d-db0a6f974502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:54.125320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae88cd8-bdca-469e-977d-db0a6f974502 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:54.126428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae88cd8-bdca-469e-977d-db0a6f974502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:54.129915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae88cd8-bdca-469e-977d-db0a6f974502 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:54.168322 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2983/5905] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:54.173131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27450864-5c5c-43bb-96f5-9d29d9d45ffc admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:54.203905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27450864-5c5c-43bb-96f5-9d29d9d45ffc admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:54.217633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fb7bb-b3b0-4e7a-8539-ca4ed2782da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:54.218929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fb7bb-b3b0-4e7a-8539-ca4ed2782da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:54.219359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fb7bb-b3b0-4e7a-8539-ca4ed2782da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:54.219798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251fb7bb-b3b0-4e7a-8539-ca4ed2782da7 admin admin] PATH_INFO: `/v3/projects/2e46b7681a284aeca828f174ed8c4766/users/d7de3788ab374648ba9c933aac807bbe/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:54.268114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fb7bb-b3b0-4e7a-8539-ca4ed2782da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e46b7681a284aeca828f174ed8c4766, user_id=d7de3788ab374648ba9c933aac807bbe, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:54.271767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251fb7bb-b3b0-4e7a-8539-ca4ed2782da7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:54.355926 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2923/5906] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:39:54 2022] PUT /identity/v3/projects/2e46b7681a284aeca828f174ed8c4766/users/d7de3788ab374648ba9c933aac807bbe/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:39:54.360002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae88cd8-bdca-469e-977d-db0a6f974502 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:54.381710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae88cd8-bdca-469e-977d-db0a6f974502 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:54.557343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fb7bb-b3b0-4e7a-8539-ca4ed2782da7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:54.561519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-251fb7bb-b3b0-4e7a-8539-ca4ed2782da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:54.594733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fb901-cd09-4805-8683-6397622c1492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:54.594733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fb901-cd09-4805-8683-6397622c1492 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:54.594733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fb901-cd09-4805-8683-6397622c1492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:54.595426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25fb901-cd09-4805-8683-6397622c1492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:54.596421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fb901-cd09-4805-8683-6397622c1492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:54.599763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25fb901-cd09-4805-8683-6397622c1492 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:54.620479 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2984/5907] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:54 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:54.622529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fb901-cd09-4805-8683-6397622c1492 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:54.639323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25fb901-cd09-4805-8683-6397622c1492 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:54.647887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94154ee3-3564-4876-a9d3-6141b915965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:54.664126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94154ee3-3564-4876-a9d3-6141b915965a admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:54.664126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94154ee3-3564-4876-a9d3-6141b915965a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:54.664126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94154ee3-3564-4876-a9d3-6141b915965a admin admin] PATH_INFO: `/v3/projects/2e46b7681a284aeca828f174ed8c4766/users/d7de3788ab374648ba9c933aac807bbe/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:54.664126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94154ee3-3564-4876-a9d3-6141b915965a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e46b7681a284aeca828f174ed8c4766, user_id=d7de3788ab374648ba9c933aac807bbe, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:54.664126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94154ee3-3564-4876-a9d3-6141b915965a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:54.691173 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2985/5908] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:39:54 2022] PUT /identity/v3/projects/2e46b7681a284aeca828f174ed8c4766/users/d7de3788ab374648ba9c933aac807bbe/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:54.692874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef454b3-636f-4998-9459-4b116e58ef74 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:54.693268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef454b3-636f-4998-9459-4b116e58ef74 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:54.693563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef454b3-636f-4998-9459-4b116e58ef74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:54.704619 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:54.736763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251fb7bb-b3b0-4e7a-8539-ca4ed2782da7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:54.759674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-cef454b3-636f-4998-9459-4b116e58ef74 None None] MFA Rules not processed for user `d7de3788ab374648ba9c933aac807bbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:54.775725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cef454b3-636f-4998-9459-4b116e58ef74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:54.869384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50be9f5-4058-4560-9f98-1b05a24d1d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:54.870403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50be9f5-4058-4560-9f98-1b05a24d1d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:54.870752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50be9f5-4058-4560-9f98-1b05a24d1d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:54.871094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50be9f5-4058-4560-9f98-1b05a24d1d21 admin admin] PATH_INFO: `/v3/projects/6d722630cf08410dbe70e0b4df123c00` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:54.872503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50be9f5-4058-4560-9f98-1b05a24d1d21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d722630cf08410dbe70e0b4df123c00)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:54.892248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50be9f5-4058-4560-9f98-1b05a24d1d21 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:54.937958 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:54.965267 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2986/5909] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:54 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:54.969592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef454b3-636f-4998-9459-4b116e58ef74 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:54.980716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef454b3-636f-4998-9459-4b116e58ef74 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:54.993008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3619ada-282b-4557-a2b0-257655645e26 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:54.997470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3619ada-282b-4557-a2b0-257655645e26 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:54.997757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3619ada-282b-4557-a2b0-257655645e26 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:54.998070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3619ada-282b-4557-a2b0-257655645e26 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:54.999825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3619ada-282b-4557-a2b0-257655645e26 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:55.000468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3619ada-282b-4557-a2b0-257655645e26 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:55.019613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a50be9f5-4058-4560-9f98-1b05a24d1d21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d722630cf08410dbe70e0b4df123c00', 'request_id': 'req-a50be9f5-4058-4560-9f98-1b05a24d1d21'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:55.138742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a50be9f5-4058-4560-9f98-1b05a24d1d21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d722630cf08410dbe70e0b4df123c00', 'request_id': 'req-a50be9f5-4058-4560-9f98-1b05a24d1d21'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:55.173609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a50be9f5-4058-4560-9f98-1b05a24d1d21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d722630cf08410dbe70e0b4df123c00', 'request_id': 'req-a50be9f5-4058-4560-9f98-1b05a24d1d21'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:55.177368 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2987/5910] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:39:54 2022] POST /identity/v3/domains => generated 276 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:55.182900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3619ada-282b-4557-a2b0-257655645e26 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:55.236621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a50be9f5-4058-4560-9f98-1b05a24d1d21 admin admin] The token cache is being invalidate because project 6d722630cf08410dbe70e0b4df123c00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:55.239746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a50be9f5-4058-4560-9f98-1b05a24d1d21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:55.241067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a50be9f5-4058-4560-9f98-1b05a24d1d21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:55.260818 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2924/5911] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:39:54 2022] DELETE /identity/v3/projects/6d722630cf08410dbe70e0b4df123c00 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:55.266244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a766201-896d-4ed3-9e2a-c0298f18d781 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:55.272453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a766201-896d-4ed3-9e2a-c0298f18d781 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:55.272453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a766201-896d-4ed3-9e2a-c0298f18d781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:55.309228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1a766201-896d-4ed3-9e2a-c0298f18d781 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:55.312527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1a766201-896d-4ed3-9e2a-c0298f18d781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:55.413670 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2925/5912] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:39:55.415572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd108a-b2f2-4861-8eb1-dececbd05069 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:55.415968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd108a-b2f2-4861-8eb1-dececbd05069 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:55.416609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd108a-b2f2-4861-8eb1-dececbd05069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:55.441023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-befd108a-b2f2-4861-8eb1-dececbd05069 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:55.442008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3619ada-282b-4557-a2b0-257655645e26 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:55.450632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-befd108a-b2f2-4861-8eb1-dececbd05069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:55.451344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d90218-394d-4709-9eeb-7b25ca2b0e38 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:55.451344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d90218-394d-4709-9eeb-7b25ca2b0e38 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:55.451344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d90218-394d-4709-9eeb-7b25ca2b0e38 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:55.451575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d90218-394d-4709-9eeb-7b25ca2b0e38 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:55.452617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d90218-394d-4709-9eeb-7b25ca2b0e38 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:55.454771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d90218-394d-4709-9eeb-7b25ca2b0e38 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:55.470561 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2926/5913] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:39:55.479780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd108a-b2f2-4861-8eb1-dececbd05069 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:55.492192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd108a-b2f2-4861-8eb1-dececbd05069 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:55.497859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ca1af-e2b6-4c47-90f6-b6951ac585c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:55.499673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ca1af-e2b6-4c47-90f6-b6951ac585c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:55.500114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ca1af-e2b6-4c47-90f6-b6951ac585c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:55.500538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ca1af-e2b6-4c47-90f6-b6951ac585c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:55.501427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ca1af-e2b6-4c47-90f6-b6951ac585c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:39:55.507884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ca1af-e2b6-4c47-90f6-b6951ac585c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:55.507884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ca1af-e2b6-4c47-90f6-b6951ac585c3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:55.520206 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2927/5914] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:55.524885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ca1af-e2b6-4c47-90f6-b6951ac585c3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:55.546770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ca1af-e2b6-4c47-90f6-b6951ac585c3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:55.554063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b39752-17f6-4820-bfbe-878bb1928034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:55.555187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b39752-17f6-4820-bfbe-878bb1928034 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:55.555670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b39752-17f6-4820-bfbe-878bb1928034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:55.556217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b39752-17f6-4820-bfbe-878bb1928034 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:55.557166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b39752-17f6-4820-bfbe-878bb1928034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:55.559436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b39752-17f6-4820-bfbe-878bb1928034 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:55.595221 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2988/5915] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:39:55 2022] POST /identity/v3/projects => generated 402 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:55.598032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d90218-394d-4709-9eeb-7b25ca2b0e38 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:55.601332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-38d90218-394d-4709-9eeb-7b25ca2b0e38 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:55.673222 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:55.687015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d90218-394d-4709-9eeb-7b25ca2b0e38 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:55.695333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ceed7f-091a-45bf-b954-77c085dc3fc7 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:55.696037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ceed7f-091a-45bf-b954-77c085dc3fc7 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:55.696547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ceed7f-091a-45bf-b954-77c085dc3fc7 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:55.696845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ceed7f-091a-45bf-b954-77c085dc3fc7 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/groups` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:55.698887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ceed7f-091a-45bf-b954-77c085dc3fc7 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:55.703982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ceed7f-091a-45bf-b954-77c085dc3fc7 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:55.712902 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2928/5916] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:39:55 2022] POST /identity/v3/projects => generated 403 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:55.717544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b39752-17f6-4820-bfbe-878bb1928034 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:55.760035 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:55.814273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b39752-17f6-4820-bfbe-878bb1928034 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:55.820798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1fe0d-ce15-46b3-8e25-3f2067c8598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:55.822017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1fe0d-ce15-46b3-8e25-3f2067c8598f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:55.823771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1fe0d-ce15-46b3-8e25-3f2067c8598f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:55.824309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1fe0d-ce15-46b3-8e25-3f2067c8598f admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:55.825273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1fe0d-ce15-46b3-8e25-3f2067c8598f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:55.828480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a1fe0d-ce15-46b3-8e25-3f2067c8598f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:55.850237 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2989/5917] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jul 19 14:39:55 2022] POST /identity/v3/groups => generated 302 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:55.854911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ceed7f-091a-45bf-b954-77c085dc3fc7 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:55.892692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ceed7f-091a-45bf-b954-77c085dc3fc7 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:55.980629 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2929/5918] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:39:55 2022] POST /identity/v3/users => generated 302 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:55.982167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1fe0d-ce15-46b3-8e25-3f2067c8598f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:55.985292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1a5f8-384b-461b-9276-74afeb18c6bc tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:55.986142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1a5f8-384b-461b-9276-74afeb18c6bc tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:55.986607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1a5f8-384b-461b-9276-74afeb18c6bc tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:55.987020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1a5f8-384b-461b-9276-74afeb18c6bc tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:55.988238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1a5f8-384b-461b-9276-74afeb18c6bc tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:55.990809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1a5f8-384b-461b-9276-74afeb18c6bc tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:56.011019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1fe0d-ce15-46b3-8e25-3f2067c8598f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:56.019181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190005bb-9e83-4e38-b058-5355fe4d3ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:56.020410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190005bb-9e83-4e38-b058-5355fe4d3ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:56.024357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190005bb-9e83-4e38-b058-5355fe4d3ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:56.024357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190005bb-9e83-4e38-b058-5355fe4d3ef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:56.024357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190005bb-9e83-4e38-b058-5355fe4d3ef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:56.024911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190005bb-9e83-4e38-b058-5355fe4d3ef2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:56.045709 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2930/5919] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:55 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:56.050073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190005bb-9e83-4e38-b058-5355fe4d3ef2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:56.063558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190005bb-9e83-4e38-b058-5355fe4d3ef2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:56.082604 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2990/5920] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:39:55 2022] POST /identity/v3/users => generated 445 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:56.087312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1a5f8-384b-461b-9276-74afeb18c6bc tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:56.088802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe0764-04ee-4d2c-810d-3364a33980ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:56.090146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe0764-04ee-4d2c-810d-3364a33980ec admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:56.091727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe0764-04ee-4d2c-810d-3364a33980ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:56.093923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebe0764-04ee-4d2c-810d-3364a33980ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:56.095168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe0764-04ee-4d2c-810d-3364a33980ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:56.100079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebe0764-04ee-4d2c-810d-3364a33980ec admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:56.112262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1a5f8-384b-461b-9276-74afeb18c6bc tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:56.124082 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2931/5921] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:39:56.130684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d79a13-614b-4bb1-94fe-58b756f63a3b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:56.131477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d79a13-614b-4bb1-94fe-58b756f63a3b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:56.132050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe0764-04ee-4d2c-810d-3364a33980ec admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:56.132385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d79a13-614b-4bb1-94fe-58b756f63a3b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:56.132744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d79a13-614b-4bb1-94fe-58b756f63a3b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:56.134355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d79a13-614b-4bb1-94fe-58b756f63a3b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:56.139908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d79a13-614b-4bb1-94fe-58b756f63a3b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:56.152345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebe0764-04ee-4d2c-810d-3364a33980ec admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:56.158274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e9632-79ec-4825-a5d2-6b6fcbb42ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:56.159817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e9632-79ec-4825-a5d2-6b6fcbb42ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:56.162448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e9632-79ec-4825-a5d2-6b6fcbb42ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:56.162448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e9632-79ec-4825-a5d2-6b6fcbb42ff8 admin admin] PATH_INFO: `/v3/projects/901775c14f244f5b92529500f8eb2a6d/users/2a93cb6e76d842089793093b456f0fb9/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:56.183177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e9632-79ec-4825-a5d2-6b6fcbb42ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=901775c14f244f5b92529500f8eb2a6d, user_id=2a93cb6e76d842089793093b456f0fb9, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:56.186120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e9632-79ec-4825-a5d2-6b6fcbb42ff8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:56.242191 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2991/5922] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:39:56 2022] POST /identity/v3/roles => generated 239 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:56.243914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d79a13-614b-4bb1-94fe-58b756f63a3b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:56.257987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d79a13-614b-4bb1-94fe-58b756f63a3b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:56.263577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f8dab-a320-4a70-a3dc-36927656bf0f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:56.265108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f8dab-a320-4a70-a3dc-36927656bf0f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:56.265396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f8dab-a320-4a70-a3dc-36927656bf0f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:56.265734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f8dab-a320-4a70-a3dc-36927656bf0f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/16a5d783f67b42b2a7a40f5d9246bac5/groups/438db4300c2f4f9d9ab53af1ab4982f5/roles/583634df521e487385a072685aded1ae/inherited_to_projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:56.276664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f8dab-a320-4a70-a3dc-36927656bf0f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:create_grant(project_id=16a5d783f67b42b2a7a40f5d9246bac5, group_id=438db4300c2f4f9d9ab53af1ab4982f5, role_id=583634df521e487385a072685aded1ae)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:56.276969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f8dab-a320-4a70-a3dc-36927656bf0f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:56.317138 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2932/5923] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:39:56 2022] PUT /identity/v3/projects/901775c14f244f5b92529500f8eb2a6d/users/2a93cb6e76d842089793093b456f0fb9/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:56.322364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302bf44-8dcc-4bcc-9753-e8d4c6f53300 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:56.322665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302bf44-8dcc-4bcc-9753-e8d4c6f53300 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:56.323097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302bf44-8dcc-4bcc-9753-e8d4c6f53300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:56.387786 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2992/5924] 10.222.0.43 () {60 vars in 1584 bytes} [Tue Jul 19 14:39:56 2022] PUT /identity/v3/OS-INHERIT/projects/16a5d783f67b42b2a7a40f5d9246bac5/groups/438db4300c2f4f9d9ab53af1ab4982f5/roles/583634df521e487385a072685aded1ae/inherited_to_projects => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:56.388505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0302bf44-8dcc-4bcc-9753-e8d4c6f53300 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:56.390109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0302bf44-8dcc-4bcc-9753-e8d4c6f53300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:56.392264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f8dab-a320-4a70-a3dc-36927656bf0f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:56.554418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f8dab-a320-4a70-a3dc-36927656bf0f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:56.562050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36e804-fc9d-4a4e-9f94-f7820f67ab29 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:56.563490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36e804-fc9d-4a4e-9f94-f7820f67ab29 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:56.563884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36e804-fc9d-4a4e-9f94-f7820f67ab29 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:56.564180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36e804-fc9d-4a4e-9f94-f7820f67ab29 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/16a5d783f67b42b2a7a40f5d9246bac5/groups/438db4300c2f4f9d9ab53af1ab4982f5/roles/583634df521e487385a072685aded1ae/inherited_to_projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:56.568062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36e804-fc9d-4a4e-9f94-f7820f67ab29 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:check_grant(project_id=16a5d783f67b42b2a7a40f5d9246bac5, group_id=438db4300c2f4f9d9ab53af1ab4982f5, role_id=583634df521e487385a072685aded1ae)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:56.572533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36e804-fc9d-4a4e-9f94-f7820f67ab29 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:56.586208 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2993/5925] 10.222.0.43 () {58 vars in 1566 bytes} [Tue Jul 19 14:39:56 2022] HEAD /identity/v3/OS-INHERIT/projects/16a5d783f67b42b2a7a40f5d9246bac5/groups/438db4300c2f4f9d9ab53af1ab4982f5/roles/583634df521e487385a072685aded1ae/inherited_to_projects => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:39:56.589258 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36e804-fc9d-4a4e-9f94-f7820f67ab29 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:56.596380 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2933/5926] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:39:56.608863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302bf44-8dcc-4bcc-9753-e8d4c6f53300 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:56.609283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0302bf44-8dcc-4bcc-9753-e8d4c6f53300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:56.617804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36e804-fc9d-4a4e-9f94-f7820f67ab29 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:56.633012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8950de-5401-4e07-a649-8f7185359022 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:56.633871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8950de-5401-4e07-a649-8f7185359022 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:56.640646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8950de-5401-4e07-a649-8f7185359022 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:56.640646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8950de-5401-4e07-a649-8f7185359022 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/16a5d783f67b42b2a7a40f5d9246bac5/groups/438db4300c2f4f9d9ab53af1ab4982f5/roles/583634df521e487385a072685aded1ae/inherited_to_projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:56.652945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8950de-5401-4e07-a649-8f7185359022 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=16a5d783f67b42b2a7a40f5d9246bac5, group_id=438db4300c2f4f9d9ab53af1ab4982f5, role_id=583634df521e487385a072685aded1ae)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:56.663817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8950de-5401-4e07-a649-8f7185359022 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:56.699042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7f8950de-5401-4e07-a649-8f7185359022 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invalidating the token cache because role 583634df521e487385a072685aded1ae was removed from group 438db4300c2f4f9d9ab53af1ab4982f5 on project 16a5d783f67b42b2a7a40f5d9246bac5. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:56.699774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7f8950de-5401-4e07-a649-8f7185359022 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:56.704245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7f8950de-5401-4e07-a649-8f7185359022 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:56.797107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302bf44-8dcc-4bcc-9753-e8d4c6f53300 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:56.806934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04127d40-23ee-4344-abf7-a556ddf4f4d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:56.807722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04127d40-23ee-4344-abf7-a556ddf4f4d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:56.808006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04127d40-23ee-4344-abf7-a556ddf4f4d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:56.808319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04127d40-23ee-4344-abf7-a556ddf4f4d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:56.812754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-04127d40-23ee-4344-abf7-a556ddf4f4d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:56.820454 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2994/5927] 10.222.0.43 () {58 vars in 1568 bytes} [Tue Jul 19 14:39:56 2022] DELETE /identity/v3/OS-INHERIT/projects/16a5d783f67b42b2a7a40f5d9246bac5/groups/438db4300c2f4f9d9ab53af1ab4982f5/roles/583634df521e487385a072685aded1ae/inherited_to_projects => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:39:56.824169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8950de-5401-4e07-a649-8f7185359022 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:56.827110 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7f8950de-5401-4e07-a649-8f7185359022 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:56.832068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04127d40-23ee-4344-abf7-a556ddf4f4d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:56.836390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04127d40-23ee-4344-abf7-a556ddf4f4d7 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:56.866943 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2934/5928] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:39:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:39:56.925947 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:57.019629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8950de-5401-4e07-a649-8f7185359022 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:57.025279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb22645-5aa1-4798-abad-76b4d8b5c33c tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:57.026900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb22645-5aa1-4798-abad-76b4d8b5c33c tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:57.027457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb22645-5aa1-4798-abad-76b4d8b5c33c tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:57.027968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb22645-5aa1-4798-abad-76b4d8b5c33c tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/roles/583634df521e487385a072685aded1ae` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:57.030010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb22645-5aa1-4798-abad-76b4d8b5c33c tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:delete_role(role_id=583634df521e487385a072685aded1ae)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:57.032022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb22645-5aa1-4798-abad-76b4d8b5c33c tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:57.237904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3cb22645-5aa1-4798-abad-76b4d8b5c33c tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invalidating the token cache because role 583634df521e487385a072685aded1ae has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:57.238610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3cb22645-5aa1-4798-abad-76b4d8b5c33c tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:57.242580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3cb22645-5aa1-4798-abad-76b4d8b5c33c tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:57.250323 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2995/5929] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:39:56 2022] DELETE /identity/v3/roles/583634df521e487385a072685aded1ae => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:57.251559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04127d40-23ee-4344-abf7-a556ddf4f4d7 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:57.268107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04127d40-23ee-4344-abf7-a556ddf4f4d7 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:57.281957 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:57.384371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9779484-7871-4c52-bc41-5762dde7406c tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:57.385100 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9779484-7871-4c52-bc41-5762dde7406c tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:57.385384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9779484-7871-4c52-bc41-5762dde7406c tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:57.385667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9779484-7871-4c52-bc41-5762dde7406c tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:57.386500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9779484-7871-4c52-bc41-5762dde7406c tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:57.388107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9779484-7871-4c52-bc41-5762dde7406c tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:57.489857 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2935/5930] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:39:57 2022] POST /identity/v3/roles => generated 240 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:39:57.494412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb22645-5aa1-4798-abad-76b4d8b5c33c tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:57.496322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3cb22645-5aa1-4798-abad-76b4d8b5c33c tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:57.557828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb22645-5aa1-4798-abad-76b4d8b5c33c tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:57.574052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b994383-b5c5-42ba-8203-57f3a58fb7fb tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:57.578935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b994383-b5c5-42ba-8203-57f3a58fb7fb tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:57.578935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b994383-b5c5-42ba-8203-57f3a58fb7fb tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:57.578935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b994383-b5c5-42ba-8203-57f3a58fb7fb tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/16a5d783f67b42b2a7a40f5d9246bac5/users/15b9c31a09ff4379b316f0de188b1952/roles/c599c85306cc48d5b68b2326f27ae155/inherited_to_projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:57.630361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b994383-b5c5-42ba-8203-57f3a58fb7fb tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:create_grant(project_id=16a5d783f67b42b2a7a40f5d9246bac5, user_id=15b9c31a09ff4379b316f0de188b1952, role_id=c599c85306cc48d5b68b2326f27ae155)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:57.641597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b994383-b5c5-42ba-8203-57f3a58fb7fb tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:57.779857 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2996/5931] 10.222.0.43 () {60 vars in 1581 bytes} [Tue Jul 19 14:39:57 2022] PUT /identity/v3/OS-INHERIT/projects/16a5d783f67b42b2a7a40f5d9246bac5/users/15b9c31a09ff4379b316f0de188b1952/roles/c599c85306cc48d5b68b2326f27ae155/inherited_to_projects => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:57.786826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9779484-7871-4c52-bc41-5762dde7406c tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:57.801757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9779484-7871-4c52-bc41-5762dde7406c tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:57.960000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0b26f-bfde-4da2-b8cb-5c113e2f78fc tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:57.960654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0b26f-bfde-4da2-b8cb-5c113e2f78fc tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:57.960881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0b26f-bfde-4da2-b8cb-5c113e2f78fc tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:57.961144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0b26f-bfde-4da2-b8cb-5c113e2f78fc tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/16a5d783f67b42b2a7a40f5d9246bac5/users/15b9c31a09ff4379b316f0de188b1952/roles/c599c85306cc48d5b68b2326f27ae155/inherited_to_projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:57.966238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0b26f-bfde-4da2-b8cb-5c113e2f78fc tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:check_grant(project_id=16a5d783f67b42b2a7a40f5d9246bac5, user_id=15b9c31a09ff4379b316f0de188b1952, role_id=c599c85306cc48d5b68b2326f27ae155)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:57.971404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0b26f-bfde-4da2-b8cb-5c113e2f78fc tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:58.002021 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2936/5932] 10.222.0.43 () {58 vars in 1563 bytes} [Tue Jul 19 14:39:57 2022] HEAD /identity/v3/OS-INHERIT/projects/16a5d783f67b42b2a7a40f5d9246bac5/users/15b9c31a09ff4379b316f0de188b1952/roles/c599c85306cc48d5b68b2326f27ae155/inherited_to_projects => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:58.003694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b994383-b5c5-42ba-8203-57f3a58fb7fb tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:58.028608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b994383-b5c5-42ba-8203-57f3a58fb7fb tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:58.043485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03f115-ead5-4d95-b968-b30f9c44833f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:58.046542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03f115-ead5-4d95-b968-b30f9c44833f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:58.046958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03f115-ead5-4d95-b968-b30f9c44833f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:58.048211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db03f115-ead5-4d95-b968-b30f9c44833f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/16a5d783f67b42b2a7a40f5d9246bac5/users/15b9c31a09ff4379b316f0de188b1952/roles/c599c85306cc48d5b68b2326f27ae155/inherited_to_projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:58.058581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03f115-ead5-4d95-b968-b30f9c44833f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=16a5d783f67b42b2a7a40f5d9246bac5, user_id=15b9c31a09ff4379b316f0de188b1952, role_id=c599c85306cc48d5b68b2326f27ae155)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:58.061888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db03f115-ead5-4d95-b968-b30f9c44833f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:58.093338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-db03f115-ead5-4d95-b968-b30f9c44833f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invalidating the token cache because role c599c85306cc48d5b68b2326f27ae155 was removed from user 15b9c31a09ff4379b316f0de188b1952 on project 16a5d783f67b42b2a7a40f5d9246bac5. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:58.093649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-db03f115-ead5-4d95-b968-b30f9c44833f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:58.094489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-db03f115-ead5-4d95-b968-b30f9c44833f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:58.190839 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2997/5933] 10.222.0.43 () {58 vars in 1565 bytes} [Tue Jul 19 14:39:58 2022] DELETE /identity/v3/OS-INHERIT/projects/16a5d783f67b42b2a7a40f5d9246bac5/users/15b9c31a09ff4379b316f0de188b1952/roles/c599c85306cc48d5b68b2326f27ae155/inherited_to_projects => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:58.195611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0b26f-bfde-4da2-b8cb-5c113e2f78fc tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:58.197780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b6a0b26f-bfde-4da2-b8cb-5c113e2f78fc tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:58.250139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0b26f-bfde-4da2-b8cb-5c113e2f78fc tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:58.461267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03f115-ead5-4d95-b968-b30f9c44833f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:58.464189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36051893-d867-45b2-8a21-e88ae50cd737 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:58.465643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-db03f115-ead5-4d95-b968-b30f9c44833f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:58.478971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36051893-d867-45b2-8a21-e88ae50cd737 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:58.483048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36051893-d867-45b2-8a21-e88ae50cd737 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:58.483615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36051893-d867-45b2-8a21-e88ae50cd737 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/roles/c599c85306cc48d5b68b2326f27ae155` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:58.488796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36051893-d867-45b2-8a21-e88ae50cd737 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c599c85306cc48d5b68b2326f27ae155)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:58.491993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36051893-d867-45b2-8a21-e88ae50cd737 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:58.679113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db03f115-ead5-4d95-b968-b30f9c44833f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:58.691625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-36051893-d867-45b2-8a21-e88ae50cd737 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invalidating the token cache because role c599c85306cc48d5b68b2326f27ae155 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:58.691974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-36051893-d867-45b2-8a21-e88ae50cd737 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:58.693547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-36051893-d867-45b2-8a21-e88ae50cd737 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:58.698588 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2937/5934] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:39:58 2022] DELETE /identity/v3/roles/c599c85306cc48d5b68b2326f27ae155 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:58.703916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4917d51-f2b6-417c-8b7b-c65e906c372a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:58.705881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4917d51-f2b6-417c-8b7b-c65e906c372a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:58.708587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36051893-d867-45b2-8a21-e88ae50cd737 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:58.711737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4917d51-f2b6-417c-8b7b-c65e906c372a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:58.712035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4917d51-f2b6-417c-8b7b-c65e906c372a admin admin] PATH_INFO: `/v3/users/8d6a446bad394101915eead3b141d077` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:58.719118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4917d51-f2b6-417c-8b7b-c65e906c372a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d6a446bad394101915eead3b141d077)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:58.720652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-36051893-d867-45b2-8a21-e88ae50cd737 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:58.721096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4917d51-f2b6-417c-8b7b-c65e906c372a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:58.751597 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:58.907255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36051893-d867-45b2-8a21-e88ae50cd737 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:58.912938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6edb2d-d80b-45ba-b713-89bb6a2b8e16 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:58.924525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6edb2d-d80b-45ba-b713-89bb6a2b8e16 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:58.928237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6edb2d-d80b-45ba-b713-89bb6a2b8e16 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:58.928642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6edb2d-d80b-45ba-b713-89bb6a2b8e16 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:58.929557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6edb2d-d80b-45ba-b713-89bb6a2b8e16 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:58.931344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6edb2d-d80b-45ba-b713-89bb6a2b8e16 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:58.997620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c4917d51-f2b6-417c-8b7b-c65e906c372a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d6a446bad394101915eead3b141d077'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:59.002383 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:59.020171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c4917d51-f2b6-417c-8b7b-c65e906c372a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d6a446bad394101915eead3b141d077'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:59.020371 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2938/5935] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:39:58 2022] POST /identity/v3/roles => generated 239 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:39:59.025006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6edb2d-d80b-45ba-b713-89bb6a2b8e16 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:59.032317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c4917d51-f2b6-417c-8b7b-c65e906c372a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d6a446bad394101915eead3b141d077'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:59.033575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c4917d51-f2b6-417c-8b7b-c65e906c372a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d6a446bad394101915eead3b141d077'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:59.046475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6edb2d-d80b-45ba-b713-89bb6a2b8e16 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:59.054128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7fd25-25d3-46c8-8d63-c6bc4f0d0741 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:59.055458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7fd25-25d3-46c8-8d63-c6bc4f0d0741 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:59.055863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7fd25-25d3-46c8-8d63-c6bc4f0d0741 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:59.056604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7fd25-25d3-46c8-8d63-c6bc4f0d0741 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/97a673842e094be986a646ee1ca29cef/groups/438db4300c2f4f9d9ab53af1ab4982f5/roles/d271706857104718996a6f40454419fc/inherited_to_projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:59.058751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7fd25-25d3-46c8-8d63-c6bc4f0d0741 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=97a673842e094be986a646ee1ca29cef, group_id=438db4300c2f4f9d9ab53af1ab4982f5, role_id=d271706857104718996a6f40454419fc)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:59.071137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7fd25-25d3-46c8-8d63-c6bc4f0d0741 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:59.129811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c4917d51-f2b6-417c-8b7b-c65e906c372a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d6a446bad394101915eead3b141d077'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:59.139158 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2998/5936] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:39:58 2022] DELETE /identity/v3/users/8d6a446bad394101915eead3b141d077 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:39:59.176273 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2939/5937] 10.222.0.43 () {60 vars in 1581 bytes} [Tue Jul 19 14:39:59 2022] PUT /identity/v3/OS-INHERIT/domains/97a673842e094be986a646ee1ca29cef/groups/438db4300c2f4f9d9ab53af1ab4982f5/roles/d271706857104718996a6f40454419fc/inherited_to_projects => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:39:59.181879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4917d51-f2b6-417c-8b7b-c65e906c372a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:59.188523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c4917d51-f2b6-417c-8b7b-c65e906c372a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:59.339487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4917d51-f2b6-417c-8b7b-c65e906c372a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:59.470986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc924d-0115-4c98-ac1a-05c9a88bdc9d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:59.473338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc924d-0115-4c98-ac1a-05c9a88bdc9d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:59.473996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc924d-0115-4c98-ac1a-05c9a88bdc9d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:59.474508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc924d-0115-4c98-ac1a-05c9a88bdc9d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/97a673842e094be986a646ee1ca29cef/groups/438db4300c2f4f9d9ab53af1ab4982f5/roles/inherited_to_projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:59.476691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc924d-0115-4c98-ac1a-05c9a88bdc9d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=97a673842e094be986a646ee1ca29cef, group_id=438db4300c2f4f9d9ab53af1ab4982f5)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:59.480417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc924d-0115-4c98-ac1a-05c9a88bdc9d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:59.504694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7fd25-25d3-46c8-8d63-c6bc4f0d0741 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:59.520044 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 2999/5938] 10.222.0.43 () {58 vars in 1463 bytes} [Tue Jul 19 14:39:59 2022] GET /identity/v3/OS-INHERIT/domains/97a673842e094be986a646ee1ca29cef/groups/438db4300c2f4f9d9ab53af1ab4982f5/roles/inherited_to_projects => generated 447 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:39:59.525735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ce0e4-a53e-4f55-830b-57e4aaa943f3 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:59.526187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ce0e4-a53e-4f55-830b-57e4aaa943f3 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:59.526375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19ce0e4-a53e-4f55-830b-57e4aaa943f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:59.531659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7fd25-25d3-46c8-8d63-c6bc4f0d0741 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:59.543656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfcc1d6-9e5f-4f7a-8d70-752cd46b16de tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:59.544678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcc1d6-9e5f-4f7a-8d70-752cd46b16de tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:59.545072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcc1d6-9e5f-4f7a-8d70-752cd46b16de tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:59.545483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfcc1d6-9e5f-4f7a-8d70-752cd46b16de tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/97a673842e094be986a646ee1ca29cef/groups/438db4300c2f4f9d9ab53af1ab4982f5/roles/d271706857104718996a6f40454419fc/inherited_to_projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:59.552306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfcc1d6-9e5f-4f7a-8d70-752cd46b16de tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=97a673842e094be986a646ee1ca29cef, group_id=438db4300c2f4f9d9ab53af1ab4982f5, role_id=d271706857104718996a6f40454419fc)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:59.555174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfcc1d6-9e5f-4f7a-8d70-752cd46b16de tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:59.570468 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2940/5939] 10.222.0.43 () {58 vars in 1563 bytes} [Tue Jul 19 14:39:59 2022] HEAD /identity/v3/OS-INHERIT/domains/97a673842e094be986a646ee1ca29cef/groups/438db4300c2f4f9d9ab53af1ab4982f5/roles/d271706857104718996a6f40454419fc/inherited_to_projects => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:39:59.574408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfcc1d6-9e5f-4f7a-8d70-752cd46b16de tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:59.584774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f19ce0e4-a53e-4f55-830b-57e4aaa943f3 None None] MFA Rules not processed for user `2a93cb6e76d842089793093b456f0fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:39:59.588293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f19ce0e4-a53e-4f55-830b-57e4aaa943f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:59.595747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfcc1d6-9e5f-4f7a-8d70-752cd46b16de tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:59.607259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e73d5-68a3-4695-a036-1ed6c687ac80 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:59.608264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e73d5-68a3-4695-a036-1ed6c687ac80 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:59.608659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e73d5-68a3-4695-a036-1ed6c687ac80 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:59.609048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e73d5-68a3-4695-a036-1ed6c687ac80 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/97a673842e094be986a646ee1ca29cef/groups/438db4300c2f4f9d9ab53af1ab4982f5/roles/d271706857104718996a6f40454419fc/inherited_to_projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:59.615143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e73d5-68a3-4695-a036-1ed6c687ac80 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=97a673842e094be986a646ee1ca29cef, group_id=438db4300c2f4f9d9ab53af1ab4982f5, role_id=d271706857104718996a6f40454419fc)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:59.618784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e73d5-68a3-4695-a036-1ed6c687ac80 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:59.645915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6f4e73d5-68a3-4695-a036-1ed6c687ac80 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invalidating the token cache because role d271706857104718996a6f40454419fc was removed from group 438db4300c2f4f9d9ab53af1ab4982f5 on domain 97a673842e094be986a646ee1ca29cef. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:39:59.646394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6f4e73d5-68a3-4695-a036-1ed6c687ac80 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:59.647361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6f4e73d5-68a3-4695-a036-1ed6c687ac80 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:39:59.683651 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:39:59.697983 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3000/5940] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:39:59 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:39:59.702228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ce0e4-a53e-4f55-830b-57e4aaa943f3 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:59.703648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f19ce0e4-a53e-4f55-830b-57e4aaa943f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:59.729408 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2941/5941] 10.222.0.43 () {58 vars in 1565 bytes} [Tue Jul 19 14:39:59 2022] DELETE /identity/v3/OS-INHERIT/domains/97a673842e094be986a646ee1ca29cef/groups/438db4300c2f4f9d9ab53af1ab4982f5/roles/d271706857104718996a6f40454419fc/inherited_to_projects => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:39:59.729408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e73d5-68a3-4695-a036-1ed6c687ac80 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:39:59.733324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6f4e73d5-68a3-4695-a036-1ed6c687ac80 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:39:59.818826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e73d5-68a3-4695-a036-1ed6c687ac80 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:59.826715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc4f30-9700-4606-84d1-d8ebdc516078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:59.828042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc4f30-9700-4606-84d1-d8ebdc516078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:59.828562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc4f30-9700-4606-84d1-d8ebdc516078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:59.829045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc4f30-9700-4606-84d1-d8ebdc516078 admin admin] PATH_INFO: `/v3/projects/32b2de5620e14005a26adedc2007c3f5` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:59.836047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc4f30-9700-4606-84d1-d8ebdc516078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b2de5620e14005a26adedc2007c3f5)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:59.838556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc4f30-9700-4606-84d1-d8ebdc516078 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:59.886860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19ce0e4-a53e-4f55-830b-57e4aaa943f3 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:39:59.896060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8bd20-c6a2-4e90-b96b-fcf91a85e7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:39:59.896772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8bd20-c6a2-4e90-b96b-fcf91a85e7e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:39:59.897071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8bd20-c6a2-4e90-b96b-fcf91a85e7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:39:59.897513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8bd20-c6a2-4e90-b96b-fcf91a85e7e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:39:59.898297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8bd20-c6a2-4e90-b96b-fcf91a85e7e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:39:59.900528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8bd20-c6a2-4e90-b96b-fcf91a85e7e0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:39:59.989074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86fc4f30-9700-4606-84d1-d8ebdc516078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b2de5620e14005a26adedc2007c3f5', 'request_id': 'req-86fc4f30-9700-4606-84d1-d8ebdc516078'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:00.064036 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3001/5942] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:39:59 2022] POST /identity/v3/projects => generated 405 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:40:00.065215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8bd20-c6a2-4e90-b96b-fcf91a85e7e0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:00.069059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-63d8bd20-c6a2-4e90-b96b-fcf91a85e7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:00.075014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86fc4f30-9700-4606-84d1-d8ebdc516078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b2de5620e14005a26adedc2007c3f5', 'request_id': 'req-86fc4f30-9700-4606-84d1-d8ebdc516078'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:00.085806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86fc4f30-9700-4606-84d1-d8ebdc516078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b2de5620e14005a26adedc2007c3f5', 'request_id': 'req-86fc4f30-9700-4606-84d1-d8ebdc516078'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:00.091920 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:00.120652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86fc4f30-9700-4606-84d1-d8ebdc516078 admin admin] The token cache is being invalidate because project 32b2de5620e14005a26adedc2007c3f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:00.121115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86fc4f30-9700-4606-84d1-d8ebdc516078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:00.121860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86fc4f30-9700-4606-84d1-d8ebdc516078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:00.127771 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2942/5943] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:39:59 2022] DELETE /identity/v3/projects/32b2de5620e14005a26adedc2007c3f5 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:00.129636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc4f30-9700-4606-84d1-d8ebdc516078 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:00.131205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-86fc4f30-9700-4606-84d1-d8ebdc516078 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:00.193208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8bd20-c6a2-4e90-b96b-fcf91a85e7e0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:00.198681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1f802-bb76-43a0-8c7d-cb040a160eb4 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:00.199725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1f802-bb76-43a0-8c7d-cb040a160eb4 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:00.200171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1f802-bb76-43a0-8c7d-cb040a160eb4 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:00.200602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1f802-bb76-43a0-8c7d-cb040a160eb4 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/roles/d271706857104718996a6f40454419fc` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:00.202463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1f802-bb76-43a0-8c7d-cb040a160eb4 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d271706857104718996a6f40454419fc)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:00.213484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1f802-bb76-43a0-8c7d-cb040a160eb4 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:00.256442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc4f30-9700-4606-84d1-d8ebdc516078 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:00.345398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1be64-6b7c-4064-b907-bb2a5ff4ca42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:00.346190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1be64-6b7c-4064-b907-bb2a5ff4ca42 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:00.346486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1be64-6b7c-4064-b907-bb2a5ff4ca42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:00.346862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1be64-6b7c-4064-b907-bb2a5ff4ca42 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:00.347699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1be64-6b7c-4064-b907-bb2a5ff4ca42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:00.349690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f1be64-6b7c-4064-b907-bb2a5ff4ca42 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:00.383262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-97c1f802-bb76-43a0-8c7d-cb040a160eb4 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invalidating the token cache because role d271706857104718996a6f40454419fc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:00.383659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-97c1f802-bb76-43a0-8c7d-cb040a160eb4 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:00.384517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-97c1f802-bb76-43a0-8c7d-cb040a160eb4 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:00.387018 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3002/5944] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:00 2022] DELETE /identity/v3/roles/d271706857104718996a6f40454419fc => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:00.392529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bf61d-e133-4499-b753-0789843b4c22 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:00.392884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bf61d-e133-4499-b753-0789843b4c22 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:00.393173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2bf61d-e133-4499-b753-0789843b4c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:00.412997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0a2bf61d-e133-4499-b753-0789843b4c22 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:00.418166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0a2bf61d-e133-4499-b753-0789843b4c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:00.469894 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2943/5945] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:00 2022] POST /identity/v3/users => generated 309 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:00.471049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1be64-6b7c-4064-b907-bb2a5ff4ca42 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:00.477475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d0f1be64-6b7c-4064-b907-bb2a5ff4ca42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:00.502450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1be64-6b7c-4064-b907-bb2a5ff4ca42 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:00.515064 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:00.584910 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3003/5946] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:00.591315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bf61d-e133-4499-b753-0789843b4c22 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:00.599994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0a2bf61d-e133-4499-b753-0789843b4c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:00.619571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e191e51-59bd-47bd-a4c8-920564c479f2 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:00.620279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e191e51-59bd-47bd-a4c8-920564c479f2 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:00.620555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e191e51-59bd-47bd-a4c8-920564c479f2 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:00.620839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e191e51-59bd-47bd-a4c8-920564c479f2 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:00.621611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e191e51-59bd-47bd-a4c8-920564c479f2 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:00.623276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e191e51-59bd-47bd-a4c8-920564c479f2 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:00.627988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2bf61d-e133-4499-b753-0789843b4c22 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:00.650866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d5b0c-3a48-473b-9f38-75a1c1fa00c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:00.651801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d5b0c-3a48-473b-9f38-75a1c1fa00c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:00.652078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d5b0c-3a48-473b-9f38-75a1c1fa00c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:00.652358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d5b0c-3a48-473b-9f38-75a1c1fa00c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:00.653146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d5b0c-3a48-473b-9f38-75a1c1fa00c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:00.654780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d5b0c-3a48-473b-9f38-75a1c1fa00c9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:00.682003 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3004/5947] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:00 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:00.683368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc621fa-798e-4cfa-aa9b-55a2ab21626b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:00.683665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc621fa-798e-4cfa-aa9b-55a2ab21626b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:00.683951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc621fa-798e-4cfa-aa9b-55a2ab21626b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:00.722796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7dc621fa-798e-4cfa-aa9b-55a2ab21626b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:00.724291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7dc621fa-798e-4cfa-aa9b-55a2ab21626b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:00.735619 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3005/5948] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:00.736729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc621fa-798e-4cfa-aa9b-55a2ab21626b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:00.751629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc621fa-798e-4cfa-aa9b-55a2ab21626b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:00.758819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c9b36-166b-405d-9670-5503342ddbec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:00.759922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c9b36-166b-405d-9670-5503342ddbec admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:00.760215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c9b36-166b-405d-9670-5503342ddbec admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:00.760499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833c9b36-166b-405d-9670-5503342ddbec admin admin] PATH_INFO: `/v3/projects/33023e7e73454f29b1c9774231b80ab9/users/9be9abcfffd84835bb4ab8c3d6c28abc/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:00.774164 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2944/5949] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:40:00 2022] POST /identity/v3/roles => generated 240 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:00.775506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e191e51-59bd-47bd-a4c8-920564c479f2 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:00.779827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c9b36-166b-405d-9670-5503342ddbec admin admin] RBAC: Authorizing `identity:create_grant(project_id=33023e7e73454f29b1c9774231b80ab9, user_id=9be9abcfffd84835bb4ab8c3d6c28abc, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:00.782741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833c9b36-166b-405d-9670-5503342ddbec admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:00.797762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e191e51-59bd-47bd-a4c8-920564c479f2 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:00.808653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7defd-b29c-4b26-b6f0-97f44a1180ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:00.812190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7defd-b29c-4b26-b6f0-97f44a1180ea admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:00.812190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7defd-b29c-4b26-b6f0-97f44a1180ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:00.812190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a7defd-b29c-4b26-b6f0-97f44a1180ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:00.812190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7defd-b29c-4b26-b6f0-97f44a1180ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:00.812190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7defd-b29c-4b26-b6f0-97f44a1180ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:00.827061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a7defd-b29c-4b26-b6f0-97f44a1180ea admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:00.853688 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2945/5950] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:40:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:00.854898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7defd-b29c-4b26-b6f0-97f44a1180ea admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:00.889348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a7defd-b29c-4b26-b6f0-97f44a1180ea admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:00.895413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750c540-f5bd-4d25-923d-8d894201c9f6 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:00.896679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750c540-f5bd-4d25-923d-8d894201c9f6 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:00.897182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750c540-f5bd-4d25-923d-8d894201c9f6 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:00.897706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750c540-f5bd-4d25-923d-8d894201c9f6 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/97a673842e094be986a646ee1ca29cef/users/15b9c31a09ff4379b316f0de188b1952/roles/e9a9f0f37407476984e39b21dfb9dd4a/inherited_to_projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:00.901821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750c540-f5bd-4d25-923d-8d894201c9f6 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=97a673842e094be986a646ee1ca29cef, user_id=15b9c31a09ff4379b316f0de188b1952, role_id=e9a9f0f37407476984e39b21dfb9dd4a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:00.905214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750c540-f5bd-4d25-923d-8d894201c9f6 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:00.911454 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:DELETE=1,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:00.922406 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3006/5951] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:00 2022] PUT /identity/v3/projects/33023e7e73454f29b1c9774231b80ab9/users/9be9abcfffd84835bb4ab8c3d6c28abc/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:00.922917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c9b36-166b-405d-9670-5503342ddbec admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:00.996752 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2946/5952] 10.222.0.43 () {60 vars in 1578 bytes} [Tue Jul 19 14:40:00 2022] PUT /identity/v3/OS-INHERIT/domains/97a673842e094be986a646ee1ca29cef/users/15b9c31a09ff4379b316f0de188b1952/roles/e9a9f0f37407476984e39b21dfb9dd4a/inherited_to_projects => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:01.001167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750c540-f5bd-4d25-923d-8d894201c9f6 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:01.022814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833c9b36-166b-405d-9670-5503342ddbec admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:01.144560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750c540-f5bd-4d25-923d-8d894201c9f6 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:01.153455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6d126-0679-4b64-946c-ea06a66b9429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:01.154065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6d126-0679-4b64-946c-ea06a66b9429 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:01.154407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6d126-0679-4b64-946c-ea06a66b9429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:01.154697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6d126-0679-4b64-946c-ea06a66b9429 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:01.155545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6d126-0679-4b64-946c-ea06a66b9429 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:01.157403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6d126-0679-4b64-946c-ea06a66b9429 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:01.166640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fe226-9810-4fd3-82a0-35bf3448b073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:01.167394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fe226-9810-4fd3-82a0-35bf3448b073 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:01.167686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fe226-9810-4fd3-82a0-35bf3448b073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:01.167978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741fe226-9810-4fd3-82a0-35bf3448b073 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:01.168714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fe226-9810-4fd3-82a0-35bf3448b073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:01.173271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741fe226-9810-4fd3-82a0-35bf3448b073 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:01.185480 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2947/5953] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:00 2022] GET /identity/v3/roles => generated 1651 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:01.186451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fe226-9810-4fd3-82a0-35bf3448b073 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:01.275103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741fe226-9810-4fd3-82a0-35bf3448b073 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:01.279894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0f811-061d-4501-99b1-2f38c66a2947 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:01.280788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0f811-061d-4501-99b1-2f38c66a2947 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:01.281078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0f811-061d-4501-99b1-2f38c66a2947 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:01.281372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0f811-061d-4501-99b1-2f38c66a2947 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/97a673842e094be986a646ee1ca29cef/users/15b9c31a09ff4379b316f0de188b1952/roles/inherited_to_projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:01.283137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0f811-061d-4501-99b1-2f38c66a2947 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=97a673842e094be986a646ee1ca29cef, user_id=15b9c31a09ff4379b316f0de188b1952)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:01.284321 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-f9b0f811-061d-4501-99b1-2f38c66a2947 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:40:01.284321 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:40:01.284321 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:40:01.286174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0f811-061d-4501-99b1-2f38c66a2947 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:01.298909 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2948/5954] 10.222.0.43 () {58 vars in 1460 bytes} [Tue Jul 19 14:40:01 2022] GET /identity/v3/OS-INHERIT/domains/97a673842e094be986a646ee1ca29cef/users/15b9c31a09ff4379b316f0de188b1952/roles/inherited_to_projects => generated 447 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:01.299842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0f811-061d-4501-99b1-2f38c66a2947 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:01.311702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0f811-061d-4501-99b1-2f38c66a2947 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:01.317459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aaa4a1-5234-4138-bb64-e4f34256627b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:01.318400 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3007/5955] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:00 2022] POST /identity/v3/projects => generated 367 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:01.318763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aaa4a1-5234-4138-bb64-e4f34256627b admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:01.319144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aaa4a1-5234-4138-bb64-e4f34256627b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:01.319284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6d126-0679-4b64-946c-ea06a66b9429 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:01.319464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aaa4a1-5234-4138-bb64-e4f34256627b admin admin] PATH_INFO: `/v3/projects/33023e7e73454f29b1c9774231b80ab9/users/9be9abcfffd84835bb4ab8c3d6c28abc/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:01.321521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aaa4a1-5234-4138-bb64-e4f34256627b admin admin] RBAC: Authorizing `identity:create_grant(project_id=33023e7e73454f29b1c9774231b80ab9, user_id=9be9abcfffd84835bb4ab8c3d6c28abc, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:01.324528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aaa4a1-5234-4138-bb64-e4f34256627b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:01.359824 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2949/5956] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:01 2022] PUT /identity/v3/projects/33023e7e73454f29b1c9774231b80ab9/users/9be9abcfffd84835bb4ab8c3d6c28abc/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:01.362211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aaa4a1-5234-4138-bb64-e4f34256627b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:01.376684 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:01.428905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6d126-0679-4b64-946c-ea06a66b9429 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:01.496590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aaa4a1-5234-4138-bb64-e4f34256627b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:01.508407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559fbaa-3c2d-40ff-ba6d-192bafcf8e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:01.509386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559fbaa-3c2d-40ff-ba6d-192bafcf8e5d admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:01.509884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559fbaa-3c2d-40ff-ba6d-192bafcf8e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:01.510559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559fbaa-3c2d-40ff-ba6d-192bafcf8e5d admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:01.511495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559fbaa-3c2d-40ff-ba6d-192bafcf8e5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:01.513654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559fbaa-3c2d-40ff-ba6d-192bafcf8e5d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:01.561151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fe51e-8bb7-414e-8aa4-1b4878c19886 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:01.562165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fe51e-8bb7-414e-8aa4-1b4878c19886 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:01.562463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fe51e-8bb7-414e-8aa4-1b4878c19886 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:01.562752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fe51e-8bb7-414e-8aa4-1b4878c19886 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/97a673842e094be986a646ee1ca29cef/users/15b9c31a09ff4379b316f0de188b1952/roles/e9a9f0f37407476984e39b21dfb9dd4a/inherited_to_projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:01.565268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fe51e-8bb7-414e-8aa4-1b4878c19886 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=97a673842e094be986a646ee1ca29cef, user_id=15b9c31a09ff4379b316f0de188b1952, role_id=e9a9f0f37407476984e39b21dfb9dd4a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:01.570058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fe51e-8bb7-414e-8aa4-1b4878c19886 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:01.581415 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3008/5957] 10.222.0.43 () {58 vars in 1560 bytes} [Tue Jul 19 14:40:01 2022] HEAD /identity/v3/OS-INHERIT/domains/97a673842e094be986a646ee1ca29cef/users/15b9c31a09ff4379b316f0de188b1952/roles/e9a9f0f37407476984e39b21dfb9dd4a/inherited_to_projects => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:01.582595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fe51e-8bb7-414e-8aa4-1b4878c19886 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:01.600642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fe51e-8bb7-414e-8aa4-1b4878c19886 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:01.609717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c39b2-7b14-4a6e-a6d1-f7c7079ee3a7 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:01.610642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c39b2-7b14-4a6e-a6d1-f7c7079ee3a7 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:01.610933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c39b2-7b14-4a6e-a6d1-f7c7079ee3a7 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:01.613184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c39b2-7b14-4a6e-a6d1-f7c7079ee3a7 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/97a673842e094be986a646ee1ca29cef/users/15b9c31a09ff4379b316f0de188b1952/roles/e9a9f0f37407476984e39b21dfb9dd4a/inherited_to_projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:01.614595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c39b2-7b14-4a6e-a6d1-f7c7079ee3a7 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=97a673842e094be986a646ee1ca29cef, user_id=15b9c31a09ff4379b316f0de188b1952, role_id=e9a9f0f37407476984e39b21dfb9dd4a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:01.617493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c39b2-7b14-4a6e-a6d1-f7c7079ee3a7 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:01.623630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-653c39b2-7b14-4a6e-a6d1-f7c7079ee3a7 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invalidating the token cache because role e9a9f0f37407476984e39b21dfb9dd4a was removed from user 15b9c31a09ff4379b316f0de188b1952 on domain 97a673842e094be986a646ee1ca29cef. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:01.624011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-653c39b2-7b14-4a6e-a6d1-f7c7079ee3a7 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:01.624877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-653c39b2-7b14-4a6e-a6d1-f7c7079ee3a7 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:01.634657 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:01.640503 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2950/5958] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:01 2022] POST /identity/v3/users => generated 284 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:01.644795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559fbaa-3c2d-40ff-ba6d-192bafcf8e5d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:01.647245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0559fbaa-3c2d-40ff-ba6d-192bafcf8e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:01.663897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559fbaa-3c2d-40ff-ba6d-192bafcf8e5d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:01.669132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d305e04-aedb-4428-ab7a-35e5ee48e190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:01.670050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d305e04-aedb-4428-ab7a-35e5ee48e190 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:01.670251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d305e04-aedb-4428-ab7a-35e5ee48e190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:01.670686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d305e04-aedb-4428-ab7a-35e5ee48e190 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:01.674148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d305e04-aedb-4428-ab7a-35e5ee48e190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:01.674148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d305e04-aedb-4428-ab7a-35e5ee48e190 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:01.686023 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2951/5959] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:01 2022] GET /identity/v3/roles => generated 1651 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:01.689666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d305e04-aedb-4428-ab7a-35e5ee48e190 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:01.701074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d305e04-aedb-4428-ab7a-35e5ee48e190 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:01.707214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf44146-52d1-4a19-bc86-0dca2215a090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:01.708736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf44146-52d1-4a19-bc86-0dca2215a090 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:01.709667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf44146-52d1-4a19-bc86-0dca2215a090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:01.709667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf44146-52d1-4a19-bc86-0dca2215a090 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:01.713166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf44146-52d1-4a19-bc86-0dca2215a090 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:01.713166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf44146-52d1-4a19-bc86-0dca2215a090 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:01.729269 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2952/5960] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:01 2022] GET /identity/v3/roles => generated 1651 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:01.739750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf44146-52d1-4a19-bc86-0dca2215a090 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:01.751078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf44146-52d1-4a19-bc86-0dca2215a090 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:01.757193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1ac70c-e480-4b40-a008-eb77304f21b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:01.758255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ac70c-e480-4b40-a008-eb77304f21b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:01.758720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ac70c-e480-4b40-a008-eb77304f21b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:01.759070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1ac70c-e480-4b40-a008-eb77304f21b0 admin admin] PATH_INFO: `/v3/projects/8e72a4ce36724fdab893155fe12cccb5/users/4bd76bbba0a440f8a132318a573a8cf6/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:01.774028 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3009/5961] 10.222.0.43 () {58 vars in 1562 bytes} [Tue Jul 19 14:40:01 2022] DELETE /identity/v3/OS-INHERIT/domains/97a673842e094be986a646ee1ca29cef/users/15b9c31a09ff4379b316f0de188b1952/roles/e9a9f0f37407476984e39b21dfb9dd4a/inherited_to_projects => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:01.775313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c39b2-7b14-4a6e-a6d1-f7c7079ee3a7 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:01.777817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-653c39b2-7b14-4a6e-a6d1-f7c7079ee3a7 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:01.789156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ac70c-e480-4b40-a008-eb77304f21b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e72a4ce36724fdab893155fe12cccb5, user_id=4bd76bbba0a440f8a132318a573a8cf6, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:01.794176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1ac70c-e480-4b40-a008-eb77304f21b0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:01.868855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c39b2-7b14-4a6e-a6d1-f7c7079ee3a7 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:01.886481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ffd5b-4323-426f-9b9f-f0de80b86ea5 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:01.886481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ffd5b-4323-426f-9b9f-f0de80b86ea5 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:01.886481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ffd5b-4323-426f-9b9f-f0de80b86ea5 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:01.886891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ffd5b-4323-426f-9b9f-f0de80b86ea5 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/roles/e9a9f0f37407476984e39b21dfb9dd4a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:01.904649 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2953/5962] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:01 2022] PUT /identity/v3/projects/8e72a4ce36724fdab893155fe12cccb5/users/4bd76bbba0a440f8a132318a573a8cf6/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:40:01.909213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ffd5b-4323-426f-9b9f-f0de80b86ea5 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e9a9f0f37407476984e39b21dfb9dd4a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:01.916009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc63e18-b737-4fed-8576-51f1dbe8ecc6 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:01.916483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc63e18-b737-4fed-8576-51f1dbe8ecc6 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:01.916837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc63e18-b737-4fed-8576-51f1dbe8ecc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:01.925086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ffd5b-4323-426f-9b9f-f0de80b86ea5 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:01.989788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1bc63e18-b737-4fed-8576-51f1dbe8ecc6 None None] MFA Rules not processed for user `4bd76bbba0a440f8a132318a573a8cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:01.992644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1bc63e18-b737-4fed-8576-51f1dbe8ecc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:02.070149 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2954/5963] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:02.079365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc63e18-b737-4fed-8576-51f1dbe8ecc6 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:02.080764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1bc63e18-b737-4fed-8576-51f1dbe8ecc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:02.095544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c81ffd5b-4323-426f-9b9f-f0de80b86ea5 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invalidating the token cache because role e9a9f0f37407476984e39b21dfb9dd4a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:02.095849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c81ffd5b-4323-426f-9b9f-f0de80b86ea5 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:02.097426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c81ffd5b-4323-426f-9b9f-f0de80b86ea5 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:02.100356 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3010/5964] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:01 2022] DELETE /identity/v3/roles/e9a9f0f37407476984e39b21dfb9dd4a => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:40:02.105098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ffd5b-4323-426f-9b9f-f0de80b86ea5 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:02.108669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c81ffd5b-4323-426f-9b9f-f0de80b86ea5 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:02.196569 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:02.237427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc63e18-b737-4fed-8576-51f1dbe8ecc6 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:02.264208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ffd5b-4323-426f-9b9f-f0de80b86ea5 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:02.273735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b76f52-abf7-46f6-a73a-8b86284ac041 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:02.274620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b76f52-abf7-46f6-a73a-8b86284ac041 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:02.275323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b76f52-abf7-46f6-a73a-8b86284ac041 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:02.275678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b76f52-abf7-46f6-a73a-8b86284ac041 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:02.276537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b76f52-abf7-46f6-a73a-8b86284ac041 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:02.278430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b76f52-abf7-46f6-a73a-8b86284ac041 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:02.331183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24bed2-7ee7-4e46-b346-5717f7f43c58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:02.334070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24bed2-7ee7-4e46-b346-5717f7f43c58 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:02.335187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24bed2-7ee7-4e46-b346-5717f7f43c58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:02.341145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b24bed2-7ee7-4e46-b346-5717f7f43c58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:02.351174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6b24bed2-7ee7-4e46-b346-5717f7f43c58 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:02.392088 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3011/5965] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:40:02 2022] POST /identity/v3/roles => generated 240 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:40:02.392355 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:02.394017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b76f52-abf7-46f6-a73a-8b86284ac041 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:02.412814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b76f52-abf7-46f6-a73a-8b86284ac041 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:02.419636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf1003-b239-4449-8a4b-88f8b7edc425 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:02.420391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf1003-b239-4449-8a4b-88f8b7edc425 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:02.420846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf1003-b239-4449-8a4b-88f8b7edc425 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:02.421593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf1003-b239-4449-8a4b-88f8b7edc425 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:02.423142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf1003-b239-4449-8a4b-88f8b7edc425 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:02.427381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf1003-b239-4449-8a4b-88f8b7edc425 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:02.499021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b24bed2-7ee7-4e46-b346-5717f7f43c58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:02.500532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b24bed2-7ee7-4e46-b346-5717f7f43c58 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:02.526176 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2955/5966] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:02 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:40:02.543501 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3012/5967] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:02 2022] POST /identity/v3/projects => generated 409 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:02.546340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24bed2-7ee7-4e46-b346-5717f7f43c58 service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:02.564124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b24bed2-7ee7-4e46-b346-5717f7f43c58 service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:02.701934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f0760-7bd6-4472-a2e3-da3791775513 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:02.703026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f0760-7bd6-4472-a2e3-da3791775513 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:02.703383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f0760-7bd6-4472-a2e3-da3791775513 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:02.703778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f0760-7bd6-4472-a2e3-da3791775513 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/97a673842e094be986a646ee1ca29cef/users/15b9c31a09ff4379b316f0de188b1952/roles/c94aa98f4d9040c690f07074ebc0e824/inherited_to_projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:02.706775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f0760-7bd6-4472-a2e3-da3791775513 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=97a673842e094be986a646ee1ca29cef, user_id=15b9c31a09ff4379b316f0de188b1952, role_id=c94aa98f4d9040c690f07074ebc0e824)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:02.709768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f0760-7bd6-4472-a2e3-da3791775513 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:02.852049 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2956/5968] 10.222.0.43 () {60 vars in 1578 bytes} [Tue Jul 19 14:40:02 2022] PUT /identity/v3/OS-INHERIT/domains/97a673842e094be986a646ee1ca29cef/users/15b9c31a09ff4379b316f0de188b1952/roles/c94aa98f4d9040c690f07074ebc0e824/inherited_to_projects => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:02.856319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf1003-b239-4449-8a4b-88f8b7edc425 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:02.871225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf1003-b239-4449-8a4b-88f8b7edc425 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:02.975996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a43b2-9b5e-45a1-a428-132fdd9307ac tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:02.977524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a43b2-9b5e-45a1-a428-132fdd9307ac tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:02.978088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a43b2-9b5e-45a1-a428-132fdd9307ac tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:02.978596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a43b2-9b5e-45a1-a428-132fdd9307ac tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:02.979597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a43b2-9b5e-45a1-a428-132fdd9307ac tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Adding query filter params (scope.project.id=16a5d783f67b42b2a7a40f5d9246bac5, user.id=15b9c31a09ff4379b316f0de188b1952) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:02.980062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a43b2-9b5e-45a1-a428-132fdd9307ac tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:02.982472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a43b2-9b5e-45a1-a428-132fdd9307ac tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:03.097435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f0760-7bd6-4472-a2e3-da3791775513 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:03.098583 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3013/5969] 10.222.0.43 () {58 vars in 1355 bytes} [Tue Jul 19 14:40:02 2022] GET /identity/v3/role_assignments?scope.project.id=16a5d783f67b42b2a7a40f5d9246bac5&user.id=15b9c31a09ff4379b316f0de188b1952&effective => generated 648 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:03.137769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f0760-7bd6-4472-a2e3-da3791775513 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:03.166176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8c27e-a4ae-4830-b88f-c2adcf1fce02 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:03.168509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8c27e-a4ae-4830-b88f-c2adcf1fce02 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:03.168901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8c27e-a4ae-4830-b88f-c2adcf1fce02 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:03.170426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b8c27e-a4ae-4830-b88f-c2adcf1fce02 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:03.172543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8c27e-a4ae-4830-b88f-c2adcf1fce02 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Adding query filter params (scope.project.id=4769cd9a1db54361b9e229f0e9357ded, user.id=15b9c31a09ff4379b316f0de188b1952) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:03.172974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8c27e-a4ae-4830-b88f-c2adcf1fce02 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:03.178777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b8c27e-a4ae-4830-b88f-c2adcf1fce02 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:03.363024 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2957/5970] 10.222.0.43 () {58 vars in 1355 bytes} [Tue Jul 19 14:40:03 2022] GET /identity/v3/role_assignments?scope.project.id=4769cd9a1db54361b9e229f0e9357ded&user.id=15b9c31a09ff4379b316f0de188b1952&effective => generated 648 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:03.365150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a43b2-9b5e-45a1-a428-132fdd9307ac tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:03.384422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a43b2-9b5e-45a1-a428-132fdd9307ac tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:03.412319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974f344-327c-44d1-b3c6-220e60e00494 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:03.413871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974f344-327c-44d1-b3c6-220e60e00494 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:03.414523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974f344-327c-44d1-b3c6-220e60e00494 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:03.414856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974f344-327c-44d1-b3c6-220e60e00494 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/97a673842e094be986a646ee1ca29cef/users/15b9c31a09ff4379b316f0de188b1952/roles/c94aa98f4d9040c690f07074ebc0e824/inherited_to_projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:03.418707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974f344-327c-44d1-b3c6-220e60e00494 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=97a673842e094be986a646ee1ca29cef, user_id=15b9c31a09ff4379b316f0de188b1952, role_id=c94aa98f4d9040c690f07074ebc0e824)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:03.422413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974f344-327c-44d1-b3c6-220e60e00494 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:03.430502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c974f344-327c-44d1-b3c6-220e60e00494 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invalidating the token cache because role c94aa98f4d9040c690f07074ebc0e824 was removed from user 15b9c31a09ff4379b316f0de188b1952 on domain 97a673842e094be986a646ee1ca29cef. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:03.430947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c974f344-327c-44d1-b3c6-220e60e00494 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:03.431831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c974f344-327c-44d1-b3c6-220e60e00494 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:03.527603 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3014/5971] 10.222.0.43 () {58 vars in 1562 bytes} [Tue Jul 19 14:40:03 2022] DELETE /identity/v3/OS-INHERIT/domains/97a673842e094be986a646ee1ca29cef/users/15b9c31a09ff4379b316f0de188b1952/roles/c94aa98f4d9040c690f07074ebc0e824/inherited_to_projects => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:03.532139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8c27e-a4ae-4830-b88f-c2adcf1fce02 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:03.534473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-62b8c27e-a4ae-4830-b88f-c2adcf1fce02 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:03.567033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b8c27e-a4ae-4830-b88f-c2adcf1fce02 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:03.658667 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:03.701487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0010f0e-a5ee-44af-afb7-cb5d6727bd7f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:03.704137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0010f0e-a5ee-44af-afb7-cb5d6727bd7f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:03.704137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0010f0e-a5ee-44af-afb7-cb5d6727bd7f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:03.704137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0010f0e-a5ee-44af-afb7-cb5d6727bd7f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:03.704137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0010f0e-a5ee-44af-afb7-cb5d6727bd7f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Adding query filter params (scope.project.id=16a5d783f67b42b2a7a40f5d9246bac5, user.id=15b9c31a09ff4379b316f0de188b1952) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:03.704895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0010f0e-a5ee-44af-afb7-cb5d6727bd7f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:03.707283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0010f0e-a5ee-44af-afb7-cb5d6727bd7f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:03.759812 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2958/5972] 10.222.0.43 () {58 vars in 1355 bytes} [Tue Jul 19 14:40:03 2022] GET /identity/v3/role_assignments?scope.project.id=16a5d783f67b42b2a7a40f5d9246bac5&user.id=15b9c31a09ff4379b316f0de188b1952&effective => generated 228 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:03.760554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974f344-327c-44d1-b3c6-220e60e00494 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:03.802075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974f344-327c-44d1-b3c6-220e60e00494 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:03.818609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d608d2-99ce-44ed-a304-5a0215d99622 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:03.820815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d608d2-99ce-44ed-a304-5a0215d99622 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:03.820815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d608d2-99ce-44ed-a304-5a0215d99622 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:03.820815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d608d2-99ce-44ed-a304-5a0215d99622 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:03.825320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d608d2-99ce-44ed-a304-5a0215d99622 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Adding query filter params (scope.project.id=4769cd9a1db54361b9e229f0e9357ded, user.id=15b9c31a09ff4379b316f0de188b1952) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:03.825320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d608d2-99ce-44ed-a304-5a0215d99622 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:03.827672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d608d2-99ce-44ed-a304-5a0215d99622 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:03.907532 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:03.987099 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3015/5973] 10.222.0.43 () {58 vars in 1355 bytes} [Tue Jul 19 14:40:03 2022] GET /identity/v3/role_assignments?scope.project.id=4769cd9a1db54361b9e229f0e9357ded&user.id=15b9c31a09ff4379b316f0de188b1952&effective => generated 228 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:40:03.989171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0010f0e-a5ee-44af-afb7-cb5d6727bd7f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:04.008665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0010f0e-a5ee-44af-afb7-cb5d6727bd7f tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:04.015001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347dbbd-9f70-473f-8226-35f234faef25 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:04.015257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347dbbd-9f70-473f-8226-35f234faef25 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:04.015617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347dbbd-9f70-473f-8226-35f234faef25 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:04.015898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8347dbbd-9f70-473f-8226-35f234faef25 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/projects/4769cd9a1db54361b9e229f0e9357ded` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:04.027148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347dbbd-9f70-473f-8226-35f234faef25 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4769cd9a1db54361b9e229f0e9357ded)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:04.029175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8347dbbd-9f70-473f-8226-35f234faef25 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:04.253896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8347dbbd-9f70-473f-8226-35f234faef25 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4769cd9a1db54361b9e229f0e9357ded', 'request_id': 'req-8347dbbd-9f70-473f-8226-35f234faef25'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:04.380821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8347dbbd-9f70-473f-8226-35f234faef25 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4769cd9a1db54361b9e229f0e9357ded', 'request_id': 'req-8347dbbd-9f70-473f-8226-35f234faef25'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:04.386572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8347dbbd-9f70-473f-8226-35f234faef25 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4769cd9a1db54361b9e229f0e9357ded', 'request_id': 'req-8347dbbd-9f70-473f-8226-35f234faef25'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:04.431455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8347dbbd-9f70-473f-8226-35f234faef25 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] The token cache is being invalidate because project 4769cd9a1db54361b9e229f0e9357ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:04.437251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8347dbbd-9f70-473f-8226-35f234faef25 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:04.442834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8347dbbd-9f70-473f-8226-35f234faef25 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:04.451904 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2959/5974] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:03 2022] DELETE /identity/v3/projects/4769cd9a1db54361b9e229f0e9357ded => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:04.455722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d608d2-99ce-44ed-a304-5a0215d99622 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:04.458222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b8d608d2-99ce-44ed-a304-5a0215d99622 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:04.514247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d608d2-99ce-44ed-a304-5a0215d99622 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:04.751983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d8e5d-16c4-4635-8b75-7ed16258622d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:04.753175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d8e5d-16c4-4635-8b75-7ed16258622d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:04.753619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d8e5d-16c4-4635-8b75-7ed16258622d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:04.754164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d8e5d-16c4-4635-8b75-7ed16258622d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/roles/c94aa98f4d9040c690f07074ebc0e824` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:04.756389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d8e5d-16c4-4635-8b75-7ed16258622d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c94aa98f4d9040c690f07074ebc0e824)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:04.758562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d8e5d-16c4-4635-8b75-7ed16258622d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:04.923870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-081d8e5d-16c4-4635-8b75-7ed16258622d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invalidating the token cache because role c94aa98f4d9040c690f07074ebc0e824 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:04.925431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-081d8e5d-16c4-4635-8b75-7ed16258622d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:04.926453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-081d8e5d-16c4-4635-8b75-7ed16258622d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:04.930547 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3016/5975] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:04 2022] DELETE /identity/v3/roles/c94aa98f4d9040c690f07074ebc0e824 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:04.935803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347dbbd-9f70-473f-8226-35f234faef25 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:04.965141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8347dbbd-9f70-473f-8226-35f234faef25 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:05.061699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3918e7-9747-4022-9d23-1409b0ee540f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:05.062286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3918e7-9747-4022-9d23-1409b0ee540f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:05.062739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3918e7-9747-4022-9d23-1409b0ee540f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:05.063574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06c388-056f-477d-bdd9-c0c16dc514c5 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:05.065645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06c388-056f-477d-bdd9-c0c16dc514c5 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:05.066555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06c388-056f-477d-bdd9-c0c16dc514c5 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:05.066858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba06c388-056f-477d-bdd9-c0c16dc514c5 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:05.067642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06c388-056f-477d-bdd9-c0c16dc514c5 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:05.069755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba06c388-056f-477d-bdd9-c0c16dc514c5 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:05.101019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0d3918e7-9747-4022-9d23-1409b0ee540f None None] MFA Rules not processed for user `9be9abcfffd84835bb4ab8c3d6c28abc`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:05.102593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0d3918e7-9747-4022-9d23-1409b0ee540f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:05.190588 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2960/5976] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:40:04 2022] POST /identity/v3/roles => generated 239 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:40:05.203735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06c388-056f-477d-bdd9-c0c16dc514c5 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:05.209510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ba06c388-056f-477d-bdd9-c0c16dc514c5 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:05.249177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba06c388-056f-477d-bdd9-c0c16dc514c5 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:05.270717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94224d6-d94d-4b44-a337-395aebbc1d34 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:05.271536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94224d6-d94d-4b44-a337-395aebbc1d34 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:05.273265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94224d6-d94d-4b44-a337-395aebbc1d34 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:05.273567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94224d6-d94d-4b44-a337-395aebbc1d34 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:05.275773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94224d6-d94d-4b44-a337-395aebbc1d34 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:05.282580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94224d6-d94d-4b44-a337-395aebbc1d34 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:05.284102 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3017/5977] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:05 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:05.340676 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:05.491774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3918e7-9747-4022-9d23-1409b0ee540f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:05.498471 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2961/5978] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:05 2022] POST /identity/v3/projects => generated 409 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:40:05.508579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3918e7-9747-4022-9d23-1409b0ee540f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:05.631233 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:05.682067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695ac85-ce05-4315-9658-15316929d4ae tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:05.691494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695ac85-ce05-4315-9658-15316929d4ae tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:05.691494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695ac85-ce05-4315-9658-15316929d4ae tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:05.691494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5695ac85-ce05-4315-9658-15316929d4ae tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/16a5d783f67b42b2a7a40f5d9246bac5/users/15b9c31a09ff4379b316f0de188b1952/roles/56dfd36870d94fb1ac0e11f678974029/inherited_to_projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:05.694650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695ac85-ce05-4315-9658-15316929d4ae tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:create_grant(project_id=16a5d783f67b42b2a7a40f5d9246bac5, user_id=15b9c31a09ff4379b316f0de188b1952, role_id=56dfd36870d94fb1ac0e11f678974029)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:05.760259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5695ac85-ce05-4315-9658-15316929d4ae tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:05.851461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94224d6-d94d-4b44-a337-395aebbc1d34 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:05.851967 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3018/5979] 10.222.0.43 () {60 vars in 1581 bytes} [Tue Jul 19 14:40:05 2022] PUT /identity/v3/OS-INHERIT/projects/16a5d783f67b42b2a7a40f5d9246bac5/users/15b9c31a09ff4379b316f0de188b1952/roles/56dfd36870d94fb1ac0e11f678974029/inherited_to_projects => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:05.865135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94224d6-d94d-4b44-a337-395aebbc1d34 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:06.007280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f665fbc-f904-415f-8a3a-031736dece61 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:06.008096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f665fbc-f904-415f-8a3a-031736dece61 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:06.008484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f665fbc-f904-415f-8a3a-031736dece61 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:06.009077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f665fbc-f904-415f-8a3a-031736dece61 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:06.010698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f665fbc-f904-415f-8a3a-031736dece61 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Adding query filter params (scope.project.id=e955820bfe5b423ea2fabd5fac2c080d, user.id=15b9c31a09ff4379b316f0de188b1952) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:06.011128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f665fbc-f904-415f-8a3a-031736dece61 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:06.013277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f665fbc-f904-415f-8a3a-031736dece61 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:06.214338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695ac85-ce05-4315-9658-15316929d4ae tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:06.215427 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2962/5980] 10.222.0.43 () {58 vars in 1355 bytes} [Tue Jul 19 14:40:05 2022] GET /identity/v3/role_assignments?scope.project.id=e955820bfe5b423ea2fabd5fac2c080d&user.id=15b9c31a09ff4379b316f0de188b1952&effective => generated 649 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:06.244471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5695ac85-ce05-4315-9658-15316929d4ae tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:06.267164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194c061-6d62-470c-9599-f1071927da86 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:06.272307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194c061-6d62-470c-9599-f1071927da86 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:06.273600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194c061-6d62-470c-9599-f1071927da86 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:06.274373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d194c061-6d62-470c-9599-f1071927da86 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/16a5d783f67b42b2a7a40f5d9246bac5/users/15b9c31a09ff4379b316f0de188b1952/roles/56dfd36870d94fb1ac0e11f678974029/inherited_to_projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:06.279926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194c061-6d62-470c-9599-f1071927da86 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=16a5d783f67b42b2a7a40f5d9246bac5, user_id=15b9c31a09ff4379b316f0de188b1952, role_id=56dfd36870d94fb1ac0e11f678974029)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:06.290059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d194c061-6d62-470c-9599-f1071927da86 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:06.307169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d194c061-6d62-470c-9599-f1071927da86 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invalidating the token cache because role 56dfd36870d94fb1ac0e11f678974029 was removed from user 15b9c31a09ff4379b316f0de188b1952 on project 16a5d783f67b42b2a7a40f5d9246bac5. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:06.307169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d194c061-6d62-470c-9599-f1071927da86 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:06.307169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d194c061-6d62-470c-9599-f1071927da86 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:06.317849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f665fbc-f904-415f-8a3a-031736dece61 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:06.319675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0f665fbc-f904-415f-8a3a-031736dece61 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:06.416677 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3019/5981] 10.222.0.43 () {58 vars in 1565 bytes} [Tue Jul 19 14:40:06 2022] DELETE /identity/v3/OS-INHERIT/projects/16a5d783f67b42b2a7a40f5d9246bac5/users/15b9c31a09ff4379b316f0de188b1952/roles/56dfd36870d94fb1ac0e11f678974029/inherited_to_projects => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:06.418263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194c061-6d62-470c-9599-f1071927da86 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:06.419944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d194c061-6d62-470c-9599-f1071927da86 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:06.473769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f665fbc-f904-415f-8a3a-031736dece61 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:06.601287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141e220-0697-43e8-b638-fadb20bf5180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:06.602372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141e220-0697-43e8-b638-fadb20bf5180 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:06.602906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141e220-0697-43e8-b638-fadb20bf5180 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:06.603422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141e220-0697-43e8-b638-fadb20bf5180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:06.604826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d194c061-6d62-470c-9599-f1071927da86 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:06.605930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8141e220-0697-43e8-b638-fadb20bf5180 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:06.610917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eadba3-e49a-4233-9fd1-96e7958fc02b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:06.611841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eadba3-e49a-4233-9fd1-96e7958fc02b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:06.612729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eadba3-e49a-4233-9fd1-96e7958fc02b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:06.613075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eadba3-e49a-4233-9fd1-96e7958fc02b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:06.614339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eadba3-e49a-4233-9fd1-96e7958fc02b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Adding query filter params (scope.project.id=e955820bfe5b423ea2fabd5fac2c080d, user.id=15b9c31a09ff4379b316f0de188b1952) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:06.614668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eadba3-e49a-4233-9fd1-96e7958fc02b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:06.617117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eadba3-e49a-4233-9fd1-96e7958fc02b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:06.649036 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:06.741909 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3020/5982] 10.222.0.43 () {58 vars in 1355 bytes} [Tue Jul 19 14:40:06 2022] GET /identity/v3/role_assignments?scope.project.id=e955820bfe5b423ea2fabd5fac2c080d&user.id=15b9c31a09ff4379b316f0de188b1952&effective => generated 228 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:06.752076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eadba3-e49a-4233-9fd1-96e7958fc02b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:06.777708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eadba3-e49a-4233-9fd1-96e7958fc02b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:06.798531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa7eb4-01b6-4c7e-a0ac-36177d64d351 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:06.801647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa7eb4-01b6-4c7e-a0ac-36177d64d351 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:06.802145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa7eb4-01b6-4c7e-a0ac-36177d64d351 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:06.803862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa7eb4-01b6-4c7e-a0ac-36177d64d351 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/projects/e955820bfe5b423ea2fabd5fac2c080d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:06.807949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa7eb4-01b6-4c7e-a0ac-36177d64d351 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e955820bfe5b423ea2fabd5fac2c080d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:06.813309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaa7eb4-01b6-4c7e-a0ac-36177d64d351 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:06.821744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141e220-0697-43e8-b638-fadb20bf5180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:06.824643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141e220-0697-43e8-b638-fadb20bf5180 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:06.870828 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2963/5983] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:40:06.992033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4eaa7eb4-01b6-4c7e-a0ac-36177d64d351 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e955820bfe5b423ea2fabd5fac2c080d', 'request_id': 'req-4eaa7eb4-01b6-4c7e-a0ac-36177d64d351'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:07.000124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4eaa7eb4-01b6-4c7e-a0ac-36177d64d351 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e955820bfe5b423ea2fabd5fac2c080d', 'request_id': 'req-4eaa7eb4-01b6-4c7e-a0ac-36177d64d351'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:07.010996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4eaa7eb4-01b6-4c7e-a0ac-36177d64d351 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e955820bfe5b423ea2fabd5fac2c080d', 'request_id': 'req-4eaa7eb4-01b6-4c7e-a0ac-36177d64d351'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:07.015307 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:07.111895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4eaa7eb4-01b6-4c7e-a0ac-36177d64d351 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] The token cache is being invalidate because project e955820bfe5b423ea2fabd5fac2c080d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:07.113005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4eaa7eb4-01b6-4c7e-a0ac-36177d64d351 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:07.114957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4eaa7eb4-01b6-4c7e-a0ac-36177d64d351 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:07.121369 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3021/5984] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:06 2022] DELETE /identity/v3/projects/e955820bfe5b423ea2fabd5fac2c080d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:07.122821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141e220-0697-43e8-b638-fadb20bf5180 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:07.147233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141e220-0697-43e8-b638-fadb20bf5180 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:07.244372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c3e30-327d-44ef-975d-ac478472131e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:07.244970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c3e30-327d-44ef-975d-ac478472131e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:07.244970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c3e30-327d-44ef-975d-ac478472131e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:07.291477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e47c3e30-327d-44ef-975d-ac478472131e None None] MFA Rules not processed for user `d1cbf58d0cf8440aae63bf31387948f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:07.296561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e47c3e30-327d-44ef-975d-ac478472131e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:07.335620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16188a-4e8a-4444-bb41-35a84f213d06 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:07.337528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16188a-4e8a-4444-bb41-35a84f213d06 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:07.337778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16188a-4e8a-4444-bb41-35a84f213d06 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:07.338066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16188a-4e8a-4444-bb41-35a84f213d06 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/roles/56dfd36870d94fb1ac0e11f678974029` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:07.343287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16188a-4e8a-4444-bb41-35a84f213d06 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:delete_role(role_id=56dfd36870d94fb1ac0e11f678974029)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:07.346711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16188a-4e8a-4444-bb41-35a84f213d06 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:07.526084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ab16188a-4e8a-4444-bb41-35a84f213d06 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invalidating the token cache because role 56dfd36870d94fb1ac0e11f678974029 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:07.526084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ab16188a-4e8a-4444-bb41-35a84f213d06 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:07.526084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ab16188a-4e8a-4444-bb41-35a84f213d06 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:07.527438 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3022/5985] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:07.528118 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2964/5986] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:07 2022] DELETE /identity/v3/roles/56dfd36870d94fb1ac0e11f678974029 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:07.532906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c3e30-327d-44ef-975d-ac478472131e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:07.534461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e47c3e30-327d-44ef-975d-ac478472131e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:07.563312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c3e30-327d-44ef-975d-ac478472131e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:07.666400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82090320-1735-4566-80e5-25a8bc10a667 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:07.667661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82090320-1735-4566-80e5-25a8bc10a667 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:07.668123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82090320-1735-4566-80e5-25a8bc10a667 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:07.673961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82090320-1735-4566-80e5-25a8bc10a667 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/users/15b9c31a09ff4379b316f0de188b1952` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:07.673961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82090320-1735-4566-80e5-25a8bc10a667 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:delete_user(user_id=15b9c31a09ff4379b316f0de188b1952)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:07.675575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82090320-1735-4566-80e5-25a8bc10a667 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:07.856114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-82090320-1735-4566-80e5-25a8bc10a667 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15b9c31a09ff4379b316f0de188b1952'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:07.923259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-82090320-1735-4566-80e5-25a8bc10a667 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15b9c31a09ff4379b316f0de188b1952'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:07.947254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-82090320-1735-4566-80e5-25a8bc10a667 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15b9c31a09ff4379b316f0de188b1952'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:07.951086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-82090320-1735-4566-80e5-25a8bc10a667 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15b9c31a09ff4379b316f0de188b1952'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:08.071337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-82090320-1735-4566-80e5-25a8bc10a667 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15b9c31a09ff4379b316f0de188b1952'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:08.089789 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3023/5987] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:07 2022] DELETE /identity/v3/users/15b9c31a09ff4379b316f0de188b1952 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:08.093444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16188a-4e8a-4444-bb41-35a84f213d06 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:08.097240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ab16188a-4e8a-4444-bb41-35a84f213d06 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:08.124428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16188a-4e8a-4444-bb41-35a84f213d06 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:08.328025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03d9c1-2bb0-41b9-a536-16b5c8bafc4d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:08.328929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03d9c1-2bb0-41b9-a536-16b5c8bafc4d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:08.329224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03d9c1-2bb0-41b9-a536-16b5c8bafc4d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:08.329512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03d9c1-2bb0-41b9-a536-16b5c8bafc4d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/groups/438db4300c2f4f9d9ab53af1ab4982f5` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:08.331726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03d9c1-2bb0-41b9-a536-16b5c8bafc4d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:delete_group(group_id=438db4300c2f4f9d9ab53af1ab4982f5)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:08.333853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03d9c1-2bb0-41b9-a536-16b5c8bafc4d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:08.378130 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:08.551379 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2965/5988] 10.222.0.43 () {58 vars in 1226 bytes} [Tue Jul 19 14:40:08 2022] DELETE /identity/v3/groups/438db4300c2f4f9d9ab53af1ab4982f5 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:08.554955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82090320-1735-4566-80e5-25a8bc10a667 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:08.557113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-82090320-1735-4566-80e5-25a8bc10a667 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:08.580251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82090320-1735-4566-80e5-25a8bc10a667 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:08.590327 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:08.761795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c9941-a2ae-4bc2-9e12-9de9222da980 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:08.773986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c9941-a2ae-4bc2-9e12-9de9222da980 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:08.774341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c9941-a2ae-4bc2-9e12-9de9222da980 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:08.774754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c9941-a2ae-4bc2-9e12-9de9222da980 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/projects/16a5d783f67b42b2a7a40f5d9246bac5` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:08.779482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c9941-a2ae-4bc2-9e12-9de9222da980 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:delete_project(project_id=16a5d783f67b42b2a7a40f5d9246bac5)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:08.784176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c9941-a2ae-4bc2-9e12-9de9222da980 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:08.996697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-213c9941-a2ae-4bc2-9e12-9de9222da980 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16a5d783f67b42b2a7a40f5d9246bac5', 'request_id': 'req-213c9941-a2ae-4bc2-9e12-9de9222da980'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:09.010451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-213c9941-a2ae-4bc2-9e12-9de9222da980 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16a5d783f67b42b2a7a40f5d9246bac5', 'request_id': 'req-213c9941-a2ae-4bc2-9e12-9de9222da980'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:09.030578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-213c9941-a2ae-4bc2-9e12-9de9222da980 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16a5d783f67b42b2a7a40f5d9246bac5', 'request_id': 'req-213c9941-a2ae-4bc2-9e12-9de9222da980'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:09.147192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-213c9941-a2ae-4bc2-9e12-9de9222da980 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] The token cache is being invalidate because project 16a5d783f67b42b2a7a40f5d9246bac5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:09.147605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-213c9941-a2ae-4bc2-9e12-9de9222da980 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:09.152712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-213c9941-a2ae-4bc2-9e12-9de9222da980 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:09.155106 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3024/5989] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:08 2022] DELETE /identity/v3/projects/16a5d783f67b42b2a7a40f5d9246bac5 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:09.159687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03d9c1-2bb0-41b9-a536-16b5c8bafc4d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:09.162005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ce03d9c1-2bb0-41b9-a536-16b5c8bafc4d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:09.210883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03d9c1-2bb0-41b9-a536-16b5c8bafc4d tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:09.351848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c9941-a2ae-4bc2-9e12-9de9222da980 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:09.353464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-213c9941-a2ae-4bc2-9e12-9de9222da980 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:09.411198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86abfb-14e5-4ea3-bd06-292d634952d3 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:09.412345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86abfb-14e5-4ea3-bd06-292d634952d3 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:09.412790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86abfb-14e5-4ea3-bd06-292d634952d3 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:09.413224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86abfb-14e5-4ea3-bd06-292d634952d3 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/domains/97a673842e094be986a646ee1ca29cef` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:09.414962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86abfb-14e5-4ea3-bd06-292d634952d3 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=97a673842e094be986a646ee1ca29cef)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:09.416734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86abfb-14e5-4ea3-bd06-292d634952d3 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:09.448743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8f86abfb-14e5-4ea3-bd06-292d634952d3 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '97a673842e094be986a646ee1ca29cef'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:09.449691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8f86abfb-14e5-4ea3-bd06-292d634952d3 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '97a673842e094be986a646ee1ca29cef'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:09.489806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c9941-a2ae-4bc2-9e12-9de9222da980 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:09.577190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8f86abfb-14e5-4ea3-bd06-292d634952d3 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '97a673842e094be986a646ee1ca29cef'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:09.580095 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8f86abfb-14e5-4ea3-bd06-292d634952d3 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '97a673842e094be986a646ee1ca29cef'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:09.588700 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2966/5990] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:40:09 2022] PATCH /identity/v3/domains/97a673842e094be986a646ee1ca29cef => generated 277 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:09.592701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86abfb-14e5-4ea3-bd06-292d634952d3 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:09.595870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8f86abfb-14e5-4ea3-bd06-292d634952d3 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:09.632484 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:09.656498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0410e0-cdf9-4f90-b236-89eecaae5838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:09.657635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0410e0-cdf9-4f90-b236-89eecaae5838 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:09.658403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0410e0-cdf9-4f90-b236-89eecaae5838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:09.658831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0410e0-cdf9-4f90-b236-89eecaae5838 admin admin] PATH_INFO: `/v3/users/2a93cb6e76d842089793093b456f0fb9` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:09.661077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0410e0-cdf9-4f90-b236-89eecaae5838 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a93cb6e76d842089793093b456f0fb9)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:09.664856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0410e0-cdf9-4f90-b236-89eecaae5838 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:09.721582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86abfb-14e5-4ea3-bd06-292d634952d3 tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:09.734406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328523ac-4603-4904-8e1e-6751726a1d2b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd7de3788ab374648ba9c933aac807bbe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e46b7681a284aeca828f174ed8c4766', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:09.739305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328523ac-4603-4904-8e1e-6751726a1d2b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:09.739305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328523ac-4603-4904-8e1e-6751726a1d2b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:09.739305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328523ac-4603-4904-8e1e-6751726a1d2b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] PATH_INFO: `/v3/domains/97a673842e094be986a646ee1ca29cef` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:09.779183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328523ac-4603-4904-8e1e-6751726a1d2b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=97a673842e094be986a646ee1ca29cef)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:09.781142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328523ac-4603-4904-8e1e-6751726a1d2b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:09.848383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-328523ac-4603-4904-8e1e-6751726a1d2b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '97a673842e094be986a646ee1ca29cef'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:09.864447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-328523ac-4603-4904-8e1e-6751726a1d2b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '97a673842e094be986a646ee1ca29cef'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:09.877597 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:09.904997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4f0410e0-cdf9-4f90-b236-89eecaae5838 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a93cb6e76d842089793093b456f0fb9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:09.927967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4f0410e0-cdf9-4f90-b236-89eecaae5838 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a93cb6e76d842089793093b456f0fb9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:09.954875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4f0410e0-cdf9-4f90-b236-89eecaae5838 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a93cb6e76d842089793093b456f0fb9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:09.961585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4f0410e0-cdf9-4f90-b236-89eecaae5838 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a93cb6e76d842089793093b456f0fb9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:10.019440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-328523ac-4603-4904-8e1e-6751726a1d2b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a673842e094be986a646ee1ca29cef', 'request_id': 'req-328523ac-4603-4904-8e1e-6751726a1d2b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:10.083180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4f0410e0-cdf9-4f90-b236-89eecaae5838 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a93cb6e76d842089793093b456f0fb9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:10.097241 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3025/5991] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:09 2022] DELETE /identity/v3/users/2a93cb6e76d842089793093b456f0fb9 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:40:10.197389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-328523ac-4603-4904-8e1e-6751726a1d2b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a673842e094be986a646ee1ca29cef', 'request_id': 'req-328523ac-4603-4904-8e1e-6751726a1d2b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:10.210556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-328523ac-4603-4904-8e1e-6751726a1d2b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a673842e094be986a646ee1ca29cef', 'request_id': 'req-328523ac-4603-4904-8e1e-6751726a1d2b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:10.244173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-328523ac-4603-4904-8e1e-6751726a1d2b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] The token cache is being invalidate because project 97a673842e094be986a646ee1ca29cef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:10.244558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-328523ac-4603-4904-8e1e-6751726a1d2b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:10.245350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-328523ac-4603-4904-8e1e-6751726a1d2b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:10.303347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-328523ac-4603-4904-8e1e-6751726a1d2b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '97a673842e094be986a646ee1ca29cef', 'request_id': 'req-328523ac-4603-4904-8e1e-6751726a1d2b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:10.306515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-328523ac-4603-4904-8e1e-6751726a1d2b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '97a673842e094be986a646ee1ca29cef', 'request_id': 'req-328523ac-4603-4904-8e1e-6751726a1d2b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:10.312356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-328523ac-4603-4904-8e1e-6751726a1d2b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '97a673842e094be986a646ee1ca29cef', 'request_id': 'req-328523ac-4603-4904-8e1e-6751726a1d2b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:10.374417 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2967/5992] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:40:09 2022] DELETE /identity/v3/domains/97a673842e094be986a646ee1ca29cef => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:10.378736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0410e0-cdf9-4f90-b236-89eecaae5838 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:10.380523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4f0410e0-cdf9-4f90-b236-89eecaae5838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:10.556116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0410e0-cdf9-4f90-b236-89eecaae5838 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:10.572503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328523ac-4603-4904-8e1e-6751726a1d2b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:10.572503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-328523ac-4603-4904-8e1e-6751726a1d2b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:10.572752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b63ac-c1a7-4c71-b5c6-372ddccba174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:10.572752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b63ac-c1a7-4c71-b5c6-372ddccba174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:10.572752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b63ac-c1a7-4c71-b5c6-372ddccba174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:10.572752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b63ac-c1a7-4c71-b5c6-372ddccba174 admin admin] PATH_INFO: `/v3/users/b392dfca826d4919811fcebf56061878` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:10.573350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b63ac-c1a7-4c71-b5c6-372ddccba174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b392dfca826d4919811fcebf56061878)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:10.577033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269b63ac-c1a7-4c71-b5c6-372ddccba174 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:10.742421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328523ac-4603-4904-8e1e-6751726a1d2b tempest-InheritsV3TestJSON-1794920699 tempest-InheritsV3TestJSON-1794920699-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:10.752283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e3904-dfd5-4f7f-a76a-1d7edf8b2d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:10.754961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e3904-dfd5-4f7f-a76a-1d7edf8b2d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:10.755592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e3904-dfd5-4f7f-a76a-1d7edf8b2d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:10.756662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e3904-dfd5-4f7f-a76a-1d7edf8b2d0d admin admin] PATH_INFO: `/v3/projects/901775c14f244f5b92529500f8eb2a6d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:10.758894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e3904-dfd5-4f7f-a76a-1d7edf8b2d0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=901775c14f244f5b92529500f8eb2a6d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:10.762837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9e3904-dfd5-4f7f-a76a-1d7edf8b2d0d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:10.973739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-269b63ac-c1a7-4c71-b5c6-372ddccba174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b392dfca826d4919811fcebf56061878'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:10.998327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7d9e3904-dfd5-4f7f-a76a-1d7edf8b2d0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '901775c14f244f5b92529500f8eb2a6d', 'request_id': 'req-7d9e3904-dfd5-4f7f-a76a-1d7edf8b2d0d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:11.011516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-269b63ac-c1a7-4c71-b5c6-372ddccba174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b392dfca826d4919811fcebf56061878'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:11.014084 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:11.021151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-269b63ac-c1a7-4c71-b5c6-372ddccba174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b392dfca826d4919811fcebf56061878'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:11.021907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-269b63ac-c1a7-4c71-b5c6-372ddccba174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b392dfca826d4919811fcebf56061878'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:11.109837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7d9e3904-dfd5-4f7f-a76a-1d7edf8b2d0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '901775c14f244f5b92529500f8eb2a6d', 'request_id': 'req-7d9e3904-dfd5-4f7f-a76a-1d7edf8b2d0d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:11.139954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7d9e3904-dfd5-4f7f-a76a-1d7edf8b2d0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '901775c14f244f5b92529500f8eb2a6d', 'request_id': 'req-7d9e3904-dfd5-4f7f-a76a-1d7edf8b2d0d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:11.174011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7d9e3904-dfd5-4f7f-a76a-1d7edf8b2d0d admin admin] The token cache is being invalidate because project 901775c14f244f5b92529500f8eb2a6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:11.174335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7d9e3904-dfd5-4f7f-a76a-1d7edf8b2d0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:11.175835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7d9e3904-dfd5-4f7f-a76a-1d7edf8b2d0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:11.183867 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2968/5993] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:10 2022] DELETE /identity/v3/projects/901775c14f244f5b92529500f8eb2a6d => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:40:11.185083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e3904-dfd5-4f7f-a76a-1d7edf8b2d0d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:11.186817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7d9e3904-dfd5-4f7f-a76a-1d7edf8b2d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:11.208596 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:11.246642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-269b63ac-c1a7-4c71-b5c6-372ddccba174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b392dfca826d4919811fcebf56061878'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:11.251888 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3026/5994] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:10 2022] DELETE /identity/v3/users/b392dfca826d4919811fcebf56061878 => generated 0 bytes in 871 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:11.253599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d96c7-3597-48a1-aa43-4b87b85caf96 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:11.253922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d96c7-3597-48a1-aa43-4b87b85caf96 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:11.254408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d96c7-3597-48a1-aa43-4b87b85caf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:11.311653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-dd5d96c7-3597-48a1-aa43-4b87b85caf96 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:11.316655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dd5d96c7-3597-48a1-aa43-4b87b85caf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:11.336992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9e3904-dfd5-4f7f-a76a-1d7edf8b2d0d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:11.517892 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3027/5995] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:11.531449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d96c7-3597-48a1-aa43-4b87b85caf96 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:11.533788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dd5d96c7-3597-48a1-aa43-4b87b85caf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:11.543723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db90aa-6618-4f17-99b8-fb3135654999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:11.544645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db90aa-6618-4f17-99b8-fb3135654999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:11.544934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db90aa-6618-4f17-99b8-fb3135654999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:11.545212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1db90aa-6618-4f17-99b8-fb3135654999 admin admin] PATH_INFO: `/v3/users/9be9abcfffd84835bb4ab8c3d6c28abc` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:11.551254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db90aa-6618-4f17-99b8-fb3135654999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be9abcfffd84835bb4ab8c3d6c28abc)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:11.553363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1db90aa-6618-4f17-99b8-fb3135654999 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:11.678367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d96c7-3597-48a1-aa43-4b87b85caf96 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:11.685878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14da61-0422-4aa4-8bd9-4ec8998bb756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:11.686592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14da61-0422-4aa4-8bd9-4ec8998bb756 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:11.687008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14da61-0422-4aa4-8bd9-4ec8998bb756 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:11.687358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14da61-0422-4aa4-8bd9-4ec8998bb756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:11.717852 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14da61-0422-4aa4-8bd9-4ec8998bb756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:11.720007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14da61-0422-4aa4-8bd9-4ec8998bb756 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:11.751062 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3028/5996] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:40:11.994918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d1db90aa-6618-4f17-99b8-fb3135654999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be9abcfffd84835bb4ab8c3d6c28abc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:12.048583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d1db90aa-6618-4f17-99b8-fb3135654999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be9abcfffd84835bb4ab8c3d6c28abc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:12.051828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d1db90aa-6618-4f17-99b8-fb3135654999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be9abcfffd84835bb4ab8c3d6c28abc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:12.053053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d1db90aa-6618-4f17-99b8-fb3135654999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be9abcfffd84835bb4ab8c3d6c28abc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:12.090858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d1db90aa-6618-4f17-99b8-fb3135654999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be9abcfffd84835bb4ab8c3d6c28abc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:12.211274 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2969/5997] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:11 2022] DELETE /identity/v3/users/9be9abcfffd84835bb4ab8c3d6c28abc => generated 0 bytes in 1024 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:12.559289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14da61-0422-4aa4-8bd9-4ec8998bb756 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:12.560968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bb14da61-0422-4aa4-8bd9-4ec8998bb756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:12.584030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14da61-0422-4aa4-8bd9-4ec8998bb756 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:12.768266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b705fc9-6f7b-4b91-bbc5-9f632b34168b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:12.769701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b705fc9-6f7b-4b91-bbc5-9f632b34168b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:12.769991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b705fc9-6f7b-4b91-bbc5-9f632b34168b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:12.774427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b705fc9-6f7b-4b91-bbc5-9f632b34168b admin admin] PATH_INFO: `/v3/projects/90245facf464421fb58224c06596b809` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:12.779199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b705fc9-6f7b-4b91-bbc5-9f632b34168b admin admin] RBAC: Authorizing `identity:delete_project(project_id=90245facf464421fb58224c06596b809)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:12.781140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b705fc9-6f7b-4b91-bbc5-9f632b34168b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:12.950751 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:12.983727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b705fc9-6f7b-4b91-bbc5-9f632b34168b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90245facf464421fb58224c06596b809', 'request_id': 'req-6b705fc9-6f7b-4b91-bbc5-9f632b34168b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:12.998768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b705fc9-6f7b-4b91-bbc5-9f632b34168b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90245facf464421fb58224c06596b809', 'request_id': 'req-6b705fc9-6f7b-4b91-bbc5-9f632b34168b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:13.023518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b705fc9-6f7b-4b91-bbc5-9f632b34168b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90245facf464421fb58224c06596b809', 'request_id': 'req-6b705fc9-6f7b-4b91-bbc5-9f632b34168b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:13.165667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db90aa-6618-4f17-99b8-fb3135654999 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:13.167177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d1db90aa-6618-4f17-99b8-fb3135654999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:13.170877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b705fc9-6f7b-4b91-bbc5-9f632b34168b admin admin] The token cache is being invalidate because project 90245facf464421fb58224c06596b809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:13.171185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b705fc9-6f7b-4b91-bbc5-9f632b34168b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:13.172828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6b705fc9-6f7b-4b91-bbc5-9f632b34168b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:13.195557 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3029/5998] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:12 2022] DELETE /identity/v3/projects/90245facf464421fb58224c06596b809 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:13.195738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1db90aa-6618-4f17-99b8-fb3135654999 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:13.201167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b705fc9-6f7b-4b91-bbc5-9f632b34168b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:13.214292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6b705fc9-6f7b-4b91-bbc5-9f632b34168b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:13.333211 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:13.411860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1379c2a-13f7-418a-a8ba-095b5dec34b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:13.412857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1379c2a-13f7-418a-a8ba-095b5dec34b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:13.413185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1379c2a-13f7-418a-a8ba-095b5dec34b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:13.413528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1379c2a-13f7-418a-a8ba-095b5dec34b3 admin admin] PATH_INFO: `/v3/projects/33023e7e73454f29b1c9774231b80ab9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:13.420909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1379c2a-13f7-418a-a8ba-095b5dec34b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33023e7e73454f29b1c9774231b80ab9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:13.426805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1379c2a-13f7-418a-a8ba-095b5dec34b3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:13.532512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b705fc9-6f7b-4b91-bbc5-9f632b34168b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:13.543772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8d1b8-eb1c-468d-9555-738d489cba20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:13.549182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8d1b8-eb1c-468d-9555-738d489cba20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:13.550223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8d1b8-eb1c-468d-9555-738d489cba20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:13.551405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8d1b8-eb1c-468d-9555-738d489cba20 admin admin] PATH_INFO: `/v3/users/d7de3788ab374648ba9c933aac807bbe` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:13.555286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8d1b8-eb1c-468d-9555-738d489cba20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7de3788ab374648ba9c933aac807bbe)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:13.583051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8d1b8-eb1c-468d-9555-738d489cba20 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:13.627496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d1379c2a-13f7-418a-a8ba-095b5dec34b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33023e7e73454f29b1c9774231b80ab9', 'request_id': 'req-d1379c2a-13f7-418a-a8ba-095b5dec34b3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:13.744962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d1379c2a-13f7-418a-a8ba-095b5dec34b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33023e7e73454f29b1c9774231b80ab9', 'request_id': 'req-d1379c2a-13f7-418a-a8ba-095b5dec34b3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:13.750984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d1379c2a-13f7-418a-a8ba-095b5dec34b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33023e7e73454f29b1c9774231b80ab9', 'request_id': 'req-d1379c2a-13f7-418a-a8ba-095b5dec34b3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:13.776479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d1379c2a-13f7-418a-a8ba-095b5dec34b3 admin admin] The token cache is being invalidate because project 33023e7e73454f29b1c9774231b80ab9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:13.777104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d1379c2a-13f7-418a-a8ba-095b5dec34b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:13.778290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d1379c2a-13f7-418a-a8ba-095b5dec34b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:13.780824 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2970/5999] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:13 2022] DELETE /identity/v3/projects/33023e7e73454f29b1c9774231b80ab9 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:40:13.787675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf144cd6-24e4-4469-ae7d-e3749bb57f4e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:13.788276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf144cd6-24e4-4469-ae7d-e3749bb57f4e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:13.788769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf144cd6-24e4-4469-ae7d-e3749bb57f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:13.848874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-cf144cd6-24e4-4469-ae7d-e3749bb57f4e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:13.853237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cf144cd6-24e4-4469-ae7d-e3749bb57f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:13.982572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-92f8d1b8-eb1c-468d-9555-738d489cba20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7de3788ab374648ba9c933aac807bbe'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:14.010345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-92f8d1b8-eb1c-468d-9555-738d489cba20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7de3788ab374648ba9c933aac807bbe'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:14.032207 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2971/6000] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:40:14.034410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397c525-0410-41b4-a3ce-25d3aa7611cf None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:14.034938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397c525-0410-41b4-a3ce-25d3aa7611cf None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:14.035206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-92f8d1b8-eb1c-468d-9555-738d489cba20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7de3788ab374648ba9c933aac807bbe'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:14.035987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-92f8d1b8-eb1c-468d-9555-738d489cba20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7de3788ab374648ba9c933aac807bbe'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:14.037604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397c525-0410-41b4-a3ce-25d3aa7611cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:14.113785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-92f8d1b8-eb1c-468d-9555-738d489cba20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7de3788ab374648ba9c933aac807bbe'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:14.115473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e397c525-0410-41b4-a3ce-25d3aa7611cf None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:14.118836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e397c525-0410-41b4-a3ce-25d3aa7611cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:14.124306 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3030/6001] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:13 2022] DELETE /identity/v3/users/d7de3788ab374648ba9c933aac807bbe => generated 0 bytes in 922 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:14.475241 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2972/6002] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:14.482792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8d1b8-eb1c-468d-9555-738d489cba20 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:14.496436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8d1b8-eb1c-468d-9555-738d489cba20 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:14.524923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43b0b0-c50b-4361-b0c5-0be7f1e51396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:14.526979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43b0b0-c50b-4361-b0c5-0be7f1e51396 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:14.527278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43b0b0-c50b-4361-b0c5-0be7f1e51396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:14.532539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e43b0b0-c50b-4361-b0c5-0be7f1e51396 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:14.533347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43b0b0-c50b-4361-b0c5-0be7f1e51396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:14.533675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43b0b0-c50b-4361-b0c5-0be7f1e51396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:14.535709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e43b0b0-c50b-4361-b0c5-0be7f1e51396 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:14.587482 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3031/6003] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:40:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:14.588714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397c525-0410-41b4-a3ce-25d3aa7611cf None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:14.600317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397c525-0410-41b4-a3ce-25d3aa7611cf None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:14.616500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69147e68-ae81-4dd0-b01a-ee86c42948bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:14.617679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69147e68-ae81-4dd0-b01a-ee86c42948bb admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:14.618173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69147e68-ae81-4dd0-b01a-ee86c42948bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:14.620759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69147e68-ae81-4dd0-b01a-ee86c42948bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:14.620759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69147e68-ae81-4dd0-b01a-ee86c42948bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:14.621663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69147e68-ae81-4dd0-b01a-ee86c42948bb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:14.627255 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:14.819824 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2973/6004] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:14 2022] POST /identity/v3/projects => generated 383 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:14.823112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43b0b0-c50b-4361-b0c5-0be7f1e51396 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:14.840725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e43b0b0-c50b-4361-b0c5-0be7f1e51396 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:15.020411 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:15.177693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9679f7b-8293-42fe-92f1-30d4b3116e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:15.178854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9679f7b-8293-42fe-92f1-30d4b3116e1b admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:15.179361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9679f7b-8293-42fe-92f1-30d4b3116e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:15.179809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9679f7b-8293-42fe-92f1-30d4b3116e1b admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:15.180692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9679f7b-8293-42fe-92f1-30d4b3116e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:15.192155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9679f7b-8293-42fe-92f1-30d4b3116e1b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:15.417702 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3032/6005] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:14 2022] POST /identity/v3/users => generated 292 bytes in 583 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:15.419070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69147e68-ae81-4dd0-b01a-ee86c42948bb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:15.436499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69147e68-ae81-4dd0-b01a-ee86c42948bb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:15.452707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183f1e2-a3a9-43a8-822c-287cc739241e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:15.453476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183f1e2-a3a9-43a8-822c-287cc739241e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:15.454433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183f1e2-a3a9-43a8-822c-287cc739241e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:15.454433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9183f1e2-a3a9-43a8-822c-287cc739241e admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:15.454820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183f1e2-a3a9-43a8-822c-287cc739241e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:15.457151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9183f1e2-a3a9-43a8-822c-287cc739241e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:15.485943 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2974/6006] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:15.488050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9679f7b-8293-42fe-92f1-30d4b3116e1b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:15.502566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9679f7b-8293-42fe-92f1-30d4b3116e1b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:15.508970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b16bd-d89e-432e-90c6-62d3aec292c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:15.509678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b16bd-d89e-432e-90c6-62d3aec292c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:15.510362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b16bd-d89e-432e-90c6-62d3aec292c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:15.510362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295b16bd-d89e-432e-90c6-62d3aec292c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:15.512310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b16bd-d89e-432e-90c6-62d3aec292c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:15.512898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295b16bd-d89e-432e-90c6-62d3aec292c4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:15.528623 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3033/6007] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:15.530220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183f1e2-a3a9-43a8-822c-287cc739241e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:15.546179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9183f1e2-a3a9-43a8-822c-287cc739241e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:15.552909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da1952-1f8e-4018-bb3d-645315f9c19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:15.554784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da1952-1f8e-4018-bb3d-645315f9c19c admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:15.555282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da1952-1f8e-4018-bb3d-645315f9c19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:15.555757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da1952-1f8e-4018-bb3d-645315f9c19c admin admin] PATH_INFO: `/v3/projects/0b48c1d65a7e4b44813faf11813a0fb9/users/04bfcc3a885d43f7a4f7b1f34ec460bc/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:15.579759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da1952-1f8e-4018-bb3d-645315f9c19c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b48c1d65a7e4b44813faf11813a0fb9, user_id=04bfcc3a885d43f7a4f7b1f34ec460bc, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:15.583581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da1952-1f8e-4018-bb3d-645315f9c19c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:15.596779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b16bd-d89e-432e-90c6-62d3aec292c4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:15.599170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-295b16bd-d89e-432e-90c6-62d3aec292c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:15.660359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295b16bd-d89e-432e-90c6-62d3aec292c4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:15.697094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fa8c2-2344-45e4-85ee-84b598c3687e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:15.697094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fa8c2-2344-45e4-85ee-84b598c3687e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:15.697576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fa8c2-2344-45e4-85ee-84b598c3687e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:15.697669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fa8c2-2344-45e4-85ee-84b598c3687e admin admin] PATH_INFO: `/v3/projects/2e46b7681a284aeca828f174ed8c4766` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:15.702982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fa8c2-2344-45e4-85ee-84b598c3687e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e46b7681a284aeca828f174ed8c4766)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:15.707644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fa8c2-2344-45e4-85ee-84b598c3687e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:15.745799 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2975/6008] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:15 2022] PUT /identity/v3/projects/0b48c1d65a7e4b44813faf11813a0fb9/users/04bfcc3a885d43f7a4f7b1f34ec460bc/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:15.748509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8675a7b-c392-4a5b-b608-3c531f9976f5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:15.753817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8675a7b-c392-4a5b-b608-3c531f9976f5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:15.762752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8675a7b-c392-4a5b-b608-3c531f9976f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:15.829024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e8675a7b-c392-4a5b-b608-3c531f9976f5 None None] MFA Rules not processed for user `04bfcc3a885d43f7a4f7b1f34ec460bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:15.830547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e8675a7b-c392-4a5b-b608-3c531f9976f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:15.924059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6c8fa8c2-2344-45e4-85ee-84b598c3687e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e46b7681a284aeca828f174ed8c4766', 'request_id': 'req-6c8fa8c2-2344-45e4-85ee-84b598c3687e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:15.931651 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2976/6009] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:15.937230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8675a7b-c392-4a5b-b608-3c531f9976f5 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:15.950398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6c8fa8c2-2344-45e4-85ee-84b598c3687e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e46b7681a284aeca828f174ed8c4766', 'request_id': 'req-6c8fa8c2-2344-45e4-85ee-84b598c3687e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:15.990185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6c8fa8c2-2344-45e4-85ee-84b598c3687e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e46b7681a284aeca828f174ed8c4766', 'request_id': 'req-6c8fa8c2-2344-45e4-85ee-84b598c3687e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:16.042686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8675a7b-c392-4a5b-b608-3c531f9976f5 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:16.109107 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:16.131084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b2a23-4126-44e0-9480-f718a2d8b4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:16.132070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b2a23-4126-44e0-9480-f718a2d8b4bb admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:16.132435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b2a23-4126-44e0-9480-f718a2d8b4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:16.132805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3b2a23-4126-44e0-9480-f718a2d8b4bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:16.134016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6c8fa8c2-2344-45e4-85ee-84b598c3687e admin admin] The token cache is being invalidate because project 2e46b7681a284aeca828f174ed8c4766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:16.134343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b2a23-4126-44e0-9480-f718a2d8b4bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:16.134503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6c8fa8c2-2344-45e4-85ee-84b598c3687e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:16.136522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3b2a23-4126-44e0-9480-f718a2d8b4bb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:16.139737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6c8fa8c2-2344-45e4-85ee-84b598c3687e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:16.146261 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3034/6010] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:15 2022] DELETE /identity/v3/projects/2e46b7681a284aeca828f174ed8c4766 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:16.150944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae6d43-0f84-47d2-a4b0-3d2f73838115 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:16.151448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae6d43-0f84-47d2-a4b0-3d2f73838115 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:16.151938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ae6d43-0f84-47d2-a4b0-3d2f73838115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:16.194638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e4ae6d43-0f84-47d2-a4b0-3d2f73838115 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:16.196177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e4ae6d43-0f84-47d2-a4b0-3d2f73838115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:16.208345 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3035/6011] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:40:16.216058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dca170-db89-4aea-8bcc-ba1dfb3b464e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:16.216468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dca170-db89-4aea-8bcc-ba1dfb3b464e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:16.217083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dca170-db89-4aea-8bcc-ba1dfb3b464e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:16.289111 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2977/6012] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:15 2022] POST /identity/v3/projects => generated 381 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:16.295144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b2a23-4126-44e0-9480-f718a2d8b4bb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:16.305451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9d3b2a23-4126-44e0-9480-f718a2d8b4bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:16.316765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a1dca170-db89-4aea-8bcc-ba1dfb3b464e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:16.322802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a1dca170-db89-4aea-8bcc-ba1dfb3b464e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:16.509753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3b2a23-4126-44e0-9480-f718a2d8b4bb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:16.533589 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3036/6013] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:16.533589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dca170-db89-4aea-8bcc-ba1dfb3b464e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:16.536368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a1dca170-db89-4aea-8bcc-ba1dfb3b464e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:16.539118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84227303-8327-4f99-a605-405678b0808b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:16.539118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84227303-8327-4f99-a605-405678b0808b admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:16.539118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84227303-8327-4f99-a605-405678b0808b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:16.541614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84227303-8327-4f99-a605-405678b0808b admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:16.542454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84227303-8327-4f99-a605-405678b0808b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:16.548944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84227303-8327-4f99-a605-405678b0808b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:16.576692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dca170-db89-4aea-8bcc-ba1dfb3b464e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:16.586269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eebc0a-f8a4-43c1-b16a-a7586c25b2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:16.587132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eebc0a-f8a4-43c1-b16a-a7586c25b2b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:16.587420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eebc0a-f8a4-43c1-b16a-a7586c25b2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:16.587708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eebc0a-f8a4-43c1-b16a-a7586c25b2b7 admin admin] PATH_INFO: `/v3/users/4dd7c55c8952488685691a07de3207a8` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:16.591197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eebc0a-f8a4-43c1-b16a-a7586c25b2b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dd7c55c8952488685691a07de3207a8)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:16.593187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eebc0a-f8a4-43c1-b16a-a7586c25b2b7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:16.646645 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:16.684561 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2978/6014] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:16 2022] POST /identity/v3/users => generated 297 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:16.688646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84227303-8327-4f99-a605-405678b0808b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:16.713456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84227303-8327-4f99-a605-405678b0808b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:16.719368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d35834-3cce-4a39-8718-5cddc7c19f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:16.720036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d35834-3cce-4a39-8718-5cddc7c19f68 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:16.720320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d35834-3cce-4a39-8718-5cddc7c19f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:16.720596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d35834-3cce-4a39-8718-5cddc7c19f68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:16.721336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d35834-3cce-4a39-8718-5cddc7c19f68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:16.723347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d35834-3cce-4a39-8718-5cddc7c19f68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:16.728919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d35834-3cce-4a39-8718-5cddc7c19f68 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:16.752929 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2979/6015] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:16.753780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d35834-3cce-4a39-8718-5cddc7c19f68 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:16.778008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d35834-3cce-4a39-8718-5cddc7c19f68 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:16.797743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698417d-6fc2-4f50-b8ce-a82a07361742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:16.798721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698417d-6fc2-4f50-b8ce-a82a07361742 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:16.799084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698417d-6fc2-4f50-b8ce-a82a07361742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:16.799461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698417d-6fc2-4f50-b8ce-a82a07361742 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:16.800662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698417d-6fc2-4f50-b8ce-a82a07361742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:16.802456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8698417d-6fc2-4f50-b8ce-a82a07361742 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:16.819040 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2980/6016] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:16.820211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698417d-6fc2-4f50-b8ce-a82a07361742 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:16.835894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698417d-6fc2-4f50-b8ce-a82a07361742 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:16.852282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed995e7-07c2-45fd-90a0-1c0e6064f5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:16.853254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed995e7-07c2-45fd-90a0-1c0e6064f5e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:16.853643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed995e7-07c2-45fd-90a0-1c0e6064f5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:16.854025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed995e7-07c2-45fd-90a0-1c0e6064f5e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:16.854859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed995e7-07c2-45fd-90a0-1c0e6064f5e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:16.857189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed995e7-07c2-45fd-90a0-1c0e6064f5e5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:16.908118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b2eebc0a-f8a4-43c1-b16a-a7586c25b2b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dd7c55c8952488685691a07de3207a8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:16.939365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b2eebc0a-f8a4-43c1-b16a-a7586c25b2b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dd7c55c8952488685691a07de3207a8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:16.960820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b2eebc0a-f8a4-43c1-b16a-a7586c25b2b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dd7c55c8952488685691a07de3207a8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:16.962493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b2eebc0a-f8a4-43c1-b16a-a7586c25b2b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dd7c55c8952488685691a07de3207a8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:17.020698 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2981/6017] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:16 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:17.021696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed995e7-07c2-45fd-90a0-1c0e6064f5e5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:17.043786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b2eebc0a-f8a4-43c1-b16a-a7586c25b2b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dd7c55c8952488685691a07de3207a8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:17.052295 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3037/6018] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:16 2022] DELETE /identity/v3/users/4dd7c55c8952488685691a07de3207a8 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:17.054628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eebc0a-f8a4-43c1-b16a-a7586c25b2b7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:17.058266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b2eebc0a-f8a4-43c1-b16a-a7586c25b2b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:17.230528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed995e7-07c2-45fd-90a0-1c0e6064f5e5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:17.260685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eebc0a-f8a4-43c1-b16a-a7586c25b2b7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:17.267528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7cfa0-d77d-4684-9856-044d1e544e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:17.269387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7cfa0-d77d-4684-9856-044d1e544e1c admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:17.270009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7cfa0-d77d-4684-9856-044d1e544e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:17.270009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7cfa0-d77d-4684-9856-044d1e544e1c admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:17.272169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7cfa0-d77d-4684-9856-044d1e544e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:17.274240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7cfa0-d77d-4684-9856-044d1e544e1c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:17.280979 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:17.369880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18a587-cf50-4d23-9d5b-b8e8c4f1de30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:17.370910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18a587-cf50-4d23-9d5b-b8e8c4f1de30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:17.371203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18a587-cf50-4d23-9d5b-b8e8c4f1de30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:17.371508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a18a587-cf50-4d23-9d5b-b8e8c4f1de30 admin admin] PATH_INFO: `/v3/projects/f3b0e53de5444dfcbbeba264f04c5d0f/users/657712558cf844609ae8ae62fe6f3479/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:17.406991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18a587-cf50-4d23-9d5b-b8e8c4f1de30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b0e53de5444dfcbbeba264f04c5d0f, user_id=657712558cf844609ae8ae62fe6f3479, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:17.408508 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3038/6019] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:17 2022] POST /identity/v3/users => generated 294 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:17.413437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7cfa0-d77d-4684-9856-044d1e544e1c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:17.414262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a18a587-cf50-4d23-9d5b-b8e8c4f1de30 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:17.434225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7cfa0-d77d-4684-9856-044d1e544e1c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:17.464268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a655718-c1b8-4603-9900-5291cf78e115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:17.464947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a655718-c1b8-4603-9900-5291cf78e115 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:17.465225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a655718-c1b8-4603-9900-5291cf78e115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:17.465501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a655718-c1b8-4603-9900-5291cf78e115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:17.466298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a655718-c1b8-4603-9900-5291cf78e115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:17.467899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a655718-c1b8-4603-9900-5291cf78e115 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:17.502839 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3039/6020] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:40:17.513244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a655718-c1b8-4603-9900-5291cf78e115 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:17.515957 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2982/6021] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:17 2022] PUT /identity/v3/projects/f3b0e53de5444dfcbbeba264f04c5d0f/users/657712558cf844609ae8ae62fe6f3479/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:17.517033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18a587-cf50-4d23-9d5b-b8e8c4f1de30 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:17.526766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5a18a587-cf50-4d23-9d5b-b8e8c4f1de30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:17.537082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a655718-c1b8-4603-9900-5291cf78e115 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:17.712215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd091e5-c7c4-46b3-837e-5748d4547639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:17.712912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd091e5-c7c4-46b3-837e-5748d4547639 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:17.713172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd091e5-c7c4-46b3-837e-5748d4547639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:17.713633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd091e5-c7c4-46b3-837e-5748d4547639 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:17.714467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd091e5-c7c4-46b3-837e-5748d4547639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:17.717297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd091e5-c7c4-46b3-837e-5748d4547639 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:17.721495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a18a587-cf50-4d23-9d5b-b8e8c4f1de30 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:17.741320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aba030-c385-4d92-a779-df8410835487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:17.741890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aba030-c385-4d92-a779-df8410835487 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:17.742201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aba030-c385-4d92-a779-df8410835487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:17.742530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24aba030-c385-4d92-a779-df8410835487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:17.743272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aba030-c385-4d92-a779-df8410835487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:17.747977 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3040/6022] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:17.748435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24aba030-c385-4d92-a779-df8410835487 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:17.749275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd091e5-c7c4-46b3-837e-5748d4547639 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:17.776630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd091e5-c7c4-46b3-837e-5748d4547639 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:17.778494 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2983/6023] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:17 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:17.782574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aba030-c385-4d92-a779-df8410835487 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:17.792159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed9d42-f1d2-4ffa-8f82-fccb0b5567e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:17.793077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed9d42-f1d2-4ffa-8f82-fccb0b5567e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:17.793360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed9d42-f1d2-4ffa-8f82-fccb0b5567e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:17.793640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed9d42-f1d2-4ffa-8f82-fccb0b5567e8 admin admin] PATH_INFO: `/v3/projects/424b9b8148684088a9f4db41ca79e5e1/users/6217d54c2faa4b10a5a56697e1f0e2a7/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:17.800931 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:17.823752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24aba030-c385-4d92-a779-df8410835487 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:17.836080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f68ac1-f04c-436b-aeec-e1f3bba137b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:17.836998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f68ac1-f04c-436b-aeec-e1f3bba137b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:17.837284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f68ac1-f04c-436b-aeec-e1f3bba137b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:17.837569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f68ac1-f04c-436b-aeec-e1f3bba137b3 admin admin] PATH_INFO: `/v3/projects/f3b0e53de5444dfcbbeba264f04c5d0f/users/657712558cf844609ae8ae62fe6f3479/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:17.847905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f68ac1-f04c-436b-aeec-e1f3bba137b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3b0e53de5444dfcbbeba264f04c5d0f, user_id=657712558cf844609ae8ae62fe6f3479, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:17.855296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f68ac1-f04c-436b-aeec-e1f3bba137b3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:17.856702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed9d42-f1d2-4ffa-8f82-fccb0b5567e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=424b9b8148684088a9f4db41ca79e5e1, user_id=6217d54c2faa4b10a5a56697e1f0e2a7, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:17.864110 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed9d42-f1d2-4ffa-8f82-fccb0b5567e8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:17.910206 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2984/6024] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:17 2022] PUT /identity/v3/projects/f3b0e53de5444dfcbbeba264f04c5d0f/users/657712558cf844609ae8ae62fe6f3479/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:17.911111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f68ac1-f04c-436b-aeec-e1f3bba137b3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:17.919099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b3f68ac1-f04c-436b-aeec-e1f3bba137b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:17.949190 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3041/6025] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:17 2022] PUT /identity/v3/projects/424b9b8148684088a9f4db41ca79e5e1/users/6217d54c2faa4b10a5a56697e1f0e2a7/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:17.950531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16751089-392e-4321-8f0d-dd5261e4c4ca None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:17.950853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16751089-392e-4321-8f0d-dd5261e4c4ca None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:17.951101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16751089-392e-4321-8f0d-dd5261e4c4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:18.054075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-16751089-392e-4321-8f0d-dd5261e4c4ca None None] MFA Rules not processed for user `657712558cf844609ae8ae62fe6f3479`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:18.057838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-16751089-392e-4321-8f0d-dd5261e4c4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:18.180884 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3042/6026] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:18.182492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0761e-c04f-4405-a4de-dbe1910f9fc3 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:18.183901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0761e-c04f-4405-a4de-dbe1910f9fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:18.184333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb0761e-c04f-4405-a4de-dbe1910f9fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:18.184706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f68ac1-f04c-436b-aeec-e1f3bba137b3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:18.258392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-dcb0761e-c04f-4405-a4de-dbe1910f9fc3 None None] MFA Rules not processed for user `6217d54c2faa4b10a5a56697e1f0e2a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:18.259896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dcb0761e-c04f-4405-a4de-dbe1910f9fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:18.279049 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:18.362708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce153f-25b7-47ba-b70d-08abf3b93b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:18.363764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce153f-25b7-47ba-b70d-08abf3b93b71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:18.364053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce153f-25b7-47ba-b70d-08abf3b93b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:18.364339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ce153f-25b7-47ba-b70d-08abf3b93b71 admin admin] PATH_INFO: `/v3/projects/10c09f0d060847f7b79e4e9c432d757a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:18.365661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce153f-25b7-47ba-b70d-08abf3b93b71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10c09f0d060847f7b79e4e9c432d757a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:18.373288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ce153f-25b7-47ba-b70d-08abf3b93b71 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:18.490931 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3043/6027] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:18.492043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0761e-c04f-4405-a4de-dbe1910f9fc3 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:18.495877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dcb0761e-c04f-4405-a4de-dbe1910f9fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:18.559137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-23ce153f-25b7-47ba-b70d-08abf3b93b71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10c09f0d060847f7b79e4e9c432d757a', 'request_id': 'req-23ce153f-25b7-47ba-b70d-08abf3b93b71'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:18.632877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb0761e-c04f-4405-a4de-dbe1910f9fc3 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:18.646801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-23ce153f-25b7-47ba-b70d-08abf3b93b71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10c09f0d060847f7b79e4e9c432d757a', 'request_id': 'req-23ce153f-25b7-47ba-b70d-08abf3b93b71'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:18.656729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-23ce153f-25b7-47ba-b70d-08abf3b93b71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10c09f0d060847f7b79e4e9c432d757a', 'request_id': 'req-23ce153f-25b7-47ba-b70d-08abf3b93b71'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:18.665246 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:18.683696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-23ce153f-25b7-47ba-b70d-08abf3b93b71 admin admin] The token cache is being invalidate because project 10c09f0d060847f7b79e4e9c432d757a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:18.684373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-23ce153f-25b7-47ba-b70d-08abf3b93b71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:18.685439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-23ce153f-25b7-47ba-b70d-08abf3b93b71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:18.690758 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2985/6028] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:17 2022] DELETE /identity/v3/projects/10c09f0d060847f7b79e4e9c432d757a => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:18.692102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce153f-25b7-47ba-b70d-08abf3b93b71 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:18.699807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-23ce153f-25b7-47ba-b70d-08abf3b93b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:18.746004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797193ab-7b1d-4acd-9833-2507ee476ef5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:18.747369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797193ab-7b1d-4acd-9833-2507ee476ef5 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:18.748093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797193ab-7b1d-4acd-9833-2507ee476ef5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:18.749165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797193ab-7b1d-4acd-9833-2507ee476ef5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:18.751427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-797193ab-7b1d-4acd-9833-2507ee476ef5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:18.827850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ce153f-25b7-47ba-b70d-08abf3b93b71 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:18.838872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51558108-0bc4-408b-adf3-3debe375eb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:18.841228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51558108-0bc4-408b-adf3-3debe375eb77 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:18.841619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51558108-0bc4-408b-adf3-3debe375eb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:18.841949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51558108-0bc4-408b-adf3-3debe375eb77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:18.842723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51558108-0bc4-408b-adf3-3debe375eb77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:18.844673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51558108-0bc4-408b-adf3-3debe375eb77 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:18.858905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797193ab-7b1d-4acd-9833-2507ee476ef5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:18.860628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797193ab-7b1d-4acd-9833-2507ee476ef5 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:18.888073 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3044/6029] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:40:18.889740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb231ff5-59b9-4f6f-b223-52a2c453477a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:18.890305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb231ff5-59b9-4f6f-b223-52a2c453477a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:18.890758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb231ff5-59b9-4f6f-b223-52a2c453477a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:18.931376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-cb231ff5-59b9-4f6f-b223-52a2c453477a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:18.932717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cb231ff5-59b9-4f6f-b223-52a2c453477a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:18.951252 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3045/6030] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:18.960067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d292ea1-9600-4531-b44d-d91e38d406e4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:18.960364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d292ea1-9600-4531-b44d-d91e38d406e4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:18.960647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d292ea1-9600-4531-b44d-d91e38d406e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:19.002619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1d292ea1-9600-4531-b44d-d91e38d406e4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:19.004398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1d292ea1-9600-4531-b44d-d91e38d406e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:19.025731 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3046/6031] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:40:19.029621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d292ea1-9600-4531-b44d-d91e38d406e4 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:19.044883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d292ea1-9600-4531-b44d-d91e38d406e4 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:19.048925 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2986/6032] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:18 2022] POST /identity/v3/projects => generated 385 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:19.050243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51558108-0bc4-408b-adf3-3debe375eb77 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:19.168641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afce63-9e70-4398-85d6-2cd0ac23d4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:19.169591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afce63-9e70-4398-85d6-2cd0ac23d4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:19.170272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afce63-9e70-4398-85d6-2cd0ac23d4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:19.177878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afce63-9e70-4398-85d6-2cd0ac23d4d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:19.177878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afce63-9e70-4398-85d6-2cd0ac23d4d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:19.177878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afce63-9e70-4398-85d6-2cd0ac23d4d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:19.177878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afce63-9e70-4398-85d6-2cd0ac23d4d2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:19.187806 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3047/6033] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:40:19.192773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afce63-9e70-4398-85d6-2cd0ac23d4d2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:19.205507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afce63-9e70-4398-85d6-2cd0ac23d4d2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:19.227923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2356b-83d0-48d6-9d97-18174680442e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:19.229080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2356b-83d0-48d6-9d97-18174680442e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:19.234006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2356b-83d0-48d6-9d97-18174680442e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:19.234006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2356b-83d0-48d6-9d97-18174680442e admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:19.234006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2356b-83d0-48d6-9d97-18174680442e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:19.237319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2356b-83d0-48d6-9d97-18174680442e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:19.274286 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:19.294693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51558108-0bc4-408b-adf3-3debe375eb77 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:19.312531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be050c2-da29-4fb5-87ab-2d0f6beb3614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:19.312840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be050c2-da29-4fb5-87ab-2d0f6beb3614 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:19.313269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be050c2-da29-4fb5-87ab-2d0f6beb3614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:19.313708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be050c2-da29-4fb5-87ab-2d0f6beb3614 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:19.314627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be050c2-da29-4fb5-87ab-2d0f6beb3614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:19.322645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be050c2-da29-4fb5-87ab-2d0f6beb3614 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:19.399968 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3048/6034] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:19 2022] POST /identity/v3/projects => generated 403 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:19.405894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2356b-83d0-48d6-9d97-18174680442e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:19.489177 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2987/6035] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:19 2022] POST /identity/v3/users => generated 299 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:19.493192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be050c2-da29-4fb5-87ab-2d0f6beb3614 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:19.519870 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:19.522030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be050c2-da29-4fb5-87ab-2d0f6beb3614 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:19.595831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bc882-5dff-4139-9e78-c4e07986b198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:19.597202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bc882-5dff-4139-9e78-c4e07986b198 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:19.597202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bc882-5dff-4139-9e78-c4e07986b198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:19.597404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bc882-5dff-4139-9e78-c4e07986b198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:19.598061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bc882-5dff-4139-9e78-c4e07986b198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:19.599759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bc882-5dff-4139-9e78-c4e07986b198 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:19.611333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2356b-83d0-48d6-9d97-18174680442e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:19.616797 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2988/6036] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:19.618065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bc882-5dff-4139-9e78-c4e07986b198 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:19.620786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5917818-cb6f-4fb0-b246-7d02a2e8277f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:19.621227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f16bc882-5dff-4139-9e78-c4e07986b198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:19.621819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5917818-cb6f-4fb0-b246-7d02a2e8277f admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:19.622307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5917818-cb6f-4fb0-b246-7d02a2e8277f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:19.622736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5917818-cb6f-4fb0-b246-7d02a2e8277f admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:19.623593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5917818-cb6f-4fb0-b246-7d02a2e8277f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:19.625727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5917818-cb6f-4fb0-b246-7d02a2e8277f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:19.707396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bc882-5dff-4139-9e78-c4e07986b198 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:19.714967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e402e7b-49c9-4427-bb27-4652de392777 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:19.715867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e402e7b-49c9-4427-bb27-4652de392777 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:19.716143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e402e7b-49c9-4427-bb27-4652de392777 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:19.717369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e402e7b-49c9-4427-bb27-4652de392777 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:19.724403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5e402e7b-49c9-4427-bb27-4652de392777 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:19.749038 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3049/6037] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:19 2022] POST /identity/v3/users => generated 302 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:19.750042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5917818-cb6f-4fb0-b246-7d02a2e8277f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:19.762263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5917818-cb6f-4fb0-b246-7d02a2e8277f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:19.767084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227e571-40b1-4424-8cd7-f66cb98c2280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:19.770553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227e571-40b1-4424-8cd7-f66cb98c2280 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:19.770858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227e571-40b1-4424-8cd7-f66cb98c2280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:19.771150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227e571-40b1-4424-8cd7-f66cb98c2280 admin admin] PATH_INFO: `/v3/projects/ff12dbaa0527434fb327f5195e9cad14/users/1ea48ed3759b4e4a89d8992b9e4bad6b/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:19.794303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227e571-40b1-4424-8cd7-f66cb98c2280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff12dbaa0527434fb327f5195e9cad14, user_id=1ea48ed3759b4e4a89d8992b9e4bad6b, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:19.797062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e402e7b-49c9-4427-bb27-4652de392777 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:19.800178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227e571-40b1-4424-8cd7-f66cb98c2280 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:19.800395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e402e7b-49c9-4427-bb27-4652de392777 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:19.811561 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2989/6038] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:40:19.813409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e402e7b-49c9-4427-bb27-4652de392777 service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:19.826233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e402e7b-49c9-4427-bb27-4652de392777 service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:19.833503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c7d54-0706-4c4b-a2f9-3904bc8d1437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:19.834358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c7d54-0706-4c4b-a2f9-3904bc8d1437 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:19.834746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c7d54-0706-4c4b-a2f9-3904bc8d1437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:19.835213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c7d54-0706-4c4b-a2f9-3904bc8d1437 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:19.836052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c7d54-0706-4c4b-a2f9-3904bc8d1437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:19.837942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c7d54-0706-4c4b-a2f9-3904bc8d1437 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:19.854859 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2990/6039] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:19.856075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c7d54-0706-4c4b-a2f9-3904bc8d1437 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:19.871329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c7d54-0706-4c4b-a2f9-3904bc8d1437 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:19.878373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4724338-c311-461e-9d6a-9e0952f0b9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:19.879399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4724338-c311-461e-9d6a-9e0952f0b9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:19.879845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4724338-c311-461e-9d6a-9e0952f0b9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:19.880534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4724338-c311-461e-9d6a-9e0952f0b9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:19.881400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4724338-c311-461e-9d6a-9e0952f0b9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:19.883420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4724338-c311-461e-9d6a-9e0952f0b9c9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:19.895607 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3050/6040] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:19 2022] PUT /identity/v3/projects/ff12dbaa0527434fb327f5195e9cad14/users/1ea48ed3759b4e4a89d8992b9e4bad6b/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:19.899745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227e571-40b1-4424-8cd7-f66cb98c2280 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:19.912937 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2991/6041] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:19.917314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4724338-c311-461e-9d6a-9e0952f0b9c9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:19.942889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4724338-c311-461e-9d6a-9e0952f0b9c9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:20.031534 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:20.032956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227e571-40b1-4424-8cd7-f66cb98c2280 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:20.039382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b12498-846a-474c-82d2-f5f612914326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:20.040382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b12498-846a-474c-82d2-f5f612914326 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:20.041548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b12498-846a-474c-82d2-f5f612914326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:20.041952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b12498-846a-474c-82d2-f5f612914326 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:20.042856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b12498-846a-474c-82d2-f5f612914326 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:20.045100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b12498-846a-474c-82d2-f5f612914326 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:20.064909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d2dfb5-1493-4fa5-adf0-bec8a3642fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:20.067167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2dfb5-1493-4fa5-adf0-bec8a3642fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:20.067167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2dfb5-1493-4fa5-adf0-bec8a3642fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:20.067167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d2dfb5-1493-4fa5-adf0-bec8a3642fc9 admin admin] PATH_INFO: `/v3/projects/4adc72f2ef51482f904ff61f4f1689c9/users/7b59c095ce7d49ca93ed5853b9a867e0/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:20.073268 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3051/6042] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:19 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:20.078671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b12498-846a-474c-82d2-f5f612914326 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:20.085448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2dfb5-1493-4fa5-adf0-bec8a3642fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4adc72f2ef51482f904ff61f4f1689c9, user_id=7b59c095ce7d49ca93ed5853b9a867e0, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:20.088505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d2dfb5-1493-4fa5-adf0-bec8a3642fc9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:20.093259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b12498-846a-474c-82d2-f5f612914326 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:20.098328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54485d7-ad04-4bd7-979a-43ae938f0c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:20.099224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54485d7-ad04-4bd7-979a-43ae938f0c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:20.099512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54485d7-ad04-4bd7-979a-43ae938f0c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:20.099793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54485d7-ad04-4bd7-979a-43ae938f0c41 admin admin] PATH_INFO: `/v3/projects/ff12dbaa0527434fb327f5195e9cad14/users/1ea48ed3759b4e4a89d8992b9e4bad6b/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:20.101976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54485d7-ad04-4bd7-979a-43ae938f0c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff12dbaa0527434fb327f5195e9cad14, user_id=1ea48ed3759b4e4a89d8992b9e4bad6b, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:20.104641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54485d7-ad04-4bd7-979a-43ae938f0c41 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:20.116669 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3052/6043] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:20 2022] PUT /identity/v3/projects/ff12dbaa0527434fb327f5195e9cad14/users/1ea48ed3759b4e4a89d8992b9e4bad6b/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:20.126788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a23b6b-b523-4c3e-b70f-a037b17e37e2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:20.127079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a23b6b-b523-4c3e-b70f-a037b17e37e2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:20.127446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a23b6b-b523-4c3e-b70f-a037b17e37e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:20.163827 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2992/6044] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:19 2022] PUT /identity/v3/projects/4adc72f2ef51482f904ff61f4f1689c9/users/7b59c095ce7d49ca93ed5853b9a867e0/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:20.173812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81219b-51a0-4b45-99a6-cb9842bb61b8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:20.174127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81219b-51a0-4b45-99a6-cb9842bb61b8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:20.174547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81219b-51a0-4b45-99a6-cb9842bb61b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:20.199112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-07a23b6b-b523-4c3e-b70f-a037b17e37e2 None None] MFA Rules not processed for user `1ea48ed3759b4e4a89d8992b9e4bad6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:20.202234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-07a23b6b-b523-4c3e-b70f-a037b17e37e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:20.236735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5d81219b-51a0-4b45-99a6-cb9842bb61b8 None None] MFA Rules not processed for user `7b59c095ce7d49ca93ed5853b9a867e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:20.239848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5d81219b-51a0-4b45-99a6-cb9842bb61b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:20.373812 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:20.393935 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3053/6045] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:20.395950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a23b6b-b523-4c3e-b70f-a037b17e37e2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:20.419617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a23b6b-b523-4c3e-b70f-a037b17e37e2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:20.429201 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2993/6046] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:20.435541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adeb031-94ea-4641-ad10-6a2bd87b9722 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea48ed3759b4e4a89d8992b9e4bad6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff12dbaa0527434fb327f5195e9cad14', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:20.438583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adeb031-94ea-4641-ad10-6a2bd87b9722 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:20.439276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81219b-51a0-4b45-99a6-cb9842bb61b8 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:20.439784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adeb031-94ea-4641-ad10-6a2bd87b9722 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:20.440479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adeb031-94ea-4641-ad10-6a2bd87b9722 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:20.442329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adeb031-94ea-4641-ad10-6a2bd87b9722 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:20.450010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adeb031-94ea-4641-ad10-6a2bd87b9722 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:20.530400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d81219b-51a0-4b45-99a6-cb9842bb61b8 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:20.537330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2fca8-4f32-4f44-b5bd-110d8a0e7d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:20.538207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2fca8-4f32-4f44-b5bd-110d8a0e7d13 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:20.538607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2fca8-4f32-4f44-b5bd-110d8a0e7d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:20.539037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2fca8-4f32-4f44-b5bd-110d8a0e7d13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:20.539845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2fca8-4f32-4f44-b5bd-110d8a0e7d13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:20.541844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2fca8-4f32-4f44-b5bd-110d8a0e7d13 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:20.571340 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3054/6047] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:20 2022] POST /identity/v3/projects => generated 359 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:40:20.574003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adeb031-94ea-4641-ad10-6a2bd87b9722 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:20.636961 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2994/6048] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:20 2022] POST /identity/v3/projects => generated 401 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:20.640820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2fca8-4f32-4f44-b5bd-110d8a0e7d13 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:20.742509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adeb031-94ea-4641-ad10-6a2bd87b9722 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:20.767448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2fca8-4f32-4f44-b5bd-110d8a0e7d13 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:20.778944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48280609-5b90-4d88-b5cd-491915eeb4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:20.779806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48280609-5b90-4d88-b5cd-491915eeb4a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:20.782416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48280609-5b90-4d88-b5cd-491915eeb4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:20.782670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48280609-5b90-4d88-b5cd-491915eeb4a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:20.783462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48280609-5b90-4d88-b5cd-491915eeb4a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:20.790649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48280609-5b90-4d88-b5cd-491915eeb4a0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:20.798568 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:20.845916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32de10-3c33-4a0d-a29a-cd61038f8a70 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea48ed3759b4e4a89d8992b9e4bad6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff12dbaa0527434fb327f5195e9cad14', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:20.850360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32de10-3c33-4a0d-a29a-cd61038f8a70 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:20.850360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32de10-3c33-4a0d-a29a-cd61038f8a70 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:20.850360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32de10-3c33-4a0d-a29a-cd61038f8a70 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] PATH_INFO: `/v3/projects/3027fb2eeee04efa95e3bca2ff067286/tags/tempest-tag-1683885635` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:20.850360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32de10-3c33-4a0d-a29a-cd61038f8a70 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=3027fb2eeee04efa95e3bca2ff067286, value=tempest-tag-1683885635)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:20.852298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32de10-3c33-4a0d-a29a-cd61038f8a70 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:20.918037 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2995/6049] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:20 2022] POST /identity/v3/users => generated 307 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:20.922082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48280609-5b90-4d88-b5cd-491915eeb4a0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:20.957997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48280609-5b90-4d88-b5cd-491915eeb4a0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:20.979564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c1417-7a69-4340-8471-5700c4071807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:20.983719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c1417-7a69-4340-8471-5700c4071807 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:20.984133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c1417-7a69-4340-8471-5700c4071807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:20.984524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c1417-7a69-4340-8471-5700c4071807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:20.988700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c1417-7a69-4340-8471-5700c4071807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:20.990658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2c1417-7a69-4340-8471-5700c4071807 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:21.005817 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2996/6050] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:21.009976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c1417-7a69-4340-8471-5700c4071807 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:21.040348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c1417-7a69-4340-8471-5700c4071807 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:21.061452 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-ad32de10-3c33-4a0d-a29a-cd61038f8a70 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1683885635. To ensure interoperability, identifiers should be a valid uuid. Jul 19 14:40:21.061452 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 14:40:21.061452 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:40:21.072270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95021caa-e9da-46e8-ae6c-f89f78fc17c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:21.073208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95021caa-e9da-46e8-ae6c-f89f78fc17c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:21.076185 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3055/6051] 10.222.0.43 () {60 vars in 1332 bytes} [Tue Jul 19 14:40:20 2022] PUT /identity/v3/projects/3027fb2eeee04efa95e3bca2ff067286/tags/tempest-tag-1683885635 => generated 0 bytes in 503 msecs (HTTP/1.1 201) 6 headers in 291 bytes (1 switches on core 0) Jul 19 14:40:21.077615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95021caa-e9da-46e8-ae6c-f89f78fc17c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:21.079156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95021caa-e9da-46e8-ae6c-f89f78fc17c7 admin admin] PATH_INFO: `/v3/projects/9ebabe6bbdcc463d89e1ec5ac6ed8531/users/5de6d57b169a46a683e8164c0b887092/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:21.082754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32de10-3c33-4a0d-a29a-cd61038f8a70 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:21.120448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95021caa-e9da-46e8-ae6c-f89f78fc17c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ebabe6bbdcc463d89e1ec5ac6ed8531, user_id=5de6d57b169a46a683e8164c0b887092, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:21.124044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95021caa-e9da-46e8-ae6c-f89f78fc17c7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:21.138834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32de10-3c33-4a0d-a29a-cd61038f8a70 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:21.157580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb0933-2411-4c9a-8934-4eaf5789d1a1 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea48ed3759b4e4a89d8992b9e4bad6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff12dbaa0527434fb327f5195e9cad14', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:21.158581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb0933-2411-4c9a-8934-4eaf5789d1a1 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:21.158975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb0933-2411-4c9a-8934-4eaf5789d1a1 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:21.159580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cb0933-2411-4c9a-8934-4eaf5789d1a1 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] PATH_INFO: `/v3/projects/3027fb2eeee04efa95e3bca2ff067286/tags/tempest-tag-1683885635` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:21.177829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb0933-2411-4c9a-8934-4eaf5789d1a1 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=3027fb2eeee04efa95e3bca2ff067286, value=tempest-tag-1683885635)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:21.180210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cb0933-2411-4c9a-8934-4eaf5789d1a1 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:21.198413 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3056/6052] 10.222.0.43 () {58 vars in 1313 bytes} [Tue Jul 19 14:40:21 2022] GET /identity/v3/projects/3027fb2eeee04efa95e3bca2ff067286/tags/tempest-tag-1683885635 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:21.198413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb0933-2411-4c9a-8934-4eaf5789d1a1 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:21.233829 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2997/6053] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:21 2022] PUT /identity/v3/projects/9ebabe6bbdcc463d89e1ec5ac6ed8531/users/5de6d57b169a46a683e8164c0b887092/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:21.235336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95021caa-e9da-46e8-ae6c-f89f78fc17c7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:21.236136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cb0933-2411-4c9a-8934-4eaf5789d1a1 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:21.252376 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:21.375069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9895960-0d42-416f-ab30-20bac0010864 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea48ed3759b4e4a89d8992b9e4bad6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff12dbaa0527434fb327f5195e9cad14', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:21.377783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9895960-0d42-416f-ab30-20bac0010864 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:21.379760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9895960-0d42-416f-ab30-20bac0010864 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:21.380413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9895960-0d42-416f-ab30-20bac0010864 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] PATH_INFO: `/v3/projects/3027fb2eeee04efa95e3bca2ff067286/tags` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:21.383101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9895960-0d42-416f-ab30-20bac0010864 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=3027fb2eeee04efa95e3bca2ff067286)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:21.388522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9895960-0d42-416f-ab30-20bac0010864 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:21.412040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95021caa-e9da-46e8-ae6c-f89f78fc17c7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:21.439811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84617860-c772-4b6f-9da8-37b17306c8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:21.443059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84617860-c772-4b6f-9da8-37b17306c8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:21.443059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84617860-c772-4b6f-9da8-37b17306c8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:21.443059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84617860-c772-4b6f-9da8-37b17306c8b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:21.443692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84617860-c772-4b6f-9da8-37b17306c8b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:21.445751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84617860-c772-4b6f-9da8-37b17306c8b5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:21.480259 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2998/6054] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:40:21.484391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84617860-c772-4b6f-9da8-37b17306c8b5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:21.508449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84617860-c772-4b6f-9da8-37b17306c8b5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:21.525084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842afc1-17fb-46fa-b738-54a5d42787b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:21.535344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842afc1-17fb-46fa-b738-54a5d42787b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:21.535344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842afc1-17fb-46fa-b738-54a5d42787b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:21.535344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842afc1-17fb-46fa-b738-54a5d42787b0 admin admin] PATH_INFO: `/v3/projects/9ebabe6bbdcc463d89e1ec5ac6ed8531/users/5de6d57b169a46a683e8164c0b887092/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:21.537621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842afc1-17fb-46fa-b738-54a5d42787b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ebabe6bbdcc463d89e1ec5ac6ed8531, user_id=5de6d57b169a46a683e8164c0b887092, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:21.544782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7842afc1-17fb-46fa-b738-54a5d42787b0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:21.559628 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3057/6055] 10.222.0.43 () {60 vars in 1264 bytes} [Tue Jul 19 14:40:21 2022] PUT /identity/v3/projects/3027fb2eeee04efa95e3bca2ff067286/tags => generated 141 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:21.560877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9895960-0d42-416f-ab30-20bac0010864 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:21.579223 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 2999/6056] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:21 2022] PUT /identity/v3/projects/9ebabe6bbdcc463d89e1ec5ac6ed8531/users/5de6d57b169a46a683e8164c0b887092/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:21.586692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9895960-0d42-416f-ab30-20bac0010864 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:21.597717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac9ee6-4b01-4031-9570-1c6a283925e1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:21.600395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac9ee6-4b01-4031-9570-1c6a283925e1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:21.600917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ac9ee6-4b01-4031-9570-1c6a283925e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:21.692286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-27ac9ee6-4b01-4031-9570-1c6a283925e1 None None] MFA Rules not processed for user `5de6d57b169a46a683e8164c0b887092`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:21.692286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-27ac9ee6-4b01-4031-9570-1c6a283925e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:21.728265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0c6b6-44ff-4641-bb82-e2ac2cacdcfa tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea48ed3759b4e4a89d8992b9e4bad6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff12dbaa0527434fb327f5195e9cad14', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:21.729037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0c6b6-44ff-4641-bb82-e2ac2cacdcfa tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:21.729402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0c6b6-44ff-4641-bb82-e2ac2cacdcfa tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:21.730784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0c6b6-44ff-4641-bb82-e2ac2cacdcfa tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] PATH_INFO: `/v3/projects/3027fb2eeee04efa95e3bca2ff067286/tags` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:21.752000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0c6b6-44ff-4641-bb82-e2ac2cacdcfa tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=3027fb2eeee04efa95e3bca2ff067286)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:21.757197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0c6b6-44ff-4641-bb82-e2ac2cacdcfa tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:21.787204 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3058/6057] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jul 19 14:40:21 2022] GET /identity/v3/projects/3027fb2eeee04efa95e3bca2ff067286/tags => generated 141 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:40:21.792804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0c6b6-44ff-4641-bb82-e2ac2cacdcfa tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:21.802533 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:21.821866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0c6b6-44ff-4641-bb82-e2ac2cacdcfa tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:21.836794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635405b-b56f-4651-bc55-f9c343323897 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea48ed3759b4e4a89d8992b9e4bad6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff12dbaa0527434fb327f5195e9cad14', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:21.847656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635405b-b56f-4651-bc55-f9c343323897 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:21.848318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635405b-b56f-4651-bc55-f9c343323897 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:21.848318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635405b-b56f-4651-bc55-f9c343323897 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] PATH_INFO: `/v3/projects/3027fb2eeee04efa95e3bca2ff067286/tags/tempest-tag-1059335142` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:21.857457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635405b-b56f-4651-bc55-f9c343323897 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=3027fb2eeee04efa95e3bca2ff067286, value=tempest-tag-1059335142)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:21.859641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5635405b-b56f-4651-bc55-f9c343323897 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:21.886856 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3000/6058] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:21 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:21.890868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac9ee6-4b01-4031-9570-1c6a283925e1 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:21.909902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ac9ee6-4b01-4031-9570-1c6a283925e1 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:21.917426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bf50b-f5a9-4deb-a29c-882bc23c39b7 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de6d57b169a46a683e8164c0b887092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ebabe6bbdcc463d89e1ec5ac6ed8531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:21.918442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bf50b-f5a9-4deb-a29c-882bc23c39b7 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:21.918984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bf50b-f5a9-4deb-a29c-882bc23c39b7 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:21.919426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bf50b-f5a9-4deb-a29c-882bc23c39b7 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:21.920527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bf50b-f5a9-4deb-a29c-882bc23c39b7 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:21.922709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bf50b-f5a9-4deb-a29c-882bc23c39b7 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:22.036164 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-5635405b-b56f-4651-bc55-f9c343323897 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-1059335142. To ensure interoperability, identifiers should be a valid uuid. Jul 19 14:40:22.036164 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 14:40:22.036164 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:40:22.039404 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3001/6059] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:40:21 2022] POST /identity/v3/roles => generated 239 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:22.040347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bf50b-f5a9-4deb-a29c-882bc23c39b7 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:22.043613 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3059/6060] 10.222.0.43 () {58 vars in 1316 bytes} [Tue Jul 19 14:40:21 2022] DELETE /identity/v3/projects/3027fb2eeee04efa95e3bca2ff067286/tags/tempest-tag-1059335142 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:22.048866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635405b-b56f-4651-bc55-f9c343323897 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:22.071661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635405b-b56f-4651-bc55-f9c343323897 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:22.072984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bf50b-f5a9-4deb-a29c-882bc23c39b7 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:22.079617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015bbb5f-d6cc-4b44-8b9d-4c4551d65c2e tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea48ed3759b4e4a89d8992b9e4bad6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff12dbaa0527434fb327f5195e9cad14', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:22.084248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bbb5f-d6cc-4b44-8b9d-4c4551d65c2e tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:22.085146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bbb5f-d6cc-4b44-8b9d-4c4551d65c2e tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:22.087051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bbb5f-d6cc-4b44-8b9d-4c4551d65c2e tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] PATH_INFO: `/v3/projects/3027fb2eeee04efa95e3bca2ff067286/tags/tempest-tag-1059335142` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:22.089358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e3212-fcfe-4b31-8ebe-c2c90cc585f4 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de6d57b169a46a683e8164c0b887092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ebabe6bbdcc463d89e1ec5ac6ed8531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:22.092758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e3212-fcfe-4b31-8ebe-c2c90cc585f4 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:22.093474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e3212-fcfe-4b31-8ebe-c2c90cc585f4 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:22.094765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e3212-fcfe-4b31-8ebe-c2c90cc585f4 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] PATH_INFO: `/v3/projects/4adc72f2ef51482f904ff61f4f1689c9/users/7b59c095ce7d49ca93ed5853b9a867e0/roles/2b461cb911404f9baf14660f20fd9d6f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:22.101028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e3212-fcfe-4b31-8ebe-c2c90cc585f4 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4adc72f2ef51482f904ff61f4f1689c9, user_id=7b59c095ce7d49ca93ed5853b9a867e0, role_id=2b461cb911404f9baf14660f20fd9d6f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:22.107931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e3212-fcfe-4b31-8ebe-c2c90cc585f4 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:22.123625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015bbb5f-d6cc-4b44-8b9d-4c4551d65c2e tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=3027fb2eeee04efa95e3bca2ff067286, value=tempest-tag-1059335142)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:22.126290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015bbb5f-d6cc-4b44-8b9d-4c4551d65c2e tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:22.152300 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-015bbb5f-d6cc-4b44-8b9d-4c4551d65c2e tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Could not find project tag: tempest-tag-1059335142.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1059335142. Jul 19 14:40:22.152300 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:40:22.152300 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:40:22.152300 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:40:22.152300 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:40:22.152300 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:40:22.152300 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:40:22.152300 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:40:22.152300 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:40:22.152300 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:40:22.152300 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:40:22.152300 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:40:22.152300 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Jul 19 14:40:22.152300 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Jul 19 14:40:22.153459 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:40:22.153459 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:40:22.153459 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Jul 19 14:40:22.153459 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Jul 19 14:40:22.153459 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-1059335142. Jul 19 14:40:22.153459 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:40:22.158236 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3060/6061] 10.222.0.43 () {58 vars in 1313 bytes} [Tue Jul 19 14:40:22 2022] GET /identity/v3/projects/3027fb2eeee04efa95e3bca2ff067286/tags/tempest-tag-1059335142 => generated 107 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:40:22.162949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015bbb5f-d6cc-4b44-8b9d-4c4551d65c2e tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:22.180512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015bbb5f-d6cc-4b44-8b9d-4c4551d65c2e tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:22.188118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83987515-9d27-4e8b-9347-dc617ddfe950 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea48ed3759b4e4a89d8992b9e4bad6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff12dbaa0527434fb327f5195e9cad14', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:22.189217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83987515-9d27-4e8b-9347-dc617ddfe950 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:22.189507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83987515-9d27-4e8b-9347-dc617ddfe950 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:22.189788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83987515-9d27-4e8b-9347-dc617ddfe950 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] PATH_INFO: `/v3/projects/3027fb2eeee04efa95e3bca2ff067286/tags` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:22.191801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83987515-9d27-4e8b-9347-dc617ddfe950 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=3027fb2eeee04efa95e3bca2ff067286)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:22.194581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83987515-9d27-4e8b-9347-dc617ddfe950 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:22.252983 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:22.269325 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3002/6062] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:22 2022] PUT /identity/v3/projects/4adc72f2ef51482f904ff61f4f1689c9/users/7b59c095ce7d49ca93ed5853b9a867e0/roles/2b461cb911404f9baf14660f20fd9d6f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:22.273965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e3212-fcfe-4b31-8ebe-c2c90cc585f4 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:22.344037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e3212-fcfe-4b31-8ebe-c2c90cc585f4 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:22.349782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e3b79-757b-4bd0-99d2-c6fcc5c4fd48 tempest-ApplicationCredentialsV3AdminTest-1190140244 tempest-ApplicationCredentialsV3AdminTest-1190140244-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b59c095ce7d49ca93ed5853b9a867e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4adc72f2ef51482f904ff61f4f1689c9', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-331187230', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:22.350800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e3b79-757b-4bd0-99d2-c6fcc5c4fd48 tempest-ApplicationCredentialsV3AdminTest-1190140244 tempest-ApplicationCredentialsV3AdminTest-1190140244-project] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:22.351179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e3b79-757b-4bd0-99d2-c6fcc5c4fd48 tempest-ApplicationCredentialsV3AdminTest-1190140244 tempest-ApplicationCredentialsV3AdminTest-1190140244-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:22.351528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e3b79-757b-4bd0-99d2-c6fcc5c4fd48 tempest-ApplicationCredentialsV3AdminTest-1190140244 tempest-ApplicationCredentialsV3AdminTest-1190140244-project] PATH_INFO: `/v3/users/7b59c095ce7d49ca93ed5853b9a867e0/application_credentials` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:22.352339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e3b79-757b-4bd0-99d2-c6fcc5c4fd48 tempest-ApplicationCredentialsV3AdminTest-1190140244 tempest-ApplicationCredentialsV3AdminTest-1190140244-project] RBAC: Authorizing `identity:create_application_credential(user_id=7b59c095ce7d49ca93ed5853b9a867e0)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:22.353580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e3b79-757b-4bd0-99d2-c6fcc5c4fd48 tempest-ApplicationCredentialsV3AdminTest-1190140244 tempest-ApplicationCredentialsV3AdminTest-1190140244-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:22.365203 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3061/6063] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jul 19 14:40:22 2022] DELETE /identity/v3/projects/3027fb2eeee04efa95e3bca2ff067286/tags => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:40:22.385439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83987515-9d27-4e8b-9347-dc617ddfe950 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:22.385439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83987515-9d27-4e8b-9347-dc617ddfe950 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:22.535130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a3f38-6da9-4fdf-9a28-0c784c57f752 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea48ed3759b4e4a89d8992b9e4bad6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff12dbaa0527434fb327f5195e9cad14', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:22.539303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a3f38-6da9-4fdf-9a28-0c784c57f752 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:22.539303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a3f38-6da9-4fdf-9a28-0c784c57f752 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:22.539303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a3f38-6da9-4fdf-9a28-0c784c57f752 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] PATH_INFO: `/v3/projects/3027fb2eeee04efa95e3bca2ff067286/tags` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:22.557568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a3f38-6da9-4fdf-9a28-0c784c57f752 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=3027fb2eeee04efa95e3bca2ff067286)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:22.563846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a3f38-6da9-4fdf-9a28-0c784c57f752 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:22.592853 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3003/6064] 10.222.0.43 () {60 vars in 1314 bytes} [Tue Jul 19 14:40:22 2022] POST /identity/v3/users/7b59c095ce7d49ca93ed5853b9a867e0/application_credentials => generated 658 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:40:22.597972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57d01a-1b40-41d7-b220-c9726f69d5b1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:22.598371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57d01a-1b40-41d7-b220-c9726f69d5b1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:22.598716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db57d01a-1b40-41d7-b220-c9726f69d5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:22.605973 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3062/6065] 10.222.0.43 () {58 vars in 1244 bytes} [Tue Jul 19 14:40:22 2022] GET /identity/v3/projects/3027fb2eeee04efa95e3bca2ff067286/tags => generated 66 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 19 14:40:22.609542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a3f38-6da9-4fdf-9a28-0c784c57f752 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:22.637058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a3f38-6da9-4fdf-9a28-0c784c57f752 tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:22.645766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed0097-c46d-4289-8d9b-e465b9952cfd tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ea48ed3759b4e4a89d8992b9e4bad6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ff12dbaa0527434fb327f5195e9cad14', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:22.647205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed0097-c46d-4289-8d9b-e465b9952cfd tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:22.648735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed0097-c46d-4289-8d9b-e465b9952cfd tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:22.651194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-db57d01a-1b40-41d7-b220-c9726f69d5b1 None None] MFA Rules not processed for user `7b59c095ce7d49ca93ed5853b9a867e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:22.654446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-db57d01a-1b40-41d7-b220-c9726f69d5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:22.657807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ed0097-c46d-4289-8d9b-e465b9952cfd tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] PATH_INFO: `/v3/projects/3027fb2eeee04efa95e3bca2ff067286` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:22.663305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed0097-c46d-4289-8d9b-e465b9952cfd tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3027fb2eeee04efa95e3bca2ff067286)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:22.666725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ed0097-c46d-4289-8d9b-e465b9952cfd tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:22.702766 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:22.883198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e9ed0097-c46d-4289-8d9b-e465b9952cfd tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3027fb2eeee04efa95e3bca2ff067286', 'request_id': 'req-e9ed0097-c46d-4289-8d9b-e465b9952cfd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:22.905008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e9ed0097-c46d-4289-8d9b-e465b9952cfd tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3027fb2eeee04efa95e3bca2ff067286', 'request_id': 'req-e9ed0097-c46d-4289-8d9b-e465b9952cfd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:22.930249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e9ed0097-c46d-4289-8d9b-e465b9952cfd tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3027fb2eeee04efa95e3bca2ff067286', 'request_id': 'req-e9ed0097-c46d-4289-8d9b-e465b9952cfd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:22.944209 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3004/6066] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:22 2022] POST /identity/v3/auth/tokens => generated 3385 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Jul 19 14:40:22.946650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57d01a-1b40-41d7-b220-c9726f69d5b1 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:23.034650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db57d01a-1b40-41d7-b220-c9726f69d5b1 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:23.040542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3856e07-1f20-4605-b94e-1280a889643a tempest-ApplicationCredentialsV3AdminTest-1190140244 tempest-ApplicationCredentialsV3AdminTest-1190140244-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b59c095ce7d49ca93ed5853b9a867e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4adc72f2ef51482f904ff61f4f1689c9', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-331187230', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:23.041690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3856e07-1f20-4605-b94e-1280a889643a tempest-ApplicationCredentialsV3AdminTest-1190140244 tempest-ApplicationCredentialsV3AdminTest-1190140244-project] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:23.041991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3856e07-1f20-4605-b94e-1280a889643a tempest-ApplicationCredentialsV3AdminTest-1190140244 tempest-ApplicationCredentialsV3AdminTest-1190140244-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:23.042706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3856e07-1f20-4605-b94e-1280a889643a tempest-ApplicationCredentialsV3AdminTest-1190140244 tempest-ApplicationCredentialsV3AdminTest-1190140244-project] PATH_INFO: `/v3/users/7b59c095ce7d49ca93ed5853b9a867e0/application_credentials/6d5ea19e6940470785f5391ace743927` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:23.044538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3856e07-1f20-4605-b94e-1280a889643a tempest-ApplicationCredentialsV3AdminTest-1190140244 tempest-ApplicationCredentialsV3AdminTest-1190140244-project] RBAC: Authorizing `identity:delete_application_credential(user_id=7b59c095ce7d49ca93ed5853b9a867e0, application_credential_id=6d5ea19e6940470785f5391ace743927)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:23.047010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3856e07-1f20-4605-b94e-1280a889643a tempest-ApplicationCredentialsV3AdminTest-1190140244 tempest-ApplicationCredentialsV3AdminTest-1190140244-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:23.048003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e9ed0097-c46d-4289-8d9b-e465b9952cfd tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] The token cache is being invalidate because project 3027fb2eeee04efa95e3bca2ff067286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:23.048307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e9ed0097-c46d-4289-8d9b-e465b9952cfd tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:23.052830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e9ed0097-c46d-4289-8d9b-e465b9952cfd tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:23.059512 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3063/6067] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:22 2022] DELETE /identity/v3/projects/3027fb2eeee04efa95e3bca2ff067286 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:23.061119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed0097-c46d-4289-8d9b-e465b9952cfd tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:23.067793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e9ed0097-c46d-4289-8d9b-e465b9952cfd tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:23.177101 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:23.185909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ed0097-c46d-4289-8d9b-e465b9952cfd tempest-IdentityV3ProjectTagsTest-985009818 tempest-IdentityV3ProjectTagsTest-985009818-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:23.227169 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3005/6068] 10.222.0.43 () {58 vars in 1394 bytes} [Tue Jul 19 14:40:22 2022] DELETE /identity/v3/users/7b59c095ce7d49ca93ed5853b9a867e0/application_credentials/6d5ea19e6940470785f5391ace743927 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:23.234709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3856e07-1f20-4605-b94e-1280a889643a tempest-ApplicationCredentialsV3AdminTest-1190140244 tempest-ApplicationCredentialsV3AdminTest-1190140244-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:23.241094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a3856e07-1f20-4605-b94e-1280a889643a tempest-ApplicationCredentialsV3AdminTest-1190140244 tempest-ApplicationCredentialsV3AdminTest-1190140244-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:23.242923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb394b-2ab5-4cca-bde6-3fc875bae9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:23.246862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb394b-2ab5-4cca-bde6-3fc875bae9ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:23.247421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb394b-2ab5-4cca-bde6-3fc875bae9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:23.247700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb394b-2ab5-4cca-bde6-3fc875bae9ee admin admin] PATH_INFO: `/v3/users/6217d54c2faa4b10a5a56697e1f0e2a7` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:23.249093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb394b-2ab5-4cca-bde6-3fc875bae9ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=6217d54c2faa4b10a5a56697e1f0e2a7)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:23.251244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb394b-2ab5-4cca-bde6-3fc875bae9ee admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:23.355414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3856e07-1f20-4605-b94e-1280a889643a tempest-ApplicationCredentialsV3AdminTest-1190140244 tempest-ApplicationCredentialsV3AdminTest-1190140244-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:23.360551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dec70b-7fd9-4b77-a2f8-96588bef3e39 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de6d57b169a46a683e8164c0b887092', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ebabe6bbdcc463d89e1ec5ac6ed8531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:23.361231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dec70b-7fd9-4b77-a2f8-96588bef3e39 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:23.361565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dec70b-7fd9-4b77-a2f8-96588bef3e39 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:23.361860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dec70b-7fd9-4b77-a2f8-96588bef3e39 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] PATH_INFO: `/v3/roles/2b461cb911404f9baf14660f20fd9d6f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:23.364655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dec70b-7fd9-4b77-a2f8-96588bef3e39 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2b461cb911404f9baf14660f20fd9d6f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:23.366260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dec70b-7fd9-4b77-a2f8-96588bef3e39 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:23.375123 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:23.497948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-39eb394b-2ab5-4cca-bde6-3fc875bae9ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6217d54c2faa4b10a5a56697e1f0e2a7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:23.516363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-39eb394b-2ab5-4cca-bde6-3fc875bae9ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6217d54c2faa4b10a5a56697e1f0e2a7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:23.528378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-39eb394b-2ab5-4cca-bde6-3fc875bae9ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6217d54c2faa4b10a5a56697e1f0e2a7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:23.530790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-39eb394b-2ab5-4cca-bde6-3fc875bae9ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6217d54c2faa4b10a5a56697e1f0e2a7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:23.632321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-39eb394b-2ab5-4cca-bde6-3fc875bae9ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6217d54c2faa4b10a5a56697e1f0e2a7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:23.640796 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3064/6069] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:23 2022] DELETE /identity/v3/users/6217d54c2faa4b10a5a56697e1f0e2a7 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:40:23.646665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f2ce0-e050-46e0-88f8-7b491ee06d89 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:23.647219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f2ce0-e050-46e0-88f8-7b491ee06d89 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:23.647697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f2ce0-e050-46e0-88f8-7b491ee06d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:23.684689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a3dec70b-7fd9-4b77-a2f8-96588bef3e39 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] Invalidating the token cache because role 2b461cb911404f9baf14660f20fd9d6f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:23.685213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a3dec70b-7fd9-4b77-a2f8-96588bef3e39 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:23.686130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a3dec70b-7fd9-4b77-a2f8-96588bef3e39 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:23.688792 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3006/6070] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:23 2022] DELETE /identity/v3/roles/2b461cb911404f9baf14660f20fd9d6f => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:23.691707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b40f2ce0-e050-46e0-88f8-7b491ee06d89 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:23.694988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dec70b-7fd9-4b77-a2f8-96588bef3e39 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:23.707886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b40f2ce0-e050-46e0-88f8-7b491ee06d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:23.729071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a3dec70b-7fd9-4b77-a2f8-96588bef3e39 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:23.857390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dec70b-7fd9-4b77-a2f8-96588bef3e39 tempest-ApplicationCredentialsV3AdminTest-510383935 tempest-ApplicationCredentialsV3AdminTest-510383935-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:23.871329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85074b3d-aaa7-4893-a574-d889281d0453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:23.872237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85074b3d-aaa7-4893-a574-d889281d0453 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:23.872856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85074b3d-aaa7-4893-a574-d889281d0453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:23.872856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85074b3d-aaa7-4893-a574-d889281d0453 admin admin] PATH_INFO: `/v3/users/7b59c095ce7d49ca93ed5853b9a867e0` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:23.875163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85074b3d-aaa7-4893-a574-d889281d0453 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b59c095ce7d49ca93ed5853b9a867e0)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:23.877005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85074b3d-aaa7-4893-a574-d889281d0453 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:23.916295 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3065/6071] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:23.927368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f2ce0-e050-46e0-88f8-7b491ee06d89 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:23.932257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b40f2ce0-e050-46e0-88f8-7b491ee06d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:24.128679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f2ce0-e050-46e0-88f8-7b491ee06d89 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:24.129625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-85074b3d-aaa7-4893-a574-d889281d0453 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b59c095ce7d49ca93ed5853b9a867e0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:24.132790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9bdc93-aaca-4697-9419-6f22a2573018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:24.133750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bdc93-aaca-4697-9419-6f22a2573018 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:24.134146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bdc93-aaca-4697-9419-6f22a2573018 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:24.134510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bdc93-aaca-4697-9419-6f22a2573018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:24.148202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bdc93-aaca-4697-9419-6f22a2573018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:24.151601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9bdc93-aaca-4697-9419-6f22a2573018 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:24.159446 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:24.163648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-85074b3d-aaa7-4893-a574-d889281d0453 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b59c095ce7d49ca93ed5853b9a867e0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:24.164630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-85074b3d-aaa7-4893-a574-d889281d0453 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b59c095ce7d49ca93ed5853b9a867e0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:24.171399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-85074b3d-aaa7-4893-a574-d889281d0453 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b59c095ce7d49ca93ed5853b9a867e0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:24.185805 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3066/6072] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:40:24.223183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-85074b3d-aaa7-4893-a574-d889281d0453 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b59c095ce7d49ca93ed5853b9a867e0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:24.295687 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3007/6073] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:23 2022] DELETE /identity/v3/users/7b59c095ce7d49ca93ed5853b9a867e0 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:24.297035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d89bc-0836-423b-8861-676198f4e6b8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:24.297622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d89bc-0836-423b-8861-676198f4e6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:24.297622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884d89bc-0836-423b-8861-676198f4e6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:24.340283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-884d89bc-0836-423b-8861-676198f4e6b8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:24.341523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-884d89bc-0836-423b-8861-676198f4e6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:24.464008 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3067/6074] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:24.475626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85074b3d-aaa7-4893-a574-d889281d0453 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:24.477176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-85074b3d-aaa7-4893-a574-d889281d0453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:24.644870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85074b3d-aaa7-4893-a574-d889281d0453 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:24.652807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b04342-b839-49d8-886e-13ae563e596b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:24.654032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b04342-b839-49d8-886e-13ae563e596b service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:24.656101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b04342-b839-49d8-886e-13ae563e596b service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:24.656470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b04342-b839-49d8-886e-13ae563e596b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:24.669446 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:24.675469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b04342-b839-49d8-886e-13ae563e596b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:24.677277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b04342-b839-49d8-886e-13ae563e596b service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:24.690710 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3008/6075] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:40:25.183166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d89bc-0836-423b-8861-676198f4e6b8 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:25.186451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-884d89bc-0836-423b-8861-676198f4e6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:25.226894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884d89bc-0836-423b-8861-676198f4e6b8 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:25.243514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1b78a-e723-49eb-8f3c-8d8043b07ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:25.243514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1b78a-e723-49eb-8f3c-8d8043b07ea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:25.250474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1b78a-e723-49eb-8f3c-8d8043b07ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:25.250474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b1b78a-e723-49eb-8f3c-8d8043b07ea1 admin admin] PATH_INFO: `/v3/projects/424b9b8148684088a9f4db41ca79e5e1` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:25.250474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b1b78a-e723-49eb-8f3c-8d8043b07ea1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=424b9b8148684088a9f4db41ca79e5e1)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:25.250474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b1b78a-e723-49eb-8f3c-8d8043b07ea1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:25.462845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-64b1b78a-e723-49eb-8f3c-8d8043b07ea1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '424b9b8148684088a9f4db41ca79e5e1', 'request_id': 'req-64b1b78a-e723-49eb-8f3c-8d8043b07ea1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:25.469951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-64b1b78a-e723-49eb-8f3c-8d8043b07ea1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '424b9b8148684088a9f4db41ca79e5e1', 'request_id': 'req-64b1b78a-e723-49eb-8f3c-8d8043b07ea1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:25.477940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-64b1b78a-e723-49eb-8f3c-8d8043b07ea1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '424b9b8148684088a9f4db41ca79e5e1', 'request_id': 'req-64b1b78a-e723-49eb-8f3c-8d8043b07ea1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:25.533675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b04342-b839-49d8-886e-13ae563e596b service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:25.538368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c8b04342-b839-49d8-886e-13ae563e596b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:25.562257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b04342-b839-49d8-886e-13ae563e596b service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:25.579905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-64b1b78a-e723-49eb-8f3c-8d8043b07ea1 admin admin] The token cache is being invalidate because project 424b9b8148684088a9f4db41ca79e5e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:25.580443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-64b1b78a-e723-49eb-8f3c-8d8043b07ea1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:25.582633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-64b1b78a-e723-49eb-8f3c-8d8043b07ea1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:25.591801 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3068/6076] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:25 2022] DELETE /identity/v3/projects/424b9b8148684088a9f4db41ca79e5e1 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:25.596001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1b78a-e723-49eb-8f3c-8d8043b07ea1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:25.603648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-64b1b78a-e723-49eb-8f3c-8d8043b07ea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:25.704086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9636a-263a-48e2-a661-a0707bf09d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:25.705686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9636a-263a-48e2-a661-a0707bf09d80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:25.707536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9636a-263a-48e2-a661-a0707bf09d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:25.720603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9636a-263a-48e2-a661-a0707bf09d80 admin admin] PATH_INFO: `/v3/projects/4adc72f2ef51482f904ff61f4f1689c9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:25.725623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9636a-263a-48e2-a661-a0707bf09d80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4adc72f2ef51482f904ff61f4f1689c9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:25.728500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9636a-263a-48e2-a661-a0707bf09d80 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:25.774085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b1b78a-e723-49eb-8f3c-8d8043b07ea1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:25.784783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f59c42f-af1c-45df-bff6-3cb9359b09af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:25.786579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59c42f-af1c-45df-bff6-3cb9359b09af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:25.787446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59c42f-af1c-45df-bff6-3cb9359b09af admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:25.788345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f59c42f-af1c-45df-bff6-3cb9359b09af admin admin] PATH_INFO: `/v3/users/1ea48ed3759b4e4a89d8992b9e4bad6b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:25.790928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59c42f-af1c-45df-bff6-3cb9359b09af admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea48ed3759b4e4a89d8992b9e4bad6b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:25.795074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f59c42f-af1c-45df-bff6-3cb9359b09af admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:25.839709 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:25.929387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ffc9636a-263a-48e2-a661-a0707bf09d80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4adc72f2ef51482f904ff61f4f1689c9', 'request_id': 'req-ffc9636a-263a-48e2-a661-a0707bf09d80'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:26.029581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ffc9636a-263a-48e2-a661-a0707bf09d80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4adc72f2ef51482f904ff61f4f1689c9', 'request_id': 'req-ffc9636a-263a-48e2-a661-a0707bf09d80'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:26.039207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ffc9636a-263a-48e2-a661-a0707bf09d80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4adc72f2ef51482f904ff61f4f1689c9', 'request_id': 'req-ffc9636a-263a-48e2-a661-a0707bf09d80'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:26.053398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ffc9636a-263a-48e2-a661-a0707bf09d80 admin admin] The token cache is being invalidate because project 4adc72f2ef51482f904ff61f4f1689c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:26.054045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ffc9636a-263a-48e2-a661-a0707bf09d80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:26.054876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ffc9636a-263a-48e2-a661-a0707bf09d80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:26.057350 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3009/6077] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:25 2022] DELETE /identity/v3/projects/4adc72f2ef51482f904ff61f4f1689c9 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:26.060786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9636a-263a-48e2-a661-a0707bf09d80 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:26.069861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ffc9636a-263a-48e2-a661-a0707bf09d80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:26.105049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8f59c42f-af1c-45df-bff6-3cb9359b09af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea48ed3759b4e4a89d8992b9e4bad6b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:26.139538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8f59c42f-af1c-45df-bff6-3cb9359b09af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea48ed3759b4e4a89d8992b9e4bad6b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:26.157562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8f59c42f-af1c-45df-bff6-3cb9359b09af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea48ed3759b4e4a89d8992b9e4bad6b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:26.158636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8f59c42f-af1c-45df-bff6-3cb9359b09af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea48ed3759b4e4a89d8992b9e4bad6b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:26.232732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9636a-263a-48e2-a661-a0707bf09d80 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:26.239339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56c9a9-24ce-4cb6-8d20-f53f09247cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:26.240477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56c9a9-24ce-4cb6-8d20-f53f09247cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:26.240994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56c9a9-24ce-4cb6-8d20-f53f09247cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:26.241479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56c9a9-24ce-4cb6-8d20-f53f09247cab admin admin] PATH_INFO: `/v3/users/5de6d57b169a46a683e8164c0b887092` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:26.242975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56c9a9-24ce-4cb6-8d20-f53f09247cab admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de6d57b169a46a683e8164c0b887092)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:26.245053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56c9a9-24ce-4cb6-8d20-f53f09247cab admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:26.249666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8f59c42f-af1c-45df-bff6-3cb9359b09af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea48ed3759b4e4a89d8992b9e4bad6b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:26.260989 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3069/6078] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:25 2022] DELETE /identity/v3/users/1ea48ed3759b4e4a89d8992b9e4bad6b => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:26.365984 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:26.531795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ea56c9a9-24ce-4cb6-8d20-f53f09247cab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de6d57b169a46a683e8164c0b887092'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:26.552172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ea56c9a9-24ce-4cb6-8d20-f53f09247cab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de6d57b169a46a683e8164c0b887092'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:26.552954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ea56c9a9-24ce-4cb6-8d20-f53f09247cab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de6d57b169a46a683e8164c0b887092'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:26.553655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ea56c9a9-24ce-4cb6-8d20-f53f09247cab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de6d57b169a46a683e8164c0b887092'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:26.563460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ea56c9a9-24ce-4cb6-8d20-f53f09247cab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de6d57b169a46a683e8164c0b887092'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:26.659704 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3010/6079] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:26 2022] DELETE /identity/v3/users/5de6d57b169a46a683e8164c0b887092 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:27.246891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe0689-da89-43cc-8026-e26bcb99b215 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:27.247576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe0689-da89-43cc-8026-e26bcb99b215 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:27.248030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe0689-da89-43cc-8026-e26bcb99b215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:27.296382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9afe0689-da89-43cc-8026-e26bcb99b215 None None] MFA Rules not processed for user `d1cbf58d0cf8440aae63bf31387948f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:27.296382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9afe0689-da89-43cc-8026-e26bcb99b215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:27.389491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56c9a9-24ce-4cb6-8d20-f53f09247cab admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:27.391524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ea56c9a9-24ce-4cb6-8d20-f53f09247cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:27.458444 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3070/6080] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:27.665701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56c9a9-24ce-4cb6-8d20-f53f09247cab admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:27.683264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ad806-3a89-4925-9adc-f342f3cf69a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:27.685366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ad806-3a89-4925-9adc-f342f3cf69a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:27.688547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ad806-3a89-4925-9adc-f342f3cf69a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:27.688863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ad806-3a89-4925-9adc-f342f3cf69a3 admin admin] PATH_INFO: `/v3/projects/ff12dbaa0527434fb327f5195e9cad14` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:27.697776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ad806-3a89-4925-9adc-f342f3cf69a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff12dbaa0527434fb327f5195e9cad14)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:27.702017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ad806-3a89-4925-9adc-f342f3cf69a3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:27.893440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f41ad806-3a89-4925-9adc-f342f3cf69a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff12dbaa0527434fb327f5195e9cad14', 'request_id': 'req-f41ad806-3a89-4925-9adc-f342f3cf69a3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:28.019039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f41ad806-3a89-4925-9adc-f342f3cf69a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff12dbaa0527434fb327f5195e9cad14', 'request_id': 'req-f41ad806-3a89-4925-9adc-f342f3cf69a3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:28.037149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f41ad806-3a89-4925-9adc-f342f3cf69a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff12dbaa0527434fb327f5195e9cad14', 'request_id': 'req-f41ad806-3a89-4925-9adc-f342f3cf69a3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:28.095532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f41ad806-3a89-4925-9adc-f342f3cf69a3 admin admin] The token cache is being invalidate because project ff12dbaa0527434fb327f5195e9cad14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:28.106377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f41ad806-3a89-4925-9adc-f342f3cf69a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:28.109052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f41ad806-3a89-4925-9adc-f342f3cf69a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:28.115899 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3011/6081] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:27 2022] DELETE /identity/v3/projects/ff12dbaa0527434fb327f5195e9cad14 => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:28.122237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4b0f2-49a1-4334-abca-44b57864ffda None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:28.122531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4b0f2-49a1-4334-abca-44b57864ffda None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:28.122815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c4b0f2-49a1-4334-abca-44b57864ffda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:28.147958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-77c4b0f2-49a1-4334-abca-44b57864ffda None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:28.149187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-77c4b0f2-49a1-4334-abca-44b57864ffda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:28.329251 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3071/6082] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:28.335211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83c9a4-b2c5-48a7-9f7f-90c8e62c02aa None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:28.335211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83c9a4-b2c5-48a7-9f7f-90c8e62c02aa None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:28.335211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83c9a4-b2c5-48a7-9f7f-90c8e62c02aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:28.337377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4b0f2-49a1-4334-abca-44b57864ffda None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:28.340249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-77c4b0f2-49a1-4334-abca-44b57864ffda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:28.391580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c4b0f2-49a1-4334-abca-44b57864ffda None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:28.393756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ad83c9a4-b2c5-48a7-9f7f-90c8e62c02aa None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:28.396306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ad83c9a4-b2c5-48a7-9f7f-90c8e62c02aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:28.414378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4c190-29f2-4df3-a40a-16506ff6202c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:28.415566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4c190-29f2-4df3-a40a-16506ff6202c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:28.416420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4c190-29f2-4df3-a40a-16506ff6202c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:28.417426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be4c190-29f2-4df3-a40a-16506ff6202c admin admin] PATH_INFO: `/v3/projects/9ebabe6bbdcc463d89e1ec5ac6ed8531` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:28.421139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4c190-29f2-4df3-a40a-16506ff6202c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ebabe6bbdcc463d89e1ec5ac6ed8531)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:28.423325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be4c190-29f2-4df3-a40a-16506ff6202c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:28.428396 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3012/6083] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:28.432661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83c9a4-b2c5-48a7-9f7f-90c8e62c02aa None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:28.460840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83c9a4-b2c5-48a7-9f7f-90c8e62c02aa None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:28.466564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3f36b-d088-4834-9238-20fdc710ab6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:28.467976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3f36b-d088-4834-9238-20fdc710ab6a admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:28.468658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3f36b-d088-4834-9238-20fdc710ab6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:28.469138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3f36b-d088-4834-9238-20fdc710ab6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:28.470199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3f36b-d088-4834-9238-20fdc710ab6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:28.470755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3f36b-d088-4834-9238-20fdc710ab6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:28.472897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d3f36b-d088-4834-9238-20fdc710ab6a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:28.504110 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3013/6084] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:28.506445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3f36b-d088-4834-9238-20fdc710ab6a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:28.509229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-19d3f36b-d088-4834-9238-20fdc710ab6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:28.532376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3f36b-d088-4834-9238-20fdc710ab6a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:28.537400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6adb1-08f9-46bd-9590-a2ace97b7b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:28.538333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6adb1-08f9-46bd-9590-a2ace97b7b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:28.538665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6adb1-08f9-46bd-9590-a2ace97b7b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:28.539403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca6adb1-08f9-46bd-9590-a2ace97b7b52 admin admin] PATH_INFO: `/v3/users/3d92fb491ef34777bcf90d811355f6f8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:28.540796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6adb1-08f9-46bd-9590-a2ace97b7b52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d92fb491ef34777bcf90d811355f6f8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:28.542764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca6adb1-08f9-46bd-9590-a2ace97b7b52 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:28.552828 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:28.653121 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:28.663177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7be4c190-29f2-4df3-a40a-16506ff6202c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ebabe6bbdcc463d89e1ec5ac6ed8531', 'request_id': 'req-7be4c190-29f2-4df3-a40a-16506ff6202c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:28.671977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7be4c190-29f2-4df3-a40a-16506ff6202c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ebabe6bbdcc463d89e1ec5ac6ed8531', 'request_id': 'req-7be4c190-29f2-4df3-a40a-16506ff6202c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:28.695271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7be4c190-29f2-4df3-a40a-16506ff6202c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ebabe6bbdcc463d89e1ec5ac6ed8531', 'request_id': 'req-7be4c190-29f2-4df3-a40a-16506ff6202c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:28.794222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7be4c190-29f2-4df3-a40a-16506ff6202c admin admin] The token cache is being invalidate because project 9ebabe6bbdcc463d89e1ec5ac6ed8531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:28.796478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7be4c190-29f2-4df3-a40a-16506ff6202c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:28.797764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7be4c190-29f2-4df3-a40a-16506ff6202c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:28.804456 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3072/6085] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:28 2022] DELETE /identity/v3/projects/9ebabe6bbdcc463d89e1ec5ac6ed8531 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:28.805923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4c190-29f2-4df3-a40a-16506ff6202c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:28.811075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7be4c190-29f2-4df3-a40a-16506ff6202c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:28.944179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dca6adb1-08f9-46bd-9590-a2ace97b7b52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d92fb491ef34777bcf90d811355f6f8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:28.979881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be4c190-29f2-4df3-a40a-16506ff6202c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:28.990719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e82a9-6b1b-4e0a-aa51-fe267c18186a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:28.991400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e82a9-6b1b-4e0a-aa51-fe267c18186a admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:28.991686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e82a9-6b1b-4e0a-aa51-fe267c18186a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:28.991966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e82a9-6b1b-4e0a-aa51-fe267c18186a admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:28.992703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e82a9-6b1b-4e0a-aa51-fe267c18186a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:28.996005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e82a9-6b1b-4e0a-aa51-fe267c18186a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:29.023909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dca6adb1-08f9-46bd-9590-a2ace97b7b52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d92fb491ef34777bcf90d811355f6f8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:29.025742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dca6adb1-08f9-46bd-9590-a2ace97b7b52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d92fb491ef34777bcf90d811355f6f8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:29.027228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dca6adb1-08f9-46bd-9590-a2ace97b7b52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d92fb491ef34777bcf90d811355f6f8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:29.089725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dca6adb1-08f9-46bd-9590-a2ace97b7b52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d92fb491ef34777bcf90d811355f6f8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:29.108640 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3073/6086] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:28 2022] POST /identity/v3/projects => generated 371 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:29.110939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb2c6f-d162-46d9-a56e-3a664b0d5bd5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:29.111231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb2c6f-d162-46d9-a56e-3a664b0d5bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:29.114122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb2c6f-d162-46d9-a56e-3a664b0d5bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:29.158382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-71cb2c6f-d162-46d9-a56e-3a664b0d5bd5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:29.161417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-71cb2c6f-d162-46d9-a56e-3a664b0d5bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:29.231018 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3014/6087] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:28 2022] DELETE /identity/v3/users/3d92fb491ef34777bcf90d811355f6f8 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:29.231900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6adb1-08f9-46bd-9590-a2ace97b7b52 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:29.247436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-dca6adb1-08f9-46bd-9590-a2ace97b7b52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:29.321758 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3074/6088] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:29.324540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb2c6f-d162-46d9-a56e-3a664b0d5bd5 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:29.326714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-71cb2c6f-d162-46d9-a56e-3a664b0d5bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:29.355679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb2c6f-d162-46d9-a56e-3a664b0d5bd5 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:29.408468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca6adb1-08f9-46bd-9590-a2ace97b7b52 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:29.414784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26046df1-7095-4b41-a765-156f18ab7bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:29.415691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26046df1-7095-4b41-a765-156f18ab7bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:29.416152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26046df1-7095-4b41-a765-156f18ab7bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:29.416530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26046df1-7095-4b41-a765-156f18ab7bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:29.417652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26046df1-7095-4b41-a765-156f18ab7bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:29.419958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26046df1-7095-4b41-a765-156f18ab7bc7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:29.516120 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:29.532389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c1a17-2619-4fa1-a423-2503efc07ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:29.533413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c1a17-2619-4fa1-a423-2503efc07ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:29.533629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c1a17-2619-4fa1-a423-2503efc07ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:29.533947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c1a17-2619-4fa1-a423-2503efc07ebf admin admin] PATH_INFO: `/v3/users/04bfcc3a885d43f7a4f7b1f34ec460bc` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:29.536215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c1a17-2619-4fa1-a423-2503efc07ebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=04bfcc3a885d43f7a4f7b1f34ec460bc)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:29.538413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c1a17-2619-4fa1-a423-2503efc07ebf admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:29.545820 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3015/6089] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:29 2022] POST /identity/v3/users => generated 286 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:29.547681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64405f5a-5958-4aa7-9cbe-c35d8d377d1b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:29.548184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64405f5a-5958-4aa7-9cbe-c35d8d377d1b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:29.548714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64405f5a-5958-4aa7-9cbe-c35d8d377d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:29.605997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-64405f5a-5958-4aa7-9cbe-c35d8d377d1b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:29.610810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-64405f5a-5958-4aa7-9cbe-c35d8d377d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:29.644647 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3016/6090] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:29.645529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb101709-e668-414b-a8ad-a2c256cc8b9d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:29.646024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb101709-e668-414b-a8ad-a2c256cc8b9d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:29.646616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb101709-e668-414b-a8ad-a2c256cc8b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:29.691582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-cb101709-e668-414b-a8ad-a2c256cc8b9d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:29.693083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cb101709-e668-414b-a8ad-a2c256cc8b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:29.703754 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3017/6091] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:29.705406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb101709-e668-414b-a8ad-a2c256cc8b9d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:29.718381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb101709-e668-414b-a8ad-a2c256cc8b9d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:29.724832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d8e24-bd51-4726-bed5-f23488a31c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:29.725606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d8e24-bd51-4726-bed5-f23488a31c6e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:29.725899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d8e24-bd51-4726-bed5-f23488a31c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:29.726215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d8e24-bd51-4726-bed5-f23488a31c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:29.727224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d8e24-bd51-4726-bed5-f23488a31c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:29.729322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d8e24-bd51-4726-bed5-f23488a31c6e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:29.746276 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3018/6092] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:29.746276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d8e24-bd51-4726-bed5-f23488a31c6e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:29.746962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d09d8e24-bd51-4726-bed5-f23488a31c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:29.831342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a19c1a17-2619-4fa1-a423-2503efc07ebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04bfcc3a885d43f7a4f7b1f34ec460bc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:29.878441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a19c1a17-2619-4fa1-a423-2503efc07ebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04bfcc3a885d43f7a4f7b1f34ec460bc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:29.894325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a19c1a17-2619-4fa1-a423-2503efc07ebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04bfcc3a885d43f7a4f7b1f34ec460bc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:29.895732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a19c1a17-2619-4fa1-a423-2503efc07ebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04bfcc3a885d43f7a4f7b1f34ec460bc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:29.929526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d8e24-bd51-4726-bed5-f23488a31c6e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:29.934040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc8b3e-fdf8-4bc9-8620-d6927fab19cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:29.935060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc8b3e-fdf8-4bc9-8620-d6927fab19cc service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:29.935608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc8b3e-fdf8-4bc9-8620-d6927fab19cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:29.936231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc8b3e-fdf8-4bc9-8620-d6927fab19cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:29.944535 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:29.950700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc8b3e-fdf8-4bc9-8620-d6927fab19cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:29.953285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc8b3e-fdf8-4bc9-8620-d6927fab19cc service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:29.971961 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3019/6093] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:40:29.977793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc8b3e-fdf8-4bc9-8620-d6927fab19cc service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:29.996071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc8b3e-fdf8-4bc9-8620-d6927fab19cc service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:30.011369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0df8d-202a-488d-8cf6-831a09fa9d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:30.012363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0df8d-202a-488d-8cf6-831a09fa9d78 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:30.012789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0df8d-202a-488d-8cf6-831a09fa9d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:30.014632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0df8d-202a-488d-8cf6-831a09fa9d78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:30.015518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0df8d-202a-488d-8cf6-831a09fa9d78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:30.016445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0df8d-202a-488d-8cf6-831a09fa9d78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:30.021077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0df8d-202a-488d-8cf6-831a09fa9d78 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:30.032112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a19c1a17-2619-4fa1-a423-2503efc07ebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04bfcc3a885d43f7a4f7b1f34ec460bc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:30.042412 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3075/6094] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:29 2022] DELETE /identity/v3/users/04bfcc3a885d43f7a4f7b1f34ec460bc => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:30.043425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c1a17-2619-4fa1-a423-2503efc07ebf admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:30.047620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a19c1a17-2619-4fa1-a423-2503efc07ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:30.065791 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3020/6095] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:40:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:30.081355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92966446-3f7e-4fa1-b92f-425088c3855c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:30.081651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92966446-3f7e-4fa1-b92f-425088c3855c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:30.081937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92966446-3f7e-4fa1-b92f-425088c3855c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:30.136592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-92966446-3f7e-4fa1-b92f-425088c3855c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:30.137894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-92966446-3f7e-4fa1-b92f-425088c3855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:30.279314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c1a17-2619-4fa1-a423-2503efc07ebf admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:30.287241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe2947-7f2f-462c-a610-11177de0029f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:30.287950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe2947-7f2f-462c-a610-11177de0029f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:30.288242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe2947-7f2f-462c-a610-11177de0029f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:30.288528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe2947-7f2f-462c-a610-11177de0029f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:30.289290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe2947-7f2f-462c-a610-11177de0029f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:30.306857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe2947-7f2f-462c-a610-11177de0029f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:30.313777 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3021/6096] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:30.314926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92966446-3f7e-4fa1-b92f-425088c3855c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:30.316276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-92966446-3f7e-4fa1-b92f-425088c3855c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:30.334970 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3076/6097] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:30.340476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92966446-3f7e-4fa1-b92f-425088c3855c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:30.347332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe2947-7f2f-462c-a610-11177de0029f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:30.355990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a552ed6-ebc7-4767-b917-1737e77bbb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:30.356686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a552ed6-ebc7-4767-b917-1737e77bbb5a admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:30.356976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a552ed6-ebc7-4767-b917-1737e77bbb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:30.357255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a552ed6-ebc7-4767-b917-1737e77bbb5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:30.357974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a552ed6-ebc7-4767-b917-1737e77bbb5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:30.359912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a552ed6-ebc7-4767-b917-1737e77bbb5a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:30.368551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe2947-7f2f-462c-a610-11177de0029f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:30.389046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f188d-4e37-4fe1-b977-e69652633f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:30.389046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f188d-4e37-4fe1-b977-e69652633f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:30.389046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f188d-4e37-4fe1-b977-e69652633f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:30.389046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f188d-4e37-4fe1-b977-e69652633f3e admin admin] PATH_INFO: `/v3/projects/0e42f2ca60fc4870b96b523a8a27459b/users/61dab6177e9b4106b88ab4d7f0549a4e/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:30.419132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f188d-4e37-4fe1-b977-e69652633f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e42f2ca60fc4870b96b523a8a27459b, user_id=61dab6177e9b4106b88ab4d7f0549a4e, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:30.422205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f188d-4e37-4fe1-b977-e69652633f3e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:30.533454 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3077/6098] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:30 2022] PUT /identity/v3/projects/0e42f2ca60fc4870b96b523a8a27459b/users/61dab6177e9b4106b88ab4d7f0549a4e/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:40:30.534396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f188d-4e37-4fe1-b977-e69652633f3e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:30.535793 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3022/6099] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:30 2022] POST /identity/v3/projects => generated 369 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:30.537713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3e1f188d-4e37-4fe1-b977-e69652633f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:30.542787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a552ed6-ebc7-4767-b917-1737e77bbb5a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:30.656848 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:30.668887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f188d-4e37-4fe1-b977-e69652633f3e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:30.739212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a552ed6-ebc7-4767-b917-1737e77bbb5a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:30.750867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b50b9e-3d2c-4b5a-b1bb-fdd5277fdd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:30.752025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b50b9e-3d2c-4b5a-b1bb-fdd5277fdd10 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:30.752025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b50b9e-3d2c-4b5a-b1bb-fdd5277fdd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:30.752199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b50b9e-3d2c-4b5a-b1bb-fdd5277fdd10 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:30.753444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b50b9e-3d2c-4b5a-b1bb-fdd5277fdd10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:30.755666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b50b9e-3d2c-4b5a-b1bb-fdd5277fdd10 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:30.778418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91edbd50-7e72-4f34-baad-d3d726379f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:30.779000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edbd50-7e72-4f34-baad-d3d726379f68 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:30.779373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edbd50-7e72-4f34-baad-d3d726379f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:30.790656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edbd50-7e72-4f34-baad-d3d726379f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:30.833122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edbd50-7e72-4f34-baad-d3d726379f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:30.834754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91edbd50-7e72-4f34-baad-d3d726379f68 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:30.856222 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3078/6100] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:40:30.857588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993559f-74c5-4334-87b9-b4ded2df0ef1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:30.857866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993559f-74c5-4334-87b9-b4ded2df0ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:30.866302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9993559f-74c5-4334-87b9-b4ded2df0ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:30.882182 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3023/6101] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:30 2022] POST /identity/v3/users => generated 285 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:40:30.883660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b50b9e-3d2c-4b5a-b1bb-fdd5277fdd10 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:30.917488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b50b9e-3d2c-4b5a-b1bb-fdd5277fdd10 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:30.918946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9993559f-74c5-4334-87b9-b4ded2df0ef1 None None] MFA Rules not processed for user `61dab6177e9b4106b88ab4d7f0549a4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:30.920181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9993559f-74c5-4334-87b9-b4ded2df0ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:30.934638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da3e73-6fe7-4dba-b392-64c56e51abdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:30.936760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da3e73-6fe7-4dba-b392-64c56e51abdd admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:30.941383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da3e73-6fe7-4dba-b392-64c56e51abdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:30.941383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da3e73-6fe7-4dba-b392-64c56e51abdd admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:30.942270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da3e73-6fe7-4dba-b392-64c56e51abdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:30.946988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da3e73-6fe7-4dba-b392-64c56e51abdd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:30.975604 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3024/6102] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:40:30.979466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da3e73-6fe7-4dba-b392-64c56e51abdd admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:31.001225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da3e73-6fe7-4dba-b392-64c56e51abdd admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:31.013064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c3ebd-4aab-44af-abea-7e2c9d929225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:31.013758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c3ebd-4aab-44af-abea-7e2c9d929225 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:31.017141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c3ebd-4aab-44af-abea-7e2c9d929225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:31.017141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9c3ebd-4aab-44af-abea-7e2c9d929225 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:31.017835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c3ebd-4aab-44af-abea-7e2c9d929225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:31.021768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9c3ebd-4aab-44af-abea-7e2c9d929225 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:31.039568 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3025/6103] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:30 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:31.043501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c3ebd-4aab-44af-abea-7e2c9d929225 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:31.048000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ec9c3ebd-4aab-44af-abea-7e2c9d929225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:31.077573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9c3ebd-4aab-44af-abea-7e2c9d929225 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:31.082569 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3079/6104] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:31.084190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993559f-74c5-4334-87b9-b4ded2df0ef1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:31.088886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b8096-29d1-4782-9545-b0c53b1eb8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:31.092775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b8096-29d1-4782-9545-b0c53b1eb8aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:31.093186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b8096-29d1-4782-9545-b0c53b1eb8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:31.094685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b8096-29d1-4782-9545-b0c53b1eb8aa admin admin] PATH_INFO: `/v3/projects/673161871d6c452089cf06cba51ca39f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:31.098354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b8096-29d1-4782-9545-b0c53b1eb8aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=673161871d6c452089cf06cba51ca39f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:31.105160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b8096-29d1-4782-9545-b0c53b1eb8aa admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:31.115302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9993559f-74c5-4334-87b9-b4ded2df0ef1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:31.133091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a507bb-dcab-48d8-8841-38ef4177dbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:31.134288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a507bb-dcab-48d8-8841-38ef4177dbbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:31.134288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a507bb-dcab-48d8-8841-38ef4177dbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:31.134556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a507bb-dcab-48d8-8841-38ef4177dbbb admin admin] PATH_INFO: `/v3/projects/db7844b888b341daa35573cde91bcbcd/users/2a7d7111a97945a188d40c2d593fee94/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:31.178747 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:31.197693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a507bb-dcab-48d8-8841-38ef4177dbbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=db7844b888b341daa35573cde91bcbcd, user_id=2a7d7111a97945a188d40c2d593fee94, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:31.204527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a507bb-dcab-48d8-8841-38ef4177dbbb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:31.337775 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3080/6105] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:31 2022] PUT /identity/v3/projects/db7844b888b341daa35573cde91bcbcd/users/2a7d7111a97945a188d40c2d593fee94/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:31.339286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a507bb-dcab-48d8-8841-38ef4177dbbb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:31.364454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2e6b8096-29d1-4782-9545-b0c53b1eb8aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '673161871d6c452089cf06cba51ca39f', 'request_id': 'req-2e6b8096-29d1-4782-9545-b0c53b1eb8aa'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:31.466695 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2e6b8096-29d1-4782-9545-b0c53b1eb8aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '673161871d6c452089cf06cba51ca39f', 'request_id': 'req-2e6b8096-29d1-4782-9545-b0c53b1eb8aa'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:31.476715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2e6b8096-29d1-4782-9545-b0c53b1eb8aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '673161871d6c452089cf06cba51ca39f', 'request_id': 'req-2e6b8096-29d1-4782-9545-b0c53b1eb8aa'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:31.484954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a507bb-dcab-48d8-8841-38ef4177dbbb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:31.506280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2e6b8096-29d1-4782-9545-b0c53b1eb8aa admin admin] The token cache is being invalidate because project 673161871d6c452089cf06cba51ca39f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:31.506589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2e6b8096-29d1-4782-9545-b0c53b1eb8aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:31.509368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2e6b8096-29d1-4782-9545-b0c53b1eb8aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:31.511752 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3026/6106] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:31 2022] DELETE /identity/v3/projects/673161871d6c452089cf06cba51ca39f => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:31.514991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4b485-2d70-4bce-b3ea-69fe64462446 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:31.515291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4b485-2d70-4bce-b3ea-69fe64462446 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:31.515573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef4b485-2d70-4bce-b3ea-69fe64462446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:31.522275 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:31.567732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f382b5-60f3-457e-abe5-ad2cff5c531e tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61dab6177e9b4106b88ab4d7f0549a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e42f2ca60fc4870b96b523a8a27459b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:31.569039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f382b5-60f3-457e-abe5-ad2cff5c531e tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:31.569591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f382b5-60f3-457e-abe5-ad2cff5c531e tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:31.570136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f382b5-60f3-457e-abe5-ad2cff5c531e tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] PATH_INFO: `/v3/users/61dab6177e9b4106b88ab4d7f0549a4e/application_credentials` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:31.571171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f382b5-60f3-457e-abe5-ad2cff5c531e tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: Authorizing `identity:create_application_credential(user_id=61dab6177e9b4106b88ab4d7f0549a4e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:31.572731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f382b5-60f3-457e-abe5-ad2cff5c531e tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:31.625082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8ef4b485-2d70-4bce-b3ea-69fe64462446 None None] MFA Rules not processed for user `2a7d7111a97945a188d40c2d593fee94`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:31.626432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8ef4b485-2d70-4bce-b3ea-69fe64462446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:31.721952 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3027/6107] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:31 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:31.723259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4b485-2d70-4bce-b3ea-69fe64462446 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:31.726856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8ef4b485-2d70-4bce-b3ea-69fe64462446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:31.744718 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3081/6108] 10.222.0.43 () {60 vars in 1314 bytes} [Tue Jul 19 14:40:31 2022] POST /identity/v3/users/61dab6177e9b4106b88ab4d7f0549a4e/application_credentials => generated 921 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:31.745903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f382b5-60f3-457e-abe5-ad2cff5c531e tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:31.748576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b1f382b5-60f3-457e-abe5-ad2cff5c531e tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:31.879477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef4b485-2d70-4bce-b3ea-69fe64462446 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:31.895889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45a21c-04b7-4f22-af79-3c143f182ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:31.896900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45a21c-04b7-4f22-af79-3c143f182ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:31.897192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45a21c-04b7-4f22-af79-3c143f182ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:31.897475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45a21c-04b7-4f22-af79-3c143f182ce4 admin admin] PATH_INFO: `/v3/users/b07aee4252cf44c38a21b71c448e5caf` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:31.899871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45a21c-04b7-4f22-af79-3c143f182ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b07aee4252cf44c38a21b71c448e5caf)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:31.901810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45a21c-04b7-4f22-af79-3c143f182ce4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:31.909576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f382b5-60f3-457e-abe5-ad2cff5c531e tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:31.933992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1bc4b-4535-4661-b2e3-cd97ea735874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:31.934926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1bc4b-4535-4661-b2e3-cd97ea735874 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:31.935218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1bc4b-4535-4661-b2e3-cd97ea735874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:31.935499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1bc4b-4535-4661-b2e3-cd97ea735874 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:31.936276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1bc4b-4535-4661-b2e3-cd97ea735874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:31.938815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1bc4b-4535-4661-b2e3-cd97ea735874 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:32.093437 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3082/6109] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:31 2022] POST /identity/v3/projects => generated 369 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:32.095665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1bc4b-4535-4661-b2e3-cd97ea735874 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:32.099914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cdd1bc4b-4535-4661-b2e3-cd97ea735874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:32.166634 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:32.188104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ab45a21c-04b7-4f22-af79-3c143f182ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b07aee4252cf44c38a21b71c448e5caf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:32.248832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ab45a21c-04b7-4f22-af79-3c143f182ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b07aee4252cf44c38a21b71c448e5caf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:32.252226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ab45a21c-04b7-4f22-af79-3c143f182ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b07aee4252cf44c38a21b71c448e5caf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:32.258470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ab45a21c-04b7-4f22-af79-3c143f182ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b07aee4252cf44c38a21b71c448e5caf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:32.266927 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:32.291991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ab45a21c-04b7-4f22-af79-3c143f182ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b07aee4252cf44c38a21b71c448e5caf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:32.306223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1bc4b-4535-4661-b2e3-cd97ea735874 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:32.323015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5f3a8-ded5-4c0a-ba61-34c708349b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:32.328424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5f3a8-ded5-4c0a-ba61-34c708349b36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:32.328714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5f3a8-ded5-4c0a-ba61-34c708349b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:32.331559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5f3a8-ded5-4c0a-ba61-34c708349b36 admin admin] PATH_INFO: `/v3/projects/0b48c1d65a7e4b44813faf11813a0fb9` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:32.335935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5f3a8-ded5-4c0a-ba61-34c708349b36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b48c1d65a7e4b44813faf11813a0fb9)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:32.340626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5f3a8-ded5-4c0a-ba61-34c708349b36 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:32.391167 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3028/6110] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:31 2022] DELETE /identity/v3/users/b07aee4252cf44c38a21b71c448e5caf => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:32.394894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45a21c-04b7-4f22-af79-3c143f182ce4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:32.430611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ab45a21c-04b7-4f22-af79-3c143f182ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:32.523841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-09d5f3a8-ded5-4c0a-ba61-34c708349b36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b48c1d65a7e4b44813faf11813a0fb9', 'request_id': 'req-09d5f3a8-ded5-4c0a-ba61-34c708349b36'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:32.545975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-09d5f3a8-ded5-4c0a-ba61-34c708349b36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b48c1d65a7e4b44813faf11813a0fb9', 'request_id': 'req-09d5f3a8-ded5-4c0a-ba61-34c708349b36'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:32.566835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-09d5f3a8-ded5-4c0a-ba61-34c708349b36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b48c1d65a7e4b44813faf11813a0fb9', 'request_id': 'req-09d5f3a8-ded5-4c0a-ba61-34c708349b36'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:32.605090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45a21c-04b7-4f22-af79-3c143f182ce4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:32.667265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-09d5f3a8-ded5-4c0a-ba61-34c708349b36 admin admin] The token cache is being invalidate because project 0b48c1d65a7e4b44813faf11813a0fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:32.667557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-09d5f3a8-ded5-4c0a-ba61-34c708349b36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:32.668931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-09d5f3a8-ded5-4c0a-ba61-34c708349b36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:32.671248 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3083/6111] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:32 2022] DELETE /identity/v3/projects/0b48c1d65a7e4b44813faf11813a0fb9 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:32.675383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5f3a8-ded5-4c0a-ba61-34c708349b36 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:32.679366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-09d5f3a8-ded5-4c0a-ba61-34c708349b36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:32.724094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab4095-ecec-439e-a216-2f395fd69956 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61dab6177e9b4106b88ab4d7f0549a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e42f2ca60fc4870b96b523a8a27459b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:32.729149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab4095-ecec-439e-a216-2f395fd69956 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:32.729149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab4095-ecec-439e-a216-2f395fd69956 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:32.729149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab4095-ecec-439e-a216-2f395fd69956 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] PATH_INFO: `/v3/users/61dab6177e9b4106b88ab4d7f0549a4e/access_rules/35c3996a41644452a1c1ac69f89c5a0f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:32.729149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab4095-ecec-439e-a216-2f395fd69956 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: Authorizing `identity:delete_access_rule(user_id=61dab6177e9b4106b88ab4d7f0549a4e, access_rule_id=35c3996a41644452a1c1ac69f89c5a0f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:32.732070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab4095-ecec-439e-a216-2f395fd69956 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:32.792535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-4fab4095-ecec-439e-a216-2f395fd69956 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jul 19 14:40:32.792535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:40:32.792535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Jul 19 14:40:32.792535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application session.delete(ref) Jul 19 14:40:32.792535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 14:40:32.792535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application next(self.gen) Jul 19 14:40:32.792535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 14:40:32.792535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application yield resource Jul 19 14:40:32.792535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 14:40:32.792535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application next(self.gen) Jul 19 14:40:32.792535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 14:40:32.792535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 14:40:32.792535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 14:40:32.792535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 14:40:32.792535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 14:40:32.792535 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise self.value Jul 19 14:40:32.793751 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 14:40:32.793751 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 14:40:32.793751 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 14:40:32.793751 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application session.commit() Jul 19 14:40:32.793751 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 14:40:32.793751 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 14:40:32.793751 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 14:40:32.793751 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 14:40:32.793751 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 14:40:32.793751 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self.session.flush() Jul 19 14:40:32.793751 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 14:40:32.793751 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 14:40:32.793751 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 14:40:32.793751 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 14:40:32.793751 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 14:40:32.793751 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application compat.raise_( Jul 19 14:40:32.803743 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 14:40:32.803743 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception Jul 19 14:40:32.803743 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 14:40:32.803743 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 14:40:32.803743 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 14:40:32.803743 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 14:40:32.803743 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Jul 19 14:40:32.803743 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Jul 19 14:40:32.803743 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Jul 19 14:40:32.803743 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._synchronize( Jul 19 14:40:32.803743 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Jul 19 14:40:32.803743 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Jul 19 14:40:32.803743 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Jul 19 14:40:32.803743 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise AssertionError( Jul 19 14:40:32.803743 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Jul 19 14:40:32.803743 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:40:32.804808 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:40:32.804808 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:40:32.804808 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:40:32.804808 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:40:32.804808 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:40:32.804808 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:40:32.804808 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:40:32.804808 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:40:32.804808 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:40:32.804808 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:40:32.804808 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:40:32.804808 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:40:32.804808 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:40:32.804808 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Jul 19 14:40:32.804808 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Jul 19 14:40:32.804808 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:40:32.804808 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:40:32.806353 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Jul 19 14:40:32.806353 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Jul 19 14:40:32.806353 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Jul 19 14:40:32.806353 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jul 19 14:40:32.806353 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jul 19 14:40:32.806353 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:40:32.806353 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3029/6112] 10.222.0.43 () {58 vars in 1361 bytes} [Tue Jul 19 14:40:32 2022] DELETE /identity/v3/users/61dab6177e9b4106b88ab4d7f0549a4e/access_rules/35c3996a41644452a1c1ac69f89c5a0f => generated 89 bytes in 403 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Jul 19 14:40:32.806353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab4095-ecec-439e-a216-2f395fd69956 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:32.806353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4fab4095-ecec-439e-a216-2f395fd69956 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:32.848811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5f3a8-ded5-4c0a-ba61-34c708349b36 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:32.855470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce36e96-fb81-4690-8961-8daf511f277d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:32.856248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce36e96-fb81-4690-8961-8daf511f277d admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:32.856605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce36e96-fb81-4690-8961-8daf511f277d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:32.856998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce36e96-fb81-4690-8961-8daf511f277d admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:32.857833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce36e96-fb81-4690-8961-8daf511f277d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:32.859952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce36e96-fb81-4690-8961-8daf511f277d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:32.939020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab4095-ecec-439e-a216-2f395fd69956 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:32.943356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd1d2e-5b5b-4a4a-b434-0d0ee71acd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:32.944269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd1d2e-5b5b-4a4a-b434-0d0ee71acd89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:32.944566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd1d2e-5b5b-4a4a-b434-0d0ee71acd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:32.944852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd1d2e-5b5b-4a4a-b434-0d0ee71acd89 admin admin] PATH_INFO: `/v3/users/657712558cf844609ae8ae62fe6f3479` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:32.946116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd1d2e-5b5b-4a4a-b434-0d0ee71acd89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=657712558cf844609ae8ae62fe6f3479)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:32.948248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd1d2e-5b5b-4a4a-b434-0d0ee71acd89 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:32.962866 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:32.968687 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3084/6113] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:32 2022] POST /identity/v3/users => generated 291 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:32.968687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce36e96-fb81-4690-8961-8daf511f277d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:32.969775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dce36e96-fb81-4690-8961-8daf511f277d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:32.995518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce36e96-fb81-4690-8961-8daf511f277d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:33.000294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4a517-7794-4740-b9bf-7f74d9a66695 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61dab6177e9b4106b88ab4d7f0549a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e42f2ca60fc4870b96b523a8a27459b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:33.001460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4a517-7794-4740-b9bf-7f74d9a66695 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:33.001754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4a517-7794-4740-b9bf-7f74d9a66695 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:33.002039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4a517-7794-4740-b9bf-7f74d9a66695 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] PATH_INFO: `/v3/users/61dab6177e9b4106b88ab4d7f0549a4e/application_credentials/c014fa5b388f48329f4cc6e217b5cf2d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:33.020262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4a517-7794-4740-b9bf-7f74d9a66695 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: Authorizing `identity:delete_application_credential(user_id=61dab6177e9b4106b88ab4d7f0549a4e, application_credential_id=c014fa5b388f48329f4cc6e217b5cf2d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:33.021783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4a517-7794-4740-b9bf-7f74d9a66695 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:33.120839 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3085/6114] 10.222.0.43 () {58 vars in 1394 bytes} [Tue Jul 19 14:40:32 2022] DELETE /identity/v3/users/61dab6177e9b4106b88ab4d7f0549a4e/application_credentials/c014fa5b388f48329f4cc6e217b5cf2d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:33.122011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4a517-7794-4740-b9bf-7f74d9a66695 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:33.148293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4a517-7794-4740-b9bf-7f74d9a66695 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:33.162469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8bbd1d2e-5b5b-4a4a-b434-0d0ee71acd89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '657712558cf844609ae8ae62fe6f3479'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:33.163110 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd7f90-3830-4013-a9ce-e7d49a20a890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:33.163810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd7f90-3830-4013-a9ce-e7d49a20a890 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:33.164094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd7f90-3830-4013-a9ce-e7d49a20a890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:33.164373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd7f90-3830-4013-a9ce-e7d49a20a890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:33.165114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd7f90-3830-4013-a9ce-e7d49a20a890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:33.166768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bd7f90-3830-4013-a9ce-e7d49a20a890 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:33.185970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8bbd1d2e-5b5b-4a4a-b434-0d0ee71acd89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '657712558cf844609ae8ae62fe6f3479'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:33.187345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8bbd1d2e-5b5b-4a4a-b434-0d0ee71acd89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '657712558cf844609ae8ae62fe6f3479'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:33.188181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8bbd1d2e-5b5b-4a4a-b434-0d0ee71acd89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '657712558cf844609ae8ae62fe6f3479'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:33.188464 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3086/6115] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:33.189450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd7f90-3830-4013-a9ce-e7d49a20a890 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:33.201329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8bbd1d2e-5b5b-4a4a-b434-0d0ee71acd89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '657712558cf844609ae8ae62fe6f3479'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:33.201790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b8bd7f90-3830-4013-a9ce-e7d49a20a890 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:33.229570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd7f90-3830-4013-a9ce-e7d49a20a890 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:33.244096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7033dd-f5e5-4e4a-b035-bc84b7512b51 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61dab6177e9b4106b88ab4d7f0549a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e42f2ca60fc4870b96b523a8a27459b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:33.245293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7033dd-f5e5-4e4a-b035-bc84b7512b51 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:33.245629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7033dd-f5e5-4e4a-b035-bc84b7512b51 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:33.245917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7033dd-f5e5-4e4a-b035-bc84b7512b51 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] PATH_INFO: `/v3/users/61dab6177e9b4106b88ab4d7f0549a4e/access_rules` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:33.247328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7033dd-f5e5-4e4a-b035-bc84b7512b51 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: Authorizing `identity:list_access_rules(user_id=61dab6177e9b4106b88ab4d7f0549a4e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:33.248934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7033dd-f5e5-4e4a-b035-bc84b7512b51 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:33.264991 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3087/6116] 10.222.0.43 () {58 vars in 1259 bytes} [Tue Jul 19 14:40:33 2022] GET /identity/v3/users/61dab6177e9b4106b88ab4d7f0549a4e/access_rules => generated 369 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:33.266609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7033dd-f5e5-4e4a-b035-bc84b7512b51 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:33.269279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7f7033dd-f5e5-4e4a-b035-bc84b7512b51 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:33.286871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7033dd-f5e5-4e4a-b035-bc84b7512b51 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:33.292217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79104c84-879e-42eb-8af5-d6ea40a120c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:33.302457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79104c84-879e-42eb-8af5-d6ea40a120c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:33.304123 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3030/6117] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:32 2022] DELETE /identity/v3/users/657712558cf844609ae8ae62fe6f3479 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:33.308834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd1d2e-5b5b-4a4a-b434-0d0ee71acd89 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:33.310865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79104c84-879e-42eb-8af5-d6ea40a120c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:33.311825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79104c84-879e-42eb-8af5-d6ea40a120c1 admin admin] PATH_INFO: `/v3/projects/23bd0bdc711a4ab29a50bc0ea4c92f25/users/847dea14552f490bb065b6027f7b2529/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:33.321003 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:33.354951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79104c84-879e-42eb-8af5-d6ea40a120c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23bd0bdc711a4ab29a50bc0ea4c92f25, user_id=847dea14552f490bb065b6027f7b2529, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:33.365343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79104c84-879e-42eb-8af5-d6ea40a120c1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:33.421108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd1d2e-5b5b-4a4a-b434-0d0ee71acd89 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:33.429103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b654d-618d-4797-a796-ac60353e4108 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61dab6177e9b4106b88ab4d7f0549a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e42f2ca60fc4870b96b523a8a27459b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:33.431283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b654d-618d-4797-a796-ac60353e4108 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:33.431724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b654d-618d-4797-a796-ac60353e4108 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:33.432174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b654d-618d-4797-a796-ac60353e4108 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] PATH_INFO: `/v3/users/61dab6177e9b4106b88ab4d7f0549a4e/access_rules/35c3996a41644452a1c1ac69f89c5a0f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:33.434131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b654d-618d-4797-a796-ac60353e4108 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: Authorizing `identity:delete_access_rule(user_id=61dab6177e9b4106b88ab4d7f0549a4e, access_rule_id=35c3996a41644452a1c1ac69f89c5a0f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:33.435781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b654d-618d-4797-a796-ac60353e4108 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:33.453772 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3088/6118] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:33 2022] PUT /identity/v3/projects/23bd0bdc711a4ab29a50bc0ea4c92f25/users/847dea14552f490bb065b6027f7b2529/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:33.455035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79104c84-879e-42eb-8af5-d6ea40a120c1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:33.536910 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3031/6119] 10.222.0.43 () {58 vars in 1361 bytes} [Tue Jul 19 14:40:33 2022] DELETE /identity/v3/users/61dab6177e9b4106b88ab4d7f0549a4e/access_rules/35c3996a41644452a1c1ac69f89c5a0f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:33.538742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b654d-618d-4797-a796-ac60353e4108 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:33.545033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79104c84-879e-42eb-8af5-d6ea40a120c1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:33.553784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5946a-bca4-49d4-91ae-8eaf00d10bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:33.554673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5946a-bca4-49d4-91ae-8eaf00d10bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:33.555070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5946a-bca4-49d4-91ae-8eaf00d10bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:33.556694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5946a-bca4-49d4-91ae-8eaf00d10bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:33.558798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5946a-bca4-49d4-91ae-8eaf00d10bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:33.560744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5946a-bca4-49d4-91ae-8eaf00d10bc3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:33.567978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b654d-618d-4797-a796-ac60353e4108 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:33.578145 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3089/6120] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:33 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:33.581897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5946a-bca4-49d4-91ae-8eaf00d10bc3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:33.625964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5946a-bca4-49d4-91ae-8eaf00d10bc3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:33.633579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59bd00-7023-4edf-9cfe-ac2677245c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:33.634972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59bd00-7023-4edf-9cfe-ac2677245c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:33.635437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59bd00-7023-4edf-9cfe-ac2677245c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:33.635926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59bd00-7023-4edf-9cfe-ac2677245c79 admin admin] PATH_INFO: `/v3/projects/23bd0bdc711a4ab29a50bc0ea4c92f25/users/847dea14552f490bb065b6027f7b2529/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:33.638299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59bd00-7023-4edf-9cfe-ac2677245c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23bd0bdc711a4ab29a50bc0ea4c92f25, user_id=847dea14552f490bb065b6027f7b2529, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:33.642830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59bd00-7023-4edf-9cfe-ac2677245c79 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:33.672160 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3090/6121] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:33 2022] PUT /identity/v3/projects/23bd0bdc711a4ab29a50bc0ea4c92f25/users/847dea14552f490bb065b6027f7b2529/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:33.683961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53b8c5-1629-42dc-a185-51ba70dc9c8c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:33.684617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53b8c5-1629-42dc-a185-51ba70dc9c8c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:33.686929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f53b8c5-1629-42dc-a185-51ba70dc9c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:33.700915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf8aa4-07ab-4d94-9562-85d29779ad1d tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61dab6177e9b4106b88ab4d7f0549a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e42f2ca60fc4870b96b523a8a27459b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:33.708261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf8aa4-07ab-4d94-9562-85d29779ad1d tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:33.709610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf8aa4-07ab-4d94-9562-85d29779ad1d tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:33.711202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf8aa4-07ab-4d94-9562-85d29779ad1d tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] PATH_INFO: `/v3/users/61dab6177e9b4106b88ab4d7f0549a4e/access_rules` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:33.717490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf8aa4-07ab-4d94-9562-85d29779ad1d tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: Authorizing `identity:list_access_rules(user_id=61dab6177e9b4106b88ab4d7f0549a4e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:33.719261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdf8aa4-07ab-4d94-9562-85d29779ad1d tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:33.741471 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3032/6122] 10.222.0.43 () {58 vars in 1259 bytes} [Tue Jul 19 14:40:33 2022] GET /identity/v3/users/61dab6177e9b4106b88ab4d7f0549a4e/access_rules => generated 158 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:33.746274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf8aa4-07ab-4d94-9562-85d29779ad1d tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:33.748336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1cdf8aa4-07ab-4d94-9562-85d29779ad1d tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:33.777200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2f53b8c5-1629-42dc-a185-51ba70dc9c8c None None] MFA Rules not processed for user `847dea14552f490bb065b6027f7b2529`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:33.779924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2f53b8c5-1629-42dc-a185-51ba70dc9c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:33.814311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf8aa4-07ab-4d94-9562-85d29779ad1d tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:33.878936 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:33.955150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235e3fe-48e2-440c-939d-b3f96b5480a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:33.956016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235e3fe-48e2-440c-939d-b3f96b5480a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:33.956969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235e3fe-48e2-440c-939d-b3f96b5480a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:33.957255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235e3fe-48e2-440c-939d-b3f96b5480a6 admin admin] PATH_INFO: `/v3/users/4bd76bbba0a440f8a132318a573a8cf6` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:33.958696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235e3fe-48e2-440c-939d-b3f96b5480a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bd76bbba0a440f8a132318a573a8cf6)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:33.960615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3235e3fe-48e2-440c-939d-b3f96b5480a6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:33.965524 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3091/6123] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:33 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:40:33.966540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53b8c5-1629-42dc-a185-51ba70dc9c8c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:34.056153 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:34.060497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f53b8c5-1629-42dc-a185-51ba70dc9c8c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:34.065168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d171a40-c0e3-459e-be03-fd12b9f5daf7 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61dab6177e9b4106b88ab4d7f0549a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e42f2ca60fc4870b96b523a8a27459b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:34.066759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d171a40-c0e3-459e-be03-fd12b9f5daf7 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:34.067055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d171a40-c0e3-459e-be03-fd12b9f5daf7 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:34.067356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d171a40-c0e3-459e-be03-fd12b9f5daf7 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] PATH_INFO: `/v3/users/61dab6177e9b4106b88ab4d7f0549a4e/application_credentials` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:34.068111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d171a40-c0e3-459e-be03-fd12b9f5daf7 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: Authorizing `identity:create_application_credential(user_id=61dab6177e9b4106b88ab4d7f0549a4e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:34.069315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d171a40-c0e3-459e-be03-fd12b9f5daf7 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:34.185387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3235e3fe-48e2-440c-939d-b3f96b5480a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bd76bbba0a440f8a132318a573a8cf6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:34.233728 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3092/6124] 10.222.0.43 () {60 vars in 1314 bytes} [Tue Jul 19 14:40:33 2022] POST /identity/v3/users/61dab6177e9b4106b88ab4d7f0549a4e/application_credentials => generated 920 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:34.234788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d171a40-c0e3-459e-be03-fd12b9f5daf7 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:34.239862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9d171a40-c0e3-459e-be03-fd12b9f5daf7 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:34.240509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3235e3fe-48e2-440c-939d-b3f96b5480a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bd76bbba0a440f8a132318a573a8cf6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:34.244005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3235e3fe-48e2-440c-939d-b3f96b5480a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bd76bbba0a440f8a132318a573a8cf6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:34.245970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3235e3fe-48e2-440c-939d-b3f96b5480a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bd76bbba0a440f8a132318a573a8cf6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:34.282364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3235e3fe-48e2-440c-939d-b3f96b5480a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bd76bbba0a440f8a132318a573a8cf6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:34.284680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d171a40-c0e3-459e-be03-fd12b9f5daf7 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:34.302927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021845e3-75f3-4caa-8a81-d443471e6363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:34.306080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021845e3-75f3-4caa-8a81-d443471e6363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:34.306080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021845e3-75f3-4caa-8a81-d443471e6363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:34.306080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021845e3-75f3-4caa-8a81-d443471e6363 admin admin] PATH_INFO: `/v3/projects/ddcc5ca2b12940f8a770d6e9cae5ad1f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:34.306475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021845e3-75f3-4caa-8a81-d443471e6363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddcc5ca2b12940f8a770d6e9cae5ad1f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:34.308410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021845e3-75f3-4caa-8a81-d443471e6363 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:34.372221 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3033/6125] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:33 2022] DELETE /identity/v3/users/4bd76bbba0a440f8a132318a573a8cf6 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:34.373363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235e3fe-48e2-440c-939d-b3f96b5480a6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:34.375763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3235e3fe-48e2-440c-939d-b3f96b5480a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:34.477635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-021845e3-75f3-4caa-8a81-d443471e6363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddcc5ca2b12940f8a770d6e9cae5ad1f', 'request_id': 'req-021845e3-75f3-4caa-8a81-d443471e6363'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:34.489567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-021845e3-75f3-4caa-8a81-d443471e6363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddcc5ca2b12940f8a770d6e9cae5ad1f', 'request_id': 'req-021845e3-75f3-4caa-8a81-d443471e6363'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:34.496977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-021845e3-75f3-4caa-8a81-d443471e6363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddcc5ca2b12940f8a770d6e9cae5ad1f', 'request_id': 'req-021845e3-75f3-4caa-8a81-d443471e6363'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:34.571184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3235e3fe-48e2-440c-939d-b3f96b5480a6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:34.576050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-021845e3-75f3-4caa-8a81-d443471e6363 admin admin] The token cache is being invalidate because project ddcc5ca2b12940f8a770d6e9cae5ad1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:34.576586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-021845e3-75f3-4caa-8a81-d443471e6363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:34.579032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-021845e3-75f3-4caa-8a81-d443471e6363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:34.582044 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3093/6126] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:34 2022] DELETE /identity/v3/projects/ddcc5ca2b12940f8a770d6e9cae5ad1f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:34.582741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021845e3-75f3-4caa-8a81-d443471e6363 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:34.587987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-021845e3-75f3-4caa-8a81-d443471e6363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:34.684812 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:34.698164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b99bf5-ed90-4eb1-984e-77fffd6c3b9c tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847dea14552f490bb065b6027f7b2529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23bd0bdc711a4ab29a50bc0ea4c92f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:34.699103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b99bf5-ed90-4eb1-984e-77fffd6c3b9c tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:34.699502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b99bf5-ed90-4eb1-984e-77fffd6c3b9c tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:34.699845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b99bf5-ed90-4eb1-984e-77fffd6c3b9c tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:34.700694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b99bf5-ed90-4eb1-984e-77fffd6c3b9c tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:34.702787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b99bf5-ed90-4eb1-984e-77fffd6c3b9c tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:34.764366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021845e3-75f3-4caa-8a81-d443471e6363 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:34.771088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585fafa-5809-4272-9875-cbec653820de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:34.771701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585fafa-5809-4272-9875-cbec653820de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:34.771994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585fafa-5809-4272-9875-cbec653820de admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:34.772277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585fafa-5809-4272-9875-cbec653820de admin admin] PATH_INFO: `/v3/projects/f3b0e53de5444dfcbbeba264f04c5d0f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:34.773977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585fafa-5809-4272-9875-cbec653820de admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3b0e53de5444dfcbbeba264f04c5d0f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:34.776124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585fafa-5809-4272-9875-cbec653820de admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:34.794260 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:34.822533 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3034/6127] 10.222.0.43 () {60 vars in 1151 bytes} [Tue Jul 19 14:40:34 2022] POST /identity/v3/services => generated 241 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:34.822533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b99bf5-ed90-4eb1-984e-77fffd6c3b9c tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:34.824387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d5b99bf5-ed90-4eb1-984e-77fffd6c3b9c tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:34.930526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d585fafa-5809-4272-9875-cbec653820de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b0e53de5444dfcbbeba264f04c5d0f', 'request_id': 'req-d585fafa-5809-4272-9875-cbec653820de'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:34.937883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b99bf5-ed90-4eb1-984e-77fffd6c3b9c tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:34.943358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d585fafa-5809-4272-9875-cbec653820de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b0e53de5444dfcbbeba264f04c5d0f', 'request_id': 'req-d585fafa-5809-4272-9875-cbec653820de'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:34.952896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d585fafa-5809-4272-9875-cbec653820de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b0e53de5444dfcbbeba264f04c5d0f', 'request_id': 'req-d585fafa-5809-4272-9875-cbec653820de'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:35.000755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767ff92-6e19-4706-af97-1dc6105afe50 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61dab6177e9b4106b88ab4d7f0549a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e42f2ca60fc4870b96b523a8a27459b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:35.001796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767ff92-6e19-4706-af97-1dc6105afe50 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:35.002244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767ff92-6e19-4706-af97-1dc6105afe50 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:35.006645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767ff92-6e19-4706-af97-1dc6105afe50 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] PATH_INFO: `/v3/users/61dab6177e9b4106b88ab4d7f0549a4e/access_rules` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:35.006645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767ff92-6e19-4706-af97-1dc6105afe50 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: Authorizing `identity:list_access_rules(user_id=61dab6177e9b4106b88ab4d7f0549a4e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:35.007399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1767ff92-6e19-4706-af97-1dc6105afe50 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:35.013324 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3035/6128] 10.222.0.43 () {58 vars in 1259 bytes} [Tue Jul 19 14:40:34 2022] GET /identity/v3/users/61dab6177e9b4106b88ab4d7f0549a4e/access_rules => generated 369 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:35.014745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c251f4-d13d-4fd8-8009-fb4e5c933a27 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:35.016743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c251f4-d13d-4fd8-8009-fb4e5c933a27 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:35.016743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c251f4-d13d-4fd8-8009-fb4e5c933a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:35.047329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e3c251f4-d13d-4fd8-8009-fb4e5c933a27 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:35.048414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d585fafa-5809-4272-9875-cbec653820de admin admin] The token cache is being invalidate because project f3b0e53de5444dfcbbeba264f04c5d0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:35.048766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e3c251f4-d13d-4fd8-8009-fb4e5c933a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:35.049033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d585fafa-5809-4272-9875-cbec653820de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:35.050543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d585fafa-5809-4272-9875-cbec653820de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:35.052683 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3094/6129] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:34 2022] DELETE /identity/v3/projects/f3b0e53de5444dfcbbeba264f04c5d0f => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:35.054205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343d4e9-8c1e-4b8a-af92-6f3233e8c5ce None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:35.054633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343d4e9-8c1e-4b8a-af92-6f3233e8c5ce None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:35.055074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343d4e9-8c1e-4b8a-af92-6f3233e8c5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:35.075089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9343d4e9-8c1e-4b8a-af92-6f3233e8c5ce None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:35.076652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9343d4e9-8c1e-4b8a-af92-6f3233e8c5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:35.207095 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3036/6130] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:35 2022] POST /identity/v3/auth/tokens => generated 3363 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:35.228660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c251f4-d13d-4fd8-8009-fb4e5c933a27 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:35.233320 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3095/6131] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:35 2022] POST /identity/v3/auth/tokens => generated 3363 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:35.234439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343d4e9-8c1e-4b8a-af92-6f3233e8c5ce None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:35.243277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e3c251f4-d13d-4fd8-8009-fb4e5c933a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:35.243965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9343d4e9-8c1e-4b8a-af92-6f3233e8c5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:35.278565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343d4e9-8c1e-4b8a-af92-6f3233e8c5ce None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:35.288994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96697760-d894-4bbb-ba37-cf33f3156184 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61dab6177e9b4106b88ab4d7f0549a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e42f2ca60fc4870b96b523a8a27459b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:35.289915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96697760-d894-4bbb-ba37-cf33f3156184 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:35.290240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96697760-d894-4bbb-ba37-cf33f3156184 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:35.290523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96697760-d894-4bbb-ba37-cf33f3156184 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] PATH_INFO: `/v3/users/61dab6177e9b4106b88ab4d7f0549a4e/application_credentials` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:35.291286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96697760-d894-4bbb-ba37-cf33f3156184 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: Authorizing `identity:create_application_credential(user_id=61dab6177e9b4106b88ab4d7f0549a4e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:35.292470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96697760-d894-4bbb-ba37-cf33f3156184 tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:35.304652 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:35.399714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c251f4-d13d-4fd8-8009-fb4e5c933a27 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:35.410074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024267c2-7742-43e5-8dd5-6cc6b12c0a2c tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847dea14552f490bb065b6027f7b2529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23bd0bdc711a4ab29a50bc0ea4c92f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:35.411037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024267c2-7742-43e5-8dd5-6cc6b12c0a2c tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:35.411330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024267c2-7742-43e5-8dd5-6cc6b12c0a2c tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:35.411616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024267c2-7742-43e5-8dd5-6cc6b12c0a2c tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] PATH_INFO: `/v3/services/118260c96bc640acb49607f12a3a4acc` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:35.412294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024267c2-7742-43e5-8dd5-6cc6b12c0a2c tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorizing `identity:delete_service(service_id=118260c96bc640acb49607f12a3a4acc)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:35.414590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024267c2-7742-43e5-8dd5-6cc6b12c0a2c tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:35.516740 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3096/6132] 10.222.0.43 () {60 vars in 1314 bytes} [Tue Jul 19 14:40:35 2022] POST /identity/v3/users/61dab6177e9b4106b88ab4d7f0549a4e/application_credentials => generated 921 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:35.516955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa9b89-4b92-46cc-86af-99163e68d6ad None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:35.517230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa9b89-4b92-46cc-86af-99163e68d6ad None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:35.517520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa9b89-4b92-46cc-86af-99163e68d6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:35.548208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7efa9b89-4b92-46cc-86af-99163e68d6ad None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:35.548979 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3037/6133] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:35 2022] DELETE /identity/v3/services/118260c96bc640acb49607f12a3a4acc => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:35.550252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7efa9b89-4b92-46cc-86af-99163e68d6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:35.551340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024267c2-7742-43e5-8dd5-6cc6b12c0a2c tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:35.554092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-024267c2-7742-43e5-8dd5-6cc6b12c0a2c tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:35.574374 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3097/6134] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:35.575815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39816769-1f97-4396-95e4-9ef5049645a5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:35.576600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39816769-1f97-4396-95e4-9ef5049645a5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:35.576600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39816769-1f97-4396-95e4-9ef5049645a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:35.598110 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:35.608777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-39816769-1f97-4396-95e4-9ef5049645a5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:35.610414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-39816769-1f97-4396-95e4-9ef5049645a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:35.622165 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3098/6135] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:35.623249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39816769-1f97-4396-95e4-9ef5049645a5 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:35.645447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024267c2-7742-43e5-8dd5-6cc6b12c0a2c tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:35.654724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39816769-1f97-4396-95e4-9ef5049645a5 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:35.661199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7841e4-870f-49e6-a5e5-598a48abf1ed tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61dab6177e9b4106b88ab4d7f0549a4e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e42f2ca60fc4870b96b523a8a27459b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:35.671369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7841e4-870f-49e6-a5e5-598a48abf1ed tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:35.671662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e41089-1189-42ba-836e-6b8a14e4e3ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:35.671865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7841e4-870f-49e6-a5e5-598a48abf1ed tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:35.672247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7841e4-870f-49e6-a5e5-598a48abf1ed tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] PATH_INFO: `/v3/users/61dab6177e9b4106b88ab4d7f0549a4e/access_rules/c46319c2d8004eaca8d60271a605456a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:35.672547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e41089-1189-42ba-836e-6b8a14e4e3ba service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:35.672939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e41089-1189-42ba-836e-6b8a14e4e3ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:35.673291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e41089-1189-42ba-836e-6b8a14e4e3ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:35.675412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7841e4-870f-49e6-a5e5-598a48abf1ed tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: Authorizing `identity:get_access_rule(user_id=61dab6177e9b4106b88ab4d7f0549a4e, access_rule_id=c46319c2d8004eaca8d60271a605456a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:35.678067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7841e4-870f-49e6-a5e5-598a48abf1ed tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:35.686295 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3099/6136] 10.222.0.43 () {58 vars in 1358 bytes} [Tue Jul 19 14:40:35 2022] GET /identity/v3/users/61dab6177e9b4106b88ab4d7f0549a4e/access_rules/c46319c2d8004eaca8d60271a605456a => generated 229 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:35.687410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7841e4-870f-49e6-a5e5-598a48abf1ed tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:35.689888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e41089-1189-42ba-836e-6b8a14e4e3ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:35.692054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e41089-1189-42ba-836e-6b8a14e4e3ba service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:35.720601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7841e4-870f-49e6-a5e5-598a48abf1ed tempest-AccessRulesV3Test-1356974424 tempest-AccessRulesV3Test-1356974424-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:35.728761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d39bc3-1682-4643-874f-eab7ac884f71 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847dea14552f490bb065b6027f7b2529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23bd0bdc711a4ab29a50bc0ea4c92f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:35.729154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d39bc3-1682-4643-874f-eab7ac884f71 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:35.729517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d39bc3-1682-4643-874f-eab7ac884f71 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:35.729812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d39bc3-1682-4643-874f-eab7ac884f71 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:35.730660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d39bc3-1682-4643-874f-eab7ac884f71 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:35.732470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d39bc3-1682-4643-874f-eab7ac884f71 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:35.735445 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3038/6137] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:40:35.738886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81f27c-44c9-4bcd-8f8d-f9e19ff8904b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:35.739258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81f27c-44c9-4bcd-8f8d-f9e19ff8904b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:35.739616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81f27c-44c9-4bcd-8f8d-f9e19ff8904b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:35.762375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2c81f27c-44c9-4bcd-8f8d-f9e19ff8904b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:35.763780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2c81f27c-44c9-4bcd-8f8d-f9e19ff8904b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:35.781150 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3039/6138] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:35.782778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81f27c-44c9-4bcd-8f8d-f9e19ff8904b None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:35.810575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81f27c-44c9-4bcd-8f8d-f9e19ff8904b None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:35.821847 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3100/6139] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:35 2022] POST /identity/v3/services => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:35.822895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d39bc3-1682-4643-874f-eab7ac884f71 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:35.826925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-99d39bc3-1682-4643-874f-eab7ac884f71 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:35.853949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d962f67-721e-4ff8-b14b-48422ae43517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:35.855286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d962f67-721e-4ff8-b14b-48422ae43517 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:35.855858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d962f67-721e-4ff8-b14b-48422ae43517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:35.856147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d962f67-721e-4ff8-b14b-48422ae43517 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:35.856958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d962f67-721e-4ff8-b14b-48422ae43517 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:35.857274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d962f67-721e-4ff8-b14b-48422ae43517 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:35.859037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d962f67-721e-4ff8-b14b-48422ae43517 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:35.872767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d39bc3-1682-4643-874f-eab7ac884f71 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:35.885526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee6eff-dfcb-4463-90a9-d4e60d4812f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:35.886698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee6eff-dfcb-4463-90a9-d4e60d4812f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:35.887083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee6eff-dfcb-4463-90a9-d4e60d4812f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:35.887655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ee6eff-dfcb-4463-90a9-d4e60d4812f3 admin admin] PATH_INFO: `/v3/users/61dab6177e9b4106b88ab4d7f0549a4e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:35.888907 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3040/6140] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:35.889235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee6eff-dfcb-4463-90a9-d4e60d4812f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61dab6177e9b4106b88ab4d7f0549a4e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:35.890045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d962f67-721e-4ff8-b14b-48422ae43517 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:35.891758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ee6eff-dfcb-4463-90a9-d4e60d4812f3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:35.909292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d962f67-721e-4ff8-b14b-48422ae43517 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:35.914625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764c933-cdfd-44ff-bf5f-8bdde091869f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:35.915354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764c933-cdfd-44ff-bf5f-8bdde091869f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:35.915699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764c933-cdfd-44ff-bf5f-8bdde091869f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:35.915992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764c933-cdfd-44ff-bf5f-8bdde091869f admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:35.916939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764c933-cdfd-44ff-bf5f-8bdde091869f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:35.917511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764c933-cdfd-44ff-bf5f-8bdde091869f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:35.920167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764c933-cdfd-44ff-bf5f-8bdde091869f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:35.935293 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3041/6141] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:40:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:35.936338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764c933-cdfd-44ff-bf5f-8bdde091869f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:35.963646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764c933-cdfd-44ff-bf5f-8bdde091869f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:35.969097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3516e-5a26-49ee-bfa7-4217adae58d4 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847dea14552f490bb065b6027f7b2529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23bd0bdc711a4ab29a50bc0ea4c92f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:35.970008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3516e-5a26-49ee-bfa7-4217adae58d4 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:35.970378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3516e-5a26-49ee-bfa7-4217adae58d4 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:35.973056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af3516e-5a26-49ee-bfa7-4217adae58d4 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] PATH_INFO: `/v3/services/94237d30c6d44871abf42e1ffc6c7ece` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:35.975666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3516e-5a26-49ee-bfa7-4217adae58d4 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorizing `identity:update_service(service_id=94237d30c6d44871abf42e1ffc6c7ece)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:35.975666 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-1af3516e-5a26-49ee-bfa7-4217adae58d4 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:40:35.975666 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:40:35.975666 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:40:35.976148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af3516e-5a26-49ee-bfa7-4217adae58d4 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:36.058240 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3042/6142] 10.222.0.43 () {60 vars in 1251 bytes} [Tue Jul 19 14:40:35 2022] PATCH /identity/v3/services/94237d30c6d44871abf42e1ffc6c7ece => generated 283 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:36.058329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3516e-5a26-49ee-bfa7-4217adae58d4 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:36.087871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af3516e-5a26-49ee-bfa7-4217adae58d4 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:36.094307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15610602-ec70-4891-bb43-7880f6655662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:36.094980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15610602-ec70-4891-bb43-7880f6655662 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:36.095268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15610602-ec70-4891-bb43-7880f6655662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:36.095547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15610602-ec70-4891-bb43-7880f6655662 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:36.096318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15610602-ec70-4891-bb43-7880f6655662 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:36.098935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15610602-ec70-4891-bb43-7880f6655662 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:36.116220 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:36.153773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f8ee6eff-dfcb-4463-90a9-d4e60d4812f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61dab6177e9b4106b88ab4d7f0549a4e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:36.199377 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3043/6143] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:36 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:36.200469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15610602-ec70-4891-bb43-7880f6655662 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:36.285800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15610602-ec70-4891-bb43-7880f6655662 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:36.293009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2b3d3-6ee5-4aa4-b708-5d6dc2c4a1bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:36.293755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2b3d3-6ee5-4aa4-b708-5d6dc2c4a1bb admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:36.294012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2b3d3-6ee5-4aa4-b708-5d6dc2c4a1bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:36.294338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2b3d3-6ee5-4aa4-b708-5d6dc2c4a1bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:36.295076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2b3d3-6ee5-4aa4-b708-5d6dc2c4a1bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:36.298408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e2b3d3-6ee5-4aa4-b708-5d6dc2c4a1bb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:36.372515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f8ee6eff-dfcb-4463-90a9-d4e60d4812f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61dab6177e9b4106b88ab4d7f0549a4e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:36.381211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f8ee6eff-dfcb-4463-90a9-d4e60d4812f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61dab6177e9b4106b88ab4d7f0549a4e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:36.382149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f8ee6eff-dfcb-4463-90a9-d4e60d4812f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61dab6177e9b4106b88ab4d7f0549a4e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:36.435919 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3044/6144] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:36 2022] POST /identity/v3/projects => generated 387 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:36.436788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2b3d3-6ee5-4aa4-b708-5d6dc2c4a1bb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:36.446775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f8ee6eff-dfcb-4463-90a9-d4e60d4812f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61dab6177e9b4106b88ab4d7f0549a4e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:36.458995 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3101/6145] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:35 2022] DELETE /identity/v3/users/61dab6177e9b4106b88ab4d7f0549a4e => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:36.468044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee6eff-dfcb-4463-90a9-d4e60d4812f3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:36.470886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f8ee6eff-dfcb-4463-90a9-d4e60d4812f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:36.611627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e2b3d3-6ee5-4aa4-b708-5d6dc2c4a1bb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:36.622686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ee6eff-dfcb-4463-90a9-d4e60d4812f3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:36.628992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a23f16-9646-4841-a9c6-3e938a0990dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:36.630175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a23f16-9646-4841-a9c6-3e938a0990dd admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:36.630888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a23f16-9646-4841-a9c6-3e938a0990dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:36.631181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a23f16-9646-4841-a9c6-3e938a0990dd admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:36.631889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a23f16-9646-4841-a9c6-3e938a0990dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:36.635095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a23f16-9646-4841-a9c6-3e938a0990dd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:36.698416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4591be-e234-43f0-a94f-50edae73251a tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847dea14552f490bb065b6027f7b2529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23bd0bdc711a4ab29a50bc0ea4c92f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:36.699688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4591be-e234-43f0-a94f-50edae73251a tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:36.699836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4591be-e234-43f0-a94f-50edae73251a tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:36.700327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4591be-e234-43f0-a94f-50edae73251a tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] PATH_INFO: `/v3/services/94237d30c6d44871abf42e1ffc6c7ece` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:36.701321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4591be-e234-43f0-a94f-50edae73251a tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorizing `identity:get_service(service_id=94237d30c6d44871abf42e1ffc6c7ece)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:36.702454 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-2e4591be-e234-43f0-a94f-50edae73251a tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:40:36.702454 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:40:36.702454 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:40:36.703508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4591be-e234-43f0-a94f-50edae73251a tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:36.712181 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3045/6146] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:40:36 2022] GET /identity/v3/services/94237d30c6d44871abf42e1ffc6c7ece => generated 283 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:36.713047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4591be-e234-43f0-a94f-50edae73251a tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:36.717902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2e4591be-e234-43f0-a94f-50edae73251a tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:36.733397 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:36.742190 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3102/6147] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:36 2022] POST /identity/v3/users => generated 289 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:36.742190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf70b92-4156-47ff-948e-0d820eb49062 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:36.742190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf70b92-4156-47ff-948e-0d820eb49062 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:36.742190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf70b92-4156-47ff-948e-0d820eb49062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:36.754998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4591be-e234-43f0-a94f-50edae73251a tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:36.761908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc33df-3d1b-4d81-82af-56eb8ee0dd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:36.762864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc33df-3d1b-4d81-82af-56eb8ee0dd4b admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:36.763451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc33df-3d1b-4d81-82af-56eb8ee0dd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:36.763923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc33df-3d1b-4d81-82af-56eb8ee0dd4b admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:36.765383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc33df-3d1b-4d81-82af-56eb8ee0dd4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:36.766090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-acf70b92-4156-47ff-948e-0d820eb49062 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:36.768024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-acf70b92-4156-47ff-948e-0d820eb49062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:36.768302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc33df-3d1b-4d81-82af-56eb8ee0dd4b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:36.778832 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3103/6148] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:36 2022] POST /identity/v3/auth/tokens => generated 3363 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:36.780648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf70b92-4156-47ff-948e-0d820eb49062 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:36.791580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-acf70b92-4156-47ff-948e-0d820eb49062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:36.805838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf70b92-4156-47ff-948e-0d820eb49062 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:36.810752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17ce28-fdc6-403f-bd7d-fa4f7096120d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:36.811654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17ce28-fdc6-403f-bd7d-fa4f7096120d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:36.811947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17ce28-fdc6-403f-bd7d-fa4f7096120d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:36.812257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a17ce28-fdc6-403f-bd7d-fa4f7096120d admin admin] PATH_INFO: `/v3/projects/8e72a4ce36724fdab893155fe12cccb5` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:36.813558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17ce28-fdc6-403f-bd7d-fa4f7096120d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e72a4ce36724fdab893155fe12cccb5)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:36.816187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a17ce28-fdc6-403f-bd7d-fa4f7096120d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:36.854548 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:36.862973 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3046/6149] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:36 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:36.863940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc33df-3d1b-4d81-82af-56eb8ee0dd4b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:36.865813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1ffc33df-3d1b-4d81-82af-56eb8ee0dd4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:36.881340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc33df-3d1b-4d81-82af-56eb8ee0dd4b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:36.886119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4db1d8-0132-4ee4-83c9-8c253845e053 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847dea14552f490bb065b6027f7b2529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23bd0bdc711a4ab29a50bc0ea4c92f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:36.887155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4db1d8-0132-4ee4-83c9-8c253845e053 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:36.887445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4db1d8-0132-4ee4-83c9-8c253845e053 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:36.887726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4db1d8-0132-4ee4-83c9-8c253845e053 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] PATH_INFO: `/v3/services/94237d30c6d44871abf42e1ffc6c7ece` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:36.889006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4db1d8-0132-4ee4-83c9-8c253845e053 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorizing `identity:delete_service(service_id=94237d30c6d44871abf42e1ffc6c7ece)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:36.890726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4db1d8-0132-4ee4-83c9-8c253845e053 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:36.960562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2a17ce28-fdc6-403f-bd7d-fa4f7096120d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e72a4ce36724fdab893155fe12cccb5', 'request_id': 'req-2a17ce28-fdc6-403f-bd7d-fa4f7096120d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:36.969344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2a17ce28-fdc6-403f-bd7d-fa4f7096120d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e72a4ce36724fdab893155fe12cccb5', 'request_id': 'req-2a17ce28-fdc6-403f-bd7d-fa4f7096120d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:36.976741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2a17ce28-fdc6-403f-bd7d-fa4f7096120d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e72a4ce36724fdab893155fe12cccb5', 'request_id': 'req-2a17ce28-fdc6-403f-bd7d-fa4f7096120d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:37.005098 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3047/6150] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:36 2022] DELETE /identity/v3/services/94237d30c6d44871abf42e1ffc6c7ece => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:37.006005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4db1d8-0132-4ee4-83c9-8c253845e053 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:37.027733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4db1d8-0132-4ee4-83c9-8c253845e053 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:37.076924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2a17ce28-fdc6-403f-bd7d-fa4f7096120d admin admin] The token cache is being invalidate because project 8e72a4ce36724fdab893155fe12cccb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:37.077305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2a17ce28-fdc6-403f-bd7d-fa4f7096120d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:37.078269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2a17ce28-fdc6-403f-bd7d-fa4f7096120d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:37.085322 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3104/6151] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:36 2022] DELETE /identity/v3/projects/8e72a4ce36724fdab893155fe12cccb5 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:37.085322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17ce28-fdc6-403f-bd7d-fa4f7096120d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:37.085322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2a17ce28-fdc6-403f-bd7d-fa4f7096120d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:37.097971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353c2a8-b678-483f-9af1-88693a16571c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:37.097971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353c2a8-b678-483f-9af1-88693a16571c admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:37.097971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353c2a8-b678-483f-9af1-88693a16571c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:37.097971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353c2a8-b678-483f-9af1-88693a16571c admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:37.098685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353c2a8-b678-483f-9af1-88693a16571c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:37.101023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353c2a8-b678-483f-9af1-88693a16571c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:37.118074 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3048/6152] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:37.119128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353c2a8-b678-483f-9af1-88693a16571c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:37.120966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b353c2a8-b678-483f-9af1-88693a16571c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:37.135452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353c2a8-b678-483f-9af1-88693a16571c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:37.140568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2593099-dba9-4588-bd0a-9e21b49094d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:37.141342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2593099-dba9-4588-bd0a-9e21b49094d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:37.141733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2593099-dba9-4588-bd0a-9e21b49094d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:37.143302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2593099-dba9-4588-bd0a-9e21b49094d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:37.143302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2593099-dba9-4588-bd0a-9e21b49094d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:37.144811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2593099-dba9-4588-bd0a-9e21b49094d6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:37.155755 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3049/6153] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:37.155929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a17ce28-fdc6-403f-bd7d-fa4f7096120d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:37.160260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2593099-dba9-4588-bd0a-9e21b49094d6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:37.161969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a2593099-dba9-4588-bd0a-9e21b49094d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:37.170981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9699262-217b-4d67-b8b9-98bd604ca19c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:37.171735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9699262-217b-4d67-b8b9-98bd604ca19c service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:37.172031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9699262-217b-4d67-b8b9-98bd604ca19c service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:37.172433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9699262-217b-4d67-b8b9-98bd604ca19c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:37.176056 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e9699262-217b-4d67-b8b9-98bd604ca19c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:37.189231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9699262-217b-4d67-b8b9-98bd604ca19c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:37.191665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9699262-217b-4d67-b8b9-98bd604ca19c service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:37.202264 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3105/6154] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:40:37.203582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d3205-e174-4f5f-84d8-1332bd9d72e3 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:37.203880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d3205-e174-4f5f-84d8-1332bd9d72e3 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:37.204189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819d3205-e174-4f5f-84d8-1332bd9d72e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:37.239501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-819d3205-e174-4f5f-84d8-1332bd9d72e3 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:37.240716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-819d3205-e174-4f5f-84d8-1332bd9d72e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:37.257037 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3106/6155] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:37.258190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d3205-e174-4f5f-84d8-1332bd9d72e3 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:37.262232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2593099-dba9-4588-bd0a-9e21b49094d6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:37.262862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-819d3205-e174-4f5f-84d8-1332bd9d72e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:37.267297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74bef8-959e-473f-b315-e100a94df567 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847dea14552f490bb065b6027f7b2529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23bd0bdc711a4ab29a50bc0ea4c92f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:37.268272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74bef8-959e-473f-b315-e100a94df567 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:37.268730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74bef8-959e-473f-b315-e100a94df567 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:37.269020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74bef8-959e-473f-b315-e100a94df567 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] PATH_INFO: `/v3/services/94237d30c6d44871abf42e1ffc6c7ece` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:37.269697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74bef8-959e-473f-b315-e100a94df567 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorizing `identity:get_service(service_id=94237d30c6d44871abf42e1ffc6c7ece)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:37.271655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74bef8-959e-473f-b315-e100a94df567 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:37.283290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819d3205-e174-4f5f-84d8-1332bd9d72e3 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:37.288080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-7e74bef8-959e-473f-b315-e100a94df567 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Could not find service: 94237d30c6d44871abf42e1ffc6c7ece.: keystone.exception.ServiceNotFound: Could not find service: 94237d30c6d44871abf42e1ffc6c7ece. Jul 19 14:40:37.288080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:40:37.288080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 14:40:37.288080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 14:40:37.288080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 14:40:37.288080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 14:40:37.288080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 14:40:37.288080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 14:40:37.288080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 94237d30c6d44871abf42e1ffc6c7ece. Jul 19 14:40:37.288080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:40:37.288080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:40:37.288080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:40:37.288080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:40:37.288080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:40:37.288080 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:40:37.289550 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:40:37.289550 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:40:37.289550 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:40:37.289550 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:40:37.289550 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:40:37.289550 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:40:37.289550 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:40:37.289550 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:40:37.289550 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 14:40:37.289550 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 14:40:37.289550 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 14:40:37.289550 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 14:40:37.289550 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:40:37.289550 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:40:37.289550 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:40:37.289550 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:40:37.290946 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:40:37.290946 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:40:37.290946 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:40:37.290946 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 14:40:37.290946 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:40:37.290946 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:40:37.290946 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:40:37.290946 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:40:37.290946 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:40:37.290946 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:40:37.290946 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:40:37.290946 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:40:37.290946 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 14:40:37.290946 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 14:40:37.290946 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 94237d30c6d44871abf42e1ffc6c7ece. Jul 19 14:40:37.290946 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:40:37.292051 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3050/6156] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:40:37 2022] GET /identity/v3/services/94237d30c6d44871abf42e1ffc6c7ece => generated 113 bytes in 131 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:40:37.292051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74bef8-959e-473f-b315-e100a94df567 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:37.296333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72f033e-dc2e-4f3f-9d9d-853e6db98527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:37.297319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f033e-dc2e-4f3f-9d9d-853e6db98527 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:37.297761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f033e-dc2e-4f3f-9d9d-853e6db98527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:37.298177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72f033e-dc2e-4f3f-9d9d-853e6db98527 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:37.299425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f033e-dc2e-4f3f-9d9d-853e6db98527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:37.303049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72f033e-dc2e-4f3f-9d9d-853e6db98527 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:37.303774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74bef8-959e-473f-b315-e100a94df567 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:37.308860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7464a3f-083f-48d7-9978-b2fedaa5a6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:37.309708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7464a3f-083f-48d7-9978-b2fedaa5a6ab admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:37.310001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7464a3f-083f-48d7-9978-b2fedaa5a6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:37.310360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7464a3f-083f-48d7-9978-b2fedaa5a6ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:37.311225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7464a3f-083f-48d7-9978-b2fedaa5a6ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:37.312961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7464a3f-083f-48d7-9978-b2fedaa5a6ab admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:37.323875 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3107/6157] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:37.325875 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3051/6158] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:37.326710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7464a3f-083f-48d7-9978-b2fedaa5a6ab admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:37.333294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6ca7d-664e-4a1c-b33c-ceb45301c589 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:37.333294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6ca7d-664e-4a1c-b33c-ceb45301c589 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:37.333294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e6ca7d-664e-4a1c-b33c-ceb45301c589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:37.340312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7464a3f-083f-48d7-9978-b2fedaa5a6ab admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:37.345270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1ebbf-6da9-49ac-acff-5ae30057acb5 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847dea14552f490bb065b6027f7b2529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23bd0bdc711a4ab29a50bc0ea4c92f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:37.346006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1ebbf-6da9-49ac-acff-5ae30057acb5 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:37.346855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1ebbf-6da9-49ac-acff-5ae30057acb5 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:37.347144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1ebbf-6da9-49ac-acff-5ae30057acb5 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:37.347945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1ebbf-6da9-49ac-acff-5ae30057acb5 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:37.349553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed1ebbf-6da9-49ac-acff-5ae30057acb5 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:37.351283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-46e6ca7d-664e-4a1c-b33c-ceb45301c589 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:37.352561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-46e6ca7d-664e-4a1c-b33c-ceb45301c589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:37.360727 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3108/6159] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:37.361603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6ca7d-664e-4a1c-b33c-ceb45301c589 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:37.372286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e6ca7d-664e-4a1c-b33c-ceb45301c589 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:37.376996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ef75d-a9c4-4c40-a48a-39acef59171a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:37.378072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ef75d-a9c4-4c40-a48a-39acef59171a admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:37.378596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ef75d-a9c4-4c40-a48a-39acef59171a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:37.378943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ef75d-a9c4-4c40-a48a-39acef59171a admin admin] PATH_INFO: `/v3/projects/e796ac1a4ac74dbda4e5e9eae87b6339/users/240080a2924f46e0a30f0900d4fbbe23/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:37.394284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ef75d-a9c4-4c40-a48a-39acef59171a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e796ac1a4ac74dbda4e5e9eae87b6339, user_id=240080a2924f46e0a30f0900d4fbbe23, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:37.396942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77ef75d-a9c4-4c40-a48a-39acef59171a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:37.518025 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3052/6160] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:37 2022] POST /identity/v3/services => generated 275 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:37.519412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1ebbf-6da9-49ac-acff-5ae30057acb5 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:37.530003 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3109/6161] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:37 2022] PUT /identity/v3/projects/e796ac1a4ac74dbda4e5e9eae87b6339/users/240080a2924f46e0a30f0900d4fbbe23/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:37.530003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ef75d-a9c4-4c40-a48a-39acef59171a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:37.541802 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:37.552052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed1ebbf-6da9-49ac-acff-5ae30057acb5 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:37.557630 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:37.612572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77ef75d-a9c4-4c40-a48a-39acef59171a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:37.619175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e17d8-9810-4ecc-bd8e-6aaba80d187e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:37.619872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e17d8-9810-4ecc-bd8e-6aaba80d187e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:37.620324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e17d8-9810-4ecc-bd8e-6aaba80d187e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:37.620617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071e17d8-9810-4ecc-bd8e-6aaba80d187e admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:37.621387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e17d8-9810-4ecc-bd8e-6aaba80d187e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:37.621704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e17d8-9810-4ecc-bd8e-6aaba80d187e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:37.624085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071e17d8-9810-4ecc-bd8e-6aaba80d187e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:37.641288 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3110/6162] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:40:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:37.641288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e17d8-9810-4ecc-bd8e-6aaba80d187e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:37.662137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb22e82-dc07-40e8-98c6-c3e45764b49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:37.663199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb22e82-dc07-40e8-98c6-c3e45764b49b admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:37.663594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb22e82-dc07-40e8-98c6-c3e45764b49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:37.663943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb22e82-dc07-40e8-98c6-c3e45764b49b admin admin] PATH_INFO: `/v3/projects/045f723474dc4d0f910e24d7eaf0011d/users/264f82f8097347b8a9678d0058ec56e7/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:37.682353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb22e82-dc07-40e8-98c6-c3e45764b49b admin admin] RBAC: Authorizing `identity:create_grant(project_id=045f723474dc4d0f910e24d7eaf0011d, user_id=264f82f8097347b8a9678d0058ec56e7, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:37.685226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb22e82-dc07-40e8-98c6-c3e45764b49b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:37.758392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071e17d8-9810-4ecc-bd8e-6aaba80d187e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:37.779729 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3053/6163] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:37 2022] PUT /identity/v3/projects/045f723474dc4d0f910e24d7eaf0011d/users/264f82f8097347b8a9678d0058ec56e7/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:37.779729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dea0e-6726-420d-b6c9-258c580795cb None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:37.779729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dea0e-6726-420d-b6c9-258c580795cb None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:37.779729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dea0e-6726-420d-b6c9-258c580795cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:37.782307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559c0ce-b3b8-47f4-8f53-9ae373956078 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847dea14552f490bb065b6027f7b2529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23bd0bdc711a4ab29a50bc0ea4c92f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:37.787148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559c0ce-b3b8-47f4-8f53-9ae373956078 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:37.787482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559c0ce-b3b8-47f4-8f53-9ae373956078 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:37.787897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b559c0ce-b3b8-47f4-8f53-9ae373956078 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:37.788719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559c0ce-b3b8-47f4-8f53-9ae373956078 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:37.791627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b559c0ce-b3b8-47f4-8f53-9ae373956078 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:37.818870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-862dea0e-6726-420d-b6c9-258c580795cb None None] MFA Rules not processed for user `240080a2924f46e0a30f0900d4fbbe23`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:37.820040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-862dea0e-6726-420d-b6c9-258c580795cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:37.906348 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3111/6164] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:37 2022] POST /identity/v3/services => generated 275 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:37.907578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559c0ce-b3b8-47f4-8f53-9ae373956078 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:37.916675 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3054/6165] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:37 2022] POST /identity/v3/auth/tokens => generated 3580 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:37.918017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5919ba-51be-4a32-9255-5a1fb4252cdd None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:37.918343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5919ba-51be-4a32-9255-5a1fb4252cdd None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:37.918629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5919ba-51be-4a32-9255-5a1fb4252cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:37.941641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b559c0ce-b3b8-47f4-8f53-9ae373956078 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:37.971877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-fb5919ba-51be-4a32-9255-5a1fb4252cdd None None] MFA Rules not processed for user `264f82f8097347b8a9678d0058ec56e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:37.974079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fb5919ba-51be-4a32-9255-5a1fb4252cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:38.043661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de36567-6b15-4517-b887-99c8bf3401af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:38.044394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de36567-6b15-4517-b887-99c8bf3401af admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:38.044755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de36567-6b15-4517-b887-99c8bf3401af admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:38.045216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de36567-6b15-4517-b887-99c8bf3401af admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:38.045937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de36567-6b15-4517-b887-99c8bf3401af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:38.047892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de36567-6b15-4517-b887-99c8bf3401af admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:38.100903 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3055/6166] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:37 2022] POST /identity/v3/auth/tokens => generated 3590 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:38.100903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5919ba-51be-4a32-9255-5a1fb4252cdd None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:38.100903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fb5919ba-51be-4a32-9255-5a1fb4252cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:38.116309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5919ba-51be-4a32-9255-5a1fb4252cdd None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:38.121943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72087278-5e2d-4ad4-8221-ce3d6ae5ca4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:38.123959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72087278-5e2d-4ad4-8221-ce3d6ae5ca4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:38.123959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72087278-5e2d-4ad4-8221-ce3d6ae5ca4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:38.123959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72087278-5e2d-4ad4-8221-ce3d6ae5ca4b admin admin] PATH_INFO: `/v3/projects/0e42f2ca60fc4870b96b523a8a27459b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:38.125043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72087278-5e2d-4ad4-8221-ce3d6ae5ca4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e42f2ca60fc4870b96b523a8a27459b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:38.127111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72087278-5e2d-4ad4-8221-ce3d6ae5ca4b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:38.136643 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:38.174963 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3112/6167] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:37 2022] POST /identity/v3/projects => generated 377 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:38.176077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de36567-6b15-4517-b887-99c8bf3401af admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:38.186194 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:38.232874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-72087278-5e2d-4ad4-8221-ce3d6ae5ca4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e42f2ca60fc4870b96b523a8a27459b', 'request_id': 'req-72087278-5e2d-4ad4-8221-ce3d6ae5ca4b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:38.272158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de36567-6b15-4517-b887-99c8bf3401af admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:38.320722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-72087278-5e2d-4ad4-8221-ce3d6ae5ca4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e42f2ca60fc4870b96b523a8a27459b', 'request_id': 'req-72087278-5e2d-4ad4-8221-ce3d6ae5ca4b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:38.331595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-72087278-5e2d-4ad4-8221-ce3d6ae5ca4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e42f2ca60fc4870b96b523a8a27459b', 'request_id': 'req-72087278-5e2d-4ad4-8221-ce3d6ae5ca4b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:38.338783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46e97c-8d3a-483a-b307-338d38664dcb tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847dea14552f490bb065b6027f7b2529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23bd0bdc711a4ab29a50bc0ea4c92f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:38.339530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46e97c-8d3a-483a-b307-338d38664dcb tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:38.339817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46e97c-8d3a-483a-b307-338d38664dcb tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:38.340096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46e97c-8d3a-483a-b307-338d38664dcb tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:38.341033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46e97c-8d3a-483a-b307-338d38664dcb tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:38.342989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46e97c-8d3a-483a-b307-338d38664dcb tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:38.347765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-72087278-5e2d-4ad4-8221-ce3d6ae5ca4b admin admin] The token cache is being invalidate because project 0e42f2ca60fc4870b96b523a8a27459b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:38.354676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-72087278-5e2d-4ad4-8221-ce3d6ae5ca4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:38.354676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-72087278-5e2d-4ad4-8221-ce3d6ae5ca4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:38.354676 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3056/6168] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:38 2022] DELETE /identity/v3/projects/0e42f2ca60fc4870b96b523a8a27459b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:38.358476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72087278-5e2d-4ad4-8221-ce3d6ae5ca4b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:38.359914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-72087278-5e2d-4ad4-8221-ce3d6ae5ca4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:38.436076 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3113/6169] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:38 2022] POST /identity/v3/services => generated 275 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:38.437291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46e97c-8d3a-483a-b307-338d38664dcb tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:38.439077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3c46e97c-8d3a-483a-b307-338d38664dcb tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:38.444810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72087278-5e2d-4ad4-8221-ce3d6ae5ca4b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:38.460505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4e6b7-c670-4f56-9c55-ac7af71e829f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:38.461189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4e6b7-c670-4f56-9c55-ac7af71e829f service glance] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:38.461482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4e6b7-c670-4f56-9c55-ac7af71e829f service glance] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:38.461765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4e6b7-c670-4f56-9c55-ac7af71e829f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:38.463689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3ad4e6b7-c670-4f56-9c55-ac7af71e829f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:38.520327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46e97c-8d3a-483a-b307-338d38664dcb tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:38.525307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee485ef-b671-482a-b413-ccc8fb56323d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:38.525975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee485ef-b671-482a-b413-ccc8fb56323d admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:38.526296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee485ef-b671-482a-b413-ccc8fb56323d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:38.526582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee485ef-b671-482a-b413-ccc8fb56323d admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:38.526768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4e6b7-c670-4f56-9c55-ac7af71e829f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:38.527270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee485ef-b671-482a-b413-ccc8fb56323d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:38.528840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4e6b7-c670-4f56-9c55-ac7af71e829f service glance] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:38.529166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee485ef-b671-482a-b413-ccc8fb56323d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:38.548082 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3057/6170] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:38 2022] GET /identity/v3/auth/tokens => generated 3748 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:40:38.548899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4e6b7-c670-4f56-9c55-ac7af71e829f service glance] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:38.550918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3ad4e6b7-c670-4f56-9c55-ac7af71e829f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:38.569548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4e6b7-c670-4f56-9c55-ac7af71e829f service glance] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:38.570690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c20cf-b184-440c-87d0-48a2c708e7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:38.571390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c20cf-b184-440c-87d0-48a2c708e7eb admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:38.571656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c20cf-b184-440c-87d0-48a2c708e7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:38.571937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c20cf-b184-440c-87d0-48a2c708e7eb admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:38.572663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c20cf-b184-440c-87d0-48a2c708e7eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:38.574628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c20cf-b184-440c-87d0-48a2c708e7eb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:38.616125 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3114/6171] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:38 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:38.616125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2b6b6-45c9-4f60-858d-b04f13369faf None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:38.616125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2b6b6-45c9-4f60-858d-b04f13369faf None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:38.616125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2b6b6-45c9-4f60-858d-b04f13369faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:38.634452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ebc2b6b6-45c9-4f60-858d-b04f13369faf None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:38.635972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ebc2b6b6-45c9-4f60-858d-b04f13369faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:38.649565 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:38.696635 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3058/6172] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:38 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:38.698384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c20cf-b184-440c-87d0-48a2c708e7eb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:38.701102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-225c20cf-b184-440c-87d0-48a2c708e7eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:38.712501 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:38.715713 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3115/6173] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:38 2022] POST /identity/v3/auth/tokens => generated 3733 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:38.716629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2b6b6-45c9-4f60-858d-b04f13369faf None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:38.727940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc2b6b6-45c9-4f60-858d-b04f13369faf None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:38.734085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b146f-6163-4556-87ea-c8b469849c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:38.734811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b146f-6163-4556-87ea-c8b469849c1e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:38.735090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b146f-6163-4556-87ea-c8b469849c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:38.735373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b146f-6163-4556-87ea-c8b469849c1e admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:38.736084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b146f-6163-4556-87ea-c8b469849c1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:38.739014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b146f-6163-4556-87ea-c8b469849c1e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:38.740398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c20cf-b184-440c-87d0-48a2c708e7eb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:38.809017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd91070-f682-4f14-b8c9-50e1c247d45b tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847dea14552f490bb065b6027f7b2529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23bd0bdc711a4ab29a50bc0ea4c92f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:38.809795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd91070-f682-4f14-b8c9-50e1c247d45b tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:38.810190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd91070-f682-4f14-b8c9-50e1c247d45b tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:38.810614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd91070-f682-4f14-b8c9-50e1c247d45b tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:38.811443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd91070-f682-4f14-b8c9-50e1c247d45b tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:38.812489 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-ddd91070-f682-4f14-b8c9-50e1c247d45b tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:40:38.812489 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:40:38.812489 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:40:38.813472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd91070-f682-4f14-b8c9-50e1c247d45b tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:38.824665 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3059/6174] 10.222.0.43 () {58 vars in 1130 bytes} [Tue Jul 19 14:40:38 2022] GET /identity/v3/services => generated 2980 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:38.825324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd91070-f682-4f14-b8c9-50e1c247d45b tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:38.828230 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3116/6175] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:38 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:38.830037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2d3e5-c346-4fe1-95de-d0baceafde6d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:38.830447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2d3e5-c346-4fe1-95de-d0baceafde6d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:38.830838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2d3e5-c346-4fe1-95de-d0baceafde6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:38.844765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd91070-f682-4f14-b8c9-50e1c247d45b tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:38.853525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a85e8-e302-44aa-a533-555a55eb448c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:38.853907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d7e2d3e5-c346-4fe1-95de-d0baceafde6d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:38.854719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a85e8-e302-44aa-a533-555a55eb448c admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:38.855154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a85e8-e302-44aa-a533-555a55eb448c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:38.855271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d7e2d3e5-c346-4fe1-95de-d0baceafde6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:38.855776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361a85e8-e302-44aa-a533-555a55eb448c admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:38.856843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a85e8-e302-44aa-a533-555a55eb448c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:38.860440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361a85e8-e302-44aa-a533-555a55eb448c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:38.865557 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3117/6176] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:38 2022] POST /identity/v3/auth/tokens => generated 3733 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:38.868218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2d3e5-c346-4fe1-95de-d0baceafde6d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:38.878357 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3060/6177] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:38.878357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a85e8-e302-44aa-a533-555a55eb448c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:38.878814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2d3e5-c346-4fe1-95de-d0baceafde6d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:38.886233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e3311-278b-4415-8db1-4234488afdf3 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847dea14552f490bb065b6027f7b2529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23bd0bdc711a4ab29a50bc0ea4c92f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:38.887122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e3311-278b-4415-8db1-4234488afdf3 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:38.887233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e3311-278b-4415-8db1-4234488afdf3 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:38.887476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1e3311-278b-4415-8db1-4234488afdf3 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:38.888201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e3311-278b-4415-8db1-4234488afdf3 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1032565003) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:38.888517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e3311-278b-4415-8db1-4234488afdf3 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:38.889545 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-7a1e3311-278b-4415-8db1-4234488afdf3 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:40:38.889545 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:40:38.889545 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:40:38.890468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1e3311-278b-4415-8db1-4234488afdf3 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:38.893553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361a85e8-e302-44aa-a533-555a55eb448c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:38.899163 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3118/6178] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Jul 19 14:40:38 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1032565003 => generated 418 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:38.899163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e3311-278b-4415-8db1-4234488afdf3 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:38.901814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b20f7-7ea2-4e38-af1d-6713c270bedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:38.902558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b20f7-7ea2-4e38-af1d-6713c270bedb admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:38.902846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b20f7-7ea2-4e38-af1d-6713c270bedb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:38.903123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61b20f7-7ea2-4e38-af1d-6713c270bedb admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:38.904005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b20f7-7ea2-4e38-af1d-6713c270bedb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:38.905780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61b20f7-7ea2-4e38-af1d-6713c270bedb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:38.911735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1e3311-278b-4415-8db1-4234488afdf3 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:38.916609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf5167-7789-465c-a04b-cdf7d7cab027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:38.917276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf5167-7789-465c-a04b-cdf7d7cab027 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:38.920996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf5167-7789-465c-a04b-cdf7d7cab027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:38.920996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf5167-7789-465c-a04b-cdf7d7cab027 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:38.921179 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3061/6179] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:38.921273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf5167-7789-465c-a04b-cdf7d7cab027 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:38.921348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b20f7-7ea2-4e38-af1d-6713c270bedb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:38.921418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf5167-7789-465c-a04b-cdf7d7cab027 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:38.921418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf5167-7789-465c-a04b-cdf7d7cab027 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:38.933445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61b20f7-7ea2-4e38-af1d-6713c270bedb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:38.934422 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3119/6180] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:40:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:38.935898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf5167-7789-465c-a04b-cdf7d7cab027 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:38.938751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b9165-7d62-4de0-94b1-769ee081bc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:38.939559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b9165-7d62-4de0-94b1-769ee081bc09 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:38.939853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b9165-7d62-4de0-94b1-769ee081bc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:38.943020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b9165-7d62-4de0-94b1-769ee081bc09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:38.943020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b9165-7d62-4de0-94b1-769ee081bc09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:38.943020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b9165-7d62-4de0-94b1-769ee081bc09 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:38.948249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf5167-7789-465c-a04b-cdf7d7cab027 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:38.953186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68c265-999e-4e58-ba9f-4eac9799d8c3 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847dea14552f490bb065b6027f7b2529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23bd0bdc711a4ab29a50bc0ea4c92f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:38.953850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68c265-999e-4e58-ba9f-4eac9799d8c3 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:38.954215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68c265-999e-4e58-ba9f-4eac9799d8c3 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:38.954393 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3062/6181] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:38.954579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68c265-999e-4e58-ba9f-4eac9799d8c3 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:38.955307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68c265-999e-4e58-ba9f-4eac9799d8c3 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1239993546) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:38.955727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b9165-7d62-4de0-94b1-769ee081bc09 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:38.957883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68c265-999e-4e58-ba9f-4eac9799d8c3 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:38.959584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68c265-999e-4e58-ba9f-4eac9799d8c3 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:38.965151 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3120/6182] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Jul 19 14:40:38 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1239993546 => generated 418 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:38.966157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68c265-999e-4e58-ba9f-4eac9799d8c3 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:38.977462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b9165-7d62-4de0-94b1-769ee081bc09 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:38.983293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b094f2c-3d7e-4bf3-86e9-e6d323d8afb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:38.984567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b094f2c-3d7e-4bf3-86e9-e6d323d8afb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:38.985043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b094f2c-3d7e-4bf3-86e9-e6d323d8afb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:38.985176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68c265-999e-4e58-ba9f-4eac9799d8c3 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:38.985634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b094f2c-3d7e-4bf3-86e9-e6d323d8afb1 admin admin] PATH_INFO: `/v3/projects/ed01c8f98afa46bfa5e43f989c0feb21/users/8ceb80e787a34c3284096cbac44c93c8/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:38.991884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c549238-562b-47e9-b3d9-43f390abfcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:38.992571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c549238-562b-47e9-b3d9-43f390abfcd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:38.992857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c549238-562b-47e9-b3d9-43f390abfcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:38.993139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c549238-562b-47e9-b3d9-43f390abfcd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:38.993831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c549238-562b-47e9-b3d9-43f390abfcd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:38.995761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c549238-562b-47e9-b3d9-43f390abfcd0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:39.003962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b094f2c-3d7e-4bf3-86e9-e6d323d8afb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed01c8f98afa46bfa5e43f989c0feb21, user_id=8ceb80e787a34c3284096cbac44c93c8, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:39.007444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b094f2c-3d7e-4bf3-86e9-e6d323d8afb1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:39.105314 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3121/6183] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:38 2022] POST /identity/v3/projects => generated 393 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:39.105314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c549238-562b-47e9-b3d9-43f390abfcd0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:39.129310 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3063/6184] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:38 2022] PUT /identity/v3/projects/ed01c8f98afa46bfa5e43f989c0feb21/users/8ceb80e787a34c3284096cbac44c93c8/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:39.129310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b094f2c-3d7e-4bf3-86e9-e6d323d8afb1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:39.208749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c549238-562b-47e9-b3d9-43f390abfcd0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:39.265526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b094f2c-3d7e-4bf3-86e9-e6d323d8afb1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:39.271229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffb7d7-f1ac-4240-a5ca-a3366122df92 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847dea14552f490bb065b6027f7b2529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23bd0bdc711a4ab29a50bc0ea4c92f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:39.271969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffb7d7-f1ac-4240-a5ca-a3366122df92 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:39.272266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffb7d7-f1ac-4240-a5ca-a3366122df92 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:39.272549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffb7d7-f1ac-4240-a5ca-a3366122df92 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] PATH_INFO: `/v3/services` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:39.273363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffb7d7-f1ac-4240-a5ca-a3366122df92 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1020064635) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:39.273749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffb7d7-f1ac-4240-a5ca-a3366122df92 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:39.275606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffb7d7-f1ac-4240-a5ca-a3366122df92 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:39.284915 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3064/6185] 10.222.0.43 () {58 vars in 1221 bytes} [Tue Jul 19 14:40:39 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1020064635 => generated 418 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:39.284915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffb7d7-f1ac-4240-a5ca-a3366122df92 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:39.303962 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:39.329764 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:39.332956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b4b0d-770d-44ea-8f60-c97daf67bc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:39.333941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b4b0d-770d-44ea-8f60-c97daf67bc05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:39.337335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b4b0d-770d-44ea-8f60-c97daf67bc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:39.337732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b4b0d-770d-44ea-8f60-c97daf67bc05 admin admin] PATH_INFO: `/v3/projects/50207f4efe1b4a32bd53f7814788096f/users/34482efcb613417ca6a2b48596089c46/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:39.357935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffb7d7-f1ac-4240-a5ca-a3366122df92 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:39.364318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec41f3-ff46-4521-962c-cd51684f35e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:39.365613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec41f3-ff46-4521-962c-cd51684f35e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:39.366180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec41f3-ff46-4521-962c-cd51684f35e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:39.366643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec41f3-ff46-4521-962c-cd51684f35e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:39.367481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec41f3-ff46-4521-962c-cd51684f35e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:39.368460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b4b0d-770d-44ea-8f60-c97daf67bc05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50207f4efe1b4a32bd53f7814788096f, user_id=34482efcb613417ca6a2b48596089c46, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:39.369762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec41f3-ff46-4521-962c-cd51684f35e0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:39.373400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b4b0d-770d-44ea-8f60-c97daf67bc05 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:39.473343 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3065/6186] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:39 2022] POST /identity/v3/users => generated 303 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:39.474373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec41f3-ff46-4521-962c-cd51684f35e0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:39.482127 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3122/6187] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:39 2022] PUT /identity/v3/projects/50207f4efe1b4a32bd53f7814788096f/users/34482efcb613417ca6a2b48596089c46/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:39.483412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b4b0d-770d-44ea-8f60-c97daf67bc05 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:39.490026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec41f3-ff46-4521-962c-cd51684f35e0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:39.573337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de1122-f62e-4bc9-96f3-de5e5252f204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:39.574047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de1122-f62e-4bc9-96f3-de5e5252f204 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:39.574638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de1122-f62e-4bc9-96f3-de5e5252f204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:39.574917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de1122-f62e-4bc9-96f3-de5e5252f204 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:39.575675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de1122-f62e-4bc9-96f3-de5e5252f204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:39.581720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de1122-f62e-4bc9-96f3-de5e5252f204 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:39.599143 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3066/6188] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:39.600997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de1122-f62e-4bc9-96f3-de5e5252f204 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:39.618871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b4b0d-770d-44ea-8f60-c97daf67bc05 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:39.619160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de1122-f62e-4bc9-96f3-de5e5252f204 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:39.626566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7497ae-6b9b-4d54-9c96-0f7bf44fafd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:39.627312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7497ae-6b9b-4d54-9c96-0f7bf44fafd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:39.629077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7497ae-6b9b-4d54-9c96-0f7bf44fafd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:39.629348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7497ae-6b9b-4d54-9c96-0f7bf44fafd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:39.629633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92949d-004c-4a15-8dae-21836dd2d026 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847dea14552f490bb065b6027f7b2529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23bd0bdc711a4ab29a50bc0ea4c92f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:39.630273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7497ae-6b9b-4d54-9c96-0f7bf44fafd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:39.630797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92949d-004c-4a15-8dae-21836dd2d026 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:39.631087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92949d-004c-4a15-8dae-21836dd2d026 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:39.631369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92949d-004c-4a15-8dae-21836dd2d026 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] PATH_INFO: `/v3/services/0c9ff44e9fba4d628e8cda614053b52d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:39.632148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92949d-004c-4a15-8dae-21836dd2d026 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorizing `identity:delete_service(service_id=0c9ff44e9fba4d628e8cda614053b52d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:39.632679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7497ae-6b9b-4d54-9c96-0f7bf44fafd9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:39.641030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f92949d-004c-4a15-8dae-21836dd2d026 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:39.648544 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3067/6189] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:39.650693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13ac7e-c033-491f-a88d-159c2162ba5a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:39.651021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13ac7e-c033-491f-a88d-159c2162ba5a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:39.651797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13ac7e-c033-491f-a88d-159c2162ba5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:39.685745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0f13ac7e-c033-491f-a88d-159c2162ba5a None None] MFA Rules not processed for user `34482efcb613417ca6a2b48596089c46`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:39.686975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0f13ac7e-c033-491f-a88d-159c2162ba5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:39.739025 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3123/6190] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:39 2022] DELETE /identity/v3/services/0c9ff44e9fba4d628e8cda614053b52d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:39.739565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92949d-004c-4a15-8dae-21836dd2d026 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:39.764657 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3068/6191] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:39 2022] POST /identity/v3/auth/tokens => generated 3580 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:39.765577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13ac7e-c033-491f-a88d-159c2162ba5a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:39.769958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f92949d-004c-4a15-8dae-21836dd2d026 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:39.775976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d37c7-d934-4224-a8fe-4ee11aade2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:39.780395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d37c7-d934-4224-a8fe-4ee11aade2af admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:39.780395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d37c7-d934-4224-a8fe-4ee11aade2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:39.780395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d37c7-d934-4224-a8fe-4ee11aade2af admin admin] PATH_INFO: `/v3/projects/ed01c8f98afa46bfa5e43f989c0feb21/users/8ceb80e787a34c3284096cbac44c93c8/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:39.781960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d37c7-d934-4224-a8fe-4ee11aade2af admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed01c8f98afa46bfa5e43f989c0feb21, user_id=8ceb80e787a34c3284096cbac44c93c8, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:39.782124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13ac7e-c033-491f-a88d-159c2162ba5a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:39.785358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7d37c7-d934-4224-a8fe-4ee11aade2af admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:39.787569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d31d7-2f33-4750-972b-20ca24030171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:39.788529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d31d7-2f33-4750-972b-20ca24030171 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:39.788820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d31d7-2f33-4750-972b-20ca24030171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:39.789848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81d31d7-2f33-4750-972b-20ca24030171 admin admin] PATH_INFO: `/v3/projects/52b7992a0c9e4986865c25207f8fc71b/users/28fa2da092ec4e10972e8d59e44dd749/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:39.798712 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3124/6192] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:39 2022] PUT /identity/v3/projects/ed01c8f98afa46bfa5e43f989c0feb21/users/8ceb80e787a34c3284096cbac44c93c8/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:39.800337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d37c7-d934-4224-a8fe-4ee11aade2af admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:39.818982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d31d7-2f33-4750-972b-20ca24030171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b7992a0c9e4986865c25207f8fc71b, user_id=28fa2da092ec4e10972e8d59e44dd749, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:39.821937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81d31d7-2f33-4750-972b-20ca24030171 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:39.879284 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3069/6193] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:39 2022] PUT /identity/v3/projects/52b7992a0c9e4986865c25207f8fc71b/users/28fa2da092ec4e10972e8d59e44dd749/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:39.880412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d31d7-2f33-4750-972b-20ca24030171 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:39.911725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7d37c7-d934-4224-a8fe-4ee11aade2af admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:39.921800 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:39.953408 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:40.008908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2871a0-1560-4dce-b39b-188cf2699921 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847dea14552f490bb065b6027f7b2529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23bd0bdc711a4ab29a50bc0ea4c92f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:40.009938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2871a0-1560-4dce-b39b-188cf2699921 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:40.010501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2871a0-1560-4dce-b39b-188cf2699921 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:40.011180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2871a0-1560-4dce-b39b-188cf2699921 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] PATH_INFO: `/v3/services/b236fb78e1ef442cb986f8026c5a6b1d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:40.014027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2871a0-1560-4dce-b39b-188cf2699921 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b236fb78e1ef442cb986f8026c5a6b1d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:40.016071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2871a0-1560-4dce-b39b-188cf2699921 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:40.036480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81d31d7-2f33-4750-972b-20ca24030171 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:40.042193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289057cc-f82a-4303-b6a6-5e663b91ee6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:40.043257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289057cc-f82a-4303-b6a6-5e663b91ee6d admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:40.043866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289057cc-f82a-4303-b6a6-5e663b91ee6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:40.044031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289057cc-f82a-4303-b6a6-5e663b91ee6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:40.044828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289057cc-f82a-4303-b6a6-5e663b91ee6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:40.046878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289057cc-f82a-4303-b6a6-5e663b91ee6d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:40.100009 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3125/6194] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:39 2022] DELETE /identity/v3/services/b236fb78e1ef442cb986f8026c5a6b1d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:40.101541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd848a80-6d4e-4abe-bb69-8a595ec4d9af None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:40.101961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd848a80-6d4e-4abe-bb69-8a595ec4d9af None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:40.102910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd848a80-6d4e-4abe-bb69-8a595ec4d9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:40.122563 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3070/6195] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:39 2022] POST /identity/v3/projects => generated 377 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:40.124413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289057cc-f82a-4303-b6a6-5e663b91ee6d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:40.156153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-cd848a80-6d4e-4abe-bb69-8a595ec4d9af None None] MFA Rules not processed for user `8ceb80e787a34c3284096cbac44c93c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:40.158436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cd848a80-6d4e-4abe-bb69-8a595ec4d9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:40.234608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289057cc-f82a-4303-b6a6-5e663b91ee6d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:40.266514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe749b-781a-49eb-a54d-80780cb2c531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:40.267975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe749b-781a-49eb-a54d-80780cb2c531 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:40.270344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe749b-781a-49eb-a54d-80780cb2c531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:40.271048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe749b-781a-49eb-a54d-80780cb2c531 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:40.272436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe749b-781a-49eb-a54d-80780cb2c531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:40.275680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe749b-781a-49eb-a54d-80780cb2c531 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:40.289867 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3126/6196] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:40 2022] POST /identity/v3/auth/tokens => generated 3489 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:40.290816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd848a80-6d4e-4abe-bb69-8a595ec4d9af None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:40.305442 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3071/6197] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:40.306325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe749b-781a-49eb-a54d-80780cb2c531 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:40.327095 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe749b-781a-49eb-a54d-80780cb2c531 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:40.334607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95a85e-f08b-47d3-af69-ff64a3797670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:40.336583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95a85e-f08b-47d3-af69-ff64a3797670 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:40.337186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95a85e-f08b-47d3-af69-ff64a3797670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:40.337804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95a85e-f08b-47d3-af69-ff64a3797670 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:40.339818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95a85e-f08b-47d3-af69-ff64a3797670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:40.343862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95a85e-f08b-47d3-af69-ff64a3797670 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:40.444373 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3072/6198] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:40 2022] POST /identity/v3/users => generated 295 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:40.445575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95a85e-f08b-47d3-af69-ff64a3797670 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:40.447968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd848a80-6d4e-4abe-bb69-8a595ec4d9af None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:40.450157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5a95a85e-f08b-47d3-af69-ff64a3797670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:40.466358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b813d-08fc-41b1-a1ca-9dde47c8c998 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '847dea14552f490bb065b6027f7b2529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '23bd0bdc711a4ab29a50bc0ea4c92f25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:40.469028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b813d-08fc-41b1-a1ca-9dde47c8c998 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:40.469265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b813d-08fc-41b1-a1ca-9dde47c8c998 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:40.469553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b813d-08fc-41b1-a1ca-9dde47c8c998 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] PATH_INFO: `/v3/services/984c896e994c4b9abfbd6f75e42c99d3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:40.470278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b813d-08fc-41b1-a1ca-9dde47c8c998 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorizing `identity:delete_service(service_id=984c896e994c4b9abfbd6f75e42c99d3)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:40.472932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b813d-08fc-41b1-a1ca-9dde47c8c998 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:40.560573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95a85e-f08b-47d3-af69-ff64a3797670 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:40.566497 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3127/6199] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:40 2022] DELETE /identity/v3/services/984c896e994c4b9abfbd6f75e42c99d3 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:40.567875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b813d-08fc-41b1-a1ca-9dde47c8c998 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:40.589511 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:40.591955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc024f05-910c-47cc-8e08-1a548287a5b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:40.592679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc024f05-910c-47cc-8e08-1a548287a5b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:40.593123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc024f05-910c-47cc-8e08-1a548287a5b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:40.593408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc024f05-910c-47cc-8e08-1a548287a5b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:40.596004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b813d-08fc-41b1-a1ca-9dde47c8c998 tempest-ServicesTestJSON-1905109770 tempest-ServicesTestJSON-1905109770-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:40.602254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f392bc8-9c52-47fd-b82b-fbafb0d789e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:40.603670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f392bc8-9c52-47fd-b82b-fbafb0d789e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:40.604166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f392bc8-9c52-47fd-b82b-fbafb0d789e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:40.604851 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:40.605592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f392bc8-9c52-47fd-b82b-fbafb0d789e1 admin admin] PATH_INFO: `/v3/projects/52b7992a0c9e4986865c25207f8fc71b/users/28fa2da092ec4e10972e8d59e44dd749/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:40.608064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f392bc8-9c52-47fd-b82b-fbafb0d789e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b7992a0c9e4986865c25207f8fc71b, user_id=28fa2da092ec4e10972e8d59e44dd749, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:40.609989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc024f05-910c-47cc-8e08-1a548287a5b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:40.611554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f392bc8-9c52-47fd-b82b-fbafb0d789e1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:40.611670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc024f05-910c-47cc-8e08-1a548287a5b6 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:40.628798 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3128/6200] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:40 2022] PUT /identity/v3/projects/52b7992a0c9e4986865c25207f8fc71b/users/28fa2da092ec4e10972e8d59e44dd749/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:40.630276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f392bc8-9c52-47fd-b82b-fbafb0d789e1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:40.685386 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3073/6201] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:40:40.686833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc024f05-910c-47cc-8e08-1a548287a5b6 service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:40.689741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bc024f05-910c-47cc-8e08-1a548287a5b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:40.715969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc024f05-910c-47cc-8e08-1a548287a5b6 service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:40.782241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f392bc8-9c52-47fd-b82b-fbafb0d789e1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:40.802950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46ee62-6535-46e0-8fa0-f4ab87bfeb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:40.803668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46ee62-6535-46e0-8fa0-f4ab87bfeb2f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:40.803973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46ee62-6535-46e0-8fa0-f4ab87bfeb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:40.804268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46ee62-6535-46e0-8fa0-f4ab87bfeb2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:40.805026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46ee62-6535-46e0-8fa0-f4ab87bfeb2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:40.806700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46ee62-6535-46e0-8fa0-f4ab87bfeb2f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:40.844096 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3129/6202] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:40 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:40.845483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf9872-0cea-4bc8-b13f-01fae33f4793 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:40.845781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf9872-0cea-4bc8-b13f-01fae33f4793 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:40.846068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bf9872-0cea-4bc8-b13f-01fae33f4793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:40.850600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2392d1-f908-469d-9203-56c2acf304e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:40.851396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2392d1-f908-469d-9203-56c2acf304e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:40.851683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2392d1-f908-469d-9203-56c2acf304e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:40.851962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2392d1-f908-469d-9203-56c2acf304e2 admin admin] PATH_INFO: `/v3/users/2a7d7111a97945a188d40c2d593fee94` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:40.854107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2392d1-f908-469d-9203-56c2acf304e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a7d7111a97945a188d40c2d593fee94)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:40.858715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2392d1-f908-469d-9203-56c2acf304e2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:40.950339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-83bf9872-0cea-4bc8-b13f-01fae33f4793 None None] MFA Rules not processed for user `28fa2da092ec4e10972e8d59e44dd749`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:40.951516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-83bf9872-0cea-4bc8-b13f-01fae33f4793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:41.088874 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3130/6203] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:40 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:41.092937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf9872-0cea-4bc8-b13f-01fae33f4793 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:41.106403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bf9872-0cea-4bc8-b13f-01fae33f4793 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:41.119003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c3e2b-8755-4744-b1a3-97521a5c121c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:41.120158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c3e2b-8755-4744-b1a3-97521a5c121c admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:41.120847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c3e2b-8755-4744-b1a3-97521a5c121c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:41.121307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c3e2b-8755-4744-b1a3-97521a5c121c admin admin] PATH_INFO: `/v3/projects/8841f70c2d8a4b7dbf04b3512320eb8f/users/bd04045878094564804ca43cd89a224f/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:41.169249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5f2392d1-f908-469d-9203-56c2acf304e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a7d7111a97945a188d40c2d593fee94'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:41.180092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c3e2b-8755-4744-b1a3-97521a5c121c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8841f70c2d8a4b7dbf04b3512320eb8f, user_id=bd04045878094564804ca43cd89a224f, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:41.184486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770c3e2b-8755-4744-b1a3-97521a5c121c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:41.202285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5f2392d1-f908-469d-9203-56c2acf304e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a7d7111a97945a188d40c2d593fee94'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:41.203200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5f2392d1-f908-469d-9203-56c2acf304e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a7d7111a97945a188d40c2d593fee94'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:41.203851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5f2392d1-f908-469d-9203-56c2acf304e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a7d7111a97945a188d40c2d593fee94'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:41.212687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5f2392d1-f908-469d-9203-56c2acf304e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a7d7111a97945a188d40c2d593fee94'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:41.301794 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3131/6204] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:41 2022] PUT /identity/v3/projects/8841f70c2d8a4b7dbf04b3512320eb8f/users/bd04045878094564804ca43cd89a224f/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:41.302948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c3e2b-8755-4744-b1a3-97521a5c121c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:41.308094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-770c3e2b-8755-4744-b1a3-97521a5c121c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:41.321793 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3074/6205] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:40 2022] DELETE /identity/v3/users/2a7d7111a97945a188d40c2d593fee94 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:41.323114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2392d1-f908-469d-9203-56c2acf304e2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:41.325759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5f2392d1-f908-469d-9203-56c2acf304e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:41.428694 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:41.456302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c3e2b-8755-4744-b1a3-97521a5c121c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:41.465421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2392d1-f908-469d-9203-56c2acf304e2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:41.468459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a26fab-a7e4-4f57-91cf-434803f8e5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:41.469153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a26fab-a7e4-4f57-91cf-434803f8e5e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:41.470003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a26fab-a7e4-4f57-91cf-434803f8e5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:41.473867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a26fab-a7e4-4f57-91cf-434803f8e5e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:41.473867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a26fab-a7e4-4f57-91cf-434803f8e5e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:41.473867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a26fab-a7e4-4f57-91cf-434803f8e5e5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:41.478693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39f12f-83e0-4116-88f9-a552dda48883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:41.479407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39f12f-83e0-4116-88f9-a552dda48883 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:41.479825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39f12f-83e0-4116-88f9-a552dda48883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:41.480103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39f12f-83e0-4116-88f9-a552dda48883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:41.480856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39f12f-83e0-4116-88f9-a552dda48883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:41.482566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb39f12f-83e0-4116-88f9-a552dda48883 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:41.512710 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3075/6206] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:41 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:41.514222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bc045-0be6-47a3-b176-fedffbe366bf None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:41.514518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bc045-0be6-47a3-b176-fedffbe366bf None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:41.514798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00bc045-0be6-47a3-b176-fedffbe366bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:41.522437 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:41.552023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d00bc045-0be6-47a3-b176-fedffbe366bf None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:41.553437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d00bc045-0be6-47a3-b176-fedffbe366bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:41.573450 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3076/6207] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:41.577778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bc045-0be6-47a3-b176-fedffbe366bf None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:41.598119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00bc045-0be6-47a3-b176-fedffbe366bf None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:41.606202 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3132/6208] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:41 2022] POST /identity/v3/projects => generated 391 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:41.607264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a26fab-a7e4-4f57-91cf-434803f8e5e5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:41.611685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5065b8f-8a4e-4ca8-abb7-1f9d9abf635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:41.613208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5065b8f-8a4e-4ca8-abb7-1f9d9abf635f admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:41.613498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5065b8f-8a4e-4ca8-abb7-1f9d9abf635f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:41.613782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5065b8f-8a4e-4ca8-abb7-1f9d9abf635f admin admin] PATH_INFO: `/v3/projects/8841f70c2d8a4b7dbf04b3512320eb8f/users/bd04045878094564804ca43cd89a224f/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:41.615298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f2a26fab-a7e4-4f57-91cf-434803f8e5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:41.619002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5065b8f-8a4e-4ca8-abb7-1f9d9abf635f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8841f70c2d8a4b7dbf04b3512320eb8f, user_id=bd04045878094564804ca43cd89a224f, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:41.622733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5065b8f-8a4e-4ca8-abb7-1f9d9abf635f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:41.663881 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3077/6209] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:41 2022] PUT /identity/v3/projects/8841f70c2d8a4b7dbf04b3512320eb8f/users/bd04045878094564804ca43cd89a224f/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:41.664919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5065b8f-8a4e-4ca8-abb7-1f9d9abf635f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:41.809191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a26fab-a7e4-4f57-91cf-434803f8e5e5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:41.837957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5065b8f-8a4e-4ca8-abb7-1f9d9abf635f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:41.874200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ff1d0-7a2c-46a7-b343-415fad62e33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:41.874905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ff1d0-7a2c-46a7-b343-415fad62e33b admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:41.875194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ff1d0-7a2c-46a7-b343-415fad62e33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:41.875474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ff1d0-7a2c-46a7-b343-415fad62e33b admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:41.877978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ff1d0-7a2c-46a7-b343-415fad62e33b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:41.886474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910ff1d0-7a2c-46a7-b343-415fad62e33b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:41.930808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e797d3-899a-414d-b3a4-97636fa13648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:41.932512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e797d3-899a-414d-b3a4-97636fa13648 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:41.934786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e797d3-899a-414d-b3a4-97636fa13648 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:41.935082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e797d3-899a-414d-b3a4-97636fa13648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:41.955115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e797d3-899a-414d-b3a4-97636fa13648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:41.956797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e797d3-899a-414d-b3a4-97636fa13648 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:41.983596 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3133/6210] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:40:41.990773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4e3d9-ce06-4846-b3fe-41c998ffda4d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:41.990929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4e3d9-ce06-4846-b3fe-41c998ffda4d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:41.991956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4e3d9-ce06-4846-b3fe-41c998ffda4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:42.018791 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3078/6211] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:41 2022] POST /identity/v3/users => generated 296 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:42.024836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ff1d0-7a2c-46a7-b343-415fad62e33b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:42.073736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910ff1d0-7a2c-46a7-b343-415fad62e33b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:42.097520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10266f-9521-4e35-9d80-82679e4a6457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:42.101551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10266f-9521-4e35-9d80-82679e4a6457 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:42.103201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10266f-9521-4e35-9d80-82679e4a6457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:42.103597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10266f-9521-4e35-9d80-82679e4a6457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:42.104806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10266f-9521-4e35-9d80-82679e4a6457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:42.107938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7ff4e3d9-ce06-4846-b3fe-41c998ffda4d None None] MFA Rules not processed for user `bd04045878094564804ca43cd89a224f`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:42.111458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7ff4e3d9-ce06-4846-b3fe-41c998ffda4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:42.111594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10266f-9521-4e35-9d80-82679e4a6457 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:42.149965 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3079/6212] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:42.153200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10266f-9521-4e35-9d80-82679e4a6457 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:42.169634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10266f-9521-4e35-9d80-82679e4a6457 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:42.177084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90751d5-6fdc-4972-803f-331519960178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:42.177937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90751d5-6fdc-4972-803f-331519960178 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:42.178397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90751d5-6fdc-4972-803f-331519960178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:42.178964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90751d5-6fdc-4972-803f-331519960178 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:42.179823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90751d5-6fdc-4972-803f-331519960178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:42.182469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90751d5-6fdc-4972-803f-331519960178 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:42.228521 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3080/6213] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:42 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:42.232366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90751d5-6fdc-4972-803f-331519960178 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:42.266482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90751d5-6fdc-4972-803f-331519960178 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:42.280918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a5ac9-f676-4b6a-925c-53b48ee6f536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:42.282147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a5ac9-f676-4b6a-925c-53b48ee6f536 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:42.283406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a5ac9-f676-4b6a-925c-53b48ee6f536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:42.285713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a5ac9-f676-4b6a-925c-53b48ee6f536 admin admin] PATH_INFO: `/v3/projects/9c581e11d0df470d9f651b2a4475b1c8/users/9918398cd3914ee8879faada3b402531/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:42.319256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a5ac9-f676-4b6a-925c-53b48ee6f536 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c581e11d0df470d9f651b2a4475b1c8, user_id=9918398cd3914ee8879faada3b402531, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:42.326889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a5ac9-f676-4b6a-925c-53b48ee6f536 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:42.355944 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3134/6214] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:42.361558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4e3d9-ce06-4846-b3fe-41c998ffda4d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:42.395400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4e3d9-ce06-4846-b3fe-41c998ffda4d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:42.395400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39ae65-c796-4ecb-afc4-c7e3aaee1a07 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd04045878094564804ca43cd89a224f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8841f70c2d8a4b7dbf04b3512320eb8f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:42.395400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39ae65-c796-4ecb-afc4-c7e3aaee1a07 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:42.395666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39ae65-c796-4ecb-afc4-c7e3aaee1a07 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:42.395666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39ae65-c796-4ecb-afc4-c7e3aaee1a07 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:42.401981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39ae65-c796-4ecb-afc4-c7e3aaee1a07 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:42.405725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39ae65-c796-4ecb-afc4-c7e3aaee1a07 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:42.414784 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:42.479410 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3081/6215] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:42 2022] PUT /identity/v3/projects/9c581e11d0df470d9f651b2a4475b1c8/users/9918398cd3914ee8879faada3b402531/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:42.481251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7c2ee-32b4-41a0-816a-ed2c83168512 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:42.481442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7c2ee-32b4-41a0-816a-ed2c83168512 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:42.481721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7c2ee-32b4-41a0-816a-ed2c83168512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:42.555859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4ca7c2ee-32b4-41a0-816a-ed2c83168512 None None] MFA Rules not processed for user `9918398cd3914ee8879faada3b402531`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:42.557160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4ca7c2ee-32b4-41a0-816a-ed2c83168512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:42.609097 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3135/6216] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:42 2022] POST /identity/v3/projects => generated 334 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:42.620640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39ae65-c796-4ecb-afc4-c7e3aaee1a07 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:42.755857 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3082/6217] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:42.758293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7c2ee-32b4-41a0-816a-ed2c83168512 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:42.759454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39ae65-c796-4ecb-afc4-c7e3aaee1a07 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:42.760152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4ca7c2ee-32b4-41a0-816a-ed2c83168512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:42.782469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f13dc-ff03-48b5-bb22-47d0682b6286 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd04045878094564804ca43cd89a224f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8841f70c2d8a4b7dbf04b3512320eb8f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:42.787667 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:42.805223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f13dc-ff03-48b5-bb22-47d0682b6286 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:42.805223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f13dc-ff03-48b5-bb22-47d0682b6286 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:42.805223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f13dc-ff03-48b5-bb22-47d0682b6286 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:42.805739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f13dc-ff03-48b5-bb22-47d0682b6286 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:42.808648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f13dc-ff03-48b5-bb22-47d0682b6286 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:42.913120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7c2ee-32b4-41a0-816a-ed2c83168512 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:42.989320 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3136/6218] 10.222.0.43 () {60 vars in 1151 bytes} [Tue Jul 19 14:40:42 2022] POST /identity/v3/projects => generated 333 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:42.990503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f13dc-ff03-48b5-bb22-47d0682b6286 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:42.996722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-723f13dc-ff03-48b5-bb22-47d0682b6286 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:43.112992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f75ea6-c73b-487e-b850-9317338314dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:43.114047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f75ea6-c73b-487e-b850-9317338314dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:43.114497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f75ea6-c73b-487e-b850-9317338314dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:43.114813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f75ea6-c73b-487e-b850-9317338314dc admin admin] PATH_INFO: `/v3/users/264f82f8097347b8a9678d0058ec56e7` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:43.120411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f75ea6-c73b-487e-b850-9317338314dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=264f82f8097347b8a9678d0058ec56e7)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:43.123196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f75ea6-c73b-487e-b850-9317338314dc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:43.153666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f13dc-ff03-48b5-bb22-47d0682b6286 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:43.159953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e2c16-86b4-4035-8957-5bd5b3ebbaa6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:43.161118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e2c16-86b4-4035-8957-5bd5b3ebbaa6 service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:43.162606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e2c16-86b4-4035-8957-5bd5b3ebbaa6 service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:43.163052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e2c16-86b4-4035-8957-5bd5b3ebbaa6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:43.166009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-af6e2c16-86b4-4035-8957-5bd5b3ebbaa6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:43.313479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e2c16-86b4-4035-8957-5bd5b3ebbaa6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:43.319936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e2c16-86b4-4035-8957-5bd5b3ebbaa6 service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:43.366556 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3137/6219] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:40:43.368297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e2c16-86b4-4035-8957-5bd5b3ebbaa6 service glance] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:43.377272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-af6e2c16-86b4-4035-8957-5bd5b3ebbaa6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:43.385013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-77f75ea6-c73b-487e-b850-9317338314dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '264f82f8097347b8a9678d0058ec56e7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:43.418558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-77f75ea6-c73b-487e-b850-9317338314dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '264f82f8097347b8a9678d0058ec56e7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:43.420960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-77f75ea6-c73b-487e-b850-9317338314dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '264f82f8097347b8a9678d0058ec56e7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:43.422662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-77f75ea6-c73b-487e-b850-9317338314dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '264f82f8097347b8a9678d0058ec56e7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:43.424047 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:43.463739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-77f75ea6-c73b-487e-b850-9317338314dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '264f82f8097347b8a9678d0058ec56e7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:43.577929 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3083/6220] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:42 2022] DELETE /identity/v3/users/264f82f8097347b8a9678d0058ec56e7 => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:43.577929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f75ea6-c73b-487e-b850-9317338314dc admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:43.577929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-77f75ea6-c73b-487e-b850-9317338314dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:43.620038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e2c16-86b4-4035-8957-5bd5b3ebbaa6 service glance] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:43.700894 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:43.735845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f75ea6-c73b-487e-b850-9317338314dc admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:43.754865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb8d59-02c0-4839-9c85-02db3375d4a4 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd04045878094564804ca43cd89a224f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8841f70c2d8a4b7dbf04b3512320eb8f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:43.757736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb8d59-02c0-4839-9c85-02db3375d4a4 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:43.757736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb8d59-02c0-4839-9c85-02db3375d4a4 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:43.757736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb8d59-02c0-4839-9c85-02db3375d4a4 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:43.757736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb8d59-02c0-4839-9c85-02db3375d4a4 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:43.759737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb8d59-02c0-4839-9c85-02db3375d4a4 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:43.763946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110b907-4598-4389-bb55-fcd5b9aaf8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:43.764872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110b907-4598-4389-bb55-fcd5b9aaf8ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:43.768031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110b907-4598-4389-bb55-fcd5b9aaf8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:43.768618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9110b907-4598-4389-bb55-fcd5b9aaf8ab admin admin] PATH_INFO: `/v3/projects/db7844b888b341daa35573cde91bcbcd` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:43.770619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110b907-4598-4389-bb55-fcd5b9aaf8ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=db7844b888b341daa35573cde91bcbcd)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:43.777752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9110b907-4598-4389-bb55-fcd5b9aaf8ab admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:43.905591 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3084/6221] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:43 2022] POST /identity/v3/projects => generated 358 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:43.906215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79d4bf-5fd9-40fa-bd78-d4eab0f464b5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:43.906440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79d4bf-5fd9-40fa-bd78-d4eab0f464b5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:43.906730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79d4bf-5fd9-40fa-bd78-d4eab0f464b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:43.949901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4e79d4bf-5fd9-40fa-bd78-d4eab0f464b5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:43.952003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4e79d4bf-5fd9-40fa-bd78-d4eab0f464b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:43.964289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9110b907-4598-4389-bb55-fcd5b9aaf8ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db7844b888b341daa35573cde91bcbcd', 'request_id': 'req-9110b907-4598-4389-bb55-fcd5b9aaf8ab'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:43.974765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9110b907-4598-4389-bb55-fcd5b9aaf8ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db7844b888b341daa35573cde91bcbcd', 'request_id': 'req-9110b907-4598-4389-bb55-fcd5b9aaf8ab'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:43.994177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9110b907-4598-4389-bb55-fcd5b9aaf8ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db7844b888b341daa35573cde91bcbcd', 'request_id': 'req-9110b907-4598-4389-bb55-fcd5b9aaf8ab'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:44.071135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9110b907-4598-4389-bb55-fcd5b9aaf8ab admin admin] The token cache is being invalidate because project db7844b888b341daa35573cde91bcbcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:44.071563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9110b907-4598-4389-bb55-fcd5b9aaf8ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:44.072653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9110b907-4598-4389-bb55-fcd5b9aaf8ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:44.075642 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3138/6222] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:43 2022] DELETE /identity/v3/projects/db7844b888b341daa35573cde91bcbcd => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:44.078636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110b907-4598-4389-bb55-fcd5b9aaf8ab admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:44.086917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9110b907-4598-4389-bb55-fcd5b9aaf8ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:44.107571 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3085/6223] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:44.108593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79d4bf-5fd9-40fa-bd78-d4eab0f464b5 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:44.110264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4e79d4bf-5fd9-40fa-bd78-d4eab0f464b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:44.125189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79d4bf-5fd9-40fa-bd78-d4eab0f464b5 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:44.133784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c6acb-6254-4b04-95d2-dc8b7d9494e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:44.135894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c6acb-6254-4b04-95d2-dc8b7d9494e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:44.136191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c6acb-6254-4b04-95d2-dc8b7d9494e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:44.136477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c6acb-6254-4b04-95d2-dc8b7d9494e5 admin admin] PATH_INFO: `/v3/users/847dea14552f490bb065b6027f7b2529` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:44.138060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c6acb-6254-4b04-95d2-dc8b7d9494e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=847dea14552f490bb065b6027f7b2529)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:44.140463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c6acb-6254-4b04-95d2-dc8b7d9494e5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:44.235145 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:44.279112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9110b907-4598-4389-bb55-fcd5b9aaf8ab admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:44.284672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b62b2-194d-4522-b1d6-f07340bcc39a tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd04045878094564804ca43cd89a224f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8841f70c2d8a4b7dbf04b3512320eb8f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:44.285349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b62b2-194d-4522-b1d6-f07340bcc39a tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:44.285645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b62b2-194d-4522-b1d6-f07340bcc39a tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:44.285930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0b62b2-194d-4522-b1d6-f07340bcc39a tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:44.289139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b62b2-194d-4522-b1d6-f07340bcc39a tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:44.289585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0b62b2-194d-4522-b1d6-f07340bcc39a tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:44.328399 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3139/6224] 10.222.0.43 () {58 vars in 1130 bytes} [Tue Jul 19 14:40:44 2022] GET /identity/v3/projects => generated 7599 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:44.336300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b62b2-194d-4522-b1d6-f07340bcc39a tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:44.346257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-aa0b62b2-194d-4522-b1d6-f07340bcc39a tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:44.400021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-323c6acb-6254-4b04-95d2-dc8b7d9494e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '847dea14552f490bb065b6027f7b2529'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:44.423635 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-323c6acb-6254-4b04-95d2-dc8b7d9494e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '847dea14552f490bb065b6027f7b2529'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:44.425760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-323c6acb-6254-4b04-95d2-dc8b7d9494e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '847dea14552f490bb065b6027f7b2529'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:44.426896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-323c6acb-6254-4b04-95d2-dc8b7d9494e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '847dea14552f490bb065b6027f7b2529'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:44.441540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-323c6acb-6254-4b04-95d2-dc8b7d9494e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '847dea14552f490bb065b6027f7b2529'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:44.479328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0b62b2-194d-4522-b1d6-f07340bcc39a tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:44.484868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25c380-460d-45dd-a1bb-cb3c8037f5b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:44.485547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25c380-460d-45dd-a1bb-cb3c8037f5b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:44.486068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25c380-460d-45dd-a1bb-cb3c8037f5b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:44.486420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25c380-460d-45dd-a1bb-cb3c8037f5b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:44.489809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ae25c380-460d-45dd-a1bb-cb3c8037f5b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:44.503352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25c380-460d-45dd-a1bb-cb3c8037f5b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:44.505151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25c380-460d-45dd-a1bb-cb3c8037f5b4 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:44.517574 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3140/6225] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:40:44.519403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25c380-460d-45dd-a1bb-cb3c8037f5b4 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:44.521059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ae25c380-460d-45dd-a1bb-cb3c8037f5b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:44.537746 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3086/6226] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:44 2022] DELETE /identity/v3/users/847dea14552f490bb065b6027f7b2529 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:44.544668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25c380-460d-45dd-a1bb-cb3c8037f5b4 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:44.672201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9573f83-95f5-4fe3-88a1-153a6e10e205 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd04045878094564804ca43cd89a224f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8841f70c2d8a4b7dbf04b3512320eb8f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:44.672894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9573f83-95f5-4fe3-88a1-153a6e10e205 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:44.673410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9573f83-95f5-4fe3-88a1-153a6e10e205 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:44.675189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9573f83-95f5-4fe3-88a1-153a6e10e205 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:44.675981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9573f83-95f5-4fe3-88a1-153a6e10e205 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:44.676301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9573f83-95f5-4fe3-88a1-153a6e10e205 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:44.680197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9573f83-95f5-4fe3-88a1-153a6e10e205 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:44.728774 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3141/6227] 10.222.0.43 () {58 vars in 1157 bytes} [Tue Jul 19 14:40:44 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:44.733447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c6acb-6254-4b04-95d2-dc8b7d9494e5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:44.753091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c6acb-6254-4b04-95d2-dc8b7d9494e5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:44.767207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad3daf-8969-4501-9211-54ff411b6ff7 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd04045878094564804ca43cd89a224f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8841f70c2d8a4b7dbf04b3512320eb8f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:44.768001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad3daf-8969-4501-9211-54ff411b6ff7 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:44.768855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad3daf-8969-4501-9211-54ff411b6ff7 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:44.769214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad3daf-8969-4501-9211-54ff411b6ff7 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:44.770076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad3daf-8969-4501-9211-54ff411b6ff7 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: Adding query filter params (parent_id=990f712e11254c079393622bd2e12a41) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:44.770491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad3daf-8969-4501-9211-54ff411b6ff7 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:44.772468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad3daf-8969-4501-9211-54ff411b6ff7 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:44.821315 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3087/6228] 10.222.0.43 () {58 vars in 1215 bytes} [Tue Jul 19 14:40:44 2022] GET /identity/v3/projects?parent_id=990f712e11254c079393622bd2e12a41 => generated 498 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:44.822619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9573f83-95f5-4fe3-88a1-153a6e10e205 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:44.837198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9573f83-95f5-4fe3-88a1-153a6e10e205 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:44.843893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a5e58-2311-45f0-9e45-ec094a60c3b9 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd04045878094564804ca43cd89a224f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8841f70c2d8a4b7dbf04b3512320eb8f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:44.844876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a5e58-2311-45f0-9e45-ec094a60c3b9 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:44.845177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a5e58-2311-45f0-9e45-ec094a60c3b9 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:44.845462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a5e58-2311-45f0-9e45-ec094a60c3b9 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] PATH_INFO: `/v3/projects/834ad29db3fd4a0cba4cf79f1663538c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:44.848306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a5e58-2311-45f0-9e45-ec094a60c3b9 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: Authorizing `identity:delete_project(project_id=834ad29db3fd4a0cba4cf79f1663538c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:44.850429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a5e58-2311-45f0-9e45-ec094a60c3b9 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:45.165048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-243a5e58-2311-45f0-9e45-ec094a60c3b9 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '834ad29db3fd4a0cba4cf79f1663538c', 'request_id': 'req-243a5e58-2311-45f0-9e45-ec094a60c3b9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:45.176057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-243a5e58-2311-45f0-9e45-ec094a60c3b9 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '834ad29db3fd4a0cba4cf79f1663538c', 'request_id': 'req-243a5e58-2311-45f0-9e45-ec094a60c3b9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:45.199262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-243a5e58-2311-45f0-9e45-ec094a60c3b9 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '834ad29db3fd4a0cba4cf79f1663538c', 'request_id': 'req-243a5e58-2311-45f0-9e45-ec094a60c3b9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:45.346509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-243a5e58-2311-45f0-9e45-ec094a60c3b9 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] The token cache is being invalidate because project 834ad29db3fd4a0cba4cf79f1663538c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:45.346804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-243a5e58-2311-45f0-9e45-ec094a60c3b9 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:45.347694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-243a5e58-2311-45f0-9e45-ec094a60c3b9 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:45.350344 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3142/6229] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:44 2022] DELETE /identity/v3/projects/834ad29db3fd4a0cba4cf79f1663538c => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:45.370150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad3daf-8969-4501-9211-54ff411b6ff7 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:45.371912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3dad3daf-8969-4501-9211-54ff411b6ff7 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:45.394219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad3daf-8969-4501-9211-54ff411b6ff7 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:45.424783 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:45.473750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed1e64-2997-4256-aecd-e8b66a7568f1 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd04045878094564804ca43cd89a224f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8841f70c2d8a4b7dbf04b3512320eb8f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:45.474672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed1e64-2997-4256-aecd-e8b66a7568f1 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:45.474970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed1e64-2997-4256-aecd-e8b66a7568f1 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:45.475303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed1e64-2997-4256-aecd-e8b66a7568f1 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] PATH_INFO: `/v3/projects/990f712e11254c079393622bd2e12a41` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:45.481745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed1e64-2997-4256-aecd-e8b66a7568f1 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: Authorizing `identity:delete_project(project_id=990f712e11254c079393622bd2e12a41)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:45.483874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ed1e64-2997-4256-aecd-e8b66a7568f1 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:45.495403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a5e58-2311-45f0-9e45-ec094a60c3b9 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:45.497037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-243a5e58-2311-45f0-9e45-ec094a60c3b9 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:45.509654 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:45.638794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a5e58-2311-45f0-9e45-ec094a60c3b9 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:45.648462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d75137-1d93-4d9d-a9cb-db56f475357c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:45.649463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d75137-1d93-4d9d-a9cb-db56f475357c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:45.649825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d75137-1d93-4d9d-a9cb-db56f475357c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:45.650257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d75137-1d93-4d9d-a9cb-db56f475357c admin admin] PATH_INFO: `/v3/projects/045f723474dc4d0f910e24d7eaf0011d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:45.651850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d75137-1d93-4d9d-a9cb-db56f475357c admin admin] RBAC: Authorizing `identity:delete_project(project_id=045f723474dc4d0f910e24d7eaf0011d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:45.654245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d75137-1d93-4d9d-a9cb-db56f475357c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:45.720187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-66ed1e64-2997-4256-aecd-e8b66a7568f1 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '990f712e11254c079393622bd2e12a41', 'request_id': 'req-66ed1e64-2997-4256-aecd-e8b66a7568f1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:45.819727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-66ed1e64-2997-4256-aecd-e8b66a7568f1 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '990f712e11254c079393622bd2e12a41', 'request_id': 'req-66ed1e64-2997-4256-aecd-e8b66a7568f1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:45.822721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-21d75137-1d93-4d9d-a9cb-db56f475357c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '045f723474dc4d0f910e24d7eaf0011d', 'request_id': 'req-21d75137-1d93-4d9d-a9cb-db56f475357c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:45.827232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-66ed1e64-2997-4256-aecd-e8b66a7568f1 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '990f712e11254c079393622bd2e12a41', 'request_id': 'req-66ed1e64-2997-4256-aecd-e8b66a7568f1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:45.829717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-21d75137-1d93-4d9d-a9cb-db56f475357c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '045f723474dc4d0f910e24d7eaf0011d', 'request_id': 'req-21d75137-1d93-4d9d-a9cb-db56f475357c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:45.836412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-21d75137-1d93-4d9d-a9cb-db56f475357c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '045f723474dc4d0f910e24d7eaf0011d', 'request_id': 'req-21d75137-1d93-4d9d-a9cb-db56f475357c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:45.841312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-66ed1e64-2997-4256-aecd-e8b66a7568f1 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] The token cache is being invalidate because project 990f712e11254c079393622bd2e12a41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:45.841808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-66ed1e64-2997-4256-aecd-e8b66a7568f1 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:45.842899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-66ed1e64-2997-4256-aecd-e8b66a7568f1 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:45.845799 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3088/6230] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:45 2022] DELETE /identity/v3/projects/990f712e11254c079393622bd2e12a41 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:45.847606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed1e64-2997-4256-aecd-e8b66a7568f1 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:45.849802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-66ed1e64-2997-4256-aecd-e8b66a7568f1 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:45.928015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-21d75137-1d93-4d9d-a9cb-db56f475357c admin admin] The token cache is being invalidate because project 045f723474dc4d0f910e24d7eaf0011d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:45.928379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-21d75137-1d93-4d9d-a9cb-db56f475357c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:45.932625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-21d75137-1d93-4d9d-a9cb-db56f475357c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:45.936145 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3143/6231] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:45 2022] DELETE /identity/v3/projects/045f723474dc4d0f910e24d7eaf0011d => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:45.937861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d75137-1d93-4d9d-a9cb-db56f475357c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:45.943444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-21d75137-1d93-4d9d-a9cb-db56f475357c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:45.946317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed1e64-2997-4256-aecd-e8b66a7568f1 tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:46.019049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968639e6-9aec-4606-9fce-0b5938c4b1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:46.020100 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968639e6-9aec-4606-9fce-0b5938c4b1a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:46.020717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968639e6-9aec-4606-9fce-0b5938c4b1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:46.021163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968639e6-9aec-4606-9fce-0b5938c4b1a5 admin admin] PATH_INFO: `/v3/projects/23bd0bdc711a4ab29a50bc0ea4c92f25` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:46.022807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968639e6-9aec-4606-9fce-0b5938c4b1a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23bd0bdc711a4ab29a50bc0ea4c92f25)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:46.025293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968639e6-9aec-4606-9fce-0b5938c4b1a5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:46.112822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d75137-1d93-4d9d-a9cb-db56f475357c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:46.121116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f889138-613f-4118-a938-5f68c670ce2d tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd04045878094564804ca43cd89a224f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8841f70c2d8a4b7dbf04b3512320eb8f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:46.122004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f889138-613f-4118-a938-5f68c670ce2d tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:46.122331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f889138-613f-4118-a938-5f68c670ce2d tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:46.122619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f889138-613f-4118-a938-5f68c670ce2d tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] PATH_INFO: `/v3/projects/ad272168ea4241119b7d8729d1891f7b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:46.123851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f889138-613f-4118-a938-5f68c670ce2d tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ad272168ea4241119b7d8729d1891f7b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:46.125779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f889138-613f-4118-a938-5f68c670ce2d tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:46.312527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-968639e6-9aec-4606-9fce-0b5938c4b1a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23bd0bdc711a4ab29a50bc0ea4c92f25', 'request_id': 'req-968639e6-9aec-4606-9fce-0b5938c4b1a5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:46.335676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3f889138-613f-4118-a938-5f68c670ce2d tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad272168ea4241119b7d8729d1891f7b', 'request_id': 'req-3f889138-613f-4118-a938-5f68c670ce2d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:46.341537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3f889138-613f-4118-a938-5f68c670ce2d tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad272168ea4241119b7d8729d1891f7b', 'request_id': 'req-3f889138-613f-4118-a938-5f68c670ce2d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:46.372122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3f889138-613f-4118-a938-5f68c670ce2d tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad272168ea4241119b7d8729d1891f7b', 'request_id': 'req-3f889138-613f-4118-a938-5f68c670ce2d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:46.406766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-968639e6-9aec-4606-9fce-0b5938c4b1a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23bd0bdc711a4ab29a50bc0ea4c92f25', 'request_id': 'req-968639e6-9aec-4606-9fce-0b5938c4b1a5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:46.417001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-968639e6-9aec-4606-9fce-0b5938c4b1a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23bd0bdc711a4ab29a50bc0ea4c92f25', 'request_id': 'req-968639e6-9aec-4606-9fce-0b5938c4b1a5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:46.432069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-968639e6-9aec-4606-9fce-0b5938c4b1a5 admin admin] The token cache is being invalidate because project 23bd0bdc711a4ab29a50bc0ea4c92f25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:46.432478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-968639e6-9aec-4606-9fce-0b5938c4b1a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:46.433561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-968639e6-9aec-4606-9fce-0b5938c4b1a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:46.436726 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3089/6232] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:45 2022] DELETE /identity/v3/projects/23bd0bdc711a4ab29a50bc0ea4c92f25 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:46.441985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968639e6-9aec-4606-9fce-0b5938c4b1a5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:46.443928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-968639e6-9aec-4606-9fce-0b5938c4b1a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:46.490712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3f889138-613f-4118-a938-5f68c670ce2d tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] The token cache is being invalidate because project ad272168ea4241119b7d8729d1891f7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:46.491080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3f889138-613f-4118-a938-5f68c670ce2d tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:46.491947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3f889138-613f-4118-a938-5f68c670ce2d tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:46.494250 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3144/6233] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:45 2022] DELETE /identity/v3/projects/ad272168ea4241119b7d8729d1891f7b => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:46.495358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f889138-613f-4118-a938-5f68c670ce2d tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:46.497020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3f889138-613f-4118-a938-5f68c670ce2d tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:46.588015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f889138-613f-4118-a938-5f68c670ce2d tempest-ListProjectsTestJSON-1722250607 tempest-ListProjectsTestJSON-1722250607-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:46.594794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adaae25-adc0-46ff-8267-61775f7958e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:46.598720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaae25-adc0-46ff-8267-61775f7958e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:46.599085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaae25-adc0-46ff-8267-61775f7958e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:46.599632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adaae25-adc0-46ff-8267-61775f7958e5 admin admin] PATH_INFO: `/v3/users/8ceb80e787a34c3284096cbac44c93c8` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:46.602631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adaae25-adc0-46ff-8267-61775f7958e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ceb80e787a34c3284096cbac44c93c8)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:46.604776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adaae25-adc0-46ff-8267-61775f7958e5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:46.625144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968639e6-9aec-4606-9fce-0b5938c4b1a5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:46.644066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965493a1-7951-4906-b1a1-a2f8e2ee6d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:46.647016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965493a1-7951-4906-b1a1-a2f8e2ee6d7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:46.647959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965493a1-7951-4906-b1a1-a2f8e2ee6d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:46.648272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965493a1-7951-4906-b1a1-a2f8e2ee6d7e admin admin] PATH_INFO: `/v3/users/28fa2da092ec4e10972e8d59e44dd749` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:46.650944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965493a1-7951-4906-b1a1-a2f8e2ee6d7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=28fa2da092ec4e10972e8d59e44dd749)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:46.654014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965493a1-7951-4906-b1a1-a2f8e2ee6d7e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:46.892464 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:46.916472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0adaae25-adc0-46ff-8267-61775f7958e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ceb80e787a34c3284096cbac44c93c8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:46.939575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0adaae25-adc0-46ff-8267-61775f7958e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ceb80e787a34c3284096cbac44c93c8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:46.950264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0adaae25-adc0-46ff-8267-61775f7958e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ceb80e787a34c3284096cbac44c93c8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:46.955493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0adaae25-adc0-46ff-8267-61775f7958e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ceb80e787a34c3284096cbac44c93c8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:46.995203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-965493a1-7951-4906-b1a1-a2f8e2ee6d7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28fa2da092ec4e10972e8d59e44dd749'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:47.001491 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:47.009826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-965493a1-7951-4906-b1a1-a2f8e2ee6d7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28fa2da092ec4e10972e8d59e44dd749'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:47.012979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-965493a1-7951-4906-b1a1-a2f8e2ee6d7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28fa2da092ec4e10972e8d59e44dd749'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:47.013896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-965493a1-7951-4906-b1a1-a2f8e2ee6d7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28fa2da092ec4e10972e8d59e44dd749'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:47.023306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-965493a1-7951-4906-b1a1-a2f8e2ee6d7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28fa2da092ec4e10972e8d59e44dd749'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:47.043557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0adaae25-adc0-46ff-8267-61775f7958e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ceb80e787a34c3284096cbac44c93c8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:47.053899 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3145/6234] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:46 2022] DELETE /identity/v3/users/8ceb80e787a34c3284096cbac44c93c8 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:47.055314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03091728-7937-4e33-ba88-bf2da96489bd None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:47.055607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03091728-7937-4e33-ba88-bf2da96489bd None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:47.055891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03091728-7937-4e33-ba88-bf2da96489bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:47.085088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-03091728-7937-4e33-ba88-bf2da96489bd None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:47.086741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-03091728-7937-4e33-ba88-bf2da96489bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:47.166355 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3146/6235] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:47.167461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03091728-7937-4e33-ba88-bf2da96489bd None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:47.168953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-03091728-7937-4e33-ba88-bf2da96489bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:47.184464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03091728-7937-4e33-ba88-bf2da96489bd None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:47.190359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03062f2-eaec-44d5-a368-c2c2253ad1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:47.191429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03062f2-eaec-44d5-a368-c2c2253ad1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:47.191718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03062f2-eaec-44d5-a368-c2c2253ad1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:47.192302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03062f2-eaec-44d5-a368-c2c2253ad1f5 admin admin] PATH_INFO: `/v3/users/34482efcb613417ca6a2b48596089c46` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:47.195782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03062f2-eaec-44d5-a368-c2c2253ad1f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34482efcb613417ca6a2b48596089c46)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:47.197878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03062f2-eaec-44d5-a368-c2c2253ad1f5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:47.208671 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3090/6236] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:46 2022] DELETE /identity/v3/users/28fa2da092ec4e10972e8d59e44dd749 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:47.209782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b88ef6-c828-42c4-87e5-ca5d060ee949 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:47.210872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b88ef6-c828-42c4-87e5-ca5d060ee949 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:47.211383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b88ef6-c828-42c4-87e5-ca5d060ee949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:47.239641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-55b88ef6-c828-42c4-87e5-ca5d060ee949 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:47.240887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-55b88ef6-c828-42c4-87e5-ca5d060ee949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:47.316924 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3091/6237] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:47.318468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276391eb-2492-4c59-ac1f-dc563e157da3 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:47.318795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276391eb-2492-4c59-ac1f-dc563e157da3 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:47.318795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276391eb-2492-4c59-ac1f-dc563e157da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:47.355218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-276391eb-2492-4c59-ac1f-dc563e157da3 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:47.357084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-276391eb-2492-4c59-ac1f-dc563e157da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:47.409492 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3092/6238] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:47.409492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276391eb-2492-4c59-ac1f-dc563e157da3 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:47.414965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276391eb-2492-4c59-ac1f-dc563e157da3 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:47.422795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84da17c-b5bd-4f93-930e-689dfaca72f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:47.423418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84da17c-b5bd-4f93-930e-689dfaca72f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:47.423708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84da17c-b5bd-4f93-930e-689dfaca72f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:47.423990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84da17c-b5bd-4f93-930e-689dfaca72f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:47.425261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84da17c-b5bd-4f93-930e-689dfaca72f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:47.425727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84da17c-b5bd-4f93-930e-689dfaca72f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:47.427647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84da17c-b5bd-4f93-930e-689dfaca72f4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:47.458345 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3093/6239] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:40:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:47.458345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84da17c-b5bd-4f93-930e-689dfaca72f4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:47.469744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c84da17c-b5bd-4f93-930e-689dfaca72f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:47.476990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f03062f2-eaec-44d5-a368-c2c2253ad1f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34482efcb613417ca6a2b48596089c46'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:47.506900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f03062f2-eaec-44d5-a368-c2c2253ad1f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34482efcb613417ca6a2b48596089c46'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:47.523379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f03062f2-eaec-44d5-a368-c2c2253ad1f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34482efcb613417ca6a2b48596089c46'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:47.527119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f03062f2-eaec-44d5-a368-c2c2253ad1f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34482efcb613417ca6a2b48596089c46'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:47.613077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84da17c-b5bd-4f93-930e-689dfaca72f4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:47.624530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22df876-9fb2-43cc-bea4-f147e8891540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:47.624530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22df876-9fb2-43cc-bea4-f147e8891540 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:47.624530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22df876-9fb2-43cc-bea4-f147e8891540 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:47.624530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22df876-9fb2-43cc-bea4-f147e8891540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:47.634039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22df876-9fb2-43cc-bea4-f147e8891540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:47.635610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22df876-9fb2-43cc-bea4-f147e8891540 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:47.648004 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3094/6240] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:40:47.648578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22df876-9fb2-43cc-bea4-f147e8891540 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:47.666310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f03062f2-eaec-44d5-a368-c2c2253ad1f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34482efcb613417ca6a2b48596089c46'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:47.669355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22df876-9fb2-43cc-bea4-f147e8891540 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:47.676462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc77303-739f-47db-bac8-cfe670e3e48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:47.677215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc77303-739f-47db-bac8-cfe670e3e48c admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:47.677581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc77303-739f-47db-bac8-cfe670e3e48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:47.677939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc77303-739f-47db-bac8-cfe670e3e48c admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:47.679002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc77303-739f-47db-bac8-cfe670e3e48c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:47.681349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc77303-739f-47db-bac8-cfe670e3e48c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:47.686830 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3147/6241] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:47 2022] DELETE /identity/v3/users/34482efcb613417ca6a2b48596089c46 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:47.688659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d738a-179c-48d2-a773-e21aaba5d973 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:47.688957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d738a-179c-48d2-a773-e21aaba5d973 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:47.689235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96d738a-179c-48d2-a773-e21aaba5d973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:47.719874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f96d738a-179c-48d2-a773-e21aaba5d973 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:47.722261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f96d738a-179c-48d2-a773-e21aaba5d973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:47.814660 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3148/6242] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:40:47.816153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d738a-179c-48d2-a773-e21aaba5d973 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:47.818500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f96d738a-179c-48d2-a773-e21aaba5d973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:47.838583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96d738a-179c-48d2-a773-e21aaba5d973 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:47.843654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37c934-e327-46b1-bcd0-c49cfdd8c692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:47.844518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37c934-e327-46b1-bcd0-c49cfdd8c692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:47.844804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37c934-e327-46b1-bcd0-c49cfdd8c692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:47.845084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37c934-e327-46b1-bcd0-c49cfdd8c692 admin admin] PATH_INFO: `/v3/projects/ed01c8f98afa46bfa5e43f989c0feb21` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:47.846992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37c934-e327-46b1-bcd0-c49cfdd8c692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed01c8f98afa46bfa5e43f989c0feb21)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:47.849097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37c934-e327-46b1-bcd0-c49cfdd8c692 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:47.869880 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3095/6243] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:47 2022] POST /identity/v3/projects => generated 369 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:47.871212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc77303-739f-47db-bac8-cfe670e3e48c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:47.873012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1bc77303-739f-47db-bac8-cfe670e3e48c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:47.913599 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:47.947896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc77303-739f-47db-bac8-cfe670e3e48c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:47.952242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1dd14a-5f3a-4bd4-ad5e-73e52e0ab89b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:47.952977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd14a-5f3a-4bd4-ad5e-73e52e0ab89b service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:47.953269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd14a-5f3a-4bd4-ad5e-73e52e0ab89b service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:47.953550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dd14a-5f3a-4bd4-ad5e-73e52e0ab89b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:47.988445 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:48.030282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ad37c934-e327-46b1-bcd0-c49cfdd8c692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed01c8f98afa46bfa5e43f989c0feb21', 'request_id': 'req-ad37c934-e327-46b1-bcd0-c49cfdd8c692'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:48.046493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1dd14a-5f3a-4bd4-ad5e-73e52e0ab89b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:48.046493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1dd14a-5f3a-4bd4-ad5e-73e52e0ab89b service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:48.046957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ad37c934-e327-46b1-bcd0-c49cfdd8c692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed01c8f98afa46bfa5e43f989c0feb21', 'request_id': 'req-ad37c934-e327-46b1-bcd0-c49cfdd8c692'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:48.058071 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3096/6244] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:40:48.058879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1dd14a-5f3a-4bd4-ad5e-73e52e0ab89b service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:48.060980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-df1dd14a-5f3a-4bd4-ad5e-73e52e0ab89b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:48.062236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ad37c934-e327-46b1-bcd0-c49cfdd8c692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed01c8f98afa46bfa5e43f989c0feb21', 'request_id': 'req-ad37c934-e327-46b1-bcd0-c49cfdd8c692'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:48.076970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1dd14a-5f3a-4bd4-ad5e-73e52e0ab89b service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:48.170503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad573de7-14bd-4f46-b040-d9a4a4347136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:48.171201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad573de7-14bd-4f46-b040-d9a4a4347136 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:48.174922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad573de7-14bd-4f46-b040-d9a4a4347136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:48.174922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad573de7-14bd-4f46-b040-d9a4a4347136 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:48.174922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad573de7-14bd-4f46-b040-d9a4a4347136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:48.176361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad573de7-14bd-4f46-b040-d9a4a4347136 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:48.178990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ad37c934-e327-46b1-bcd0-c49cfdd8c692 admin admin] The token cache is being invalidate because project ed01c8f98afa46bfa5e43f989c0feb21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:48.179657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ad37c934-e327-46b1-bcd0-c49cfdd8c692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:48.180802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ad37c934-e327-46b1-bcd0-c49cfdd8c692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:48.183303 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3149/6245] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:47 2022] DELETE /identity/v3/projects/ed01c8f98afa46bfa5e43f989c0feb21 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:48.191478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264f586-447d-422c-b2ee-a5c9e8c5b76c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:48.193309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264f586-447d-422c-b2ee-a5c9e8c5b76c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:48.193622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2264f586-447d-422c-b2ee-a5c9e8c5b76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:48.244432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2264f586-447d-422c-b2ee-a5c9e8c5b76c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:48.247774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2264f586-447d-422c-b2ee-a5c9e8c5b76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:48.256445 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3150/6246] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:48.266535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b6d17-5d0c-4ba1-84a0-52b74c7502c1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:48.266535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b6d17-5d0c-4ba1-84a0-52b74c7502c1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:48.266535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b6d17-5d0c-4ba1-84a0-52b74c7502c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:48.288170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5c9b6d17-5d0c-4ba1-84a0-52b74c7502c1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:48.293674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5c9b6d17-5d0c-4ba1-84a0-52b74c7502c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:48.298937 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3097/6247] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:48 2022] POST /identity/v3/users => generated 285 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:48.302147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad573de7-14bd-4f46-b040-d9a4a4347136 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:48.306115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ad573de7-14bd-4f46-b040-d9a4a4347136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:48.306858 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3151/6248] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:48.308116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b6d17-5d0c-4ba1-84a0-52b74c7502c1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:48.321827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b6d17-5d0c-4ba1-84a0-52b74c7502c1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:48.327836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478230b-b578-4553-bbd9-d12e6353107e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:48.328663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478230b-b578-4553-bbd9-d12e6353107e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:48.329051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478230b-b578-4553-bbd9-d12e6353107e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:48.329651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478230b-b578-4553-bbd9-d12e6353107e admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:48.330637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478230b-b578-4553-bbd9-d12e6353107e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:48.331500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478230b-b578-4553-bbd9-d12e6353107e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:48.332887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478230b-b578-4553-bbd9-d12e6353107e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:48.339864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad573de7-14bd-4f46-b040-d9a4a4347136 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:48.347711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87548dd-f439-4f54-8fde-d31a44369f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:48.349307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87548dd-f439-4f54-8fde-d31a44369f66 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:48.350509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87548dd-f439-4f54-8fde-d31a44369f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:48.351014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87548dd-f439-4f54-8fde-d31a44369f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:48.363461 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3152/6249] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:48.364960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478230b-b578-4553-bbd9-d12e6353107e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:48.389126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478230b-b578-4553-bbd9-d12e6353107e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:48.394968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38330527-b58d-4431-9e74-bbaa84fb34d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:48.397412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38330527-b58d-4431-9e74-bbaa84fb34d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:48.397412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38330527-b58d-4431-9e74-bbaa84fb34d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:48.397412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38330527-b58d-4431-9e74-bbaa84fb34d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:48.397412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38330527-b58d-4431-9e74-bbaa84fb34d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:48.398549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87548dd-f439-4f54-8fde-d31a44369f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:48.400492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38330527-b58d-4431-9e74-bbaa84fb34d8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:48.402136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87548dd-f439-4f54-8fde-d31a44369f66 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:48.420031 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3098/6250] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:40:48.423815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87548dd-f439-4f54-8fde-d31a44369f66 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:48.435532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87548dd-f439-4f54-8fde-d31a44369f66 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:48.443973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a33fa8-33f8-4922-8e73-4680372a19bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:48.443973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a33fa8-33f8-4922-8e73-4680372a19bf admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:48.443973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a33fa8-33f8-4922-8e73-4680372a19bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:48.443973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a33fa8-33f8-4922-8e73-4680372a19bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:48.444322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a33fa8-33f8-4922-8e73-4680372a19bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:48.444952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a33fa8-33f8-4922-8e73-4680372a19bf admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:48.484284 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3099/6251] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:48 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:48.485526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a33fa8-33f8-4922-8e73-4680372a19bf admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:48.497166 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3153/6252] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:48 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:48.501476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38330527-b58d-4431-9e74-bbaa84fb34d8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:48.506666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a33fa8-33f8-4922-8e73-4680372a19bf admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:48.576705 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:48.603756 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:48.647876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8326ff-0cb8-492e-b04b-8f18b4d5a128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:48.648789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8326ff-0cb8-492e-b04b-8f18b4d5a128 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:48.649077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8326ff-0cb8-492e-b04b-8f18b4d5a128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:48.649366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8326ff-0cb8-492e-b04b-8f18b4d5a128 admin admin] PATH_INFO: `/v3/projects/fe7c55047f3b4c6b945711143361d94b/users/dd779757eddc4ee49e1875f205fbd11e/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:48.684284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38330527-b58d-4431-9e74-bbaa84fb34d8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:48.684751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8326ff-0cb8-492e-b04b-8f18b4d5a128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe7c55047f3b4c6b945711143361d94b, user_id=dd779757eddc4ee49e1875f205fbd11e, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:48.687719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8326ff-0cb8-492e-b04b-8f18b4d5a128 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:48.696670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f4db1f-941f-41f3-a9e7-d53d3d349c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:48.697199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4db1f-941f-41f3-a9e7-d53d3d349c65 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:48.697490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4db1f-941f-41f3-a9e7-d53d3d349c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:48.697770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4db1f-941f-41f3-a9e7-d53d3d349c65 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:48.698789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4db1f-941f-41f3-a9e7-d53d3d349c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:48.700447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f4db1f-941f-41f3-a9e7-d53d3d349c65 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:48.807157 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3100/6253] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:48 2022] PUT /identity/v3/projects/fe7c55047f3b4c6b945711143361d94b/users/dd779757eddc4ee49e1875f205fbd11e/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:48.807157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8326ff-0cb8-492e-b04b-8f18b4d5a128 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:48.807157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7f8326ff-0cb8-492e-b04b-8f18b4d5a128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:48.842751 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3154/6254] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:48 2022] POST /identity/v3/users => generated 286 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:48.844144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df30cf4-4268-43b4-8eb1-f0c8b927b159 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:48.844450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df30cf4-4268-43b4-8eb1-f0c8b927b159 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:48.844736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df30cf4-4268-43b4-8eb1-f0c8b927b159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:48.857280 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:48.886906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8df30cf4-4268-43b4-8eb1-f0c8b927b159 None None] MFA Rules not processed for user `dd779757eddc4ee49e1875f205fbd11e`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:48.888862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8df30cf4-4268-43b4-8eb1-f0c8b927b159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:49.009781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8326ff-0cb8-492e-b04b-8f18b4d5a128 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:49.024345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c9322-8f26-475f-b989-ec17db6930f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:49.027284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c9322-8f26-475f-b989-ec17db6930f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:49.027737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c9322-8f26-475f-b989-ec17db6930f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:49.029259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c9322-8f26-475f-b989-ec17db6930f4 admin admin] PATH_INFO: `/v3/projects/52b7992a0c9e4986865c25207f8fc71b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:49.030967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c9322-8f26-475f-b989-ec17db6930f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b7992a0c9e4986865c25207f8fc71b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:49.033209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c9322-8f26-475f-b989-ec17db6930f4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:49.059065 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3155/6255] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:48 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:49.061896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df30cf4-4268-43b4-8eb1-f0c8b927b159 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:49.074916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df30cf4-4268-43b4-8eb1-f0c8b927b159 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:49.082268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84877a9-7985-4ae5-9677-432c1a2043fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:49.085498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84877a9-7985-4ae5-9677-432c1a2043fb admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:49.085498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84877a9-7985-4ae5-9677-432c1a2043fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:49.085498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84877a9-7985-4ae5-9677-432c1a2043fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:49.085498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84877a9-7985-4ae5-9677-432c1a2043fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:49.087352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84877a9-7985-4ae5-9677-432c1a2043fb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:49.113806 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:49.125838 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3156/6256] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:49.125838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84877a9-7985-4ae5-9677-432c1a2043fb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:49.127179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a84877a9-7985-4ae5-9677-432c1a2043fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:49.148920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84877a9-7985-4ae5-9677-432c1a2043fb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:49.158150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca6490-8827-4d1e-8937-3f3d0abd13d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:49.159529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca6490-8827-4d1e-8937-3f3d0abd13d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:49.159903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca6490-8827-4d1e-8937-3f3d0abd13d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:49.160272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca6490-8827-4d1e-8937-3f3d0abd13d2 admin admin] PATH_INFO: `/v3/projects/50207f4efe1b4a32bd53f7814788096f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:49.161524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca6490-8827-4d1e-8937-3f3d0abd13d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50207f4efe1b4a32bd53f7814788096f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:49.163620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ca6490-8827-4d1e-8937-3f3d0abd13d2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:49.232048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eb0c9322-8f26-475f-b989-ec17db6930f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b7992a0c9e4986865c25207f8fc71b', 'request_id': 'req-eb0c9322-8f26-475f-b989-ec17db6930f4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:49.322385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eb0c9322-8f26-475f-b989-ec17db6930f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b7992a0c9e4986865c25207f8fc71b', 'request_id': 'req-eb0c9322-8f26-475f-b989-ec17db6930f4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:49.336082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eb0c9322-8f26-475f-b989-ec17db6930f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b7992a0c9e4986865c25207f8fc71b', 'request_id': 'req-eb0c9322-8f26-475f-b989-ec17db6930f4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:49.352684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eb0c9322-8f26-475f-b989-ec17db6930f4 admin admin] The token cache is being invalidate because project 52b7992a0c9e4986865c25207f8fc71b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:49.353001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eb0c9322-8f26-475f-b989-ec17db6930f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:49.353672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eb0c9322-8f26-475f-b989-ec17db6930f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:49.356294 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3101/6257] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:48 2022] DELETE /identity/v3/projects/52b7992a0c9e4986865c25207f8fc71b => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:49.357382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c9322-8f26-475f-b989-ec17db6930f4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:49.359551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eb0c9322-8f26-475f-b989-ec17db6930f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:49.359955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-26ca6490-8827-4d1e-8937-3f3d0abd13d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50207f4efe1b4a32bd53f7814788096f', 'request_id': 'req-26ca6490-8827-4d1e-8937-3f3d0abd13d2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:49.381966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-26ca6490-8827-4d1e-8937-3f3d0abd13d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50207f4efe1b4a32bd53f7814788096f', 'request_id': 'req-26ca6490-8827-4d1e-8937-3f3d0abd13d2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:49.469625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c9322-8f26-475f-b989-ec17db6930f4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:49.539721 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:49.543983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-26ca6490-8827-4d1e-8937-3f3d0abd13d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50207f4efe1b4a32bd53f7814788096f', 'request_id': 'req-26ca6490-8827-4d1e-8937-3f3d0abd13d2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:49.554542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d84d59-d8af-495d-9563-f7e5302035f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:49.555240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d84d59-d8af-495d-9563-f7e5302035f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:49.555538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d84d59-d8af-495d-9563-f7e5302035f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:49.555825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d84d59-d8af-495d-9563-f7e5302035f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:49.556542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d84d59-d8af-495d-9563-f7e5302035f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:49.558565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d84d59-d8af-495d-9563-f7e5302035f7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:49.658596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-26ca6490-8827-4d1e-8937-3f3d0abd13d2 admin admin] The token cache is being invalidate because project 50207f4efe1b4a32bd53f7814788096f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:49.659134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-26ca6490-8827-4d1e-8937-3f3d0abd13d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:49.660067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-26ca6490-8827-4d1e-8937-3f3d0abd13d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:49.662968 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3157/6258] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:49 2022] DELETE /identity/v3/projects/50207f4efe1b4a32bd53f7814788096f => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:49.663811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca6490-8827-4d1e-8937-3f3d0abd13d2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:49.665199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-26ca6490-8827-4d1e-8937-3f3d0abd13d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:49.681409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca6490-8827-4d1e-8937-3f3d0abd13d2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:49.689033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c0ef8-967c-457d-b218-779253b7f5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:49.689996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c0ef8-967c-457d-b218-779253b7f5aa admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:49.691172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c0ef8-967c-457d-b218-779253b7f5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:49.691633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c0ef8-967c-457d-b218-779253b7f5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:49.692387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c0ef8-967c-457d-b218-779253b7f5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:49.707161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c0ef8-967c-457d-b218-779253b7f5aa admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:49.711528 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3102/6259] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:49 2022] POST /identity/v3/projects => generated 369 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:49.711961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d84d59-d8af-495d-9563-f7e5302035f7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:49.715571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f2d84d59-d8af-495d-9563-f7e5302035f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:49.752140 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3158/6260] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:49.758295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c0ef8-967c-457d-b218-779253b7f5aa admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:49.771031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5b4c0ef8-967c-457d-b218-779253b7f5aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:49.802822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c0ef8-967c-457d-b218-779253b7f5aa admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:49.842026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d84d59-d8af-495d-9563-f7e5302035f7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:49.858054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d32ca-8898-4dbc-a574-1d2027be0be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:49.859106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d32ca-8898-4dbc-a574-1d2027be0be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:49.859399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d32ca-8898-4dbc-a574-1d2027be0be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:49.859681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d32ca-8898-4dbc-a574-1d2027be0be6 admin admin] PATH_INFO: `/v3/users/9918398cd3914ee8879faada3b402531` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:49.862902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d32ca-8898-4dbc-a574-1d2027be0be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9918398cd3914ee8879faada3b402531)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:49.865036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d32ca-8898-4dbc-a574-1d2027be0be6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:49.912616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30915b9-4054-42f1-a762-27d171218f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:49.913849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30915b9-4054-42f1-a762-27d171218f09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:49.914397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30915b9-4054-42f1-a762-27d171218f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:49.914735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30915b9-4054-42f1-a762-27d171218f09 admin admin] PATH_INFO: `/v3/users/bd04045878094564804ca43cd89a224f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:49.916358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30915b9-4054-42f1-a762-27d171218f09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd04045878094564804ca43cd89a224f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:49.922669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30915b9-4054-42f1-a762-27d171218f09 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:50.160653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-050d32ca-8898-4dbc-a574-1d2027be0be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9918398cd3914ee8879faada3b402531'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:50.209376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-050d32ca-8898-4dbc-a574-1d2027be0be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9918398cd3914ee8879faada3b402531'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:50.210504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-050d32ca-8898-4dbc-a574-1d2027be0be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9918398cd3914ee8879faada3b402531'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:50.211604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-050d32ca-8898-4dbc-a574-1d2027be0be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9918398cd3914ee8879faada3b402531'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:50.227731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-050d32ca-8898-4dbc-a574-1d2027be0be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9918398cd3914ee8879faada3b402531'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:50.292741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a30915b9-4054-42f1-a762-27d171218f09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd04045878094564804ca43cd89a224f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:50.325009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a30915b9-4054-42f1-a762-27d171218f09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd04045878094564804ca43cd89a224f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:50.341174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a30915b9-4054-42f1-a762-27d171218f09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd04045878094564804ca43cd89a224f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:50.342063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a30915b9-4054-42f1-a762-27d171218f09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd04045878094564804ca43cd89a224f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:50.360747 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:50.367223 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3103/6261] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:49 2022] DELETE /identity/v3/users/9918398cd3914ee8879faada3b402531 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:50.369129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d32ca-8898-4dbc-a574-1d2027be0be6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:50.370658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-050d32ca-8898-4dbc-a574-1d2027be0be6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:50.442703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d32ca-8898-4dbc-a574-1d2027be0be6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:50.447836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d96d0b-1298-4afb-bfe7-530bd39bf94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:50.448526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d96d0b-1298-4afb-bfe7-530bd39bf94e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:50.448820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d96d0b-1298-4afb-bfe7-530bd39bf94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:50.449104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d96d0b-1298-4afb-bfe7-530bd39bf94e admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:50.449805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d96d0b-1298-4afb-bfe7-530bd39bf94e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:50.451914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d96d0b-1298-4afb-bfe7-530bd39bf94e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:50.466886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a30915b9-4054-42f1-a762-27d171218f09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd04045878094564804ca43cd89a224f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:50.478003 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3159/6262] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:49 2022] DELETE /identity/v3/users/bd04045878094564804ca43cd89a224f => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:50.478851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30915b9-4054-42f1-a762-27d171218f09 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:50.487509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a30915b9-4054-42f1-a762-27d171218f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:50.567162 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3104/6263] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:50 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:50.568176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d96d0b-1298-4afb-bfe7-530bd39bf94e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:50.571526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-10d96d0b-1298-4afb-bfe7-530bd39bf94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:50.594309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d96d0b-1298-4afb-bfe7-530bd39bf94e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:50.646381 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:50.662021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30915b9-4054-42f1-a762-27d171218f09 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:50.694817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9c1d6-1866-4c21-b3bb-dd05c414fc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:50.695621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9c1d6-1866-4c21-b3bb-dd05c414fc16 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:50.696061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9c1d6-1866-4c21-b3bb-dd05c414fc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:50.696768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9c1d6-1866-4c21-b3bb-dd05c414fc16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:50.700707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09caae9c-097a-4c99-8db0-237677f12e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:50.707573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09caae9c-097a-4c99-8db0-237677f12e80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:50.707573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09caae9c-097a-4c99-8db0-237677f12e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:50.707956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9c1d6-1866-4c21-b3bb-dd05c414fc16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:50.708147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09caae9c-097a-4c99-8db0-237677f12e80 admin admin] PATH_INFO: `/v3/projects/022a1ddabee04e10bf3f601ac491b048/users/dc80f46640f74bd5bb04be3104567ea6/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:50.709564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9c1d6-1866-4c21-b3bb-dd05c414fc16 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:50.729709 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3105/6264] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:40:50.735071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9c1d6-1866-4c21-b3bb-dd05c414fc16 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:50.754154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09caae9c-097a-4c99-8db0-237677f12e80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=022a1ddabee04e10bf3f601ac491b048, user_id=dc80f46640f74bd5bb04be3104567ea6, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:50.756822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9c1d6-1866-4c21-b3bb-dd05c414fc16 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:50.757364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09caae9c-097a-4c99-8db0-237677f12e80 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:50.764628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47b45d-4b25-467b-bf93-f4c2bd8958ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:50.765868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47b45d-4b25-467b-bf93-f4c2bd8958ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:50.766330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47b45d-4b25-467b-bf93-f4c2bd8958ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:50.766775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be47b45d-4b25-467b-bf93-f4c2bd8958ad admin admin] PATH_INFO: `/v3/projects/84d77f1a646c48d8a62b47f39611d7b2/users/86c111f5265f45ad9fb81cc1423f1f9d/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:50.806917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47b45d-4b25-467b-bf93-f4c2bd8958ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=84d77f1a646c48d8a62b47f39611d7b2, user_id=86c111f5265f45ad9fb81cc1423f1f9d, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:50.809664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be47b45d-4b25-467b-bf93-f4c2bd8958ad admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:50.905831 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3160/6265] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:50 2022] PUT /identity/v3/projects/022a1ddabee04e10bf3f601ac491b048/users/dc80f46640f74bd5bb04be3104567ea6/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:50.917557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47340fd-3698-4db8-bacc-958cc6f5157a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:50.920902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47340fd-3698-4db8-bacc-958cc6f5157a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:50.920902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47340fd-3698-4db8-bacc-958cc6f5157a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:50.948201 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3106/6266] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:50 2022] PUT /identity/v3/projects/84d77f1a646c48d8a62b47f39611d7b2/users/86c111f5265f45ad9fb81cc1423f1f9d/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:50.955087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47b45d-4b25-467b-bf93-f4c2bd8958ad admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:50.992106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a47340fd-3698-4db8-bacc-958cc6f5157a None None] MFA Rules not processed for user `dc80f46640f74bd5bb04be3104567ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:50.994136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a47340fd-3698-4db8-bacc-958cc6f5157a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:51.126147 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3161/6267] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:40:51.159062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47340fd-3698-4db8-bacc-958cc6f5157a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:51.161606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a47340fd-3698-4db8-bacc-958cc6f5157a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:51.162316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be47b45d-4b25-467b-bf93-f4c2bd8958ad admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:51.169308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98456f9-bf69-4b2d-990d-7a20aa39f9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:51.169308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98456f9-bf69-4b2d-990d-7a20aa39f9c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:51.174079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98456f9-bf69-4b2d-990d-7a20aa39f9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:51.175825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98456f9-bf69-4b2d-990d-7a20aa39f9c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:51.177057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98456f9-bf69-4b2d-990d-7a20aa39f9c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:51.183245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98456f9-bf69-4b2d-990d-7a20aa39f9c1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:51.208811 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3107/6268] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:50 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:51.210126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98456f9-bf69-4b2d-990d-7a20aa39f9c1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:51.213278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f98456f9-bf69-4b2d-990d-7a20aa39f9c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:51.249237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98456f9-bf69-4b2d-990d-7a20aa39f9c1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:51.256045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829edbff-acff-48a5-a3bb-7a9d91d1dfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:51.257252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829edbff-acff-48a5-a3bb-7a9d91d1dfc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:51.258003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829edbff-acff-48a5-a3bb-7a9d91d1dfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:51.258470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829edbff-acff-48a5-a3bb-7a9d91d1dfc2 admin admin] PATH_INFO: `/v3/projects/9c581e11d0df470d9f651b2a4475b1c8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:51.260198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829edbff-acff-48a5-a3bb-7a9d91d1dfc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c581e11d0df470d9f651b2a4475b1c8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:51.262664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829edbff-acff-48a5-a3bb-7a9d91d1dfc2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:51.383086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47340fd-3698-4db8-bacc-958cc6f5157a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:51.389724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a2941-d9e9-4107-bcff-23e7f54ef266 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:51.390508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a2941-d9e9-4107-bcff-23e7f54ef266 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:51.391850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a2941-d9e9-4107-bcff-23e7f54ef266 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:51.394524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972a2941-d9e9-4107-bcff-23e7f54ef266 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:51.423498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a2941-d9e9-4107-bcff-23e7f54ef266 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:51.425616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972a2941-d9e9-4107-bcff-23e7f54ef266 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:51.453951 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3162/6269] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:40:51.454968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a2941-d9e9-4107-bcff-23e7f54ef266 service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:51.467607 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:51.472275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-829edbff-acff-48a5-a3bb-7a9d91d1dfc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c581e11d0df470d9f651b2a4475b1c8', 'request_id': 'req-829edbff-acff-48a5-a3bb-7a9d91d1dfc2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:51.491212 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:51.496274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972a2941-d9e9-4107-bcff-23e7f54ef266 service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:51.574643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-829edbff-acff-48a5-a3bb-7a9d91d1dfc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c581e11d0df470d9f651b2a4475b1c8', 'request_id': 'req-829edbff-acff-48a5-a3bb-7a9d91d1dfc2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:51.586418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-829edbff-acff-48a5-a3bb-7a9d91d1dfc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c581e11d0df470d9f651b2a4475b1c8', 'request_id': 'req-829edbff-acff-48a5-a3bb-7a9d91d1dfc2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:51.591542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c42637-7612-4691-97eb-3502a5881657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:51.592515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c42637-7612-4691-97eb-3502a5881657 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:51.592798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c42637-7612-4691-97eb-3502a5881657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:51.593434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c42637-7612-4691-97eb-3502a5881657 admin admin] PATH_INFO: `/v3/projects/84d77f1a646c48d8a62b47f39611d7b2/users/86c111f5265f45ad9fb81cc1423f1f9d/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:51.606489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c42637-7612-4691-97eb-3502a5881657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84d77f1a646c48d8a62b47f39611d7b2, user_id=86c111f5265f45ad9fb81cc1423f1f9d, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:51.613629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c42637-7612-4691-97eb-3502a5881657 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:51.614341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-829edbff-acff-48a5-a3bb-7a9d91d1dfc2 admin admin] The token cache is being invalidate because project 9c581e11d0df470d9f651b2a4475b1c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:51.614647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-829edbff-acff-48a5-a3bb-7a9d91d1dfc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:51.615484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-829edbff-acff-48a5-a3bb-7a9d91d1dfc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:51.617537 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3108/6270] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:51 2022] DELETE /identity/v3/projects/9c581e11d0df470d9f651b2a4475b1c8 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:51.618443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829edbff-acff-48a5-a3bb-7a9d91d1dfc2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:51.625046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-829edbff-acff-48a5-a3bb-7a9d91d1dfc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:51.657570 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3163/6271] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:51 2022] PUT /identity/v3/projects/84d77f1a646c48d8a62b47f39611d7b2/users/86c111f5265f45ad9fb81cc1423f1f9d/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:51.659693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c42637-7612-4691-97eb-3502a5881657 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:51.662123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-90c42637-7612-4691-97eb-3502a5881657 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:51.671748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829edbff-acff-48a5-a3bb-7a9d91d1dfc2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:51.783632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c42637-7612-4691-97eb-3502a5881657 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:51.790122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4eff50-22c3-46a8-97ca-011dc7cefa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:51.792037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4eff50-22c3-46a8-97ca-011dc7cefa07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:51.792544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4eff50-22c3-46a8-97ca-011dc7cefa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:51.793583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4eff50-22c3-46a8-97ca-011dc7cefa07 admin admin] PATH_INFO: `/v3/users/dc80f46640f74bd5bb04be3104567ea6` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:51.795469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4eff50-22c3-46a8-97ca-011dc7cefa07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc80f46640f74bd5bb04be3104567ea6)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:51.800975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4eff50-22c3-46a8-97ca-011dc7cefa07 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:51.806944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e06a1-32f9-4c7e-819e-e4ebed1def55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:51.807929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e06a1-32f9-4c7e-819e-e4ebed1def55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:51.809014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e06a1-32f9-4c7e-819e-e4ebed1def55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:51.809317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e06a1-32f9-4c7e-819e-e4ebed1def55 admin admin] PATH_INFO: `/v3/projects/8841f70c2d8a4b7dbf04b3512320eb8f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:51.811880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e06a1-32f9-4c7e-819e-e4ebed1def55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8841f70c2d8a4b7dbf04b3512320eb8f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:51.816660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e06a1-32f9-4c7e-819e-e4ebed1def55 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:52.019372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-380e06a1-32f9-4c7e-819e-e4ebed1def55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8841f70c2d8a4b7dbf04b3512320eb8f', 'request_id': 'req-380e06a1-32f9-4c7e-819e-e4ebed1def55'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:52.021354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3b4eff50-22c3-46a8-97ca-011dc7cefa07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc80f46640f74bd5bb04be3104567ea6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:52.041903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3b4eff50-22c3-46a8-97ca-011dc7cefa07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc80f46640f74bd5bb04be3104567ea6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:52.045773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3b4eff50-22c3-46a8-97ca-011dc7cefa07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc80f46640f74bd5bb04be3104567ea6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:52.046770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3b4eff50-22c3-46a8-97ca-011dc7cefa07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc80f46640f74bd5bb04be3104567ea6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:52.115587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-380e06a1-32f9-4c7e-819e-e4ebed1def55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8841f70c2d8a4b7dbf04b3512320eb8f', 'request_id': 'req-380e06a1-32f9-4c7e-819e-e4ebed1def55'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:52.123935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-380e06a1-32f9-4c7e-819e-e4ebed1def55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8841f70c2d8a4b7dbf04b3512320eb8f', 'request_id': 'req-380e06a1-32f9-4c7e-819e-e4ebed1def55'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:52.141355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-380e06a1-32f9-4c7e-819e-e4ebed1def55 admin admin] The token cache is being invalidate because project 8841f70c2d8a4b7dbf04b3512320eb8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:52.141653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-380e06a1-32f9-4c7e-819e-e4ebed1def55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:52.142365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-380e06a1-32f9-4c7e-819e-e4ebed1def55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:52.147777 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3109/6272] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:51 2022] DELETE /identity/v3/projects/8841f70c2d8a4b7dbf04b3512320eb8f => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:52.147777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56abc0-6599-4b32-a719-fd8ace26b47b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:52.147777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56abc0-6599-4b32-a719-fd8ace26b47b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:52.147777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56abc0-6599-4b32-a719-fd8ace26b47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:52.169149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7b56abc0-6599-4b32-a719-fd8ace26b47b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:52.170529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7b56abc0-6599-4b32-a719-fd8ace26b47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:52.214955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3b4eff50-22c3-46a8-97ca-011dc7cefa07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc80f46640f74bd5bb04be3104567ea6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:52.228792 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3164/6273] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:51 2022] DELETE /identity/v3/users/dc80f46640f74bd5bb04be3104567ea6 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:52.230567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13a769-25cb-4a7f-b766-03651231fb3c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:52.231226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13a769-25cb-4a7f-b766-03651231fb3c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:52.232333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13a769-25cb-4a7f-b766-03651231fb3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:52.239940 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3110/6274] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:52.246346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a0fe1-980c-4257-91b4-394d700d29b4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:52.246346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a0fe1-980c-4257-91b4-394d700d29b4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:52.246346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50a0fe1-980c-4257-91b4-394d700d29b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:52.251598 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:52.274605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b50a0fe1-980c-4257-91b4-394d700d29b4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:52.276222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b50a0fe1-980c-4257-91b4-394d700d29b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:52.288214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3b13a769-25cb-4a7f-b766-03651231fb3c None None] MFA Rules not processed for user `86c111f5265f45ad9fb81cc1423f1f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:52.293241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3b13a769-25cb-4a7f-b766-03651231fb3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:52.295822 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:52.376345 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3111/6275] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:52.379853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985030f5-240f-4d80-8239-407a70171063 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:52.380270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985030f5-240f-4d80-8239-407a70171063 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:52.380616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985030f5-240f-4d80-8239-407a70171063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:52.408467 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3165/6276] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:52 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:52.410392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f657e70-aebb-4814-8695-30650788d180 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:52.410627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f657e70-aebb-4814-8695-30650788d180 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:52.410907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f657e70-aebb-4814-8695-30650788d180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:52.411801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-985030f5-240f-4d80-8239-407a70171063 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:52.413120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-985030f5-240f-4d80-8239-407a70171063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:52.422652 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3112/6277] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:52.425245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82b22e-a021-4770-b2e2-a44498254d20 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:52.425245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82b22e-a021-4770-b2e2-a44498254d20 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:52.425245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82b22e-a021-4770-b2e2-a44498254d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:52.445292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8f657e70-aebb-4814-8695-30650788d180 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:52.458554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8f657e70-aebb-4814-8695-30650788d180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:52.459404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0b82b22e-a021-4770-b2e2-a44498254d20 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:52.459404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0b82b22e-a021-4770-b2e2-a44498254d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:52.459670 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3166/6278] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:52.460155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f657e70-aebb-4814-8695-30650788d180 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:52.463255 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3113/6279] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:52.464312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82b22e-a021-4770-b2e2-a44498254d20 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:52.465711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0b82b22e-a021-4770-b2e2-a44498254d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:52.498840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f657e70-aebb-4814-8695-30650788d180 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:52.505078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0366bc-a538-4206-ae10-a5cb740510e5 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:52.507487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0366bc-a538-4206-ae10-a5cb740510e5 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:52.507778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0366bc-a538-4206-ae10-a5cb740510e5 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:52.508063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0366bc-a538-4206-ae10-a5cb740510e5 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:52.508772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0366bc-a538-4206-ae10-a5cb740510e5 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:52.510733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0366bc-a538-4206-ae10-a5cb740510e5 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:52.554454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82b22e-a021-4770-b2e2-a44498254d20 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:52.561200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034e562-1a92-4d66-be94-a1c690c4ea6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:52.561896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034e562-1a92-4d66-be94-a1c690c4ea6b service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:52.562219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034e562-1a92-4d66-be94-a1c690c4ea6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:52.562505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034e562-1a92-4d66-be94-a1c690c4ea6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:52.573016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034e562-1a92-4d66-be94-a1c690c4ea6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:52.575348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034e562-1a92-4d66-be94-a1c690c4ea6b service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:52.585862 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3114/6280] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:40:52.586847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034e562-1a92-4d66-be94-a1c690c4ea6b service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:52.599420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034e562-1a92-4d66-be94-a1c690c4ea6b service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:52.604067 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3167/6281] 10.222.0.43 () {60 vars in 1151 bytes} [Tue Jul 19 14:40:52 2022] POST /identity/v3/projects => generated 329 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:52.605036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0366bc-a538-4206-ae10-a5cb740510e5 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:52.607959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5918e-162b-44a4-ae68-6200a0a6d59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:52.609325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5918e-162b-44a4-ae68-6200a0a6d59b admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:52.609822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5918e-162b-44a4-ae68-6200a0a6d59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:52.610356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c5918e-162b-44a4-ae68-6200a0a6d59b admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:52.611358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5918e-162b-44a4-ae68-6200a0a6d59b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:52.612415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5918e-162b-44a4-ae68-6200a0a6d59b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:52.614609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c5918e-162b-44a4-ae68-6200a0a6d59b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:52.639341 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3115/6282] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:52.639341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5918e-162b-44a4-ae68-6200a0a6d59b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:52.659327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c5918e-162b-44a4-ae68-6200a0a6d59b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:52.772976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0366bc-a538-4206-ae10-a5cb740510e5 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:52.775829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54784b-11b5-4c48-9842-13d21c05a256 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:52.776928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54784b-11b5-4c48-9842-13d21c05a256 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:52.777336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54784b-11b5-4c48-9842-13d21c05a256 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:52.777697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54784b-11b5-4c48-9842-13d21c05a256 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:52.780650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54784b-11b5-4c48-9842-13d21c05a256 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:52.780790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7570d67-b9b5-4f77-84e1-9cd2399552d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:52.780969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54784b-11b5-4c48-9842-13d21c05a256 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:52.781138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7570d67-b9b5-4f77-84e1-9cd2399552d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:52.781429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7570d67-b9b5-4f77-84e1-9cd2399552d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:52.782027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7570d67-b9b5-4f77-84e1-9cd2399552d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:52.782931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7570d67-b9b5-4f77-84e1-9cd2399552d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:52.783244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7570d67-b9b5-4f77-84e1-9cd2399552d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:52.785249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7570d67-b9b5-4f77-84e1-9cd2399552d1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:52.814624 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3168/6283] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:40:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:52.821767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7570d67-b9b5-4f77-84e1-9cd2399552d1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:52.836312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7570d67-b9b5-4f77-84e1-9cd2399552d1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:52.841491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21c1d3-829c-45f6-9975-199aee1ce306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:52.842191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21c1d3-829c-45f6-9975-199aee1ce306 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:52.842482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21c1d3-829c-45f6-9975-199aee1ce306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:52.842760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21c1d3-829c-45f6-9975-199aee1ce306 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:52.843547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21c1d3-829c-45f6-9975-199aee1ce306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:52.845427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21c1d3-829c-45f6-9975-199aee1ce306 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:52.923582 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3116/6284] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:52 2022] POST /identity/v3/users => generated 413 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:52.923582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54784b-11b5-4c48-9842-13d21c05a256 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:52.936804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54784b-11b5-4c48-9842-13d21c05a256 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:52.943570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052514a9-15bb-4f51-99a9-02bd8e8ddf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:52.944589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052514a9-15bb-4f51-99a9-02bd8e8ddf0d admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:52.944883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052514a9-15bb-4f51-99a9-02bd8e8ddf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:52.945184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052514a9-15bb-4f51-99a9-02bd8e8ddf0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:52.947332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052514a9-15bb-4f51-99a9-02bd8e8ddf0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:52.950300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052514a9-15bb-4f51-99a9-02bd8e8ddf0d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:52.951756 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3169/6285] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:52 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:52.952772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21c1d3-829c-45f6-9975-199aee1ce306 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:52.960428 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:53.041030 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:53.064169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21c1d3-829c-45f6-9975-199aee1ce306 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:53.070843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92272e-b32a-4a1c-b57d-d61c0c0d1c1e tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:53.072321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92272e-b32a-4a1c-b57d-d61c0c0d1c1e tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:53.072883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92272e-b32a-4a1c-b57d-d61c0c0d1c1e tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:53.073337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92272e-b32a-4a1c-b57d-d61c0c0d1c1e tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:53.075112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92272e-b32a-4a1c-b57d-d61c0c0d1c1e tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:53.077177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f92272e-b32a-4a1c-b57d-d61c0c0d1c1e tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:53.127338 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3117/6286] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:52 2022] POST /identity/v3/projects => generated 367 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:53.129063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052514a9-15bb-4f51-99a9-02bd8e8ddf0d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:53.162375 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3170/6287] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:40:52 2022] POST /identity/v3/roles => generated 244 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:53.162375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92272e-b32a-4a1c-b57d-d61c0c0d1c1e tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:53.264474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052514a9-15bb-4f51-99a9-02bd8e8ddf0d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:53.275756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92272e-b32a-4a1c-b57d-d61c0c0d1c1e tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:53.291384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac9a1d-3fe1-4cfc-8c47-7c2bad9be858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:53.291384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac9a1d-3fe1-4cfc-8c47-7c2bad9be858 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:53.291384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac9a1d-3fe1-4cfc-8c47-7c2bad9be858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:53.291384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac9a1d-3fe1-4cfc-8c47-7c2bad9be858 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:53.291914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac9a1d-3fe1-4cfc-8c47-7c2bad9be858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:53.295044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac9a1d-3fe1-4cfc-8c47-7c2bad9be858 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:53.299161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba07115-9838-472e-bfb6-68033479cbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:53.301110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba07115-9838-472e-bfb6-68033479cbf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:53.301501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba07115-9838-472e-bfb6-68033479cbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:53.301788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba07115-9838-472e-bfb6-68033479cbf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:53.302525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba07115-9838-472e-bfb6-68033479cbf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:53.305489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba07115-9838-472e-bfb6-68033479cbf9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:53.421910 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3171/6288] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:53 2022] POST /identity/v3/users => generated 284 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:53.421910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac9a1d-3fe1-4cfc-8c47-7c2bad9be858 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:53.423399 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3118/6289] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:53 2022] POST /identity/v3/users => generated 292 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:53.426581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba07115-9838-472e-bfb6-68033479cbf9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:53.436196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4ba07115-9838-472e-bfb6-68033479cbf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:53.457578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba07115-9838-472e-bfb6-68033479cbf9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:53.463119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1c9c6-2b88-4879-8da3-03fe2ae8b353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:53.464056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1c9c6-2b88-4879-8da3-03fe2ae8b353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:53.464493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1c9c6-2b88-4879-8da3-03fe2ae8b353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:53.464794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1c9c6-2b88-4879-8da3-03fe2ae8b353 admin admin] PATH_INFO: `/v3/projects/022a1ddabee04e10bf3f601ac491b048` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:53.466075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1c9c6-2b88-4879-8da3-03fe2ae8b353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=022a1ddabee04e10bf3f601ac491b048)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:53.468133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd1c9c6-2b88-4879-8da3-03fe2ae8b353 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:53.556083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac9a1d-3fe1-4cfc-8c47-7c2bad9be858 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:53.563766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f09d06-ca58-4784-9fbd-97c18ec3e278 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:53.565034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f09d06-ca58-4784-9fbd-97c18ec3e278 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:53.565520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f09d06-ca58-4784-9fbd-97c18ec3e278 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:53.566384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f09d06-ca58-4784-9fbd-97c18ec3e278 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:53.567454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f09d06-ca58-4784-9fbd-97c18ec3e278 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:53.569312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f09d06-ca58-4784-9fbd-97c18ec3e278 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:53.631876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bbd1c9c6-2b88-4879-8da3-03fe2ae8b353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '022a1ddabee04e10bf3f601ac491b048', 'request_id': 'req-bbd1c9c6-2b88-4879-8da3-03fe2ae8b353'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:53.706811 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3172/6290] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:40:53 2022] POST /identity/v3/roles => generated 246 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:53.709715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f09d06-ca58-4784-9fbd-97c18ec3e278 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:53.713453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bbd1c9c6-2b88-4879-8da3-03fe2ae8b353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '022a1ddabee04e10bf3f601ac491b048', 'request_id': 'req-bbd1c9c6-2b88-4879-8da3-03fe2ae8b353'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:53.723058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bbd1c9c6-2b88-4879-8da3-03fe2ae8b353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '022a1ddabee04e10bf3f601ac491b048', 'request_id': 'req-bbd1c9c6-2b88-4879-8da3-03fe2ae8b353'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:53.732268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f09d06-ca58-4784-9fbd-97c18ec3e278 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:53.751338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bbd1c9c6-2b88-4879-8da3-03fe2ae8b353 admin admin] The token cache is being invalidate because project 022a1ddabee04e10bf3f601ac491b048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:53.751992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bbd1c9c6-2b88-4879-8da3-03fe2ae8b353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:53.754824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bbd1c9c6-2b88-4879-8da3-03fe2ae8b353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:53.759122 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3119/6291] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:53 2022] DELETE /identity/v3/projects/022a1ddabee04e10bf3f601ac491b048 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:53.764785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1c9c6-2b88-4879-8da3-03fe2ae8b353 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:53.771752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bbd1c9c6-2b88-4879-8da3-03fe2ae8b353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:53.846888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047ddd8-cff0-42ac-a02d-a49fc3d2262c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:53.848440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047ddd8-cff0-42ac-a02d-a49fc3d2262c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:53.848883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047ddd8-cff0-42ac-a02d-a49fc3d2262c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:53.849378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f047ddd8-cff0-42ac-a02d-a49fc3d2262c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:53.850947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047ddd8-cff0-42ac-a02d-a49fc3d2262c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:53.852949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f047ddd8-cff0-42ac-a02d-a49fc3d2262c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:53.861068 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:53.877637 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3173/6292] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:53 2022] GET /identity/v3/roles => generated 1892 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:53.879111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047ddd8-cff0-42ac-a02d-a49fc3d2262c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:53.882192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f047ddd8-cff0-42ac-a02d-a49fc3d2262c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:53.901141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1c9c6-2b88-4879-8da3-03fe2ae8b353 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:53.902092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc9055-c8ec-49df-89a1-9bfd7ed78f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:53.903046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc9055-c8ec-49df-89a1-9bfd7ed78f37 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:53.903364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc9055-c8ec-49df-89a1-9bfd7ed78f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:53.903717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc9055-c8ec-49df-89a1-9bfd7ed78f37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:53.905610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc9055-c8ec-49df-89a1-9bfd7ed78f37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:53.907456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc9055-c8ec-49df-89a1-9bfd7ed78f37 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:53.912019 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:53.928780 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3120/6293] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:53 2022] GET /identity/v3/roles => generated 1892 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:53.933631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc234ed6-d4d8-4279-a04b-95a9e7d4d026 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:53.933867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc234ed6-d4d8-4279-a04b-95a9e7d4d026 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:53.934169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc234ed6-d4d8-4279-a04b-95a9e7d4d026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:53.959255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-fc234ed6-d4d8-4279-a04b-95a9e7d4d026 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:53.960452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fc234ed6-d4d8-4279-a04b-95a9e7d4d026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:53.969816 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3121/6294] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:53.970833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc234ed6-d4d8-4279-a04b-95a9e7d4d026 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:53.973150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fc234ed6-d4d8-4279-a04b-95a9e7d4d026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:53.986734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc234ed6-d4d8-4279-a04b-95a9e7d4d026 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:53.992691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7409e0e-16f4-4ca9-90a3-f84bea1f242b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:53.993401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7409e0e-16f4-4ca9-90a3-f84bea1f242b admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:53.993727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7409e0e-16f4-4ca9-90a3-f84bea1f242b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:53.994009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7409e0e-16f4-4ca9-90a3-f84bea1f242b admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:53.998582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7409e0e-16f4-4ca9-90a3-f84bea1f242b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:53.998582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7409e0e-16f4-4ca9-90a3-f84bea1f242b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:54.012822 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3122/6295] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:53 2022] GET /identity/v3/roles => generated 1892 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:54.013807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7409e0e-16f4-4ca9-90a3-f84bea1f242b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:54.034651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7409e0e-16f4-4ca9-90a3-f84bea1f242b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:54.035097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f047ddd8-cff0-42ac-a02d-a49fc3d2262c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:54.040765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7fe69-89fb-4d2d-a76f-0e1f193c41ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:54.042583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7fe69-89fb-4d2d-a76f-0e1f193c41ae admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:54.044135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7fe69-89fb-4d2d-a76f-0e1f193c41ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:54.044995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7fe69-89fb-4d2d-a76f-0e1f193c41ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:54.045960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7fe69-89fb-4d2d-a76f-0e1f193c41ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:54.051049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7fe69-89fb-4d2d-a76f-0e1f193c41ae admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:54.062790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f61389-5371-4bbe-ba80-e1b55ee8cce8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:54.063408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f61389-5371-4bbe-ba80-e1b55ee8cce8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:54.063702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f61389-5371-4bbe-ba80-e1b55ee8cce8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:54.063987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f61389-5371-4bbe-ba80-e1b55ee8cce8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects/584cd26d92114fae975bda06d455b116/users/9dca4c6263014850b342e537e036a085/roles/4db3fcb4e69d49188dbfa4d3ad6d63e9` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:54.090406 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3123/6296] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:54 2022] GET /identity/v3/roles => generated 1892 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:54.095897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f61389-5371-4bbe-ba80-e1b55ee8cce8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_grant(project_id=584cd26d92114fae975bda06d455b116, user_id=9dca4c6263014850b342e537e036a085, role_id=4db3fcb4e69d49188dbfa4d3ad6d63e9)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:54.099595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b1857-dbef-441a-9bb8-ff7df50f5d9f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:54.099878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b1857-dbef-441a-9bb8-ff7df50f5d9f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:54.100161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b1857-dbef-441a-9bb8-ff7df50f5d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:54.103056 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f61389-5371-4bbe-ba80-e1b55ee8cce8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:54.154338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4b1b1857-dbef-441a-9bb8-ff7df50f5d9f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:54.161697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4b1b1857-dbef-441a-9bb8-ff7df50f5d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:54.178088 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3124/6297] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:54.179369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b1857-dbef-441a-9bb8-ff7df50f5d9f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:54.189643 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3174/6298] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:53 2022] PUT /identity/v3/projects/584cd26d92114fae975bda06d455b116/users/9dca4c6263014850b342e537e036a085/roles/4db3fcb4e69d49188dbfa4d3ad6d63e9 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:54.191598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f61389-5371-4bbe-ba80-e1b55ee8cce8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:54.212039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b1857-dbef-441a-9bb8-ff7df50f5d9f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:54.326692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f61389-5371-4bbe-ba80-e1b55ee8cce8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:54.326972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72e594-fdf2-4b88-a756-4d7cd4645b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:54.327881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72e594-fdf2-4b88-a756-4d7cd4645b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:54.328174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72e594-fdf2-4b88-a756-4d7cd4645b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:54.328455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72e594-fdf2-4b88-a756-4d7cd4645b53 admin admin] PATH_INFO: `/v3/projects/d54d6ed893c14c7ebeb10f4de9e4b1a0/users/0a4a57dd620441e59d40d33bd6ee4364/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:54.333964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6354e7a-0b0e-44a4-89c4-82f95f5f926c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:54.336558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6354e7a-0b0e-44a4-89c4-82f95f5f926c admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:54.336558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6354e7a-0b0e-44a4-89c4-82f95f5f926c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:54.336558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6354e7a-0b0e-44a4-89c4-82f95f5f926c admin admin] PATH_INFO: `/v3/projects/6a1240659dbd40bc85dafb47b3da6138/users/a262c2b2552e41de9d86a8ea0b5e14d6/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:54.365901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72e594-fdf2-4b88-a756-4d7cd4645b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d54d6ed893c14c7ebeb10f4de9e4b1a0, user_id=0a4a57dd620441e59d40d33bd6ee4364, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:54.369499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6354e7a-0b0e-44a4-89c4-82f95f5f926c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a1240659dbd40bc85dafb47b3da6138, user_id=a262c2b2552e41de9d86a8ea0b5e14d6, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:54.374069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c72e594-fdf2-4b88-a756-4d7cd4645b53 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:54.378308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6354e7a-0b0e-44a4-89c4-82f95f5f926c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:54.510452 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3125/6300] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:54 2022] PUT /identity/v3/projects/d54d6ed893c14c7ebeb10f4de9e4b1a0/users/0a4a57dd620441e59d40d33bd6ee4364/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:54.510452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72e594-fdf2-4b88-a756-4d7cd4645b53 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:54.511393 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3175/6300] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:54 2022] PUT /identity/v3/projects/6a1240659dbd40bc85dafb47b3da6138/users/a262c2b2552e41de9d86a8ea0b5e14d6/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:54.512463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6354e7a-0b0e-44a4-89c4-82f95f5f926c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:54.628176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72e594-fdf2-4b88-a756-4d7cd4645b53 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:54.649239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a4074-5abb-48a1-bba8-7c6c5895668b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:54.650023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a4074-5abb-48a1-bba8-7c6c5895668b admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:54.650435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a4074-5abb-48a1-bba8-7c6c5895668b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:54.650761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a4074-5abb-48a1-bba8-7c6c5895668b admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:54.652441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a4074-5abb-48a1-bba8-7c6c5895668b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:40:54.652875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a4074-5abb-48a1-bba8-7c6c5895668b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:54.655794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a4074-5abb-48a1-bba8-7c6c5895668b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:54.659224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6354e7a-0b0e-44a4-89c4-82f95f5f926c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:54.671402 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:54.681289 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3126/6301] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:54.681289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b40f3e-691f-48d3-be07-74883d18e1b6 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:54.681289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b40f3e-691f-48d3-be07-74883d18e1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:54.681289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b40f3e-691f-48d3-be07-74883d18e1b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:54.719361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-48b40f3e-691f-48d3-be07-74883d18e1b6 None None] MFA Rules not processed for user `0a4a57dd620441e59d40d33bd6ee4364`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:54.726567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-48b40f3e-691f-48d3-be07-74883d18e1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:54.757575 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:54.766019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249745a3-1299-4b7b-96e0-1c6b0226d897 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:54.767060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249745a3-1299-4b7b-96e0-1c6b0226d897 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:54.767314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249745a3-1299-4b7b-96e0-1c6b0226d897 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:54.767595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249745a3-1299-4b7b-96e0-1c6b0226d897 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects/584cd26d92114fae975bda06d455b116/users/9dca4c6263014850b342e537e036a085/roles/6138e01b59924630bc37700d02c43a4f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:54.773032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249745a3-1299-4b7b-96e0-1c6b0226d897 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_grant(project_id=584cd26d92114fae975bda06d455b116, user_id=9dca4c6263014850b342e537e036a085, role_id=6138e01b59924630bc37700d02c43a4f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:54.777085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249745a3-1299-4b7b-96e0-1c6b0226d897 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:54.800733 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3127/6302] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:54.802331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04671457-0df7-4a41-9ec7-97654434200b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:54.802652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04671457-0df7-4a41-9ec7-97654434200b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:54.802939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04671457-0df7-4a41-9ec7-97654434200b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:54.833480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-04671457-0df7-4a41-9ec7-97654434200b None None] MFA Rules not processed for user `a262c2b2552e41de9d86a8ea0b5e14d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:54.833480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-04671457-0df7-4a41-9ec7-97654434200b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:54.910976 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3176/6303] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:54 2022] PUT /identity/v3/projects/584cd26d92114fae975bda06d455b116/users/9dca4c6263014850b342e537e036a085/roles/6138e01b59924630bc37700d02c43a4f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:54.911866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249745a3-1299-4b7b-96e0-1c6b0226d897 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:54.950172 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3128/6304] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:54.951885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04671457-0df7-4a41-9ec7-97654434200b None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:54.990985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04671457-0df7-4a41-9ec7-97654434200b None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:55.053680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249745a3-1299-4b7b-96e0-1c6b0226d897 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:55.060017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a85010-b94c-46bf-a412-863caa2aede9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:55.060962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a85010-b94c-46bf-a412-863caa2aede9 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:55.061351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a85010-b94c-46bf-a412-863caa2aede9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:55.066377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a85010-b94c-46bf-a412-863caa2aede9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:55.068175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a85010-b94c-46bf-a412-863caa2aede9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:55.070576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a85010-b94c-46bf-a412-863caa2aede9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:55.128573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0a98a-a276-4572-b663-22d0f2ba2246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:55.129496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0a98a-a276-4572-b663-22d0f2ba2246 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:55.129790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0a98a-a276-4572-b663-22d0f2ba2246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:55.130071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b0a98a-a276-4572-b663-22d0f2ba2246 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:55.132841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0a98a-a276-4572-b663-22d0f2ba2246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:55.134888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b0a98a-a276-4572-b663-22d0f2ba2246 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:55.191949 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3177/6305] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:54 2022] POST /identity/v3/projects => generated 377 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:55.192881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a85010-b94c-46bf-a412-863caa2aede9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:55.289997 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3129/6306] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:54 2022] POST /identity/v3/projects => generated 385 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:55.292717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0a98a-a276-4572-b663-22d0f2ba2246 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:55.296988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a85010-b94c-46bf-a412-863caa2aede9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:55.386706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b0a98a-a276-4572-b663-22d0f2ba2246 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:55.393876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469b438-dc09-478c-98e3-1e9b80f6fe4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:55.394723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469b438-dc09-478c-98e3-1e9b80f6fe4f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:55.395090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469b438-dc09-478c-98e3-1e9b80f6fe4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:55.395473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469b438-dc09-478c-98e3-1e9b80f6fe4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:55.396250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469b438-dc09-478c-98e3-1e9b80f6fe4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:55.398421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e469b438-dc09-478c-98e3-1e9b80f6fe4f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:55.441476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5ce79-818f-4a45-8738-20c2b11d0370 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:55.442386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5ce79-818f-4a45-8738-20c2b11d0370 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:55.454215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5ce79-818f-4a45-8738-20c2b11d0370 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:55.454215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce5ce79-818f-4a45-8738-20c2b11d0370 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:55.454215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce5ce79-818f-4a45-8738-20c2b11d0370 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:55.454215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce5ce79-818f-4a45-8738-20c2b11d0370 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:55.481871 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3178/6307] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:55 2022] GET /identity/v3/users => generated 7757 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:55.482759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5ce79-818f-4a45-8738-20c2b11d0370 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:55.494472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce5ce79-818f-4a45-8738-20c2b11d0370 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:55.499710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94280b4c-47c1-4880-a17d-8bb5da5774f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:55.500486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94280b4c-47c1-4880-a17d-8bb5da5774f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:55.500780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94280b4c-47c1-4880-a17d-8bb5da5774f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:55.503357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94280b4c-47c1-4880-a17d-8bb5da5774f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:55.503357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94280b4c-47c1-4880-a17d-8bb5da5774f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:55.504873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94280b4c-47c1-4880-a17d-8bb5da5774f2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:55.552314 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3130/6308] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:40:55 2022] POST /identity/v3/projects => generated 367 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:55.553531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469b438-dc09-478c-98e3-1e9b80f6fe4f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:55.571163 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:55.628153 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3179/6309] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:55 2022] POST /identity/v3/users => generated 289 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:55.629851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d0369-d7eb-422b-a348-c623018f3337 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:55.630470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d0369-d7eb-422b-a348-c623018f3337 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:55.630889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d0369-d7eb-422b-a348-c623018f3337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:55.641743 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:55.688723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469b438-dc09-478c-98e3-1e9b80f6fe4f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:55.699548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdf736-42a3-4704-97e1-b4005c350063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:55.701065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdf736-42a3-4704-97e1-b4005c350063 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:55.701543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdf736-42a3-4704-97e1-b4005c350063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:55.702089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acdf736-42a3-4704-97e1-b4005c350063 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:55.703030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acdf736-42a3-4704-97e1-b4005c350063 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:55.706324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acdf736-42a3-4704-97e1-b4005c350063 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:55.716116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f53d0369-d7eb-422b-a348-c623018f3337 None None] MFA Rules not processed for user `9dca4c6263014850b342e537e036a085`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:55.716116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f53d0369-d7eb-422b-a348-c623018f3337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:55.834133 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3131/6310] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:55 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:55.835374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdf736-42a3-4704-97e1-b4005c350063 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:55.847885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acdf736-42a3-4704-97e1-b4005c350063 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:55.854811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13672961-b7b5-440f-94ad-29e59f62d1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:55.855786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13672961-b7b5-440f-94ad-29e59f62d1cd admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:55.856319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13672961-b7b5-440f-94ad-29e59f62d1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:55.858694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13672961-b7b5-440f-94ad-29e59f62d1cd admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:55.858694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13672961-b7b5-440f-94ad-29e59f62d1cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:55.860105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13672961-b7b5-440f-94ad-29e59f62d1cd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:55.865098 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3180/6311] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:55 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:55.866026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d0369-d7eb-422b-a348-c623018f3337 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:55.886862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d0369-d7eb-422b-a348-c623018f3337 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:55.892814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67008cad-2e47-4d88-b3fd-c9a91bd344de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:55.894771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67008cad-2e47-4d88-b3fd-c9a91bd344de admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:55.895367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67008cad-2e47-4d88-b3fd-c9a91bd344de admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:55.895960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67008cad-2e47-4d88-b3fd-c9a91bd344de admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:55.897603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67008cad-2e47-4d88-b3fd-c9a91bd344de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:55.899703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67008cad-2e47-4d88-b3fd-c9a91bd344de admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:55.918996 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3181/6312] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:55 2022] GET /identity/v3/roles => generated 1892 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:55.918996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabe289-ebf1-467a-bcad-3b0b39f39292 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:55.918996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabe289-ebf1-467a-bcad-3b0b39f39292 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:55.918996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aabe289-ebf1-467a-bcad-3b0b39f39292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:55.934168 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3132/6313] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:40:55 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:55.935468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13672961-b7b5-440f-94ad-29e59f62d1cd admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:55.957944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13672961-b7b5-440f-94ad-29e59f62d1cd admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:55.964774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8aabe289-ebf1-467a-bcad-3b0b39f39292 None None] MFA Rules not processed for user `d1cbf58d0cf8440aae63bf31387948f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:55.966857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8aabe289-ebf1-467a-bcad-3b0b39f39292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:55.970730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa14cf-ee9a-43fd-a628-b0f0f385b46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:55.972284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa14cf-ee9a-43fd-a628-b0f0f385b46c admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:55.972641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa14cf-ee9a-43fd-a628-b0f0f385b46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:55.972989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa14cf-ee9a-43fd-a628-b0f0f385b46c admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:55.973808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa14cf-ee9a-43fd-a628-b0f0f385b46c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:55.979029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa14cf-ee9a-43fd-a628-b0f0f385b46c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:56.004186 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3133/6314] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:55 2022] GET /identity/v3/roles => generated 1892 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:56.007273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359058e-b84b-4478-b491-1d75112bf76f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:56.008528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359058e-b84b-4478-b491-1d75112bf76f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:56.008682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359058e-b84b-4478-b491-1d75112bf76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:56.032811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d359058e-b84b-4478-b491-1d75112bf76f None None] MFA Rules not processed for user `9dca4c6263014850b342e537e036a085`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:56.034659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d359058e-b84b-4478-b491-1d75112bf76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:56.044733 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3134/6315] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:56 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:56.045742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359058e-b84b-4478-b491-1d75112bf76f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:56.089210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359058e-b84b-4478-b491-1d75112bf76f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:56.093986 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3182/6316] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:55 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:56.094942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabe289-ebf1-467a-bcad-3b0b39f39292 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:56.100399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f4982-0eaf-4ff3-9bdd-dee4d473a2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:56.101170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f4982-0eaf-4ff3-9bdd-dee4d473a2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:56.101610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f4982-0eaf-4ff3-9bdd-dee4d473a2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:56.101870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f4982-0eaf-4ff3-9bdd-dee4d473a2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:56.102724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f4982-0eaf-4ff3-9bdd-dee4d473a2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:56.104582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940f4982-0eaf-4ff3-9bdd-dee4d473a2e9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:56.110497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aabe289-ebf1-467a-bcad-3b0b39f39292 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:56.124162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f4757-de6b-4bf9-8f3c-c391fca263ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:56.124860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f4757-de6b-4bf9-8f3c-c391fca263ec admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:56.125144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f4757-de6b-4bf9-8f3c-c391fca263ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:56.125422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f4757-de6b-4bf9-8f3c-c391fca263ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:56.126189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f4757-de6b-4bf9-8f3c-c391fca263ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:56.132121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5f4757-de6b-4bf9-8f3c-c391fca263ec admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:56.133486 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3135/6317] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:56 2022] GET /identity/v3/roles => generated 1892 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:56.135643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f4982-0eaf-4ff3-9bdd-dee4d473a2e9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:56.158601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f4982-0eaf-4ff3-9bdd-dee4d473a2e9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:56.159975 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3183/6318] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:56 2022] GET /identity/v3/roles => generated 1892 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:56.160851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f4757-de6b-4bf9-8f3c-c391fca263ec admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:56.172406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debbbbf-6816-4312-bc71-327f0aef0070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:56.173094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debbbbf-6816-4312-bc71-327f0aef0070 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:56.173384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debbbbf-6816-4312-bc71-327f0aef0070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:56.174615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debbbbf-6816-4312-bc71-327f0aef0070 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:56.174879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debbbbf-6816-4312-bc71-327f0aef0070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:56.176490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debbbbf-6816-4312-bc71-327f0aef0070 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:56.182563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5f4757-de6b-4bf9-8f3c-c391fca263ec admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:56.196886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe333fc-dd15-4e89-919e-07ea40c1c68d tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dca4c6263014850b342e537e036a085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584cd26d92114fae975bda06d455b116', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-950969004', 'tempest-DelegatedRole-1706941417'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:56.198708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe333fc-dd15-4e89-919e-07ea40c1c68d tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:56.199167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe333fc-dd15-4e89-919e-07ea40c1c68d tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:56.200609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe333fc-dd15-4e89-919e-07ea40c1c68d tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:56.202839 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3136/6319] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:56 2022] GET /identity/v3/roles => generated 1892 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:56.203635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe333fc-dd15-4e89-919e-07ea40c1c68d tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] RBAC: Authorizing `identity:create_trust()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:56.207578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debbbbf-6816-4312-bc71-327f0aef0070 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:56.209035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe333fc-dd15-4e89-919e-07ea40c1c68d tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:56.235439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debbbbf-6816-4312-bc71-327f0aef0070 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:56.246001 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:56.248507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc799022-7ead-47d5-b9ac-80d1b07aea4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:56.249491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc799022-7ead-47d5-b9ac-80d1b07aea4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:56.249776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc799022-7ead-47d5-b9ac-80d1b07aea4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:56.250063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc799022-7ead-47d5-b9ac-80d1b07aea4b admin admin] PATH_INFO: `/v3/projects/3220a50ac4ed4ef690394b8000cde14f/users/a66d2235fd20498aacaebac9ce53db27/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:56.320486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc799022-7ead-47d5-b9ac-80d1b07aea4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3220a50ac4ed4ef690394b8000cde14f, user_id=a66d2235fd20498aacaebac9ce53db27, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:56.330174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc799022-7ead-47d5-b9ac-80d1b07aea4b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:56.425401 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3137/6320] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:56 2022] PUT /identity/v3/projects/3220a50ac4ed4ef690394b8000cde14f/users/a66d2235fd20498aacaebac9ce53db27/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:56.427347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc799022-7ead-47d5-b9ac-80d1b07aea4b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:56.549874 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3184/6321] 10.222.0.43 () {60 vars in 1173 bytes} [Tue Jul 19 14:40:56 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:56.549874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe333fc-dd15-4e89-919e-07ea40c1c68d tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:56.551993 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:56.565249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe333fc-dd15-4e89-919e-07ea40c1c68d tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:56.600560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc799022-7ead-47d5-b9ac-80d1b07aea4b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:56.648958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e268608-c24d-476c-82c8-21f95ef7fad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:56.649883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e268608-c24d-476c-82c8-21f95ef7fad0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:56.688131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e268608-c24d-476c-82c8-21f95ef7fad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:56.688131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e268608-c24d-476c-82c8-21f95ef7fad0 admin admin] PATH_INFO: `/v3/projects/2d31db00b61349169e2d4513879fb684/users/630180a7c16347dc9c791711a94e8f10/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:56.689196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b22981-7f5a-458c-98bc-bba1efa97103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:56.689196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b22981-7f5a-458c-98bc-bba1efa97103 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:56.689196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b22981-7f5a-458c-98bc-bba1efa97103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:56.689196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b22981-7f5a-458c-98bc-bba1efa97103 admin admin] PATH_INFO: `/v3/projects/cb941bc6eb904768965429736882f6d4/users/a86b0b5e4c7142359ee384792486d3b2/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:56.689501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e268608-c24d-476c-82c8-21f95ef7fad0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d31db00b61349169e2d4513879fb684, user_id=630180a7c16347dc9c791711a94e8f10, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:56.689501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e268608-c24d-476c-82c8-21f95ef7fad0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:56.710302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b22981-7f5a-458c-98bc-bba1efa97103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb941bc6eb904768965429736882f6d4, user_id=a86b0b5e4c7142359ee384792486d3b2, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:56.714314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b22981-7f5a-458c-98bc-bba1efa97103 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:57.130404 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3138/6322] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:56 2022] PUT /identity/v3/projects/2d31db00b61349169e2d4513879fb684/users/630180a7c16347dc9c791711a94e8f10/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:57.130404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11d2cd-8d57-4f82-948f-b5c905501156 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:57.130404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11d2cd-8d57-4f82-948f-b5c905501156 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:57.130736 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3185/6323] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:56 2022] PUT /identity/v3/projects/cb941bc6eb904768965429736882f6d4/users/a86b0b5e4c7142359ee384792486d3b2/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:57.131437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11d2cd-8d57-4f82-948f-b5c905501156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:57.131534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b22981-7f5a-458c-98bc-bba1efa97103 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:57.157859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6e11d2cd-8d57-4f82-948f-b5c905501156 None None] MFA Rules not processed for user `a66d2235fd20498aacaebac9ce53db27`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:57.159812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6e11d2cd-8d57-4f82-948f-b5c905501156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:57.209787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b22981-7f5a-458c-98bc-bba1efa97103 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:57.215070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a9679-c3ce-4666-800a-58e798928ca3 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:57.215735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a9679-c3ce-4666-800a-58e798928ca3 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:57.216035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a9679-c3ce-4666-800a-58e798928ca3 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:57.216311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a9679-c3ce-4666-800a-58e798928ca3 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:57.217037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a9679-c3ce-4666-800a-58e798928ca3 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:57.218214 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-a82a9679-c3ce-4666-800a-58e798928ca3 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:40:57.218214 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:40:57.218214 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:40:57.219102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a9679-c3ce-4666-800a-58e798928ca3 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:57.227605 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3186/6324] 10.222.0.43 () {58 vars in 1154 bytes} [Tue Jul 19 14:40:57 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:57.229902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a9679-c3ce-4666-800a-58e798928ca3 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:57.262573 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3139/6325] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:57.268746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333418d-c366-4ee9-8e30-8877c8bce71f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:57.270031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333418d-c366-4ee9-8e30-8877c8bce71f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:57.270190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333418d-c366-4ee9-8e30-8877c8bce71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:57.299634 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:57.327829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f333418d-c366-4ee9-8e30-8877c8bce71f None None] MFA Rules not processed for user `a86b0b5e4c7142359ee384792486d3b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:57.329321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f333418d-c366-4ee9-8e30-8877c8bce71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:57.376298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a9679-c3ce-4666-800a-58e798928ca3 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:57.392584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712a56b-cc0b-44c4-8ca2-ce19ce6ea1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:57.392584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712a56b-cc0b-44c4-8ca2-ce19ce6ea1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:57.392584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712a56b-cc0b-44c4-8ca2-ce19ce6ea1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:57.392584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712a56b-cc0b-44c4-8ca2-ce19ce6ea1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:57.393165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712a56b-cc0b-44c4-8ca2-ce19ce6ea1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:57.393165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c712a56b-cc0b-44c4-8ca2-ce19ce6ea1f5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:57.407185 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3187/6326] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:40:57 2022] GET /identity/v3/roles => generated 1892 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:40:57.410142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712a56b-cc0b-44c4-8ca2-ce19ce6ea1f5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:57.468224 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3140/6327] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:57.475725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333418d-c366-4ee9-8e30-8877c8bce71f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:57.478967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f333418d-c366-4ee9-8e30-8877c8bce71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:57.508188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712a56b-cc0b-44c4-8ca2-ce19ce6ea1f5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:57.512993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb955a-5b6a-4530-8937-543255c0c71b tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dca4c6263014850b342e537e036a085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584cd26d92114fae975bda06d455b116', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-950969004', 'tempest-DelegatedRole-1706941417'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:57.513216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb955a-5b6a-4530-8937-543255c0c71b tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:57.513510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb955a-5b6a-4530-8937-543255c0c71b tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:57.513792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb955a-5b6a-4530-8937-543255c0c71b tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] PATH_INFO: `/v3/OS-TRUST/trusts/a9ced595ae304ae7a382c649bb033c7e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:57.526378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb955a-5b6a-4530-8937-543255c0c71b tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] RBAC: Authorizing `identity:delete_trust(trust_id=a9ced595ae304ae7a382c649bb033c7e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:57.528618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb955a-5b6a-4530-8937-543255c0c71b tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:57.553111 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:57.575655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333418d-c366-4ee9-8e30-8877c8bce71f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:57.584710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ba0b8-8f5f-4fcb-84cb-f571be920958 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:57.585434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ba0b8-8f5f-4fcb-84cb-f571be920958 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:57.585885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ba0b8-8f5f-4fcb-84cb-f571be920958 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:57.586263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ba0b8-8f5f-4fcb-84cb-f571be920958 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:57.601359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ba0b8-8f5f-4fcb-84cb-f571be920958 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:57.603830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ba0b8-8f5f-4fcb-84cb-f571be920958 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:57.614161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f1bb955a-5b6a-4530-8937-543255c0c71b tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'a9ced595ae304ae7a382c649bb033c7e', 'request_id': 'req-f1bb955a-5b6a-4530-8937-543255c0c71b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:57.636732 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3141/6328] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:40:57.637800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ba0b8-8f5f-4fcb-84cb-f571be920958 service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:57.682321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ba0b8-8f5f-4fcb-84cb-f571be920958 service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:57.686689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95573f-0a11-4d4e-83b9-3969e1c84057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:57.687929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95573f-0a11-4d4e-83b9-3969e1c84057 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:57.688422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95573f-0a11-4d4e-83b9-3969e1c84057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:57.688776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f95573f-0a11-4d4e-83b9-3969e1c84057 admin admin] PATH_INFO: `/v3/projects/2d31db00b61349169e2d4513879fb684/users/630180a7c16347dc9c791711a94e8f10/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:57.691695 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95573f-0a11-4d4e-83b9-3969e1c84057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d31db00b61349169e2d4513879fb684, user_id=630180a7c16347dc9c791711a94e8f10, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:57.695080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f95573f-0a11-4d4e-83b9-3969e1c84057 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:57.703472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f1bb955a-5b6a-4530-8937-543255c0c71b tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a9ced595ae304ae7a382c649bb033c7e', 'request_id': 'req-f1bb955a-5b6a-4530-8937-543255c0c71b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:57.704346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f1bb955a-5b6a-4530-8937-543255c0c71b tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'a9ced595ae304ae7a382c649bb033c7e', 'request_id': 'req-f1bb955a-5b6a-4530-8937-543255c0c71b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:57.713659 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3188/6329] 10.222.0.43 () {58 vars in 1253 bytes} [Tue Jul 19 14:40:57 2022] DELETE /identity/v3/OS-TRUST/trusts/a9ced595ae304ae7a382c649bb033c7e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:57.734313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb955a-5b6a-4530-8937-543255c0c71b tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:57.734313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f1bb955a-5b6a-4530-8937-543255c0c71b tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:57.734534 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3142/6330] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:40:57 2022] PUT /identity/v3/projects/2d31db00b61349169e2d4513879fb684/users/630180a7c16347dc9c791711a94e8f10/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:57.734534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95573f-0a11-4d4e-83b9-3969e1c84057 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:57.738672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4f95573f-0a11-4d4e-83b9-3969e1c84057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:57.867188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f95573f-0a11-4d4e-83b9-3969e1c84057 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:57.871925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28e3a1-83b1-43ab-a70b-0bdd1604e92e tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dca4c6263014850b342e537e036a085', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '584cd26d92114fae975bda06d455b116', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-950969004', 'tempest-DelegatedRole-1706941417'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:57.872842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28e3a1-83b1-43ab-a70b-0bdd1604e92e tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:57.873129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28e3a1-83b1-43ab-a70b-0bdd1604e92e tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:57.873411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28e3a1-83b1-43ab-a70b-0bdd1604e92e tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] PATH_INFO: `/v3/OS-TRUST/trusts/a9ced595ae304ae7a382c649bb033c7e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:57.892454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb955a-5b6a-4530-8937-543255c0c71b tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:57.907092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-4e28e3a1-83b1-43ab-a70b-0bdd1604e92e tempest-TrustsV3TestJSON-1176909725 tempest-user-805769072] Could not find trust: a9ced595ae304ae7a382c649bb033c7e.: keystone.exception.TrustNotFound: Could not find trust: a9ced595ae304ae7a382c649bb033c7e. Jul 19 14:40:57.907092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:40:57.907092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:40:57.907092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:40:57.907092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:40:57.907092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:40:57.907092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:40:57.907092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:40:57.907092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:40:57.907092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:40:57.907092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:40:57.907092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:40:57.907092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 19 14:40:57.907092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 19 14:40:57.907092 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 19 14:40:57.915662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 19 14:40:57.915662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 19 14:40:57.915662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 19 14:40:57.915662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 19 14:40:57.915662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 19 14:40:57.915662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:40:57.915662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:40:57.915662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 19 14:40:57.915662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 19 14:40:57.915662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 19 14:40:57.915662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 19 14:40:57.915662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: a9ced595ae304ae7a382c649bb033c7e. Jul 19 14:40:57.915662 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:40:57.915662 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3143/6331] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jul 19 14:40:57 2022] GET /identity/v3/OS-TRUST/trusts/a9ced595ae304ae7a382c649bb033c7e => generated 111 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:40:57.916701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d24c42-c11f-459e-b34c-f45503322053 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:57.916701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d24c42-c11f-459e-b34c-f45503322053 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:57.916701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d24c42-c11f-459e-b34c-f45503322053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:57.955361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-97d24c42-c11f-459e-b34c-f45503322053 None None] MFA Rules not processed for user `630180a7c16347dc9c791711a94e8f10`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:57.958061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-97d24c42-c11f-459e-b34c-f45503322053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:58.010137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a92926-9a40-4cad-853f-6762af859d12 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:58.010826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a92926-9a40-4cad-853f-6762af859d12 service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:58.011113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a92926-9a40-4cad-853f-6762af859d12 service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:58.011395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a92926-9a40-4cad-853f-6762af859d12 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:58.013377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-55a92926-9a40-4cad-853f-6762af859d12 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:58.022969 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:58.071694 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3144/6332] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:57 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:58.074228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da2f2a-7720-40a0-a749-1b46ec03a36c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:58.074228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da2f2a-7720-40a0-a749-1b46ec03a36c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:58.074228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da2f2a-7720-40a0-a749-1b46ec03a36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:58.093511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-34da2f2a-7720-40a0-a749-1b46ec03a36c None None] MFA Rules not processed for user `20cc5d36e4004359903122049a88079f`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:40:58.094692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-34da2f2a-7720-40a0-a749-1b46ec03a36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:58.103472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a92926-9a40-4cad-853f-6762af859d12 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:58.106079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a92926-9a40-4cad-853f-6762af859d12 service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:58.124272 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3189/6333] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:40:58.125602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a92926-9a40-4cad-853f-6762af859d12 service glance] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:58.131446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-55a92926-9a40-4cad-853f-6762af859d12 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:58.183146 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:58.220232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a92926-9a40-4cad-853f-6762af859d12 service glance] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:58.222646 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3145/6334] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:40:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:40:58.223602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da2f2a-7720-40a0-a749-1b46ec03a36c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:58.231334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76453cfd-4149-4f7a-9a1d-efb591e7e752 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:58.233868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76453cfd-4149-4f7a-9a1d-efb591e7e752 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:58.234534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76453cfd-4149-4f7a-9a1d-efb591e7e752 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:58.235050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76453cfd-4149-4f7a-9a1d-efb591e7e752 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles/6138e01b59924630bc37700d02c43a4f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:58.237581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76453cfd-4149-4f7a-9a1d-efb591e7e752 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_role(role_id=6138e01b59924630bc37700d02c43a4f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:58.240036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76453cfd-4149-4f7a-9a1d-efb591e7e752 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:58.274625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da2f2a-7720-40a0-a749-1b46ec03a36c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:58.300664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff90a7-8193-413f-9e80-d63cf3d6be1a tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630180a7c16347dc9c791711a94e8f10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d31db00b61349169e2d4513879fb684', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:58.301168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff90a7-8193-413f-9e80-d63cf3d6be1a tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:58.301465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff90a7-8193-413f-9e80-d63cf3d6be1a tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:58.301755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff90a7-8193-413f-9e80-d63cf3d6be1a tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] PATH_INFO: `/v3/policies` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:58.307376 n-d-master-1 devstack@keystone.service[80679]: WARNING oslo_log.versionutils [None req-44ff90a7-8193-413f-9e80-d63cf3d6be1a tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 19 14:40:58.308166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff90a7-8193-413f-9e80-d63cf3d6be1a tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:58.309437 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-44ff90a7-8193-413f-9e80-d63cf3d6be1a tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:40:58.309437 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:40:58.309437 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:40:58.311500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff90a7-8193-413f-9e80-d63cf3d6be1a tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:58.438393 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3146/6335] 10.222.0.43 () {60 vars in 1151 bytes} [Tue Jul 19 14:40:58 2022] POST /identity/v3/policies => generated 229 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:58.442318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff90a7-8193-413f-9e80-d63cf3d6be1a tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:58.477783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-76453cfd-4149-4f7a-9a1d-efb591e7e752 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invalidating the token cache because role 6138e01b59924630bc37700d02c43a4f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:58.478080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-76453cfd-4149-4f7a-9a1d-efb591e7e752 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:58.480695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-76453cfd-4149-4f7a-9a1d-efb591e7e752 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:58.483506 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3190/6336] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:58 2022] DELETE /identity/v3/roles/6138e01b59924630bc37700d02c43a4f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:58.484316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76453cfd-4149-4f7a-9a1d-efb591e7e752 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:58.488013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-76453cfd-4149-4f7a-9a1d-efb591e7e752 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:58.510132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff90a7-8193-413f-9e80-d63cf3d6be1a tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:58.637138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76453cfd-4149-4f7a-9a1d-efb591e7e752 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:58.642243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b1328-ee54-4fa8-9f68-adfaff6f5103 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:58.643768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b1328-ee54-4fa8-9f68-adfaff6f5103 service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:58.644420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b1328-ee54-4fa8-9f68-adfaff6f5103 service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:58.645030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b1328-ee54-4fa8-9f68-adfaff6f5103 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:58.647261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3d5b1328-ee54-4fa8-9f68-adfaff6f5103 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:58.653560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61ef59-9794-42f9-a307-92f5cde3c274 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630180a7c16347dc9c791711a94e8f10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d31db00b61349169e2d4513879fb684', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:58.657029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61ef59-9794-42f9-a307-92f5cde3c274 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:58.657029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61ef59-9794-42f9-a307-92f5cde3c274 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:58.657029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61ef59-9794-42f9-a307-92f5cde3c274 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] PATH_INFO: `/v3/policies/4b780b81f98c4103a8823e0f0b795665` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:58.657029 n-d-master-1 devstack@keystone.service[80679]: WARNING oslo_log.versionutils [None req-3a61ef59-9794-42f9-a307-92f5cde3c274 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 19 14:40:58.657522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61ef59-9794-42f9-a307-92f5cde3c274 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=4b780b81f98c4103a8823e0f0b795665)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:58.667751 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-3a61ef59-9794-42f9-a307-92f5cde3c274 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:40:58.667751 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:40:58.667751 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:40:58.668774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61ef59-9794-42f9-a307-92f5cde3c274 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:58.746546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b1328-ee54-4fa8-9f68-adfaff6f5103 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:58.748160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b1328-ee54-4fa8-9f68-adfaff6f5103 service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:58.771031 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3191/6337] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:40:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:40:58.771031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b1328-ee54-4fa8-9f68-adfaff6f5103 service glance] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:58.783411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3d5b1328-ee54-4fa8-9f68-adfaff6f5103 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:58.818543 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3147/6338] 10.222.0.43 () {60 vars in 1251 bytes} [Tue Jul 19 14:40:58 2022] PATCH /identity/v3/policies/4b780b81f98c4103a8823e0f0b795665 => generated 236 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:58.822796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61ef59-9794-42f9-a307-92f5cde3c274 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:58.828114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3a61ef59-9794-42f9-a307-92f5cde3c274 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:58.858628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61ef59-9794-42f9-a307-92f5cde3c274 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:58.873387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b4787-be8f-47c3-8091-3dae0e1bd2ee tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630180a7c16347dc9c791711a94e8f10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d31db00b61349169e2d4513879fb684', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:58.876197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b4787-be8f-47c3-8091-3dae0e1bd2ee tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:58.876197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b4787-be8f-47c3-8091-3dae0e1bd2ee tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:58.876197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b4787-be8f-47c3-8091-3dae0e1bd2ee tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] PATH_INFO: `/v3/policies/4b780b81f98c4103a8823e0f0b795665` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:58.876197 n-d-master-1 devstack@keystone.service[80679]: WARNING oslo_log.versionutils [None req-f41b4787-be8f-47c3-8091-3dae0e1bd2ee tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 19 14:40:58.877117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b4787-be8f-47c3-8091-3dae0e1bd2ee tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=4b780b81f98c4103a8823e0f0b795665)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:58.879288 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-f41b4787-be8f-47c3-8091-3dae0e1bd2ee tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:40:58.879288 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:40:58.879288 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:40:58.880532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b4787-be8f-47c3-8091-3dae0e1bd2ee tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:58.894884 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3148/6339] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:40:58 2022] GET /identity/v3/policies/4b780b81f98c4103a8823e0f0b795665 => generated 236 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:40:58.899445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b4787-be8f-47c3-8091-3dae0e1bd2ee tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:58.913671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b1328-ee54-4fa8-9f68-adfaff6f5103 service glance] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:58.919541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e0f4e-fd77-438b-86ab-551ceaa18bc0 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:58.920567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e0f4e-fd77-438b-86ab-551ceaa18bc0 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:58.920955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e0f4e-fd77-438b-86ab-551ceaa18bc0 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:58.921336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7e0f4e-fd77-438b-86ab-551ceaa18bc0 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles/4db3fcb4e69d49188dbfa4d3ad6d63e9` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:58.923333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b4787-be8f-47c3-8091-3dae0e1bd2ee tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:58.923785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e0f4e-fd77-438b-86ab-551ceaa18bc0 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4db3fcb4e69d49188dbfa4d3ad6d63e9)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:58.926789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7e0f4e-fd77-438b-86ab-551ceaa18bc0 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:58.941059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc33bd-fe9a-4c0c-bb1f-663fc7378913 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630180a7c16347dc9c791711a94e8f10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d31db00b61349169e2d4513879fb684', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:58.942170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc33bd-fe9a-4c0c-bb1f-663fc7378913 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:58.942564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc33bd-fe9a-4c0c-bb1f-663fc7378913 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:58.942942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc33bd-fe9a-4c0c-bb1f-663fc7378913 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] PATH_INFO: `/v3/policies/4b780b81f98c4103a8823e0f0b795665` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:58.943863 n-d-master-1 devstack@keystone.service[80679]: WARNING oslo_log.versionutils [None req-76fc33bd-fe9a-4c0c-bb1f-663fc7378913 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 19 14:40:58.944769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc33bd-fe9a-4c0c-bb1f-663fc7378913 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=4b780b81f98c4103a8823e0f0b795665)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:58.949192 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-76fc33bd-fe9a-4c0c-bb1f-663fc7378913 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:40:58.949192 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:40:58.949192 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:40:58.950473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc33bd-fe9a-4c0c-bb1f-663fc7378913 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:59.057877 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3149/6340] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:58 2022] DELETE /identity/v3/policies/4b780b81f98c4103a8823e0f0b795665 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:59.063355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc33bd-fe9a-4c0c-bb1f-663fc7378913 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:59.083113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc33bd-fe9a-4c0c-bb1f-663fc7378913 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:59.084207 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:59.100089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a5a00-6156-4b39-896e-0eeabeda153b tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630180a7c16347dc9c791711a94e8f10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d31db00b61349169e2d4513879fb684', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:59.103748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a5a00-6156-4b39-896e-0eeabeda153b tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:59.103748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a5a00-6156-4b39-896e-0eeabeda153b tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:59.103748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a5a00-6156-4b39-896e-0eeabeda153b tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] PATH_INFO: `/v3/policies` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:59.103748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a5a00-6156-4b39-896e-0eeabeda153b tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:59.105043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a5a00-6156-4b39-896e-0eeabeda153b tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:59.161260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4a7e0f4e-fd77-438b-86ab-551ceaa18bc0 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invalidating the token cache because role 4db3fcb4e69d49188dbfa4d3ad6d63e9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:40:59.161260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4a7e0f4e-fd77-438b-86ab-551ceaa18bc0 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:59.161260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4a7e0f4e-fd77-438b-86ab-551ceaa18bc0 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:59.166753 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3192/6341] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:58 2022] DELETE /identity/v3/roles/4db3fcb4e69d49188dbfa4d3ad6d63e9 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:59.167765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e0f4e-fd77-438b-86ab-551ceaa18bc0 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:59.169180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4a7e0f4e-fd77-438b-86ab-551ceaa18bc0 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:59.229725 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3150/6342] 10.222.0.43 () {60 vars in 1151 bytes} [Tue Jul 19 14:40:59 2022] POST /identity/v3/policies => generated 229 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:59.234205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a5a00-6156-4b39-896e-0eeabeda153b tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:59.238302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bd9a5a00-6156-4b39-896e-0eeabeda153b tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:59.282687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7e0f4e-fd77-438b-86ab-551ceaa18bc0 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:59.288647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468b59f-8aad-423f-89ec-fece4136e28d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:59.289600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468b59f-8aad-423f-89ec-fece4136e28d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:59.290206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468b59f-8aad-423f-89ec-fece4136e28d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:59.290485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c468b59f-8aad-423f-89ec-fece4136e28d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/users/9dca4c6263014850b342e537e036a085` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:59.292806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468b59f-8aad-423f-89ec-fece4136e28d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9dca4c6263014850b342e537e036a085)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:59.295459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c468b59f-8aad-423f-89ec-fece4136e28d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:59.308111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a5a00-6156-4b39-896e-0eeabeda153b tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:59.411193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e862fb-a6b6-43e1-95af-2e1e94f33ef2 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630180a7c16347dc9c791711a94e8f10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d31db00b61349169e2d4513879fb684', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:59.411428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e862fb-a6b6-43e1-95af-2e1e94f33ef2 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:59.411599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e862fb-a6b6-43e1-95af-2e1e94f33ef2 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:59.411891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e862fb-a6b6-43e1-95af-2e1e94f33ef2 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] PATH_INFO: `/v3/policies` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:59.414343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e862fb-a6b6-43e1-95af-2e1e94f33ef2 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:59.415993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e862fb-a6b6-43e1-95af-2e1e94f33ef2 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:59.434347 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:59.458043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c468b59f-8aad-423f-89ec-fece4136e28d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dca4c6263014850b342e537e036a085'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:59.485775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c468b59f-8aad-423f-89ec-fece4136e28d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dca4c6263014850b342e537e036a085'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:59.498373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c468b59f-8aad-423f-89ec-fece4136e28d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dca4c6263014850b342e537e036a085'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:59.499187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c468b59f-8aad-423f-89ec-fece4136e28d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dca4c6263014850b342e537e036a085'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:59.587383 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3151/6343] 10.222.0.43 () {60 vars in 1151 bytes} [Tue Jul 19 14:40:59 2022] POST /identity/v3/policies => generated 230 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:59.592132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e862fb-a6b6-43e1-95af-2e1e94f33ef2 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:59.614751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c468b59f-8aad-423f-89ec-fece4136e28d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dca4c6263014850b342e537e036a085'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:40:59.622241 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3193/6344] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:59 2022] DELETE /identity/v3/users/9dca4c6263014850b342e537e036a085 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:40:59.624532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e862fb-a6b6-43e1-95af-2e1e94f33ef2 tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:59.627206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468b59f-8aad-423f-89ec-fece4136e28d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:59.636184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c468b59f-8aad-423f-89ec-fece4136e28d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:40:59.704258 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:40:59.787278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b1e67-43dd-47e9-adc2-274b24e15dee tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630180a7c16347dc9c791711a94e8f10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d31db00b61349169e2d4513879fb684', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:59.787973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b1e67-43dd-47e9-adc2-274b24e15dee tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:59.788281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b1e67-43dd-47e9-adc2-274b24e15dee tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:59.788549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b1e67-43dd-47e9-adc2-274b24e15dee tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] PATH_INFO: `/v3/policies` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:59.789806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b1e67-43dd-47e9-adc2-274b24e15dee tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:59.794482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b1e67-43dd-47e9-adc2-274b24e15dee tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:59.806345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c468b59f-8aad-423f-89ec-fece4136e28d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:40:59.818654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56c1c9-f9a2-4b52-ae53-cde8a1df7140 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:40:59.818654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56c1c9-f9a2-4b52-ae53-cde8a1df7140 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:40:59.818654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56c1c9-f9a2-4b52-ae53-cde8a1df7140 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:40:59.819848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56c1c9-f9a2-4b52-ae53-cde8a1df7140 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects/584cd26d92114fae975bda06d455b116` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:40:59.819848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56c1c9-f9a2-4b52-ae53-cde8a1df7140 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_project(project_id=584cd26d92114fae975bda06d455b116)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:40:59.819848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c56c1c9-f9a2-4b52-ae53-cde8a1df7140 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:40:59.959841 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3152/6345] 10.222.0.43 () {60 vars in 1151 bytes} [Tue Jul 19 14:40:59 2022] POST /identity/v3/policies => generated 229 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:40:59.962836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b1e67-43dd-47e9-adc2-274b24e15dee tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:40:59.970041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-529b1e67-43dd-47e9-adc2-274b24e15dee tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:00.121456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8c56c1c9-f9a2-4b52-ae53-cde8a1df7140 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '584cd26d92114fae975bda06d455b116', 'request_id': 'req-8c56c1c9-f9a2-4b52-ae53-cde8a1df7140'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:00.134774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8c56c1c9-f9a2-4b52-ae53-cde8a1df7140 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '584cd26d92114fae975bda06d455b116', 'request_id': 'req-8c56c1c9-f9a2-4b52-ae53-cde8a1df7140'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:00.142716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8c56c1c9-f9a2-4b52-ae53-cde8a1df7140 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '584cd26d92114fae975bda06d455b116', 'request_id': 'req-8c56c1c9-f9a2-4b52-ae53-cde8a1df7140'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:00.150319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b1e67-43dd-47e9-adc2-274b24e15dee tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:00.245488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b52202-b1c9-4ce7-9686-e06e063f4e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:00.246928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b52202-b1c9-4ce7-9686-e06e063f4e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:00.247606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b52202-b1c9-4ce7-9686-e06e063f4e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:00.248299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b52202-b1c9-4ce7-9686-e06e063f4e24 admin admin] PATH_INFO: `/v3/users/0a4a57dd620441e59d40d33bd6ee4364` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:00.250265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b52202-b1c9-4ce7-9686-e06e063f4e24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a4a57dd620441e59d40d33bd6ee4364)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:00.253473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8c56c1c9-f9a2-4b52-ae53-cde8a1df7140 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] The token cache is being invalidate because project 584cd26d92114fae975bda06d455b116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:00.253954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8c56c1c9-f9a2-4b52-ae53-cde8a1df7140 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:00.254196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b52202-b1c9-4ce7-9686-e06e063f4e24 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:00.254711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8c56c1c9-f9a2-4b52-ae53-cde8a1df7140 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:00.257875 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3194/6346] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:40:59 2022] DELETE /identity/v3/projects/584cd26d92114fae975bda06d455b116 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:41:00.263635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56c1c9-f9a2-4b52-ae53-cde8a1df7140 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:00.265902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8c56c1c9-f9a2-4b52-ae53-cde8a1df7140 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:00.341238 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:00.380637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56c1c9-f9a2-4b52-ae53-cde8a1df7140 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:00.387058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8af67d-0271-4e74-97ca-5d812056a6ec tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630180a7c16347dc9c791711a94e8f10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d31db00b61349169e2d4513879fb684', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:00.387756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8af67d-0271-4e74-97ca-5d812056a6ec tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:00.388127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8af67d-0271-4e74-97ca-5d812056a6ec tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:00.389071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8af67d-0271-4e74-97ca-5d812056a6ec tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] PATH_INFO: `/v3/policies` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:00.389936 n-d-master-1 devstack@keystone.service[80680]: WARNING oslo_log.versionutils [None req-fc8af67d-0271-4e74-97ca-5d812056a6ec tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 19 14:41:00.390594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8af67d-0271-4e74-97ca-5d812056a6ec tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:00.392729 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-fc8af67d-0271-4e74-97ca-5d812056a6ec tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:41:00.392729 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:41:00.392729 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:41:00.405446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8af67d-0271-4e74-97ca-5d812056a6ec tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:00.430441 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3195/6347] 10.222.0.43 () {58 vars in 1130 bytes} [Tue Jul 19 14:41:00 2022] GET /identity/v3/policies => generated 764 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:00.431751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8af67d-0271-4e74-97ca-5d812056a6ec tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:00.441550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fc8af67d-0271-4e74-97ca-5d812056a6ec tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:00.512514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-67b52202-b1c9-4ce7-9686-e06e063f4e24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a4a57dd620441e59d40d33bd6ee4364'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:00.536862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-67b52202-b1c9-4ce7-9686-e06e063f4e24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a4a57dd620441e59d40d33bd6ee4364'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:00.537986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-67b52202-b1c9-4ce7-9686-e06e063f4e24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a4a57dd620441e59d40d33bd6ee4364'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:00.538873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-67b52202-b1c9-4ce7-9686-e06e063f4e24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a4a57dd620441e59d40d33bd6ee4364'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:00.547148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8af67d-0271-4e74-97ca-5d812056a6ec tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:00.547670 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:00.552206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-67b52202-b1c9-4ce7-9686-e06e063f4e24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a4a57dd620441e59d40d33bd6ee4364'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:00.557746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e2d73-bc23-4f0d-aafb-40cc1270851f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:00.558468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e2d73-bc23-4f0d-aafb-40cc1270851f service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:00.558758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e2d73-bc23-4f0d-aafb-40cc1270851f service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:00.559048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417e2d73-bc23-4f0d-aafb-40cc1270851f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:00.561169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-417e2d73-bc23-4f0d-aafb-40cc1270851f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:00.576872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e2d73-bc23-4f0d-aafb-40cc1270851f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:00.578531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417e2d73-bc23-4f0d-aafb-40cc1270851f service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:00.613447 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3196/6348] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:00.615075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e2d73-bc23-4f0d-aafb-40cc1270851f service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:00.617891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-417e2d73-bc23-4f0d-aafb-40cc1270851f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:00.693262 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3153/6349] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:40:59 2022] DELETE /identity/v3/users/0a4a57dd620441e59d40d33bd6ee4364 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:00.694918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b52202-b1c9-4ce7-9686-e06e063f4e24 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:00.699821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-67b52202-b1c9-4ce7-9686-e06e063f4e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:00.750396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417e2d73-bc23-4f0d-aafb-40cc1270851f service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:00.913387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db6f77-6a36-405e-8700-8ab86db84c99 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:00.917220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db6f77-6a36-405e-8700-8ab86db84c99 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:00.918520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db6f77-6a36-405e-8700-8ab86db84c99 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:00.919887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db6f77-6a36-405e-8700-8ab86db84c99 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:00.923955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db6f77-6a36-405e-8700-8ab86db84c99 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:00.927424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33db6f77-6a36-405e-8700-8ab86db84c99 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:00.997755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b52202-b1c9-4ce7-9686-e06e063f4e24 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:01.012932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ded2a-df89-4d7d-a5a8-f91d8a1a411e tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630180a7c16347dc9c791711a94e8f10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d31db00b61349169e2d4513879fb684', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:01.016642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ded2a-df89-4d7d-a5a8-f91d8a1a411e tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:01.017081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ded2a-df89-4d7d-a5a8-f91d8a1a411e tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:01.017429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ded2a-df89-4d7d-a5a8-f91d8a1a411e tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] PATH_INFO: `/v3/policies/d64b6f37418248a5a1dd1ab9745eafd5` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:01.019906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ded2a-df89-4d7d-a5a8-f91d8a1a411e tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=d64b6f37418248a5a1dd1ab9745eafd5)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:01.025033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ded2a-df89-4d7d-a5a8-f91d8a1a411e tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:01.058628 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3197/6350] 10.222.0.43 () {60 vars in 1151 bytes} [Tue Jul 19 14:41:00 2022] POST /identity/v3/projects => generated 329 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:01.066217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7c07f-c668-4520-a39d-20ac1899eddf None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:01.069949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7c07f-c668-4520-a39d-20ac1899eddf None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:01.071769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7c07f-c668-4520-a39d-20ac1899eddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:01.207163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-49e7c07f-c668-4520-a39d-20ac1899eddf None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:01.207163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-49e7c07f-c668-4520-a39d-20ac1899eddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:01.207163 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:01.208859 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3154/6351] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:00 2022] DELETE /identity/v3/policies/d64b6f37418248a5a1dd1ab9745eafd5 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:01.208859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ded2a-df89-4d7d-a5a8-f91d8a1a411e tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:01.237732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ded2a-df89-4d7d-a5a8-f91d8a1a411e tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:01.323320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd6670-b1e8-4632-95d5-026fe833a2a6 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:01.325378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd6670-b1e8-4632-95d5-026fe833a2a6 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:01.326019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd6670-b1e8-4632-95d5-026fe833a2a6 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:01.326501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fd6670-b1e8-4632-95d5-026fe833a2a6 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:01.327465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd6670-b1e8-4632-95d5-026fe833a2a6 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:01.332611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fd6670-b1e8-4632-95d5-026fe833a2a6 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:01.334826 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3198/6352] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:01.335933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7c07f-c668-4520-a39d-20ac1899eddf None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:01.432314 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3155/6353] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:01 2022] POST /identity/v3/users => generated 416 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:01.433654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7c07f-c668-4520-a39d-20ac1899eddf None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:01.433794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd6670-b1e8-4632-95d5-026fe833a2a6 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:01.436860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-06fd6670-b1e8-4632-95d5-026fe833a2a6 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:01.443493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b10b8-7581-4187-9a0c-3687d096ef2f tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630180a7c16347dc9c791711a94e8f10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d31db00b61349169e2d4513879fb684', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:01.444685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b10b8-7581-4187-9a0c-3687d096ef2f tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:01.445662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b10b8-7581-4187-9a0c-3687d096ef2f tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:01.446008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b10b8-7581-4187-9a0c-3687d096ef2f tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] PATH_INFO: `/v3/policies/fd4ed00327304e18bfba9f0d96fc2686` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:01.447056 n-d-master-1 devstack@keystone.service[80680]: WARNING oslo_log.versionutils [None req-b77b10b8-7581-4187-9a0c-3687d096ef2f tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 19 14:41:01.447691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b10b8-7581-4187-9a0c-3687d096ef2f tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=fd4ed00327304e18bfba9f0d96fc2686)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:01.449071 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-b77b10b8-7581-4187-9a0c-3687d096ef2f tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:41:01.449071 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:41:01.449071 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:41:01.450140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b10b8-7581-4187-9a0c-3687d096ef2f tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:01.538201 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3199/6354] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:01 2022] DELETE /identity/v3/policies/fd4ed00327304e18bfba9f0d96fc2686 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:01.544027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b10b8-7581-4187-9a0c-3687d096ef2f tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:01.549083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fd6670-b1e8-4632-95d5-026fe833a2a6 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:01.559599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc8f65-7253-4392-a9d3-968fefb3887c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:01.560899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc8f65-7253-4392-a9d3-968fefb3887c service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:01.561305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc8f65-7253-4392-a9d3-968fefb3887c service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:01.561625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc8f65-7253-4392-a9d3-968fefb3887c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:01.566978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b10b8-7581-4187-9a0c-3687d096ef2f tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:01.577939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc8f65-7253-4392-a9d3-968fefb3887c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:01.580205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0200e1f-04bd-4e04-a4e8-77000e721797 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:01.580433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc8f65-7253-4392-a9d3-968fefb3887c service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:01.584583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0200e1f-04bd-4e04-a4e8-77000e721797 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:01.590837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0200e1f-04bd-4e04-a4e8-77000e721797 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:01.590837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0200e1f-04bd-4e04-a4e8-77000e721797 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:01.590837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0200e1f-04bd-4e04-a4e8-77000e721797 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:01.590837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0200e1f-04bd-4e04-a4e8-77000e721797 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:01.609928 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3156/6355] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:01.612255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc8f65-7253-4392-a9d3-968fefb3887c service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:01.665405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc8f65-7253-4392-a9d3-968fefb3887c service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:01.669329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75ea5d-2640-4dff-bb17-116dc6da33cc tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '630180a7c16347dc9c791711a94e8f10', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2d31db00b61349169e2d4513879fb684', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:01.670257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75ea5d-2640-4dff-bb17-116dc6da33cc tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:01.674034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75ea5d-2640-4dff-bb17-116dc6da33cc tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:01.674034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c75ea5d-2640-4dff-bb17-116dc6da33cc tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] PATH_INFO: `/v3/policies/da7eb3635110423eabbe9620b6338456` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:01.674034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75ea5d-2640-4dff-bb17-116dc6da33cc tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=da7eb3635110423eabbe9620b6338456)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:01.675060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c75ea5d-2640-4dff-bb17-116dc6da33cc tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:01.683382 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:01.737209 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3200/6356] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:41:01 2022] POST /identity/v3/roles => generated 243 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:01.741353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0200e1f-04bd-4e04-a4e8-77000e721797 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:01.758884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0200e1f-04bd-4e04-a4e8-77000e721797 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:01.764666 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3157/6357] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:01 2022] DELETE /identity/v3/policies/da7eb3635110423eabbe9620b6338456 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:01.769317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d09c3-0e84-475f-b0d7-4b5c69670c4c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:01.769317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d09c3-0e84-475f-b0d7-4b5c69670c4c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:01.769317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d09c3-0e84-475f-b0d7-4b5c69670c4c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:01.769571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d09c3-0e84-475f-b0d7-4b5c69670c4c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:01.769571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d09c3-0e84-475f-b0d7-4b5c69670c4c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:01.770399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d09c3-0e84-475f-b0d7-4b5c69670c4c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:01.772377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75ea5d-2640-4dff-bb17-116dc6da33cc tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:01.775749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3c75ea5d-2640-4dff-bb17-116dc6da33cc tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:01.793675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c75ea5d-2640-4dff-bb17-116dc6da33cc tempest-PoliciesTestJSON-856429301 tempest-PoliciesTestJSON-856429301-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:01.800497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff240eb2-7b4e-4109-bc1e-51d2b038210b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:01.801462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff240eb2-7b4e-4109-bc1e-51d2b038210b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:01.801756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff240eb2-7b4e-4109-bc1e-51d2b038210b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:01.802039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff240eb2-7b4e-4109-bc1e-51d2b038210b admin admin] PATH_INFO: `/v3/users/a262c2b2552e41de9d86a8ea0b5e14d6` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:01.803342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff240eb2-7b4e-4109-bc1e-51d2b038210b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a262c2b2552e41de9d86a8ea0b5e14d6)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:01.805626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff240eb2-7b4e-4109-bc1e-51d2b038210b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:02.563195 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3201/6358] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:41:01 2022] POST /identity/v3/roles => generated 247 bytes in 822 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:02.568567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d09c3-0e84-475f-b0d7-4b5c69670c4c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:02.595967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d09c3-0e84-475f-b0d7-4b5c69670c4c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:02.608530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8402c5c-5ed7-40c0-8442-0d7a8418a447 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:02.609044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8402c5c-5ed7-40c0-8442-0d7a8418a447 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:02.609044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8402c5c-5ed7-40c0-8442-0d7a8418a447 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:02.609254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8402c5c-5ed7-40c0-8442-0d7a8418a447 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects/4a0c8f371c80434383e2b058c3c08caa/users/478065360e6040ffa825abbe0e334513/roles/e4ccad33bb3a4826a2c14322b6d71d95` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:02.639775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8402c5c-5ed7-40c0-8442-0d7a8418a447 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4a0c8f371c80434383e2b058c3c08caa, user_id=478065360e6040ffa825abbe0e334513, role_id=e4ccad33bb3a4826a2c14322b6d71d95)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:02.643746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8402c5c-5ed7-40c0-8442-0d7a8418a447 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:02.760154 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3202/6359] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:02 2022] PUT /identity/v3/projects/4a0c8f371c80434383e2b058c3c08caa/users/478065360e6040ffa825abbe0e334513/roles/e4ccad33bb3a4826a2c14322b6d71d95 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:02.763743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8402c5c-5ed7-40c0-8442-0d7a8418a447 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:02.879008 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:02.898018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8402c5c-5ed7-40c0-8442-0d7a8418a447 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:02.903683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfa12e-0e2a-4782-8f75-56a416ca7700 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:02.904805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfa12e-0e2a-4782-8f75-56a416ca7700 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:02.905106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfa12e-0e2a-4782-8f75-56a416ca7700 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:02.905395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfa12e-0e2a-4782-8f75-56a416ca7700 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects/4a0c8f371c80434383e2b058c3c08caa/users/478065360e6040ffa825abbe0e334513/roles/8ea124d02d1c4bffa0be5296319091d4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:02.906641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ff240eb2-7b4e-4109-bc1e-51d2b038210b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a262c2b2552e41de9d86a8ea0b5e14d6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:02.908035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfa12e-0e2a-4782-8f75-56a416ca7700 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4a0c8f371c80434383e2b058c3c08caa, user_id=478065360e6040ffa825abbe0e334513, role_id=8ea124d02d1c4bffa0be5296319091d4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:02.912311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfa12e-0e2a-4782-8f75-56a416ca7700 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:02.940593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ff240eb2-7b4e-4109-bc1e-51d2b038210b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a262c2b2552e41de9d86a8ea0b5e14d6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:02.942504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ff240eb2-7b4e-4109-bc1e-51d2b038210b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a262c2b2552e41de9d86a8ea0b5e14d6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:02.944143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ff240eb2-7b4e-4109-bc1e-51d2b038210b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a262c2b2552e41de9d86a8ea0b5e14d6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:02.961067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ff240eb2-7b4e-4109-bc1e-51d2b038210b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a262c2b2552e41de9d86a8ea0b5e14d6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:03.042632 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3158/6360] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:01 2022] DELETE /identity/v3/users/a262c2b2552e41de9d86a8ea0b5e14d6 => generated 0 bytes in 1272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:03.047618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af14666-a314-49b1-bb01-39f13c3ba22f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:03.048033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af14666-a314-49b1-bb01-39f13c3ba22f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:03.048488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af14666-a314-49b1-bb01-39f13c3ba22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:03.052776 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3203/6361] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:02 2022] PUT /identity/v3/projects/4a0c8f371c80434383e2b058c3c08caa/users/478065360e6040ffa825abbe0e334513/roles/8ea124d02d1c4bffa0be5296319091d4 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:41:03.053780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfa12e-0e2a-4782-8f75-56a416ca7700 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:03.056966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e4cfa12e-0e2a-4782-8f75-56a416ca7700 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:03.088113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4af14666-a314-49b1-bb01-39f13c3ba22f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:03.089506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4af14666-a314-49b1-bb01-39f13c3ba22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:03.240824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfa12e-0e2a-4782-8f75-56a416ca7700 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:03.256002 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3159/6362] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:41:03.267669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af14666-a314-49b1-bb01-39f13c3ba22f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:03.270435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4af14666-a314-49b1-bb01-39f13c3ba22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:03.333025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e4171-87e5-4f20-adbe-358a82051ec6 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:03.333791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e4171-87e5-4f20-adbe-358a82051ec6 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:03.334090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e4171-87e5-4f20-adbe-358a82051ec6 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:03.334425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e4171-87e5-4f20-adbe-358a82051ec6 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:03.335313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e4171-87e5-4f20-adbe-358a82051ec6 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:03.337431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e4171-87e5-4f20-adbe-358a82051ec6 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:03.372406 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3204/6363] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:03 2022] GET /identity/v3/users => generated 8047 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:03.378745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda3002-0b8a-4221-8cb6-1bf467012167 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:03.379053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda3002-0b8a-4221-8cb6-1bf467012167 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:03.379395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eda3002-0b8a-4221-8cb6-1bf467012167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:03.426352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0eda3002-0b8a-4221-8cb6-1bf467012167 None None] MFA Rules not processed for user `478065360e6040ffa825abbe0e334513`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:03.427681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0eda3002-0b8a-4221-8cb6-1bf467012167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:03.439496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af14666-a314-49b1-bb01-39f13c3ba22f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:03.459447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c20d60-47d4-4a5c-8ea7-99db635f6e8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:03.470156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c20d60-47d4-4a5c-8ea7-99db635f6e8f service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:03.470156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c20d60-47d4-4a5c-8ea7-99db635f6e8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:03.470156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c20d60-47d4-4a5c-8ea7-99db635f6e8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:03.491693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c20d60-47d4-4a5c-8ea7-99db635f6e8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:03.494360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c20d60-47d4-4a5c-8ea7-99db635f6e8f service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:03.520899 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3160/6364] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:41:03.522711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c20d60-47d4-4a5c-8ea7-99db635f6e8f service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:03.524782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-67c20d60-47d4-4a5c-8ea7-99db635f6e8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:03.541649 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3205/6365] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:03.544395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe8477-8144-4ba9-9719-002a673d4725 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:03.544395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe8477-8144-4ba9-9719-002a673d4725 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:03.544395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfe8477-8144-4ba9-9719-002a673d4725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:03.572313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c20d60-47d4-4a5c-8ea7-99db635f6e8f service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:03.589592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f70603-379c-4be7-b95f-cd44b01db788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:03.590581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f70603-379c-4be7-b95f-cd44b01db788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:03.594562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f70603-379c-4be7-b95f-cd44b01db788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:03.594863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f70603-379c-4be7-b95f-cd44b01db788 admin admin] PATH_INFO: `/v3/projects/d54d6ed893c14c7ebeb10f4de9e4b1a0` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:03.602272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f70603-379c-4be7-b95f-cd44b01db788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d54d6ed893c14c7ebeb10f4de9e4b1a0)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:03.609170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-adfe8477-8144-4ba9-9719-002a673d4725 None None] MFA Rules not processed for user `478065360e6040ffa825abbe0e334513`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:03.610360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f70603-379c-4be7-b95f-cd44b01db788 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:03.613391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-adfe8477-8144-4ba9-9719-002a673d4725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:03.646811 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:03.648126 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3206/6366] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:03.656419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe8477-8144-4ba9-9719-002a673d4725 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:03.688173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfe8477-8144-4ba9-9719-002a673d4725 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:03.704403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366334d-476b-4326-a85f-03bddd1b0af3 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478065360e6040ffa825abbe0e334513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a0c8f371c80434383e2b058c3c08caa', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-242934090', 'tempest-NotDelegatedRole-1700383495'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:03.705095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366334d-476b-4326-a85f-03bddd1b0af3 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:03.705447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366334d-476b-4326-a85f-03bddd1b0af3 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:03.705834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d366334d-476b-4326-a85f-03bddd1b0af3 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:03.706699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366334d-476b-4326-a85f-03bddd1b0af3 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] RBAC: Authorizing `identity:create_trust()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:03.712338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d366334d-476b-4326-a85f-03bddd1b0af3 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:03.836327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-82f70603-379c-4be7-b95f-cd44b01db788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd54d6ed893c14c7ebeb10f4de9e4b1a0', 'request_id': 'req-82f70603-379c-4be7-b95f-cd44b01db788'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:03.934273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-82f70603-379c-4be7-b95f-cd44b01db788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd54d6ed893c14c7ebeb10f4de9e4b1a0', 'request_id': 'req-82f70603-379c-4be7-b95f-cd44b01db788'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:03.944639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-82f70603-379c-4be7-b95f-cd44b01db788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd54d6ed893c14c7ebeb10f4de9e4b1a0', 'request_id': 'req-82f70603-379c-4be7-b95f-cd44b01db788'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:03.944845 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3207/6367] 10.222.0.43 () {60 vars in 1173 bytes} [Tue Jul 19 14:41:03 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:03.947401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366334d-476b-4326-a85f-03bddd1b0af3 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:03.969823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-82f70603-379c-4be7-b95f-cd44b01db788 admin admin] The token cache is being invalidate because project d54d6ed893c14c7ebeb10f4de9e4b1a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:03.972184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-82f70603-379c-4be7-b95f-cd44b01db788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:03.972184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-82f70603-379c-4be7-b95f-cd44b01db788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:03.972394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d366334d-476b-4326-a85f-03bddd1b0af3 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:03.973742 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3161/6368] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:03 2022] DELETE /identity/v3/projects/d54d6ed893c14c7ebeb10f4de9e4b1a0 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:03.977710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f70603-379c-4be7-b95f-cd44b01db788 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:03.980640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-82f70603-379c-4be7-b95f-cd44b01db788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:04.061476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4878ed-a3e0-405a-8fa9-9e754c2dc058 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478065360e6040ffa825abbe0e334513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a0c8f371c80434383e2b058c3c08caa', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-242934090', 'tempest-NotDelegatedRole-1700383495'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:04.062455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4878ed-a3e0-405a-8fa9-9e754c2dc058 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:04.062835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4878ed-a3e0-405a-8fa9-9e754c2dc058 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:04.063224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4878ed-a3e0-405a-8fa9-9e754c2dc058 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:04.066493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4878ed-a3e0-405a-8fa9-9e754c2dc058 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:04.072728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4878ed-a3e0-405a-8fa9-9e754c2dc058 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:04.090380 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:04.106010 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3208/6369] 10.222.0.43 () {58 vars in 1251 bytes} [Tue Jul 19 14:41:03 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=478065360e6040ffa825abbe0e334513 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:04.108758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4878ed-a3e0-405a-8fa9-9e754c2dc058 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:04.115603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2b4878ed-a3e0-405a-8fa9-9e754c2dc058 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:04.152585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f70603-379c-4be7-b95f-cd44b01db788 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:04.160146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4878ed-a3e0-405a-8fa9-9e754c2dc058 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:04.166917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0b87e-0bc9-4cd1-91d3-3423e6483d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:04.168078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0b87e-0bc9-4cd1-91d3-3423e6483d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:04.169691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0b87e-0bc9-4cd1-91d3-3423e6483d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:04.170163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf0b87e-0bc9-4cd1-91d3-3423e6483d90 admin admin] PATH_INFO: `/v3/users/a86b0b5e4c7142359ee384792486d3b2` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:04.172181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0b87e-0bc9-4cd1-91d3-3423e6483d90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a86b0b5e4c7142359ee384792486d3b2)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:04.173239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54d165-892b-4257-9424-a52cb87fad59 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478065360e6040ffa825abbe0e334513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a0c8f371c80434383e2b058c3c08caa', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-242934090', 'tempest-NotDelegatedRole-1700383495'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:04.175243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54d165-892b-4257-9424-a52cb87fad59 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:04.177205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf0b87e-0bc9-4cd1-91d3-3423e6483d90 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:04.178409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54d165-892b-4257-9424-a52cb87fad59 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:04.182204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54d165-892b-4257-9424-a52cb87fad59 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] PATH_INFO: `/v3/OS-TRUST/trusts/f9b7a43be1304df6914462505f3480da` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:04.232144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54d165-892b-4257-9424-a52cb87fad59 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] RBAC: Authorizing `identity:delete_trust(trust_id=f9b7a43be1304df6914462505f3480da)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:04.236223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc54d165-892b-4257-9424-a52cb87fad59 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:04.347500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fc54d165-892b-4257-9424-a52cb87fad59 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'f9b7a43be1304df6914462505f3480da', 'request_id': 'req-fc54d165-892b-4257-9424-a52cb87fad59'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:04.429732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fc54d165-892b-4257-9424-a52cb87fad59 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'f9b7a43be1304df6914462505f3480da', 'request_id': 'req-fc54d165-892b-4257-9424-a52cb87fad59'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:04.430658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fc54d165-892b-4257-9424-a52cb87fad59 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'f9b7a43be1304df6914462505f3480da', 'request_id': 'req-fc54d165-892b-4257-9424-a52cb87fad59'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:04.452030 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3209/6370] 10.222.0.43 () {58 vars in 1253 bytes} [Tue Jul 19 14:41:04 2022] DELETE /identity/v3/OS-TRUST/trusts/f9b7a43be1304df6914462505f3480da => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:04.459151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54d165-892b-4257-9424-a52cb87fad59 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:04.461109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ecf0b87e-0bc9-4cd1-91d3-3423e6483d90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a86b0b5e4c7142359ee384792486d3b2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:04.466646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fc54d165-892b-4257-9424-a52cb87fad59 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:04.535546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ecf0b87e-0bc9-4cd1-91d3-3423e6483d90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a86b0b5e4c7142359ee384792486d3b2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:04.539382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ecf0b87e-0bc9-4cd1-91d3-3423e6483d90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a86b0b5e4c7142359ee384792486d3b2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:04.542699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ecf0b87e-0bc9-4cd1-91d3-3423e6483d90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a86b0b5e4c7142359ee384792486d3b2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:04.549791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc54d165-892b-4257-9424-a52cb87fad59 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:04.569360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a0023-b7b9-43a0-9b9f-18fd15cfd841 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '478065360e6040ffa825abbe0e334513', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4a0c8f371c80434383e2b058c3c08caa', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-242934090', 'tempest-NotDelegatedRole-1700383495'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:04.573916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a0023-b7b9-43a0-9b9f-18fd15cfd841 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:04.574354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a0023-b7b9-43a0-9b9f-18fd15cfd841 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:04.577847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a0023-b7b9-43a0-9b9f-18fd15cfd841 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] PATH_INFO: `/v3/OS-TRUST/trusts/f9b7a43be1304df6914462505f3480da` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:04.584237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ecf0b87e-0bc9-4cd1-91d3-3423e6483d90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a86b0b5e4c7142359ee384792486d3b2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:04.638883 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-ca8a0023-b7b9-43a0-9b9f-18fd15cfd841 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] Could not find trust: f9b7a43be1304df6914462505f3480da.: keystone.exception.TrustNotFound: Could not find trust: f9b7a43be1304df6914462505f3480da. Jul 19 14:41:04.638883 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:04.638883 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:41:04.638883 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:41:04.638883 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:41:04.638883 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:41:04.638883 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:41:04.638883 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:41:04.638883 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:41:04.638883 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:41:04.638883 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:41:04.638883 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:41:04.638883 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 19 14:41:04.638883 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 19 14:41:04.638883 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 19 14:41:04.640493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 19 14:41:04.640493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 19 14:41:04.640493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 19 14:41:04.640493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 19 14:41:04.640493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 19 14:41:04.640493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:41:04.640493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:41:04.640493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 19 14:41:04.640493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 19 14:41:04.640493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 19 14:41:04.640493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 19 14:41:04.640493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: f9b7a43be1304df6914462505f3480da. Jul 19 14:41:04.640493 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:04.652918 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3210/6371] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jul 19 14:41:04 2022] GET /identity/v3/OS-TRUST/trusts/f9b7a43be1304df6914462505f3480da => generated 111 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:41:04.654173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a0023-b7b9-43a0-9b9f-18fd15cfd841 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:04.661943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ca8a0023-b7b9-43a0-9b9f-18fd15cfd841 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:04.716564 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3162/6372] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:03 2022] DELETE /identity/v3/users/a86b0b5e4c7142359ee384792486d3b2 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:41:04.895871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a0023-b7b9-43a0-9b9f-18fd15cfd841 tempest-TrustsV3TestJSON-1458766909 tempest-user-1174938562] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:05.009564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8887df-b62d-43f8-aabb-cdb1fcb54ad9 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:05.010444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8887df-b62d-43f8-aabb-cdb1fcb54ad9 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:05.010840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8887df-b62d-43f8-aabb-cdb1fcb54ad9 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:05.011130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8887df-b62d-43f8-aabb-cdb1fcb54ad9 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles/8ea124d02d1c4bffa0be5296319091d4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:05.013020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8887df-b62d-43f8-aabb-cdb1fcb54ad9 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_role(role_id=8ea124d02d1c4bffa0be5296319091d4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:05.015125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8887df-b62d-43f8-aabb-cdb1fcb54ad9 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:05.055518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0b87e-0bc9-4cd1-91d3-3423e6483d90 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:05.058309 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:05.060065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ecf0b87e-0bc9-4cd1-91d3-3423e6483d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:05.080419 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:05.200190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf0b87e-0bc9-4cd1-91d3-3423e6483d90 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:05.209448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dbbda-1285-4b67-ab18-1ae004aafef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:05.209448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dbbda-1285-4b67-ab18-1ae004aafef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:05.209448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dbbda-1285-4b67-ab18-1ae004aafef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:05.209448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dbbda-1285-4b67-ab18-1ae004aafef1 admin admin] PATH_INFO: `/v3/projects/6a1240659dbd40bc85dafb47b3da6138` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:05.209952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9dbbda-1285-4b67-ab18-1ae004aafef1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a1240659dbd40bc85dafb47b3da6138)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:05.210565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9dbbda-1285-4b67-ab18-1ae004aafef1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:05.220869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0c8887df-b62d-43f8-aabb-cdb1fcb54ad9 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invalidating the token cache because role 8ea124d02d1c4bffa0be5296319091d4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:05.221237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0c8887df-b62d-43f8-aabb-cdb1fcb54ad9 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:05.222131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0c8887df-b62d-43f8-aabb-cdb1fcb54ad9 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:05.225627 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3211/6373] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:04 2022] DELETE /identity/v3/roles/8ea124d02d1c4bffa0be5296319091d4 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:05.231318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8887df-b62d-43f8-aabb-cdb1fcb54ad9 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:05.235465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0c8887df-b62d-43f8-aabb-cdb1fcb54ad9 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:05.385204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8887df-b62d-43f8-aabb-cdb1fcb54ad9 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:05.403075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ba9dbbda-1285-4b67-ab18-1ae004aafef1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a1240659dbd40bc85dafb47b3da6138', 'request_id': 'req-ba9dbbda-1285-4b67-ab18-1ae004aafef1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:05.499701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ba9dbbda-1285-4b67-ab18-1ae004aafef1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a1240659dbd40bc85dafb47b3da6138', 'request_id': 'req-ba9dbbda-1285-4b67-ab18-1ae004aafef1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:05.509349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ba9dbbda-1285-4b67-ab18-1ae004aafef1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a1240659dbd40bc85dafb47b3da6138', 'request_id': 'req-ba9dbbda-1285-4b67-ab18-1ae004aafef1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:05.532583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cc60d-8fb4-47e6-b2fd-c1f453807aed tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:05.534065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cc60d-8fb4-47e6-b2fd-c1f453807aed tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:05.534650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cc60d-8fb4-47e6-b2fd-c1f453807aed tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:05.535564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cc60d-8fb4-47e6-b2fd-c1f453807aed tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles/e4ccad33bb3a4826a2c14322b6d71d95` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:05.538263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7cc60d-8fb4-47e6-b2fd-c1f453807aed tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e4ccad33bb3a4826a2c14322b6d71d95)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:05.538484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ba9dbbda-1285-4b67-ab18-1ae004aafef1 admin admin] The token cache is being invalidate because project 6a1240659dbd40bc85dafb47b3da6138 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:05.538734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ba9dbbda-1285-4b67-ab18-1ae004aafef1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:05.539440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ba9dbbda-1285-4b67-ab18-1ae004aafef1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:05.541129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7cc60d-8fb4-47e6-b2fd-c1f453807aed tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:05.541256 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3163/6374] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:05 2022] DELETE /identity/v3/projects/6a1240659dbd40bc85dafb47b3da6138 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:41:05.546915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dbbda-1285-4b67-ab18-1ae004aafef1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:05.549720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ba9dbbda-1285-4b67-ab18-1ae004aafef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:05.757875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dbbda-1285-4b67-ab18-1ae004aafef1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:05.768763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6f7cc60d-8fb4-47e6-b2fd-c1f453807aed tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invalidating the token cache because role e4ccad33bb3a4826a2c14322b6d71d95 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:05.770873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6f7cc60d-8fb4-47e6-b2fd-c1f453807aed tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:05.770873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6f7cc60d-8fb4-47e6-b2fd-c1f453807aed tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:05.780196 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3212/6375] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:05 2022] DELETE /identity/v3/roles/e4ccad33bb3a4826a2c14322b6d71d95 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:05.783001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cc60d-8fb4-47e6-b2fd-c1f453807aed tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:05.789294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6f7cc60d-8fb4-47e6-b2fd-c1f453807aed tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:05.792548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6873e-4da9-433b-ad01-fcf5b8a8dc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:05.795677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6873e-4da9-433b-ad01-fcf5b8a8dc62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:05.799084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6873e-4da9-433b-ad01-fcf5b8a8dc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:05.800303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6873e-4da9-433b-ad01-fcf5b8a8dc62 admin admin] PATH_INFO: `/v3/users/630180a7c16347dc9c791711a94e8f10` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:05.803080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6873e-4da9-433b-ad01-fcf5b8a8dc62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=630180a7c16347dc9c791711a94e8f10)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:05.813515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6873e-4da9-433b-ad01-fcf5b8a8dc62 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:06.014673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7cc60d-8fb4-47e6-b2fd-c1f453807aed tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:06.042155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9a16f-9f35-4277-b934-edcd1c6620dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:06.043346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9a16f-9f35-4277-b934-edcd1c6620dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:06.043770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9a16f-9f35-4277-b934-edcd1c6620dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:06.044130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9a16f-9f35-4277-b934-edcd1c6620dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/users/478065360e6040ffa825abbe0e334513` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:06.045507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9a16f-9f35-4277-b934-edcd1c6620dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_user(user_id=478065360e6040ffa825abbe0e334513)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:06.047828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b9a16f-9f35-4277-b934-edcd1c6620dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:06.122668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-afa6873e-4da9-433b-ad01-fcf5b8a8dc62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '630180a7c16347dc9c791711a94e8f10'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:06.149180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-afa6873e-4da9-433b-ad01-fcf5b8a8dc62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '630180a7c16347dc9c791711a94e8f10'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:06.150471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-afa6873e-4da9-433b-ad01-fcf5b8a8dc62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '630180a7c16347dc9c791711a94e8f10'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:06.151347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-afa6873e-4da9-433b-ad01-fcf5b8a8dc62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '630180a7c16347dc9c791711a94e8f10'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:06.160513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-afa6873e-4da9-433b-ad01-fcf5b8a8dc62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '630180a7c16347dc9c791711a94e8f10'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:06.284952 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3164/6376] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:05 2022] DELETE /identity/v3/users/630180a7c16347dc9c791711a94e8f10 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:41:06.340321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a0b9a16f-9f35-4277-b934-edcd1c6620dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '478065360e6040ffa825abbe0e334513'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:06.377929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a0b9a16f-9f35-4277-b934-edcd1c6620dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '478065360e6040ffa825abbe0e334513'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:06.400540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a0b9a16f-9f35-4277-b934-edcd1c6620dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '478065360e6040ffa825abbe0e334513'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:06.403718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a0b9a16f-9f35-4277-b934-edcd1c6620dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '478065360e6040ffa825abbe0e334513'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:06.511683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a0b9a16f-9f35-4277-b934-edcd1c6620dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '478065360e6040ffa825abbe0e334513'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:06.528813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6873e-4da9-433b-ad01-fcf5b8a8dc62 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:06.529379 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3213/6377] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:05 2022] DELETE /identity/v3/users/478065360e6040ffa825abbe0e334513 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:06.530616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-afa6873e-4da9-433b-ad01-fcf5b8a8dc62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:06.561748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9a16f-9f35-4277-b934-edcd1c6620dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:06.564588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a0b9a16f-9f35-4277-b934-edcd1c6620dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:06.736376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6873e-4da9-433b-ad01-fcf5b8a8dc62 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:06.804049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9a16f-9f35-4277-b934-edcd1c6620dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:06.821959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75418575-fc72-461f-9697-9d0de9258b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:06.822656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75418575-fc72-461f-9697-9d0de9258b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:06.823146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75418575-fc72-461f-9697-9d0de9258b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:06.823614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75418575-fc72-461f-9697-9d0de9258b29 admin admin] PATH_INFO: `/v3/projects/cb941bc6eb904768965429736882f6d4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:06.826445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75418575-fc72-461f-9697-9d0de9258b29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb941bc6eb904768965429736882f6d4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:06.831111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75418575-fc72-461f-9697-9d0de9258b29 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:06.857110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a6574-39fe-4e0d-a238-7c2d75091a76 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:06.869443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a6574-39fe-4e0d-a238-7c2d75091a76 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:06.869755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a6574-39fe-4e0d-a238-7c2d75091a76 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:06.870908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a6574-39fe-4e0d-a238-7c2d75091a76 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects/4a0c8f371c80434383e2b058c3c08caa` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:06.876366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a6574-39fe-4e0d-a238-7c2d75091a76 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4a0c8f371c80434383e2b058c3c08caa)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:06.881749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a6574-39fe-4e0d-a238-7c2d75091a76 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:07.068726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-75418575-fc72-461f-9697-9d0de9258b29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb941bc6eb904768965429736882f6d4', 'request_id': 'req-75418575-fc72-461f-9697-9d0de9258b29'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:07.085484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-75418575-fc72-461f-9697-9d0de9258b29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb941bc6eb904768965429736882f6d4', 'request_id': 'req-75418575-fc72-461f-9697-9d0de9258b29'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:07.098889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-75418575-fc72-461f-9697-9d0de9258b29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb941bc6eb904768965429736882f6d4', 'request_id': 'req-75418575-fc72-461f-9697-9d0de9258b29'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:07.121126 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:07.178543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d85a6574-39fe-4e0d-a238-7c2d75091a76 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a0c8f371c80434383e2b058c3c08caa', 'request_id': 'req-d85a6574-39fe-4e0d-a238-7c2d75091a76'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:07.241913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-75418575-fc72-461f-9697-9d0de9258b29 admin admin] The token cache is being invalidate because project cb941bc6eb904768965429736882f6d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:07.242279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-75418575-fc72-461f-9697-9d0de9258b29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:07.243734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-75418575-fc72-461f-9697-9d0de9258b29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:07.251290 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3214/6378] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:06 2022] DELETE /identity/v3/projects/cb941bc6eb904768965429736882f6d4 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:07.257738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509ee6b-147f-4855-ba6f-19613fbbfab3 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:07.258037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509ee6b-147f-4855-ba6f-19613fbbfab3 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:07.258361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6509ee6b-147f-4855-ba6f-19613fbbfab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:07.311804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6509ee6b-147f-4855-ba6f-19613fbbfab3 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:07.313064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6509ee6b-147f-4855-ba6f-19613fbbfab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:07.326578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d85a6574-39fe-4e0d-a238-7c2d75091a76 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a0c8f371c80434383e2b058c3c08caa', 'request_id': 'req-d85a6574-39fe-4e0d-a238-7c2d75091a76'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:07.334884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d85a6574-39fe-4e0d-a238-7c2d75091a76 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a0c8f371c80434383e2b058c3c08caa', 'request_id': 'req-d85a6574-39fe-4e0d-a238-7c2d75091a76'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:07.371972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d85a6574-39fe-4e0d-a238-7c2d75091a76 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] The token cache is being invalidate because project 4a0c8f371c80434383e2b058c3c08caa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:07.374016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d85a6574-39fe-4e0d-a238-7c2d75091a76 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:07.376116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d85a6574-39fe-4e0d-a238-7c2d75091a76 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:07.379530 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3165/6379] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:06 2022] DELETE /identity/v3/projects/4a0c8f371c80434383e2b058c3c08caa => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:41:07.388001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a6574-39fe-4e0d-a238-7c2d75091a76 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:07.398534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d85a6574-39fe-4e0d-a238-7c2d75091a76 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:07.452263 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3215/6380] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:07.459672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218958cf-33f0-4484-acda-a215e61c88ec None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:07.460160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218958cf-33f0-4484-acda-a215e61c88ec None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:07.460503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218958cf-33f0-4484-acda-a215e61c88ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:07.495814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-218958cf-33f0-4484-acda-a215e61c88ec None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:07.497068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-218958cf-33f0-4484-acda-a215e61c88ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:07.519762 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3216/6381] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:41:07.525930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218958cf-33f0-4484-acda-a215e61c88ec None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:07.539907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218958cf-33f0-4484-acda-a215e61c88ec None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:07.546391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60750af-e420-4ebc-aa4c-99015332f077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:07.547212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60750af-e420-4ebc-aa4c-99015332f077 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:07.547577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60750af-e420-4ebc-aa4c-99015332f077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:07.549025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60750af-e420-4ebc-aa4c-99015332f077 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:07.551109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60750af-e420-4ebc-aa4c-99015332f077 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:41:07.551510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60750af-e420-4ebc-aa4c-99015332f077 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:07.553452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60750af-e420-4ebc-aa4c-99015332f077 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:07.576529 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3217/6382] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:41:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:41:07.581372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60750af-e420-4ebc-aa4c-99015332f077 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:07.614524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60750af-e420-4ebc-aa4c-99015332f077 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:07.623474 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:07.636781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c8be1-c6d9-4dbb-a168-34029320938f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:07.637806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c8be1-c6d9-4dbb-a168-34029320938f admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:07.638090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a6574-39fe-4e0d-a238-7c2d75091a76 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:07.638965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c8be1-c6d9-4dbb-a168-34029320938f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:07.639336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c8be1-c6d9-4dbb-a168-34029320938f admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:07.642776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c8be1-c6d9-4dbb-a168-34029320938f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:07.647057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c8be1-c6d9-4dbb-a168-34029320938f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:07.652496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbfec35-6a39-4f35-9f53-26bbc776039c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:07.653199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfec35-6a39-4f35-9f53-26bbc776039c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:07.653496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfec35-6a39-4f35-9f53-26bbc776039c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:07.653782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfec35-6a39-4f35-9f53-26bbc776039c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:07.654566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbfec35-6a39-4f35-9f53-26bbc776039c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:07.656650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbfec35-6a39-4f35-9f53-26bbc776039c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:07.801770 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3218/6383] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:07 2022] POST /identity/v3/projects => generated 377 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:07.805937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c8be1-c6d9-4dbb-a168-34029320938f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:07.818841 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3166/6384] 10.222.0.43 () {60 vars in 1151 bytes} [Tue Jul 19 14:41:07 2022] POST /identity/v3/projects => generated 328 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:07.824050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbfec35-6a39-4f35-9f53-26bbc776039c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:07.973309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c8be1-c6d9-4dbb-a168-34029320938f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:07.978055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbfec35-6a39-4f35-9f53-26bbc776039c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:08.009227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12826a6-6c35-4b7c-b198-bb3455e37ddc tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:08.012817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12826a6-6c35-4b7c-b198-bb3455e37ddc tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:08.013156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12826a6-6c35-4b7c-b198-bb3455e37ddc tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:08.013449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12826a6-6c35-4b7c-b198-bb3455e37ddc tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:08.018638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12826a6-6c35-4b7c-b198-bb3455e37ddc tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:08.029845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12826a6-6c35-4b7c-b198-bb3455e37ddc tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:08.116168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdb23b-d8bc-497f-85f8-5123bd22445a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:08.116881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdb23b-d8bc-497f-85f8-5123bd22445a admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:08.117170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdb23b-d8bc-497f-85f8-5123bd22445a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:08.117454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdb23b-d8bc-497f-85f8-5123bd22445a admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:08.118205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fdb23b-d8bc-497f-85f8-5123bd22445a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:08.126713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fdb23b-d8bc-497f-85f8-5123bd22445a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:08.144812 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3167/6385] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:07 2022] POST /identity/v3/users => generated 413 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:08.148790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12826a6-6c35-4b7c-b198-bb3455e37ddc tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:08.171803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12826a6-6c35-4b7c-b198-bb3455e37ddc tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:08.185060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4babf24-1d46-446f-9f2e-110a8e160d9c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:08.186826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4babf24-1d46-446f-9f2e-110a8e160d9c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:08.189026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4babf24-1d46-446f-9f2e-110a8e160d9c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:08.193298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4babf24-1d46-446f-9f2e-110a8e160d9c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:08.194402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4babf24-1d46-446f-9f2e-110a8e160d9c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:08.198461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4babf24-1d46-446f-9f2e-110a8e160d9c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:08.220845 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3219/6386] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:07 2022] POST /identity/v3/users => generated 289 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:08.225193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdb23b-d8bc-497f-85f8-5123bd22445a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:08.244771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdb23b-d8bc-497f-85f8-5123bd22445a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:08.257277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894d2b1-dd8e-467f-abf4-6922c3f9dd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:08.258008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894d2b1-dd8e-467f-abf4-6922c3f9dd3b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:08.258336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894d2b1-dd8e-467f-abf4-6922c3f9dd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:08.258621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894d2b1-dd8e-467f-abf4-6922c3f9dd3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:08.259368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894d2b1-dd8e-467f-abf4-6922c3f9dd3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:08.260991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b894d2b1-dd8e-467f-abf4-6922c3f9dd3b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:08.291509 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3220/6387] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:08 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:41:08.300022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894d2b1-dd8e-467f-abf4-6922c3f9dd3b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:08.314608 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3168/6388] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:41:08 2022] POST /identity/v3/roles => generated 243 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:08.323370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4babf24-1d46-446f-9f2e-110a8e160d9c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:08.330234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b894d2b1-dd8e-467f-abf4-6922c3f9dd3b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:08.339372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4babf24-1d46-446f-9f2e-110a8e160d9c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:08.340852 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb9064-b386-40f8-aab0-a01d8a77700b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:08.342578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb9064-b386-40f8-aab0-a01d8a77700b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:08.342945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb9064-b386-40f8-aab0-a01d8a77700b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:08.344074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bb9064-b386-40f8-aab0-a01d8a77700b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:08.345299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701229d-08ae-48ac-b14c-9a99bfde5877 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:08.345749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb9064-b386-40f8-aab0-a01d8a77700b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:08.345983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701229d-08ae-48ac-b14c-9a99bfde5877 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:08.348279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701229d-08ae-48ac-b14c-9a99bfde5877 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:08.348279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5701229d-08ae-48ac-b14c-9a99bfde5877 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:08.348279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701229d-08ae-48ac-b14c-9a99bfde5877 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:08.349615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5701229d-08ae-48ac-b14c-9a99bfde5877 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:08.351006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bb9064-b386-40f8-aab0-a01d8a77700b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:08.380236 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3221/6389] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:08 2022] GET /identity/v3/roles => generated 1654 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:08.381890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb9064-b386-40f8-aab0-a01d8a77700b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:08.403441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bb9064-b386-40f8-aab0-a01d8a77700b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:08.408667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9454c0b-155c-495c-9005-2dece11f7da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:08.410295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9454c0b-155c-495c-9005-2dece11f7da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:08.410587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9454c0b-155c-495c-9005-2dece11f7da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:08.411010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9454c0b-155c-495c-9005-2dece11f7da1 admin admin] PATH_INFO: `/v3/projects/1927be7494fc47ffbfe030f2e8d7617b/users/eb4b258d1c024fd0896821ab005d0f25/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:08.435963 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3169/6390] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:41:08 2022] POST /identity/v3/roles => generated 247 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:41:08.439729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701229d-08ae-48ac-b14c-9a99bfde5877 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:08.452381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9454c0b-155c-495c-9005-2dece11f7da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1927be7494fc47ffbfe030f2e8d7617b, user_id=eb4b258d1c024fd0896821ab005d0f25, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:08.469741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9454c0b-155c-495c-9005-2dece11f7da1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:08.474417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5701229d-08ae-48ac-b14c-9a99bfde5877 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:08.489901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c66fb2-5259-4d80-9666-da0bf45aaf48 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:08.491433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c66fb2-5259-4d80-9666-da0bf45aaf48 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:08.491734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c66fb2-5259-4d80-9666-da0bf45aaf48 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:08.492066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c66fb2-5259-4d80-9666-da0bf45aaf48 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects/a3b899f86cba4f7f8f70e82144edf956/users/f51e33bde56b49cea48573778b56384f/roles/55dad7bb5bed4217b630c2c55278a15b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:08.519954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c66fb2-5259-4d80-9666-da0bf45aaf48 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a3b899f86cba4f7f8f70e82144edf956, user_id=f51e33bde56b49cea48573778b56384f, role_id=55dad7bb5bed4217b630c2c55278a15b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:08.550937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c66fb2-5259-4d80-9666-da0bf45aaf48 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:08.579036 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3222/6391] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:08 2022] PUT /identity/v3/projects/1927be7494fc47ffbfe030f2e8d7617b/users/eb4b258d1c024fd0896821ab005d0f25/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:08.594751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b896f-1786-40e3-9c6d-28d3b080b343 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:08.595380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b896f-1786-40e3-9c6d-28d3b080b343 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:08.595862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748b896f-1786-40e3-9c6d-28d3b080b343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:08.660767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-748b896f-1786-40e3-9c6d-28d3b080b343 None None] MFA Rules not processed for user `eb4b258d1c024fd0896821ab005d0f25`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:08.661988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-748b896f-1786-40e3-9c6d-28d3b080b343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:08.686145 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3170/6392] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:08 2022] PUT /identity/v3/projects/a3b899f86cba4f7f8f70e82144edf956/users/f51e33bde56b49cea48573778b56384f/roles/55dad7bb5bed4217b630c2c55278a15b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:41:08.693239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c66fb2-5259-4d80-9666-da0bf45aaf48 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:08.762246 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3223/6393] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:41:08.766832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b896f-1786-40e3-9c6d-28d3b080b343 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:08.843398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c66fb2-5259-4d80-9666-da0bf45aaf48 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:08.858261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96143b69-924a-42a1-947e-1f5b2a8c173d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:08.860844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96143b69-924a-42a1-947e-1f5b2a8c173d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:08.860844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96143b69-924a-42a1-947e-1f5b2a8c173d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:08.860844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96143b69-924a-42a1-947e-1f5b2a8c173d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects/a3b899f86cba4f7f8f70e82144edf956/users/f51e33bde56b49cea48573778b56384f/roles/b9a2c41d301047269b8d0729fbf3903e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:08.867240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96143b69-924a-42a1-947e-1f5b2a8c173d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a3b899f86cba4f7f8f70e82144edf956, user_id=f51e33bde56b49cea48573778b56384f, role_id=b9a2c41d301047269b8d0729fbf3903e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:08.873369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96143b69-924a-42a1-947e-1f5b2a8c173d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:08.880089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748b896f-1786-40e3-9c6d-28d3b080b343 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:08.935217 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:08.994589 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3171/6394] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:08 2022] PUT /identity/v3/projects/a3b899f86cba4f7f8f70e82144edf956/users/f51e33bde56b49cea48573778b56384f/roles/b9a2c41d301047269b8d0729fbf3903e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:41:08.998607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96143b69-924a-42a1-947e-1f5b2a8c173d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:09.015820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140df8f8-8d70-4bc9-b680-52a719399c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:09.016564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140df8f8-8d70-4bc9-b680-52a719399c07 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:09.016851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140df8f8-8d70-4bc9-b680-52a719399c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:09.017130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140df8f8-8d70-4bc9-b680-52a719399c07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:09.017882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140df8f8-8d70-4bc9-b680-52a719399c07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:09.021848 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:09.025247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140df8f8-8d70-4bc9-b680-52a719399c07 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:09.140892 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3224/6395] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:08 2022] POST /identity/v3/projects => generated 375 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:09.141930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140df8f8-8d70-4bc9-b680-52a719399c07 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:09.145296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-140df8f8-8d70-4bc9-b680-52a719399c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:09.157586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96143b69-924a-42a1-947e-1f5b2a8c173d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:09.278635 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b770b28-7130-4ca2-8eb9-fa058e60c388 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:09.282735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b770b28-7130-4ca2-8eb9-fa058e60c388 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:09.282735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b770b28-7130-4ca2-8eb9-fa058e60c388 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:09.283201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b770b28-7130-4ca2-8eb9-fa058e60c388 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:09.284304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b770b28-7130-4ca2-8eb9-fa058e60c388 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:09.285503 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-9b770b28-7130-4ca2-8eb9-fa058e60c388 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:41:09.285503 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:41:09.285503 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:41:09.287181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b770b28-7130-4ca2-8eb9-fa058e60c388 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:09.313736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140df8f8-8d70-4bc9-b680-52a719399c07 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:09.329441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acaffc1-da5a-4386-bbac-1f27e44e46fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:09.330526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acaffc1-da5a-4386-bbac-1f27e44e46fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:09.331031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acaffc1-da5a-4386-bbac-1f27e44e46fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:09.335013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acaffc1-da5a-4386-bbac-1f27e44e46fe admin admin] PATH_INFO: `/v3/projects/2d31db00b61349169e2d4513879fb684` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:09.339789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acaffc1-da5a-4386-bbac-1f27e44e46fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d31db00b61349169e2d4513879fb684)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:09.342363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acaffc1-da5a-4386-bbac-1f27e44e46fe admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:09.390743 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3172/6396] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:08 2022] GET /identity/v3/users => generated 7759 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:41:09.391754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b770b28-7130-4ca2-8eb9-fa058e60c388 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:09.418896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b770b28-7130-4ca2-8eb9-fa058e60c388 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:09.425941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d6a96-4e11-4821-b2c3-60e126670476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:09.428102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d6a96-4e11-4821-b2c3-60e126670476 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:09.429392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d6a96-4e11-4821-b2c3-60e126670476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:09.429695 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d6a96-4e11-4821-b2c3-60e126670476 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:09.430504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d6a96-4e11-4821-b2c3-60e126670476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:09.433949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3d6a96-4e11-4821-b2c3-60e126670476 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:09.537616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2acaffc1-da5a-4386-bbac-1f27e44e46fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d31db00b61349169e2d4513879fb684', 'request_id': 'req-2acaffc1-da5a-4386-bbac-1f27e44e46fe'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:09.556143 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3173/6397] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:09 2022] POST /identity/v3/users => generated 294 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:09.556976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2acaffc1-da5a-4386-bbac-1f27e44e46fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d31db00b61349169e2d4513879fb684', 'request_id': 'req-2acaffc1-da5a-4386-bbac-1f27e44e46fe'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:09.559459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a8867-52b1-42cf-9b34-68fe8b411fae None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:09.559758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a8867-52b1-42cf-9b34-68fe8b411fae None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:09.569518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0a8867-52b1-42cf-9b34-68fe8b411fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:09.573480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2acaffc1-da5a-4386-bbac-1f27e44e46fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d31db00b61349169e2d4513879fb684', 'request_id': 'req-2acaffc1-da5a-4386-bbac-1f27e44e46fe'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:09.645286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6c0a8867-52b1-42cf-9b34-68fe8b411fae None None] MFA Rules not processed for user `f51e33bde56b49cea48573778b56384f`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:09.646585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6c0a8867-52b1-42cf-9b34-68fe8b411fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:09.657162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2acaffc1-da5a-4386-bbac-1f27e44e46fe admin admin] The token cache is being invalidate because project 2d31db00b61349169e2d4513879fb684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:09.657573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2acaffc1-da5a-4386-bbac-1f27e44e46fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:09.658389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2acaffc1-da5a-4386-bbac-1f27e44e46fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:09.660841 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3225/6398] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:09 2022] DELETE /identity/v3/projects/2d31db00b61349169e2d4513879fb684 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:09.684205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acaffc1-da5a-4386-bbac-1f27e44e46fe admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:09.685945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2acaffc1-da5a-4386-bbac-1f27e44e46fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:09.811234 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3174/6399] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:09.812624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba34f20-b643-4b3d-ae30-5fdb1759af7c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:09.812919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba34f20-b643-4b3d-ae30-5fdb1759af7c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:09.813200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba34f20-b643-4b3d-ae30-5fdb1759af7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:09.860555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-bba34f20-b643-4b3d-ae30-5fdb1759af7c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:09.862224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bba34f20-b643-4b3d-ae30-5fdb1759af7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:09.904228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acaffc1-da5a-4386-bbac-1f27e44e46fe admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:09.911462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778c8424-12f2-43ec-ace3-10eca2fb20b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:09.912701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c8424-12f2-43ec-ace3-10eca2fb20b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:09.914057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c8424-12f2-43ec-ace3-10eca2fb20b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:09.914410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778c8424-12f2-43ec-ace3-10eca2fb20b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:09.915217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c8424-12f2-43ec-ace3-10eca2fb20b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:09.918839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778c8424-12f2-43ec-ace3-10eca2fb20b1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:09.934645 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3226/6400] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:09 2022] GET /identity/v3/roles => generated 1892 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:09.936303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a3e18-53c7-4f4d-9379-c115c1346e0f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:09.937216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a3e18-53c7-4f4d-9379-c115c1346e0f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:09.937512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a3e18-53c7-4f4d-9379-c115c1346e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:09.964984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9f9a3e18-53c7-4f4d-9379-c115c1346e0f None None] MFA Rules not processed for user `f51e33bde56b49cea48573778b56384f`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:09.966221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9f9a3e18-53c7-4f4d-9379-c115c1346e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:09.969978 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3175/6401] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:09.970936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba34f20-b643-4b3d-ae30-5fdb1759af7c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:09.981519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba34f20-b643-4b3d-ae30-5fdb1759af7c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:09.988010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e74b7-dbe6-4bc7-8e2e-e150194c9d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:09.989144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e74b7-dbe6-4bc7-8e2e-e150194c9d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:09.989554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e74b7-dbe6-4bc7-8e2e-e150194c9d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:09.989736 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3227/6402] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:09.990013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e74b7-dbe6-4bc7-8e2e-e150194c9d35 admin admin] PATH_INFO: `/v3/projects/0f36380e686c480992ce09b1d33b29ff/users/738541efb2504e048400e9e5e8cac8b1/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:09.991093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6127c05-e310-47d2-972f-9d642d8a9b3e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:09.991383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6127c05-e310-47d2-972f-9d642d8a9b3e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:09.991662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6127c05-e310-47d2-972f-9d642d8a9b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:10.011863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e74b7-dbe6-4bc7-8e2e-e150194c9d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f36380e686c480992ce09b1d33b29ff, user_id=738541efb2504e048400e9e5e8cac8b1, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:10.015088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e74b7-dbe6-4bc7-8e2e-e150194c9d35 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:10.017328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a6127c05-e310-47d2-972f-9d642d8a9b3e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:10.019413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a6127c05-e310-47d2-972f-9d642d8a9b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:10.029900 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3228/6403] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:10.030824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6127c05-e310-47d2-972f-9d642d8a9b3e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:10.043881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6127c05-e310-47d2-972f-9d642d8a9b3e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:10.048119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a06f25-f238-452f-9aef-fdd7117919a0 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e33bde56b49cea48573778b56384f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b899f86cba4f7f8f70e82144edf956', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1415211059', 'tempest-DelegatedRole-910779925'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:10.048823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a06f25-f238-452f-9aef-fdd7117919a0 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:10.049112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a06f25-f238-452f-9aef-fdd7117919a0 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:10.049922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a06f25-f238-452f-9aef-fdd7117919a0 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:10.050800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a06f25-f238-452f-9aef-fdd7117919a0 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: Authorizing `identity:create_trust()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:10.052071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a06f25-f238-452f-9aef-fdd7117919a0 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:10.103321 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3176/6404] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:09 2022] PUT /identity/v3/projects/0f36380e686c480992ce09b1d33b29ff/users/738541efb2504e048400e9e5e8cac8b1/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:10.107094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e74b7-dbe6-4bc7-8e2e-e150194c9d35 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:10.229122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e74b7-dbe6-4bc7-8e2e-e150194c9d35 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:10.229363 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3229/6405] 10.222.0.43 () {60 vars in 1173 bytes} [Tue Jul 19 14:41:10 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:10.229363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a06f25-f238-452f-9aef-fdd7117919a0 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:10.251094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7bc6d-b43b-4b0f-b6ec-672438220584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:10.251094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7bc6d-b43b-4b0f-b6ec-672438220584 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:10.251094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7bc6d-b43b-4b0f-b6ec-672438220584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:10.251094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7bc6d-b43b-4b0f-b6ec-672438220584 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:10.251811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7bc6d-b43b-4b0f-b6ec-672438220584 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:41:10.257124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7bc6d-b43b-4b0f-b6ec-672438220584 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:10.259162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7bc6d-b43b-4b0f-b6ec-672438220584 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:10.264752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a06f25-f238-452f-9aef-fdd7117919a0 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:10.293303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8fff6-a6e2-472d-a0c2-b9e8337c72e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:10.293303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8fff6-a6e2-472d-a0c2-b9e8337c72e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:10.293303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8fff6-a6e2-472d-a0c2-b9e8337c72e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:10.293303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8fff6-a6e2-472d-a0c2-b9e8337c72e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:10.293597 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3177/6406] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:10.294006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8fff6-a6e2-472d-a0c2-b9e8337c72e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:10.294081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7bc6d-b43b-4b0f-b6ec-672438220584 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:10.296488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8fff6-a6e2-472d-a0c2-b9e8337c72e1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:10.316474 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3230/6407] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:10 2022] GET /identity/v3/roles => generated 1892 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:10.317826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8fff6-a6e2-472d-a0c2-b9e8337c72e1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:10.330584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8fff6-a6e2-472d-a0c2-b9e8337c72e1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:10.345858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dcc13-d566-4697-8e01-6a1559d5602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:10.345858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dcc13-d566-4697-8e01-6a1559d5602f admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:10.345858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dcc13-d566-4697-8e01-6a1559d5602f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:10.345858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457dcc13-d566-4697-8e01-6a1559d5602f admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:10.346932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457dcc13-d566-4697-8e01-6a1559d5602f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:10.346932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457dcc13-d566-4697-8e01-6a1559d5602f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:10.403023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7bc6d-b43b-4b0f-b6ec-672438220584 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:10.407574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bd040-6be3-4c9f-b6c0-e3c57e11fc5d tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e33bde56b49cea48573778b56384f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b899f86cba4f7f8f70e82144edf956', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1415211059', 'tempest-DelegatedRole-910779925'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:10.408422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bd040-6be3-4c9f-b6c0-e3c57e11fc5d tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:10.409460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bd040-6be3-4c9f-b6c0-e3c57e11fc5d tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:10.409764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3bd040-6be3-4c9f-b6c0-e3c57e11fc5d tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] PATH_INFO: `/v3/OS-TRUST/trusts/98c38b34833b4b9fb055195f6c23cd60` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:10.441850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bd040-6be3-4c9f-b6c0-e3c57e11fc5d tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: Authorizing `identity:get_trust(trust_id=98c38b34833b4b9fb055195f6c23cd60)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:10.446171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3bd040-6be3-4c9f-b6c0-e3c57e11fc5d tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:10.462684 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3231/6408] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:10 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:10.463566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dcc13-d566-4697-8e01-6a1559d5602f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:10.607731 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:10.626083 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3178/6409] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jul 19 14:41:10 2022] GET /identity/v3/OS-TRUST/trusts/98c38b34833b4b9fb055195f6c23cd60 => generated 858 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:10.627593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bd040-6be3-4c9f-b6c0-e3c57e11fc5d tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:10.641577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3bd040-6be3-4c9f-b6c0-e3c57e11fc5d tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:10.655885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625ae46-732c-41d1-be44-7499cbb74b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:10.657167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625ae46-732c-41d1-be44-7499cbb74b5e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:10.657721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625ae46-732c-41d1-be44-7499cbb74b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:10.658262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4625ae46-732c-41d1-be44-7499cbb74b5e admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:10.660031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4625ae46-732c-41d1-be44-7499cbb74b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:10.662586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4625ae46-732c-41d1-be44-7499cbb74b5e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:10.663104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457dcc13-d566-4697-8e01-6a1559d5602f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:10.683399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee2273-9d2c-43bd-9d3b-edc482610ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:10.685473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee2273-9d2c-43bd-9d3b-edc482610ac9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:10.686155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee2273-9d2c-43bd-9d3b-edc482610ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:10.686472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee2273-9d2c-43bd-9d3b-edc482610ac9 admin admin] PATH_INFO: `/v3/projects/0f36380e686c480992ce09b1d33b29ff/users/738541efb2504e048400e9e5e8cac8b1/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:10.689022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee2273-9d2c-43bd-9d3b-edc482610ac9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f36380e686c480992ce09b1d33b29ff, user_id=738541efb2504e048400e9e5e8cac8b1, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:10.692136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee2273-9d2c-43bd-9d3b-edc482610ac9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:10.707989 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3232/6410] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:10 2022] PUT /identity/v3/projects/0f36380e686c480992ce09b1d33b29ff/users/738541efb2504e048400e9e5e8cac8b1/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:10.715728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee2273-9d2c-43bd-9d3b-edc482610ac9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:10.793300 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3179/6411] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:10 2022] POST /identity/v3/users => generated 284 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:10.797681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625ae46-732c-41d1-be44-7499cbb74b5e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:10.833531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4625ae46-732c-41d1-be44-7499cbb74b5e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:10.933980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b7de0-1a76-4d93-a0c2-9edd84268c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:10.935413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b7de0-1a76-4d93-a0c2-9edd84268c4c admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:10.936598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b7de0-1a76-4d93-a0c2-9edd84268c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:10.936598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b7de0-1a76-4d93-a0c2-9edd84268c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:10.941220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b7de0-1a76-4d93-a0c2-9edd84268c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:10.945900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b7de0-1a76-4d93-a0c2-9edd84268c4c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:10.984636 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3180/6412] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:10 2022] GET /identity/v3/roles => generated 1892 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:10.988392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee2273-9d2c-43bd-9d3b-edc482610ac9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:10.988945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea3a9a-d329-4a08-9962-0e9896a6868b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:10.988945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea3a9a-d329-4a08-9962-0e9896a6868b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:10.988945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea3a9a-d329-4a08-9962-0e9896a6868b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:10.999542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edbbba-2b08-4b00-9ce2-5be114394b38 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e33bde56b49cea48573778b56384f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b899f86cba4f7f8f70e82144edf956', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1415211059', 'tempest-DelegatedRole-910779925'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:11.000366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edbbba-2b08-4b00-9ce2-5be114394b38 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:11.000655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edbbba-2b08-4b00-9ce2-5be114394b38 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:11.000941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04edbbba-2b08-4b00-9ce2-5be114394b38 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] PATH_INFO: `/v3/OS-TRUST/trusts/98c38b34833b4b9fb055195f6c23cd60/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:11.027308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edbbba-2b08-4b00-9ce2-5be114394b38 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=98c38b34833b4b9fb055195f6c23cd60)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:11.028709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04edbbba-2b08-4b00-9ce2-5be114394b38 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:11.061938 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3233/6413] 10.222.0.43 () {58 vars in 1268 bytes} [Tue Jul 19 14:41:10 2022] GET /identity/v3/OS-TRUST/trusts/98c38b34833b4b9fb055195f6c23cd60/roles => generated 370 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:11.062548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edbbba-2b08-4b00-9ce2-5be114394b38 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:11.070938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e3ea3a9a-d329-4a08-9962-0e9896a6868b None None] MFA Rules not processed for user `738541efb2504e048400e9e5e8cac8b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:11.072603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e3ea3a9a-d329-4a08-9962-0e9896a6868b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:11.085011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04edbbba-2b08-4b00-9ce2-5be114394b38 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:11.093292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5e7c9-9cd9-40b1-8b3f-e83b46c4c63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:11.094087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5e7c9-9cd9-40b1-8b3f-e83b46c4c63a admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:11.094477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5e7c9-9cd9-40b1-8b3f-e83b46c4c63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:11.095262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5e7c9-9cd9-40b1-8b3f-e83b46c4c63a admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:11.096589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5e7c9-9cd9-40b1-8b3f-e83b46c4c63a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:11.099496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5e7c9-9cd9-40b1-8b3f-e83b46c4c63a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:11.117783 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3234/6414] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:11 2022] GET /identity/v3/roles => generated 1892 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:11.118973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5e7c9-9cd9-40b1-8b3f-e83b46c4c63a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:11.141577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5e7c9-9cd9-40b1-8b3f-e83b46c4c63a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:11.144600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce3e19-d162-40f6-bf66-e4f209a5c5ac tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e33bde56b49cea48573778b56384f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b899f86cba4f7f8f70e82144edf956', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1415211059', 'tempest-DelegatedRole-910779925'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:11.145955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce3e19-d162-40f6-bf66-e4f209a5c5ac tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:11.146387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce3e19-d162-40f6-bf66-e4f209a5c5ac tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:11.146744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce3e19-d162-40f6-bf66-e4f209a5c5ac tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] PATH_INFO: `/v3/OS-TRUST/trusts/98c38b34833b4b9fb055195f6c23cd60/roles/55dad7bb5bed4217b630c2c55278a15b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:11.163001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce3e19-d162-40f6-bf66-e4f209a5c5ac tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: Authorizing `identity:get_role_for_trust(trust_id=98c38b34833b4b9fb055195f6c23cd60, role_id=55dad7bb5bed4217b630c2c55278a15b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:11.169893 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:11.170272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce3e19-d162-40f6-bf66-e4f209a5c5ac tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:11.176075 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3181/6415] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:11.176075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea3a9a-d329-4a08-9962-0e9896a6868b None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:11.199723 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3235/6416] 10.222.0.43 () {58 vars in 1367 bytes} [Tue Jul 19 14:41:11 2022] GET /identity/v3/OS-TRUST/trusts/98c38b34833b4b9fb055195f6c23cd60/roles/55dad7bb5bed4217b630c2c55278a15b => generated 243 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:11.199723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce3e19-d162-40f6-bf66-e4f209a5c5ac tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:11.200364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea3a9a-d329-4a08-9962-0e9896a6868b None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:11.202566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-03ce3e19-d162-40f6-bf66-e4f209a5c5ac tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:11.210397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce06b29-a304-4fe3-9c58-10e619d0cba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:11.210397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce06b29-a304-4fe3-9c58-10e619d0cba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:11.210397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce06b29-a304-4fe3-9c58-10e619d0cba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:11.210397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce06b29-a304-4fe3-9c58-10e619d0cba2 admin admin] PATH_INFO: `/v3/projects/18a5b69ca6fb439aa12f932521147f59/users/384887324a2d4ae788eba4117c709610/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:11.234550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce06b29-a304-4fe3-9c58-10e619d0cba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a5b69ca6fb439aa12f932521147f59, user_id=384887324a2d4ae788eba4117c709610, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:11.243557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce06b29-a304-4fe3-9c58-10e619d0cba2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:11.308843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce3e19-d162-40f6-bf66-e4f209a5c5ac tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:11.312834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001657f-dc08-4471-87a8-a7afbc3f5e22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:11.321047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001657f-dc08-4471-87a8-a7afbc3f5e22 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:11.321047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001657f-dc08-4471-87a8-a7afbc3f5e22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:11.321047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001657f-dc08-4471-87a8-a7afbc3f5e22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:11.324356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001657f-dc08-4471-87a8-a7afbc3f5e22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:11.325825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001657f-dc08-4471-87a8-a7afbc3f5e22 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:11.338305 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3236/6417] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:11.338922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001657f-dc08-4471-87a8-a7afbc3f5e22 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:11.351848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001657f-dc08-4471-87a8-a7afbc3f5e22 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:11.359759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ef7b1-63a7-498a-bdb3-b06c025788bb tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e33bde56b49cea48573778b56384f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b899f86cba4f7f8f70e82144edf956', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1415211059', 'tempest-DelegatedRole-910779925'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:11.363445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ef7b1-63a7-498a-bdb3-b06c025788bb tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] REQUEST_METHOD: `HEAD` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:11.363857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ef7b1-63a7-498a-bdb3-b06c025788bb tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:11.364355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290ef7b1-63a7-498a-bdb3-b06c025788bb tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] PATH_INFO: `/v3/OS-TRUST/trusts/98c38b34833b4b9fb055195f6c23cd60/roles/55dad7bb5bed4217b630c2c55278a15b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:11.372877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ef7b1-63a7-498a-bdb3-b06c025788bb tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: Authorizing `identity:get_role_for_trust(trust_id=98c38b34833b4b9fb055195f6c23cd60, role_id=55dad7bb5bed4217b630c2c55278a15b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:11.374426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290ef7b1-63a7-498a-bdb3-b06c025788bb tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:11.383778 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3237/6418] 10.222.0.43 () {58 vars in 1368 bytes} [Tue Jul 19 14:41:11 2022] HEAD /identity/v3/OS-TRUST/trusts/98c38b34833b4b9fb055195f6c23cd60/roles/55dad7bb5bed4217b630c2c55278a15b => generated 0 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 19 14:41:11.387916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ef7b1-63a7-498a-bdb3-b06c025788bb tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:11.398057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290ef7b1-63a7-498a-bdb3-b06c025788bb tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:11.402361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4b1ce-6fc8-4710-ab1a-e42f929216dc tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e33bde56b49cea48573778b56384f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b899f86cba4f7f8f70e82144edf956', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1415211059', 'tempest-DelegatedRole-910779925'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:11.403236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4b1ce-6fc8-4710-ab1a-e42f929216dc tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:11.403526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4b1ce-6fc8-4710-ab1a-e42f929216dc tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:11.403821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4b1ce-6fc8-4710-ab1a-e42f929216dc tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] PATH_INFO: `/v3/OS-TRUST/trusts/98c38b34833b4b9fb055195f6c23cd60/roles/b9a2c41d301047269b8d0729fbf3903e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:11.411200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4b1ce-6fc8-4710-ab1a-e42f929216dc tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: Authorizing `identity:get_role_for_trust(trust_id=98c38b34833b4b9fb055195f6c23cd60, role_id=b9a2c41d301047269b8d0729fbf3903e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:11.412797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4b1ce-6fc8-4710-ab1a-e42f929216dc tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:11.434157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-4ea4b1ce-6fc8-4710-ab1a-e42f929216dc tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Could not find role: b9a2c41d301047269b8d0729fbf3903e.: keystone.exception.RoleNotFound: Could not find role: b9a2c41d301047269b8d0729fbf3903e. Jul 19 14:41:11.434157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:11.434157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:41:11.434157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:41:11.434157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:41:11.434157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:41:11.434157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:41:11.434157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:41:11.434157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:41:11.434157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:41:11.434157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:41:11.434157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:41:11.434157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 19 14:41:11.434157 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 14:41:11.435363 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: b9a2c41d301047269b8d0729fbf3903e. Jul 19 14:41:11.435363 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:11.435363 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3238/6419] 10.222.0.43 () {58 vars in 1367 bytes} [Tue Jul 19 14:41:11 2022] GET /identity/v3/OS-TRUST/trusts/98c38b34833b4b9fb055195f6c23cd60/roles/b9a2c41d301047269b8d0729fbf3903e => generated 110 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 19 14:41:11.449885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4b1ce-6fc8-4710-ab1a-e42f929216dc tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:11.464106 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3182/6420] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:11 2022] PUT /identity/v3/projects/18a5b69ca6fb439aa12f932521147f59/users/384887324a2d4ae788eba4117c709610/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:11.467018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4b1ce-6fc8-4710-ab1a-e42f929216dc tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:11.476276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e07ceb-f628-48b6-b1e3-5f8333f13986 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:11.476500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e07ceb-f628-48b6-b1e3-5f8333f13986 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:11.476788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e07ceb-f628-48b6-b1e3-5f8333f13986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:11.534092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a0e07ceb-f628-48b6-b1e3-5f8333f13986 None None] MFA Rules not processed for user `384887324a2d4ae788eba4117c709610`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:11.535423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a0e07ceb-f628-48b6-b1e3-5f8333f13986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:11.661853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a4467-fdfb-4c21-b61a-8841c6133cf7 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e33bde56b49cea48573778b56384f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b899f86cba4f7f8f70e82144edf956', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1415211059', 'tempest-DelegatedRole-910779925'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:11.662080 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3183/6421] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:11 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:11.663256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a4467-fdfb-4c21-b61a-8841c6133cf7 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] REQUEST_METHOD: `HEAD` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:11.663628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a4467-fdfb-4c21-b61a-8841c6133cf7 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:11.664012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93a4467-fdfb-4c21-b61a-8841c6133cf7 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] PATH_INFO: `/v3/OS-TRUST/trusts/98c38b34833b4b9fb055195f6c23cd60/roles/b9a2c41d301047269b8d0729fbf3903e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:11.666490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e07ceb-f628-48b6-b1e3-5f8333f13986 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:11.690667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a4467-fdfb-4c21-b61a-8841c6133cf7 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: Authorizing `identity:get_role_for_trust(trust_id=98c38b34833b4b9fb055195f6c23cd60, role_id=b9a2c41d301047269b8d0729fbf3903e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:11.692214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93a4467-fdfb-4c21-b61a-8841c6133cf7 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:11.715071 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-f93a4467-fdfb-4c21-b61a-8841c6133cf7 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Could not find role: b9a2c41d301047269b8d0729fbf3903e.: keystone.exception.RoleNotFound: Could not find role: b9a2c41d301047269b8d0729fbf3903e. Jul 19 14:41:11.715071 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:11.715071 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:41:11.715071 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:41:11.715071 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:41:11.715071 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:41:11.715071 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:41:11.715071 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:41:11.715071 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:41:11.715071 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:41:11.715071 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:41:11.715071 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:41:11.715071 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 19 14:41:11.715071 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 14:41:11.716072 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: b9a2c41d301047269b8d0729fbf3903e. Jul 19 14:41:11.716072 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:11.717482 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3239/6422] 10.222.0.43 () {58 vars in 1368 bytes} [Tue Jul 19 14:41:11 2022] HEAD /identity/v3/OS-TRUST/trusts/98c38b34833b4b9fb055195f6c23cd60/roles/b9a2c41d301047269b8d0729fbf3903e => generated 0 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jul 19 14:41:11.722371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a4467-fdfb-4c21-b61a-8841c6133cf7 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:11.752029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93a4467-fdfb-4c21-b61a-8841c6133cf7 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:11.758069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89b4c9-fc6a-4cc7-b13a-4914ef96c4a2 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e33bde56b49cea48573778b56384f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b899f86cba4f7f8f70e82144edf956', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1415211059', 'tempest-DelegatedRole-910779925'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:11.758954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89b4c9-fc6a-4cc7-b13a-4914ef96c4a2 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:11.759898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89b4c9-fc6a-4cc7-b13a-4914ef96c4a2 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:11.760336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89b4c9-fc6a-4cc7-b13a-4914ef96c4a2 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] PATH_INFO: `/v3/OS-TRUST/trusts/98c38b34833b4b9fb055195f6c23cd60` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:11.774192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89b4c9-fc6a-4cc7-b13a-4914ef96c4a2 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: Authorizing `identity:delete_trust(trust_id=98c38b34833b4b9fb055195f6c23cd60)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:11.775978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e89b4c9-fc6a-4cc7-b13a-4914ef96c4a2 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:11.797622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e07ceb-f628-48b6-b1e3-5f8333f13986 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:11.805974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4acfe-94ba-46f7-9c48-b954fe0ab12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:11.806654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4acfe-94ba-46f7-9c48-b954fe0ab12c admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:11.807036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4acfe-94ba-46f7-9c48-b954fe0ab12c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:11.807361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4acfe-94ba-46f7-9c48-b954fe0ab12c admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:11.808751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4acfe-94ba-46f7-9c48-b954fe0ab12c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:11.811802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4acfe-94ba-46f7-9c48-b954fe0ab12c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:11.920703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3e89b4c9-fc6a-4cc7-b13a-4914ef96c4a2 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '98c38b34833b4b9fb055195f6c23cd60', 'request_id': 'req-3e89b4c9-fc6a-4cc7-b13a-4914ef96c4a2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:11.929872 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3184/6423] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:11 2022] POST /identity/v3/projects => generated 367 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:41:11.930858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4acfe-94ba-46f7-9c48-b954fe0ab12c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:11.937574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f6f4acfe-94ba-46f7-9c48-b954fe0ab12c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:12.063946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3e89b4c9-fc6a-4cc7-b13a-4914ef96c4a2 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '98c38b34833b4b9fb055195f6c23cd60', 'request_id': 'req-3e89b4c9-fc6a-4cc7-b13a-4914ef96c4a2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:12.066375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3e89b4c9-fc6a-4cc7-b13a-4914ef96c4a2 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '98c38b34833b4b9fb055195f6c23cd60', 'request_id': 'req-3e89b4c9-fc6a-4cc7-b13a-4914ef96c4a2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:12.076399 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3240/6424] 10.222.0.43 () {58 vars in 1253 bytes} [Tue Jul 19 14:41:11 2022] DELETE /identity/v3/OS-TRUST/trusts/98c38b34833b4b9fb055195f6c23cd60 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:12.083857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89b4c9-fc6a-4cc7-b13a-4914ef96c4a2 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:12.086803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3e89b4c9-fc6a-4cc7-b13a-4914ef96c4a2 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:12.090041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4acfe-94ba-46f7-9c48-b954fe0ab12c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:12.107229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aa508-e447-453a-8237-a77ccd1642e8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:12.111409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aa508-e447-453a-8237-a77ccd1642e8 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:12.112956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aa508-e447-453a-8237-a77ccd1642e8 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:12.113472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0aa508-e447-453a-8237-a77ccd1642e8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:12.117615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6e0aa508-e447-453a-8237-a77ccd1642e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:12.126301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89b4c9-fc6a-4cc7-b13a-4914ef96c4a2 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:12.137854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0aa508-e447-453a-8237-a77ccd1642e8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:12.139655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0aa508-e447-453a-8237-a77ccd1642e8 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:12.157422 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3185/6425] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:12.158609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aa508-e447-453a-8237-a77ccd1642e8 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:12.160625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6e0aa508-e447-453a-8237-a77ccd1642e8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:12.252217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0aa508-e447-453a-8237-a77ccd1642e8 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:12.263846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ac8d6-1b9f-4cc6-9880-61df6937ada9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:12.265319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ac8d6-1b9f-4cc6-9880-61df6937ada9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:12.265614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ac8d6-1b9f-4cc6-9880-61df6937ada9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:12.265896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ac8d6-1b9f-4cc6-9880-61df6937ada9 admin admin] PATH_INFO: `/v3/users/2cb5060535f440a5b822500807c10688` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:12.268951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ac8d6-1b9f-4cc6-9880-61df6937ada9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cb5060535f440a5b822500807c10688)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:12.271223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ac8d6-1b9f-4cc6-9880-61df6937ada9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:12.285874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879bcaf-d14c-4235-8038-c8b97bab912b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:12.287163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879bcaf-d14c-4235-8038-c8b97bab912b admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:12.287659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879bcaf-d14c-4235-8038-c8b97bab912b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:12.288152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b879bcaf-d14c-4235-8038-c8b97bab912b admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:12.289210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879bcaf-d14c-4235-8038-c8b97bab912b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:12.292104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b879bcaf-d14c-4235-8038-c8b97bab912b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:12.467749 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3241/6426] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:12 2022] POST /identity/v3/users => generated 290 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:12.469116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879bcaf-d14c-4235-8038-c8b97bab912b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:12.472143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b879bcaf-d14c-4235-8038-c8b97bab912b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:12.560843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b879bcaf-d14c-4235-8038-c8b97bab912b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:12.567493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849db4b4-93cf-434a-8fc5-a08fc8e62625 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f51e33bde56b49cea48573778b56384f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a3b899f86cba4f7f8f70e82144edf956', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1415211059', 'tempest-DelegatedRole-910779925'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:12.572235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849db4b4-93cf-434a-8fc5-a08fc8e62625 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:12.572235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849db4b4-93cf-434a-8fc5-a08fc8e62625 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:12.572235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849db4b4-93cf-434a-8fc5-a08fc8e62625 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] PATH_INFO: `/v3/OS-TRUST/trusts/98c38b34833b4b9fb055195f6c23cd60` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:12.574922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-947ac8d6-1b9f-4cc6-9880-61df6937ada9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cb5060535f440a5b822500807c10688'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:12.582665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-849db4b4-93cf-434a-8fc5-a08fc8e62625 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Could not find trust: 98c38b34833b4b9fb055195f6c23cd60.: keystone.exception.TrustNotFound: Could not find trust: 98c38b34833b4b9fb055195f6c23cd60. Jul 19 14:41:12.582665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:12.582665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:41:12.582665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:41:12.582665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:41:12.582665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:41:12.582665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:41:12.582665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:41:12.582665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:41:12.582665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:41:12.582665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:41:12.582665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:41:12.582665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 19 14:41:12.582665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 19 14:41:12.582665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 19 14:41:12.584341 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 19 14:41:12.584341 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 19 14:41:12.584341 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 19 14:41:12.584341 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 19 14:41:12.584341 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 19 14:41:12.584341 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:41:12.584341 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:41:12.584341 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 19 14:41:12.584341 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 19 14:41:12.584341 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 19 14:41:12.584341 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 19 14:41:12.584341 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 98c38b34833b4b9fb055195f6c23cd60. Jul 19 14:41:12.584341 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:12.584341 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3242/6427] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jul 19 14:41:12 2022] GET /identity/v3/OS-TRUST/trusts/98c38b34833b4b9fb055195f6c23cd60 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:41:12.585148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849db4b4-93cf-434a-8fc5-a08fc8e62625 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:12.592066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-947ac8d6-1b9f-4cc6-9880-61df6937ada9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cb5060535f440a5b822500807c10688'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:12.592779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-947ac8d6-1b9f-4cc6-9880-61df6937ada9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cb5060535f440a5b822500807c10688'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:12.593559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-947ac8d6-1b9f-4cc6-9880-61df6937ada9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cb5060535f440a5b822500807c10688'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:12.597483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849db4b4-93cf-434a-8fc5-a08fc8e62625 tempest-TrustsV3TestJSON-584909797 tempest-user-171170002] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:12.602624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-947ac8d6-1b9f-4cc6-9880-61df6937ada9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cb5060535f440a5b822500807c10688'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:12.604925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfa830-4007-4eed-b22c-bbe8501a5e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:12.605584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfa830-4007-4eed-b22c-bbe8501a5e8c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:12.605928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfa830-4007-4eed-b22c-bbe8501a5e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:12.606249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dfa830-4007-4eed-b22c-bbe8501a5e8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:12.607054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dfa830-4007-4eed-b22c-bbe8501a5e8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:12.609147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dfa830-4007-4eed-b22c-bbe8501a5e8c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:12.624382 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3243/6428] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:12 2022] GET /identity/v3/roles => generated 1892 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:12.625328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfa830-4007-4eed-b22c-bbe8501a5e8c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:12.627854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-73dfa830-4007-4eed-b22c-bbe8501a5e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:12.743371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dfa830-4007-4eed-b22c-bbe8501a5e8c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:12.763539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db369d3-68ff-4efa-af35-06aafc4a42fa tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:12.764729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db369d3-68ff-4efa-af35-06aafc4a42fa tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:12.768178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db369d3-68ff-4efa-af35-06aafc4a42fa tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:12.768178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db369d3-68ff-4efa-af35-06aafc4a42fa tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles/b9a2c41d301047269b8d0729fbf3903e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:12.769317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db369d3-68ff-4efa-af35-06aafc4a42fa tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b9a2c41d301047269b8d0729fbf3903e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:12.772398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db369d3-68ff-4efa-af35-06aafc4a42fa tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:12.776502 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3186/6429] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:12 2022] DELETE /identity/v3/users/2cb5060535f440a5b822500807c10688 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:12.777569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ac8d6-1b9f-4cc6-9880-61df6937ada9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:12.779033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-947ac8d6-1b9f-4cc6-9880-61df6937ada9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:12.903325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ac8d6-1b9f-4cc6-9880-61df6937ada9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:12.913735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be89160-bcc2-45fe-b10b-839d1006e328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:12.914644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be89160-bcc2-45fe-b10b-839d1006e328 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:12.914934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be89160-bcc2-45fe-b10b-839d1006e328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:12.915263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be89160-bcc2-45fe-b10b-839d1006e328 admin admin] PATH_INFO: `/v3/projects/ce8dffdfdf6a43b6b8f2202f4b7730e9/users/7f6ea16c773c488cb6acad44efe8bad9/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:12.936513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be89160-bcc2-45fe-b10b-839d1006e328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce8dffdfdf6a43b6b8f2202f4b7730e9, user_id=7f6ea16c773c488cb6acad44efe8bad9, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:12.944630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be89160-bcc2-45fe-b10b-839d1006e328 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:13.114511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1db369d3-68ff-4efa-af35-06aafc4a42fa tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invalidating the token cache because role b9a2c41d301047269b8d0729fbf3903e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:13.115057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1db369d3-68ff-4efa-af35-06aafc4a42fa tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:13.115408 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3187/6430] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:12 2022] PUT /identity/v3/projects/ce8dffdfdf6a43b6b8f2202f4b7730e9/users/7f6ea16c773c488cb6acad44efe8bad9/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:13.115915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1db369d3-68ff-4efa-af35-06aafc4a42fa tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:13.120286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be89160-bcc2-45fe-b10b-839d1006e328 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:13.125743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2be89160-bcc2-45fe-b10b-839d1006e328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:13.126124 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3244/6431] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:12 2022] DELETE /identity/v3/roles/b9a2c41d301047269b8d0729fbf3903e => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:13.135539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db369d3-68ff-4efa-af35-06aafc4a42fa tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:13.138010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1db369d3-68ff-4efa-af35-06aafc4a42fa tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:13.288134 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:13.293452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db369d3-68ff-4efa-af35-06aafc4a42fa tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:13.299476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be89160-bcc2-45fe-b10b-839d1006e328 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:13.303433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e6dac-084f-4b27-bf25-24193da147b4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:13.304337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e6dac-084f-4b27-bf25-24193da147b4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:13.304748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e6dac-084f-4b27-bf25-24193da147b4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:13.305099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e6dac-084f-4b27-bf25-24193da147b4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles/55dad7bb5bed4217b630c2c55278a15b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:13.306798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e6dac-084f-4b27-bf25-24193da147b4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_role(role_id=55dad7bb5bed4217b630c2c55278a15b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:13.308637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e6dac-084f-4b27-bf25-24193da147b4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:13.394694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c07cb-3981-4b7d-a268-8a6296f47e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:13.395441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c07cb-3981-4b7d-a268-8a6296f47e86 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:13.395852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c07cb-3981-4b7d-a268-8a6296f47e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:13.396890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c07cb-3981-4b7d-a268-8a6296f47e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:13.398932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c07cb-3981-4b7d-a268-8a6296f47e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:13.400973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426c07cb-3981-4b7d-a268-8a6296f47e86 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:13.405945 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:13.419365 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3188/6432] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:13 2022] GET /identity/v3/roles => generated 1654 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:13.419365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c07cb-3981-4b7d-a268-8a6296f47e86 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:13.419365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-426c07cb-3981-4b7d-a268-8a6296f47e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:13.441856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c07cb-3981-4b7d-a268-8a6296f47e86 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:13.443255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9fb7e6-2522-43ae-bd86-9fad64842972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:13.444225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fb7e6-2522-43ae-bd86-9fad64842972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:13.444583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fb7e6-2522-43ae-bd86-9fad64842972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:13.444932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9fb7e6-2522-43ae-bd86-9fad64842972 admin admin] PATH_INFO: `/v3/projects/eb94ff13b1bd45be89521c4983a579d2` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:13.446246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fb7e6-2522-43ae-bd86-9fad64842972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb94ff13b1bd45be89521c4983a579d2)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:13.448455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9fb7e6-2522-43ae-bd86-9fad64842972 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:13.617600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-345e6dac-084f-4b27-bf25-24193da147b4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invalidating the token cache because role 55dad7bb5bed4217b630c2c55278a15b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:13.618358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-345e6dac-084f-4b27-bf25-24193da147b4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:13.619819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-345e6dac-084f-4b27-bf25-24193da147b4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:13.625481 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3245/6433] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:13 2022] DELETE /identity/v3/roles/55dad7bb5bed4217b630c2c55278a15b => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:13.627924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e6dac-084f-4b27-bf25-24193da147b4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:13.629184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9c9fb7e6-2522-43ae-bd86-9fad64842972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb94ff13b1bd45be89521c4983a579d2', 'request_id': 'req-9c9fb7e6-2522-43ae-bd86-9fad64842972'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:13.630926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-345e6dac-084f-4b27-bf25-24193da147b4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:13.740199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9c9fb7e6-2522-43ae-bd86-9fad64842972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb94ff13b1bd45be89521c4983a579d2', 'request_id': 'req-9c9fb7e6-2522-43ae-bd86-9fad64842972'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:13.741150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e6dac-084f-4b27-bf25-24193da147b4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:13.754160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9c9fb7e6-2522-43ae-bd86-9fad64842972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb94ff13b1bd45be89521c4983a579d2', 'request_id': 'req-9c9fb7e6-2522-43ae-bd86-9fad64842972'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:13.768086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873e10f-39a2-42bc-8cf7-e250508eb001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:13.769533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873e10f-39a2-42bc-8cf7-e250508eb001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:13.770363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873e10f-39a2-42bc-8cf7-e250508eb001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:13.770971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873e10f-39a2-42bc-8cf7-e250508eb001 admin admin] PATH_INFO: `/v3/projects/ce8dffdfdf6a43b6b8f2202f4b7730e9/users/7f6ea16c773c488cb6acad44efe8bad9/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:13.776102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873e10f-39a2-42bc-8cf7-e250508eb001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce8dffdfdf6a43b6b8f2202f4b7730e9, user_id=7f6ea16c773c488cb6acad44efe8bad9, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:13.786425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873e10f-39a2-42bc-8cf7-e250508eb001 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:13.787958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9c9fb7e6-2522-43ae-bd86-9fad64842972 admin admin] The token cache is being invalidate because project eb94ff13b1bd45be89521c4983a579d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:13.790238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9c9fb7e6-2522-43ae-bd86-9fad64842972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:13.791619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9c9fb7e6-2522-43ae-bd86-9fad64842972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:13.809118 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3246/6434] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:13 2022] PUT /identity/v3/projects/ce8dffdfdf6a43b6b8f2202f4b7730e9/users/7f6ea16c773c488cb6acad44efe8bad9/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:13.810001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873e10f-39a2-42bc-8cf7-e250508eb001 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:13.813956 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3189/6435] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:13 2022] DELETE /identity/v3/projects/eb94ff13b1bd45be89521c4983a579d2 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:13.814083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2873e10f-39a2-42bc-8cf7-e250508eb001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:13.824746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff100f1-f864-4181-9371-3a1efc09d84a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:13.828299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff100f1-f864-4181-9371-3a1efc09d84a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:13.829005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff100f1-f864-4181-9371-3a1efc09d84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:13.852333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3ff100f1-f864-4181-9371-3a1efc09d84a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:13.853538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3ff100f1-f864-4181-9371-3a1efc09d84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:13.926293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873e10f-39a2-42bc-8cf7-e250508eb001 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:13.934478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac5739-d504-433c-952e-45f99c39eb2a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:13.935723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac5739-d504-433c-952e-45f99c39eb2a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:13.936146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac5739-d504-433c-952e-45f99c39eb2a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:13.936532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac5739-d504-433c-952e-45f99c39eb2a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/users/f51e33bde56b49cea48573778b56384f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:13.938002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac5739-d504-433c-952e-45f99c39eb2a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f51e33bde56b49cea48573778b56384f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:13.940961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac5739-d504-433c-952e-45f99c39eb2a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:13.973498 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3190/6436] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:13.975053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feebde5-f60c-4874-9c15-2dd488b5ec18 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:13.975347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feebde5-f60c-4874-9c15-2dd488b5ec18 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:13.975842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feebde5-f60c-4874-9c15-2dd488b5ec18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:14.011994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4feebde5-f60c-4874-9c15-2dd488b5ec18 None None] MFA Rules not processed for user `7f6ea16c773c488cb6acad44efe8bad9`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:14.013445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4feebde5-f60c-4874-9c15-2dd488b5ec18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:14.088885 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3191/6437] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:13 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:14.090211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8fc90-302d-4a19-97b0-eed7e1c66647 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:14.090509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8fc90-302d-4a19-97b0-eed7e1c66647 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:14.090791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e8fc90-302d-4a19-97b0-eed7e1c66647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:14.119618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-95e8fc90-302d-4a19-97b0-eed7e1c66647 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:14.119618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-95e8fc90-302d-4a19-97b0-eed7e1c66647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:14.130086 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3192/6438] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:14.131756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8fc90-302d-4a19-97b0-eed7e1c66647 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:14.144624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e8fc90-302d-4a19-97b0-eed7e1c66647 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:14.151242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafb9b0-cc43-4164-a0f2-85433ad4d915 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f6ea16c773c488cb6acad44efe8bad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce8dffdfdf6a43b6b8f2202f4b7730e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:14.152640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafb9b0-cc43-4164-a0f2-85433ad4d915 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:14.153022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafb9b0-cc43-4164-a0f2-85433ad4d915 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:14.153511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafb9b0-cc43-4164-a0f2-85433ad4d915 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] PATH_INFO: `/v3/regions` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:14.154621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafb9b0-cc43-4164-a0f2-85433ad4d915 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:14.155893 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-5aafb9b0-cc43-4164-a0f2-85433ad4d915 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:41:14.155893 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:41:14.155893 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:41:14.156961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafb9b0-cc43-4164-a0f2-85433ad4d915 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:14.164247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-64ac5739-d504-433c-952e-45f99c39eb2a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f51e33bde56b49cea48573778b56384f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:14.179294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-64ac5739-d504-433c-952e-45f99c39eb2a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f51e33bde56b49cea48573778b56384f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:14.186897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-64ac5739-d504-433c-952e-45f99c39eb2a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f51e33bde56b49cea48573778b56384f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:14.188334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-64ac5739-d504-433c-952e-45f99c39eb2a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f51e33bde56b49cea48573778b56384f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:14.325152 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3193/6439] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:41:14 2022] POST /identity/v3/regions => generated 224 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:14.325152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafb9b0-cc43-4164-a0f2-85433ad4d915 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:14.347007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafb9b0-cc43-4164-a0f2-85433ad4d915 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:14.349643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-64ac5739-d504-433c-952e-45f99c39eb2a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f51e33bde56b49cea48573778b56384f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:14.353126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c75822-80cb-4a4c-adb9-f6f065163d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:14.353803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c75822-80cb-4a4c-adb9-f6f065163d59 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:14.354091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c75822-80cb-4a4c-adb9-f6f065163d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:14.354399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c75822-80cb-4a4c-adb9-f6f065163d59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:14.355139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c75822-80cb-4a4c-adb9-f6f065163d59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:41:14.355444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c75822-80cb-4a4c-adb9-f6f065163d59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:14.357037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c75822-80cb-4a4c-adb9-f6f065163d59 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:14.357789 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3247/6440] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:13 2022] DELETE /identity/v3/users/f51e33bde56b49cea48573778b56384f => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:14.362108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac5739-d504-433c-952e-45f99c39eb2a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:14.363643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-64ac5739-d504-433c-952e-45f99c39eb2a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:14.380602 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3194/6441] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:41:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:14.381730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c75822-80cb-4a4c-adb9-f6f065163d59 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:14.385896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-77c75822-80cb-4a4c-adb9-f6f065163d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:14.435315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c75822-80cb-4a4c-adb9-f6f065163d59 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:14.448052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac5739-d504-433c-952e-45f99c39eb2a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:14.478631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0a574-5219-4cbd-a759-53a91f5c598e tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f6ea16c773c488cb6acad44efe8bad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce8dffdfdf6a43b6b8f2202f4b7730e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:14.479508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0a574-5219-4cbd-a759-53a91f5c598e tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:14.479899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0a574-5219-4cbd-a759-53a91f5c598e tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:14.480287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de0a574-5219-4cbd-a759-53a91f5c598e tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] PATH_INFO: `/v3/regions` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:14.481119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0a574-5219-4cbd-a759-53a91f5c598e tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:14.482386 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-4de0a574-5219-4cbd-a759-53a91f5c598e tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:41:14.482386 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:41:14.482386 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:41:14.489119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de0a574-5219-4cbd-a759-53a91f5c598e tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:14.509683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bb9e7-e940-4bfd-8624-09ea82202be1 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:14.510678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bb9e7-e940-4bfd-8624-09ea82202be1 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:14.511695 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bb9e7-e940-4bfd-8624-09ea82202be1 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:14.511986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bb9e7-e940-4bfd-8624-09ea82202be1 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects/a3b899f86cba4f7f8f70e82144edf956` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:14.513444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bb9e7-e940-4bfd-8624-09ea82202be1 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a3b899f86cba4f7f8f70e82144edf956)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:14.516559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bb9e7-e940-4bfd-8624-09ea82202be1 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:14.611567 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3248/6442] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:41:14 2022] POST /identity/v3/regions => generated 223 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:14.612419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0a574-5219-4cbd-a759-53a91f5c598e tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:14.614587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4de0a574-5219-4cbd-a759-53a91f5c598e tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:14.714685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de0a574-5219-4cbd-a759-53a91f5c598e tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:14.762005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec5bb9e7-e940-4bfd-8624-09ea82202be1 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b899f86cba4f7f8f70e82144edf956', 'request_id': 'req-ec5bb9e7-e940-4bfd-8624-09ea82202be1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:14.778169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f87d7a-686e-414f-96fc-3af16bd0aef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:14.778852 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f87d7a-686e-414f-96fc-3af16bd0aef6 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:14.779170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f87d7a-686e-414f-96fc-3af16bd0aef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:14.779482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f87d7a-686e-414f-96fc-3af16bd0aef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:14.780261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f87d7a-686e-414f-96fc-3af16bd0aef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:14.783471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f87d7a-686e-414f-96fc-3af16bd0aef6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:14.877367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec5bb9e7-e940-4bfd-8624-09ea82202be1 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b899f86cba4f7f8f70e82144edf956', 'request_id': 'req-ec5bb9e7-e940-4bfd-8624-09ea82202be1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:14.890311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec5bb9e7-e940-4bfd-8624-09ea82202be1 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b899f86cba4f7f8f70e82144edf956', 'request_id': 'req-ec5bb9e7-e940-4bfd-8624-09ea82202be1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:14.911792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec5bb9e7-e940-4bfd-8624-09ea82202be1 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] The token cache is being invalidate because project a3b899f86cba4f7f8f70e82144edf956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:14.912183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec5bb9e7-e940-4bfd-8624-09ea82202be1 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:14.913140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec5bb9e7-e940-4bfd-8624-09ea82202be1 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:14.918028 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3195/6443] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:14 2022] DELETE /identity/v3/projects/a3b899f86cba4f7f8f70e82144edf956 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:14.922852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bb9e7-e940-4bfd-8624-09ea82202be1 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:14.922852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ec5bb9e7-e940-4bfd-8624-09ea82202be1 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:14.926489 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3249/6444] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:14 2022] POST /identity/v3/projects => generated 381 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:14.930691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f87d7a-686e-414f-96fc-3af16bd0aef6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:14.936484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-08f87d7a-686e-414f-96fc-3af16bd0aef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:15.030794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bb9e7-e940-4bfd-8624-09ea82202be1 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:15.057127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f87d7a-686e-414f-96fc-3af16bd0aef6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:15.062901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176106b6-0d18-4497-92ed-9437654f928f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:15.063454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176106b6-0d18-4497-92ed-9437654f928f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:15.068866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176106b6-0d18-4497-92ed-9437654f928f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:15.068866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176106b6-0d18-4497-92ed-9437654f928f admin admin] PATH_INFO: `/v3/users/eb4b258d1c024fd0896821ab005d0f25` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:15.068866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176106b6-0d18-4497-92ed-9437654f928f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb4b258d1c024fd0896821ab005d0f25)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:15.068866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176106b6-0d18-4497-92ed-9437654f928f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:15.107504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd263a-ed68-4f44-acab-5a9460986bf5 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f6ea16c773c488cb6acad44efe8bad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce8dffdfdf6a43b6b8f2202f4b7730e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:15.108384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd263a-ed68-4f44-acab-5a9460986bf5 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:15.108674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd263a-ed68-4f44-acab-5a9460986bf5 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:15.108954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd263a-ed68-4f44-acab-5a9460986bf5 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] PATH_INFO: `/v3/regions/54ac915b-7ea9-4481-a1b0-5f8bc29288e2` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:15.109693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd263a-ed68-4f44-acab-5a9460986bf5 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorizing `identity:create_region(region_id=54ac915b-7ea9-4481-a1b0-5f8bc29288e2)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:15.111349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accd263a-ed68-4f44-acab-5a9460986bf5 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:15.230415 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3196/6445] 10.222.0.43 () {60 vars in 1258 bytes} [Tue Jul 19 14:41:14 2022] PUT /identity/v3/regions/54ac915b-7ea9-4481-a1b0-5f8bc29288e2 => generated 230 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:15.231562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd263a-ed68-4f44-acab-5a9460986bf5 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:15.234671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-accd263a-ed68-4f44-acab-5a9460986bf5 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:15.324617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd263a-ed68-4f44-acab-5a9460986bf5 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:15.329912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ca49f-a858-472d-b17c-f2320c9732bd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:15.331246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ca49f-a858-472d-b17c-f2320c9732bd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:15.331545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ca49f-a858-472d-b17c-f2320c9732bd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:15.331836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ca49f-a858-472d-b17c-f2320c9732bd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:15.332574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ca49f-a858-472d-b17c-f2320c9732bd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:15.334515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ca49f-a858-472d-b17c-f2320c9732bd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:15.345370 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:15.369977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-176106b6-0d18-4497-92ed-9437654f928f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb4b258d1c024fd0896821ab005d0f25'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:15.390562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-176106b6-0d18-4497-92ed-9437654f928f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb4b258d1c024fd0896821ab005d0f25'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:15.399675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-176106b6-0d18-4497-92ed-9437654f928f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb4b258d1c024fd0896821ab005d0f25'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:15.400771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-176106b6-0d18-4497-92ed-9437654f928f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb4b258d1c024fd0896821ab005d0f25'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:15.418872 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:15.521476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-176106b6-0d18-4497-92ed-9437654f928f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb4b258d1c024fd0896821ab005d0f25'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:15.532199 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3250/6446] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:14 2022] DELETE /identity/v3/users/eb4b258d1c024fd0896821ab005d0f25 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:15.532199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176106b6-0d18-4497-92ed-9437654f928f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:15.534447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-176106b6-0d18-4497-92ed-9437654f928f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:15.541274 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3197/6447] 10.222.0.43 () {60 vars in 1151 bytes} [Tue Jul 19 14:41:15 2022] POST /identity/v3/projects => generated 328 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:15.541274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ca49f-a858-472d-b17c-f2320c9732bd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:15.555906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-367ca49f-a858-472d-b17c-f2320c9732bd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:15.620164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176106b6-0d18-4497-92ed-9437654f928f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:15.657334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ca49f-a858-472d-b17c-f2320c9732bd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:15.665395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67df27-592e-484c-8521-ab8948ce96a1 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f6ea16c773c488cb6acad44efe8bad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce8dffdfdf6a43b6b8f2202f4b7730e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:15.666339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67df27-592e-484c-8521-ab8948ce96a1 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:15.666683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67df27-592e-484c-8521-ab8948ce96a1 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:15.666968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67df27-592e-484c-8521-ab8948ce96a1 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] PATH_INFO: `/v3/regions/54ac915b-7ea9-4481-a1b0-5f8bc29288e2` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:15.667690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67df27-592e-484c-8521-ab8948ce96a1 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorizing `identity:delete_region(region_id=54ac915b-7ea9-4481-a1b0-5f8bc29288e2)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:15.669925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67df27-592e-484c-8521-ab8948ce96a1 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:15.699853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f139ad4-d7e3-49e7-b81e-4c0bbbf0746f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:15.700460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f139ad4-d7e3-49e7-b81e-4c0bbbf0746f admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:15.700930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f139ad4-d7e3-49e7-b81e-4c0bbbf0746f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:15.701222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f139ad4-d7e3-49e7-b81e-4c0bbbf0746f admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:15.702067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f139ad4-d7e3-49e7-b81e-4c0bbbf0746f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:15.704013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f139ad4-d7e3-49e7-b81e-4c0bbbf0746f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:15.819435 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3198/6448] 10.222.0.43 () {58 vars in 1241 bytes} [Tue Jul 19 14:41:15 2022] DELETE /identity/v3/regions/54ac915b-7ea9-4481-a1b0-5f8bc29288e2 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:15.825138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000582cd-231a-437c-8063-8007ac934333 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:15.825869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000582cd-231a-437c-8063-8007ac934333 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:15.826178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000582cd-231a-437c-8063-8007ac934333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:15.847369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-000582cd-231a-437c-8063-8007ac934333 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:15.848601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-000582cd-231a-437c-8063-8007ac934333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:15.869117 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3199/6449] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:15.869998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000582cd-231a-437c-8063-8007ac934333 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:15.871300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-000582cd-231a-437c-8063-8007ac934333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:15.944152 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3251/6450] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:15 2022] POST /identity/v3/users => generated 291 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:15.948372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f139ad4-d7e3-49e7-b81e-4c0bbbf0746f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:15.962349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f139ad4-d7e3-49e7-b81e-4c0bbbf0746f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:15.974014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000582cd-231a-437c-8063-8007ac934333 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:15.979223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca93b8-83ea-4714-9044-4e5d70702b15 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:15.979810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161755bf-bf67-41e2-9601-ef94683eda00 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f6ea16c773c488cb6acad44efe8bad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce8dffdfdf6a43b6b8f2202f4b7730e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:15.980127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca93b8-83ea-4714-9044-4e5d70702b15 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:15.980590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca93b8-83ea-4714-9044-4e5d70702b15 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:15.980715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161755bf-bf67-41e2-9601-ef94683eda00 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:15.981007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161755bf-bf67-41e2-9601-ef94683eda00 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:15.981118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca93b8-83ea-4714-9044-4e5d70702b15 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:15.982082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca93b8-83ea-4714-9044-4e5d70702b15 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:15.984075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca93b8-83ea-4714-9044-4e5d70702b15 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:15.987369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161755bf-bf67-41e2-9601-ef94683eda00 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] PATH_INFO: `/v3/regions` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:15.988335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161755bf-bf67-41e2-9601-ef94683eda00 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:15.990049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161755bf-bf67-41e2-9601-ef94683eda00 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:16.129835 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3200/6451] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:15 2022] POST /identity/v3/users => generated 416 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:16.135203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca93b8-83ea-4714-9044-4e5d70702b15 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:16.141938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-89ca93b8-83ea-4714-9044-4e5d70702b15 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:16.205746 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3252/6452] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Jul 19 14:41:15 2022] POST /identity/v3/regions => generated 252 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:16.207409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161755bf-bf67-41e2-9601-ef94683eda00 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:16.247107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161755bf-bf67-41e2-9601-ef94683eda00 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:16.258486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184d618-0c58-4fe1-896e-2b9b1594738b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:16.259708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184d618-0c58-4fe1-896e-2b9b1594738b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:16.260219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184d618-0c58-4fe1-896e-2b9b1594738b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:16.260660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184d618-0c58-4fe1-896e-2b9b1594738b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:16.261740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184d618-0c58-4fe1-896e-2b9b1594738b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:16.263479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b184d618-0c58-4fe1-896e-2b9b1594738b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:16.272545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca93b8-83ea-4714-9044-4e5d70702b15 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:16.274918 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3253/6453] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:16.278775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184d618-0c58-4fe1-896e-2b9b1594738b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:16.291197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb677b72-3b17-4680-a49f-c95a81833640 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:16.291734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb677b72-3b17-4680-a49f-c95a81833640 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:16.292074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb677b72-3b17-4680-a49f-c95a81833640 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:16.292360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb677b72-3b17-4680-a49f-c95a81833640 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:16.304876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb677b72-3b17-4680-a49f-c95a81833640 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:16.306485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb677b72-3b17-4680-a49f-c95a81833640 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:16.311163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184d618-0c58-4fe1-896e-2b9b1594738b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:16.316342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971842e-c847-4f98-8b9e-09f3e291d749 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:16.317014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971842e-c847-4f98-8b9e-09f3e291d749 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:16.317249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971842e-c847-4f98-8b9e-09f3e291d749 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:16.317532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971842e-c847-4f98-8b9e-09f3e291d749 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:16.318473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971842e-c847-4f98-8b9e-09f3e291d749 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:16.320935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971842e-c847-4f98-8b9e-09f3e291d749 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:16.329348 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3201/6454] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:16.330183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb677b72-3b17-4680-a49f-c95a81833640 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:16.363526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb677b72-3b17-4680-a49f-c95a81833640 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:16.369032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b64169-09b7-4c8c-bc51-28ad75cdf9aa tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f6ea16c773c488cb6acad44efe8bad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce8dffdfdf6a43b6b8f2202f4b7730e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:16.370227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b64169-09b7-4c8c-bc51-28ad75cdf9aa tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:16.370520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b64169-09b7-4c8c-bc51-28ad75cdf9aa tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:16.370798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b64169-09b7-4c8c-bc51-28ad75cdf9aa tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] PATH_INFO: `/v3/regions/fd1304eac7ae471883ad91cda85250c1` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:16.371758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b64169-09b7-4c8c-bc51-28ad75cdf9aa tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorizing `identity:update_region(region_id=fd1304eac7ae471883ad91cda85250c1)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:16.372917 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-c2b64169-09b7-4c8c-bc51-28ad75cdf9aa tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:41:16.372917 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:41:16.372917 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:41:16.374390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b64169-09b7-4c8c-bc51-28ad75cdf9aa tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:16.393844 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3254/6455] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:41:16 2022] POST /identity/v3/roles => generated 244 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:16.397710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971842e-c847-4f98-8b9e-09f3e291d749 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:16.413639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971842e-c847-4f98-8b9e-09f3e291d749 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:16.418947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264409eb-e79f-4144-b1d8-7503b370bdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:16.419723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264409eb-e79f-4144-b1d8-7503b370bdec admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:16.420009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264409eb-e79f-4144-b1d8-7503b370bdec admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:16.421647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264409eb-e79f-4144-b1d8-7503b370bdec admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:16.421647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264409eb-e79f-4144-b1d8-7503b370bdec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:16.422888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264409eb-e79f-4144-b1d8-7503b370bdec admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:16.436334 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3255/6456] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:16 2022] GET /identity/v3/roles => generated 1655 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:16.437124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264409eb-e79f-4144-b1d8-7503b370bdec admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:16.451497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264409eb-e79f-4144-b1d8-7503b370bdec admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:16.457347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68e135-fd4b-43b3-9c41-8117f830ad8b tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:16.458037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68e135-fd4b-43b3-9c41-8117f830ad8b tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:16.458478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68e135-fd4b-43b3-9c41-8117f830ad8b tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:16.458765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68e135-fd4b-43b3-9c41-8117f830ad8b tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:16.459568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68e135-fd4b-43b3-9c41-8117f830ad8b tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:16.461207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68e135-fd4b-43b3-9c41-8117f830ad8b tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:16.479091 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3202/6457] 10.222.0.43 () {60 vars in 1249 bytes} [Tue Jul 19 14:41:16 2022] PATCH /identity/v3/regions/fd1304eac7ae471883ad91cda85250c1 => generated 252 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:16.479091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b64169-09b7-4c8c-bc51-28ad75cdf9aa tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:16.512529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b64169-09b7-4c8c-bc51-28ad75cdf9aa tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:16.518136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2993b-307c-4e86-a186-a499d91936fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:16.519361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2993b-307c-4e86-a186-a499d91936fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:16.519967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2993b-307c-4e86-a186-a499d91936fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:16.520390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2993b-307c-4e86-a186-a499d91936fe admin admin] PATH_INFO: `/v3/projects/5af89581188b4be7ada96e3717ddc5ac/users/02bad968753a4aacb357bbae879e87ae/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:16.553605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2993b-307c-4e86-a186-a499d91936fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af89581188b4be7ada96e3717ddc5ac, user_id=02bad968753a4aacb357bbae879e87ae, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:16.560783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b2993b-307c-4e86-a186-a499d91936fe admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:16.571348 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3256/6458] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:41:16 2022] POST /identity/v3/roles => generated 247 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:16.579973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68e135-fd4b-43b3-9c41-8117f830ad8b tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:16.599326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68e135-fd4b-43b3-9c41-8117f830ad8b tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:16.621558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9e946-b3ee-471a-90c6-195241d3b38d tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f6ea16c773c488cb6acad44efe8bad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce8dffdfdf6a43b6b8f2202f4b7730e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:16.624025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9e946-b3ee-471a-90c6-195241d3b38d tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:16.624025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9e946-b3ee-471a-90c6-195241d3b38d tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:16.624025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd9e946-b3ee-471a-90c6-195241d3b38d tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] PATH_INFO: `/v3/regions/fd1304eac7ae471883ad91cda85250c1` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:16.624025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9e946-b3ee-471a-90c6-195241d3b38d tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorizing `identity:get_region(region_id=fd1304eac7ae471883ad91cda85250c1)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:16.624992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd9e946-b3ee-471a-90c6-195241d3b38d tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:16.636550 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3257/6459] 10.222.0.43 () {58 vars in 1226 bytes} [Tue Jul 19 14:41:16 2022] GET /identity/v3/regions/fd1304eac7ae471883ad91cda85250c1 => generated 252 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:16.637649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9e946-b3ee-471a-90c6-195241d3b38d tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:16.657401 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3203/6460] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:16 2022] PUT /identity/v3/projects/5af89581188b4be7ada96e3717ddc5ac/users/02bad968753a4aacb357bbae879e87ae/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:16.660237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2993b-307c-4e86-a186-a499d91936fe admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:16.708673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd9e946-b3ee-471a-90c6-195241d3b38d tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:16.825800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fd85d-1033-494d-aebf-2e3a6bb9355f tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:16.830305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fd85d-1033-494d-aebf-2e3a6bb9355f tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:16.833614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2993b-307c-4e86-a186-a499d91936fe admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:16.834698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fd85d-1033-494d-aebf-2e3a6bb9355f tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:16.835497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fd85d-1033-494d-aebf-2e3a6bb9355f tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects/bd4f70a9753e4e389e19232c7aa1c344/users/4f3428b4ac1048c0951639d4aaac5774/roles/b9ad55e179884abc9353c33961afab6b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:16.846565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb5ce1-3fbd-4f5d-8a72-03cff28640cb tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f6ea16c773c488cb6acad44efe8bad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce8dffdfdf6a43b6b8f2202f4b7730e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:16.847455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb5ce1-3fbd-4f5d-8a72-03cff28640cb tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:16.847789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb5ce1-3fbd-4f5d-8a72-03cff28640cb tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:16.848071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb5ce1-3fbd-4f5d-8a72-03cff28640cb tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] PATH_INFO: `/v3/regions/fd1304eac7ae471883ad91cda85250c1` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:16.848808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb5ce1-3fbd-4f5d-8a72-03cff28640cb tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorizing `identity:delete_region(region_id=fd1304eac7ae471883ad91cda85250c1)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:16.853094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb5ce1-3fbd-4f5d-8a72-03cff28640cb tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:16.869224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067fd85d-1033-494d-aebf-2e3a6bb9355f tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bd4f70a9753e4e389e19232c7aa1c344, user_id=4f3428b4ac1048c0951639d4aaac5774, role_id=b9ad55e179884abc9353c33961afab6b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:16.872837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067fd85d-1033-494d-aebf-2e3a6bb9355f tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:16.946274 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:16.951350 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3258/6461] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:16 2022] PUT /identity/v3/projects/bd4f70a9753e4e389e19232c7aa1c344/users/4f3428b4ac1048c0951639d4aaac5774/roles/b9ad55e179884abc9353c33961afab6b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:16.952792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8480d2e-9d60-46da-88a0-6ba230f205f5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:16.953027 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3204/6462] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:41:16 2022] DELETE /identity/v3/regions/fd1304eac7ae471883ad91cda85250c1 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:16.956495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8480d2e-9d60-46da-88a0-6ba230f205f5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:16.956495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8480d2e-9d60-46da-88a0-6ba230f205f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:16.956728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb5ce1-3fbd-4f5d-8a72-03cff28640cb tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:17.013159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb5ce1-3fbd-4f5d-8a72-03cff28640cb tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:17.023794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a8480d2e-9d60-46da-88a0-6ba230f205f5 None None] MFA Rules not processed for user `02bad968753a4aacb357bbae879e87ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:17.025005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a8480d2e-9d60-46da-88a0-6ba230f205f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:17.131787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27858f40-9ff2-401e-b212-53027804d5dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:17.133008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27858f40-9ff2-401e-b212-53027804d5dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:17.133450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27858f40-9ff2-401e-b212-53027804d5dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:17.134072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27858f40-9ff2-401e-b212-53027804d5dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects/bd4f70a9753e4e389e19232c7aa1c344/users/4f3428b4ac1048c0951639d4aaac5774/roles/3c95a29e59db47679d59bd5cdacaa236` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:17.147616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27858f40-9ff2-401e-b212-53027804d5dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_grant(project_id=bd4f70a9753e4e389e19232c7aa1c344, user_id=4f3428b4ac1048c0951639d4aaac5774, role_id=3c95a29e59db47679d59bd5cdacaa236)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:17.154246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27858f40-9ff2-401e-b212-53027804d5dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:17.155099 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3259/6463] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:17.156047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8480d2e-9d60-46da-88a0-6ba230f205f5 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:17.240652 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3205/6464] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:16 2022] PUT /identity/v3/projects/bd4f70a9753e4e389e19232c7aa1c344/users/4f3428b4ac1048c0951639d4aaac5774/roles/3c95a29e59db47679d59bd5cdacaa236 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:17.241671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27858f40-9ff2-401e-b212-53027804d5dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:17.244487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-27858f40-9ff2-401e-b212-53027804d5dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:17.253019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8480d2e-9d60-46da-88a0-6ba230f205f5 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:17.335528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f8b3f-a661-4ecb-a5ac-83b109541608 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f6ea16c773c488cb6acad44efe8bad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce8dffdfdf6a43b6b8f2202f4b7730e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:17.336397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f8b3f-a661-4ecb-a5ac-83b109541608 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:17.336763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f8b3f-a661-4ecb-a5ac-83b109541608 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:17.337121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f8b3f-a661-4ecb-a5ac-83b109541608 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] PATH_INFO: `/v3/regions` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:17.337911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f8b3f-a661-4ecb-a5ac-83b109541608 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:17.339184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f8b3f-a661-4ecb-a5ac-83b109541608 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:17.347388 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3260/6465] 10.222.0.43 () {58 vars in 1127 bytes} [Tue Jul 19 14:41:17 2022] GET /identity/v3/regions => generated 669 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:17.348238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f8b3f-a661-4ecb-a5ac-83b109541608 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:17.350072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fc0f8b3f-a661-4ecb-a5ac-83b109541608 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:17.364563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27858f40-9ff2-401e-b212-53027804d5dd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:17.369897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fe508-7f8c-470e-bfc2-28d891b2fa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:17.371097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fe508-7f8c-470e-bfc2-28d891b2fa70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:17.371594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fe508-7f8c-470e-bfc2-28d891b2fa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:17.372102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fe508-7f8c-470e-bfc2-28d891b2fa70 admin admin] PATH_INFO: `/v3/projects/1927be7494fc47ffbfe030f2e8d7617b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:17.373602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fe508-7f8c-470e-bfc2-28d891b2fa70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1927be7494fc47ffbfe030f2e8d7617b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:17.375448 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:17.376126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fe508-7f8c-470e-bfc2-28d891b2fa70 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:17.458849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f8b3f-a661-4ecb-a5ac-83b109541608 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:17.468471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ec85a-ce9e-49fe-85aa-7ece047b8115 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:17.472073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ec85a-ce9e-49fe-85aa-7ece047b8115 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:17.472073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ec85a-ce9e-49fe-85aa-7ece047b8115 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:17.472073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ec85a-ce9e-49fe-85aa-7ece047b8115 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:17.484479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7a8fe508-7f8c-470e-bfc2-28d891b2fa70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1927be7494fc47ffbfe030f2e8d7617b', 'request_id': 'req-7a8fe508-7f8c-470e-bfc2-28d891b2fa70'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:17.538835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ec85a-ce9e-49fe-85aa-7ece047b8115 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:17.540525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ec85a-ce9e-49fe-85aa-7ece047b8115 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:17.551804 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3261/6466] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:17.552594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ec85a-ce9e-49fe-85aa-7ece047b8115 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:17.584152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7a8fe508-7f8c-470e-bfc2-28d891b2fa70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1927be7494fc47ffbfe030f2e8d7617b', 'request_id': 'req-7a8fe508-7f8c-470e-bfc2-28d891b2fa70'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:17.592137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7a8fe508-7f8c-470e-bfc2-28d891b2fa70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1927be7494fc47ffbfe030f2e8d7617b', 'request_id': 'req-7a8fe508-7f8c-470e-bfc2-28d891b2fa70'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:17.613848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7a8fe508-7f8c-470e-bfc2-28d891b2fa70 admin admin] The token cache is being invalidate because project 1927be7494fc47ffbfe030f2e8d7617b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:17.614155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7a8fe508-7f8c-470e-bfc2-28d891b2fa70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:17.615850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7a8fe508-7f8c-470e-bfc2-28d891b2fa70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:17.619220 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3206/6467] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:17 2022] DELETE /identity/v3/projects/1927be7494fc47ffbfe030f2e8d7617b => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:17.622283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fe508-7f8c-470e-bfc2-28d891b2fa70 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:17.624069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7a8fe508-7f8c-470e-bfc2-28d891b2fa70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:17.663108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ec85a-ce9e-49fe-85aa-7ece047b8115 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:17.771774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf7a2a-9711-4150-8f88-13acfe05889d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:17.772280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf7a2a-9711-4150-8f88-13acfe05889d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:17.772692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf7a2a-9711-4150-8f88-13acfe05889d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:17.773074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bf7a2a-9711-4150-8f88-13acfe05889d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:17.774219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf7a2a-9711-4150-8f88-13acfe05889d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:17.776409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bf7a2a-9711-4150-8f88-13acfe05889d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:17.776763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fe508-7f8c-470e-bfc2-28d891b2fa70 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:17.807788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fefabf3-63ac-450d-8069-dc9d438de7d4 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f6ea16c773c488cb6acad44efe8bad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce8dffdfdf6a43b6b8f2202f4b7730e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:17.808991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefabf3-63ac-450d-8069-dc9d438de7d4 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:17.809452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefabf3-63ac-450d-8069-dc9d438de7d4 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:17.809753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fefabf3-63ac-450d-8069-dc9d438de7d4 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] PATH_INFO: `/v3/regions/fd1304eac7ae471883ad91cda85250c1` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:17.810549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefabf3-63ac-450d-8069-dc9d438de7d4 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorizing `identity:delete_region(region_id=fd1304eac7ae471883ad91cda85250c1)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:17.812315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fefabf3-63ac-450d-8069-dc9d438de7d4 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:17.819611 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3262/6468] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:17 2022] GET /identity/v3/users => generated 8322 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:17.820646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf7a2a-9711-4150-8f88-13acfe05889d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:17.823098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f6bf7a2a-9711-4150-8f88-13acfe05889d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:17.844199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-8fefabf3-63ac-450d-8069-dc9d438de7d4 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Could not find region: fd1304eac7ae471883ad91cda85250c1.: keystone.exception.RegionNotFound: Could not find region: fd1304eac7ae471883ad91cda85250c1. Jul 19 14:41:17.844199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:17.844199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Jul 19 14:41:17.844199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Jul 19 14:41:17.844199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Jul 19 14:41:17.844199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Jul 19 14:41:17.844199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Jul 19 14:41:17.844199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jul 19 14:41:17.844199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: fd1304eac7ae471883ad91cda85250c1. Jul 19 14:41:17.844199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:17.844199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:41:17.844199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:17.844199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:17.844199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:41:17.844199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:41:17.844199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:41:17.849987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:41:17.849987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:41:17.849987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:41:17.849987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:41:17.849987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:41:17.849987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:41:17.849987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:41:17.849987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Jul 19 14:41:17.849987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Jul 19 14:41:17.849987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:41:17.849987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:41:17.849987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Jul 19 14:41:17.849987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jul 19 14:41:17.849987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: fd1304eac7ae471883ad91cda85250c1. Jul 19 14:41:17.849987 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:17.849987 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3207/6469] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:41:17 2022] DELETE /identity/v3/regions/fd1304eac7ae471883ad91cda85250c1 => generated 112 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:41:17.850941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c402c-1524-4831-b599-dd139c2085a6 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:17.850941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c402c-1524-4831-b599-dd139c2085a6 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:17.850941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6c402c-1524-4831-b599-dd139c2085a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:17.870867 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:17.903185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-fd6c402c-1524-4831-b599-dd139c2085a6 None None] MFA Rules not processed for user `4f3428b4ac1048c0951639d4aaac5774`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:17.920198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fd6c402c-1524-4831-b599-dd139c2085a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:17.920306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bf7a2a-9711-4150-8f88-13acfe05889d tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:17.920306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9a9b0-04ce-4285-a104-56d97ad58e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:17.921283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9a9b0-04ce-4285-a104-56d97ad58e9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:17.921640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9a9b0-04ce-4285-a104-56d97ad58e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:17.922171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9a9b0-04ce-4285-a104-56d97ad58e9e admin admin] PATH_INFO: `/v3/users/738541efb2504e048400e9e5e8cac8b1` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:17.923932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9a9b0-04ce-4285-a104-56d97ad58e9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=738541efb2504e048400e9e5e8cac8b1)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:17.926359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9a9b0-04ce-4285-a104-56d97ad58e9e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:18.007106 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3208/6470] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:17 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:18.008240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c402c-1524-4831-b599-dd139c2085a6 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:18.029054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6c402c-1524-4831-b599-dd139c2085a6 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:18.038446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2de784-2163-4f08-b405-7425e6720fbc tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f6ea16c773c488cb6acad44efe8bad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce8dffdfdf6a43b6b8f2202f4b7730e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:18.039160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2de784-2163-4f08-b405-7425e6720fbc tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:18.039452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2de784-2163-4f08-b405-7425e6720fbc tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:18.039737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2de784-2163-4f08-b405-7425e6720fbc tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] PATH_INFO: `/v3/regions` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:18.040434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2de784-2163-4f08-b405-7425e6720fbc tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:18.041553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2de784-2163-4f08-b405-7425e6720fbc tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:18.054015 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3209/6471] 10.222.0.43 () {58 vars in 1127 bytes} [Tue Jul 19 14:41:18 2022] GET /identity/v3/regions => generated 669 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:18.055458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2234e-412d-4e20-a37d-81f3695e69ba None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:18.058448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2234e-412d-4e20-a37d-81f3695e69ba None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:18.058448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2234e-412d-4e20-a37d-81f3695e69ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:18.078082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b3c2234e-412d-4e20-a37d-81f3695e69ba None None] MFA Rules not processed for user `4f3428b4ac1048c0951639d4aaac5774`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:18.079569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b3c2234e-412d-4e20-a37d-81f3695e69ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:18.088728 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3210/6472] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:18.089803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2234e-412d-4e20-a37d-81f3695e69ba None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:18.118432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2234e-412d-4e20-a37d-81f3695e69ba None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:18.118432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88675d2-362e-407d-8dac-a656807f3a0f tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f6ea16c773c488cb6acad44efe8bad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce8dffdfdf6a43b6b8f2202f4b7730e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:18.118432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88675d2-362e-407d-8dac-a656807f3a0f tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:18.118708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88675d2-362e-407d-8dac-a656807f3a0f tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:18.118708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88675d2-362e-407d-8dac-a656807f3a0f tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] PATH_INFO: `/v3/regions` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:18.118708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88675d2-362e-407d-8dac-a656807f3a0f tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:18.121193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88675d2-362e-407d-8dac-a656807f3a0f tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:18.163859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-12c9a9b0-04ce-4285-a104-56d97ad58e9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '738541efb2504e048400e9e5e8cac8b1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:18.180413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-12c9a9b0-04ce-4285-a104-56d97ad58e9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '738541efb2504e048400e9e5e8cac8b1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:18.190637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-12c9a9b0-04ce-4285-a104-56d97ad58e9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '738541efb2504e048400e9e5e8cac8b1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:18.192067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-12c9a9b0-04ce-4285-a104-56d97ad58e9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '738541efb2504e048400e9e5e8cac8b1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:18.233428 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3211/6473] 10.222.0.43 () {60 vars in 1149 bytes} [Tue Jul 19 14:41:18 2022] POST /identity/v3/regions => generated 253 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:18.234625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88675d2-362e-407d-8dac-a656807f3a0f tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:18.275061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88675d2-362e-407d-8dac-a656807f3a0f tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:18.281480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e94f8-e1ba-4784-a75b-6f3fa8e507a7 tempest-TrustsV3TestJSON-420633629 tempest-user-1826190006] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f3428b4ac1048c0951639d4aaac5774', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4f70a9753e4e389e19232c7aa1c344', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1450488713', 'tempest-NotDelegatedRole-1873159624'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:18.282191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e94f8-e1ba-4784-a75b-6f3fa8e507a7 tempest-TrustsV3TestJSON-420633629 tempest-user-1826190006] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:18.282487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e94f8-e1ba-4784-a75b-6f3fa8e507a7 tempest-TrustsV3TestJSON-420633629 tempest-user-1826190006] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:18.283162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-12c9a9b0-04ce-4285-a104-56d97ad58e9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '738541efb2504e048400e9e5e8cac8b1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:18.283275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e94f8-e1ba-4784-a75b-6f3fa8e507a7 tempest-TrustsV3TestJSON-420633629 tempest-user-1826190006] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:18.284890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e94f8-e1ba-4784-a75b-6f3fa8e507a7 tempest-TrustsV3TestJSON-420633629 tempest-user-1826190006] RBAC: Authorizing `identity:create_trust()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:18.286292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e94f8-e1ba-4784-a75b-6f3fa8e507a7 tempest-TrustsV3TestJSON-420633629 tempest-user-1826190006] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:18.292066 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3263/6474] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:17 2022] DELETE /identity/v3/users/738541efb2504e048400e9e5e8cac8b1 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:18.298063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9a9b0-04ce-4285-a104-56d97ad58e9e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:18.299093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-12c9a9b0-04ce-4285-a104-56d97ad58e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:18.464774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9a9b0-04ce-4285-a104-56d97ad58e9e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:18.482291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c78fc0-9eba-4411-85b6-5a8efe0ae247 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f6ea16c773c488cb6acad44efe8bad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce8dffdfdf6a43b6b8f2202f4b7730e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:18.483367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c78fc0-9eba-4411-85b6-5a8efe0ae247 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:18.483726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c78fc0-9eba-4411-85b6-5a8efe0ae247 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:18.484226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c78fc0-9eba-4411-85b6-5a8efe0ae247 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] PATH_INFO: `/v3/regions` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:18.484780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-138e94f8-e1ba-4784-a75b-6f3fa8e507a7 tempest-TrustsV3TestJSON-420633629 tempest-user-1826190006] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jul 19 14:41:18.484780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:18.484780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Jul 19 14:41:18.484780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Jul 19 14:41:18.484780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Jul 19 14:41:18.484780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Jul 19 14:41:18.484780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Jul 19 14:41:18.484780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:18.484780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:41:18.484780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:18.484780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:18.484780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Jul 19 14:41:18.484780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Jul 19 14:41:18.484780 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Jul 19 14:41:18.485866 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise ValueError(str(e)) Jul 19 14:41:18.485866 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Jul 19 14:41:18.485866 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:18.485866 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:41:18.485866 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:18.485866 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:18.485866 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:41:18.485866 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:41:18.485866 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:41:18.485866 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:41:18.485866 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:41:18.485866 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:41:18.485866 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:41:18.485866 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:41:18.485866 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:41:18.485866 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:41:18.485866 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Jul 19 14:41:18.485866 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Jul 19 14:41:18.487174 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Jul 19 14:41:18.487174 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Jul 19 14:41:18.487174 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Jul 19 14:41:18.487174 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Jul 19 14:41:18.487174 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jul 19 14:41:18.487174 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:18.487535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c78fc0-9eba-4411-85b6-5a8efe0ae247 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Adding query filter params (parent_region_id=9049dbd5c0b840d98231628bace0d61f) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:41:18.487535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c78fc0-9eba-4411-85b6-5a8efe0ae247 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:18.487671 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3212/6475] 10.222.0.43 () {60 vars in 1173 bytes} [Tue Jul 19 14:41:18 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 253 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 19 14:41:18.487752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c78fc0-9eba-4411-85b6-5a8efe0ae247 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:18.490717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e94f8-e1ba-4784-a75b-6f3fa8e507a7 tempest-TrustsV3TestJSON-420633629 tempest-user-1826190006] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:18.492576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-138e94f8-e1ba-4784-a75b-6f3fa8e507a7 tempest-TrustsV3TestJSON-420633629 tempest-user-1826190006] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:18.499407 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3264/6476] 10.222.0.43 () {58 vars in 1226 bytes} [Tue Jul 19 14:41:18 2022] GET /identity/v3/regions?parent_region_id=9049dbd5c0b840d98231628bace0d61f => generated 399 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:18.500556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c78fc0-9eba-4411-85b6-5a8efe0ae247 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:18.516465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c78fc0-9eba-4411-85b6-5a8efe0ae247 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:18.527685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e94f8-e1ba-4784-a75b-6f3fa8e507a7 tempest-TrustsV3TestJSON-420633629 tempest-user-1826190006] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:18.541462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7ec7b-bad4-44c1-84f7-c03a5b78631a tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f6ea16c773c488cb6acad44efe8bad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce8dffdfdf6a43b6b8f2202f4b7730e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:18.544068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7ec7b-bad4-44c1-84f7-c03a5b78631a tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:18.545121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7ec7b-bad4-44c1-84f7-c03a5b78631a tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:18.545615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7ec7b-bad4-44c1-84f7-c03a5b78631a tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] PATH_INFO: `/v3/regions/f3376863c3cf4b92993f2fec5d7984dd` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:18.553412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7ec7b-bad4-44c1-84f7-c03a5b78631a tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorizing `identity:delete_region(region_id=f3376863c3cf4b92993f2fec5d7984dd)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:18.553412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d7ec7b-bad4-44c1-84f7-c03a5b78631a tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:18.677171 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:18.683297 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3265/6477] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:41:18 2022] DELETE /identity/v3/regions/f3376863c3cf4b92993f2fec5d7984dd => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:18.690487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7ec7b-bad4-44c1-84f7-c03a5b78631a tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:18.705657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82205ec-f42c-42e7-859b-5a55e621882a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:18.707536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82205ec-f42c-42e7-859b-5a55e621882a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:18.708175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82205ec-f42c-42e7-859b-5a55e621882a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:18.708175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82205ec-f42c-42e7-859b-5a55e621882a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles/3c95a29e59db47679d59bd5cdacaa236` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:18.710046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82205ec-f42c-42e7-859b-5a55e621882a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3c95a29e59db47679d59bd5cdacaa236)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:18.715988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82205ec-f42c-42e7-859b-5a55e621882a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:18.761597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7ec7b-bad4-44c1-84f7-c03a5b78631a tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:18.774754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba550f-d3f4-42d9-a058-239bc08f4999 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f6ea16c773c488cb6acad44efe8bad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce8dffdfdf6a43b6b8f2202f4b7730e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:18.776454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba550f-d3f4-42d9-a058-239bc08f4999 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:18.776908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba550f-d3f4-42d9-a058-239bc08f4999 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:18.777349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba550f-d3f4-42d9-a058-239bc08f4999 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] PATH_INFO: `/v3/regions/292d112e52334d5286ffaf64c50c5237` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:18.778213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba550f-d3f4-42d9-a058-239bc08f4999 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorizing `identity:delete_region(region_id=292d112e52334d5286ffaf64c50c5237)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:18.785522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba550f-d3f4-42d9-a058-239bc08f4999 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:18.917798 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:18.928604 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3266/6478] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:41:18 2022] DELETE /identity/v3/regions/292d112e52334d5286ffaf64c50c5237 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:18.933840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba550f-d3f4-42d9-a058-239bc08f4999 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:18.976995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba550f-d3f4-42d9-a058-239bc08f4999 tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:19.010343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013ea9b-fb1c-4dde-a84f-833e876c700e tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f6ea16c773c488cb6acad44efe8bad9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce8dffdfdf6a43b6b8f2202f4b7730e9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:19.012376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013ea9b-fb1c-4dde-a84f-833e876c700e tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:19.013192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013ea9b-fb1c-4dde-a84f-833e876c700e tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:19.013488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6013ea9b-fb1c-4dde-a84f-833e876c700e tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] PATH_INFO: `/v3/regions/9049dbd5c0b840d98231628bace0d61f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:19.014403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013ea9b-fb1c-4dde-a84f-833e876c700e tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorizing `identity:delete_region(region_id=9049dbd5c0b840d98231628bace0d61f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:19.016273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6013ea9b-fb1c-4dde-a84f-833e876c700e tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:19.027999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f82205ec-f42c-42e7-859b-5a55e621882a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invalidating the token cache because role 3c95a29e59db47679d59bd5cdacaa236 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:19.028280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f82205ec-f42c-42e7-859b-5a55e621882a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:19.036262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f82205ec-f42c-42e7-859b-5a55e621882a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:19.036262 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3213/6479] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:18 2022] DELETE /identity/v3/roles/3c95a29e59db47679d59bd5cdacaa236 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:41:19.037976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82205ec-f42c-42e7-859b-5a55e621882a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:19.042841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f82205ec-f42c-42e7-859b-5a55e621882a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:19.126778 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3267/6480] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:41:18 2022] DELETE /identity/v3/regions/9049dbd5c0b840d98231628bace0d61f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:19.128458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013ea9b-fb1c-4dde-a84f-833e876c700e tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:19.135219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6013ea9b-fb1c-4dde-a84f-833e876c700e tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:19.178706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82205ec-f42c-42e7-859b-5a55e621882a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:19.218917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d023c73-2b5d-406d-b1b6-8db6f0482d5c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:19.219851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d023c73-2b5d-406d-b1b6-8db6f0482d5c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:19.220146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d023c73-2b5d-406d-b1b6-8db6f0482d5c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:19.220428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d023c73-2b5d-406d-b1b6-8db6f0482d5c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles/b9ad55e179884abc9353c33961afab6b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:19.224088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d023c73-2b5d-406d-b1b6-8db6f0482d5c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b9ad55e179884abc9353c33961afab6b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:19.226389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d023c73-2b5d-406d-b1b6-8db6f0482d5c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:19.360542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6013ea9b-fb1c-4dde-a84f-833e876c700e tempest-RegionsTestJSON-1392319428 tempest-RegionsTestJSON-1392319428-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:19.427529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5d023c73-2b5d-406d-b1b6-8db6f0482d5c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invalidating the token cache because role b9ad55e179884abc9353c33961afab6b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:19.428088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5d023c73-2b5d-406d-b1b6-8db6f0482d5c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:19.428912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5d023c73-2b5d-406d-b1b6-8db6f0482d5c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:19.436178 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3214/6481] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:19 2022] DELETE /identity/v3/roles/b9ad55e179884abc9353c33961afab6b => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:19.437660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d023c73-2b5d-406d-b1b6-8db6f0482d5c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:19.442384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5d023c73-2b5d-406d-b1b6-8db6f0482d5c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:19.509391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c4de8-b46a-497f-8273-bd4218fb12b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:19.512287 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:19.513548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c4de8-b46a-497f-8273-bd4218fb12b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:19.514214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c4de8-b46a-497f-8273-bd4218fb12b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:19.514729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c4de8-b46a-497f-8273-bd4218fb12b4 admin admin] PATH_INFO: `/v3/projects/0f36380e686c480992ce09b1d33b29ff` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:19.517265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c4de8-b46a-497f-8273-bd4218fb12b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f36380e686c480992ce09b1d33b29ff)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:19.519617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c4de8-b46a-497f-8273-bd4218fb12b4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:19.567039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d023c73-2b5d-406d-b1b6-8db6f0482d5c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:19.574127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71dfc57-4ba8-40a1-95ec-bc8859617ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:19.576549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dfc57-4ba8-40a1-95ec-bc8859617ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:19.576549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dfc57-4ba8-40a1-95ec-bc8859617ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:19.578897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71dfc57-4ba8-40a1-95ec-bc8859617ab6 admin admin] PATH_INFO: `/v3/users/384887324a2d4ae788eba4117c709610` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:19.581338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71dfc57-4ba8-40a1-95ec-bc8859617ab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=384887324a2d4ae788eba4117c709610)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:19.583978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71dfc57-4ba8-40a1-95ec-bc8859617ab6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:19.673877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-665c4de8-b46a-497f-8273-bd4218fb12b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f36380e686c480992ce09b1d33b29ff', 'request_id': 'req-665c4de8-b46a-497f-8273-bd4218fb12b4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:19.679677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-665c4de8-b46a-497f-8273-bd4218fb12b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f36380e686c480992ce09b1d33b29ff', 'request_id': 'req-665c4de8-b46a-497f-8273-bd4218fb12b4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:19.687825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-665c4de8-b46a-497f-8273-bd4218fb12b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f36380e686c480992ce09b1d33b29ff', 'request_id': 'req-665c4de8-b46a-497f-8273-bd4218fb12b4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:19.787885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-665c4de8-b46a-497f-8273-bd4218fb12b4 admin admin] The token cache is being invalidate because project 0f36380e686c480992ce09b1d33b29ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:19.788197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-665c4de8-b46a-497f-8273-bd4218fb12b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:19.788867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-665c4de8-b46a-497f-8273-bd4218fb12b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:19.794204 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3268/6482] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:19 2022] DELETE /identity/v3/projects/0f36380e686c480992ce09b1d33b29ff => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:19.795998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c4de8-b46a-497f-8273-bd4218fb12b4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:19.797371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-665c4de8-b46a-497f-8273-bd4218fb12b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:19.851558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d71dfc57-4ba8-40a1-95ec-bc8859617ab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '384887324a2d4ae788eba4117c709610'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:19.879841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d71dfc57-4ba8-40a1-95ec-bc8859617ab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '384887324a2d4ae788eba4117c709610'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:19.881124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d71dfc57-4ba8-40a1-95ec-bc8859617ab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '384887324a2d4ae788eba4117c709610'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:19.883857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d71dfc57-4ba8-40a1-95ec-bc8859617ab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '384887324a2d4ae788eba4117c709610'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:19.900367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d71dfc57-4ba8-40a1-95ec-bc8859617ab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '384887324a2d4ae788eba4117c709610'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:19.904855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c4de8-b46a-497f-8273-bd4218fb12b4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:19.913010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90054cf5-0d81-4581-b59d-007420133e57 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:19.914375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90054cf5-0d81-4581-b59d-007420133e57 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:19.914702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90054cf5-0d81-4581-b59d-007420133e57 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:19.914997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90054cf5-0d81-4581-b59d-007420133e57 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/users/4f3428b4ac1048c0951639d4aaac5774` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:19.926923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90054cf5-0d81-4581-b59d-007420133e57 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4f3428b4ac1048c0951639d4aaac5774)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:19.929878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90054cf5-0d81-4581-b59d-007420133e57 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:20.010413 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3215/6483] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:19 2022] DELETE /identity/v3/users/384887324a2d4ae788eba4117c709610 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:20.012768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb844f-a6c1-4a38-acee-28f70b6f9b02 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:20.012867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb844f-a6c1-4a38-acee-28f70b6f9b02 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:20.014040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb844f-a6c1-4a38-acee-28f70b6f9b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:20.043974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-eecb844f-a6c1-4a38-acee-28f70b6f9b02 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:20.047754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eecb844f-a6c1-4a38-acee-28f70b6f9b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:20.087101 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:20.115253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-90054cf5-0d81-4581-b59d-007420133e57 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f3428b4ac1048c0951639d4aaac5774'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:20.158739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-90054cf5-0d81-4581-b59d-007420133e57 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f3428b4ac1048c0951639d4aaac5774'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:20.179306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-90054cf5-0d81-4581-b59d-007420133e57 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f3428b4ac1048c0951639d4aaac5774'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:20.180243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-90054cf5-0d81-4581-b59d-007420133e57 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f3428b4ac1048c0951639d4aaac5774'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:20.232151 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3216/6484] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:20.233564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4077919-aa75-4175-9252-7c620b373109 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:20.233860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4077919-aa75-4175-9252-7c620b373109 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:20.234188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4077919-aa75-4175-9252-7c620b373109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:20.257802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d4077919-aa75-4175-9252-7c620b373109 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:20.259145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d4077919-aa75-4175-9252-7c620b373109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:20.268521 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3217/6485] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:20.270435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4e82b-6c58-4d69-b4ce-11f0296f43d4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:20.270915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4e82b-6c58-4d69-b4ce-11f0296f43d4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:20.276354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-90054cf5-0d81-4581-b59d-007420133e57 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f3428b4ac1048c0951639d4aaac5774'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:20.284024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4e82b-6c58-4d69-b4ce-11f0296f43d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:20.287948 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3269/6486] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:19 2022] DELETE /identity/v3/users/4f3428b4ac1048c0951639d4aaac5774 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:20.288949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90054cf5-0d81-4581-b59d-007420133e57 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:20.290354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-90054cf5-0d81-4581-b59d-007420133e57 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:20.325768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e6d4e82b-6c58-4d69-b4ce-11f0296f43d4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:20.329081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e6d4e82b-6c58-4d69-b4ce-11f0296f43d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:20.379129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90054cf5-0d81-4581-b59d-007420133e57 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:20.383889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951c4c7-16dc-42e0-9200-8caebaa14485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:20.384737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951c4c7-16dc-42e0-9200-8caebaa14485 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:20.385215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951c4c7-16dc-42e0-9200-8caebaa14485 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:20.386690 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:20.387736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951c4c7-16dc-42e0-9200-8caebaa14485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:20.391570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2951c4c7-16dc-42e0-9200-8caebaa14485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:20.433962 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3218/6487] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:20.434896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4e82b-6c58-4d69-b4ce-11f0296f43d4 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:20.436214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e6d4e82b-6c58-4d69-b4ce-11f0296f43d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:20.461810 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:20.556834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4e82b-6c58-4d69-b4ce-11f0296f43d4 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:20.560297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951c4c7-16dc-42e0-9200-8caebaa14485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:20.561830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951c4c7-16dc-42e0-9200-8caebaa14485 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:20.570007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cb70c-d7f1-4a2f-bc8d-dec5be11faf8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:20.574329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cb70c-d7f1-4a2f-bc8d-dec5be11faf8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:20.574587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cb70c-d7f1-4a2f-bc8d-dec5be11faf8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:20.574857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cb70c-d7f1-4a2f-bc8d-dec5be11faf8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects/bd4f70a9753e4e389e19232c7aa1c344` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:20.582931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cb70c-d7f1-4a2f-bc8d-dec5be11faf8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bd4f70a9753e4e389e19232c7aa1c344)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:20.590372 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3270/6488] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:20.590513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cb70c-d7f1-4a2f-bc8d-dec5be11faf8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:20.590604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951c4c7-16dc-42e0-9200-8caebaa14485 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:20.605628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951c4c7-16dc-42e0-9200-8caebaa14485 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:20.619448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53369231-3717-4faa-bb23-72a466b69d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:20.620152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53369231-3717-4faa-bb23-72a466b69d9a admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:20.620457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53369231-3717-4faa-bb23-72a466b69d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:20.622361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53369231-3717-4faa-bb23-72a466b69d9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:20.622361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53369231-3717-4faa-bb23-72a466b69d9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:41:20.622361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53369231-3717-4faa-bb23-72a466b69d9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:20.629232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53369231-3717-4faa-bb23-72a466b69d9a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:20.649165 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3271/6489] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:20.651323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53369231-3717-4faa-bb23-72a466b69d9a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:20.654126 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:20.672921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53369231-3717-4faa-bb23-72a466b69d9a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:20.686792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999ac7f-12d4-4c76-ac62-48b0641acf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:20.687284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999ac7f-12d4-4c76-ac62-48b0641acf5e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:20.687572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999ac7f-12d4-4c76-ac62-48b0641acf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:20.687854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9999ac7f-12d4-4c76-ac62-48b0641acf5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:20.690736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999ac7f-12d4-4c76-ac62-48b0641acf5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:20.695648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9999ac7f-12d4-4c76-ac62-48b0641acf5e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:20.730435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-800cb70c-d7f1-4a2f-bc8d-dec5be11faf8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd4f70a9753e4e389e19232c7aa1c344', 'request_id': 'req-800cb70c-d7f1-4a2f-bc8d-dec5be11faf8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:20.842893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-800cb70c-d7f1-4a2f-bc8d-dec5be11faf8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd4f70a9753e4e389e19232c7aa1c344', 'request_id': 'req-800cb70c-d7f1-4a2f-bc8d-dec5be11faf8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:20.850112 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:20.860819 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3272/6490] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:20 2022] POST /identity/v3/projects => generated 357 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:20.862076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999ac7f-12d4-4c76-ac62-48b0641acf5e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:20.872351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-800cb70c-d7f1-4a2f-bc8d-dec5be11faf8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd4f70a9753e4e389e19232c7aa1c344', 'request_id': 'req-800cb70c-d7f1-4a2f-bc8d-dec5be11faf8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:20.888390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-800cb70c-d7f1-4a2f-bc8d-dec5be11faf8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] The token cache is being invalidate because project bd4f70a9753e4e389e19232c7aa1c344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:20.891476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-800cb70c-d7f1-4a2f-bc8d-dec5be11faf8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:20.891476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-800cb70c-d7f1-4a2f-bc8d-dec5be11faf8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:20.896939 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3219/6491] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:20 2022] DELETE /identity/v3/projects/bd4f70a9753e4e389e19232c7aa1c344 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:20.909333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cb70c-d7f1-4a2f-bc8d-dec5be11faf8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:20.915695 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-800cb70c-d7f1-4a2f-bc8d-dec5be11faf8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:21.014143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9999ac7f-12d4-4c76-ac62-48b0641acf5e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:21.023370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471f8d-ef1d-4661-8e1f-1811328bcc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:21.024252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471f8d-ef1d-4661-8e1f-1811328bcc67 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:21.024634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471f8d-ef1d-4661-8e1f-1811328bcc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:21.024891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471f8d-ef1d-4661-8e1f-1811328bcc67 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:21.025611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03471f8d-ef1d-4661-8e1f-1811328bcc67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:21.028060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03471f8d-ef1d-4661-8e1f-1811328bcc67 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:21.109544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cb70c-d7f1-4a2f-bc8d-dec5be11faf8 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:21.129368 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3273/6492] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:20 2022] POST /identity/v3/users => generated 279 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:41:21.134459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471f8d-ef1d-4661-8e1f-1811328bcc67 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:21.138665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-03471f8d-ef1d-4661-8e1f-1811328bcc67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:21.187873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471f8d-ef1d-4661-8e1f-1811328bcc67 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:21.198193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017acdc8-ccaa-4ba9-9997-a42d95a83134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:21.198928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017acdc8-ccaa-4ba9-9997-a42d95a83134 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:21.199251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017acdc8-ccaa-4ba9-9997-a42d95a83134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:21.202816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017acdc8-ccaa-4ba9-9997-a42d95a83134 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:21.203663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017acdc8-ccaa-4ba9-9997-a42d95a83134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:21.210153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017acdc8-ccaa-4ba9-9997-a42d95a83134 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:21.246571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d55f6-3bca-4bef-8a19-508fb972ab40 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:21.248414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d55f6-3bca-4bef-8a19-508fb972ab40 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:21.249783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d55f6-3bca-4bef-8a19-508fb972ab40 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:21.251480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d55f6-3bca-4bef-8a19-508fb972ab40 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:21.252425 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3274/6493] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:21.253205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d55f6-3bca-4bef-8a19-508fb972ab40 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:21.258724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d55f6-3bca-4bef-8a19-508fb972ab40 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:21.283073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017acdc8-ccaa-4ba9-9997-a42d95a83134 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:21.358931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017acdc8-ccaa-4ba9-9997-a42d95a83134 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:21.374925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244e02b-b37e-4173-81f2-b638607799c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:21.375625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244e02b-b37e-4173-81f2-b638607799c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:21.375916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244e02b-b37e-4173-81f2-b638607799c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:21.376199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2244e02b-b37e-4173-81f2-b638607799c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:21.377057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244e02b-b37e-4173-81f2-b638607799c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:21.378662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2244e02b-b37e-4173-81f2-b638607799c0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:21.403942 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3275/6494] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:21.406014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244e02b-b37e-4173-81f2-b638607799c0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:21.408136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2244e02b-b37e-4173-81f2-b638607799c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:21.450613 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3220/6495] 10.222.0.43 () {60 vars in 1151 bytes} [Tue Jul 19 14:41:20 2022] POST /identity/v3/projects => generated 329 bytes in 548 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:21.451626 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:21.451814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d55f6-3bca-4bef-8a19-508fb972ab40 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:21.512640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2244e02b-b37e-4173-81f2-b638607799c0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:21.655262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d55f6-3bca-4bef-8a19-508fb972ab40 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:21.671208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719552f-46fd-494e-8c72-17a89a8823d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:21.672534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719552f-46fd-494e-8c72-17a89a8823d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:21.672831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719552f-46fd-494e-8c72-17a89a8823d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:21.684445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2719552f-46fd-494e-8c72-17a89a8823d8 admin admin] PATH_INFO: `/v3/projects/84bdf5a062064aca9cfccf3cfc04bf79/users/3d645e52552b4aecb338fcfa52abdef4/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:21.696240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be97031-56ed-4e06-97d4-0079b3531628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:21.697227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be97031-56ed-4e06-97d4-0079b3531628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:21.697592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be97031-56ed-4e06-97d4-0079b3531628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:21.698229 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be97031-56ed-4e06-97d4-0079b3531628 admin admin] PATH_INFO: `/v3/projects/18a5b69ca6fb439aa12f932521147f59` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:21.700397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be97031-56ed-4e06-97d4-0079b3531628 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18a5b69ca6fb439aa12f932521147f59)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:21.702926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be97031-56ed-4e06-97d4-0079b3531628 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:21.739677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719552f-46fd-494e-8c72-17a89a8823d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84bdf5a062064aca9cfccf3cfc04bf79, user_id=3d645e52552b4aecb338fcfa52abdef4, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:21.748896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2719552f-46fd-494e-8c72-17a89a8823d8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:21.873630 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3221/6496] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:21 2022] PUT /identity/v3/projects/84bdf5a062064aca9cfccf3cfc04bf79/users/3d645e52552b4aecb338fcfa52abdef4/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:21.875208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719552f-46fd-494e-8c72-17a89a8823d8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:21.890463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1be97031-56ed-4e06-97d4-0079b3531628 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18a5b69ca6fb439aa12f932521147f59', 'request_id': 'req-1be97031-56ed-4e06-97d4-0079b3531628'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:21.898843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1be97031-56ed-4e06-97d4-0079b3531628 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18a5b69ca6fb439aa12f932521147f59', 'request_id': 'req-1be97031-56ed-4e06-97d4-0079b3531628'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:21.909752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1be97031-56ed-4e06-97d4-0079b3531628 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18a5b69ca6fb439aa12f932521147f59', 'request_id': 'req-1be97031-56ed-4e06-97d4-0079b3531628'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:21.968054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2719552f-46fd-494e-8c72-17a89a8823d8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:22.041929 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:22.046591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1be97031-56ed-4e06-97d4-0079b3531628 admin admin] The token cache is being invalidate because project 18a5b69ca6fb439aa12f932521147f59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:22.046887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1be97031-56ed-4e06-97d4-0079b3531628 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:22.047585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1be97031-56ed-4e06-97d4-0079b3531628 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:22.050544 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3276/6497] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:21 2022] DELETE /identity/v3/projects/18a5b69ca6fb439aa12f932521147f59 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:22.054784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e71e83-d69a-4f2b-ae87-1832e90dd8a4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:22.055958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e71e83-d69a-4f2b-ae87-1832e90dd8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:22.056248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e71e83-d69a-4f2b-ae87-1832e90dd8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:22.070134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2f0f7-d043-40b6-87a9-4edc0cf6ebfd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:22.070991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2f0f7-d043-40b6-87a9-4edc0cf6ebfd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:22.071294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2f0f7-d043-40b6-87a9-4edc0cf6ebfd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:22.071583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa2f0f7-d043-40b6-87a9-4edc0cf6ebfd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:22.072305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2f0f7-d043-40b6-87a9-4edc0cf6ebfd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:22.075294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa2f0f7-d043-40b6-87a9-4edc0cf6ebfd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:22.088748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-35e71e83-d69a-4f2b-ae87-1832e90dd8a4 None None] MFA Rules not processed for user `3d645e52552b4aecb338fcfa52abdef4`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:22.089989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-35e71e83-d69a-4f2b-ae87-1832e90dd8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:22.170689 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3222/6498] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:21 2022] POST /identity/v3/users => generated 413 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:22.170689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2f0f7-d043-40b6-87a9-4edc0cf6ebfd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:22.173914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9fa2f0f7-d043-40b6-87a9-4edc0cf6ebfd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:22.179797 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3277/6499] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:22 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:22.181907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e71e83-d69a-4f2b-ae87-1832e90dd8a4 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:22.184445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-35e71e83-d69a-4f2b-ae87-1832e90dd8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:22.190494 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:22.226601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e71e83-d69a-4f2b-ae87-1832e90dd8a4 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:22.237697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69719818-9a39-4744-a095-9478cb79c22f tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:22.238580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69719818-9a39-4744-a095-9478cb79c22f tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:22.238784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69719818-9a39-4744-a095-9478cb79c22f tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:22.239068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69719818-9a39-4744-a095-9478cb79c22f tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:22.239831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69719818-9a39-4744-a095-9478cb79c22f tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:22.241474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69719818-9a39-4744-a095-9478cb79c22f tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:22.340095 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3278/6500] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:41:22 2022] POST /identity/v3/roles => generated 243 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:22.340095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69719818-9a39-4744-a095-9478cb79c22f tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:22.343592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-69719818-9a39-4744-a095-9478cb79c22f tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:22.346373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa2f0f7-d043-40b6-87a9-4edc0cf6ebfd tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:22.370600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4aec5-e5b6-4957-a808-146858a2d1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:22.371710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4aec5-e5b6-4957-a808-146858a2d1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:22.371969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4aec5-e5b6-4957-a808-146858a2d1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:22.372094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4aec5-e5b6-4957-a808-146858a2d1e0 admin admin] PATH_INFO: `/v3/users/7f6ea16c773c488cb6acad44efe8bad9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:22.380450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4aec5-e5b6-4957-a808-146858a2d1e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f6ea16c773c488cb6acad44efe8bad9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:22.389381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d4aec5-e5b6-4957-a808-146858a2d1e0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:22.392442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69719818-9a39-4744-a095-9478cb79c22f tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:22.414967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694abc5f-9e55-403a-97d9-6300bdf2896f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:22.416420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694abc5f-9e55-403a-97d9-6300bdf2896f admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:22.418270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694abc5f-9e55-403a-97d9-6300bdf2896f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:22.419587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694abc5f-9e55-403a-97d9-6300bdf2896f admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:22.419587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694abc5f-9e55-403a-97d9-6300bdf2896f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:22.421211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694abc5f-9e55-403a-97d9-6300bdf2896f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:22.584397 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3279/6501] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:22 2022] POST /identity/v3/projects => generated 357 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:22.585403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694abc5f-9e55-403a-97d9-6300bdf2896f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:22.687652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86d4aec5-e5b6-4957-a808-146858a2d1e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f6ea16c773c488cb6acad44efe8bad9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:22.707642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86d4aec5-e5b6-4957-a808-146858a2d1e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f6ea16c773c488cb6acad44efe8bad9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:22.708680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86d4aec5-e5b6-4957-a808-146858a2d1e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f6ea16c773c488cb6acad44efe8bad9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:22.714436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86d4aec5-e5b6-4957-a808-146858a2d1e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f6ea16c773c488cb6acad44efe8bad9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:22.735917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-86d4aec5-e5b6-4957-a808-146858a2d1e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f6ea16c773c488cb6acad44efe8bad9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:22.777351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694abc5f-9e55-403a-97d9-6300bdf2896f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:22.801224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad335f1-48fe-454e-964e-2334c436ea8e tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:22.802958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad335f1-48fe-454e-964e-2334c436ea8e tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:22.806451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad335f1-48fe-454e-964e-2334c436ea8e tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:22.808418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad335f1-48fe-454e-964e-2334c436ea8e tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:22.809446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad335f1-48fe-454e-964e-2334c436ea8e tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:22.814769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad335f1-48fe-454e-964e-2334c436ea8e tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:22.880492 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3223/6502] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:22 2022] DELETE /identity/v3/users/7f6ea16c773c488cb6acad44efe8bad9 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:22.880492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4aec5-e5b6-4957-a808-146858a2d1e0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:22.883717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-86d4aec5-e5b6-4957-a808-146858a2d1e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:22.911958 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3280/6503] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:41:22 2022] POST /identity/v3/roles => generated 247 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:22.918752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad335f1-48fe-454e-964e-2334c436ea8e tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:22.920821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2ad335f1-48fe-454e-964e-2334c436ea8e tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:22.995203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad335f1-48fe-454e-964e-2334c436ea8e tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:23.031320 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:23.044040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4aec5-e5b6-4957-a808-146858a2d1e0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:23.058423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06276fe2-a5c4-4549-a10f-b61a15aa5dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:23.059225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06276fe2-a5c4-4549-a10f-b61a15aa5dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:23.065405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06276fe2-a5c4-4549-a10f-b61a15aa5dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:23.065405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06276fe2-a5c4-4549-a10f-b61a15aa5dc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:23.065405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06276fe2-a5c4-4549-a10f-b61a15aa5dc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:23.070375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06276fe2-a5c4-4549-a10f-b61a15aa5dc1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:23.108857 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:23.147363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a89964-782d-4b81-913d-4daf3f135e67 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:23.150277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a89964-782d-4b81-913d-4daf3f135e67 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:23.151409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a89964-782d-4b81-913d-4daf3f135e67 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:23.151989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a89964-782d-4b81-913d-4daf3f135e67 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects/aa61e51ccba34bd28b79d03c9b5e4957/users/ee1f255e3cac493b93a2acae8b26ed5c/roles/5fd369d11d184d128324b0ea5ae7deb5` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:23.172017 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3224/6504] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:22 2022] POST /identity/v3/users => generated 285 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:23.174393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06276fe2-a5c4-4549-a10f-b61a15aa5dc1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:23.237536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06276fe2-a5c4-4549-a10f-b61a15aa5dc1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:23.271779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a89964-782d-4b81-913d-4daf3f135e67 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_grant(project_id=aa61e51ccba34bd28b79d03c9b5e4957, user_id=ee1f255e3cac493b93a2acae8b26ed5c, role_id=5fd369d11d184d128324b0ea5ae7deb5)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:23.271997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0ad4e-23eb-4c1c-9448-34adedc5e350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:23.271997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0ad4e-23eb-4c1c-9448-34adedc5e350 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:23.271997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0ad4e-23eb-4c1c-9448-34adedc5e350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:23.271997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0ad4e-23eb-4c1c-9448-34adedc5e350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:23.272296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0ad4e-23eb-4c1c-9448-34adedc5e350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:23.272369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a89964-782d-4b81-913d-4daf3f135e67 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:23.272441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0ad4e-23eb-4c1c-9448-34adedc5e350 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:23.272441 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3225/6505] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:23 2022] GET /identity/v3/roles => generated 1892 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:23.273697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0ad4e-23eb-4c1c-9448-34adedc5e350 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:23.289577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0ad4e-23eb-4c1c-9448-34adedc5e350 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:23.295396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096568c-c026-4dd2-92b4-de436a6463e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:23.296370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096568c-c026-4dd2-92b4-de436a6463e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:23.296732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096568c-c026-4dd2-92b4-de436a6463e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:23.297094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096568c-c026-4dd2-92b4-de436a6463e3 admin admin] PATH_INFO: `/v3/projects/4cf592014fe143228170f4e51d87c75e/users/78849640e3164e5aacaf8f160a4cb3a0/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:23.315604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096568c-c026-4dd2-92b4-de436a6463e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf592014fe143228170f4e51d87c75e, user_id=78849640e3164e5aacaf8f160a4cb3a0, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:23.318539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096568c-c026-4dd2-92b4-de436a6463e3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:23.391539 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3281/6506] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:22 2022] PUT /identity/v3/projects/aa61e51ccba34bd28b79d03c9b5e4957/users/ee1f255e3cac493b93a2acae8b26ed5c/roles/5fd369d11d184d128324b0ea5ae7deb5 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:23.397676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a89964-782d-4b81-913d-4daf3f135e67 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:23.411160 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3226/6507] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:23 2022] PUT /identity/v3/projects/4cf592014fe143228170f4e51d87c75e/users/78849640e3164e5aacaf8f160a4cb3a0/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:23.422243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096568c-c026-4dd2-92b4-de436a6463e3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:23.503470 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:23.571625 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:23.594499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a89964-782d-4b81-913d-4daf3f135e67 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:23.665247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096568c-c026-4dd2-92b4-de436a6463e3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:23.683292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c175e-f61b-4873-87c1-3ee53adfd135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:23.683985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c175e-f61b-4873-87c1-3ee53adfd135 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:23.684267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c175e-f61b-4873-87c1-3ee53adfd135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:23.684553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c175e-f61b-4873-87c1-3ee53adfd135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:23.691536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c175e-f61b-4873-87c1-3ee53adfd135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:23.694429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87c175e-f61b-4873-87c1-3ee53adfd135 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:23.701322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3b8e7-bfe3-427a-9725-a2a23d55d7be tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:23.702990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3b8e7-bfe3-427a-9725-a2a23d55d7be tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:23.703583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3b8e7-bfe3-427a-9725-a2a23d55d7be tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:23.704024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd3b8e7-bfe3-427a-9725-a2a23d55d7be tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects/aa61e51ccba34bd28b79d03c9b5e4957/users/ee1f255e3cac493b93a2acae8b26ed5c/roles/b7cd3e531caf4d6e90f8fe77268c5518` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:23.708239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3b8e7-bfe3-427a-9725-a2a23d55d7be tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_grant(project_id=aa61e51ccba34bd28b79d03c9b5e4957, user_id=ee1f255e3cac493b93a2acae8b26ed5c, role_id=b7cd3e531caf4d6e90f8fe77268c5518)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:23.711941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd3b8e7-bfe3-427a-9725-a2a23d55d7be tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:23.740926 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3227/6508] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:23 2022] GET /identity/v3/roles => generated 1892 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:23.744829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c175e-f61b-4873-87c1-3ee53adfd135 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:23.772414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c175e-f61b-4873-87c1-3ee53adfd135 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:23.788935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7392c-681d-4f50-942a-4af2e2f5d6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:23.790312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7392c-681d-4f50-942a-4af2e2f5d6f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:23.790933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7392c-681d-4f50-942a-4af2e2f5d6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:23.792003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7392c-681d-4f50-942a-4af2e2f5d6f8 admin admin] PATH_INFO: `/v3/projects/4cf592014fe143228170f4e51d87c75e/users/78849640e3164e5aacaf8f160a4cb3a0/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:23.802962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7392c-681d-4f50-942a-4af2e2f5d6f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf592014fe143228170f4e51d87c75e, user_id=78849640e3164e5aacaf8f160a4cb3a0, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:23.808370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7392c-681d-4f50-942a-4af2e2f5d6f8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:23.824647 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:23.834303 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3282/6509] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:23 2022] PUT /identity/v3/projects/aa61e51ccba34bd28b79d03c9b5e4957/users/ee1f255e3cac493b93a2acae8b26ed5c/roles/b7cd3e531caf4d6e90f8fe77268c5518 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:41:23.838060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3b8e7-bfe3-427a-9725-a2a23d55d7be tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:23.839967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9fd3b8e7-bfe3-427a-9725-a2a23d55d7be tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:23.857916 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3228/6510] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:23 2022] PUT /identity/v3/projects/4cf592014fe143228170f4e51d87c75e/users/78849640e3164e5aacaf8f160a4cb3a0/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:23.868383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7392c-681d-4f50-942a-4af2e2f5d6f8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:23.981319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd3b8e7-bfe3-427a-9725-a2a23d55d7be tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:24.012068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7392c-681d-4f50-942a-4af2e2f5d6f8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:24.020466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf1ae44-cdac-4828-9117-ca44af08a4b4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:24.021722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1ae44-cdac-4828-9117-ca44af08a4b4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:24.022130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1ae44-cdac-4828-9117-ca44af08a4b4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:24.022577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1ae44-cdac-4828-9117-ca44af08a4b4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:24.023802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1ae44-cdac-4828-9117-ca44af08a4b4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:24.026794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf1ae44-cdac-4828-9117-ca44af08a4b4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:24.041844 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:24.060311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61335774-72c1-45c2-8efb-5450a74c0afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:24.061437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61335774-72c1-45c2-8efb-5450a74c0afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:24.062171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61335774-72c1-45c2-8efb-5450a74c0afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:24.062608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61335774-72c1-45c2-8efb-5450a74c0afd admin admin] PATH_INFO: `/v3/projects/ce8dffdfdf6a43b6b8f2202f4b7730e9` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:24.064495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61335774-72c1-45c2-8efb-5450a74c0afd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce8dffdfdf6a43b6b8f2202f4b7730e9)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:24.067956 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3229/6511] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:23 2022] GET /identity/v3/users => generated 8024 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:24.068678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61335774-72c1-45c2-8efb-5450a74c0afd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:24.073980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867151e9-778b-4909-926f-ba61261670eb None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:24.074397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867151e9-778b-4909-926f-ba61261670eb None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:24.074768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867151e9-778b-4909-926f-ba61261670eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:24.108884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-867151e9-778b-4909-926f-ba61261670eb None None] MFA Rules not processed for user `78849640e3164e5aacaf8f160a4cb3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:24.112745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-867151e9-778b-4909-926f-ba61261670eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:24.146187 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:24.217364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-61335774-72c1-45c2-8efb-5450a74c0afd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce8dffdfdf6a43b6b8f2202f4b7730e9', 'request_id': 'req-61335774-72c1-45c2-8efb-5450a74c0afd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:24.218753 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3230/6512] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:24 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:24.221743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4eeb2-d011-4d7b-8dae-5aa31022eded None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:24.222221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4eeb2-d011-4d7b-8dae-5aa31022eded None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:24.222706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a4eeb2-d011-4d7b-8dae-5aa31022eded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:24.225455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-61335774-72c1-45c2-8efb-5450a74c0afd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce8dffdfdf6a43b6b8f2202f4b7730e9', 'request_id': 'req-61335774-72c1-45c2-8efb-5450a74c0afd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:24.233047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-61335774-72c1-45c2-8efb-5450a74c0afd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce8dffdfdf6a43b6b8f2202f4b7730e9', 'request_id': 'req-61335774-72c1-45c2-8efb-5450a74c0afd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:24.271167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-87a4eeb2-d011-4d7b-8dae-5aa31022eded None None] MFA Rules not processed for user `ee1f255e3cac493b93a2acae8b26ed5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:24.272550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-87a4eeb2-d011-4d7b-8dae-5aa31022eded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:24.358698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-61335774-72c1-45c2-8efb-5450a74c0afd admin admin] The token cache is being invalidate because project ce8dffdfdf6a43b6b8f2202f4b7730e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:24.358926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-61335774-72c1-45c2-8efb-5450a74c0afd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:24.360413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-61335774-72c1-45c2-8efb-5450a74c0afd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:24.365899 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3283/6513] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:23 2022] DELETE /identity/v3/projects/ce8dffdfdf6a43b6b8f2202f4b7730e9 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:24.365899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769b485-32cb-4a30-9908-ffacbc96b408 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:24.365899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769b485-32cb-4a30-9908-ffacbc96b408 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:24.365899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a769b485-32cb-4a30-9908-ffacbc96b408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:24.379523 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3231/6514] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:24 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:24.379523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4eeb2-d011-4d7b-8dae-5aa31022eded None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:24.389660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a769b485-32cb-4a30-9908-ffacbc96b408 None None] MFA Rules not processed for user `d1cbf58d0cf8440aae63bf31387948f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:24.390924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a769b485-32cb-4a30-9908-ffacbc96b408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:24.491035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a4eeb2-d011-4d7b-8dae-5aa31022eded None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:24.502152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb5ed4-dba3-4648-823a-6f69d05ac31a tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78849640e3164e5aacaf8f160a4cb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf592014fe143228170f4e51d87c75e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:24.502152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb5ed4-dba3-4648-823a-6f69d05ac31a tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:24.502152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb5ed4-dba3-4648-823a-6f69d05ac31a tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:24.503307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb5ed4-dba3-4648-823a-6f69d05ac31a tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:24.505305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb5ed4-dba3-4648-823a-6f69d05ac31a tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:41:24.505629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb5ed4-dba3-4648-823a-6f69d05ac31a tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:24.508657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acb5ed4-dba3-4648-823a-6f69d05ac31a tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:24.534167 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:24.541910 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3232/6515] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:24.541910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a9856-98d3-4fb3-9bb7-e4fe8f40b7de None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:24.541910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a9856-98d3-4fb3-9bb7-e4fe8f40b7de None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:24.541910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a9856-98d3-4fb3-9bb7-e4fe8f40b7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:24.557895 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3284/6516] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:24.557895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48895d1b-470e-4931-81ea-4e592181b227 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:24.557895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48895d1b-470e-4931-81ea-4e592181b227 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:24.557895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48895d1b-470e-4931-81ea-4e592181b227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:24.580949 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:24.583693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0f3a9856-98d3-4fb3-9bb7-e4fe8f40b7de None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:24.586028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0f3a9856-98d3-4fb3-9bb7-e4fe8f40b7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:24.636255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-48895d1b-470e-4931-81ea-4e592181b227 None None] MFA Rules not processed for user `ee1f255e3cac493b93a2acae8b26ed5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:24.637472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-48895d1b-470e-4931-81ea-4e592181b227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:24.651910 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:24.655701 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3285/6517] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:24 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:24.660441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48895d1b-470e-4931-81ea-4e592181b227 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:24.663956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-48895d1b-470e-4931-81ea-4e592181b227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:24.681632 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:24.715216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48895d1b-470e-4931-81ea-4e592181b227 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:24.728469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8d9e8-f5c3-42c1-b660-2a82a8757ad1 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78849640e3164e5aacaf8f160a4cb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf592014fe143228170f4e51d87c75e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:24.728836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8d9e8-f5c3-42c1-b660-2a82a8757ad1 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:24.733220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8d9e8-f5c3-42c1-b660-2a82a8757ad1 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:24.733512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8d9e8-f5c3-42c1-b660-2a82a8757ad1 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:24.734309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8d9e8-f5c3-42c1-b660-2a82a8757ad1 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:24.739965 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3233/6518] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:24.740630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a9856-98d3-4fb3-9bb7-e4fe8f40b7de None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:24.744411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e8d9e8-f5c3-42c1-b660-2a82a8757ad1 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:24.770046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a9856-98d3-4fb3-9bb7-e4fe8f40b7de None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:24.781685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45637a3c-3789-4c68-ab96-f40dc7ef77af tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee1f255e3cac493b93a2acae8b26ed5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa61e51ccba34bd28b79d03c9b5e4957', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2042297573', 'tempest-DelegatedRole-928806374'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:24.782389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45637a3c-3789-4c68-ab96-f40dc7ef77af tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:24.782678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45637a3c-3789-4c68-ab96-f40dc7ef77af tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:24.782961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45637a3c-3789-4c68-ab96-f40dc7ef77af tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:24.783775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45637a3c-3789-4c68-ab96-f40dc7ef77af tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: Authorizing `identity:create_trust()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:24.789002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45637a3c-3789-4c68-ab96-f40dc7ef77af tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:24.897474 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:24.899637 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3286/6519] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:24 2022] POST /identity/v3/projects => generated 349 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:24.901249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a68b5-6851-4b65-859e-29c6cdce9487 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:24.901708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a68b5-6851-4b65-859e-29c6cdce9487 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:24.901995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a68b5-6851-4b65-859e-29c6cdce9487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:24.926476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a62a68b5-6851-4b65-859e-29c6cdce9487 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:24.928981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a62a68b5-6851-4b65-859e-29c6cdce9487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:24.963591 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:24.976926 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3234/6520] 10.222.0.43 () {60 vars in 1173 bytes} [Tue Jul 19 14:41:24 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:24.976926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45637a3c-3789-4c68-ab96-f40dc7ef77af tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:24.981283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-45637a3c-3789-4c68-ab96-f40dc7ef77af tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:25.015529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45637a3c-3789-4c68-ab96-f40dc7ef77af tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:25.106522 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3287/6521] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:25.106522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a68b5-6851-4b65-859e-29c6cdce9487 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:25.150754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf2948-028e-4e37-b0a1-f3dc00707872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:25.151459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf2948-028e-4e37-b0a1-f3dc00707872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:25.152197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf2948-028e-4e37-b0a1-f3dc00707872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:25.152197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf2948-028e-4e37-b0a1-f3dc00707872 admin admin] PATH_INFO: `/v3/users/240080a2924f46e0a30f0900d4fbbe23` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:25.164241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf2948-028e-4e37-b0a1-f3dc00707872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=240080a2924f46e0a30f0900d4fbbe23)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:25.168480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf2948-028e-4e37-b0a1-f3dc00707872 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:25.193758 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:25.249977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a68b5-6851-4b65-859e-29c6cdce9487 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:25.256424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10811b5-a037-4ed9-9543-13b81de5d3e1 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78849640e3164e5aacaf8f160a4cb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf592014fe143228170f4e51d87c75e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:25.257805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10811b5-a037-4ed9-9543-13b81de5d3e1 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:25.258540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10811b5-a037-4ed9-9543-13b81de5d3e1 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:25.258785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10811b5-a037-4ed9-9543-13b81de5d3e1 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:25.259427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10811b5-a037-4ed9-9543-13b81de5d3e1 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:41:25.259747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10811b5-a037-4ed9-9543-13b81de5d3e1 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:25.261933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10811b5-a037-4ed9-9543-13b81de5d3e1 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:25.276857 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3288/6522] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:25.277599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10811b5-a037-4ed9-9543-13b81de5d3e1 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:25.403983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10811b5-a037-4ed9-9543-13b81de5d3e1 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:25.410480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4684e92-93a5-40a8-bae2-4548d065c7a0 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee1f255e3cac493b93a2acae8b26ed5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa61e51ccba34bd28b79d03c9b5e4957', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2042297573', 'tempest-DelegatedRole-928806374'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:25.412489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4684e92-93a5-40a8-bae2-4548d065c7a0 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:25.412881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4684e92-93a5-40a8-bae2-4548d065c7a0 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:25.413270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4684e92-93a5-40a8-bae2-4548d065c7a0 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] PATH_INFO: `/v3/OS-TRUST/trusts/2d9e73976a854019b5df91f88d095a50` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:25.423854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4684e92-93a5-40a8-bae2-4548d065c7a0 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: Authorizing `identity:get_trust(trust_id=2d9e73976a854019b5df91f88d095a50)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:25.426862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4684e92-93a5-40a8-bae2-4548d065c7a0 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:25.441720 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3289/6523] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jul 19 14:41:25 2022] GET /identity/v3/OS-TRUST/trusts/2d9e73976a854019b5df91f88d095a50 => generated 833 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:25.442889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4684e92-93a5-40a8-bae2-4548d065c7a0 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:25.452288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5eaf2948-028e-4e37-b0a1-f3dc00707872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '240080a2924f46e0a30f0900d4fbbe23'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:25.475530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4684e92-93a5-40a8-bae2-4548d065c7a0 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:25.488901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5eaf2948-028e-4e37-b0a1-f3dc00707872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '240080a2924f46e0a30f0900d4fbbe23'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:25.492332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5eaf2948-028e-4e37-b0a1-f3dc00707872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '240080a2924f46e0a30f0900d4fbbe23'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:25.493891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb92f26-c4b9-49ac-a517-dd7543986f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:25.494834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb92f26-c4b9-49ac-a517-dd7543986f2b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:25.495294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5eaf2948-028e-4e37-b0a1-f3dc00707872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '240080a2924f46e0a30f0900d4fbbe23'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:25.497201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb92f26-c4b9-49ac-a517-dd7543986f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:25.497590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb92f26-c4b9-49ac-a517-dd7543986f2b admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:25.500587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb92f26-c4b9-49ac-a517-dd7543986f2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:41:25.501080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb92f26-c4b9-49ac-a517-dd7543986f2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:25.507318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb92f26-c4b9-49ac-a517-dd7543986f2b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:25.516701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5eaf2948-028e-4e37-b0a1-f3dc00707872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '240080a2924f46e0a30f0900d4fbbe23'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:25.529321 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3290/6524] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:25.530716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb92f26-c4b9-49ac-a517-dd7543986f2b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:25.533397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2bb92f26-c4b9-49ac-a517-dd7543986f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:25.574583 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:25.619074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb92f26-c4b9-49ac-a517-dd7543986f2b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:25.623299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a44ea7-0cff-411a-9293-c94c07962eec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:25.624111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a44ea7-0cff-411a-9293-c94c07962eec service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:25.624519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a44ea7-0cff-411a-9293-c94c07962eec service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:25.625154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a44ea7-0cff-411a-9293-c94c07962eec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:25.627710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-98a44ea7-0cff-411a-9293-c94c07962eec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:25.647299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a44ea7-0cff-411a-9293-c94c07962eec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:25.648927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a44ea7-0cff-411a-9293-c94c07962eec service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:25.652406 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3235/6525] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:24 2022] DELETE /identity/v3/users/240080a2924f46e0a30f0900d4fbbe23 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:25.653654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf2948-028e-4e37-b0a1-f3dc00707872 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:25.664120 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3291/6526] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:25 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:25.665879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a44ea7-0cff-411a-9293-c94c07962eec service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:25.667086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-98a44ea7-0cff-411a-9293-c94c07962eec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:25.670077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5eaf2948-028e-4e37-b0a1-f3dc00707872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:25.689014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a44ea7-0cff-411a-9293-c94c07962eec service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:25.867329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf2948-028e-4e37-b0a1-f3dc00707872 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:25.870359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f243f-7ec5-4876-8171-d5e14d2efdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:25.871041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f243f-7ec5-4876-8171-d5e14d2efdc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:25.871334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f243f-7ec5-4876-8171-d5e14d2efdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:25.871618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2f243f-7ec5-4876-8171-d5e14d2efdc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:25.872338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f243f-7ec5-4876-8171-d5e14d2efdc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:25.876230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2f243f-7ec5-4876-8171-d5e14d2efdc1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:25.883112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda020c3-c3d9-4fc2-847a-97b2b4177df4 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee1f255e3cac493b93a2acae8b26ed5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa61e51ccba34bd28b79d03c9b5e4957', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2042297573', 'tempest-DelegatedRole-928806374'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:25.886338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda020c3-c3d9-4fc2-847a-97b2b4177df4 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:25.887298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda020c3-c3d9-4fc2-847a-97b2b4177df4 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:25.888857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda020c3-c3d9-4fc2-847a-97b2b4177df4 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] PATH_INFO: `/v3/OS-TRUST/trusts/2d9e73976a854019b5df91f88d095a50/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:25.910224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda020c3-c3d9-4fc2-847a-97b2b4177df4 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=2d9e73976a854019b5df91f88d095a50)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:25.910224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda020c3-c3d9-4fc2-847a-97b2b4177df4 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:25.929728 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3236/6527] 10.222.0.43 () {58 vars in 1268 bytes} [Tue Jul 19 14:41:25 2022] GET /identity/v3/OS-TRUST/trusts/2d9e73976a854019b5df91f88d095a50/roles => generated 370 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:25.932247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63bc5b-0f42-4d18-bd6e-b2736a72b6a0 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:25.932725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63bc5b-0f42-4d18-bd6e-b2736a72b6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:25.933114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab63bc5b-0f42-4d18-bd6e-b2736a72b6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:25.972009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ab63bc5b-0f42-4d18-bd6e-b2736a72b6a0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:25.973580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ab63bc5b-0f42-4d18-bd6e-b2736a72b6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:25.987966 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3237/6528] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:25.989176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63bc5b-0f42-4d18-bd6e-b2736a72b6a0 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:26.010316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab63bc5b-0f42-4d18-bd6e-b2736a72b6a0 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:26.015769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb9bba-3aa7-4e31-876c-2fdb4e365da3 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee1f255e3cac493b93a2acae8b26ed5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa61e51ccba34bd28b79d03c9b5e4957', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2042297573', 'tempest-DelegatedRole-928806374'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:26.031079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb9bba-3aa7-4e31-876c-2fdb4e365da3 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:26.034175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb9bba-3aa7-4e31-876c-2fdb4e365da3 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:26.034175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb9bba-3aa7-4e31-876c-2fdb4e365da3 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] PATH_INFO: `/v3/OS-TRUST/trusts/2d9e73976a854019b5df91f88d095a50/roles/5fd369d11d184d128324b0ea5ae7deb5` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:26.040906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb9bba-3aa7-4e31-876c-2fdb4e365da3 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: Authorizing `identity:get_role_for_trust(trust_id=2d9e73976a854019b5df91f88d095a50, role_id=5fd369d11d184d128324b0ea5ae7deb5)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:26.042880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb9bba-3aa7-4e31-876c-2fdb4e365da3 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:26.050979 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3292/6529] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:25 2022] POST /identity/v3/projects => generated 369 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:26.050979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f243f-7ec5-4876-8171-d5e14d2efdc1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:26.055381 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3238/6530] 10.222.0.43 () {58 vars in 1367 bytes} [Tue Jul 19 14:41:25 2022] GET /identity/v3/OS-TRUST/trusts/2d9e73976a854019b5df91f88d095a50/roles/5fd369d11d184d128324b0ea5ae7deb5 => generated 243 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:26.055381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb9bba-3aa7-4e31-876c-2fdb4e365da3 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:26.101639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb9bba-3aa7-4e31-876c-2fdb4e365da3 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:26.149577 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:26.181695 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:26.186829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a210bc-9c9a-4df2-8bef-b114ab1009fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:26.187634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a210bc-9c9a-4df2-8bef-b114ab1009fe admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:26.188935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a210bc-9c9a-4df2-8bef-b114ab1009fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:26.198211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a210bc-9c9a-4df2-8bef-b114ab1009fe admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:26.198211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a210bc-9c9a-4df2-8bef-b114ab1009fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:26.198211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a210bc-9c9a-4df2-8bef-b114ab1009fe admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:26.238829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2f243f-7ec5-4876-8171-d5e14d2efdc1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:26.263179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab27352-b1e6-484f-b1b1-fbefa915c1c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:26.263957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab27352-b1e6-484f-b1b1-fbefa915c1c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:26.264629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab27352-b1e6-484f-b1b1-fbefa915c1c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:26.265006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab27352-b1e6-484f-b1b1-fbefa915c1c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:26.278149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab27352-b1e6-484f-b1b1-fbefa915c1c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:26.281977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab27352-b1e6-484f-b1b1-fbefa915c1c0 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:26.296902 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3293/6531] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:26.298127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab27352-b1e6-484f-b1b1-fbefa915c1c0 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:26.308310 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3239/6532] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:26 2022] POST /identity/v3/users => generated 285 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:26.309538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a210bc-9c9a-4df2-8bef-b114ab1009fe admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:26.431528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab27352-b1e6-484f-b1b1-fbefa915c1c0 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:26.452469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34d3a1-e0bf-48a4-8669-587728b39fb8 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee1f255e3cac493b93a2acae8b26ed5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa61e51ccba34bd28b79d03c9b5e4957', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2042297573', 'tempest-DelegatedRole-928806374'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:26.453564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34d3a1-e0bf-48a4-8669-587728b39fb8 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] REQUEST_METHOD: `HEAD` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:26.454055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34d3a1-e0bf-48a4-8669-587728b39fb8 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:26.455021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34d3a1-e0bf-48a4-8669-587728b39fb8 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] PATH_INFO: `/v3/OS-TRUST/trusts/2d9e73976a854019b5df91f88d095a50/roles/5fd369d11d184d128324b0ea5ae7deb5` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:26.469114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34d3a1-e0bf-48a4-8669-587728b39fb8 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: Authorizing `identity:get_role_for_trust(trust_id=2d9e73976a854019b5df91f88d095a50, role_id=5fd369d11d184d128324b0ea5ae7deb5)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:26.473819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34d3a1-e0bf-48a4-8669-587728b39fb8 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:26.483130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a210bc-9c9a-4df2-8bef-b114ab1009fe admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:26.491145 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3294/6533] 10.222.0.43 () {58 vars in 1368 bytes} [Tue Jul 19 14:41:26 2022] HEAD /identity/v3/OS-TRUST/trusts/2d9e73976a854019b5df91f88d095a50/roles/5fd369d11d184d128324b0ea5ae7deb5 => generated 0 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 19 14:41:26.492887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34d3a1-e0bf-48a4-8669-587728b39fb8 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:26.497022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0f258-25a6-4c52-9025-33459f263621 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78849640e3164e5aacaf8f160a4cb3a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4cf592014fe143228170f4e51d87c75e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:26.499450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0f258-25a6-4c52-9025-33459f263621 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:26.500434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0f258-25a6-4c52-9025-33459f263621 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:26.500949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0f258-25a6-4c52-9025-33459f263621 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] PATH_INFO: `/v3/projects/4846e1ee1c914f39bf8b92b88069b748` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:26.503613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0f258-25a6-4c52-9025-33459f263621 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4846e1ee1c914f39bf8b92b88069b748)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:26.507993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0f258-25a6-4c52-9025-33459f263621 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:26.522730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34d3a1-e0bf-48a4-8669-587728b39fb8 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:26.534717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b88510-3f3f-425a-ae29-b4fb92d3f121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:26.536554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b88510-3f3f-425a-ae29-b4fb92d3f121 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:26.538920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b88510-3f3f-425a-ae29-b4fb92d3f121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:26.539838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b88510-3f3f-425a-ae29-b4fb92d3f121 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:26.540760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b88510-3f3f-425a-ae29-b4fb92d3f121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:26.545199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b88510-3f3f-425a-ae29-b4fb92d3f121 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:26.562362 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3295/6534] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:26 2022] GET /identity/v3/roles => generated 1892 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:26.562362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b88510-3f3f-425a-ae29-b4fb92d3f121 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:26.576337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b88510-3f3f-425a-ae29-b4fb92d3f121 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:26.582541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335df02-7dcb-4a87-a581-3ad82ece7ad6 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee1f255e3cac493b93a2acae8b26ed5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa61e51ccba34bd28b79d03c9b5e4957', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2042297573', 'tempest-DelegatedRole-928806374'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:26.583781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335df02-7dcb-4a87-a581-3ad82ece7ad6 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:26.586430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335df02-7dcb-4a87-a581-3ad82ece7ad6 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:26.586912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335df02-7dcb-4a87-a581-3ad82ece7ad6 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] PATH_INFO: `/v3/OS-TRUST/trusts/2d9e73976a854019b5df91f88d095a50/roles/b7cd3e531caf4d6e90f8fe77268c5518` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:26.594854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335df02-7dcb-4a87-a581-3ad82ece7ad6 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: Authorizing `identity:get_role_for_trust(trust_id=2d9e73976a854019b5df91f88d095a50, role_id=b7cd3e531caf4d6e90f8fe77268c5518)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:26.597313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335df02-7dcb-4a87-a581-3ad82ece7ad6 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:26.616796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-e335df02-7dcb-4a87-a581-3ad82ece7ad6 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Could not find role: b7cd3e531caf4d6e90f8fe77268c5518.: keystone.exception.RoleNotFound: Could not find role: b7cd3e531caf4d6e90f8fe77268c5518. Jul 19 14:41:26.616796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:26.616796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:41:26.616796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:41:26.616796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:41:26.616796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:41:26.616796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:41:26.616796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:41:26.616796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:41:26.616796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:41:26.616796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:41:26.616796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:41:26.616796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 19 14:41:26.616796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 14:41:26.617995 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: b7cd3e531caf4d6e90f8fe77268c5518. Jul 19 14:41:26.617995 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:26.624191 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3296/6535] 10.222.0.43 () {58 vars in 1367 bytes} [Tue Jul 19 14:41:26 2022] GET /identity/v3/OS-TRUST/trusts/2d9e73976a854019b5df91f88d095a50/roles/b7cd3e531caf4d6e90f8fe77268c5518 => generated 110 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:41:26.625402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335df02-7dcb-4a87-a581-3ad82ece7ad6 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:26.644023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335df02-7dcb-4a87-a581-3ad82ece7ad6 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:26.666784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bba8b-ef25-4850-b605-fc657ae579ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:26.667929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bba8b-ef25-4850-b605-fc657ae579ba admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:26.668795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bba8b-ef25-4850-b605-fc657ae579ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:26.672806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87bba8b-ef25-4850-b605-fc657ae579ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:26.673866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87bba8b-ef25-4850-b605-fc657ae579ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:26.676344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87bba8b-ef25-4850-b605-fc657ae579ba admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:26.686029 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:26.691131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d5c0f258-25a6-4c52-9025-33459f263621 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4846e1ee1c914f39bf8b92b88069b748', 'request_id': 'req-d5c0f258-25a6-4c52-9025-33459f263621'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:26.708526 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3297/6536] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:26 2022] GET /identity/v3/roles => generated 1892 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:26.709473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bba8b-ef25-4850-b605-fc657ae579ba admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:26.740686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87bba8b-ef25-4850-b605-fc657ae579ba admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:26.791806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d5c0f258-25a6-4c52-9025-33459f263621 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4846e1ee1c914f39bf8b92b88069b748', 'request_id': 'req-d5c0f258-25a6-4c52-9025-33459f263621'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:26.801191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d5c0f258-25a6-4c52-9025-33459f263621 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4846e1ee1c914f39bf8b92b88069b748', 'request_id': 'req-d5c0f258-25a6-4c52-9025-33459f263621'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:26.826027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d5c0f258-25a6-4c52-9025-33459f263621 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] The token cache is being invalidate because project 4846e1ee1c914f39bf8b92b88069b748 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:26.826347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d5c0f258-25a6-4c52-9025-33459f263621 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:26.827567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d5c0f258-25a6-4c52-9025-33459f263621 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:26.833325 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3240/6537] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:26 2022] DELETE /identity/v3/projects/4846e1ee1c914f39bf8b92b88069b748 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:26.846524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0f258-25a6-4c52-9025-33459f263621 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:26.849110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d5c0f258-25a6-4c52-9025-33459f263621 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:26.901017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3827c30-4af7-4a95-afba-ac33d946932d tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee1f255e3cac493b93a2acae8b26ed5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa61e51ccba34bd28b79d03c9b5e4957', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2042297573', 'tempest-DelegatedRole-928806374'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:26.903135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3827c30-4af7-4a95-afba-ac33d946932d tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] REQUEST_METHOD: `HEAD` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:26.904418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3827c30-4af7-4a95-afba-ac33d946932d tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:26.909325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3827c30-4af7-4a95-afba-ac33d946932d tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] PATH_INFO: `/v3/OS-TRUST/trusts/2d9e73976a854019b5df91f88d095a50/roles/b7cd3e531caf4d6e90f8fe77268c5518` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:26.923441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3827c30-4af7-4a95-afba-ac33d946932d tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: Authorizing `identity:get_role_for_trust(trust_id=2d9e73976a854019b5df91f88d095a50, role_id=b7cd3e531caf4d6e90f8fe77268c5518)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:26.929810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3827c30-4af7-4a95-afba-ac33d946932d tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:26.983938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-b3827c30-4af7-4a95-afba-ac33d946932d tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Could not find role: b7cd3e531caf4d6e90f8fe77268c5518.: keystone.exception.RoleNotFound: Could not find role: b7cd3e531caf4d6e90f8fe77268c5518. Jul 19 14:41:26.983938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:26.983938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:41:26.983938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:41:26.983938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:41:26.983938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:41:26.983938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:41:26.983938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:41:26.983938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:41:26.983938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:41:26.983938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:41:26.983938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:41:26.983938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 19 14:41:26.983938 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 14:41:26.985012 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: b7cd3e531caf4d6e90f8fe77268c5518. Jul 19 14:41:26.985012 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:26.991855 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3298/6538] 10.222.0.43 () {58 vars in 1368 bytes} [Tue Jul 19 14:41:26 2022] HEAD /identity/v3/OS-TRUST/trusts/2d9e73976a854019b5df91f88d095a50/roles/b7cd3e531caf4d6e90f8fe77268c5518 => generated 0 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jul 19 14:41:27.002085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3827c30-4af7-4a95-afba-ac33d946932d tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:27.008217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b3827c30-4af7-4a95-afba-ac33d946932d tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:27.036975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3827c30-4af7-4a95-afba-ac33d946932d tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:27.042364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0f258-25a6-4c52-9025-33459f263621 tempest-QuotasTest-1177785801 tempest-QuotasTest-1177785801-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:27.043477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2055a0-fd88-4b8c-a582-0e4fd147fc20 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee1f255e3cac493b93a2acae8b26ed5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa61e51ccba34bd28b79d03c9b5e4957', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2042297573', 'tempest-DelegatedRole-928806374'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:27.044327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2055a0-fd88-4b8c-a582-0e4fd147fc20 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:27.044614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2055a0-fd88-4b8c-a582-0e4fd147fc20 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:27.048139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2055a0-fd88-4b8c-a582-0e4fd147fc20 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] PATH_INFO: `/v3/OS-TRUST/trusts/2d9e73976a854019b5df91f88d095a50` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:27.057458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61303070-41e3-4ecd-8ba4-7335b72305ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:27.058210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61303070-41e3-4ecd-8ba4-7335b72305ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:27.058496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61303070-41e3-4ecd-8ba4-7335b72305ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:27.058772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61303070-41e3-4ecd-8ba4-7335b72305ec admin admin] PATH_INFO: `/v3/projects/cf2fe92479e8499cbc209a309e87c0ee/users/9f62e94837b2498c80ecab743bfb1db7/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:27.079243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2055a0-fd88-4b8c-a582-0e4fd147fc20 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: Authorizing `identity:delete_trust(trust_id=2d9e73976a854019b5df91f88d095a50)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:27.082117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2055a0-fd88-4b8c-a582-0e4fd147fc20 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:27.092653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61303070-41e3-4ecd-8ba4-7335b72305ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2fe92479e8499cbc209a309e87c0ee, user_id=9f62e94837b2498c80ecab743bfb1db7, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:27.096547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61303070-41e3-4ecd-8ba4-7335b72305ec admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:27.156836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8e2055a0-fd88-4b8c-a582-0e4fd147fc20 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '2d9e73976a854019b5df91f88d095a50', 'request_id': 'req-8e2055a0-fd88-4b8c-a582-0e4fd147fc20'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:27.195355 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3241/6539] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:26 2022] PUT /identity/v3/projects/cf2fe92479e8499cbc209a309e87c0ee/users/9f62e94837b2498c80ecab743bfb1db7/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:27.196699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61303070-41e3-4ecd-8ba4-7335b72305ec admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:27.216642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-61303070-41e3-4ecd-8ba4-7335b72305ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:27.248474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8e2055a0-fd88-4b8c-a582-0e4fd147fc20 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '2d9e73976a854019b5df91f88d095a50', 'request_id': 'req-8e2055a0-fd88-4b8c-a582-0e4fd147fc20'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:27.249812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8e2055a0-fd88-4b8c-a582-0e4fd147fc20 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '2d9e73976a854019b5df91f88d095a50', 'request_id': 'req-8e2055a0-fd88-4b8c-a582-0e4fd147fc20'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:27.263629 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3299/6540] 10.222.0.43 () {58 vars in 1253 bytes} [Tue Jul 19 14:41:26 2022] DELETE /identity/v3/OS-TRUST/trusts/2d9e73976a854019b5df91f88d095a50 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:27.263629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2055a0-fd88-4b8c-a582-0e4fd147fc20 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:27.265285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8e2055a0-fd88-4b8c-a582-0e4fd147fc20 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:27.289818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2055a0-fd88-4b8c-a582-0e4fd147fc20 tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:27.323095 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:INSERT=6,keystone:DELETE=1,keystone:SELECT=93 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:27.345524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61303070-41e3-4ecd-8ba4-7335b72305ec admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:27.354077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bed3d-8349-40bb-94fa-cac8e603713f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:27.356664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bed3d-8349-40bb-94fa-cac8e603713f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:27.357988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bed3d-8349-40bb-94fa-cac8e603713f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:27.358330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bed3d-8349-40bb-94fa-cac8e603713f admin admin] PATH_INFO: `/v3/projects/e796ac1a4ac74dbda4e5e9eae87b6339` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:27.359888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bed3d-8349-40bb-94fa-cac8e603713f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e796ac1a4ac74dbda4e5e9eae87b6339)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:27.362533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bed3d-8349-40bb-94fa-cac8e603713f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:27.385141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27eff6-01ba-496c-9017-47c4fcee9b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:27.386252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27eff6-01ba-496c-9017-47c4fcee9b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:27.386615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27eff6-01ba-496c-9017-47c4fcee9b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:27.386970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27eff6-01ba-496c-9017-47c4fcee9b58 admin admin] PATH_INFO: `/v3/users/3d645e52552b4aecb338fcfa52abdef4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:27.388319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27eff6-01ba-496c-9017-47c4fcee9b58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d645e52552b4aecb338fcfa52abdef4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:27.390371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27eff6-01ba-496c-9017-47c4fcee9b58 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:27.499975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-533bed3d-8349-40bb-94fa-cac8e603713f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e796ac1a4ac74dbda4e5e9eae87b6339', 'request_id': 'req-533bed3d-8349-40bb-94fa-cac8e603713f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:27.606663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-533bed3d-8349-40bb-94fa-cac8e603713f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e796ac1a4ac74dbda4e5e9eae87b6339', 'request_id': 'req-533bed3d-8349-40bb-94fa-cac8e603713f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:27.618244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-533bed3d-8349-40bb-94fa-cac8e603713f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e796ac1a4ac74dbda4e5e9eae87b6339', 'request_id': 'req-533bed3d-8349-40bb-94fa-cac8e603713f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:27.636519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd27eff6-01ba-496c-9017-47c4fcee9b58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d645e52552b4aecb338fcfa52abdef4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:27.641798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-533bed3d-8349-40bb-94fa-cac8e603713f admin admin] The token cache is being invalidate because project e796ac1a4ac74dbda4e5e9eae87b6339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:27.642129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-533bed3d-8349-40bb-94fa-cac8e603713f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:27.642884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-533bed3d-8349-40bb-94fa-cac8e603713f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:27.649581 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3242/6541] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:27 2022] DELETE /identity/v3/projects/e796ac1a4ac74dbda4e5e9eae87b6339 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:27.651790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cf299-2f22-4ea7-bbd3-cd1b44a98e59 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:27.652280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cf299-2f22-4ea7-bbd3-cd1b44a98e59 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:27.652724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd27eff6-01ba-496c-9017-47c4fcee9b58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d645e52552b4aecb338fcfa52abdef4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:27.652907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cf299-2f22-4ea7-bbd3-cd1b44a98e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:27.662476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd27eff6-01ba-496c-9017-47c4fcee9b58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d645e52552b4aecb338fcfa52abdef4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:27.663605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd27eff6-01ba-496c-9017-47c4fcee9b58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d645e52552b4aecb338fcfa52abdef4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:27.688413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2a3cf299-2f22-4ea7-bbd3-cd1b44a98e59 None None] MFA Rules not processed for user `9f62e94837b2498c80ecab743bfb1db7`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:27.689841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2a3cf299-2f22-4ea7-bbd3-cd1b44a98e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:27.771008 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3243/6542] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:27 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:27.772266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cf299-2f22-4ea7-bbd3-cd1b44a98e59 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:27.773696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2a3cf299-2f22-4ea7-bbd3-cd1b44a98e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:27.780018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd27eff6-01ba-496c-9017-47c4fcee9b58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d645e52552b4aecb338fcfa52abdef4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:27.789881 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3300/6543] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:27 2022] DELETE /identity/v3/users/3d645e52552b4aecb338fcfa52abdef4 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:27.791377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949eb82-0c85-4a21-a2e3-704b8d39c091 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:27.791764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949eb82-0c85-4a21-a2e3-704b8d39c091 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:27.792143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949eb82-0c85-4a21-a2e3-704b8d39c091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:27.825052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6949eb82-0c85-4a21-a2e3-704b8d39c091 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:27.826231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6949eb82-0c85-4a21-a2e3-704b8d39c091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:27.869935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3cf299-2f22-4ea7-bbd3-cd1b44a98e59 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:27.916730 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3301/6544] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:27.925286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949eb82-0c85-4a21-a2e3-704b8d39c091 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:27.927141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6949eb82-0c85-4a21-a2e3-704b8d39c091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:27.935853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6ba788-b036-4d63-b89f-b3538240897c tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee1f255e3cac493b93a2acae8b26ed5c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa61e51ccba34bd28b79d03c9b5e4957', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-2042297573', 'tempest-DelegatedRole-928806374'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:27.936796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ba788-b036-4d63-b89f-b3538240897c tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:27.937093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ba788-b036-4d63-b89f-b3538240897c tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:27.937382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6ba788-b036-4d63-b89f-b3538240897c tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] PATH_INFO: `/v3/OS-TRUST/trusts/2d9e73976a854019b5df91f88d095a50` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:27.952293 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-1c6ba788-b036-4d63-b89f-b3538240897c tempest-TrustsV3TestJSON-1465035507 tempest-user-855666583] Could not find trust: 2d9e73976a854019b5df91f88d095a50.: keystone.exception.TrustNotFound: Could not find trust: 2d9e73976a854019b5df91f88d095a50. Jul 19 14:41:27.952293 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:27.952293 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:41:27.952293 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:41:27.952293 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:41:27.952293 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:41:27.952293 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:41:27.952293 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:41:27.952293 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:41:27.952293 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:41:27.952293 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:41:27.952293 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:41:27.952293 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 19 14:41:27.952293 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 19 14:41:27.952293 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 19 14:41:27.957835 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 19 14:41:27.957835 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 19 14:41:27.957835 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 19 14:41:27.957835 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 19 14:41:27.957835 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 19 14:41:27.957835 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:41:27.957835 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:41:27.957835 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 19 14:41:27.957835 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 19 14:41:27.957835 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 19 14:41:27.957835 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 19 14:41:27.957835 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 2d9e73976a854019b5df91f88d095a50. Jul 19 14:41:27.957835 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:27.959327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949eb82-0c85-4a21-a2e3-704b8d39c091 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:27.959423 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3244/6545] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jul 19 14:41:27 2022] GET /identity/v3/OS-TRUST/trusts/2d9e73976a854019b5df91f88d095a50 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:41:27.959423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4b65c-ba1f-406f-b2c7-db7ed054f913 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:27.959423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4b65c-ba1f-406f-b2c7-db7ed054f913 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:27.959423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b4b65c-ba1f-406f-b2c7-db7ed054f913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:27.970310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfe31a-27ad-4e1b-898e-35842e69ec74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:27.972490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfe31a-27ad-4e1b-898e-35842e69ec74 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:27.973042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfe31a-27ad-4e1b-898e-35842e69ec74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:27.973564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dfe31a-27ad-4e1b-898e-35842e69ec74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:27.975711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfe31a-27ad-4e1b-898e-35842e69ec74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:27.977919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dfe31a-27ad-4e1b-898e-35842e69ec74 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:27.986401 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:27.995140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b1b4b65c-ba1f-406f-b2c7-db7ed054f913 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:27.995140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b1b4b65c-ba1f-406f-b2c7-db7ed054f913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:28.019289 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3245/6546] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:28.019289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4c32a-5904-445b-be4d-0e15ae67c3ea None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:28.019289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4c32a-5904-445b-be4d-0e15ae67c3ea None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:28.019289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4c32a-5904-445b-be4d-0e15ae67c3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:28.055976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-61d4c32a-5904-445b-be4d-0e15ae67c3ea None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:28.056577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-61d4c32a-5904-445b-be4d-0e15ae67c3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:28.074353 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3246/6547] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:28.074353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4c32a-5904-445b-be4d-0e15ae67c3ea None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:28.079281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-61d4c32a-5904-445b-be4d-0e15ae67c3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:28.224108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4c32a-5904-445b-be4d-0e15ae67c3ea None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:28.230172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863f6b1-0e52-489f-99e7-99ce22c4fa62 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:28.233204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863f6b1-0e52-489f-99e7-99ce22c4fa62 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:28.233762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863f6b1-0e52-489f-99e7-99ce22c4fa62 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:28.233762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863f6b1-0e52-489f-99e7-99ce22c4fa62 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles/b7cd3e531caf4d6e90f8fe77268c5518` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:28.235579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863f6b1-0e52-489f-99e7-99ce22c4fa62 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b7cd3e531caf4d6e90f8fe77268c5518)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:28.238380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863f6b1-0e52-489f-99e7-99ce22c4fa62 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:28.280032 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3302/6548] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:27 2022] POST /identity/v3/projects => generated 371 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:28.280032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfe31a-27ad-4e1b-898e-35842e69ec74 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:28.283362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b4dfe31a-27ad-4e1b-898e-35842e69ec74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:28.392243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dfe31a-27ad-4e1b-898e-35842e69ec74 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:28.397564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cff4f1-1ac7-44a4-a94a-3560d50339a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:28.398962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cff4f1-1ac7-44a4-a94a-3560d50339a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:28.399257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cff4f1-1ac7-44a4-a94a-3560d50339a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:28.399545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cff4f1-1ac7-44a4-a94a-3560d50339a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:28.470325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cff4f1-1ac7-44a4-a94a-3560d50339a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:28.472691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cff4f1-1ac7-44a4-a94a-3560d50339a7 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:28.483104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2863f6b1-0e52-489f-99e7-99ce22c4fa62 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invalidating the token cache because role b7cd3e531caf4d6e90f8fe77268c5518 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:28.483483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2863f6b1-0e52-489f-99e7-99ce22c4fa62 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:28.484804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2863f6b1-0e52-489f-99e7-99ce22c4fa62 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:28.485072 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3303/6549] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:28.485987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cff4f1-1ac7-44a4-a94a-3560d50339a7 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:28.488553 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3247/6550] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:28 2022] DELETE /identity/v3/roles/b7cd3e531caf4d6e90f8fe77268c5518 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:28.489393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863f6b1-0e52-489f-99e7-99ce22c4fa62 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:28.492907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2863f6b1-0e52-489f-99e7-99ce22c4fa62 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:28.497124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cff4f1-1ac7-44a4-a94a-3560d50339a7 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:28.574049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea8b21-b7d2-49c3-947a-424e72f4d6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:28.574893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea8b21-b7d2-49c3-947a-424e72f4d6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:28.575183 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea8b21-b7d2-49c3-947a-424e72f4d6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:28.575532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea8b21-b7d2-49c3-947a-424e72f4d6c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:28.576253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea8b21-b7d2-49c3-947a-424e72f4d6c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:41:28.576899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea8b21-b7d2-49c3-947a-424e72f4d6c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:28.580978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea8b21-b7d2-49c3-947a-424e72f4d6c7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:28.609355 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3304/6551] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:28.609355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea8b21-b7d2-49c3-947a-424e72f4d6c7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:28.612028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3cea8b21-b7d2-49c3-947a-424e72f4d6c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:28.643698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863f6b1-0e52-489f-99e7-99ce22c4fa62 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:28.656134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958a916-4704-445b-9af4-b1e303239c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:28.657043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958a916-4704-445b-9af4-b1e303239c97 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:28.657472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958a916-4704-445b-9af4-b1e303239c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:28.657740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5958a916-4704-445b-9af4-b1e303239c97 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:28.659052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958a916-4704-445b-9af4-b1e303239c97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:28.661157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5958a916-4704-445b-9af4-b1e303239c97 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:28.671871 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:28.711252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea8b21-b7d2-49c3-947a-424e72f4d6c7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:28.716022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4eaa9-0b5f-41f3-abf3-c4d37d4783f4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:28.716892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4eaa9-0b5f-41f3-abf3-c4d37d4783f4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:28.717180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4eaa9-0b5f-41f3-abf3-c4d37d4783f4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:28.717462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4eaa9-0b5f-41f3-abf3-c4d37d4783f4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles/5fd369d11d184d128324b0ea5ae7deb5` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:28.719029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4eaa9-0b5f-41f3-abf3-c4d37d4783f4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5fd369d11d184d128324b0ea5ae7deb5)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:28.720631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4eaa9-0b5f-41f3-abf3-c4d37d4783f4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:28.782624 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3248/6552] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:28 2022] POST /identity/v3/users => generated 292 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:28.782624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958a916-4704-445b-9af4-b1e303239c97 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:28.785246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5958a916-4704-445b-9af4-b1e303239c97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:28.805914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5958a916-4704-445b-9af4-b1e303239c97 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:28.815488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179ed64-7693-4807-a18c-71ff4d1ea83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:28.816318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179ed64-7693-4807-a18c-71ff4d1ea83a admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:28.816605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179ed64-7693-4807-a18c-71ff4d1ea83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:28.816933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c179ed64-7693-4807-a18c-71ff4d1ea83a admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:28.817648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179ed64-7693-4807-a18c-71ff4d1ea83a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:28.820833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c179ed64-7693-4807-a18c-71ff4d1ea83a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:28.943020 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3249/6553] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:28 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:28.944276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179ed64-7693-4807-a18c-71ff4d1ea83a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:28.946223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ffa4eaa9-0b5f-41f3-abf3-c4d37d4783f4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invalidating the token cache because role 5fd369d11d184d128324b0ea5ae7deb5 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:28.946732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ffa4eaa9-0b5f-41f3-abf3-c4d37d4783f4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:28.948343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ffa4eaa9-0b5f-41f3-abf3-c4d37d4783f4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:28.954132 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3305/6554] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:28 2022] DELETE /identity/v3/roles/5fd369d11d184d128324b0ea5ae7deb5 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:28.955117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4eaa9-0b5f-41f3-abf3-c4d37d4783f4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:28.958645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ffa4eaa9-0b5f-41f3-abf3-c4d37d4783f4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:29.008691 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:29.103745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c179ed64-7693-4807-a18c-71ff4d1ea83a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:29.141271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4eaa9-0b5f-41f3-abf3-c4d37d4783f4 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:29.155413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fa677-b359-41b6-8939-07cd247effc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:29.157917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fa677-b359-41b6-8939-07cd247effc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:29.157917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fa677-b359-41b6-8939-07cd247effc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:29.157917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fa677-b359-41b6-8939-07cd247effc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:29.157917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fa677-b359-41b6-8939-07cd247effc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:29.160395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fa677-b359-41b6-8939-07cd247effc9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:29.215063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ac405-979a-4de0-ae3e-b3741a05eafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:29.215777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ac405-979a-4de0-ae3e-b3741a05eafb admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:29.216123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ac405-979a-4de0-ae3e-b3741a05eafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:29.216411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ac405-979a-4de0-ae3e-b3741a05eafb admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:29.227492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ac405-979a-4de0-ae3e-b3741a05eafb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:29.229024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ac405-979a-4de0-ae3e-b3741a05eafb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:29.235521 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:29.245883 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3250/6555] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:28 2022] GET /identity/v3/roles => generated 1420 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:29.245883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ac405-979a-4de0-ae3e-b3741a05eafb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:29.245883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-417ac405-979a-4de0-ae3e-b3741a05eafb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:29.295082 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3306/6556] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:28 2022] POST /identity/v3/users => generated 288 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:29.295082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fa677-b359-41b6-8939-07cd247effc9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:29.300430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d96fa677-b359-41b6-8939-07cd247effc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:29.331817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fa677-b359-41b6-8939-07cd247effc9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:29.348669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5b8b1-3994-4fde-84ce-51bb0ac33f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:29.349582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5b8b1-3994-4fde-84ce-51bb0ac33f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:29.349875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5b8b1-3994-4fde-84ce-51bb0ac33f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:29.350235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5b8b1-3994-4fde-84ce-51bb0ac33f22 admin admin] PATH_INFO: `/v3/projects/84bdf5a062064aca9cfccf3cfc04bf79` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:29.354135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5b8b1-3994-4fde-84ce-51bb0ac33f22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84bdf5a062064aca9cfccf3cfc04bf79)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:29.359367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5b8b1-3994-4fde-84ce-51bb0ac33f22 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:29.374255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ac405-979a-4de0-ae3e-b3741a05eafb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:29.380144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845c7d7-db7b-4534-bec6-e39197947c24 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:29.382403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845c7d7-db7b-4534-bec6-e39197947c24 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:29.382403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845c7d7-db7b-4534-bec6-e39197947c24 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:29.382783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845c7d7-db7b-4534-bec6-e39197947c24 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/users/ee1f255e3cac493b93a2acae8b26ed5c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:29.384168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845c7d7-db7b-4534-bec6-e39197947c24 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_user(user_id=ee1f255e3cac493b93a2acae8b26ed5c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:29.388210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845c7d7-db7b-4534-bec6-e39197947c24 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:29.547120 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:29.558487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e845c7d7-db7b-4534-bec6-e39197947c24 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee1f255e3cac493b93a2acae8b26ed5c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:29.572536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e845c7d7-db7b-4534-bec6-e39197947c24 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee1f255e3cac493b93a2acae8b26ed5c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:29.573325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e845c7d7-db7b-4534-bec6-e39197947c24 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee1f255e3cac493b93a2acae8b26ed5c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:29.574704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e845c7d7-db7b-4534-bec6-e39197947c24 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee1f255e3cac493b93a2acae8b26ed5c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:29.584481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e845c7d7-db7b-4534-bec6-e39197947c24 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee1f255e3cac493b93a2acae8b26ed5c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:29.584938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0ae5b8b1-3994-4fde-84ce-51bb0ac33f22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84bdf5a062064aca9cfccf3cfc04bf79', 'request_id': 'req-0ae5b8b1-3994-4fde-84ce-51bb0ac33f22'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:29.595070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0ae5b8b1-3994-4fde-84ce-51bb0ac33f22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84bdf5a062064aca9cfccf3cfc04bf79', 'request_id': 'req-0ae5b8b1-3994-4fde-84ce-51bb0ac33f22'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:29.603735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0ae5b8b1-3994-4fde-84ce-51bb0ac33f22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84bdf5a062064aca9cfccf3cfc04bf79', 'request_id': 'req-0ae5b8b1-3994-4fde-84ce-51bb0ac33f22'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:29.664414 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3251/6557] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:29 2022] DELETE /identity/v3/users/ee1f255e3cac493b93a2acae8b26ed5c => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:29.665596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845c7d7-db7b-4534-bec6-e39197947c24 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:29.667172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e845c7d7-db7b-4534-bec6-e39197947c24 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:29.746472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0ae5b8b1-3994-4fde-84ce-51bb0ac33f22 admin admin] The token cache is being invalidate because project 84bdf5a062064aca9cfccf3cfc04bf79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:29.746822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0ae5b8b1-3994-4fde-84ce-51bb0ac33f22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:29.747546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0ae5b8b1-3994-4fde-84ce-51bb0ac33f22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:29.749808 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3307/6558] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:29 2022] DELETE /identity/v3/projects/84bdf5a062064aca9cfccf3cfc04bf79 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:29.751411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5b8b1-3994-4fde-84ce-51bb0ac33f22 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:29.755513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0ae5b8b1-3994-4fde-84ce-51bb0ac33f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:29.766149 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:29.773717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845c7d7-db7b-4534-bec6-e39197947c24 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:29.779399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3d87e-18e0-4b28-a866-e804f61b2cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:29.780652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3d87e-18e0-4b28-a866-e804f61b2cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:29.781044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3d87e-18e0-4b28-a866-e804f61b2cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:29.781987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b3d87e-18e0-4b28-a866-e804f61b2cdc admin admin] PATH_INFO: `/v3/projects/585677fcb8bc4975afd68e132d54f896/users/a834441c113d4e1190d9eeb16fc5db08/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:29.811450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3d87e-18e0-4b28-a866-e804f61b2cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=585677fcb8bc4975afd68e132d54f896, user_id=a834441c113d4e1190d9eeb16fc5db08, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:29.814472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b3d87e-18e0-4b28-a866-e804f61b2cdc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:29.880295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5b8b1-3994-4fde-84ce-51bb0ac33f22 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:29.888302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c1337-c4dd-414b-9dd7-c8fe83161704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:29.892724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c1337-c4dd-414b-9dd7-c8fe83161704 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:29.892724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c1337-c4dd-414b-9dd7-c8fe83161704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:29.892724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c1337-c4dd-414b-9dd7-c8fe83161704 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:29.892724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c1337-c4dd-414b-9dd7-c8fe83161704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:29.892724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c1337-c4dd-414b-9dd7-c8fe83161704 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:29.907960 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3308/6559] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:29 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:29.913474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c1337-c4dd-414b-9dd7-c8fe83161704 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:29.921107 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3252/6560] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:29 2022] PUT /identity/v3/projects/585677fcb8bc4975afd68e132d54f896/users/a834441c113d4e1190d9eeb16fc5db08/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:29.922188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3d87e-18e0-4b28-a866-e804f61b2cdc admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:29.925245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-20b3d87e-18e0-4b28-a866-e804f61b2cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:29.927440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-295c1337-c4dd-414b-9dd7-c8fe83161704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:30.017438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c1337-c4dd-414b-9dd7-c8fe83161704 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:30.044432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b3d87e-18e0-4b28-a866-e804f61b2cdc admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:30.051965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c798e8-9ef3-444c-b83c-8484389f5b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:30.053262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c798e8-9ef3-444c-b83c-8484389f5b01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:30.053723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c798e8-9ef3-444c-b83c-8484389f5b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:30.054009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c798e8-9ef3-444c-b83c-8484389f5b01 admin admin] PATH_INFO: `/v3/users/78849640e3164e5aacaf8f160a4cb3a0` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:30.055358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c798e8-9ef3-444c-b83c-8484389f5b01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78849640e3164e5aacaf8f160a4cb3a0)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:30.057392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c798e8-9ef3-444c-b83c-8484389f5b01 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:30.123861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ceb3bc-a431-4686-950b-d8068c85ac42 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:30.124810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ceb3bc-a431-4686-950b-d8068c85ac42 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:30.126146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ceb3bc-a431-4686-950b-d8068c85ac42 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:30.130008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ceb3bc-a431-4686-950b-d8068c85ac42 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects/aa61e51ccba34bd28b79d03c9b5e4957` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:30.133881 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:30.137582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ceb3bc-a431-4686-950b-d8068c85ac42 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_project(project_id=aa61e51ccba34bd28b79d03c9b5e4957)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:30.140234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ceb3bc-a431-4686-950b-d8068c85ac42 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:30.242945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-14c798e8-9ef3-444c-b83c-8484389f5b01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78849640e3164e5aacaf8f160a4cb3a0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:30.259161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-14c798e8-9ef3-444c-b83c-8484389f5b01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78849640e3164e5aacaf8f160a4cb3a0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:30.260867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-14c798e8-9ef3-444c-b83c-8484389f5b01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78849640e3164e5aacaf8f160a4cb3a0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:30.261709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-14c798e8-9ef3-444c-b83c-8484389f5b01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78849640e3164e5aacaf8f160a4cb3a0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:30.272926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-14c798e8-9ef3-444c-b83c-8484389f5b01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78849640e3164e5aacaf8f160a4cb3a0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:30.345449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d9ceb3bc-a431-4686-950b-d8068c85ac42 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa61e51ccba34bd28b79d03c9b5e4957', 'request_id': 'req-d9ceb3bc-a431-4686-950b-d8068c85ac42'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:30.352617 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3253/6561] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:29 2022] DELETE /identity/v3/users/78849640e3164e5aacaf8f160a4cb3a0 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:30.352617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c798e8-9ef3-444c-b83c-8484389f5b01 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:30.357855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-14c798e8-9ef3-444c-b83c-8484389f5b01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:30.363454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d9ceb3bc-a431-4686-950b-d8068c85ac42 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa61e51ccba34bd28b79d03c9b5e4957', 'request_id': 'req-d9ceb3bc-a431-4686-950b-d8068c85ac42'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:30.384545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d9ceb3bc-a431-4686-950b-d8068c85ac42 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa61e51ccba34bd28b79d03c9b5e4957', 'request_id': 'req-d9ceb3bc-a431-4686-950b-d8068c85ac42'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:30.487213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d9ceb3bc-a431-4686-950b-d8068c85ac42 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] The token cache is being invalidate because project aa61e51ccba34bd28b79d03c9b5e4957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:30.487213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d9ceb3bc-a431-4686-950b-d8068c85ac42 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:30.487826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d9ceb3bc-a431-4686-950b-d8068c85ac42 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:30.490234 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3309/6562] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:29 2022] DELETE /identity/v3/projects/aa61e51ccba34bd28b79d03c9b5e4957 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:30.499313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ceb3bc-a431-4686-950b-d8068c85ac42 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:30.504041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d9ceb3bc-a431-4686-950b-d8068c85ac42 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:30.538613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c798e8-9ef3-444c-b83c-8484389f5b01 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:30.548891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4acb35-498e-4597-a1d6-6c0be5e79f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:30.550301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4acb35-498e-4597-a1d6-6c0be5e79f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:30.552451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4acb35-498e-4597-a1d6-6c0be5e79f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:30.553590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4acb35-498e-4597-a1d6-6c0be5e79f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:30.555271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4acb35-498e-4597-a1d6-6c0be5e79f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:30.565993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4acb35-498e-4597-a1d6-6c0be5e79f43 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:30.607759 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3254/6563] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:30.608645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4acb35-498e-4597-a1d6-6c0be5e79f43 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:30.614902 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:30.616728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3a4acb35-498e-4597-a1d6-6c0be5e79f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:30.737691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ceb3bc-a431-4686-950b-d8068c85ac42 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:30.750112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca40fb1-d89d-41c3-812e-748a9c94b9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:30.754855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca40fb1-d89d-41c3-812e-748a9c94b9eb admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:30.754855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca40fb1-d89d-41c3-812e-748a9c94b9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:30.754855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca40fb1-d89d-41c3-812e-748a9c94b9eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:30.754855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca40fb1-d89d-41c3-812e-748a9c94b9eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:30.755452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca40fb1-d89d-41c3-812e-748a9c94b9eb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:30.775353 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3310/6564] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:30.780587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca40fb1-d89d-41c3-812e-748a9c94b9eb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:30.783094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0ca40fb1-d89d-41c3-812e-748a9c94b9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:30.803454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca40fb1-d89d-41c3-812e-748a9c94b9eb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:30.813399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a14e2-6320-4d06-b9e0-5077db7007cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:30.815604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a14e2-6320-4d06-b9e0-5077db7007cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:30.816067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a14e2-6320-4d06-b9e0-5077db7007cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:30.816576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a14e2-6320-4d06-b9e0-5077db7007cd admin admin] PATH_INFO: `/v3/projects/195f85363ef84d4db5f8250e663c9f9f/users/8321c3bb9925499d8631ae79f3a07db4/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:30.849702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a14e2-6320-4d06-b9e0-5077db7007cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=195f85363ef84d4db5f8250e663c9f9f, user_id=8321c3bb9925499d8631ae79f3a07db4, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:30.859857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a14e2-6320-4d06-b9e0-5077db7007cd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:30.864844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4acb35-498e-4597-a1d6-6c0be5e79f43 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:30.887391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78486b-6918-4d4d-902d-ebd23a16b329 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:30.887690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78486b-6918-4d4d-902d-ebd23a16b329 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:30.890522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78486b-6918-4d4d-902d-ebd23a16b329 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:30.891061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78486b-6918-4d4d-902d-ebd23a16b329 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:30.891960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78486b-6918-4d4d-902d-ebd23a16b329 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:30.896495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78486b-6918-4d4d-902d-ebd23a16b329 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:30.952865 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3311/6565] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:30 2022] PUT /identity/v3/projects/195f85363ef84d4db5f8250e663c9f9f/users/8321c3bb9925499d8631ae79f3a07db4/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:30.969604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a14e2-6320-4d06-b9e0-5077db7007cd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:31.036482 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3255/6566] 10.222.0.43 () {60 vars in 1151 bytes} [Tue Jul 19 14:41:30 2022] POST /identity/v3/projects => generated 328 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:31.039339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50d075-3ada-46ac-b692-66b3ce56ad05 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:31.039339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50d075-3ada-46ac-b692-66b3ce56ad05 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:31.039339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50d075-3ada-46ac-b692-66b3ce56ad05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:31.090688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0e50d075-3ada-46ac-b692-66b3ce56ad05 None None] MFA Rules not processed for user `8321c3bb9925499d8631ae79f3a07db4`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:31.091840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0e50d075-3ada-46ac-b692-66b3ce56ad05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:31.098445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a14e2-6320-4d06-b9e0-5077db7007cd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:31.275035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dde06-6ad5-4afe-ae7f-cc8c016596cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:31.276148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dde06-6ad5-4afe-ae7f-cc8c016596cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:31.276493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dde06-6ad5-4afe-ae7f-cc8c016596cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:31.276784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528dde06-6ad5-4afe-ae7f-cc8c016596cb admin admin] PATH_INFO: `/v3/projects/585677fcb8bc4975afd68e132d54f896/users/a834441c113d4e1190d9eeb16fc5db08/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:31.279225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dde06-6ad5-4afe-ae7f-cc8c016596cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=585677fcb8bc4975afd68e132d54f896, user_id=a834441c113d4e1190d9eeb16fc5db08, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:31.282542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528dde06-6ad5-4afe-ae7f-cc8c016596cb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:31.284446 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3256/6567] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:31.289001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50d075-3ada-46ac-b692-66b3ce56ad05 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:31.308161 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3312/6568] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:30 2022] PUT /identity/v3/projects/585677fcb8bc4975afd68e132d54f896/users/a834441c113d4e1190d9eeb16fc5db08/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:31.309578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dde06-6ad5-4afe-ae7f-cc8c016596cb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:31.316727 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:31.418538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528dde06-6ad5-4afe-ae7f-cc8c016596cb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:31.431131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cd844-c0f2-4454-bd80-a5c1c7f10ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:31.439060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cd844-c0f2-4454-bd80-a5c1c7f10ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:31.439060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cd844-c0f2-4454-bd80-a5c1c7f10ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:31.439060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cd844-c0f2-4454-bd80-a5c1c7f10ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:31.439060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cd844-c0f2-4454-bd80-a5c1c7f10ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:31.439407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50d075-3ada-46ac-b692-66b3ce56ad05 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:31.439496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cd844-c0f2-4454-bd80-a5c1c7f10ca4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:31.478844 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:31.540693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedee206-5e3c-4243-9714-bce1f5937023 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:31.543277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedee206-5e3c-4243-9714-bce1f5937023 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:31.543277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedee206-5e3c-4243-9714-bce1f5937023 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:31.543277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedee206-5e3c-4243-9714-bce1f5937023 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:31.543625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedee206-5e3c-4243-9714-bce1f5937023 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:31.546541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedee206-5e3c-4243-9714-bce1f5937023 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:31.587627 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3313/6569] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:31 2022] POST /identity/v3/projects => generated 375 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:31.588987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33079d65-d899-4245-8238-c877586390d1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:31.589280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33079d65-d899-4245-8238-c877586390d1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:31.589561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33079d65-d899-4245-8238-c877586390d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:31.639230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-33079d65-d899-4245-8238-c877586390d1 None None] MFA Rules not processed for user `a834441c113d4e1190d9eeb16fc5db08`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:31.640844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-33079d65-d899-4245-8238-c877586390d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:31.657428 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3257/6570] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:31 2022] POST /identity/v3/users => generated 413 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:31.664886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedee206-5e3c-4243-9714-bce1f5937023 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:31.671942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cedee206-5e3c-4243-9714-bce1f5937023 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:31.691246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedee206-5e3c-4243-9714-bce1f5937023 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:31.816493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e1965-ce61-4f7e-870c-01880c9c3f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:31.820811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e1965-ce61-4f7e-870c-01880c9c3f5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:31.820811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e1965-ce61-4f7e-870c-01880c9c3f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:31.820811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30e1965-ce61-4f7e-870c-01880c9c3f5a admin admin] PATH_INFO: `/v3/projects/4cf592014fe143228170f4e51d87c75e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:31.820811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e1965-ce61-4f7e-870c-01880c9c3f5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cf592014fe143228170f4e51d87c75e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:31.821296 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3314/6571] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:31 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:31.821640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30e1965-ce61-4f7e-870c-01880c9c3f5a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:31.824948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33079d65-d899-4245-8238-c877586390d1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:31.853328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33079d65-d899-4245-8238-c877586390d1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:31.865601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9cea4-3585-4ace-b65b-527c5b5afa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:31.866637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9cea4-3585-4ace-b65b-527c5b5afa09 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:31.867263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9cea4-3585-4ace-b65b-527c5b5afa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:31.867865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9cea4-3585-4ace-b65b-527c5b5afa09 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:31.869304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9cea4-3585-4ace-b65b-527c5b5afa09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:31.871737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9cea4-3585-4ace-b65b-527c5b5afa09 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:32.025793 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:32.032953 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3315/6572] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:31 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:32.035086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9cea4-3585-4ace-b65b-527c5b5afa09 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:32.044919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c30e1965-ce61-4f7e-870c-01880c9c3f5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cf592014fe143228170f4e51d87c75e', 'request_id': 'req-c30e1965-ce61-4f7e-870c-01880c9c3f5a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:32.134517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c30e1965-ce61-4f7e-870c-01880c9c3f5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cf592014fe143228170f4e51d87c75e', 'request_id': 'req-c30e1965-ce61-4f7e-870c-01880c9c3f5a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:32.145434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c30e1965-ce61-4f7e-870c-01880c9c3f5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cf592014fe143228170f4e51d87c75e', 'request_id': 'req-c30e1965-ce61-4f7e-870c-01880c9c3f5a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:32.183505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c30e1965-ce61-4f7e-870c-01880c9c3f5a admin admin] The token cache is being invalidate because project 4cf592014fe143228170f4e51d87c75e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:32.183801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c30e1965-ce61-4f7e-870c-01880c9c3f5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:32.187418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c30e1965-ce61-4f7e-870c-01880c9c3f5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:32.197646 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3258/6573] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:31 2022] DELETE /identity/v3/projects/4cf592014fe143228170f4e51d87c75e => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:32.197646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e1965-ce61-4f7e-870c-01880c9c3f5a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:32.202626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c30e1965-ce61-4f7e-870c-01880c9c3f5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:32.243430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9cea4-3585-4ace-b65b-527c5b5afa09 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:32.354598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694de1b-e7cf-491b-98e0-c091ef9871e0 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:32.362556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694de1b-e7cf-491b-98e0-c091ef9871e0 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:32.362556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694de1b-e7cf-491b-98e0-c091ef9871e0 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:32.362556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694de1b-e7cf-491b-98e0-c091ef9871e0 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:32.362556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694de1b-e7cf-491b-98e0-c091ef9871e0 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:32.362556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694de1b-e7cf-491b-98e0-c091ef9871e0 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:32.373111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30e1965-ce61-4f7e-870c-01880c9c3f5a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:32.382974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b25d0-854f-46c0-a05a-51d4af45e5cc tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a834441c113d4e1190d9eeb16fc5db08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '585677fcb8bc4975afd68e132d54f896', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:32.384881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b25d0-854f-46c0-a05a-51d4af45e5cc tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:32.387329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b25d0-854f-46c0-a05a-51d4af45e5cc tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:32.387711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b25d0-854f-46c0-a05a-51d4af45e5cc tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:32.388482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b25d0-854f-46c0-a05a-51d4af45e5cc tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:32.393606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b25d0-854f-46c0-a05a-51d4af45e5cc tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:32.433129 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3316/6574] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:41:32 2022] POST /identity/v3/roles => generated 244 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:32.434466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694de1b-e7cf-491b-98e0-c091ef9871e0 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:32.448377 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:32.448687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b694de1b-e7cf-491b-98e0-c091ef9871e0 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:32.573715 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3259/6575] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:32 2022] POST /identity/v3/projects => generated 357 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:32.573715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67071eb5-25a8-475f-b76e-5b2fc0f1f0a2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:32.573715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67071eb5-25a8-475f-b76e-5b2fc0f1f0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:32.573715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67071eb5-25a8-475f-b76e-5b2fc0f1f0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:32.604241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-67071eb5-25a8-475f-b76e-5b2fc0f1f0a2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:32.606876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-67071eb5-25a8-475f-b76e-5b2fc0f1f0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:32.683390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694de1b-e7cf-491b-98e0-c091ef9871e0 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:32.712650 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:32.774130 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:32.775330 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3260/6576] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:32.776369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67071eb5-25a8-475f-b76e-5b2fc0f1f0a2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:32.788407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-67071eb5-25a8-475f-b76e-5b2fc0f1f0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:32.872365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6653bb-3cff-4153-b3bc-7e36d284ab5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:32.873347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6653bb-3cff-4153-b3bc-7e36d284ab5d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:32.873790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6653bb-3cff-4153-b3bc-7e36d284ab5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:32.874279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6653bb-3cff-4153-b3bc-7e36d284ab5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:32.875203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6653bb-3cff-4153-b3bc-7e36d284ab5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:32.878431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6653bb-3cff-4153-b3bc-7e36d284ab5d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:32.897517 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3317/6577] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:32 2022] GET /identity/v3/roles => generated 1655 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:32.901109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6653bb-3cff-4153-b3bc-7e36d284ab5d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:32.982270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67071eb5-25a8-475f-b76e-5b2fc0f1f0a2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:33.005030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb3c2e-69fc-4290-ac21-b29dbd2f42ce tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:33.007828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb3c2e-69fc-4290-ac21-b29dbd2f42ce tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:33.008505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb3c2e-69fc-4290-ac21-b29dbd2f42ce tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:33.009048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb3c2e-69fc-4290-ac21-b29dbd2f42ce tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:33.013546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb3c2e-69fc-4290-ac21-b29dbd2f42ce tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:33.016446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb3c2e-69fc-4290-ac21-b29dbd2f42ce tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:33.027705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6653bb-3cff-4153-b3bc-7e36d284ab5d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:33.034584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808705ae-8def-4120-8c54-d8a15601dc06 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a834441c113d4e1190d9eeb16fc5db08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '585677fcb8bc4975afd68e132d54f896', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:33.035299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808705ae-8def-4120-8c54-d8a15601dc06 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:33.036214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808705ae-8def-4120-8c54-d8a15601dc06 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:33.036214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808705ae-8def-4120-8c54-d8a15601dc06 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:33.036582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808705ae-8def-4120-8c54-d8a15601dc06 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:33.039054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808705ae-8def-4120-8c54-d8a15601dc06 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:33.142825 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3261/6578] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:41:32 2022] POST /identity/v3/roles => generated 246 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:33.142825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838718ec-7ec3-4adc-94b6-0e478183da49 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:33.142825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838718ec-7ec3-4adc-94b6-0e478183da49 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:33.142825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838718ec-7ec3-4adc-94b6-0e478183da49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:33.172285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-838718ec-7ec3-4adc-94b6-0e478183da49 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:33.173542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-838718ec-7ec3-4adc-94b6-0e478183da49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:33.176296 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3318/6579] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:32 2022] POST /identity/v3/users => generated 373 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:33.180042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808705ae-8def-4120-8c54-d8a15601dc06 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:33.194089 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3262/6580] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:33.195112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838718ec-7ec3-4adc-94b6-0e478183da49 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:33.221356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808705ae-8def-4120-8c54-d8a15601dc06 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:33.224144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c5d0e-0581-49a6-a271-2c310c3ba377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:33.225115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c5d0e-0581-49a6-a271-2c310c3ba377 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:33.225642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c5d0e-0581-49a6-a271-2c310c3ba377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:33.225826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838718ec-7ec3-4adc-94b6-0e478183da49 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:33.226369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5c5d0e-0581-49a6-a271-2c310c3ba377 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:33.227543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c5d0e-0581-49a6-a271-2c310c3ba377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:33.229672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5c5d0e-0581-49a6-a271-2c310c3ba377 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:33.235778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cfe7d-20f1-469e-9f31-1a1005fcff6c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:33.240629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cfe7d-20f1-469e-9f31-1a1005fcff6c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:33.240985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cfe7d-20f1-469e-9f31-1a1005fcff6c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:33.241264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cfe7d-20f1-469e-9f31-1a1005fcff6c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects/cc777d367c244c2cbaa8fa5964be1c6b/users/c4de5fc7dedc41999dbfba0138cab0cf/roles/9e8e3fbb85bf4159b9de2542a6037829` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:33.263382 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3319/6581] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:33 2022] GET /identity/v3/roles => generated 1892 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:33.265933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c5d0e-0581-49a6-a271-2c310c3ba377 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:33.289326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5c5d0e-0581-49a6-a271-2c310c3ba377 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:33.289720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449cfe7d-20f1-469e-9f31-1a1005fcff6c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cc777d367c244c2cbaa8fa5964be1c6b, user_id=c4de5fc7dedc41999dbfba0138cab0cf, role_id=9e8e3fbb85bf4159b9de2542a6037829)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:33.295898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449cfe7d-20f1-469e-9f31-1a1005fcff6c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:33.303255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515241c-cac3-4729-ba41-558faf5abae8 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a834441c113d4e1190d9eeb16fc5db08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '585677fcb8bc4975afd68e132d54f896', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:33.304317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515241c-cac3-4729-ba41-558faf5abae8 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:33.306129 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:33.306877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515241c-cac3-4729-ba41-558faf5abae8 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:33.307174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515241c-cac3-4729-ba41-558faf5abae8 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:33.310211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515241c-cac3-4729-ba41-558faf5abae8 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:41:33.314775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515241c-cac3-4729-ba41-558faf5abae8 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:33.314775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e515241c-cac3-4729-ba41-558faf5abae8 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:33.379519 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3263/6582] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:33 2022] PUT /identity/v3/projects/cc777d367c244c2cbaa8fa5964be1c6b/users/c4de5fc7dedc41999dbfba0138cab0cf/roles/9e8e3fbb85bf4159b9de2542a6037829 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:33.381479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cfe7d-20f1-469e-9f31-1a1005fcff6c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:33.405929 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:33.417312 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3320/6583] 10.222.0.43 () {58 vars in 1156 bytes} [Tue Jul 19 14:41:33 2022] GET /identity/v3/users?domain_id=default => generated 8395 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:33.420577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515241c-cac3-4729-ba41-558faf5abae8 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:33.438055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515241c-cac3-4729-ba41-558faf5abae8 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:33.543539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cfe7d-20f1-469e-9f31-1a1005fcff6c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:33.553549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdf9d9-3d81-458f-95f3-53982c164872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:33.554862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdf9d9-3d81-458f-95f3-53982c164872 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:33.555902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdf9d9-3d81-458f-95f3-53982c164872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:33.560275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdf9d9-3d81-458f-95f3-53982c164872 admin admin] PATH_INFO: `/v3/projects/6c83fdbefaeb44e5a278c1e8301ccf5b/users/9399eb26d4c74e1897ed3c61b7b73b3d/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:33.560525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4655d5-e000-47cf-83fe-3acc01d00050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:33.562263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4655d5-e000-47cf-83fe-3acc01d00050 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:33.562542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4655d5-e000-47cf-83fe-3acc01d00050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:33.562832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4655d5-e000-47cf-83fe-3acc01d00050 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:33.563593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4655d5-e000-47cf-83fe-3acc01d00050 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:41:33.564715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4655d5-e000-47cf-83fe-3acc01d00050 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:33.575076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4655d5-e000-47cf-83fe-3acc01d00050 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:33.591593 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3264/6584] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:33.592448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdf9d9-3d81-458f-95f3-53982c164872 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c83fdbefaeb44e5a278c1e8301ccf5b, user_id=9399eb26d4c74e1897ed3c61b7b73b3d, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:33.598946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4655d5-e000-47cf-83fe-3acc01d00050 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:33.611526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdf9d9-3d81-458f-95f3-53982c164872 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:33.708163 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3321/6585] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:33 2022] PUT /identity/v3/projects/6c83fdbefaeb44e5a278c1e8301ccf5b/users/9399eb26d4c74e1897ed3c61b7b73b3d/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:33.709598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdf9d9-3d81-458f-95f3-53982c164872 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:33.750735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4655d5-e000-47cf-83fe-3acc01d00050 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:33.766256 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:33.879068 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:33.883764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd8bf0-d4b5-4bd7-a613-7e9b284bd589 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:33.889534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd8bf0-d4b5-4bd7-a613-7e9b284bd589 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:33.889534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd8bf0-d4b5-4bd7-a613-7e9b284bd589 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:33.889534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbd8bf0-d4b5-4bd7-a613-7e9b284bd589 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects/cc777d367c244c2cbaa8fa5964be1c6b/users/c4de5fc7dedc41999dbfba0138cab0cf/roles/ac2d35e8246d45eeab058c676f50038c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:33.890753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdf9d9-3d81-458f-95f3-53982c164872 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:33.891114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd8bf0-d4b5-4bd7-a613-7e9b284bd589 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:create_grant(project_id=cc777d367c244c2cbaa8fa5964be1c6b, user_id=c4de5fc7dedc41999dbfba0138cab0cf, role_id=ac2d35e8246d45eeab058c676f50038c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:33.894406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbd8bf0-d4b5-4bd7-a613-7e9b284bd589 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:33.904758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc60c5e-b265-496e-bda5-eba0e2856b9f tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a834441c113d4e1190d9eeb16fc5db08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '585677fcb8bc4975afd68e132d54f896', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:33.905673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc60c5e-b265-496e-bda5-eba0e2856b9f tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:33.905961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc60c5e-b265-496e-bda5-eba0e2856b9f tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:33.906276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc60c5e-b265-496e-bda5-eba0e2856b9f tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] PATH_INFO: `/v3/users/69f66cc555d04218a7c54f0fe4415faf` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:33.927845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc60c5e-b265-496e-bda5-eba0e2856b9f tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] RBAC: Authorizing `identity:update_user(user_id=69f66cc555d04218a7c54f0fe4415faf)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:33.929271 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-1bc60c5e-b265-496e-bda5-eba0e2856b9f tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:41:33.929271 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:41:33.929271 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:41:33.930511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc60c5e-b265-496e-bda5-eba0e2856b9f tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:33.974480 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3265/6586] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:33 2022] PUT /identity/v3/projects/cc777d367c244c2cbaa8fa5964be1c6b/users/c4de5fc7dedc41999dbfba0138cab0cf/roles/ac2d35e8246d45eeab058c676f50038c => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:33.976027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd8bf0-d4b5-4bd7-a613-7e9b284bd589 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:34.041579 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:34.041952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1bc60c5e-b265-496e-bda5-eba0e2856b9f tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '69f66cc555d04218a7c54f0fe4415faf'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:34.070207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbd8bf0-d4b5-4bd7-a613-7e9b284bd589 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:34.083149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba5e98-0f62-4937-973c-008ab1e6a880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:34.084144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba5e98-0f62-4937-973c-008ab1e6a880 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:34.084722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba5e98-0f62-4937-973c-008ab1e6a880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:34.084722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba5e98-0f62-4937-973c-008ab1e6a880 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:34.085402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba5e98-0f62-4937-973c-008ab1e6a880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:34.087861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba5e98-0f62-4937-973c-008ab1e6a880 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:34.117683 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:34.146076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1bc60c5e-b265-496e-bda5-eba0e2856b9f tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Invalidating the token cache because user 69f66cc555d04218a7c54f0fe4415faf was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:34.146678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1bc60c5e-b265-496e-bda5-eba0e2856b9f tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:34.148244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1bc60c5e-b265-496e-bda5-eba0e2856b9f tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:34.151623 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3322/6587] 10.222.0.43 () {60 vars in 1243 bytes} [Tue Jul 19 14:41:33 2022] PATCH /identity/v3/users/69f66cc555d04218a7c54f0fe4415faf => generated 488 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:34.152846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc60c5e-b265-496e-bda5-eba0e2856b9f tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:34.154856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1bc60c5e-b265-496e-bda5-eba0e2856b9f tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:34.229312 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3266/6588] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:33 2022] POST /identity/v3/projects => generated 389 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:34.231058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f7db9-df05-4bac-b192-cc77616e54c4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:34.231550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f7db9-df05-4bac-b192-cc77616e54c4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:34.231960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f7db9-df05-4bac-b192-cc77616e54c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:34.286047 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:34.307668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc60c5e-b265-496e-bda5-eba0e2856b9f tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:34.307990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-064f7db9-df05-4bac-b192-cc77616e54c4 None None] MFA Rules not processed for user `9399eb26d4c74e1897ed3c61b7b73b3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:34.309319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-064f7db9-df05-4bac-b192-cc77616e54c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:34.314448 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:34.426703 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3267/6589] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:34.426703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f7db9-df05-4bac-b192-cc77616e54c4 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:34.426703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-064f7db9-df05-4bac-b192-cc77616e54c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:34.432410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cf0c7-ddab-4b7b-8dd9-d99f761f1d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:34.433879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cf0c7-ddab-4b7b-8dd9-d99f761f1d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:34.434418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cf0c7-ddab-4b7b-8dd9-d99f761f1d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:34.435114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5cf0c7-ddab-4b7b-8dd9-d99f761f1d66 admin admin] PATH_INFO: `/v3/users/02bad968753a4aacb357bbae879e87ae` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:34.437197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cf0c7-ddab-4b7b-8dd9-d99f761f1d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02bad968753a4aacb357bbae879e87ae)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:34.442786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5cf0c7-ddab-4b7b-8dd9-d99f761f1d66 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:34.481521 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:34.566539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f7db9-df05-4bac-b192-cc77616e54c4 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:34.572079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d57d4-e316-4fbc-879c-567cf4730b1c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:34.572777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d57d4-e316-4fbc-879c-567cf4730b1c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:34.573125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d57d4-e316-4fbc-879c-567cf4730b1c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:34.573342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d57d4-e316-4fbc-879c-567cf4730b1c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:34.574181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d57d4-e316-4fbc-879c-567cf4730b1c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:34.576015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d57d4-e316-4fbc-879c-567cf4730b1c tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:34.580166 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:34.617097 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:34.618291 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3268/6590] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:34 2022] GET /identity/v3/users => generated 8680 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:34.619840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d90e7-8a2b-4d8d-be3d-cd8709b323aa None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:34.620128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d90e7-8a2b-4d8d-be3d-cd8709b323aa None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:34.620410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d90e7-8a2b-4d8d-be3d-cd8709b323aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:34.641169 n-d-master-1 devstack@keystone.service[80679]: WARNING keystone.auth.plugins.core [None req-ed8d90e7-8a2b-4d8d-be3d-cd8709b323aa None None] User is disabled: 69f66cc555d04218a7c54f0fe4415faf: AssertionError: User is disabled: 69f66cc555d04218a7c54f0fe4415faf Jul 19 14:41:34.653410 n-d-master-1 devstack@keystone.service[80679]: WARNING keystone.server.flask.application [None req-ed8d90e7-8a2b-4d8d-be3d-cd8709b323aa None None] Authorization failed. The request you have made requires authentication. from 10.222.0.43: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 19 14:41:34.655936 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3269/6591] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:34 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 37 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 19 14:41:34.656861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d90e7-8a2b-4d8d-be3d-cd8709b323aa None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:34.659141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ed8d90e7-8a2b-4d8d-be3d-cd8709b323aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:34.695601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d90e7-8a2b-4d8d-be3d-cd8709b323aa None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:34.695601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5970fa-f97c-49d6-a9b0-d67cece9c48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:34.695601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5970fa-f97c-49d6-a9b0-d67cece9c48d admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:34.695601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5970fa-f97c-49d6-a9b0-d67cece9c48d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:34.696121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5970fa-f97c-49d6-a9b0-d67cece9c48d admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:34.696121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5970fa-f97c-49d6-a9b0-d67cece9c48d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:34.696121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5970fa-f97c-49d6-a9b0-d67cece9c48d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:34.732537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ec5cf0c7-ddab-4b7b-8dd9-d99f761f1d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02bad968753a4aacb357bbae879e87ae'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:34.748714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ec5cf0c7-ddab-4b7b-8dd9-d99f761f1d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02bad968753a4aacb357bbae879e87ae'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:34.760329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ec5cf0c7-ddab-4b7b-8dd9-d99f761f1d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02bad968753a4aacb357bbae879e87ae'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:34.761137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ec5cf0c7-ddab-4b7b-8dd9-d99f761f1d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02bad968753a4aacb357bbae879e87ae'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:34.826675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ec5cf0c7-ddab-4b7b-8dd9-d99f761f1d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02bad968753a4aacb357bbae879e87ae'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:34.834957 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3323/6592] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:34 2022] DELETE /identity/v3/users/02bad968753a4aacb357bbae879e87ae => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:34.838010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cf0c7-ddab-4b7b-8dd9-d99f761f1d66 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:34.838010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ec5cf0c7-ddab-4b7b-8dd9-d99f761f1d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:34.839797 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3270/6593] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:34 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:34.841788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdc92f-fea1-48ac-a022-5cbdf674b1b4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:34.842568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdc92f-fea1-48ac-a022-5cbdf674b1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:34.843017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdc92f-fea1-48ac-a022-5cbdf674b1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:34.943358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2cbdc92f-fea1-48ac-a022-5cbdf674b1b4 None None] MFA Rules not processed for user `c4de5fc7dedc41999dbfba0138cab0cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:34.944781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2cbdc92f-fea1-48ac-a022-5cbdf674b1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:35.025022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5cf0c7-ddab-4b7b-8dd9-d99f761f1d66 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:35.039587 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3271/6594] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:35.040465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eded5c06-9c80-4d08-baff-31ae432a40cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:35.040634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdc92f-fea1-48ac-a022-5cbdf674b1b4 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:35.043416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2cbdc92f-fea1-48ac-a022-5cbdf674b1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:35.046545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded5c06-9c80-4d08-baff-31ae432a40cc admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:35.050503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded5c06-9c80-4d08-baff-31ae432a40cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:35.050503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eded5c06-9c80-4d08-baff-31ae432a40cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:35.050503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded5c06-9c80-4d08-baff-31ae432a40cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:35.058362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eded5c06-9c80-4d08-baff-31ae432a40cc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:35.073901 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:35.136996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdc92f-fea1-48ac-a022-5cbdf674b1b4 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:35.144305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d27b7-d6a6-4569-93d9-005595e0a880 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a834441c113d4e1190d9eeb16fc5db08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '585677fcb8bc4975afd68e132d54f896', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:35.145433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d27b7-d6a6-4569-93d9-005595e0a880 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:35.145914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d27b7-d6a6-4569-93d9-005595e0a880 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:35.146402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d27b7-d6a6-4569-93d9-005595e0a880 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] PATH_INFO: `/v3/users/69f66cc555d04218a7c54f0fe4415faf` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:35.168739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d27b7-d6a6-4569-93d9-005595e0a880 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] RBAC: Authorizing `identity:delete_user(user_id=69f66cc555d04218a7c54f0fe4415faf)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:35.170979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91d27b7-d6a6-4569-93d9-005595e0a880 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:35.181623 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3324/6595] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:34 2022] POST /identity/v3/projects => generated 377 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:35.181623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fb816-f35d-49a4-93f7-615e55480e03 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:35.181623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fb816-f35d-49a4-93f7-615e55480e03 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:35.181623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fb816-f35d-49a4-93f7-615e55480e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:35.216230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-890fb816-f35d-49a4-93f7-615e55480e03 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:35.218592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-890fb816-f35d-49a4-93f7-615e55480e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:35.317226 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3325/6596] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:35.318140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fb816-f35d-49a4-93f7-615e55480e03 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:35.320256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-890fb816-f35d-49a4-93f7-615e55480e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:35.338703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fb816-f35d-49a4-93f7-615e55480e03 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:35.344868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86134a6-f7c2-4d9f-ab16-116623a6e847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:35.345842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86134a6-f7c2-4d9f-ab16-116623a6e847 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:35.346231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86134a6-f7c2-4d9f-ab16-116623a6e847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:35.346516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86134a6-f7c2-4d9f-ab16-116623a6e847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:35.348054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86134a6-f7c2-4d9f-ab16-116623a6e847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:35.348977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f91d27b7-d6a6-4569-93d9-005595e0a880 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69f66cc555d04218a7c54f0fe4415faf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:35.349436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86134a6-f7c2-4d9f-ab16-116623a6e847 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:35.365552 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3326/6597] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:35 2022] GET /identity/v3/roles => generated 1892 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:35.367059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9fdb5-85e7-4da9-9c0f-5774bbb60301 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:35.367367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9fdb5-85e7-4da9-9c0f-5774bbb60301 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:35.367823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9fdb5-85e7-4da9-9c0f-5774bbb60301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:35.370526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f91d27b7-d6a6-4569-93d9-005595e0a880 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69f66cc555d04218a7c54f0fe4415faf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:35.372336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f91d27b7-d6a6-4569-93d9-005595e0a880 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69f66cc555d04218a7c54f0fe4415faf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:35.373303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f91d27b7-d6a6-4569-93d9-005595e0a880 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69f66cc555d04218a7c54f0fe4415faf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:35.387280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f91d27b7-d6a6-4569-93d9-005595e0a880 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69f66cc555d04218a7c54f0fe4415faf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:35.388820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b4f9fdb5-85e7-4da9-9c0f-5774bbb60301 None None] MFA Rules not processed for user `c4de5fc7dedc41999dbfba0138cab0cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:35.390424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b4f9fdb5-85e7-4da9-9c0f-5774bbb60301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:35.406314 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:35.454923 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3327/6598] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:35.456912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9fdb5-85e7-4da9-9c0f-5774bbb60301 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:35.457881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b4f9fdb5-85e7-4da9-9c0f-5774bbb60301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:35.477011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9fdb5-85e7-4da9-9c0f-5774bbb60301 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:35.484301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e354a4-98dd-4ca9-afc4-10271bc7f012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:35.485174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e354a4-98dd-4ca9-afc4-10271bc7f012 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:35.485310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e354a4-98dd-4ca9-afc4-10271bc7f012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:35.486015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e354a4-98dd-4ca9-afc4-10271bc7f012 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:35.486528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e354a4-98dd-4ca9-afc4-10271bc7f012 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:35.489359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e354a4-98dd-4ca9-afc4-10271bc7f012 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:35.751782 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3272/6599] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:35 2022] DELETE /identity/v3/users/69f66cc555d04218a7c54f0fe4415faf => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:35.753284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d27b7-d6a6-4569-93d9-005595e0a880 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:35.754710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f91d27b7-d6a6-4569-93d9-005595e0a880 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:35.818976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d27b7-d6a6-4569-93d9-005595e0a880 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:35.822621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea44d9-97bb-4129-ab89-b3e39b281200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:35.823318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea44d9-97bb-4129-ab89-b3e39b281200 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:35.823610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea44d9-97bb-4129-ab89-b3e39b281200 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:35.823894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ea44d9-97bb-4129-ab89-b3e39b281200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:35.826294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-00ea44d9-97bb-4129-ab89-b3e39b281200 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:35.872936 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:35.897336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea44d9-97bb-4129-ab89-b3e39b281200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:35.898795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ea44d9-97bb-4129-ab89-b3e39b281200 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:35.910693 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3273/6600] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:35.918778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea44d9-97bb-4129-ab89-b3e39b281200 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:35.918778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-00ea44d9-97bb-4129-ab89-b3e39b281200 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:35.926453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ea44d9-97bb-4129-ab89-b3e39b281200 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:35.931865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fc57b-3aeb-4ce7-a907-c68e0e07a56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:35.932551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fc57b-3aeb-4ce7-a907-c68e0e07a56b admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:35.932837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fc57b-3aeb-4ce7-a907-c68e0e07a56b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:35.933312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fc57b-3aeb-4ce7-a907-c68e0e07a56b admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:35.941143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fc57b-3aeb-4ce7-a907-c68e0e07a56b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:35.946613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4fc57b-3aeb-4ce7-a907-c68e0e07a56b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:35.960894 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3328/6601] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:35 2022] POST /identity/v3/users => generated 295 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:35.960894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e354a4-98dd-4ca9-afc4-10271bc7f012 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:35.961191 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3274/6602] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:35 2022] GET /identity/v3/roles => generated 1892 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:35.962028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fc57b-3aeb-4ce7-a907-c68e0e07a56b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:35.964143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8a4fc57b-3aeb-4ce7-a907-c68e0e07a56b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:35.980631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e354a4-98dd-4ca9-afc4-10271bc7f012 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:36.055269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928014c7-89c0-420c-8b10-b2480bb772fe tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4de5fc7dedc41999dbfba0138cab0cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc777d367c244c2cbaa8fa5964be1c6b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-353037532', 'tempest-DelegatedRole-1972379635'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:36.055888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928014c7-89c0-420c-8b10-b2480bb772fe tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:36.056215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928014c7-89c0-420c-8b10-b2480bb772fe tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:36.056960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928014c7-89c0-420c-8b10-b2480bb772fe tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:36.057742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928014c7-89c0-420c-8b10-b2480bb772fe tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: Authorizing `identity:create_trust()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:36.059260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928014c7-89c0-420c-8b10-b2480bb772fe tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:36.075164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fc57b-3aeb-4ce7-a907-c68e0e07a56b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:36.078985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40454e4-8d9c-44f2-a04d-180cee33c13b tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a834441c113d4e1190d9eeb16fc5db08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '585677fcb8bc4975afd68e132d54f896', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:36.079921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40454e4-8d9c-44f2-a04d-180cee33c13b tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:36.080213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40454e4-8d9c-44f2-a04d-180cee33c13b tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:36.080524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40454e4-8d9c-44f2-a04d-180cee33c13b tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] PATH_INFO: `/v3/projects/412d956627164c2b842697c6db923747` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:36.082452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40454e4-8d9c-44f2-a04d-180cee33c13b tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] RBAC: Authorizing `identity:delete_project(project_id=412d956627164c2b842697c6db923747)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:36.084568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40454e4-8d9c-44f2-a04d-180cee33c13b tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:36.252052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a40454e4-8d9c-44f2-a04d-180cee33c13b tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '412d956627164c2b842697c6db923747', 'request_id': 'req-a40454e4-8d9c-44f2-a04d-180cee33c13b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:36.333084 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3329/6603] 10.222.0.43 () {60 vars in 1173 bytes} [Tue Jul 19 14:41:35 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:36.339389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928014c7-89c0-420c-8b10-b2480bb772fe tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:36.367562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a40454e4-8d9c-44f2-a04d-180cee33c13b tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '412d956627164c2b842697c6db923747', 'request_id': 'req-a40454e4-8d9c-44f2-a04d-180cee33c13b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:36.372240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928014c7-89c0-420c-8b10-b2480bb772fe tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:36.378434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a40454e4-8d9c-44f2-a04d-180cee33c13b tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '412d956627164c2b842697c6db923747', 'request_id': 'req-a40454e4-8d9c-44f2-a04d-180cee33c13b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:36.397740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a40454e4-8d9c-44f2-a04d-180cee33c13b tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] The token cache is being invalidate because project 412d956627164c2b842697c6db923747 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:36.398049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a40454e4-8d9c-44f2-a04d-180cee33c13b tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:36.400263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a40454e4-8d9c-44f2-a04d-180cee33c13b tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:36.409129 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3275/6604] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:35 2022] DELETE /identity/v3/projects/412d956627164c2b842697c6db923747 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:36.409129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40454e4-8d9c-44f2-a04d-180cee33c13b tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:36.410842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a40454e4-8d9c-44f2-a04d-180cee33c13b tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:36.458317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84729f91-bfb3-4130-b4e3-569290d8d1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:36.461068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84729f91-bfb3-4130-b4e3-569290d8d1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:36.461068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84729f91-bfb3-4130-b4e3-569290d8d1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:36.461068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84729f91-bfb3-4130-b4e3-569290d8d1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:36.461068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84729f91-bfb3-4130-b4e3-569290d8d1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:36.462215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84729f91-bfb3-4130-b4e3-569290d8d1a9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:36.475579 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3330/6605] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:36 2022] GET /identity/v3/roles => generated 1892 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:36.481687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84729f91-bfb3-4130-b4e3-569290d8d1a9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:36.481687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-84729f91-bfb3-4130-b4e3-569290d8d1a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:36.524141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40454e4-8d9c-44f2-a04d-180cee33c13b tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:36.535218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1c889-5f1c-448e-8d5f-02f9e5e725c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:36.536873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1c889-5f1c-448e-8d5f-02f9e5e725c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:36.537276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1c889-5f1c-448e-8d5f-02f9e5e725c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:36.538258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e1c889-5f1c-448e-8d5f-02f9e5e725c7 admin admin] PATH_INFO: `/v3/projects/a482bce8739b484b87aca0ab20b84c68/users/78dc610e046f477497e7766be18824b8/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:36.559471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1c889-5f1c-448e-8d5f-02f9e5e725c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a482bce8739b484b87aca0ab20b84c68, user_id=78dc610e046f477497e7766be18824b8, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:36.562270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e1c889-5f1c-448e-8d5f-02f9e5e725c7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:36.578979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84729f91-bfb3-4130-b4e3-569290d8d1a9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:36.586474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a783509-7ca3-42e8-b259-c56dbfb3d9a5 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4de5fc7dedc41999dbfba0138cab0cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc777d367c244c2cbaa8fa5964be1c6b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-353037532', 'tempest-DelegatedRole-1972379635'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:36.590810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a783509-7ca3-42e8-b259-c56dbfb3d9a5 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:36.590810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a783509-7ca3-42e8-b259-c56dbfb3d9a5 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:36.590810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a783509-7ca3-42e8-b259-c56dbfb3d9a5 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] PATH_INFO: `/v3/OS-TRUST/trusts/7324ef165aff479e9299c9b377b85814` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:36.595993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a783509-7ca3-42e8-b259-c56dbfb3d9a5 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: Authorizing `identity:get_trust(trust_id=7324ef165aff479e9299c9b377b85814)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:36.597464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a783509-7ca3-42e8-b259-c56dbfb3d9a5 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:36.608941 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3331/6606] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jul 19 14:41:36 2022] GET /identity/v3/OS-TRUST/trusts/7324ef165aff479e9299c9b377b85814 => generated 835 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:36.609714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a783509-7ca3-42e8-b259-c56dbfb3d9a5 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:36.616017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1a783509-7ca3-42e8-b259-c56dbfb3d9a5 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:36.660633 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3276/6607] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:36 2022] PUT /identity/v3/projects/a482bce8739b484b87aca0ab20b84c68/users/78dc610e046f477497e7766be18824b8/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:36.662055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1c889-5f1c-448e-8d5f-02f9e5e725c7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:36.672385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-12e1c889-5f1c-448e-8d5f-02f9e5e725c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:36.714823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a783509-7ca3-42e8-b259-c56dbfb3d9a5 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:36.761427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e1c889-5f1c-448e-8d5f-02f9e5e725c7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:36.767560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd96682-7aa5-41ac-b8ae-4a0b821fe27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:36.769063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd96682-7aa5-41ac-b8ae-4a0b821fe27b admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:36.769352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd96682-7aa5-41ac-b8ae-4a0b821fe27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:36.769638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd96682-7aa5-41ac-b8ae-4a0b821fe27b admin admin] PATH_INFO: `/v3/projects/8802c771c3ea4204991cc31fed2306e9/users/1fd5087aa79e4ee09a4ec9beebca1534/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:36.787039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd96682-7aa5-41ac-b8ae-4a0b821fe27b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8802c771c3ea4204991cc31fed2306e9, user_id=1fd5087aa79e4ee09a4ec9beebca1534, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:36.788211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bab265-477a-4645-b6a2-82a4285bbf54 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a834441c113d4e1190d9eeb16fc5db08', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '585677fcb8bc4975afd68e132d54f896', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:36.788904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bab265-477a-4645-b6a2-82a4285bbf54 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:36.789226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bab265-477a-4645-b6a2-82a4285bbf54 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:36.789577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bab265-477a-4645-b6a2-82a4285bbf54 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:36.790463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bab265-477a-4645-b6a2-82a4285bbf54 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:36.790834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd96682-7aa5-41ac-b8ae-4a0b821fe27b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:36.792380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bab265-477a-4645-b6a2-82a4285bbf54 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:36.807569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-b6bab265-477a-4645-b6a2-82a4285bbf54 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Could not find domain: 6bab7c6aa5d046848f77538a92b9a7dd.: keystone.exception.DomainNotFound: Could not find domain: 6bab7c6aa5d046848f77538a92b9a7dd. Jul 19 14:41:36.807569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:36.807569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 14:41:36.807569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 14:41:36.807569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 14:41:36.807569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 14:41:36.807569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 14:41:36.807569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 14:41:36.807569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6bab7c6aa5d046848f77538a92b9a7dd. Jul 19 14:41:36.807569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:36.807569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:41:36.807569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:36.807569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:36.807569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:41:36.807569 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:41:36.813665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:41:36.813665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:41:36.813665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:41:36.813665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:41:36.813665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:41:36.813665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:41:36.813665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:41:36.813665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:41:36.813665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 19 14:41:36.813665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 19 14:41:36.813665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:41:36.813665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:41:36.813665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 14:41:36.813665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 14:41:36.813665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 14:41:36.813665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 14:41:36.813665 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Jul 19 14:41:36.815600 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Jul 19 14:41:36.815600 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:41:36.815600 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:41:36.815600 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:41:36.815600 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:41:36.815600 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:41:36.815600 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:41:36.815600 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:41:36.815600 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application with Lock( Jul 19 14:41:36.815600 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:41:36.815600 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:41:36.815600 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:41:36.815600 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:41:36.815600 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:41:36.815600 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:41:36.815600 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:41:36.815600 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:41:36.816979 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 14:41:36.816979 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 14:41:36.816979 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 6bab7c6aa5d046848f77538a92b9a7dd. Jul 19 14:41:36.816979 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:36.816979 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3332/6608] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:36 2022] POST /identity/v3/users => generated 112 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:41:36.816979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bab265-477a-4645-b6a2-82a4285bbf54 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:36.816979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b6bab265-477a-4645-b6a2-82a4285bbf54 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:36.828173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bab265-477a-4645-b6a2-82a4285bbf54 tempest-UsersNegativeTest-1977561987 tempest-UsersNegativeTest-1977561987-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:36.840788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8ae86-bc3d-4ea6-a9d5-f9cd9e5c692b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:36.840788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8ae86-bc3d-4ea6-a9d5-f9cd9e5c692b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:36.840788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8ae86-bc3d-4ea6-a9d5-f9cd9e5c692b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:36.840788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8ae86-bc3d-4ea6-a9d5-f9cd9e5c692b admin admin] PATH_INFO: `/v3/projects/5af89581188b4be7ada96e3717ddc5ac` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:36.841249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8ae86-bc3d-4ea6-a9d5-f9cd9e5c692b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5af89581188b4be7ada96e3717ddc5ac)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:36.841249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff8ae86-bc3d-4ea6-a9d5-f9cd9e5c692b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:36.905979 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3277/6609] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:36 2022] PUT /identity/v3/projects/8802c771c3ea4204991cc31fed2306e9/users/1fd5087aa79e4ee09a4ec9beebca1534/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:36.907574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd96682-7aa5-41ac-b8ae-4a0b821fe27b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:36.972160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd96682-7aa5-41ac-b8ae-4a0b821fe27b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:36.982755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f596d7-d585-4fb3-8ef1-8f5c3deb1ba4 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4de5fc7dedc41999dbfba0138cab0cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc777d367c244c2cbaa8fa5964be1c6b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-353037532', 'tempest-DelegatedRole-1972379635'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:36.983612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f596d7-d585-4fb3-8ef1-8f5c3deb1ba4 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:36.984056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f596d7-d585-4fb3-8ef1-8f5c3deb1ba4 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:36.984237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f596d7-d585-4fb3-8ef1-8f5c3deb1ba4 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] PATH_INFO: `/v3/OS-TRUST/trusts/7324ef165aff479e9299c9b377b85814/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:36.991709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f596d7-d585-4fb3-8ef1-8f5c3deb1ba4 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=7324ef165aff479e9299c9b377b85814)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:36.993182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f596d7-d585-4fb3-8ef1-8f5c3deb1ba4 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:37.006999 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3278/6610] 10.222.0.43 () {58 vars in 1268 bytes} [Tue Jul 19 14:41:36 2022] GET /identity/v3/OS-TRUST/trusts/7324ef165aff479e9299c9b377b85814/roles => generated 371 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:37.008517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec148bb-ede2-4d5d-9068-1c4e65188376 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:37.008810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec148bb-ede2-4d5d-9068-1c4e65188376 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:37.009091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec148bb-ede2-4d5d-9068-1c4e65188376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:37.045061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3ff8ae86-bc3d-4ea6-a9d5-f9cd9e5c692b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af89581188b4be7ada96e3717ddc5ac', 'request_id': 'req-3ff8ae86-bc3d-4ea6-a9d5-f9cd9e5c692b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:37.046358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-bec148bb-ede2-4d5d-9068-1c4e65188376 None None] MFA Rules not processed for user `78dc610e046f477497e7766be18824b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:37.047819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bec148bb-ede2-4d5d-9068-1c4e65188376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:37.058297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3ff8ae86-bc3d-4ea6-a9d5-f9cd9e5c692b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af89581188b4be7ada96e3717ddc5ac', 'request_id': 'req-3ff8ae86-bc3d-4ea6-a9d5-f9cd9e5c692b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:37.072046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3ff8ae86-bc3d-4ea6-a9d5-f9cd9e5c692b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af89581188b4be7ada96e3717ddc5ac', 'request_id': 'req-3ff8ae86-bc3d-4ea6-a9d5-f9cd9e5c692b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:37.163893 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3279/6611] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:37.164984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec148bb-ede2-4d5d-9068-1c4e65188376 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:37.166041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bec148bb-ede2-4d5d-9068-1c4e65188376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:37.219794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3ff8ae86-bc3d-4ea6-a9d5-f9cd9e5c692b admin admin] The token cache is being invalidate because project 5af89581188b4be7ada96e3717ddc5ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:37.222426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3ff8ae86-bc3d-4ea6-a9d5-f9cd9e5c692b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:37.223257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3ff8ae86-bc3d-4ea6-a9d5-f9cd9e5c692b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:37.225312 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3333/6612] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:36 2022] DELETE /identity/v3/projects/5af89581188b4be7ada96e3717ddc5ac => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:37.226331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8ae86-bc3d-4ea6-a9d5-f9cd9e5c692b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:37.227804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3ff8ae86-bc3d-4ea6-a9d5-f9cd9e5c692b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:37.243516 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:37.260862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec148bb-ede2-4d5d-9068-1c4e65188376 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:37.268032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2220906-9718-4170-a3db-776d11dd49e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:37.272595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2220906-9718-4170-a3db-776d11dd49e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:37.272890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2220906-9718-4170-a3db-776d11dd49e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:37.273181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2220906-9718-4170-a3db-776d11dd49e6 admin admin] PATH_INFO: `/v3/users/9f62e94837b2498c80ecab743bfb1db7` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:37.274571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2220906-9718-4170-a3db-776d11dd49e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f62e94837b2498c80ecab743bfb1db7)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:37.276970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2220906-9718-4170-a3db-776d11dd49e6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:37.309190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8ae86-bc3d-4ea6-a9d5-f9cd9e5c692b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:37.314397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14025a-b278-4754-b753-52177f3ecfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:37.315233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14025a-b278-4754-b753-52177f3ecfb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:37.316051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14025a-b278-4754-b753-52177f3ecfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:37.316051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14025a-b278-4754-b753-52177f3ecfb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:37.318825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14025a-b278-4754-b753-52177f3ecfb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:37.318825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf14025a-b278-4754-b753-52177f3ecfb8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:37.333329 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3334/6613] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:37 2022] GET /identity/v3/roles => generated 1892 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:37.334282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14025a-b278-4754-b753-52177f3ecfb8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:37.336346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bf14025a-b278-4754-b753-52177f3ecfb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:37.407189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14025a-b278-4754-b753-52177f3ecfb8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:37.415052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97688d-bc64-4969-90be-f43f054a6261 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4de5fc7dedc41999dbfba0138cab0cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc777d367c244c2cbaa8fa5964be1c6b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-353037532', 'tempest-DelegatedRole-1972379635'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:37.415905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97688d-bc64-4969-90be-f43f054a6261 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:37.416195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97688d-bc64-4969-90be-f43f054a6261 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:37.416478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97688d-bc64-4969-90be-f43f054a6261 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] PATH_INFO: `/v3/OS-TRUST/trusts/7324ef165aff479e9299c9b377b85814/roles/9e8e3fbb85bf4159b9de2542a6037829` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:37.423255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97688d-bc64-4969-90be-f43f054a6261 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7324ef165aff479e9299c9b377b85814, role_id=9e8e3fbb85bf4159b9de2542a6037829)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:37.426297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97688d-bc64-4969-90be-f43f054a6261 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:37.451457 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3335/6614] 10.222.0.43 () {58 vars in 1367 bytes} [Tue Jul 19 14:41:37 2022] GET /identity/v3/OS-TRUST/trusts/7324ef165aff479e9299c9b377b85814/roles/9e8e3fbb85bf4159b9de2542a6037829 => generated 244 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:37.451457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97688d-bc64-4969-90be-f43f054a6261 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:37.451457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ff97688d-bc64-4969-90be-f43f054a6261 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:37.518262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97688d-bc64-4969-90be-f43f054a6261 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:37.525706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b9939b-827a-45af-98d2-7ef43484e99b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:37.526552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9939b-827a-45af-98d2-7ef43484e99b service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:37.526844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9939b-827a-45af-98d2-7ef43484e99b service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:37.527132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b9939b-827a-45af-98d2-7ef43484e99b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:37.529873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-46b9939b-827a-45af-98d2-7ef43484e99b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:37.536723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e2220906-9718-4170-a3db-776d11dd49e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f62e94837b2498c80ecab743bfb1db7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:37.546261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9939b-827a-45af-98d2-7ef43484e99b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:37.547751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b9939b-827a-45af-98d2-7ef43484e99b service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:37.559013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e2220906-9718-4170-a3db-776d11dd49e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f62e94837b2498c80ecab743bfb1db7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:37.560379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e2220906-9718-4170-a3db-776d11dd49e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f62e94837b2498c80ecab743bfb1db7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:37.560979 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3336/6615] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:37 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:37.564776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7ba00-f19c-4c55-aa64-b56567277990 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:37.564998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7ba00-f19c-4c55-aa64-b56567277990 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:37.568332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7ba00-f19c-4c55-aa64-b56567277990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:37.574308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e2220906-9718-4170-a3db-776d11dd49e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f62e94837b2498c80ecab743bfb1db7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:37.599490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e2220906-9718-4170-a3db-776d11dd49e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f62e94837b2498c80ecab743bfb1db7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:37.616930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-aaa7ba00-f19c-4c55-aa64-b56567277990 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:37.622644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-aaa7ba00-f19c-4c55-aa64-b56567277990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:37.636849 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3337/6616] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:37.636849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7ba00-f19c-4c55-aa64-b56567277990 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:37.636849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-aaa7ba00-f19c-4c55-aa64-b56567277990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:37.649440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7ba00-f19c-4c55-aa64-b56567277990 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:37.656374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5db8e-21f4-478c-b690-15f19745cd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:37.657699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5db8e-21f4-478c-b690-15f19745cd7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:37.659563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5db8e-21f4-478c-b690-15f19745cd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:37.660111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5db8e-21f4-478c-b690-15f19745cd7b admin admin] PATH_INFO: `/v3/projects/8802c771c3ea4204991cc31fed2306e9/users/1fd5087aa79e4ee09a4ec9beebca1534/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:37.663158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5db8e-21f4-478c-b690-15f19745cd7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8802c771c3ea4204991cc31fed2306e9, user_id=1fd5087aa79e4ee09a4ec9beebca1534, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:37.666150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5db8e-21f4-478c-b690-15f19745cd7b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:37.686161 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3338/6617] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:37 2022] PUT /identity/v3/projects/8802c771c3ea4204991cc31fed2306e9/users/1fd5087aa79e4ee09a4ec9beebca1534/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:37.686161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5db8e-21f4-478c-b690-15f19745cd7b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:37.686161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b9b5db8e-21f4-478c-b690-15f19745cd7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:37.713083 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3280/6618] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:37 2022] DELETE /identity/v3/users/9f62e94837b2498c80ecab743bfb1db7 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:37.714380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f634c-f544-4cc1-8f43-e1d5b50d577b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:37.714743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f634c-f544-4cc1-8f43-e1d5b50d577b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:37.716699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f634c-f544-4cc1-8f43-e1d5b50d577b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:37.757684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-636f634c-f544-4cc1-8f43-e1d5b50d577b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:37.759100 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-636f634c-f544-4cc1-8f43-e1d5b50d577b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:37.817104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5db8e-21f4-478c-b690-15f19745cd7b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:37.858980 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3281/6619] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:37.868792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496a81f-9a8b-4996-97ad-38c96c27d967 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:37.868792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496a81f-9a8b-4996-97ad-38c96c27d967 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:37.868792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a496a81f-9a8b-4996-97ad-38c96c27d967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:37.912524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a496a81f-9a8b-4996-97ad-38c96c27d967 None None] MFA Rules not processed for user `1fd5087aa79e4ee09a4ec9beebca1534`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:37.912524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a496a81f-9a8b-4996-97ad-38c96c27d967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:37.912977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b1705-cc6e-4d10-a04e-e4ef02422465 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4de5fc7dedc41999dbfba0138cab0cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc777d367c244c2cbaa8fa5964be1c6b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-353037532', 'tempest-DelegatedRole-1972379635'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:37.912977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b1705-cc6e-4d10-a04e-e4ef02422465 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] REQUEST_METHOD: `HEAD` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:37.912977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b1705-cc6e-4d10-a04e-e4ef02422465 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:37.913366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b1705-cc6e-4d10-a04e-e4ef02422465 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] PATH_INFO: `/v3/OS-TRUST/trusts/7324ef165aff479e9299c9b377b85814/roles/9e8e3fbb85bf4159b9de2542a6037829` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:37.919909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b1705-cc6e-4d10-a04e-e4ef02422465 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7324ef165aff479e9299c9b377b85814, role_id=9e8e3fbb85bf4159b9de2542a6037829)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:37.921402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b1705-cc6e-4d10-a04e-e4ef02422465 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:37.930404 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3339/6620] 10.222.0.43 () {58 vars in 1368 bytes} [Tue Jul 19 14:41:37 2022] HEAD /identity/v3/OS-TRUST/trusts/7324ef165aff479e9299c9b377b85814/roles/9e8e3fbb85bf4159b9de2542a6037829 => generated 0 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 19 14:41:37.931855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314b07a-40f6-40e9-b3e9-be6adf19f0e6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:37.932150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314b07a-40f6-40e9-b3e9-be6adf19f0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:37.932434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314b07a-40f6-40e9-b3e9-be6adf19f0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:37.936750 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:37.956885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0314b07a-40f6-40e9-b3e9-be6adf19f0e6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:37.958977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0314b07a-40f6-40e9-b3e9-be6adf19f0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:37.970938 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3340/6621] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:37.972373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314b07a-40f6-40e9-b3e9-be6adf19f0e6 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:37.984805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314b07a-40f6-40e9-b3e9-be6adf19f0e6 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:37.990052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a139f-bc57-4c5d-91e0-1350537748ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:37.991060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a139f-bc57-4c5d-91e0-1350537748ca admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:37.991514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a139f-bc57-4c5d-91e0-1350537748ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:37.992175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a139f-bc57-4c5d-91e0-1350537748ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:37.993229 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a139f-bc57-4c5d-91e0-1350537748ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:41:37.993562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a139f-bc57-4c5d-91e0-1350537748ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:37.995373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a139f-bc57-4c5d-91e0-1350537748ca admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:38.010874 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3341/6622] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:38.016189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a139f-bc57-4c5d-91e0-1350537748ca admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:38.024741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a139f-bc57-4c5d-91e0-1350537748ca admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:38.025922 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3282/6623] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:38.027031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496a81f-9a8b-4996-97ad-38c96c27d967 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:38.028704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a496a81f-9a8b-4996-97ad-38c96c27d967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:38.030908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ae600-9711-4604-857f-443fd842ee48 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4de5fc7dedc41999dbfba0138cab0cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc777d367c244c2cbaa8fa5964be1c6b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-353037532', 'tempest-DelegatedRole-1972379635'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:38.031949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ae600-9711-4604-857f-443fd842ee48 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:38.032305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ae600-9711-4604-857f-443fd842ee48 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:38.032653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ae600-9711-4604-857f-443fd842ee48 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] PATH_INFO: `/v3/OS-TRUST/trusts/7324ef165aff479e9299c9b377b85814/roles/ac2d35e8246d45eeab058c676f50038c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:38.043672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ae600-9711-4604-857f-443fd842ee48 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7324ef165aff479e9299c9b377b85814, role_id=ac2d35e8246d45eeab058c676f50038c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:38.054332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ae600-9711-4604-857f-443fd842ee48 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:38.060842 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-d60ae600-9711-4604-857f-443fd842ee48 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] Could not find role: ac2d35e8246d45eeab058c676f50038c.: keystone.exception.RoleNotFound: Could not find role: ac2d35e8246d45eeab058c676f50038c. Jul 19 14:41:38.060842 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:38.060842 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:41:38.060842 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:41:38.060842 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:41:38.060842 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:41:38.060842 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:41:38.060842 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:41:38.060842 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:41:38.060842 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:41:38.060842 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:41:38.060842 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:41:38.060842 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 19 14:41:38.060842 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 14:41:38.061913 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ac2d35e8246d45eeab058c676f50038c. Jul 19 14:41:38.061913 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:38.063893 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3342/6624] 10.222.0.43 () {58 vars in 1367 bytes} [Tue Jul 19 14:41:38 2022] GET /identity/v3/OS-TRUST/trusts/7324ef165aff479e9299c9b377b85814/roles/ac2d35e8246d45eeab058c676f50038c => generated 110 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:41:38.065484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ae600-9711-4604-857f-443fd842ee48 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:38.085581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ae600-9711-4604-857f-443fd842ee48 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:38.096518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f003529-9353-4aa5-ae0c-ea8b4d8add38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:38.097328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f003529-9353-4aa5-ae0c-ea8b4d8add38 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:38.097622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f003529-9353-4aa5-ae0c-ea8b4d8add38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:38.097903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f003529-9353-4aa5-ae0c-ea8b4d8add38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:38.098734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f003529-9353-4aa5-ae0c-ea8b4d8add38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:38.101179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f003529-9353-4aa5-ae0c-ea8b4d8add38 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:38.122911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a496a81f-9a8b-4996-97ad-38c96c27d967 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:38.127617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d45af4-e565-451a-97ee-77c6ca13510f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:38.128255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d45af4-e565-451a-97ee-77c6ca13510f service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:38.128540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d45af4-e565-451a-97ee-77c6ca13510f service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:38.128824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d45af4-e565-451a-97ee-77c6ca13510f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:38.141897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d45af4-e565-451a-97ee-77c6ca13510f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:38.144752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d45af4-e565-451a-97ee-77c6ca13510f service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:38.157137 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3283/6625] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:38.157992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d45af4-e565-451a-97ee-77c6ca13510f service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:38.161289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-80d45af4-e565-451a-97ee-77c6ca13510f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:38.248689 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3343/6626] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:38 2022] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:38.250818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f003529-9353-4aa5-ae0c-ea8b4d8add38 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:38.322252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d45af4-e565-451a-97ee-77c6ca13510f service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:38.359209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f003529-9353-4aa5-ae0c-ea8b4d8add38 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:38.365101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6adba5-582e-4860-912a-f8935bee931c tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4de5fc7dedc41999dbfba0138cab0cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc777d367c244c2cbaa8fa5964be1c6b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-353037532', 'tempest-DelegatedRole-1972379635'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:38.374557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6adba5-582e-4860-912a-f8935bee931c tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] REQUEST_METHOD: `HEAD` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:38.374557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6adba5-582e-4860-912a-f8935bee931c tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:38.374557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6adba5-582e-4860-912a-f8935bee931c tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] PATH_INFO: `/v3/OS-TRUST/trusts/7324ef165aff479e9299c9b377b85814/roles/ac2d35e8246d45eeab058c676f50038c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:38.374557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6adba5-582e-4860-912a-f8935bee931c tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: Authorizing `identity:get_role_for_trust(trust_id=7324ef165aff479e9299c9b377b85814, role_id=ac2d35e8246d45eeab058c676f50038c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:38.376784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6adba5-582e-4860-912a-f8935bee931c tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:38.394796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-0a6adba5-582e-4860-912a-f8935bee931c tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] Could not find role: ac2d35e8246d45eeab058c676f50038c.: keystone.exception.RoleNotFound: Could not find role: ac2d35e8246d45eeab058c676f50038c. Jul 19 14:41:38.394796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:38.394796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:41:38.394796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:41:38.394796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:41:38.394796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:41:38.394796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:41:38.394796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:41:38.394796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:41:38.394796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:41:38.394796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:41:38.394796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:41:38.394796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 19 14:41:38.394796 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 14:41:38.402615 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ac2d35e8246d45eeab058c676f50038c. Jul 19 14:41:38.402615 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:38.402615 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3344/6627] 10.222.0.43 () {58 vars in 1368 bytes} [Tue Jul 19 14:41:38 2022] HEAD /identity/v3/OS-TRUST/trusts/7324ef165aff479e9299c9b377b85814/roles/ac2d35e8246d45eeab058c676f50038c => generated 0 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jul 19 14:41:38.402615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6adba5-582e-4860-912a-f8935bee931c tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:38.437584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703e8a9-c63a-4838-a1c2-1fa64664592d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:38.438767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703e8a9-c63a-4838-a1c2-1fa64664592d service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:38.439232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703e8a9-c63a-4838-a1c2-1fa64664592d service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:38.439524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703e8a9-c63a-4838-a1c2-1fa64664592d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:38.443433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7703e8a9-c63a-4838-a1c2-1fa64664592d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:38.516838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6adba5-582e-4860-912a-f8935bee931c tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:38.551431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9562c-b9d4-4c04-a491-2a7ac13e688e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:38.551431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9562c-b9d4-4c04-a491-2a7ac13e688e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:38.551431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9562c-b9d4-4c04-a491-2a7ac13e688e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:38.551431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9562c-b9d4-4c04-a491-2a7ac13e688e admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:38.552251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9562c-b9d4-4c04-a491-2a7ac13e688e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:38.552251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9562c-b9d4-4c04-a491-2a7ac13e688e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:38.614855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703e8a9-c63a-4838-a1c2-1fa64664592d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:38.619220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703e8a9-c63a-4838-a1c2-1fa64664592d service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:38.638557 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3284/6628] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:38.639582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703e8a9-c63a-4838-a1c2-1fa64664592d service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:38.663888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703e8a9-c63a-4838-a1c2-1fa64664592d service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:38.677274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191232e1-7bf6-4d20-97f2-fac2bb032c09 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4de5fc7dedc41999dbfba0138cab0cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc777d367c244c2cbaa8fa5964be1c6b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-353037532', 'tempest-DelegatedRole-1972379635'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:38.678231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191232e1-7bf6-4d20-97f2-fac2bb032c09 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:38.678535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191232e1-7bf6-4d20-97f2-fac2bb032c09 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:38.678972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191232e1-7bf6-4d20-97f2-fac2bb032c09 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] PATH_INFO: `/v3/OS-TRUST/trusts/7324ef165aff479e9299c9b377b85814` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:38.681664 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3345/6629] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:38 2022] POST /identity/v3/users => generated 292 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:38.683071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9562c-b9d4-4c04-a491-2a7ac13e688e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:38.704103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9562c-b9d4-4c04-a491-2a7ac13e688e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:38.712413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191232e1-7bf6-4d20-97f2-fac2bb032c09 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: Authorizing `identity:delete_trust(trust_id=7324ef165aff479e9299c9b377b85814)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:38.712574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2833a4-3b3c-47a4-98d5-6cd7d2ae920c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:38.712700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191232e1-7bf6-4d20-97f2-fac2bb032c09 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:38.713840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2833a4-3b3c-47a4-98d5-6cd7d2ae920c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:38.714151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2833a4-3b3c-47a4-98d5-6cd7d2ae920c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:38.714455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2833a4-3b3c-47a4-98d5-6cd7d2ae920c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:38.715184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2833a4-3b3c-47a4-98d5-6cd7d2ae920c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:38.718757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2833a4-3b3c-47a4-98d5-6cd7d2ae920c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:38.752744 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3346/6630] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:38 2022] GET /identity/v3/roles => generated 1892 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:38.756150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2833a4-3b3c-47a4-98d5-6cd7d2ae920c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:38.770710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2833a4-3b3c-47a4-98d5-6cd7d2ae920c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:38.781418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92dc3d-1430-4cfb-a3c8-87496995c2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:38.782330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92dc3d-1430-4cfb-a3c8-87496995c2ca admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:38.786994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92dc3d-1430-4cfb-a3c8-87496995c2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:38.786994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b92dc3d-1430-4cfb-a3c8-87496995c2ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:38.786994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92dc3d-1430-4cfb-a3c8-87496995c2ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:38.786994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b92dc3d-1430-4cfb-a3c8-87496995c2ca admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:38.805065 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3347/6631] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:38 2022] GET /identity/v3/roles => generated 1892 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:41:38.805971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92dc3d-1430-4cfb-a3c8-87496995c2ca admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:38.819173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b92dc3d-1430-4cfb-a3c8-87496995c2ca admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:38.827492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057575b-dff4-4519-b923-d2c434cbfd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:38.827492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057575b-dff4-4519-b923-d2c434cbfd49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:38.827492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057575b-dff4-4519-b923-d2c434cbfd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:38.827492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057575b-dff4-4519-b923-d2c434cbfd49 admin admin] PATH_INFO: `/v3/projects/772dcee824f946ecb04164d0b4b8dffe/users/ac628ca939434e19a337817bc9cab963/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:38.848222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-191232e1-7bf6-4d20-97f2-fac2bb032c09 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '7324ef165aff479e9299c9b377b85814', 'request_id': 'req-191232e1-7bf6-4d20-97f2-fac2bb032c09'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:38.857461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057575b-dff4-4519-b923-d2c434cbfd49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=772dcee824f946ecb04164d0b4b8dffe, user_id=ac628ca939434e19a337817bc9cab963, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:38.857461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5057575b-dff4-4519-b923-d2c434cbfd49 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:39.014561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-191232e1-7bf6-4d20-97f2-fac2bb032c09 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7324ef165aff479e9299c9b377b85814', 'request_id': 'req-191232e1-7bf6-4d20-97f2-fac2bb032c09'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:39.014561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-191232e1-7bf6-4d20-97f2-fac2bb032c09 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '7324ef165aff479e9299c9b377b85814', 'request_id': 'req-191232e1-7bf6-4d20-97f2-fac2bb032c09'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:39.014561 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3285/6632] 10.222.0.43 () {58 vars in 1253 bytes} [Tue Jul 19 14:41:38 2022] DELETE /identity/v3/OS-TRUST/trusts/7324ef165aff479e9299c9b377b85814 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:39.014561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191232e1-7bf6-4d20-97f2-fac2bb032c09 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:39.023273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-191232e1-7bf6-4d20-97f2-fac2bb032c09 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:39.062878 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3348/6633] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:38 2022] PUT /identity/v3/projects/772dcee824f946ecb04164d0b4b8dffe/users/ac628ca939434e19a337817bc9cab963/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:39.062878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057575b-dff4-4519-b923-d2c434cbfd49 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:39.068139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5057575b-dff4-4519-b923-d2c434cbfd49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:39.077761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191232e1-7bf6-4d20-97f2-fac2bb032c09 tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:39.156250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057575b-dff4-4519-b923-d2c434cbfd49 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:39.164063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e9391-952e-49da-9fcf-ac0405d5429f tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4de5fc7dedc41999dbfba0138cab0cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cc777d367c244c2cbaa8fa5964be1c6b', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-353037532', 'tempest-DelegatedRole-1972379635'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:39.165013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9391-952e-49da-9fcf-ac0405d5429f tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:39.165353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9391-952e-49da-9fcf-ac0405d5429f tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:39.165914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e9391-952e-49da-9fcf-ac0405d5429f tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] PATH_INFO: `/v3/OS-TRUST/trusts/7324ef165aff479e9299c9b377b85814` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:39.169541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c6f62-fbaa-4687-a364-fc651e631c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:39.170709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c6f62-fbaa-4687-a364-fc651e631c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:39.170995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c6f62-fbaa-4687-a364-fc651e631c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:39.171276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c6f62-fbaa-4687-a364-fc651e631c58 admin admin] PATH_INFO: `/v3/projects/cf2fe92479e8499cbc209a309e87c0ee` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:39.172707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c6f62-fbaa-4687-a364-fc651e631c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2fe92479e8499cbc209a309e87c0ee)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:39.175658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242c6f62-fbaa-4687-a364-fc651e631c58 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:39.179980 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-c14e9391-952e-49da-9fcf-ac0405d5429f tempest-TrustsV3TestJSON-119380540 tempest-user-687622365] Could not find trust: 7324ef165aff479e9299c9b377b85814.: keystone.exception.TrustNotFound: Could not find trust: 7324ef165aff479e9299c9b377b85814. Jul 19 14:41:39.179980 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:39.179980 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:41:39.179980 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:41:39.179980 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:41:39.179980 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:41:39.179980 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:41:39.179980 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:41:39.179980 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:41:39.179980 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:41:39.179980 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:41:39.179980 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:41:39.179980 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 19 14:41:39.179980 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 19 14:41:39.179980 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 19 14:41:39.188315 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 19 14:41:39.188315 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 19 14:41:39.188315 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 19 14:41:39.188315 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 19 14:41:39.188315 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 19 14:41:39.188315 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:41:39.188315 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:41:39.188315 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 19 14:41:39.188315 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 19 14:41:39.188315 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 19 14:41:39.188315 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 19 14:41:39.188315 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 7324ef165aff479e9299c9b377b85814. Jul 19 14:41:39.188315 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:39.188315 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3349/6634] 10.222.0.43 () {58 vars in 1250 bytes} [Tue Jul 19 14:41:39 2022] GET /identity/v3/OS-TRUST/trusts/7324ef165aff479e9299c9b377b85814 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:41:39.189192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc14916-48e9-4b31-83eb-5c2f6734acea None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:39.189192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc14916-48e9-4b31-83eb-5c2f6734acea None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:39.189192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc14916-48e9-4b31-83eb-5c2f6734acea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:39.255245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7fc14916-48e9-4b31-83eb-5c2f6734acea None None] MFA Rules not processed for user `ac628ca939434e19a337817bc9cab963`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:39.256582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7fc14916-48e9-4b31-83eb-5c2f6734acea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:39.362659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-242c6f62-fbaa-4687-a364-fc651e631c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2fe92479e8499cbc209a309e87c0ee', 'request_id': 'req-242c6f62-fbaa-4687-a364-fc651e631c58'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:39.369275 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3350/6635] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:39.369275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc14916-48e9-4b31-83eb-5c2f6734acea None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:39.369275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7fc14916-48e9-4b31-83eb-5c2f6734acea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:39.466247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc14916-48e9-4b31-83eb-5c2f6734acea None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:39.523739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-242c6f62-fbaa-4687-a364-fc651e631c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2fe92479e8499cbc209a309e87c0ee', 'request_id': 'req-242c6f62-fbaa-4687-a364-fc651e631c58'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:39.529720 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:39.544740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-242c6f62-fbaa-4687-a364-fc651e631c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2fe92479e8499cbc209a309e87c0ee', 'request_id': 'req-242c6f62-fbaa-4687-a364-fc651e631c58'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:39.545070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b6b9b-4a7a-4521-b7e0-081342e9612a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:39.546075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b6b9b-4a7a-4521-b7e0-081342e9612a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:39.546671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b6b9b-4a7a-4521-b7e0-081342e9612a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:39.547199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4b6b9b-4a7a-4521-b7e0-081342e9612a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles/ac2d35e8246d45eeab058c676f50038c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:39.548714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b6b9b-4a7a-4521-b7e0-081342e9612a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ac2d35e8246d45eeab058c676f50038c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:39.550748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-242c6f62-fbaa-4687-a364-fc651e631c58 admin admin] The token cache is being invalidate because project cf2fe92479e8499cbc209a309e87c0ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:39.551322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-242c6f62-fbaa-4687-a364-fc651e631c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:39.552049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-242c6f62-fbaa-4687-a364-fc651e631c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:39.557028 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3286/6636] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:39 2022] DELETE /identity/v3/projects/cf2fe92479e8499cbc209a309e87c0ee => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:39.557028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c6f62-fbaa-4687-a364-fc651e631c58 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:39.557324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4b6b9b-4a7a-4521-b7e0-081342e9612a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:39.558882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-242c6f62-fbaa-4687-a364-fc651e631c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:39.796227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c6f62-fbaa-4687-a364-fc651e631c58 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:39.817217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a68432-ee83-4dd0-bb38-4f36006daded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:39.817932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a68432-ee83-4dd0-bb38-4f36006daded admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:39.818296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a68432-ee83-4dd0-bb38-4f36006daded admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:39.818559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a68432-ee83-4dd0-bb38-4f36006daded admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:39.819270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a68432-ee83-4dd0-bb38-4f36006daded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:39.822543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a68432-ee83-4dd0-bb38-4f36006daded admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:40.551724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fd4b6b9b-4a7a-4521-b7e0-081342e9612a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invalidating the token cache because role ac2d35e8246d45eeab058c676f50038c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:40.551936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fd4b6b9b-4a7a-4521-b7e0-081342e9612a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:40.552596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fd4b6b9b-4a7a-4521-b7e0-081342e9612a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:40.560292 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3351/6637] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:39 2022] DELETE /identity/v3/roles/ac2d35e8246d45eeab058c676f50038c => generated 0 bytes in 1194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:40.561669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b6b9b-4a7a-4521-b7e0-081342e9612a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:40.563281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fd4b6b9b-4a7a-4521-b7e0-081342e9612a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:40.606786 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3287/6638] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:39 2022] POST /identity/v3/projects => generated 381 bytes in 1048 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:40.606786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a68432-ee83-4dd0-bb38-4f36006daded admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:40.608462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f7a68432-ee83-4dd0-bb38-4f36006daded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:40.742886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4b6b9b-4a7a-4521-b7e0-081342e9612a tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:40.784166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a68432-ee83-4dd0-bb38-4f36006daded admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:40.803220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663bedf-f750-4958-8f4f-f5199376c0ac tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:40.805355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663bedf-f750-4958-8f4f-f5199376c0ac tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:40.807076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663bedf-f750-4958-8f4f-f5199376c0ac tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:40.812462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2663bedf-f750-4958-8f4f-f5199376c0ac tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/roles/9e8e3fbb85bf4159b9de2542a6037829` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:40.812462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663bedf-f750-4958-8f4f-f5199376c0ac tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9e8e3fbb85bf4159b9de2542a6037829)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:40.817167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2663bedf-f750-4958-8f4f-f5199376c0ac tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:40.903467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e052f8-c57f-4013-9618-195ee84b5322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:40.904646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e052f8-c57f-4013-9618-195ee84b5322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:40.905148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e052f8-c57f-4013-9618-195ee84b5322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:40.905651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e052f8-c57f-4013-9618-195ee84b5322 admin admin] PATH_INFO: `/v3/users/a834441c113d4e1190d9eeb16fc5db08` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:40.907273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e052f8-c57f-4013-9618-195ee84b5322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a834441c113d4e1190d9eeb16fc5db08)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:40.909975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e052f8-c57f-4013-9618-195ee84b5322 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:41.106397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2663bedf-f750-4958-8f4f-f5199376c0ac tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invalidating the token cache because role 9e8e3fbb85bf4159b9de2542a6037829 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:41.107246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2663bedf-f750-4958-8f4f-f5199376c0ac tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:41.109016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2663bedf-f750-4958-8f4f-f5199376c0ac tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:41.113665 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3288/6639] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:40 2022] DELETE /identity/v3/roles/9e8e3fbb85bf4159b9de2542a6037829 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:41.116808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663bedf-f750-4958-8f4f-f5199376c0ac tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:41.120646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2663bedf-f750-4958-8f4f-f5199376c0ac tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:41.226000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2663bedf-f750-4958-8f4f-f5199376c0ac tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:41.231709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b26909-6dfd-430f-b5eb-e27556148114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:41.232065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b26909-6dfd-430f-b5eb-e27556148114 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:41.232362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b26909-6dfd-430f-b5eb-e27556148114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:41.232650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b26909-6dfd-430f-b5eb-e27556148114 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:41.233361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b26909-6dfd-430f-b5eb-e27556148114 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:41.235320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b26909-6dfd-430f-b5eb-e27556148114 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:41.260897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d7e052f8-c57f-4013-9618-195ee84b5322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a834441c113d4e1190d9eeb16fc5db08'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:41.275767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d7e052f8-c57f-4013-9618-195ee84b5322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a834441c113d4e1190d9eeb16fc5db08'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:41.284215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d7e052f8-c57f-4013-9618-195ee84b5322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a834441c113d4e1190d9eeb16fc5db08'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:41.285039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d7e052f8-c57f-4013-9618-195ee84b5322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a834441c113d4e1190d9eeb16fc5db08'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:41.379649 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3289/6640] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:41 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:41.385518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b26909-6dfd-430f-b5eb-e27556148114 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:41.391902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d7e052f8-c57f-4013-9618-195ee84b5322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a834441c113d4e1190d9eeb16fc5db08'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:41.403207 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3352/6641] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:40 2022] DELETE /identity/v3/users/a834441c113d4e1190d9eeb16fc5db08 => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:41.403946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e052f8-c57f-4013-9618-195ee84b5322 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:41.405258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-60b26909-6dfd-430f-b5eb-e27556148114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:41.409303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d7e052f8-c57f-4013-9618-195ee84b5322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:41.512202 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:41.588003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e052f8-c57f-4013-9618-195ee84b5322 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:41.594903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af86e0-2a41-48b8-8662-eefa991587cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:41.595688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af86e0-2a41-48b8-8662-eefa991587cb admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:41.596049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af86e0-2a41-48b8-8662-eefa991587cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:41.596411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12af86e0-2a41-48b8-8662-eefa991587cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:41.597342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af86e0-2a41-48b8-8662-eefa991587cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:41.603411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12af86e0-2a41-48b8-8662-eefa991587cb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:41.639893 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3353/6642] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:41.642401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af86e0-2a41-48b8-8662-eefa991587cb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:41.652127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-12af86e0-2a41-48b8-8662-eefa991587cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:41.680490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b26909-6dfd-430f-b5eb-e27556148114 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:41.851875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12af86e0-2a41-48b8-8662-eefa991587cb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:41.857120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a67166-df60-4f81-acac-7721ceb9a8ae tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:41.858408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a67166-df60-4f81-acac-7721ceb9a8ae tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:41.858544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a67166-df60-4f81-acac-7721ceb9a8ae tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:41.858858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a67166-df60-4f81-acac-7721ceb9a8ae tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/users/c4de5fc7dedc41999dbfba0138cab0cf` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:41.867925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a67166-df60-4f81-acac-7721ceb9a8ae tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c4de5fc7dedc41999dbfba0138cab0cf)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:41.869687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a67166-df60-4f81-acac-7721ceb9a8ae tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:41.876742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea420423-6b8b-4d7c-8c94-80be2ac8203d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:41.878280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea420423-6b8b-4d7c-8c94-80be2ac8203d service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:41.878476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea420423-6b8b-4d7c-8c94-80be2ac8203d service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:41.878743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea420423-6b8b-4d7c-8c94-80be2ac8203d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:41.884409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ea420423-6b8b-4d7c-8c94-80be2ac8203d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:42.050502 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:42.105254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea420423-6b8b-4d7c-8c94-80be2ac8203d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:42.106946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea420423-6b8b-4d7c-8c94-80be2ac8203d service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:42.114686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e9a67166-df60-4f81-acac-7721ceb9a8ae tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4de5fc7dedc41999dbfba0138cab0cf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:42.137656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e9a67166-df60-4f81-acac-7721ceb9a8ae tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4de5fc7dedc41999dbfba0138cab0cf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:42.139002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e9a67166-df60-4f81-acac-7721ceb9a8ae tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4de5fc7dedc41999dbfba0138cab0cf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:42.140329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e9a67166-df60-4f81-acac-7721ceb9a8ae tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4de5fc7dedc41999dbfba0138cab0cf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:42.151979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e9a67166-df60-4f81-acac-7721ceb9a8ae tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4de5fc7dedc41999dbfba0138cab0cf'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:42.179578 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3354/6643] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:42.180460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea420423-6b8b-4d7c-8c94-80be2ac8203d service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:42.195976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea420423-6b8b-4d7c-8c94-80be2ac8203d service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:42.202063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efbbf6-9b3b-49ec-a686-417177e0d1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:42.203299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efbbf6-9b3b-49ec-a686-417177e0d1e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:42.203605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efbbf6-9b3b-49ec-a686-417177e0d1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:42.203904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95efbbf6-9b3b-49ec-a686-417177e0d1e5 admin admin] PATH_INFO: `/v3/projects/0f5ff94ee8de48eda754fbc29f63996d/users/f9ff0d82a5294bb58e43542ec044d4ff/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:42.233693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efbbf6-9b3b-49ec-a686-417177e0d1e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f5ff94ee8de48eda754fbc29f63996d, user_id=f9ff0d82a5294bb58e43542ec044d4ff, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:42.240506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95efbbf6-9b3b-49ec-a686-417177e0d1e5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:42.277078 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3290/6644] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:41 2022] DELETE /identity/v3/users/c4de5fc7dedc41999dbfba0138cab0cf => generated 0 bytes in 878 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:42.277078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a67166-df60-4f81-acac-7721ceb9a8ae tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:42.277883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e9a67166-df60-4f81-acac-7721ceb9a8ae tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:42.388025 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3355/6645] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:42 2022] PUT /identity/v3/projects/0f5ff94ee8de48eda754fbc29f63996d/users/f9ff0d82a5294bb58e43542ec044d4ff/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:42.391479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efbbf6-9b3b-49ec-a686-417177e0d1e5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:42.396110 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-95efbbf6-9b3b-49ec-a686-417177e0d1e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:42.544578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a67166-df60-4f81-acac-7721ceb9a8ae tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:42.564663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95efbbf6-9b3b-49ec-a686-417177e0d1e5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:42.569909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4c9f8-031d-4de0-b0fb-3ff0d473d41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:42.570904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4c9f8-031d-4de0-b0fb-3ff0d473d41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:42.571195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4c9f8-031d-4de0-b0fb-3ff0d473d41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:42.571477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4c9f8-031d-4de0-b0fb-3ff0d473d41a admin admin] PATH_INFO: `/v3/projects/585677fcb8bc4975afd68e132d54f896` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:42.573097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4c9f8-031d-4de0-b0fb-3ff0d473d41a admin admin] RBAC: Authorizing `identity:delete_project(project_id=585677fcb8bc4975afd68e132d54f896)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:42.575290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4c9f8-031d-4de0-b0fb-3ff0d473d41a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:42.721612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598a7ca-5582-4afb-8b6c-bafe2d2bca25 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86c111f5265f45ad9fb81cc1423f1f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '84d77f1a646c48d8a62b47f39611d7b2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:42.724614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598a7ca-5582-4afb-8b6c-bafe2d2bca25 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:42.724930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598a7ca-5582-4afb-8b6c-bafe2d2bca25 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:42.725221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598a7ca-5582-4afb-8b6c-bafe2d2bca25 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] PATH_INFO: `/v3/projects/cc777d367c244c2cbaa8fa5964be1c6b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:42.727271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598a7ca-5582-4afb-8b6c-bafe2d2bca25 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cc777d367c244c2cbaa8fa5964be1c6b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:42.730300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598a7ca-5582-4afb-8b6c-bafe2d2bca25 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:42.799452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7eb4c9f8-031d-4de0-b0fb-3ff0d473d41a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '585677fcb8bc4975afd68e132d54f896', 'request_id': 'req-7eb4c9f8-031d-4de0-b0fb-3ff0d473d41a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:42.805572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7eb4c9f8-031d-4de0-b0fb-3ff0d473d41a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '585677fcb8bc4975afd68e132d54f896', 'request_id': 'req-7eb4c9f8-031d-4de0-b0fb-3ff0d473d41a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:42.816457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7eb4c9f8-031d-4de0-b0fb-3ff0d473d41a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '585677fcb8bc4975afd68e132d54f896', 'request_id': 'req-7eb4c9f8-031d-4de0-b0fb-3ff0d473d41a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:42.947459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7eb4c9f8-031d-4de0-b0fb-3ff0d473d41a admin admin] The token cache is being invalidate because project 585677fcb8bc4975afd68e132d54f896 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:42.947779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7eb4c9f8-031d-4de0-b0fb-3ff0d473d41a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:42.948595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7eb4c9f8-031d-4de0-b0fb-3ff0d473d41a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:42.954415 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3356/6646] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:42 2022] DELETE /identity/v3/projects/585677fcb8bc4975afd68e132d54f896 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:42.954415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4c9f8-031d-4de0-b0fb-3ff0d473d41a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:42.954415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7eb4c9f8-031d-4de0-b0fb-3ff0d473d41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:42.972571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9598a7ca-5582-4afb-8b6c-bafe2d2bca25 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc777d367c244c2cbaa8fa5964be1c6b', 'request_id': 'req-9598a7ca-5582-4afb-8b6c-bafe2d2bca25'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:43.066121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9598a7ca-5582-4afb-8b6c-bafe2d2bca25 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc777d367c244c2cbaa8fa5964be1c6b', 'request_id': 'req-9598a7ca-5582-4afb-8b6c-bafe2d2bca25'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:43.072233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9598a7ca-5582-4afb-8b6c-bafe2d2bca25 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc777d367c244c2cbaa8fa5964be1c6b', 'request_id': 'req-9598a7ca-5582-4afb-8b6c-bafe2d2bca25'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:43.110342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9598a7ca-5582-4afb-8b6c-bafe2d2bca25 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] The token cache is being invalidate because project cc777d367c244c2cbaa8fa5964be1c6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:43.110606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9598a7ca-5582-4afb-8b6c-bafe2d2bca25 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:43.111238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9598a7ca-5582-4afb-8b6c-bafe2d2bca25 tempest-TrustsV3TestJSON-1944690201 tempest-TrustsV3TestJSON-1944690201-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:43.118680 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3291/6647] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:42 2022] DELETE /identity/v3/projects/cc777d367c244c2cbaa8fa5964be1c6b => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:43.128651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7028447-bff2-4f65-b0f0-8d464d32cbc6 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:43.128947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7028447-bff2-4f65-b0f0-8d464d32cbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:43.129230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7028447-bff2-4f65-b0f0-8d464d32cbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:43.166897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f7028447-bff2-4f65-b0f0-8d464d32cbc6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:43.168546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f7028447-bff2-4f65-b0f0-8d464d32cbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:43.181567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4c9f8-031d-4de0-b0fb-3ff0d473d41a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:43.335264 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3292/6648] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:43.337557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7028447-bff2-4f65-b0f0-8d464d32cbc6 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:43.339154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f7028447-bff2-4f65-b0f0-8d464d32cbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:43.353994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb0d843-a220-48d9-9e48-c2da446d9d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:43.357628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0d843-a220-48d9-9e48-c2da446d9d59 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:43.358789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0d843-a220-48d9-9e48-c2da446d9d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:43.360772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb0d843-a220-48d9-9e48-c2da446d9d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:43.362344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0d843-a220-48d9-9e48-c2da446d9d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:43.364074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb0d843-a220-48d9-9e48-c2da446d9d59 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:43.367983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7028447-bff2-4f65-b0f0-8d464d32cbc6 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:43.375900 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:43.381880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da95effb-5eeb-4f1a-a1ff-db8379e773d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:43.383080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95effb-5eeb-4f1a-a1ff-db8379e773d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:43.383371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95effb-5eeb-4f1a-a1ff-db8379e773d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:43.383651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da95effb-5eeb-4f1a-a1ff-db8379e773d7 admin admin] PATH_INFO: `/v3/users/dd779757eddc4ee49e1875f205fbd11e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:43.389249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95effb-5eeb-4f1a-a1ff-db8379e773d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd779757eddc4ee49e1875f205fbd11e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:43.391225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da95effb-5eeb-4f1a-a1ff-db8379e773d7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:43.403712 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3357/6649] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 452 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:43.412295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f99ec-046a-4b2b-9ea4-0d0954f5ab1e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:43.412612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f99ec-046a-4b2b-9ea4-0d0954f5ab1e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:43.412877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913f99ec-046a-4b2b-9ea4-0d0954f5ab1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:43.435178 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:43.474830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-913f99ec-046a-4b2b-9ea4-0d0954f5ab1e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:43.478533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-913f99ec-046a-4b2b-9ea4-0d0954f5ab1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:43.497223 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3358/6650] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:43.499016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f99ec-046a-4b2b-9ea4-0d0954f5ab1e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:43.500687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-913f99ec-046a-4b2b-9ea4-0d0954f5ab1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:43.519589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913f99ec-046a-4b2b-9ea4-0d0954f5ab1e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:43.526799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a223ba-d1b2-4b70-b8a9-e840096d1f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:43.527712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a223ba-d1b2-4b70-b8a9-e840096d1f82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:43.528001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a223ba-d1b2-4b70-b8a9-e840096d1f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:43.528285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a223ba-d1b2-4b70-b8a9-e840096d1f82 admin admin] PATH_INFO: `/v3/projects/0f5ff94ee8de48eda754fbc29f63996d/users/f9ff0d82a5294bb58e43542ec044d4ff/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:43.530355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a223ba-d1b2-4b70-b8a9-e840096d1f82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f5ff94ee8de48eda754fbc29f63996d, user_id=f9ff0d82a5294bb58e43542ec044d4ff, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:43.533269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a223ba-d1b2-4b70-b8a9-e840096d1f82 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:43.546762 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3359/6651] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:43 2022] PUT /identity/v3/projects/0f5ff94ee8de48eda754fbc29f63996d/users/f9ff0d82a5294bb58e43542ec044d4ff/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:43.550914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a223ba-d1b2-4b70-b8a9-e840096d1f82 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:43.651069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a223ba-d1b2-4b70-b8a9-e840096d1f82 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:43.660010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc6bc7-b96c-4199-ab7b-f0ca3cf7375e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:43.660010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc6bc7-b96c-4199-ab7b-f0ca3cf7375e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:43.663058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc6bc7-b96c-4199-ab7b-f0ca3cf7375e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:43.663498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc6bc7-b96c-4199-ab7b-f0ca3cf7375e admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:43.664608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc6bc7-b96c-4199-ab7b-f0ca3cf7375e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:41:43.665003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc6bc7-b96c-4199-ab7b-f0ca3cf7375e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:43.667083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc6bc7-b96c-4199-ab7b-f0ca3cf7375e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:43.684671 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3360/6652] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:43.689850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc6bc7-b96c-4199-ab7b-f0ca3cf7375e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:43.692058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-27cc6bc7-b96c-4199-ab7b-f0ca3cf7375e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:43.804436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-da95effb-5eeb-4f1a-a1ff-db8379e773d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd779757eddc4ee49e1875f205fbd11e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:43.828773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-da95effb-5eeb-4f1a-a1ff-db8379e773d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd779757eddc4ee49e1875f205fbd11e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:43.828773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-da95effb-5eeb-4f1a-a1ff-db8379e773d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd779757eddc4ee49e1875f205fbd11e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:43.828773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-da95effb-5eeb-4f1a-a1ff-db8379e773d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd779757eddc4ee49e1875f205fbd11e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:43.829025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc6bc7-b96c-4199-ab7b-f0ca3cf7375e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:43.838911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a112c38-76cd-4d97-8770-3640c78b7b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:43.839374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-da95effb-5eeb-4f1a-a1ff-db8379e773d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd779757eddc4ee49e1875f205fbd11e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:43.839619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a112c38-76cd-4d97-8770-3640c78b7b3f service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:43.839908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a112c38-76cd-4d97-8770-3640c78b7b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:43.840190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a112c38-76cd-4d97-8770-3640c78b7b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:43.842472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7a112c38-76cd-4d97-8770-3640c78b7b3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:43.934636 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3293/6653] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:43 2022] DELETE /identity/v3/users/dd779757eddc4ee49e1875f205fbd11e => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:43.937627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77db12-fe5f-4ae0-9c0d-586ab19edc8f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:43.944967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77db12-fe5f-4ae0-9c0d-586ab19edc8f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:43.944967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77db12-fe5f-4ae0-9c0d-586ab19edc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:43.983714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a112c38-76cd-4d97-8770-3640c78b7b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:43.986655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a112c38-76cd-4d97-8770-3640c78b7b3f service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:44.005648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-aa77db12-fe5f-4ae0-9c0d-586ab19edc8f None None] MFA Rules not processed for user `f9ff0d82a5294bb58e43542ec044d4ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:44.006997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aa77db12-fe5f-4ae0-9c0d-586ab19edc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:44.020604 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3361/6654] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:44.021649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a112c38-76cd-4d97-8770-3640c78b7b3f service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:44.023065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7a112c38-76cd-4d97-8770-3640c78b7b3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:44.154408 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3294/6655] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:44.156181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77db12-fe5f-4ae0-9c0d-586ab19edc8f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:44.159238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aa77db12-fe5f-4ae0-9c0d-586ab19edc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:44.165346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a112c38-76cd-4d97-8770-3640c78b7b3f service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:44.346888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b241a-7979-4e57-9c25-2033f993e64a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:44.348187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b241a-7979-4e57-9c25-2033f993e64a service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:44.348479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b241a-7979-4e57-9c25-2033f993e64a service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:44.348759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b241a-7979-4e57-9c25-2033f993e64a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:44.356218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8e6b241a-7979-4e57-9c25-2033f993e64a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:44.375108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77db12-fe5f-4ae0-9c0d-586ab19edc8f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:44.377992 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:44.383658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a668ab-f735-4087-9c74-619a4fd18ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:44.384736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a668ab-f735-4087-9c74-619a4fd18ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:44.385279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a668ab-f735-4087-9c74-619a4fd18ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:44.385833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a668ab-f735-4087-9c74-619a4fd18ef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:44.386770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a668ab-f735-4087-9c74-619a4fd18ef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:44.390323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a668ab-f735-4087-9c74-619a4fd18ef3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:44.481283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b241a-7979-4e57-9c25-2033f993e64a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:44.488543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b241a-7979-4e57-9c25-2033f993e64a service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:44.519021 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3362/6656] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:44.522260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49772a6-d002-4320-8ef9-fdb33ce758e4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:44.522574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49772a6-d002-4320-8ef9-fdb33ce758e4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:44.522854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49772a6-d002-4320-8ef9-fdb33ce758e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:44.558074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e49772a6-d002-4320-8ef9-fdb33ce758e4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:44.560567 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3295/6657] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:44 2022] POST /identity/v3/projects => generated 393 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:44.561533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a668ab-f735-4087-9c74-619a4fd18ef3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:44.562844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e49772a6-d002-4320-8ef9-fdb33ce758e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:44.692161 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:44.708861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a668ab-f735-4087-9c74-619a4fd18ef3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:44.731599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b60d1-5b08-4441-8a7d-f1a7686774e4 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ff0d82a5294bb58e43542ec044d4ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f5ff94ee8de48eda754fbc29f63996d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:44.733471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b60d1-5b08-4441-8a7d-f1a7686774e4 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:44.733471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b60d1-5b08-4441-8a7d-f1a7686774e4 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:44.733471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b60d1-5b08-4441-8a7d-f1a7686774e4 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:44.734501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b60d1-5b08-4441-8a7d-f1a7686774e4 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:44.736204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b60d1-5b08-4441-8a7d-f1a7686774e4 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:44.744929 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3363/6658] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:44.745623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49772a6-d002-4320-8ef9-fdb33ce758e4 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-662b60d1-5b08-4441-8a7d-f1a7686774e4 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invalid input for field 'name': '' is too short Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: Failed validating 'minLength' in schema['properties']['name']: Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: On instance['name']: Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: Failed validating 'minLength' in schema['properties']['name']: Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: On instance['name']: Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: '' Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise error Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application On instance['name']: Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application '' Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:44.761284 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:41:44.763110 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:44.763110 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:44.763110 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:41:44.763110 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:41:44.763110 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:41:44.763110 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:41:44.763110 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:41:44.763110 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:41:44.763110 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:41:44.763110 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:41:44.763110 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:41:44.763110 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:41:44.763110 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jul 19 14:41:44.763110 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jul 19 14:41:44.763110 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 19 14:41:44.763110 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 19 14:41:44.763110 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 19 14:41:44.764273 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 19 14:41:44.764273 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 19 14:41:44.764273 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:44.764273 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 19 14:41:44.764273 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 14:41:44.764273 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:44.764273 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application On instance['name']: Jul 19 14:41:44.764273 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application '' Jul 19 14:41:44.764273 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:44.765264 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3296/6659] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:41:44 2022] POST /identity/v3/domains => generated 283 bytes in 204 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 19 14:41:44.773697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b60d1-5b08-4441-8a7d-f1a7686774e4 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:44.781544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-662b60d1-5b08-4441-8a7d-f1a7686774e4 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:44.784929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49772a6-d002-4320-8ef9-fdb33ce758e4 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:44.805263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b8bd9-1e7b-4d31-a4e3-d35951caa95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:44.806219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b8bd9-1e7b-4d31-a4e3-d35951caa95b admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:44.806665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b8bd9-1e7b-4d31-a4e3-d35951caa95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:44.808129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b8bd9-1e7b-4d31-a4e3-d35951caa95b admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:44.808129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b8bd9-1e7b-4d31-a4e3-d35951caa95b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:44.810243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b8bd9-1e7b-4d31-a4e3-d35951caa95b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:44.906877 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3364/6660] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:44 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:44.907480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b8bd9-1e7b-4d31-a4e3-d35951caa95b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:44.954891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b8bd9-1e7b-4d31-a4e3-d35951caa95b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:44.999082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b60d1-5b08-4441-8a7d-f1a7686774e4 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:44.999588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a020f7f-789c-4ab3-927c-bd54fa01d26e tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ff0d82a5294bb58e43542ec044d4ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f5ff94ee8de48eda754fbc29f63996d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:45.001055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b855edd-9886-44bb-a483-5c4b0aecdbf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:45.001748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b855edd-9886-44bb-a483-5c4b0aecdbf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:45.002610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b855edd-9886-44bb-a483-5c4b0aecdbf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:45.004265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b855edd-9886-44bb-a483-5c4b0aecdbf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:45.008600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a020f7f-789c-4ab3-927c-bd54fa01d26e tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:45.009094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a020f7f-789c-4ab3-927c-bd54fa01d26e tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:45.011027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a020f7f-789c-4ab3-927c-bd54fa01d26e tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:45.013734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a020f7f-789c-4ab3-927c-bd54fa01d26e tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:45.030662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a020f7f-789c-4ab3-927c-bd54fa01d26e tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:45.044723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-0a020f7f-789c-4ab3-927c-bd54fa01d26e tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 14:41:45.044723 n-d-master-1 devstack@keystone.service[80680]: Failed validating 'maxLength' in schema['properties']['name']: Jul 19 14:41:45.044723 n-d-master-1 devstack@keystone.service[80680]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 14:41:45.044723 n-d-master-1 devstack@keystone.service[80680]: On instance['name']: Jul 19 14:41:45.044723 n-d-master-1 devstack@keystone.service[80680]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 14:41:45.044723 n-d-master-1 devstack@keystone.service[80680]: Failed validating 'maxLength' in schema['properties']['name']: Jul 19 14:41:45.044723 n-d-master-1 devstack@keystone.service[80680]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 14:41:45.044723 n-d-master-1 devstack@keystone.service[80680]: On instance['name']: Jul 19 14:41:45.044723 n-d-master-1 devstack@keystone.service[80680]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 14:41:45.044723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:45.044723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 19 14:41:45.044723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 19 14:41:45.044723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 14:41:45.044723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise error Jul 19 14:41:45.044723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 14:41:45.044723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:45.044723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 19 14:41:45.044723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 14:41:45.044723 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:45.051700 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application On instance['name']: Jul 19 14:41:45.051700 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 14:41:45.051700 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:45.051700 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:41:45.051700 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:45.051700 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:45.051700 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:41:45.051700 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:41:45.051700 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:41:45.051700 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:41:45.051700 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:41:45.051700 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:41:45.051700 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:41:45.051700 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:41:45.051700 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:41:45.051700 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:41:45.051700 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jul 19 14:41:45.051700 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jul 19 14:41:45.053046 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 19 14:41:45.053046 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 19 14:41:45.053046 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 19 14:41:45.053046 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 19 14:41:45.053046 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 14:41:45.053046 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:45.053046 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 19 14:41:45.053046 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 14:41:45.053046 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:45.053046 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application On instance['name']: Jul 19 14:41:45.053046 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 14:41:45.053046 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:45.053892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b855edd-9886-44bb-a483-5c4b0aecdbf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:45.053892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b855edd-9886-44bb-a483-5c4b0aecdbf7 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:45.075659 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3365/6661] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:41:44 2022] POST /identity/v3/domains => generated 412 bytes in 164 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 19 14:41:45.075873 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3297/6662] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:45.075975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a020f7f-789c-4ab3-927c-bd54fa01d26e tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:45.083599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b855edd-9886-44bb-a483-5c4b0aecdbf7 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:45.143382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a020f7f-789c-4ab3-927c-bd54fa01d26e tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:45.152153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b855edd-9886-44bb-a483-5c4b0aecdbf7 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:45.172008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060a16b-153a-4934-892e-4260c4c652c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:45.175064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060a16b-153a-4934-892e-4260c4c652c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:45.175946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388c40d-5038-4cb3-bee7-596e081097a3 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ff0d82a5294bb58e43542ec044d4ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f5ff94ee8de48eda754fbc29f63996d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:45.176632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060a16b-153a-4934-892e-4260c4c652c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:45.177107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060a16b-153a-4934-892e-4260c4c652c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:45.184729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388c40d-5038-4cb3-bee7-596e081097a3 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:45.187557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060a16b-153a-4934-892e-4260c4c652c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:45.188068 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:45.190675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388c40d-5038-4cb3-bee7-596e081097a3 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:45.192802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388c40d-5038-4cb3-bee7-596e081097a3 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:45.192802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388c40d-5038-4cb3-bee7-596e081097a3 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:45.193016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060a16b-153a-4934-892e-4260c4c652c8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:45.202660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388c40d-5038-4cb3-bee7-596e081097a3 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:45.261913 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3366/6663] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:45.265189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060a16b-153a-4934-892e-4260c4c652c8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:45.279565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060a16b-153a-4934-892e-4260c4c652c8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:45.295580 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:45.296592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e96e2b-2f91-496c-8e87-55fd31e0283f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:45.297408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e96e2b-2f91-496c-8e87-55fd31e0283f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:45.302920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e96e2b-2f91-496c-8e87-55fd31e0283f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:45.309263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e96e2b-2f91-496c-8e87-55fd31e0283f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:45.309263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e96e2b-2f91-496c-8e87-55fd31e0283f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:45.309263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e96e2b-2f91-496c-8e87-55fd31e0283f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:45.326330 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3367/6664] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:41:45.330075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e96e2b-2f91-496c-8e87-55fd31e0283f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:45.341857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e96e2b-2f91-496c-8e87-55fd31e0283f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:45.366398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5dfd8-01ad-4021-819a-b949ad222556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:45.370162 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3298/6665] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:41:45 2022] POST /identity/v3/domains => generated 275 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:41:45.370307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5dfd8-01ad-4021-819a-b949ad222556 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:45.370307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5dfd8-01ad-4021-819a-b949ad222556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:45.370307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5dfd8-01ad-4021-819a-b949ad222556 admin admin] PATH_INFO: `/v3/projects/cfcbef0c60b84453aa839501679d4b8a/users/bf3bf6cc997f4144866ac163ea1d57bc/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:45.371676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388c40d-5038-4cb3-bee7-596e081097a3 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:45.434396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5dfd8-01ad-4021-819a-b949ad222556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfcbef0c60b84453aa839501679d4b8a, user_id=bf3bf6cc997f4144866ac163ea1d57bc, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:45.437437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5dfd8-01ad-4021-819a-b949ad222556 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:45.544414 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3368/6666] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:45 2022] PUT /identity/v3/projects/cfcbef0c60b84453aa839501679d4b8a/users/bf3bf6cc997f4144866ac163ea1d57bc/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:41:45.546879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa4442-7144-4526-9806-d033f20fd081 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:45.547281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa4442-7144-4526-9806-d033f20fd081 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:45.548454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa4442-7144-4526-9806-d033f20fd081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:45.557376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388c40d-5038-4cb3-bee7-596e081097a3 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:45.650482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2daa4442-7144-4526-9806-d033f20fd081 None None] MFA Rules not processed for user `bf3bf6cc997f4144866ac163ea1d57bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:45.652976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2daa4442-7144-4526-9806-d033f20fd081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:45.660704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a31ec-0efe-4145-99a2-d1ba8eed979a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ff0d82a5294bb58e43542ec044d4ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f5ff94ee8de48eda754fbc29f63996d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:45.661673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a31ec-0efe-4145-99a2-d1ba8eed979a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:45.662949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a31ec-0efe-4145-99a2-d1ba8eed979a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:45.662949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4a31ec-0efe-4145-99a2-d1ba8eed979a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] PATH_INFO: `/v3/domains/1fb6815da88c478793dbbf1721911335` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:45.677265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a31ec-0efe-4145-99a2-d1ba8eed979a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1fb6815da88c478793dbbf1721911335)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:45.679056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4a31ec-0efe-4145-99a2-d1ba8eed979a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:45.702922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-fe4a31ec-0efe-4145-99a2-d1ba8eed979a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jul 19 14:41:45.702922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:45.702922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:41:45.702922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:41:45.702922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:41:45.702922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:41:45.702922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:41:45.702922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:41:45.702922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:41:45.702922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:41:45.702922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:41:45.702922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:41:45.702922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Jul 19 14:41:45.702922 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Jul 19 14:41:45.706482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:41:45.706482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:41:45.706482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Jul 19 14:41:45.706482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Jul 19 14:41:45.706482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Jul 19 14:41:45.706482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jul 19 14:41:45.706482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jul 19 14:41:45.706482 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:45.706482 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3299/6667] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:41:45 2022] DELETE /identity/v3/domains/1fb6815da88c478793dbbf1721911335 => generated 120 bytes in 334 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Jul 19 14:41:45.710376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a31ec-0efe-4145-99a2-d1ba8eed979a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:45.724074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4a31ec-0efe-4145-99a2-d1ba8eed979a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:45.730059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3731a-5cce-442e-ba2a-9209a197c669 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ff0d82a5294bb58e43542ec044d4ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f5ff94ee8de48eda754fbc29f63996d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:45.732504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3731a-5cce-442e-ba2a-9209a197c669 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:45.732504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3731a-5cce-442e-ba2a-9209a197c669 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:45.732504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed3731a-5cce-442e-ba2a-9209a197c669 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] PATH_INFO: `/v3/domains/1fb6815da88c478793dbbf1721911335` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:45.733730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3731a-5cce-442e-ba2a-9209a197c669 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1fb6815da88c478793dbbf1721911335)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:45.735523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed3731a-5cce-442e-ba2a-9209a197c669 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:45.762471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eed3731a-5cce-442e-ba2a-9209a197c669 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1fb6815da88c478793dbbf1721911335'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:45.763277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eed3731a-5cce-442e-ba2a-9209a197c669 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1fb6815da88c478793dbbf1721911335'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:45.771208 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3369/6668] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:45.784282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa4442-7144-4526-9806-d033f20fd081 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:45.797018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa4442-7144-4526-9806-d033f20fd081 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:45.857069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457e2b1-b7ff-4a97-9428-c69b6f8c4b1f tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf3bf6cc997f4144866ac163ea1d57bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcbef0c60b84453aa839501679d4b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:45.858130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457e2b1-b7ff-4a97-9428-c69b6f8c4b1f tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:45.858424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457e2b1-b7ff-4a97-9428-c69b6f8c4b1f tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:45.858706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457e2b1-b7ff-4a97-9428-c69b6f8c4b1f tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] PATH_INFO: `/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:45.859444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457e2b1-b7ff-4a97-9428-c69b6f8c4b1f tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorizing `identity:create_application_credential(user_id=bf3bf6cc997f4144866ac163ea1d57bc)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:45.860614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457e2b1-b7ff-4a97-9428-c69b6f8c4b1f tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:45.984923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eed3731a-5cce-442e-ba2a-9209a197c669 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1fb6815da88c478793dbbf1721911335'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:45.986985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eed3731a-5cce-442e-ba2a-9209a197c669 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1fb6815da88c478793dbbf1721911335'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:45.996252 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3300/6669] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:41:45 2022] PATCH /identity/v3/domains/1fb6815da88c478793dbbf1721911335 => generated 276 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:41:45.997607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3731a-5cce-442e-ba2a-9209a197c669 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:45.999288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eed3731a-5cce-442e-ba2a-9209a197c669 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:46.040129 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3370/6670] 10.222.0.43 () {60 vars in 1313 bytes} [Tue Jul 19 14:41:45 2022] POST /identity/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials => generated 789 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:41:46.041232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457e2b1-b7ff-4a97-9428-c69b6f8c4b1f tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:46.047191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1457e2b1-b7ff-4a97-9428-c69b6f8c4b1f tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:46.124536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed3731a-5cce-442e-ba2a-9209a197c669 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:46.135919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491913e9-1357-429d-b69d-5ab42bf29408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:46.137112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491913e9-1357-429d-b69d-5ab42bf29408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:46.137567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491913e9-1357-429d-b69d-5ab42bf29408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:46.138191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491913e9-1357-429d-b69d-5ab42bf29408 admin admin] PATH_INFO: `/v3/projects/fe7c55047f3b4c6b945711143361d94b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:46.145158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491913e9-1357-429d-b69d-5ab42bf29408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe7c55047f3b4c6b945711143361d94b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:46.147521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491913e9-1357-429d-b69d-5ab42bf29408 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:46.155943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457e2b1-b7ff-4a97-9428-c69b6f8c4b1f tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:46.156095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac6da4-7e0b-4882-93ce-8de979e2676f tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ff0d82a5294bb58e43542ec044d4ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f5ff94ee8de48eda754fbc29f63996d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:46.156895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac6da4-7e0b-4882-93ce-8de979e2676f tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:46.157186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac6da4-7e0b-4882-93ce-8de979e2676f tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:46.157468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac6da4-7e0b-4882-93ce-8de979e2676f tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] PATH_INFO: `/v3/domains/1fb6815da88c478793dbbf1721911335` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:46.171448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac6da4-7e0b-4882-93ce-8de979e2676f tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1fb6815da88c478793dbbf1721911335)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:46.173464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ac6da4-7e0b-4882-93ce-8de979e2676f tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:46.207425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a2ac6da4-7e0b-4882-93ce-8de979e2676f tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1fb6815da88c478793dbbf1721911335'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:46.239256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a2ac6da4-7e0b-4882-93ce-8de979e2676f tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1fb6815da88c478793dbbf1721911335'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:46.360441 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:46.397560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-491913e9-1357-429d-b69d-5ab42bf29408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe7c55047f3b4c6b945711143361d94b', 'request_id': 'req-491913e9-1357-429d-b69d-5ab42bf29408'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:46.407662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a2ac6da4-7e0b-4882-93ce-8de979e2676f tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fb6815da88c478793dbbf1721911335', 'request_id': 'req-a2ac6da4-7e0b-4882-93ce-8de979e2676f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:46.415789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a2ac6da4-7e0b-4882-93ce-8de979e2676f tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fb6815da88c478793dbbf1721911335', 'request_id': 'req-a2ac6da4-7e0b-4882-93ce-8de979e2676f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:46.425422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a2ac6da4-7e0b-4882-93ce-8de979e2676f tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fb6815da88c478793dbbf1721911335', 'request_id': 'req-a2ac6da4-7e0b-4882-93ce-8de979e2676f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:46.492594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-491913e9-1357-429d-b69d-5ab42bf29408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe7c55047f3b4c6b945711143361d94b', 'request_id': 'req-491913e9-1357-429d-b69d-5ab42bf29408'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:46.505150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-491913e9-1357-429d-b69d-5ab42bf29408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe7c55047f3b4c6b945711143361d94b', 'request_id': 'req-491913e9-1357-429d-b69d-5ab42bf29408'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:46.521967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-491913e9-1357-429d-b69d-5ab42bf29408 admin admin] The token cache is being invalidate because project fe7c55047f3b4c6b945711143361d94b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:46.522156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-491913e9-1357-429d-b69d-5ab42bf29408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:46.522811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-491913e9-1357-429d-b69d-5ab42bf29408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:46.524530 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3301/6671] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:45 2022] DELETE /identity/v3/projects/fe7c55047f3b4c6b945711143361d94b => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:46.525338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491913e9-1357-429d-b69d-5ab42bf29408 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:46.526647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-491913e9-1357-429d-b69d-5ab42bf29408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:46.584900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a2ac6da4-7e0b-4882-93ce-8de979e2676f tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] The token cache is being invalidate because project 1fb6815da88c478793dbbf1721911335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:46.588340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a2ac6da4-7e0b-4882-93ce-8de979e2676f tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:46.588340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a2ac6da4-7e0b-4882-93ce-8de979e2676f tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:46.610986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a2ac6da4-7e0b-4882-93ce-8de979e2676f tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1fb6815da88c478793dbbf1721911335', 'request_id': 'req-a2ac6da4-7e0b-4882-93ce-8de979e2676f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:46.612398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a2ac6da4-7e0b-4882-93ce-8de979e2676f tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1fb6815da88c478793dbbf1721911335', 'request_id': 'req-a2ac6da4-7e0b-4882-93ce-8de979e2676f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:46.613626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a2ac6da4-7e0b-4882-93ce-8de979e2676f tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1fb6815da88c478793dbbf1721911335', 'request_id': 'req-a2ac6da4-7e0b-4882-93ce-8de979e2676f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:46.619540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491913e9-1357-429d-b69d-5ab42bf29408 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:46.626333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50992b03-473a-4a81-9b7d-235436d7ba1c tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf3bf6cc997f4144866ac163ea1d57bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcbef0c60b84453aa839501679d4b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:46.633279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50992b03-473a-4a81-9b7d-235436d7ba1c tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:46.633745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50992b03-473a-4a81-9b7d-235436d7ba1c tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:46.634274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50992b03-473a-4a81-9b7d-235436d7ba1c tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] PATH_INFO: `/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials/b41dfe04e8a248cc94ae3604f887bcc0` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:46.664117 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3371/6672] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:41:46 2022] DELETE /identity/v3/domains/1fb6815da88c478793dbbf1721911335 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:46.664970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac6da4-7e0b-4882-93ce-8de979e2676f tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:46.669027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a2ac6da4-7e0b-4882-93ce-8de979e2676f tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:46.672004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50992b03-473a-4a81-9b7d-235436d7ba1c tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorizing `identity:get_application_credential(user_id=bf3bf6cc997f4144866ac163ea1d57bc, application_credential_id=b41dfe04e8a248cc94ae3604f887bcc0)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:46.675274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50992b03-473a-4a81-9b7d-235436d7ba1c tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:46.679520 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3302/6673] 10.222.0.43 () {58 vars in 1391 bytes} [Tue Jul 19 14:41:46 2022] GET /identity/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials/b41dfe04e8a248cc94ae3604f887bcc0 => generated 689 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:46.679520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50992b03-473a-4a81-9b7d-235436d7ba1c tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:46.681245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-50992b03-473a-4a81-9b7d-235436d7ba1c tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:46.778339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac6da4-7e0b-4882-93ce-8de979e2676f tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:46.815331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50992b03-473a-4a81-9b7d-235436d7ba1c tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:46.825884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cadce-0082-4c49-a7fd-cc4da4932770 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ff0d82a5294bb58e43542ec044d4ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f5ff94ee8de48eda754fbc29f63996d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:46.832184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cadce-0082-4c49-a7fd-cc4da4932770 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:46.832967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cadce-0082-4c49-a7fd-cc4da4932770 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:46.834112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cadce-0082-4c49-a7fd-cc4da4932770 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] PATH_INFO: `/v3/domains/796cde95a8a842239eb9584289836294` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:46.845118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1cadce-0082-4c49-a7fd-cc4da4932770 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 14:41:46.861450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fc90f-1fb9-4d49-be6e-aa64039d7679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:46.862472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fc90f-1fb9-4d49-be6e-aa64039d7679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:46.862808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fc90f-1fb9-4d49-be6e-aa64039d7679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:46.863043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391fc90f-1fb9-4d49-be6e-aa64039d7679 admin admin] PATH_INFO: `/v3/users/86c111f5265f45ad9fb81cc1423f1f9d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:46.864287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fc90f-1fb9-4d49-be6e-aa64039d7679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86c111f5265f45ad9fb81cc1423f1f9d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:46.866754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391fc90f-1fb9-4d49-be6e-aa64039d7679 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:46.871886 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-ae1cadce-0082-4c49-a7fd-cc4da4932770 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Could not find domain: 796cde95a8a842239eb9584289836294.: keystone.exception.DomainNotFound: Could not find domain: 796cde95a8a842239eb9584289836294. Jul 19 14:41:46.871886 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:46.871886 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 14:41:46.871886 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 14:41:46.871886 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 14:41:46.871886 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 14:41:46.871886 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 14:41:46.871886 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 14:41:46.871886 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 796cde95a8a842239eb9584289836294. Jul 19 14:41:46.871886 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:46.871886 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:41:46.871886 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:46.871886 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:46.871886 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:41:46.871886 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:41:46.874784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:41:46.874784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:41:46.874784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:41:46.874784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:41:46.874784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:41:46.874784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:41:46.874784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:41:46.874784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:41:46.874784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Jul 19 14:41:46.874784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Jul 19 14:41:46.874784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 14:41:46.874784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 14:41:46.874784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 14:41:46.874784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 14:41:46.874784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:41:46.874784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:41:46.875784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:41:46.875784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:41:46.875784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:41:46.875784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:41:46.875784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:41:46.875784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 14:41:46.875784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:41:46.875784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:41:46.875784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:41:46.875784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:41:46.875784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:41:46.875784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:41:46.875784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:41:46.875784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:41:46.875784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 14:41:46.875784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 14:41:46.875784 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 796cde95a8a842239eb9584289836294. Jul 19 14:41:46.876734 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:46.876734 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3303/6674] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:41:46 2022] DELETE /identity/v3/domains/796cde95a8a842239eb9584289836294 => generated 112 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:41:46.876734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b5048-3fd0-44ac-bc3b-01618b80a2ba None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:46.876734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b5048-3fd0-44ac-bc3b-01618b80a2ba None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:46.876734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b5048-3fd0-44ac-bc3b-01618b80a2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:46.918589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9d6b5048-3fd0-44ac-bc3b-01618b80a2ba None None] MFA Rules not processed for user `bf3bf6cc997f4144866ac163ea1d57bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:46.919925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9d6b5048-3fd0-44ac-bc3b-01618b80a2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:47.170510 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3304/6675] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:46 2022] POST /identity/v3/auth/tokens => generated 3417 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 19 14:41:47.175451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b5048-3fd0-44ac-bc3b-01618b80a2ba None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:47.194516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-391fc90f-1fb9-4d49-be6e-aa64039d7679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86c111f5265f45ad9fb81cc1423f1f9d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:47.195249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b5048-3fd0-44ac-bc3b-01618b80a2ba None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:47.196237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ef2d2-42e9-4179-a26d-ab6aa8557122 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ff0d82a5294bb58e43542ec044d4ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f5ff94ee8de48eda754fbc29f63996d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:47.196916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ef2d2-42e9-4179-a26d-ab6aa8557122 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:47.197219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ef2d2-42e9-4179-a26d-ab6aa8557122 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:47.197502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34ef2d2-42e9-4179-a26d-ab6aa8557122 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:47.199152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ef2d2-42e9-4179-a26d-ab6aa8557122 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:47.201006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34ef2d2-42e9-4179-a26d-ab6aa8557122 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:47.208723 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:47.219310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-391fc90f-1fb9-4d49-be6e-aa64039d7679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86c111f5265f45ad9fb81cc1423f1f9d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:47.227997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-391fc90f-1fb9-4d49-be6e-aa64039d7679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86c111f5265f45ad9fb81cc1423f1f9d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:47.230970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-391fc90f-1fb9-4d49-be6e-aa64039d7679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86c111f5265f45ad9fb81cc1423f1f9d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:47.344671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-391fc90f-1fb9-4d49-be6e-aa64039d7679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86c111f5265f45ad9fb81cc1423f1f9d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:47.360635 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3305/6676] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:41:47 2022] POST /identity/v3/domains => generated 253 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:47.360635 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ef2d2-42e9-4179-a26d-ab6aa8557122 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:47.365989 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3372/6677] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:46 2022] DELETE /identity/v3/users/86c111f5265f45ad9fb81cc1423f1f9d => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:47.365989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fc90f-1fb9-4d49-be6e-aa64039d7679 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:47.366948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d34ef2d2-42e9-4179-a26d-ab6aa8557122 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:47.384253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-391fc90f-1fb9-4d49-be6e-aa64039d7679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:47.479544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34ef2d2-42e9-4179-a26d-ab6aa8557122 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:47.495114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391fc90f-1fb9-4d49-be6e-aa64039d7679 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:47.499232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21add319-2139-44a8-9e04-8ca4073f2eaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:47.506524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21add319-2139-44a8-9e04-8ca4073f2eaa service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:47.506524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21add319-2139-44a8-9e04-8ca4073f2eaa service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:47.506524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21add319-2139-44a8-9e04-8ca4073f2eaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:47.506524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-21add319-2139-44a8-9e04-8ca4073f2eaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:47.610211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926905ca-fe7c-4068-820a-d4ad88347b8d tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf3bf6cc997f4144866ac163ea1d57bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcbef0c60b84453aa839501679d4b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:47.612124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926905ca-fe7c-4068-820a-d4ad88347b8d tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:47.612623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926905ca-fe7c-4068-820a-d4ad88347b8d tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:47.613174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926905ca-fe7c-4068-820a-d4ad88347b8d tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] PATH_INFO: `/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials/b41dfe04e8a248cc94ae3604f887bcc0` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:47.615025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926905ca-fe7c-4068-820a-d4ad88347b8d tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bf3bf6cc997f4144866ac163ea1d57bc, application_credential_id=b41dfe04e8a248cc94ae3604f887bcc0)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:47.617101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926905ca-fe7c-4068-820a-d4ad88347b8d tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:47.633794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21add319-2139-44a8-9e04-8ca4073f2eaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:47.639788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21add319-2139-44a8-9e04-8ca4073f2eaa service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:47.658265 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3373/6678] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:47.660397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21add319-2139-44a8-9e04-8ca4073f2eaa service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:47.661841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-21add319-2139-44a8-9e04-8ca4073f2eaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:47.746145 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3306/6679] 10.222.0.43 () {58 vars in 1394 bytes} [Tue Jul 19 14:41:47 2022] DELETE /identity/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials/b41dfe04e8a248cc94ae3604f887bcc0 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:47.747304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926905ca-fe7c-4068-820a-d4ad88347b8d tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:47.778538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926905ca-fe7c-4068-820a-d4ad88347b8d tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:47.791911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e4e42-fd8d-4386-b053-5213cf67ad48 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf3bf6cc997f4144866ac163ea1d57bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcbef0c60b84453aa839501679d4b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:47.807292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e4e42-fd8d-4386-b053-5213cf67ad48 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:47.808146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e4e42-fd8d-4386-b053-5213cf67ad48 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:47.809091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e4e42-fd8d-4386-b053-5213cf67ad48 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] PATH_INFO: `/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:47.812908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e4e42-fd8d-4386-b053-5213cf67ad48 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorizing `identity:create_application_credential(user_id=bf3bf6cc997f4144866ac163ea1d57bc)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:47.812908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e4e42-fd8d-4386-b053-5213cf67ad48 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:47.813163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21add319-2139-44a8-9e04-8ca4073f2eaa service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:47.820761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d70255-a422-4638-9f88-192ebd32aeb5 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ff0d82a5294bb58e43542ec044d4ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f5ff94ee8de48eda754fbc29f63996d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:47.822460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d70255-a422-4638-9f88-192ebd32aeb5 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:47.822765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d70255-a422-4638-9f88-192ebd32aeb5 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:47.823052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d70255-a422-4638-9f88-192ebd32aeb5 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:47.823863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d70255-a422-4638-9f88-192ebd32aeb5 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:47.825901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d70255-a422-4638-9f88-192ebd32aeb5 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:47.890140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.sql.core [None req-11d70255-a422-4638-9f88-192ebd32aeb5 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1472692938' for key 'project.ixu_project_name_domain_id'") Jul 19 14:41:47.890140 n-d-master-1 devstack@keystone.service[80680]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 19 14:41:47.890140 n-d-master-1 devstack@keystone.service[80680]: [parameters: {'id': '7125149d09a34ae391f3eed067bebc6f', 'name': 'tempest-domain-dup-1472692938', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jul 19 14:41:47.890140 n-d-master-1 devstack@keystone.service[80680]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80680) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 14:41:47.901124 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-11d70255-a422-4638-9f88-192ebd32aeb5 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1472692938.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1472692938. Jul 19 14:41:47.901124 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:47.901124 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 14:41:47.901124 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 14:41:47.901124 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 14:41:47.901124 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 14:41:47.901124 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 14:41:47.901124 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 14:41:47.901124 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 14:41:47.901124 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application conn.query(q) Jul 19 14:41:47.901124 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 14:41:47.901124 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 14:41:47.901124 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 14:41:47.902139 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application result.read() Jul 19 14:41:47.902139 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 14:41:47.902139 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 14:41:47.902139 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 14:41:47.902139 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 14:41:47.902139 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 14:41:47.902139 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 14:41:47.902139 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 14:41:47.902139 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 14:41:47.902139 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-1472692938' for key 'project.ixu_project_name_domain_id'") Jul 19 14:41:47.902139 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:47.902139 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 14:41:47.902139 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:47.902139 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:47.902139 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 14:41:47.902139 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 14:41:47.902139 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 19 14:41:47.902139 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 19 14:41:47.903841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 14:41:47.903841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application next(self.gen) Jul 19 14:41:47.903841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 14:41:47.903841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application yield resource Jul 19 14:41:47.903841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 14:41:47.903841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application next(self.gen) Jul 19 14:41:47.903841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 14:41:47.903841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 14:41:47.903841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 14:41:47.903841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 14:41:47.903841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 14:41:47.903841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise self.value Jul 19 14:41:47.903841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 14:41:47.903841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 14:41:47.903841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 14:41:47.903841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application session.commit() Jul 19 14:41:47.903841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 14:41:47.905057 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 14:41:47.905057 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 14:41:47.905057 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 14:41:47.905057 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 14:41:47.905057 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.session.flush() Jul 19 14:41:47.905057 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 14:41:47.905057 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 14:41:47.905057 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 14:41:47.905057 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 14:41:47.905057 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 14:41:47.905057 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application compat.raise_( Jul 19 14:41:47.905057 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 14:41:47.905057 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception Jul 19 14:41:47.905057 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 14:41:47.905057 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 14:41:47.905057 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 14:41:47.905057 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 14:41:47.908978 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 14:41:47.908978 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 14:41:47.908978 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 14:41:47.908978 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 14:41:47.908978 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 19 14:41:47.908978 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 19 14:41:47.908978 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 14:41:47.908978 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 14:41:47.908978 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 14:41:47.908978 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 14:41:47.908978 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 14:41:47.908978 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 14:41:47.908978 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 14:41:47.908978 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 14:41:47.908978 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 14:41:47.911121 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 14:41:47.911121 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 14:41:47.911121 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception Jul 19 14:41:47.911121 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 14:41:47.911121 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 14:41:47.911121 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 14:41:47.911121 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 14:41:47.911121 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 14:41:47.911121 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 14:41:47.911121 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 14:41:47.911121 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application conn.query(q) Jul 19 14:41:47.911121 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 14:41:47.911121 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 14:41:47.911121 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 14:41:47.911121 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application result.read() Jul 19 14:41:47.911121 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 14:41:47.911121 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 14:41:47.914392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 14:41:47.914392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 14:41:47.914392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 14:41:47.914392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 14:41:47.914392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 14:41:47.914392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 14:41:47.914392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1472692938' for key 'project.ixu_project_name_domain_id'") Jul 19 14:41:47.914392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 19 14:41:47.914392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [parameters: {'id': '7125149d09a34ae391f3eed067bebc6f', 'name': 'tempest-domain-dup-1472692938', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jul 19 14:41:47.914392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 14:41:47.914392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:47.914392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:41:47.914392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:47.914392 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:47.919282 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 19 14:41:47.919282 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 19 14:41:47.919282 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 14:41:47.919282 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 14:41:47.919282 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-1472692938. Jul 19 14:41:47.919282 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:47.919282 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:41:47.919282 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:47.919282 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:47.919282 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:41:47.919282 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:41:47.919282 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:41:47.919282 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:41:47.919282 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:41:47.919282 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:41:47.919282 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:41:47.919282 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:41:47.922386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:41:47.922386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:41:47.922386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Jul 19 14:41:47.922386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Jul 19 14:41:47.922386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:41:47.922386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:41:47.922386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Jul 19 14:41:47.922386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Jul 19 14:41:47.922386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:41:47.922386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:41:47.922386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 19 14:41:47.922386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 19 14:41:47.922386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1472692938. Jul 19 14:41:47.922386 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:47.922386 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3374/6680] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:41:47 2022] POST /identity/v3/domains => generated 212 bytes in 244 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 19 14:41:47.924782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d70255-a422-4638-9f88-192ebd32aeb5 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:47.930734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d70255-a422-4638-9f88-192ebd32aeb5 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:47.936572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edbd78-8659-49d4-b508-a80264590c39 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ff0d82a5294bb58e43542ec044d4ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f5ff94ee8de48eda754fbc29f63996d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:47.937565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edbd78-8659-49d4-b508-a80264590c39 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:47.937855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edbd78-8659-49d4-b508-a80264590c39 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:47.938186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edbd78-8659-49d4-b508-a80264590c39 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] PATH_INFO: `/v3/domains/b57af59ef9d441c0b79af439d642f0be` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:47.970394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edbd78-8659-49d4-b508-a80264590c39 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b57af59ef9d441c0b79af439d642f0be)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:47.973356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edbd78-8659-49d4-b508-a80264590c39 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:47.999129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b3edbd78-8659-49d4-b508-a80264590c39 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b57af59ef9d441c0b79af439d642f0be'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:47.999934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b3edbd78-8659-49d4-b508-a80264590c39 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b57af59ef9d441c0b79af439d642f0be'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:48.139818 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3307/6681] 10.222.0.43 () {60 vars in 1314 bytes} [Tue Jul 19 14:41:47 2022] POST /identity/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials => generated 921 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:48.146254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e4e42-fd8d-4386-b053-5213cf67ad48 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:48.147321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-844e4e42-fd8d-4386-b053-5213cf67ad48 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:48.162470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e4e42-fd8d-4386-b053-5213cf67ad48 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:48.191176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b3edbd78-8659-49d4-b508-a80264590c39 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b57af59ef9d441c0b79af439d642f0be'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:48.191870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b3edbd78-8659-49d4-b508-a80264590c39 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b57af59ef9d441c0b79af439d642f0be'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:48.200028 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3375/6682] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:41:47 2022] PATCH /identity/v3/domains/b57af59ef9d441c0b79af439d642f0be => generated 254 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:48.213478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edbd78-8659-49d4-b508-a80264590c39 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:48.213478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b3edbd78-8659-49d4-b508-a80264590c39 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:48.256279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb2131-60d6-4f8a-975a-d036fd913f33 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf3bf6cc997f4144866ac163ea1d57bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcbef0c60b84453aa839501679d4b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:48.258034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb2131-60d6-4f8a-975a-d036fd913f33 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:48.258494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb2131-60d6-4f8a-975a-d036fd913f33 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:48.259135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfb2131-60d6-4f8a-975a-d036fd913f33 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] PATH_INFO: `/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials/363ce2ff242646f48c456c2c3c6967aa` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:48.281889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb2131-60d6-4f8a-975a-d036fd913f33 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bf3bf6cc997f4144866ac163ea1d57bc, application_credential_id=363ce2ff242646f48c456c2c3c6967aa)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:48.284826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfb2131-60d6-4f8a-975a-d036fd913f33 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:48.329842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edbd78-8659-49d4-b508-a80264590c39 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:48.338656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0aad7-b108-4046-b4e8-66aec6f3621a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ff0d82a5294bb58e43542ec044d4ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f5ff94ee8de48eda754fbc29f63996d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:48.347574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0aad7-b108-4046-b4e8-66aec6f3621a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:48.347574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0aad7-b108-4046-b4e8-66aec6f3621a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:48.347574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0aad7-b108-4046-b4e8-66aec6f3621a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] PATH_INFO: `/v3/domains/b57af59ef9d441c0b79af439d642f0be` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:48.359354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0aad7-b108-4046-b4e8-66aec6f3621a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b57af59ef9d441c0b79af439d642f0be)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:48.362536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0aad7-b108-4046-b4e8-66aec6f3621a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:48.398933 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:48.404936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-14b0aad7-b108-4046-b4e8-66aec6f3621a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b57af59ef9d441c0b79af439d642f0be'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:48.420025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-14b0aad7-b108-4046-b4e8-66aec6f3621a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b57af59ef9d441c0b79af439d642f0be'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:48.441709 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3308/6683] 10.222.0.43 () {58 vars in 1394 bytes} [Tue Jul 19 14:41:48 2022] DELETE /identity/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials/363ce2ff242646f48c456c2c3c6967aa => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:41:48.442648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb2131-60d6-4f8a-975a-d036fd913f33 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:48.445484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9dfb2131-60d6-4f8a-975a-d036fd913f33 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:48.550479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfb2131-60d6-4f8a-975a-d036fd913f33 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:48.557102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e074dce-23df-4fc1-a43c-5725011b199a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:48.558296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e074dce-23df-4fc1-a43c-5725011b199a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:48.558296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e074dce-23df-4fc1-a43c-5725011b199a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:48.558737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e074dce-23df-4fc1-a43c-5725011b199a admin admin] PATH_INFO: `/v3/projects/84d77f1a646c48d8a62b47f39611d7b2` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:48.560464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e074dce-23df-4fc1-a43c-5725011b199a admin admin] RBAC: Authorizing `identity:delete_project(project_id=84d77f1a646c48d8a62b47f39611d7b2)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:48.562749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e074dce-23df-4fc1-a43c-5725011b199a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:48.618842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-14b0aad7-b108-4046-b4e8-66aec6f3621a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b57af59ef9d441c0b79af439d642f0be', 'request_id': 'req-14b0aad7-b108-4046-b4e8-66aec6f3621a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:48.626716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-14b0aad7-b108-4046-b4e8-66aec6f3621a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b57af59ef9d441c0b79af439d642f0be', 'request_id': 'req-14b0aad7-b108-4046-b4e8-66aec6f3621a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:48.637173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-14b0aad7-b108-4046-b4e8-66aec6f3621a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b57af59ef9d441c0b79af439d642f0be', 'request_id': 'req-14b0aad7-b108-4046-b4e8-66aec6f3621a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:48.736000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-14b0aad7-b108-4046-b4e8-66aec6f3621a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] The token cache is being invalidate because project b57af59ef9d441c0b79af439d642f0be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:48.736375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-14b0aad7-b108-4046-b4e8-66aec6f3621a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:48.738270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-14b0aad7-b108-4046-b4e8-66aec6f3621a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:48.754918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-14b0aad7-b108-4046-b4e8-66aec6f3621a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b57af59ef9d441c0b79af439d642f0be', 'request_id': 'req-14b0aad7-b108-4046-b4e8-66aec6f3621a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:48.756360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-14b0aad7-b108-4046-b4e8-66aec6f3621a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b57af59ef9d441c0b79af439d642f0be', 'request_id': 'req-14b0aad7-b108-4046-b4e8-66aec6f3621a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:48.756878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-14b0aad7-b108-4046-b4e8-66aec6f3621a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b57af59ef9d441c0b79af439d642f0be', 'request_id': 'req-14b0aad7-b108-4046-b4e8-66aec6f3621a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:48.764958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3e074dce-23df-4fc1-a43c-5725011b199a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84d77f1a646c48d8a62b47f39611d7b2', 'request_id': 'req-3e074dce-23df-4fc1-a43c-5725011b199a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:48.771755 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3376/6684] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:41:48 2022] DELETE /identity/v3/domains/b57af59ef9d441c0b79af439d642f0be => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:48.773013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0aad7-b108-4046-b4e8-66aec6f3621a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:48.774557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-14b0aad7-b108-4046-b4e8-66aec6f3621a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:48.842483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0aad7-b108-4046-b4e8-66aec6f3621a tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:48.903990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3e074dce-23df-4fc1-a43c-5725011b199a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84d77f1a646c48d8a62b47f39611d7b2', 'request_id': 'req-3e074dce-23df-4fc1-a43c-5725011b199a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:48.907071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e07589-48c2-4493-a781-8175c8aba7e2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf3bf6cc997f4144866ac163ea1d57bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcbef0c60b84453aa839501679d4b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:48.907984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e07589-48c2-4493-a781-8175c8aba7e2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:48.908384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e07589-48c2-4493-a781-8175c8aba7e2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:48.912877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e07589-48c2-4493-a781-8175c8aba7e2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] PATH_INFO: `/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:48.912877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e07589-48c2-4493-a781-8175c8aba7e2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorizing `identity:create_application_credential(user_id=bf3bf6cc997f4144866ac163ea1d57bc)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:48.912877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e07589-48c2-4493-a781-8175c8aba7e2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:48.913168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3e074dce-23df-4fc1-a43c-5725011b199a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84d77f1a646c48d8a62b47f39611d7b2', 'request_id': 'req-3e074dce-23df-4fc1-a43c-5725011b199a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:48.930433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3e074dce-23df-4fc1-a43c-5725011b199a admin admin] The token cache is being invalidate because project 84d77f1a646c48d8a62b47f39611d7b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:48.931225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3e074dce-23df-4fc1-a43c-5725011b199a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:48.931671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3e074dce-23df-4fc1-a43c-5725011b199a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:48.940290 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3309/6685] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:48 2022] DELETE /identity/v3/projects/84d77f1a646c48d8a62b47f39611d7b2 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:48.940290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e074dce-23df-4fc1-a43c-5725011b199a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:48.942535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3e074dce-23df-4fc1-a43c-5725011b199a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:49.059563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e074dce-23df-4fc1-a43c-5725011b199a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:49.070795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae11089-b6d8-4a82-89e3-020d89bd5069 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9ff0d82a5294bb58e43542ec044d4ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0f5ff94ee8de48eda754fbc29f63996d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:49.071744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae11089-b6d8-4a82-89e3-020d89bd5069 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:49.072042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae11089-b6d8-4a82-89e3-020d89bd5069 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:49.072330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae11089-b6d8-4a82-89e3-020d89bd5069 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] PATH_INFO: `/v3/domains/1fb6815da88c478793dbbf1721911335` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:49.080101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae11089-b6d8-4a82-89e3-020d89bd5069 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 14:41:49.091558 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-fae11089-b6d8-4a82-89e3-020d89bd5069 tempest-DomainsNegativeTestJSON-456448509 tempest-DomainsNegativeTestJSON-456448509-project-admin] Could not find domain: 1fb6815da88c478793dbbf1721911335.: keystone.exception.DomainNotFound: Could not find domain: 1fb6815da88c478793dbbf1721911335. Jul 19 14:41:49.091558 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:49.091558 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 14:41:49.091558 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 14:41:49.091558 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 14:41:49.091558 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 14:41:49.091558 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 14:41:49.091558 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 14:41:49.091558 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1fb6815da88c478793dbbf1721911335. Jul 19 14:41:49.091558 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:49.091558 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:41:49.091558 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:49.091558 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:49.091558 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:41:49.091558 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:41:49.099718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:41:49.099718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:41:49.099718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:41:49.099718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:41:49.099718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:41:49.099718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:41:49.099718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:41:49.099718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:41:49.099718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 14:41:49.099718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 14:41:49.099718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 14:41:49.099718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 14:41:49.099718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 14:41:49.099718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 14:41:49.099718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:41:49.099718 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:41:49.101075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:41:49.101075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:41:49.101075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:41:49.101075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:41:49.101075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:41:49.101075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 14:41:49.101075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:41:49.101075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:41:49.101075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:41:49.101075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:41:49.101075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:41:49.101075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:41:49.101075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:41:49.101075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:41:49.101075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 14:41:49.101075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 14:41:49.101075 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 1fb6815da88c478793dbbf1721911335. Jul 19 14:41:49.102121 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:41:49.102121 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3310/6686] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:41:48 2022] PATCH /identity/v3/domains/1fb6815da88c478793dbbf1721911335 => generated 112 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:41:49.102121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a1bfa-8cf2-49f7-9495-5dc17ae56f63 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:49.102121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a1bfa-8cf2-49f7-9495-5dc17ae56f63 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:49.102121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a1bfa-8cf2-49f7-9495-5dc17ae56f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:49.148386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-429a1bfa-8cf2-49f7-9495-5dc17ae56f63 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:49.150016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-429a1bfa-8cf2-49f7-9495-5dc17ae56f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:49.173764 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3377/6687] 10.222.0.43 () {60 vars in 1314 bytes} [Tue Jul 19 14:41:48 2022] POST /identity/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials => generated 813 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:49.175167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e07589-48c2-4493-a781-8175c8aba7e2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:49.179197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f1e07589-48c2-4493-a781-8175c8aba7e2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:49.186055 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:49.273651 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3311/6688] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:49.275285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a1bfa-8cf2-49f7-9495-5dc17ae56f63 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:49.291864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-429a1bfa-8cf2-49f7-9495-5dc17ae56f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:49.321790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e07589-48c2-4493-a781-8175c8aba7e2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:49.329456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a1bfa-8cf2-49f7-9495-5dc17ae56f63 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:49.330778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca611a7-65cb-4792-adf5-7fd81120a161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:49.332533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca611a7-65cb-4792-adf5-7fd81120a161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:49.337115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca611a7-65cb-4792-adf5-7fd81120a161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:49.337115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca611a7-65cb-4792-adf5-7fd81120a161 admin admin] PATH_INFO: `/v3/users/ac628ca939434e19a337817bc9cab963` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:49.337115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca611a7-65cb-4792-adf5-7fd81120a161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac628ca939434e19a337817bc9cab963)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:49.337388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21404959-1d8b-40bc-b5c8-6793aad01870 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf3bf6cc997f4144866ac163ea1d57bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcbef0c60b84453aa839501679d4b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:49.337388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21404959-1d8b-40bc-b5c8-6793aad01870 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:49.338491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21404959-1d8b-40bc-b5c8-6793aad01870 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:49.338607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21404959-1d8b-40bc-b5c8-6793aad01870 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] PATH_INFO: `/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials/8bfc5d89f4454db6b6329919cb322924` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:49.348086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca611a7-65cb-4792-adf5-7fd81120a161 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:49.373349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21404959-1d8b-40bc-b5c8-6793aad01870 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bf3bf6cc997f4144866ac163ea1d57bc, application_credential_id=8bfc5d89f4454db6b6329919cb322924)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:49.377811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21404959-1d8b-40bc-b5c8-6793aad01870 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:49.495246 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:49.559747 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3312/6689] 10.222.0.43 () {58 vars in 1394 bytes} [Tue Jul 19 14:41:49 2022] DELETE /identity/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials/8bfc5d89f4454db6b6329919cb322924 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:49.565442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc684b3-2f8f-4eb4-ba94-2bf63a07077e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:49.565442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc684b3-2f8f-4eb4-ba94-2bf63a07077e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:49.565442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc684b3-2f8f-4eb4-ba94-2bf63a07077e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:49.583316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-abc684b3-2f8f-4eb4-ba94-2bf63a07077e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:49.584625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-abc684b3-2f8f-4eb4-ba94-2bf63a07077e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:49.598908 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3313/6690] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:49.598908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc684b3-2f8f-4eb4-ba94-2bf63a07077e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:49.609743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc684b3-2f8f-4eb4-ba94-2bf63a07077e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:49.619605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e614c-e2b5-43e5-966a-8f5361daa028 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf3bf6cc997f4144866ac163ea1d57bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcbef0c60b84453aa839501679d4b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:49.620444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e614c-e2b5-43e5-966a-8f5361daa028 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:49.620729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e614c-e2b5-43e5-966a-8f5361daa028 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:49.621016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e614c-e2b5-43e5-966a-8f5361daa028 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] PATH_INFO: `/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:49.621752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e614c-e2b5-43e5-966a-8f5361daa028 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorizing `identity:create_application_credential(user_id=bf3bf6cc997f4144866ac163ea1d57bc)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:49.623204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e614c-e2b5-43e5-966a-8f5361daa028 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:49.688964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4ca611a7-65cb-4792-adf5-7fd81120a161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac628ca939434e19a337817bc9cab963'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:49.702872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4ca611a7-65cb-4792-adf5-7fd81120a161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac628ca939434e19a337817bc9cab963'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:49.711735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4ca611a7-65cb-4792-adf5-7fd81120a161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac628ca939434e19a337817bc9cab963'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:49.716468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4ca611a7-65cb-4792-adf5-7fd81120a161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac628ca939434e19a337817bc9cab963'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:49.812387 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3314/6691] 10.222.0.43 () {60 vars in 1313 bytes} [Tue Jul 19 14:41:49 2022] POST /identity/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials => generated 789 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:49.815154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e614c-e2b5-43e5-966a-8f5361daa028 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:49.839631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e614c-e2b5-43e5-966a-8f5361daa028 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:49.849319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495e325-be24-4449-8cd5-8e51f386372e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:49.852678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4ca611a7-65cb-4792-adf5-7fd81120a161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac628ca939434e19a337817bc9cab963'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:49.854953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495e325-be24-4449-8cd5-8e51f386372e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:49.855528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495e325-be24-4449-8cd5-8e51f386372e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:49.856109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495e325-be24-4449-8cd5-8e51f386372e admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:49.857970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495e325-be24-4449-8cd5-8e51f386372e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:41:49.858536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495e325-be24-4449-8cd5-8e51f386372e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:49.862999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495e325-be24-4449-8cd5-8e51f386372e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:49.869299 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3378/6692] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:49 2022] DELETE /identity/v3/users/ac628ca939434e19a337817bc9cab963 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:49.869299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca611a7-65cb-4792-adf5-7fd81120a161 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:49.869299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4ca611a7-65cb-4792-adf5-7fd81120a161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:49.903068 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3315/6693] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:41:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:49.904877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a884609-fa34-4976-b62b-f5d226a316b1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:49.907060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a884609-fa34-4976-b62b-f5d226a316b1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:49.907493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a884609-fa34-4976-b62b-f5d226a316b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:49.940800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7a884609-fa34-4976-b62b-f5d226a316b1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:49.948099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7a884609-fa34-4976-b62b-f5d226a316b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:50.010528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca611a7-65cb-4792-adf5-7fd81120a161 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:50.036875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81523f0-cc98-4ae4-bc10-d0cd741700b2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf3bf6cc997f4144866ac163ea1d57bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcbef0c60b84453aa839501679d4b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:50.038690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81523f0-cc98-4ae4-bc10-d0cd741700b2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:50.038690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81523f0-cc98-4ae4-bc10-d0cd741700b2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:50.038690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81523f0-cc98-4ae4-bc10-d0cd741700b2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] PATH_INFO: `/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:50.040141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81523f0-cc98-4ae4-bc10-d0cd741700b2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorizing `identity:create_application_credential(user_id=bf3bf6cc997f4144866ac163ea1d57bc)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:50.057589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81523f0-cc98-4ae4-bc10-d0cd741700b2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:50.096238 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3316/6694] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:50.107105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a884609-fa34-4976-b62b-f5d226a316b1 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:50.107105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7a884609-fa34-4976-b62b-f5d226a316b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:50.123874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a884609-fa34-4976-b62b-f5d226a316b1 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:50.129967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6a4e4-b106-4b74-9282-6fffbfffd2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:50.130829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6a4e4-b106-4b74-9282-6fffbfffd2ec admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:50.131108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6a4e4-b106-4b74-9282-6fffbfffd2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:50.131384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6a4e4-b106-4b74-9282-6fffbfffd2ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:50.132099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6a4e4-b106-4b74-9282-6fffbfffd2ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:50.134404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d6a4e4-b106-4b74-9282-6fffbfffd2ec admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:50.254158 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3317/6695] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:50 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:50.254158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6a4e4-b106-4b74-9282-6fffbfffd2ec admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:50.254158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-53d6a4e4-b106-4b74-9282-6fffbfffd2ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:50.358230 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3379/6696] 10.222.0.43 () {60 vars in 1313 bytes} [Tue Jul 19 14:41:49 2022] POST /identity/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials => generated 788 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:50.361509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81523f0-cc98-4ae4-bc10-d0cd741700b2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:50.378297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d6a4e4-b106-4b74-9282-6fffbfffd2ec admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:50.382041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e08011-808e-474c-91f4-3677f3b51b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:50.383263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e08011-808e-474c-91f4-3677f3b51b47 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:50.383657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e08011-808e-474c-91f4-3677f3b51b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:50.384053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e08011-808e-474c-91f4-3677f3b51b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:50.396387 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:50.402473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81523f0-cc98-4ae4-bc10-d0cd741700b2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:50.462483 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:50.575126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e08011-808e-474c-91f4-3677f3b51b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:50.576597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e08011-808e-474c-91f4-3677f3b51b47 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:50.597303 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3318/6697] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:50.598211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e08011-808e-474c-91f4-3677f3b51b47 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:50.621242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff6aa8-b209-42c8-a8f0-1a4baf25c412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:50.622753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff6aa8-b209-42c8-a8f0-1a4baf25c412 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:50.623092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff6aa8-b209-42c8-a8f0-1a4baf25c412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:50.623521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff6aa8-b209-42c8-a8f0-1a4baf25c412 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:50.624704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff6aa8-b209-42c8-a8f0-1a4baf25c412 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:50.629021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ff6aa8-b209-42c8-a8f0-1a4baf25c412 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:50.634429 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:50.788845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e08011-808e-474c-91f4-3677f3b51b47 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:50.793507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b3848-6fe2-4cb1-be50-8dc7b5b33d34 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf3bf6cc997f4144866ac163ea1d57bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcbef0c60b84453aa839501679d4b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:50.794457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b3848-6fe2-4cb1-be50-8dc7b5b33d34 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:50.794773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b3848-6fe2-4cb1-be50-8dc7b5b33d34 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:50.795129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b3848-6fe2-4cb1-be50-8dc7b5b33d34 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] PATH_INFO: `/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:50.796132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b3848-6fe2-4cb1-be50-8dc7b5b33d34 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorizing `identity:list_application_credentials(user_id=bf3bf6cc997f4144866ac163ea1d57bc)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:50.797879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b3848-6fe2-4cb1-be50-8dc7b5b33d34 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:50.808433 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3380/6698] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:50 2022] POST /identity/v3/users => generated 296 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:50.813208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff6aa8-b209-42c8-a8f0-1a4baf25c412 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:50.820619 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3319/6699] 10.222.0.43 () {58 vars in 1292 bytes} [Tue Jul 19 14:41:50 2022] GET /identity/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials => generated 1501 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:50.826702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b3848-6fe2-4cb1-be50-8dc7b5b33d34 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:50.828682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff6aa8-b209-42c8-a8f0-1a4baf25c412 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:50.838441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b3848-6fe2-4cb1-be50-8dc7b5b33d34 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:50.839454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428dad03-2438-4fcd-b7e7-930ced43f150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:50.843634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428dad03-2438-4fcd-b7e7-930ced43f150 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:50.843634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428dad03-2438-4fcd-b7e7-930ced43f150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:50.843634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428dad03-2438-4fcd-b7e7-930ced43f150 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:50.843634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428dad03-2438-4fcd-b7e7-930ced43f150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:50.843634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428dad03-2438-4fcd-b7e7-930ced43f150 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:50.857096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bacc8-2a67-4911-9a08-986d119e8c46 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf3bf6cc997f4144866ac163ea1d57bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcbef0c60b84453aa839501679d4b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:50.858197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bacc8-2a67-4911-9a08-986d119e8c46 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:50.858490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bacc8-2a67-4911-9a08-986d119e8c46 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:50.858790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bacc8-2a67-4911-9a08-986d119e8c46 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] PATH_INFO: `/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials/164ba56fe31742a9be50aa74544ea310` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:50.866155 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3381/6700] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:50 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:41:50.867272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428dad03-2438-4fcd-b7e7-930ced43f150 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:50.869707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894bacc8-2a67-4911-9a08-986d119e8c46 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bf3bf6cc997f4144866ac163ea1d57bc, application_credential_id=164ba56fe31742a9be50aa74544ea310)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:50.878192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894bacc8-2a67-4911-9a08-986d119e8c46 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:50.885206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428dad03-2438-4fcd-b7e7-930ced43f150 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:50.892352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979ac5b-dffe-46db-8736-e6b9c8988b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:50.894058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979ac5b-dffe-46db-8736-e6b9c8988b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:50.894058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979ac5b-dffe-46db-8736-e6b9c8988b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:50.894392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d979ac5b-dffe-46db-8736-e6b9c8988b35 admin admin] PATH_INFO: `/v3/projects/cbc939684fff4ff1be15affe6a91f50f/users/0e491958ec314b6da65864fb6fb7a0b0/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:50.913212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979ac5b-dffe-46db-8736-e6b9c8988b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc939684fff4ff1be15affe6a91f50f, user_id=0e491958ec314b6da65864fb6fb7a0b0, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:50.916212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d979ac5b-dffe-46db-8736-e6b9c8988b35 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:51.012398 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3320/6701] 10.222.0.43 () {58 vars in 1394 bytes} [Tue Jul 19 14:41:50 2022] DELETE /identity/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials/164ba56fe31742a9be50aa74544ea310 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:51.017369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bacc8-2a67-4911-9a08-986d119e8c46 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:51.027745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bacc8-2a67-4911-9a08-986d119e8c46 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:51.032468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681c050-3af5-4a72-a18a-7b4bcec8eda2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf3bf6cc997f4144866ac163ea1d57bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcbef0c60b84453aa839501679d4b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:51.033692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681c050-3af5-4a72-a18a-7b4bcec8eda2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:51.034246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681c050-3af5-4a72-a18a-7b4bcec8eda2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:51.034696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681c050-3af5-4a72-a18a-7b4bcec8eda2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] PATH_INFO: `/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials/6238f98bb9334c1686455999fca443c3` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:51.044587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681c050-3af5-4a72-a18a-7b4bcec8eda2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bf3bf6cc997f4144866ac163ea1d57bc, application_credential_id=6238f98bb9334c1686455999fca443c3)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:51.045742 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3382/6702] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:50 2022] PUT /identity/v3/projects/cbc939684fff4ff1be15affe6a91f50f/users/0e491958ec314b6da65864fb6fb7a0b0/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:51.047534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681c050-3af5-4a72-a18a-7b4bcec8eda2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:51.057466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979ac5b-dffe-46db-8736-e6b9c8988b35 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:51.169275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d979ac5b-dffe-46db-8736-e6b9c8988b35 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:51.180865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47365a28-6d9f-4cd2-8338-f54a6a67307a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:51.181708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47365a28-6d9f-4cd2-8338-f54a6a67307a admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:51.182667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47365a28-6d9f-4cd2-8338-f54a6a67307a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:51.182667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47365a28-6d9f-4cd2-8338-f54a6a67307a admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:51.183588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47365a28-6d9f-4cd2-8338-f54a6a67307a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:51.188566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47365a28-6d9f-4cd2-8338-f54a6a67307a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:51.216507 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3321/6703] 10.222.0.43 () {58 vars in 1394 bytes} [Tue Jul 19 14:41:51 2022] DELETE /identity/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials/6238f98bb9334c1686455999fca443c3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:51.227579 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3383/6704] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:51 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:51.229915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681c050-3af5-4a72-a18a-7b4bcec8eda2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:51.234609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47365a28-6d9f-4cd2-8338-f54a6a67307a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:51.266143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47365a28-6d9f-4cd2-8338-f54a6a67307a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:51.290996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043421ba-04ad-4beb-8de6-8b4d35fa0bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:51.296303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043421ba-04ad-4beb-8de6-8b4d35fa0bf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:51.296733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043421ba-04ad-4beb-8de6-8b4d35fa0bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:51.301499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043421ba-04ad-4beb-8de6-8b4d35fa0bf2 admin admin] PATH_INFO: `/v3/projects/cbc939684fff4ff1be15affe6a91f50f/users/0e491958ec314b6da65864fb6fb7a0b0/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:51.305034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043421ba-04ad-4beb-8de6-8b4d35fa0bf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc939684fff4ff1be15affe6a91f50f, user_id=0e491958ec314b6da65864fb6fb7a0b0, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:51.305205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681c050-3af5-4a72-a18a-7b4bcec8eda2 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:51.307685 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:51.308190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043421ba-04ad-4beb-8de6-8b4d35fa0bf2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:51.328027 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3384/6705] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:51 2022] PUT /identity/v3/projects/cbc939684fff4ff1be15affe6a91f50f/users/0e491958ec314b6da65864fb6fb7a0b0/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:51.333319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043421ba-04ad-4beb-8de6-8b4d35fa0bf2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:51.360786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-043421ba-04ad-4beb-8de6-8b4d35fa0bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:51.455806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa94bbe-6a3d-454c-9aaf-a256d4d4411a tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf3bf6cc997f4144866ac163ea1d57bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcbef0c60b84453aa839501679d4b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:51.459472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa94bbe-6a3d-454c-9aaf-a256d4d4411a tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:51.459923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa94bbe-6a3d-454c-9aaf-a256d4d4411a tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:51.460210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa94bbe-6a3d-454c-9aaf-a256d4d4411a tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] PATH_INFO: `/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:51.461085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa94bbe-6a3d-454c-9aaf-a256d4d4411a tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorizing `identity:create_application_credential(user_id=bf3bf6cc997f4144866ac163ea1d57bc)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:51.462343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa94bbe-6a3d-454c-9aaf-a256d4d4411a tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:51.479058 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:51.565593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043421ba-04ad-4beb-8de6-8b4d35fa0bf2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:51.582831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77005aed-370e-43fc-9e51-daa5464fc8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:51.586303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77005aed-370e-43fc-9e51-daa5464fc8da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:51.586303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77005aed-370e-43fc-9e51-daa5464fc8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:51.586303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77005aed-370e-43fc-9e51-daa5464fc8da admin admin] PATH_INFO: `/v3/projects/772dcee824f946ecb04164d0b4b8dffe` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:51.589116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77005aed-370e-43fc-9e51-daa5464fc8da admin admin] RBAC: Authorizing `identity:delete_project(project_id=772dcee824f946ecb04164d0b4b8dffe)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:51.591363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77005aed-370e-43fc-9e51-daa5464fc8da admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:51.684427 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3322/6706] 10.222.0.43 () {60 vars in 1313 bytes} [Tue Jul 19 14:41:51 2022] POST /identity/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials => generated 787 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:51.685842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8880d6-9b0c-4ce1-9e72-24119b32e8ef None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:51.686162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8880d6-9b0c-4ce1-9e72-24119b32e8ef None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:51.686453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8880d6-9b0c-4ce1-9e72-24119b32e8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:51.749055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-de8880d6-9b0c-4ce1-9e72-24119b32e8ef None None] MFA Rules not processed for user `0e491958ec314b6da65864fb6fb7a0b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:51.752927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-de8880d6-9b0c-4ce1-9e72-24119b32e8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:51.891182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77005aed-370e-43fc-9e51-daa5464fc8da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '772dcee824f946ecb04164d0b4b8dffe', 'request_id': 'req-77005aed-370e-43fc-9e51-daa5464fc8da'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:51.896749 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3323/6707] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:51.897441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8880d6-9b0c-4ce1-9e72-24119b32e8ef None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:51.900420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77005aed-370e-43fc-9e51-daa5464fc8da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '772dcee824f946ecb04164d0b4b8dffe', 'request_id': 'req-77005aed-370e-43fc-9e51-daa5464fc8da'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:51.910332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77005aed-370e-43fc-9e51-daa5464fc8da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '772dcee824f946ecb04164d0b4b8dffe', 'request_id': 'req-77005aed-370e-43fc-9e51-daa5464fc8da'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:52.002858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8880d6-9b0c-4ce1-9e72-24119b32e8ef None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:52.060072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce1f7c-9394-4b3f-b80c-d08e7d49cc64 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf3bf6cc997f4144866ac163ea1d57bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcbef0c60b84453aa839501679d4b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:52.061017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce1f7c-9394-4b3f-b80c-d08e7d49cc64 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:52.061307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce1f7c-9394-4b3f-b80c-d08e7d49cc64 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:52.061592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce1f7c-9394-4b3f-b80c-d08e7d49cc64 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] PATH_INFO: `/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:52.062384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce1f7c-9394-4b3f-b80c-d08e7d49cc64 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorizing `identity:create_application_credential(user_id=bf3bf6cc997f4144866ac163ea1d57bc)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:52.063604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce1f7c-9394-4b3f-b80c-d08e7d49cc64 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:52.109983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77005aed-370e-43fc-9e51-daa5464fc8da admin admin] The token cache is being invalidate because project 772dcee824f946ecb04164d0b4b8dffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:52.110571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77005aed-370e-43fc-9e51-daa5464fc8da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:52.111231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-77005aed-370e-43fc-9e51-daa5464fc8da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:52.116618 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3385/6708] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:51 2022] DELETE /identity/v3/projects/772dcee824f946ecb04164d0b4b8dffe => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:52.116618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77005aed-370e-43fc-9e51-daa5464fc8da admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:52.118365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-77005aed-370e-43fc-9e51-daa5464fc8da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:52.196564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77005aed-370e-43fc-9e51-daa5464fc8da admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:52.202401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d925ffb-576e-4008-8615-1072f2ed69fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:52.203093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d925ffb-576e-4008-8615-1072f2ed69fd admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:52.203381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d925ffb-576e-4008-8615-1072f2ed69fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:52.203662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d925ffb-576e-4008-8615-1072f2ed69fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:52.204367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d925ffb-576e-4008-8615-1072f2ed69fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:52.206499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d925ffb-576e-4008-8615-1072f2ed69fd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:52.237234 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3324/6709] 10.222.0.43 () {60 vars in 1313 bytes} [Tue Jul 19 14:41:51 2022] POST /identity/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials => generated 788 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:52.237955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce1f7c-9394-4b3f-b80c-d08e7d49cc64 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:52.239954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-89ce1f7c-9394-4b3f-b80c-d08e7d49cc64 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:52.255704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce1f7c-9394-4b3f-b80c-d08e7d49cc64 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:52.261100 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7188b1-670b-4900-b7ef-192297e59155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:52.262128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7188b1-670b-4900-b7ef-192297e59155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:52.262395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7188b1-670b-4900-b7ef-192297e59155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:52.262684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7188b1-670b-4900-b7ef-192297e59155 admin admin] PATH_INFO: `/v3/users/f9ff0d82a5294bb58e43542ec044d4ff` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:52.263915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7188b1-670b-4900-b7ef-192297e59155 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9ff0d82a5294bb58e43542ec044d4ff)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:52.265849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7188b1-670b-4900-b7ef-192297e59155 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:52.326060 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3386/6710] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:52 2022] POST /identity/v3/projects => generated 381 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:52.326060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d925ffb-576e-4008-8615-1072f2ed69fd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:52.327281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8d925ffb-576e-4008-8615-1072f2ed69fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:52.450304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d925ffb-576e-4008-8615-1072f2ed69fd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:52.460622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21465ce2-6ea6-4c36-9ff9-e79359669606 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf3bf6cc997f4144866ac163ea1d57bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcbef0c60b84453aa839501679d4b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:52.461548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21465ce2-6ea6-4c36-9ff9-e79359669606 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:52.461845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21465ce2-6ea6-4c36-9ff9-e79359669606 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:52.462155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21465ce2-6ea6-4c36-9ff9-e79359669606 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] PATH_INFO: `/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:52.462885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21465ce2-6ea6-4c36-9ff9-e79359669606 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Adding query filter params (name=tempest-application_credential-618836923) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:41:52.464692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21465ce2-6ea6-4c36-9ff9-e79359669606 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorizing `identity:list_application_credentials(user_id=bf3bf6cc997f4144866ac163ea1d57bc)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:52.464985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21465ce2-6ea6-4c36-9ff9-e79359669606 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:52.486191 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3387/6711] 10.222.0.43 () {58 vars in 1383 bytes} [Tue Jul 19 14:41:52 2022] GET /identity/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials?name=tempest-application_credential-618836923 => generated 885 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:52.486191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21465ce2-6ea6-4c36-9ff9-e79359669606 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:52.530722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5a7188b1-670b-4900-b7ef-192297e59155 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9ff0d82a5294bb58e43542ec044d4ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:52.553562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5a7188b1-670b-4900-b7ef-192297e59155 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9ff0d82a5294bb58e43542ec044d4ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:52.554363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5a7188b1-670b-4900-b7ef-192297e59155 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9ff0d82a5294bb58e43542ec044d4ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:52.555367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5a7188b1-670b-4900-b7ef-192297e59155 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9ff0d82a5294bb58e43542ec044d4ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:52.563405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5a7188b1-670b-4900-b7ef-192297e59155 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9ff0d82a5294bb58e43542ec044d4ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:52.576188 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:52.594906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21465ce2-6ea6-4c36-9ff9-e79359669606 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:52.599799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920fd5f-42ea-4ec8-b41e-fd41f1c64dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:52.600536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920fd5f-42ea-4ec8-b41e-fd41f1c64dfd admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:52.600837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920fd5f-42ea-4ec8-b41e-fd41f1c64dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:52.601127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920fd5f-42ea-4ec8-b41e-fd41f1c64dfd admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:52.601823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920fd5f-42ea-4ec8-b41e-fd41f1c64dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:52.603809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920fd5f-42ea-4ec8-b41e-fd41f1c64dfd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:52.649173 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3325/6712] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:52 2022] DELETE /identity/v3/users/f9ff0d82a5294bb58e43542ec044d4ff => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:52.651370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7188b1-670b-4900-b7ef-192297e59155 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:52.655156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5a7188b1-670b-4900-b7ef-192297e59155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:52.732193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7188b1-670b-4900-b7ef-192297e59155 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:52.737824 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3388/6713] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:52 2022] POST /identity/v3/users => generated 291 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:52.742092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920fd5f-42ea-4ec8-b41e-fd41f1c64dfd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:52.743970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1920fd5f-42ea-4ec8-b41e-fd41f1c64dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:52.749908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c726a95-0750-4e81-afda-34a4ef8e513d tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf3bf6cc997f4144866ac163ea1d57bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcbef0c60b84453aa839501679d4b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:52.753540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c726a95-0750-4e81-afda-34a4ef8e513d tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:52.753540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c726a95-0750-4e81-afda-34a4ef8e513d tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:52.753540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c726a95-0750-4e81-afda-34a4ef8e513d tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] PATH_INFO: `/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials/1f762c38dd4248ba81799d01f756bebd` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:52.770066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920fd5f-42ea-4ec8-b41e-fd41f1c64dfd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:52.777331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c726a95-0750-4e81-afda-34a4ef8e513d tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bf3bf6cc997f4144866ac163ea1d57bc, application_credential_id=1f762c38dd4248ba81799d01f756bebd)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:52.779570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c726a95-0750-4e81-afda-34a4ef8e513d tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:52.872482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a9c23-c147-4804-acae-24bfbe1f70f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:52.874651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a9c23-c147-4804-acae-24bfbe1f70f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:52.881654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a9c23-c147-4804-acae-24bfbe1f70f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:52.882006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a9c23-c147-4804-acae-24bfbe1f70f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:52.883609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a9c23-c147-4804-acae-24bfbe1f70f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:52.885392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a9c23-c147-4804-acae-24bfbe1f70f7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:52.902510 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3389/6714] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:41:52.903784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a9c23-c147-4804-acae-24bfbe1f70f7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:52.921334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a9c23-c147-4804-acae-24bfbe1f70f7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:52.926011 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3326/6715] 10.222.0.43 () {58 vars in 1394 bytes} [Tue Jul 19 14:41:52 2022] DELETE /identity/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials/1f762c38dd4248ba81799d01f756bebd => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:52.928384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476d452-bd7a-4480-8593-ac335f9a9a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:52.929443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476d452-bd7a-4480-8593-ac335f9a9a56 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:52.929967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476d452-bd7a-4480-8593-ac335f9a9a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:52.930139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c726a95-0750-4e81-afda-34a4ef8e513d tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:52.930287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476d452-bd7a-4480-8593-ac335f9a9a56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:52.931025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476d452-bd7a-4480-8593-ac335f9a9a56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:52.933015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3476d452-bd7a-4480-8593-ac335f9a9a56 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:52.949172 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3390/6716] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:52.953472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476d452-bd7a-4480-8593-ac335f9a9a56 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:52.957942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c726a95-0750-4e81-afda-34a4ef8e513d tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:52.963210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48bc1eb-f694-43ac-a43d-9e2e0f901443 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf3bf6cc997f4144866ac163ea1d57bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfcbef0c60b84453aa839501679d4b8a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:52.964167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bc1eb-f694-43ac-a43d-9e2e0f901443 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:52.964461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bc1eb-f694-43ac-a43d-9e2e0f901443 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:52.964746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48bc1eb-f694-43ac-a43d-9e2e0f901443 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] PATH_INFO: `/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials/3412850818ab4951b442c4a7436d56da` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:52.969624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3476d452-bd7a-4480-8593-ac335f9a9a56 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:52.980683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa9cbe-165a-489c-b49c-819175a8de93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:52.982048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa9cbe-165a-489c-b49c-819175a8de93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:52.982727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa9cbe-165a-489c-b49c-819175a8de93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:52.983235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafa9cbe-165a-489c-b49c-819175a8de93 admin admin] PATH_INFO: `/v3/projects/5caab688a80d4069b1031d6f42a3f377/users/4e2ef8282005495588ae60eddc3f8cc4/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:52.988699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48bc1eb-f694-43ac-a43d-9e2e0f901443 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bf3bf6cc997f4144866ac163ea1d57bc, application_credential_id=3412850818ab4951b442c4a7436d56da)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:52.993898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48bc1eb-f694-43ac-a43d-9e2e0f901443 tempest-ApplicationCredentialsV3Test-1365122825 tempest-ApplicationCredentialsV3Test-1365122825-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:53.009363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa9cbe-165a-489c-b49c-819175a8de93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5caab688a80d4069b1031d6f42a3f377, user_id=4e2ef8282005495588ae60eddc3f8cc4, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:53.012612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafa9cbe-165a-489c-b49c-819175a8de93 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:53.020721 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:53.164877 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3391/6718] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:52 2022] PUT /identity/v3/projects/5caab688a80d4069b1031d6f42a3f377/users/4e2ef8282005495588ae60eddc3f8cc4/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:53.171071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa9cbe-165a-489c-b49c-819175a8de93 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:53.173072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bafa9cbe-165a-489c-b49c-819175a8de93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:53.177142 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3327/6718] 10.222.0.43 () {58 vars in 1394 bytes} [Tue Jul 19 14:41:52 2022] DELETE /identity/v3/users/bf3bf6cc997f4144866ac163ea1d57bc/application_credentials/3412850818ab4951b442c4a7436d56da => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:41:53.181089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8045f-570d-4749-a820-5db7e8241e96 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:53.181431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8045f-570d-4749-a820-5db7e8241e96 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:53.181678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8045f-570d-4749-a820-5db7e8241e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:53.222713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-28c8045f-570d-4749-a820-5db7e8241e96 None None] MFA Rules not processed for user `4e2ef8282005495588ae60eddc3f8cc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:53.223865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-28c8045f-570d-4749-a820-5db7e8241e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:53.339412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafa9cbe-165a-489c-b49c-819175a8de93 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:53.355357 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3328/6719] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:53.356379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88b2ca-1ac9-4372-bc0a-d5087513f0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:53.357891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88b2ca-1ac9-4372-bc0a-d5087513f0b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:53.358214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88b2ca-1ac9-4372-bc0a-d5087513f0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:53.358843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88b2ca-1ac9-4372-bc0a-d5087513f0b1 admin admin] PATH_INFO: `/v3/users/bf3bf6cc997f4144866ac163ea1d57bc` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:53.360461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88b2ca-1ac9-4372-bc0a-d5087513f0b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf3bf6cc997f4144866ac163ea1d57bc)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:53.362606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88b2ca-1ac9-4372-bc0a-d5087513f0b1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:53.368597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8045f-570d-4749-a820-5db7e8241e96 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:53.371132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-28c8045f-570d-4749-a820-5db7e8241e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:53.479300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8045f-570d-4749-a820-5db7e8241e96 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:53.484584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdc10f-ce55-46ce-8b2e-ecd36c046fcb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:53.485267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdc10f-ce55-46ce-8b2e-ecd36c046fcb service glance] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:53.485558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdc10f-ce55-46ce-8b2e-ecd36c046fcb service glance] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:53.485891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cdc10f-ce55-46ce-8b2e-ecd36c046fcb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:53.490418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c5cdc10f-ce55-46ce-8b2e-ecd36c046fcb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:53.595256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdc10f-ce55-46ce-8b2e-ecd36c046fcb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:53.599683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cdc10f-ce55-46ce-8b2e-ecd36c046fcb service glance] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:53.624578 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3329/6720] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:53.637186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdc10f-ce55-46ce-8b2e-ecd36c046fcb service glance] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:53.647875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c5cdc10f-ce55-46ce-8b2e-ecd36c046fcb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:53.675023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cdc10f-ce55-46ce-8b2e-ecd36c046fcb service glance] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:53.678226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9c88b2ca-1ac9-4372-bc0a-d5087513f0b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf3bf6cc997f4144866ac163ea1d57bc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:53.682431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c347d-2c78-43da-9528-897a592910b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:53.683843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c347d-2c78-43da-9528-897a592910b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:53.684440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c347d-2c78-43da-9528-897a592910b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:53.684829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c347d-2c78-43da-9528-897a592910b6 admin admin] PATH_INFO: `/v3/projects/0f5ff94ee8de48eda754fbc29f63996d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:53.686854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c347d-2c78-43da-9528-897a592910b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f5ff94ee8de48eda754fbc29f63996d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:53.691870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c347d-2c78-43da-9528-897a592910b6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:53.862920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9c88b2ca-1ac9-4372-bc0a-d5087513f0b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf3bf6cc997f4144866ac163ea1d57bc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:53.888152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9c88b2ca-1ac9-4372-bc0a-d5087513f0b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf3bf6cc997f4144866ac163ea1d57bc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:53.890368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9c88b2ca-1ac9-4372-bc0a-d5087513f0b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf3bf6cc997f4144866ac163ea1d57bc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:53.914259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-878c347d-2c78-43da-9528-897a592910b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f5ff94ee8de48eda754fbc29f63996d', 'request_id': 'req-878c347d-2c78-43da-9528-897a592910b6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:54.092604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9c88b2ca-1ac9-4372-bc0a-d5087513f0b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf3bf6cc997f4144866ac163ea1d57bc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:54.100295 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3392/6721] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:53 2022] DELETE /identity/v3/users/bf3bf6cc997f4144866ac163ea1d57bc => generated 0 bytes in 930 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:54.104672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a85d2-7fe7-49f1-9ce2-d5c047f45b36 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:54.105216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a85d2-7fe7-49f1-9ce2-d5c047f45b36 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:54.105479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a85d2-7fe7-49f1-9ce2-d5c047f45b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:54.124949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-240a85d2-7fe7-49f1-9ce2-d5c047f45b36 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:54.126216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-240a85d2-7fe7-49f1-9ce2-d5c047f45b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:54.195759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-878c347d-2c78-43da-9528-897a592910b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f5ff94ee8de48eda754fbc29f63996d', 'request_id': 'req-878c347d-2c78-43da-9528-897a592910b6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:54.202829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-878c347d-2c78-43da-9528-897a592910b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f5ff94ee8de48eda754fbc29f63996d', 'request_id': 'req-878c347d-2c78-43da-9528-897a592910b6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:54.229362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-878c347d-2c78-43da-9528-897a592910b6 admin admin] The token cache is being invalidate because project 0f5ff94ee8de48eda754fbc29f63996d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:54.229759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-878c347d-2c78-43da-9528-897a592910b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:54.234965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-878c347d-2c78-43da-9528-897a592910b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:54.237395 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3330/6722] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:53 2022] DELETE /identity/v3/projects/0f5ff94ee8de48eda754fbc29f63996d => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:54.242130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50de81-5a6e-44c9-865d-4521507b805d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:54.242499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50de81-5a6e-44c9-865d-4521507b805d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:54.242851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50de81-5a6e-44c9-865d-4521507b805d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:54.243580 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3393/6723] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:41:54.257174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a85d2-7fe7-49f1-9ce2-d5c047f45b36 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:54.260238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-240a85d2-7fe7-49f1-9ce2-d5c047f45b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:54.273253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0f50de81-5a6e-44c9-865d-4521507b805d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:54.275280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0f50de81-5a6e-44c9-865d-4521507b805d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:54.295494 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3331/6724] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:41:54.309780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98889f10-1fc1-488b-83e4-98d4b0f013df None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:54.310074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98889f10-1fc1-488b-83e4-98d4b0f013df None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:54.310695 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98889f10-1fc1-488b-83e4-98d4b0f013df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:54.347166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-98889f10-1fc1-488b-83e4-98d4b0f013df None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:54.349224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-98889f10-1fc1-488b-83e4-98d4b0f013df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:54.375587 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3332/6725] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:54.376478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a85d2-7fe7-49f1-9ce2-d5c047f45b36 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:54.377134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98889f10-1fc1-488b-83e4-98d4b0f013df None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:54.385211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a27a05-ea7e-4ca6-a35c-166d95857d4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:54.388994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a27a05-ea7e-4ca6-a35c-166d95857d4f service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:54.388994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a27a05-ea7e-4ca6-a35c-166d95857d4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:54.388994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a27a05-ea7e-4ca6-a35c-166d95857d4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:54.397314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98889f10-1fc1-488b-83e4-98d4b0f013df None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:54.402326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a27a05-ea7e-4ca6-a35c-166d95857d4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:54.404166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a27a05-ea7e-4ca6-a35c-166d95857d4f service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:54.414522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9eade-bf3f-4f42-912c-6246f8a3cd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:54.415529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9eade-bf3f-4f42-912c-6246f8a3cd56 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:54.415961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9eade-bf3f-4f42-912c-6246f8a3cd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:54.416386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a9eade-bf3f-4f42-912c-6246f8a3cd56 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:54.417282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9eade-bf3f-4f42-912c-6246f8a3cd56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:41:54.417718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9eade-bf3f-4f42-912c-6246f8a3cd56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:54.419662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a9eade-bf3f-4f42-912c-6246f8a3cd56 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:54.451290 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3394/6726] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:54.474399 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3333/6727] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:54.474587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a27a05-ea7e-4ca6-a35c-166d95857d4f service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:54.486308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a27a05-ea7e-4ca6-a35c-166d95857d4f service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:54.500610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fa833-5177-46d1-a2f4-cd457e4023b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:54.501478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fa833-5177-46d1-a2f4-cd457e4023b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:54.501885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fa833-5177-46d1-a2f4-cd457e4023b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:54.502809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30fa833-5177-46d1-a2f4-cd457e4023b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:54.503615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fa833-5177-46d1-a2f4-cd457e4023b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:54.510442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30fa833-5177-46d1-a2f4-cd457e4023b7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:54.541555 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:54.661510 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3395/6728] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:54 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:54.662976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9eade-bf3f-4f42-912c-6246f8a3cd56 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:54.680434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a9eade-bf3f-4f42-912c-6246f8a3cd56 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:54.767391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225ae92-1b8f-4d6d-8567-9822aeff9206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:54.767391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225ae92-1b8f-4d6d-8567-9822aeff9206 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:54.767391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225ae92-1b8f-4d6d-8567-9822aeff9206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:54.767391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225ae92-1b8f-4d6d-8567-9822aeff9206 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:54.768249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225ae92-1b8f-4d6d-8567-9822aeff9206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:54.768823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225ae92-1b8f-4d6d-8567-9822aeff9206 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:54.934968 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3334/6729] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:54 2022] POST /identity/v3/users => generated 288 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:54.940893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fa833-5177-46d1-a2f4-cd457e4023b7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:54.959773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30fa833-5177-46d1-a2f4-cd457e4023b7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:54.984030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdaa721-e707-4517-a951-12687f19f2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:54.985084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdaa721-e707-4517-a951-12687f19f2fe admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:54.993441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdaa721-e707-4517-a951-12687f19f2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:54.994153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdaa721-e707-4517-a951-12687f19f2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:54.998260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdaa721-e707-4517-a951-12687f19f2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:55.005861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdaa721-e707-4517-a951-12687f19f2fe admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:55.070672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225ae92-1b8f-4d6d-8567-9822aeff9206 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:55.076067 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:55.083073 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3396/6730] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:54 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:55.086193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225ae92-1b8f-4d6d-8567-9822aeff9206 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:55.093357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd4b8e-f787-43a1-8b65-bbbd9cd7663d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:55.094057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd4b8e-f787-43a1-8b65-bbbd9cd7663d admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:55.103885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd4b8e-f787-43a1-8b65-bbbd9cd7663d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:55.103885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd4b8e-f787-43a1-8b65-bbbd9cd7663d admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:55.103885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd4b8e-f787-43a1-8b65-bbbd9cd7663d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:55.103885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd4b8e-f787-43a1-8b65-bbbd9cd7663d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:55.110496 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3335/6731] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:41:55.115299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdaa721-e707-4517-a951-12687f19f2fe admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:55.125689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdaa721-e707-4517-a951-12687f19f2fe admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:55.132947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9ba0d-8f55-4136-81ef-1a039daf0e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:55.134285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9ba0d-8f55-4136-81ef-1a039daf0e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:55.134726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9ba0d-8f55-4136-81ef-1a039daf0e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:55.135182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9ba0d-8f55-4136-81ef-1a039daf0e89 admin admin] PATH_INFO: `/v3/projects/1facbaea79e14edf93245001b16bc17f/users/fd38c2fa0a5549d482f18026fde4f617/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:55.170611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9ba0d-8f55-4136-81ef-1a039daf0e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1facbaea79e14edf93245001b16bc17f, user_id=fd38c2fa0a5549d482f18026fde4f617, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:55.173277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed9ba0d-8f55-4136-81ef-1a039daf0e89 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:55.239377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd4b8e-f787-43a1-8b65-bbbd9cd7663d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:55.241143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-37fd4b8e-f787-43a1-8b65-bbbd9cd7663d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:55.258211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd4b8e-f787-43a1-8b65-bbbd9cd7663d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:55.265570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254940e4-148c-4dff-8b00-fda8879be8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:55.266591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254940e4-148c-4dff-8b00-fda8879be8dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:55.266962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254940e4-148c-4dff-8b00-fda8879be8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:55.267371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254940e4-148c-4dff-8b00-fda8879be8dc admin admin] PATH_INFO: `/v3/users/0e491958ec314b6da65864fb6fb7a0b0` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:55.269463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254940e4-148c-4dff-8b00-fda8879be8dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e491958ec314b6da65864fb6fb7a0b0)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:55.271796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254940e4-148c-4dff-8b00-fda8879be8dc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:55.376284 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3397/6732] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:55 2022] PUT /identity/v3/projects/1facbaea79e14edf93245001b16bc17f/users/fd38c2fa0a5549d482f18026fde4f617/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:41:55.388207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f3730-ad78-4113-b018-da58ceec21d6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:55.388516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f3730-ad78-4113-b018-da58ceec21d6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:55.388776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f3730-ad78-4113-b018-da58ceec21d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:55.422537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0d7f3730-ad78-4113-b018-da58ceec21d6 None None] MFA Rules not processed for user `fd38c2fa0a5549d482f18026fde4f617`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:55.424644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0d7f3730-ad78-4113-b018-da58ceec21d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:55.532029 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3398/6733] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:41:55.533256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f3730-ad78-4113-b018-da58ceec21d6 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:55.536074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0d7f3730-ad78-4113-b018-da58ceec21d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:55.551286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-254940e4-148c-4dff-8b00-fda8879be8dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e491958ec314b6da65864fb6fb7a0b0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:55.573244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-254940e4-148c-4dff-8b00-fda8879be8dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e491958ec314b6da65864fb6fb7a0b0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:55.574016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-254940e4-148c-4dff-8b00-fda8879be8dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e491958ec314b6da65864fb6fb7a0b0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:55.574719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-254940e4-148c-4dff-8b00-fda8879be8dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e491958ec314b6da65864fb6fb7a0b0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:55.585273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-254940e4-148c-4dff-8b00-fda8879be8dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e491958ec314b6da65864fb6fb7a0b0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:55.647486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f3730-ad78-4113-b018-da58ceec21d6 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:55.656507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cf780-1a0a-4203-98a0-8228e674dd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:55.660184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cf780-1a0a-4203-98a0-8228e674dd25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:55.660866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cf780-1a0a-4203-98a0-8228e674dd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:55.661308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1cf780-1a0a-4203-98a0-8228e674dd25 admin admin] PATH_INFO: `/v3/projects/cfcbef0c60b84453aa839501679d4b8a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:55.663342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1cf780-1a0a-4203-98a0-8228e674dd25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfcbef0c60b84453aa839501679d4b8a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:55.667109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1cf780-1a0a-4203-98a0-8228e674dd25 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:55.768815 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3336/6734] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:55 2022] DELETE /identity/v3/users/0e491958ec314b6da65864fb6fb7a0b0 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:41:55.770357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254940e4-148c-4dff-8b00-fda8879be8dc admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:55.772155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-254940e4-148c-4dff-8b00-fda8879be8dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:55.849948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254940e4-148c-4dff-8b00-fda8879be8dc admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:55.863753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03695144-38ea-4183-b55b-5b1ee46349f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:55.864804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03695144-38ea-4183-b55b-5b1ee46349f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:55.865168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03695144-38ea-4183-b55b-5b1ee46349f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:55.865454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03695144-38ea-4183-b55b-5b1ee46349f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:55.866198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03695144-38ea-4183-b55b-5b1ee46349f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:55.868102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03695144-38ea-4183-b55b-5b1ee46349f5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:55.905177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7c1cf780-1a0a-4203-98a0-8228e674dd25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfcbef0c60b84453aa839501679d4b8a', 'request_id': 'req-7c1cf780-1a0a-4203-98a0-8228e674dd25'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:55.912827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7c1cf780-1a0a-4203-98a0-8228e674dd25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfcbef0c60b84453aa839501679d4b8a', 'request_id': 'req-7c1cf780-1a0a-4203-98a0-8228e674dd25'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:55.919799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7c1cf780-1a0a-4203-98a0-8228e674dd25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfcbef0c60b84453aa839501679d4b8a', 'request_id': 'req-7c1cf780-1a0a-4203-98a0-8228e674dd25'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:56.013932 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3337/6735] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:55 2022] POST /identity/v3/projects => generated 375 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:56.014689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb8aff-6a31-4b2d-ad78-5a333535ab01 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:56.015096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb8aff-6a31-4b2d-ad78-5a333535ab01 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:56.015479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb8aff-6a31-4b2d-ad78-5a333535ab01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:56.035027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-acfb8aff-6a31-4b2d-ad78-5a333535ab01 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:56.036391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-acfb8aff-6a31-4b2d-ad78-5a333535ab01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:56.078974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7c1cf780-1a0a-4203-98a0-8228e674dd25 admin admin] The token cache is being invalidate because project cfcbef0c60b84453aa839501679d4b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:56.082529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7c1cf780-1a0a-4203-98a0-8228e674dd25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:56.083950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7c1cf780-1a0a-4203-98a0-8228e674dd25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:56.089067 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3399/6736] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:55 2022] DELETE /identity/v3/projects/cfcbef0c60b84453aa839501679d4b8a => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:56.090144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cf780-1a0a-4203-98a0-8228e674dd25 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:56.096309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7c1cf780-1a0a-4203-98a0-8228e674dd25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:56.126214 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3338/6737] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:56.129193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6468a63-d336-4913-a259-029c5e0e51f7 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:56.129494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6468a63-d336-4913-a259-029c5e0e51f7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:56.129852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6468a63-d336-4913-a259-029c5e0e51f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:56.161890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b6468a63-d336-4913-a259-029c5e0e51f7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:56.161890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b6468a63-d336-4913-a259-029c5e0e51f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:56.173311 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3339/6738] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:56.175078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6468a63-d336-4913-a259-029c5e0e51f7 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:56.176462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b6468a63-d336-4913-a259-029c5e0e51f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:56.193418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1cf780-1a0a-4203-98a0-8228e674dd25 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:56.200176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19d7184-15f5-4ea5-8e5a-8d6fb9161052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:56.201061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d7184-15f5-4ea5-8e5a-8d6fb9161052 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:56.201537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d7184-15f5-4ea5-8e5a-8d6fb9161052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:56.201981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19d7184-15f5-4ea5-8e5a-8d6fb9161052 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:56.203058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d7184-15f5-4ea5-8e5a-8d6fb9161052 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:56.207162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19d7184-15f5-4ea5-8e5a-8d6fb9161052 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:56.312230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6468a63-d336-4913-a259-029c5e0e51f7 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:56.321600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b125f5-a393-46f8-af82-c6747db53b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:56.321600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b125f5-a393-46f8-af82-c6747db53b3f service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:56.321600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b125f5-a393-46f8-af82-c6747db53b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:56.321600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b125f5-a393-46f8-af82-c6747db53b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:56.339207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b125f5-a393-46f8-af82-c6747db53b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:56.345347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b125f5-a393-46f8-af82-c6747db53b3f service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:56.360983 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3400/6739] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:56 2022] POST /identity/v3/users => generated 294 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:56.364230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9097847-6006-4f32-b20f-f9b70bd88eae None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:56.364737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9097847-6006-4f32-b20f-f9b70bd88eae None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:56.367209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9097847-6006-4f32-b20f-f9b70bd88eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:56.384328 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3340/6740] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:56.385213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b125f5-a393-46f8-af82-c6747db53b3f service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:56.412694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b125f5-a393-46f8-af82-c6747db53b3f service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:56.415508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e9097847-6006-4f32-b20f-f9b70bd88eae None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:56.417214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e9097847-6006-4f32-b20f-f9b70bd88eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:56.424880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258e913-9238-4251-b65f-9e6be5d4638e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:56.431143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258e913-9238-4251-b65f-9e6be5d4638e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:56.431143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258e913-9238-4251-b65f-9e6be5d4638e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:56.431143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258e913-9238-4251-b65f-9e6be5d4638e admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:56.431143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258e913-9238-4251-b65f-9e6be5d4638e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:56.431143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258e913-9238-4251-b65f-9e6be5d4638e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:56.439912 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3401/6741] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:56.445772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9097847-6006-4f32-b20f-f9b70bd88eae None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:56.462363 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3341/6742] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:56.468820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258e913-9238-4251-b65f-9e6be5d4638e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:56.471680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9097847-6006-4f32-b20f-f9b70bd88eae None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:56.483399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258e913-9238-4251-b65f-9e6be5d4638e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:56.484038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc2071-4d76-4951-b117-cadc2e11ec1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:56.485509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc2071-4d76-4951-b117-cadc2e11ec1c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:56.487797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc2071-4d76-4951-b117-cadc2e11ec1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:56.488603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bc2071-4d76-4951-b117-cadc2e11ec1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:56.489387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc2071-4d76-4951-b117-cadc2e11ec1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:41:56.489705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc2071-4d76-4951-b117-cadc2e11ec1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:56.491968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bc2071-4d76-4951-b117-cadc2e11ec1c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:56.494468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4402e-7820-45ca-9876-e08f0940421d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:56.496996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4402e-7820-45ca-9876-e08f0940421d admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:56.499290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4402e-7820-45ca-9876-e08f0940421d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:56.499987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4402e-7820-45ca-9876-e08f0940421d admin admin] PATH_INFO: `/v3/projects/630ccbb83cd84caeb2b2d48956f58b60/users/0dc7c410f77548568fee8a09ede1644d/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:56.521513 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3402/6743] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:41:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:41:56.524367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc2071-4d76-4951-b117-cadc2e11ec1c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:56.547035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bc2071-4d76-4951-b117-cadc2e11ec1c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:56.558202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4402e-7820-45ca-9876-e08f0940421d admin admin] RBAC: Authorizing `identity:create_grant(project_id=630ccbb83cd84caeb2b2d48956f58b60, user_id=0dc7c410f77548568fee8a09ede1644d, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:56.562445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32616601-9d4a-4be3-bee7-8e132788534c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:56.563135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32616601-9d4a-4be3-bee7-8e132788534c admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:56.563266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4402e-7820-45ca-9876-e08f0940421d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:56.563436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32616601-9d4a-4be3-bee7-8e132788534c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:56.563720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32616601-9d4a-4be3-bee7-8e132788534c admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:56.564415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32616601-9d4a-4be3-bee7-8e132788534c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:56.568634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32616601-9d4a-4be3-bee7-8e132788534c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:56.663457 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3342/6744] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:56 2022] PUT /identity/v3/projects/630ccbb83cd84caeb2b2d48956f58b60/users/0dc7c410f77548568fee8a09ede1644d/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:56.664612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4402e-7820-45ca-9876-e08f0940421d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:56.708798 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3403/6745] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:41:56 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:56.710733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32616601-9d4a-4be3-bee7-8e132788534c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:56.828353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32616601-9d4a-4be3-bee7-8e132788534c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:56.838854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983aded1-6ca8-4242-b642-2569bdfccd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:56.839695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983aded1-6ca8-4242-b642-2569bdfccd80 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:56.839991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983aded1-6ca8-4242-b642-2569bdfccd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:56.840274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983aded1-6ca8-4242-b642-2569bdfccd80 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:56.841000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983aded1-6ca8-4242-b642-2569bdfccd80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:56.843174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983aded1-6ca8-4242-b642-2569bdfccd80 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:56.855326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4402e-7820-45ca-9876-e08f0940421d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:56.865580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66679e1c-5fd0-4898-9271-0829e5e6d1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:56.868437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66679e1c-5fd0-4898-9271-0829e5e6d1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:56.868437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66679e1c-5fd0-4898-9271-0829e5e6d1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:56.868437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66679e1c-5fd0-4898-9271-0829e5e6d1d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:56.868437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66679e1c-5fd0-4898-9271-0829e5e6d1d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:56.869735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66679e1c-5fd0-4898-9271-0829e5e6d1d9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:56.886758 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3343/6746] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:56 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:56.889008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66679e1c-5fd0-4898-9271-0829e5e6d1d9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:56.903748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66679e1c-5fd0-4898-9271-0829e5e6d1d9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:56.923122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d7bed-4677-45c8-b856-251f5523e807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:56.924751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d7bed-4677-45c8-b856-251f5523e807 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:56.925324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d7bed-4677-45c8-b856-251f5523e807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:56.925657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d7bed-4677-45c8-b856-251f5523e807 admin admin] PATH_INFO: `/v3/projects/630ccbb83cd84caeb2b2d48956f58b60/users/0dc7c410f77548568fee8a09ede1644d/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:56.933335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d7bed-4677-45c8-b856-251f5523e807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=630ccbb83cd84caeb2b2d48956f58b60, user_id=0dc7c410f77548568fee8a09ede1644d, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:56.938772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d7bed-4677-45c8-b856-251f5523e807 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:56.958260 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3344/6747] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:56 2022] PUT /identity/v3/projects/630ccbb83cd84caeb2b2d48956f58b60/users/0dc7c410f77548568fee8a09ede1644d/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:56.968719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9326c-87b2-4cf4-800e-a72e9f9bb158 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:56.972477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9326c-87b2-4cf4-800e-a72e9f9bb158 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:56.972806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9326c-87b2-4cf4-800e-a72e9f9bb158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:57.024414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3da9326c-87b2-4cf4-800e-a72e9f9bb158 None None] MFA Rules not processed for user `0dc7c410f77548568fee8a09ede1644d`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:57.026674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3da9326c-87b2-4cf4-800e-a72e9f9bb158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:57.035935 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3404/6748] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:41:56 2022] POST /identity/v3/users => generated 288 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:57.036899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983aded1-6ca8-4242-b642-2569bdfccd80 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:57.048666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983aded1-6ca8-4242-b642-2569bdfccd80 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:57.179215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d126fb-d890-404b-9804-a89d10ca4a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:57.179912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d126fb-d890-404b-9804-a89d10ca4a97 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:57.180175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d126fb-d890-404b-9804-a89d10ca4a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:57.180453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d126fb-d890-404b-9804-a89d10ca4a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:57.181223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d126fb-d890-404b-9804-a89d10ca4a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:57.182895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d126fb-d890-404b-9804-a89d10ca4a97 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:57.226635 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3345/6749] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:56 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:57.227863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9326c-87b2-4cf4-800e-a72e9f9bb158 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:57.238857 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3405/6750] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:57.239950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d126fb-d890-404b-9804-a89d10ca4a97 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:57.266512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9326c-87b2-4cf4-800e-a72e9f9bb158 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:57.274942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d126fb-d890-404b-9804-a89d10ca4a97 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:57.278994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6d564-2095-4773-b019-83f981b6e36c tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7c410f77548568fee8a09ede1644d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '630ccbb83cd84caeb2b2d48956f58b60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:57.279835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6d564-2095-4773-b019-83f981b6e36c tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:57.280139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6d564-2095-4773-b019-83f981b6e36c tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:57.280292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6d564-2095-4773-b019-83f981b6e36c tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:57.281029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6d564-2095-4773-b019-83f981b6e36c tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:57.285435 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-0bc6d564-2095-4773-b019-83f981b6e36c tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:41:57.285435 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:41:57.285435 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:41:57.286442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc6d564-2095-4773-b019-83f981b6e36c tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:57.316580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf635f1-c430-4dfc-a99d-90fd540b427c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:57.317280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf635f1-c430-4dfc-a99d-90fd540b427c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:57.317571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf635f1-c430-4dfc-a99d-90fd540b427c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:57.317853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf635f1-c430-4dfc-a99d-90fd540b427c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:57.318631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf635f1-c430-4dfc-a99d-90fd540b427c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:57.320316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf635f1-c430-4dfc-a99d-90fd540b427c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:57.349968 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3406/6751] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:57.353756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf635f1-c430-4dfc-a99d-90fd540b427c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:57.357879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cdf635f1-c430-4dfc-a99d-90fd540b427c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:57.394547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf635f1-c430-4dfc-a99d-90fd540b427c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:57.402660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18636116-9dd1-4aec-a3bc-a959b85ead2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:57.403563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18636116-9dd1-4aec-a3bc-a959b85ead2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:57.403846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18636116-9dd1-4aec-a3bc-a959b85ead2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:57.404127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18636116-9dd1-4aec-a3bc-a959b85ead2f admin admin] PATH_INFO: `/v3/projects/cbc939684fff4ff1be15affe6a91f50f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:57.405450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18636116-9dd1-4aec-a3bc-a959b85ead2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc939684fff4ff1be15affe6a91f50f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:57.407446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18636116-9dd1-4aec-a3bc-a959b85ead2f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:57.462945 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3346/6752] 10.222.0.43 () {60 vars in 1184 bytes} [Tue Jul 19 14:41:57 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:57.463645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6d564-2095-4773-b019-83f981b6e36c tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:57.489573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6d564-2095-4773-b019-83f981b6e36c tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:57.506508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d731a-0641-4f5f-8dfc-8502808e2a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:57.511028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d731a-0641-4f5f-8dfc-8502808e2a1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:57.511826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d731a-0641-4f5f-8dfc-8502808e2a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:57.511826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d731a-0641-4f5f-8dfc-8502808e2a1e admin admin] PATH_INFO: `/v3/projects/26413d2bf254416ca89723e6557adfea/users/48f0082e55a340188d6a2acde4693069/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:57.534807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d731a-0641-4f5f-8dfc-8502808e2a1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=26413d2bf254416ca89723e6557adfea, user_id=48f0082e55a340188d6a2acde4693069, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:57.538609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d731a-0641-4f5f-8dfc-8502808e2a1e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:57.645483 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3347/6753] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:41:57 2022] PUT /identity/v3/projects/26413d2bf254416ca89723e6557adfea/users/48f0082e55a340188d6a2acde4693069/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:57.655720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d731a-0641-4f5f-8dfc-8502808e2a1e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:57.672962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-18636116-9dd1-4aec-a3bc-a959b85ead2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc939684fff4ff1be15affe6a91f50f', 'request_id': 'req-18636116-9dd1-4aec-a3bc-a959b85ead2f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:57.687961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-18636116-9dd1-4aec-a3bc-a959b85ead2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc939684fff4ff1be15affe6a91f50f', 'request_id': 'req-18636116-9dd1-4aec-a3bc-a959b85ead2f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:57.698658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-18636116-9dd1-4aec-a3bc-a959b85ead2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc939684fff4ff1be15affe6a91f50f', 'request_id': 'req-18636116-9dd1-4aec-a3bc-a959b85ead2f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:57.726471 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:57.767962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d731a-0641-4f5f-8dfc-8502808e2a1e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:57.791729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-18636116-9dd1-4aec-a3bc-a959b85ead2f admin admin] The token cache is being invalidate because project cbc939684fff4ff1be15affe6a91f50f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:57.792091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-18636116-9dd1-4aec-a3bc-a959b85ead2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:57.793096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-18636116-9dd1-4aec-a3bc-a959b85ead2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:57.799600 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3407/6754] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:57 2022] DELETE /identity/v3/projects/cbc939684fff4ff1be15affe6a91f50f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:57.803834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e17a94-6576-4d85-88a6-db95df748712 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:57.804212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e17a94-6576-4d85-88a6-db95df748712 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:57.804561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e17a94-6576-4d85-88a6-db95df748712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:57.860461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-21e17a94-6576-4d85-88a6-db95df748712 None None] MFA Rules not processed for user `48f0082e55a340188d6a2acde4693069`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:57.862910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-21e17a94-6576-4d85-88a6-db95df748712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:57.876404 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:57.902599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97010aab-c95f-462d-a7cd-905abd67dd87 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7c410f77548568fee8a09ede1644d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '630ccbb83cd84caeb2b2d48956f58b60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:57.903639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97010aab-c95f-462d-a7cd-905abd67dd87 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:57.903932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97010aab-c95f-462d-a7cd-905abd67dd87 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:57.904218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97010aab-c95f-462d-a7cd-905abd67dd87 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/b88ef50ce6d241058378530ab83e739d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:57.904900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97010aab-c95f-462d-a7cd-905abd67dd87 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=b88ef50ce6d241058378530ab83e739d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:57.906127 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-97010aab-c95f-462d-a7cd-905abd67dd87 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:41:57.906127 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:41:57.906127 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:41:57.907038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97010aab-c95f-462d-a7cd-905abd67dd87 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:57.918043 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3348/6755] 10.222.0.43 () {58 vars in 1262 bytes} [Tue Jul 19 14:41:57 2022] GET /identity/v3/OS-OAUTH1/consumers/b88ef50ce6d241058378530ab83e739d => generated 221 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:57.918943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97010aab-c95f-462d-a7cd-905abd67dd87 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:57.920686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-97010aab-c95f-462d-a7cd-905abd67dd87 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:58.035488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97010aab-c95f-462d-a7cd-905abd67dd87 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:58.044997 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3408/6756] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:58.046937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e17a94-6576-4d85-88a6-db95df748712 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:58.049899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-21e17a94-6576-4d85-88a6-db95df748712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:58.050451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff16369-1896-4658-ac2b-7c04a1060b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:58.054337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff16369-1896-4658-ac2b-7c04a1060b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:58.054534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff16369-1896-4658-ac2b-7c04a1060b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:58.055717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff16369-1896-4658-ac2b-7c04a1060b5b admin admin] PATH_INFO: `/v3/users/4e2ef8282005495588ae60eddc3f8cc4` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:58.058968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff16369-1896-4658-ac2b-7c04a1060b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e2ef8282005495588ae60eddc3f8cc4)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:58.061022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff16369-1896-4658-ac2b-7c04a1060b5b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:58.071678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e17a94-6576-4d85-88a6-db95df748712 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:58.077149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8143e-42a2-4363-99c4-8a6b4f0dd6ea tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7c410f77548568fee8a09ede1644d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '630ccbb83cd84caeb2b2d48956f58b60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:58.078440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8143e-42a2-4363-99c4-8a6b4f0dd6ea tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:58.078962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8143e-42a2-4363-99c4-8a6b4f0dd6ea tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:58.079422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae8143e-42a2-4363-99c4-8a6b4f0dd6ea tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/b88ef50ce6d241058378530ab83e739d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:58.080934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8143e-42a2-4363-99c4-8a6b4f0dd6ea tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=b88ef50ce6d241058378530ab83e739d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:58.082428 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-5ae8143e-42a2-4363-99c4-8a6b4f0dd6ea tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:41:58.082428 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:41:58.082428 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:41:58.083689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae8143e-42a2-4363-99c4-8a6b4f0dd6ea tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:58.084154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5ae8143e-42a2-4363-99c4-8a6b4f0dd6ea tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invalidating token cache because consumer b88ef50ce6d241058378530ab83e739d has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:58.084658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5ae8143e-42a2-4363-99c4-8a6b4f0dd6ea tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:58.085599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5ae8143e-42a2-4363-99c4-8a6b4f0dd6ea tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:58.225531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5ae8143e-42a2-4363-99c4-8a6b4f0dd6ea tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'b88ef50ce6d241058378530ab83e739d', 'request_id': 'req-5ae8143e-42a2-4363-99c4-8a6b4f0dd6ea'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:58.310354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bff16369-1896-4658-ac2b-7c04a1060b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e2ef8282005495588ae60eddc3f8cc4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:58.339215 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3409/6757] 10.222.0.43 () {58 vars in 1265 bytes} [Tue Jul 19 14:41:58 2022] DELETE /identity/v3/OS-OAUTH1/consumers/b88ef50ce6d241058378530ab83e739d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:58.340239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8143e-42a2-4363-99c4-8a6b4f0dd6ea tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:58.347468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5ae8143e-42a2-4363-99c4-8a6b4f0dd6ea tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:58.352426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bff16369-1896-4658-ac2b-7c04a1060b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e2ef8282005495588ae60eddc3f8cc4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:58.353833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bff16369-1896-4658-ac2b-7c04a1060b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e2ef8282005495588ae60eddc3f8cc4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:58.357275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bff16369-1896-4658-ac2b-7c04a1060b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e2ef8282005495588ae60eddc3f8cc4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:58.393217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bff16369-1896-4658-ac2b-7c04a1060b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e2ef8282005495588ae60eddc3f8cc4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:58.402017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae8143e-42a2-4363-99c4-8a6b4f0dd6ea tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:58.416963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c264c-e15e-4275-9fcd-079974dc7c8a tempest-IdentityCatalogTest-1414437197 tempest-IdentityCatalogTest-1414437197-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '48f0082e55a340188d6a2acde4693069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '26413d2bf254416ca89723e6557adfea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:58.418609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c264c-e15e-4275-9fcd-079974dc7c8a tempest-IdentityCatalogTest-1414437197 tempest-IdentityCatalogTest-1414437197-project] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:58.418609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c264c-e15e-4275-9fcd-079974dc7c8a tempest-IdentityCatalogTest-1414437197 tempest-IdentityCatalogTest-1414437197-project] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:58.418919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c264c-e15e-4275-9fcd-079974dc7c8a tempest-IdentityCatalogTest-1414437197 tempest-IdentityCatalogTest-1414437197-project] PATH_INFO: `/v3/auth/catalog` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:58.419796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c264c-e15e-4275-9fcd-079974dc7c8a tempest-IdentityCatalogTest-1414437197 tempest-IdentityCatalogTest-1414437197-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:58.422974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c264c-e15e-4275-9fcd-079974dc7c8a tempest-IdentityCatalogTest-1414437197 tempest-IdentityCatalogTest-1414437197-project] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:58.426487 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3410/6758] 10.222.0.43 () {58 vars in 1142 bytes} [Tue Jul 19 14:41:58 2022] GET /identity/v3/auth/catalog => generated 2648 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:41:58.427391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c264c-e15e-4275-9fcd-079974dc7c8a tempest-IdentityCatalogTest-1414437197 tempest-IdentityCatalogTest-1414437197-project] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:58.432808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-966c264c-e15e-4275-9fcd-079974dc7c8a tempest-IdentityCatalogTest-1414437197 tempest-IdentityCatalogTest-1414437197-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:58.468244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c264c-e15e-4275-9fcd-079974dc7c8a tempest-IdentityCatalogTest-1414437197 tempest-IdentityCatalogTest-1414437197-project] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:58.480055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c1975-476c-419c-8559-d2ac240a8845 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7c410f77548568fee8a09ede1644d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '630ccbb83cd84caeb2b2d48956f58b60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:58.481034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c1975-476c-419c-8559-d2ac240a8845 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:58.481993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c1975-476c-419c-8559-d2ac240a8845 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:58.481993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c1975-476c-419c-8559-d2ac240a8845 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:58.482563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c1975-476c-419c-8559-d2ac240a8845 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:58.483658 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-3c1c1975-476c-419c-8559-d2ac240a8845 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:41:58.483658 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:41:58.483658 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:41:58.484568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c1975-476c-419c-8559-d2ac240a8845 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:58.494562 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3349/6759] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:57 2022] DELETE /identity/v3/users/4e2ef8282005495588ae60eddc3f8cc4 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:58.495430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff16369-1896-4658-ac2b-7c04a1060b5b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:58.499299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bff16369-1896-4658-ac2b-7c04a1060b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:58.616938 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3411/6760] 10.222.0.43 () {60 vars in 1184 bytes} [Tue Jul 19 14:41:58 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:58.620698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c1975-476c-419c-8559-d2ac240a8845 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:58.651369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c1975-476c-419c-8559-d2ac240a8845 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:58.679744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff16369-1896-4658-ac2b-7c04a1060b5b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:58.696572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f175a3-b7e1-4b47-bfbf-b24cdf7fecfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:58.697495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f175a3-b7e1-4b47-bfbf-b24cdf7fecfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:58.697794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f175a3-b7e1-4b47-bfbf-b24cdf7fecfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:58.698074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f175a3-b7e1-4b47-bfbf-b24cdf7fecfa admin admin] PATH_INFO: `/v3/users/48f0082e55a340188d6a2acde4693069` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:58.702979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f175a3-b7e1-4b47-bfbf-b24cdf7fecfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=48f0082e55a340188d6a2acde4693069)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:58.706695 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f175a3-b7e1-4b47-bfbf-b24cdf7fecfa admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:58.798971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3374883-55f6-4ed1-8b70-27e65daffb34 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7c410f77548568fee8a09ede1644d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '630ccbb83cd84caeb2b2d48956f58b60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:58.801924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3374883-55f6-4ed1-8b70-27e65daffb34 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:58.802090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3374883-55f6-4ed1-8b70-27e65daffb34 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:58.803970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3374883-55f6-4ed1-8b70-27e65daffb34 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a9c2a0da19f848658e062f26a3a3bd1d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:58.806156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3374883-55f6-4ed1-8b70-27e65daffb34 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=a9c2a0da19f848658e062f26a3a3bd1d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:58.809027 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:58.811818 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-c3374883-55f6-4ed1-8b70-27e65daffb34 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:41:58.811818 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:41:58.811818 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:41:58.814867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3374883-55f6-4ed1-8b70-27e65daffb34 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:58.827050 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3412/6761] 10.222.0.43 () {58 vars in 1262 bytes} [Tue Jul 19 14:41:58 2022] GET /identity/v3/OS-OAUTH1/consumers/a9c2a0da19f848658e062f26a3a3bd1d => generated 221 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:41:58.833219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3374883-55f6-4ed1-8b70-27e65daffb34 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:58.853323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3374883-55f6-4ed1-8b70-27e65daffb34 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:58.858728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c40b00-a1eb-40bd-803e-87ba1b3ad0c6 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7c410f77548568fee8a09ede1644d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '630ccbb83cd84caeb2b2d48956f58b60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:58.861249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c40b00-a1eb-40bd-803e-87ba1b3ad0c6 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:58.861615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c40b00-a1eb-40bd-803e-87ba1b3ad0c6 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:58.861902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c40b00-a1eb-40bd-803e-87ba1b3ad0c6 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a9c2a0da19f848658e062f26a3a3bd1d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:58.864668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c40b00-a1eb-40bd-803e-87ba1b3ad0c6 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=a9c2a0da19f848658e062f26a3a3bd1d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:58.866396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c40b00-a1eb-40bd-803e-87ba1b3ad0c6 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:58.866651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-36c40b00-a1eb-40bd-803e-87ba1b3ad0c6 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invalidating token cache because consumer a9c2a0da19f848658e062f26a3a3bd1d has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:58.867807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-36c40b00-a1eb-40bd-803e-87ba1b3ad0c6 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:58.868566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-36c40b00-a1eb-40bd-803e-87ba1b3ad0c6 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:58.981029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-64f175a3-b7e1-4b47-bfbf-b24cdf7fecfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48f0082e55a340188d6a2acde4693069'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:58.989489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-36c40b00-a1eb-40bd-803e-87ba1b3ad0c6 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'a9c2a0da19f848658e062f26a3a3bd1d', 'request_id': 'req-36c40b00-a1eb-40bd-803e-87ba1b3ad0c6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:59.038278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-64f175a3-b7e1-4b47-bfbf-b24cdf7fecfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48f0082e55a340188d6a2acde4693069'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:59.041166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-64f175a3-b7e1-4b47-bfbf-b24cdf7fecfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48f0082e55a340188d6a2acde4693069'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:59.042955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-64f175a3-b7e1-4b47-bfbf-b24cdf7fecfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48f0082e55a340188d6a2acde4693069'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:59.063796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-64f175a3-b7e1-4b47-bfbf-b24cdf7fecfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48f0082e55a340188d6a2acde4693069'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:59.084390 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:41:59.111292 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3413/6762] 10.222.0.43 () {58 vars in 1265 bytes} [Tue Jul 19 14:41:58 2022] DELETE /identity/v3/OS-OAUTH1/consumers/a9c2a0da19f848658e062f26a3a3bd1d => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:59.115434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c40b00-a1eb-40bd-803e-87ba1b3ad0c6 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:59.117686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-36c40b00-a1eb-40bd-803e-87ba1b3ad0c6 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:59.135164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c40b00-a1eb-40bd-803e-87ba1b3ad0c6 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:59.140698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a415c-84aa-4e4d-8973-bb73a5ec5d79 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7c410f77548568fee8a09ede1644d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '630ccbb83cd84caeb2b2d48956f58b60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:59.141872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a415c-84aa-4e4d-8973-bb73a5ec5d79 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:59.142419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a415c-84aa-4e4d-8973-bb73a5ec5d79 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:59.143722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a415c-84aa-4e4d-8973-bb73a5ec5d79 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a9c2a0da19f848658e062f26a3a3bd1d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:59.144754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a415c-84aa-4e4d-8973-bb73a5ec5d79 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=a9c2a0da19f848658e062f26a3a3bd1d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:59.146738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a415c-84aa-4e4d-8973-bb73a5ec5d79 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:59.171254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-9e6a415c-84aa-4e4d-8973-bb73a5ec5d79 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jul 19 14:41:59.171254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:59.171254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:41:59.171254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:41:59.171254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:41:59.171254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:41:59.171254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:41:59.171254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:41:59.171254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:41:59.171254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:41:59.171254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:41:59.171254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:41:59.171254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Jul 19 14:41:59.171254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Jul 19 14:41:59.171254 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Jul 19 14:41:59.172841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Jul 19 14:41:59.172841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Jul 19 14:41:59.172841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Jul 19 14:41:59.172841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Jul 19 14:41:59.172841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jul 19 14:41:59.172841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jul 19 14:41:59.172841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jul 19 14:41:59.172841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jul 19 14:41:59.172841 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:59.178151 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3414/6763] 10.222.0.43 () {58 vars in 1262 bytes} [Tue Jul 19 14:41:59 2022] GET /identity/v3/OS-OAUTH1/consumers/a9c2a0da19f848658e062f26a3a3bd1d => generated 74 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 14:41:59.179154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a415c-84aa-4e4d-8973-bb73a5ec5d79 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:59.183257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9e6a415c-84aa-4e4d-8973-bb73a5ec5d79 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:59.200617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a415c-84aa-4e4d-8973-bb73a5ec5d79 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:59.206255 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3350/6764] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:41:58 2022] DELETE /identity/v3/users/48f0082e55a340188d6a2acde4693069 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:59.212727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedce342-fb87-49c8-9b9a-9edeb92ac4d4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:59.213035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedce342-fb87-49c8-9b9a-9edeb92ac4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:59.213417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedce342-fb87-49c8-9b9a-9edeb92ac4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:59.245053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-aedce342-fb87-49c8-9b9a-9edeb92ac4d4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:59.246537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aedce342-fb87-49c8-9b9a-9edeb92ac4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:59.315072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bac7c-9f33-458a-b45a-68b5f80fa3ac tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7c410f77548568fee8a09ede1644d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '630ccbb83cd84caeb2b2d48956f58b60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:59.316005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bac7c-9f33-458a-b45a-68b5f80fa3ac tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:59.316346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bac7c-9f33-458a-b45a-68b5f80fa3ac tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:59.316692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bac7c-9f33-458a-b45a-68b5f80fa3ac tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/a9c2a0da19f848658e062f26a3a3bd1d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:59.317426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bac7c-9f33-458a-b45a-68b5f80fa3ac tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=a9c2a0da19f848658e062f26a3a3bd1d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:59.319434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413bac7c-9f33-458a-b45a-68b5f80fa3ac tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:59.319603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-413bac7c-9f33-458a-b45a-68b5f80fa3ac tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invalidating token cache because consumer a9c2a0da19f848658e062f26a3a3bd1d has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:59.319893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-413bac7c-9f33-458a-b45a-68b5f80fa3ac tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:59.321215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-413bac7c-9f33-458a-b45a-68b5f80fa3ac tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:59.367267 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-413bac7c-9f33-458a-b45a-68b5f80fa3ac tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jul 19 14:41:59.367267 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:41:59.367267 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:41:59.367267 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:41:59.367267 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:41:59.367267 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:41:59.367267 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:41:59.367267 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:41:59.367267 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:41:59.367267 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:41:59.367267 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:41:59.367267 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:41:59.367267 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Jul 19 14:41:59.367267 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Jul 19 14:41:59.367267 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:41:59.368331 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:41:59.368331 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Jul 19 14:41:59.368331 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Jul 19 14:41:59.368331 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Jul 19 14:41:59.368331 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Jul 19 14:41:59.368331 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Jul 19 14:41:59.368331 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jul 19 14:41:59.368331 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jul 19 14:41:59.368331 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jul 19 14:41:59.368331 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jul 19 14:41:59.368331 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:41:59.371905 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3415/6765] 10.222.0.43 () {58 vars in 1265 bytes} [Tue Jul 19 14:41:59 2022] DELETE /identity/v3/OS-OAUTH1/consumers/a9c2a0da19f848658e062f26a3a3bd1d => generated 74 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 14:41:59.381197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bac7c-9f33-458a-b45a-68b5f80fa3ac tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:59.383143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-413bac7c-9f33-458a-b45a-68b5f80fa3ac tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:59.388700 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3351/6766] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:41:59.397006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedce342-fb87-49c8-9b9a-9edeb92ac4d4 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:59.399065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aedce342-fb87-49c8-9b9a-9edeb92ac4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:59.409305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bac7c-9f33-458a-b45a-68b5f80fa3ac tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:59.422137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea84deb-e1a8-4cf8-b33b-36dedb842c34 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7c410f77548568fee8a09ede1644d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '630ccbb83cd84caeb2b2d48956f58b60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:59.422833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea84deb-e1a8-4cf8-b33b-36dedb842c34 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:59.423103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea84deb-e1a8-4cf8-b33b-36dedb842c34 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:59.423385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea84deb-e1a8-4cf8-b33b-36dedb842c34 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:59.426424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea84deb-e1a8-4cf8-b33b-36dedb842c34 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:59.428846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea84deb-e1a8-4cf8-b33b-36dedb842c34 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:59.487306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedce342-fb87-49c8-9b9a-9edeb92ac4d4 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:59.491855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecdab2-bb6d-4a98-b9cf-123560c9ca57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:59.492623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecdab2-bb6d-4a98-b9cf-123560c9ca57 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:59.493573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecdab2-bb6d-4a98-b9cf-123560c9ca57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:59.493865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecdab2-bb6d-4a98-b9cf-123560c9ca57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:59.503890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecdab2-bb6d-4a98-b9cf-123560c9ca57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:59.514925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ecdab2-bb6d-4a98-b9cf-123560c9ca57 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:59.529029 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3352/6767] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:41:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:41:59.529934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecdab2-bb6d-4a98-b9cf-123560c9ca57 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:59.531325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c2ecdab2-bb6d-4a98-b9cf-123560c9ca57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:41:59.547154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ecdab2-bb6d-4a98-b9cf-123560c9ca57 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:59.553034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec441f06-38f6-4e30-8eac-7604be68afac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:59.554050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec441f06-38f6-4e30-8eac-7604be68afac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:59.554464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec441f06-38f6-4e30-8eac-7604be68afac admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:59.554859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec441f06-38f6-4e30-8eac-7604be68afac admin admin] PATH_INFO: `/v3/projects/5caab688a80d4069b1031d6f42a3f377` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:59.555534 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3416/6768] 10.222.0.43 () {60 vars in 1184 bytes} [Tue Jul 19 14:41:59 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:41:59.576372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec441f06-38f6-4e30-8eac-7604be68afac admin admin] RBAC: Authorizing `identity:delete_project(project_id=5caab688a80d4069b1031d6f42a3f377)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:59.576472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea84deb-e1a8-4cf8-b33b-36dedb842c34 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:59.576561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec441f06-38f6-4e30-8eac-7604be68afac admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:59.582775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea84deb-e1a8-4cf8-b33b-36dedb842c34 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:59.588312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca32e43-cb92-416a-af75-ce81245b24f4 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7c410f77548568fee8a09ede1644d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '630ccbb83cd84caeb2b2d48956f58b60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:59.588973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca32e43-cb92-416a-af75-ce81245b24f4 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:59.589289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca32e43-cb92-416a-af75-ce81245b24f4 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:59.589718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca32e43-cb92-416a-af75-ce81245b24f4 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:59.590488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca32e43-cb92-416a-af75-ce81245b24f4 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:59.592105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca32e43-cb92-416a-af75-ce81245b24f4 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:59.699209 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3417/6769] 10.222.0.43 () {60 vars in 1184 bytes} [Tue Jul 19 14:41:59 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:41:59.700736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca32e43-cb92-416a-af75-ce81245b24f4 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:59.716486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca32e43-cb92-416a-af75-ce81245b24f4 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:59.724188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bcbf1-c995-4118-88ae-e39fd80f58f2 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7c410f77548568fee8a09ede1644d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '630ccbb83cd84caeb2b2d48956f58b60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:59.724856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bcbf1-c995-4118-88ae-e39fd80f58f2 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:59.725156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bcbf1-c995-4118-88ae-e39fd80f58f2 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:59.728823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011bcbf1-c995-4118-88ae-e39fd80f58f2 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:59.730326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bcbf1-c995-4118-88ae-e39fd80f58f2 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:59.733835 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-011bcbf1-c995-4118-88ae-e39fd80f58f2 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:41:59.733835 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:41:59.733835 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:41:59.736031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011bcbf1-c995-4118-88ae-e39fd80f58f2 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:59.742332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec441f06-38f6-4e30-8eac-7604be68afac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5caab688a80d4069b1031d6f42a3f377', 'request_id': 'req-ec441f06-38f6-4e30-8eac-7604be68afac'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:59.749274 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3418/6770] 10.222.0.43 () {58 vars in 1163 bytes} [Tue Jul 19 14:41:59 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:41:59.753402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bcbf1-c995-4118-88ae-e39fd80f58f2 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:41:59.766796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011bcbf1-c995-4118-88ae-e39fd80f58f2 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:41:59.837631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec441f06-38f6-4e30-8eac-7604be68afac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5caab688a80d4069b1031d6f42a3f377', 'request_id': 'req-ec441f06-38f6-4e30-8eac-7604be68afac'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:59.845634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec441f06-38f6-4e30-8eac-7604be68afac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5caab688a80d4069b1031d6f42a3f377', 'request_id': 'req-ec441f06-38f6-4e30-8eac-7604be68afac'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:59.856770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7213f7b-047f-4630-b622-75168fb2efd4 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7c410f77548568fee8a09ede1644d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '630ccbb83cd84caeb2b2d48956f58b60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:41:59.857663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7213f7b-047f-4630-b622-75168fb2efd4 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:59.857958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7213f7b-047f-4630-b622-75168fb2efd4 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:59.858280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7213f7b-047f-4630-b622-75168fb2efd4 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/bf765c3635c64c3ab757b11e3253afbc` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:59.858969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7213f7b-047f-4630-b622-75168fb2efd4 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=bf765c3635c64c3ab757b11e3253afbc)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:41:59.860671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7213f7b-047f-4630-b622-75168fb2efd4 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:41:59.861000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a7213f7b-047f-4630-b622-75168fb2efd4 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invalidating token cache because consumer bf765c3635c64c3ab757b11e3253afbc has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:59.861290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a7213f7b-047f-4630-b622-75168fb2efd4 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:59.863304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a7213f7b-047f-4630-b622-75168fb2efd4 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:59.876582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec441f06-38f6-4e30-8eac-7604be68afac admin admin] The token cache is being invalidate because project 5caab688a80d4069b1031d6f42a3f377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:41:59.879943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec441f06-38f6-4e30-8eac-7604be68afac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:59.883036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ec441f06-38f6-4e30-8eac-7604be68afac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:59.891257 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3353/6771] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:41:59 2022] DELETE /identity/v3/projects/5caab688a80d4069b1031d6f42a3f377 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:41:59.896950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556a5f6-6995-4e1e-bf0f-5f09955b0dfe None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:41:59.897250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556a5f6-6995-4e1e-bf0f-5f09955b0dfe None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:41:59.897541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4556a5f6-6995-4e1e-bf0f-5f09955b0dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:41:59.932072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a7213f7b-047f-4630-b622-75168fb2efd4 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'bf765c3635c64c3ab757b11e3253afbc', 'request_id': 'req-a7213f7b-047f-4630-b622-75168fb2efd4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:41:59.960997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4556a5f6-6995-4e1e-bf0f-5f09955b0dfe None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:41:59.962228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4556a5f6-6995-4e1e-bf0f-5f09955b0dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:00.025478 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3419/6772] 10.222.0.43 () {58 vars in 1265 bytes} [Tue Jul 19 14:41:59 2022] DELETE /identity/v3/OS-OAUTH1/consumers/bf765c3635c64c3ab757b11e3253afbc => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:00.028318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7213f7b-047f-4630-b622-75168fb2efd4 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:00.030031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a7213f7b-047f-4630-b622-75168fb2efd4 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:00.073026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7213f7b-047f-4630-b622-75168fb2efd4 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:00.088662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be83a76-4622-4693-b4b0-8dc5df118f9d tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7c410f77548568fee8a09ede1644d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '630ccbb83cd84caeb2b2d48956f58b60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:00.093400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be83a76-4622-4693-b4b0-8dc5df118f9d tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:00.093706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be83a76-4622-4693-b4b0-8dc5df118f9d tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:00.093995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be83a76-4622-4693-b4b0-8dc5df118f9d tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/29269f37f795495984fd7f94b807d30e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:00.097064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be83a76-4622-4693-b4b0-8dc5df118f9d tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=29269f37f795495984fd7f94b807d30e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:00.102046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be83a76-4622-4693-b4b0-8dc5df118f9d tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:00.103790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4be83a76-4622-4693-b4b0-8dc5df118f9d tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invalidating token cache because consumer 29269f37f795495984fd7f94b807d30e has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:00.104097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4be83a76-4622-4693-b4b0-8dc5df118f9d tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:00.105726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4be83a76-4622-4693-b4b0-8dc5df118f9d tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:00.153782 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3354/6773] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:42:00.161870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556a5f6-6995-4e1e-bf0f-5f09955b0dfe None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:00.165214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4556a5f6-6995-4e1e-bf0f-5f09955b0dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:00.192847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4be83a76-4622-4693-b4b0-8dc5df118f9d tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '29269f37f795495984fd7f94b807d30e', 'request_id': 'req-4be83a76-4622-4693-b4b0-8dc5df118f9d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:00.217765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4556a5f6-6995-4e1e-bf0f-5f09955b0dfe None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:00.235950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c9436-83de-40fa-8709-1425faf9ad93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:00.237627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c9436-83de-40fa-8709-1425faf9ad93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:00.238074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c9436-83de-40fa-8709-1425faf9ad93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:00.238638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c9436-83de-40fa-8709-1425faf9ad93 admin admin] PATH_INFO: `/v3/projects/26413d2bf254416ca89723e6557adfea` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:00.240249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c9436-83de-40fa-8709-1425faf9ad93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26413d2bf254416ca89723e6557adfea)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:00.242594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c9436-83de-40fa-8709-1425faf9ad93 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:00.253968 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:00.304349 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3420/6774] 10.222.0.43 () {58 vars in 1265 bytes} [Tue Jul 19 14:42:00 2022] DELETE /identity/v3/OS-OAUTH1/consumers/29269f37f795495984fd7f94b807d30e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:00.305953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423e82e-1043-4f12-bc59-a9c4a31f51eb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:00.307216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423e82e-1043-4f12-bc59-a9c4a31f51eb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:00.307216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f423e82e-1043-4f12-bc59-a9c4a31f51eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:00.370260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f423e82e-1043-4f12-bc59-a9c4a31f51eb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:00.376232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f423e82e-1043-4f12-bc59-a9c4a31f51eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:00.396702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ac0c9436-83de-40fa-8709-1425faf9ad93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26413d2bf254416ca89723e6557adfea', 'request_id': 'req-ac0c9436-83de-40fa-8709-1425faf9ad93'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:00.492782 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3421/6775] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:00.496165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423e82e-1043-4f12-bc59-a9c4a31f51eb None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:00.497186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f423e82e-1043-4f12-bc59-a9c4a31f51eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:00.505647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ac0c9436-83de-40fa-8709-1425faf9ad93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26413d2bf254416ca89723e6557adfea', 'request_id': 'req-ac0c9436-83de-40fa-8709-1425faf9ad93'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:00.515573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ac0c9436-83de-40fa-8709-1425faf9ad93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26413d2bf254416ca89723e6557adfea', 'request_id': 'req-ac0c9436-83de-40fa-8709-1425faf9ad93'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:00.535726 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:00.541202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ac0c9436-83de-40fa-8709-1425faf9ad93 admin admin] The token cache is being invalidate because project 26413d2bf254416ca89723e6557adfea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:00.541590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ac0c9436-83de-40fa-8709-1425faf9ad93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:00.542518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ac0c9436-83de-40fa-8709-1425faf9ad93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:00.544842 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3355/6776] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:00 2022] DELETE /identity/v3/projects/26413d2bf254416ca89723e6557adfea => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:00.545708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c9436-83de-40fa-8709-1425faf9ad93 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:00.547143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ac0c9436-83de-40fa-8709-1425faf9ad93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:00.571872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c9436-83de-40fa-8709-1425faf9ad93 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:00.577499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812d9a3-6179-4212-98a1-98457474b686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:00.579359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812d9a3-6179-4212-98a1-98457474b686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:00.584439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812d9a3-6179-4212-98a1-98457474b686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:00.584439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812d9a3-6179-4212-98a1-98457474b686 admin admin] PATH_INFO: `/v3/users/8321c3bb9925499d8631ae79f3a07db4` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:00.584439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812d9a3-6179-4212-98a1-98457474b686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8321c3bb9925499d8631ae79f3a07db4)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:00.603982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812d9a3-6179-4212-98a1-98457474b686 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:00.662358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f423e82e-1043-4f12-bc59-a9c4a31f51eb None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:00.665174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252c2f4-04d7-4627-b04f-b918fcb39de5 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7c410f77548568fee8a09ede1644d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '630ccbb83cd84caeb2b2d48956f58b60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:00.665992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252c2f4-04d7-4627-b04f-b918fcb39de5 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:00.666427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252c2f4-04d7-4627-b04f-b918fcb39de5 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:00.666602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252c2f4-04d7-4627-b04f-b918fcb39de5 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:00.667345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252c2f4-04d7-4627-b04f-b918fcb39de5 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:00.669064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d252c2f4-04d7-4627-b04f-b918fcb39de5 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:00.810643 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3422/6777] 10.222.0.43 () {60 vars in 1184 bytes} [Tue Jul 19 14:42:00 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:00.811553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252c2f4-04d7-4627-b04f-b918fcb39de5 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:00.822525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d252c2f4-04d7-4627-b04f-b918fcb39de5 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:00.845776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d252c2f4-04d7-4627-b04f-b918fcb39de5 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:00.858346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84de14-22ec-4ea0-86f3-e189c8408cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:00.859046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84de14-22ec-4ea0-86f3-e189c8408cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:00.859334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84de14-22ec-4ea0-86f3-e189c8408cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:00.859622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84de14-22ec-4ea0-86f3-e189c8408cf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:00.860371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84de14-22ec-4ea0-86f3-e189c8408cf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:42:00.860684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84de14-22ec-4ea0-86f3-e189c8408cf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:00.863039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84de14-22ec-4ea0-86f3-e189c8408cf7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:00.901795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4812d9a3-6179-4212-98a1-98457474b686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8321c3bb9925499d8631ae79f3a07db4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:00.909974 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3423/6778] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:42:00.911818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff2b9a-0718-47f0-92a7-488639cd84a8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:00.912308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff2b9a-0718-47f0-92a7-488639cd84a8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:00.912818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bff2b9a-0718-47f0-92a7-488639cd84a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:00.921242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4812d9a3-6179-4212-98a1-98457474b686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8321c3bb9925499d8631ae79f3a07db4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:00.922026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4812d9a3-6179-4212-98a1-98457474b686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8321c3bb9925499d8631ae79f3a07db4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:00.922702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4812d9a3-6179-4212-98a1-98457474b686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8321c3bb9925499d8631ae79f3a07db4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:00.932143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4812d9a3-6179-4212-98a1-98457474b686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8321c3bb9925499d8631ae79f3a07db4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:00.943792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6bff2b9a-0718-47f0-92a7-488639cd84a8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:00.944678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6bff2b9a-0718-47f0-92a7-488639cd84a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:00.957245 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3424/6779] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:00.957831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff2b9a-0718-47f0-92a7-488639cd84a8 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:00.959245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6bff2b9a-0718-47f0-92a7-488639cd84a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:00.995934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bff2b9a-0718-47f0-92a7-488639cd84a8 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:01.001795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28b8e8-c3cf-4026-93d9-ee1e9236e571 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7c410f77548568fee8a09ede1644d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '630ccbb83cd84caeb2b2d48956f58b60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:01.003621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28b8e8-c3cf-4026-93d9-ee1e9236e571 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:01.003988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28b8e8-c3cf-4026-93d9-ee1e9236e571 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:01.004280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28b8e8-c3cf-4026-93d9-ee1e9236e571 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2d9c019b1f084093bda9ac1ee3bb67d2` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:01.005033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28b8e8-c3cf-4026-93d9-ee1e9236e571 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=2d9c019b1f084093bda9ac1ee3bb67d2)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:01.006304 n-d-master-1 devstack@keystone.service[80680]: WARNING py.warnings [None req-6e28b8e8-c3cf-4026-93d9-ee1e9236e571 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:42:01.006304 n-d-master-1 devstack@keystone.service[80680]: warnings.warn(msg) Jul 19 14:42:01.006304 n-d-master-1 devstack@keystone.service[80680]: Jul 19 14:42:01.007186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e28b8e8-c3cf-4026-93d9-ee1e9236e571 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:01.050279 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3356/6780] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:00 2022] DELETE /identity/v3/users/8321c3bb9925499d8631ae79f3a07db4 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:01.050994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812d9a3-6179-4212-98a1-98457474b686 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:01.053585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4812d9a3-6179-4212-98a1-98457474b686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:01.116688 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3425/6781] 10.222.0.43 () {60 vars in 1284 bytes} [Tue Jul 19 14:42:00 2022] PATCH /identity/v3/OS-OAUTH1/consumers/2d9c019b1f084093bda9ac1ee3bb67d2 => generated 220 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:42:01.116688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e2807-7a5e-4f43-9b16-60cfcd9396da None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:01.116688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e2807-7a5e-4f43-9b16-60cfcd9396da None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:01.116688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e2807-7a5e-4f43-9b16-60cfcd9396da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:01.181296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-391e2807-7a5e-4f43-9b16-60cfcd9396da None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:01.188352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-391e2807-7a5e-4f43-9b16-60cfcd9396da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:01.251883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812d9a3-6179-4212-98a1-98457474b686 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:01.261281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512ca9c9-ac9d-4d3c-be62-f15eceaac2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:01.264707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ca9c9-ac9d-4d3c-be62-f15eceaac2bb admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:01.264707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ca9c9-ac9d-4d3c-be62-f15eceaac2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:01.264707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512ca9c9-ac9d-4d3c-be62-f15eceaac2bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:01.264707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ca9c9-ac9d-4d3c-be62-f15eceaac2bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:01.266793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512ca9c9-ac9d-4d3c-be62-f15eceaac2bb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:01.324690 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3426/6782] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:01.325931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e2807-7a5e-4f43-9b16-60cfcd9396da None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:01.327517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-391e2807-7a5e-4f43-9b16-60cfcd9396da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:01.413102 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3357/6783] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:01 2022] POST /identity/v3/projects => generated 387 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:01.414918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60f51f-398a-427b-9dfb-f1c43d542a02 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:01.416676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60f51f-398a-427b-9dfb-f1c43d542a02 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:01.443262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc60f51f-398a-427b-9dfb-f1c43d542a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:01.484763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e2807-7a5e-4f43-9b16-60cfcd9396da None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:01.518747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-bc60f51f-398a-427b-9dfb-f1c43d542a02 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:01.524150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bc60f51f-398a-427b-9dfb-f1c43d542a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:01.614791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd692622-03f6-40b1-adb6-bf6ba7b8cf1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:01.616138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd692622-03f6-40b1-adb6-bf6ba7b8cf1f service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:01.616704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd692622-03f6-40b1-adb6-bf6ba7b8cf1f service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:01.617100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd692622-03f6-40b1-adb6-bf6ba7b8cf1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:01.619967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bd692622-03f6-40b1-adb6-bf6ba7b8cf1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:01.640913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd692622-03f6-40b1-adb6-bf6ba7b8cf1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:01.641942 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3358/6784] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:01.645175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd692622-03f6-40b1-adb6-bf6ba7b8cf1f service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:01.651483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60f51f-398a-427b-9dfb-f1c43d542a02 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:01.660145 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3427/6785] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:01.661494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd692622-03f6-40b1-adb6-bf6ba7b8cf1f service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:01.663473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bd692622-03f6-40b1-adb6-bf6ba7b8cf1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:01.708965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd692622-03f6-40b1-adb6-bf6ba7b8cf1f service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:01.720079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e2b72-b4e3-4f4f-b508-42f246e253f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:01.723472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e2b72-b4e3-4f4f-b508-42f246e253f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:01.723472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e2b72-b4e3-4f4f-b508-42f246e253f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:01.723472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e2b72-b4e3-4f4f-b508-42f246e253f7 admin admin] PATH_INFO: `/v3/users/78dc610e046f477497e7766be18824b8` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:01.726009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e2b72-b4e3-4f4f-b508-42f246e253f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78dc610e046f477497e7766be18824b8)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:01.732038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6e2b72-b4e3-4f4f-b508-42f246e253f7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:01.806783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc60f51f-398a-427b-9dfb-f1c43d542a02 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:01.822873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c485f3-35c9-41f5-a9fb-ed8576457c6e tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7c410f77548568fee8a09ede1644d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '630ccbb83cd84caeb2b2d48956f58b60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:01.823944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c485f3-35c9-41f5-a9fb-ed8576457c6e tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:01.824238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c485f3-35c9-41f5-a9fb-ed8576457c6e tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:01.826427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c485f3-35c9-41f5-a9fb-ed8576457c6e tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2d9c019b1f084093bda9ac1ee3bb67d2` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:01.827284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c485f3-35c9-41f5-a9fb-ed8576457c6e tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=2d9c019b1f084093bda9ac1ee3bb67d2)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:01.829061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c485f3-35c9-41f5-a9fb-ed8576457c6e tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:01.846987 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3359/6786] 10.222.0.43 () {58 vars in 1262 bytes} [Tue Jul 19 14:42:01 2022] GET /identity/v3/OS-OAUTH1/consumers/2d9c019b1f084093bda9ac1ee3bb67d2 => generated 220 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:42:01.847310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c485f3-35c9-41f5-a9fb-ed8576457c6e tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:01.872982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c485f3-35c9-41f5-a9fb-ed8576457c6e tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:01.881219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6a95f-62d0-4614-8e98-53252b22aed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:01.882034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6a95f-62d0-4614-8e98-53252b22aed8 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:01.888051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6a95f-62d0-4614-8e98-53252b22aed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:01.888051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6a95f-62d0-4614-8e98-53252b22aed8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:01.888051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6a95f-62d0-4614-8e98-53252b22aed8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:42:01.888051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6a95f-62d0-4614-8e98-53252b22aed8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:01.888051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6a95f-62d0-4614-8e98-53252b22aed8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:01.916738 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3360/6787] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:42:01.917994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6a95f-62d0-4614-8e98-53252b22aed8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:01.930741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6a95f-62d0-4614-8e98-53252b22aed8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:01.937728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a90b5-9fe4-49e8-a6a6-c6097907acb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:01.938966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a90b5-9fe4-49e8-a6a6-c6097907acb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:01.939985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a90b5-9fe4-49e8-a6a6-c6097907acb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:01.940472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a90b5-9fe4-49e8-a6a6-c6097907acb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:01.941505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a90b5-9fe4-49e8-a6a6-c6097907acb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:01.947701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a90b5-9fe4-49e8-a6a6-c6097907acb8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:02.016907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4c6e2b72-b4e3-4f4f-b508-42f246e253f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78dc610e046f477497e7766be18824b8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:02.032382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4c6e2b72-b4e3-4f4f-b508-42f246e253f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78dc610e046f477497e7766be18824b8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:02.043195 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3361/6788] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:01 2022] POST /identity/v3/users => generated 300 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:02.045252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a90b5-9fe4-49e8-a6a6-c6097907acb8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:02.045408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4c6e2b72-b4e3-4f4f-b508-42f246e253f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78dc610e046f477497e7766be18824b8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:02.046188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4c6e2b72-b4e3-4f4f-b508-42f246e253f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78dc610e046f477497e7766be18824b8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:02.047450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-056a90b5-9fe4-49e8-a6a6-c6097907acb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:02.134662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4c6e2b72-b4e3-4f4f-b508-42f246e253f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78dc610e046f477497e7766be18824b8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:02.140656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a90b5-9fe4-49e8-a6a6-c6097907acb8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:02.145591 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3428/6789] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:01 2022] DELETE /identity/v3/users/78dc610e046f477497e7766be18824b8 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:02.145591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e2b72-b4e3-4f4f-b508-42f246e253f7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:02.146770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4c6e2b72-b4e3-4f4f-b508-42f246e253f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:02.213535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4c17a-2a6a-43a4-a9f1-74711f88d96f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:02.214314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4c17a-2a6a-43a4-a9f1-74711f88d96f service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:02.214747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4c17a-2a6a-43a4-a9f1-74711f88d96f service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:02.215092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4c17a-2a6a-43a4-a9f1-74711f88d96f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:02.218067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c7c4c17a-2a6a-43a4-a9f1-74711f88d96f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:02.269429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e2b72-b4e3-4f4f-b508-42f246e253f7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:02.272682 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:02.276301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e21e2-e9ef-46bf-9b8a-9a27074402f8 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0dc7c410f77548568fee8a09ede1644d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '630ccbb83cd84caeb2b2d48956f58b60', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:02.277791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e21e2-e9ef-46bf-9b8a-9a27074402f8 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:02.278165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e21e2-e9ef-46bf-9b8a-9a27074402f8 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:02.278821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e21e2-e9ef-46bf-9b8a-9a27074402f8 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/2d9c019b1f084093bda9ac1ee3bb67d2` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:02.279608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e21e2-e9ef-46bf-9b8a-9a27074402f8 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=2d9c019b1f084093bda9ac1ee3bb67d2)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:02.281303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e21e2-e9ef-46bf-9b8a-9a27074402f8 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:02.281582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d09e21e2-e9ef-46bf-9b8a-9a27074402f8 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invalidating token cache because consumer 2d9c019b1f084093bda9ac1ee3bb67d2 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:02.281871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d09e21e2-e9ef-46bf-9b8a-9a27074402f8 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:02.282965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d09e21e2-e9ef-46bf-9b8a-9a27074402f8 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:02.307113 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:02.309942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4c17a-2a6a-43a4-a9f1-74711f88d96f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:02.310924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4c17a-2a6a-43a4-a9f1-74711f88d96f service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:02.322144 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3362/6790] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:02.327394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4c17a-2a6a-43a4-a9f1-74711f88d96f service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:02.330900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c7c4c17a-2a6a-43a4-a9f1-74711f88d96f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:02.347709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4c17a-2a6a-43a4-a9f1-74711f88d96f service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:02.353738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70754324-ddc4-4747-a936-840e990e735f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:02.354872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70754324-ddc4-4747-a936-840e990e735f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:02.355316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70754324-ddc4-4747-a936-840e990e735f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:02.355794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70754324-ddc4-4747-a936-840e990e735f admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:02.356704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70754324-ddc4-4747-a936-840e990e735f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:02.359527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70754324-ddc4-4747-a936-840e990e735f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:02.362808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d09e21e2-e9ef-46bf-9b8a-9a27074402f8 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '2d9c019b1f084093bda9ac1ee3bb67d2', 'request_id': 'req-d09e21e2-e9ef-46bf-9b8a-9a27074402f8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:02.460921 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3429/6791] 10.222.0.43 () {58 vars in 1265 bytes} [Tue Jul 19 14:42:02 2022] DELETE /identity/v3/OS-OAUTH1/consumers/2d9c019b1f084093bda9ac1ee3bb67d2 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:02.462431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e21e2-e9ef-46bf-9b8a-9a27074402f8 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:02.464576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d09e21e2-e9ef-46bf-9b8a-9a27074402f8 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:02.488369 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3363/6792] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:02 2022] POST /identity/v3/projects => generated 387 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:02.489620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f9d1a-6347-4857-b251-81896213c74c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:02.490166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f9d1a-6347-4857-b251-81896213c74c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:02.490281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f9d1a-6347-4857-b251-81896213c74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:02.491730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e21e2-e9ef-46bf-9b8a-9a27074402f8 tempest-OAUTHConsumersV3Test-737900616 tempest-OAUTHConsumersV3Test-737900616-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:02.511980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-561f9d1a-6347-4857-b251-81896213c74c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:02.513286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-561f9d1a-6347-4857-b251-81896213c74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:02.584578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde5dc9-4fd8-45b4-93d0-e2cdf50b88ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:02.585367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde5dc9-4fd8-45b4-93d0-e2cdf50b88ad admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:02.585723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde5dc9-4fd8-45b4-93d0-e2cdf50b88ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:02.587344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde5dc9-4fd8-45b4-93d0-e2cdf50b88ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:02.589120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde5dc9-4fd8-45b4-93d0-e2cdf50b88ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:02.592623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde5dc9-4fd8-45b4-93d0-e2cdf50b88ad admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:02.615644 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3364/6793] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:02.616725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f9d1a-6347-4857-b251-81896213c74c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:02.620667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-561f9d1a-6347-4857-b251-81896213c74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:02.642028 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3430/6794] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:02.642028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde5dc9-4fd8-45b4-93d0-e2cdf50b88ad admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:02.642028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cbde5dc9-4fd8-45b4-93d0-e2cdf50b88ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:02.644243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f9d1a-6347-4857-b251-81896213c74c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:02.650295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde5dc9-4fd8-45b4-93d0-e2cdf50b88ad admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:02.655006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f9c27-70fd-4d4e-83ba-6534a09a4e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:02.655570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f05ee-f1a6-42d5-878d-953b86acca62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:02.656801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f05ee-f1a6-42d5-878d-953b86acca62 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:02.657103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f05ee-f1a6-42d5-878d-953b86acca62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:02.657390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f05ee-f1a6-42d5-878d-953b86acca62 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:02.658085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f9c27-70fd-4d4e-83ba-6534a09a4e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:02.659320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f05ee-f1a6-42d5-878d-953b86acca62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:02.660285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f9c27-70fd-4d4e-83ba-6534a09a4e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:02.661335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f9c27-70fd-4d4e-83ba-6534a09a4e81 admin admin] PATH_INFO: `/v3/users/fd38c2fa0a5549d482f18026fde4f617` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:02.661572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92f05ee-f1a6-42d5-878d-953b86acca62 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:02.664651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f9c27-70fd-4d4e-83ba-6534a09a4e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd38c2fa0a5549d482f18026fde4f617)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:02.669416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f9c27-70fd-4d4e-83ba-6534a09a4e81 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:02.773101 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3431/6795] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:02 2022] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:02.774678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f05ee-f1a6-42d5-878d-953b86acca62 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:02.777910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a92f05ee-f1a6-42d5-878d-953b86acca62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:02.862774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f05ee-f1a6-42d5-878d-953b86acca62 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:02.866543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9c246-4057-4807-a07d-87219c154efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:02.867300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9c246-4057-4807-a07d-87219c154efd service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:02.867611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9c246-4057-4807-a07d-87219c154efd service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:02.867896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9c246-4057-4807-a07d-87219c154efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:02.879693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9c246-4057-4807-a07d-87219c154efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:02.881323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a9c246-4057-4807-a07d-87219c154efd service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:02.892202 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3432/6796] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:02.893865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9c246-4057-4807-a07d-87219c154efd service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:02.931983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9c246-4057-4807-a07d-87219c154efd service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:02.947222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ffcc6-8460-4baf-8760-2284574beef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:02.948797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ffcc6-8460-4baf-8760-2284574beef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:02.949088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ffcc6-8460-4baf-8760-2284574beef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:02.949375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ffcc6-8460-4baf-8760-2284574beef8 admin admin] PATH_INFO: `/v3/projects/9a763ed3d0b246c8833082822867f88e/users/0684287990654b8a9e08d2fa4c4eb08d/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:02.952402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-da5f9c27-70fd-4d4e-83ba-6534a09a4e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd38c2fa0a5549d482f18026fde4f617'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:02.985240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ffcc6-8460-4baf-8760-2284574beef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a763ed3d0b246c8833082822867f88e, user_id=0684287990654b8a9e08d2fa4c4eb08d, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:02.988869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ffcc6-8460-4baf-8760-2284574beef8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:02.994402 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:03.035311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-da5f9c27-70fd-4d4e-83ba-6534a09a4e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd38c2fa0a5549d482f18026fde4f617'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:03.041065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-da5f9c27-70fd-4d4e-83ba-6534a09a4e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd38c2fa0a5549d482f18026fde4f617'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:03.045215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-da5f9c27-70fd-4d4e-83ba-6534a09a4e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd38c2fa0a5549d482f18026fde4f617'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:03.057001 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:03.061013 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3433/6797] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:02 2022] PUT /identity/v3/projects/9a763ed3d0b246c8833082822867f88e/users/0684287990654b8a9e08d2fa4c4eb08d/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:03.061590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ffcc6-8460-4baf-8760-2284574beef8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:03.069123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-da5f9c27-70fd-4d4e-83ba-6534a09a4e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd38c2fa0a5549d482f18026fde4f617'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:03.071716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-826ffcc6-8460-4baf-8760-2284574beef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:03.141080 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3365/6798] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:02 2022] DELETE /identity/v3/users/fd38c2fa0a5549d482f18026fde4f617 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:03.143035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f9c27-70fd-4d4e-83ba-6534a09a4e81 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:03.146233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-da5f9c27-70fd-4d4e-83ba-6534a09a4e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:03.201524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ffcc6-8460-4baf-8760-2284574beef8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:03.256233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f9c27-70fd-4d4e-83ba-6534a09a4e81 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:03.262221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f084b16-dab9-4131-88ac-e30827c8cd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:03.263243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f084b16-dab9-4131-88ac-e30827c8cd26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:03.263632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f084b16-dab9-4131-88ac-e30827c8cd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:03.264090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f084b16-dab9-4131-88ac-e30827c8cd26 admin admin] PATH_INFO: `/v3/projects/195f85363ef84d4db5f8250e663c9f9f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:03.265487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f084b16-dab9-4131-88ac-e30827c8cd26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=195f85363ef84d4db5f8250e663c9f9f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:03.268701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f084b16-dab9-4131-88ac-e30827c8cd26 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:03.288832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d4331-30da-408a-9fca-694250286c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:03.289834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d4331-30da-408a-9fca-694250286c78 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:03.290192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d4331-30da-408a-9fca-694250286c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:03.290488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d4331-30da-408a-9fca-694250286c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:03.291409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d4331-30da-408a-9fca-694250286c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:03.294543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d4331-30da-408a-9fca-694250286c78 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:03.310438 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3434/6799] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:03.314353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d4331-30da-408a-9fca-694250286c78 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:03.316278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e84d4331-30da-408a-9fca-694250286c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:03.317293 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:03.333621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d4331-30da-408a-9fca-694250286c78 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:03.343503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f9c112-a44e-4edb-a068-2f9c12a62117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:03.343503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9c112-a44e-4edb-a068-2f9c12a62117 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:03.343503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9c112-a44e-4edb-a068-2f9c12a62117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:03.343503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f9c112-a44e-4edb-a068-2f9c12a62117 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:03.343847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9c112-a44e-4edb-a068-2f9c12a62117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:03.343847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f9c112-a44e-4edb-a068-2f9c12a62117 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:03.354845 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3435/6800] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:03.356134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d31787-ad63-47fe-9978-bdba2b022ee2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:03.356303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d31787-ad63-47fe-9978-bdba2b022ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:03.356593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d31787-ad63-47fe-9978-bdba2b022ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:03.384888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-09d31787-ad63-47fe-9978-bdba2b022ee2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:03.386172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-09d31787-ad63-47fe-9978-bdba2b022ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:03.394988 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3436/6801] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:03.399547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d31787-ad63-47fe-9978-bdba2b022ee2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:03.411242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d31787-ad63-47fe-9978-bdba2b022ee2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:03.416574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49dbe6e-01e2-476a-8adc-29ae9b40002c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:03.417269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49dbe6e-01e2-476a-8adc-29ae9b40002c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:03.417555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49dbe6e-01e2-476a-8adc-29ae9b40002c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:03.417836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49dbe6e-01e2-476a-8adc-29ae9b40002c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:03.418825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49dbe6e-01e2-476a-8adc-29ae9b40002c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:03.420464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49dbe6e-01e2-476a-8adc-29ae9b40002c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:03.447735 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:03.448288 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3437/6802] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:03.449212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6f084b16-dab9-4131-88ac-e30827c8cd26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '195f85363ef84d4db5f8250e663c9f9f', 'request_id': 'req-6f084b16-dab9-4131-88ac-e30827c8cd26'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:03.449744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49dbe6e-01e2-476a-8adc-29ae9b40002c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:03.452117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f49dbe6e-01e2-476a-8adc-29ae9b40002c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:03.468075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49dbe6e-01e2-476a-8adc-29ae9b40002c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:03.528836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e819e-7dc1-4a4d-b2be-1faebffc3c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:03.529790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e819e-7dc1-4a4d-b2be-1faebffc3c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:03.530073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e819e-7dc1-4a4d-b2be-1faebffc3c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:03.530403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6e819e-7dc1-4a4d-b2be-1faebffc3c8c admin admin] PATH_INFO: `/v3/projects/a482bce8739b484b87aca0ab20b84c68` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:03.531642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e819e-7dc1-4a4d-b2be-1faebffc3c8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a482bce8739b484b87aca0ab20b84c68)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:03.534375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6e819e-7dc1-4a4d-b2be-1faebffc3c8c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:03.555675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6f084b16-dab9-4131-88ac-e30827c8cd26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '195f85363ef84d4db5f8250e663c9f9f', 'request_id': 'req-6f084b16-dab9-4131-88ac-e30827c8cd26'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:03.563271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6f084b16-dab9-4131-88ac-e30827c8cd26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '195f85363ef84d4db5f8250e663c9f9f', 'request_id': 'req-6f084b16-dab9-4131-88ac-e30827c8cd26'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:03.575848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6f084b16-dab9-4131-88ac-e30827c8cd26 admin admin] The token cache is being invalidate because project 195f85363ef84d4db5f8250e663c9f9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:03.576205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6f084b16-dab9-4131-88ac-e30827c8cd26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:03.576971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6f084b16-dab9-4131-88ac-e30827c8cd26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:03.578651 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3366/6803] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:03 2022] DELETE /identity/v3/projects/195f85363ef84d4db5f8250e663c9f9f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:03.579419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f084b16-dab9-4131-88ac-e30827c8cd26 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:03.581825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6f084b16-dab9-4131-88ac-e30827c8cd26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:03.596573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f084b16-dab9-4131-88ac-e30827c8cd26 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:03.601658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab65b89-a538-4ad7-8129-83458425579b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:03.602606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab65b89-a538-4ad7-8129-83458425579b admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:03.602895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab65b89-a538-4ad7-8129-83458425579b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:03.603176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab65b89-a538-4ad7-8129-83458425579b admin admin] PATH_INFO: `/v3/projects/9a763ed3d0b246c8833082822867f88e/users/0684287990654b8a9e08d2fa4c4eb08d/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:03.605243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab65b89-a538-4ad7-8129-83458425579b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a763ed3d0b246c8833082822867f88e, user_id=0684287990654b8a9e08d2fa4c4eb08d, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:03.608041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab65b89-a538-4ad7-8129-83458425579b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:03.620159 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3367/6804] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:03 2022] PUT /identity/v3/projects/9a763ed3d0b246c8833082822867f88e/users/0684287990654b8a9e08d2fa4c4eb08d/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:03.620939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab65b89-a538-4ad7-8129-83458425579b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:03.622550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3ab65b89-a538-4ad7-8129-83458425579b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:03.661794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ea6e819e-7dc1-4a4d-b2be-1faebffc3c8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a482bce8739b484b87aca0ab20b84c68', 'request_id': 'req-ea6e819e-7dc1-4a4d-b2be-1faebffc3c8c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:03.670172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ea6e819e-7dc1-4a4d-b2be-1faebffc3c8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a482bce8739b484b87aca0ab20b84c68', 'request_id': 'req-ea6e819e-7dc1-4a4d-b2be-1faebffc3c8c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:03.677207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ea6e819e-7dc1-4a4d-b2be-1faebffc3c8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a482bce8739b484b87aca0ab20b84c68', 'request_id': 'req-ea6e819e-7dc1-4a4d-b2be-1faebffc3c8c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:03.696024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab65b89-a538-4ad7-8129-83458425579b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:03.754394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc977a7-b7c0-4081-9921-92ffea208c88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:03.755318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc977a7-b7c0-4081-9921-92ffea208c88 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:03.755610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc977a7-b7c0-4081-9921-92ffea208c88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:03.756173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc977a7-b7c0-4081-9921-92ffea208c88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:03.758507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0fc977a7-b7c0-4081-9921-92ffea208c88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:03.765706 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:03.771760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ea6e819e-7dc1-4a4d-b2be-1faebffc3c8c admin admin] The token cache is being invalidate because project a482bce8739b484b87aca0ab20b84c68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:03.772256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ea6e819e-7dc1-4a4d-b2be-1faebffc3c8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:03.773465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ea6e819e-7dc1-4a4d-b2be-1faebffc3c8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:03.779369 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3438/6805] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:03 2022] DELETE /identity/v3/projects/a482bce8739b484b87aca0ab20b84c68 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:03.779369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e819e-7dc1-4a4d-b2be-1faebffc3c8c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:03.779369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ea6e819e-7dc1-4a4d-b2be-1faebffc3c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:03.833305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc977a7-b7c0-4081-9921-92ffea208c88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:03.834890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc977a7-b7c0-4081-9921-92ffea208c88 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:03.847595 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3368/6806] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:03.848600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc977a7-b7c0-4081-9921-92ffea208c88 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:03.850333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0fc977a7-b7c0-4081-9921-92ffea208c88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:03.866184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc977a7-b7c0-4081-9921-92ffea208c88 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:03.871479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af623423-1fb1-4398-a896-92d6995c17e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:03.872648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af623423-1fb1-4398-a896-92d6995c17e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:03.873013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af623423-1fb1-4398-a896-92d6995c17e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:03.873396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af623423-1fb1-4398-a896-92d6995c17e5 admin admin] PATH_INFO: `/v3/users/9399eb26d4c74e1897ed3c61b7b73b3d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:03.875352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af623423-1fb1-4398-a896-92d6995c17e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9399eb26d4c74e1897ed3c61b7b73b3d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:03.879906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af623423-1fb1-4398-a896-92d6995c17e5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:03.898932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6e819e-7dc1-4a4d-b2be-1faebffc3c8c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:03.911788 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:03.914467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09185aae-e8a6-485e-8d90-ee3795230a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:03.919231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09185aae-e8a6-485e-8d90-ee3795230a4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:03.919231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09185aae-e8a6-485e-8d90-ee3795230a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:03.919231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09185aae-e8a6-485e-8d90-ee3795230a4d admin admin] PATH_INFO: `/v3/projects/671c22153837483681efca4f51628610/users/30ff710e1cb7493eabc5dbd840ed3078/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:03.941739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09185aae-e8a6-485e-8d90-ee3795230a4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=671c22153837483681efca4f51628610, user_id=30ff710e1cb7493eabc5dbd840ed3078, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:03.946417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09185aae-e8a6-485e-8d90-ee3795230a4d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:04.028228 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3439/6807] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:03 2022] PUT /identity/v3/projects/671c22153837483681efca4f51628610/users/30ff710e1cb7493eabc5dbd840ed3078/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:04.029995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24f5b9-1444-4a3c-a8dd-6ad3cc27fd89 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:04.030455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24f5b9-1444-4a3c-a8dd-6ad3cc27fd89 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:04.030885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24f5b9-1444-4a3c-a8dd-6ad3cc27fd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:04.133934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-af623423-1fb1-4398-a896-92d6995c17e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9399eb26d4c74e1897ed3c61b7b73b3d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:04.151561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7c24f5b9-1444-4a3c-a8dd-6ad3cc27fd89 None None] MFA Rules not processed for user `0684287990654b8a9e08d2fa4c4eb08d`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:04.155042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7c24f5b9-1444-4a3c-a8dd-6ad3cc27fd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:04.169142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-af623423-1fb1-4398-a896-92d6995c17e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9399eb26d4c74e1897ed3c61b7b73b3d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:04.169142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-af623423-1fb1-4398-a896-92d6995c17e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9399eb26d4c74e1897ed3c61b7b73b3d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:04.169142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-af623423-1fb1-4398-a896-92d6995c17e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9399eb26d4c74e1897ed3c61b7b73b3d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:04.179217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-af623423-1fb1-4398-a896-92d6995c17e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9399eb26d4c74e1897ed3c61b7b73b3d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:04.255865 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3369/6808] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:03 2022] DELETE /identity/v3/users/9399eb26d4c74e1897ed3c61b7b73b3d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:04.260822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93415b5-9b1e-4162-8ac5-2e46dfe59d7f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:04.260822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93415b5-9b1e-4162-8ac5-2e46dfe59d7f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:04.260822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93415b5-9b1e-4162-8ac5-2e46dfe59d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:04.284406 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:04.293488 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3440/6809] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:04.295292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a15b0b-64bc-4fa2-94fe-ed583cb687f9 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:04.295747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a15b0b-64bc-4fa2-94fe-ed583cb687f9 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:04.296198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a15b0b-64bc-4fa2-94fe-ed583cb687f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:04.300879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c93415b5-9b1e-4162-8ac5-2e46dfe59d7f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:04.302214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c93415b5-9b1e-4162-8ac5-2e46dfe59d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:04.357117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-80a15b0b-64bc-4fa2-94fe-ed583cb687f9 None None] MFA Rules not processed for user `30ff710e1cb7493eabc5dbd840ed3078`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:04.358525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-80a15b0b-64bc-4fa2-94fe-ed583cb687f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:04.444804 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3441/6810] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:04.445717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a15b0b-64bc-4fa2-94fe-ed583cb687f9 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:04.447335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-80a15b0b-64bc-4fa2-94fe-ed583cb687f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:04.476156 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3370/6811] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:04.477191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93415b5-9b1e-4162-8ac5-2e46dfe59d7f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:04.482502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c93415b5-9b1e-4162-8ac5-2e46dfe59d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:04.502870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93415b5-9b1e-4162-8ac5-2e46dfe59d7f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:04.511076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca81aa4-ef92-4d6c-b018-30978ceddc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:04.513150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca81aa4-ef92-4d6c-b018-30978ceddc2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:04.513873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca81aa4-ef92-4d6c-b018-30978ceddc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:04.514500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca81aa4-ef92-4d6c-b018-30978ceddc2a admin admin] PATH_INFO: `/v3/users/a66d2235fd20498aacaebac9ce53db27` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:04.517284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca81aa4-ef92-4d6c-b018-30978ceddc2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a66d2235fd20498aacaebac9ce53db27)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:04.519999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca81aa4-ef92-4d6c-b018-30978ceddc2a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:04.570394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a15b0b-64bc-4fa2-94fe-ed583cb687f9 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:04.575985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf67367-0df2-4d78-9f87-269496274201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:04.576950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf67367-0df2-4d78-9f87-269496274201 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:04.577422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf67367-0df2-4d78-9f87-269496274201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:04.577821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf67367-0df2-4d78-9f87-269496274201 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:04.578859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf67367-0df2-4d78-9f87-269496274201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:04.582001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf67367-0df2-4d78-9f87-269496274201 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:04.693417 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:04.753663 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3442/6812] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:04 2022] POST /identity/v3/projects => generated 387 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:04.753663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf67367-0df2-4d78-9f87-269496274201 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:04.757855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fca81aa4-ef92-4d6c-b018-30978ceddc2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a66d2235fd20498aacaebac9ce53db27'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:04.764033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6cf67367-0df2-4d78-9f87-269496274201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:04.773367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fca81aa4-ef92-4d6c-b018-30978ceddc2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a66d2235fd20498aacaebac9ce53db27'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:04.773884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fca81aa4-ef92-4d6c-b018-30978ceddc2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a66d2235fd20498aacaebac9ce53db27'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:04.774590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fca81aa4-ef92-4d6c-b018-30978ceddc2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a66d2235fd20498aacaebac9ce53db27'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:04.781966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fca81aa4-ef92-4d6c-b018-30978ceddc2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a66d2235fd20498aacaebac9ce53db27'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:04.852590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf67367-0df2-4d78-9f87-269496274201 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:04.856490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2645b7d-843a-441d-94df-d40648d1e7e1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:04.857666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2645b7d-843a-441d-94df-d40648d1e7e1 service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:04.858004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2645b7d-843a-441d-94df-d40648d1e7e1 service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:04.858314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2645b7d-843a-441d-94df-d40648d1e7e1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:04.867231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f2645b7d-843a-441d-94df-d40648d1e7e1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:04.904570 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3371/6813] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:04 2022] DELETE /identity/v3/users/a66d2235fd20498aacaebac9ce53db27 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:04.906508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507521c-e5f5-4d34-8caf-49e97a1f7211 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:04.907076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507521c-e5f5-4d34-8caf-49e97a1f7211 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:04.907827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507521c-e5f5-4d34-8caf-49e97a1f7211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:04.938814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2645b7d-843a-441d-94df-d40648d1e7e1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:04.940811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4507521c-e5f5-4d34-8caf-49e97a1f7211 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:04.941240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2645b7d-843a-441d-94df-d40648d1e7e1 service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:04.942914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4507521c-e5f5-4d34-8caf-49e97a1f7211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:04.951844 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3443/6814] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:04.952787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2645b7d-843a-441d-94df-d40648d1e7e1 service glance] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:04.954130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f2645b7d-843a-441d-94df-d40648d1e7e1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:05.057828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2645b7d-843a-441d-94df-d40648d1e7e1 service glance] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:05.079693 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3372/6815] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:05.081921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507521c-e5f5-4d34-8caf-49e97a1f7211 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:05.084407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4507521c-e5f5-4d34-8caf-49e97a1f7211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:05.108003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507521c-e5f5-4d34-8caf-49e97a1f7211 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:05.118567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4191cc2-05bb-43df-bb21-b86a4a727fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:05.120943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4191cc2-05bb-43df-bb21-b86a4a727fde admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:05.121486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4191cc2-05bb-43df-bb21-b86a4a727fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:05.121603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4191cc2-05bb-43df-bb21-b86a4a727fde admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:05.122340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4191cc2-05bb-43df-bb21-b86a4a727fde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:05.127835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4191cc2-05bb-43df-bb21-b86a4a727fde admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:05.156455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49892e5f-4a83-4e49-8a66-43ed69e44744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:05.157322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49892e5f-4a83-4e49-8a66-43ed69e44744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:05.157833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49892e5f-4a83-4e49-8a66-43ed69e44744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:05.158369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49892e5f-4a83-4e49-8a66-43ed69e44744 admin admin] PATH_INFO: `/v3/projects/1facbaea79e14edf93245001b16bc17f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:05.160412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49892e5f-4a83-4e49-8a66-43ed69e44744 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1facbaea79e14edf93245001b16bc17f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:05.162889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49892e5f-4a83-4e49-8a66-43ed69e44744 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:05.239171 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3373/6816] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:05 2022] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:05.241017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396b92a-b9d8-4d89-80da-15c7be637a34 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:05.241450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396b92a-b9d8-4d89-80da-15c7be637a34 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:05.241954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396b92a-b9d8-4d89-80da-15c7be637a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:05.262081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1396b92a-b9d8-4d89-80da-15c7be637a34 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:05.263348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1396b92a-b9d8-4d89-80da-15c7be637a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:05.272436 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3374/6817] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:05.273465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396b92a-b9d8-4d89-80da-15c7be637a34 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:05.283138 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:05.296229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1396b92a-b9d8-4d89-80da-15c7be637a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:05.318373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-49892e5f-4a83-4e49-8a66-43ed69e44744 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1facbaea79e14edf93245001b16bc17f', 'request_id': 'req-49892e5f-4a83-4e49-8a66-43ed69e44744'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:05.320588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396b92a-b9d8-4d89-80da-15c7be637a34 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:05.325064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-49892e5f-4a83-4e49-8a66-43ed69e44744 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1facbaea79e14edf93245001b16bc17f', 'request_id': 'req-49892e5f-4a83-4e49-8a66-43ed69e44744'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:05.328913 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:05.334377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-49892e5f-4a83-4e49-8a66-43ed69e44744 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1facbaea79e14edf93245001b16bc17f', 'request_id': 'req-49892e5f-4a83-4e49-8a66-43ed69e44744'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:05.389426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d204e5e-5e03-4bfc-afdf-3a4bafea9366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:05.390582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d204e5e-5e03-4bfc-afdf-3a4bafea9366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:05.390969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d204e5e-5e03-4bfc-afdf-3a4bafea9366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:05.391352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d204e5e-5e03-4bfc-afdf-3a4bafea9366 admin admin] PATH_INFO: `/v3/projects/6c83fdbefaeb44e5a278c1e8301ccf5b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:05.392983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d204e5e-5e03-4bfc-afdf-3a4bafea9366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c83fdbefaeb44e5a278c1e8301ccf5b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:05.395502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d204e5e-5e03-4bfc-afdf-3a4bafea9366 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:05.409364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-49892e5f-4a83-4e49-8a66-43ed69e44744 admin admin] The token cache is being invalidate because project 1facbaea79e14edf93245001b16bc17f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:05.409988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-49892e5f-4a83-4e49-8a66-43ed69e44744 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:05.411042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-49892e5f-4a83-4e49-8a66-43ed69e44744 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:05.417184 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3444/6818] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:04 2022] DELETE /identity/v3/projects/1facbaea79e14edf93245001b16bc17f => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:05.418397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49892e5f-4a83-4e49-8a66-43ed69e44744 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:05.421287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-49892e5f-4a83-4e49-8a66-43ed69e44744 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:05.437093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49892e5f-4a83-4e49-8a66-43ed69e44744 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:05.443548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f42b23-5679-42cb-aa44-840d49c5edcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:05.444240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f42b23-5679-42cb-aa44-840d49c5edcd admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:05.444527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f42b23-5679-42cb-aa44-840d49c5edcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:05.444803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f42b23-5679-42cb-aa44-840d49c5edcd admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:05.445554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f42b23-5679-42cb-aa44-840d49c5edcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:42:05.445864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f42b23-5679-42cb-aa44-840d49c5edcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:05.447703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f42b23-5679-42cb-aa44-840d49c5edcd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:05.461090 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3445/6819] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:42:05.462071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f42b23-5679-42cb-aa44-840d49c5edcd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:05.466814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-09f42b23-5679-42cb-aa44-840d49c5edcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:05.481297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f42b23-5679-42cb-aa44-840d49c5edcd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:05.486245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca5df8-56a2-44ec-93db-6987520cce0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:05.487471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca5df8-56a2-44ec-93db-6987520cce0e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:05.489553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca5df8-56a2-44ec-93db-6987520cce0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:05.489553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ca5df8-56a2-44ec-93db-6987520cce0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:05.489553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca5df8-56a2-44ec-93db-6987520cce0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:05.490483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ca5df8-56a2-44ec-93db-6987520cce0e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:05.503183 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3446/6820] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:05.504184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca5df8-56a2-44ec-93db-6987520cce0e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:05.505891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-12ca5df8-56a2-44ec-93db-6987520cce0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:05.528578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4d204e5e-5e03-4bfc-afdf-3a4bafea9366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c83fdbefaeb44e5a278c1e8301ccf5b', 'request_id': 'req-4d204e5e-5e03-4bfc-afdf-3a4bafea9366'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:05.569565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ca5df8-56a2-44ec-93db-6987520cce0e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:05.618762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4d204e5e-5e03-4bfc-afdf-3a4bafea9366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c83fdbefaeb44e5a278c1e8301ccf5b', 'request_id': 'req-4d204e5e-5e03-4bfc-afdf-3a4bafea9366'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:05.624471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20284538-e5f1-4cbf-afe2-510417881b7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:05.625469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20284538-e5f1-4cbf-afe2-510417881b7e service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:05.625877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20284538-e5f1-4cbf-afe2-510417881b7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:05.626288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20284538-e5f1-4cbf-afe2-510417881b7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:05.627796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4d204e5e-5e03-4bfc-afdf-3a4bafea9366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c83fdbefaeb44e5a278c1e8301ccf5b', 'request_id': 'req-4d204e5e-5e03-4bfc-afdf-3a4bafea9366'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:05.629427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-20284538-e5f1-4cbf-afe2-510417881b7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:05.639117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4d204e5e-5e03-4bfc-afdf-3a4bafea9366 admin admin] The token cache is being invalidate because project 6c83fdbefaeb44e5a278c1e8301ccf5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:05.639412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4d204e5e-5e03-4bfc-afdf-3a4bafea9366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:05.640096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4d204e5e-5e03-4bfc-afdf-3a4bafea9366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:05.641923 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3375/6821] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:05 2022] DELETE /identity/v3/projects/6c83fdbefaeb44e5a278c1e8301ccf5b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:05.643584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef0e8b-56ce-4f2b-b86a-2c64ba3400ab None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:05.643584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef0e8b-56ce-4f2b-b86a-2c64ba3400ab None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:05.643883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef0e8b-56ce-4f2b-b86a-2c64ba3400ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:05.677189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-cdef0e8b-56ce-4f2b-b86a-2c64ba3400ab None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:05.678696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cdef0e8b-56ce-4f2b-b86a-2c64ba3400ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:05.706133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20284538-e5f1-4cbf-afe2-510417881b7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:05.707842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20284538-e5f1-4cbf-afe2-510417881b7e service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:05.719312 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3447/6822] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:05.720151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20284538-e5f1-4cbf-afe2-510417881b7e service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:05.722565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-20284538-e5f1-4cbf-afe2-510417881b7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:05.736298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20284538-e5f1-4cbf-afe2-510417881b7e service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:05.742392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c84c75-8cc0-4235-98de-ea543eed9d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:05.743446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c84c75-8cc0-4235-98de-ea543eed9d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:05.743743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c84c75-8cc0-4235-98de-ea543eed9d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:05.744025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c84c75-8cc0-4235-98de-ea543eed9d70 admin admin] PATH_INFO: `/v3/users/0dc7c410f77548568fee8a09ede1644d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:05.745299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c84c75-8cc0-4235-98de-ea543eed9d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dc7c410f77548568fee8a09ede1644d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:05.747522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c84c75-8cc0-4235-98de-ea543eed9d70 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:05.756260 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3376/6823] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:42:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:05.756899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef0e8b-56ce-4f2b-b86a-2c64ba3400ab None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:05.758397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cdef0e8b-56ce-4f2b-b86a-2c64ba3400ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:05.784520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef0e8b-56ce-4f2b-b86a-2c64ba3400ab None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:05.791024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854d557-f075-4f09-bb7e-696581c1e17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:05.791880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854d557-f075-4f09-bb7e-696581c1e17e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:05.792714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854d557-f075-4f09-bb7e-696581c1e17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:05.793147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854d557-f075-4f09-bb7e-696581c1e17e admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:05.793903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854d557-f075-4f09-bb7e-696581c1e17e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:05.796001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e854d557-f075-4f09-bb7e-696581c1e17e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:05.802618 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:05.946262 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3377/6824] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:05 2022] POST /identity/v3/projects => generated 389 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:05.946262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854d557-f075-4f09-bb7e-696581c1e17e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:05.950581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e854d557-f075-4f09-bb7e-696581c1e17e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:06.085137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a0c84c75-8cc0-4235-98de-ea543eed9d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dc7c410f77548568fee8a09ede1644d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:06.101220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e854d557-f075-4f09-bb7e-696581c1e17e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:06.107471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a0c84c75-8cc0-4235-98de-ea543eed9d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dc7c410f77548568fee8a09ede1644d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:06.113060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec722b87-b26d-4c7d-b0f5-b13650df56e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:06.116315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec722b87-b26d-4c7d-b0f5-b13650df56e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:06.116792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec722b87-b26d-4c7d-b0f5-b13650df56e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:06.117036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec722b87-b26d-4c7d-b0f5-b13650df56e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:06.119140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a0c84c75-8cc0-4235-98de-ea543eed9d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dc7c410f77548568fee8a09ede1644d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:06.120465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a0c84c75-8cc0-4235-98de-ea543eed9d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dc7c410f77548568fee8a09ede1644d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:06.120609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec722b87-b26d-4c7d-b0f5-b13650df56e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:06.126886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec722b87-b26d-4c7d-b0f5-b13650df56e6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:06.145121 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3378/6825] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:06.146469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec722b87-b26d-4c7d-b0f5-b13650df56e6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:06.149269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ec722b87-b26d-4c7d-b0f5-b13650df56e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:06.166281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec722b87-b26d-4c7d-b0f5-b13650df56e6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:06.171713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece69098-68e2-4a60-be5a-4745d30aeebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:06.172791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece69098-68e2-4a60-be5a-4745d30aeebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:06.173085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece69098-68e2-4a60-be5a-4745d30aeebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:06.173369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece69098-68e2-4a60-be5a-4745d30aeebd admin admin] PATH_INFO: `/v3/users/1fd5087aa79e4ee09a4ec9beebca1534` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:06.175313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece69098-68e2-4a60-be5a-4745d30aeebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fd5087aa79e4ee09a4ec9beebca1534)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:06.177224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece69098-68e2-4a60-be5a-4745d30aeebd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:06.229496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a0c84c75-8cc0-4235-98de-ea543eed9d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dc7c410f77548568fee8a09ede1644d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:06.237977 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3448/6826] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:05 2022] DELETE /identity/v3/users/0dc7c410f77548568fee8a09ede1644d => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:06.238894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c84c75-8cc0-4235-98de-ea543eed9d70 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:06.240359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a0c84c75-8cc0-4235-98de-ea543eed9d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:06.324761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c84c75-8cc0-4235-98de-ea543eed9d70 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:06.338639 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:06.347347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6713809-b0e6-46a2-936f-3f341988865d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:06.348294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6713809-b0e6-46a2-936f-3f341988865d admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:06.349196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6713809-b0e6-46a2-936f-3f341988865d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:06.349772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6713809-b0e6-46a2-936f-3f341988865d admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:06.350752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6713809-b0e6-46a2-936f-3f341988865d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:06.352871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6713809-b0e6-46a2-936f-3f341988865d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:06.382617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ece69098-68e2-4a60-be5a-4745d30aeebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fd5087aa79e4ee09a4ec9beebca1534'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:06.398365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ece69098-68e2-4a60-be5a-4745d30aeebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fd5087aa79e4ee09a4ec9beebca1534'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:06.399563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ece69098-68e2-4a60-be5a-4745d30aeebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fd5087aa79e4ee09a4ec9beebca1534'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:06.400702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ece69098-68e2-4a60-be5a-4745d30aeebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fd5087aa79e4ee09a4ec9beebca1534'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:06.410243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ece69098-68e2-4a60-be5a-4745d30aeebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fd5087aa79e4ee09a4ec9beebca1534'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:06.468735 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3449/6827] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:06 2022] POST /identity/v3/users => generated 295 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:06.468735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6713809-b0e6-46a2-936f-3f341988865d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:06.468735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f6713809-b0e6-46a2-936f-3f341988865d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:06.496354 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3379/6828] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:06 2022] DELETE /identity/v3/users/1fd5087aa79e4ee09a4ec9beebca1534 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:06.497860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece69098-68e2-4a60-be5a-4745d30aeebd admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:06.499475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ece69098-68e2-4a60-be5a-4745d30aeebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:06.552467 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:06.602792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece69098-68e2-4a60-be5a-4745d30aeebd admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:06.608697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55534142-f68c-4e7c-9f79-f2db13cef3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:06.609773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55534142-f68c-4e7c-9f79-f2db13cef3c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:06.610133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55534142-f68c-4e7c-9f79-f2db13cef3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:06.610476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55534142-f68c-4e7c-9f79-f2db13cef3c4 admin admin] PATH_INFO: `/v3/projects/84dacb8d667a4206bd07370d42d408ec/users/d60e1f9233474bd4802e03bfa9a30a1c/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:06.637641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55534142-f68c-4e7c-9f79-f2db13cef3c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84dacb8d667a4206bd07370d42d408ec, user_id=d60e1f9233474bd4802e03bfa9a30a1c, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:06.640575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55534142-f68c-4e7c-9f79-f2db13cef3c4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:06.655067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6713809-b0e6-46a2-936f-3f341988865d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:06.726767 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3380/6829] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:06 2022] PUT /identity/v3/projects/84dacb8d667a4206bd07370d42d408ec/users/d60e1f9233474bd4802e03bfa9a30a1c/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:06.727553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55534142-f68c-4e7c-9f79-f2db13cef3c4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:06.738055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-55534142-f68c-4e7c-9f79-f2db13cef3c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:06.754591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab1371-5cd2-4ebf-8640-9bd573edef23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:06.755393 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab1371-5cd2-4ebf-8640-9bd573edef23 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:06.755763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab1371-5cd2-4ebf-8640-9bd573edef23 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:06.756136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab1371-5cd2-4ebf-8640-9bd573edef23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:06.759661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6cab1371-5cd2-4ebf-8640-9bd573edef23 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:06.792290 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:06.864485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab1371-5cd2-4ebf-8640-9bd573edef23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:06.866869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab1371-5cd2-4ebf-8640-9bd573edef23 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:06.880631 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3450/6830] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:42:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:42:06.881740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab1371-5cd2-4ebf-8640-9bd573edef23 service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:06.882542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55534142-f68c-4e7c-9f79-f2db13cef3c4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:06.884253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6cab1371-5cd2-4ebf-8640-9bd573edef23 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:06.899103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4552a90-1e2f-431f-b5cc-986b6afce300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:06.899866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4552a90-1e2f-431f-b5cc-986b6afce300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:06.900297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4552a90-1e2f-431f-b5cc-986b6afce300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:06.900589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4552a90-1e2f-431f-b5cc-986b6afce300 admin admin] PATH_INFO: `/v3/projects/3220a50ac4ed4ef690394b8000cde14f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:06.902664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4552a90-1e2f-431f-b5cc-986b6afce300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3220a50ac4ed4ef690394b8000cde14f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:06.908100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab1371-5cd2-4ebf-8640-9bd573edef23 service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:06.909385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4552a90-1e2f-431f-b5cc-986b6afce300 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:06.911479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3685f4-f5f8-47e8-add0-51a9a8b52eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:06.912287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3685f4-f5f8-47e8-add0-51a9a8b52eda admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:06.912980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3685f4-f5f8-47e8-add0-51a9a8b52eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:06.913124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3685f4-f5f8-47e8-add0-51a9a8b52eda admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:06.913975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3685f4-f5f8-47e8-add0-51a9a8b52eda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:06.916584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3685f4-f5f8-47e8-add0-51a9a8b52eda admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:06.945111 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3451/6831] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:06.950222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a62dd1-56db-4128-a77c-da67c477e2a4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:06.950591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a62dd1-56db-4128-a77c-da67c477e2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:06.950950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a62dd1-56db-4128-a77c-da67c477e2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:07.021071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-02a62dd1-56db-4128-a77c-da67c477e2a4 None None] MFA Rules not processed for user `d60e1f9233474bd4802e03bfa9a30a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:07.023296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-02a62dd1-56db-4128-a77c-da67c477e2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:07.116636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c4552a90-1e2f-431f-b5cc-986b6afce300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3220a50ac4ed4ef690394b8000cde14f', 'request_id': 'req-c4552a90-1e2f-431f-b5cc-986b6afce300'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:07.151765 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:07.160172 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3452/6832] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:07.160172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a62dd1-56db-4128-a77c-da67c477e2a4 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:07.175535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a62dd1-56db-4128-a77c-da67c477e2a4 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:07.211768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c4552a90-1e2f-431f-b5cc-986b6afce300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3220a50ac4ed4ef690394b8000cde14f', 'request_id': 'req-c4552a90-1e2f-431f-b5cc-986b6afce300'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:07.224896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c4552a90-1e2f-431f-b5cc-986b6afce300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3220a50ac4ed4ef690394b8000cde14f', 'request_id': 'req-c4552a90-1e2f-431f-b5cc-986b6afce300'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:07.247507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c4552a90-1e2f-431f-b5cc-986b6afce300 admin admin] The token cache is being invalidate because project 3220a50ac4ed4ef690394b8000cde14f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:07.248317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c4552a90-1e2f-431f-b5cc-986b6afce300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:07.250143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c4552a90-1e2f-431f-b5cc-986b6afce300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:07.256590 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3381/6833] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:06 2022] DELETE /identity/v3/projects/3220a50ac4ed4ef690394b8000cde14f => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:07.257676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4552a90-1e2f-431f-b5cc-986b6afce300 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:07.260850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c4552a90-1e2f-431f-b5cc-986b6afce300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:07.292972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c31dc-58f7-4a9f-a852-6ebf7259b1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:07.293928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c31dc-58f7-4a9f-a852-6ebf7259b1bd admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:07.294426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c31dc-58f7-4a9f-a852-6ebf7259b1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:07.295024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3c31dc-58f7-4a9f-a852-6ebf7259b1bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:07.296002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c31dc-58f7-4a9f-a852-6ebf7259b1bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:07.297817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3c31dc-58f7-4a9f-a852-6ebf7259b1bd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:07.310344 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3453/6834] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:07 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:07.311633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c31dc-58f7-4a9f-a852-6ebf7259b1bd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:07.314132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ef3c31dc-58f7-4a9f-a852-6ebf7259b1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:07.367045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4552a90-1e2f-431f-b5cc-986b6afce300 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:07.374450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b211b-e3af-47a9-aa25-3c78c688204a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:07.375581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b211b-e3af-47a9-aa25-3c78c688204a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:07.376038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b211b-e3af-47a9-aa25-3c78c688204a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:07.376686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b211b-e3af-47a9-aa25-3c78c688204a admin admin] PATH_INFO: `/v3/projects/630ccbb83cd84caeb2b2d48956f58b60` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:07.379277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b211b-e3af-47a9-aa25-3c78c688204a admin admin] RBAC: Authorizing `identity:delete_project(project_id=630ccbb83cd84caeb2b2d48956f58b60)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:07.381934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b211b-e3af-47a9-aa25-3c78c688204a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:07.389438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3c31dc-58f7-4a9f-a852-6ebf7259b1bd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:07.394800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3c9d6-76bf-4f54-b410-9235c51966ba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:07.395536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3c9d6-76bf-4f54-b410-9235c51966ba service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:07.400812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3c9d6-76bf-4f54-b410-9235c51966ba service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:07.400812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3c9d6-76bf-4f54-b410-9235c51966ba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:07.400812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-96b3c9d6-76bf-4f54-b410-9235c51966ba service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:07.471891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3c9d6-76bf-4f54-b410-9235c51966ba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:07.473365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b3c9d6-76bf-4f54-b410-9235c51966ba service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:07.490051 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3454/6835] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:07 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:07.491476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36011456-68af-4a8b-8ef3-bda331fde6a7 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:07.491771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36011456-68af-4a8b-8ef3-bda331fde6a7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:07.492055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36011456-68af-4a8b-8ef3-bda331fde6a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:07.514750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2c3b211b-e3af-47a9-aa25-3c78c688204a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '630ccbb83cd84caeb2b2d48956f58b60', 'request_id': 'req-2c3b211b-e3af-47a9-aa25-3c78c688204a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:07.529304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-36011456-68af-4a8b-8ef3-bda331fde6a7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:07.530586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-36011456-68af-4a8b-8ef3-bda331fde6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:07.591384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2c3b211b-e3af-47a9-aa25-3c78c688204a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '630ccbb83cd84caeb2b2d48956f58b60', 'request_id': 'req-2c3b211b-e3af-47a9-aa25-3c78c688204a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:07.601244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2c3b211b-e3af-47a9-aa25-3c78c688204a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '630ccbb83cd84caeb2b2d48956f58b60', 'request_id': 'req-2c3b211b-e3af-47a9-aa25-3c78c688204a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:07.605493 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3455/6836] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:07.606589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36011456-68af-4a8b-8ef3-bda331fde6a7 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:07.608023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-36011456-68af-4a8b-8ef3-bda331fde6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:07.627855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36011456-68af-4a8b-8ef3-bda331fde6a7 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:07.632172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ed183-a5c1-404f-9c9e-4367242e6828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:07.633507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ed183-a5c1-404f-9c9e-4367242e6828 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:07.633845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ed183-a5c1-404f-9c9e-4367242e6828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:07.634421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ed183-a5c1-404f-9c9e-4367242e6828 admin admin] PATH_INFO: `/v3/projects/fda6ebe15e1b4fa28227e04c4c6547d6/users/0c1f57fe8a6741d8925623fa4966b895/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:07.634944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2c3b211b-e3af-47a9-aa25-3c78c688204a admin admin] The token cache is being invalidate because project 630ccbb83cd84caeb2b2d48956f58b60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:07.635352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2c3b211b-e3af-47a9-aa25-3c78c688204a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:07.637482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2c3b211b-e3af-47a9-aa25-3c78c688204a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:07.646279 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3382/6837] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:07 2022] DELETE /identity/v3/projects/630ccbb83cd84caeb2b2d48956f58b60 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:07.646279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b211b-e3af-47a9-aa25-3c78c688204a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:07.647975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2c3b211b-e3af-47a9-aa25-3c78c688204a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:07.659895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ed183-a5c1-404f-9c9e-4367242e6828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fda6ebe15e1b4fa28227e04c4c6547d6, user_id=0c1f57fe8a6741d8925623fa4966b895, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:07.663495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ed183-a5c1-404f-9c9e-4367242e6828 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:07.676676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b211b-e3af-47a9-aa25-3c78c688204a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:07.683214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628bfc0-5e84-4c84-aae4-abc4ce573137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:07.684131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628bfc0-5e84-4c84-aae4-abc4ce573137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:07.686126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628bfc0-5e84-4c84-aae4-abc4ce573137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:07.686126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628bfc0-5e84-4c84-aae4-abc4ce573137 admin admin] PATH_INFO: `/v3/projects/8802c771c3ea4204991cc31fed2306e9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:07.686126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628bfc0-5e84-4c84-aae4-abc4ce573137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8802c771c3ea4204991cc31fed2306e9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:07.688160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628bfc0-5e84-4c84-aae4-abc4ce573137 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:07.742681 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3456/6838] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:07 2022] PUT /identity/v3/projects/fda6ebe15e1b4fa28227e04c4c6547d6/users/0c1f57fe8a6741d8925623fa4966b895/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:07.750580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae1e03-7bee-4b56-9846-6a6519159bd1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:07.751868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae1e03-7bee-4b56-9846-6a6519159bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:07.752867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae1e03-7bee-4b56-9846-6a6519159bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:07.765866 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:07.787332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-fcae1e03-7bee-4b56-9846-6a6519159bd1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:07.788779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fcae1e03-7bee-4b56-9846-6a6519159bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:07.857810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2628bfc0-5e84-4c84-aae4-abc4ce573137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8802c771c3ea4204991cc31fed2306e9', 'request_id': 'req-2628bfc0-5e84-4c84-aae4-abc4ce573137'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:07.874002 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3457/6839] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:07.879759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e93c00-81b9-4640-8ea0-433fbc971cb6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:07.880228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e93c00-81b9-4640-8ea0-433fbc971cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:07.880515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e93c00-81b9-4640-8ea0-433fbc971cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:07.902454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-50e93c00-81b9-4640-8ea0-433fbc971cb6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:07.905897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-50e93c00-81b9-4640-8ea0-433fbc971cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:07.927521 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:07.927521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2628bfc0-5e84-4c84-aae4-abc4ce573137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8802c771c3ea4204991cc31fed2306e9', 'request_id': 'req-2628bfc0-5e84-4c84-aae4-abc4ce573137'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:07.935080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2628bfc0-5e84-4c84-aae4-abc4ce573137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8802c771c3ea4204991cc31fed2306e9', 'request_id': 'req-2628bfc0-5e84-4c84-aae4-abc4ce573137'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:07.950303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2628bfc0-5e84-4c84-aae4-abc4ce573137 admin admin] The token cache is being invalidate because project 8802c771c3ea4204991cc31fed2306e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:07.950848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2628bfc0-5e84-4c84-aae4-abc4ce573137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:07.951633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2628bfc0-5e84-4c84-aae4-abc4ce573137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:07.953930 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3383/6840] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:07 2022] DELETE /identity/v3/projects/8802c771c3ea4204991cc31fed2306e9 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:07.955590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee8513-d1a8-4ae8-8a33-324ee7f91cf5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:07.956024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee8513-d1a8-4ae8-8a33-324ee7f91cf5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:07.956400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee8513-d1a8-4ae8-8a33-324ee7f91cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:07.990829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a9ee8513-d1a8-4ae8-8a33-324ee7f91cf5 None None] MFA Rules not processed for user `0c1f57fe8a6741d8925623fa4966b895`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:07.992407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a9ee8513-d1a8-4ae8-8a33-324ee7f91cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:07.998868 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3458/6841] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:08.000411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d788c3-c40c-4ab1-afde-4ae0a16fabff None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:08.000698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d788c3-c40c-4ab1-afde-4ae0a16fabff None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:08.002511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d788c3-c40c-4ab1-afde-4ae0a16fabff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:08.020611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-85d788c3-c40c-4ab1-afde-4ae0a16fabff None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:08.022193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-85d788c3-c40c-4ab1-afde-4ae0a16fabff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:08.082383 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3384/6842] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:07 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:08.083829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee8513-d1a8-4ae8-8a33-324ee7f91cf5 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:08.085240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a9ee8513-d1a8-4ae8-8a33-324ee7f91cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:08.100003 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3459/6843] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:42:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:08.102744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafc988-282e-457d-898f-38c68ea2f7f2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:08.103038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafc988-282e-457d-898f-38c68ea2f7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:08.103319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bafc988-282e-457d-898f-38c68ea2f7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:08.108423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee8513-d1a8-4ae8-8a33-324ee7f91cf5 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:08.117731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21b1208-9b5d-49ee-b5fc-44ebd7b6a2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:08.122446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b1208-9b5d-49ee-b5fc-44ebd7b6a2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:08.122446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b1208-9b5d-49ee-b5fc-44ebd7b6a2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:08.122446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21b1208-9b5d-49ee-b5fc-44ebd7b6a2f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:08.122446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b1208-9b5d-49ee-b5fc-44ebd7b6a2f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:42:08.122446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b1208-9b5d-49ee-b5fc-44ebd7b6a2f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:08.122446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21b1208-9b5d-49ee-b5fc-44ebd7b6a2f7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:08.130004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2bafc988-282e-457d-898f-38c68ea2f7f2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:08.131210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2bafc988-282e-457d-898f-38c68ea2f7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:08.136402 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3385/6844] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:42:08.137741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022b7b4-3155-4e80-9524-8da2babf26fe None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:08.138141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022b7b4-3155-4e80-9524-8da2babf26fe None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:08.138393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022b7b4-3155-4e80-9524-8da2babf26fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:08.145496 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3460/6845] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:08.145496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafc988-282e-457d-898f-38c68ea2f7f2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:08.145496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2bafc988-282e-457d-898f-38c68ea2f7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:08.159289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bafc988-282e-457d-898f-38c68ea2f7f2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:08.164881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06f575-ed41-4f66-bff4-f6472e303a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:08.165703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06f575-ed41-4f66-bff4-f6472e303a77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:08.165986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06f575-ed41-4f66-bff4-f6472e303a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:08.166210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5022b7b4-3155-4e80-9524-8da2babf26fe None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:08.166342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06f575-ed41-4f66-bff4-f6472e303a77 admin admin] PATH_INFO: `/v3/users/0684287990654b8a9e08d2fa4c4eb08d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:08.167421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5022b7b4-3155-4e80-9524-8da2babf26fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:08.167546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06f575-ed41-4f66-bff4-f6472e303a77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0684287990654b8a9e08d2fa4c4eb08d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:08.169403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06f575-ed41-4f66-bff4-f6472e303a77 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:08.176174 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3386/6846] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:08.177072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022b7b4-3155-4e80-9524-8da2babf26fe None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:08.178796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5022b7b4-3155-4e80-9524-8da2babf26fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:08.246335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022b7b4-3155-4e80-9524-8da2babf26fe None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:08.249930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c87870-c529-4826-a97e-492510866fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:08.250615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c87870-c529-4826-a97e-492510866fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:08.250898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c87870-c529-4826-a97e-492510866fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:08.251184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c87870-c529-4826-a97e-492510866fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:08.259856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c87870-c529-4826-a97e-492510866fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:08.261278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c87870-c529-4826-a97e-492510866fa5 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:08.270593 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3387/6847] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:08.271895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c87870-c529-4826-a97e-492510866fa5 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:08.272989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-48c87870-c529-4826-a97e-492510866fa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:08.354242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c87870-c529-4826-a97e-492510866fa5 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:08.359727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506d632-cf81-4b15-b137-fd2021ea4444 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:08.360402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506d632-cf81-4b15-b137-fd2021ea4444 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:08.360699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506d632-cf81-4b15-b137-fd2021ea4444 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:08.360984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7506d632-cf81-4b15-b137-fd2021ea4444 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:08.370232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506d632-cf81-4b15-b137-fd2021ea4444 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:08.371872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7506d632-cf81-4b15-b137-fd2021ea4444 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:08.380666 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3388/6848] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:42:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:42:08.381406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506d632-cf81-4b15-b137-fd2021ea4444 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:08.392236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7506d632-cf81-4b15-b137-fd2021ea4444 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:08.401662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8efb0c-87d9-436a-ab6d-cb1d0e2f3d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:08.402472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8efb0c-87d9-436a-ab6d-cb1d0e2f3d39 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:08.402779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8efb0c-87d9-436a-ab6d-cb1d0e2f3d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:08.403052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8efb0c-87d9-436a-ab6d-cb1d0e2f3d39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:08.403757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8efb0c-87d9-436a-ab6d-cb1d0e2f3d39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:08.404922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8f06f575-ed41-4f66-bff4-f6472e303a77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0684287990654b8a9e08d2fa4c4eb08d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:08.405859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8efb0c-87d9-436a-ab6d-cb1d0e2f3d39 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:08.425002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8f06f575-ed41-4f66-bff4-f6472e303a77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0684287990654b8a9e08d2fa4c4eb08d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:08.432724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8f06f575-ed41-4f66-bff4-f6472e303a77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0684287990654b8a9e08d2fa4c4eb08d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:08.433579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8f06f575-ed41-4f66-bff4-f6472e303a77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0684287990654b8a9e08d2fa4c4eb08d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:08.555153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8f06f575-ed41-4f66-bff4-f6472e303a77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0684287990654b8a9e08d2fa4c4eb08d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:08.561693 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3461/6849] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:08 2022] DELETE /identity/v3/users/0684287990654b8a9e08d2fa4c4eb08d => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:08.565903 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3389/6850] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:08 2022] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:08.565903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8efb0c-87d9-436a-ab6d-cb1d0e2f3d39 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:08.566152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c42197-a37a-4a77-941c-7942fc6a1e98 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:08.566333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c42197-a37a-4a77-941c-7942fc6a1e98 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:08.566618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c42197-a37a-4a77-941c-7942fc6a1e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:08.567694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8e8efb0c-87d9-436a-ab6d-cb1d0e2f3d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:08.584788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c3c42197-a37a-4a77-941c-7942fc6a1e98 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:08.585977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c3c42197-a37a-4a77-941c-7942fc6a1e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:08.635636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8efb0c-87d9-436a-ab6d-cb1d0e2f3d39 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:08.648059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33fcdc-d115-4074-977d-e52663b8b828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:08.648865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33fcdc-d115-4074-977d-e52663b8b828 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:08.649160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33fcdc-d115-4074-977d-e52663b8b828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:08.649490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33fcdc-d115-4074-977d-e52663b8b828 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:08.650396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33fcdc-d115-4074-977d-e52663b8b828 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:42:08.650801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33fcdc-d115-4074-977d-e52663b8b828 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:08.651269 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:08.662974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f33fcdc-d115-4074-977d-e52663b8b828 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:08.682693 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3462/6851] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:08.684059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cbe21-2fb0-4afe-bd53-937adcd2a55c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:08.684352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cbe21-2fb0-4afe-bd53-937adcd2a55c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:08.686442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456cbe21-2fb0-4afe-bd53-937adcd2a55c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:08.691314 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3390/6852] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:42:08.692449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33fcdc-d115-4074-977d-e52663b8b828 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:08.695606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6f33fcdc-d115-4074-977d-e52663b8b828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:08.708479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-456cbe21-2fb0-4afe-bd53-937adcd2a55c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:08.709810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33fcdc-d115-4074-977d-e52663b8b828 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:08.710927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-456cbe21-2fb0-4afe-bd53-937adcd2a55c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:08.715270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa32df-db29-480a-9877-9da1b6d9fbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:08.720355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa32df-db29-480a-9877-9da1b6d9fbca admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:08.720355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa32df-db29-480a-9877-9da1b6d9fbca admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:08.720355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa32df-db29-480a-9877-9da1b6d9fbca admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:08.720355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa32df-db29-480a-9877-9da1b6d9fbca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:08.720355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa32df-db29-480a-9877-9da1b6d9fbca admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:08.720905 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3463/6853] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:08.721723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cbe21-2fb0-4afe-bd53-937adcd2a55c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:08.732309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456cbe21-2fb0-4afe-bd53-937adcd2a55c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:08.737528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8b301-90bd-472b-b95b-f4853b7d3cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:08.738767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8b301-90bd-472b-b95b-f4853b7d3cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:08.738973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8b301-90bd-472b-b95b-f4853b7d3cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:08.739255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8b301-90bd-472b-b95b-f4853b7d3cc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:08.740000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8b301-90bd-472b-b95b-f4853b7d3cc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:42:08.740311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8b301-90bd-472b-b95b-f4853b7d3cc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:08.741932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8b301-90bd-472b-b95b-f4853b7d3cc6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:08.754655 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3464/6854] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:42:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:42:08.755452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8b301-90bd-472b-b95b-f4853b7d3cc6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:08.765461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8b301-90bd-472b-b95b-f4853b7d3cc6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:08.770883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e2463-25f4-42cc-846c-725a8fa18294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:08.771527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e2463-25f4-42cc-846c-725a8fa18294 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:08.771819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e2463-25f4-42cc-846c-725a8fa18294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:08.772101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e2463-25f4-42cc-846c-725a8fa18294 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:08.772824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e2463-25f4-42cc-846c-725a8fa18294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:08.774754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e2463-25f4-42cc-846c-725a8fa18294 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:08.814287 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3391/6855] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:08 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:08.815653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa32df-db29-480a-9877-9da1b6d9fbca admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:08.817321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-affa32df-db29-480a-9877-9da1b6d9fbca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:08.878414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa32df-db29-480a-9877-9da1b6d9fbca admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:08.882251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd39ab-597d-4bd0-8893-eac4014e6374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:08.882907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd39ab-597d-4bd0-8893-eac4014e6374 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:08.883450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd39ab-597d-4bd0-8893-eac4014e6374 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:08.883733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd39ab-597d-4bd0-8893-eac4014e6374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:08.893631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd39ab-597d-4bd0-8893-eac4014e6374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:08.895044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd39ab-597d-4bd0-8893-eac4014e6374 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:08.904776 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3392/6856] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:08.905564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd39ab-597d-4bd0-8893-eac4014e6374 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:08.915608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd39ab-597d-4bd0-8893-eac4014e6374 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:08.924846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82260f-2538-4627-8fcb-3baab2137587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:08.924846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82260f-2538-4627-8fcb-3baab2137587 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:08.924846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82260f-2538-4627-8fcb-3baab2137587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:08.924846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82260f-2538-4627-8fcb-3baab2137587 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:08.925266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82260f-2538-4627-8fcb-3baab2137587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:08.925266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82260f-2538-4627-8fcb-3baab2137587 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:08.979282 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:08.992325 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3465/6857] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:08 2022] POST /identity/v3/projects => generated 387 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:08.992325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e2463-25f4-42cc-846c-725a8fa18294 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:09.072965 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3393/6858] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:08 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:09.074644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82260f-2538-4627-8fcb-3baab2137587 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:09.095541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e2463-25f4-42cc-846c-725a8fa18294 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:09.163676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d3203-4f55-4176-b00c-87eee19601ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:09.164364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d3203-4f55-4176-b00c-87eee19601ea admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:09.164680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d3203-4f55-4176-b00c-87eee19601ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:09.164994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88d3203-4f55-4176-b00c-87eee19601ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:09.165869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d3203-4f55-4176-b00c-87eee19601ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:09.167658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88d3203-4f55-4176-b00c-87eee19601ea admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:09.184334 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3466/6859] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:08 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:09.185054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82260f-2538-4627-8fcb-3baab2137587 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:09.185246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d3203-4f55-4176-b00c-87eee19601ea admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:09.190985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd698220-e660-4af0-bf69-2c49e6253d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:09.191673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd698220-e660-4af0-bf69-2c49e6253d6a admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:09.191960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd698220-e660-4af0-bf69-2c49e6253d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:09.192240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd698220-e660-4af0-bf69-2c49e6253d6a admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:09.192942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd698220-e660-4af0-bf69-2c49e6253d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:09.195227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd698220-e660-4af0-bf69-2c49e6253d6a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:09.198257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88d3203-4f55-4176-b00c-87eee19601ea admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:09.206089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425a95e-8af6-48ae-be2f-6b047e8ab963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:09.206417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425a95e-8af6-48ae-be2f-6b047e8ab963 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:09.206809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425a95e-8af6-48ae-be2f-6b047e8ab963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:09.207191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0425a95e-8af6-48ae-be2f-6b047e8ab963 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:09.208052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425a95e-8af6-48ae-be2f-6b047e8ab963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:09.210529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0425a95e-8af6-48ae-be2f-6b047e8ab963 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:09.326151 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3467/6860] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:09 2022] POST /identity/v3/users => generated 286 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:09.326399 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3394/6861] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:09 2022] POST /identity/v3/users => generated 300 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:09.328274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd698220-e660-4af0-bf69-2c49e6253d6a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:09.329109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425a95e-8af6-48ae-be2f-6b047e8ab963 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:09.338867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd698220-e660-4af0-bf69-2c49e6253d6a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:09.339662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0425a95e-8af6-48ae-be2f-6b047e8ab963 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:09.344181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c48b8-ab7a-44a1-ad6d-1588363e7003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:09.348372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c48b8-ab7a-44a1-ad6d-1588363e7003 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:09.348504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefabda-0183-4213-8e24-ec406fb51c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:09.348649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c48b8-ab7a-44a1-ad6d-1588363e7003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:09.348649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c48b8-ab7a-44a1-ad6d-1588363e7003 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:09.348858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefabda-0183-4213-8e24-ec406fb51c23 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:09.348858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefabda-0183-4213-8e24-ec406fb51c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:09.349019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c48b8-ab7a-44a1-ad6d-1588363e7003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:09.349106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefabda-0183-4213-8e24-ec406fb51c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:09.349106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefabda-0183-4213-8e24-ec406fb51c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:09.349271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c48b8-ab7a-44a1-ad6d-1588363e7003 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:09.349365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefabda-0183-4213-8e24-ec406fb51c23 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:09.359470 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3395/6862] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:09.360243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c48b8-ab7a-44a1-ad6d-1588363e7003 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:09.367889 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3468/6863] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:09.368805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefabda-0183-4213-8e24-ec406fb51c23 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:09.371834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c48b8-ab7a-44a1-ad6d-1588363e7003 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:09.377979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88d7c5-443c-4539-bc1c-a104c20983ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:09.379053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88d7c5-443c-4539-bc1c-a104c20983ea admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:09.379549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88d7c5-443c-4539-bc1c-a104c20983ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:09.379986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c88d7c5-443c-4539-bc1c-a104c20983ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:09.380872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88d7c5-443c-4539-bc1c-a104c20983ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:09.381010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefabda-0183-4213-8e24-ec406fb51c23 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:09.383575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c88d7c5-443c-4539-bc1c-a104c20983ea admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:09.390051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4eb50-cf0f-49bf-93e8-12b2be68fbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:09.391114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4eb50-cf0f-49bf-93e8-12b2be68fbee admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:09.391430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4eb50-cf0f-49bf-93e8-12b2be68fbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:09.391925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b4eb50-cf0f-49bf-93e8-12b2be68fbee admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:09.393666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4eb50-cf0f-49bf-93e8-12b2be68fbee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:09.396030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b4eb50-cf0f-49bf-93e8-12b2be68fbee admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:09.398908 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3396/6864] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:09.399884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88d7c5-443c-4539-bc1c-a104c20983ea admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:09.406932 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3469/6865] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:09.412145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4eb50-cf0f-49bf-93e8-12b2be68fbee admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:09.412524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c88d7c5-443c-4539-bc1c-a104c20983ea admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:09.418692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58ae72-4720-478d-8788-3c31765447f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:09.419601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58ae72-4720-478d-8788-3c31765447f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:09.419882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58ae72-4720-478d-8788-3c31765447f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:09.420163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58ae72-4720-478d-8788-3c31765447f5 admin admin] PATH_INFO: `/v3/projects/2203333572c24b229d3efb0e58d4b84c/users/4da804ebc57f46ee99a1eb94cf59fded/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:09.422959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b4eb50-cf0f-49bf-93e8-12b2be68fbee admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:09.428318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedff78-49f4-43ea-843c-23aaea2dc2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:09.429372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedff78-49f4-43ea-843c-23aaea2dc2a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:09.429722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedff78-49f4-43ea-843c-23aaea2dc2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:09.434653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedff78-49f4-43ea-843c-23aaea2dc2a9 admin admin] PATH_INFO: `/v3/projects/9d67804916ed4a799674051db1ac37fe/users/95a143e24cd5432ca28d54674d84c900/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:09.438845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58ae72-4720-478d-8788-3c31765447f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2203333572c24b229d3efb0e58d4b84c, user_id=4da804ebc57f46ee99a1eb94cf59fded, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:09.442555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58ae72-4720-478d-8788-3c31765447f5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:09.447030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cedff78-49f4-43ea-843c-23aaea2dc2a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d67804916ed4a799674051db1ac37fe, user_id=95a143e24cd5432ca28d54674d84c900, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:09.449810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cedff78-49f4-43ea-843c-23aaea2dc2a9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:09.522874 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3397/6866] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:09 2022] PUT /identity/v3/projects/2203333572c24b229d3efb0e58d4b84c/users/4da804ebc57f46ee99a1eb94cf59fded/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:09.524267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48128769-777a-4b82-8aa5-376c5c2756ed None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:09.526640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48128769-777a-4b82-8aa5-376c5c2756ed None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:09.526640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48128769-777a-4b82-8aa5-376c5c2756ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:09.543269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-48128769-777a-4b82-8aa5-376c5c2756ed None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:09.544470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-48128769-777a-4b82-8aa5-376c5c2756ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:09.554549 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3470/6867] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:09 2022] PUT /identity/v3/projects/9d67804916ed4a799674051db1ac37fe/users/95a143e24cd5432ca28d54674d84c900/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:09.555472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedff78-49f4-43ea-843c-23aaea2dc2a9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:09.603588 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3398/6868] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:42:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:09.604896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3b290-aef7-4d61-9b8b-2573d6c69802 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:09.605198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3b290-aef7-4d61-9b8b-2573d6c69802 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:09.605651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3b290-aef7-4d61-9b8b-2573d6c69802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:09.631290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cedff78-49f4-43ea-843c-23aaea2dc2a9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:09.632765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a5a3b290-aef7-4d61-9b8b-2573d6c69802 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:09.634655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a5a3b290-aef7-4d61-9b8b-2573d6c69802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:09.639796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446be3c-1922-4928-87a2-698aedf13870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:09.640725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446be3c-1922-4928-87a2-698aedf13870 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:09.641063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446be3c-1922-4928-87a2-698aedf13870 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:09.641590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5446be3c-1922-4928-87a2-698aedf13870 admin admin] PATH_INFO: `/v3/projects/ca8b3055c4354f989534aa2079e081b2/users/715ec227b2bd4ca798a8b1e417870a0f/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:09.651314 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3399/6869] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:09.654118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3b290-aef7-4d61-9b8b-2573d6c69802 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:09.660723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446be3c-1922-4928-87a2-698aedf13870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca8b3055c4354f989534aa2079e081b2, user_id=715ec227b2bd4ca798a8b1e417870a0f, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:09.663458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5446be3c-1922-4928-87a2-698aedf13870 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:09.668136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3b290-aef7-4d61-9b8b-2573d6c69802 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:09.672997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b770165-bfb3-4007-9e3e-7d8e7e290b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:09.673667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b770165-bfb3-4007-9e3e-7d8e7e290b32 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:09.674721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b770165-bfb3-4007-9e3e-7d8e7e290b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:09.675014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b770165-bfb3-4007-9e3e-7d8e7e290b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:09.676075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b770165-bfb3-4007-9e3e-7d8e7e290b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:09.677675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b770165-bfb3-4007-9e3e-7d8e7e290b32 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:09.692364 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3400/6870] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:09.693586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b770165-bfb3-4007-9e3e-7d8e7e290b32 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:09.698279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5b770165-bfb3-4007-9e3e-7d8e7e290b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:09.771366 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3471/6871] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:09 2022] PUT /identity/v3/projects/ca8b3055c4354f989534aa2079e081b2/users/715ec227b2bd4ca798a8b1e417870a0f/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:09.772847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446be3c-1922-4928-87a2-698aedf13870 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:09.774466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5446be3c-1922-4928-87a2-698aedf13870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:09.785296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b770165-bfb3-4007-9e3e-7d8e7e290b32 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:09.846619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b3681-e2cc-430b-810f-ad77153bdae8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:09.847286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b3681-e2cc-430b-810f-ad77153bdae8 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:09.847574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b3681-e2cc-430b-810f-ad77153bdae8 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:09.847857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30b3681-e2cc-430b-810f-ad77153bdae8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:09.849338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5446be3c-1922-4928-87a2-698aedf13870 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:09.854489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463280e-505b-436e-996d-a9a3d165bf7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:09.855378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463280e-505b-436e-996d-a9a3d165bf7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:09.855664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463280e-505b-436e-996d-a9a3d165bf7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:09.855949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463280e-505b-436e-996d-a9a3d165bf7a admin admin] PATH_INFO: `/v3/projects/9a763ed3d0b246c8833082822867f88e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:09.857157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463280e-505b-436e-996d-a9a3d165bf7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a763ed3d0b246c8833082822867f88e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:09.859533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463280e-505b-436e-996d-a9a3d165bf7a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:09.905582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b3681-e2cc-430b-810f-ad77153bdae8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:09.907148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30b3681-e2cc-430b-810f-ad77153bdae8 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:09.916245 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3401/6872] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:42:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:42:09.917075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b3681-e2cc-430b-810f-ad77153bdae8 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:09.922732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f30b3681-e2cc-430b-810f-ad77153bdae8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:09.979591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30b3681-e2cc-430b-810f-ad77153bdae8 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:09.983354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725fb44-682e-4810-8dc6-e76728f3a4e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:09.984009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725fb44-682e-4810-8dc6-e76728f3a4e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:09.984302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725fb44-682e-4810-8dc6-e76728f3a4e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:09.984587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725fb44-682e-4810-8dc6-e76728f3a4e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:09.995074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725fb44-682e-4810-8dc6-e76728f3a4e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:09.996548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0725fb44-682e-4810-8dc6-e76728f3a4e4 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:10.007524 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3402/6873] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:10.014763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725fb44-682e-4810-8dc6-e76728f3a4e4 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:10.015061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3463280e-505b-436e-996d-a9a3d165bf7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a763ed3d0b246c8833082822867f88e', 'request_id': 'req-3463280e-505b-436e-996d-a9a3d165bf7a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:10.017325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3463280e-505b-436e-996d-a9a3d165bf7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a763ed3d0b246c8833082822867f88e', 'request_id': 'req-3463280e-505b-436e-996d-a9a3d165bf7a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:10.018297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0725fb44-682e-4810-8dc6-e76728f3a4e4 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:10.024511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3463280e-505b-436e-996d-a9a3d165bf7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a763ed3d0b246c8833082822867f88e', 'request_id': 'req-3463280e-505b-436e-996d-a9a3d165bf7a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:10.077138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48997e4-bef3-4cd1-b6f4-08b305801ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:10.078052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48997e4-bef3-4cd1-b6f4-08b305801ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:10.078348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48997e4-bef3-4cd1-b6f4-08b305801ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:10.078628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48997e4-bef3-4cd1-b6f4-08b305801ecd admin admin] PATH_INFO: `/v3/projects/9d67804916ed4a799674051db1ac37fe/users/95a143e24cd5432ca28d54674d84c900/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:10.080712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48997e4-bef3-4cd1-b6f4-08b305801ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d67804916ed4a799674051db1ac37fe, user_id=95a143e24cd5432ca28d54674d84c900, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:10.083493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48997e4-bef3-4cd1-b6f4-08b305801ecd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:10.094319 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3403/6874] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:10 2022] PUT /identity/v3/projects/9d67804916ed4a799674051db1ac37fe/users/95a143e24cd5432ca28d54674d84c900/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:10.095352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cb395-624b-4914-b08b-3bbbd6f23c32 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:10.098619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cb395-624b-4914-b08b-3bbbd6f23c32 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:10.098619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403cb395-624b-4914-b08b-3bbbd6f23c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:10.102655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3463280e-505b-436e-996d-a9a3d165bf7a admin admin] The token cache is being invalidate because project 9a763ed3d0b246c8833082822867f88e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:10.103014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3463280e-505b-436e-996d-a9a3d165bf7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:10.103775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3463280e-505b-436e-996d-a9a3d165bf7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:10.105584 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3472/6875] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:09 2022] DELETE /identity/v3/projects/9a763ed3d0b246c8833082822867f88e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:10.106885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d433e8-36ee-498d-a749-135a90a74e4f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:10.107164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d433e8-36ee-498d-a749-135a90a74e4f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:10.107470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d433e8-36ee-498d-a749-135a90a74e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:10.128596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-403cb395-624b-4914-b08b-3bbbd6f23c32 None None] MFA Rules not processed for user `715ec227b2bd4ca798a8b1e417870a0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:10.130013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-403cb395-624b-4914-b08b-3bbbd6f23c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:10.138257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f9d433e8-36ee-498d-a749-135a90a74e4f None None] MFA Rules not processed for user `95a143e24cd5432ca28d54674d84c900`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:10.139537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f9d433e8-36ee-498d-a749-135a90a74e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:10.255487 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3404/6876] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:10.256546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cb395-624b-4914-b08b-3bbbd6f23c32 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:10.269006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-403cb395-624b-4914-b08b-3bbbd6f23c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:10.291262 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3473/6877] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:10.291262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d433e8-36ee-498d-a749-135a90a74e4f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:10.291262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f9d433e8-36ee-498d-a749-135a90a74e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:10.378804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d433e8-36ee-498d-a749-135a90a74e4f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:10.382901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382eb2b-2a93-48fc-8aee-f6b8c511d4a8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:10.384111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382eb2b-2a93-48fc-8aee-f6b8c511d4a8 service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:10.384593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382eb2b-2a93-48fc-8aee-f6b8c511d4a8 service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:10.385039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d382eb2b-2a93-48fc-8aee-f6b8c511d4a8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:10.404862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382eb2b-2a93-48fc-8aee-f6b8c511d4a8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:10.406400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d382eb2b-2a93-48fc-8aee-f6b8c511d4a8 service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:10.418974 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:10.432184 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3474/6878] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:10.432825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382eb2b-2a93-48fc-8aee-f6b8c511d4a8 service glance] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:10.437242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403cb395-624b-4914-b08b-3bbbd6f23c32 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:10.438588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d382eb2b-2a93-48fc-8aee-f6b8c511d4a8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:10.449501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbd830-8eac-4e1a-bc92-a76d70f9ee51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:10.450439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbd830-8eac-4e1a-bc92-a76d70f9ee51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:10.450882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbd830-8eac-4e1a-bc92-a76d70f9ee51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:10.453316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bbd830-8eac-4e1a-bc92-a76d70f9ee51 admin admin] PATH_INFO: `/v3/users/d60e1f9233474bd4802e03bfa9a30a1c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:10.457742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbd830-8eac-4e1a-bc92-a76d70f9ee51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d60e1f9233474bd4802e03bfa9a30a1c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:10.459727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bbd830-8eac-4e1a-bc92-a76d70f9ee51 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:10.466603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d382eb2b-2a93-48fc-8aee-f6b8c511d4a8 service glance] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:10.494819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82652001-5bcc-4752-9034-c0c44443f022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:10.495771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82652001-5bcc-4752-9034-c0c44443f022 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:10.496809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82652001-5bcc-4752-9034-c0c44443f022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:10.497097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82652001-5bcc-4752-9034-c0c44443f022 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:10.497816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82652001-5bcc-4752-9034-c0c44443f022 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:10.499787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82652001-5bcc-4752-9034-c0c44443f022 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:10.603498 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:10.662015 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3475/6879] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:10 2022] POST /identity/v3/projects => generated 385 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:10.664109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9127b-c0f3-4783-8301-e989b9cc5418 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:10.665438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9127b-c0f3-4783-8301-e989b9cc5418 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:10.665942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb9127b-c0f3-4783-8301-e989b9cc5418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:10.703007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-acb9127b-c0f3-4783-8301-e989b9cc5418 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:10.704463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-acb9127b-c0f3-4783-8301-e989b9cc5418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:10.778661 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3476/6880] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:42:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:10.779313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9127b-c0f3-4783-8301-e989b9cc5418 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:10.805687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-25bbd830-8eac-4e1a-bc92-a76d70f9ee51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd60e1f9233474bd4802e03bfa9a30a1c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:10.834060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-25bbd830-8eac-4e1a-bc92-a76d70f9ee51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd60e1f9233474bd4802e03bfa9a30a1c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:10.835791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-25bbd830-8eac-4e1a-bc92-a76d70f9ee51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd60e1f9233474bd4802e03bfa9a30a1c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:10.837454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-25bbd830-8eac-4e1a-bc92-a76d70f9ee51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd60e1f9233474bd4802e03bfa9a30a1c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:10.847242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-25bbd830-8eac-4e1a-bc92-a76d70f9ee51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd60e1f9233474bd4802e03bfa9a30a1c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:10.894952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb9127b-c0f3-4783-8301-e989b9cc5418 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:10.899860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc73a4-a674-4f03-afc0-7cb397f7dbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:10.900639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc73a4-a674-4f03-afc0-7cb397f7dbc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:10.900992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc73a4-a674-4f03-afc0-7cb397f7dbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:10.901337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc73a4-a674-4f03-afc0-7cb397f7dbc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:10.902266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc73a4-a674-4f03-afc0-7cb397f7dbc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:10.904341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc73a4-a674-4f03-afc0-7cb397f7dbc8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:10.952926 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3405/6881] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:10 2022] DELETE /identity/v3/users/d60e1f9233474bd4802e03bfa9a30a1c => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:10.955641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbd830-8eac-4e1a-bc92-a76d70f9ee51 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:10.979923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-25bbd830-8eac-4e1a-bc92-a76d70f9ee51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:11.087484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bbd830-8eac-4e1a-bc92-a76d70f9ee51 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:11.101800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e1666-0c1b-432e-ad3d-ba98920f0758 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:11.105159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e1666-0c1b-432e-ad3d-ba98920f0758 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:11.105159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e1666-0c1b-432e-ad3d-ba98920f0758 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:11.105159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462e1666-0c1b-432e-ad3d-ba98920f0758 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:11.106499 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3477/6882] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:10 2022] POST /identity/v3/users => generated 293 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:11.107279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc73a4-a674-4f03-afc0-7cb397f7dbc8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:11.109571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-462e1666-0c1b-432e-ad3d-ba98920f0758 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:11.114453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-05cc73a4-a674-4f03-afc0-7cb397f7dbc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:11.128052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc73a4-a674-4f03-afc0-7cb397f7dbc8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:11.206607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e1666-0c1b-432e-ad3d-ba98920f0758 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:11.210318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462e1666-0c1b-432e-ad3d-ba98920f0758 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:11.226283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec60598-a257-45f8-8d0b-74a3eb976438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:11.226991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec60598-a257-45f8-8d0b-74a3eb976438 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:11.227337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec60598-a257-45f8-8d0b-74a3eb976438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:11.227853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec60598-a257-45f8-8d0b-74a3eb976438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:11.227976 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3406/6883] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:42:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:42:11.235241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec60598-a257-45f8-8d0b-74a3eb976438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:11.238225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec60598-a257-45f8-8d0b-74a3eb976438 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:11.257541 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3478/6884] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:11.259614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e1666-0c1b-432e-ad3d-ba98920f0758 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:11.282698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462e1666-0c1b-432e-ad3d-ba98920f0758 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:11.289575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a156e6-68e5-4d00-b256-aa40ee7a7bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:11.290650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a156e6-68e5-4d00-b256-aa40ee7a7bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:11.291050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a156e6-68e5-4d00-b256-aa40ee7a7bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:11.291767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a156e6-68e5-4d00-b256-aa40ee7a7bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:11.292753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a156e6-68e5-4d00-b256-aa40ee7a7bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:11.294438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a156e6-68e5-4d00-b256-aa40ee7a7bb7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:11.363920 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3407/6885] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:11 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:11.383744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec60598-a257-45f8-8d0b-74a3eb976438 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:11.425259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec60598-a257-45f8-8d0b-74a3eb976438 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:11.447132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b9ca9-5195-4f5d-bc38-b5163464f47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:11.448247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b9ca9-5195-4f5d-bc38-b5163464f47d admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:11.450390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b9ca9-5195-4f5d-bc38-b5163464f47d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:11.451532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b9ca9-5195-4f5d-bc38-b5163464f47d admin admin] PATH_INFO: `/v3/projects/c9ba4bc660004c57923750e912fde569/users/23897271518048dcb309e51fd2105376/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:11.485465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b9ca9-5195-4f5d-bc38-b5163464f47d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ba4bc660004c57923750e912fde569, user_id=23897271518048dcb309e51fd2105376, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:11.489561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b9ca9-5195-4f5d-bc38-b5163464f47d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:11.592229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a156e6-68e5-4d00-b256-aa40ee7a7bb7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:11.593160 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3479/6886] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:11 2022] PUT /identity/v3/projects/c9ba4bc660004c57923750e912fde569/users/23897271518048dcb309e51fd2105376/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:11.594889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-45a156e6-68e5-4d00-b256-aa40ee7a7bb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:11.605886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd8fb3-ab06-4d03-82a8-e2118c6817a9 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:11.606220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd8fb3-ab06-4d03-82a8-e2118c6817a9 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:11.606504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd8fb3-ab06-4d03-82a8-e2118c6817a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:11.636845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a156e6-68e5-4d00-b256-aa40ee7a7bb7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:11.703898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5fbd8fb3-ab06-4d03-82a8-e2118c6817a9 None None] MFA Rules not processed for user `23897271518048dcb309e51fd2105376`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:11.703898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5fbd8fb3-ab06-4d03-82a8-e2118c6817a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:11.809020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0bf45-e181-45cc-adb5-dae10acd19b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:11.810155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0bf45-e181-45cc-adb5-dae10acd19b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:11.810449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0bf45-e181-45cc-adb5-dae10acd19b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:11.810728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0bf45-e181-45cc-adb5-dae10acd19b8 admin admin] PATH_INFO: `/v3/projects/84dacb8d667a4206bd07370d42d408ec` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:11.813619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0bf45-e181-45cc-adb5-dae10acd19b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84dacb8d667a4206bd07370d42d408ec)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:11.816309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0bf45-e181-45cc-adb5-dae10acd19b8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:11.866815 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3480/6887] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:11.881247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd8fb3-ab06-4d03-82a8-e2118c6817a9 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:11.883368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5fbd8fb3-ab06-4d03-82a8-e2118c6817a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:11.967833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd8fb3-ab06-4d03-82a8-e2118c6817a9 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:11.970551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5790a383-4ed6-4507-bb63-8052636e3766 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:11.971966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790a383-4ed6-4507-bb63-8052636e3766 service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:11.972335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790a383-4ed6-4507-bb63-8052636e3766 service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:11.972620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5790a383-4ed6-4507-bb63-8052636e3766 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:11.974858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5790a383-4ed6-4507-bb63-8052636e3766 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:12.012919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f8c0bf45-e181-45cc-adb5-dae10acd19b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84dacb8d667a4206bd07370d42d408ec', 'request_id': 'req-f8c0bf45-e181-45cc-adb5-dae10acd19b8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:12.068887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790a383-4ed6-4507-bb63-8052636e3766 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:12.070427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5790a383-4ed6-4507-bb63-8052636e3766 service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:12.091881 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3481/6888] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:12.105721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f8c0bf45-e181-45cc-adb5-dae10acd19b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84dacb8d667a4206bd07370d42d408ec', 'request_id': 'req-f8c0bf45-e181-45cc-adb5-dae10acd19b8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:12.134279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f8c0bf45-e181-45cc-adb5-dae10acd19b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84dacb8d667a4206bd07370d42d408ec', 'request_id': 'req-f8c0bf45-e181-45cc-adb5-dae10acd19b8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:12.157150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f8c0bf45-e181-45cc-adb5-dae10acd19b8 admin admin] The token cache is being invalidate because project 84dacb8d667a4206bd07370d42d408ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:12.157980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f8c0bf45-e181-45cc-adb5-dae10acd19b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:12.160521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f8c0bf45-e181-45cc-adb5-dae10acd19b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:12.164976 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3408/6889] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:11 2022] DELETE /identity/v3/projects/84dacb8d667a4206bd07370d42d408ec => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:42:12.176755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbbff8-733f-42c8-895a-149fa945a1b4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:12.177114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbbff8-733f-42c8-895a-149fa945a1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:12.177473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fbbff8-733f-42c8-895a-149fa945a1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:12.191381 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:12.218005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-35fbbff8-733f-42c8-895a-149fa945a1b4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:12.225006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-35fbbff8-733f-42c8-895a-149fa945a1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:12.237354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf22445-4cfc-4b32-b723-d9b525b1f98c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:12.237734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf22445-4cfc-4b32-b723-d9b525b1f98c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:12.238251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf22445-4cfc-4b32-b723-d9b525b1f98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:12.261236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1bf22445-4cfc-4b32-b723-d9b525b1f98c None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:12.262798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1bf22445-4cfc-4b32-b723-d9b525b1f98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:12.388914 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3482/6890] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:12.393136 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3409/6891] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:42:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:42:12.394842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8695b0-8e30-4eca-8488-e75658b67396 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:12.396608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8695b0-8e30-4eca-8488-e75658b67396 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:12.405093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8695b0-8e30-4eca-8488-e75658b67396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:12.407700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf22445-4cfc-4b32-b723-d9b525b1f98c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:12.409989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1bf22445-4cfc-4b32-b723-d9b525b1f98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:12.446771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8f8695b0-8e30-4eca-8488-e75658b67396 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:12.447503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8f8695b0-8e30-4eca-8488-e75658b67396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:12.459349 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3483/6892] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:12.484311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882180d0-ea85-467c-a76b-894f9bb4ab4a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:12.484921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882180d0-ea85-467c-a76b-894f9bb4ab4a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:12.485542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882180d0-ea85-467c-a76b-894f9bb4ab4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:12.535898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf22445-4cfc-4b32-b723-d9b525b1f98c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:12.547560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed75e2-f5dc-480b-a6fe-49f665a0b5b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:12.550158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed75e2-f5dc-480b-a6fe-49f665a0b5b5 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:12.550527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed75e2-f5dc-480b-a6fe-49f665a0b5b5 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:12.551361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ed75e2-f5dc-480b-a6fe-49f665a0b5b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:12.561164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-882180d0-ea85-467c-a76b-894f9bb4ab4a None None] MFA Rules not processed for user `4da804ebc57f46ee99a1eb94cf59fded`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:12.562540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-882180d0-ea85-467c-a76b-894f9bb4ab4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:12.572290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed75e2-f5dc-480b-a6fe-49f665a0b5b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:12.586752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ed75e2-f5dc-480b-a6fe-49f665a0b5b5 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:12.623360 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3410/6893] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:42:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:42:12.624294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed75e2-f5dc-480b-a6fe-49f665a0b5b5 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:12.658285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ed75e2-f5dc-480b-a6fe-49f665a0b5b5 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:12.666664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bee668-3a7b-49bf-b916-eaa9917682a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:12.667801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bee668-3a7b-49bf-b916-eaa9917682a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:12.668299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bee668-3a7b-49bf-b916-eaa9917682a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:12.668993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bee668-3a7b-49bf-b916-eaa9917682a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:12.670146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bee668-3a7b-49bf-b916-eaa9917682a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:42:12.670954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bee668-3a7b-49bf-b916-eaa9917682a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:12.673013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bee668-3a7b-49bf-b916-eaa9917682a3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:12.703457 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3411/6894] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:42:12.708382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bee668-3a7b-49bf-b916-eaa9917682a3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:12.713213 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3484/6895] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:12.714593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882180d0-ea85-467c-a76b-894f9bb4ab4a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:12.716436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-882180d0-ea85-467c-a76b-894f9bb4ab4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:12.727374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bee668-3a7b-49bf-b916-eaa9917682a3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:12.748214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5bb30-f239-411d-bf01-b9eb5a18bf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:12.748980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5bb30-f239-411d-bf01-b9eb5a18bf6e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:12.749358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5bb30-f239-411d-bf01-b9eb5a18bf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:12.749709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5bb30-f239-411d-bf01-b9eb5a18bf6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:12.750525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5bb30-f239-411d-bf01-b9eb5a18bf6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:12.755538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d5bb30-f239-411d-bf01-b9eb5a18bf6e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:12.829444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882180d0-ea85-467c-a76b-894f9bb4ab4a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:12.834694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec889a41-72b5-418e-8b42-5deccfb3c661 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:12.835431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec889a41-72b5-418e-8b42-5deccfb3c661 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:12.835732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec889a41-72b5-418e-8b42-5deccfb3c661 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:12.836099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec889a41-72b5-418e-8b42-5deccfb3c661 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:12.846200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec889a41-72b5-418e-8b42-5deccfb3c661 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:12.848105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec889a41-72b5-418e-8b42-5deccfb3c661 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:12.866516 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3485/6896] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:12.970423 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3412/6897] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:12 2022] POST /identity/v3/projects => generated 373 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:42:12.975438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec889a41-72b5-418e-8b42-5deccfb3c661 service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:12.992145 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:13.014245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec889a41-72b5-418e-8b42-5deccfb3c661 service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:13.150460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339d01e-e513-4578-a2a3-d3a0f9fd615b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:13.151565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339d01e-e513-4578-a2a3-d3a0f9fd615b admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:13.151950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339d01e-e513-4578-a2a3-d3a0f9fd615b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:13.152346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f339d01e-e513-4578-a2a3-d3a0f9fd615b admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:13.153281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339d01e-e513-4578-a2a3-d3a0f9fd615b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:13.156080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f339d01e-e513-4578-a2a3-d3a0f9fd615b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:13.306262 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3486/6898] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:12 2022] POST /identity/v3/users => generated 287 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:13.311472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5bb30-f239-411d-bf01-b9eb5a18bf6e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:13.326603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5bb30-f239-411d-bf01-b9eb5a18bf6e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:13.332737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740d1e4-6eb3-4710-8535-e7c77ca2dfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:13.339129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740d1e4-6eb3-4710-8535-e7c77ca2dfe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:13.339129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740d1e4-6eb3-4710-8535-e7c77ca2dfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:13.339129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740d1e4-6eb3-4710-8535-e7c77ca2dfe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:13.339129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740d1e4-6eb3-4710-8535-e7c77ca2dfe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:13.339129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740d1e4-6eb3-4710-8535-e7c77ca2dfe0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:13.358317 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3413/6899] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:13.359571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339d01e-e513-4578-a2a3-d3a0f9fd615b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:13.388286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f339d01e-e513-4578-a2a3-d3a0f9fd615b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:13.411931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcd4773-acbf-4a0d-b2aa-33f7a970f22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:13.413712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd4773-acbf-4a0d-b2aa-33f7a970f22a admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:13.414506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd4773-acbf-4a0d-b2aa-33f7a970f22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:13.415271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd4773-acbf-4a0d-b2aa-33f7a970f22a admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:13.417405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd4773-acbf-4a0d-b2aa-33f7a970f22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:13.422483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcd4773-acbf-4a0d-b2aa-33f7a970f22a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:13.447744 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3487/6900] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:13.451791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740d1e4-6eb3-4710-8535-e7c77ca2dfe0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:13.480175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740d1e4-6eb3-4710-8535-e7c77ca2dfe0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:13.493948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd2edd-3288-4987-b820-c0a57385cd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:13.495503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd2edd-3288-4987-b820-c0a57385cd5b admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:13.495879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd2edd-3288-4987-b820-c0a57385cd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:13.496727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd2edd-3288-4987-b820-c0a57385cd5b admin admin] PATH_INFO: `/v3/projects/7eb8fd7a78af42669830f35c6cf37290/users/91aa860e7f1e48999ae50b55d1dac8c8/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:13.519286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd2edd-3288-4987-b820-c0a57385cd5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb8fd7a78af42669830f35c6cf37290, user_id=91aa860e7f1e48999ae50b55d1dac8c8, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:13.527730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd2edd-3288-4987-b820-c0a57385cd5b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:13.662752 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3414/6901] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:13 2022] PUT /identity/v3/projects/7eb8fd7a78af42669830f35c6cf37290/users/91aa860e7f1e48999ae50b55d1dac8c8/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:13.676034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93171fa1-b8e7-475c-bc7d-af5e154626b0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:13.677278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93171fa1-b8e7-475c-bc7d-af5e154626b0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:13.678049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93171fa1-b8e7-475c-bc7d-af5e154626b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:13.758513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-93171fa1-b8e7-475c-bc7d-af5e154626b0 None None] MFA Rules not processed for user `91aa860e7f1e48999ae50b55d1dac8c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:13.761944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-93171fa1-b8e7-475c-bc7d-af5e154626b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:13.969123 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3488/6902] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:14.060634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c6a8c-7eec-4312-bbe9-270b40773650 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:14.061173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c6a8c-7eec-4312-bbe9-270b40773650 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:14.061624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c6a8c-7eec-4312-bbe9-270b40773650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:14.118243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5c4c6a8c-7eec-4312-bbe9-270b40773650 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:14.120435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5c4c6a8c-7eec-4312-bbe9-270b40773650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:14.258973 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3415/6903] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:42:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:14.276424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93171fa1-b8e7-475c-bc7d-af5e154626b0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:14.485369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93171fa1-b8e7-475c-bc7d-af5e154626b0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:14.496352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c301e1-a3c4-4c95-a996-a5824040fe9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:14.497510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c301e1-a3c4-4c95-a996-a5824040fe9a service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:14.498254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c301e1-a3c4-4c95-a996-a5824040fe9a service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:14.498778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c301e1-a3c4-4c95-a996-a5824040fe9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:14.512421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c301e1-a3c4-4c95-a996-a5824040fe9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:14.518528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c301e1-a3c4-4c95-a996-a5824040fe9a service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:14.530750 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3489/6904] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:42:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:42:14.824113 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:15.055622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c6a8c-7eec-4312-bbe9-270b40773650 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:15.057669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5c4c6a8c-7eec-4312-bbe9-270b40773650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:15.163971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c6a8c-7eec-4312-bbe9-270b40773650 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:15.190318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eaa679-efa9-47ce-bfe9-04684814ed0c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:15.190894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaa679-efa9-47ce-bfe9-04684814ed0c service glance] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:15.191185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaa679-efa9-47ce-bfe9-04684814ed0c service glance] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:15.191637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eaa679-efa9-47ce-bfe9-04684814ed0c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:15.217716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eaa679-efa9-47ce-bfe9-04684814ed0c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:15.226617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eaa679-efa9-47ce-bfe9-04684814ed0c service glance] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:15.258605 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3416/6905] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:15.366865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c301e1-a3c4-4c95-a996-a5824040fe9a service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:15.369461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-39c301e1-a3c4-4c95-a996-a5824040fe9a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:15.396819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eaa679-efa9-47ce-bfe9-04684814ed0c service glance] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:15.398967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-22eaa679-efa9-47ce-bfe9-04684814ed0c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:15.455290 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:15.580166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c301e1-a3c4-4c95-a996-a5824040fe9a service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:15.587400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626adfc0-48ef-4f0f-9039-63298e3953ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:15.590423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626adfc0-48ef-4f0f-9039-63298e3953ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:15.591196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626adfc0-48ef-4f0f-9039-63298e3953ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:15.591632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626adfc0-48ef-4f0f-9039-63298e3953ac admin admin] PATH_INFO: `/v3/users/30ff710e1cb7493eabc5dbd840ed3078` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:15.593811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626adfc0-48ef-4f0f-9039-63298e3953ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=30ff710e1cb7493eabc5dbd840ed3078)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:15.598390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626adfc0-48ef-4f0f-9039-63298e3953ac admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:15.693804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eaa679-efa9-47ce-bfe9-04684814ed0c service glance] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:15.702373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ffac2e-e11c-470b-afd2-4120a93c28bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:15.704392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffac2e-e11c-470b-afd2-4120a93c28bf service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:15.704692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffac2e-e11c-470b-afd2-4120a93c28bf service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:15.704997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ffac2e-e11c-470b-afd2-4120a93c28bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:15.707942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-10ffac2e-e11c-470b-afd2-4120a93c28bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:15.734679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffac2e-e11c-470b-afd2-4120a93c28bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:15.737292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ffac2e-e11c-470b-afd2-4120a93c28bf service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:15.780727 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3417/6906] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:15.868962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-626adfc0-48ef-4f0f-9039-63298e3953ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30ff710e1cb7493eabc5dbd840ed3078'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:15.881629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-626adfc0-48ef-4f0f-9039-63298e3953ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30ff710e1cb7493eabc5dbd840ed3078'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:15.889033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-626adfc0-48ef-4f0f-9039-63298e3953ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30ff710e1cb7493eabc5dbd840ed3078'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:15.889780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-626adfc0-48ef-4f0f-9039-63298e3953ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30ff710e1cb7493eabc5dbd840ed3078'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:16.037230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-626adfc0-48ef-4f0f-9039-63298e3953ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30ff710e1cb7493eabc5dbd840ed3078'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:16.064168 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3490/6907] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:15 2022] DELETE /identity/v3/users/30ff710e1cb7493eabc5dbd840ed3078 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:16.065657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80502fef-dd7b-4266-bf25-09ec46941e79 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:16.066012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80502fef-dd7b-4266-bf25-09ec46941e79 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:16.066532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80502fef-dd7b-4266-bf25-09ec46941e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:16.125180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-80502fef-dd7b-4266-bf25-09ec46941e79 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:16.125180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-80502fef-dd7b-4266-bf25-09ec46941e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:16.237757 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:16.266198 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3418/6908] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:16.270174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626adfc0-48ef-4f0f-9039-63298e3953ac admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:16.271931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-626adfc0-48ef-4f0f-9039-63298e3953ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:16.393984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626adfc0-48ef-4f0f-9039-63298e3953ac admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:16.398556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d641f-480e-4c1a-b737-745e70659512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:16.399322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d641f-480e-4c1a-b737-745e70659512 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:16.399810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d641f-480e-4c1a-b737-745e70659512 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:16.400416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d641f-480e-4c1a-b737-745e70659512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:16.412935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d641f-480e-4c1a-b737-745e70659512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:16.414680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d641f-480e-4c1a-b737-745e70659512 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:16.432521 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3491/6909] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:16.452864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a353d-bea0-4bb8-a481-62906176954b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:16.453322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a353d-bea0-4bb8-a481-62906176954b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:16.454497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a353d-bea0-4bb8-a481-62906176954b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:16.513801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1a3a353d-bea0-4bb8-a481-62906176954b None None] MFA Rules not processed for user `4da804ebc57f46ee99a1eb94cf59fded`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:16.515417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1a3a353d-bea0-4bb8-a481-62906176954b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:16.559798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d641f-480e-4c1a-b737-745e70659512 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:16.564120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2d3d641f-480e-4c1a-b737-745e70659512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:16.592836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d641f-480e-4c1a-b737-745e70659512 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:16.606065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e04f4-f681-42a3-9c80-d9789276baab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:16.607377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e04f4-f681-42a3-9c80-d9789276baab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:16.607738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e04f4-f681-42a3-9c80-d9789276baab admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:16.608064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e04f4-f681-42a3-9c80-d9789276baab admin admin] PATH_INFO: `/v3/users/95a143e24cd5432ca28d54674d84c900` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:16.611823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e04f4-f681-42a3-9c80-d9789276baab admin admin] RBAC: Authorizing `identity:delete_user(user_id=95a143e24cd5432ca28d54674d84c900)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:16.615349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e04f4-f681-42a3-9c80-d9789276baab admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:16.654194 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3419/6910] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:16.661374 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:16.926662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1c9e04f4-f681-42a3-9c80-d9789276baab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95a143e24cd5432ca28d54674d84c900'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:16.965958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1c9e04f4-f681-42a3-9c80-d9789276baab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95a143e24cd5432ca28d54674d84c900'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:16.983689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1c9e04f4-f681-42a3-9c80-d9789276baab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95a143e24cd5432ca28d54674d84c900'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:17.003143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1c9e04f4-f681-42a3-9c80-d9789276baab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95a143e24cd5432ca28d54674d84c900'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:17.099963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1c9e04f4-f681-42a3-9c80-d9789276baab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95a143e24cd5432ca28d54674d84c900'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:17.108079 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3492/6911] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:16 2022] DELETE /identity/v3/users/95a143e24cd5432ca28d54674d84c900 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:17.117136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddb188-45e0-4c3e-acbe-6078f8802788 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:17.117433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddb188-45e0-4c3e-acbe-6078f8802788 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:17.117723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddb188-45e0-4c3e-acbe-6078f8802788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:17.162021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-fbddb188-45e0-4c3e-acbe-6078f8802788 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:17.182584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fbddb188-45e0-4c3e-acbe-6078f8802788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:17.363886 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=17,keystone:SELECT=80,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:17.370024 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3420/6912] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:17.375383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e04f4-f681-42a3-9c80-d9789276baab admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:17.378069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1c9e04f4-f681-42a3-9c80-d9789276baab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:17.384542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddb188-45e0-4c3e-acbe-6078f8802788 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:17.385953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fbddb188-45e0-4c3e-acbe-6078f8802788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:17.548297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddb188-45e0-4c3e-acbe-6078f8802788 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:17.557145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5ec30-7723-4358-8f07-070f5a277c1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:17.557873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5ec30-7723-4358-8f07-070f5a277c1c service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:17.558195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5ec30-7723-4358-8f07-070f5a277c1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:17.558481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5ec30-7723-4358-8f07-070f5a277c1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:17.566639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e04f4-f681-42a3-9c80-d9789276baab admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:17.572814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5ec30-7723-4358-8f07-070f5a277c1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:17.573204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6c0646-bcc5-427c-8880-3f054351adbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:17.574120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c0646-bcc5-427c-8880-3f054351adbc service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:17.574488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5ec30-7723-4358-8f07-070f5a277c1c service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:17.575227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c0646-bcc5-427c-8880-3f054351adbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:17.575831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c0646-bcc5-427c-8880-3f054351adbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:17.578553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4e6c0646-bcc5-427c-8880-3f054351adbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:17.596857 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3421/6913] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:17.597450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c0646-bcc5-427c-8880-3f054351adbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:17.599435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6c0646-bcc5-427c-8880-3f054351adbc service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:17.605834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5ec30-7723-4358-8f07-070f5a277c1c service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:17.609511 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:17.615810 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3493/6914] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:17.619269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-35b5ec30-7723-4358-8f07-070f5a277c1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:17.641682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5ec30-7723-4358-8f07-070f5a277c1c service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:17.649132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a551e8-a221-438c-b917-bbc1652b2bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:17.650190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a551e8-a221-438c-b917-bbc1652b2bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:17.650482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a551e8-a221-438c-b917-bbc1652b2bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:17.650757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a551e8-a221-438c-b917-bbc1652b2bb4 admin admin] PATH_INFO: `/v3/projects/671c22153837483681efca4f51628610` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:17.652063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a551e8-a221-438c-b917-bbc1652b2bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=671c22153837483681efca4f51628610)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:17.654048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a551e8-a221-438c-b917-bbc1652b2bb4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:17.850257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a9a551e8-a221-438c-b917-bbc1652b2bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '671c22153837483681efca4f51628610', 'request_id': 'req-a9a551e8-a221-438c-b917-bbc1652b2bb4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:17.963952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a9a551e8-a221-438c-b917-bbc1652b2bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '671c22153837483681efca4f51628610', 'request_id': 'req-a9a551e8-a221-438c-b917-bbc1652b2bb4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:17.985970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a9a551e8-a221-438c-b917-bbc1652b2bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '671c22153837483681efca4f51628610', 'request_id': 'req-a9a551e8-a221-438c-b917-bbc1652b2bb4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:18.031123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a9a551e8-a221-438c-b917-bbc1652b2bb4 admin admin] The token cache is being invalidate because project 671c22153837483681efca4f51628610 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:18.035599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a9a551e8-a221-438c-b917-bbc1652b2bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:18.036984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a9a551e8-a221-438c-b917-bbc1652b2bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:18.049231 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3422/6915] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:17 2022] DELETE /identity/v3/projects/671c22153837483681efca4f51628610 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:18.057679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb93caf-713b-4868-b0b3-b8bc806aa6e6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:18.067764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb93caf-713b-4868-b0b3-b8bc806aa6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:18.067764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb93caf-713b-4868-b0b3-b8bc806aa6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:18.118013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3eb93caf-713b-4868-b0b3-b8bc806aa6e6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:18.118797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3eb93caf-713b-4868-b0b3-b8bc806aa6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:18.279525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a551e8-a221-438c-b917-bbc1652b2bb4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:18.280888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a9a551e8-a221-438c-b917-bbc1652b2bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:18.311981 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3494/6916] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:18.321850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55e40a-6d47-4987-b527-985fe7a8737b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:18.322185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55e40a-6d47-4987-b527-985fe7a8737b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:18.322522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f55e40a-6d47-4987-b527-985fe7a8737b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:18.348339 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:18.360172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0f55e40a-6d47-4987-b527-985fe7a8737b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:18.362518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0f55e40a-6d47-4987-b527-985fe7a8737b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:18.383936 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3495/6917] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:18.394521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55e40a-6d47-4987-b527-985fe7a8737b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:18.407206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f55e40a-6d47-4987-b527-985fe7a8737b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:18.420091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662ad8d-9744-41d9-b779-4427563b10a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:18.420900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662ad8d-9744-41d9-b779-4427563b10a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:18.421988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662ad8d-9744-41d9-b779-4427563b10a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:18.422471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662ad8d-9744-41d9-b779-4427563b10a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:18.425412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662ad8d-9744-41d9-b779-4427563b10a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:42:18.426362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662ad8d-9744-41d9-b779-4427563b10a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:18.431018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662ad8d-9744-41d9-b779-4427563b10a3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:18.451968 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3496/6918] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:42:18.457020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a551e8-a221-438c-b917-bbc1652b2bb4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:18.457523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662ad8d-9744-41d9-b779-4427563b10a3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:18.464448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc83e6-4c17-444e-b6b8-c89a6b570cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:18.465684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc83e6-4c17-444e-b6b8-c89a6b570cb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:18.466360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc83e6-4c17-444e-b6b8-c89a6b570cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:18.466819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc83e6-4c17-444e-b6b8-c89a6b570cb3 admin admin] PATH_INFO: `/v3/users/91aa860e7f1e48999ae50b55d1dac8c8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:18.469498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc83e6-4c17-444e-b6b8-c89a6b570cb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91aa860e7f1e48999ae50b55d1dac8c8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:18.472780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc83e6-4c17-444e-b6b8-c89a6b570cb3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:18.477474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662ad8d-9744-41d9-b779-4427563b10a3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:18.482963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33704a5a-50d3-489a-bd31-c51b4a9f95c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:18.488075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33704a5a-50d3-489a-bd31-c51b4a9f95c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:18.488075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33704a5a-50d3-489a-bd31-c51b4a9f95c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:18.488075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33704a5a-50d3-489a-bd31-c51b4a9f95c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:18.488075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33704a5a-50d3-489a-bd31-c51b4a9f95c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:18.488075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33704a5a-50d3-489a-bd31-c51b4a9f95c3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:18.500821 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:18.659337 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3497/6919] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:18 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:18.660283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33704a5a-50d3-489a-bd31-c51b4a9f95c3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:18.663739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-33704a5a-50d3-489a-bd31-c51b4a9f95c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:18.771420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cadc83e6-4c17-444e-b6b8-c89a6b570cb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91aa860e7f1e48999ae50b55d1dac8c8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:18.775158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33704a5a-50d3-489a-bd31-c51b4a9f95c3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:18.798016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80065f-5fb0-4172-a16d-c7642b90f825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:18.799308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80065f-5fb0-4172-a16d-c7642b90f825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:18.799909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80065f-5fb0-4172-a16d-c7642b90f825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:18.800386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80065f-5fb0-4172-a16d-c7642b90f825 admin admin] PATH_INFO: `/v3/projects/9d67804916ed4a799674051db1ac37fe` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:18.802442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80065f-5fb0-4172-a16d-c7642b90f825 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d67804916ed4a799674051db1ac37fe)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:18.805356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80065f-5fb0-4172-a16d-c7642b90f825 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:18.813134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cadc83e6-4c17-444e-b6b8-c89a6b570cb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91aa860e7f1e48999ae50b55d1dac8c8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:18.813134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cadc83e6-4c17-444e-b6b8-c89a6b570cb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91aa860e7f1e48999ae50b55d1dac8c8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:18.813134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cadc83e6-4c17-444e-b6b8-c89a6b570cb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91aa860e7f1e48999ae50b55d1dac8c8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:18.823505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cadc83e6-4c17-444e-b6b8-c89a6b570cb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91aa860e7f1e48999ae50b55d1dac8c8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:18.948814 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3423/6920] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:18 2022] DELETE /identity/v3/users/91aa860e7f1e48999ae50b55d1dac8c8 => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:18.950310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc83e6-4c17-444e-b6b8-c89a6b570cb3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:18.952129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cadc83e6-4c17-444e-b6b8-c89a6b570cb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:19.006976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9e80065f-5fb0-4172-a16d-c7642b90f825 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d67804916ed4a799674051db1ac37fe', 'request_id': 'req-9e80065f-5fb0-4172-a16d-c7642b90f825'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:19.015661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9e80065f-5fb0-4172-a16d-c7642b90f825 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d67804916ed4a799674051db1ac37fe', 'request_id': 'req-9e80065f-5fb0-4172-a16d-c7642b90f825'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:19.025045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9e80065f-5fb0-4172-a16d-c7642b90f825 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d67804916ed4a799674051db1ac37fe', 'request_id': 'req-9e80065f-5fb0-4172-a16d-c7642b90f825'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:19.032226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc83e6-4c17-444e-b6b8-c89a6b570cb3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:19.104397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb235e3d-c823-4ef9-a5dc-241973aced7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:19.105134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb235e3d-c823-4ef9-a5dc-241973aced7d service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:19.105478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb235e3d-c823-4ef9-a5dc-241973aced7d service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:19.105772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb235e3d-c823-4ef9-a5dc-241973aced7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:19.108255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fb235e3d-c823-4ef9-a5dc-241973aced7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:19.131005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9e80065f-5fb0-4172-a16d-c7642b90f825 admin admin] The token cache is being invalidate because project 9d67804916ed4a799674051db1ac37fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:19.131834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9e80065f-5fb0-4172-a16d-c7642b90f825 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:19.134477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9e80065f-5fb0-4172-a16d-c7642b90f825 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:19.140060 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3498/6921] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:18 2022] DELETE /identity/v3/projects/9d67804916ed4a799674051db1ac37fe => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:19.147907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80065f-5fb0-4172-a16d-c7642b90f825 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:19.151200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb235e3d-c823-4ef9-a5dc-241973aced7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:19.152848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9e80065f-5fb0-4172-a16d-c7642b90f825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:19.155458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb235e3d-c823-4ef9-a5dc-241973aced7d service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:19.171827 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3424/6922] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:19.173490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0c1b0-5108-47e3-b46f-5900a2e7b733 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:19.174206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0c1b0-5108-47e3-b46f-5900a2e7b733 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:19.175118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0c1b0-5108-47e3-b46f-5900a2e7b733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:19.212355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b1d0c1b0-5108-47e3-b46f-5900a2e7b733 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:19.215358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b1d0c1b0-5108-47e3-b46f-5900a2e7b733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:19.256458 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:19.347908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80065f-5fb0-4172-a16d-c7642b90f825 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:19.363390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a031d-53ca-4130-9095-b34a00acfcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:19.364467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a031d-53ca-4130-9095-b34a00acfcc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:19.364994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a031d-53ca-4130-9095-b34a00acfcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:19.365487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93a031d-53ca-4130-9095-b34a00acfcc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:19.366446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a031d-53ca-4130-9095-b34a00acfcc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:19.368449 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3425/6923] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:19.369419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0c1b0-5108-47e3-b46f-5900a2e7b733 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:19.370843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b1d0c1b0-5108-47e3-b46f-5900a2e7b733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:19.371074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93a031d-53ca-4130-9095-b34a00acfcc3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:19.388893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0c1b0-5108-47e3-b46f-5900a2e7b733 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:19.396153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316b417-f83e-45b4-b7d6-a165dba2c672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:19.399958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316b417-f83e-45b4-b7d6-a165dba2c672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:19.400483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316b417-f83e-45b4-b7d6-a165dba2c672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:19.400962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316b417-f83e-45b4-b7d6-a165dba2c672 admin admin] PATH_INFO: `/v3/users/23897271518048dcb309e51fd2105376` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:19.403420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316b417-f83e-45b4-b7d6-a165dba2c672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23897271518048dcb309e51fd2105376)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:19.407142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316b417-f83e-45b4-b7d6-a165dba2c672 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:19.431380 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:19.498835 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3499/6924] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:19 2022] POST /identity/v3/users => generated 291 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:19.498835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a031d-53ca-4130-9095-b34a00acfcc3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:19.501443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c93a031d-53ca-4130-9095-b34a00acfcc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:19.599100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93a031d-53ca-4130-9095-b34a00acfcc3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:19.603418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948054f-c575-4563-966d-6c0eb444b33f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:19.604095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948054f-c575-4563-966d-6c0eb444b33f service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:19.604387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948054f-c575-4563-966d-6c0eb444b33f service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:19.604671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948054f-c575-4563-966d-6c0eb444b33f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:19.631374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948054f-c575-4563-966d-6c0eb444b33f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:19.634071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948054f-c575-4563-966d-6c0eb444b33f service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:19.644060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6316b417-f83e-45b4-b7d6-a165dba2c672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23897271518048dcb309e51fd2105376'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:19.654504 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3500/6925] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:19.666995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948054f-c575-4563-966d-6c0eb444b33f service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:19.675913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6316b417-f83e-45b4-b7d6-a165dba2c672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23897271518048dcb309e51fd2105376'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:19.677720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6316b417-f83e-45b4-b7d6-a165dba2c672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23897271518048dcb309e51fd2105376'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:19.679044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6316b417-f83e-45b4-b7d6-a165dba2c672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23897271518048dcb309e51fd2105376'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:19.693903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6316b417-f83e-45b4-b7d6-a165dba2c672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23897271518048dcb309e51fd2105376'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:19.696421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948054f-c575-4563-966d-6c0eb444b33f service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:19.721044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da006e46-2f16-467c-9253-b58618c6dcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:19.721927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da006e46-2f16-467c-9253-b58618c6dcac admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:19.722243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da006e46-2f16-467c-9253-b58618c6dcac admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:19.722559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da006e46-2f16-467c-9253-b58618c6dcac admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:19.723268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da006e46-2f16-467c-9253-b58618c6dcac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:19.724890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da006e46-2f16-467c-9253-b58618c6dcac admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:19.740164 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3501/6926] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:19.744117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da006e46-2f16-467c-9253-b58618c6dcac admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:19.745984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-da006e46-2f16-467c-9253-b58618c6dcac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:19.761099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da006e46-2f16-467c-9253-b58618c6dcac admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:19.766471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e84464-3790-45f0-b82e-6f8981a7e8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:19.767772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e84464-3790-45f0-b82e-6f8981a7e8fa admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:19.767772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e84464-3790-45f0-b82e-6f8981a7e8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:19.768050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e84464-3790-45f0-b82e-6f8981a7e8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:19.768804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e84464-3790-45f0-b82e-6f8981a7e8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:19.770461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e84464-3790-45f0-b82e-6f8981a7e8fa admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:19.788415 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3426/6927] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:19 2022] DELETE /identity/v3/users/23897271518048dcb309e51fd2105376 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:19.788678 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3502/6928] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:19.788782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316b417-f83e-45b4-b7d6-a165dba2c672 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:19.944906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316b417-f83e-45b4-b7d6-a165dba2c672 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:19.957366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c54d1f-f24c-47d0-9137-c88fbcbe9f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:19.958354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c54d1f-f24c-47d0-9137-c88fbcbe9f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:19.958626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c54d1f-f24c-47d0-9137-c88fbcbe9f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:19.958907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c54d1f-f24c-47d0-9137-c88fbcbe9f17 admin admin] PATH_INFO: `/v3/projects/3d3f39cdf25948adae37aa63d2f1d390/users/849da2d00436473796fc90577a502f57/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:19.993691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c54d1f-f24c-47d0-9137-c88fbcbe9f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d3f39cdf25948adae37aa63d2f1d390, user_id=849da2d00436473796fc90577a502f57, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:19.997628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c54d1f-f24c-47d0-9137-c88fbcbe9f17 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:20.175145 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3427/6929] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:19 2022] PUT /identity/v3/projects/3d3f39cdf25948adae37aa63d2f1d390/users/849da2d00436473796fc90577a502f57/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:20.178874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f9ca3-0f8d-47ae-b22d-3da1402d4ba7 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:20.179372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f9ca3-0f8d-47ae-b22d-3da1402d4ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:20.179893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f9ca3-0f8d-47ae-b22d-3da1402d4ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:20.216190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-fb2f9ca3-0f8d-47ae-b22d-3da1402d4ba7 None None] MFA Rules not processed for user `849da2d00436473796fc90577a502f57`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:20.220073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fb2f9ca3-0f8d-47ae-b22d-3da1402d4ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:20.340093 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3503/6930] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:20.349844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c54d1f-f24c-47d0-9137-c88fbcbe9f17 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:20.360791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c9c54d1f-f24c-47d0-9137-c88fbcbe9f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:20.449879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c54d1f-f24c-47d0-9137-c88fbcbe9f17 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:20.453759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b55eba-669e-45a3-9099-32b885afee46 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:20.454492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b55eba-669e-45a3-9099-32b885afee46 service glance] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:20.454786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b55eba-669e-45a3-9099-32b885afee46 service glance] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:20.455619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b55eba-669e-45a3-9099-32b885afee46 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:20.465303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b55eba-669e-45a3-9099-32b885afee46 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:20.466792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b55eba-669e-45a3-9099-32b885afee46 service glance] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:20.480333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f9ca3-0f8d-47ae-b22d-3da1402d4ba7 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:20.482782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fb2f9ca3-0f8d-47ae-b22d-3da1402d4ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:20.507996 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:20.528014 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3428/6931] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:20.529935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b55eba-669e-45a3-9099-32b885afee46 service glance] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:20.539031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-27b55eba-669e-45a3-9099-32b885afee46 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:20.554207 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:20.678946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f9ca3-0f8d-47ae-b22d-3da1402d4ba7 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:20.693936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4c474-29b4-4a00-9173-723d5e58a0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:20.694876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4c474-29b4-4a00-9173-723d5e58a0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:20.696202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4c474-29b4-4a00-9173-723d5e58a0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:20.696202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4c474-29b4-4a00-9173-723d5e58a0a1 admin admin] PATH_INFO: `/v3/projects/7eb8fd7a78af42669830f35c6cf37290` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:20.696765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4c474-29b4-4a00-9173-723d5e58a0a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eb8fd7a78af42669830f35c6cf37290)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:20.698732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4c474-29b4-4a00-9173-723d5e58a0a1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:20.769281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b55eba-669e-45a3-9099-32b885afee46 service glance] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:20.776566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34591af-5514-4546-8bf9-39b05b0ae531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:20.778399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34591af-5514-4546-8bf9-39b05b0ae531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:20.779541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34591af-5514-4546-8bf9-39b05b0ae531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:20.779838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34591af-5514-4546-8bf9-39b05b0ae531 admin admin] PATH_INFO: `/v3/projects/c9ba4bc660004c57923750e912fde569` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:20.781662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34591af-5514-4546-8bf9-39b05b0ae531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9ba4bc660004c57923750e912fde569)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:20.787855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34591af-5514-4546-8bf9-39b05b0ae531 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:20.915548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b0a4c474-29b4-4a00-9173-723d5e58a0a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eb8fd7a78af42669830f35c6cf37290', 'request_id': 'req-b0a4c474-29b4-4a00-9173-723d5e58a0a1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:20.949541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b0a4c474-29b4-4a00-9173-723d5e58a0a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eb8fd7a78af42669830f35c6cf37290', 'request_id': 'req-b0a4c474-29b4-4a00-9173-723d5e58a0a1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:20.960577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b0a4c474-29b4-4a00-9173-723d5e58a0a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eb8fd7a78af42669830f35c6cf37290', 'request_id': 'req-b0a4c474-29b4-4a00-9173-723d5e58a0a1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:21.001682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c34591af-5514-4546-8bf9-39b05b0ae531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ba4bc660004c57923750e912fde569', 'request_id': 'req-c34591af-5514-4546-8bf9-39b05b0ae531'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:21.042630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b0a4c474-29b4-4a00-9173-723d5e58a0a1 admin admin] The token cache is being invalidate because project 7eb8fd7a78af42669830f35c6cf37290 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:21.042927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b0a4c474-29b4-4a00-9173-723d5e58a0a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:21.043608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b0a4c474-29b4-4a00-9173-723d5e58a0a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:21.045831 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3504/6932] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:20 2022] DELETE /identity/v3/projects/7eb8fd7a78af42669830f35c6cf37290 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:21.052065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36a610-30d7-40f6-8041-6b3197af395b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:21.052498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36a610-30d7-40f6-8041-6b3197af395b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:21.052782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36a610-30d7-40f6-8041-6b3197af395b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:21.097620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c34591af-5514-4546-8bf9-39b05b0ae531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ba4bc660004c57923750e912fde569', 'request_id': 'req-c34591af-5514-4546-8bf9-39b05b0ae531'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:21.098378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8d36a610-30d7-40f6-8041-6b3197af395b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:21.104221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8d36a610-30d7-40f6-8041-6b3197af395b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:21.112127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c34591af-5514-4546-8bf9-39b05b0ae531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ba4bc660004c57923750e912fde569', 'request_id': 'req-c34591af-5514-4546-8bf9-39b05b0ae531'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:21.142020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c34591af-5514-4546-8bf9-39b05b0ae531 admin admin] The token cache is being invalidate because project c9ba4bc660004c57923750e912fde569 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:21.143078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c34591af-5514-4546-8bf9-39b05b0ae531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:21.146013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c34591af-5514-4546-8bf9-39b05b0ae531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:21.149273 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3429/6933] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:20 2022] DELETE /identity/v3/projects/c9ba4bc660004c57923750e912fde569 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:21.160348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da542c3-1d54-42b5-ad48-88ee6f17ec46 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:21.160669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da542c3-1d54-42b5-ad48-88ee6f17ec46 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:21.161127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da542c3-1d54-42b5-ad48-88ee6f17ec46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:21.227881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8da542c3-1d54-42b5-ad48-88ee6f17ec46 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:21.238092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8da542c3-1d54-42b5-ad48-88ee6f17ec46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:21.268342 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3505/6934] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:21.268342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36a610-30d7-40f6-8041-6b3197af395b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:21.269963 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3430/6935] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:42:21.276154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c39aa-3860-432c-8e03-c7106139ed3b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:21.276800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c39aa-3860-432c-8e03-c7106139ed3b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:21.276917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8d36a610-30d7-40f6-8041-6b3197af395b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:21.277623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c39aa-3860-432c-8e03-c7106139ed3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:21.301517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36a610-30d7-40f6-8041-6b3197af395b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:21.309767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3c6c39aa-3860-432c-8e03-c7106139ed3b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:21.311383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3c6c39aa-3860-432c-8e03-c7106139ed3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:21.317557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d9634-92d9-48e6-b5d6-ffd1f85f7704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:21.318503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d9634-92d9-48e6-b5d6-ffd1f85f7704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:21.318972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d9634-92d9-48e6-b5d6-ffd1f85f7704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:21.319118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8d9634-92d9-48e6-b5d6-ffd1f85f7704 admin admin] PATH_INFO: `/v3/users/849da2d00436473796fc90577a502f57` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:21.320511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d9634-92d9-48e6-b5d6-ffd1f85f7704 admin admin] RBAC: Authorizing `identity:delete_user(user_id=849da2d00436473796fc90577a502f57)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:21.323871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8d9634-92d9-48e6-b5d6-ffd1f85f7704 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:21.338997 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3431/6936] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:21.338997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd6232-2fcd-407e-a0cb-3ba7f856deff None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:21.338997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd6232-2fcd-407e-a0cb-3ba7f856deff None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:21.338997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd6232-2fcd-407e-a0cb-3ba7f856deff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:21.362906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d1fd6232-2fcd-407e-a0cb-3ba7f856deff None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:21.364166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d1fd6232-2fcd-407e-a0cb-3ba7f856deff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:21.365623 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:21.375866 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3432/6937] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:21.377595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd6232-2fcd-407e-a0cb-3ba7f856deff None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:21.390852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fd6232-2fcd-407e-a0cb-3ba7f856deff None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:21.401133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6025eff-52a4-486d-99d7-d07d2019a657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:21.401921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6025eff-52a4-486d-99d7-d07d2019a657 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:21.402238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6025eff-52a4-486d-99d7-d07d2019a657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:21.402539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6025eff-52a4-486d-99d7-d07d2019a657 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:21.403286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6025eff-52a4-486d-99d7-d07d2019a657 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:42:21.403598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6025eff-52a4-486d-99d7-d07d2019a657 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:21.405428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6025eff-52a4-486d-99d7-d07d2019a657 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:21.420857 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3433/6938] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:42:21.422329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6025eff-52a4-486d-99d7-d07d2019a657 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:21.436549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6025eff-52a4-486d-99d7-d07d2019a657 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:21.453256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf0686-3f76-42b0-93a1-ce0c196b1d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:21.453256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf0686-3f76-42b0-93a1-ce0c196b1d91 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:21.453256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf0686-3f76-42b0-93a1-ce0c196b1d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:21.453256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf0686-3f76-42b0-93a1-ce0c196b1d91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:21.456939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf0686-3f76-42b0-93a1-ce0c196b1d91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:42:21.457433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf0686-3f76-42b0-93a1-ce0c196b1d91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:21.459304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbf0686-3f76-42b0-93a1-ce0c196b1d91 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:21.479779 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3434/6939] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:42:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:42:21.480891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf0686-3f76-42b0-93a1-ce0c196b1d91 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:21.495935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbf0686-3f76-42b0-93a1-ce0c196b1d91 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:21.501397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d27dbe-1bfe-4abd-b8bc-a00a0654258c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:21.503091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d27dbe-1bfe-4abd-b8bc-a00a0654258c admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:21.505154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d27dbe-1bfe-4abd-b8bc-a00a0654258c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:21.505154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d27dbe-1bfe-4abd-b8bc-a00a0654258c admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:21.505154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d27dbe-1bfe-4abd-b8bc-a00a0654258c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:21.507158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d27dbe-1bfe-4abd-b8bc-a00a0654258c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:21.556927 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:21.610203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4d8d9634-92d9-48e6-b5d6-ffd1f85f7704 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '849da2d00436473796fc90577a502f57'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:21.636824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4d8d9634-92d9-48e6-b5d6-ffd1f85f7704 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '849da2d00436473796fc90577a502f57'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:21.671965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4d8d9634-92d9-48e6-b5d6-ffd1f85f7704 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '849da2d00436473796fc90577a502f57'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:21.673327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4d8d9634-92d9-48e6-b5d6-ffd1f85f7704 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '849da2d00436473796fc90577a502f57'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:21.719642 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3435/6940] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:21 2022] POST /identity/v3/projects => generated 391 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:21.724662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d27dbe-1bfe-4abd-b8bc-a00a0654258c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:21.803969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4d8d9634-92d9-48e6-b5d6-ffd1f85f7704 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '849da2d00436473796fc90577a502f57'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:21.834521 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3506/6941] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:21 2022] DELETE /identity/v3/users/849da2d00436473796fc90577a502f57 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:21.836649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d9634-92d9-48e6-b5d6-ffd1f85f7704 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:21.839476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4d8d9634-92d9-48e6-b5d6-ffd1f85f7704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:21.870268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d27dbe-1bfe-4abd-b8bc-a00a0654258c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:21.936564 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:21.962657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082e5469-fdbf-46eb-877c-43a00524b4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:21.963369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e5469-fdbf-46eb-877c-43a00524b4ac admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:21.966680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e5469-fdbf-46eb-877c-43a00524b4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:21.966680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082e5469-fdbf-46eb-877c-43a00524b4ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:21.966680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e5469-fdbf-46eb-877c-43a00524b4ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:21.966680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082e5469-fdbf-46eb-877c-43a00524b4ac admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:21.992664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8d9634-92d9-48e6-b5d6-ffd1f85f7704 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:22.006855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af12c45-66ac-46e5-89ae-ef03cfc9403f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:22.011093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af12c45-66ac-46e5-89ae-ef03cfc9403f admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:22.011442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af12c45-66ac-46e5-89ae-ef03cfc9403f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:22.011890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af12c45-66ac-46e5-89ae-ef03cfc9403f admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:22.012675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af12c45-66ac-46e5-89ae-ef03cfc9403f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:22.015039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af12c45-66ac-46e5-89ae-ef03cfc9403f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:22.094083 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3436/6942] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:21 2022] POST /identity/v3/projects => generated 373 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:22.094083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fae187-329e-4756-91bb-d5a578b72240 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:22.094083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fae187-329e-4756-91bb-d5a578b72240 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:22.094083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fae187-329e-4756-91bb-d5a578b72240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:22.130262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-46fae187-329e-4756-91bb-d5a578b72240 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:22.133802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-46fae187-329e-4756-91bb-d5a578b72240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:22.139319 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3507/6943] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:21 2022] POST /identity/v3/users => generated 296 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:22.140132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af12c45-66ac-46e5-89ae-ef03cfc9403f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:22.142065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5af12c45-66ac-46e5-89ae-ef03cfc9403f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:22.180625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af12c45-66ac-46e5-89ae-ef03cfc9403f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:22.282970 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3437/6944] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:22.285010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fae187-329e-4756-91bb-d5a578b72240 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:22.319467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fae187-329e-4756-91bb-d5a578b72240 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:22.319467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c74ff-16f6-4d8f-b258-2a098588e3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:22.319467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c74ff-16f6-4d8f-b258-2a098588e3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:22.319467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c74ff-16f6-4d8f-b258-2a098588e3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:22.320497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c74ff-16f6-4d8f-b258-2a098588e3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:22.320497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c74ff-16f6-4d8f-b258-2a098588e3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:22.321508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fba24-aad2-48b5-9217-3985deff5084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:22.322320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fba24-aad2-48b5-9217-3985deff5084 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:22.322763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fba24-aad2-48b5-9217-3985deff5084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:22.323553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1fba24-aad2-48b5-9217-3985deff5084 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:22.324623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fba24-aad2-48b5-9217-3985deff5084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:22.327401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1fba24-aad2-48b5-9217-3985deff5084 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:22.329729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c74ff-16f6-4d8f-b258-2a098588e3b2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:22.347475 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3438/6945] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:22.348287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c74ff-16f6-4d8f-b258-2a098588e3b2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:22.350656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9d1c74ff-16f6-4d8f-b258-2a098588e3b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:22.430430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c74ff-16f6-4d8f-b258-2a098588e3b2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:22.434353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16e4c4-667c-4ce9-9a7b-169882ea6815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:22.435101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16e4c4-667c-4ce9-9a7b-169882ea6815 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:22.435379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16e4c4-667c-4ce9-9a7b-169882ea6815 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:22.435699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16e4c4-667c-4ce9-9a7b-169882ea6815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:22.447865 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3508/6946] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:22 2022] POST /identity/v3/users => generated 287 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:22.447865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fba24-aad2-48b5-9217-3985deff5084 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:22.456854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1fba24-aad2-48b5-9217-3985deff5084 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:22.463419 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:22.465241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16e4c4-667c-4ce9-9a7b-169882ea6815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:22.467502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c16e4c4-667c-4ce9-9a7b-169882ea6815 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:22.474003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe49fd-cfff-43f5-898d-8c3b7943cf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:22.474933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe49fd-cfff-43f5-898d-8c3b7943cf59 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:22.475227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe49fd-cfff-43f5-898d-8c3b7943cf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:22.475512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe49fd-cfff-43f5-898d-8c3b7943cf59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:22.476323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe49fd-cfff-43f5-898d-8c3b7943cf59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:22.477896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fe49fd-cfff-43f5-898d-8c3b7943cf59 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:22.491765 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3509/6947] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:22.492752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe49fd-cfff-43f5-898d-8c3b7943cf59 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:22.493168 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3439/6948] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:22.504237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16e4c4-667c-4ce9-9a7b-169882ea6815 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:22.505848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe49fd-cfff-43f5-898d-8c3b7943cf59 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:22.514408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411df55b-ab52-4658-9547-3cc04e9717ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:22.515233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411df55b-ab52-4658-9547-3cc04e9717ff admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:22.517214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411df55b-ab52-4658-9547-3cc04e9717ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:22.517214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411df55b-ab52-4658-9547-3cc04e9717ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:22.521536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411df55b-ab52-4658-9547-3cc04e9717ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:22.524575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411df55b-ab52-4658-9547-3cc04e9717ff admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:22.539639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16e4c4-667c-4ce9-9a7b-169882ea6815 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:22.554316 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3510/6949] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:22.555888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9920e51-b6dd-424f-a776-29a2788d5aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:22.556043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411df55b-ab52-4658-9547-3cc04e9717ff admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:22.557089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9920e51-b6dd-424f-a776-29a2788d5aec admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:22.558836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9920e51-b6dd-424f-a776-29a2788d5aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:22.559138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9920e51-b6dd-424f-a776-29a2788d5aec admin admin] PATH_INFO: `/v3/projects/8d809703d9524deb8273fbfe5867009c/users/8e76ce5de56a4dccb129ba1540bc5a94/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:22.576303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411df55b-ab52-4658-9547-3cc04e9717ff admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:22.583646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4754df-3c05-4ac3-a917-7d5f17f67b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:22.584870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4754df-3c05-4ac3-a917-7d5f17f67b67 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:22.586292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4754df-3c05-4ac3-a917-7d5f17f67b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:22.586712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4754df-3c05-4ac3-a917-7d5f17f67b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:22.588772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4754df-3c05-4ac3-a917-7d5f17f67b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:22.590973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4754df-3c05-4ac3-a917-7d5f17f67b67 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:22.599173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9920e51-b6dd-424f-a776-29a2788d5aec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d809703d9524deb8273fbfe5867009c, user_id=8e76ce5de56a4dccb129ba1540bc5a94, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:22.601971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9920e51-b6dd-424f-a776-29a2788d5aec admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:22.615187 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3511/6950] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:22 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:22.619702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4754df-3c05-4ac3-a917-7d5f17f67b67 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:22.632776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4754df-3c05-4ac3-a917-7d5f17f67b67 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:22.639396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6da9b-08ff-4aa7-8986-cedc8f2e64dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:22.640244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6da9b-08ff-4aa7-8986-cedc8f2e64dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:22.640534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6da9b-08ff-4aa7-8986-cedc8f2e64dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:22.640815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6da9b-08ff-4aa7-8986-cedc8f2e64dc admin admin] PATH_INFO: `/v3/projects/c4270d1ac1a34e87b1cac1439c3c2063/users/4e18806bc98448eb96f4c77784179488/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:22.674194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6da9b-08ff-4aa7-8986-cedc8f2e64dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4270d1ac1a34e87b1cac1439c3c2063, user_id=4e18806bc98448eb96f4c77784179488, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:22.678076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b6da9b-08ff-4aa7-8986-cedc8f2e64dc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:22.724512 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3440/6951] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:22 2022] PUT /identity/v3/projects/8d809703d9524deb8273fbfe5867009c/users/8e76ce5de56a4dccb129ba1540bc5a94/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:22.737943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565f85b-39e3-40b5-a82d-d4f26d6baf18 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:22.738495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565f85b-39e3-40b5-a82d-d4f26d6baf18 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:22.738777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565f85b-39e3-40b5-a82d-d4f26d6baf18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:22.783694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6565f85b-39e3-40b5-a82d-d4f26d6baf18 None None] MFA Rules not processed for user `8e76ce5de56a4dccb129ba1540bc5a94`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:22.784953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6565f85b-39e3-40b5-a82d-d4f26d6baf18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:22.805710 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3512/6952] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:22 2022] PUT /identity/v3/projects/c4270d1ac1a34e87b1cac1439c3c2063/users/4e18806bc98448eb96f4c77784179488/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:22.818023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36df51c-07d7-4689-aa1c-00deb889c064 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:22.818526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36df51c-07d7-4689-aa1c-00deb889c064 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:22.818807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36df51c-07d7-4689-aa1c-00deb889c064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:22.861881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b36df51c-07d7-4689-aa1c-00deb889c064 None None] MFA Rules not processed for user `4e18806bc98448eb96f4c77784179488`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:22.863611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b36df51c-07d7-4689-aa1c-00deb889c064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:22.886306 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3441/6953] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:42:22.891557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565f85b-39e3-40b5-a82d-d4f26d6baf18 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:22.993638 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3513/6954] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:23.021880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36df51c-07d7-4689-aa1c-00deb889c064 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:23.022130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565f85b-39e3-40b5-a82d-d4f26d6baf18 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:23.023458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b36df51c-07d7-4689-aa1c-00deb889c064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:23.078438 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:23.153097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36df51c-07d7-4689-aa1c-00deb889c064 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:23.162444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c5e74-1aa7-4c39-82dc-af31e7ee23c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:23.163186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c5e74-1aa7-4c39-82dc-af31e7ee23c0 service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:23.163567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c5e74-1aa7-4c39-82dc-af31e7ee23c0 service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:23.163767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c5e74-1aa7-4c39-82dc-af31e7ee23c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:23.180872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c5e74-1aa7-4c39-82dc-af31e7ee23c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:23.182429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c5e74-1aa7-4c39-82dc-af31e7ee23c0 service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:23.185587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad1dd5-03aa-42b6-ba44-5b6d4a9d9d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:23.185587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad1dd5-03aa-42b6-ba44-5b6d4a9d9d60 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:23.185587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad1dd5-03aa-42b6-ba44-5b6d4a9d9d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:23.185587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ad1dd5-03aa-42b6-ba44-5b6d4a9d9d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:23.185914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad1dd5-03aa-42b6-ba44-5b6d4a9d9d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:23.187885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ad1dd5-03aa-42b6-ba44-5b6d4a9d9d60 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:23.193183 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3514/6955] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:42:23.337772 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3442/6956] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:22 2022] POST /identity/v3/projects => generated 391 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:23.340488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c5e74-1aa7-4c39-82dc-af31e7ee23c0 service glance] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:23.364726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c5e74-1aa7-4c39-82dc-af31e7ee23c0 service glance] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:23.500666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc94ef-7752-4339-bc21-bb12688c7c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:23.502062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc94ef-7752-4339-bc21-bb12688c7c6b admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:23.502062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc94ef-7752-4339-bc21-bb12688c7c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:23.502062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc94ef-7752-4339-bc21-bb12688c7c6b admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:23.503250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc94ef-7752-4339-bc21-bb12688c7c6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:23.506442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc94ef-7752-4339-bc21-bb12688c7c6b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:23.603541 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3515/6957] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:23 2022] POST /identity/v3/users => generated 302 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:23.607788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad1dd5-03aa-42b6-ba44-5b6d4a9d9d60 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:23.622151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ad1dd5-03aa-42b6-ba44-5b6d4a9d9d60 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:23.639552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc4395-9c78-4efd-8fc7-ced39f18c8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:23.641282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc4395-9c78-4efd-8fc7-ced39f18c8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:23.641937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc4395-9c78-4efd-8fc7-ced39f18c8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:23.642386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc4395-9c78-4efd-8fc7-ced39f18c8f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:23.643262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc4395-9c78-4efd-8fc7-ced39f18c8f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:23.646267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc4395-9c78-4efd-8fc7-ced39f18c8f9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:23.678512 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3443/6958] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:23.682938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc94ef-7752-4339-bc21-bb12688c7c6b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:23.696481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc94ef-7752-4339-bc21-bb12688c7c6b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:23.705421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce16149-7a41-4b1d-83fa-2f6de06f924b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:23.706868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce16149-7a41-4b1d-83fa-2f6de06f924b admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:23.707418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce16149-7a41-4b1d-83fa-2f6de06f924b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:23.707945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce16149-7a41-4b1d-83fa-2f6de06f924b admin admin] PATH_INFO: `/v3/projects/e953d7fb5e2149e1b845a153cbe3d386/users/5abc97fa9e0a4bd4923183b477b9e1bd/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:23.723449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc4395-9c78-4efd-8fc7-ced39f18c8f9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:23.727099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6bcc4395-9c78-4efd-8fc7-ced39f18c8f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:23.757769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce16149-7a41-4b1d-83fa-2f6de06f924b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e953d7fb5e2149e1b845a153cbe3d386, user_id=5abc97fa9e0a4bd4923183b477b9e1bd, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:23.759476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc4395-9c78-4efd-8fc7-ced39f18c8f9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:23.765506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce16149-7a41-4b1d-83fa-2f6de06f924b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:23.772644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf968dd-ac7b-4623-8e42-efe25d6ebe87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:23.776250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf968dd-ac7b-4623-8e42-efe25d6ebe87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:23.776797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf968dd-ac7b-4623-8e42-efe25d6ebe87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:23.777427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf968dd-ac7b-4623-8e42-efe25d6ebe87 admin admin] PATH_INFO: `/v3/projects/3d3f39cdf25948adae37aa63d2f1d390` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:23.779228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf968dd-ac7b-4623-8e42-efe25d6ebe87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d3f39cdf25948adae37aa63d2f1d390)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:23.781480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf968dd-ac7b-4623-8e42-efe25d6ebe87 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:23.872777 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3516/6959] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:23 2022] PUT /identity/v3/projects/e953d7fb5e2149e1b845a153cbe3d386/users/5abc97fa9e0a4bd4923183b477b9e1bd/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:23.874191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3240e9-744a-459e-849c-9ad55908c197 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:23.874544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3240e9-744a-459e-849c-9ad55908c197 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:23.874849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3240e9-744a-459e-849c-9ad55908c197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:23.934852 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ff3240e9-744a-459e-849c-9ad55908c197 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:23.936174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ff3240e9-744a-459e-849c-9ad55908c197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:23.966318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dbf968dd-ac7b-4623-8e42-efe25d6ebe87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d3f39cdf25948adae37aa63d2f1d390', 'request_id': 'req-dbf968dd-ac7b-4623-8e42-efe25d6ebe87'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:24.049459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dbf968dd-ac7b-4623-8e42-efe25d6ebe87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d3f39cdf25948adae37aa63d2f1d390', 'request_id': 'req-dbf968dd-ac7b-4623-8e42-efe25d6ebe87'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:24.061180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dbf968dd-ac7b-4623-8e42-efe25d6ebe87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d3f39cdf25948adae37aa63d2f1d390', 'request_id': 'req-dbf968dd-ac7b-4623-8e42-efe25d6ebe87'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:24.077963 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3517/6960] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:42:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:24.079201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3240e9-744a-459e-849c-9ad55908c197 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:24.093355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dbf968dd-ac7b-4623-8e42-efe25d6ebe87 admin admin] The token cache is being invalidate because project 3d3f39cdf25948adae37aa63d2f1d390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:24.094957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dbf968dd-ac7b-4623-8e42-efe25d6ebe87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:24.096371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dbf968dd-ac7b-4623-8e42-efe25d6ebe87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:24.100333 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3444/6961] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:23 2022] DELETE /identity/v3/projects/3d3f39cdf25948adae37aa63d2f1d390 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:24.102636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf968dd-ac7b-4623-8e42-efe25d6ebe87 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:24.105148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-dbf968dd-ac7b-4623-8e42-efe25d6ebe87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:24.228193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3240e9-744a-459e-849c-9ad55908c197 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:24.237063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf968dd-ac7b-4623-8e42-efe25d6ebe87 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:24.241609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fad8e-0f14-4700-8a58-d8351f07ed17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:24.243557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03b2dd-33ee-4316-bcb6-544b3cbd52fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:24.244205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03b2dd-33ee-4316-bcb6-544b3cbd52fb service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:24.244599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03b2dd-33ee-4316-bcb6-544b3cbd52fb service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:24.244980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03b2dd-33ee-4316-bcb6-544b3cbd52fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:24.245299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fad8e-0f14-4700-8a58-d8351f07ed17 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:24.247093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fad8e-0f14-4700-8a58-d8351f07ed17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:24.247934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ee03b2dd-33ee-4316-bcb6-544b3cbd52fb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:24.248274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fad8e-0f14-4700-8a58-d8351f07ed17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:24.252643 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:24.254399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0fad8e-0f14-4700-8a58-d8351f07ed17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:24.260197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0fad8e-0f14-4700-8a58-d8351f07ed17 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:24.261431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03b2dd-33ee-4316-bcb6-544b3cbd52fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:24.263380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee03b2dd-33ee-4316-bcb6-544b3cbd52fb service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:24.288658 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3445/6962] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:42:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:42:24.294838 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3518/6963] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:24.294838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fad8e-0f14-4700-8a58-d8351f07ed17 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:24.296010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c5402-6d7e-4935-913d-c3b1fcaabb50 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:24.296523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c5402-6d7e-4935-913d-c3b1fcaabb50 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:24.297063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c5402-6d7e-4935-913d-c3b1fcaabb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:24.297245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5a0fad8e-0f14-4700-8a58-d8351f07ed17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:24.340525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d33c5402-6d7e-4935-913d-c3b1fcaabb50 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:24.345013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d33c5402-6d7e-4935-913d-c3b1fcaabb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:24.363020 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3446/6964] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:24.363020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c5402-6d7e-4935-913d-c3b1fcaabb50 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:24.363020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d33c5402-6d7e-4935-913d-c3b1fcaabb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:24.378560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c5402-6d7e-4935-913d-c3b1fcaabb50 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:24.384490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b738ef9-0b61-414c-bc07-b94f6b0e2b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:24.385636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b738ef9-0b61-414c-bc07-b94f6b0e2b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:24.386298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b738ef9-0b61-414c-bc07-b94f6b0e2b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:24.386677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b738ef9-0b61-414c-bc07-b94f6b0e2b67 admin admin] PATH_INFO: `/v3/projects/e953d7fb5e2149e1b845a153cbe3d386/users/5abc97fa9e0a4bd4923183b477b9e1bd/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:24.388877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b738ef9-0b61-414c-bc07-b94f6b0e2b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e953d7fb5e2149e1b845a153cbe3d386, user_id=5abc97fa9e0a4bd4923183b477b9e1bd, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:24.392188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b738ef9-0b61-414c-bc07-b94f6b0e2b67 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:24.419637 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3447/6965] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:24 2022] PUT /identity/v3/projects/e953d7fb5e2149e1b845a153cbe3d386/users/5abc97fa9e0a4bd4923183b477b9e1bd/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:24.436778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da935e32-65f8-4850-be49-02648aca2e7d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:24.437072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da935e32-65f8-4850-be49-02648aca2e7d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:24.437341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da935e32-65f8-4850-be49-02648aca2e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:24.498428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fad8e-0f14-4700-8a58-d8351f07ed17 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:24.500689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-da935e32-65f8-4850-be49-02648aca2e7d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:24.504582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-da935e32-65f8-4850-be49-02648aca2e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:24.633759 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3448/6966] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:24.636769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848306c3-573c-4867-b679-d87220d702e9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:24.637587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848306c3-573c-4867-b679-d87220d702e9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:24.638716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848306c3-573c-4867-b679-d87220d702e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:24.639545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aafcc9-1eb7-4bbe-8a18-199b0ba8a0f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:24.640388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aafcc9-1eb7-4bbe-8a18-199b0ba8a0f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:24.642212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aafcc9-1eb7-4bbe-8a18-199b0ba8a0f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:24.643432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aafcc9-1eb7-4bbe-8a18-199b0ba8a0f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:24.647603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-33aafcc9-1eb7-4bbe-8a18-199b0ba8a0f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:24.675117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aafcc9-1eb7-4bbe-8a18-199b0ba8a0f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:24.677156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aafcc9-1eb7-4bbe-8a18-199b0ba8a0f1 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:24.698375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-848306c3-573c-4867-b679-d87220d702e9 None None] MFA Rules not processed for user `5abc97fa9e0a4bd4923183b477b9e1bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:24.701597 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3519/6967] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:24.703003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aafcc9-1eb7-4bbe-8a18-199b0ba8a0f1 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:24.704334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-848306c3-573c-4867-b679-d87220d702e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:24.731494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aafcc9-1eb7-4bbe-8a18-199b0ba8a0f1 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:24.746932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84cfe4-ef17-44a5-bab8-349b3db88fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:24.748184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84cfe4-ef17-44a5-bab8-349b3db88fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:24.748726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84cfe4-ef17-44a5-bab8-349b3db88fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:24.749231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84cfe4-ef17-44a5-bab8-349b3db88fc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:24.750271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84cfe4-ef17-44a5-bab8-349b3db88fc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:42:24.750993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84cfe4-ef17-44a5-bab8-349b3db88fc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:24.753552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84cfe4-ef17-44a5-bab8-349b3db88fc0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:24.788071 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3520/6968] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:42:24.796152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84cfe4-ef17-44a5-bab8-349b3db88fc0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:24.819641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84cfe4-ef17-44a5-bab8-349b3db88fc0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:24.834739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5078ef0-02a3-4f5e-9b2a-ab5b21dd1334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:24.839197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5078ef0-02a3-4f5e-9b2a-ab5b21dd1334 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:24.839197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5078ef0-02a3-4f5e-9b2a-ab5b21dd1334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:24.839197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5078ef0-02a3-4f5e-9b2a-ab5b21dd1334 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:24.839197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5078ef0-02a3-4f5e-9b2a-ab5b21dd1334 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:24.845619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5078ef0-02a3-4f5e-9b2a-ab5b21dd1334 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:24.872173 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3449/6969] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:24.907757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848306c3-573c-4867-b679-d87220d702e9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:24.932868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848306c3-573c-4867-b679-d87220d702e9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:24.936854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b3cd0-86b8-4edd-a7f1-db423d0e9c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:24.937519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b3cd0-86b8-4edd-a7f1-db423d0e9c94 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:24.937808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b3cd0-86b8-4edd-a7f1-db423d0e9c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:24.938090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b3cd0-86b8-4edd-a7f1-db423d0e9c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:24.952320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-548b3cd0-86b8-4edd-a7f1-db423d0e9c94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:25.011701 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:25.023253 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3521/6970] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:24 2022] POST /identity/v3/projects => generated 373 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:42:25.024233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5078ef0-02a3-4f5e-9b2a-ab5b21dd1334 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:25.160974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b3cd0-86b8-4edd-a7f1-db423d0e9c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:25.166341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b3cd0-86b8-4edd-a7f1-db423d0e9c94 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:25.170089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5078ef0-02a3-4f5e-9b2a-ab5b21dd1334 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:25.179673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff9c75-d0e0-49c9-8e30-cfc198cee695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:25.180374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff9c75-d0e0-49c9-8e30-cfc198cee695 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:25.180653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff9c75-d0e0-49c9-8e30-cfc198cee695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:25.180930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff9c75-d0e0-49c9-8e30-cfc198cee695 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:25.181662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff9c75-d0e0-49c9-8e30-cfc198cee695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:25.184633 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3450/6971] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:24 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:25.192252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ff9c75-d0e0-49c9-8e30-cfc198cee695 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:25.324654 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3522/6972] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:25 2022] POST /identity/v3/users => generated 287 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:25.328690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b3cd0-86b8-4edd-a7f1-db423d0e9c94 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:25.350889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b3cd0-86b8-4edd-a7f1-db423d0e9c94 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:25.364884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e364054-b11d-4ca0-8fa3-45b50ea7f52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:25.365772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364054-b11d-4ca0-8fa3-45b50ea7f52c admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:25.366385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364054-b11d-4ca0-8fa3-45b50ea7f52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:25.366827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e364054-b11d-4ca0-8fa3-45b50ea7f52c admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:25.367818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e364054-b11d-4ca0-8fa3-45b50ea7f52c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:25.369923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e364054-b11d-4ca0-8fa3-45b50ea7f52c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:25.385890 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3451/6973] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:25.389607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff9c75-d0e0-49c9-8e30-cfc198cee695 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:25.395810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69424b5a-f6ac-4697-b685-a0405b6f5ff9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:25.396628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69424b5a-f6ac-4697-b685-a0405b6f5ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:25.397141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69424b5a-f6ac-4697-b685-a0405b6f5ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:25.424876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff9c75-d0e0-49c9-8e30-cfc198cee695 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:25.435172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482cadc-3c59-4bbe-bd46-7932232d921d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:25.435977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482cadc-3c59-4bbe-bd46-7932232d921d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:25.436270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482cadc-3c59-4bbe-bd46-7932232d921d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:25.436551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482cadc-3c59-4bbe-bd46-7932232d921d admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:25.437302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482cadc-3c59-4bbe-bd46-7932232d921d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:25.441128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482cadc-3c59-4bbe-bd46-7932232d921d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:25.469551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-69424b5a-f6ac-4697-b685-a0405b6f5ff9 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:25.473817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-69424b5a-f6ac-4697-b685-a0405b6f5ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:25.504465 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3523/6974] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:25.506174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482cadc-3c59-4bbe-bd46-7932232d921d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:25.532728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482cadc-3c59-4bbe-bd46-7932232d921d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:25.551402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0194b38-aac4-4e2f-8c7d-0e6947ebdf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:25.552586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0194b38-aac4-4e2f-8c7d-0e6947ebdf65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:25.553023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0194b38-aac4-4e2f-8c7d-0e6947ebdf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:25.553452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0194b38-aac4-4e2f-8c7d-0e6947ebdf65 admin admin] PATH_INFO: `/v3/projects/7e5066b0588d47719baa94ea6e0dec72/users/57efb5d565464b06adbd0ff69057d029/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:25.591253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0194b38-aac4-4e2f-8c7d-0e6947ebdf65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e5066b0588d47719baa94ea6e0dec72, user_id=57efb5d565464b06adbd0ff69057d029, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:25.594370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0194b38-aac4-4e2f-8c7d-0e6947ebdf65 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:25.677819 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3524/6975] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:25 2022] PUT /identity/v3/projects/7e5066b0588d47719baa94ea6e0dec72/users/57efb5d565464b06adbd0ff69057d029/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:25.699122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb5938-9fe5-478a-8a97-f8fbdae9f85c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:25.699122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb5938-9fe5-478a-8a97-f8fbdae9f85c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:25.699122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb5938-9fe5-478a-8a97-f8fbdae9f85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:25.699122 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:25.723705 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3452/6976] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:42:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:25.724866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69424b5a-f6ac-4697-b685-a0405b6f5ff9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:25.745124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3bbb5938-9fe5-478a-8a97-f8fbdae9f85c None None] MFA Rules not processed for user `57efb5d565464b06adbd0ff69057d029`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:25.746635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3bbb5938-9fe5-478a-8a97-f8fbdae9f85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:25.829008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69424b5a-f6ac-4697-b685-a0405b6f5ff9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:25.949720 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3525/6977] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:25.954753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb5938-9fe5-478a-8a97-f8fbdae9f85c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:25.970865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e3e35-2369-439b-bbe2-238a5ef50df4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:25.971935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e3e35-2369-439b-bbe2-238a5ef50df4 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:25.972234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e3e35-2369-439b-bbe2-238a5ef50df4 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:25.972576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e3e35-2369-439b-bbe2-238a5ef50df4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:26.054255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e3e35-2369-439b-bbe2-238a5ef50df4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:26.056082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935e3e35-2369-439b-bbe2-238a5ef50df4 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:26.073427 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3453/6978] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:42:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:42:26.104599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb5938-9fe5-478a-8a97-f8fbdae9f85c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:26.121765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d99fc-6ae6-437d-bbeb-552815d3e1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:26.121765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d99fc-6ae6-437d-bbeb-552815d3e1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:26.121765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d99fc-6ae6-437d-bbeb-552815d3e1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:26.121765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9d99fc-6ae6-437d-bbeb-552815d3e1d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:26.122325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d99fc-6ae6-437d-bbeb-552815d3e1d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:26.124823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9d99fc-6ae6-437d-bbeb-552815d3e1d2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:26.241522 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3526/6979] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:25 2022] POST /identity/v3/projects => generated 373 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:42:26.245331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e3e35-2369-439b-bbe2-238a5ef50df4 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:26.260960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935e3e35-2369-439b-bbe2-238a5ef50df4 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:26.349873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604c910-8a41-4884-a423-d65c199c41ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:26.350612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604c910-8a41-4884-a423-d65c199c41ef admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:26.350904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604c910-8a41-4884-a423-d65c199c41ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:26.351326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604c910-8a41-4884-a423-d65c199c41ef admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:26.352181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604c910-8a41-4884-a423-d65c199c41ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:26.354401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b604c910-8a41-4884-a423-d65c199c41ef admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:26.467172 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3454/6980] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:26 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:26.473511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d99fc-6ae6-437d-bbeb-552815d3e1d2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:26.491419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9d99fc-6ae6-437d-bbeb-552815d3e1d2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:26.498339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ba75a-70b8-441a-84d2-421ee1cbe873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:26.500356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ba75a-70b8-441a-84d2-421ee1cbe873 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:26.500984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ba75a-70b8-441a-84d2-421ee1cbe873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:26.501428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ba75a-70b8-441a-84d2-421ee1cbe873 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:26.503967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ba75a-70b8-441a-84d2-421ee1cbe873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:26.509356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ba75a-70b8-441a-84d2-421ee1cbe873 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:26.539870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604c910-8a41-4884-a423-d65c199c41ef admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:26.547526 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3527/6981] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:26.548385 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:26.560422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604c910-8a41-4884-a423-d65c199c41ef admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:26.567552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb01c68-0cc1-432d-9a54-6157a2fc397b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:26.571413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb01c68-0cc1-432d-9a54-6157a2fc397b admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:26.571930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb01c68-0cc1-432d-9a54-6157a2fc397b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:26.573338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb01c68-0cc1-432d-9a54-6157a2fc397b admin admin] PATH_INFO: `/v3/projects/da3f9de396f84366b06454d857c46c89/users/86a617b09aba4f619e8f2e34d79c7b2b/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:26.623178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb01c68-0cc1-432d-9a54-6157a2fc397b admin admin] RBAC: Authorizing `identity:create_grant(project_id=da3f9de396f84366b06454d857c46c89, user_id=86a617b09aba4f619e8f2e34d79c7b2b, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:26.625919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb01c68-0cc1-432d-9a54-6157a2fc397b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:26.758868 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3455/6982] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:26 2022] PUT /identity/v3/projects/da3f9de396f84366b06454d857c46c89/users/86a617b09aba4f619e8f2e34d79c7b2b/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:26.768240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ba75a-70b8-441a-84d2-421ee1cbe873 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:26.817362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ba75a-70b8-441a-84d2-421ee1cbe873 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:26.906996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d57943b-7df6-4974-ae03-c0c2daec647f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:26.909528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57943b-7df6-4974-ae03-c0c2daec647f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:26.910809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57943b-7df6-4974-ae03-c0c2daec647f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:26.911825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d57943b-7df6-4974-ae03-c0c2daec647f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:26.914462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57943b-7df6-4974-ae03-c0c2daec647f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:26.918193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d57943b-7df6-4974-ae03-c0c2daec647f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:26.959582 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:26.990354 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3528/6983] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:26 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:26.991711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb01c68-0cc1-432d-9a54-6157a2fc397b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:27.015103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb01c68-0cc1-432d-9a54-6157a2fc397b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:27.020997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4c5be2-0a4f-4772-9fd4-9d702b807472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:27.023743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c5be2-0a4f-4772-9fd4-9d702b807472 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:27.023743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c5be2-0a4f-4772-9fd4-9d702b807472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:27.023743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4c5be2-0a4f-4772-9fd4-9d702b807472 admin admin] PATH_INFO: `/v3/projects/da3f9de396f84366b06454d857c46c89/users/86a617b09aba4f619e8f2e34d79c7b2b/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:27.032061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c5be2-0a4f-4772-9fd4-9d702b807472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da3f9de396f84366b06454d857c46c89, user_id=86a617b09aba4f619e8f2e34d79c7b2b, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:27.035153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4c5be2-0a4f-4772-9fd4-9d702b807472 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:27.058162 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3456/6984] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:26 2022] PUT /identity/v3/projects/da3f9de396f84366b06454d857c46c89/users/86a617b09aba4f619e8f2e34d79c7b2b/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:27.060190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ceccf-f66a-4629-96ee-79a3f915937d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:27.060487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ceccf-f66a-4629-96ee-79a3f915937d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:27.060771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ceccf-f66a-4629-96ee-79a3f915937d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:27.105687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d04ceccf-f66a-4629-96ee-79a3f915937d None None] MFA Rules not processed for user `86a617b09aba4f619e8f2e34d79c7b2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:27.109144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d04ceccf-f66a-4629-96ee-79a3f915937d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:27.155846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bc2cc-ed18-4a6a-9d19-4be58e6a2940 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:27.156379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bc2cc-ed18-4a6a-9d19-4be58e6a2940 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:27.157329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555bc2cc-ed18-4a6a-9d19-4be58e6a2940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:27.209325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-555bc2cc-ed18-4a6a-9d19-4be58e6a2940 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:27.222862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-555bc2cc-ed18-4a6a-9d19-4be58e6a2940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:27.331535 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3529/6985] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:42:27.336441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ceccf-f66a-4629-96ee-79a3f915937d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:27.347508 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3457/6986] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:42:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:42:27.357914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ceccf-f66a-4629-96ee-79a3f915937d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:27.359700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bc2cc-ed18-4a6a-9d19-4be58e6a2940 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:27.366767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e696b-040c-4f97-9460-d266e47de717 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a617b09aba4f619e8f2e34d79c7b2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da3f9de396f84366b06454d857c46c89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:27.368264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e696b-040c-4f97-9460-d266e47de717 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:27.368582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e696b-040c-4f97-9460-d266e47de717 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:27.368846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e696b-040c-4f97-9460-d266e47de717 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:27.370257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e696b-040c-4f97-9460-d266e47de717 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:42:27.370584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e696b-040c-4f97-9460-d266e47de717 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:27.372234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e696b-040c-4f97-9460-d266e47de717 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:27.388003 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3530/6987] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:42:27.392200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e696b-040c-4f97-9460-d266e47de717 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:27.419151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e696b-040c-4f97-9460-d266e47de717 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:27.425132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f02a8-a267-4a78-aa3a-f07e07900b09 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a617b09aba4f619e8f2e34d79c7b2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da3f9de396f84366b06454d857c46c89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:27.425893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f02a8-a267-4a78-aa3a-f07e07900b09 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:27.426322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f02a8-a267-4a78-aa3a-f07e07900b09 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:27.428054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f02a8-a267-4a78-aa3a-f07e07900b09 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:27.428948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f02a8-a267-4a78-aa3a-f07e07900b09 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:27.431002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f02a8-a267-4a78-aa3a-f07e07900b09 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:27.499104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555bc2cc-ed18-4a6a-9d19-4be58e6a2940 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:27.508384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a92e8-086b-4722-aa4b-36c2ef5a7599 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:27.508384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a92e8-086b-4722-aa4b-36c2ef5a7599 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:27.508384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a92e8-086b-4722-aa4b-36c2ef5a7599 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:27.508384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a92e8-086b-4722-aa4b-36c2ef5a7599 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:27.517467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a92e8-086b-4722-aa4b-36c2ef5a7599 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:27.519634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a92e8-086b-4722-aa4b-36c2ef5a7599 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:27.529509 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3458/6988] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:42:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 14:42:27.549361 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3531/6989] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:27 2022] POST /identity/v3/projects => generated 350 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:27.551620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a92e8-086b-4722-aa4b-36c2ef5a7599 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:27.565986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a92e8-086b-4722-aa4b-36c2ef5a7599 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:27.639846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5b334-bc3d-49dd-8178-470689be71fe tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a617b09aba4f619e8f2e34d79c7b2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da3f9de396f84366b06454d857c46c89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:27.640536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5b334-bc3d-49dd-8178-470689be71fe tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:27.640826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5b334-bc3d-49dd-8178-470689be71fe tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:27.641178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5b334-bc3d-49dd-8178-470689be71fe tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:27.641929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5b334-bc3d-49dd-8178-470689be71fe tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:42:27.642284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5b334-bc3d-49dd-8178-470689be71fe tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:27.644561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5b334-bc3d-49dd-8178-470689be71fe tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:27.662035 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3459/6990] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:42:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:42:27.680006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f02a8-a267-4a78-aa3a-f07e07900b09 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:27.685764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-de1f02a8-a267-4a78-aa3a-f07e07900b09 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:27.834992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f02a8-a267-4a78-aa3a-f07e07900b09 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:27.841002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b715fb-c1be-4154-a70d-833189b38797 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:27.843208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b715fb-c1be-4154-a70d-833189b38797 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:27.843520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b715fb-c1be-4154-a70d-833189b38797 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:27.848376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b715fb-c1be-4154-a70d-833189b38797 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:27.878666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b715fb-c1be-4154-a70d-833189b38797 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:27.878666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b715fb-c1be-4154-a70d-833189b38797 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:27.900255 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:27.903928 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3532/6991] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:28.613921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fa597-2113-4adb-a92c-0e0cc5112069 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:28.615037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fa597-2113-4adb-a92c-0e0cc5112069 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:28.615037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64fa597-2113-4adb-a92c-0e0cc5112069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:28.663916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e64fa597-2113-4adb-a92c-0e0cc5112069 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:28.665666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e64fa597-2113-4adb-a92c-0e0cc5112069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:28.746562 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3460/6992] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:42:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:42:28.768812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b715fb-c1be-4154-a70d-833189b38797 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:28.990943 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:29.049278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b715fb-c1be-4154-a70d-833189b38797 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:29.065772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90fd8b2-4955-46ba-bdf2-4377df430d1c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:29.067107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fd8b2-4955-46ba-bdf2-4377df430d1c service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:29.067561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fd8b2-4955-46ba-bdf2-4377df430d1c service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:29.068005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90fd8b2-4955-46ba-bdf2-4377df430d1c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:29.082132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fd8b2-4955-46ba-bdf2-4377df430d1c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:29.084535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90fd8b2-4955-46ba-bdf2-4377df430d1c service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:29.106584 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:29.112102 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3533/6993] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:42:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:42:29.160008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fa597-2113-4adb-a92c-0e0cc5112069 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:29.211360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64fa597-2113-4adb-a92c-0e0cc5112069 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:29.233722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545e57e-aa6b-4b40-8fa8-f21be36c00c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:29.236599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545e57e-aa6b-4b40-8fa8-f21be36c00c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:29.236599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545e57e-aa6b-4b40-8fa8-f21be36c00c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:29.238194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545e57e-aa6b-4b40-8fa8-f21be36c00c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:29.265210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1545e57e-aa6b-4b40-8fa8-f21be36c00c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:29.286389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545e57e-aa6b-4b40-8fa8-f21be36c00c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:29.289146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545e57e-aa6b-4b40-8fa8-f21be36c00c3 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:29.331127 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3461/6994] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:30.266755 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:30.341068 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:30.690371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57453e39-dd3f-4377-b890-f78e7d8203d4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:30.690371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57453e39-dd3f-4377-b890-f78e7d8203d4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:30.690371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57453e39-dd3f-4377-b890-f78e7d8203d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:30.694820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-57453e39-dd3f-4377-b890-f78e7d8203d4 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:30.696314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-57453e39-dd3f-4377-b890-f78e7d8203d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:30.715112 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3534/6995] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:42:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:30.729245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545e57e-aa6b-4b40-8fa8-f21be36c00c3 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:30.757025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545e57e-aa6b-4b40-8fa8-f21be36c00c3 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:30.771123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfc6cac-e249-4510-b02a-998944ebeb2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:30.771872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc6cac-e249-4510-b02a-998944ebeb2d service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:30.772161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc6cac-e249-4510-b02a-998944ebeb2d service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:30.772445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfc6cac-e249-4510-b02a-998944ebeb2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:30.793474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc6cac-e249-4510-b02a-998944ebeb2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:30.795387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfc6cac-e249-4510-b02a-998944ebeb2d service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:30.816432 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3462/6996] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:42:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:42:31.519599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57453e39-dd3f-4377-b890-f78e7d8203d4 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:31.521198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-57453e39-dd3f-4377-b890-f78e7d8203d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:31.580859 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:31.607418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57453e39-dd3f-4377-b890-f78e7d8203d4 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:31.628473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f7a56-3aa6-47ff-95e6-0762d798cc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:31.633616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f7a56-3aa6-47ff-95e6-0762d798cc93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:31.634421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f7a56-3aa6-47ff-95e6-0762d798cc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:31.634854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f7a56-3aa6-47ff-95e6-0762d798cc93 admin admin] PATH_INFO: `/v3/users/0c1f57fe8a6741d8925623fa4966b895` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:31.638433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f7a56-3aa6-47ff-95e6-0762d798cc93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c1f57fe8a6741d8925623fa4966b895)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:31.643616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f7a56-3aa6-47ff-95e6-0762d798cc93 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:31.673419 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:31.957185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b02f7a56-3aa6-47ff-95e6-0762d798cc93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c1f57fe8a6741d8925623fa4966b895'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:31.968841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cd32f-da80-4eac-a3f0-c602654ef338 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:31.969452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cd32f-da80-4eac-a3f0-c602654ef338 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:31.969963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3cd32f-da80-4eac-a3f0-c602654ef338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:31.982458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b02f7a56-3aa6-47ff-95e6-0762d798cc93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c1f57fe8a6741d8925623fa4966b895'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:32.007504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b02f7a56-3aa6-47ff-95e6-0762d798cc93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c1f57fe8a6741d8925623fa4966b895'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:32.014432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b02f7a56-3aa6-47ff-95e6-0762d798cc93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c1f57fe8a6741d8925623fa4966b895'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:32.066563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9d3cd32f-da80-4eac-a3f0-c602654ef338 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:32.069707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9d3cd32f-da80-4eac-a3f0-c602654ef338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:32.093016 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3463/6997] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:42:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:32.109147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cd32f-da80-4eac-a3f0-c602654ef338 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:32.110067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b02f7a56-3aa6-47ff-95e6-0762d798cc93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c1f57fe8a6741d8925623fa4966b895'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:32.120516 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3535/6998] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:31 2022] DELETE /identity/v3/users/0c1f57fe8a6741d8925623fa4966b895 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:32.125335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c16ab-d88e-4bc8-8218-e43b8e4a10f2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:32.125847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c16ab-d88e-4bc8-8218-e43b8e4a10f2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:32.128272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c16ab-d88e-4bc8-8218-e43b8e4a10f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:32.151901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3cd32f-da80-4eac-a3f0-c602654ef338 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:32.162946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2c2c16ab-d88e-4bc8-8218-e43b8e4a10f2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:32.165571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2c2c16ab-d88e-4bc8-8218-e43b8e4a10f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:32.295293 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3536/6999] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:32.304608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c16ab-d88e-4bc8-8218-e43b8e4a10f2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:32.306348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2c2c16ab-d88e-4bc8-8218-e43b8e4a10f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:32.355834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336404d-28e8-4e34-a0c4-337da2e915fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:32.356826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336404d-28e8-4e34-a0c4-337da2e915fb service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:32.361151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336404d-28e8-4e34-a0c4-337da2e915fb service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:32.368828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336404d-28e8-4e34-a0c4-337da2e915fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:32.368828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9336404d-28e8-4e34-a0c4-337da2e915fb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:32.443536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c16ab-d88e-4bc8-8218-e43b8e4a10f2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:32.447831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a418961-193b-42e4-aeb3-076fdf6b824b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:32.455046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a418961-193b-42e4-aeb3-076fdf6b824b service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:32.455046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a418961-193b-42e4-aeb3-076fdf6b824b service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:32.455046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a418961-193b-42e4-aeb3-076fdf6b824b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:32.472656 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:32.483257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a418961-193b-42e4-aeb3-076fdf6b824b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:32.484860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a418961-193b-42e4-aeb3-076fdf6b824b service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:32.512047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336404d-28e8-4e34-a0c4-337da2e915fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:32.514478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9336404d-28e8-4e34-a0c4-337da2e915fb service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:32.515088 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3537/7000] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:42:32.526982 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3464/7001] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:42:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 14:42:32.893985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a418961-193b-42e4-aeb3-076fdf6b824b service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:32.898662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0a418961-193b-42e4-aeb3-076fdf6b824b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:32.918188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a418961-193b-42e4-aeb3-076fdf6b824b service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:32.936188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37c02f-d72a-4b42-ad55-0fb8758007f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:32.936188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37c02f-d72a-4b42-ad55-0fb8758007f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:32.936188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37c02f-d72a-4b42-ad55-0fb8758007f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:32.936188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37c02f-d72a-4b42-ad55-0fb8758007f9 admin admin] PATH_INFO: `/v3/projects/fda6ebe15e1b4fa28227e04c4c6547d6` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:32.937068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37c02f-d72a-4b42-ad55-0fb8758007f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fda6ebe15e1b4fa28227e04c4c6547d6)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:32.947460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37c02f-d72a-4b42-ad55-0fb8758007f9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:33.151085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd37c02f-d72a-4b42-ad55-0fb8758007f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fda6ebe15e1b4fa28227e04c4c6547d6', 'request_id': 'req-dd37c02f-d72a-4b42-ad55-0fb8758007f9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:33.193506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd37c02f-d72a-4b42-ad55-0fb8758007f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fda6ebe15e1b4fa28227e04c4c6547d6', 'request_id': 'req-dd37c02f-d72a-4b42-ad55-0fb8758007f9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:33.216113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd37c02f-d72a-4b42-ad55-0fb8758007f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fda6ebe15e1b4fa28227e04c4c6547d6', 'request_id': 'req-dd37c02f-d72a-4b42-ad55-0fb8758007f9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:33.312014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd37c02f-d72a-4b42-ad55-0fb8758007f9 admin admin] The token cache is being invalidate because project fda6ebe15e1b4fa28227e04c4c6547d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:33.312655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd37c02f-d72a-4b42-ad55-0fb8758007f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:33.313727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd37c02f-d72a-4b42-ad55-0fb8758007f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:33.321232 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3538/7002] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:32 2022] DELETE /identity/v3/projects/fda6ebe15e1b4fa28227e04c4c6547d6 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:33.326616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4279ca-6610-455b-b7fd-ee52035aeefc None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:33.328000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4279ca-6610-455b-b7fd-ee52035aeefc None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:33.329748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4279ca-6610-455b-b7fd-ee52035aeefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:33.397949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7b4279ca-6610-455b-b7fd-ee52035aeefc None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:33.397949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7b4279ca-6610-455b-b7fd-ee52035aeefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:33.608927 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:33.678242 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3465/7003] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:33.687500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0604674-898e-4b93-863c-b0046e98c2fd None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:33.687925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0604674-898e-4b93-863c-b0046e98c2fd None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:33.688414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0604674-898e-4b93-863c-b0046e98c2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:33.734423 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:33.749088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d0604674-898e-4b93-863c-b0046e98c2fd None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:33.754886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d0604674-898e-4b93-863c-b0046e98c2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:33.785656 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3539/7004] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:33.790180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4279ca-6610-455b-b7fd-ee52035aeefc None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:33.807057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4279ca-6610-455b-b7fd-ee52035aeefc None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:33.834948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991badb-6d2c-4376-8b6e-33122f4a0c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:33.837221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991badb-6d2c-4376-8b6e-33122f4a0c7c admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:33.837523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991badb-6d2c-4376-8b6e-33122f4a0c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:33.837812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991badb-6d2c-4376-8b6e-33122f4a0c7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:33.843615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991badb-6d2c-4376-8b6e-33122f4a0c7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:42:33.844109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991badb-6d2c-4376-8b6e-33122f4a0c7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:33.852126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991badb-6d2c-4376-8b6e-33122f4a0c7c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:33.904145 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3466/7005] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:42:33.913129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0604674-898e-4b93-863c-b0046e98c2fd None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:33.923522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991badb-6d2c-4376-8b6e-33122f4a0c7c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:33.930904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9991badb-6d2c-4376-8b6e-33122f4a0c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:33.937236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0604674-898e-4b93-863c-b0046e98c2fd None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:33.958927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bf6ed-81b2-4ae5-b5cd-7b6ba24e0305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:33.975995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bf6ed-81b2-4ae5-b5cd-7b6ba24e0305 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:33.978301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bf6ed-81b2-4ae5-b5cd-7b6ba24e0305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:33.978588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bf6ed-81b2-4ae5-b5cd-7b6ba24e0305 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:33.984939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bf6ed-81b2-4ae5-b5cd-7b6ba24e0305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:33.990325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bf6ed-81b2-4ae5-b5cd-7b6ba24e0305 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:34.130532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991badb-6d2c-4376-8b6e-33122f4a0c7c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:34.138767 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3540/7006] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:33 2022] POST /identity/v3/projects => generated 379 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:42:34.142968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bf6ed-81b2-4ae5-b5cd-7b6ba24e0305 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:34.146741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30ddea-ac0f-4fb8-8141-7789f73a9c93 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86a617b09aba4f619e8f2e34d79c7b2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'da3f9de396f84366b06454d857c46c89', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:34.148510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30ddea-ac0f-4fb8-8141-7789f73a9c93 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:34.148821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30ddea-ac0f-4fb8-8141-7789f73a9c93 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:34.149100 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e30ddea-ac0f-4fb8-8141-7789f73a9c93 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] PATH_INFO: `/v3/projects/6e97d7e8fa1046d1b1d5d5c035d98ed3` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:34.150638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30ddea-ac0f-4fb8-8141-7789f73a9c93 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6e97d7e8fa1046d1b1d5d5c035d98ed3)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:34.153387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e30ddea-ac0f-4fb8-8141-7789f73a9c93 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:34.390324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e30ddea-ac0f-4fb8-8141-7789f73a9c93 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e97d7e8fa1046d1b1d5d5c035d98ed3', 'request_id': 'req-0e30ddea-ac0f-4fb8-8141-7789f73a9c93'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:34.442345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bf6ed-81b2-4ae5-b5cd-7b6ba24e0305 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:34.488142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e30ddea-ac0f-4fb8-8141-7789f73a9c93 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e97d7e8fa1046d1b1d5d5c035d98ed3', 'request_id': 'req-0e30ddea-ac0f-4fb8-8141-7789f73a9c93'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:34.501493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e30ddea-ac0f-4fb8-8141-7789f73a9c93 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e97d7e8fa1046d1b1d5d5c035d98ed3', 'request_id': 'req-0e30ddea-ac0f-4fb8-8141-7789f73a9c93'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:34.525742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e30ddea-ac0f-4fb8-8141-7789f73a9c93 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] The token cache is being invalidate because project 6e97d7e8fa1046d1b1d5d5c035d98ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:34.526455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e30ddea-ac0f-4fb8-8141-7789f73a9c93 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:34.529648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e30ddea-ac0f-4fb8-8141-7789f73a9c93 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:34.542703 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3467/7007] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:33 2022] DELETE /identity/v3/projects/6e97d7e8fa1046d1b1d5d5c035d98ed3 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:34.547689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30ddea-ac0f-4fb8-8141-7789f73a9c93 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:34.551085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0e30ddea-ac0f-4fb8-8141-7789f73a9c93 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:34.570119 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:34.608274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785b380-5b77-4426-9c2e-819d653b2a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:34.612483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785b380-5b77-4426-9c2e-819d653b2a77 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:34.612483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785b380-5b77-4426-9c2e-819d653b2a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:34.612483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785b380-5b77-4426-9c2e-819d653b2a77 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:34.612483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785b380-5b77-4426-9c2e-819d653b2a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:34.614402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785b380-5b77-4426-9c2e-819d653b2a77 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:34.735091 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:34.774273 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3541/7008] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:34 2022] POST /identity/v3/users => generated 290 bytes in 632 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:34.777196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785b380-5b77-4426-9c2e-819d653b2a77 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:34.785651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6785b380-5b77-4426-9c2e-819d653b2a77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:34.815727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785b380-5b77-4426-9c2e-819d653b2a77 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:34.821085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9744e-67da-4bc6-837b-9788996b7104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:34.821777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9744e-67da-4bc6-837b-9788996b7104 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:34.822065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9744e-67da-4bc6-837b-9788996b7104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:34.822416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d9744e-67da-4bc6-837b-9788996b7104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:34.823149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9744e-67da-4bc6-837b-9788996b7104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:34.824824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d9744e-67da-4bc6-837b-9788996b7104 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:34.845344 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3542/7009] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:34.845344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9744e-67da-4bc6-837b-9788996b7104 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:34.847285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e30ddea-ac0f-4fb8-8141-7789f73a9c93 tempest-QuotasNegativeTest-1644527225 tempest-QuotasNegativeTest-1644527225-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:34.852856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26952eba-0336-49ee-912e-38fbd8845fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:34.853837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26952eba-0336-49ee-912e-38fbd8845fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:34.865818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d9744e-67da-4bc6-837b-9788996b7104 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:34.866454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26952eba-0336-49ee-912e-38fbd8845fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:34.867096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26952eba-0336-49ee-912e-38fbd8845fda admin admin] PATH_INFO: `/v3/users/57efb5d565464b06adbd0ff69057d029` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:34.870567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26952eba-0336-49ee-912e-38fbd8845fda admin admin] RBAC: Authorizing `identity:delete_user(user_id=57efb5d565464b06adbd0ff69057d029)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:34.873516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26952eba-0336-49ee-912e-38fbd8845fda admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:34.880922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4150de-e172-4674-a0fa-94de4c4ade9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:34.881646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4150de-e172-4674-a0fa-94de4c4ade9f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:34.881949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4150de-e172-4674-a0fa-94de4c4ade9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:34.882806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4150de-e172-4674-a0fa-94de4c4ade9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:34.884215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4150de-e172-4674-a0fa-94de4c4ade9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:34.887643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4150de-e172-4674-a0fa-94de4c4ade9f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:34.921208 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3543/7010] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:42:34.923283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4150de-e172-4674-a0fa-94de4c4ade9f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:34.944141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4150de-e172-4674-a0fa-94de4c4ade9f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:34.949689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe6804d-f511-4e3d-baca-b92e698ab26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:34.956509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6804d-f511-4e3d-baca-b92e698ab26a admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:34.956864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6804d-f511-4e3d-baca-b92e698ab26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:34.957161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe6804d-f511-4e3d-baca-b92e698ab26a admin admin] PATH_INFO: `/v3/projects/b8eec01f6f824a48a9c24c48cdcbe14e/users/28c701d9e14540bd9969f18d18608f75/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:35.003574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6804d-f511-4e3d-baca-b92e698ab26a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8eec01f6f824a48a9c24c48cdcbe14e, user_id=28c701d9e14540bd9969f18d18608f75, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:35.038186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe6804d-f511-4e3d-baca-b92e698ab26a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:35.178536 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3544/7011] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:34 2022] PUT /identity/v3/projects/b8eec01f6f824a48a9c24c48cdcbe14e/users/28c701d9e14540bd9969f18d18608f75/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:35.187951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-26952eba-0336-49ee-912e-38fbd8845fda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57efb5d565464b06adbd0ff69057d029'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:35.199641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fef09c-54d6-4d10-96c7-67cd86fca7e5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:35.245220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fef09c-54d6-4d10-96c7-67cd86fca7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:35.245522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fef09c-54d6-4d10-96c7-67cd86fca7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:35.292229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-26952eba-0336-49ee-912e-38fbd8845fda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57efb5d565464b06adbd0ff69057d029'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:35.294023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-26952eba-0336-49ee-912e-38fbd8845fda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57efb5d565464b06adbd0ff69057d029'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:35.295686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-26952eba-0336-49ee-912e-38fbd8845fda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57efb5d565464b06adbd0ff69057d029'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:35.319460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-26952eba-0336-49ee-912e-38fbd8845fda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57efb5d565464b06adbd0ff69057d029'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:35.355588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-23fef09c-54d6-4d10-96c7-67cd86fca7e5 None None] MFA Rules not processed for user `28c701d9e14540bd9969f18d18608f75`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:35.358584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-23fef09c-54d6-4d10-96c7-67cd86fca7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:35.501669 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3545/7012] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:35.507014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c22c12-3c79-45f7-ab53-5eb61b20e7c2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:35.507316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c22c12-3c79-45f7-ab53-5eb61b20e7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:35.507608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c22c12-3c79-45f7-ab53-5eb61b20e7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:35.547192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-98c22c12-3c79-45f7-ab53-5eb61b20e7c2 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:35.548442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-98c22c12-3c79-45f7-ab53-5eb61b20e7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:35.678473 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3546/7013] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:42:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:35.680854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c22c12-3c79-45f7-ab53-5eb61b20e7c2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:35.682794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-98c22c12-3c79-45f7-ab53-5eb61b20e7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:35.846989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c22c12-3c79-45f7-ab53-5eb61b20e7c2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:35.846989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf853282-d765-44cb-9d6d-ba48e3b8cefd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:35.846989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf853282-d765-44cb-9d6d-ba48e3b8cefd service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:35.846989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf853282-d765-44cb-9d6d-ba48e3b8cefd service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:35.849229 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf853282-d765-44cb-9d6d-ba48e3b8cefd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:35.849229 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf853282-d765-44cb-9d6d-ba48e3b8cefd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:35.869330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf853282-d765-44cb-9d6d-ba48e3b8cefd service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:35.895017 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3547/7014] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:35.896355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf853282-d765-44cb-9d6d-ba48e3b8cefd service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:35.899499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cf853282-d765-44cb-9d6d-ba48e3b8cefd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:35.991008 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3468/7015] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:34 2022] DELETE /identity/v3/users/57efb5d565464b06adbd0ff69057d029 => generated 0 bytes in 1448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:35.999719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de03f6-a9ca-43e2-8f3e-b2d9ed68dc9a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:36.000103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de03f6-a9ca-43e2-8f3e-b2d9ed68dc9a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:36.000960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de03f6-a9ca-43e2-8f3e-b2d9ed68dc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:36.034155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf853282-d765-44cb-9d6d-ba48e3b8cefd service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:36.037433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-20de03f6-a9ca-43e2-8f3e-b2d9ed68dc9a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:36.041668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-20de03f6-a9ca-43e2-8f3e-b2d9ed68dc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:36.268001 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:36.282870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad5418-5cf4-49e4-a6d9-2ebbd76372a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:36.285763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad5418-5cf4-49e4-a6d9-2ebbd76372a5 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:36.286058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad5418-5cf4-49e4-a6d9-2ebbd76372a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:36.286367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad5418-5cf4-49e4-a6d9-2ebbd76372a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:36.391014 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3469/7016] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:36.412105 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:36.469566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad5418-5cf4-49e4-a6d9-2ebbd76372a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:36.472364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad5418-5cf4-49e4-a6d9-2ebbd76372a5 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:36.475574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de03f6-a9ca-43e2-8f3e-b2d9ed68dc9a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:36.509392 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3548/7017] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:42:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:42:36.511958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad5418-5cf4-49e4-a6d9-2ebbd76372a5 service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:36.646270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de03f6-a9ca-43e2-8f3e-b2d9ed68dc9a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:36.654807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5c630-6c89-47bf-b9be-7bef744fb350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:36.655563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5c630-6c89-47bf-b9be-7bef744fb350 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:36.655855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5c630-6c89-47bf-b9be-7bef744fb350 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:36.656055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad5418-5cf4-49e4-a6d9-2ebbd76372a5 service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:36.656173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc5c630-6c89-47bf-b9be-7bef744fb350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:36.661513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb83a3-6478-4b37-b7ee-72bae79e145c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:36.661955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb83a3-6478-4b37-b7ee-72bae79e145c service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:36.662335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb83a3-6478-4b37-b7ee-72bae79e145c service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:36.662624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb83a3-6478-4b37-b7ee-72bae79e145c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:36.664829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e5cb83a3-6478-4b37-b7ee-72bae79e145c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:36.676250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5c630-6c89-47bf-b9be-7bef744fb350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:36.677966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc5c630-6c89-47bf-b9be-7bef744fb350 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:36.695016 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:36.711069 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3470/7018] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:36.829759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb83a3-6478-4b37-b7ee-72bae79e145c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:36.838687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb83a3-6478-4b37-b7ee-72bae79e145c service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:36.879972 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3549/7019] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:36.904545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5c630-6c89-47bf-b9be-7bef744fb350 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:36.906325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2fc5c630-6c89-47bf-b9be-7bef744fb350 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:36.936071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc5c630-6c89-47bf-b9be-7bef744fb350 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:36.950714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d76656-cf82-4040-ab52-fd20fca7d9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:36.954709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d76656-cf82-4040-ab52-fd20fca7d9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:36.954709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d76656-cf82-4040-ab52-fd20fca7d9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:36.954709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d76656-cf82-4040-ab52-fd20fca7d9c3 admin admin] PATH_INFO: `/v3/users/d1cbf58d0cf8440aae63bf31387948f3` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:36.956370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d76656-cf82-4040-ab52-fd20fca7d9c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1cbf58d0cf8440aae63bf31387948f3)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:36.958545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d76656-cf82-4040-ab52-fd20fca7d9c3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:37.065557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb83a3-6478-4b37-b7ee-72bae79e145c service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:37.067711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e5cb83a3-6478-4b37-b7ee-72bae79e145c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:37.152469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e3d76656-cf82-4040-ab52-fd20fca7d9c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1cbf58d0cf8440aae63bf31387948f3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:37.207780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e3d76656-cf82-4040-ab52-fd20fca7d9c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1cbf58d0cf8440aae63bf31387948f3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:37.210497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e3d76656-cf82-4040-ab52-fd20fca7d9c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1cbf58d0cf8440aae63bf31387948f3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:37.221769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e3d76656-cf82-4040-ab52-fd20fca7d9c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1cbf58d0cf8440aae63bf31387948f3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:37.242782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e3d76656-cf82-4040-ab52-fd20fca7d9c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1cbf58d0cf8440aae63bf31387948f3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:37.295111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb83a3-6478-4b37-b7ee-72bae79e145c service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:37.318908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0112ca-a545-416b-8559-850be9af869a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:37.319787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0112ca-a545-416b-8559-850be9af869a service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:37.320094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0112ca-a545-416b-8559-850be9af869a service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:37.322363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0112ca-a545-416b-8559-850be9af869a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:37.325248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3b0112ca-a545-416b-8559-850be9af869a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:37.358512 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3471/7020] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:36 2022] DELETE /identity/v3/users/d1cbf58d0cf8440aae63bf31387948f3 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:37.360532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea080308-6e9d-4d96-a99e-fc94d303d9dd None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:37.361237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea080308-6e9d-4d96-a99e-fc94d303d9dd None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:37.362451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea080308-6e9d-4d96-a99e-fc94d303d9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:37.402146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0112ca-a545-416b-8559-850be9af869a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:37.402146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0112ca-a545-416b-8559-850be9af869a service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:37.416128 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3550/7021] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:42:37.420282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ea080308-6e9d-4d96-a99e-fc94d303d9dd None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:37.421645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ea080308-6e9d-4d96-a99e-fc94d303d9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:37.509288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0112ca-a545-416b-8559-850be9af869a service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:37.513669 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3472/7022] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:42:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:37.515483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea080308-6e9d-4d96-a99e-fc94d303d9dd None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:37.519213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ea080308-6e9d-4d96-a99e-fc94d303d9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:37.523629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3b0112ca-a545-416b-8559-850be9af869a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:37.565947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0112ca-a545-416b-8559-850be9af869a service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:37.724038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea080308-6e9d-4d96-a99e-fc94d303d9dd None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:37.731802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d96525-ba0c-4f9b-9cca-7b4670a29b06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:37.732742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d96525-ba0c-4f9b-9cca-7b4670a29b06 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:37.733215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d96525-ba0c-4f9b-9cca-7b4670a29b06 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:37.733639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d96525-ba0c-4f9b-9cca-7b4670a29b06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:37.760628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b28f8b-4eef-4670-a6dc-1d1326d72023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:37.761651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b28f8b-4eef-4670-a6dc-1d1326d72023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:37.761935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b28f8b-4eef-4670-a6dc-1d1326d72023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:37.762245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b28f8b-4eef-4670-a6dc-1d1326d72023 admin admin] PATH_INFO: `/v3/projects/7e5066b0588d47719baa94ea6e0dec72` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:37.768730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b28f8b-4eef-4670-a6dc-1d1326d72023 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e5066b0588d47719baa94ea6e0dec72)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:37.776169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b28f8b-4eef-4670-a6dc-1d1326d72023 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:37.777588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d96525-ba0c-4f9b-9cca-7b4670a29b06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:37.781230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d96525-ba0c-4f9b-9cca-7b4670a29b06 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:37.826833 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3473/7023] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:42:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:42:37.976478 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:37.995891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f9b28f8b-4eef-4670-a6dc-1d1326d72023 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e5066b0588d47719baa94ea6e0dec72', 'request_id': 'req-f9b28f8b-4eef-4670-a6dc-1d1326d72023'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:38.039383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f9b28f8b-4eef-4670-a6dc-1d1326d72023 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e5066b0588d47719baa94ea6e0dec72', 'request_id': 'req-f9b28f8b-4eef-4670-a6dc-1d1326d72023'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:38.065657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f9b28f8b-4eef-4670-a6dc-1d1326d72023 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e5066b0588d47719baa94ea6e0dec72', 'request_id': 'req-f9b28f8b-4eef-4670-a6dc-1d1326d72023'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:38.243588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f9b28f8b-4eef-4670-a6dc-1d1326d72023 admin admin] The token cache is being invalidate because project 7e5066b0588d47719baa94ea6e0dec72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:38.243893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f9b28f8b-4eef-4670-a6dc-1d1326d72023 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:38.244622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f9b28f8b-4eef-4670-a6dc-1d1326d72023 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:38.250850 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3551/7024] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:37 2022] DELETE /identity/v3/projects/7e5066b0588d47719baa94ea6e0dec72 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:38.252539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d96525-ba0c-4f9b-9cca-7b4670a29b06 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:38.289564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d96525-ba0c-4f9b-9cca-7b4670a29b06 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:38.340291 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:38.394426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd3d80-952c-45b1-9b3b-23436fb392df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:38.407128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd3d80-952c-45b1-9b3b-23436fb392df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:38.407577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd3d80-952c-45b1-9b3b-23436fb392df admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:38.408071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd3d80-952c-45b1-9b3b-23436fb392df admin admin] PATH_INFO: `/v3/users/86a617b09aba4f619e8f2e34d79c7b2b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:38.410339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd3d80-952c-45b1-9b3b-23436fb392df admin admin] RBAC: Authorizing `identity:delete_user(user_id=86a617b09aba4f619e8f2e34d79c7b2b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:38.413873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dd3d80-952c-45b1-9b3b-23436fb392df admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:38.492217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0103244-898e-4072-838c-dd7ccbfb707e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:38.492569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0103244-898e-4072-838c-dd7ccbfb707e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:38.492855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0103244-898e-4072-838c-dd7ccbfb707e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:38.531125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a0103244-898e-4072-838c-dd7ccbfb707e None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:38.535323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a0103244-898e-4072-838c-dd7ccbfb707e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:38.733884 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3552/7025] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:42:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:42:38.735062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0103244-898e-4072-838c-dd7ccbfb707e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:38.740198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a0103244-898e-4072-838c-dd7ccbfb707e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:38.754642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d7dd3d80-952c-45b1-9b3b-23436fb392df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86a617b09aba4f619e8f2e34d79c7b2b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:38.791075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d7dd3d80-952c-45b1-9b3b-23436fb392df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86a617b09aba4f619e8f2e34d79c7b2b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:38.793242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d7dd3d80-952c-45b1-9b3b-23436fb392df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86a617b09aba4f619e8f2e34d79c7b2b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:38.796509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d7dd3d80-952c-45b1-9b3b-23436fb392df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86a617b09aba4f619e8f2e34d79c7b2b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:38.814936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d7dd3d80-952c-45b1-9b3b-23436fb392df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86a617b09aba4f619e8f2e34d79c7b2b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:38.861692 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:38.932140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0103244-898e-4072-838c-dd7ccbfb707e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:38.940412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ed18b9-1bed-4f3e-928b-0afecdbddc64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:38.941092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed18b9-1bed-4f3e-928b-0afecdbddc64 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:38.941379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed18b9-1bed-4f3e-928b-0afecdbddc64 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:38.941660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ed18b9-1bed-4f3e-928b-0afecdbddc64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:38.944470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-68ed18b9-1bed-4f3e-928b-0afecdbddc64 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:38.950806 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3474/7026] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:38 2022] DELETE /identity/v3/users/86a617b09aba4f619e8f2e34d79c7b2b => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:42:38.952059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd3d80-952c-45b1-9b3b-23436fb392df admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:38.954903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d7dd3d80-952c-45b1-9b3b-23436fb392df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:38.991620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed18b9-1bed-4f3e-928b-0afecdbddc64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:38.996084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ed18b9-1bed-4f3e-928b-0afecdbddc64 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:39.030588 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3553/7027] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:42:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:42:39.101718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dd3d80-952c-45b1-9b3b-23436fb392df admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:39.116159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce4354-4ee2-4733-9414-52673b91895c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:39.117428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce4354-4ee2-4733-9414-52673b91895c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:39.118602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce4354-4ee2-4733-9414-52673b91895c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:39.119043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce4354-4ee2-4733-9414-52673b91895c admin admin] PATH_INFO: `/v3/projects/987892c9b9ca479989700a7e77ad369e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:39.125021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce4354-4ee2-4733-9414-52673b91895c admin admin] RBAC: Authorizing `identity:delete_project(project_id=987892c9b9ca479989700a7e77ad369e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:39.129712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce4354-4ee2-4733-9414-52673b91895c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:39.355117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-11ce4354-4ee2-4733-9414-52673b91895c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '987892c9b9ca479989700a7e77ad369e', 'request_id': 'req-11ce4354-4ee2-4733-9414-52673b91895c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:39.437481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-11ce4354-4ee2-4733-9414-52673b91895c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '987892c9b9ca479989700a7e77ad369e', 'request_id': 'req-11ce4354-4ee2-4733-9414-52673b91895c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:39.443675 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:39.452000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-11ce4354-4ee2-4733-9414-52673b91895c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '987892c9b9ca479989700a7e77ad369e', 'request_id': 'req-11ce4354-4ee2-4733-9414-52673b91895c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:39.481379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-11ce4354-4ee2-4733-9414-52673b91895c admin admin] The token cache is being invalidate because project 987892c9b9ca479989700a7e77ad369e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:39.482749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-11ce4354-4ee2-4733-9414-52673b91895c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:39.484846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-11ce4354-4ee2-4733-9414-52673b91895c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:39.490917 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3475/7028] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:38 2022] DELETE /identity/v3/projects/987892c9b9ca479989700a7e77ad369e => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:39.498896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044df828-9dc9-4add-9616-0592bad4def1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:39.499931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044df828-9dc9-4add-9616-0592bad4def1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:39.500659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044df828-9dc9-4add-9616-0592bad4def1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:39.563184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-044df828-9dc9-4add-9616-0592bad4def1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:39.568103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-044df828-9dc9-4add-9616-0592bad4def1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:39.645938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482014f-4de2-42dc-9dd1-3b9bf8695f4e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:39.645938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482014f-4de2-42dc-9dd1-3b9bf8695f4e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:39.645938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9482014f-4de2-42dc-9dd1-3b9bf8695f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:39.711939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9482014f-4de2-42dc-9dd1-3b9bf8695f4e None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:39.722238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9482014f-4de2-42dc-9dd1-3b9bf8695f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:39.783579 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3554/7029] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:42:39.784846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044df828-9dc9-4add-9616-0592bad4def1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:39.789260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-044df828-9dc9-4add-9616-0592bad4def1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:39.845254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044df828-9dc9-4add-9616-0592bad4def1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:39.868333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed243b99-33f5-47ef-a877-6726dc610376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:39.868333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed243b99-33f5-47ef-a877-6726dc610376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:39.868333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed243b99-33f5-47ef-a877-6726dc610376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:39.876249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed243b99-33f5-47ef-a877-6726dc610376 admin admin] PATH_INFO: `/v3/projects/da3f9de396f84366b06454d857c46c89` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:39.880263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed243b99-33f5-47ef-a877-6726dc610376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da3f9de396f84366b06454d857c46c89)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:39.885900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed243b99-33f5-47ef-a877-6726dc610376 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:39.896319 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:39.941178 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3476/7030] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:42:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:42:39.942560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacbb3c-ddae-403c-8317-bf6b5f11a2d7 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:39.944264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacbb3c-ddae-403c-8317-bf6b5f11a2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:39.944575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bacbb3c-ddae-403c-8317-bf6b5f11a2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:40.050689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6bacbb3c-ddae-403c-8317-bf6b5f11a2d7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:40.052704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6bacbb3c-ddae-403c-8317-bf6b5f11a2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:40.073149 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3477/7031] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:40.073149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacbb3c-ddae-403c-8317-bf6b5f11a2d7 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:40.073149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6bacbb3c-ddae-403c-8317-bf6b5f11a2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:40.118366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ed243b99-33f5-47ef-a877-6726dc610376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da3f9de396f84366b06454d857c46c89', 'request_id': 'req-ed243b99-33f5-47ef-a877-6726dc610376'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:40.136745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ed243b99-33f5-47ef-a877-6726dc610376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da3f9de396f84366b06454d857c46c89', 'request_id': 'req-ed243b99-33f5-47ef-a877-6726dc610376'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:40.148355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ed243b99-33f5-47ef-a877-6726dc610376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da3f9de396f84366b06454d857c46c89', 'request_id': 'req-ed243b99-33f5-47ef-a877-6726dc610376'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:40.230003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ed243b99-33f5-47ef-a877-6726dc610376 admin admin] The token cache is being invalidate because project da3f9de396f84366b06454d857c46c89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:40.230348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ed243b99-33f5-47ef-a877-6726dc610376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:40.231015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ed243b99-33f5-47ef-a877-6726dc610376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:40.235761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bacbb3c-ddae-403c-8317-bf6b5f11a2d7 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:40.238269 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3555/7032] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:39 2022] DELETE /identity/v3/projects/da3f9de396f84366b06454d857c46c89 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:40.239159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed243b99-33f5-47ef-a877-6726dc610376 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:40.240720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ed243b99-33f5-47ef-a877-6726dc610376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:40.376519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed243b99-33f5-47ef-a877-6726dc610376 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:40.379104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3a1fd-503a-4387-a112-89a026d80b13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:40.379807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3a1fd-503a-4387-a112-89a026d80b13 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:40.380095 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3a1fd-503a-4387-a112-89a026d80b13 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:40.387512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3a1fd-503a-4387-a112-89a026d80b13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:40.391382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5ed3a1fd-503a-4387-a112-89a026d80b13 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:40.398656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e95a3b1-4232-4a6c-9ed8-ff856eb93d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:40.399358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95a3b1-4232-4a6c-9ed8-ff856eb93d08 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:40.399651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95a3b1-4232-4a6c-9ed8-ff856eb93d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:40.399936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e95a3b1-4232-4a6c-9ed8-ff856eb93d08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:40.414496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95a3b1-4232-4a6c-9ed8-ff856eb93d08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:42:40.414883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95a3b1-4232-4a6c-9ed8-ff856eb93d08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:40.416608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e95a3b1-4232-4a6c-9ed8-ff856eb93d08 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:40.456858 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3556/7033] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:42:40.456858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b1a6c-2627-4185-a5ab-50fde33a2bc3 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:40.456858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b1a6c-2627-4185-a5ab-50fde33a2bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:40.456858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179b1a6c-2627-4185-a5ab-50fde33a2bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:40.499320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-179b1a6c-2627-4185-a5ab-50fde33a2bc3 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:40.500540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-179b1a6c-2627-4185-a5ab-50fde33a2bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:40.522048 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3557/7034] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:40.529720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b1a6c-2627-4185-a5ab-50fde33a2bc3 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:40.545016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3a1fd-503a-4387-a112-89a026d80b13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:40.546691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3a1fd-503a-4387-a112-89a026d80b13 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:40.552340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179b1a6c-2627-4185-a5ab-50fde33a2bc3 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:40.562768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd28b9b-a304-48cd-ad8a-4a7b118ead59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:40.563456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd28b9b-a304-48cd-ad8a-4a7b118ead59 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:40.563748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd28b9b-a304-48cd-ad8a-4a7b118ead59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:40.564030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd28b9b-a304-48cd-ad8a-4a7b118ead59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:40.566456 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3478/7035] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:42:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:42:40.574716 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:40.588003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e0ded-7be4-4052-bf9d-1dc5913fb1c2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:40.588300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e0ded-7be4-4052-bf9d-1dc5913fb1c2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:40.588585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e0ded-7be4-4052-bf9d-1dc5913fb1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:40.591376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd28b9b-a304-48cd-ad8a-4a7b118ead59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:40.593341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd28b9b-a304-48cd-ad8a-4a7b118ead59 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:40.648323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8c4e0ded-7be4-4052-bf9d-1dc5913fb1c2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:40.651062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8c4e0ded-7be4-4052-bf9d-1dc5913fb1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:40.679425 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3479/7036] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:40.683422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e0ded-7be4-4052-bf9d-1dc5913fb1c2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:40.688710 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:40.700094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4e0ded-7be4-4052-bf9d-1dc5913fb1c2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:40.706120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086086f2-4608-44a9-9038-0c882f111225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:40.707059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086086f2-4608-44a9-9038-0c882f111225 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:40.707347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086086f2-4608-44a9-9038-0c882f111225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:40.707629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086086f2-4608-44a9-9038-0c882f111225 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:40.710216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086086f2-4608-44a9-9038-0c882f111225 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:42:40.710655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086086f2-4608-44a9-9038-0c882f111225 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:40.714852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086086f2-4608-44a9-9038-0c882f111225 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:40.750974 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3480/7037] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:42:40.772608 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3558/7038] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:40 2022] POST /identity/v3/projects => generated 387 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:40.773131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086086f2-4608-44a9-9038-0c882f111225 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:40.774530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd28b9b-a304-48cd-ad8a-4a7b118ead59 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:40.811321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086086f2-4608-44a9-9038-0c882f111225 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:40.981176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd28b9b-a304-48cd-ad8a-4a7b118ead59 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:40.998844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4eded32-5878-4bcc-bae9-337f5d3e1a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:40.999549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eded32-5878-4bcc-bae9-337f5d3e1a69 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:40.999842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eded32-5878-4bcc-bae9-337f5d3e1a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:41.000128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4eded32-5878-4bcc-bae9-337f5d3e1a69 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:41.000888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eded32-5878-4bcc-bae9-337f5d3e1a69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:41.002384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca840a-1713-453d-87f8-62cf9f7edf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:41.003118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca840a-1713-453d-87f8-62cf9f7edf9e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:41.003408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca840a-1713-453d-87f8-62cf9f7edf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:41.003691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca840a-1713-453d-87f8-62cf9f7edf9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:41.004400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca840a-1713-453d-87f8-62cf9f7edf9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:41.006374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca840a-1713-453d-87f8-62cf9f7edf9e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:41.009177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4eded32-5878-4bcc-bae9-337f5d3e1a69 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:41.122205 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3559/7039] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:40 2022] POST /identity/v3/users => generated 294 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:41.124370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9aef9-5fc6-4c7b-9628-fa6d5096695e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:41.124669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9aef9-5fc6-4c7b-9628-fa6d5096695e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:41.125291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec9aef9-5fc6-4c7b-9628-fa6d5096695e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:41.129037 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3481/7040] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:40 2022] POST /identity/v3/projects => generated 397 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:41.133822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca840a-1713-453d-87f8-62cf9f7edf9e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:41.192774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3ec9aef9-5fc6-4c7b-9628-fa6d5096695e None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:41.192774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3ec9aef9-5fc6-4c7b-9628-fa6d5096695e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:41.249409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca840a-1713-453d-87f8-62cf9f7edf9e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:41.266256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1aaee1-9a19-4162-93d6-4070587e14d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:41.266982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aaee1-9a19-4162-93d6-4070587e14d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:41.267256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aaee1-9a19-4162-93d6-4070587e14d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:41.268128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aaee1-9a19-4162-93d6-4070587e14d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:41.270355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1aaee1-9a19-4162-93d6-4070587e14d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:41.272029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1aaee1-9a19-4162-93d6-4070587e14d9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:41.295193 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3482/7041] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:41.296137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1aaee1-9a19-4162-93d6-4070587e14d9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:41.300648 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3560/7042] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:42:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:41.301553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9aef9-5fc6-4c7b-9628-fa6d5096695e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:41.320853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1aaee1-9a19-4162-93d6-4070587e14d9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:41.327368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec9aef9-5fc6-4c7b-9628-fa6d5096695e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:41.332974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969302a-2903-4d7c-b9fa-45626c6ac9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:41.333687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969302a-2903-4d7c-b9fa-45626c6ac9a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:41.333979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969302a-2903-4d7c-b9fa-45626c6ac9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:41.334291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969302a-2903-4d7c-b9fa-45626c6ac9a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:41.335003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969302a-2903-4d7c-b9fa-45626c6ac9a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:41.335271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924e8c2-21db-4a4b-a3f6-2d68cd233648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:41.336061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924e8c2-21db-4a4b-a3f6-2d68cd233648 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:41.336538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924e8c2-21db-4a4b-a3f6-2d68cd233648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:41.336839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924e8c2-21db-4a4b-a3f6-2d68cd233648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:41.336986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969302a-2903-4d7c-b9fa-45626c6ac9a4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:41.337874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924e8c2-21db-4a4b-a3f6-2d68cd233648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:41.340768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924e8c2-21db-4a4b-a3f6-2d68cd233648 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:41.357236 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3561/7043] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:41.358348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924e8c2-21db-4a4b-a3f6-2d68cd233648 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:41.360506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1924e8c2-21db-4a4b-a3f6-2d68cd233648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:41.441703 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:41.464849 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3483/7044] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:41 2022] POST /identity/v3/users => generated 299 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:41.469327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969302a-2903-4d7c-b9fa-45626c6ac9a4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:41.492597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969302a-2903-4d7c-b9fa-45626c6ac9a4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:41.503552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1548e-5606-48c2-8ff5-a10d40c1bcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:41.504754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1548e-5606-48c2-8ff5-a10d40c1bcca admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:41.505206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1548e-5606-48c2-8ff5-a10d40c1bcca admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:41.505652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1548e-5606-48c2-8ff5-a10d40c1bcca admin admin] PATH_INFO: `/v3/projects/03a6e969a713403b90a4783d74f23525/users/487aa06d87aa4a28801ef21fb10dc94e/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:41.526754 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:41.530320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924e8c2-21db-4a4b-a3f6-2d68cd233648 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:41.541735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1548e-5606-48c2-8ff5-a10d40c1bcca admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a6e969a713403b90a4783d74f23525, user_id=487aa06d87aa4a28801ef21fb10dc94e, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:41.544659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc1548e-5606-48c2-8ff5-a10d40c1bcca admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:41.545497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50287730-d5de-4948-9bde-bd6251d6d37f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:41.547586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50287730-d5de-4948-9bde-bd6251d6d37f service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:41.548127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50287730-d5de-4948-9bde-bd6251d6d37f service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:41.551279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50287730-d5de-4948-9bde-bd6251d6d37f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:41.563215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50287730-d5de-4948-9bde-bd6251d6d37f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:41.566281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50287730-d5de-4948-9bde-bd6251d6d37f service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:41.578674 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3562/7045] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:42:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:42:41.584385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50287730-d5de-4948-9bde-bd6251d6d37f service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:41.600244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50287730-d5de-4948-9bde-bd6251d6d37f service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:41.606041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf5ce0-9f20-4135-af93-6f27e0971168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:41.606974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf5ce0-9f20-4135-af93-6f27e0971168 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:41.607317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf5ce0-9f20-4135-af93-6f27e0971168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:41.607966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf5ce0-9f20-4135-af93-6f27e0971168 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:41.608934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf5ce0-9f20-4135-af93-6f27e0971168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:41.612333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacf5ce0-9f20-4135-af93-6f27e0971168 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:41.624504 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3563/7046] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:41.628639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf5ce0-9f20-4135-af93-6f27e0971168 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:41.640405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf5ce0-9f20-4135-af93-6f27e0971168 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:41.648583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f41e7-86ab-40b6-ba74-b50d449e8a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:41.649471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f41e7-86ab-40b6-ba74-b50d449e8a50 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:41.649916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f41e7-86ab-40b6-ba74-b50d449e8a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:41.650377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f41e7-86ab-40b6-ba74-b50d449e8a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:41.651295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f41e7-86ab-40b6-ba74-b50d449e8a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:41.653423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f41e7-86ab-40b6-ba74-b50d449e8a50 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:41.672964 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3564/7047] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:41.678732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f41e7-86ab-40b6-ba74-b50d449e8a50 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:41.696289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f41e7-86ab-40b6-ba74-b50d449e8a50 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:41.702475 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3484/7048] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:41 2022] PUT /identity/v3/projects/03a6e969a713403b90a4783d74f23525/users/487aa06d87aa4a28801ef21fb10dc94e/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:41.713245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca1ecd-c371-45e5-80b4-e36b98dcff52 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:41.715406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca1ecd-c371-45e5-80b4-e36b98dcff52 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:41.718091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca1ecd-c371-45e5-80b4-e36b98dcff52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:41.809909 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:41.843528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-38ca1ecd-c371-45e5-80b4-e36b98dcff52 None None] MFA Rules not processed for user `487aa06d87aa4a28801ef21fb10dc94e`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:41.848271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-38ca1ecd-c371-45e5-80b4-e36b98dcff52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:41.859042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c098b7ee-ec47-4ed3-904a-0604b8d4d91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:41.866235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098b7ee-ec47-4ed3-904a-0604b8d4d91d admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:41.866235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098b7ee-ec47-4ed3-904a-0604b8d4d91d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:41.866235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098b7ee-ec47-4ed3-904a-0604b8d4d91d admin admin] PATH_INFO: `/v3/projects/2cef59aa121e4ac6abfb022de5cdbae4/users/e6ed5c73a9d74a6495d920381846aceb/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:41.901474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098b7ee-ec47-4ed3-904a-0604b8d4d91d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cef59aa121e4ac6abfb022de5cdbae4, user_id=e6ed5c73a9d74a6495d920381846aceb, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:41.905025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c098b7ee-ec47-4ed3-904a-0604b8d4d91d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:41.975579 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:41.999241 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3485/7049] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:42:42.005094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca1ecd-c371-45e5-80b4-e36b98dcff52 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:42.019343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca1ecd-c371-45e5-80b4-e36b98dcff52 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:42.024876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d904664-545a-4b32-b79e-af8860c7744d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:42.026245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d904664-545a-4b32-b79e-af8860c7744d admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:42.027668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d904664-545a-4b32-b79e-af8860c7744d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:42.029701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d904664-545a-4b32-b79e-af8860c7744d admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:42.030476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d904664-545a-4b32-b79e-af8860c7744d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:42.035767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d904664-545a-4b32-b79e-af8860c7744d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:42.044837 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3565/7050] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:41 2022] PUT /identity/v3/projects/2cef59aa121e4ac6abfb022de5cdbae4/users/e6ed5c73a9d74a6495d920381846aceb/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:42:42.047752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35ae13-cfcd-4b60-a16a-2371d88251e1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:42.048077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35ae13-cfcd-4b60-a16a-2371d88251e1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:42.048362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d35ae13-cfcd-4b60-a16a-2371d88251e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:42.057252 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:42.132280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5d35ae13-cfcd-4b60-a16a-2371d88251e1 None None] MFA Rules not processed for user `e6ed5c73a9d74a6495d920381846aceb`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:42.133653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5d35ae13-cfcd-4b60-a16a-2371d88251e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:42.193099 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3486/7051] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:42 2022] POST /identity/v3/projects => generated 389 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:42:42.194442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea42d47-203b-4065-9ef3-fd89eb8254c1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:42.194825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea42d47-203b-4065-9ef3-fd89eb8254c1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:42.195432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea42d47-203b-4065-9ef3-fd89eb8254c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:42.237433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-dea42d47-203b-4065-9ef3-fd89eb8254c1 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:42.241955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-dea42d47-203b-4065-9ef3-fd89eb8254c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:42.261074 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3566/7052] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:42:42.262303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35ae13-cfcd-4b60-a16a-2371d88251e1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:42.360469 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:42.396811 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3487/7053] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:42:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:42.397879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea42d47-203b-4065-9ef3-fd89eb8254c1 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:42.425037 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:42.474428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d35ae13-cfcd-4b60-a16a-2371d88251e1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:42.576256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b9710-17e2-46c2-947f-b5d7f7c2d513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:42.577811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b9710-17e2-46c2-947f-b5d7f7c2d513 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:42.578769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b9710-17e2-46c2-947f-b5d7f7c2d513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:42.579207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b9710-17e2-46c2-947f-b5d7f7c2d513 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:42.583576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b9710-17e2-46c2-947f-b5d7f7c2d513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:42.583704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea42d47-203b-4065-9ef3-fd89eb8254c1 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:42.584118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b9710-17e2-46c2-947f-b5d7f7c2d513 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:42.598594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3db2e-fdc1-4b7b-8552-54424a625fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:42.599604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3db2e-fdc1-4b7b-8552-54424a625fae admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:42.600055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3db2e-fdc1-4b7b-8552-54424a625fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:42.600537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3db2e-fdc1-4b7b-8552-54424a625fae admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:42.601499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3db2e-fdc1-4b7b-8552-54424a625fae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:42.603811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3db2e-fdc1-4b7b-8552-54424a625fae admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:42.679711 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3567/7054] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:42 2022] POST /identity/v3/users => generated 301 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:42.680866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b9710-17e2-46c2-947f-b5d7f7c2d513 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:42.712555 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3488/7055] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:42 2022] POST /identity/v3/projects => generated 397 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:42.713683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3db2e-fdc1-4b7b-8552-54424a625fae admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:42.852559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3db2e-fdc1-4b7b-8552-54424a625fae admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:42.867769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14317093-48e0-4b53-a355-6da349f63b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:42.868479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14317093-48e0-4b53-a355-6da349f63b85 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:42.868772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14317093-48e0-4b53-a355-6da349f63b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:42.869068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14317093-48e0-4b53-a355-6da349f63b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:42.869832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14317093-48e0-4b53-a355-6da349f63b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:42.871503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14317093-48e0-4b53-a355-6da349f63b85 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:42.891528 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3489/7056] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:42.892470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14317093-48e0-4b53-a355-6da349f63b85 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:42.920492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14317093-48e0-4b53-a355-6da349f63b85 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:42.928487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a8c6f-1455-4528-8261-5f0e16b63a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:42.929102 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:42.929571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a8c6f-1455-4528-8261-5f0e16b63a7d admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:42.930016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a8c6f-1455-4528-8261-5f0e16b63a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:42.930478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a8c6f-1455-4528-8261-5f0e16b63a7d admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:42.931361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a8c6f-1455-4528-8261-5f0e16b63a7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:42.933623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a8c6f-1455-4528-8261-5f0e16b63a7d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:42.961699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b9710-17e2-46c2-947f-b5d7f7c2d513 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:43.040749 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:43.047190 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3490/7057] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:42 2022] POST /identity/v3/users => generated 305 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:43.048340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a8c6f-1455-4528-8261-5f0e16b63a7d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:43.067070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a8c6f-1455-4528-8261-5f0e16b63a7d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:43.086799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd259d-8b47-498d-be21-3cb7a1e6e4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:43.086799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd259d-8b47-498d-be21-3cb7a1e6e4cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:43.086799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd259d-8b47-498d-be21-3cb7a1e6e4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:43.086799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd259d-8b47-498d-be21-3cb7a1e6e4cd admin admin] PATH_INFO: `/v3/projects/d53666cb3f634e82b14fa33c4c21afaa/users/77639d2163944c93bc144f9e9b5f09a4/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:43.101801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf7e76-b867-4901-88e2-d37752e1da21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:43.102643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf7e76-b867-4901-88e2-d37752e1da21 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:43.102940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf7e76-b867-4901-88e2-d37752e1da21 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:43.103224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf7e76-b867-4901-88e2-d37752e1da21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:43.118001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd259d-8b47-498d-be21-3cb7a1e6e4cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d53666cb3f634e82b14fa33c4c21afaa, user_id=77639d2163944c93bc144f9e9b5f09a4, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:43.123238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd259d-8b47-498d-be21-3cb7a1e6e4cd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:43.194047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf7e76-b867-4901-88e2-d37752e1da21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:43.196756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf7e76-b867-4901-88e2-d37752e1da21 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:43.201399 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3491/7058] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:43 2022] PUT /identity/v3/projects/d53666cb3f634e82b14fa33c4c21afaa/users/77639d2163944c93bc144f9e9b5f09a4/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:43.202531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd259d-8b47-498d-be21-3cb7a1e6e4cd admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:43.231206 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3568/7059] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:42:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:42:43.232090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf7e76-b867-4901-88e2-d37752e1da21 service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:43.248468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf7e76-b867-4901-88e2-d37752e1da21 service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:43.338380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd259d-8b47-498d-be21-3cb7a1e6e4cd admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:43.351759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9c938-9e74-42f7-9549-dfb0d3b2c384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:43.352493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9c938-9e74-42f7-9549-dfb0d3b2c384 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:43.352786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9c938-9e74-42f7-9549-dfb0d3b2c384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:43.353142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9c938-9e74-42f7-9549-dfb0d3b2c384 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:43.353822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9c938-9e74-42f7-9549-dfb0d3b2c384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:43.355546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9c938-9e74-42f7-9549-dfb0d3b2c384 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:43.375375 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3492/7060] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:43.381469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9c938-9e74-42f7-9549-dfb0d3b2c384 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:43.384728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119d38f-be83-4ad9-9d26-6e382db3e4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:43.386235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119d38f-be83-4ad9-9d26-6e382db3e4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:43.386950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119d38f-be83-4ad9-9d26-6e382db3e4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:43.387615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b119d38f-be83-4ad9-9d26-6e382db3e4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:43.389186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119d38f-be83-4ad9-9d26-6e382db3e4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:43.391629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b119d38f-be83-4ad9-9d26-6e382db3e4a2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:43.407421 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3569/7061] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:43.415231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119d38f-be83-4ad9-9d26-6e382db3e4a2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:43.416438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9c938-9e74-42f7-9549-dfb0d3b2c384 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:43.436472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e499fdb-2067-4b6c-b645-8911eac750f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:43.437393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e499fdb-2067-4b6c-b645-8911eac750f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:43.437885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e499fdb-2067-4b6c-b645-8911eac750f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:43.438392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e499fdb-2067-4b6c-b645-8911eac750f0 admin admin] PATH_INFO: `/v3/projects/be2922c75434475bb5def2e63e279656/users/ca628f421e0e4d8ab1e2753b0c823248/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:43.447953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b119d38f-be83-4ad9-9d26-6e382db3e4a2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:43.451444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0827cf69-7d88-48eb-ae14-c4cb01eaf28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:43.453782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827cf69-7d88-48eb-ae14-c4cb01eaf28f admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:43.453944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827cf69-7d88-48eb-ae14-c4cb01eaf28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:43.454322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827cf69-7d88-48eb-ae14-c4cb01eaf28f admin admin] PATH_INFO: `/v3/projects/d53666cb3f634e82b14fa33c4c21afaa/users/77639d2163944c93bc144f9e9b5f09a4/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:43.457913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827cf69-7d88-48eb-ae14-c4cb01eaf28f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d53666cb3f634e82b14fa33c4c21afaa, user_id=77639d2163944c93bc144f9e9b5f09a4, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:43.461058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0827cf69-7d88-48eb-ae14-c4cb01eaf28f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:43.492115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e499fdb-2067-4b6c-b645-8911eac750f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2922c75434475bb5def2e63e279656, user_id=ca628f421e0e4d8ab1e2753b0c823248, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:43.498302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e499fdb-2067-4b6c-b645-8911eac750f0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:43.512820 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3570/7062] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:43 2022] PUT /identity/v3/projects/d53666cb3f634e82b14fa33c4c21afaa/users/77639d2163944c93bc144f9e9b5f09a4/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:43.514486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66919160-0fef-455f-bf0f-49e5700bb983 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:43.515577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66919160-0fef-455f-bf0f-49e5700bb983 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:43.515867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66919160-0fef-455f-bf0f-49e5700bb983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:43.578600 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3493/7063] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:43 2022] PUT /identity/v3/projects/be2922c75434475bb5def2e63e279656/users/ca628f421e0e4d8ab1e2753b0c823248/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:43.579533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e499fdb-2067-4b6c-b645-8911eac750f0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:43.603436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-66919160-0fef-455f-bf0f-49e5700bb983 None None] MFA Rules not processed for user `77639d2163944c93bc144f9e9b5f09a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:43.632297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-66919160-0fef-455f-bf0f-49e5700bb983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:43.706438 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:43.776175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e499fdb-2067-4b6c-b645-8911eac750f0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:43.785848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b742e58-1f2d-4c06-a7a2-d1541a51dd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:43.787211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b742e58-1f2d-4c06-a7a2-d1541a51dd24 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:43.787539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b742e58-1f2d-4c06-a7a2-d1541a51dd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:43.787793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b742e58-1f2d-4c06-a7a2-d1541a51dd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:43.788552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b742e58-1f2d-4c06-a7a2-d1541a51dd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:43.790326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b742e58-1f2d-4c06-a7a2-d1541a51dd24 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:43.825736 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3494/7064] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:43 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:43.836703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b742e58-1f2d-4c06-a7a2-d1541a51dd24 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:43.839327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9b742e58-1f2d-4c06-a7a2-d1541a51dd24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:43.847742 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:43.867811 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3571/7065] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:43.868731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66919160-0fef-455f-bf0f-49e5700bb983 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:43.877822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b742e58-1f2d-4c06-a7a2-d1541a51dd24 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:43.892850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66919160-0fef-455f-bf0f-49e5700bb983 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:43.899131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba745d-e0e5-4501-8ea6-f001dd331e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:43.900057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba745d-e0e5-4501-8ea6-f001dd331e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:43.900349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba745d-e0e5-4501-8ea6-f001dd331e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:43.900630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba745d-e0e5-4501-8ea6-f001dd331e51 admin admin] PATH_INFO: `/v3/projects/be2922c75434475bb5def2e63e279656/users/ca628f421e0e4d8ab1e2753b0c823248/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:43.901730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e2d51-e6b2-478d-a3ae-ccd95d49a1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:43.903293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e2d51-e6b2-478d-a3ae-ccd95d49a1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:43.906205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e2d51-e6b2-478d-a3ae-ccd95d49a1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:43.906619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e2d51-e6b2-478d-a3ae-ccd95d49a1c5 admin admin] PATH_INFO: `/v3/users/4e18806bc98448eb96f4c77784179488` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:43.911884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba745d-e0e5-4501-8ea6-f001dd331e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2922c75434475bb5def2e63e279656, user_id=ca628f421e0e4d8ab1e2753b0c823248, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:43.912898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e2d51-e6b2-478d-a3ae-ccd95d49a1c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e18806bc98448eb96f4c77784179488)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:43.914790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba745d-e0e5-4501-8ea6-f001dd331e51 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:43.915153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e2d51-e6b2-478d-a3ae-ccd95d49a1c5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:43.942335 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3572/7066] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:43 2022] PUT /identity/v3/projects/be2922c75434475bb5def2e63e279656/users/ca628f421e0e4d8ab1e2753b0c823248/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:43.943214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba745d-e0e5-4501-8ea6-f001dd331e51 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:44.060684 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:44.119871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba745d-e0e5-4501-8ea6-f001dd331e51 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:44.131664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52cd4c-8a10-461f-b2aa-24c17fb32adc tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77639d2163944c93bc144f9e9b5f09a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd53666cb3f634e82b14fa33c4c21afaa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:44.132935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52cd4c-8a10-461f-b2aa-24c17fb32adc tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:44.133455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52cd4c-8a10-461f-b2aa-24c17fb32adc tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:44.133894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52cd4c-8a10-461f-b2aa-24c17fb32adc tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] PATH_INFO: `/v3/projects/03a6e969a713403b90a4783d74f23525` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:44.138076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52cd4c-8a10-461f-b2aa-24c17fb32adc tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorizing `identity:get_project(project_id=03a6e969a713403b90a4783d74f23525)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:44.142324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52cd4c-8a10-461f-b2aa-24c17fb32adc tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:44.153211 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3573/7067] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:42:43 2022] GET /identity/v3/projects/03a6e969a713403b90a4783d74f23525 => generated 387 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:42:44.156624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bc448-ba1d-4122-bfea-5094445cf8bc None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:44.157534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bc448-ba1d-4122-bfea-5094445cf8bc None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:44.157830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bc448-ba1d-4122-bfea-5094445cf8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:44.174872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-445e2d51-e6b2-478d-a3ae-ccd95d49a1c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e18806bc98448eb96f4c77784179488'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:44.214937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-445e2d51-e6b2-478d-a3ae-ccd95d49a1c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e18806bc98448eb96f4c77784179488'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:44.215451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1c9bc448-ba1d-4122-bfea-5094445cf8bc None None] MFA Rules not processed for user `ca628f421e0e4d8ab1e2753b0c823248`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:44.221757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1c9bc448-ba1d-4122-bfea-5094445cf8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:44.225591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-445e2d51-e6b2-478d-a3ae-ccd95d49a1c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e18806bc98448eb96f4c77784179488'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:44.226559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-445e2d51-e6b2-478d-a3ae-ccd95d49a1c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e18806bc98448eb96f4c77784179488'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:44.301575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-445e2d51-e6b2-478d-a3ae-ccd95d49a1c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e18806bc98448eb96f4c77784179488'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:44.380188 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3574/7068] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:44 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:44.385332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bc448-ba1d-4122-bfea-5094445cf8bc None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:44.389497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1c9bc448-ba1d-4122-bfea-5094445cf8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:44.428056 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bc448-ba1d-4122-bfea-5094445cf8bc None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:44.442122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10118492-ad09-4506-a068-a13b0043a30e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77639d2163944c93bc144f9e9b5f09a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd53666cb3f634e82b14fa33c4c21afaa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:44.443464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10118492-ad09-4506-a068-a13b0043a30e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:44.445436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10118492-ad09-4506-a068-a13b0043a30e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:44.445808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10118492-ad09-4506-a068-a13b0043a30e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:44.446246 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3495/7069] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:43 2022] DELETE /identity/v3/users/4e18806bc98448eb96f4c77784179488 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:44.447658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e2d51-e6b2-478d-a3ae-ccd95d49a1c5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:44.447829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10118492-ad09-4506-a068-a13b0043a30e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:44.452555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10118492-ad09-4506-a068-a13b0043a30e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:44.454282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-445e2d51-e6b2-478d-a3ae-ccd95d49a1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:44.563226 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3575/7070] 10.222.0.43 () {60 vars in 1151 bytes} [Tue Jul 19 14:42:44 2022] POST /identity/v3/projects => generated 339 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:44.568733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10118492-ad09-4506-a068-a13b0043a30e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:44.573621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-10118492-ad09-4506-a068-a13b0043a30e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:44.645910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e2d51-e6b2-478d-a3ae-ccd95d49a1c5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:44.715598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10118492-ad09-4506-a068-a13b0043a30e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:44.721085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2148c-ff07-49ff-88b1-774e5e2bf0b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:44.722642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2148c-ff07-49ff-88b1-774e5e2bf0b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:44.722967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2148c-ff07-49ff-88b1-774e5e2bf0b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:44.723360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2148c-ff07-49ff-88b1-774e5e2bf0b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:44.725824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-88e2148c-ff07-49ff-88b1-774e5e2bf0b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:44.775082 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:44.783667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f0c89-def6-45db-99ed-124551b6293e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:44.784585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f0c89-def6-45db-99ed-124551b6293e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:44.784873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f0c89-def6-45db-99ed-124551b6293e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:44.785158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f0c89-def6-45db-99ed-124551b6293e admin admin] PATH_INFO: `/v3/users/8e76ce5de56a4dccb129ba1540bc5a94` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:44.786462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f0c89-def6-45db-99ed-124551b6293e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e76ce5de56a4dccb129ba1540bc5a94)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:44.788407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f0c89-def6-45db-99ed-124551b6293e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:44.851715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2148c-ff07-49ff-88b1-774e5e2bf0b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:44.853938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2148c-ff07-49ff-88b1-774e5e2bf0b2 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:44.867446 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3576/7071] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:44 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:44.870214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22739a0f-10af-449b-a1d5-cd26f8432ff8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:44.870662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22739a0f-10af-449b-a1d5-cd26f8432ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:44.874546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22739a0f-10af-449b-a1d5-cd26f8432ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:44.903259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-22739a0f-10af-449b-a1d5-cd26f8432ff8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:44.903259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-22739a0f-10af-449b-a1d5-cd26f8432ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:44.918254 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3577/7072] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:44.919168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22739a0f-10af-449b-a1d5-cd26f8432ff8 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:45.015955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22739a0f-10af-449b-a1d5-cd26f8432ff8 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:45.021550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631debb6-b1d8-44a5-b56b-74add609ddf9 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77639d2163944c93bc144f9e9b5f09a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd53666cb3f634e82b14fa33c4c21afaa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:45.022445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631debb6-b1d8-44a5-b56b-74add609ddf9 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:45.027665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631debb6-b1d8-44a5-b56b-74add609ddf9 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:45.027665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631debb6-b1d8-44a5-b56b-74add609ddf9 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:45.027665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631debb6-b1d8-44a5-b56b-74add609ddf9 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:45.027665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631debb6-b1d8-44a5-b56b-74add609ddf9 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:45.049955 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3578/7073] 10.222.0.43 () {58 vars in 1130 bytes} [Tue Jul 19 14:42:44 2022] GET /identity/v3/projects => generated 6975 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:45.050989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631debb6-b1d8-44a5-b56b-74add609ddf9 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:45.063458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631debb6-b1d8-44a5-b56b-74add609ddf9 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:45.067884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b311b-e172-451d-9a0a-7070eb3491af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:45.068563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b311b-e172-451d-9a0a-7070eb3491af service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:45.069028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b311b-e172-451d-9a0a-7070eb3491af service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:45.069367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b311b-e172-451d-9a0a-7070eb3491af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:45.089985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b311b-e172-451d-9a0a-7070eb3491af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:45.093551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b311b-e172-451d-9a0a-7070eb3491af service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:45.098625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-263f0c89-def6-45db-99ed-124551b6293e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e76ce5de56a4dccb129ba1540bc5a94'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:45.115442 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3579/7074] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:45.116440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b311b-e172-451d-9a0a-7070eb3491af service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:45.127882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b311b-e172-451d-9a0a-7070eb3491af service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:45.134947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86bbaf-9072-4924-b7e9-ff4b1c767206 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77639d2163944c93bc144f9e9b5f09a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd53666cb3f634e82b14fa33c4c21afaa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:45.136996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86bbaf-9072-4924-b7e9-ff4b1c767206 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:45.142947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86bbaf-9072-4924-b7e9-ff4b1c767206 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:45.142947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86bbaf-9072-4924-b7e9-ff4b1c767206 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] PATH_INFO: `/v3/projects/03a6e969a713403b90a4783d74f23525` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:45.142947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86bbaf-9072-4924-b7e9-ff4b1c767206 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorizing `identity:get_project(project_id=03a6e969a713403b90a4783d74f23525)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:45.146930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86bbaf-9072-4924-b7e9-ff4b1c767206 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:45.147442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-263f0c89-def6-45db-99ed-124551b6293e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e76ce5de56a4dccb129ba1540bc5a94'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:45.150360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-263f0c89-def6-45db-99ed-124551b6293e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e76ce5de56a4dccb129ba1540bc5a94'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:45.152227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-263f0c89-def6-45db-99ed-124551b6293e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e76ce5de56a4dccb129ba1540bc5a94'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:45.154838 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3580/7075] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:42:45 2022] GET /identity/v3/projects/03a6e969a713403b90a4783d74f23525 => generated 387 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:42:45.155754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86bbaf-9072-4924-b7e9-ff4b1c767206 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:45.162908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-aa86bbaf-9072-4924-b7e9-ff4b1c767206 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:45.185822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86bbaf-9072-4924-b7e9-ff4b1c767206 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:45.201004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b2814-4fc6-4af4-a893-955271d10f06 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77639d2163944c93bc144f9e9b5f09a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd53666cb3f634e82b14fa33c4c21afaa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:45.205594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b2814-4fc6-4af4-a893-955271d10f06 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:45.205594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b2814-4fc6-4af4-a893-955271d10f06 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:45.205594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b2814-4fc6-4af4-a893-955271d10f06 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] PATH_INFO: `/v3/projects/2596bc03d70b41658b42f89e7bb8e8a2` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:45.207989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b2814-4fc6-4af4-a893-955271d10f06 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorizing `identity:get_project(project_id=2596bc03d70b41658b42f89e7bb8e8a2)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:45.210084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b2814-4fc6-4af4-a893-955271d10f06 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:45.218534 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3581/7076] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:42:45 2022] GET /identity/v3/projects/2596bc03d70b41658b42f89e7bb8e8a2 => generated 339 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:42:45.219476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b2814-4fc6-4af4-a893-955271d10f06 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:45.231838 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:45.241965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-263f0c89-def6-45db-99ed-124551b6293e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e76ce5de56a4dccb129ba1540bc5a94'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:45.247633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b2814-4fc6-4af4-a893-955271d10f06 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:45.266883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdf73c-e8e0-4f03-92b0-b9b5de960f35 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77639d2163944c93bc144f9e9b5f09a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd53666cb3f634e82b14fa33c4c21afaa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:45.268612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdf73c-e8e0-4f03-92b0-b9b5de960f35 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:45.268911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdf73c-e8e0-4f03-92b0-b9b5de960f35 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:45.269203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bdf73c-e8e0-4f03-92b0-b9b5de960f35 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:45.269965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdf73c-e8e0-4f03-92b0-b9b5de960f35 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:45.271898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bdf73c-e8e0-4f03-92b0-b9b5de960f35 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:45.326175 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3582/7077] 10.222.0.43 () {58 vars in 1130 bytes} [Tue Jul 19 14:42:45 2022] GET /identity/v3/projects => generated 6975 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:45.327189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdf73c-e8e0-4f03-92b0-b9b5de960f35 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:45.346288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bdf73c-e8e0-4f03-92b0-b9b5de960f35 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:45.352474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85b4f1-f607-456b-a115-64245cd9f864 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77639d2163944c93bc144f9e9b5f09a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd53666cb3f634e82b14fa33c4c21afaa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:45.353152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85b4f1-f607-456b-a115-64245cd9f864 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:45.353449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85b4f1-f607-456b-a115-64245cd9f864 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:45.353734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85b4f1-f607-456b-a115-64245cd9f864 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:45.354645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85b4f1-f607-456b-a115-64245cd9f864 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:42:45.354962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85b4f1-f607-456b-a115-64245cd9f864 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:45.356925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85b4f1-f607-456b-a115-64245cd9f864 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:45.375896 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3496/7078] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:44 2022] DELETE /identity/v3/users/8e76ce5de56a4dccb129ba1540bc5a94 => generated 0 bytes in 925 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:45.378190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf1629-6861-4487-90c3-481045c6246c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:45.378491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf1629-6861-4487-90c3-481045c6246c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:45.389119 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3583/7079] 10.222.0.43 () {58 vars in 1165 bytes} [Tue Jul 19 14:42:45 2022] GET /identity/v3/projects?domain_id=default => generated 6644 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:45.392818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cf1629-6861-4487-90c3-481045c6246c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:45.397208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85b4f1-f607-456b-a115-64245cd9f864 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:45.420047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85b4f1-f607-456b-a115-64245cd9f864 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:45.456496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d1cf1629-6861-4487-90c3-481045c6246c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:45.458509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d1cf1629-6861-4487-90c3-481045c6246c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:45.534290 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:45.559838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b059a6-9178-4e8b-b3ee-fb0841f9c0a3 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77639d2163944c93bc144f9e9b5f09a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd53666cb3f634e82b14fa33c4c21afaa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:45.560535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b059a6-9178-4e8b-b3ee-fb0841f9c0a3 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:45.560827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b059a6-9178-4e8b-b3ee-fb0841f9c0a3 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:45.561118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b059a6-9178-4e8b-b3ee-fb0841f9c0a3 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:45.561857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b059a6-9178-4e8b-b3ee-fb0841f9c0a3 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:45.563773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b059a6-9178-4e8b-b3ee-fb0841f9c0a3 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:45.613683 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3497/7080] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:45.646270 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3584/7081] 10.222.0.43 () {58 vars in 1130 bytes} [Tue Jul 19 14:42:45 2022] GET /identity/v3/projects => generated 6975 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:45.647142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf1629-6861-4487-90c3-481045c6246c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:45.671951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cf1629-6861-4487-90c3-481045c6246c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:45.692475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b059a6-9178-4e8b-b3ee-fb0841f9c0a3 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:45.694389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a1b059a6-9178-4e8b-b3ee-fb0841f9c0a3 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:45.702165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa71b0-c2d5-4302-9541-05afefa2468f tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77639d2163944c93bc144f9e9b5f09a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd53666cb3f634e82b14fa33c4c21afaa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:45.703031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa71b0-c2d5-4302-9541-05afefa2468f tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:45.705655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa71b0-c2d5-4302-9541-05afefa2468f tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:45.707347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa71b0-c2d5-4302-9541-05afefa2468f tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:45.712061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa71b0-c2d5-4302-9541-05afefa2468f tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:42:45.713163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa71b0-c2d5-4302-9541-05afefa2468f tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:45.721595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa71b0-c2d5-4302-9541-05afefa2468f tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:45.885668 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3498/7082] 10.222.0.43 () {58 vars in 1165 bytes} [Tue Jul 19 14:42:45 2022] GET /identity/v3/projects?domain_id=default => generated 6644 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:45.887326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa71b0-c2d5-4302-9541-05afefa2468f tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:45.894434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b059a6-9178-4e8b-b3ee-fb0841f9c0a3 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:45.913901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107229d-24e5-4de0-9418-835ccc07e5c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:45.914968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107229d-24e5-4de0-9418-835ccc07e5c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:45.915816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107229d-24e5-4de0-9418-835ccc07e5c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:45.916439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107229d-24e5-4de0-9418-835ccc07e5c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:45.932596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa71b0-c2d5-4302-9541-05afefa2468f tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:45.943964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107229d-24e5-4de0-9418-835ccc07e5c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:45.951324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107229d-24e5-4de0-9418-835ccc07e5c6 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:45.955096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cb04d-fee4-4cd3-92b1-b6af20433ff3 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77639d2163944c93bc144f9e9b5f09a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd53666cb3f634e82b14fa33c4c21afaa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:45.955574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cb04d-fee4-4cd3-92b1-b6af20433ff3 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:45.956391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cb04d-fee4-4cd3-92b1-b6af20433ff3 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:45.956737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54cb04d-fee4-4cd3-92b1-b6af20433ff3 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:45.960206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54cb04d-fee4-4cd3-92b1-b6af20433ff3 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:45.963361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54cb04d-fee4-4cd3-92b1-b6af20433ff3 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:45.978072 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3585/7083] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:45.980942 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:45.994772 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3499/7084] 10.222.0.43 () {58 vars in 1130 bytes} [Tue Jul 19 14:42:45 2022] GET /identity/v3/projects => generated 6975 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:46.000996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107229d-24e5-4de0-9418-835ccc07e5c6 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:46.016418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107229d-24e5-4de0-9418-835ccc07e5c6 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:46.023972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f201681-fb8b-438a-b2d5-110c39e43f0b tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77639d2163944c93bc144f9e9b5f09a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd53666cb3f634e82b14fa33c4c21afaa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:46.024806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f201681-fb8b-438a-b2d5-110c39e43f0b tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:46.025199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f201681-fb8b-438a-b2d5-110c39e43f0b tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:46.025603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f201681-fb8b-438a-b2d5-110c39e43f0b tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:46.026661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f201681-fb8b-438a-b2d5-110c39e43f0b tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-793623290) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:42:46.027081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f201681-fb8b-438a-b2d5-110c39e43f0b tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:46.031290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f201681-fb8b-438a-b2d5-110c39e43f0b tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:46.048231 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3586/7085] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:42:45 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-793623290 => generated 534 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:42:46.054499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cb04d-fee4-4cd3-92b1-b6af20433ff3 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:46.066716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54cb04d-fee4-4cd3-92b1-b6af20433ff3 tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:46.073013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2432b5-5d4a-45db-a329-318f297b831e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77639d2163944c93bc144f9e9b5f09a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd53666cb3f634e82b14fa33c4c21afaa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:46.074489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2432b5-5d4a-45db-a329-318f297b831e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:46.074939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2432b5-5d4a-45db-a329-318f297b831e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:46.075371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2432b5-5d4a-45db-a329-318f297b831e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] PATH_INFO: `/v3/projects/2596bc03d70b41658b42f89e7bb8e8a2` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:46.077276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2432b5-5d4a-45db-a329-318f297b831e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2596bc03d70b41658b42f89e7bb8e8a2)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:46.081651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2432b5-5d4a-45db-a329-318f297b831e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:46.140132 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:46.249260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bd2432b5-5d4a-45db-a329-318f297b831e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2596bc03d70b41658b42f89e7bb8e8a2', 'request_id': 'req-bd2432b5-5d4a-45db-a329-318f297b831e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:46.339822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bd2432b5-5d4a-45db-a329-318f297b831e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2596bc03d70b41658b42f89e7bb8e8a2', 'request_id': 'req-bd2432b5-5d4a-45db-a329-318f297b831e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:46.352782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bd2432b5-5d4a-45db-a329-318f297b831e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2596bc03d70b41658b42f89e7bb8e8a2', 'request_id': 'req-bd2432b5-5d4a-45db-a329-318f297b831e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:46.380750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f201681-fb8b-438a-b2d5-110c39e43f0b tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:46.382550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5f201681-fb8b-438a-b2d5-110c39e43f0b tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:46.386877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bd2432b5-5d4a-45db-a329-318f297b831e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] The token cache is being invalidate because project 2596bc03d70b41658b42f89e7bb8e8a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:46.387223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bd2432b5-5d4a-45db-a329-318f297b831e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:46.388989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bd2432b5-5d4a-45db-a329-318f297b831e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:46.400097 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3500/7086] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:46 2022] DELETE /identity/v3/projects/2596bc03d70b41658b42f89e7bb8e8a2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:46.401369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2432b5-5d4a-45db-a329-318f297b831e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:46.417031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bd2432b5-5d4a-45db-a329-318f297b831e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:46.536402 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:46.599666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f201681-fb8b-438a-b2d5-110c39e43f0b tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:46.626897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2432b5-5d4a-45db-a329-318f297b831e tempest-ListProjectsStaticTestJSON-2044960180 tempest-ListProjectsStaticTestJSON-2044960180-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:46.648463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1fe6d-a984-46e9-9843-b606c523bb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:46.649694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1fe6d-a984-46e9-9843-b606c523bb17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:46.650240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1fe6d-a984-46e9-9843-b606c523bb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:46.650679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1fe6d-a984-46e9-9843-b606c523bb17 admin admin] PATH_INFO: `/v3/users/487aa06d87aa4a28801ef21fb10dc94e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:46.653602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1fe6d-a984-46e9-9843-b606c523bb17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=487aa06d87aa4a28801ef21fb10dc94e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:46.657652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1fe6d-a984-46e9-9843-b606c523bb17 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:46.752274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14d187-466e-4115-8ec2-0d7a792cd6c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:46.753467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14d187-466e-4115-8ec2-0d7a792cd6c1 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:46.753750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14d187-466e-4115-8ec2-0d7a792cd6c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:46.754025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb14d187-466e-4115-8ec2-0d7a792cd6c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:46.755956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bb14d187-466e-4115-8ec2-0d7a792cd6c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:46.882279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14d187-466e-4115-8ec2-0d7a792cd6c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:46.883904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb14d187-466e-4115-8ec2-0d7a792cd6c1 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:46.901154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-14d1fe6d-a984-46e9-9843-b606c523bb17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '487aa06d87aa4a28801ef21fb10dc94e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:46.913071 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3587/7087] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:42:46.913867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14d187-466e-4115-8ec2-0d7a792cd6c1 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:46.917137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bb14d187-466e-4115-8ec2-0d7a792cd6c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:46.941024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-14d1fe6d-a984-46e9-9843-b606c523bb17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '487aa06d87aa4a28801ef21fb10dc94e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:46.942158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-14d1fe6d-a984-46e9-9843-b606c523bb17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '487aa06d87aa4a28801ef21fb10dc94e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:46.942801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-14d1fe6d-a984-46e9-9843-b606c523bb17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '487aa06d87aa4a28801ef21fb10dc94e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:46.949310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb14d187-466e-4115-8ec2-0d7a792cd6c1 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:46.963437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-14d1fe6d-a984-46e9-9843-b606c523bb17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '487aa06d87aa4a28801ef21fb10dc94e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:46.968728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840a48fe-4a6f-48fd-a788-dba1694ee6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:46.969716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a48fe-4a6f-48fd-a788-dba1694ee6cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:46.969900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a48fe-4a6f-48fd-a788-dba1694ee6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:46.970209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840a48fe-4a6f-48fd-a788-dba1694ee6cd admin admin] PATH_INFO: `/v3/projects/8d809703d9524deb8273fbfe5867009c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:46.972297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a48fe-4a6f-48fd-a788-dba1694ee6cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d809703d9524deb8273fbfe5867009c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:46.976762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840a48fe-4a6f-48fd-a788-dba1694ee6cd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:47.060152 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3501/7088] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:46 2022] DELETE /identity/v3/users/487aa06d87aa4a28801ef21fb10dc94e => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:47.062076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1fe6d-a984-46e9-9843-b606c523bb17 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:47.068376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-14d1fe6d-a984-46e9-9843-b606c523bb17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:47.218616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-840a48fe-4a6f-48fd-a788-dba1694ee6cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d809703d9524deb8273fbfe5867009c', 'request_id': 'req-840a48fe-4a6f-48fd-a788-dba1694ee6cd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:47.242362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-840a48fe-4a6f-48fd-a788-dba1694ee6cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d809703d9524deb8273fbfe5867009c', 'request_id': 'req-840a48fe-4a6f-48fd-a788-dba1694ee6cd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:47.254582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-840a48fe-4a6f-48fd-a788-dba1694ee6cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d809703d9524deb8273fbfe5867009c', 'request_id': 'req-840a48fe-4a6f-48fd-a788-dba1694ee6cd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:47.259699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1fe6d-a984-46e9-9843-b606c523bb17 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:47.378326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-840a48fe-4a6f-48fd-a788-dba1694ee6cd admin admin] The token cache is being invalidate because project 8d809703d9524deb8273fbfe5867009c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:47.378944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-840a48fe-4a6f-48fd-a788-dba1694ee6cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:47.380237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-840a48fe-4a6f-48fd-a788-dba1694ee6cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:47.388176 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3588/7089] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:46 2022] DELETE /identity/v3/projects/8d809703d9524deb8273fbfe5867009c => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:47.397970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427b922-4163-499a-bd3d-3725b4cf6dad None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:47.400036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427b922-4163-499a-bd3d-3725b4cf6dad None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:47.400327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427b922-4163-499a-bd3d-3725b4cf6dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:47.430202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90df58-d579-4899-b77a-ac879a0f6fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:47.431107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90df58-d579-4899-b77a-ac879a0f6fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:47.431395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90df58-d579-4899-b77a-ac879a0f6fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:47.431734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90df58-d579-4899-b77a-ac879a0f6fcc admin admin] PATH_INFO: `/v3/projects/c4270d1ac1a34e87b1cac1439c3c2063` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:47.433151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90df58-d579-4899-b77a-ac879a0f6fcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4270d1ac1a34e87b1cac1439c3c2063)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:47.435506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90df58-d579-4899-b77a-ac879a0f6fcc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:47.466212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4427b922-4163-499a-bd3d-3725b4cf6dad None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:47.484777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4427b922-4163-499a-bd3d-3725b4cf6dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:47.509492 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3589/7090] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:47.511489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427b922-4163-499a-bd3d-3725b4cf6dad None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:47.520395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4427b922-4163-499a-bd3d-3725b4cf6dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:47.557946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427b922-4163-499a-bd3d-3725b4cf6dad None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:47.576249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7725f-4adf-4a38-8ed7-f927292b7c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:47.579034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7725f-4adf-4a38-8ed7-f927292b7c10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:47.579545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7725f-4adf-4a38-8ed7-f927292b7c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:47.580141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7725f-4adf-4a38-8ed7-f927292b7c10 admin admin] PATH_INFO: `/v3/users/5abc97fa9e0a4bd4923183b477b9e1bd` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:47.583132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7725f-4adf-4a38-8ed7-f927292b7c10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5abc97fa9e0a4bd4923183b477b9e1bd)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:47.586598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7725f-4adf-4a38-8ed7-f927292b7c10 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:47.644739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ae90df58-d579-4899-b77a-ac879a0f6fcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4270d1ac1a34e87b1cac1439c3c2063', 'request_id': 'req-ae90df58-d579-4899-b77a-ac879a0f6fcc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:47.745965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ae90df58-d579-4899-b77a-ac879a0f6fcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4270d1ac1a34e87b1cac1439c3c2063', 'request_id': 'req-ae90df58-d579-4899-b77a-ac879a0f6fcc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:47.753912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ae90df58-d579-4899-b77a-ac879a0f6fcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4270d1ac1a34e87b1cac1439c3c2063', 'request_id': 'req-ae90df58-d579-4899-b77a-ac879a0f6fcc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:47.767195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ae90df58-d579-4899-b77a-ac879a0f6fcc admin admin] The token cache is being invalidate because project c4270d1ac1a34e87b1cac1439c3c2063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:47.767770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ae90df58-d579-4899-b77a-ac879a0f6fcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:47.769043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ae90df58-d579-4899-b77a-ac879a0f6fcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:47.771571 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3502/7091] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:47 2022] DELETE /identity/v3/projects/c4270d1ac1a34e87b1cac1439c3c2063 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:47.772786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90df58-d579-4899-b77a-ac879a0f6fcc admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:47.776698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ae90df58-d579-4899-b77a-ac879a0f6fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:47.867580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90df58-d579-4899-b77a-ac879a0f6fcc admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:47.874527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a6e81-e6c1-421e-a5a7-23c9e0fa2913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:47.875599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a6e81-e6c1-421e-a5a7-23c9e0fa2913 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:47.876486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a6e81-e6c1-421e-a5a7-23c9e0fa2913 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:47.877014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a6e81-e6c1-421e-a5a7-23c9e0fa2913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:47.879500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-073a6e81-e6c1-421e-a5a7-23c9e0fa2913 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:47.949449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-25f7725f-4adf-4a38-8ed7-f927292b7c10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5abc97fa9e0a4bd4923183b477b9e1bd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:47.974683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-25f7725f-4adf-4a38-8ed7-f927292b7c10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5abc97fa9e0a4bd4923183b477b9e1bd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:47.991502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-25f7725f-4adf-4a38-8ed7-f927292b7c10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5abc97fa9e0a4bd4923183b477b9e1bd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:47.997292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-25f7725f-4adf-4a38-8ed7-f927292b7c10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5abc97fa9e0a4bd4923183b477b9e1bd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:48.049502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a6e81-e6c1-421e-a5a7-23c9e0fa2913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:48.060980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a6e81-e6c1-421e-a5a7-23c9e0fa2913 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:48.077515 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3503/7092] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:48.079443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6002a-24ff-40bc-bc57-1aa68b389578 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:48.080126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6002a-24ff-40bc-bc57-1aa68b389578 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:48.080126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6002a-24ff-40bc-bc57-1aa68b389578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:48.106988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f5b6002a-24ff-40bc-bc57-1aa68b389578 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:48.108539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f5b6002a-24ff-40bc-bc57-1aa68b389578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:48.121607 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3504/7093] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:48.132086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db9fc6-1feb-484e-b54b-7804f0855ddb None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:48.132385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db9fc6-1feb-484e-b54b-7804f0855ddb None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:48.132655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33db9fc6-1feb-484e-b54b-7804f0855ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:48.168484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-25f7725f-4adf-4a38-8ed7-f927292b7c10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5abc97fa9e0a4bd4923183b477b9e1bd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:48.178024 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3590/7094] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:47 2022] DELETE /identity/v3/users/5abc97fa9e0a4bd4923183b477b9e1bd => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:48.226613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-33db9fc6-1feb-484e-b54b-7804f0855ddb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:48.226613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-33db9fc6-1feb-484e-b54b-7804f0855ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:48.288716 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:48.347933 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3505/7095] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:48.351912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7725f-4adf-4a38-8ed7-f927292b7c10 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:48.364070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7725f-4adf-4a38-8ed7-f927292b7c10 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:48.379295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d2d5b-51ae-4c0a-9681-0c89b88825bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:48.380516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d2d5b-51ae-4c0a-9681-0c89b88825bd admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:48.383079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d2d5b-51ae-4c0a-9681-0c89b88825bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:48.383570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d2d5b-51ae-4c0a-9681-0c89b88825bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:48.386748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d2d5b-51ae-4c0a-9681-0c89b88825bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:42:48.387611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d2d5b-51ae-4c0a-9681-0c89b88825bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:48.393309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d2d5b-51ae-4c0a-9681-0c89b88825bd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:48.422526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db9fc6-1feb-484e-b54b-7804f0855ddb None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:48.422793 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3591/7096] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:42:48.435080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33db9fc6-1feb-484e-b54b-7804f0855ddb None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:48.448381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656bebe-4bf9-4eaf-b31a-2f2a1ebf68f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:48.448381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656bebe-4bf9-4eaf-b31a-2f2a1ebf68f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:48.448381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656bebe-4bf9-4eaf-b31a-2f2a1ebf68f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:48.448381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656bebe-4bf9-4eaf-b31a-2f2a1ebf68f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:48.448895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656bebe-4bf9-4eaf-b31a-2f2a1ebf68f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:48.448895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656bebe-4bf9-4eaf-b31a-2f2a1ebf68f6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:48.591153 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3506/7097] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:48 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:48.595556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d2d5b-51ae-4c0a-9681-0c89b88825bd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:48.617610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d2d5b-51ae-4c0a-9681-0c89b88825bd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:48.734809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720a35c-c494-4be4-bca5-1634e6d30a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:48.738851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720a35c-c494-4be4-bca5-1634e6d30a08 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:48.739824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720a35c-c494-4be4-bca5-1634e6d30a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:48.740529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720a35c-c494-4be4-bca5-1634e6d30a08 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:48.742117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720a35c-c494-4be4-bca5-1634e6d30a08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:48.759755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720a35c-c494-4be4-bca5-1634e6d30a08 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:48.843688 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:48.947871 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3592/7098] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:48 2022] POST /identity/v3/users => generated 291 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:48.952106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656bebe-4bf9-4eaf-b31a-2f2a1ebf68f6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:48.965784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656bebe-4bf9-4eaf-b31a-2f2a1ebf68f6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:48.973966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78e5bf-eb8c-4243-b605-2037a1b20077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:48.974930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78e5bf-eb8c-4243-b605-2037a1b20077 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:48.975423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78e5bf-eb8c-4243-b605-2037a1b20077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:48.976247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c78e5bf-eb8c-4243-b605-2037a1b20077 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:48.977311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78e5bf-eb8c-4243-b605-2037a1b20077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:48.983870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c78e5bf-eb8c-4243-b605-2037a1b20077 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:49.011684 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3507/7099] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:48 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:49.015622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720a35c-c494-4be4-bca5-1634e6d30a08 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:49.029171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720a35c-c494-4be4-bca5-1634e6d30a08 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:49.044506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a9373e-9e4e-4231-b0c6-3cf938e44094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:49.045687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9373e-9e4e-4231-b0c6-3cf938e44094 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:49.046229 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9373e-9e4e-4231-b0c6-3cf938e44094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:49.049829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a9373e-9e4e-4231-b0c6-3cf938e44094 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:49.057353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9373e-9e4e-4231-b0c6-3cf938e44094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:49.059405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a9373e-9e4e-4231-b0c6-3cf938e44094 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:49.093258 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3593/7100] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:49 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:49.097922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78e5bf-eb8c-4243-b605-2037a1b20077 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:49.128312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c78e5bf-eb8c-4243-b605-2037a1b20077 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:49.141317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed006358-526d-424b-8260-d7dfe005bda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:49.142800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed006358-526d-424b-8260-d7dfe005bda9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:49.143255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed006358-526d-424b-8260-d7dfe005bda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:49.143641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed006358-526d-424b-8260-d7dfe005bda9 admin admin] PATH_INFO: `/v3/projects/466f74eba5ee46f98cd8bac3510a47f0/users/14fb30b0015e41e6b809dfd90922f137/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:49.168767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed006358-526d-424b-8260-d7dfe005bda9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=466f74eba5ee46f98cd8bac3510a47f0, user_id=14fb30b0015e41e6b809dfd90922f137, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:49.172440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed006358-526d-424b-8260-d7dfe005bda9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:49.306495 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3508/7101] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:49 2022] PUT /identity/v3/projects/466f74eba5ee46f98cd8bac3510a47f0/users/14fb30b0015e41e6b809dfd90922f137/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:42:49.307478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d6b9d-f173-44a5-995f-e9b6de51620c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:49.307778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d6b9d-f173-44a5-995f-e9b6de51620c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:49.308074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d6b9d-f173-44a5-995f-e9b6de51620c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:49.343369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed006358-526d-424b-8260-d7dfe005bda9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:49.345190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ed006358-526d-424b-8260-d7dfe005bda9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:49.358802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-222d6b9d-f173-44a5-995f-e9b6de51620c None None] MFA Rules not processed for user `14fb30b0015e41e6b809dfd90922f137`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:49.360309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-222d6b9d-f173-44a5-995f-e9b6de51620c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:49.458886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed006358-526d-424b-8260-d7dfe005bda9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:49.459013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0065172-a8b0-46a4-bad0-64c312ff2b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:49.459906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0065172-a8b0-46a4-bad0-64c312ff2b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:49.460195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0065172-a8b0-46a4-bad0-64c312ff2b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:49.460481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0065172-a8b0-46a4-bad0-64c312ff2b14 admin admin] PATH_INFO: `/v3/projects/e953d7fb5e2149e1b845a153cbe3d386` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:49.461838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0065172-a8b0-46a4-bad0-64c312ff2b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e953d7fb5e2149e1b845a153cbe3d386)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:49.463964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0065172-a8b0-46a4-bad0-64c312ff2b14 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:49.518171 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3594/7102] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:49.518171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d6b9d-f173-44a5-995f-e9b6de51620c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:49.518559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-222d6b9d-f173-44a5-995f-e9b6de51620c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:49.535189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d6b9d-f173-44a5-995f-e9b6de51620c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:49.540912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0881e31-488b-4f3a-99a4-89ebcddcfb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:49.541856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0881e31-488b-4f3a-99a4-89ebcddcfb9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:49.542085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0881e31-488b-4f3a-99a4-89ebcddcfb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:49.542444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0881e31-488b-4f3a-99a4-89ebcddcfb9e admin admin] PATH_INFO: `/v3/projects/03a6e969a713403b90a4783d74f23525` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:49.545381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0881e31-488b-4f3a-99a4-89ebcddcfb9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a6e969a713403b90a4783d74f23525)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:49.547529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0881e31-488b-4f3a-99a4-89ebcddcfb9e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:49.626826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c0065172-a8b0-46a4-bad0-64c312ff2b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e953d7fb5e2149e1b845a153cbe3d386', 'request_id': 'req-c0065172-a8b0-46a4-bad0-64c312ff2b14'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:49.741324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b0881e31-488b-4f3a-99a4-89ebcddcfb9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a6e969a713403b90a4783d74f23525', 'request_id': 'req-b0881e31-488b-4f3a-99a4-89ebcddcfb9e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:49.747865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b0881e31-488b-4f3a-99a4-89ebcddcfb9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a6e969a713403b90a4783d74f23525', 'request_id': 'req-b0881e31-488b-4f3a-99a4-89ebcddcfb9e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:49.756703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b0881e31-488b-4f3a-99a4-89ebcddcfb9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a6e969a713403b90a4783d74f23525', 'request_id': 'req-b0881e31-488b-4f3a-99a4-89ebcddcfb9e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:49.757333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c0065172-a8b0-46a4-bad0-64c312ff2b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e953d7fb5e2149e1b845a153cbe3d386', 'request_id': 'req-c0065172-a8b0-46a4-bad0-64c312ff2b14'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:49.768510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c0065172-a8b0-46a4-bad0-64c312ff2b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e953d7fb5e2149e1b845a153cbe3d386', 'request_id': 'req-c0065172-a8b0-46a4-bad0-64c312ff2b14'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:49.783129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c0065172-a8b0-46a4-bad0-64c312ff2b14 admin admin] The token cache is being invalidate because project e953d7fb5e2149e1b845a153cbe3d386 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:49.783499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c0065172-a8b0-46a4-bad0-64c312ff2b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:49.784402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c0065172-a8b0-46a4-bad0-64c312ff2b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:49.786874 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3509/7103] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:49 2022] DELETE /identity/v3/projects/e953d7fb5e2149e1b845a153cbe3d386 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:42:49.787971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0065172-a8b0-46a4-bad0-64c312ff2b14 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:49.791173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c0065172-a8b0-46a4-bad0-64c312ff2b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:49.858811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b0881e31-488b-4f3a-99a4-89ebcddcfb9e admin admin] The token cache is being invalidate because project 03a6e969a713403b90a4783d74f23525 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:49.859042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b0881e31-488b-4f3a-99a4-89ebcddcfb9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:49.861557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b0881e31-488b-4f3a-99a4-89ebcddcfb9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:49.867555 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3595/7104] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:49 2022] DELETE /identity/v3/projects/03a6e969a713403b90a4783d74f23525 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:49.869135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497188cd-786b-43d6-95ce-8669dcd26a59 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:49.869437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497188cd-786b-43d6-95ce-8669dcd26a59 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:49.869724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497188cd-786b-43d6-95ce-8669dcd26a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:49.893475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-497188cd-786b-43d6-95ce-8669dcd26a59 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:49.895184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-497188cd-786b-43d6-95ce-8669dcd26a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:49.899931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0065172-a8b0-46a4-bad0-64c312ff2b14 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:50.028099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a16075-bea9-4b1c-a958-9a0840652957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:50.028785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a16075-bea9-4b1c-a958-9a0840652957 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:50.029102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a16075-bea9-4b1c-a958-9a0840652957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:50.037272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a16075-bea9-4b1c-a958-9a0840652957 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:50.037272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a16075-bea9-4b1c-a958-9a0840652957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:50.037504 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3596/7105] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:50.038498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497188cd-786b-43d6-95ce-8669dcd26a59 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:50.039969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-497188cd-786b-43d6-95ce-8669dcd26a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:50.049491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a16075-bea9-4b1c-a958-9a0840652957 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:50.057315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497188cd-786b-43d6-95ce-8669dcd26a59 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:50.065447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35337d-eee3-4ce1-b61e-d43eaf98f435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:50.068486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35337d-eee3-4ce1-b61e-d43eaf98f435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:50.068782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35337d-eee3-4ce1-b61e-d43eaf98f435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:50.069070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d35337d-eee3-4ce1-b61e-d43eaf98f435 admin admin] PATH_INFO: `/v3/users/77639d2163944c93bc144f9e9b5f09a4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:50.075832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35337d-eee3-4ce1-b61e-d43eaf98f435 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77639d2163944c93bc144f9e9b5f09a4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:50.078944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d35337d-eee3-4ce1-b61e-d43eaf98f435 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:50.170272 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3510/7106] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:49 2022] POST /identity/v3/projects => generated 383 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:50.174875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc061d-15ff-4c48-89c3-15bb6cc01289 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:50.174875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc061d-15ff-4c48-89c3-15bb6cc01289 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:50.174875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc061d-15ff-4c48-89c3-15bb6cc01289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:50.205807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9cfc061d-15ff-4c48-89c3-15bb6cc01289 None None] MFA Rules not processed for user `4da804ebc57f46ee99a1eb94cf59fded`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:50.207125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9cfc061d-15ff-4c48-89c3-15bb6cc01289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:50.313219 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:50.322135 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3511/7107] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:50.327750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba9171-1269-431a-af72-c8b9a2358b20 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:50.328707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba9171-1269-431a-af72-c8b9a2358b20 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:50.328993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba9171-1269-431a-af72-c8b9a2358b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:50.342945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1d35337d-eee3-4ce1-b61e-d43eaf98f435 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77639d2163944c93bc144f9e9b5f09a4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:50.372172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1d35337d-eee3-4ce1-b61e-d43eaf98f435 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77639d2163944c93bc144f9e9b5f09a4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:50.383963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f8ba9171-1269-431a-af72-c8b9a2358b20 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:50.385415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f8ba9171-1269-431a-af72-c8b9a2358b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:50.395306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1d35337d-eee3-4ce1-b61e-d43eaf98f435 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77639d2163944c93bc144f9e9b5f09a4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:50.398371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1d35337d-eee3-4ce1-b61e-d43eaf98f435 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77639d2163944c93bc144f9e9b5f09a4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:50.488990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1d35337d-eee3-4ce1-b61e-d43eaf98f435 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77639d2163944c93bc144f9e9b5f09a4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:50.493588 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3512/7108] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:50.494641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba9171-1269-431a-af72-c8b9a2358b20 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:50.507390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f8ba9171-1269-431a-af72-c8b9a2358b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:50.507541 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3597/7109] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:50 2022] DELETE /identity/v3/users/77639d2163944c93bc144f9e9b5f09a4 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:50.511389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35337d-eee3-4ce1-b61e-d43eaf98f435 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:50.512859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1d35337d-eee3-4ce1-b61e-d43eaf98f435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:50.513612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba9171-1269-431a-af72-c8b9a2358b20 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:50.631751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540e585-75df-4197-bf49-64f5f69449a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:50.632238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d35337d-eee3-4ce1-b61e-d43eaf98f435 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:50.634016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e585-75df-4197-bf49-64f5f69449a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:50.634720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e585-75df-4197-bf49-64f5f69449a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:50.636811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540e585-75df-4197-bf49-64f5f69449a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:50.637604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540e585-75df-4197-bf49-64f5f69449a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:50.641088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540e585-75df-4197-bf49-64f5f69449a9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:50.642567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979fd8b-955b-4044-a0b1-334d8d6393b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:50.643565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979fd8b-955b-4044-a0b1-334d8d6393b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:50.643964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979fd8b-955b-4044-a0b1-334d8d6393b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:50.644355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979fd8b-955b-4044-a0b1-334d8d6393b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:50.645582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979fd8b-955b-4044-a0b1-334d8d6393b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:42:50.646831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979fd8b-955b-4044-a0b1-334d8d6393b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:50.649895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979fd8b-955b-4044-a0b1-334d8d6393b4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:50.668840 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3598/7110] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:42:50.672850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979fd8b-955b-4044-a0b1-334d8d6393b4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:50.691709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979fd8b-955b-4044-a0b1-334d8d6393b4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:50.702651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fcc43-03b5-4b4c-baaf-df4001677146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:50.708495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fcc43-03b5-4b4c-baaf-df4001677146 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:50.709533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fcc43-03b5-4b4c-baaf-df4001677146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:50.710934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54fcc43-03b5-4b4c-baaf-df4001677146 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:50.711923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fcc43-03b5-4b4c-baaf-df4001677146 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:50.717419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54fcc43-03b5-4b4c-baaf-df4001677146 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:50.737798 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3513/7111] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:50 2022] POST /identity/v3/users => generated 292 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:50.740896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540e585-75df-4197-bf49-64f5f69449a9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:50.752193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a540e585-75df-4197-bf49-64f5f69449a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:50.776149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540e585-75df-4197-bf49-64f5f69449a9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:50.796605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9325721-a3e9-4f22-a8df-5e4dccba5f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:50.797257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9325721-a3e9-4f22-a8df-5e4dccba5f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:50.797556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9325721-a3e9-4f22-a8df-5e4dccba5f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:50.797802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9325721-a3e9-4f22-a8df-5e4dccba5f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:50.799179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9325721-a3e9-4f22-a8df-5e4dccba5f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:50.800915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9325721-a3e9-4f22-a8df-5e4dccba5f22 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:50.825733 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3514/7112] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:42:50.834621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9325721-a3e9-4f22-a8df-5e4dccba5f22 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:50.870450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9325721-a3e9-4f22-a8df-5e4dccba5f22 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:50.883573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002aba3-391f-41b1-8f52-620bf7336c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:50.884176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002aba3-391f-41b1-8f52-620bf7336c57 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:50.884720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002aba3-391f-41b1-8f52-620bf7336c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:50.886245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002aba3-391f-41b1-8f52-620bf7336c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:50.887561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002aba3-391f-41b1-8f52-620bf7336c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:50.889192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002aba3-391f-41b1-8f52-620bf7336c57 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:50.902171 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3515/7113] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:50 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:50.910395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002aba3-391f-41b1-8f52-620bf7336c57 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:50.926317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002aba3-391f-41b1-8f52-620bf7336c57 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:50.935723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4273422-4eff-4296-8017-84f6b879ba6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:50.936896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4273422-4eff-4296-8017-84f6b879ba6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:50.937333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4273422-4eff-4296-8017-84f6b879ba6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:50.938192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4273422-4eff-4296-8017-84f6b879ba6c admin admin] PATH_INFO: `/v3/projects/188e32a56f5b48c0b045449a353d7b1c/users/1d207885d56f470cabaa6a5810e3f0b6/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:50.951718 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3599/7114] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:50 2022] POST /identity/v3/projects => generated 369 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:50.956679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fcc43-03b5-4b4c-baaf-df4001677146 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:50.960646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4273422-4eff-4296-8017-84f6b879ba6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=188e32a56f5b48c0b045449a353d7b1c, user_id=1d207885d56f470cabaa6a5810e3f0b6, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:50.963784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4273422-4eff-4296-8017-84f6b879ba6c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:51.038689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54fcc43-03b5-4b4c-baaf-df4001677146 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:51.044060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb459820-5b98-4e43-8955-c130bf32feff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:51.044761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb459820-5b98-4e43-8955-c130bf32feff admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:51.045049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb459820-5b98-4e43-8955-c130bf32feff admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:51.045328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb459820-5b98-4e43-8955-c130bf32feff admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:51.046037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb459820-5b98-4e43-8955-c130bf32feff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:51.048107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb459820-5b98-4e43-8955-c130bf32feff admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:51.147040 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3516/7115] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:50 2022] PUT /identity/v3/projects/188e32a56f5b48c0b045449a353d7b1c/users/1d207885d56f470cabaa6a5810e3f0b6/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:51.157137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b461b-3a61-405b-b423-219c892682ba None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:51.157425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b461b-3a61-405b-b423-219c892682ba None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:51.157708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b461b-3a61-405b-b423-219c892682ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:51.212584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-387b461b-3a61-405b-b423-219c892682ba None None] MFA Rules not processed for user `1d207885d56f470cabaa6a5810e3f0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:51.215140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-387b461b-3a61-405b-b423-219c892682ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:51.232635 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3600/7116] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:50 2022] POST /identity/v3/users => generated 285 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:51.237749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb459820-5b98-4e43-8955-c130bf32feff admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:51.261411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb459820-5b98-4e43-8955-c130bf32feff admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:51.409058 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3517/7117] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:42:51.413335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b461b-3a61-405b-b423-219c892682ba None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:51.417402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d9608-c6f4-4f43-8e60-b7a3fce86368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:51.418141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d9608-c6f4-4f43-8e60-b7a3fce86368 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:51.418436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d9608-c6f4-4f43-8e60-b7a3fce86368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:51.420106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d9608-c6f4-4f43-8e60-b7a3fce86368 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:51.423619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d9608-c6f4-4f43-8e60-b7a3fce86368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:51.435974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b461b-3a61-405b-b423-219c892682ba None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:51.444155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252a1a0-68fd-463a-8086-e53f3d1a0aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:51.444599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d9608-c6f4-4f43-8e60-b7a3fce86368 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:51.445309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252a1a0-68fd-463a-8086-e53f3d1a0aed admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:51.445835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252a1a0-68fd-463a-8086-e53f3d1a0aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:51.446371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252a1a0-68fd-463a-8086-e53f3d1a0aed admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:51.447380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252a1a0-68fd-463a-8086-e53f3d1a0aed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:51.453450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252a1a0-68fd-463a-8086-e53f3d1a0aed admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:51.483070 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3601/7118] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:51.487428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d9608-c6f4-4f43-8e60-b7a3fce86368 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:51.506666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d9608-c6f4-4f43-8e60-b7a3fce86368 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:51.509615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609e7bd-80f5-4748-b602-d1aa347622e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:51.510627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609e7bd-80f5-4748-b602-d1aa347622e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:51.510980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609e7bd-80f5-4748-b602-d1aa347622e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:51.511494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609e7bd-80f5-4748-b602-d1aa347622e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:51.512397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609e7bd-80f5-4748-b602-d1aa347622e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:51.514835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609e7bd-80f5-4748-b602-d1aa347622e9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:51.541487 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3602/7119] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:51.546909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609e7bd-80f5-4748-b602-d1aa347622e9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:51.558454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609e7bd-80f5-4748-b602-d1aa347622e9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:51.580219 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3518/7120] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:51 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:51.580381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b507bcb-fad5-470d-9927-674215b34a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:51.580381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b507bcb-fad5-470d-9927-674215b34a0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:51.580381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b507bcb-fad5-470d-9927-674215b34a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:51.580381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b507bcb-fad5-470d-9927-674215b34a0f admin admin] PATH_INFO: `/v3/projects/43f9b121f2f54b2bbf40a0438324f547/users/35d85df8a48341c0b224462eadc1f9aa/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:51.581640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252a1a0-68fd-463a-8086-e53f3d1a0aed admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:51.603711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b507bcb-fad5-470d-9927-674215b34a0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f9b121f2f54b2bbf40a0438324f547, user_id=35d85df8a48341c0b224462eadc1f9aa, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:51.606500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b507bcb-fad5-470d-9927-674215b34a0f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:51.658391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252a1a0-68fd-463a-8086-e53f3d1a0aed admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:51.664444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ae1e9-6ebe-41a7-8bfb-96e4b5b50c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:51.665344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ae1e9-6ebe-41a7-8bfb-96e4b5b50c06 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:51.665967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ae1e9-6ebe-41a7-8bfb-96e4b5b50c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:51.665967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ae1e9-6ebe-41a7-8bfb-96e4b5b50c06 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:51.666761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ae1e9-6ebe-41a7-8bfb-96e4b5b50c06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:51.668778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8ae1e9-6ebe-41a7-8bfb-96e4b5b50c06 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:51.743570 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3603/7121] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:51 2022] PUT /identity/v3/projects/43f9b121f2f54b2bbf40a0438324f547/users/35d85df8a48341c0b224462eadc1f9aa/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:51.762730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721118a-8aa0-4276-b499-b7280d13c5e5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:51.763026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721118a-8aa0-4276-b499-b7280d13c5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:51.763311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721118a-8aa0-4276-b499-b7280d13c5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:51.811330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5721118a-8aa0-4276-b499-b7280d13c5e5 None None] MFA Rules not processed for user `35d85df8a48341c0b224462eadc1f9aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:51.812854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5721118a-8aa0-4276-b499-b7280d13c5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:51.828478 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3519/7122] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:51 2022] POST /identity/v3/users => generated 298 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:42:51.832413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ae1e9-6ebe-41a7-8bfb-96e4b5b50c06 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:51.856076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8ae1e9-6ebe-41a7-8bfb-96e4b5b50c06 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:51.949385 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3604/7123] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:51 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:42:51.950881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721118a-8aa0-4276-b499-b7280d13c5e5 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:51.959034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5721118a-8aa0-4276-b499-b7280d13c5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:52.021077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dcc089-045e-4722-b7c8-31827c781dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:52.021791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcc089-045e-4722-b7c8-31827c781dca admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:52.022079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcc089-045e-4722-b7c8-31827c781dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:52.022416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcc089-045e-4722-b7c8-31827c781dca admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:52.024412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dcc089-045e-4722-b7c8-31827c781dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:52.026375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dcc089-045e-4722-b7c8-31827c781dca admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:52.055511 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3520/7124] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:52.056607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dcc089-045e-4722-b7c8-31827c781dca admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:52.069349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dcc089-045e-4722-b7c8-31827c781dca admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:52.075432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b78d1f-e8d4-4214-9851-6b4c66edd570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:52.076604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b78d1f-e8d4-4214-9851-6b4c66edd570 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:52.077077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b78d1f-e8d4-4214-9851-6b4c66edd570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:52.077564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b78d1f-e8d4-4214-9851-6b4c66edd570 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:52.078738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b78d1f-e8d4-4214-9851-6b4c66edd570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:52.082125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b78d1f-e8d4-4214-9851-6b4c66edd570 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:52.099452 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:52.130921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721118a-8aa0-4276-b499-b7280d13c5e5 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:52.137918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17255a11-4bd0-4afb-9548-b6b538473769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:52.145957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17255a11-4bd0-4afb-9548-b6b538473769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:52.145957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17255a11-4bd0-4afb-9548-b6b538473769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:52.145957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17255a11-4bd0-4afb-9548-b6b538473769 admin admin] PATH_INFO: `/v3/projects/d53666cb3f634e82b14fa33c4c21afaa` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:52.147505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17255a11-4bd0-4afb-9548-b6b538473769 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d53666cb3f634e82b14fa33c4c21afaa)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:52.149378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17255a11-4bd0-4afb-9548-b6b538473769 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:52.258714 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3521/7125] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:52 2022] POST /identity/v3/projects => generated 367 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:52.259617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b78d1f-e8d4-4214-9851-6b4c66edd570 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:52.353909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-17255a11-4bd0-4afb-9548-b6b538473769 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd53666cb3f634e82b14fa33c4c21afaa', 'request_id': 'req-17255a11-4bd0-4afb-9548-b6b538473769'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:52.369704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-17255a11-4bd0-4afb-9548-b6b538473769 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd53666cb3f634e82b14fa33c4c21afaa', 'request_id': 'req-17255a11-4bd0-4afb-9548-b6b538473769'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:52.396927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-17255a11-4bd0-4afb-9548-b6b538473769 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd53666cb3f634e82b14fa33c4c21afaa', 'request_id': 'req-17255a11-4bd0-4afb-9548-b6b538473769'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:52.455604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b78d1f-e8d4-4214-9851-6b4c66edd570 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:52.521637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05d6e4-88e3-43aa-8044-fa4196c5dc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:52.522649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05d6e4-88e3-43aa-8044-fa4196c5dc06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:52.522986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05d6e4-88e3-43aa-8044-fa4196c5dc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:52.523288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05d6e4-88e3-43aa-8044-fa4196c5dc06 admin admin] PATH_INFO: `/v3/projects/42892b4d2fb2405aa983a1e25331c699/users/74703644d3d74af680dfc2f328ec251e/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:52.537528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-17255a11-4bd0-4afb-9548-b6b538473769 admin admin] The token cache is being invalidate because project d53666cb3f634e82b14fa33c4c21afaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:42:52.538462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-17255a11-4bd0-4afb-9548-b6b538473769 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:52.538945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-17255a11-4bd0-4afb-9548-b6b538473769 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:52.540998 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3605/7126] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:42:51 2022] DELETE /identity/v3/projects/d53666cb3f634e82b14fa33c4c21afaa => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:52.541897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17255a11-4bd0-4afb-9548-b6b538473769 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:52.543105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-17255a11-4bd0-4afb-9548-b6b538473769 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:52.548270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05d6e4-88e3-43aa-8044-fa4196c5dc06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42892b4d2fb2405aa983a1e25331c699, user_id=74703644d3d74af680dfc2f328ec251e, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:52.551479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05d6e4-88e3-43aa-8044-fa4196c5dc06 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:52.558007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17255a11-4bd0-4afb-9548-b6b538473769 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:52.563434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb9347-9f56-45cb-80b4-38e236aa9b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:52.564321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb9347-9f56-45cb-80b4-38e236aa9b04 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:52.564679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb9347-9f56-45cb-80b4-38e236aa9b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:52.564991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb9347-9f56-45cb-80b4-38e236aa9b04 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:52.565850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb9347-9f56-45cb-80b4-38e236aa9b04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:52.568888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb9347-9f56-45cb-80b4-38e236aa9b04 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:52.694853 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3606/7127] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:52 2022] POST /identity/v3/users => generated 290 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:52.695053 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3522/7128] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:52 2022] PUT /identity/v3/projects/42892b4d2fb2405aa983a1e25331c699/users/74703644d3d74af680dfc2f328ec251e/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:52.696386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612a573-89bc-4ed2-9792-4e68ed72458f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:52.697456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612a573-89bc-4ed2-9792-4e68ed72458f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:52.697697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612a573-89bc-4ed2-9792-4e68ed72458f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:52.699288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb9347-9f56-45cb-80b4-38e236aa9b04 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:52.731892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb9347-9f56-45cb-80b4-38e236aa9b04 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:52.737581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b612a573-89bc-4ed2-9792-4e68ed72458f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:52.747244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b612a573-89bc-4ed2-9792-4e68ed72458f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:52.849753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1196b-4cc8-44a5-9438-9471befdb877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:52.852811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1196b-4cc8-44a5-9438-9471befdb877 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:52.853154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1196b-4cc8-44a5-9438-9471befdb877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:52.857790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1196b-4cc8-44a5-9438-9471befdb877 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:52.857905 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3523/7129] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:52.857989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1196b-4cc8-44a5-9438-9471befdb877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:52.858752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612a573-89bc-4ed2-9792-4e68ed72458f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:52.860756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b612a573-89bc-4ed2-9792-4e68ed72458f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:52.864944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1196b-4cc8-44a5-9438-9471befdb877 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:52.880857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612a573-89bc-4ed2-9792-4e68ed72458f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:52.887562 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3607/7130] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:52.888925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5babd-fbad-457d-b7e1-9c7ca064a36f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:52.889219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5babd-fbad-457d-b7e1-9c7ca064a36f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:52.894660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5babd-fbad-457d-b7e1-9c7ca064a36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:52.898558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e600f-2790-4efe-b4b3-9df7ad242c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:52.899462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e600f-2790-4efe-b4b3-9df7ad242c42 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:52.899757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e600f-2790-4efe-b4b3-9df7ad242c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:52.900042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e600f-2790-4efe-b4b3-9df7ad242c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:52.901618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e600f-2790-4efe-b4b3-9df7ad242c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:52.914867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e600f-2790-4efe-b4b3-9df7ad242c42 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:52.973857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-bdd5babd-fbad-457d-b7e1-9c7ca064a36f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:52.975843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bdd5babd-fbad-457d-b7e1-9c7ca064a36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:52.981583 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3524/7131] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:52.988886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e600f-2790-4efe-b4b3-9df7ad242c42 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:52.990849 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3608/7132] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:52.992156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5babd-fbad-457d-b7e1-9c7ca064a36f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:53.006865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5babd-fbad-457d-b7e1-9c7ca064a36f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:53.013527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c4b7f-00e3-4ed0-98b0-fa6042c63a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:53.014632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c4b7f-00e3-4ed0-98b0-fa6042c63a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:53.015019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c4b7f-00e3-4ed0-98b0-fa6042c63a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:53.015346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c4b7f-00e3-4ed0-98b0-fa6042c63a4f admin admin] PATH_INFO: `/v3/projects/42892b4d2fb2405aa983a1e25331c699/users/74703644d3d74af680dfc2f328ec251e/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:53.018872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c4b7f-00e3-4ed0-98b0-fa6042c63a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=42892b4d2fb2405aa983a1e25331c699, user_id=74703644d3d74af680dfc2f328ec251e, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:53.025871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e600f-2790-4efe-b4b3-9df7ad242c42 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:53.026382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c4b7f-00e3-4ed0-98b0-fa6042c63a4f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:53.053407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c3939-b1a5-4527-9512-bf9c141860ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:53.053407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c3939-b1a5-4527-9512-bf9c141860ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:53.053407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c3939-b1a5-4527-9512-bf9c141860ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:53.053407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405c3939-b1a5-4527-9512-bf9c141860ec admin admin] PATH_INFO: `/v3/projects/03e6071637ea4169bf0c3fdace7729cc/users/49896b1c0bb34319816cca70b582960c/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:53.063436 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3609/7133] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:52 2022] PUT /identity/v3/projects/42892b4d2fb2405aa983a1e25331c699/users/74703644d3d74af680dfc2f328ec251e/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:53.074332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c4b7f-00e3-4ed0-98b0-fa6042c63a4f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:53.091888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c3939-b1a5-4527-9512-bf9c141860ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e6071637ea4169bf0c3fdace7729cc, user_id=49896b1c0bb34319816cca70b582960c, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:53.095145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405c3939-b1a5-4527-9512-bf9c141860ec admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:53.171182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c4b7f-00e3-4ed0-98b0-fa6042c63a4f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:53.177105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a08a4-24a8-490f-9ba9-a77bed0099aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:53.177857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a08a4-24a8-490f-9ba9-a77bed0099aa admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:53.178176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a08a4-24a8-490f-9ba9-a77bed0099aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:53.178460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a08a4-24a8-490f-9ba9-a77bed0099aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:53.179271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a08a4-24a8-490f-9ba9-a77bed0099aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:42:53.179683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a08a4-24a8-490f-9ba9-a77bed0099aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:53.181314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a08a4-24a8-490f-9ba9-a77bed0099aa admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:53.196490 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3610/7134] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:42:53.197585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a6696-16f6-4b2e-a6c4-ec64d73d2345 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:53.197886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a6696-16f6-4b2e-a6c4-ec64d73d2345 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:53.198216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a6696-16f6-4b2e-a6c4-ec64d73d2345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:53.234685 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3525/7135] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:52 2022] PUT /identity/v3/projects/03e6071637ea4169bf0c3fdace7729cc/users/49896b1c0bb34319816cca70b582960c/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:53.235786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c3939-b1a5-4527-9512-bf9c141860ec admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:53.240096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1b9a6696-16f6-4b2e-a6c4-ec64d73d2345 None None] MFA Rules not processed for user `74703644d3d74af680dfc2f328ec251e`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:53.242061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1b9a6696-16f6-4b2e-a6c4-ec64d73d2345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:53.397458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405c3939-b1a5-4527-9512-bf9c141860ec admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:53.403902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b212074-66b5-4bb8-8ffa-11b7c6ed47b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:53.404749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b212074-66b5-4bb8-8ffa-11b7c6ed47b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:53.405143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b212074-66b5-4bb8-8ffa-11b7c6ed47b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:53.405537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b212074-66b5-4bb8-8ffa-11b7c6ed47b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:53.406444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b212074-66b5-4bb8-8ffa-11b7c6ed47b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:53.408694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b212074-66b5-4bb8-8ffa-11b7c6ed47b4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:53.453025 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3611/7136] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:53.464894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a6696-16f6-4b2e-a6c4-ec64d73d2345 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:53.489176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a6696-16f6-4b2e-a6c4-ec64d73d2345 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:53.503075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45060da7-c080-4b2c-83e2-a00740c21cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:53.504631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45060da7-c080-4b2c-83e2-a00740c21cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:53.504926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45060da7-c080-4b2c-83e2-a00740c21cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:53.505265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45060da7-c080-4b2c-83e2-a00740c21cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:53.505959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45060da7-c080-4b2c-83e2-a00740c21cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:53.528461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45060da7-c080-4b2c-83e2-a00740c21cd9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:53.528558 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3526/7137] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:53 2022] POST /identity/v3/projects => generated 367 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:53.528558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b212074-66b5-4bb8-8ffa-11b7c6ed47b4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:53.537954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8b212074-66b5-4bb8-8ffa-11b7c6ed47b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:53.548986 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3612/7138] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:53.550307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45060da7-c080-4b2c-83e2-a00740c21cd9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:53.567500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45060da7-c080-4b2c-83e2-a00740c21cd9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:53.701378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b212074-66b5-4bb8-8ffa-11b7c6ed47b4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:53.714336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef8e76-4c7a-40f1-b5d0-256eb6272edb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:53.719428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d1406-fe52-494c-8bb8-d8a26319c1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:53.719610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef8e76-4c7a-40f1-b5d0-256eb6272edb service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:53.720011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef8e76-4c7a-40f1-b5d0-256eb6272edb service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:53.720428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef8e76-4c7a-40f1-b5d0-256eb6272edb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:53.720940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d1406-fe52-494c-8bb8-d8a26319c1cc admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:53.721441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d1406-fe52-494c-8bb8-d8a26319c1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:53.722163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d1406-fe52-494c-8bb8-d8a26319c1cc admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:53.723099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d1406-fe52-494c-8bb8-d8a26319c1cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:53.725486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816d1406-fe52-494c-8bb8-d8a26319c1cc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:53.728728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d7ef8e76-4c7a-40f1-b5d0-256eb6272edb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:53.740189 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:53.842896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef8e76-4c7a-40f1-b5d0-256eb6272edb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:53.844386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef8e76-4c7a-40f1-b5d0-256eb6272edb service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:53.853695 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3613/7139] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:53 2022] POST /identity/v3/users => generated 284 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:53.856882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d1406-fe52-494c-8bb8-d8a26319c1cc admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:53.873725 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3527/7140] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:42:53.876121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef8e76-4c7a-40f1-b5d0-256eb6272edb service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:53.881494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816d1406-fe52-494c-8bb8-d8a26319c1cc admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:53.895911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f4b2a-dcce-4b1b-bbae-4a3a064cbef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:53.896922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f4b2a-dcce-4b1b-bbae-4a3a064cbef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:53.897390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef8e76-4c7a-40f1-b5d0-256eb6272edb service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:53.898382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f4b2a-dcce-4b1b-bbae-4a3a064cbef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:53.899773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f4b2a-dcce-4b1b-bbae-4a3a064cbef8 admin admin] PATH_INFO: `/v3/projects/03e6071637ea4169bf0c3fdace7729cc/users/49896b1c0bb34319816cca70b582960c/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:53.909758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9bb59-64e4-48d4-baf0-c0b8b0b868d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:53.912083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f4b2a-dcce-4b1b-bbae-4a3a064cbef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03e6071637ea4169bf0c3fdace7729cc, user_id=49896b1c0bb34319816cca70b582960c, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:53.913655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9bb59-64e4-48d4-baf0-c0b8b0b868d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:53.914201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9bb59-64e4-48d4-baf0-c0b8b0b868d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:53.914813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01f4b2a-dcce-4b1b-bbae-4a3a064cbef8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:53.922904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b9bb59-64e4-48d4-baf0-c0b8b0b868d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:53.925197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9bb59-64e4-48d4-baf0-c0b8b0b868d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:53.931809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b9bb59-64e4-48d4-baf0-c0b8b0b868d4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:53.949828 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3614/7141] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:53 2022] PUT /identity/v3/projects/03e6071637ea4169bf0c3fdace7729cc/users/49896b1c0bb34319816cca70b582960c/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:53.954746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccff36-059b-49bd-93a3-aeee7ce9e47b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:53.955054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccff36-059b-49bd-93a3-aeee7ce9e47b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:53.955846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ccff36-059b-49bd-93a3-aeee7ce9e47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:53.964854 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3528/7142] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:53.967207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9bb59-64e4-48d4-baf0-c0b8b0b868d4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:53.986632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b9bb59-64e4-48d4-baf0-c0b8b0b868d4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:54.018765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-36ccff36-059b-49bd-93a3-aeee7ce9e47b None None] MFA Rules not processed for user `49896b1c0bb34319816cca70b582960c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:54.032104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-36ccff36-059b-49bd-93a3-aeee7ce9e47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:54.120812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d819f-ca23-41b7-a344-c72d68125ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:54.121804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d819f-ca23-41b7-a344-c72d68125ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:54.121892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d819f-ca23-41b7-a344-c72d68125ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:54.122526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d819f-ca23-41b7-a344-c72d68125ad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:54.123083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d819f-ca23-41b7-a344-c72d68125ad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:54.127313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53d819f-ca23-41b7-a344-c72d68125ad6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:54.163120 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3529/7143] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:54.165954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d819f-ca23-41b7-a344-c72d68125ad6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:54.181070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d819f-ca23-41b7-a344-c72d68125ad6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:54.186846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeca709-19e0-46d2-84b2-72ee01909fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:54.187964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeca709-19e0-46d2-84b2-72ee01909fbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:54.188313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeca709-19e0-46d2-84b2-72ee01909fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:54.188606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeca709-19e0-46d2-84b2-72ee01909fbe admin admin] PATH_INFO: `/v3/projects/2432cb9dbdaa4b69ae7dcc43e3e0d839/users/ac3c790985af426abc202fdef803bf98/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:54.203687 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3615/7144] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:53 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:54.216887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeca709-19e0-46d2-84b2-72ee01909fbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=2432cb9dbdaa4b69ae7dcc43e3e0d839, user_id=ac3c790985af426abc202fdef803bf98, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:54.221691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeca709-19e0-46d2-84b2-72ee01909fbe admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:54.229516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccff36-059b-49bd-93a3-aeee7ce9e47b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:54.341989 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3530/7145] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:54 2022] PUT /identity/v3/projects/2432cb9dbdaa4b69ae7dcc43e3e0d839/users/ac3c790985af426abc202fdef803bf98/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:54.343960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51ce65-f7c3-4b6e-9175-d65f8d7caa8f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:54.344328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51ce65-f7c3-4b6e-9175-d65f8d7caa8f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:54.344686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51ce65-f7c3-4b6e-9175-d65f8d7caa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:54.349783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ccff36-059b-49bd-93a3-aeee7ce9e47b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:54.415622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-bd51ce65-f7c3-4b6e-9175-d65f8d7caa8f None None] MFA Rules not processed for user `ac3c790985af426abc202fdef803bf98`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:54.417329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bd51ce65-f7c3-4b6e-9175-d65f8d7caa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:54.464415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d1fc4-d3c5-412e-b07a-f94b483da1e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:54.467618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d1fc4-d3c5-412e-b07a-f94b483da1e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:54.467842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d1fc4-d3c5-412e-b07a-f94b483da1e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:54.468135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d1fc4-d3c5-412e-b07a-f94b483da1e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:54.562800 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3531/7146] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:54 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:54.569025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51ce65-f7c3-4b6e-9175-d65f8d7caa8f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:54.649299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d1fc4-d3c5-412e-b07a-f94b483da1e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:54.651089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724d1fc4-d3c5-412e-b07a-f94b483da1e8 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:54.667477 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3616/7147] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:42:54 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:42:54.690559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51ce65-f7c3-4b6e-9175-d65f8d7caa8f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:54.697436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd161a-fa6d-434a-9531-3751b5ef066d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:54.698401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd161a-fa6d-434a-9531-3751b5ef066d admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:54.698700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd161a-fa6d-434a-9531-3751b5ef066d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:54.699044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd161a-fa6d-434a-9531-3751b5ef066d admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:54.699813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd161a-fa6d-434a-9531-3751b5ef066d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:54.701892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd161a-fa6d-434a-9531-3751b5ef066d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:54.915015 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3532/7148] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:54 2022] POST /identity/v3/projects => generated 369 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:54.917411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d1fc4-d3c5-412e-b07a-f94b483da1e8 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:54.951334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724d1fc4-d3c5-412e-b07a-f94b483da1e8 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:55.114857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55ed80-1a54-43bf-bf7e-93f4a371febf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:55.115583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55ed80-1a54-43bf-bf7e-93f4a371febf admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:55.115926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55ed80-1a54-43bf-bf7e-93f4a371febf admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:55.116218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55ed80-1a54-43bf-bf7e-93f4a371febf admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:55.116945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55ed80-1a54-43bf-bf7e-93f4a371febf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:55.119566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55ed80-1a54-43bf-bf7e-93f4a371febf admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:55.229951 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3617/7149] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:54 2022] POST /identity/v3/users => generated 291 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:42:55.231166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd161a-fa6d-434a-9531-3751b5ef066d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:55.254410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd161a-fa6d-434a-9531-3751b5ef066d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:55.284682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013ebad-fc0b-4372-88b6-d058aa845487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:55.285396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013ebad-fc0b-4372-88b6-d058aa845487 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:55.285690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013ebad-fc0b-4372-88b6-d058aa845487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:55.285968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8013ebad-fc0b-4372-88b6-d058aa845487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:55.286809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013ebad-fc0b-4372-88b6-d058aa845487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:55.288467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8013ebad-fc0b-4372-88b6-d058aa845487 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:55.337991 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3533/7150] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:55.343222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55ed80-1a54-43bf-bf7e-93f4a371febf admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:55.351480 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:55.357522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55ed80-1a54-43bf-bf7e-93f4a371febf admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:55.382438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705a779-6780-41e4-9882-08ec5734fdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:55.382730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705a779-6780-41e4-9882-08ec5734fdcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:55.383010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705a779-6780-41e4-9882-08ec5734fdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:55.383295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705a779-6780-41e4-9882-08ec5734fdcd admin admin] PATH_INFO: `/v3/projects/53756e5d53274467a2ab66efdda7665a/users/f0521fc742394d22a38d6e089be14371/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:55.453026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705a779-6780-41e4-9882-08ec5734fdcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=53756e5d53274467a2ab66efdda7665a, user_id=f0521fc742394d22a38d6e089be14371, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:55.463027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705a779-6780-41e4-9882-08ec5734fdcd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:55.557290 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3618/7151] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:55 2022] PUT /identity/v3/projects/53756e5d53274467a2ab66efdda7665a/users/f0521fc742394d22a38d6e089be14371/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:55.566023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013ebad-fc0b-4372-88b6-d058aa845487 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:55.591373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8013ebad-fc0b-4372-88b6-d058aa845487 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:55.742074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3a2ed-34b3-4e23-80da-c870d75bca96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:55.745187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3a2ed-34b3-4e23-80da-c870d75bca96 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:55.745187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3a2ed-34b3-4e23-80da-c870d75bca96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:55.745187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3a2ed-34b3-4e23-80da-c870d75bca96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:55.745187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3a2ed-34b3-4e23-80da-c870d75bca96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:55.745795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3a2ed-34b3-4e23-80da-c870d75bca96 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:55.769531 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3534/7152] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:55 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:55.773755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705a779-6780-41e4-9882-08ec5734fdcd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:55.791396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705a779-6780-41e4-9882-08ec5734fdcd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:55.802552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5cb17-8778-4a5e-8360-a275148c925b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:55.803474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5cb17-8778-4a5e-8360-a275148c925b admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:55.803766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5cb17-8778-4a5e-8360-a275148c925b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:55.804050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5cb17-8778-4a5e-8360-a275148c925b admin admin] PATH_INFO: `/v3/projects/53756e5d53274467a2ab66efdda7665a/users/f0521fc742394d22a38d6e089be14371/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:55.807698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5cb17-8778-4a5e-8360-a275148c925b admin admin] RBAC: Authorizing `identity:create_grant(project_id=53756e5d53274467a2ab66efdda7665a, user_id=f0521fc742394d22a38d6e089be14371, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:55.818358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5cb17-8778-4a5e-8360-a275148c925b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:55.862354 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3619/7153] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:55 2022] PUT /identity/v3/projects/53756e5d53274467a2ab66efdda7665a/users/f0521fc742394d22a38d6e089be14371/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:55.864992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8faa2-83e0-4d1d-9da4-37dcc8c22832 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:55.865476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8faa2-83e0-4d1d-9da4-37dcc8c22832 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:55.866112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8faa2-83e0-4d1d-9da4-37dcc8c22832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:55.929534 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:55.966643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d7f8faa2-83e0-4d1d-9da4-37dcc8c22832 None None] MFA Rules not processed for user `f0521fc742394d22a38d6e089be14371`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:55.973161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d7f8faa2-83e0-4d1d-9da4-37dcc8c22832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:56.102383 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3535/7154] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:55 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:56.106632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5cb17-8778-4a5e-8360-a275148c925b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:56.200005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5cb17-8778-4a5e-8360-a275148c925b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:56.229489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc2fa1-181b-4331-9ce6-ba2aa8c38c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:56.230397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc2fa1-181b-4331-9ce6-ba2aa8c38c9c admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:56.230937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc2fa1-181b-4331-9ce6-ba2aa8c38c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:56.231138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc2fa1-181b-4331-9ce6-ba2aa8c38c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:56.232318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc2fa1-181b-4331-9ce6-ba2aa8c38c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:56.234757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc2fa1-181b-4331-9ce6-ba2aa8c38c9c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:56.360414 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3620/7155] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:42:56 2022] POST /identity/v3/projects => generated 367 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:42:56.364702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8faa2-83e0-4d1d-9da4-37dcc8c22832 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:56.379988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8faa2-83e0-4d1d-9da4-37dcc8c22832 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:56.486969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346bb89-7ace-46eb-90d5-6506d667b442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:56.488173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346bb89-7ace-46eb-90d5-6506d667b442 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:56.488754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346bb89-7ace-46eb-90d5-6506d667b442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:56.489288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346bb89-7ace-46eb-90d5-6506d667b442 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:56.490848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346bb89-7ace-46eb-90d5-6506d667b442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:56.493703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346bb89-7ace-46eb-90d5-6506d667b442 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:56.652913 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3536/7156] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:42:56 2022] POST /identity/v3/users => generated 284 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:56.655800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc2fa1-181b-4331-9ce6-ba2aa8c38c9c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:56.677181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc2fa1-181b-4331-9ce6-ba2aa8c38c9c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:56.693636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6decd1f-b509-4557-aa52-da3a508e6fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:56.695476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6decd1f-b509-4557-aa52-da3a508e6fe6 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:56.695778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6decd1f-b509-4557-aa52-da3a508e6fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:56.696069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6decd1f-b509-4557-aa52-da3a508e6fe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:56.698032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6decd1f-b509-4557-aa52-da3a508e6fe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:56.703444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6decd1f-b509-4557-aa52-da3a508e6fe6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:56.736855 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3621/7157] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:56.738891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346bb89-7ace-46eb-90d5-6506d667b442 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:56.750588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346bb89-7ace-46eb-90d5-6506d667b442 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:56.756400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eaceae-5d1c-48f0-a2bd-3cadcdc4244a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:56.757344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eaceae-5d1c-48f0-a2bd-3cadcdc4244a admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:56.757808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eaceae-5d1c-48f0-a2bd-3cadcdc4244a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:56.758474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eaceae-5d1c-48f0-a2bd-3cadcdc4244a admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:56.759750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eaceae-5d1c-48f0-a2bd-3cadcdc4244a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:56.761653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eaceae-5d1c-48f0-a2bd-3cadcdc4244a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:56.783471 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3537/7158] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:42:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:42:56.785018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6decd1f-b509-4557-aa52-da3a508e6fe6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:56.800800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6decd1f-b509-4557-aa52-da3a508e6fe6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:56.809778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fb146-0c28-46cb-a626-0662fc2556e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:56.811654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fb146-0c28-46cb-a626-0662fc2556e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:56.812421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fb146-0c28-46cb-a626-0662fc2556e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:56.812913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fb146-0c28-46cb-a626-0662fc2556e8 admin admin] PATH_INFO: `/v3/projects/45ce3ec13ff74eff9168320b452ba243/users/55274a5f086940f09926f66bc4a3b24a/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:56.867237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8fb146-0c28-46cb-a626-0662fc2556e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45ce3ec13ff74eff9168320b452ba243, user_id=55274a5f086940f09926f66bc4a3b24a, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:56.870914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8fb146-0c28-46cb-a626-0662fc2556e8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:56.970933 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3622/7159] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:56 2022] PUT /identity/v3/projects/45ce3ec13ff74eff9168320b452ba243/users/55274a5f086940f09926f66bc4a3b24a/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:56.984963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b27ee-e18a-4391-8b31-d491cdba9c97 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:56.986999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b27ee-e18a-4391-8b31-d491cdba9c97 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:56.987467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3b27ee-e18a-4391-8b31-d491cdba9c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:57.057025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4e3b27ee-e18a-4391-8b31-d491cdba9c97 None None] MFA Rules not processed for user `55274a5f086940f09926f66bc4a3b24a`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:42:57.058710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4e3b27ee-e18a-4391-8b31-d491cdba9c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:42:57.303436 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3538/7160] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:42:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:42:57.308438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fb146-0c28-46cb-a626-0662fc2556e8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:57.348904 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:57.411069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fb146-0c28-46cb-a626-0662fc2556e8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:57.440112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba3a29-1edf-4490-b8ba-0e3cb03ca85c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:57.441159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba3a29-1edf-4490-b8ba-0e3cb03ca85c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:57.442373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba3a29-1edf-4490-b8ba-0e3cb03ca85c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:57.442660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba3a29-1edf-4490-b8ba-0e3cb03ca85c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:57.443461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba3a29-1edf-4490-b8ba-0e3cb03ca85c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:57.445138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba3a29-1edf-4490-b8ba-0e3cb03ca85c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:57.538037 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3623/7161] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:42:57 2022] POST /identity/v3/domains => generated 275 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:57.542240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b27ee-e18a-4391-8b31-d491cdba9c97 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:57.561689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3b27ee-e18a-4391-8b31-d491cdba9c97 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:57.593464 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:57.646386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7bafb-2ccb-47bf-b65a-2ce4e1efdd23 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:57.647151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7bafb-2ccb-47bf-b65a-2ce4e1efdd23 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:57.647588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7bafb-2ccb-47bf-b65a-2ce4e1efdd23 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:57.647891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7bafb-2ccb-47bf-b65a-2ce4e1efdd23 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:57.649092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7bafb-2ccb-47bf-b65a-2ce4e1efdd23 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:57.651003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7bafb-2ccb-47bf-b65a-2ce4e1efdd23 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:57.732444 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3539/7162] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:42:57 2022] POST /identity/v3/roles => generated 239 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:42:57.735718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba3a29-1edf-4490-b8ba-0e3cb03ca85c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:57.752822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba3a29-1edf-4490-b8ba-0e3cb03ca85c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:57.768547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8200ad4-ce6b-4c05-bfa6-8df3b1c96390 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:57.769504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8200ad4-ce6b-4c05-bfa6-8df3b1c96390 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:57.769916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8200ad4-ce6b-4c05-bfa6-8df3b1c96390 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:57.770051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8200ad4-ce6b-4c05-bfa6-8df3b1c96390 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains/6681c071645f46abaca79f3d06b328cb/users/55274a5f086940f09926f66bc4a3b24a/roles/5532cc4d7d8b484aab1dfb330361e3f0` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:57.791144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8200ad4-ce6b-4c05-bfa6-8df3b1c96390 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=6681c071645f46abaca79f3d06b328cb, user_id=55274a5f086940f09926f66bc4a3b24a, role_id=5532cc4d7d8b484aab1dfb330361e3f0)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:57.794642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8200ad4-ce6b-4c05-bfa6-8df3b1c96390 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:57.888421 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3624/7163] 10.222.0.43 () {60 vars in 1479 bytes} [Tue Jul 19 14:42:57 2022] PUT /identity/v3/domains/6681c071645f46abaca79f3d06b328cb/users/55274a5f086940f09926f66bc4a3b24a/roles/5532cc4d7d8b484aab1dfb330361e3f0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:57.893340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7bafb-2ccb-47bf-b65a-2ce4e1efdd23 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:57.909332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7bafb-2ccb-47bf-b65a-2ce4e1efdd23 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:58.009807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ad7cc-06d4-40d1-8053-fc18d0924e27 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:58.010928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ad7cc-06d4-40d1-8053-fc18d0924e27 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:58.011472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ad7cc-06d4-40d1-8053-fc18d0924e27 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:58.012234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ad7cc-06d4-40d1-8053-fc18d0924e27 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:58.013647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ad7cc-06d4-40d1-8053-fc18d0924e27 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:58.015741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ad7cc-06d4-40d1-8053-fc18d0924e27 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:58.138251 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3540/7164] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:42:57 2022] POST /identity/v3/domains => generated 277 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:42:58.140744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8200ad4-ce6b-4c05-bfa6-8df3b1c96390 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:58.156235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8200ad4-ce6b-4c05-bfa6-8df3b1c96390 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:58.249506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dab574-9d86-4bd2-95a6-0963c7c63990 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:58.254689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dab574-9d86-4bd2-95a6-0963c7c63990 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:58.255105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dab574-9d86-4bd2-95a6-0963c7c63990 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:58.255492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dab574-9d86-4bd2-95a6-0963c7c63990 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:58.256355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dab574-9d86-4bd2-95a6-0963c7c63990 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:58.261111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dab574-9d86-4bd2-95a6-0963c7c63990 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:58.413472 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3625/7165] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:42:58 2022] POST /identity/v3/roles => generated 239 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:58.417260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ad7cc-06d4-40d1-8053-fc18d0924e27 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:58.432855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ad7cc-06d4-40d1-8053-fc18d0924e27 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:58.438166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc96de-0a2d-464c-9575-65986efb6d75 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:58.440739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc96de-0a2d-464c-9575-65986efb6d75 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:58.441305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc96de-0a2d-464c-9575-65986efb6d75 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:58.443203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc96de-0a2d-464c-9575-65986efb6d75 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/groups` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:58.444220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc96de-0a2d-464c-9575-65986efb6d75 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:58.447138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc96de-0a2d-464c-9575-65986efb6d75 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:58.518660 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:58.554914 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3541/7166] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jul 19 14:42:58 2022] POST /identity/v3/groups => generated 326 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:42:58.558921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dab574-9d86-4bd2-95a6-0963c7c63990 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:58.575508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dab574-9d86-4bd2-95a6-0963c7c63990 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:58.583380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b5caa-b5c9-4d97-a0f0-b0df97e9b161 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:58.584547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b5caa-b5c9-4d97-a0f0-b0df97e9b161 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:58.584936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b5caa-b5c9-4d97-a0f0-b0df97e9b161 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:58.585327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b5caa-b5c9-4d97-a0f0-b0df97e9b161 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/groups/918768ea5ae44be69a4be3a34e1cc642/users/55274a5f086940f09926f66bc4a3b24a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:58.593333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b5caa-b5c9-4d97-a0f0-b0df97e9b161 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=918768ea5ae44be69a4be3a34e1cc642, user_id=55274a5f086940f09926f66bc4a3b24a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:58.596099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b5caa-b5c9-4d97-a0f0-b0df97e9b161 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:58.692650 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3626/7167] 10.222.0.43 () {60 vars in 1359 bytes} [Tue Jul 19 14:42:58 2022] PUT /identity/v3/groups/918768ea5ae44be69a4be3a34e1cc642/users/55274a5f086940f09926f66bc4a3b24a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:58.694418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc96de-0a2d-464c-9575-65986efb6d75 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:58.705665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc96de-0a2d-464c-9575-65986efb6d75 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:58.773065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d98e3-2198-4ce1-ac7d-dd7ca12b0536 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:58.774006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d98e3-2198-4ce1-ac7d-dd7ca12b0536 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:58.774330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d98e3-2198-4ce1-ac7d-dd7ca12b0536 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:58.774620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d98e3-2198-4ce1-ac7d-dd7ca12b0536 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains/e3a57d1a33f84b33a09a31c01c7221f1/groups/918768ea5ae44be69a4be3a34e1cc642/roles/32aff70874424dc98693593d2f037b0b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:58.776950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d98e3-2198-4ce1-ac7d-dd7ca12b0536 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=e3a57d1a33f84b33a09a31c01c7221f1, group_id=918768ea5ae44be69a4be3a34e1cc642, role_id=32aff70874424dc98693593d2f037b0b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:58.779705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d98e3-2198-4ce1-ac7d-dd7ca12b0536 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:58.862424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b5caa-b5c9-4d97-a0f0-b0df97e9b161 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:58.863001 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3542/7168] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:42:58 2022] PUT /identity/v3/domains/e3a57d1a33f84b33a09a31c01c7221f1/groups/918768ea5ae44be69a4be3a34e1cc642/roles/32aff70874424dc98693593d2f037b0b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:42:58.879896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b5caa-b5c9-4d97-a0f0-b0df97e9b161 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:58.882392 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:58.982685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b99527-d55d-4ff3-993e-5ecf93b7a568 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:58.984682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b99527-d55d-4ff3-993e-5ecf93b7a568 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:58.986485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b99527-d55d-4ff3-993e-5ecf93b7a568 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:58.987632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b99527-d55d-4ff3-993e-5ecf93b7a568 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:58.990155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b99527-d55d-4ff3-993e-5ecf93b7a568 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:58.994669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b99527-d55d-4ff3-993e-5ecf93b7a568 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:59.096654 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3627/7169] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:42:58 2022] POST /identity/v3/domains => generated 277 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:42:59.098313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d98e3-2198-4ce1-ac7d-dd7ca12b0536 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:59.113828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d98e3-2198-4ce1-ac7d-dd7ca12b0536 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:59.260744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976df1c-709d-4ca9-8b0e-4b411d91d605 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:59.262912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976df1c-709d-4ca9-8b0e-4b411d91d605 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:59.263270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976df1c-709d-4ca9-8b0e-4b411d91d605 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:59.263601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976df1c-709d-4ca9-8b0e-4b411d91d605 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:59.264612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6976df1c-709d-4ca9-8b0e-4b411d91d605 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:59.266389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6976df1c-709d-4ca9-8b0e-4b411d91d605 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:59.380858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b99527-d55d-4ff3-993e-5ecf93b7a568 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:59.388751 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3543/7170] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:42:59 2022] POST /identity/v3/roles => generated 240 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:59.393236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976df1c-709d-4ca9-8b0e-4b411d91d605 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:59.401301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b99527-d55d-4ff3-993e-5ecf93b7a568 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:59.421032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd593927-4c63-4afd-aa90-bfefa0b3dc5d tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:59.425116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd593927-4c63-4afd-aa90-bfefa0b3dc5d tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:59.426600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd593927-4c63-4afd-aa90-bfefa0b3dc5d tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:59.427141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd593927-4c63-4afd-aa90-bfefa0b3dc5d tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains/9d483896da2041c4a3fc37740ee704d9/users/55274a5f086940f09926f66bc4a3b24a/roles/7b7891e43bcb4f138b924529331f18fd` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:59.501153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd593927-4c63-4afd-aa90-bfefa0b3dc5d tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=9d483896da2041c4a3fc37740ee704d9, user_id=55274a5f086940f09926f66bc4a3b24a, role_id=7b7891e43bcb4f138b924529331f18fd)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:59.524753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd593927-4c63-4afd-aa90-bfefa0b3dc5d tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:59.620021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976df1c-709d-4ca9-8b0e-4b411d91d605 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:59.640405 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3628/7171] 10.222.0.43 () {60 vars in 1479 bytes} [Tue Jul 19 14:42:59 2022] PUT /identity/v3/domains/9d483896da2041c4a3fc37740ee704d9/users/55274a5f086940f09926f66bc4a3b24a/roles/7b7891e43bcb4f138b924529331f18fd => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:42:59.645760 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:42:59.645934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd593927-4c63-4afd-aa90-bfefa0b3dc5d tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:59.647909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d9c8a3-192e-4a5a-8803-74f29bb9fe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:59.651550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9c8a3-192e-4a5a-8803-74f29bb9fe8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:59.651858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9c8a3-192e-4a5a-8803-74f29bb9fe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:59.652933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9c8a3-192e-4a5a-8803-74f29bb9fe8e admin admin] PATH_INFO: `/v3/users/35d85df8a48341c0b224462eadc1f9aa` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:59.656944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9c8a3-192e-4a5a-8803-74f29bb9fe8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=35d85df8a48341c0b224462eadc1f9aa)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:59.661656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d9c8a3-192e-4a5a-8803-74f29bb9fe8e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:59.809093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd593927-4c63-4afd-aa90-bfefa0b3dc5d tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:42:59.816436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7de7e-4ac7-4716-acf4-548de64c79d2 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:42:59.817676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7de7e-4ac7-4716-acf4-548de64c79d2 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:42:59.818435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7de7e-4ac7-4716-acf4-548de64c79d2 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:42:59.818435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7de7e-4ac7-4716-acf4-548de64c79d2 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:42:59.819383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7de7e-4ac7-4716-acf4-548de64c79d2 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:42:59.821276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7de7e-4ac7-4716-acf4-548de64c79d2 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:42:59.909019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-04d9c8a3-192e-4a5a-8803-74f29bb9fe8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35d85df8a48341c0b224462eadc1f9aa'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:59.925947 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3629/7172] 10.222.0.43 () {60 vars in 1148 bytes} [Tue Jul 19 14:42:59 2022] POST /identity/v3/domains => generated 275 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:42:59.930042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7de7e-4ac7-4716-acf4-548de64c79d2 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:42:59.956466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-04d9c8a3-192e-4a5a-8803-74f29bb9fe8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35d85df8a48341c0b224462eadc1f9aa'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:59.959637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-04d9c8a3-192e-4a5a-8803-74f29bb9fe8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35d85df8a48341c0b224462eadc1f9aa'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:59.961235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-04d9c8a3-192e-4a5a-8803-74f29bb9fe8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35d85df8a48341c0b224462eadc1f9aa'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:42:59.985085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-04d9c8a3-192e-4a5a-8803-74f29bb9fe8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35d85df8a48341c0b224462eadc1f9aa'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:00.007787 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:00.048828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7de7e-4ac7-4716-acf4-548de64c79d2 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:00.054197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd75473-920a-4e1e-9275-d09571614e9f tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:00.055141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd75473-920a-4e1e-9275-d09571614e9f tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:00.055677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd75473-920a-4e1e-9275-d09571614e9f tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:00.056155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd75473-920a-4e1e-9275-d09571614e9f tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:00.057098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd75473-920a-4e1e-9275-d09571614e9f tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:00.064260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd75473-920a-4e1e-9275-d09571614e9f tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:00.132879 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3544/7173] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:42:59 2022] DELETE /identity/v3/users/35d85df8a48341c0b224462eadc1f9aa => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:00.135569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026182d-5ae6-4e57-aad8-fc829837c7f7 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:00.136364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026182d-5ae6-4e57-aad8-fc829837c7f7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:00.136881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026182d-5ae6-4e57-aad8-fc829837c7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:00.164494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8026182d-5ae6-4e57-aad8-fc829837c7f7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:00.167471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8026182d-5ae6-4e57-aad8-fc829837c7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:00.192975 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3630/7174] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:42:59 2022] POST /identity/v3/roles => generated 240 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:43:00.210970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd75473-920a-4e1e-9275-d09571614e9f tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:00.218952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6cd75473-920a-4e1e-9275-d09571614e9f tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:00.258394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd75473-920a-4e1e-9275-d09571614e9f tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:00.308374 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3545/7175] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:00.327128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026182d-5ae6-4e57-aad8-fc829837c7f7 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:00.328617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8026182d-5ae6-4e57-aad8-fc829837c7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:00.419430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f661fba-e9a8-4b37-a195-c1e7d3e1e706 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:00.420180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f661fba-e9a8-4b37-a195-c1e7d3e1e706 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:00.420561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f661fba-e9a8-4b37-a195-c1e7d3e1e706 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:00.422128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f661fba-e9a8-4b37-a195-c1e7d3e1e706 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/groups` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:00.423002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f661fba-e9a8-4b37-a195-c1e7d3e1e706 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:00.427113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f661fba-e9a8-4b37-a195-c1e7d3e1e706 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:00.476640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026182d-5ae6-4e57-aad8-fc829837c7f7 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:00.487632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a916e7-012b-4553-b7ac-3ef195d97724 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:00.488326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a916e7-012b-4553-b7ac-3ef195d97724 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:00.488627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a916e7-012b-4553-b7ac-3ef195d97724 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:00.489505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a916e7-012b-4553-b7ac-3ef195d97724 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:00.503495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a916e7-012b-4553-b7ac-3ef195d97724 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:00.505876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a916e7-012b-4553-b7ac-3ef195d97724 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:00.520353 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3546/7176] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:43:00.538945 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3631/7177] 10.222.0.43 () {60 vars in 1146 bytes} [Tue Jul 19 14:43:00 2022] POST /identity/v3/groups => generated 326 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:00.539841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a916e7-012b-4553-b7ac-3ef195d97724 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:00.566892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a916e7-012b-4553-b7ac-3ef195d97724 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:00.579094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48876e5b-95d5-4cf0-a091-b48aa0ad05d7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:00.581245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48876e5b-95d5-4cf0-a091-b48aa0ad05d7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:00.581546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48876e5b-95d5-4cf0-a091-b48aa0ad05d7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:00.582255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48876e5b-95d5-4cf0-a091-b48aa0ad05d7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/groups/2379ba1e0a2b4793b0a8ce8415c0af4c/users/55274a5f086940f09926f66bc4a3b24a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:00.588988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48876e5b-95d5-4cf0-a091-b48aa0ad05d7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2379ba1e0a2b4793b0a8ce8415c0af4c, user_id=55274a5f086940f09926f66bc4a3b24a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:00.593295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48876e5b-95d5-4cf0-a091-b48aa0ad05d7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:00.740155 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3547/7178] 10.222.0.43 () {60 vars in 1359 bytes} [Tue Jul 19 14:43:00 2022] PUT /identity/v3/groups/2379ba1e0a2b4793b0a8ce8415c0af4c/users/55274a5f086940f09926f66bc4a3b24a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:00.744092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f661fba-e9a8-4b37-a195-c1e7d3e1e706 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:00.753427 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:00.757117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f661fba-e9a8-4b37-a195-c1e7d3e1e706 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:00.862003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576419ab-a3f7-48e5-b3ab-2b09b46e08ab tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:00.880075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576419ab-a3f7-48e5-b3ab-2b09b46e08ab tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:00.880607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576419ab-a3f7-48e5-b3ab-2b09b46e08ab tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:00.881050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576419ab-a3f7-48e5-b3ab-2b09b46e08ab tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains/29353f39990c4bdfaf36ec8c2e412388/groups/2379ba1e0a2b4793b0a8ce8415c0af4c/roles/68afd26346c04839afaebafc8fa1c33b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:00.887441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576419ab-a3f7-48e5-b3ab-2b09b46e08ab tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=29353f39990c4bdfaf36ec8c2e412388, group_id=2379ba1e0a2b4793b0a8ce8415c0af4c, role_id=68afd26346c04839afaebafc8fa1c33b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:00.893404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576419ab-a3f7-48e5-b3ab-2b09b46e08ab tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:00.991432 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3632/7179] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:00 2022] PUT /identity/v3/domains/29353f39990c4bdfaf36ec8c2e412388/groups/2379ba1e0a2b4793b0a8ce8415c0af4c/roles/68afd26346c04839afaebafc8fa1c33b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:00.995463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48876e5b-95d5-4cf0-a091-b48aa0ad05d7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:00.997479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-48876e5b-95d5-4cf0-a091-b48aa0ad05d7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:01.147750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48876e5b-95d5-4cf0-a091-b48aa0ad05d7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:01.313279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8de41-9508-4c6e-8222-8c375c754c44 tempest-TokensV3TestJSON-640337460 tempest-TokensV3TestJSON-640337460-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55274a5f086940f09926f66bc4a3b24a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '45ce3ec13ff74eff9168320b452ba243', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:01.313279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8de41-9508-4c6e-8222-8c375c754c44 tempest-TokensV3TestJSON-640337460 tempest-TokensV3TestJSON-640337460-project] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:01.313279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8de41-9508-4c6e-8222-8c375c754c44 tempest-TokensV3TestJSON-640337460 tempest-TokensV3TestJSON-640337460-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:01.313673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8de41-9508-4c6e-8222-8c375c754c44 tempest-TokensV3TestJSON-640337460 tempest-TokensV3TestJSON-640337460-project] PATH_INFO: `/v3/auth/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:01.315018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8de41-9508-4c6e-8222-8c375c754c44 tempest-TokensV3TestJSON-640337460 tempest-TokensV3TestJSON-640337460-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:01.316681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8de41-9508-4c6e-8222-8c375c754c44 tempest-TokensV3TestJSON-640337460 tempest-TokensV3TestJSON-640337460-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:01.335170 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:01.599024 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3548/7180] 10.222.0.43 () {58 vars in 1142 bytes} [Tue Jul 19 14:43:00 2022] GET /identity/v3/auth/domains => generated 1172 bytes in 596 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:01.599429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576419ab-a3f7-48e5-b3ab-2b09b46e08ab tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:01.689983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576419ab-a3f7-48e5-b3ab-2b09b46e08ab tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:01.697981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00e183-fc74-4194-977b-749b9c982761 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:01.699041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00e183-fc74-4194-977b-749b9c982761 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:01.704513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00e183-fc74-4194-977b-749b9c982761 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:01.704513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00e183-fc74-4194-977b-749b9c982761 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains/29353f39990c4bdfaf36ec8c2e412388/groups/2379ba1e0a2b4793b0a8ce8415c0af4c/roles/68afd26346c04839afaebafc8fa1c33b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:01.704513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00e183-fc74-4194-977b-749b9c982761 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=29353f39990c4bdfaf36ec8c2e412388, group_id=2379ba1e0a2b4793b0a8ce8415c0af4c, role_id=68afd26346c04839afaebafc8fa1c33b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:01.706773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00e183-fc74-4194-977b-749b9c982761 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:01.713756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ee00e183-fc74-4194-977b-749b9c982761 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invalidating the token cache because role 68afd26346c04839afaebafc8fa1c33b was removed from group 2379ba1e0a2b4793b0a8ce8415c0af4c on domain 29353f39990c4bdfaf36ec8c2e412388. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:01.714227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ee00e183-fc74-4194-977b-749b9c982761 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:01.714975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ee00e183-fc74-4194-977b-749b9c982761 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:01.839790 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3633/7181] 10.222.0.43 () {58 vars in 1466 bytes} [Tue Jul 19 14:43:01 2022] DELETE /identity/v3/domains/29353f39990c4bdfaf36ec8c2e412388/groups/2379ba1e0a2b4793b0a8ce8415c0af4c/roles/68afd26346c04839afaebafc8fa1c33b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:01.849977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8de41-9508-4c6e-8222-8c375c754c44 tempest-TokensV3TestJSON-640337460 tempest-TokensV3TestJSON-640337460-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:01.855895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-35c8de41-9508-4c6e-8222-8c375c754c44 tempest-TokensV3TestJSON-640337460 tempest-TokensV3TestJSON-640337460-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:01.895746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00e183-fc74-4194-977b-749b9c982761 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:01.897452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ee00e183-fc74-4194-977b-749b9c982761 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:01.927518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8de41-9508-4c6e-8222-8c375c754c44 tempest-TokensV3TestJSON-640337460 tempest-TokensV3TestJSON-640337460-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:02.079582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00e183-fc74-4194-977b-749b9c982761 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:02.083010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa268dd6-0de7-496b-aff9-3cd5d48137c9 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:02.084478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa268dd6-0de7-496b-aff9-3cd5d48137c9 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:02.084943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa268dd6-0de7-496b-aff9-3cd5d48137c9 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:02.085447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1e442-f0a7-44e3-a07d-0b2be58a8165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:02.085714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa268dd6-0de7-496b-aff9-3cd5d48137c9 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/groups/2379ba1e0a2b4793b0a8ce8415c0af4c/users/55274a5f086940f09926f66bc4a3b24a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:02.086439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1e442-f0a7-44e3-a07d-0b2be58a8165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:02.086791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1e442-f0a7-44e3-a07d-0b2be58a8165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:02.087117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a1e442-f0a7-44e3-a07d-0b2be58a8165 admin admin] PATH_INFO: `/v3/projects/43f9b121f2f54b2bbf40a0438324f547` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:02.088501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1e442-f0a7-44e3-a07d-0b2be58a8165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43f9b121f2f54b2bbf40a0438324f547)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:02.090591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a1e442-f0a7-44e3-a07d-0b2be58a8165 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:02.105690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa268dd6-0de7-496b-aff9-3cd5d48137c9 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=2379ba1e0a2b4793b0a8ce8415c0af4c, user_id=55274a5f086940f09926f66bc4a3b24a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:02.107970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa268dd6-0de7-496b-aff9-3cd5d48137c9 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:02.208196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-aa268dd6-0de7-496b-aff9-3cd5d48137c9 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '55274a5f086940f09926f66bc4a3b24a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:02.241488 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:02.267029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-22a1e442-f0a7-44e3-a07d-0b2be58a8165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f9b121f2f54b2bbf40a0438324f547', 'request_id': 'req-22a1e442-f0a7-44e3-a07d-0b2be58a8165'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:02.286605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-22a1e442-f0a7-44e3-a07d-0b2be58a8165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f9b121f2f54b2bbf40a0438324f547', 'request_id': 'req-22a1e442-f0a7-44e3-a07d-0b2be58a8165'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:02.298048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-22a1e442-f0a7-44e3-a07d-0b2be58a8165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f9b121f2f54b2bbf40a0438324f547', 'request_id': 'req-22a1e442-f0a7-44e3-a07d-0b2be58a8165'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:02.316431 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3549/7182] 10.222.0.43 () {58 vars in 1343 bytes} [Tue Jul 19 14:43:01 2022] DELETE /identity/v3/groups/2379ba1e0a2b4793b0a8ce8415c0af4c/users/55274a5f086940f09926f66bc4a3b24a => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:02.322268 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:02.322268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa268dd6-0de7-496b-aff9-3cd5d48137c9 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:02.415948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-22a1e442-f0a7-44e3-a07d-0b2be58a8165 admin admin] The token cache is being invalidate because project 43f9b121f2f54b2bbf40a0438324f547 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:02.416269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-22a1e442-f0a7-44e3-a07d-0b2be58a8165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:02.417081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-22a1e442-f0a7-44e3-a07d-0b2be58a8165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:02.423309 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3634/7183] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:01 2022] DELETE /identity/v3/projects/43f9b121f2f54b2bbf40a0438324f547 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:02.426967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1e442-f0a7-44e3-a07d-0b2be58a8165 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:02.433110 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-22a1e442-f0a7-44e3-a07d-0b2be58a8165 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:02.482270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa268dd6-0de7-496b-aff9-3cd5d48137c9 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:02.495609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4e36f-d9ae-4685-892f-ea8ce2c009aa tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:02.497132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4e36f-d9ae-4685-892f-ea8ce2c009aa tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:02.497445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4e36f-d9ae-4685-892f-ea8ce2c009aa tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:02.497714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4e36f-d9ae-4685-892f-ea8ce2c009aa tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/groups/2379ba1e0a2b4793b0a8ce8415c0af4c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:02.508310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4e36f-d9ae-4685-892f-ea8ce2c009aa tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2379ba1e0a2b4793b0a8ce8415c0af4c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:02.517065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4e36f-d9ae-4685-892f-ea8ce2c009aa tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:02.592742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a1e442-f0a7-44e3-a07d-0b2be58a8165 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:02.677280 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3550/7184] 10.222.0.43 () {58 vars in 1226 bytes} [Tue Jul 19 14:43:02 2022] DELETE /identity/v3/groups/2379ba1e0a2b4793b0a8ce8415c0af4c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:43:02.678218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4e36f-d9ae-4685-892f-ea8ce2c009aa tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:02.679858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c3c4e36f-d9ae-4685-892f-ea8ce2c009aa tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:02.709075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cc431-43ad-4b7d-8484-8468382a22de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:02.709075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cc431-43ad-4b7d-8484-8468382a22de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:02.709075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cc431-43ad-4b7d-8484-8468382a22de admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:02.709075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cc431-43ad-4b7d-8484-8468382a22de admin admin] PATH_INFO: `/v3/users/49896b1c0bb34319816cca70b582960c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:02.709831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cc431-43ad-4b7d-8484-8468382a22de admin admin] RBAC: Authorizing `identity:delete_user(user_id=49896b1c0bb34319816cca70b582960c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:02.709831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cc431-43ad-4b7d-8484-8468382a22de admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:02.805271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4e36f-d9ae-4685-892f-ea8ce2c009aa tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:02.811434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1768eb9-0ad2-4142-a433-67cf3fe37abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:02.812641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1768eb9-0ad2-4142-a433-67cf3fe37abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:02.813164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1768eb9-0ad2-4142-a433-67cf3fe37abe admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:02.813523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1768eb9-0ad2-4142-a433-67cf3fe37abe admin admin] PATH_INFO: `/v3/users/e6ed5c73a9d74a6495d920381846aceb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:02.815679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1768eb9-0ad2-4142-a433-67cf3fe37abe admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6ed5c73a9d74a6495d920381846aceb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:02.818602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1768eb9-0ad2-4142-a433-67cf3fe37abe admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:02.996184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b75cc431-43ad-4b7d-8484-8468382a22de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49896b1c0bb34319816cca70b582960c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:03.015594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b75cc431-43ad-4b7d-8484-8468382a22de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49896b1c0bb34319816cca70b582960c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:03.029665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b75cc431-43ad-4b7d-8484-8468382a22de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49896b1c0bb34319816cca70b582960c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:03.029665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b75cc431-43ad-4b7d-8484-8468382a22de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49896b1c0bb34319816cca70b582960c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:03.139904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b75cc431-43ad-4b7d-8484-8468382a22de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49896b1c0bb34319816cca70b582960c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:03.152061 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3635/7185] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:02 2022] DELETE /identity/v3/users/49896b1c0bb34319816cca70b582960c => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:03.152061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cc431-43ad-4b7d-8484-8468382a22de admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:03.158453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b75cc431-43ad-4b7d-8484-8468382a22de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:03.170202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c1768eb9-0ad2-4142-a433-67cf3fe37abe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6ed5c73a9d74a6495d920381846aceb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:03.193438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c1768eb9-0ad2-4142-a433-67cf3fe37abe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6ed5c73a9d74a6495d920381846aceb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:03.194928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c1768eb9-0ad2-4142-a433-67cf3fe37abe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6ed5c73a9d74a6495d920381846aceb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:03.195745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c1768eb9-0ad2-4142-a433-67cf3fe37abe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6ed5c73a9d74a6495d920381846aceb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:03.224327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c1768eb9-0ad2-4142-a433-67cf3fe37abe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6ed5c73a9d74a6495d920381846aceb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:03.317650 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3551/7186] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:02 2022] DELETE /identity/v3/users/e6ed5c73a9d74a6495d920381846aceb => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:03.322025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4807d-ccfa-41ac-837f-b2fc52007d3a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:03.322559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4807d-ccfa-41ac-837f-b2fc52007d3a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:03.323086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb4807d-ccfa-41ac-837f-b2fc52007d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:03.328308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cc431-43ad-4b7d-8484-8468382a22de admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:03.401392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6bb4807d-ccfa-41ac-837f-b2fc52007d3a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:03.403561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6bb4807d-ccfa-41ac-837f-b2fc52007d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:03.410728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c95f39-f420-4821-8b2a-7c5b45991e15 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:03.411743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c95f39-f420-4821-8b2a-7c5b45991e15 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:03.412126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c95f39-f420-4821-8b2a-7c5b45991e15 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:03.412486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c95f39-f420-4821-8b2a-7c5b45991e15 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/roles/68afd26346c04839afaebafc8fa1c33b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:03.414862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c95f39-f420-4821-8b2a-7c5b45991e15 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:delete_role(role_id=68afd26346c04839afaebafc8fa1c33b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:03.416960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c95f39-f420-4821-8b2a-7c5b45991e15 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:03.522786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b5c95f39-f420-4821-8b2a-7c5b45991e15 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invalidating the token cache because role 68afd26346c04839afaebafc8fa1c33b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:03.522786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b5c95f39-f420-4821-8b2a-7c5b45991e15 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:03.523432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b5c95f39-f420-4821-8b2a-7c5b45991e15 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:03.527768 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3636/7187] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:03 2022] DELETE /identity/v3/roles/68afd26346c04839afaebafc8fa1c33b => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:03.531911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c95f39-f420-4821-8b2a-7c5b45991e15 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:03.534422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b5c95f39-f420-4821-8b2a-7c5b45991e15 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:03.553083 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3552/7188] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:03.592162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4807d-ccfa-41ac-837f-b2fc52007d3a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:03.593940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6bb4807d-ccfa-41ac-837f-b2fc52007d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:03.682826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c95f39-f420-4821-8b2a-7c5b45991e15 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:03.697979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772fd6c-768a-47d5-8ae1-a7ef26b18cdd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:03.698900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772fd6c-768a-47d5-8ae1-a7ef26b18cdd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:03.699200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772fd6c-768a-47d5-8ae1-a7ef26b18cdd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:03.699490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0772fd6c-768a-47d5-8ae1-a7ef26b18cdd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains/29353f39990c4bdfaf36ec8c2e412388` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:03.704137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772fd6c-768a-47d5-8ae1-a7ef26b18cdd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=29353f39990c4bdfaf36ec8c2e412388)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:03.706395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0772fd6c-768a-47d5-8ae1-a7ef26b18cdd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:03.733108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb4807d-ccfa-41ac-837f-b2fc52007d3a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:03.782716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0772fd6c-768a-47d5-8ae1-a7ef26b18cdd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '29353f39990c4bdfaf36ec8c2e412388'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:03.785993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0772fd6c-768a-47d5-8ae1-a7ef26b18cdd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '29353f39990c4bdfaf36ec8c2e412388'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:03.877023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead52ad-94f2-4f2c-b175-62d64700985d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:03.877625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead52ad-94f2-4f2c-b175-62d64700985d service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:03.877913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead52ad-94f2-4f2c-b175-62d64700985d service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:03.878272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead52ad-94f2-4f2c-b175-62d64700985d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:03.885678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cead52ad-94f2-4f2c-b175-62d64700985d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:03.913857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0772fd6c-768a-47d5-8ae1-a7ef26b18cdd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '29353f39990c4bdfaf36ec8c2e412388'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:03.914514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0772fd6c-768a-47d5-8ae1-a7ef26b18cdd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '29353f39990c4bdfaf36ec8c2e412388'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:03.920878 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3637/7189] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:43:03 2022] PATCH /identity/v3/domains/29353f39990c4bdfaf36ec8c2e412388 => generated 276 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:43:03.926136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772fd6c-768a-47d5-8ae1-a7ef26b18cdd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:03.928764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0772fd6c-768a-47d5-8ae1-a7ef26b18cdd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:04.057592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead52ad-94f2-4f2c-b175-62d64700985d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:04.063941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead52ad-94f2-4f2c-b175-62d64700985d service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:04.074854 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3553/7190] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:43:04.094571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0772fd6c-768a-47d5-8ae1-a7ef26b18cdd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:04.106254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4fe70-da0c-4544-a987-be54e0caf732 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:04.106254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4fe70-da0c-4544-a987-be54e0caf732 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:04.106254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4fe70-da0c-4544-a987-be54e0caf732 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:04.106584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4fe70-da0c-4544-a987-be54e0caf732 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains/29353f39990c4bdfaf36ec8c2e412388` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:04.119980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4fe70-da0c-4544-a987-be54e0caf732 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=29353f39990c4bdfaf36ec8c2e412388)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:04.121811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b4fe70-da0c-4544-a987-be54e0caf732 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:04.161088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-21b4fe70-da0c-4544-a987-be54e0caf732 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '29353f39990c4bdfaf36ec8c2e412388'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:04.177567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-21b4fe70-da0c-4544-a987-be54e0caf732 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '29353f39990c4bdfaf36ec8c2e412388'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:04.223146 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:04.341445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-21b4fe70-da0c-4544-a987-be54e0caf732 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29353f39990c4bdfaf36ec8c2e412388', 'request_id': 'req-21b4fe70-da0c-4544-a987-be54e0caf732'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:04.418405 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:04.424429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-21b4fe70-da0c-4544-a987-be54e0caf732 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29353f39990c4bdfaf36ec8c2e412388', 'request_id': 'req-21b4fe70-da0c-4544-a987-be54e0caf732'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:04.432788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-21b4fe70-da0c-4544-a987-be54e0caf732 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29353f39990c4bdfaf36ec8c2e412388', 'request_id': 'req-21b4fe70-da0c-4544-a987-be54e0caf732'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:04.541671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-21b4fe70-da0c-4544-a987-be54e0caf732 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] The token cache is being invalidate because project 29353f39990c4bdfaf36ec8c2e412388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:04.543426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-21b4fe70-da0c-4544-a987-be54e0caf732 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:04.547128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-21b4fe70-da0c-4544-a987-be54e0caf732 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:04.556530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-21b4fe70-da0c-4544-a987-be54e0caf732 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '29353f39990c4bdfaf36ec8c2e412388', 'request_id': 'req-21b4fe70-da0c-4544-a987-be54e0caf732'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:04.557856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-21b4fe70-da0c-4544-a987-be54e0caf732 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '29353f39990c4bdfaf36ec8c2e412388', 'request_id': 'req-21b4fe70-da0c-4544-a987-be54e0caf732'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:04.558521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-21b4fe70-da0c-4544-a987-be54e0caf732 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '29353f39990c4bdfaf36ec8c2e412388', 'request_id': 'req-21b4fe70-da0c-4544-a987-be54e0caf732'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:04.572141 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3638/7191] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:43:03 2022] DELETE /identity/v3/domains/29353f39990c4bdfaf36ec8c2e412388 => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:04.573338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead52ad-94f2-4f2c-b175-62d64700985d service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:04.575427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cead52ad-94f2-4f2c-b175-62d64700985d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:04.607453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead52ad-94f2-4f2c-b175-62d64700985d service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:04.784236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed350e-9892-4f26-bd26-d40fc2da0041 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:04.785182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed350e-9892-4f26-bd26-d40fc2da0041 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:04.785471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed350e-9892-4f26-bd26-d40fc2da0041 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:04.785754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed350e-9892-4f26-bd26-d40fc2da0041 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains/9d483896da2041c4a3fc37740ee704d9/users/55274a5f086940f09926f66bc4a3b24a/roles/7b7891e43bcb4f138b924529331f18fd` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:04.792235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed350e-9892-4f26-bd26-d40fc2da0041 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=9d483896da2041c4a3fc37740ee704d9, user_id=55274a5f086940f09926f66bc4a3b24a, role_id=7b7891e43bcb4f138b924529331f18fd)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:04.795012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed350e-9892-4f26-bd26-d40fc2da0041 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:04.801319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-81ed350e-9892-4f26-bd26-d40fc2da0041 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invalidating the token cache because role 7b7891e43bcb4f138b924529331f18fd was removed from user 55274a5f086940f09926f66bc4a3b24a on domain 9d483896da2041c4a3fc37740ee704d9. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:04.801683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-81ed350e-9892-4f26-bd26-d40fc2da0041 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:04.807566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-81ed350e-9892-4f26-bd26-d40fc2da0041 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:04.885050 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3554/7192] 10.222.0.43 () {58 vars in 1463 bytes} [Tue Jul 19 14:43:04 2022] DELETE /identity/v3/domains/9d483896da2041c4a3fc37740ee704d9/users/55274a5f086940f09926f66bc4a3b24a/roles/7b7891e43bcb4f138b924529331f18fd => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:04.889675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4fe70-da0c-4544-a987-be54e0caf732 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:04.891389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-21b4fe70-da0c-4544-a987-be54e0caf732 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:04.906823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b4fe70-da0c-4544-a987-be54e0caf732 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:04.997408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1351a40-ec76-4426-b729-5a0e4d49a5a9 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:04.998559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1351a40-ec76-4426-b729-5a0e4d49a5a9 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:04.998954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1351a40-ec76-4426-b729-5a0e4d49a5a9 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:04.999339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1351a40-ec76-4426-b729-5a0e4d49a5a9 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/roles/7b7891e43bcb4f138b924529331f18fd` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:05.001209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1351a40-ec76-4426-b729-5a0e4d49a5a9 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7b7891e43bcb4f138b924529331f18fd)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:05.003892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1351a40-ec76-4426-b729-5a0e4d49a5a9 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:05.023274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed350e-9892-4f26-bd26-d40fc2da0041 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:05.025742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-81ed350e-9892-4f26-bd26-d40fc2da0041 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:05.177626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c1351a40-ec76-4426-b729-5a0e4d49a5a9 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invalidating the token cache because role 7b7891e43bcb4f138b924529331f18fd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:05.178309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c1351a40-ec76-4426-b729-5a0e4d49a5a9 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:05.180019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c1351a40-ec76-4426-b729-5a0e4d49a5a9 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:05.185076 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3639/7193] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:04 2022] DELETE /identity/v3/roles/7b7891e43bcb4f138b924529331f18fd => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:05.186858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed6ff0-c05a-450b-a437-8c8656f6c580 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:05.187632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed6ff0-c05a-450b-a437-8c8656f6c580 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:05.188109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed6ff0-c05a-450b-a437-8c8656f6c580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:05.212217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed350e-9892-4f26-bd26-d40fc2da0041 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:05.256913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c5ed6ff0-c05a-450b-a437-8c8656f6c580 None None] MFA Rules not processed for user `20cc5d36e4004359903122049a88079f`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:05.263173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c5ed6ff0-c05a-450b-a437-8c8656f6c580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:05.349773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ae6ed-a1b5-4e48-8f61-cdaf8e85a96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:05.351400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ae6ed-a1b5-4e48-8f61-cdaf8e85a96d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:05.353552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ae6ed-a1b5-4e48-8f61-cdaf8e85a96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:05.353552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ae6ed-a1b5-4e48-8f61-cdaf8e85a96d admin admin] PATH_INFO: `/v3/projects/03e6071637ea4169bf0c3fdace7729cc` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:05.359060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ae6ed-a1b5-4e48-8f61-cdaf8e85a96d admin admin] RBAC: Authorizing `identity:delete_project(project_id=03e6071637ea4169bf0c3fdace7729cc)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:05.365366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ae6ed-a1b5-4e48-8f61-cdaf8e85a96d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:05.483783 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:05.523409 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:05.542806 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3640/7194] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:05.544236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed6ff0-c05a-450b-a437-8c8656f6c580 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:05.550959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c5ed6ff0-c05a-450b-a437-8c8656f6c580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:05.553166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ee0ae6ed-a1b5-4e48-8f61-cdaf8e85a96d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03e6071637ea4169bf0c3fdace7729cc', 'request_id': 'req-ee0ae6ed-a1b5-4e48-8f61-cdaf8e85a96d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:05.637657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ee0ae6ed-a1b5-4e48-8f61-cdaf8e85a96d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03e6071637ea4169bf0c3fdace7729cc', 'request_id': 'req-ee0ae6ed-a1b5-4e48-8f61-cdaf8e85a96d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:05.649606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed6ff0-c05a-450b-a437-8c8656f6c580 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:05.653423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ee0ae6ed-a1b5-4e48-8f61-cdaf8e85a96d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03e6071637ea4169bf0c3fdace7729cc', 'request_id': 'req-ee0ae6ed-a1b5-4e48-8f61-cdaf8e85a96d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:05.683459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ee0ae6ed-a1b5-4e48-8f61-cdaf8e85a96d admin admin] The token cache is being invalidate because project 03e6071637ea4169bf0c3fdace7729cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:05.686154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ee0ae6ed-a1b5-4e48-8f61-cdaf8e85a96d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:05.692546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ee0ae6ed-a1b5-4e48-8f61-cdaf8e85a96d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:05.692546 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3555/7195] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:05 2022] DELETE /identity/v3/projects/03e6071637ea4169bf0c3fdace7729cc => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:05.693861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ae6ed-a1b5-4e48-8f61-cdaf8e85a96d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:05.695751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ee0ae6ed-a1b5-4e48-8f61-cdaf8e85a96d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:05.762034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031555d9-6184-45f8-bfc4-d93e44df9579 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:05.762692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031555d9-6184-45f8-bfc4-d93e44df9579 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:05.762983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031555d9-6184-45f8-bfc4-d93e44df9579 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:05.763266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031555d9-6184-45f8-bfc4-d93e44df9579 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains/9d483896da2041c4a3fc37740ee704d9` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:05.768465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031555d9-6184-45f8-bfc4-d93e44df9579 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=9d483896da2041c4a3fc37740ee704d9)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:05.770133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031555d9-6184-45f8-bfc4-d93e44df9579 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:05.827879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ae6ed-a1b5-4e48-8f61-cdaf8e85a96d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:05.837744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-031555d9-6184-45f8-bfc4-d93e44df9579 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '9d483896da2041c4a3fc37740ee704d9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:05.843463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-031555d9-6184-45f8-bfc4-d93e44df9579 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '9d483896da2041c4a3fc37740ee704d9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:05.844928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f14a9e-456a-4049-be5e-9247b5380375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:05.846627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f14a9e-456a-4049-be5e-9247b5380375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:05.846927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f14a9e-456a-4049-be5e-9247b5380375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:05.847216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f14a9e-456a-4049-be5e-9247b5380375 admin admin] PATH_INFO: `/v3/projects/2cef59aa121e4ac6abfb022de5cdbae4` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:05.848692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f14a9e-456a-4049-be5e-9247b5380375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cef59aa121e4ac6abfb022de5cdbae4)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:05.850759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f14a9e-456a-4049-be5e-9247b5380375 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:05.996368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-031555d9-6184-45f8-bfc4-d93e44df9579 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '9d483896da2041c4a3fc37740ee704d9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:05.999960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-031555d9-6184-45f8-bfc4-d93e44df9579 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '9d483896da2041c4a3fc37740ee704d9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:06.004109 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3641/7196] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:43:05 2022] PATCH /identity/v3/domains/9d483896da2041c4a3fc37740ee704d9 => generated 278 bytes in 460 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:06.011871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7a2f2-f03e-4961-822e-c6798e32d6ba None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:06.012627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7a2f2-f03e-4961-822e-c6798e32d6ba None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:06.018112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7a2f2-f03e-4961-822e-c6798e32d6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:06.059377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d9d7a2f2-f03e-4961-822e-c6798e32d6ba None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:06.061558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d9d7a2f2-f03e-4961-822e-c6798e32d6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:06.065812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-58f14a9e-456a-4049-be5e-9247b5380375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cef59aa121e4ac6abfb022de5cdbae4', 'request_id': 'req-58f14a9e-456a-4049-be5e-9247b5380375'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:06.145743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-58f14a9e-456a-4049-be5e-9247b5380375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cef59aa121e4ac6abfb022de5cdbae4', 'request_id': 'req-58f14a9e-456a-4049-be5e-9247b5380375'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:06.154740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-58f14a9e-456a-4049-be5e-9247b5380375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cef59aa121e4ac6abfb022de5cdbae4', 'request_id': 'req-58f14a9e-456a-4049-be5e-9247b5380375'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:06.182617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-58f14a9e-456a-4049-be5e-9247b5380375 admin admin] The token cache is being invalidate because project 2cef59aa121e4ac6abfb022de5cdbae4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:06.183178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-58f14a9e-456a-4049-be5e-9247b5380375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:06.184205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-58f14a9e-456a-4049-be5e-9247b5380375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:06.190580 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3556/7197] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:05 2022] DELETE /identity/v3/projects/2cef59aa121e4ac6abfb022de5cdbae4 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:06.191789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f14a9e-456a-4049-be5e-9247b5380375 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:06.194362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-58f14a9e-456a-4049-be5e-9247b5380375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:06.209515 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3642/7198] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:06.210814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7a2f2-f03e-4961-822e-c6798e32d6ba None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:06.212382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d9d7a2f2-f03e-4961-822e-c6798e32d6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:06.250478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7a2f2-f03e-4961-822e-c6798e32d6ba None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:06.264473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f99df4-c984-4af3-a41f-8a5b3db47498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:06.265699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f99df4-c984-4af3-a41f-8a5b3db47498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:06.266279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f99df4-c984-4af3-a41f-8a5b3db47498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:06.267029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f99df4-c984-4af3-a41f-8a5b3db47498 admin admin] PATH_INFO: `/v3/users/ca628f421e0e4d8ab1e2753b0c823248` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:06.270883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f99df4-c984-4af3-a41f-8a5b3db47498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca628f421e0e4d8ab1e2753b0c823248)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:06.273098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f99df4-c984-4af3-a41f-8a5b3db47498 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:06.369553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f14a9e-456a-4049-be5e-9247b5380375 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:06.374678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696cf8f-e593-4860-8fed-75e0941039dd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:06.377944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696cf8f-e593-4860-8fed-75e0941039dd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:06.377944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696cf8f-e593-4860-8fed-75e0941039dd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:06.377944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696cf8f-e593-4860-8fed-75e0941039dd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains/9d483896da2041c4a3fc37740ee704d9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:06.406991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696cf8f-e593-4860-8fed-75e0941039dd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9d483896da2041c4a3fc37740ee704d9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:06.408906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696cf8f-e593-4860-8fed-75e0941039dd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:06.451258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8696cf8f-e593-4860-8fed-75e0941039dd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9d483896da2041c4a3fc37740ee704d9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:06.462405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8696cf8f-e593-4860-8fed-75e0941039dd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9d483896da2041c4a3fc37740ee704d9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:06.506714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b7f99df4-c984-4af3-a41f-8a5b3db47498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca628f421e0e4d8ab1e2753b0c823248'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:06.544467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b7f99df4-c984-4af3-a41f-8a5b3db47498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca628f421e0e4d8ab1e2753b0c823248'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:06.563218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b7f99df4-c984-4af3-a41f-8a5b3db47498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca628f421e0e4d8ab1e2753b0c823248'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:06.565729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b7f99df4-c984-4af3-a41f-8a5b3db47498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca628f421e0e4d8ab1e2753b0c823248'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:06.585147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8696cf8f-e593-4860-8fed-75e0941039dd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d483896da2041c4a3fc37740ee704d9', 'request_id': 'req-8696cf8f-e593-4860-8fed-75e0941039dd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:06.637122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b7f99df4-c984-4af3-a41f-8a5b3db47498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca628f421e0e4d8ab1e2753b0c823248'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:06.645775 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3643/7199] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:06 2022] DELETE /identity/v3/users/ca628f421e0e4d8ab1e2753b0c823248 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:06.647584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac96f3-bcba-4b21-ab5c-ceff736d62a1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:06.649210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac96f3-bcba-4b21-ab5c-ceff736d62a1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:06.650402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac96f3-bcba-4b21-ab5c-ceff736d62a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:06.698642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8696cf8f-e593-4860-8fed-75e0941039dd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d483896da2041c4a3fc37740ee704d9', 'request_id': 'req-8696cf8f-e593-4860-8fed-75e0941039dd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:06.708404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-68ac96f3-bcba-4b21-ab5c-ceff736d62a1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:06.709507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8696cf8f-e593-4860-8fed-75e0941039dd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d483896da2041c4a3fc37740ee704d9', 'request_id': 'req-8696cf8f-e593-4860-8fed-75e0941039dd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:06.713480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-68ac96f3-bcba-4b21-ab5c-ceff736d62a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:06.745222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8696cf8f-e593-4860-8fed-75e0941039dd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] The token cache is being invalidate because project 9d483896da2041c4a3fc37740ee704d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:06.745526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8696cf8f-e593-4860-8fed-75e0941039dd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:06.751448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8696cf8f-e593-4860-8fed-75e0941039dd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:06.773262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8696cf8f-e593-4860-8fed-75e0941039dd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9d483896da2041c4a3fc37740ee704d9', 'request_id': 'req-8696cf8f-e593-4860-8fed-75e0941039dd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:06.774056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8696cf8f-e593-4860-8fed-75e0941039dd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9d483896da2041c4a3fc37740ee704d9', 'request_id': 'req-8696cf8f-e593-4860-8fed-75e0941039dd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:06.774741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8696cf8f-e593-4860-8fed-75e0941039dd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9d483896da2041c4a3fc37740ee704d9', 'request_id': 'req-8696cf8f-e593-4860-8fed-75e0941039dd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:06.800920 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3557/7200] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:43:06 2022] DELETE /identity/v3/domains/9d483896da2041c4a3fc37740ee704d9 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:06.808471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696cf8f-e593-4860-8fed-75e0941039dd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:06.808471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8696cf8f-e593-4860-8fed-75e0941039dd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:06.950395 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3644/7201] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:06.969679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac96f3-bcba-4b21-ab5c-ceff736d62a1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:07.000189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac96f3-bcba-4b21-ab5c-ceff736d62a1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:07.016820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2171d-630d-4415-a780-f8a4f8e4dc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:07.018384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2171d-630d-4415-a780-f8a4f8e4dc4d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:07.019215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2171d-630d-4415-a780-f8a4f8e4dc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:07.019503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2171d-630d-4415-a780-f8a4f8e4dc4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:07.023048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2171d-630d-4415-a780-f8a4f8e4dc4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:43:07.023445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2171d-630d-4415-a780-f8a4f8e4dc4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:07.026476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696cf8f-e593-4860-8fed-75e0941039dd tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:07.027938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2171d-630d-4415-a780-f8a4f8e4dc4d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:07.065142 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3645/7202] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:07.072045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2171d-630d-4415-a780-f8a4f8e4dc4d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:07.089941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2171d-630d-4415-a780-f8a4f8e4dc4d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:07.104873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0862e-6d1a-474e-9a02-980e711fb590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:07.105561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0862e-6d1a-474e-9a02-980e711fb590 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:07.105852 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0862e-6d1a-474e-9a02-980e711fb590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:07.106181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0862e-6d1a-474e-9a02-980e711fb590 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:07.106897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0862e-6d1a-474e-9a02-980e711fb590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:07.113716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0862e-6d1a-474e-9a02-980e711fb590 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:07.130628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa111376-69a8-4b2c-82c1-4e914ce310f2 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:07.131692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa111376-69a8-4b2c-82c1-4e914ce310f2 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:07.131983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa111376-69a8-4b2c-82c1-4e914ce310f2 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:07.132268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa111376-69a8-4b2c-82c1-4e914ce310f2 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains/e3a57d1a33f84b33a09a31c01c7221f1/groups/918768ea5ae44be69a4be3a34e1cc642/roles/32aff70874424dc98693593d2f037b0b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:07.136173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa111376-69a8-4b2c-82c1-4e914ce310f2 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=e3a57d1a33f84b33a09a31c01c7221f1, group_id=918768ea5ae44be69a4be3a34e1cc642, role_id=32aff70874424dc98693593d2f037b0b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:07.139439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa111376-69a8-4b2c-82c1-4e914ce310f2 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:07.163835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fa111376-69a8-4b2c-82c1-4e914ce310f2 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invalidating the token cache because role 32aff70874424dc98693593d2f037b0b was removed from group 918768ea5ae44be69a4be3a34e1cc642 on domain e3a57d1a33f84b33a09a31c01c7221f1. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:07.165110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fa111376-69a8-4b2c-82c1-4e914ce310f2 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:07.166028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fa111376-69a8-4b2c-82c1-4e914ce310f2 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:07.202725 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:07.271638 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3558/7203] 10.222.0.43 () {58 vars in 1466 bytes} [Tue Jul 19 14:43:06 2022] DELETE /identity/v3/domains/e3a57d1a33f84b33a09a31c01c7221f1/groups/918768ea5ae44be69a4be3a34e1cc642/roles/32aff70874424dc98693593d2f037b0b => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:07.277324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa111376-69a8-4b2c-82c1-4e914ce310f2 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:07.279858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fa111376-69a8-4b2c-82c1-4e914ce310f2 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:07.303256 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3646/7204] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:43:07 2022] POST /identity/v3/projects => generated 379 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:07.307739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0862e-6d1a-474e-9a02-980e711fb590 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:07.316277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-80c0862e-6d1a-474e-9a02-980e711fb590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:07.365937 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:07.524607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa111376-69a8-4b2c-82c1-4e914ce310f2 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:07.612607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0862e-6d1a-474e-9a02-980e711fb590 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:07.633131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c7774-0111-469b-be77-514c6a90142e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:07.636410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c7774-0111-469b-be77-514c6a90142e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:07.637692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c7774-0111-469b-be77-514c6a90142e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:07.638201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6c7774-0111-469b-be77-514c6a90142e admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:07.639088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c7774-0111-469b-be77-514c6a90142e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:07.648605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6c7774-0111-469b-be77-514c6a90142e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:07.690426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04c949-0cd5-4076-b6ff-9fe184428bfe tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:07.692105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04c949-0cd5-4076-b6ff-9fe184428bfe tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:07.692597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04c949-0cd5-4076-b6ff-9fe184428bfe tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:07.693106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04c949-0cd5-4076-b6ff-9fe184428bfe tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/groups/918768ea5ae44be69a4be3a34e1cc642/users/55274a5f086940f09926f66bc4a3b24a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:07.695324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04c949-0cd5-4076-b6ff-9fe184428bfe tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=918768ea5ae44be69a4be3a34e1cc642, user_id=55274a5f086940f09926f66bc4a3b24a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:07.697530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04c949-0cd5-4076-b6ff-9fe184428bfe tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:07.756245 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3647/7205] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:43:07 2022] POST /identity/v3/users => generated 290 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:07.757973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c7774-0111-469b-be77-514c6a90142e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:07.762663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0f6c7774-0111-469b-be77-514c6a90142e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:07.773979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4d04c949-0cd5-4076-b6ff-9fe184428bfe tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '55274a5f086940f09926f66bc4a3b24a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:07.810742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6c7774-0111-469b-be77-514c6a90142e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:07.826997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9feafe9-06c0-4f81-b575-4a485b52c44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:07.875940 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3559/7206] 10.222.0.43 () {58 vars in 1343 bytes} [Tue Jul 19 14:43:07 2022] DELETE /identity/v3/groups/918768ea5ae44be69a4be3a34e1cc642/users/55274a5f086940f09926f66bc4a3b24a => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:07.877060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04c949-0cd5-4076-b6ff-9fe184428bfe tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:07.882853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9feafe9-06c0-4f81-b575-4a485b52c44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:07.887218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9feafe9-06c0-4f81-b575-4a485b52c44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:07.887526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9feafe9-06c0-4f81-b575-4a485b52c44b admin admin] PATH_INFO: `/v3/projects/be2922c75434475bb5def2e63e279656` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:07.909367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9feafe9-06c0-4f81-b575-4a485b52c44b admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2922c75434475bb5def2e63e279656)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:07.922369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9feafe9-06c0-4f81-b575-4a485b52c44b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:08.059662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04c949-0cd5-4076-b6ff-9fe184428bfe tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:08.066170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52740c8-533f-4eb7-afd4-9d440c68337d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:08.066927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52740c8-533f-4eb7-afd4-9d440c68337d admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:08.067162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52740c8-533f-4eb7-afd4-9d440c68337d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:08.067448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52740c8-533f-4eb7-afd4-9d440c68337d admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:08.068625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52740c8-533f-4eb7-afd4-9d440c68337d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:08.072503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52740c8-533f-4eb7-afd4-9d440c68337d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:08.094503 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3560/7207] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:07 2022] GET /identity/v3/roles => generated 1880 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:08.096193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52740c8-533f-4eb7-afd4-9d440c68337d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:08.147548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c9feafe9-06c0-4f81-b575-4a485b52c44b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2922c75434475bb5def2e63e279656', 'request_id': 'req-c9feafe9-06c0-4f81-b575-4a485b52c44b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:08.154655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c9feafe9-06c0-4f81-b575-4a485b52c44b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2922c75434475bb5def2e63e279656', 'request_id': 'req-c9feafe9-06c0-4f81-b575-4a485b52c44b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:08.164487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c9feafe9-06c0-4f81-b575-4a485b52c44b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2922c75434475bb5def2e63e279656', 'request_id': 'req-c9feafe9-06c0-4f81-b575-4a485b52c44b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:08.230870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52740c8-533f-4eb7-afd4-9d440c68337d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:08.244026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c9feafe9-06c0-4f81-b575-4a485b52c44b admin admin] The token cache is being invalidate because project be2922c75434475bb5def2e63e279656 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:08.246875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c9feafe9-06c0-4f81-b575-4a485b52c44b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:08.247435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c9feafe9-06c0-4f81-b575-4a485b52c44b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:08.249864 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3648/7208] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:07 2022] DELETE /identity/v3/projects/be2922c75434475bb5def2e63e279656 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:08.250829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9feafe9-06c0-4f81-b575-4a485b52c44b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:08.259240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c9feafe9-06c0-4f81-b575-4a485b52c44b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:08.327863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76d7f3-0193-4574-89a9-764f6e41e434 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:08.332245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76d7f3-0193-4574-89a9-764f6e41e434 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:08.332682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76d7f3-0193-4574-89a9-764f6e41e434 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:08.333073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76d7f3-0193-4574-89a9-764f6e41e434 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/groups/918768ea5ae44be69a4be3a34e1cc642` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:08.335888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76d7f3-0193-4574-89a9-764f6e41e434 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:delete_group(group_id=918768ea5ae44be69a4be3a34e1cc642)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:08.341588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76d7f3-0193-4574-89a9-764f6e41e434 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:08.414898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9feafe9-06c0-4f81-b575-4a485b52c44b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:08.422127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b2668-210c-4fd4-a0cf-bf0bc7be468e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:08.423047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b2668-210c-4fd4-a0cf-bf0bc7be468e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:08.424225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b2668-210c-4fd4-a0cf-bf0bc7be468e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:08.424626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b2668-210c-4fd4-a0cf-bf0bc7be468e admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:08.425549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b2668-210c-4fd4-a0cf-bf0bc7be468e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:08.427626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b2668-210c-4fd4-a0cf-bf0bc7be468e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:08.468529 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3649/7209] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:08 2022] GET /identity/v3/roles => generated 1880 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:08.473355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f9e43-7a87-49cd-b13a-591902536a98 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:08.473797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f9e43-7a87-49cd-b13a-591902536a98 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:08.475210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f9e43-7a87-49cd-b13a-591902536a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:08.512849 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3561/7210] 10.222.0.43 () {58 vars in 1226 bytes} [Tue Jul 19 14:43:08 2022] DELETE /identity/v3/groups/918768ea5ae44be69a4be3a34e1cc642 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:08.520235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76d7f3-0193-4574-89a9-764f6e41e434 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:08.521780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-967f9e43-7a87-49cd-b13a-591902536a98 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:08.524733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-967f9e43-7a87-49cd-b13a-591902536a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:08.678246 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3650/7211] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:08.678246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f9e43-7a87-49cd-b13a-591902536a98 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:08.681005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-967f9e43-7a87-49cd-b13a-591902536a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:08.687479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76d7f3-0193-4574-89a9-764f6e41e434 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:08.693820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf172e7-8da0-4d61-87eb-5ac6b2ea870d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:08.698931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf172e7-8da0-4d61-87eb-5ac6b2ea870d admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:08.698931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf172e7-8da0-4d61-87eb-5ac6b2ea870d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:08.698931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf172e7-8da0-4d61-87eb-5ac6b2ea870d admin admin] PATH_INFO: `/v3/projects/885e04c87f9449ea8766ad400ebe80a8/users/f75da8a9c09645d19e3f09c52d0226c2/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:08.722828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf172e7-8da0-4d61-87eb-5ac6b2ea870d admin admin] RBAC: Authorizing `identity:create_grant(project_id=885e04c87f9449ea8766ad400ebe80a8, user_id=f75da8a9c09645d19e3f09c52d0226c2, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:08.729665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf172e7-8da0-4d61-87eb-5ac6b2ea870d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:08.772452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f9e43-7a87-49cd-b13a-591902536a98 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:08.777306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb225a-31af-479f-bb10-2fc9d2c0b993 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:08.778235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb225a-31af-479f-bb10-2fc9d2c0b993 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:08.778676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb225a-31af-479f-bb10-2fc9d2c0b993 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:08.778976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb225a-31af-479f-bb10-2fc9d2c0b993 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/roles/32aff70874424dc98693593d2f037b0b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:08.784970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb225a-31af-479f-bb10-2fc9d2c0b993 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:delete_role(role_id=32aff70874424dc98693593d2f037b0b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:08.784970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb225a-31af-479f-bb10-2fc9d2c0b993 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:08.847434 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3562/7212] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:08 2022] PUT /identity/v3/projects/885e04c87f9449ea8766ad400ebe80a8/users/f75da8a9c09645d19e3f09c52d0226c2/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:08.849275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6dffd-32ee-4f33-97c9-36111028d6b0 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:08.849666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6dffd-32ee-4f33-97c9-36111028d6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:08.850048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe6dffd-32ee-4f33-97c9-36111028d6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:08.882973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-abe6dffd-32ee-4f33-97c9-36111028d6b0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:08.886789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-abe6dffd-32ee-4f33-97c9-36111028d6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:08.956210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-54cb225a-31af-479f-bb10-2fc9d2c0b993 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invalidating the token cache because role 32aff70874424dc98693593d2f037b0b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:08.956792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-54cb225a-31af-479f-bb10-2fc9d2c0b993 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:08.958509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-54cb225a-31af-479f-bb10-2fc9d2c0b993 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:08.965151 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3651/7213] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:08 2022] DELETE /identity/v3/roles/32aff70874424dc98693593d2f037b0b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:08.967470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d4427-b2c3-4b0b-8988-7b05367150ff None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:08.967956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d4427-b2c3-4b0b-8988-7b05367150ff None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:08.968394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d4427-b2c3-4b0b-8988-7b05367150ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:08.985627 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3563/7214] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:08.986932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6dffd-32ee-4f33-97c9-36111028d6b0 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:08.992398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-abe6dffd-32ee-4f33-97c9-36111028d6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:09.014762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-491d4427-b2c3-4b0b-8988-7b05367150ff None None] MFA Rules not processed for user `f75da8a9c09645d19e3f09c52d0226c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:09.016177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-491d4427-b2c3-4b0b-8988-7b05367150ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:09.088008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe6dffd-32ee-4f33-97c9-36111028d6b0 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:09.093440 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3652/7215] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:09.097675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d4427-b2c3-4b0b-8988-7b05367150ff None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:09.195834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f24aa-4e1f-4ad1-9195-1f6484d6fb23 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:09.197241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f24aa-4e1f-4ad1-9195-1f6484d6fb23 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:09.197531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f24aa-4e1f-4ad1-9195-1f6484d6fb23 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:09.197813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907f24aa-4e1f-4ad1-9195-1f6484d6fb23 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains/e3a57d1a33f84b33a09a31c01c7221f1` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:09.199228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f24aa-4e1f-4ad1-9195-1f6484d6fb23 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e3a57d1a33f84b33a09a31c01c7221f1)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:09.201047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907f24aa-4e1f-4ad1-9195-1f6484d6fb23 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:09.227414 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:09.233629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d4427-b2c3-4b0b-8988-7b05367150ff None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:09.238405 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:09.240465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83c2d0-350f-4369-872b-07365ae374bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:09.242071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83c2d0-350f-4369-872b-07365ae374bf admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:09.242887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-907f24aa-4e1f-4ad1-9195-1f6484d6fb23 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e3a57d1a33f84b33a09a31c01c7221f1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:09.244017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83c2d0-350f-4369-872b-07365ae374bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:09.244017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83c2d0-350f-4369-872b-07365ae374bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:09.244857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-907f24aa-4e1f-4ad1-9195-1f6484d6fb23 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e3a57d1a33f84b33a09a31c01c7221f1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:09.245207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83c2d0-350f-4369-872b-07365ae374bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:43:09.245619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83c2d0-350f-4369-872b-07365ae374bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:09.248213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b83c2d0-350f-4369-872b-07365ae374bf admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:09.266853 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3653/7216] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:09.268611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83c2d0-350f-4369-872b-07365ae374bf admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:09.271079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8b83c2d0-350f-4369-872b-07365ae374bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:09.343378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-907f24aa-4e1f-4ad1-9195-1f6484d6fb23 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e3a57d1a33f84b33a09a31c01c7221f1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:09.344415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-907f24aa-4e1f-4ad1-9195-1f6484d6fb23 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e3a57d1a33f84b33a09a31c01c7221f1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:09.353546 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3564/7217] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:43:08 2022] PATCH /identity/v3/domains/e3a57d1a33f84b33a09a31c01c7221f1 => generated 278 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:09.359814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f24aa-4e1f-4ad1-9195-1f6484d6fb23 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:09.366487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-907f24aa-4e1f-4ad1-9195-1f6484d6fb23 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:09.403646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83c2d0-350f-4369-872b-07365ae374bf admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:09.500415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907f24aa-4e1f-4ad1-9195-1f6484d6fb23 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:09.512607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327acc4-247d-4837-b9c4-bf7b41641f6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:09.512607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327acc4-247d-4837-b9c4-bf7b41641f6d service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:09.512607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327acc4-247d-4837-b9c4-bf7b41641f6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:09.512607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327acc4-247d-4837-b9c4-bf7b41641f6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:09.513738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e327acc4-247d-4837-b9c4-bf7b41641f6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:09.514581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261723f-c579-4106-9b9d-66dc6e124513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:09.526800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261723f-c579-4106-9b9d-66dc6e124513 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:09.528147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261723f-c579-4106-9b9d-66dc6e124513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:09.529169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261723f-c579-4106-9b9d-66dc6e124513 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:09.529903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261723f-c579-4106-9b9d-66dc6e124513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:09.532000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261723f-c579-4106-9b9d-66dc6e124513 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:09.636335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327acc4-247d-4837-b9c4-bf7b41641f6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:09.639090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327acc4-247d-4837-b9c4-bf7b41641f6d service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:09.649237 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3654/7218] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:43:09.650009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327acc4-247d-4837-b9c4-bf7b41641f6d service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:09.651621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e327acc4-247d-4837-b9c4-bf7b41641f6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:09.707806 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3565/7219] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:43:09 2022] POST /identity/v3/projects => generated 395 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:09.712034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261723f-c579-4106-9b9d-66dc6e124513 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:09.719471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7261723f-c579-4106-9b9d-66dc6e124513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:09.775637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327acc4-247d-4837-b9c4-bf7b41641f6d service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:09.847203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261723f-c579-4106-9b9d-66dc6e124513 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:09.879186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0958cd3-678d-4a30-bd56-d54722ca1600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:09.880680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0958cd3-678d-4a30-bd56-d54722ca1600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:09.880680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0958cd3-678d-4a30-bd56-d54722ca1600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:09.880680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0958cd3-678d-4a30-bd56-d54722ca1600 admin admin] PATH_INFO: `/v3/users/f75da8a9c09645d19e3f09c52d0226c2` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:09.882672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0958cd3-678d-4a30-bd56-d54722ca1600 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f75da8a9c09645d19e3f09c52d0226c2)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:09.887480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0958cd3-678d-4a30-bd56-d54722ca1600 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:09.937467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bfb51-5b5a-4da5-9415-be4b7522fd99 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:09.938654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bfb51-5b5a-4da5-9415-be4b7522fd99 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:09.938952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bfb51-5b5a-4da5-9415-be4b7522fd99 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:09.939269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bfb51-5b5a-4da5-9415-be4b7522fd99 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains/e3a57d1a33f84b33a09a31c01c7221f1` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:09.984786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bfb51-5b5a-4da5-9415-be4b7522fd99 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e3a57d1a33f84b33a09a31c01c7221f1)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:09.987376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bfb51-5b5a-4da5-9415-be4b7522fd99 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:10.073068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-848bfb51-5b5a-4da5-9415-be4b7522fd99 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e3a57d1a33f84b33a09a31c01c7221f1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:10.078611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b0958cd3-678d-4a30-bd56-d54722ca1600 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f75da8a9c09645d19e3f09c52d0226c2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:10.102848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-848bfb51-5b5a-4da5-9415-be4b7522fd99 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e3a57d1a33f84b33a09a31c01c7221f1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:10.143725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b0958cd3-678d-4a30-bd56-d54722ca1600 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f75da8a9c09645d19e3f09c52d0226c2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:10.145244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b0958cd3-678d-4a30-bd56-d54722ca1600 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f75da8a9c09645d19e3f09c52d0226c2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:10.150820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b0958cd3-678d-4a30-bd56-d54722ca1600 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f75da8a9c09645d19e3f09c52d0226c2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:10.181177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b0958cd3-678d-4a30-bd56-d54722ca1600 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f75da8a9c09645d19e3f09c52d0226c2'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:10.248720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-848bfb51-5b5a-4da5-9415-be4b7522fd99 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3a57d1a33f84b33a09a31c01c7221f1', 'request_id': 'req-848bfb51-5b5a-4da5-9415-be4b7522fd99'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:10.254942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-848bfb51-5b5a-4da5-9415-be4b7522fd99 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3a57d1a33f84b33a09a31c01c7221f1', 'request_id': 'req-848bfb51-5b5a-4da5-9415-be4b7522fd99'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:10.263688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-848bfb51-5b5a-4da5-9415-be4b7522fd99 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3a57d1a33f84b33a09a31c01c7221f1', 'request_id': 'req-848bfb51-5b5a-4da5-9415-be4b7522fd99'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:10.264984 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3566/7220] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:09 2022] DELETE /identity/v3/users/f75da8a9c09645d19e3f09c52d0226c2 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:10.268292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0958cd3-678d-4a30-bd56-d54722ca1600 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:10.284278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b0958cd3-678d-4a30-bd56-d54722ca1600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:10.342006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-848bfb51-5b5a-4da5-9415-be4b7522fd99 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] The token cache is being invalidate because project e3a57d1a33f84b33a09a31c01c7221f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:10.342626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-848bfb51-5b5a-4da5-9415-be4b7522fd99 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:10.343746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-848bfb51-5b5a-4da5-9415-be4b7522fd99 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:10.366133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-848bfb51-5b5a-4da5-9415-be4b7522fd99 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e3a57d1a33f84b33a09a31c01c7221f1', 'request_id': 'req-848bfb51-5b5a-4da5-9415-be4b7522fd99'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:10.367301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-848bfb51-5b5a-4da5-9415-be4b7522fd99 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e3a57d1a33f84b33a09a31c01c7221f1', 'request_id': 'req-848bfb51-5b5a-4da5-9415-be4b7522fd99'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:10.368188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-848bfb51-5b5a-4da5-9415-be4b7522fd99 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e3a57d1a33f84b33a09a31c01c7221f1', 'request_id': 'req-848bfb51-5b5a-4da5-9415-be4b7522fd99'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:10.383392 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3655/7221] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:43:09 2022] DELETE /identity/v3/domains/e3a57d1a33f84b33a09a31c01c7221f1 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:10.386130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4953a-ce31-474d-adb9-29b6f3b5839c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:10.390288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4953a-ce31-474d-adb9-29b6f3b5839c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:10.390288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4953a-ce31-474d-adb9-29b6f3b5839c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:10.425807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ebf4953a-ce31-474d-adb9-29b6f3b5839c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:10.427198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ebf4953a-ce31-474d-adb9-29b6f3b5839c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:10.442244 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3656/7222] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:10.442244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4953a-ce31-474d-adb9-29b6f3b5839c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:10.443837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0958cd3-678d-4a30-bd56-d54722ca1600 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:10.445708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ebf4953a-ce31-474d-adb9-29b6f3b5839c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:10.456125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e18c0a-8b4d-4f19-a6e0-1ea9ad6939f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:10.456926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e18c0a-8b4d-4f19-a6e0-1ea9ad6939f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:10.457341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e18c0a-8b4d-4f19-a6e0-1ea9ad6939f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:10.458580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e18c0a-8b4d-4f19-a6e0-1ea9ad6939f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:10.459452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e18c0a-8b4d-4f19-a6e0-1ea9ad6939f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:10.462494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e18c0a-8b4d-4f19-a6e0-1ea9ad6939f1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:10.582385 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3567/7223] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:43:10 2022] POST /identity/v3/users => generated 298 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:10.583385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4953a-ce31-474d-adb9-29b6f3b5839c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:10.585566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e18c0a-8b4d-4f19-a6e0-1ea9ad6939f1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:10.587017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a0e18c0a-8b4d-4f19-a6e0-1ea9ad6939f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:10.590253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54335311-f060-4c88-bf9a-3a77ae3b40ab tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:10.591658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54335311-f060-4c88-bf9a-3a77ae3b40ab tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:10.592320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54335311-f060-4c88-bf9a-3a77ae3b40ab tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:10.592856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54335311-f060-4c88-bf9a-3a77ae3b40ab tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains/6681c071645f46abaca79f3d06b328cb/users/55274a5f086940f09926f66bc4a3b24a/roles/5532cc4d7d8b484aab1dfb330361e3f0` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:10.598484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54335311-f060-4c88-bf9a-3a77ae3b40ab tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=6681c071645f46abaca79f3d06b328cb, user_id=55274a5f086940f09926f66bc4a3b24a, role_id=5532cc4d7d8b484aab1dfb330361e3f0)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:10.602692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54335311-f060-4c88-bf9a-3a77ae3b40ab tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:10.610644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-54335311-f060-4c88-bf9a-3a77ae3b40ab tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invalidating the token cache because role 5532cc4d7d8b484aab1dfb330361e3f0 was removed from user 55274a5f086940f09926f66bc4a3b24a on domain 6681c071645f46abaca79f3d06b328cb. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:10.611325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-54335311-f060-4c88-bf9a-3a77ae3b40ab tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:10.612439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-54335311-f060-4c88-bf9a-3a77ae3b40ab tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:10.674860 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3657/7224] 10.222.0.43 () {58 vars in 1463 bytes} [Tue Jul 19 14:43:10 2022] DELETE /identity/v3/domains/6681c071645f46abaca79f3d06b328cb/users/55274a5f086940f09926f66bc4a3b24a/roles/5532cc4d7d8b484aab1dfb330361e3f0 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:10.676097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54335311-f060-4c88-bf9a-3a77ae3b40ab tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:10.678091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-54335311-f060-4c88-bf9a-3a77ae3b40ab tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:10.711016 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:10.742689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e18c0a-8b4d-4f19-a6e0-1ea9ad6939f1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:10.808146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54335311-f060-4c88-bf9a-3a77ae3b40ab tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:10.820827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1d756-e066-4323-bb7a-e084cd018872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:10.821675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b70cd8-b7f1-4292-8338-dcac048bb7e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:10.821836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1d756-e066-4323-bb7a-e084cd018872 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:10.822609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1d756-e066-4323-bb7a-e084cd018872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:10.822742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b70cd8-b7f1-4292-8338-dcac048bb7e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:10.822938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b70cd8-b7f1-4292-8338-dcac048bb7e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:10.823233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1d756-e066-4323-bb7a-e084cd018872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:10.823359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b70cd8-b7f1-4292-8338-dcac048bb7e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:10.824920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1d756-e066-4323-bb7a-e084cd018872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:10.825888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-57b70cd8-b7f1-4292-8338-dcac048bb7e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:10.831792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a1d756-e066-4323-bb7a-e084cd018872 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:10.840395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b70cd8-b7f1-4292-8338-dcac048bb7e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:10.841960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b70cd8-b7f1-4292-8338-dcac048bb7e3 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:10.861048 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3658/7225] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:10 2022] GET /identity/v3/roles => generated 1650 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:10.861277 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3568/7226] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:43:10.861368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1d756-e066-4323-bb7a-e084cd018872 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:10.862140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b70cd8-b7f1-4292-8338-dcac048bb7e3 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:10.866679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-69a1d756-e066-4323-bb7a-e084cd018872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:10.874089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b70cd8-b7f1-4292-8338-dcac048bb7e3 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:10.879789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06134f81-8100-447d-8382-6ec313b157f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:10.880678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06134f81-8100-447d-8382-6ec313b157f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:10.881186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06134f81-8100-447d-8382-6ec313b157f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:10.881615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06134f81-8100-447d-8382-6ec313b157f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:10.882819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06134f81-8100-447d-8382-6ec313b157f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:10.885623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06134f81-8100-447d-8382-6ec313b157f6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:10.903426 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3569/7227] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:10 2022] GET /identity/v3/roles => generated 1650 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:10.904636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06134f81-8100-447d-8382-6ec313b157f6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:10.918224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06134f81-8100-447d-8382-6ec313b157f6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:10.925728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52814071-9ae2-4f4f-9c73-ff6d2d55758f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:10.926850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52814071-9ae2-4f4f-9c73-ff6d2d55758f admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:10.927143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52814071-9ae2-4f4f-9c73-ff6d2d55758f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:10.927736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52814071-9ae2-4f4f-9c73-ff6d2d55758f admin admin] PATH_INFO: `/v3/projects/00211e7217264ff28c401766ae88bcf4/users/b646b41e6d2d43b59ba6a7dc98054de8/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:10.950363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52814071-9ae2-4f4f-9c73-ff6d2d55758f admin admin] RBAC: Authorizing `identity:create_grant(project_id=00211e7217264ff28c401766ae88bcf4, user_id=b646b41e6d2d43b59ba6a7dc98054de8, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:10.953235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52814071-9ae2-4f4f-9c73-ff6d2d55758f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:10.996268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a1d756-e066-4323-bb7a-e084cd018872 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:11.002677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fed3e-4626-466b-90e3-d69727701268 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:11.003620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fed3e-4626-466b-90e3-d69727701268 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:11.003979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fed3e-4626-466b-90e3-d69727701268 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:11.004644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fed3e-4626-466b-90e3-d69727701268 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/roles/5532cc4d7d8b484aab1dfb330361e3f0` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:11.007222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fed3e-4626-466b-90e3-d69727701268 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5532cc4d7d8b484aab1dfb330361e3f0)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:11.010292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fed3e-4626-466b-90e3-d69727701268 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:11.020662 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3570/7228] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:10 2022] PUT /identity/v3/projects/00211e7217264ff28c401766ae88bcf4/users/b646b41e6d2d43b59ba6a7dc98054de8/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:43:11.031716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e157c13-6c9c-4d1c-b596-88178801a2ec None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:11.032021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e157c13-6c9c-4d1c-b596-88178801a2ec None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:11.032300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e157c13-6c9c-4d1c-b596-88178801a2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:11.082343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7e157c13-6c9c-4d1c-b596-88178801a2ec None None] MFA Rules not processed for user `b646b41e6d2d43b59ba6a7dc98054de8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:11.083565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7e157c13-6c9c-4d1c-b596-88178801a2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:11.101295 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:11.144132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b69fed3e-4626-466b-90e3-d69727701268 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invalidating the token cache because role 5532cc4d7d8b484aab1dfb330361e3f0 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:11.144951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b69fed3e-4626-466b-90e3-d69727701268 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:11.146570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b69fed3e-4626-466b-90e3-d69727701268 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:11.154924 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3659/7229] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:10 2022] DELETE /identity/v3/roles/5532cc4d7d8b484aab1dfb330361e3f0 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:11.156296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fed3e-4626-466b-90e3-d69727701268 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:11.161183 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b69fed3e-4626-466b-90e3-d69727701268 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:11.187844 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3571/7230] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:43:11.196710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e157c13-6c9c-4d1c-b596-88178801a2ec None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:11.199727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7e157c13-6c9c-4d1c-b596-88178801a2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:11.304957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fed3e-4626-466b-90e3-d69727701268 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:11.310444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c4d75-eeae-43a9-91fe-5d586872bd95 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:11.311344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c4d75-eeae-43a9-91fe-5d586872bd95 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:11.311638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c4d75-eeae-43a9-91fe-5d586872bd95 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:11.311922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434c4d75-eeae-43a9-91fe-5d586872bd95 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains/6681c071645f46abaca79f3d06b328cb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:11.313361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c4d75-eeae-43a9-91fe-5d586872bd95 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6681c071645f46abaca79f3d06b328cb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:11.315826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434c4d75-eeae-43a9-91fe-5d586872bd95 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:11.316109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e157c13-6c9c-4d1c-b596-88178801a2ec None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:11.340189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-434c4d75-eeae-43a9-91fe-5d586872bd95 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6681c071645f46abaca79f3d06b328cb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:11.340966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-434c4d75-eeae-43a9-91fe-5d586872bd95 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6681c071645f46abaca79f3d06b328cb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:11.459432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388771e4-71bc-4f1f-b5bb-f2036d38f741 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:11.460208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388771e4-71bc-4f1f-b5bb-f2036d38f741 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:11.460499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388771e4-71bc-4f1f-b5bb-f2036d38f741 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:11.460783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388771e4-71bc-4f1f-b5bb-f2036d38f741 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:11.471104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-388771e4-71bc-4f1f-b5bb-f2036d38f741 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:11.478928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-434c4d75-eeae-43a9-91fe-5d586872bd95 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6681c071645f46abaca79f3d06b328cb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:11.480010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-434c4d75-eeae-43a9-91fe-5d586872bd95 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6681c071645f46abaca79f3d06b328cb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:11.489939 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3660/7231] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:43:11 2022] PATCH /identity/v3/domains/6681c071645f46abaca79f3d06b328cb => generated 276 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:43:11.491364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c4d75-eeae-43a9-91fe-5d586872bd95 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:11.493100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-434c4d75-eeae-43a9-91fe-5d586872bd95 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:11.612027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388771e4-71bc-4f1f-b5bb-f2036d38f741 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:11.615332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388771e4-71bc-4f1f-b5bb-f2036d38f741 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:11.628647 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3572/7232] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:43:11.665380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434c4d75-eeae-43a9-91fe-5d586872bd95 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:11.702917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86418312-21eb-467c-b6b6-9bb1761057f7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:11.707178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86418312-21eb-467c-b6b6-9bb1761057f7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:11.708449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86418312-21eb-467c-b6b6-9bb1761057f7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:11.708902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86418312-21eb-467c-b6b6-9bb1761057f7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains/6681c071645f46abaca79f3d06b328cb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:11.744303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86418312-21eb-467c-b6b6-9bb1761057f7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6681c071645f46abaca79f3d06b328cb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:11.745981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86418312-21eb-467c-b6b6-9bb1761057f7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:11.785817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-86418312-21eb-467c-b6b6-9bb1761057f7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6681c071645f46abaca79f3d06b328cb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:11.810891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-86418312-21eb-467c-b6b6-9bb1761057f7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6681c071645f46abaca79f3d06b328cb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:11.956908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-86418312-21eb-467c-b6b6-9bb1761057f7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6681c071645f46abaca79f3d06b328cb', 'request_id': 'req-86418312-21eb-467c-b6b6-9bb1761057f7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:11.968372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-86418312-21eb-467c-b6b6-9bb1761057f7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6681c071645f46abaca79f3d06b328cb', 'request_id': 'req-86418312-21eb-467c-b6b6-9bb1761057f7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:11.980972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-86418312-21eb-467c-b6b6-9bb1761057f7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6681c071645f46abaca79f3d06b328cb', 'request_id': 'req-86418312-21eb-467c-b6b6-9bb1761057f7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:12.082037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-86418312-21eb-467c-b6b6-9bb1761057f7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] The token cache is being invalidate because project 6681c071645f46abaca79f3d06b328cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:12.086683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-86418312-21eb-467c-b6b6-9bb1761057f7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:12.090033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-86418312-21eb-467c-b6b6-9bb1761057f7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:12.128063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-86418312-21eb-467c-b6b6-9bb1761057f7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6681c071645f46abaca79f3d06b328cb', 'request_id': 'req-86418312-21eb-467c-b6b6-9bb1761057f7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:12.128999 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-86418312-21eb-467c-b6b6-9bb1761057f7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6681c071645f46abaca79f3d06b328cb', 'request_id': 'req-86418312-21eb-467c-b6b6-9bb1761057f7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:12.129715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-86418312-21eb-467c-b6b6-9bb1761057f7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6681c071645f46abaca79f3d06b328cb', 'request_id': 'req-86418312-21eb-467c-b6b6-9bb1761057f7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:12.141423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388771e4-71bc-4f1f-b5bb-f2036d38f741 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:12.143674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-388771e4-71bc-4f1f-b5bb-f2036d38f741 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:12.175548 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3661/7233] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:43:11 2022] DELETE /identity/v3/domains/6681c071645f46abaca79f3d06b328cb => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:12.183328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86418312-21eb-467c-b6b6-9bb1761057f7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:12.199085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-86418312-21eb-467c-b6b6-9bb1761057f7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:12.335013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388771e4-71bc-4f1f-b5bb-f2036d38f741 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:12.357887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86418312-21eb-467c-b6b6-9bb1761057f7 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:12.368925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c0488-c4f0-4806-9138-507873185439 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:12.369639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c0488-c4f0-4806-9138-507873185439 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:12.369933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c0488-c4f0-4806-9138-507873185439 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:12.370291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c0488-c4f0-4806-9138-507873185439 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:12.371058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c0488-c4f0-4806-9138-507873185439 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:12.372758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c0488-c4f0-4806-9138-507873185439 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:12.410463 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3662/7234] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:12.414220 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:12.415669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c0488-c4f0-4806-9138-507873185439 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:12.432342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c0488-c4f0-4806-9138-507873185439 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:12.459054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f6c25-a633-4b1b-9dd0-f1b69a7be900 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:12.465724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f6c25-a633-4b1b-9dd0-f1b69a7be900 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:12.466583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f6c25-a633-4b1b-9dd0-f1b69a7be900 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:12.466583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8f6c25-a633-4b1b-9dd0-f1b69a7be900 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/projects/2432cb9dbdaa4b69ae7dcc43e3e0d839/users/f0521fc742394d22a38d6e089be14371/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:12.476605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f6c25-a633-4b1b-9dd0-f1b69a7be900 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2432cb9dbdaa4b69ae7dcc43e3e0d839, user_id=f0521fc742394d22a38d6e089be14371, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:12.479647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8f6c25-a633-4b1b-9dd0-f1b69a7be900 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:12.485278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d7cf8-5fcb-44ab-961e-1282d489cd39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:12.486319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d7cf8-5fcb-44ab-961e-1282d489cd39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:12.486707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d7cf8-5fcb-44ab-961e-1282d489cd39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:12.486954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d7cf8-5fcb-44ab-961e-1282d489cd39 admin admin] PATH_INFO: `/v3/projects/885e04c87f9449ea8766ad400ebe80a8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:12.489501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d7cf8-5fcb-44ab-961e-1282d489cd39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=885e04c87f9449ea8766ad400ebe80a8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:12.491809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d7cf8-5fcb-44ab-961e-1282d489cd39 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:12.568621 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3663/7235] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:12 2022] PUT /identity/v3/projects/2432cb9dbdaa4b69ae7dcc43e3e0d839/users/f0521fc742394d22a38d6e089be14371/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:12.577615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f6c25-a633-4b1b-9dd0-f1b69a7be900 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:12.674506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c82d7cf8-5fcb-44ab-961e-1282d489cd39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '885e04c87f9449ea8766ad400ebe80a8', 'request_id': 'req-c82d7cf8-5fcb-44ab-961e-1282d489cd39'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:12.705332 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:12.762374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c82d7cf8-5fcb-44ab-961e-1282d489cd39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '885e04c87f9449ea8766ad400ebe80a8', 'request_id': 'req-c82d7cf8-5fcb-44ab-961e-1282d489cd39'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:12.773256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8f6c25-a633-4b1b-9dd0-f1b69a7be900 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:12.783095 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c82d7cf8-5fcb-44ab-961e-1282d489cd39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '885e04c87f9449ea8766ad400ebe80a8', 'request_id': 'req-c82d7cf8-5fcb-44ab-961e-1282d489cd39'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:12.809699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c82d7cf8-5fcb-44ab-961e-1282d489cd39 admin admin] The token cache is being invalidate because project 885e04c87f9449ea8766ad400ebe80a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:12.809998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c82d7cf8-5fcb-44ab-961e-1282d489cd39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:12.812799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c82d7cf8-5fcb-44ab-961e-1282d489cd39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:12.822265 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3573/7236] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:12 2022] DELETE /identity/v3/projects/885e04c87f9449ea8766ad400ebe80a8 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:12.827321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f89f69-2fce-4f46-bc4e-de856671824e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:12.827622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f89f69-2fce-4f46-bc4e-de856671824e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:12.827887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f89f69-2fce-4f46-bc4e-de856671824e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:12.871959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-84f89f69-2fce-4f46-bc4e-de856671824e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:12.875356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-84f89f69-2fce-4f46-bc4e-de856671824e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:12.921697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307ffc3-3623-4cea-b527-65123cd57ac3 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:12.922750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307ffc3-3623-4cea-b527-65123cd57ac3 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:12.923240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307ffc3-3623-4cea-b527-65123cd57ac3 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:12.923712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307ffc3-3623-4cea-b527-65123cd57ac3 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:12.924532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307ffc3-3623-4cea-b527-65123cd57ac3 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:12.926279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307ffc3-3623-4cea-b527-65123cd57ac3 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:12.990184 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3664/7237] 10.222.0.43 () {58 vars in 1145 bytes} [Tue Jul 19 14:43:12 2022] GET /identity/v3/auth/projects => generated 826 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:12.994229 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307ffc3-3623-4cea-b527-65123cd57ac3 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:12.998366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3307ffc3-3623-4cea-b527-65123cd57ac3 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:13.027699 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3574/7238] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:43:13.029507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13258339-503d-4131-bd9c-775ed8cfb837 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:13.029806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13258339-503d-4131-bd9c-775ed8cfb837 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:13.030152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13258339-503d-4131-bd9c-775ed8cfb837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:13.032633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307ffc3-3623-4cea-b527-65123cd57ac3 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:13.042779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0ea70-d356-4a4b-b31c-c7f29a189882 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:13.042779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0ea70-d356-4a4b-b31c-c7f29a189882 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:13.042779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0ea70-d356-4a4b-b31c-c7f29a189882 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:13.043144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c0ea70-d356-4a4b-b31c-c7f29a189882 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/projects/2432cb9dbdaa4b69ae7dcc43e3e0d839/users/f0521fc742394d22a38d6e089be14371/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:13.045597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0ea70-d356-4a4b-b31c-c7f29a189882 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=2432cb9dbdaa4b69ae7dcc43e3e0d839, user_id=f0521fc742394d22a38d6e089be14371, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:13.052114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c0ea70-d356-4a4b-b31c-c7f29a189882 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:13.065580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-84c0ea70-d356-4a4b-b31c-c7f29a189882 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invalidating the token cache because role bc315edf089d43b18acf9790031f3fcb was removed from user f0521fc742394d22a38d6e089be14371 on project 2432cb9dbdaa4b69ae7dcc43e3e0d839. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:13.065809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-13258339-503d-4131-bd9c-775ed8cfb837 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:13.066478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-84c0ea70-d356-4a4b-b31c-c7f29a189882 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:13.070632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-84c0ea70-d356-4a4b-b31c-c7f29a189882 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:13.070800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-13258339-503d-4131-bd9c-775ed8cfb837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:13.095987 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:13.095987 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3575/7239] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:43:13.097611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13258339-503d-4131-bd9c-775ed8cfb837 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:13.116181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13258339-503d-4131-bd9c-775ed8cfb837 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:13.132644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761df5f-2e59-4dff-87a7-015c5046541d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:13.133338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761df5f-2e59-4dff-87a7-015c5046541d admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:13.133643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761df5f-2e59-4dff-87a7-015c5046541d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:13.133907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b761df5f-2e59-4dff-87a7-015c5046541d admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:13.135145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761df5f-2e59-4dff-87a7-015c5046541d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:43:13.135449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761df5f-2e59-4dff-87a7-015c5046541d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:13.139439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b761df5f-2e59-4dff-87a7-015c5046541d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:13.140966 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3665/7240] 10.222.0.43 () {58 vars in 1466 bytes} [Tue Jul 19 14:43:12 2022] DELETE /identity/v3/projects/2432cb9dbdaa4b69ae7dcc43e3e0d839/users/f0521fc742394d22a38d6e089be14371/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:13.148406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0ea70-d356-4a4b-b31c-c7f29a189882 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:13.150878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-84c0ea70-d356-4a4b-b31c-c7f29a189882 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:13.173066 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3576/7241] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:43:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:43:13.177359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761df5f-2e59-4dff-87a7-015c5046541d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:13.194617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b761df5f-2e59-4dff-87a7-015c5046541d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:13.362138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3280d0-5b18-4646-9f0b-34048f754d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:13.362851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3280d0-5b18-4646-9f0b-34048f754d63 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:13.363206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3280d0-5b18-4646-9f0b-34048f754d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:13.363476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3280d0-5b18-4646-9f0b-34048f754d63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:13.364290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3280d0-5b18-4646-9f0b-34048f754d63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:13.369588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3280d0-5b18-4646-9f0b-34048f754d63 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:13.372134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c0ea70-d356-4a4b-b31c-c7f29a189882 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:13.381058 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:13.391494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1438f2f-d800-433f-a63e-26e3fdcaa159 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:13.393876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1438f2f-d800-433f-a63e-26e3fdcaa159 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:13.397493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1438f2f-d800-433f-a63e-26e3fdcaa159 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:13.397840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1438f2f-d800-433f-a63e-26e3fdcaa159 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:13.398693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1438f2f-d800-433f-a63e-26e3fdcaa159 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:13.405412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1438f2f-d800-433f-a63e-26e3fdcaa159 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:13.517198 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3666/7242] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:43:13 2022] POST /identity/v3/users => generated 321 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:13.517660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1438f2f-d800-433f-a63e-26e3fdcaa159 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:13.522047 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3577/7243] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:43:13 2022] POST /identity/v3/projects => generated 375 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:13.525898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3280d0-5b18-4646-9f0b-34048f754d63 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:13.550959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1438f2f-d800-433f-a63e-26e3fdcaa159 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:13.714052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3280d0-5b18-4646-9f0b-34048f754d63 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:13.721632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68a6df-c4af-4fb7-93b6-17e31b74fc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:13.731846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68a6df-c4af-4fb7-93b6-17e31b74fc0a admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:13.731846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68a6df-c4af-4fb7-93b6-17e31b74fc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:13.731846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68a6df-c4af-4fb7-93b6-17e31b74fc0a admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:13.731846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68a6df-c4af-4fb7-93b6-17e31b74fc0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:13.731846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68a6df-c4af-4fb7-93b6-17e31b74fc0a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:13.735455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcc72e-9e02-460b-9ed9-4e4e95dd6d34 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:13.736729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcc72e-9e02-460b-9ed9-4e4e95dd6d34 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:13.737141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcc72e-9e02-460b-9ed9-4e4e95dd6d34 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:13.737397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dcc72e-9e02-460b-9ed9-4e4e95dd6d34 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:13.738130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcc72e-9e02-460b-9ed9-4e4e95dd6d34 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:13.740199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dcc72e-9e02-460b-9ed9-4e4e95dd6d34 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:13.788653 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:13.860272 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3578/7244] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:43:13 2022] POST /identity/v3/users => generated 288 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:13.862524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68a6df-c4af-4fb7-93b6-17e31b74fc0a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:13.895853 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:13.906388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68a6df-c4af-4fb7-93b6-17e31b74fc0a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:13.920744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5ae87-2bbc-4dba-8456-9fabca3edd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:13.920988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5ae87-2bbc-4dba-8456-9fabca3edd61 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:13.921298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5ae87-2bbc-4dba-8456-9fabca3edd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:13.921577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5ae87-2bbc-4dba-8456-9fabca3edd61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:13.922482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5ae87-2bbc-4dba-8456-9fabca3edd61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:13.922916 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3667/7245] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:43:13 2022] POST /identity/v3/projects => generated 364 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:13.924374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5ae87-2bbc-4dba-8456-9fabca3edd61 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:13.940111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcc72e-9e02-460b-9ed9-4e4e95dd6d34 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:13.966948 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3579/7246] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:13.967911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5ae87-2bbc-4dba-8456-9fabca3edd61 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:13.993469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5ae87-2bbc-4dba-8456-9fabca3edd61 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:14.100279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dcc72e-9e02-460b-9ed9-4e4e95dd6d34 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:14.119096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b80d6-920a-41c1-9277-0b6beaef541c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:14.130317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b80d6-920a-41c1-9277-0b6beaef541c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:14.130317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b80d6-920a-41c1-9277-0b6beaef541c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:14.130317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b80d6-920a-41c1-9277-0b6beaef541c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:14.134222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b80d6-920a-41c1-9277-0b6beaef541c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:14.142879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b80d6-920a-41c1-9277-0b6beaef541c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:14.151223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cb9e9-5629-432a-af24-7bf33a68d6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:14.152184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cb9e9-5629-432a-af24-7bf33a68d6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:14.152912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cb9e9-5629-432a-af24-7bf33a68d6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:14.153360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66cb9e9-5629-432a-af24-7bf33a68d6b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:14.154572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cb9e9-5629-432a-af24-7bf33a68d6b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:14.158952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66cb9e9-5629-432a-af24-7bf33a68d6b8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:14.184562 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3580/7247] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:14.186301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cb9e9-5629-432a-af24-7bf33a68d6b8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:14.204720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66cb9e9-5629-432a-af24-7bf33a68d6b8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:14.211427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9630cc5e-e566-43e8-b2b1-8a19efddbde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:14.213344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630cc5e-e566-43e8-b2b1-8a19efddbde3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:14.216375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630cc5e-e566-43e8-b2b1-8a19efddbde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:14.216375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9630cc5e-e566-43e8-b2b1-8a19efddbde3 admin admin] PATH_INFO: `/v3/projects/a5b5556d0d2341189f5387b4002e4bc6/users/85dd871eed8748a4b8653b2733d512fb/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:14.235592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630cc5e-e566-43e8-b2b1-8a19efddbde3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b5556d0d2341189f5387b4002e4bc6, user_id=85dd871eed8748a4b8653b2733d512fb, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:14.239835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9630cc5e-e566-43e8-b2b1-8a19efddbde3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:14.314449 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3668/7248] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:43:13 2022] POST /identity/v3/projects => generated 362 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:14.315513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b80d6-920a-41c1-9277-0b6beaef541c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:14.375556 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3581/7249] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:14 2022] PUT /identity/v3/projects/a5b5556d0d2341189f5387b4002e4bc6/users/85dd871eed8748a4b8653b2733d512fb/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:14.387402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c990ef9-ab2e-4e94-a80d-96541f610e3c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:14.388010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c990ef9-ab2e-4e94-a80d-96541f610e3c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:14.388356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c990ef9-ab2e-4e94-a80d-96541f610e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:14.458426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3c990ef9-ab2e-4e94-a80d-96541f610e3c None None] MFA Rules not processed for user `85dd871eed8748a4b8653b2733d512fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:14.459778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3c990ef9-ab2e-4e94-a80d-96541f610e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:14.537658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b80d6-920a-41c1-9277-0b6beaef541c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:14.634693 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3582/7250] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:43:14.651934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b5a67-e80d-4464-96d1-a227fbc3cdf4 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:14.652748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b5a67-e80d-4464-96d1-a227fbc3cdf4 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:14.653057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b5a67-e80d-4464-96d1-a227fbc3cdf4 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:14.653282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b5a67-e80d-4464-96d1-a227fbc3cdf4 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:14.654037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b5a67-e80d-4464-96d1-a227fbc3cdf4 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:14.659235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b5a67-e80d-4464-96d1-a227fbc3cdf4 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:14.660738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c990ef9-ab2e-4e94-a80d-96541f610e3c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:14.662604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3c990ef9-ab2e-4e94-a80d-96541f610e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:14.763543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c990ef9-ab2e-4e94-a80d-96541f610e3c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:14.769125 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3669/7251] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:43:14 2022] POST /identity/v3/roles => generated 240 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:14.770050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b5a67-e80d-4464-96d1-a227fbc3cdf4 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:14.771646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634e04e-60ab-4c2d-bc24-3190d08800a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:14.772599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634e04e-60ab-4c2d-bc24-3190d08800a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:14.773149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634e04e-60ab-4c2d-bc24-3190d08800a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:14.773654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634e04e-60ab-4c2d-bc24-3190d08800a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:14.788237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b5a67-e80d-4464-96d1-a227fbc3cdf4 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:14.799362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634e04e-60ab-4c2d-bc24-3190d08800a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:14.807373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634e04e-60ab-4c2d-bc24-3190d08800a8 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:14.809100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fe731-9473-47cb-aad9-f75d936ad554 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:14.809100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fe731-9473-47cb-aad9-f75d936ad554 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:14.809542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fe731-9473-47cb-aad9-f75d936ad554 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:14.809542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533fe731-9473-47cb-aad9-f75d936ad554 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/projects/a67a2e8ffd3547be8d9868b9ee4a5e25/users/3f5e5b9be79c4af0899a88878fb76673/roles/af8722cce5064e2bb9783b84307591b2` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:14.855020 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:14.859613 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3583/7252] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:43:14.870263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fe731-9473-47cb-aad9-f75d936ad554 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a67a2e8ffd3547be8d9868b9ee4a5e25, user_id=3f5e5b9be79c4af0899a88878fb76673, role_id=af8722cce5064e2bb9783b84307591b2)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:14.870263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533fe731-9473-47cb-aad9-f75d936ad554 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:14.883740 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:14.888887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634e04e-60ab-4c2d-bc24-3190d08800a8 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:14.940824 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3670/7253] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:14 2022] PUT /identity/v3/projects/a67a2e8ffd3547be8d9868b9ee4a5e25/users/3f5e5b9be79c4af0899a88878fb76673/roles/af8722cce5064e2bb9783b84307591b2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:14.945242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fe731-9473-47cb-aad9-f75d936ad554 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:15.119511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533fe731-9473-47cb-aad9-f75d936ad554 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:15.133031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634e04e-60ab-4c2d-bc24-3190d08800a8 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:15.135527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b276c-ef53-43b2-8804-a144cb29717e tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:15.136509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b276c-ef53-43b2-8804-a144cb29717e tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:15.136838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b276c-ef53-43b2-8804-a144cb29717e tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:15.137285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b276c-ef53-43b2-8804-a144cb29717e tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/projects/5b960cfaf976409ebfc8b8a7c5debb43/users/3f5e5b9be79c4af0899a88878fb76673/roles/af8722cce5064e2bb9783b84307591b2` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:15.146335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b276c-ef53-43b2-8804-a144cb29717e tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5b960cfaf976409ebfc8b8a7c5debb43, user_id=3f5e5b9be79c4af0899a88878fb76673, role_id=af8722cce5064e2bb9783b84307591b2)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:15.154400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b276c-ef53-43b2-8804-a144cb29717e tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:15.255629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56794b7-99c7-4489-80d3-ac02efc73fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:15.256654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56794b7-99c7-4489-80d3-ac02efc73fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:15.257266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56794b7-99c7-4489-80d3-ac02efc73fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:15.257564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56794b7-99c7-4489-80d3-ac02efc73fad admin admin] PATH_INFO: `/v3/users/85dd871eed8748a4b8653b2733d512fb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:15.259077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56794b7-99c7-4489-80d3-ac02efc73fad admin admin] RBAC: Authorizing `identity:delete_user(user_id=85dd871eed8748a4b8653b2733d512fb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:15.261468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56794b7-99c7-4489-80d3-ac02efc73fad admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:15.313372 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3671/7254] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:14 2022] PUT /identity/v3/projects/5b960cfaf976409ebfc8b8a7c5debb43/users/3f5e5b9be79c4af0899a88878fb76673/roles/af8722cce5064e2bb9783b84307591b2 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:15.318287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a214f-9f88-456a-b8e4-304b8e03aab8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:15.318797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a214f-9f88-456a-b8e4-304b8e03aab8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:15.319238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895a214f-9f88-456a-b8e4-304b8e03aab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:15.360287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-895a214f-9f88-456a-b8e4-304b8e03aab8 None None] MFA Rules not processed for user `3f5e5b9be79c4af0899a88878fb76673`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:15.363093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-895a214f-9f88-456a-b8e4-304b8e03aab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:15.368507 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3672/7255] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:15 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 14:43:15.373640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03743a21-9da0-4f13-a188-f069e0cd8c99 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:15.374509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03743a21-9da0-4f13-a188-f069e0cd8c99 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:15.374948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03743a21-9da0-4f13-a188-f069e0cd8c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:15.386439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-03743a21-9da0-4f13-a188-f069e0cd8c99 None None] MFA Rules not processed for user `3f5e5b9be79c4af0899a88878fb76673`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:15.387586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-03743a21-9da0-4f13-a188-f069e0cd8c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:15.485084 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3673/7256] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:15 2022] POST /identity/v3/auth/tokens => generated 3215 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Jul 19 14:43:15.486866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03743a21-9da0-4f13-a188-f069e0cd8c99 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:15.513901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a56794b7-99c7-4489-80d3-ac02efc73fad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85dd871eed8748a4b8653b2733d512fb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:15.541239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a56794b7-99c7-4489-80d3-ac02efc73fad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85dd871eed8748a4b8653b2733d512fb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:15.542948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a56794b7-99c7-4489-80d3-ac02efc73fad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85dd871eed8748a4b8653b2733d512fb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:15.545110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a56794b7-99c7-4489-80d3-ac02efc73fad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85dd871eed8748a4b8653b2733d512fb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:15.566360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a56794b7-99c7-4489-80d3-ac02efc73fad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85dd871eed8748a4b8653b2733d512fb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:15.603254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03743a21-9da0-4f13-a188-f069e0cd8c99 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:15.615848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a045d0-f1f6-496e-af5d-b087aba70828 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:15.615848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a045d0-f1f6-496e-af5d-b087aba70828 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:15.615848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a045d0-f1f6-496e-af5d-b087aba70828 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:15.616090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a045d0-f1f6-496e-af5d-b087aba70828 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:15.619350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-22a045d0-f1f6-496e-af5d-b087aba70828 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:15.650542 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3584/7257] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:14 2022] DELETE /identity/v3/users/85dd871eed8748a4b8653b2733d512fb => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:15.653878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a045d0-f1f6-496e-af5d-b087aba70828 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:15.653878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a045d0-f1f6-496e-af5d-b087aba70828 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:15.655091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db178956-4e99-4d12-a01a-be66b3b2f828 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:15.655388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db178956-4e99-4d12-a01a-be66b3b2f828 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:15.655761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db178956-4e99-4d12-a01a-be66b3b2f828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:15.702917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-db178956-4e99-4d12-a01a-be66b3b2f828 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:15.704417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-db178956-4e99-4d12-a01a-be66b3b2f828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:15.764586 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3674/7258] 10.222.0.43 () {56 vars in 1307 bytes} [Tue Jul 19 14:43:15 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:15.769594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1aeb4-e16d-4d16-88ad-79ff1cdef337 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:15.770454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1aeb4-e16d-4d16-88ad-79ff1cdef337 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:15.771418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1aeb4-e16d-4d16-88ad-79ff1cdef337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:15.793410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-18c1aeb4-e16d-4d16-88ad-79ff1cdef337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:15.811332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-18c1aeb4-e16d-4d16-88ad-79ff1cdef337 None None] MFA Rules not processed for user `3f5e5b9be79c4af0899a88878fb76673`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:15.813602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-18c1aeb4-e16d-4d16-88ad-79ff1cdef337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:15.909586 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:15.931382 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3585/7259] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:15.936996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db178956-4e99-4d12-a01a-be66b3b2f828 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:15.943929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-db178956-4e99-4d12-a01a-be66b3b2f828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:15.988947 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3675/7260] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:15 2022] POST /identity/v3/auth/tokens => generated 3214 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 406 bytes (2 switches on core 0) Jul 19 14:43:15.988947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1aeb4-e16d-4d16-88ad-79ff1cdef337 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:15.989646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-18c1aeb4-e16d-4d16-88ad-79ff1cdef337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:15.998595 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:16.125139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1aeb4-e16d-4d16-88ad-79ff1cdef337 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:16.141307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e7790-d847-421b-a4e4-ee47b9a30bf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:16.141671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e7790-d847-421b-a4e4-ee47b9a30bf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:16.142726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e7790-d847-421b-a4e4-ee47b9a30bf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:16.143742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254e7790-d847-421b-a4e4-ee47b9a30bf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:16.165277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e7790-d847-421b-a4e4-ee47b9a30bf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:16.167246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db178956-4e99-4d12-a01a-be66b3b2f828 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:16.168717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254e7790-d847-421b-a4e4-ee47b9a30bf1 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:16.178054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e37c2a-7bb7-458e-8da9-db93fa02d7f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:16.178836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e37c2a-7bb7-458e-8da9-db93fa02d7f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:16.179122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e37c2a-7bb7-458e-8da9-db93fa02d7f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:16.179567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e37c2a-7bb7-458e-8da9-db93fa02d7f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:16.182581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e3e37c2a-7bb7-458e-8da9-db93fa02d7f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:16.195381 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3676/7261] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:43:16.199272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e7790-d847-421b-a4e4-ee47b9a30bf1 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:16.203020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-254e7790-d847-421b-a4e4-ee47b9a30bf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:16.310233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e37c2a-7bb7-458e-8da9-db93fa02d7f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:16.313020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e37c2a-7bb7-458e-8da9-db93fa02d7f1 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:16.314118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254e7790-d847-421b-a4e4-ee47b9a30bf1 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:16.319398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dbff3-c7d0-4b62-a0ae-e93be6d0d68c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:16.321788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dbff3-c7d0-4b62-a0ae-e93be6d0d68c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:16.322082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dbff3-c7d0-4b62-a0ae-e93be6d0d68c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:16.322407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2dbff3-c7d0-4b62-a0ae-e93be6d0d68c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/roles/af8722cce5064e2bb9783b84307591b2` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:16.324453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2dbff3-c7d0-4b62-a0ae-e93be6d0d68c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:delete_role(role_id=af8722cce5064e2bb9783b84307591b2)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:16.326075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2dbff3-c7d0-4b62-a0ae-e93be6d0d68c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:16.329705 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3586/7262] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:43:16.579272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd2dbff3-c7d0-4b62-a0ae-e93be6d0d68c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invalidating the token cache because role af8722cce5064e2bb9783b84307591b2 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:16.582836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd2dbff3-c7d0-4b62-a0ae-e93be6d0d68c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:16.582836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd2dbff3-c7d0-4b62-a0ae-e93be6d0d68c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:16.588474 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3677/7263] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:16 2022] DELETE /identity/v3/roles/af8722cce5064e2bb9783b84307591b2 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:16.593007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e37c2a-7bb7-458e-8da9-db93fa02d7f1 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:16.609816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e37c2a-7bb7-458e-8da9-db93fa02d7f1 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:16.710416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e374cf6-9d08-424a-878a-2339718d4287 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:16.711640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e374cf6-9d08-424a-878a-2339718d4287 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:16.712308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e374cf6-9d08-424a-878a-2339718d4287 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:16.712745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e374cf6-9d08-424a-878a-2339718d4287 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/projects/5b960cfaf976409ebfc8b8a7c5debb43` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:16.714324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e374cf6-9d08-424a-878a-2339718d4287 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5b960cfaf976409ebfc8b8a7c5debb43)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:16.716835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e374cf6-9d08-424a-878a-2339718d4287 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:16.840766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5e374cf6-9d08-424a-878a-2339718d4287 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b960cfaf976409ebfc8b8a7c5debb43', 'request_id': 'req-5e374cf6-9d08-424a-878a-2339718d4287'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:16.951634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5e374cf6-9d08-424a-878a-2339718d4287 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b960cfaf976409ebfc8b8a7c5debb43', 'request_id': 'req-5e374cf6-9d08-424a-878a-2339718d4287'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:16.984586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5e374cf6-9d08-424a-878a-2339718d4287 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b960cfaf976409ebfc8b8a7c5debb43', 'request_id': 'req-5e374cf6-9d08-424a-878a-2339718d4287'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:17.042975 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:17.044799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5e374cf6-9d08-424a-878a-2339718d4287 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] The token cache is being invalidate because project 5b960cfaf976409ebfc8b8a7c5debb43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:17.045787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5e374cf6-9d08-424a-878a-2339718d4287 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:17.046715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5e374cf6-9d08-424a-878a-2339718d4287 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:17.049068 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3587/7264] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:16 2022] DELETE /identity/v3/projects/5b960cfaf976409ebfc8b8a7c5debb43 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:17.053817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dbff3-c7d0-4b62-a0ae-e93be6d0d68c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:17.056639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dd2dbff3-c7d0-4b62-a0ae-e93be6d0d68c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:17.085707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2dbff3-c7d0-4b62-a0ae-e93be6d0d68c tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:17.180311 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:17.247765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea48d5-082f-422f-90e8-5647ffe57d7a tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:17.250256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea48d5-082f-422f-90e8-5647ffe57d7a tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:17.250256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea48d5-082f-422f-90e8-5647ffe57d7a tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:17.250256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea48d5-082f-422f-90e8-5647ffe57d7a tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/projects/5b960cfaf976409ebfc8b8a7c5debb43` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:17.275846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea48d5-082f-422f-90e8-5647ffe57d7a tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5b960cfaf976409ebfc8b8a7c5debb43)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:17.283564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea48d5-082f-422f-90e8-5647ffe57d7a tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:17.324122 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application [None req-33ea48d5-082f-422f-90e8-5647ffe57d7a tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Could not find project: 5b960cfaf976409ebfc8b8a7c5debb43.: keystone.exception.ProjectNotFound: Could not find project: 5b960cfaf976409ebfc8b8a7c5debb43. Jul 19 14:43:17.324122 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:43:17.324122 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:43:17.324122 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:43:17.324122 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:43:17.324122 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:43:17.324122 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:43:17.324122 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:43:17.324122 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:43:17.324122 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:43:17.324122 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:43:17.324122 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:43:17.324122 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 19 14:43:17.324122 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 19 14:43:17.333309 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:43:17.333309 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:43:17.333309 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 19 14:43:17.333309 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 19 14:43:17.333309 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 14:43:17.333309 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 14:43:17.333309 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 14:43:17.333309 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 14:43:17.333309 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 5b960cfaf976409ebfc8b8a7c5debb43. Jul 19 14:43:17.333309 n-d-master-1 devstack@keystone.service[80680]: ERROR keystone.server.flask.application Jul 19 14:43:17.333309 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3678/7265] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:17 2022] DELETE /identity/v3/projects/5b960cfaf976409ebfc8b8a7c5debb43 => generated 113 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:43:17.335579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e374cf6-9d08-424a-878a-2339718d4287 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:17.337555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5e374cf6-9d08-424a-878a-2339718d4287 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:17.353419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e374cf6-9d08-424a-878a-2339718d4287 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:17.366130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a3195-456d-4b2e-8988-ea56063c75eb tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:17.367536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a3195-456d-4b2e-8988-ea56063c75eb tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:17.368025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a3195-456d-4b2e-8988-ea56063c75eb tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:17.369897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a3195-456d-4b2e-8988-ea56063c75eb tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/projects/a67a2e8ffd3547be8d9868b9ee4a5e25` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:17.372015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a3195-456d-4b2e-8988-ea56063c75eb tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a67a2e8ffd3547be8d9868b9ee4a5e25)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:17.378577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3a3195-456d-4b2e-8988-ea56063c75eb tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:17.509344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1c3a3195-456d-4b2e-8988-ea56063c75eb tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a67a2e8ffd3547be8d9868b9ee4a5e25', 'request_id': 'req-1c3a3195-456d-4b2e-8988-ea56063c75eb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:17.641945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1c3a3195-456d-4b2e-8988-ea56063c75eb tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a67a2e8ffd3547be8d9868b9ee4a5e25', 'request_id': 'req-1c3a3195-456d-4b2e-8988-ea56063c75eb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:17.651084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1c3a3195-456d-4b2e-8988-ea56063c75eb tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a67a2e8ffd3547be8d9868b9ee4a5e25', 'request_id': 'req-1c3a3195-456d-4b2e-8988-ea56063c75eb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:17.674602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1c3a3195-456d-4b2e-8988-ea56063c75eb tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] The token cache is being invalidate because project a67a2e8ffd3547be8d9868b9ee4a5e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:17.675149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1c3a3195-456d-4b2e-8988-ea56063c75eb tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:17.675946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1c3a3195-456d-4b2e-8988-ea56063c75eb tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:17.678132 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3588/7266] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:17 2022] DELETE /identity/v3/projects/a67a2e8ffd3547be8d9868b9ee4a5e25 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:17.682784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea48d5-082f-422f-90e8-5647ffe57d7a tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:17.684918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-33ea48d5-082f-422f-90e8-5647ffe57d7a tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:17.699998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea48d5-082f-422f-90e8-5647ffe57d7a tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:17.823358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6846de-b470-4525-b30f-65bb7cfcb6f1 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:17.824236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6846de-b470-4525-b30f-65bb7cfcb6f1 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:17.824555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6846de-b470-4525-b30f-65bb7cfcb6f1 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:17.824829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6846de-b470-4525-b30f-65bb7cfcb6f1 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/users/3f5e5b9be79c4af0899a88878fb76673` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:17.826267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6846de-b470-4525-b30f-65bb7cfcb6f1 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3f5e5b9be79c4af0899a88878fb76673)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:17.832408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6846de-b470-4525-b30f-65bb7cfcb6f1 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:18.042460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9e6846de-b470-4525-b30f-65bb7cfcb6f1 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f5e5b9be79c4af0899a88878fb76673'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:18.108523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9e6846de-b470-4525-b30f-65bb7cfcb6f1 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f5e5b9be79c4af0899a88878fb76673'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:18.124472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9e6846de-b470-4525-b30f-65bb7cfcb6f1 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f5e5b9be79c4af0899a88878fb76673'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:18.125473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9e6846de-b470-4525-b30f-65bb7cfcb6f1 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f5e5b9be79c4af0899a88878fb76673'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:18.168323 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:18.197492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9e6846de-b470-4525-b30f-65bb7cfcb6f1 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f5e5b9be79c4af0899a88878fb76673'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:18.212341 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3679/7267] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:17 2022] DELETE /identity/v3/users/3f5e5b9be79c4af0899a88878fb76673 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:18.213334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a3195-456d-4b2e-8988-ea56063c75eb tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:18.228798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a3195-456d-4b2e-8988-ea56063c75eb tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:18.242277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6846de-b470-4525-b30f-65bb7cfcb6f1 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:18.246051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9e6846de-b470-4525-b30f-65bb7cfcb6f1 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:18.429174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca81675-1fc1-4a28-a616-8a9d589fd5ea tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:18.430786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca81675-1fc1-4a28-a616-8a9d589fd5ea tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:18.433826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca81675-1fc1-4a28-a616-8a9d589fd5ea tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:18.434959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca81675-1fc1-4a28-a616-8a9d589fd5ea tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains/29353f39990c4bdfaf36ec8c2e412388` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:18.455192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca81675-1fc1-4a28-a616-8a9d589fd5ea tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 14:43:18.472700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6846de-b470-4525-b30f-65bb7cfcb6f1 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:18.480122 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-6ca81675-1fc1-4a28-a616-8a9d589fd5ea tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Could not find domain: 29353f39990c4bdfaf36ec8c2e412388.: keystone.exception.DomainNotFound: Could not find domain: 29353f39990c4bdfaf36ec8c2e412388. Jul 19 14:43:18.480122 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:43:18.480122 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 14:43:18.480122 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 14:43:18.480122 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 14:43:18.480122 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 14:43:18.480122 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 14:43:18.480122 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 14:43:18.480122 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 29353f39990c4bdfaf36ec8c2e412388. Jul 19 14:43:18.480122 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:43:18.480122 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:43:18.480122 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:43:18.480122 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:43:18.480122 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:43:18.480122 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:43:18.480122 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:43:18.481320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:43:18.481320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:43:18.481320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:43:18.481320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:43:18.481320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:43:18.481320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:43:18.481320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:43:18.481320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 14:43:18.481320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 14:43:18.481320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 14:43:18.481320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 14:43:18.481320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 14:43:18.481320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 14:43:18.481320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:43:18.481320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:43:18.481320 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:43:18.482767 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:43:18.482767 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:43:18.482767 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:43:18.482767 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:43:18.482767 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 14:43:18.482767 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:43:18.482767 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:43:18.482767 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:43:18.482767 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:43:18.482767 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:43:18.482767 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:43:18.482767 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:43:18.482767 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:43:18.482767 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 14:43:18.482767 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 14:43:18.482767 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 29353f39990c4bdfaf36ec8c2e412388. Jul 19 14:43:18.482767 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:43:18.489571 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3589/7268] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:43:18 2022] PATCH /identity/v3/domains/29353f39990c4bdfaf36ec8c2e412388 => generated 112 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:43:18.490152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61c70a-37f8-4a91-b78b-9fa3ef6f7e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:18.492265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61c70a-37f8-4a91-b78b-9fa3ef6f7e52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:18.492395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca81675-1fc1-4a28-a616-8a9d589fd5ea tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:18.492861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61c70a-37f8-4a91-b78b-9fa3ef6f7e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:18.495491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61c70a-37f8-4a91-b78b-9fa3ef6f7e52 admin admin] PATH_INFO: `/v3/projects/a5b5556d0d2341189f5387b4002e4bc6` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:18.497962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61c70a-37f8-4a91-b78b-9fa3ef6f7e52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b5556d0d2341189f5387b4002e4bc6)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:18.502824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e61c70a-37f8-4a91-b78b-9fa3ef6f7e52 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:18.507112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6ca81675-1fc1-4a28-a616-8a9d589fd5ea tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:18.531760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca81675-1fc1-4a28-a616-8a9d589fd5ea tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:18.538683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26ff5b-ec4a-486d-a713-5f166ed70ec4 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:18.539924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26ff5b-ec4a-486d-a713-5f166ed70ec4 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:18.540453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26ff5b-ec4a-486d-a713-5f166ed70ec4 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:18.541005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26ff5b-ec4a-486d-a713-5f166ed70ec4 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains/9d483896da2041c4a3fc37740ee704d9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:18.550720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26ff5b-ec4a-486d-a713-5f166ed70ec4 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 14:43:18.552991 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:18.563678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-8d26ff5b-ec4a-486d-a713-5f166ed70ec4 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Could not find domain: 9d483896da2041c4a3fc37740ee704d9.: keystone.exception.DomainNotFound: Could not find domain: 9d483896da2041c4a3fc37740ee704d9. Jul 19 14:43:18.563678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:43:18.563678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 14:43:18.563678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 14:43:18.563678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 14:43:18.563678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 14:43:18.563678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 14:43:18.563678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 14:43:18.563678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 9d483896da2041c4a3fc37740ee704d9. Jul 19 14:43:18.563678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:43:18.563678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:43:18.563678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:43:18.563678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:43:18.563678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:43:18.563678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:43:18.563678 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:43:18.565757 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:43:18.565757 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:43:18.565757 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:43:18.565757 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:43:18.565757 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:43:18.565757 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:43:18.565757 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:43:18.565757 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 14:43:18.565757 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 14:43:18.565757 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 14:43:18.565757 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 14:43:18.565757 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 14:43:18.565757 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 14:43:18.565757 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:43:18.565757 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:43:18.565757 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:43:18.567084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:43:18.567084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:43:18.567084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:43:18.567084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:43:18.567084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 14:43:18.567084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:43:18.567084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:43:18.567084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:43:18.567084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:43:18.567084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:43:18.567084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:43:18.567084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:43:18.567084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:43:18.567084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 14:43:18.567084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 14:43:18.567084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 9d483896da2041c4a3fc37740ee704d9. Jul 19 14:43:18.567084 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:43:18.575384 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3590/7269] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:43:18 2022] PATCH /identity/v3/domains/9d483896da2041c4a3fc37740ee704d9 => generated 112 bytes in 83 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:43:18.576851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26ff5b-ec4a-486d-a713-5f166ed70ec4 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:18.589451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26ff5b-ec4a-486d-a713-5f166ed70ec4 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:18.597051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3603d3f-aff8-4afd-9c31-ae71f2a6579b tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:18.598751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3603d3f-aff8-4afd-9c31-ae71f2a6579b tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:18.598751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3603d3f-aff8-4afd-9c31-ae71f2a6579b tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:18.598751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3603d3f-aff8-4afd-9c31-ae71f2a6579b tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains/e3a57d1a33f84b33a09a31c01c7221f1` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:18.608437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3603d3f-aff8-4afd-9c31-ae71f2a6579b tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 14:43:18.619134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-b3603d3f-aff8-4afd-9c31-ae71f2a6579b tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Could not find domain: e3a57d1a33f84b33a09a31c01c7221f1.: keystone.exception.DomainNotFound: Could not find domain: e3a57d1a33f84b33a09a31c01c7221f1. Jul 19 14:43:18.619134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:43:18.619134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 14:43:18.619134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 14:43:18.619134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 14:43:18.619134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 14:43:18.619134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 14:43:18.619134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 14:43:18.619134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e3a57d1a33f84b33a09a31c01c7221f1. Jul 19 14:43:18.619134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:43:18.619134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:43:18.619134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:43:18.619134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:43:18.619134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:43:18.619134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:43:18.619134 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:43:18.622737 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:43:18.622737 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:43:18.622737 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:43:18.622737 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:43:18.622737 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:43:18.622737 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:43:18.622737 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:43:18.622737 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 14:43:18.622737 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 14:43:18.622737 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 14:43:18.622737 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 14:43:18.622737 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 14:43:18.622737 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 14:43:18.622737 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:43:18.622737 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:43:18.622737 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:43:18.624199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:43:18.624199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:43:18.624199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:43:18.624199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:43:18.624199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 14:43:18.624199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:43:18.624199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:43:18.624199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:43:18.624199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:43:18.624199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:43:18.624199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:43:18.624199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:43:18.624199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:43:18.624199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 14:43:18.624199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 14:43:18.624199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e3a57d1a33f84b33a09a31c01c7221f1. Jul 19 14:43:18.624199 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:43:18.625261 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3591/7270] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:43:18 2022] PATCH /identity/v3/domains/e3a57d1a33f84b33a09a31c01c7221f1 => generated 112 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 14:43:18.625261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3603d3f-aff8-4afd-9c31-ae71f2a6579b tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:18.635683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3603d3f-aff8-4afd-9c31-ae71f2a6579b tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:18.640497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3851b1-438b-44ea-bb48-52af7ca58c39 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0521fc742394d22a38d6e089be14371', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '53756e5d53274467a2ab66efdda7665a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:18.641642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3851b1-438b-44ea-bb48-52af7ca58c39 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:18.641941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3851b1-438b-44ea-bb48-52af7ca58c39 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:18.642402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3851b1-438b-44ea-bb48-52af7ca58c39 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] PATH_INFO: `/v3/domains/6681c071645f46abaca79f3d06b328cb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:18.651135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3851b1-438b-44ea-bb48-52af7ca58c39 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 14:43:18.662372 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-3c3851b1-438b-44ea-bb48-52af7ca58c39 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Could not find domain: 6681c071645f46abaca79f3d06b328cb.: keystone.exception.DomainNotFound: Could not find domain: 6681c071645f46abaca79f3d06b328cb. Jul 19 14:43:18.662372 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:43:18.662372 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 14:43:18.662372 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 14:43:18.662372 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 14:43:18.662372 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 14:43:18.662372 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 14:43:18.662372 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 14:43:18.662372 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 6681c071645f46abaca79f3d06b328cb. Jul 19 14:43:18.662372 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:43:18.662372 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 14:43:18.662372 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:43:18.662372 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 14:43:18.662372 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 14:43:18.662372 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 14:43:18.662372 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 14:43:18.663510 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 14:43:18.663510 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 14:43:18.663510 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 14:43:18.663510 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 14:43:18.663510 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 14:43:18.663510 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 14:43:18.663510 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 14:43:18.663510 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 14:43:18.663510 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 14:43:18.663510 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 14:43:18.663510 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 14:43:18.663510 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 14:43:18.663510 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 14:43:18.663510 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 14:43:18.663510 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 14:43:18.663510 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 14:43:18.664909 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 14:43:18.664909 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 14:43:18.664909 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 14:43:18.664909 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 14:43:18.664909 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application with Lock( Jul 19 14:43:18.664909 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 14:43:18.664909 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._enter() Jul 19 14:43:18.664909 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 14:43:18.664909 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 14:43:18.664909 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 14:43:18.664909 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.creator() Jul 19 14:43:18.664909 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 14:43:18.664909 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application created_value = creator( Jul 19 14:43:18.664909 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 14:43:18.664909 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 14:43:18.664909 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 6681c071645f46abaca79f3d06b328cb. Jul 19 14:43:18.664909 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 14:43:18.667324 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3592/7271] 10.222.0.43 () {60 vars in 1248 bytes} [Tue Jul 19 14:43:18 2022] PATCH /identity/v3/domains/6681c071645f46abaca79f3d06b328cb => generated 112 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 19 14:43:18.669432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3851b1-438b-44ea-bb48-52af7ca58c39 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:18.670244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3c3851b1-438b-44ea-bb48-52af7ca58c39 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:18.685341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4e61c70a-37f8-4a91-b78b-9fa3ef6f7e52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b5556d0d2341189f5387b4002e4bc6', 'request_id': 'req-4e61c70a-37f8-4a91-b78b-9fa3ef6f7e52'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:18.686481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3851b1-438b-44ea-bb48-52af7ca58c39 tempest-TokensV3TestJSON-1900921211 tempest-TokensV3TestJSON-1900921211-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:18.696563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4e61c70a-37f8-4a91-b78b-9fa3ef6f7e52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b5556d0d2341189f5387b4002e4bc6', 'request_id': 'req-4e61c70a-37f8-4a91-b78b-9fa3ef6f7e52'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:18.708128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4e61c70a-37f8-4a91-b78b-9fa3ef6f7e52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b5556d0d2341189f5387b4002e4bc6', 'request_id': 'req-4e61c70a-37f8-4a91-b78b-9fa3ef6f7e52'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:18.824690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfc2b6-9f2e-4a40-ade3-840e7745523e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:18.825873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfc2b6-9f2e-4a40-ade3-840e7745523e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:18.826309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfc2b6-9f2e-4a40-ade3-840e7745523e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:18.826661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfc2b6-9f2e-4a40-ade3-840e7745523e admin admin] PATH_INFO: `/v3/users/ac3c790985af426abc202fdef803bf98` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:18.828386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfc2b6-9f2e-4a40-ade3-840e7745523e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac3c790985af426abc202fdef803bf98)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:18.831225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfc2b6-9f2e-4a40-ade3-840e7745523e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:18.869122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4e61c70a-37f8-4a91-b78b-9fa3ef6f7e52 admin admin] The token cache is being invalidate because project a5b5556d0d2341189f5387b4002e4bc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:18.869979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4e61c70a-37f8-4a91-b78b-9fa3ef6f7e52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:18.870424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4e61c70a-37f8-4a91-b78b-9fa3ef6f7e52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:18.873644 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3680/7272] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:18 2022] DELETE /identity/v3/projects/a5b5556d0d2341189f5387b4002e4bc6 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:18.882615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef609d5-5f07-4afe-8599-6509533ef1af None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:18.883047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef609d5-5f07-4afe-8599-6509533ef1af None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:18.884654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef609d5-5f07-4afe-8599-6509533ef1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:18.936192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3ef609d5-5f07-4afe-8599-6509533ef1af None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:18.941109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3ef609d5-5f07-4afe-8599-6509533ef1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:18.959879 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3681/7273] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:18.978380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ec0d3-9b54-49ea-bfa5-5929d94c507a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:18.979013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ec0d3-9b54-49ea-bfa5-5929d94c507a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:18.980015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491ec0d3-9b54-49ea-bfa5-5929d94c507a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:19.028012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-491ec0d3-9b54-49ea-bfa5-5929d94c507a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:19.030058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-491ec0d3-9b54-49ea-bfa5-5929d94c507a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:19.032599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dfdfc2b6-9f2e-4a40-ade3-840e7745523e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac3c790985af426abc202fdef803bf98'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:19.044530 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3682/7274] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:19.047153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ec0d3-9b54-49ea-bfa5-5929d94c507a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:19.059711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491ec0d3-9b54-49ea-bfa5-5929d94c507a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:19.065508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dfdfc2b6-9f2e-4a40-ade3-840e7745523e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac3c790985af426abc202fdef803bf98'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:19.066529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dfdfc2b6-9f2e-4a40-ade3-840e7745523e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac3c790985af426abc202fdef803bf98'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:19.067254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2fd59-6b8d-43de-b760-dc398cbf1920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:19.068461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2fd59-6b8d-43de-b760-dc398cbf1920 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:19.068601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2fd59-6b8d-43de-b760-dc398cbf1920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:19.069089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2fd59-6b8d-43de-b760-dc398cbf1920 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:19.069263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dfdfc2b6-9f2e-4a40-ade3-840e7745523e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac3c790985af426abc202fdef803bf98'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:19.070022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2fd59-6b8d-43de-b760-dc398cbf1920 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:43:19.080090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2fd59-6b8d-43de-b760-dc398cbf1920 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:19.080090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2fd59-6b8d-43de-b760-dc398cbf1920 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:19.084840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dfdfc2b6-9f2e-4a40-ade3-840e7745523e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac3c790985af426abc202fdef803bf98'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:19.109653 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3683/7275] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:19.114018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2fd59-6b8d-43de-b760-dc398cbf1920 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:19.118721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-83e2fd59-6b8d-43de-b760-dc398cbf1920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:19.154218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2fd59-6b8d-43de-b760-dc398cbf1920 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:19.162137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d7300-9211-4c2e-9bb9-9073c77e7424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:19.163046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d7300-9211-4c2e-9bb9-9073c77e7424 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:19.163522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d7300-9211-4c2e-9bb9-9073c77e7424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:19.163981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129d7300-9211-4c2e-9bb9-9073c77e7424 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:19.165103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d7300-9211-4c2e-9bb9-9073c77e7424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:19.167751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129d7300-9211-4c2e-9bb9-9073c77e7424 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:19.204948 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3593/7276] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:18 2022] DELETE /identity/v3/users/ac3c790985af426abc202fdef803bf98 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:19.210200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da49a3-0f19-456d-929f-3aad44edb6de None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:19.210702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da49a3-0f19-456d-929f-3aad44edb6de None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:19.211150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da49a3-0f19-456d-929f-3aad44edb6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:19.267068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-34da49a3-0f19-456d-929f-3aad44edb6de None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:19.268566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-34da49a3-0f19-456d-929f-3aad44edb6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:19.276988 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3684/7277] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:43:19 2022] POST /identity/v3/projects => generated 353 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:19.281711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d7300-9211-4c2e-9bb9-9073c77e7424 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:19.402891 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3594/7278] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:43:19.416069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da49a3-0f19-456d-929f-3aad44edb6de None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:19.418934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-34da49a3-0f19-456d-929f-3aad44edb6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:19.447686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129d7300-9211-4c2e-9bb9-9073c77e7424 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:19.466044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b0617-a165-4448-8ba3-46e476f4fc3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:19.469690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b0617-a165-4448-8ba3-46e476f4fc3e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:19.470009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b0617-a165-4448-8ba3-46e476f4fc3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:19.470884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b0617-a165-4448-8ba3-46e476f4fc3e admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:19.490320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b0617-a165-4448-8ba3-46e476f4fc3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:19.496385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b0617-a165-4448-8ba3-46e476f4fc3e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:19.587435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da49a3-0f19-456d-929f-3aad44edb6de None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:19.609248 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3685/7279] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:43:19 2022] POST /identity/v3/users => generated 277 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:43:19.614122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b0617-a165-4448-8ba3-46e476f4fc3e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:19.633175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b0617-a165-4448-8ba3-46e476f4fc3e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:19.648786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebac26b-250c-45fb-91bf-797a0a0d1b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:19.650069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebac26b-250c-45fb-91bf-797a0a0d1b0e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:19.650069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebac26b-250c-45fb-91bf-797a0a0d1b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:19.650296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebac26b-250c-45fb-91bf-797a0a0d1b0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:19.652207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebac26b-250c-45fb-91bf-797a0a0d1b0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:19.656121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebac26b-250c-45fb-91bf-797a0a0d1b0e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:19.677587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bb95a-2014-4c96-96a8-079a9c668cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:19.679041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bb95a-2014-4c96-96a8-079a9c668cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:19.679393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bb95a-2014-4c96-96a8-079a9c668cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:19.679870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767bb95a-2014-4c96-96a8-079a9c668cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:19.681723 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3686/7280] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:43:19.685738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebac26b-250c-45fb-91bf-797a0a0d1b0e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:19.697390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bb95a-2014-4c96-96a8-079a9c668cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:19.699513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767bb95a-2014-4c96-96a8-079a9c668cb7 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:19.708648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebac26b-250c-45fb-91bf-797a0a0d1b0e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:19.723111 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3595/7281] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:43:19.727445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63537159-4f06-440f-afbd-8f9494d7f8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:19.728157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63537159-4f06-440f-afbd-8f9494d7f8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:19.728449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63537159-4f06-440f-afbd-8f9494d7f8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:19.728736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63537159-4f06-440f-afbd-8f9494d7f8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:19.729497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63537159-4f06-440f-afbd-8f9494d7f8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:19.731298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63537159-4f06-440f-afbd-8f9494d7f8b0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:19.768089 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3687/7282] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:19 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:43:19.771874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bb95a-2014-4c96-96a8-079a9c668cb7 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:19.786526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767bb95a-2014-4c96-96a8-079a9c668cb7 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:19.801190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286b1c8-2dc4-48a9-b0f2-26da782737ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:19.801955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286b1c8-2dc4-48a9-b0f2-26da782737ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:19.802282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286b1c8-2dc4-48a9-b0f2-26da782737ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:19.802642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286b1c8-2dc4-48a9-b0f2-26da782737ba admin admin] PATH_INFO: `/v3/projects/7297334e00904cbabe4eaf2ce3137851/users/ba22f69a6d334fe09065dd2d18a4fc67/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:19.823699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286b1c8-2dc4-48a9-b0f2-26da782737ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=7297334e00904cbabe4eaf2ce3137851, user_id=ba22f69a6d334fe09065dd2d18a4fc67, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:19.826713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c286b1c8-2dc4-48a9-b0f2-26da782737ba admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:19.855526 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:19.942218 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3596/7283] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:19 2022] PUT /identity/v3/projects/7297334e00904cbabe4eaf2ce3137851/users/ba22f69a6d334fe09065dd2d18a4fc67/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:19.959925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38fc29-9c7e-4b46-a54a-8ffa3e2a8716 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:19.960229 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38fc29-9c7e-4b46-a54a-8ffa3e2a8716 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:19.960772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38fc29-9c7e-4b46-a54a-8ffa3e2a8716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:20.022929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-cf38fc29-9c7e-4b46-a54a-8ffa3e2a8716 None None] MFA Rules not processed for user `ba22f69a6d334fe09065dd2d18a4fc67`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:20.024221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cf38fc29-9c7e-4b46-a54a-8ffa3e2a8716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:20.227450 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3688/7284] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:19 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:20.265293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286b1c8-2dc4-48a9-b0f2-26da782737ba admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:20.324863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c286b1c8-2dc4-48a9-b0f2-26da782737ba admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:20.329267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003d01b-9da7-4aba-ad34-1c5af074f9e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:20.330471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003d01b-9da7-4aba-ad34-1c5af074f9e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:20.330774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003d01b-9da7-4aba-ad34-1c5af074f9e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:20.331059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003d01b-9da7-4aba-ad34-1c5af074f9e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:20.340718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003d01b-9da7-4aba-ad34-1c5af074f9e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:20.342218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003d01b-9da7-4aba-ad34-1c5af074f9e0 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:20.357141 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3597/7285] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:20 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:43:21.056817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38fc29-9c7e-4b46-a54a-8ffa3e2a8716 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:21.058449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cf38fc29-9c7e-4b46-a54a-8ffa3e2a8716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:21.171065 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:21.221057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38fc29-9c7e-4b46-a54a-8ffa3e2a8716 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:21.226790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdad594-6ce4-49fd-8308-4092f74bcd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:21.227920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdad594-6ce4-49fd-8308-4092f74bcd18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:21.228892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdad594-6ce4-49fd-8308-4092f74bcd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:21.229368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdad594-6ce4-49fd-8308-4092f74bcd18 admin admin] PATH_INFO: `/v3/projects/2432cb9dbdaa4b69ae7dcc43e3e0d839` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:21.231575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdad594-6ce4-49fd-8308-4092f74bcd18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2432cb9dbdaa4b69ae7dcc43e3e0d839)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:21.234015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdad594-6ce4-49fd-8308-4092f74bcd18 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:21.334976 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:21.417843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1fdad594-6ce4-49fd-8308-4092f74bcd18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2432cb9dbdaa4b69ae7dcc43e3e0d839', 'request_id': 'req-1fdad594-6ce4-49fd-8308-4092f74bcd18'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:21.423454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1fdad594-6ce4-49fd-8308-4092f74bcd18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2432cb9dbdaa4b69ae7dcc43e3e0d839', 'request_id': 'req-1fdad594-6ce4-49fd-8308-4092f74bcd18'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:21.435288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1fdad594-6ce4-49fd-8308-4092f74bcd18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2432cb9dbdaa4b69ae7dcc43e3e0d839', 'request_id': 'req-1fdad594-6ce4-49fd-8308-4092f74bcd18'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:21.551755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1fdad594-6ce4-49fd-8308-4092f74bcd18 admin admin] The token cache is being invalidate because project 2432cb9dbdaa4b69ae7dcc43e3e0d839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:21.552208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1fdad594-6ce4-49fd-8308-4092f74bcd18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:21.558631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1fdad594-6ce4-49fd-8308-4092f74bcd18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:21.561049 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3689/7286] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:21 2022] DELETE /identity/v3/projects/2432cb9dbdaa4b69ae7dcc43e3e0d839 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:21.565872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003d01b-9da7-4aba-ad34-1c5af074f9e0 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:21.591725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003d01b-9da7-4aba-ad34-1c5af074f9e0 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:21.759647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e42c1-bea3-4428-a222-1bbf01135751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:21.761308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e42c1-bea3-4428-a222-1bbf01135751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:21.761701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e42c1-bea3-4428-a222-1bbf01135751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:21.765564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e42c1-bea3-4428-a222-1bbf01135751 admin admin] PATH_INFO: `/v3/users/f0521fc742394d22a38d6e089be14371` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:21.767964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e42c1-bea3-4428-a222-1bbf01135751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0521fc742394d22a38d6e089be14371)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:21.772008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e42c1-bea3-4428-a222-1bbf01135751 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:22.096527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a22e42c1-bea3-4428-a222-1bbf01135751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0521fc742394d22a38d6e089be14371'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:22.117969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a22e42c1-bea3-4428-a222-1bbf01135751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0521fc742394d22a38d6e089be14371'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:22.120244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a22e42c1-bea3-4428-a222-1bbf01135751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0521fc742394d22a38d6e089be14371'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:22.120244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a22e42c1-bea3-4428-a222-1bbf01135751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0521fc742394d22a38d6e089be14371'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:22.130056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a22e42c1-bea3-4428-a222-1bbf01135751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0521fc742394d22a38d6e089be14371'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:22.238465 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3598/7287] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:21 2022] DELETE /identity/v3/users/f0521fc742394d22a38d6e089be14371 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:22.420587 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:23.167352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdceb768-3326-4800-9c0e-e2039a2ba596 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:23.167729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdceb768-3326-4800-9c0e-e2039a2ba596 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:23.167968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdceb768-3326-4800-9c0e-e2039a2ba596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:23.279049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-fdceb768-3326-4800-9c0e-e2039a2ba596 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:23.280905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fdceb768-3326-4800-9c0e-e2039a2ba596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:23.332513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e42c1-bea3-4428-a222-1bbf01135751 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:23.337149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a22e42c1-bea3-4428-a222-1bbf01135751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:23.390086 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3690/7288] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:43:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:23.461600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdceb768-3326-4800-9c0e-e2039a2ba596 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:23.464663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fdceb768-3326-4800-9c0e-e2039a2ba596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:23.539957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e42c1-bea3-4428-a222-1bbf01135751 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:23.545363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3b842-90ec-4e86-85bf-5c8d4155fef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:23.547241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3b842-90ec-4e86-85bf-5c8d4155fef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:23.547701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3b842-90ec-4e86-85bf-5c8d4155fef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:23.548224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3b842-90ec-4e86-85bf-5c8d4155fef5 admin admin] PATH_INFO: `/v3/projects/53756e5d53274467a2ab66efdda7665a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:23.550059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3b842-90ec-4e86-85bf-5c8d4155fef5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53756e5d53274467a2ab66efdda7665a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:23.552198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3b842-90ec-4e86-85bf-5c8d4155fef5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:23.556377 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:23.606549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdceb768-3326-4800-9c0e-e2039a2ba596 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:23.613201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04088d79-920f-46f3-bce9-fb9429e60b65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:23.614410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04088d79-920f-46f3-bce9-fb9429e60b65 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:23.614914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04088d79-920f-46f3-bce9-fb9429e60b65 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:23.615402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04088d79-920f-46f3-bce9-fb9429e60b65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:23.630578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04088d79-920f-46f3-bce9-fb9429e60b65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:23.632184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04088d79-920f-46f3-bce9-fb9429e60b65 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:23.644410 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3691/7289] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:43:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:43:23.697447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-87b3b842-90ec-4e86-85bf-5c8d4155fef5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53756e5d53274467a2ab66efdda7665a', 'request_id': 'req-87b3b842-90ec-4e86-85bf-5c8d4155fef5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:23.806420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-87b3b842-90ec-4e86-85bf-5c8d4155fef5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53756e5d53274467a2ab66efdda7665a', 'request_id': 'req-87b3b842-90ec-4e86-85bf-5c8d4155fef5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:23.815673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-87b3b842-90ec-4e86-85bf-5c8d4155fef5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53756e5d53274467a2ab66efdda7665a', 'request_id': 'req-87b3b842-90ec-4e86-85bf-5c8d4155fef5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:23.845838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-87b3b842-90ec-4e86-85bf-5c8d4155fef5 admin admin] The token cache is being invalidate because project 53756e5d53274467a2ab66efdda7665a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:23.846664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-87b3b842-90ec-4e86-85bf-5c8d4155fef5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:23.847554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-87b3b842-90ec-4e86-85bf-5c8d4155fef5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:23.851825 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3599/7290] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:23 2022] DELETE /identity/v3/projects/53756e5d53274467a2ab66efdda7665a => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:23.855279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04088d79-920f-46f3-bce9-fb9429e60b65 service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:23.883590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04088d79-920f-46f3-bce9-fb9429e60b65 service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:24.081839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3b842-90ec-4e86-85bf-5c8d4155fef5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:24.084986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-87b3b842-90ec-4e86-85bf-5c8d4155fef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:24.098928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b50ba9-ac74-481c-adb6-082a91804377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:24.102459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b50ba9-ac74-481c-adb6-082a91804377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:24.102459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b50ba9-ac74-481c-adb6-082a91804377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:24.102459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b50ba9-ac74-481c-adb6-082a91804377 admin admin] PATH_INFO: `/v3/users/55274a5f086940f09926f66bc4a3b24a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:24.102847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b50ba9-ac74-481c-adb6-082a91804377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55274a5f086940f09926f66bc4a3b24a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:24.104553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b50ba9-ac74-481c-adb6-082a91804377 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:24.114263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3b842-90ec-4e86-85bf-5c8d4155fef5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:24.124815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1c077-ba22-4d09-a1b1-1c68fc1e6328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:24.131169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1c077-ba22-4d09-a1b1-1c68fc1e6328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:24.131990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1c077-ba22-4d09-a1b1-1c68fc1e6328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:24.132462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1c077-ba22-4d09-a1b1-1c68fc1e6328 admin admin] PATH_INFO: `/v3/users/28c701d9e14540bd9969f18d18608f75` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:24.138255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1c077-ba22-4d09-a1b1-1c68fc1e6328 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28c701d9e14540bd9969f18d18608f75)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:24.140520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1c077-ba22-4d09-a1b1-1c68fc1e6328 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:24.185727 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:24.406152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bed1c077-ba22-4d09-a1b1-1c68fc1e6328 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28c701d9e14540bd9969f18d18608f75'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:24.415923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b3b50ba9-ac74-481c-adb6-082a91804377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55274a5f086940f09926f66bc4a3b24a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:24.444511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b3b50ba9-ac74-481c-adb6-082a91804377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55274a5f086940f09926f66bc4a3b24a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:24.450032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bed1c077-ba22-4d09-a1b1-1c68fc1e6328 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28c701d9e14540bd9969f18d18608f75'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:24.455607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bed1c077-ba22-4d09-a1b1-1c68fc1e6328 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28c701d9e14540bd9969f18d18608f75'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:24.463516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bed1c077-ba22-4d09-a1b1-1c68fc1e6328 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28c701d9e14540bd9969f18d18608f75'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:24.464735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b3b50ba9-ac74-481c-adb6-082a91804377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55274a5f086940f09926f66bc4a3b24a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:24.465495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b3b50ba9-ac74-481c-adb6-082a91804377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55274a5f086940f09926f66bc4a3b24a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:24.510397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bed1c077-ba22-4d09-a1b1-1c68fc1e6328 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28c701d9e14540bd9969f18d18608f75'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:24.557127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b3b50ba9-ac74-481c-adb6-082a91804377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55274a5f086940f09926f66bc4a3b24a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:24.563750 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3692/7291] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:23 2022] DELETE /identity/v3/users/55274a5f086940f09926f66bc4a3b24a => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:24.672042 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3600/7292] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:24 2022] DELETE /identity/v3/users/28c701d9e14540bd9969f18d18608f75 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:43:24.672706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a7f36-9084-43e5-ad25-1a0f7684e186 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:24.673008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a7f36-9084-43e5-ad25-1a0f7684e186 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:24.675353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a7f36-9084-43e5-ad25-1a0f7684e186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:24.716237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-fa3a7f36-9084-43e5-ad25-1a0f7684e186 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:24.717414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fa3a7f36-9084-43e5-ad25-1a0f7684e186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:24.883024 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3693/7293] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:43:24.906688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1c077-ba22-4d09-a1b1-1c68fc1e6328 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:24.909066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bed1c077-ba22-4d09-a1b1-1c68fc1e6328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:25.059227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1c077-ba22-4d09-a1b1-1c68fc1e6328 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:25.072737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b307ac-6090-408d-8572-c660e2ef1ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:25.073712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b307ac-6090-408d-8572-c660e2ef1ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:25.073856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b307ac-6090-408d-8572-c660e2ef1ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:25.074182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b307ac-6090-408d-8572-c660e2ef1ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:25.106894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b307ac-6090-408d-8572-c660e2ef1ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:25.108173 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:25.112972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b307ac-6090-408d-8572-c660e2ef1ab2 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:25.137317 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3601/7294] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:43:25.740092 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:25.849308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a7f36-9084-43e5-ad25-1a0f7684e186 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:25.855630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fa3a7f36-9084-43e5-ad25-1a0f7684e186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:25.918127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a7f36-9084-43e5-ad25-1a0f7684e186 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:25.951766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25709b10-b973-4d28-8459-82ddd757718c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:25.961841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25709b10-b973-4d28-8459-82ddd757718c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:25.962986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25709b10-b973-4d28-8459-82ddd757718c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:25.963286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25709b10-b973-4d28-8459-82ddd757718c admin admin] PATH_INFO: `/v3/projects/b8eec01f6f824a48a9c24c48cdcbe14e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:25.972695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25709b10-b973-4d28-8459-82ddd757718c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8eec01f6f824a48a9c24c48cdcbe14e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:25.982547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25709b10-b973-4d28-8459-82ddd757718c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:25.984383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b307ac-6090-408d-8572-c660e2ef1ab2 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:25.986237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-24b307ac-6090-408d-8572-c660e2ef1ab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:26.019108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b307ac-6090-408d-8572-c660e2ef1ab2 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:26.038434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb64407-1b1d-442f-80ec-ee50e0025641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:26.038434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb64407-1b1d-442f-80ec-ee50e0025641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:26.038434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb64407-1b1d-442f-80ec-ee50e0025641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:26.038434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb64407-1b1d-442f-80ec-ee50e0025641 admin admin] PATH_INFO: `/v3/users/ba22f69a6d334fe09065dd2d18a4fc67` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:26.039592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb64407-1b1d-442f-80ec-ee50e0025641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba22f69a6d334fe09065dd2d18a4fc67)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:26.044705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb64407-1b1d-442f-80ec-ee50e0025641 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:26.051519 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:26.326586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4bb64407-1b1d-442f-80ec-ee50e0025641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba22f69a6d334fe09065dd2d18a4fc67'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:26.337572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-25709b10-b973-4d28-8459-82ddd757718c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8eec01f6f824a48a9c24c48cdcbe14e', 'request_id': 'req-25709b10-b973-4d28-8459-82ddd757718c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:26.353950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4bb64407-1b1d-442f-80ec-ee50e0025641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba22f69a6d334fe09065dd2d18a4fc67'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:26.355426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4bb64407-1b1d-442f-80ec-ee50e0025641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba22f69a6d334fe09065dd2d18a4fc67'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:26.361428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4bb64407-1b1d-442f-80ec-ee50e0025641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba22f69a6d334fe09065dd2d18a4fc67'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:26.363985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-25709b10-b973-4d28-8459-82ddd757718c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8eec01f6f824a48a9c24c48cdcbe14e', 'request_id': 'req-25709b10-b973-4d28-8459-82ddd757718c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:26.379113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4bb64407-1b1d-442f-80ec-ee50e0025641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba22f69a6d334fe09065dd2d18a4fc67'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:26.386201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-25709b10-b973-4d28-8459-82ddd757718c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8eec01f6f824a48a9c24c48cdcbe14e', 'request_id': 'req-25709b10-b973-4d28-8459-82ddd757718c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:26.467251 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3602/7295] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:25 2022] DELETE /identity/v3/users/ba22f69a6d334fe09065dd2d18a4fc67 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:43:26.469723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb64407-1b1d-442f-80ec-ee50e0025641 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:26.471631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4bb64407-1b1d-442f-80ec-ee50e0025641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:26.526418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-25709b10-b973-4d28-8459-82ddd757718c admin admin] The token cache is being invalidate because project b8eec01f6f824a48a9c24c48cdcbe14e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:26.526881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-25709b10-b973-4d28-8459-82ddd757718c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:26.527674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-25709b10-b973-4d28-8459-82ddd757718c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:26.534296 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3694/7296] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:25 2022] DELETE /identity/v3/projects/b8eec01f6f824a48a9c24c48cdcbe14e => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:26.536032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757381bb-95a1-4b57-a4f1-4bfb69fe7216 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:26.537634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757381bb-95a1-4b57-a4f1-4bfb69fe7216 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:26.538028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757381bb-95a1-4b57-a4f1-4bfb69fe7216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:26.593573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-757381bb-95a1-4b57-a4f1-4bfb69fe7216 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:26.598394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-757381bb-95a1-4b57-a4f1-4bfb69fe7216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:26.631712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb64407-1b1d-442f-80ec-ee50e0025641 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:26.654595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da54860-a709-4c5a-a041-d146e9f07f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:26.659751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da54860-a709-4c5a-a041-d146e9f07f8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:26.661594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da54860-a709-4c5a-a041-d146e9f07f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:26.666125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da54860-a709-4c5a-a041-d146e9f07f8f admin admin] PATH_INFO: `/v3/projects/45ce3ec13ff74eff9168320b452ba243` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:26.675813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da54860-a709-4c5a-a041-d146e9f07f8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=45ce3ec13ff74eff9168320b452ba243)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:26.677983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da54860-a709-4c5a-a041-d146e9f07f8f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:26.843092 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3695/7297] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:26.844840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543d6c-225c-419a-946c-4a033bdd646d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:26.846476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543d6c-225c-419a-946c-4a033bdd646d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:26.847004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f543d6c-225c-419a-946c-4a033bdd646d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:26.891719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1f543d6c-225c-419a-946c-4a033bdd646d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:26.909311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1f543d6c-225c-419a-946c-4a033bdd646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:26.935175 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3696/7298] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:26.936374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f543d6c-225c-419a-946c-4a033bdd646d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:26.938387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1f543d6c-225c-419a-946c-4a033bdd646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:26.993235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7da54860-a709-4c5a-a041-d146e9f07f8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45ce3ec13ff74eff9168320b452ba243', 'request_id': 'req-7da54860-a709-4c5a-a041-d146e9f07f8f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:27.027549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f543d6c-225c-419a-946c-4a033bdd646d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:27.071111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7da54860-a709-4c5a-a041-d146e9f07f8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45ce3ec13ff74eff9168320b452ba243', 'request_id': 'req-7da54860-a709-4c5a-a041-d146e9f07f8f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:27.081364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7da54860-a709-4c5a-a041-d146e9f07f8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45ce3ec13ff74eff9168320b452ba243', 'request_id': 'req-7da54860-a709-4c5a-a041-d146e9f07f8f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:27.102981 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:27.114762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7da54860-a709-4c5a-a041-d146e9f07f8f admin admin] The token cache is being invalidate because project 45ce3ec13ff74eff9168320b452ba243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:27.115092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7da54860-a709-4c5a-a041-d146e9f07f8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:27.117879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7da54860-a709-4c5a-a041-d146e9f07f8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:27.120922 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3603/7299] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:26 2022] DELETE /identity/v3/projects/45ce3ec13ff74eff9168320b452ba243 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:27.125151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f455f0-9d8b-4ee9-9222-5150f9d266cb None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:27.125447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f455f0-9d8b-4ee9-9222-5150f9d266cb None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:27.129943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f455f0-9d8b-4ee9-9222-5150f9d266cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:27.179394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-87f455f0-9d8b-4ee9-9222-5150f9d266cb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:27.180621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-87f455f0-9d8b-4ee9-9222-5150f9d266cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:27.291817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1718f42-1a3c-4166-a74b-d45c13dc64ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:27.292627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1718f42-1a3c-4166-a74b-d45c13dc64ef service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:27.293040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1718f42-1a3c-4166-a74b-d45c13dc64ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:27.293426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1718f42-1a3c-4166-a74b-d45c13dc64ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:27.300136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b1718f42-1a3c-4166-a74b-d45c13dc64ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:27.301795 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3604/7300] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:27.316538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f8653-68b2-4b7e-842e-d1e07821ec25 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:27.316854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f8653-68b2-4b7e-842e-d1e07821ec25 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:27.317144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f8653-68b2-4b7e-842e-d1e07821ec25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:27.339944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1718f42-1a3c-4166-a74b-d45c13dc64ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:27.342131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1718f42-1a3c-4166-a74b-d45c13dc64ef service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:27.357714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-255f8653-68b2-4b7e-842e-d1e07821ec25 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:27.359021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-255f8653-68b2-4b7e-842e-d1e07821ec25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:27.370653 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3697/7301] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:43:27.371879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1718f42-1a3c-4166-a74b-d45c13dc64ef service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:27.389492 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3605/7302] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:27.389724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1718f42-1a3c-4166-a74b-d45c13dc64ef service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:27.391442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb84440-8067-4f57-b32e-91007e3dd1da None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:27.392028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb84440-8067-4f57-b32e-91007e3dd1da None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:27.392321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb84440-8067-4f57-b32e-91007e3dd1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:27.395051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286a239-1118-473d-b2c7-4da82da1f4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:27.395918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286a239-1118-473d-b2c7-4da82da1f4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:27.396221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286a239-1118-473d-b2c7-4da82da1f4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:27.401968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286a239-1118-473d-b2c7-4da82da1f4e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:27.401968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286a239-1118-473d-b2c7-4da82da1f4e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:43:27.401968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286a239-1118-473d-b2c7-4da82da1f4e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:27.405537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286a239-1118-473d-b2c7-4da82da1f4e9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:27.436959 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3698/7303] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:27.438387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286a239-1118-473d-b2c7-4da82da1f4e9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:27.452461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286a239-1118-473d-b2c7-4da82da1f4e9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:27.459837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa55ed-fcc7-480e-b5c9-67b5b93c1e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:27.460689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa55ed-fcc7-480e-b5c9-67b5b93c1e13 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:27.461045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa55ed-fcc7-480e-b5c9-67b5b93c1e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:27.461403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa55ed-fcc7-480e-b5c9-67b5b93c1e13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:27.462527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa55ed-fcc7-480e-b5c9-67b5b93c1e13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:27.463592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ebb84440-8067-4f57-b32e-91007e3dd1da None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:27.464702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa55ed-fcc7-480e-b5c9-67b5b93c1e13 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:27.466974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ebb84440-8067-4f57-b32e-91007e3dd1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:27.485783 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3606/7304] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:43:27.489537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb84440-8067-4f57-b32e-91007e3dd1da None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:27.525870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb84440-8067-4f57-b32e-91007e3dd1da None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:27.536050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217224ac-fb64-472e-bb13-9ceb90fd9a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:27.538316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217224ac-fb64-472e-bb13-9ceb90fd9a89 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:27.538670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217224ac-fb64-472e-bb13-9ceb90fd9a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:27.538947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217224ac-fb64-472e-bb13-9ceb90fd9a89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:27.540895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217224ac-fb64-472e-bb13-9ceb90fd9a89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:43:27.541219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217224ac-fb64-472e-bb13-9ceb90fd9a89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:27.545907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217224ac-fb64-472e-bb13-9ceb90fd9a89 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:27.578837 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3607/7305] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:27.583753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217224ac-fb64-472e-bb13-9ceb90fd9a89 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:27.602900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217224ac-fb64-472e-bb13-9ceb90fd9a89 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:27.616938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b97b9b-1a5e-4a00-b6ab-1daff70b0f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:27.620670 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3699/7306] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:43:27 2022] POST /identity/v3/projects => generated 357 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:27.621347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b97b9b-1a5e-4a00-b6ab-1daff70b0f71 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:27.621686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa55ed-fcc7-480e-b5c9-67b5b93c1e13 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:27.623239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b97b9b-1a5e-4a00-b6ab-1daff70b0f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:27.623736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b97b9b-1a5e-4a00-b6ab-1daff70b0f71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:27.625453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b97b9b-1a5e-4a00-b6ab-1daff70b0f71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:27.637550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b97b9b-1a5e-4a00-b6ab-1daff70b0f71 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:27.671561 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:27.762849 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:27.784834 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3608/7307] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:43:27 2022] POST /identity/v3/projects => generated 367 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:27.790174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b97b9b-1a5e-4a00-b6ab-1daff70b0f71 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:27.800317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa55ed-fcc7-480e-b5c9-67b5b93c1e13 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:28.039882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b97b9b-1a5e-4a00-b6ab-1daff70b0f71 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:28.043139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d0bd3-b34e-40d6-af2f-8caa8b380da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:28.044449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d0bd3-b34e-40d6-af2f-8caa8b380da1 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:28.045267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d0bd3-b34e-40d6-af2f-8caa8b380da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:28.045831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d0bd3-b34e-40d6-af2f-8caa8b380da1 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:28.046746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d0bd3-b34e-40d6-af2f-8caa8b380da1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:28.049029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52d0bd3-b34e-40d6-af2f-8caa8b380da1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:28.052984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7dc04-8b52-4d2d-87f0-2594f7fef45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:28.053880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7dc04-8b52-4d2d-87f0-2594f7fef45c admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:28.054224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7dc04-8b52-4d2d-87f0-2594f7fef45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:28.054603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7dc04-8b52-4d2d-87f0-2594f7fef45c admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:28.056693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7dc04-8b52-4d2d-87f0-2594f7fef45c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:28.060143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f7dc04-8b52-4d2d-87f0-2594f7fef45c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:28.211246 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3700/7308] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:43:27 2022] POST /identity/v3/users => generated 279 bytes in 590 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:28.217440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d0bd3-b34e-40d6-af2f-8caa8b380da1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:28.238088 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3609/7309] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:43:27 2022] POST /identity/v3/users => generated 284 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:28.241494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7dc04-8b52-4d2d-87f0-2594f7fef45c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:28.267999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7dc04-8b52-4d2d-87f0-2594f7fef45c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:28.277458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d0bd3-b34e-40d6-af2f-8caa8b380da1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:28.285510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292d263-25b9-4f42-b01e-a9bbba317adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:28.286460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292d263-25b9-4f42-b01e-a9bbba317adb admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:28.286852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292d263-25b9-4f42-b01e-a9bbba317adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:28.287231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292d263-25b9-4f42-b01e-a9bbba317adb admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:28.288084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292d263-25b9-4f42-b01e-a9bbba317adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:28.291194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292d263-25b9-4f42-b01e-a9bbba317adb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:28.295982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba40568-6f84-43c4-82d2-ca65800158d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:28.298848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba40568-6f84-43c4-82d2-ca65800158d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:28.299388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba40568-6f84-43c4-82d2-ca65800158d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:28.299851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba40568-6f84-43c4-82d2-ca65800158d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:28.300792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba40568-6f84-43c4-82d2-ca65800158d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:28.303469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba40568-6f84-43c4-82d2-ca65800158d3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:28.312732 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3610/7310] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:28.320753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292d263-25b9-4f42-b01e-a9bbba317adb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:28.330225 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3701/7311] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:28.334786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba40568-6f84-43c4-82d2-ca65800158d3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:28.356869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292d263-25b9-4f42-b01e-a9bbba317adb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:28.359495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba40568-6f84-43c4-82d2-ca65800158d3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:28.372809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d4258-1052-4744-aaa5-1df16093cebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:28.374011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d4258-1052-4744-aaa5-1df16093cebf admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:28.374579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d4258-1052-4744-aaa5-1df16093cebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:28.375075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7d4258-1052-4744-aaa5-1df16093cebf admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:28.376033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d4258-1052-4744-aaa5-1df16093cebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:28.380584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d04b2-3b6e-43dd-904f-bf38036d6cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:28.380941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d04b2-3b6e-43dd-904f-bf38036d6cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:28.381237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d04b2-3b6e-43dd-904f-bf38036d6cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:28.381515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d04b2-3b6e-43dd-904f-bf38036d6cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:28.382311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d04b2-3b6e-43dd-904f-bf38036d6cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:28.384260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7d4258-1052-4744-aaa5-1df16093cebf admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:28.387512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d04b2-3b6e-43dd-904f-bf38036d6cb4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:28.415232 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3702/7312] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:28.416429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d4258-1052-4744-aaa5-1df16093cebf admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:28.424871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9f7d4258-1052-4744-aaa5-1df16093cebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:28.438286 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3611/7313] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:28 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:28.440202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d04b2-3b6e-43dd-904f-bf38036d6cb4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:28.469748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d04b2-3b6e-43dd-904f-bf38036d6cb4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:28.475046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7d4258-1052-4744-aaa5-1df16093cebf admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:28.477902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a82b8-6443-49a5-ad35-8f7acbacccc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:28.479099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a82b8-6443-49a5-ad35-8f7acbacccc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:28.479586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a82b8-6443-49a5-ad35-8f7acbacccc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:28.480234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a82b8-6443-49a5-ad35-8f7acbacccc6 admin admin] PATH_INFO: `/v3/projects/6458913670bf4854a1d9e98d19e39e3f/users/7a090334034e4dc790a36c3283f7561d/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:28.493426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba245daf-c85c-4d78-8ad9-354ddf112e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:28.495017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba245daf-c85c-4d78-8ad9-354ddf112e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:28.495367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba245daf-c85c-4d78-8ad9-354ddf112e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:28.498008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba245daf-c85c-4d78-8ad9-354ddf112e6e admin admin] PATH_INFO: `/v3/projects/7297334e00904cbabe4eaf2ce3137851` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:28.500907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba245daf-c85c-4d78-8ad9-354ddf112e6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7297334e00904cbabe4eaf2ce3137851)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:28.507157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba245daf-c85c-4d78-8ad9-354ddf112e6e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:28.511653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a82b8-6443-49a5-ad35-8f7acbacccc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6458913670bf4854a1d9e98d19e39e3f, user_id=7a090334034e4dc790a36c3283f7561d, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:28.515329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205a82b8-6443-49a5-ad35-8f7acbacccc6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:28.520288 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:28.546124 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:28.619670 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3612/7314] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:28 2022] PUT /identity/v3/projects/6458913670bf4854a1d9e98d19e39e3f/users/7a090334034e4dc790a36c3283f7561d/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:28.620897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a82b8-6443-49a5-ad35-8f7acbacccc6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:28.729380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ba245daf-c85c-4d78-8ad9-354ddf112e6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7297334e00904cbabe4eaf2ce3137851', 'request_id': 'req-ba245daf-c85c-4d78-8ad9-354ddf112e6e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:28.749052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ba245daf-c85c-4d78-8ad9-354ddf112e6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7297334e00904cbabe4eaf2ce3137851', 'request_id': 'req-ba245daf-c85c-4d78-8ad9-354ddf112e6e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:28.750397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205a82b8-6443-49a5-ad35-8f7acbacccc6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:28.761301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ba245daf-c85c-4d78-8ad9-354ddf112e6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7297334e00904cbabe4eaf2ce3137851', 'request_id': 'req-ba245daf-c85c-4d78-8ad9-354ddf112e6e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:28.860471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ba245daf-c85c-4d78-8ad9-354ddf112e6e admin admin] The token cache is being invalidate because project 7297334e00904cbabe4eaf2ce3137851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:28.861563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ba245daf-c85c-4d78-8ad9-354ddf112e6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:28.862879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ba245daf-c85c-4d78-8ad9-354ddf112e6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:28.871102 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3703/7315] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:28 2022] DELETE /identity/v3/projects/7297334e00904cbabe4eaf2ce3137851 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:28.882932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029b314-68f6-46d5-a9bf-b47e4d10ad2d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:28.887397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029b314-68f6-46d5-a9bf-b47e4d10ad2d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:28.888540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7029b314-68f6-46d5-a9bf-b47e4d10ad2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:28.903534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de1de7-927c-4f4e-a964-ddb698f6e437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:28.904622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de1de7-927c-4f4e-a964-ddb698f6e437 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:28.905029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de1de7-927c-4f4e-a964-ddb698f6e437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:28.905410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de1de7-927c-4f4e-a964-ddb698f6e437 admin admin] PATH_INFO: `/v3/projects/fdfa2414e22c4e508c54a2f17c7a28ba/users/fec3ccad323d4f94971cc9ba929e6c2c/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:28.945911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de1de7-927c-4f4e-a964-ddb698f6e437 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdfa2414e22c4e508c54a2f17c7a28ba, user_id=fec3ccad323d4f94971cc9ba929e6c2c, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:28.948893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de1de7-927c-4f4e-a964-ddb698f6e437 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:29.031459 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3613/7316] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:28 2022] PUT /identity/v3/projects/fdfa2414e22c4e508c54a2f17c7a28ba/users/fec3ccad323d4f94971cc9ba929e6c2c/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:29.033623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea759d1-dec2-4e3f-b83a-1dbd9ea2e62c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:29.035985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea759d1-dec2-4e3f-b83a-1dbd9ea2e62c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:29.035985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea759d1-dec2-4e3f-b83a-1dbd9ea2e62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:29.036210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7029b314-68f6-46d5-a9bf-b47e4d10ad2d None None] MFA Rules not processed for user `7a090334034e4dc790a36c3283f7561d`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:29.036210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7029b314-68f6-46d5-a9bf-b47e4d10ad2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:29.083080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2ea759d1-dec2-4e3f-b83a-1dbd9ea2e62c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:29.087799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2ea759d1-dec2-4e3f-b83a-1dbd9ea2e62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:29.254739 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3614/7317] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:29.256178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa977a-a56a-43ef-a22a-fafcb76a01f2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:29.256475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa977a-a56a-43ef-a22a-fafcb76a01f2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:29.258153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fa977a-a56a-43ef-a22a-fafcb76a01f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:29.357136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-30fa977a-a56a-43ef-a22a-fafcb76a01f2 None None] MFA Rules not processed for user `fec3ccad323d4f94971cc9ba929e6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:29.360665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-30fa977a-a56a-43ef-a22a-fafcb76a01f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:29.372044 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3704/7318] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:28 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 493 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:29.374587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1c63f-1f49-4a5b-bfa3-86baf9e1b120 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:29.375262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1c63f-1f49-4a5b-bfa3-86baf9e1b120 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:29.378373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1c63f-1f49-4a5b-bfa3-86baf9e1b120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:29.439654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6be1c63f-1f49-4a5b-bfa3-86baf9e1b120 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:29.447116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6be1c63f-1f49-4a5b-bfa3-86baf9e1b120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:29.487426 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3705/7319] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:29.488756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1c63f-1f49-4a5b-bfa3-86baf9e1b120 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:29.491471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6be1c63f-1f49-4a5b-bfa3-86baf9e1b120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:29.588481 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3615/7320] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:29.598846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa977a-a56a-43ef-a22a-fafcb76a01f2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:29.599358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1c63f-1f49-4a5b-bfa3-86baf9e1b120 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:29.611591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f2819-c7e2-4522-9f4c-e3daba6b0613 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:29.612500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f2819-c7e2-4522-9f4c-e3daba6b0613 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:29.614366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f2819-c7e2-4522-9f4c-e3daba6b0613 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:29.616217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765f2819-c7e2-4522-9f4c-e3daba6b0613 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:29.642925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f2819-c7e2-4522-9f4c-e3daba6b0613 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:29.648338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765f2819-c7e2-4522-9f4c-e3daba6b0613 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:29.648504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fa977a-a56a-43ef-a22a-fafcb76a01f2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:29.653110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2c292-29a6-4b2b-9c58-dd92a379d0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:29.654037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2c292-29a6-4b2b-9c58-dd92a379d0da admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:29.654581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2c292-29a6-4b2b-9c58-dd92a379d0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:29.655081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd2c292-29a6-4b2b-9c58-dd92a379d0da admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:29.656022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2c292-29a6-4b2b-9c58-dd92a379d0da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:43:29.656721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2c292-29a6-4b2b-9c58-dd92a379d0da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:29.660252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd2c292-29a6-4b2b-9c58-dd92a379d0da admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:29.675773 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3706/7321] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:29 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:43:29.680507 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3616/7322] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:29.683669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f2819-c7e2-4522-9f4c-e3daba6b0613 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:29.688649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2c292-29a6-4b2b-9c58-dd92a379d0da admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:29.692890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-765f2819-c7e2-4522-9f4c-e3daba6b0613 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:29.700315 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:29.728409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd2c292-29a6-4b2b-9c58-dd92a379d0da admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:29.738286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce88de0-7788-476f-ab2e-9998e24ae6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:29.739218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce88de0-7788-476f-ab2e-9998e24ae6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:29.740468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce88de0-7788-476f-ab2e-9998e24ae6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:29.741280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce88de0-7788-476f-ab2e-9998e24ae6b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:29.742288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce88de0-7788-476f-ab2e-9998e24ae6b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:29.743936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765f2819-c7e2-4522-9f4c-e3daba6b0613 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:29.757292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce88de0-7788-476f-ab2e-9998e24ae6b5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:29.758225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecb91e-5e7e-43bc-9486-3083ceb99b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:29.758934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecb91e-5e7e-43bc-9486-3083ceb99b63 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:29.759226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecb91e-5e7e-43bc-9486-3083ceb99b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:29.759512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ecb91e-5e7e-43bc-9486-3083ceb99b63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:29.764791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ecb91e-5e7e-43bc-9486-3083ceb99b63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:29.768834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ecb91e-5e7e-43bc-9486-3083ceb99b63 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:29.871793 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:29.926547 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3617/7323] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:43:29 2022] POST /identity/v3/projects => generated 381 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:29.930458 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3707/7324] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:43:29 2022] POST /identity/v3/projects => generated 367 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:29.931738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce88de0-7788-476f-ab2e-9998e24ae6b5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:29.933564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecb91e-5e7e-43bc-9486-3083ceb99b63 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:30.153378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ecb91e-5e7e-43bc-9486-3083ceb99b63 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:30.154986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce88de0-7788-476f-ab2e-9998e24ae6b5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:30.165280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba864a-bfa0-43d2-ad08-1a2c716f61cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:30.166320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb3ca3-a58c-4803-9634-2efcde76d175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:30.167216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba864a-bfa0-43d2-ad08-1a2c716f61cd admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:30.168070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb3ca3-a58c-4803-9634-2efcde76d175 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:30.169041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb3ca3-a58c-4803-9634-2efcde76d175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:30.169363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba864a-bfa0-43d2-ad08-1a2c716f61cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:30.169804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba864a-bfa0-43d2-ad08-1a2c716f61cd admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:30.170263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb3ca3-a58c-4803-9634-2efcde76d175 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:30.177217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba864a-bfa0-43d2-ad08-1a2c716f61cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:30.183941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba864a-bfa0-43d2-ad08-1a2c716f61cd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:30.191814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb3ca3-a58c-4803-9634-2efcde76d175 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:30.196028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb3ca3-a58c-4803-9634-2efcde76d175 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:30.359564 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3618/7325] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:43:29 2022] POST /identity/v3/users => generated 291 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:30.360425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba864a-bfa0-43d2-ad08-1a2c716f61cd admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:30.367629 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3708/7326] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:43:29 2022] POST /identity/v3/users => generated 290 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:30.368611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb3ca3-a58c-4803-9634-2efcde76d175 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:30.377431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b8ba864a-bfa0-43d2-ad08-1a2c716f61cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:30.378944 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:30.412653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb3ca3-a58c-4803-9634-2efcde76d175 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:30.436862 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:30.445683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba864a-bfa0-43d2-ad08-1a2c716f61cd admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:30.451529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148b079-9925-4d3a-9b3a-ef0738a998f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:30.464096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148b079-9925-4d3a-9b3a-ef0738a998f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:30.464436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148b079-9925-4d3a-9b3a-ef0738a998f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:30.464727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148b079-9925-4d3a-9b3a-ef0738a998f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:30.465538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148b079-9925-4d3a-9b3a-ef0738a998f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:30.467226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148b079-9925-4d3a-9b3a-ef0738a998f5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:30.490058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2c4b4-f8c6-4c19-9039-8115d72eacdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:30.492017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2c4b4-f8c6-4c19-9039-8115d72eacdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:30.492271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2c4b4-f8c6-4c19-9039-8115d72eacdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:30.492559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2c4b4-f8c6-4c19-9039-8115d72eacdd admin admin] PATH_INFO: `/v3/users/715ec227b2bd4ca798a8b1e417870a0f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:30.495665 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:30.505451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2c4b4-f8c6-4c19-9039-8115d72eacdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=715ec227b2bd4ca798a8b1e417870a0f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:30.507610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2c4b4-f8c6-4c19-9039-8115d72eacdd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:30.543047 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3709/7327] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:30.546008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148b079-9925-4d3a-9b3a-ef0738a998f5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:30.586881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148b079-9925-4d3a-9b3a-ef0738a998f5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:30.605924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bff85-731b-4938-8158-378d102eedf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:30.606833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bff85-731b-4938-8158-378d102eedf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:30.607128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bff85-731b-4938-8158-378d102eedf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:30.607407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99bff85-731b-4938-8158-378d102eedf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:30.608159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bff85-731b-4938-8158-378d102eedf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:30.617045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99bff85-731b-4938-8158-378d102eedf2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:30.670631 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3710/7328] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:30.670631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bff85-731b-4938-8158-378d102eedf2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:30.690060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99bff85-731b-4938-8158-378d102eedf2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:30.701308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d8235-cced-4ea1-a6e0-8244b4cb48bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:30.702005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d8235-cced-4ea1-a6e0-8244b4cb48bd admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:30.702324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d8235-cced-4ea1-a6e0-8244b4cb48bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:30.702611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5d8235-cced-4ea1-a6e0-8244b4cb48bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:30.707763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d8235-cced-4ea1-a6e0-8244b4cb48bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:30.711466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5d8235-cced-4ea1-a6e0-8244b4cb48bd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:30.750153 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3711/7329] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:30.750153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d8235-cced-4ea1-a6e0-8244b4cb48bd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:30.766521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5d8235-cced-4ea1-a6e0-8244b4cb48bd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:30.785535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f846f-5e29-4fa0-9ab2-a5d65997ffd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:30.786658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f846f-5e29-4fa0-9ab2-a5d65997ffd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:30.786948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f846f-5e29-4fa0-9ab2-a5d65997ffd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:30.787236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f846f-5e29-4fa0-9ab2-a5d65997ffd2 admin admin] PATH_INFO: `/v3/projects/a7a3bc2f1a5d428aa67459a4db8d8e61/users/fc957af991f24888a521e5b860339af7/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:30.840306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c8c2c4b4-f8c6-4c19-9039-8115d72eacdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '715ec227b2bd4ca798a8b1e417870a0f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:30.872410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f846f-5e29-4fa0-9ab2-a5d65997ffd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a3bc2f1a5d428aa67459a4db8d8e61, user_id=fc957af991f24888a521e5b860339af7, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:30.908598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044f846f-5e29-4fa0-9ab2-a5d65997ffd2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:30.930705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c8c2c4b4-f8c6-4c19-9039-8115d72eacdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '715ec227b2bd4ca798a8b1e417870a0f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:30.932372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c8c2c4b4-f8c6-4c19-9039-8115d72eacdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '715ec227b2bd4ca798a8b1e417870a0f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:30.933282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c8c2c4b4-f8c6-4c19-9039-8115d72eacdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '715ec227b2bd4ca798a8b1e417870a0f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:30.937405 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:31.000921 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3712/7330] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:30 2022] PUT /identity/v3/projects/a7a3bc2f1a5d428aa67459a4db8d8e61/users/fc957af991f24888a521e5b860339af7/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:31.002487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f846f-5e29-4fa0-9ab2-a5d65997ffd2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:31.006148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-044f846f-5e29-4fa0-9ab2-a5d65997ffd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:31.012123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c8c2c4b4-f8c6-4c19-9039-8115d72eacdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '715ec227b2bd4ca798a8b1e417870a0f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:31.126161 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3619/7331] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:30 2022] DELETE /identity/v3/users/715ec227b2bd4ca798a8b1e417870a0f => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:31.126161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2c4b4-f8c6-4c19-9039-8115d72eacdd admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:31.131692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c8c2c4b4-f8c6-4c19-9039-8115d72eacdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:31.311851 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:31.447286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f846f-5e29-4fa0-9ab2-a5d65997ffd2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:31.503733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2c4b4-f8c6-4c19-9039-8115d72eacdd admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:31.519320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162559cb-4899-4817-b069-52945ff72855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:31.520024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162559cb-4899-4817-b069-52945ff72855 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:31.520316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162559cb-4899-4817-b069-52945ff72855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:31.524185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162559cb-4899-4817-b069-52945ff72855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:31.530907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-162559cb-4899-4817-b069-52945ff72855 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:31.758470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c745d-8079-482a-8619-60f678307e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:31.762209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c745d-8079-482a-8619-60f678307e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:31.769007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c745d-8079-482a-8619-60f678307e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:31.769449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c745d-8079-482a-8619-60f678307e72 admin admin] PATH_INFO: `/v3/projects/f7d142cf80aa4ec189d862302f79dd0a/users/6f048d2f8686464783cacde89b6ccf9d/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:31.791375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162559cb-4899-4817-b069-52945ff72855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:31.794873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162559cb-4899-4817-b069-52945ff72855 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:31.823313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c745d-8079-482a-8619-60f678307e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d142cf80aa4ec189d862302f79dd0a, user_id=6f048d2f8686464783cacde89b6ccf9d, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:31.826553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c745d-8079-482a-8619-60f678307e72 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:31.849642 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3620/7332] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 725 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:43:31.851345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162559cb-4899-4817-b069-52945ff72855 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:31.856826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-162559cb-4899-4817-b069-52945ff72855 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:31.916545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162559cb-4899-4817-b069-52945ff72855 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:31.946974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bcd5d2-9a21-4bfb-9ebc-c0dc22c891a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:31.950270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcd5d2-9a21-4bfb-9ebc-c0dc22c891a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:31.950270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcd5d2-9a21-4bfb-9ebc-c0dc22c891a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:31.950270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bcd5d2-9a21-4bfb-9ebc-c0dc22c891a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:31.950270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcd5d2-9a21-4bfb-9ebc-c0dc22c891a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:31.951480 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3713/7333] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:31 2022] PUT /identity/v3/projects/f7d142cf80aa4ec189d862302f79dd0a/users/6f048d2f8686464783cacde89b6ccf9d/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 950 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:31.953628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc6249-4071-4c9a-9575-63b130ee0cfe None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:31.954241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc6249-4071-4c9a-9575-63b130ee0cfe None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:31.955383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc6249-4071-4c9a-9575-63b130ee0cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:31.961431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bcd5d2-9a21-4bfb-9ebc-c0dc22c891a2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:31.991825 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3621/7334] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:31.993516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d487289-37e1-434d-b12b-1cdd0be741b1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:31.993809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d487289-37e1-434d-b12b-1cdd0be741b1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:31.993920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d487289-37e1-434d-b12b-1cdd0be741b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:32.008663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f8bc6249-4071-4c9a-9575-63b130ee0cfe None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:32.012442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f8bc6249-4071-4c9a-9575-63b130ee0cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:32.049592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3d487289-37e1-434d-b12b-1cdd0be741b1 None None] MFA Rules not processed for user `6f048d2f8686464783cacde89b6ccf9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:32.050862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3d487289-37e1-434d-b12b-1cdd0be741b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:32.165671 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3622/7335] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:32.167100 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3714/7336] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:32.167571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d487289-37e1-434d-b12b-1cdd0be741b1 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:32.170795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc6249-4071-4c9a-9575-63b130ee0cfe None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:32.184790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d487289-37e1-434d-b12b-1cdd0be741b1 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:32.189479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc6249-4071-4c9a-9575-63b130ee0cfe None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:32.196051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a14f09-66a5-4e89-9eb4-9de6b83de0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:32.197388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a14f09-66a5-4e89-9eb4-9de6b83de0f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:32.197677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a14f09-66a5-4e89-9eb4-9de6b83de0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:32.197958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a14f09-66a5-4e89-9eb4-9de6b83de0f9 admin admin] PATH_INFO: `/v3/projects/a7a3bc2f1a5d428aa67459a4db8d8e61/users/fc957af991f24888a521e5b860339af7/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:32.201457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a14f09-66a5-4e89-9eb4-9de6b83de0f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a3bc2f1a5d428aa67459a4db8d8e61, user_id=fc957af991f24888a521e5b860339af7, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:32.203503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70675bbe-0209-42d1-9a3f-4cbc460fafd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:32.208108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70675bbe-0209-42d1-9a3f-4cbc460fafd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:32.208277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a14f09-66a5-4e89-9eb4-9de6b83de0f9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:32.208366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70675bbe-0209-42d1-9a3f-4cbc460fafd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:32.208366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70675bbe-0209-42d1-9a3f-4cbc460fafd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:32.208366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70675bbe-0209-42d1-9a3f-4cbc460fafd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:32.209628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70675bbe-0209-42d1-9a3f-4cbc460fafd3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:32.247034 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3623/7337] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:32 2022] PUT /identity/v3/projects/a7a3bc2f1a5d428aa67459a4db8d8e61/users/fc957af991f24888a521e5b860339af7/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:32.249236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a14f09-66a5-4e89-9eb4-9de6b83de0f9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:32.252177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-87a14f09-66a5-4e89-9eb4-9de6b83de0f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:32.272549 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:32.358873 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3715/7338] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:43:32 2022] POST /identity/v3/projects => generated 381 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:43:32.360252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c58c9d-f2c1-4245-b7db-28bb8cd20867 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:32.360627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c58c9d-f2c1-4245-b7db-28bb8cd20867 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:32.361378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c58c9d-f2c1-4245-b7db-28bb8cd20867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:32.365719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a14f09-66a5-4e89-9eb4-9de6b83de0f9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:32.381496 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:32.447252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e453e-30a9-4973-b1e5-4702715e6a40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:32.448736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e453e-30a9-4973-b1e5-4702715e6a40 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:32.449124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e453e-30a9-4973-b1e5-4702715e6a40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:32.449504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e453e-30a9-4973-b1e5-4702715e6a40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:32.452458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d6c58c9d-f2c1-4245-b7db-28bb8cd20867 None None] MFA Rules not processed for user `fc957af991f24888a521e5b860339af7`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:32.454226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d6c58c9d-f2c1-4245-b7db-28bb8cd20867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:32.568072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e453e-30a9-4973-b1e5-4702715e6a40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:32.572041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e453e-30a9-4973-b1e5-4702715e6a40 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:32.591667 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3624/7339] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:43:32.593909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e453e-30a9-4973-b1e5-4702715e6a40 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:32.607902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e453e-30a9-4973-b1e5-4702715e6a40 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:32.618984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4128da-f324-4add-9b5c-54eee138c4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:32.620211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4128da-f324-4add-9b5c-54eee138c4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:32.620713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4128da-f324-4add-9b5c-54eee138c4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:32.621089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4128da-f324-4add-9b5c-54eee138c4d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:32.621974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4128da-f324-4add-9b5c-54eee138c4d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:32.623504 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3716/7340] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:32 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:32.625287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4128da-f324-4add-9b5c-54eee138c4d1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:32.629628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c58c9d-f2c1-4245-b7db-28bb8cd20867 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:32.651531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c58c9d-f2c1-4245-b7db-28bb8cd20867 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:32.659074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3176fa-49a7-462b-8355-fded29aac8f2 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:32.660121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3176fa-49a7-462b-8355-fded29aac8f2 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:32.660576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3176fa-49a7-462b-8355-fded29aac8f2 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:32.661030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3176fa-49a7-462b-8355-fded29aac8f2 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:32.666486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3176fa-49a7-462b-8355-fded29aac8f2 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:32.668959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3176fa-49a7-462b-8355-fded29aac8f2 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:32.824183 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3625/7341] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:43:32 2022] POST /identity/v3/users => generated 297 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:32.827101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4128da-f324-4add-9b5c-54eee138c4d1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:32.843286 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3717/7342] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:43:32 2022] POST /identity/v3/projects => generated 360 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:32.846867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3176fa-49a7-462b-8355-fded29aac8f2 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:32.864676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4128da-f324-4add-9b5c-54eee138c4d1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:32.980836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6338d0-caa8-443c-92a4-5012131ea99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:32.981639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6338d0-caa8-443c-92a4-5012131ea99a admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:32.983343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6338d0-caa8-443c-92a4-5012131ea99a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:32.983493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6338d0-caa8-443c-92a4-5012131ea99a admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:32.985814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6338d0-caa8-443c-92a4-5012131ea99a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:32.991033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6338d0-caa8-443c-92a4-5012131ea99a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:33.002967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3176fa-49a7-462b-8355-fded29aac8f2 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:33.012663 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3626/7343] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:32 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:43:33.014564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6864946-81ea-4480-967f-43ad45eae0d4 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:33.015356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6864946-81ea-4480-967f-43ad45eae0d4 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:33.015699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6864946-81ea-4480-967f-43ad45eae0d4 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:33.016155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6864946-81ea-4480-967f-43ad45eae0d4 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:33.016844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6864946-81ea-4480-967f-43ad45eae0d4 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:33.017044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6338d0-caa8-443c-92a4-5012131ea99a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:33.021882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6864946-81ea-4480-967f-43ad45eae0d4 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:33.043593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6338d0-caa8-443c-92a4-5012131ea99a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:33.065773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b8700-9490-406d-8ca5-c8e3a76d0f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:33.066744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b8700-9490-406d-8ca5-c8e3a76d0f5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:33.067030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b8700-9490-406d-8ca5-c8e3a76d0f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:33.067314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b8700-9490-406d-8ca5-c8e3a76d0f5a admin admin] PATH_INFO: `/v3/projects/02209d4f186c4b578922d28b128e5329/users/bdf8d6e64232404f997e260ef2585534/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:33.098390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b8700-9490-406d-8ca5-c8e3a76d0f5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=02209d4f186c4b578922d28b128e5329, user_id=bdf8d6e64232404f997e260ef2585534, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:33.101398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b8700-9490-406d-8ca5-c8e3a76d0f5a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:33.260712 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3627/7344] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:33 2022] PUT /identity/v3/projects/02209d4f186c4b578922d28b128e5329/users/bdf8d6e64232404f997e260ef2585534/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:33.264987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b8700-9490-406d-8ca5-c8e3a76d0f5a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:33.280716 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3718/7345] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:43:32 2022] POST /identity/v3/users => generated 367 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:33.283501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6864946-81ea-4480-967f-43ad45eae0d4 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:33.300656 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:33.315444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6864946-81ea-4480-967f-43ad45eae0d4 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:33.460768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b8700-9490-406d-8ca5-c8e3a76d0f5a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:33.463948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f8251-3ef2-451a-a6d0-c23c35cded18 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:33.468333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f8251-3ef2-451a-a6d0-c23c35cded18 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:33.468635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f8251-3ef2-451a-a6d0-c23c35cded18 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:33.468924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f8251-3ef2-451a-a6d0-c23c35cded18 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/users/4d369751bb0d449790c333886aa60f57` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:33.472636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397f85d-1156-4d43-914f-b2e526c269aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:33.473359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397f85d-1156-4d43-914f-b2e526c269aa admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:33.474533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397f85d-1156-4d43-914f-b2e526c269aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:33.474816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f397f85d-1156-4d43-914f-b2e526c269aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:33.475744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397f85d-1156-4d43-914f-b2e526c269aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:33.477469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f397f85d-1156-4d43-914f-b2e526c269aa admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:33.491540 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3628/7346] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:33 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:33.505342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397f85d-1156-4d43-914f-b2e526c269aa admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:33.505891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f8251-3ef2-451a-a6d0-c23c35cded18 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:get_user(user_id=4d369751bb0d449790c333886aa60f57)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:33.508984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f8251-3ef2-451a-a6d0-c23c35cded18 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:33.514274 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3719/7347] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Jul 19 14:43:33 2022] GET /identity/v3/users/4d369751bb0d449790c333886aa60f57 => generated 367 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:33.515883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f8251-3ef2-451a-a6d0-c23c35cded18 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:33.524988 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:33.539594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f8251-3ef2-451a-a6d0-c23c35cded18 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:33.540920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8db65-9f4d-4a83-8547-3a330432e422 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:33.543368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8db65-9f4d-4a83-8547-3a330432e422 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:33.545263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8db65-9f4d-4a83-8547-3a330432e422 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:33.545724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8db65-9f4d-4a83-8547-3a330432e422 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/users/4d369751bb0d449790c333886aa60f57` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:33.551108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8db65-9f4d-4a83-8547-3a330432e422 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4d369751bb0d449790c333886aa60f57)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:33.557165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8db65-9f4d-4a83-8547-3a330432e422 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:33.564699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f397f85d-1156-4d43-914f-b2e526c269aa admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:33.581538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc1604-8706-4cb1-a76a-7e1f72cc598d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:33.582707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc1604-8706-4cb1-a76a-7e1f72cc598d admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:33.583099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc1604-8706-4cb1-a76a-7e1f72cc598d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:33.587798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc1604-8706-4cb1-a76a-7e1f72cc598d admin admin] PATH_INFO: `/v3/projects/02209d4f186c4b578922d28b128e5329/users/bdf8d6e64232404f997e260ef2585534/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:33.594922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc1604-8706-4cb1-a76a-7e1f72cc598d admin admin] RBAC: Authorizing `identity:create_grant(project_id=02209d4f186c4b578922d28b128e5329, user_id=bdf8d6e64232404f997e260ef2585534, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:33.594922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc1604-8706-4cb1-a76a-7e1f72cc598d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:33.647766 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3629/7348] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:33 2022] PUT /identity/v3/projects/02209d4f186c4b578922d28b128e5329/users/bdf8d6e64232404f997e260ef2585534/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:33.660404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6708a-a482-4781-9b75-2d0996aa677d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:33.660842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6708a-a482-4781-9b75-2d0996aa677d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:33.661225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6708a-a482-4781-9b75-2d0996aa677d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:33.716320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b3a6708a-a482-4781-9b75-2d0996aa677d None None] MFA Rules not processed for user `bdf8d6e64232404f997e260ef2585534`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:33.717910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b3a6708a-a482-4781-9b75-2d0996aa677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:33.766256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b4c8db65-9f4d-4a83-8547-3a330432e422 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d369751bb0d449790c333886aa60f57'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:33.796510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b4c8db65-9f4d-4a83-8547-3a330432e422 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d369751bb0d449790c333886aa60f57'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:33.827044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b4c8db65-9f4d-4a83-8547-3a330432e422 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d369751bb0d449790c333886aa60f57'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:33.829869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b4c8db65-9f4d-4a83-8547-3a330432e422 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d369751bb0d449790c333886aa60f57'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:33.917211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b4c8db65-9f4d-4a83-8547-3a330432e422 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d369751bb0d449790c333886aa60f57'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:33.925669 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3720/7349] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:33 2022] DELETE /identity/v3/users/4d369751bb0d449790c333886aa60f57 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:33.930564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8db65-9f4d-4a83-8547-3a330432e422 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:33.933193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b4c8db65-9f4d-4a83-8547-3a330432e422 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:33.959346 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3630/7350] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:33.978873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6708a-a482-4781-9b75-2d0996aa677d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:33.984113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b3a6708a-a482-4781-9b75-2d0996aa677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:34.063720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8db65-9f4d-4a83-8547-3a330432e422 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:34.070957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea27399-59a1-4026-ab4b-a426f194e724 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:34.072162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea27399-59a1-4026-ab4b-a426f194e724 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:34.072650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea27399-59a1-4026-ab4b-a426f194e724 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:34.073239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea27399-59a1-4026-ab4b-a426f194e724 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/projects/107e300ecfda4d018aae1c322a50a27c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:34.075209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea27399-59a1-4026-ab4b-a426f194e724 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:delete_project(project_id=107e300ecfda4d018aae1c322a50a27c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:34.077543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea27399-59a1-4026-ab4b-a426f194e724 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:34.240019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6708a-a482-4781-9b75-2d0996aa677d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:34.254447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-aea27399-59a1-4026-ab4b-a426f194e724 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '107e300ecfda4d018aae1c322a50a27c', 'request_id': 'req-aea27399-59a1-4026-ab4b-a426f194e724'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:34.285662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-aea27399-59a1-4026-ab4b-a426f194e724 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '107e300ecfda4d018aae1c322a50a27c', 'request_id': 'req-aea27399-59a1-4026-ab4b-a426f194e724'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:34.306472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-aea27399-59a1-4026-ab4b-a426f194e724 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '107e300ecfda4d018aae1c322a50a27c', 'request_id': 'req-aea27399-59a1-4026-ab4b-a426f194e724'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:34.375911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed6577-4207-40ba-ac50-d50e461211eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:34.378407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed6577-4207-40ba-ac50-d50e461211eb service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:34.378407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed6577-4207-40ba-ac50-d50e461211eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:34.378407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed6577-4207-40ba-ac50-d50e461211eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:34.383434 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:34.402630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-aea27399-59a1-4026-ab4b-a426f194e724 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] The token cache is being invalidate because project 107e300ecfda4d018aae1c322a50a27c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:34.407147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-aea27399-59a1-4026-ab4b-a426f194e724 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:34.407147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-aea27399-59a1-4026-ab4b-a426f194e724 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:34.407147 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3721/7351] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:33 2022] DELETE /identity/v3/projects/107e300ecfda4d018aae1c322a50a27c => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:34.409890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea27399-59a1-4026-ab4b-a426f194e724 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:34.425971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-aea27399-59a1-4026-ab4b-a426f194e724 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:34.553724 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:34.605828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed6577-4207-40ba-ac50-d50e461211eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:34.609662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed6577-4207-40ba-ac50-d50e461211eb service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:34.656743 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3631/7352] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:43:34.661740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed6577-4207-40ba-ac50-d50e461211eb service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:34.668625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea27399-59a1-4026-ab4b-a426f194e724 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:34.688129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae7055-e9c8-4c92-adcd-dfc6559fde00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:34.692346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae7055-e9c8-4c92-adcd-dfc6559fde00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:34.698512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae7055-e9c8-4c92-adcd-dfc6559fde00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:34.699091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aae7055-e9c8-4c92-adcd-dfc6559fde00 admin admin] PATH_INFO: `/v3/projects/ca8b3055c4354f989534aa2079e081b2` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:34.708708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae7055-e9c8-4c92-adcd-dfc6559fde00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca8b3055c4354f989534aa2079e081b2)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:34.718019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aae7055-e9c8-4c92-adcd-dfc6559fde00 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:34.934060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed6577-4207-40ba-ac50-d50e461211eb service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:34.956740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61560f-0610-4c1f-a1a0-c94975e36a27 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:34.964986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61560f-0610-4c1f-a1a0-c94975e36a27 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:34.964986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61560f-0610-4c1f-a1a0-c94975e36a27 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:34.964986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61560f-0610-4c1f-a1a0-c94975e36a27 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:34.964986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61560f-0610-4c1f-a1a0-c94975e36a27 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:34.964986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61560f-0610-4c1f-a1a0-c94975e36a27 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:35.009065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0aae7055-e9c8-4c92-adcd-dfc6559fde00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca8b3055c4354f989534aa2079e081b2', 'request_id': 'req-0aae7055-e9c8-4c92-adcd-dfc6559fde00'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:35.019119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0aae7055-e9c8-4c92-adcd-dfc6559fde00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca8b3055c4354f989534aa2079e081b2', 'request_id': 'req-0aae7055-e9c8-4c92-adcd-dfc6559fde00'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:35.027962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0aae7055-e9c8-4c92-adcd-dfc6559fde00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca8b3055c4354f989534aa2079e081b2', 'request_id': 'req-0aae7055-e9c8-4c92-adcd-dfc6559fde00'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:35.127786 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3632/7353] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:43:34 2022] POST /identity/v3/projects => generated 358 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:35.129002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61560f-0610-4c1f-a1a0-c94975e36a27 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:35.136778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7f61560f-0610-4c1f-a1a0-c94975e36a27 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:35.156975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0aae7055-e9c8-4c92-adcd-dfc6559fde00 admin admin] The token cache is being invalidate because project ca8b3055c4354f989534aa2079e081b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:35.158806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0aae7055-e9c8-4c92-adcd-dfc6559fde00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:35.160603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0aae7055-e9c8-4c92-adcd-dfc6559fde00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:35.173546 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3722/7354] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:34 2022] DELETE /identity/v3/projects/ca8b3055c4354f989534aa2079e081b2 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:35.179342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae7055-e9c8-4c92-adcd-dfc6559fde00 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:35.191879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0aae7055-e9c8-4c92-adcd-dfc6559fde00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:35.278518 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:35.282804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61560f-0610-4c1f-a1a0-c94975e36a27 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:35.288311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf4c9e8-1503-4688-a215-de8a3a8b4ad5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:35.289231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4c9e8-1503-4688-a215-de8a3a8b4ad5 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:35.289682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4c9e8-1503-4688-a215-de8a3a8b4ad5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:35.290165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf4c9e8-1503-4688-a215-de8a3a8b4ad5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:35.292618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eaf4c9e8-1503-4688-a215-de8a3a8b4ad5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:35.351750 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:35.378171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4c9e8-1503-4688-a215-de8a3a8b4ad5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:35.380122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf4c9e8-1503-4688-a215-de8a3a8b4ad5 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:35.397192 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3633/7355] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:43:35.398754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facda707-ee00-46f3-9201-e4ef9b86e94c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:35.399045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facda707-ee00-46f3-9201-e4ef9b86e94c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:35.399327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facda707-ee00-46f3-9201-e4ef9b86e94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:35.428513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-facda707-ee00-46f3-9201-e4ef9b86e94c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:35.432607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-facda707-ee00-46f3-9201-e4ef9b86e94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:35.466177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aae7055-e9c8-4c92-adcd-dfc6559fde00 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:35.613719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102384d-a435-488e-86ad-02fef31fbcb6 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:35.615167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102384d-a435-488e-86ad-02fef31fbcb6 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:35.615497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102384d-a435-488e-86ad-02fef31fbcb6 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:35.615792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102384d-a435-488e-86ad-02fef31fbcb6 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:35.620930 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:35.621665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102384d-a435-488e-86ad-02fef31fbcb6 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:35.625521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102384d-a435-488e-86ad-02fef31fbcb6 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:35.634573 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3634/7356] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:35.643300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7540350-8379-43fb-b8ad-f272b032760a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:35.643611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7540350-8379-43fb-b8ad-f272b032760a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:35.643901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7540350-8379-43fb-b8ad-f272b032760a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:35.706987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c7540350-8379-43fb-b8ad-f272b032760a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:35.710070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c7540350-8379-43fb-b8ad-f272b032760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:35.738179 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3635/7357] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:43:35.749849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7540350-8379-43fb-b8ad-f272b032760a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:35.767647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7540350-8379-43fb-b8ad-f272b032760a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:35.793750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ba71f-55b3-4518-be53-659f7c4ada32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:35.793750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ba71f-55b3-4518-be53-659f7c4ada32 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:35.793750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ba71f-55b3-4518-be53-659f7c4ada32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:35.793750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ba71f-55b3-4518-be53-659f7c4ada32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:35.794252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ba71f-55b3-4518-be53-659f7c4ada32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:43:35.794252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ba71f-55b3-4518-be53-659f7c4ada32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:35.794252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ba71f-55b3-4518-be53-659f7c4ada32 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:35.799677 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3723/7358] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:43:35 2022] POST /identity/v3/users => generated 414 bytes in 625 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:35.808251 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:35.827869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102384d-a435-488e-86ad-02fef31fbcb6 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:35.860578 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3636/7359] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:35.863546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ba71f-55b3-4518-be53-659f7c4ada32 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:35.870875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102384d-a435-488e-86ad-02fef31fbcb6 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:35.887768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d1fb7-4236-4a7a-a663-2ad7b6366f1a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:35.888525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d1fb7-4236-4a7a-a663-2ad7b6366f1a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:35.888824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d1fb7-4236-4a7a-a663-2ad7b6366f1a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:35.889115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d1fb7-4236-4a7a-a663-2ad7b6366f1a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:35.890368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d1fb7-4236-4a7a-a663-2ad7b6366f1a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:35.896196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d1fb7-4236-4a7a-a663-2ad7b6366f1a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:35.901481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ba71f-55b3-4518-be53-659f7c4ada32 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:35.911576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375ddeb-7d18-4a6a-acd5-52c578d0c909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:35.915051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375ddeb-7d18-4a6a-acd5-52c578d0c909 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:35.916234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375ddeb-7d18-4a6a-acd5-52c578d0c909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:35.916739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375ddeb-7d18-4a6a-acd5-52c578d0c909 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:35.920581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375ddeb-7d18-4a6a-acd5-52c578d0c909 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:35.928969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375ddeb-7d18-4a6a-acd5-52c578d0c909 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:36.033325 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3724/7360] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:43:35 2022] POST /identity/v3/roles => generated 239 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:36.039777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d1fb7-4236-4a7a-a663-2ad7b6366f1a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:36.058881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d1fb7-4236-4a7a-a663-2ad7b6366f1a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:36.070865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06305e52-7a46-4301-aa54-01134d41b17b tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:36.071775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06305e52-7a46-4301-aa54-01134d41b17b tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:36.072072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06305e52-7a46-4301-aa54-01134d41b17b tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:36.072363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06305e52-7a46-4301-aa54-01134d41b17b tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/users/caec4b2ae448489cb4175b3af49af2f6` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:36.108567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06305e52-7a46-4301-aa54-01134d41b17b tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:get_user(user_id=caec4b2ae448489cb4175b3af49af2f6)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:36.110970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06305e52-7a46-4301-aa54-01134d41b17b tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:36.116307 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3725/7361] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Jul 19 14:43:36 2022] GET /identity/v3/users/caec4b2ae448489cb4175b3af49af2f6 => generated 414 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:36.117211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06305e52-7a46-4301-aa54-01134d41b17b tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:36.137755 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3637/7362] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:43:35 2022] POST /identity/v3/projects => generated 365 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:36.139148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375ddeb-7d18-4a6a-acd5-52c578d0c909 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:36.142740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06305e52-7a46-4301-aa54-01134d41b17b tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:36.272167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c271a-90d3-4e88-8bcc-d9f65de179ea tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:36.273069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c271a-90d3-4e88-8bcc-d9f65de179ea tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:36.273362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c271a-90d3-4e88-8bcc-d9f65de179ea tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:36.273654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c271a-90d3-4e88-8bcc-d9f65de179ea tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/roles/c964b5c3b7514b78928cfce82414e3e9` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:36.275274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c271a-90d3-4e88-8bcc-d9f65de179ea tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:get_role(role_id=c964b5c3b7514b78928cfce82414e3e9)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:36.282740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c271a-90d3-4e88-8bcc-d9f65de179ea tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:36.286800 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3726/7363] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Jul 19 14:43:36 2022] GET /identity/v3/roles/c964b5c3b7514b78928cfce82414e3e9 => generated 239 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:36.291093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c271a-90d3-4e88-8bcc-d9f65de179ea tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:36.319768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c271a-90d3-4e88-8bcc-d9f65de179ea tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:36.328234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375ddeb-7d18-4a6a-acd5-52c578d0c909 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:36.332849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd0fdf-3fa7-461c-af91-2743b415813a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:36.333873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd0fdf-3fa7-461c-af91-2743b415813a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:36.335683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd0fdf-3fa7-461c-af91-2743b415813a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:36.336174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd0fdf-3fa7-461c-af91-2743b415813a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:36.337099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd0fdf-3fa7-461c-af91-2743b415813a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:36.345774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd0fdf-3fa7-461c-af91-2743b415813a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:36.351113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a149157-adff-47c5-ade1-7fbd1fa8e304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:36.351811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a149157-adff-47c5-ade1-7fbd1fa8e304 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:36.352127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a149157-adff-47c5-ade1-7fbd1fa8e304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:36.352469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a149157-adff-47c5-ade1-7fbd1fa8e304 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:36.353319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a149157-adff-47c5-ade1-7fbd1fa8e304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:36.355305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a149157-adff-47c5-ade1-7fbd1fa8e304 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:36.464810 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3638/7364] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:43:36 2022] POST /identity/v3/users => generated 283 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:36.466634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a149157-adff-47c5-ade1-7fbd1fa8e304 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:36.479976 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3727/7365] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:43:36 2022] POST /identity/v3/projects => generated 360 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:36.481172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd0fdf-3fa7-461c-af91-2743b415813a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:36.494562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a149157-adff-47c5-ade1-7fbd1fa8e304 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:36.665808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b8346-4a4b-423c-9595-3ea93da8ba87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:36.668247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b8346-4a4b-423c-9595-3ea93da8ba87 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:36.669835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b8346-4a4b-423c-9595-3ea93da8ba87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:36.670174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b8346-4a4b-423c-9595-3ea93da8ba87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:36.674484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b8346-4a4b-423c-9595-3ea93da8ba87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:36.676557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b8346-4a4b-423c-9595-3ea93da8ba87 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:36.708341 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3639/7366] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:36 2022] GET /identity/v3/roles => generated 1650 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:36.710204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b8346-4a4b-423c-9595-3ea93da8ba87 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:36.742595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b8346-4a4b-423c-9595-3ea93da8ba87 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:36.749670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039ecdf-e9d0-4e49-8cce-ba8b5dfbd85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:36.750843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039ecdf-e9d0-4e49-8cce-ba8b5dfbd85c admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:36.753270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039ecdf-e9d0-4e49-8cce-ba8b5dfbd85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:36.753918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039ecdf-e9d0-4e49-8cce-ba8b5dfbd85c admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:36.755107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039ecdf-e9d0-4e49-8cce-ba8b5dfbd85c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:36.758043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6039ecdf-e9d0-4e49-8cce-ba8b5dfbd85c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:36.790279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd0fdf-3fa7-461c-af91-2743b415813a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:36.794460 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3640/7367] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:36 2022] GET /identity/v3/roles => generated 1650 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:36.796776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039ecdf-e9d0-4e49-8cce-ba8b5dfbd85c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:36.818881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5f5bc-e657-4b6f-9a37-fb98905fa083 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:36.819932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5f5bc-e657-4b6f-9a37-fb98905fa083 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:36.820092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5f5bc-e657-4b6f-9a37-fb98905fa083 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:36.820359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5f5bc-e657-4b6f-9a37-fb98905fa083 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/projects/ea23ee474c854b7c90dad9beccf7216e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:36.828708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5f5bc-e657-4b6f-9a37-fb98905fa083 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:get_project(project_id=ea23ee474c854b7c90dad9beccf7216e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:36.831497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf5f5bc-e657-4b6f-9a37-fb98905fa083 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:36.843147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6039ecdf-e9d0-4e49-8cce-ba8b5dfbd85c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:36.850990 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3728/7368] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:43:36 2022] GET /identity/v3/projects/ea23ee474c854b7c90dad9beccf7216e => generated 360 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:36.854344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5f5bc-e657-4b6f-9a37-fb98905fa083 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:36.856206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f5a38-a55d-4a27-8477-adc174a8be5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:36.858918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f5a38-a55d-4a27-8477-adc174a8be5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:36.859219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f5a38-a55d-4a27-8477-adc174a8be5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:36.859513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f5a38-a55d-4a27-8477-adc174a8be5e admin admin] PATH_INFO: `/v3/projects/cb2e3ac979ea4076a72333ca492aabc4/users/eb6677b6e4084aba9da6fb0728040fe9/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:36.891353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5f5bc-e657-4b6f-9a37-fb98905fa083 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:36.911433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f6f76-5e92-4022-b123-3dcecdd9a249 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:36.912614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f6f76-5e92-4022-b123-3dcecdd9a249 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:36.913220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f6f76-5e92-4022-b123-3dcecdd9a249 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:36.913686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f6f76-5e92-4022-b123-3dcecdd9a249 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/projects/ea23ee474c854b7c90dad9beccf7216e/users/caec4b2ae448489cb4175b3af49af2f6/roles/c964b5c3b7514b78928cfce82414e3e9` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:36.920260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f6f76-5e92-4022-b123-3dcecdd9a249 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ea23ee474c854b7c90dad9beccf7216e, user_id=caec4b2ae448489cb4175b3af49af2f6, role_id=c964b5c3b7514b78928cfce82414e3e9)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:36.923618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f5a38-a55d-4a27-8477-adc174a8be5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb2e3ac979ea4076a72333ca492aabc4, user_id=eb6677b6e4084aba9da6fb0728040fe9, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:36.925390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f6f76-5e92-4022-b123-3dcecdd9a249 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:36.930458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f5a38-a55d-4a27-8477-adc174a8be5e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:37.004337 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3729/7369] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:36 2022] PUT /identity/v3/projects/ea23ee474c854b7c90dad9beccf7216e/users/caec4b2ae448489cb4175b3af49af2f6/roles/c964b5c3b7514b78928cfce82414e3e9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:37.005693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f6f76-5e92-4022-b123-3dcecdd9a249 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:37.011009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-df5f6f76-5e92-4022-b123-3dcecdd9a249 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:37.042202 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3641/7370] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:36 2022] PUT /identity/v3/projects/cb2e3ac979ea4076a72333ca492aabc4/users/eb6677b6e4084aba9da6fb0728040fe9/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:37.043453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f5a38-a55d-4a27-8477-adc174a8be5e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:37.232267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f6f76-5e92-4022-b123-3dcecdd9a249 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:37.232868 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:37.271996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f5a38-a55d-4a27-8477-adc174a8be5e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:37.294923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d4553-f114-4c81-aae3-a29f3366f17f tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:37.295691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d4553-f114-4c81-aae3-a29f3366f17f tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:37.295936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d4553-f114-4c81-aae3-a29f3366f17f tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:37.296219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d4553-f114-4c81-aae3-a29f3366f17f tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:37.299082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d4553-f114-4c81-aae3-a29f3366f17f tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:37.300991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d4553-f114-4c81-aae3-a29f3366f17f tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:37.388382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d7192a-f932-42e9-a70a-57f7e26afb27 tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf8d6e64232404f997e260ef2585534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02209d4f186c4b578922d28b128e5329', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:37.389083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7192a-f932-42e9-a70a-57f7e26afb27 tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:37.389405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7192a-f932-42e9-a70a-57f7e26afb27 tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:37.389764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d7192a-f932-42e9-a70a-57f7e26afb27 tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:37.390728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7192a-f932-42e9-a70a-57f7e26afb27 tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:43:37.391051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7192a-f932-42e9-a70a-57f7e26afb27 tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:37.392950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d7192a-f932-42e9-a70a-57f7e26afb27 tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:37.407119 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3730/7371] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:37.409086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6b622-4ddd-4f90-9ac2-9130c435b944 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:37.409383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6b622-4ddd-4f90-9ac2-9130c435b944 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:37.409668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6b622-4ddd-4f90-9ac2-9130c435b944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:37.448436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-49e6b622-4ddd-4f90-9ac2-9130c435b944 None None] MFA Rules not processed for user `eb6677b6e4084aba9da6fb0728040fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:37.452605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-49e6b622-4ddd-4f90-9ac2-9130c435b944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:37.458944 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3642/7372] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:43:37 2022] POST /identity/v3/projects => generated 359 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:37.459970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d4553-f114-4c81-aae3-a29f3366f17f tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:37.518183 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:37.621498 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3731/7373] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:37.622670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6b622-4ddd-4f90-9ac2-9130c435b944 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:37.628473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d4553-f114-4c81-aae3-a29f3366f17f tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:37.636944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187beec9-a308-4f7a-b9c4-38dae8a0befc tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf8d6e64232404f997e260ef2585534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02209d4f186c4b578922d28b128e5329', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:37.638407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187beec9-a308-4f7a-b9c4-38dae8a0befc tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:37.638810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187beec9-a308-4f7a-b9c4-38dae8a0befc tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:37.639166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187beec9-a308-4f7a-b9c4-38dae8a0befc tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:37.639967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187beec9-a308-4f7a-b9c4-38dae8a0befc tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:37.642491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187beec9-a308-4f7a-b9c4-38dae8a0befc tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:37.783053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6b622-4ddd-4f90-9ac2-9130c435b944 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:37.794190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f764b9-2751-4a4c-b5bc-535a6bda9b1c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:37.795409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f764b9-2751-4a4c-b5bc-535a6bda9b1c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:37.795725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f764b9-2751-4a4c-b5bc-535a6bda9b1c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:37.795850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f764b9-2751-4a4c-b5bc-535a6bda9b1c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/projects/194f40b87f544ad78f932f048c0cc134` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:37.800750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f764b9-2751-4a4c-b5bc-535a6bda9b1c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:get_project(project_id=194f40b87f544ad78f932f048c0cc134)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:37.802229 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f764b9-2751-4a4c-b5bc-535a6bda9b1c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:37.807600 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3732/7374] 10.222.0.43 () {58 vars in 1229 bytes} [Tue Jul 19 14:43:37 2022] GET /identity/v3/projects/194f40b87f544ad78f932f048c0cc134 => generated 359 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:37.808448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f764b9-2751-4a4c-b5bc-535a6bda9b1c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:37.815124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a1f764b9-2751-4a4c-b5bc-535a6bda9b1c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:37.900865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f764b9-2751-4a4c-b5bc-535a6bda9b1c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:37.905943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d468a7-8e3e-4382-9850-12dd287b3e1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:37.912120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d468a7-8e3e-4382-9850-12dd287b3e1d service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:37.912120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d468a7-8e3e-4382-9850-12dd287b3e1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:37.912120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d468a7-8e3e-4382-9850-12dd287b3e1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:37.938217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d468a7-8e3e-4382-9850-12dd287b3e1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:37.941533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d468a7-8e3e-4382-9850-12dd287b3e1d service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:37.962765 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3733/7375] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:43:37.973282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d468a7-8e3e-4382-9850-12dd287b3e1d service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:37.980170 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3643/7376] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:43:37 2022] POST /identity/v3/projects => generated 355 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:37.980170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187beec9-a308-4f7a-b9c4-38dae8a0befc tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:38.026620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d468a7-8e3e-4382-9850-12dd287b3e1d service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:38.216479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187beec9-a308-4f7a-b9c4-38dae8a0befc tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:38.232580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d9e9f-60c0-4657-a90c-966d3134fdd1 tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf8d6e64232404f997e260ef2585534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02209d4f186c4b578922d28b128e5329', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:38.232956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48772e8c-aa71-4b11-a47a-3f2438098e24 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:38.233287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d9e9f-60c0-4657-a90c-966d3134fdd1 tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:38.233582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d9e9f-60c0-4657-a90c-966d3134fdd1 tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:38.233867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6d9e9f-60c0-4657-a90c-966d3134fdd1 tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:38.233981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48772e8c-aa71-4b11-a47a-3f2438098e24 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:38.234239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48772e8c-aa71-4b11-a47a-3f2438098e24 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:38.234579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48772e8c-aa71-4b11-a47a-3f2438098e24 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/projects/194f40b87f544ad78f932f048c0cc134/users/caec4b2ae448489cb4175b3af49af2f6/roles/c964b5c3b7514b78928cfce82414e3e9` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:38.236732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d9e9f-60c0-4657-a90c-966d3134fdd1 tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:43:38.239309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d9e9f-60c0-4657-a90c-966d3134fdd1 tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:38.239309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6d9e9f-60c0-4657-a90c-966d3134fdd1 tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:38.240764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48772e8c-aa71-4b11-a47a-3f2438098e24 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:create_grant(project_id=194f40b87f544ad78f932f048c0cc134, user_id=caec4b2ae448489cb4175b3af49af2f6, role_id=c964b5c3b7514b78928cfce82414e3e9)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:38.244398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48772e8c-aa71-4b11-a47a-3f2438098e24 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:38.270419 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3644/7377] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:38.299522 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:38.324851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d9e9f-60c0-4657-a90c-966d3134fdd1 tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:38.332575 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3734/7378] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:37 2022] PUT /identity/v3/projects/194f40b87f544ad78f932f048c0cc134/users/caec4b2ae448489cb4175b3af49af2f6/roles/c964b5c3b7514b78928cfce82414e3e9 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:38.339186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48772e8c-aa71-4b11-a47a-3f2438098e24 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:38.344933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6d9e9f-60c0-4657-a90c-966d3134fdd1 tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:38.519308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48772e8c-aa71-4b11-a47a-3f2438098e24 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:38.538080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c9a6f-319a-431e-a4b6-e0f0ca8fb5f9 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:38.539002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c9a6f-319a-431e-a4b6-e0f0ca8fb5f9 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:38.539371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c9a6f-319a-431e-a4b6-e0f0ca8fb5f9 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:38.539632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c9a6f-319a-431e-a4b6-e0f0ca8fb5f9 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/users/caec4b2ae448489cb4175b3af49af2f6/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:38.543694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c9a6f-319a-431e-a4b6-e0f0ca8fb5f9 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=caec4b2ae448489cb4175b3af49af2f6)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:38.545865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c9a6f-319a-431e-a4b6-e0f0ca8fb5f9 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:38.562764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad80b02-111f-4977-9673-aa00dfd23a5d tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bdf8d6e64232404f997e260ef2585534', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '02209d4f186c4b578922d28b128e5329', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:38.565546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad80b02-111f-4977-9673-aa00dfd23a5d tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:38.565849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad80b02-111f-4977-9673-aa00dfd23a5d tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:38.570254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad80b02-111f-4977-9673-aa00dfd23a5d tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] PATH_INFO: `/v3/projects/d510040d2b8e40a6a498012c852e955b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:38.572251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad80b02-111f-4977-9673-aa00dfd23a5d tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d510040d2b8e40a6a498012c852e955b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:38.574585 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:38.577980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad80b02-111f-4977-9673-aa00dfd23a5d tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:38.659673 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3735/7379] 10.222.0.43 () {58 vars in 1247 bytes} [Tue Jul 19 14:43:38 2022] GET /identity/v3/users/caec4b2ae448489cb4175b3af49af2f6/projects => generated 843 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:43:38.661610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c9a6f-319a-431e-a4b6-e0f0ca8fb5f9 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:38.691336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c9a6f-319a-431e-a4b6-e0f0ca8fb5f9 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:38.709087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34e718-abd6-4a26-bc62-b4929fbb483c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:38.713245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34e718-abd6-4a26-bc62-b4929fbb483c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:38.713769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34e718-abd6-4a26-bc62-b4929fbb483c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:38.715198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d34e718-abd6-4a26-bc62-b4929fbb483c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/projects/194f40b87f544ad78f932f048c0cc134` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:38.719786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34e718-abd6-4a26-bc62-b4929fbb483c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:delete_project(project_id=194f40b87f544ad78f932f048c0cc134)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:38.730919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d34e718-abd6-4a26-bc62-b4929fbb483c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:38.837302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ad80b02-111f-4977-9673-aa00dfd23a5d tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd510040d2b8e40a6a498012c852e955b', 'request_id': 'req-7ad80b02-111f-4977-9673-aa00dfd23a5d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:38.913545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ad80b02-111f-4977-9673-aa00dfd23a5d tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd510040d2b8e40a6a498012c852e955b', 'request_id': 'req-7ad80b02-111f-4977-9673-aa00dfd23a5d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:38.928944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ad80b02-111f-4977-9673-aa00dfd23a5d tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd510040d2b8e40a6a498012c852e955b', 'request_id': 'req-7ad80b02-111f-4977-9673-aa00dfd23a5d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:38.966191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ad80b02-111f-4977-9673-aa00dfd23a5d tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] The token cache is being invalidate because project d510040d2b8e40a6a498012c852e955b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:38.972497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ad80b02-111f-4977-9673-aa00dfd23a5d tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:38.972497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ad80b02-111f-4977-9673-aa00dfd23a5d tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:38.980892 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3645/7380] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:38 2022] DELETE /identity/v3/projects/d510040d2b8e40a6a498012c852e955b => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:43:39.077432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5d34e718-abd6-4a26-bc62-b4929fbb483c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '194f40b87f544ad78f932f048c0cc134', 'request_id': 'req-5d34e718-abd6-4a26-bc62-b4929fbb483c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:39.099830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5d34e718-abd6-4a26-bc62-b4929fbb483c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '194f40b87f544ad78f932f048c0cc134', 'request_id': 'req-5d34e718-abd6-4a26-bc62-b4929fbb483c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:39.117341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5d34e718-abd6-4a26-bc62-b4929fbb483c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '194f40b87f544ad78f932f048c0cc134', 'request_id': 'req-5d34e718-abd6-4a26-bc62-b4929fbb483c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:39.200525 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:39.211978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5d34e718-abd6-4a26-bc62-b4929fbb483c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] The token cache is being invalidate because project 194f40b87f544ad78f932f048c0cc134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:39.211978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5d34e718-abd6-4a26-bc62-b4929fbb483c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:39.211978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5d34e718-abd6-4a26-bc62-b4929fbb483c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:39.214336 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3736/7381] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:38 2022] DELETE /identity/v3/projects/194f40b87f544ad78f932f048c0cc134 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:39.226076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad80b02-111f-4977-9673-aa00dfd23a5d tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:39.234068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7ad80b02-111f-4977-9673-aa00dfd23a5d tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:39.485106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad80b02-111f-4977-9673-aa00dfd23a5d tempest-VolumeQuotaClassesTest-1993203509 tempest-VolumeQuotaClassesTest-1993203509-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:39.669231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28986d-49a3-4f6d-be91-cb1767644c8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:39.671416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28986d-49a3-4f6d-be91-cb1767644c8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:39.674877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28986d-49a3-4f6d-be91-cb1767644c8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:39.675464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce28986d-49a3-4f6d-be91-cb1767644c8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/projects/ea23ee474c854b7c90dad9beccf7216e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:39.678594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28986d-49a3-4f6d-be91-cb1767644c8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ea23ee474c854b7c90dad9beccf7216e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:39.685828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce28986d-49a3-4f6d-be91-cb1767644c8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:39.993559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce28986d-49a3-4f6d-be91-cb1767644c8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea23ee474c854b7c90dad9beccf7216e', 'request_id': 'req-ce28986d-49a3-4f6d-be91-cb1767644c8a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:39.996293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34e718-abd6-4a26-bc62-b4929fbb483c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:39.998606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5d34e718-abd6-4a26-bc62-b4929fbb483c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:40.105515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce28986d-49a3-4f6d-be91-cb1767644c8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea23ee474c854b7c90dad9beccf7216e', 'request_id': 'req-ce28986d-49a3-4f6d-be91-cb1767644c8a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:40.120311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce28986d-49a3-4f6d-be91-cb1767644c8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea23ee474c854b7c90dad9beccf7216e', 'request_id': 'req-ce28986d-49a3-4f6d-be91-cb1767644c8a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:40.156313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce28986d-49a3-4f6d-be91-cb1767644c8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] The token cache is being invalidate because project ea23ee474c854b7c90dad9beccf7216e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:40.156882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce28986d-49a3-4f6d-be91-cb1767644c8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:40.158913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce28986d-49a3-4f6d-be91-cb1767644c8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:40.164480 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3646/7382] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:39 2022] DELETE /identity/v3/projects/ea23ee474c854b7c90dad9beccf7216e => generated 0 bytes in 939 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:40.168521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28986d-49a3-4f6d-be91-cb1767644c8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:40.174430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ce28986d-49a3-4f6d-be91-cb1767644c8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:40.215357 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:40.226637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d34e718-abd6-4a26-bc62-b4929fbb483c tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:40.295951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce28986d-49a3-4f6d-be91-cb1767644c8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:40.301610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d38b11-9c83-4cad-9c78-88f9c9bfa258 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:40.302802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d38b11-9c83-4cad-9c78-88f9c9bfa258 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:40.303319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d38b11-9c83-4cad-9c78-88f9c9bfa258 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:40.303945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d38b11-9c83-4cad-9c78-88f9c9bfa258 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/roles/c964b5c3b7514b78928cfce82414e3e9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:40.306217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d38b11-9c83-4cad-9c78-88f9c9bfa258 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c964b5c3b7514b78928cfce82414e3e9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:40.308225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d38b11-9c83-4cad-9c78-88f9c9bfa258 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:40.389569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9d897-c63a-446d-a073-91d614e6cc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:40.390532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9d897-c63a-446d-a073-91d614e6cc33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:40.390822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9d897-c63a-446d-a073-91d614e6cc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:40.391105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9d897-c63a-446d-a073-91d614e6cc33 admin admin] PATH_INFO: `/v3/users/6f048d2f8686464783cacde89b6ccf9d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:40.393786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9d897-c63a-446d-a073-91d614e6cc33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f048d2f8686464783cacde89b6ccf9d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:40.396607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9d897-c63a-446d-a073-91d614e6cc33 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:40.434219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-90d38b11-9c83-4cad-9c78-88f9c9bfa258 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invalidating the token cache because role c964b5c3b7514b78928cfce82414e3e9 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:40.434890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-90d38b11-9c83-4cad-9c78-88f9c9bfa258 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:40.436000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-90d38b11-9c83-4cad-9c78-88f9c9bfa258 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:40.439915 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3647/7383] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:40 2022] DELETE /identity/v3/roles/c964b5c3b7514b78928cfce82414e3e9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:40.444556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d38b11-9c83-4cad-9c78-88f9c9bfa258 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:40.449097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-90d38b11-9c83-4cad-9c78-88f9c9bfa258 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:40.565186 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:40.604914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e9c9d897-c63a-446d-a073-91d614e6cc33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f048d2f8686464783cacde89b6ccf9d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:40.620496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d38b11-9c83-4cad-9c78-88f9c9bfa258 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:40.636217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69664b-c397-4576-8ccd-804906297ead tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:40.637931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69664b-c397-4576-8ccd-804906297ead tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:40.638257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69664b-c397-4576-8ccd-804906297ead tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:40.640725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c69664b-c397-4576-8ccd-804906297ead tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/users/caec4b2ae448489cb4175b3af49af2f6` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:40.642789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e9c9d897-c63a-446d-a073-91d614e6cc33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f048d2f8686464783cacde89b6ccf9d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:40.643947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69664b-c397-4576-8ccd-804906297ead tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:delete_user(user_id=caec4b2ae448489cb4175b3af49af2f6)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:40.649517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c69664b-c397-4576-8ccd-804906297ead tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:40.672547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e9c9d897-c63a-446d-a073-91d614e6cc33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f048d2f8686464783cacde89b6ccf9d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:40.678530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e9c9d897-c63a-446d-a073-91d614e6cc33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f048d2f8686464783cacde89b6ccf9d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:40.750876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e9c9d897-c63a-446d-a073-91d614e6cc33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f048d2f8686464783cacde89b6ccf9d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:40.764263 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3737/7384] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:39 2022] DELETE /identity/v3/users/6f048d2f8686464783cacde89b6ccf9d => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:40.766326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca4221-2606-42e9-9488-b28f0c990276 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:40.766632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca4221-2606-42e9-9488-b28f0c990276 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:40.767046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca4221-2606-42e9-9488-b28f0c990276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:40.814916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4fca4221-2606-42e9-9488-b28f0c990276 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:40.816737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4fca4221-2606-42e9-9488-b28f0c990276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:40.859197 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:40.877464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2c69664b-c397-4576-8ccd-804906297ead tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caec4b2ae448489cb4175b3af49af2f6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:40.920142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2c69664b-c397-4576-8ccd-804906297ead tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caec4b2ae448489cb4175b3af49af2f6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:40.920919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2c69664b-c397-4576-8ccd-804906297ead tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caec4b2ae448489cb4175b3af49af2f6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:40.921625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2c69664b-c397-4576-8ccd-804906297ead tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caec4b2ae448489cb4175b3af49af2f6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:40.942643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2c69664b-c397-4576-8ccd-804906297ead tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caec4b2ae448489cb4175b3af49af2f6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:40.947333 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3738/7385] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:40.960464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca4221-2606-42e9-9488-b28f0c990276 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:40.967445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4fca4221-2606-42e9-9488-b28f0c990276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:41.022571 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3648/7386] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:40 2022] DELETE /identity/v3/users/caec4b2ae448489cb4175b3af49af2f6 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:41.027338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69664b-c397-4576-8ccd-804906297ead tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:41.029239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2c69664b-c397-4576-8ccd-804906297ead tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:41.084525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca4221-2606-42e9-9488-b28f0c990276 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:41.226790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c69664b-c397-4576-8ccd-804906297ead tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:41.233542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1bdad-8a49-4c71-8b0f-d40e8c2fa26d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:41.234579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1bdad-8a49-4c71-8b0f-d40e8c2fa26d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:41.234984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1bdad-8a49-4c71-8b0f-d40e8c2fa26d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:41.235355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1bdad-8a49-4c71-8b0f-d40e8c2fa26d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/projects/aa80bf3734884f0798e4b690906662db` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:41.236927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1bdad-8a49-4c71-8b0f-d40e8c2fa26d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:delete_project(project_id=aa80bf3734884f0798e4b690906662db)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:41.243094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1bdad-8a49-4c71-8b0f-d40e8c2fa26d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:41.277970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461156b-7828-4fc8-8137-663edd8e8ec9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:41.277970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461156b-7828-4fc8-8137-663edd8e8ec9 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:41.277970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461156b-7828-4fc8-8137-663edd8e8ec9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:41.277970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e461156b-7828-4fc8-8137-663edd8e8ec9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:41.409292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461156b-7828-4fc8-8137-663edd8e8ec9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:41.410465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e461156b-7828-4fc8-8137-663edd8e8ec9 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:41.424868 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3739/7387] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:43:41.779930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-34f1bdad-8a49-4c71-8b0f-d40e8c2fa26d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa80bf3734884f0798e4b690906662db', 'request_id': 'req-34f1bdad-8a49-4c71-8b0f-d40e8c2fa26d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:41.888404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-34f1bdad-8a49-4c71-8b0f-d40e8c2fa26d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa80bf3734884f0798e4b690906662db', 'request_id': 'req-34f1bdad-8a49-4c71-8b0f-d40e8c2fa26d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:41.902349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-34f1bdad-8a49-4c71-8b0f-d40e8c2fa26d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa80bf3734884f0798e4b690906662db', 'request_id': 'req-34f1bdad-8a49-4c71-8b0f-d40e8c2fa26d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:41.973347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-34f1bdad-8a49-4c71-8b0f-d40e8c2fa26d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] The token cache is being invalidate because project aa80bf3734884f0798e4b690906662db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:41.973347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-34f1bdad-8a49-4c71-8b0f-d40e8c2fa26d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:41.990765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-34f1bdad-8a49-4c71-8b0f-d40e8c2fa26d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:42.003879 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3649/7388] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:41 2022] DELETE /identity/v3/projects/aa80bf3734884f0798e4b690906662db => generated 0 bytes in 977 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:42.012752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461156b-7828-4fc8-8137-663edd8e8ec9 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:42.038531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e461156b-7828-4fc8-8137-663edd8e8ec9 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:42.070871 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:42.296483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5730be9-e37b-42da-ab1e-d3cdcc09d2e1 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:42.297398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5730be9-e37b-42da-ab1e-d3cdcc09d2e1 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:42.297689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5730be9-e37b-42da-ab1e-d3cdcc09d2e1 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:42.301607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5730be9-e37b-42da-ab1e-d3cdcc09d2e1 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/users/fec3ccad323d4f94971cc9ba929e6c2c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:42.306488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5730be9-e37b-42da-ab1e-d3cdcc09d2e1 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:update_user(user_id=fec3ccad323d4f94971cc9ba929e6c2c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:42.329948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5730be9-e37b-42da-ab1e-d3cdcc09d2e1 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:42.528855 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:42.534375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c5730be9-e37b-42da-ab1e-d3cdcc09d2e1 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fec3ccad323d4f94971cc9ba929e6c2c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:42.608894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c5730be9-e37b-42da-ab1e-d3cdcc09d2e1 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invalidating the token cache because user fec3ccad323d4f94971cc9ba929e6c2c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:42.609457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c5730be9-e37b-42da-ab1e-d3cdcc09d2e1 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:42.610772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c5730be9-e37b-42da-ab1e-d3cdcc09d2e1 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:42.614867 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3740/7389] 10.222.0.43 () {60 vars in 1242 bytes} [Tue Jul 19 14:43:42 2022] PATCH /identity/v3/users/fec3ccad323d4f94971cc9ba929e6c2c => generated 297 bytes in 602 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:42.620079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cad6a8-3562-4d38-90cf-c71b81f1f3c9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:42.620582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cad6a8-3562-4d38-90cf-c71b81f1f3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:42.620875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cad6a8-3562-4d38-90cf-c71b81f1f3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:42.669642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5730be9-e37b-42da-ab1e-d3cdcc09d2e1 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:42.672284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c5730be9-e37b-42da-ab1e-d3cdcc09d2e1 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:42.712824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-08cad6a8-3562-4d38-90cf-c71b81f1f3c9 None None] MFA Rules not processed for user `fec3ccad323d4f94971cc9ba929e6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:42.723172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-08cad6a8-3562-4d38-90cf-c71b81f1f3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:42.781232 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3650/7390] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:42 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 14:43:42.786059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cad6a8-3562-4d38-90cf-c71b81f1f3c9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:42.797772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-08cad6a8-3562-4d38-90cf-c71b81f1f3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:42.903854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cad6a8-3562-4d38-90cf-c71b81f1f3c9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:42.917736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7757809-fc2e-4013-8863-443b4b1bd5c8 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:42.919839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7757809-fc2e-4013-8863-443b4b1bd5c8 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:42.920133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7757809-fc2e-4013-8863-443b4b1bd5c8 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:42.920420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7757809-fc2e-4013-8863-443b4b1bd5c8 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/users/fec3ccad323d4f94971cc9ba929e6c2c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:42.927961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5730be9-e37b-42da-ab1e-d3cdcc09d2e1 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:42.938056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7757809-fc2e-4013-8863-443b4b1bd5c8 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:update_user(user_id=fec3ccad323d4f94971cc9ba929e6c2c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:42.939321 n-d-master-1 devstack@keystone.service[80679]: WARNING py.warnings [None req-d7757809-fc2e-4013-8863-443b4b1bd5c8 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 14:43:42.939321 n-d-master-1 devstack@keystone.service[80679]: warnings.warn(msg) Jul 19 14:43:42.939321 n-d-master-1 devstack@keystone.service[80679]: Jul 19 14:43:42.940797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7757809-fc2e-4013-8863-443b4b1bd5c8 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:42.965516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94c2ea-1b5a-42fe-96f9-e50ea1e7f83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:42.966447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94c2ea-1b5a-42fe-96f9-e50ea1e7f83e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:42.966736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94c2ea-1b5a-42fe-96f9-e50ea1e7f83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:42.967020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94c2ea-1b5a-42fe-96f9-e50ea1e7f83e admin admin] PATH_INFO: `/v3/projects/f7d142cf80aa4ec189d862302f79dd0a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:42.969244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94c2ea-1b5a-42fe-96f9-e50ea1e7f83e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7d142cf80aa4ec189d862302f79dd0a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:42.971910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94c2ea-1b5a-42fe-96f9-e50ea1e7f83e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:43.127062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d7757809-fc2e-4013-8863-443b4b1bd5c8 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fec3ccad323d4f94971cc9ba929e6c2c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:43.208021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4d94c2ea-1b5a-42fe-96f9-e50ea1e7f83e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7d142cf80aa4ec189d862302f79dd0a', 'request_id': 'req-4d94c2ea-1b5a-42fe-96f9-e50ea1e7f83e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:43.224287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4d94c2ea-1b5a-42fe-96f9-e50ea1e7f83e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7d142cf80aa4ec189d862302f79dd0a', 'request_id': 'req-4d94c2ea-1b5a-42fe-96f9-e50ea1e7f83e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:43.233141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4d94c2ea-1b5a-42fe-96f9-e50ea1e7f83e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7d142cf80aa4ec189d862302f79dd0a', 'request_id': 'req-4d94c2ea-1b5a-42fe-96f9-e50ea1e7f83e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:43.254221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d7757809-fc2e-4013-8863-443b4b1bd5c8 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invalidating the token cache because user fec3ccad323d4f94971cc9ba929e6c2c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:43.254720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d7757809-fc2e-4013-8863-443b4b1bd5c8 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:43.255872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d7757809-fc2e-4013-8863-443b4b1bd5c8 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:43.258117 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3651/7391] 10.222.0.43 () {60 vars in 1242 bytes} [Tue Jul 19 14:43:42 2022] PATCH /identity/v3/users/fec3ccad323d4f94971cc9ba929e6c2c => generated 297 bytes in 472 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:43.262381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7757809-fc2e-4013-8863-443b4b1bd5c8 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:43.264393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d7757809-fc2e-4013-8863-443b4b1bd5c8 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:43.283394 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:43.303379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7757809-fc2e-4013-8863-443b4b1bd5c8 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:43.379964 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:43.387630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4d94c2ea-1b5a-42fe-96f9-e50ea1e7f83e admin admin] The token cache is being invalidate because project f7d142cf80aa4ec189d862302f79dd0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:43.387921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4d94c2ea-1b5a-42fe-96f9-e50ea1e7f83e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:43.400755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4d94c2ea-1b5a-42fe-96f9-e50ea1e7f83e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:43.400755 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3741/7392] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:42 2022] DELETE /identity/v3/projects/f7d142cf80aa4ec189d862302f79dd0a => generated 0 bytes in 727 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:43.400755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94c2ea-1b5a-42fe-96f9-e50ea1e7f83e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:43.401301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4d94c2ea-1b5a-42fe-96f9-e50ea1e7f83e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:43.475127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b2979-fadf-463e-b54e-1bb30721e277 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:43.476218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b2979-fadf-463e-b54e-1bb30721e277 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:43.477934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b2979-fadf-463e-b54e-1bb30721e277 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:43.478353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b2979-fadf-463e-b54e-1bb30721e277 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/users/fec3ccad323d4f94971cc9ba929e6c2c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:43.516105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b2979-fadf-463e-b54e-1bb30721e277 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:update_user(user_id=fec3ccad323d4f94971cc9ba929e6c2c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:43.541865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b2979-fadf-463e-b54e-1bb30721e277 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:43.553909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94c2ea-1b5a-42fe-96f9-e50ea1e7f83e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:43.566295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afb3c0-7bac-4fe3-acc5-90f8471d13d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:43.570392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afb3c0-7bac-4fe3-acc5-90f8471d13d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:43.570760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afb3c0-7bac-4fe3-acc5-90f8471d13d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:43.571055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37afb3c0-7bac-4fe3-acc5-90f8471d13d3 admin admin] PATH_INFO: `/v3/users/bdf8d6e64232404f997e260ef2585534` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:43.572543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afb3c0-7bac-4fe3-acc5-90f8471d13d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdf8d6e64232404f997e260ef2585534)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:43.580767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37afb3c0-7bac-4fe3-acc5-90f8471d13d3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:43.693517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d10b2979-fadf-463e-b54e-1bb30721e277 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fec3ccad323d4f94971cc9ba929e6c2c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:43.836960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d10b2979-fadf-463e-b54e-1bb30721e277 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invalidating the token cache because user fec3ccad323d4f94971cc9ba929e6c2c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:43.837692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d10b2979-fadf-463e-b54e-1bb30721e277 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:43.839167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d10b2979-fadf-463e-b54e-1bb30721e277 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:43.842086 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3652/7393] 10.222.0.43 () {60 vars in 1242 bytes} [Tue Jul 19 14:43:43 2022] PATCH /identity/v3/users/fec3ccad323d4f94971cc9ba929e6c2c => generated 297 bytes in 580 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:43:43.847040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac25ca-4acb-4f90-b662-a088496f9eea None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:43.847634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac25ca-4acb-4f90-b662-a088496f9eea None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:43.848157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac25ca-4acb-4f90-b662-a088496f9eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:43.863733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-37afb3c0-7bac-4fe3-acc5-90f8471d13d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdf8d6e64232404f997e260ef2585534'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:43.896805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-37afb3c0-7bac-4fe3-acc5-90f8471d13d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdf8d6e64232404f997e260ef2585534'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:43.904785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-37afb3c0-7bac-4fe3-acc5-90f8471d13d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdf8d6e64232404f997e260ef2585534'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:43.910594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-37afb3c0-7bac-4fe3-acc5-90f8471d13d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdf8d6e64232404f997e260ef2585534'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:43.989645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d9ac25ca-4acb-4f90-b662-a088496f9eea None None] MFA Rules not processed for user `fec3ccad323d4f94971cc9ba929e6c2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:43.989645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d9ac25ca-4acb-4f90-b662-a088496f9eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:43.997863 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3653/7394] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:43 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 14:43:44.002805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac25ca-4acb-4f90-b662-a088496f9eea None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:44.005331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d9ac25ca-4acb-4f90-b662-a088496f9eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:44.007928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-37afb3c0-7bac-4fe3-acc5-90f8471d13d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdf8d6e64232404f997e260ef2585534'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:44.016566 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3742/7395] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:43 2022] DELETE /identity/v3/users/bdf8d6e64232404f997e260ef2585534 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:44.041800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac25ca-4acb-4f90-b662-a088496f9eea None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:44.145084 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:44.236464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f62ae-3ee0-4227-9dbf-931b279b13ea tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:44.237550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f62ae-3ee0-4227-9dbf-931b279b13ea tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:44.243613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f62ae-3ee0-4227-9dbf-931b279b13ea tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:44.244210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511f62ae-3ee0-4227-9dbf-931b279b13ea tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/users/fec3ccad323d4f94971cc9ba929e6c2c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:44.249540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f62ae-3ee0-4227-9dbf-931b279b13ea tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:update_user(user_id=fec3ccad323d4f94971cc9ba929e6c2c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:44.252334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511f62ae-3ee0-4227-9dbf-931b279b13ea tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:44.432351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-511f62ae-3ee0-4227-9dbf-931b279b13ea tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'fec3ccad323d4f94971cc9ba929e6c2c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:44.505578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-511f62ae-3ee0-4227-9dbf-931b279b13ea tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invalidating the token cache because user fec3ccad323d4f94971cc9ba929e6c2c was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:44.505879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-511f62ae-3ee0-4227-9dbf-931b279b13ea tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:44.508215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-511f62ae-3ee0-4227-9dbf-931b279b13ea tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:44.510611 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3654/7396] 10.222.0.43 () {60 vars in 1242 bytes} [Tue Jul 19 14:43:44 2022] PATCH /identity/v3/users/fec3ccad323d4f94971cc9ba929e6c2c => generated 297 bytes in 509 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:44.516276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afb3c0-7bac-4fe3-acc5-90f8471d13d3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:44.520572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-37afb3c0-7bac-4fe3-acc5-90f8471d13d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:44.556503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37afb3c0-7bac-4fe3-acc5-90f8471d13d3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:44.570724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273ac9d-6f9e-4649-8cb5-92a3de28309e tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:44.579064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273ac9d-6f9e-4649-8cb5-92a3de28309e tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:44.581047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273ac9d-6f9e-4649-8cb5-92a3de28309e tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:44.581563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273ac9d-6f9e-4649-8cb5-92a3de28309e tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:44.586662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273ac9d-6f9e-4649-8cb5-92a3de28309e tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:44.622967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273ac9d-6f9e-4649-8cb5-92a3de28309e tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:44.700716 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:44.826211 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3743/7397] 10.222.0.43 () {60 vars in 1142 bytes} [Tue Jul 19 14:43:44 2022] POST /identity/v3/users => generated 265 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:43:44.828525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f62ae-3ee0-4227-9dbf-931b279b13ea tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:44.830453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-511f62ae-3ee0-4227-9dbf-931b279b13ea tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:44.847542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511f62ae-3ee0-4227-9dbf-931b279b13ea tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:44.855905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175f7775-224f-4ee9-abbe-2c2236f6204e tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:44.870921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f7775-224f-4ee9-abbe-2c2236f6204e tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:44.871636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f7775-224f-4ee9-abbe-2c2236f6204e tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:44.872834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175f7775-224f-4ee9-abbe-2c2236f6204e tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/users/a1036ad0476445959516ce79f5869c8e/password` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:45.125471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-175f7775-224f-4ee9-abbe-2c2236f6204e tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a1036ad0476445959516ce79f5869c8e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:45.207423 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3655/7398] 10.222.0.43 () {60 vars in 1268 bytes} [Tue Jul 19 14:43:44 2022] POST /identity/v3/users/a1036ad0476445959516ce79f5869c8e/password => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:45.482961 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:45.554050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273ac9d-6f9e-4649-8cb5-92a3de28309e tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:45.556312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d273ac9d-6f9e-4649-8cb5-92a3de28309e tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:45.749244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273ac9d-6f9e-4649-8cb5-92a3de28309e tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:45.752961 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:45.768884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0aecd0-b521-4cf5-99de-9515bd638410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:45.771866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aecd0-b521-4cf5-99de-9515bd638410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:45.778591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aecd0-b521-4cf5-99de-9515bd638410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:45.791761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aecd0-b521-4cf5-99de-9515bd638410 admin admin] PATH_INFO: `/v3/projects/02209d4f186c4b578922d28b128e5329` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:45.803075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0aecd0-b521-4cf5-99de-9515bd638410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02209d4f186c4b578922d28b128e5329)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:45.804966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0aecd0-b521-4cf5-99de-9515bd638410 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:46.044409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4f0aecd0-b521-4cf5-99de-9515bd638410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02209d4f186c4b578922d28b128e5329', 'request_id': 'req-4f0aecd0-b521-4cf5-99de-9515bd638410'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:46.088152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4f0aecd0-b521-4cf5-99de-9515bd638410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02209d4f186c4b578922d28b128e5329', 'request_id': 'req-4f0aecd0-b521-4cf5-99de-9515bd638410'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:46.110237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4f0aecd0-b521-4cf5-99de-9515bd638410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02209d4f186c4b578922d28b128e5329', 'request_id': 'req-4f0aecd0-b521-4cf5-99de-9515bd638410'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:46.210783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e72a7-bb15-487b-95b7-742f357b85e4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:46.211234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e72a7-bb15-487b-95b7-742f357b85e4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:46.211435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609e72a7-bb15-487b-95b7-742f357b85e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:46.219393 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4f0aecd0-b521-4cf5-99de-9515bd638410 admin admin] The token cache is being invalidate because project 02209d4f186c4b578922d28b128e5329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:46.221256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4f0aecd0-b521-4cf5-99de-9515bd638410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:46.223930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4f0aecd0-b521-4cf5-99de-9515bd638410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:46.228839 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3744/7399] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:45 2022] DELETE /identity/v3/projects/02209d4f186c4b578922d28b128e5329 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:46.234537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89e69c-6611-49f6-9c36-fb54bc69e017 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:46.235042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89e69c-6611-49f6-9c36-fb54bc69e017 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:46.235540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89e69c-6611-49f6-9c36-fb54bc69e017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:46.241889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-609e72a7-bb15-487b-95b7-742f357b85e4 None None] MFA Rules not processed for user `a1036ad0476445959516ce79f5869c8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:46.243547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-609e72a7-bb15-487b-95b7-742f357b85e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:46.252544 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3656/7400] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:46 2022] POST /identity/v3/auth/tokens => generated 330 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 14:43:46.254971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e72a7-bb15-487b-95b7-742f357b85e4 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:46.256579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-609e72a7-bb15-487b-95b7-742f357b85e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:46.312033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ae89e69c-6611-49f6-9c36-fb54bc69e017 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:46.322726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ae89e69c-6611-49f6-9c36-fb54bc69e017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:46.473479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609e72a7-bb15-487b-95b7-742f357b85e4 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:46.487961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c92f83-3f88-4c13-87c5-d798c7210bbc tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:46.489783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c92f83-3f88-4c13-87c5-d798c7210bbc tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:46.490088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c92f83-3f88-4c13-87c5-d798c7210bbc tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:46.490399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c92f83-3f88-4c13-87c5-d798c7210bbc tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:46.499668 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:46.510277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c92f83-3f88-4c13-87c5-d798c7210bbc tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:46.520966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c92f83-3f88-4c13-87c5-d798c7210bbc tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:46.523575 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3745/7401] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:46.531343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc07e2-1976-434a-8ddf-0924c0adb61b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:46.531993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc07e2-1976-434a-8ddf-0924c0adb61b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:46.532547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdc07e2-1976-434a-8ddf-0924c0adb61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:46.566698 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3657/7402] 10.222.0.43 () {56 vars in 1262 bytes} [Tue Jul 19 14:43:46 2022] GET /identity/v3/auth/tokens => generated 330 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 14:43:46.571191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c92f83-3f88-4c13-87c5-d798c7210bbc tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:46.573689 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:46.578451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6fdc07e2-1976-434a-8ddf-0924c0adb61b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:46.579985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6fdc07e2-1976-434a-8ddf-0924c0adb61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:46.600903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c92f83-3f88-4c13-87c5-d798c7210bbc tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:46.621774 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3746/7403] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:43:46.623733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc07e2-1976-434a-8ddf-0924c0adb61b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:46.632636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca87fb1-034c-4145-9178-4ea615d5f72d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:46.633579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca87fb1-034c-4145-9178-4ea615d5f72d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:46.633876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca87fb1-034c-4145-9178-4ea615d5f72d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:46.634227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca87fb1-034c-4145-9178-4ea615d5f72d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/users/a1036ad0476445959516ce79f5869c8e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:46.644592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca87fb1-034c-4145-9178-4ea615d5f72d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a1036ad0476445959516ce79f5869c8e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:46.648481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdc07e2-1976-434a-8ddf-0924c0adb61b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:46.649541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca87fb1-034c-4145-9178-4ea615d5f72d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:46.674436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ebf2c-c2f0-45c1-8de5-c180dc545726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:46.675601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ebf2c-c2f0-45c1-8de5-c180dc545726 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:46.678074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ebf2c-c2f0-45c1-8de5-c180dc545726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:46.678616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ebf2c-c2f0-45c1-8de5-c180dc545726 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:46.679804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ebf2c-c2f0-45c1-8de5-c180dc545726 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:43:46.680304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ebf2c-c2f0-45c1-8de5-c180dc545726 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:46.686138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577ebf2c-c2f0-45c1-8de5-c180dc545726 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:46.767552 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3747/7404] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:43:46.767552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ebf2c-c2f0-45c1-8de5-c180dc545726 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:46.798608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ebf2c-c2f0-45c1-8de5-c180dc545726 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:46.825373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f5298-4c54-4233-8b3a-fc751980093b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:46.828039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f5298-4c54-4233-8b3a-fc751980093b admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:46.828512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f5298-4c54-4233-8b3a-fc751980093b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:46.829077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f5298-4c54-4233-8b3a-fc751980093b admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:46.831146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f5298-4c54-4233-8b3a-fc751980093b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:46.834053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033f5298-4c54-4233-8b3a-fc751980093b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:46.946125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5ca87fb1-034c-4145-9178-4ea615d5f72d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1036ad0476445959516ce79f5869c8e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:46.967563 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3748/7405] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:43:46 2022] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:46.974624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f5298-4c54-4233-8b3a-fc751980093b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:47.023585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5ca87fb1-034c-4145-9178-4ea615d5f72d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1036ad0476445959516ce79f5869c8e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:47.029467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5ca87fb1-034c-4145-9178-4ea615d5f72d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1036ad0476445959516ce79f5869c8e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:47.035882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5ca87fb1-034c-4145-9178-4ea615d5f72d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1036ad0476445959516ce79f5869c8e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:47.106680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5ca87fb1-034c-4145-9178-4ea615d5f72d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1036ad0476445959516ce79f5869c8e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:47.198869 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3658/7406] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:46 2022] DELETE /identity/v3/users/a1036ad0476445959516ce79f5869c8e => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:47.210460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca87fb1-034c-4145-9178-4ea615d5f72d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:47.212535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5ca87fb1-034c-4145-9178-4ea615d5f72d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:47.227934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f5298-4c54-4233-8b3a-fc751980093b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:47.239210 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:47.341666 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:47.367035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab085c7-2303-4681-b5b1-4e1d7df6801a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:47.367748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab085c7-2303-4681-b5b1-4e1d7df6801a admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:47.368044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab085c7-2303-4681-b5b1-4e1d7df6801a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:47.368420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab085c7-2303-4681-b5b1-4e1d7df6801a admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:47.369157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab085c7-2303-4681-b5b1-4e1d7df6801a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:47.371299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab085c7-2303-4681-b5b1-4e1d7df6801a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:47.514607 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3749/7407] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:43:46 2022] POST /identity/v3/users => generated 289 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:47.516069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab085c7-2303-4681-b5b1-4e1d7df6801a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:47.519615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca87fb1-034c-4145-9178-4ea615d5f72d tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:47.526982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cab085c7-2303-4681-b5b1-4e1d7df6801a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:47.544900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3088e1-dc8c-4792-9e96-1d21ed1447c0 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:47.547641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3088e1-dc8c-4792-9e96-1d21ed1447c0 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:47.547939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3088e1-dc8c-4792-9e96-1d21ed1447c0 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:47.550659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3088e1-dc8c-4792-9e96-1d21ed1447c0 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:47.554254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3088e1-dc8c-4792-9e96-1d21ed1447c0 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:47.563158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3088e1-dc8c-4792-9e96-1d21ed1447c0 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:47.564589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab085c7-2303-4681-b5b1-4e1d7df6801a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:47.614556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90ac40-5105-4e39-a5c8-0ac5cdc8c555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:47.615462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90ac40-5105-4e39-a5c8-0ac5cdc8c555 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:47.615668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90ac40-5105-4e39-a5c8-0ac5cdc8c555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:47.615978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90ac40-5105-4e39-a5c8-0ac5cdc8c555 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:47.616760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90ac40-5105-4e39-a5c8-0ac5cdc8c555 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:47.618778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a90ac40-5105-4e39-a5c8-0ac5cdc8c555 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:47.693835 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3750/7408] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:43:47.730241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90ac40-5105-4e39-a5c8-0ac5cdc8c555 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:47.750133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90ac40-5105-4e39-a5c8-0ac5cdc8c555 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:47.764742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f0c62-8494-4e08-a51f-e7c4cdcade19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:47.766339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f0c62-8494-4e08-a51f-e7c4cdcade19 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:47.766812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f0c62-8494-4e08-a51f-e7c4cdcade19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:47.767919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f0c62-8494-4e08-a51f-e7c4cdcade19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:47.768965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f0c62-8494-4e08-a51f-e7c4cdcade19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:47.783873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f0c62-8494-4e08-a51f-e7c4cdcade19 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:47.842481 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3751/7409] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:47.843675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f0c62-8494-4e08-a51f-e7c4cdcade19 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:47.914580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f0c62-8494-4e08-a51f-e7c4cdcade19 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:47.947011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c4a74-9905-4f3a-ab29-18f64008a3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:47.947981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c4a74-9905-4f3a-ab29-18f64008a3cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:47.948280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c4a74-9905-4f3a-ab29-18f64008a3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:47.948593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c4a74-9905-4f3a-ab29-18f64008a3cc admin admin] PATH_INFO: `/v3/projects/89f067ab0960448b87d63427c9eb951e/users/8b0ae24648ff414994bc7de0fd58b830/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:48.014078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c4a74-9905-4f3a-ab29-18f64008a3cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=89f067ab0960448b87d63427c9eb951e, user_id=8b0ae24648ff414994bc7de0fd58b830, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:48.017098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c4a74-9905-4f3a-ab29-18f64008a3cc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:48.087821 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3659/7410] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:43:47 2022] POST /identity/v3/users => generated 364 bytes in 881 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:43:48.105668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3088e1-dc8c-4792-9e96-1d21ed1447c0 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:48.152172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3088e1-dc8c-4792-9e96-1d21ed1447c0 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:48.187482 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3752/7411] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:47 2022] PUT /identity/v3/projects/89f067ab0960448b87d63427c9eb951e/users/8b0ae24648ff414994bc7de0fd58b830/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:48.199955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ac6de-3a7c-47f8-b995-643aaf0ba136 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:48.202082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ac6de-3a7c-47f8-b995-643aaf0ba136 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:48.212145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ac6de-3a7c-47f8-b995-643aaf0ba136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:48.254016 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:48.351193 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:48.366888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-596ac6de-3a7c-47f8-b995-643aaf0ba136 None None] MFA Rules not processed for user `8b0ae24648ff414994bc7de0fd58b830`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:48.372825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-596ac6de-3a7c-47f8-b995-643aaf0ba136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:48.506030 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:48.560324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5a065-6155-4459-9b24-c1cea13bd841 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:48.561327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5a065-6155-4459-9b24-c1cea13bd841 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:48.563040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5a065-6155-4459-9b24-c1cea13bd841 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:48.565660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5a065-6155-4459-9b24-c1cea13bd841 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:48.566702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5a065-6155-4459-9b24-c1cea13bd841 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:48.569297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5a065-6155-4459-9b24-c1cea13bd841 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:48.644337 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:48.651921 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3753/7412] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:48.656355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ac6de-3a7c-47f8-b995-643aaf0ba136 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:48.693802 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3660/7413] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:43:48 2022] POST /identity/v3/projects => generated 359 bytes in 589 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:48.698722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5a065-6155-4459-9b24-c1cea13bd841 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:48.780282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ac6de-3a7c-47f8-b995-643aaf0ba136 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:48.897754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5a065-6155-4459-9b24-c1cea13bd841 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:48.903802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c09074-cc65-4b65-9879-b75a52a61b8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:48.904877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c09074-cc65-4b65-9879-b75a52a61b8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:48.905169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c09074-cc65-4b65-9879-b75a52a61b8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:48.905650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c09074-cc65-4b65-9879-b75a52a61b8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/users/25e9ec097691420e9b88d668c7e792ba` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:48.947824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277b63a-6d60-4d3f-a192-a0b72fb9a7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:48.950876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277b63a-6d60-4d3f-a192-a0b72fb9a7e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:48.951338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277b63a-6d60-4d3f-a192-a0b72fb9a7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:48.952173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277b63a-6d60-4d3f-a192-a0b72fb9a7e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:48.955383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277b63a-6d60-4d3f-a192-a0b72fb9a7e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:48.958907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277b63a-6d60-4d3f-a192-a0b72fb9a7e7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:48.960531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c09074-cc65-4b65-9879-b75a52a61b8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:update_user(user_id=25e9ec097691420e9b88d668c7e792ba)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:48.965279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c09074-cc65-4b65-9879-b75a52a61b8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:49.071999 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3754/7414] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:43:48 2022] POST /identity/v3/projects => generated 377 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:49.074768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277b63a-6d60-4d3f-a192-a0b72fb9a7e7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:49.103419 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3661/7415] 10.222.0.43 () {60 vars in 1243 bytes} [Tue Jul 19 14:43:48 2022] PATCH /identity/v3/users/25e9ec097691420e9b88d668c7e792ba => generated 522 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:49.108143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c09074-cc65-4b65-9879-b75a52a61b8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:49.128902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c09074-cc65-4b65-9879-b75a52a61b8a tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:49.239514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277b63a-6d60-4d3f-a192-a0b72fb9a7e7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:49.255280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca1a3e-1fa6-4db6-8f91-5baea10df05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:49.256141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca1a3e-1fa6-4db6-8f91-5baea10df05c admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:49.258197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca1a3e-1fa6-4db6-8f91-5baea10df05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:49.266270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aca1a3e-1fa6-4db6-8f91-5baea10df05c admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:49.266270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca1a3e-1fa6-4db6-8f91-5baea10df05c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:49.266270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aca1a3e-1fa6-4db6-8f91-5baea10df05c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:49.273507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec18b81-3d5d-44b7-81c2-17b5e5ae7345 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:49.274585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec18b81-3d5d-44b7-81c2-17b5e5ae7345 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:49.277685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec18b81-3d5d-44b7-81c2-17b5e5ae7345 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:49.278070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec18b81-3d5d-44b7-81c2-17b5e5ae7345 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/users/25e9ec097691420e9b88d668c7e792ba` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:49.313320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec18b81-3d5d-44b7-81c2-17b5e5ae7345 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:get_user(user_id=25e9ec097691420e9b88d668c7e792ba)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:49.317083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec18b81-3d5d-44b7-81c2-17b5e5ae7345 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:49.319260 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3662/7416] 10.222.0.43 () {58 vars in 1220 bytes} [Tue Jul 19 14:43:49 2022] GET /identity/v3/users/25e9ec097691420e9b88d668c7e792ba => generated 389 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:49.323011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec18b81-3d5d-44b7-81c2-17b5e5ae7345 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:49.353079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec18b81-3d5d-44b7-81c2-17b5e5ae7345 tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:49.360305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbf2a0-8ca4-478c-977a-2f10dc55e8be tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:49.362446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbf2a0-8ca4-478c-977a-2f10dc55e8be tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:49.362924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbf2a0-8ca4-478c-977a-2f10dc55e8be tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:49.367711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cbf2a0-8ca4-478c-977a-2f10dc55e8be tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/projects/117247e7b84f44d99ccb9043154d3375` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:49.369274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbf2a0-8ca4-478c-977a-2f10dc55e8be tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:delete_project(project_id=117247e7b84f44d99ccb9043154d3375)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:49.371442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cbf2a0-8ca4-478c-977a-2f10dc55e8be tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:49.383374 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3755/7417] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:43:49 2022] POST /identity/v3/users => generated 289 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:49.386285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca1a3e-1fa6-4db6-8f91-5baea10df05c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:49.402634 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:49.420535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aca1a3e-1fa6-4db6-8f91-5baea10df05c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:49.451917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f6a80-06d0-4e86-bd5d-280f4e855974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:49.454286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f6a80-06d0-4e86-bd5d-280f4e855974 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:49.456189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f6a80-06d0-4e86-bd5d-280f4e855974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:49.456682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f6a80-06d0-4e86-bd5d-280f4e855974 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:49.457800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f6a80-06d0-4e86-bd5d-280f4e855974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:49.460919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591f6a80-06d0-4e86-bd5d-280f4e855974 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:49.510404 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3756/7418] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:43:49.516070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f6a80-06d0-4e86-bd5d-280f4e855974 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:49.526803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37cbf2a0-8ca4-478c-977a-2f10dc55e8be tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '117247e7b84f44d99ccb9043154d3375', 'request_id': 'req-37cbf2a0-8ca4-478c-977a-2f10dc55e8be'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:49.549983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591f6a80-06d0-4e86-bd5d-280f4e855974 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:49.613468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37cbf2a0-8ca4-478c-977a-2f10dc55e8be tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '117247e7b84f44d99ccb9043154d3375', 'request_id': 'req-37cbf2a0-8ca4-478c-977a-2f10dc55e8be'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:49.624029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37cbf2a0-8ca4-478c-977a-2f10dc55e8be tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '117247e7b84f44d99ccb9043154d3375', 'request_id': 'req-37cbf2a0-8ca4-478c-977a-2f10dc55e8be'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:49.625365 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:49.686959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37cbf2a0-8ca4-478c-977a-2f10dc55e8be tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] The token cache is being invalidate because project 117247e7b84f44d99ccb9043154d3375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:49.687304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37cbf2a0-8ca4-478c-977a-2f10dc55e8be tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:49.688114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37cbf2a0-8ca4-478c-977a-2f10dc55e8be tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:49.693271 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3663/7419] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:49 2022] DELETE /identity/v3/projects/117247e7b84f44d99ccb9043154d3375 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:49.694244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbf2a0-8ca4-478c-977a-2f10dc55e8be tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:49.710176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-37cbf2a0-8ca4-478c-977a-2f10dc55e8be tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:49.765380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbbe7f-abfa-4688-9446-d67583e2fa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:49.772277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbbe7f-abfa-4688-9446-d67583e2fa06 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:49.772874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbbe7f-abfa-4688-9446-d67583e2fa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:49.773334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cbbe7f-abfa-4688-9446-d67583e2fa06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:49.774689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbbe7f-abfa-4688-9446-d67583e2fa06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:49.776778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cbbe7f-abfa-4688-9446-d67583e2fa06 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:49.825998 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3757/7420] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:49.830091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbbe7f-abfa-4688-9446-d67583e2fa06 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:49.837177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-99cbbe7f-abfa-4688-9446-d67583e2fa06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:49.868164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cbbe7f-abfa-4688-9446-d67583e2fa06 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:49.881744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cbf2a0-8ca4-478c-977a-2f10dc55e8be tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:49.883873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f83090-c52d-4463-90c1-dc549b0387d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:49.886177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f83090-c52d-4463-90c1-dc549b0387d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:49.887310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f83090-c52d-4463-90c1-dc549b0387d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:49.888202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f83090-c52d-4463-90c1-dc549b0387d8 admin admin] PATH_INFO: `/v3/projects/17491a0e97614237bc6395cb9dcc14fa/users/fa6267c8ddd945bd88928dc250283001/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:49.898056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028347a-c2d0-4619-a94e-f7a4c35126af tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc957af991f24888a521e5b860339af7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:49.899259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028347a-c2d0-4619-a94e-f7a4c35126af tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:49.901391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028347a-c2d0-4619-a94e-f7a4c35126af tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:49.901842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d028347a-c2d0-4619-a94e-f7a4c35126af tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] PATH_INFO: `/v3/users/25e9ec097691420e9b88d668c7e792ba` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:49.904642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028347a-c2d0-4619-a94e-f7a4c35126af tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorizing `identity:delete_user(user_id=25e9ec097691420e9b88d668c7e792ba)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:49.913576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d028347a-c2d0-4619-a94e-f7a4c35126af tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:49.935592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f83090-c52d-4463-90c1-dc549b0387d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17491a0e97614237bc6395cb9dcc14fa, user_id=fa6267c8ddd945bd88928dc250283001, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:49.948840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f83090-c52d-4463-90c1-dc549b0387d8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:50.076310 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3758/7421] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:49 2022] PUT /identity/v3/projects/17491a0e97614237bc6395cb9dcc14fa/users/fa6267c8ddd945bd88928dc250283001/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:50.093627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7878b6-5942-43fa-ae49-992c579009fd None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:50.094313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7878b6-5942-43fa-ae49-992c579009fd None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:50.094752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7878b6-5942-43fa-ae49-992c579009fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:50.139861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d028347a-c2d0-4619-a94e-f7a4c35126af tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25e9ec097691420e9b88d668c7e792ba'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:50.188202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d028347a-c2d0-4619-a94e-f7a4c35126af tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25e9ec097691420e9b88d668c7e792ba'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:50.191022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d028347a-c2d0-4619-a94e-f7a4c35126af tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25e9ec097691420e9b88d668c7e792ba'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:50.191663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4d7878b6-5942-43fa-ae49-992c579009fd None None] MFA Rules not processed for user `fa6267c8ddd945bd88928dc250283001`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:50.193059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d028347a-c2d0-4619-a94e-f7a4c35126af tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25e9ec097691420e9b88d668c7e792ba'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:50.206062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4d7878b6-5942-43fa-ae49-992c579009fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:50.224123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d028347a-c2d0-4619-a94e-f7a4c35126af tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25e9ec097691420e9b88d668c7e792ba'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:50.229790 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:50.302582 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3664/7422] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:49 2022] DELETE /identity/v3/users/25e9ec097691420e9b88d668c7e792ba => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:50.307270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028347a-c2d0-4619-a94e-f7a4c35126af tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:50.315129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d028347a-c2d0-4619-a94e-f7a4c35126af tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:50.405187 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3759/7423] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:50.411416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7878b6-5942-43fa-ae49-992c579009fd None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:50.414534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4d7878b6-5942-43fa-ae49-992c579009fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:50.500512 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:50.519577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d028347a-c2d0-4619-a94e-f7a4c35126af tempest-UsersV3TestJSON-1586592060 tempest-UsersV3TestJSON-1586592060-project-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:50.534758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608ba624-bbde-4b76-a2c9-60b474cb3d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:50.537794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ba624-bbde-4b76-a2c9-60b474cb3d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:50.538324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ba624-bbde-4b76-a2c9-60b474cb3d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:50.539108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608ba624-bbde-4b76-a2c9-60b474cb3d71 admin admin] PATH_INFO: `/v3/users/fec3ccad323d4f94971cc9ba929e6c2c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:50.592533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ba624-bbde-4b76-a2c9-60b474cb3d71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fec3ccad323d4f94971cc9ba929e6c2c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:50.599449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608ba624-bbde-4b76-a2c9-60b474cb3d71 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:50.623643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7878b6-5942-43fa-ae49-992c579009fd None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:50.630060 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:50.661169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08ba04-742f-4c57-a380-038713a63b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:50.664598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08ba04-742f-4c57-a380-038713a63b35 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:50.664598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08ba04-742f-4c57-a380-038713a63b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:50.664598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d08ba04-742f-4c57-a380-038713a63b35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:50.664598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08ba04-742f-4c57-a380-038713a63b35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:50.673743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d08ba04-742f-4c57-a380-038713a63b35 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:50.843382 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3760/7424] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:43:50 2022] POST /identity/v3/projects => generated 375 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:50.845803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08ba04-742f-4c57-a380-038713a63b35 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:50.884588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-608ba624-bbde-4b76-a2c9-60b474cb3d71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fec3ccad323d4f94971cc9ba929e6c2c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:50.929581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-608ba624-bbde-4b76-a2c9-60b474cb3d71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fec3ccad323d4f94971cc9ba929e6c2c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:50.930385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-608ba624-bbde-4b76-a2c9-60b474cb3d71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fec3ccad323d4f94971cc9ba929e6c2c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:50.931199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-608ba624-bbde-4b76-a2c9-60b474cb3d71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fec3ccad323d4f94971cc9ba929e6c2c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:50.952953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-608ba624-bbde-4b76-a2c9-60b474cb3d71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fec3ccad323d4f94971cc9ba929e6c2c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:50.957527 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:50.999766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d08ba04-742f-4c57-a380-038713a63b35 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:51.007013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cc641-0c3c-48e7-b214-40e0cb9a88ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:51.007653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cc641-0c3c-48e7-b214-40e0cb9a88ec admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:51.007945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cc641-0c3c-48e7-b214-40e0cb9a88ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:51.008231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2cc641-0c3c-48e7-b214-40e0cb9a88ec admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:51.008958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cc641-0c3c-48e7-b214-40e0cb9a88ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:51.011259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2cc641-0c3c-48e7-b214-40e0cb9a88ec admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:51.061451 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3665/7425] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:50 2022] DELETE /identity/v3/users/fec3ccad323d4f94971cc9ba929e6c2c => generated 0 bytes in 754 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:51.066530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fe89d-5abf-46e7-9f3a-c3de258e9427 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:51.066830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fe89d-5abf-46e7-9f3a-c3de258e9427 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:51.067120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6fe89d-5abf-46e7-9f3a-c3de258e9427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:51.099898 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:51.104811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1e6fe89d-5abf-46e7-9f3a-c3de258e9427 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:51.106080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1e6fe89d-5abf-46e7-9f3a-c3de258e9427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:51.146039 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3761/7426] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:43:50 2022] POST /identity/v3/users => generated 294 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:43:51.147697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cc641-0c3c-48e7-b214-40e0cb9a88ec admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:51.151292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1a2cc641-0c3c-48e7-b214-40e0cb9a88ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:51.163517 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:51.180968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2cc641-0c3c-48e7-b214-40e0cb9a88ec admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:51.337510 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3666/7427] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:51.368002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fe89d-5abf-46e7-9f3a-c3de258e9427 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:51.369575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1e6fe89d-5abf-46e7-9f3a-c3de258e9427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:51.403352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996577b0-7f92-4de4-a0ef-085cf37caef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:51.404069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996577b0-7f92-4de4-a0ef-085cf37caef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:51.404385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996577b0-7f92-4de4-a0ef-085cf37caef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:51.404833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996577b0-7f92-4de4-a0ef-085cf37caef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:51.405597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996577b0-7f92-4de4-a0ef-085cf37caef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:51.407254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996577b0-7f92-4de4-a0ef-085cf37caef1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:51.435598 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3762/7428] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:43:51.436451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996577b0-7f92-4de4-a0ef-085cf37caef1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:51.460469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996577b0-7f92-4de4-a0ef-085cf37caef1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:51.473209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6fe89d-5abf-46e7-9f3a-c3de258e9427 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:51.474515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030d364-7564-4294-bd9e-ceee7007cede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:51.485328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030d364-7564-4294-bd9e-ceee7007cede admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:51.485328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030d364-7564-4294-bd9e-ceee7007cede admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:51.485328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e030d364-7564-4294-bd9e-ceee7007cede admin admin] PATH_INFO: `/v3/projects/6c39bb0e5b8740e4a0e011c12eaccf6e/users/92c1b7aa934a4df2be67991fba0ab3e2/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:51.485666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aecd31-469f-4b62-a710-204ab7a20134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:51.485666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aecd31-469f-4b62-a710-204ab7a20134 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:51.485666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aecd31-469f-4b62-a710-204ab7a20134 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:51.485666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aecd31-469f-4b62-a710-204ab7a20134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:51.499820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aecd31-469f-4b62-a710-204ab7a20134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:51.502348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aecd31-469f-4b62-a710-204ab7a20134 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:51.511399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030d364-7564-4294-bd9e-ceee7007cede admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c39bb0e5b8740e4a0e011c12eaccf6e, user_id=92c1b7aa934a4df2be67991fba0ab3e2, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:51.516347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e030d364-7564-4294-bd9e-ceee7007cede admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:51.521313 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:51.527860 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3667/7429] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:43:51.593605 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3763/7430] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:51 2022] PUT /identity/v3/projects/6c39bb0e5b8740e4a0e011c12eaccf6e/users/92c1b7aa934a4df2be67991fba0ab3e2/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:51.599153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aecd31-469f-4b62-a710-204ab7a20134 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:51.611964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aecd31-469f-4b62-a710-204ab7a20134 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:51.687970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6430a88-e82d-48cf-a493-6f03e799d809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:51.688391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6430a88-e82d-48cf-a493-6f03e799d809 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:51.689302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6430a88-e82d-48cf-a493-6f03e799d809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:51.689660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6430a88-e82d-48cf-a493-6f03e799d809 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:51.690576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6430a88-e82d-48cf-a493-6f03e799d809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:51.692543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6430a88-e82d-48cf-a493-6f03e799d809 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:51.713272 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:51.715550 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3668/7431] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:51.719504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030d364-7564-4294-bd9e-ceee7007cede admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:51.734720 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:51.742910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e030d364-7564-4294-bd9e-ceee7007cede admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:51.758608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623c178-f3cf-40c4-a1aa-da1dbdd33ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:51.762912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623c178-f3cf-40c4-a1aa-da1dbdd33ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:51.762912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623c178-f3cf-40c4-a1aa-da1dbdd33ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:51.762912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4623c178-f3cf-40c4-a1aa-da1dbdd33ce0 admin admin] PATH_INFO: `/v3/projects/6c39bb0e5b8740e4a0e011c12eaccf6e/users/92c1b7aa934a4df2be67991fba0ab3e2/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:51.765931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623c178-f3cf-40c4-a1aa-da1dbdd33ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c39bb0e5b8740e4a0e011c12eaccf6e, user_id=92c1b7aa934a4df2be67991fba0ab3e2, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:51.771271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4623c178-f3cf-40c4-a1aa-da1dbdd33ce0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:51.803540 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3764/7432] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:51 2022] PUT /identity/v3/projects/6c39bb0e5b8740e4a0e011c12eaccf6e/users/92c1b7aa934a4df2be67991fba0ab3e2/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:51.813980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83900efd-6c79-41c1-96f4-609ac19092b6 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:51.814428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83900efd-6c79-41c1-96f4-609ac19092b6 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:51.814707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83900efd-6c79-41c1-96f4-609ac19092b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:51.868552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-83900efd-6c79-41c1-96f4-609ac19092b6 None None] MFA Rules not processed for user `92c1b7aa934a4df2be67991fba0ab3e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:51.869814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-83900efd-6c79-41c1-96f4-609ac19092b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:51.877154 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:51.933818 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:52.016407 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3669/7433] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:52.029490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623c178-f3cf-40c4-a1aa-da1dbdd33ce0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:52.031835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4623c178-f3cf-40c4-a1aa-da1dbdd33ce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:52.149024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4623c178-f3cf-40c4-a1aa-da1dbdd33ce0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:52.164585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce719b9e-9530-4440-a12c-136d67da59c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:52.165642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce719b9e-9530-4440-a12c-136d67da59c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:52.166220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce719b9e-9530-4440-a12c-136d67da59c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:52.166872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce719b9e-9530-4440-a12c-136d67da59c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:52.169042 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:52.197563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce719b9e-9530-4440-a12c-136d67da59c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:52.203972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce719b9e-9530-4440-a12c-136d67da59c2 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:52.265076 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3765/7434] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:52 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:43:52.345813 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:52.461840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83900efd-6c79-41c1-96f4-609ac19092b6 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:52.463759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-83900efd-6c79-41c1-96f4-609ac19092b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:52.485451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83900efd-6c79-41c1-96f4-609ac19092b6 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:52.498659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755c4f1-914b-4dbb-9bb9-f5e4fb005757 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:52.499572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755c4f1-914b-4dbb-9bb9-f5e4fb005757 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:52.499865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755c4f1-914b-4dbb-9bb9-f5e4fb005757 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:52.500200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a755c4f1-914b-4dbb-9bb9-f5e4fb005757 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:52.503351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a755c4f1-914b-4dbb-9bb9-f5e4fb005757 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:52.643506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755c4f1-914b-4dbb-9bb9-f5e4fb005757 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:52.647753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a755c4f1-914b-4dbb-9bb9-f5e4fb005757 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:52.671870 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3670/7435] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:43:52.957207 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:52.972061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce719b9e-9530-4440-a12c-136d67da59c2 service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:52.973821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ce719b9e-9530-4440-a12c-136d67da59c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:53.060066 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:53.169289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce719b9e-9530-4440-a12c-136d67da59c2 service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:53.179393 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fe6d8-62ef-4352-90e7-9dfe94b47cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:53.180306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fe6d8-62ef-4352-90e7-9dfe94b47cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:53.180775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fe6d8-62ef-4352-90e7-9dfe94b47cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:53.181069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495fe6d8-62ef-4352-90e7-9dfe94b47cea admin admin] PATH_INFO: `/v3/projects/fdfa2414e22c4e508c54a2f17c7a28ba` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:53.184384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fe6d8-62ef-4352-90e7-9dfe94b47cea admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdfa2414e22c4e508c54a2f17c7a28ba)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:53.189439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495fe6d8-62ef-4352-90e7-9dfe94b47cea admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:53.463014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-495fe6d8-62ef-4352-90e7-9dfe94b47cea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdfa2414e22c4e508c54a2f17c7a28ba', 'request_id': 'req-495fe6d8-62ef-4352-90e7-9dfe94b47cea'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:53.477492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-495fe6d8-62ef-4352-90e7-9dfe94b47cea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdfa2414e22c4e508c54a2f17c7a28ba', 'request_id': 'req-495fe6d8-62ef-4352-90e7-9dfe94b47cea'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:53.492290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-495fe6d8-62ef-4352-90e7-9dfe94b47cea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdfa2414e22c4e508c54a2f17c7a28ba', 'request_id': 'req-495fe6d8-62ef-4352-90e7-9dfe94b47cea'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:53.593342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-495fe6d8-62ef-4352-90e7-9dfe94b47cea admin admin] The token cache is being invalidate because project fdfa2414e22c4e508c54a2f17c7a28ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:53.600934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-495fe6d8-62ef-4352-90e7-9dfe94b47cea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:53.600934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-495fe6d8-62ef-4352-90e7-9dfe94b47cea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:53.600934 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3766/7436] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:52 2022] DELETE /identity/v3/projects/fdfa2414e22c4e508c54a2f17c7a28ba => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:43:53.608002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755c4f1-914b-4dbb-9bb9-f5e4fb005757 service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:53.643742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a755c4f1-914b-4dbb-9bb9-f5e4fb005757 service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:53.663517 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:53.744207 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:53.798722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c161c0f-6e9c-416f-a5da-449f5395c5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:53.799834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c161c0f-6e9c-416f-a5da-449f5395c5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:53.800320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c161c0f-6e9c-416f-a5da-449f5395c5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:53.800778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c161c0f-6e9c-416f-a5da-449f5395c5d2 admin admin] PATH_INFO: `/v3/users/fc957af991f24888a521e5b860339af7` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:53.802074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c161c0f-6e9c-416f-a5da-449f5395c5d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc957af991f24888a521e5b860339af7)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:53.804213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c161c0f-6e9c-416f-a5da-449f5395c5d2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:54.083421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c161c0f-6e9c-416f-a5da-449f5395c5d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc957af991f24888a521e5b860339af7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:54.104482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c161c0f-6e9c-416f-a5da-449f5395c5d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc957af991f24888a521e5b860339af7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:54.114636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c161c0f-6e9c-416f-a5da-449f5395c5d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc957af991f24888a521e5b860339af7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:54.117523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c161c0f-6e9c-416f-a5da-449f5395c5d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc957af991f24888a521e5b860339af7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:54.134083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c161c0f-6e9c-416f-a5da-449f5395c5d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc957af991f24888a521e5b860339af7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:54.217279 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3671/7437] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:53 2022] DELETE /identity/v3/users/fc957af991f24888a521e5b860339af7 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:54.242920 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:54.551372 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86,keystone:UPDATE=3,keystone:INSERT=6,keystone:DELETE=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:54.734230 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:55.214019 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:55.436934 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:55.573648 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:55.664890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fe6d8-62ef-4352-90e7-9dfe94b47cea admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:55.664890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-495fe6d8-62ef-4352-90e7-9dfe94b47cea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:55.703873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495fe6d8-62ef-4352-90e7-9dfe94b47cea admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:55.922301 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:UPDATE=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:55.950766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54be48-cbe6-4ca9-ae0c-f81f805f912e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:55.978723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54be48-cbe6-4ca9-ae0c-f81f805f912e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:55.978723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54be48-cbe6-4ca9-ae0c-f81f805f912e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:55.978723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54be48-cbe6-4ca9-ae0c-f81f805f912e admin admin] PATH_INFO: `/v3/projects/a7a3bc2f1a5d428aa67459a4db8d8e61` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:55.978723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54be48-cbe6-4ca9-ae0c-f81f805f912e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a3bc2f1a5d428aa67459a4db8d8e61)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:55.978723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54be48-cbe6-4ca9-ae0c-f81f805f912e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:56.394070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c161c0f-6e9c-416f-a5da-449f5395c5d2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:56.395589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4c161c0f-6e9c-416f-a5da-449f5395c5d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:56.407001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3e54be48-cbe6-4ca9-ae0c-f81f805f912e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'request_id': 'req-3e54be48-cbe6-4ca9-ae0c-f81f805f912e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:56.426489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c161c0f-6e9c-416f-a5da-449f5395c5d2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:56.444008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3e54be48-cbe6-4ca9-ae0c-f81f805f912e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'request_id': 'req-3e54be48-cbe6-4ca9-ae0c-f81f805f912e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:56.448062 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:56.457228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3e54be48-cbe6-4ca9-ae0c-f81f805f912e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a3bc2f1a5d428aa67459a4db8d8e61', 'request_id': 'req-3e54be48-cbe6-4ca9-ae0c-f81f805f912e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:56.569531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3e54be48-cbe6-4ca9-ae0c-f81f805f912e admin admin] The token cache is being invalidate because project a7a3bc2f1a5d428aa67459a4db8d8e61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:56.570629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3e54be48-cbe6-4ca9-ae0c-f81f805f912e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:56.571467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3e54be48-cbe6-4ca9-ae0c-f81f805f912e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:56.573942 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3767/7438] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:55 2022] DELETE /identity/v3/projects/a7a3bc2f1a5d428aa67459a4db8d8e61 => generated 0 bytes in 918 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:56.582063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c444963-71bb-4385-ae5e-8085060afe58 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:56.582637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c444963-71bb-4385-ae5e-8085060afe58 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:56.583410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c444963-71bb-4385-ae5e-8085060afe58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:56.608780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3c444963-71bb-4385-ae5e-8085060afe58 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:56.621995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3c444963-71bb-4385-ae5e-8085060afe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:56.646010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba1ee7-4eb9-48a6-8737-d246fe72d0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:56.652561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba1ee7-4eb9-48a6-8737-d246fe72d0dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:56.652561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba1ee7-4eb9-48a6-8737-d246fe72d0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:56.652561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba1ee7-4eb9-48a6-8737-d246fe72d0dc admin admin] PATH_INFO: `/v3/users/b646b41e6d2d43b59ba6a7dc98054de8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:56.652561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba1ee7-4eb9-48a6-8737-d246fe72d0dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b646b41e6d2d43b59ba6a7dc98054de8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:56.652561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba1ee7-4eb9-48a6-8737-d246fe72d0dc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:56.775731 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:56.896825 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3768/7439] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:43:56.906428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d5bf1-34c7-45bf-bac0-e0510fc62d92 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:56.910444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d5bf1-34c7-45bf-bac0-e0510fc62d92 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:56.910848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-70ba1ee7-4eb9-48a6-8737-d246fe72d0dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b646b41e6d2d43b59ba6a7dc98054de8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:56.911741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682d5bf1-34c7-45bf-bac0-e0510fc62d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:56.975161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-682d5bf1-34c7-45bf-bac0-e0510fc62d92 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:56.978710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-682d5bf1-34c7-45bf-bac0-e0510fc62d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:56.994660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-70ba1ee7-4eb9-48a6-8737-d246fe72d0dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b646b41e6d2d43b59ba6a7dc98054de8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:56.997008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-70ba1ee7-4eb9-48a6-8737-d246fe72d0dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b646b41e6d2d43b59ba6a7dc98054de8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:56.998460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-70ba1ee7-4eb9-48a6-8737-d246fe72d0dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b646b41e6d2d43b59ba6a7dc98054de8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:57.000572 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3769/7440] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:57.007779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d5bf1-34c7-45bf-bac0-e0510fc62d92 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:57.022530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-70ba1ee7-4eb9-48a6-8737-d246fe72d0dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b646b41e6d2d43b59ba6a7dc98054de8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:57.040579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682d5bf1-34c7-45bf-bac0-e0510fc62d92 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:57.059740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a57331-f603-48b8-97ea-5e494eea4b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:57.060442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a57331-f603-48b8-97ea-5e494eea4b1c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:57.060728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a57331-f603-48b8-97ea-5e494eea4b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:57.061397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a57331-f603-48b8-97ea-5e494eea4b1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:57.062200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a57331-f603-48b8-97ea-5e494eea4b1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:43:57.062519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a57331-f603-48b8-97ea-5e494eea4b1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:57.064931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a57331-f603-48b8-97ea-5e494eea4b1c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:57.098291 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3770/7441] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:57.102589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a57331-f603-48b8-97ea-5e494eea4b1c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:57.104381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a1a57331-f603-48b8-97ea-5e494eea4b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:57.105555 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:57.117497 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3672/7442] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:56 2022] DELETE /identity/v3/users/b646b41e6d2d43b59ba6a7dc98054de8 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:57.122040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe05017-154c-4f47-968b-283347ef79e5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:57.122040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe05017-154c-4f47-968b-283347ef79e5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:57.122423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe05017-154c-4f47-968b-283347ef79e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:57.128962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a57331-f603-48b8-97ea-5e494eea4b1c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:57.160039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5fe05017-154c-4f47-968b-283347ef79e5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:57.161296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5fe05017-154c-4f47-968b-283347ef79e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:57.267738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804da0d7-6222-44bd-bf5b-8990b96a61f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:57.268431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804da0d7-6222-44bd-bf5b-8990b96a61f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:57.268724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804da0d7-6222-44bd-bf5b-8990b96a61f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:57.269071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804da0d7-6222-44bd-bf5b-8990b96a61f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:57.269843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804da0d7-6222-44bd-bf5b-8990b96a61f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:57.271806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804da0d7-6222-44bd-bf5b-8990b96a61f1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:57.296117 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3673/7443] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:43:57.316285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe05017-154c-4f47-968b-283347ef79e5 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:57.316285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5fe05017-154c-4f47-968b-283347ef79e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:57.410681 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3771/7444] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:43:57 2022] POST /identity/v3/projects => generated 377 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:43:57.412517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804da0d7-6222-44bd-bf5b-8990b96a61f1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:57.485199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe05017-154c-4f47-968b-283347ef79e5 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:57.540377 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:57.603933 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:57.615015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804da0d7-6222-44bd-bf5b-8990b96a61f1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:57.624905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989af995-1848-43d1-9dbe-92a2c7f01bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:57.626811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989af995-1848-43d1-9dbe-92a2c7f01bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:57.629440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989af995-1848-43d1-9dbe-92a2c7f01bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:57.629440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989af995-1848-43d1-9dbe-92a2c7f01bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:57.629440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989af995-1848-43d1-9dbe-92a2c7f01bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:57.632487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989af995-1848-43d1-9dbe-92a2c7f01bb6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:57.638796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dd898-7ab3-49bc-b14b-c67f58eb63dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:57.639840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dd898-7ab3-49bc-b14b-c67f58eb63dc service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:57.640334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dd898-7ab3-49bc-b14b-c67f58eb63dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:57.642019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129dd898-7ab3-49bc-b14b-c67f58eb63dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:57.661253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129dd898-7ab3-49bc-b14b-c67f58eb63dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:57.670810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129dd898-7ab3-49bc-b14b-c67f58eb63dc service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:57.683702 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3674/7445] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:43:57.692185 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:57.780063 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3772/7446] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:43:57 2022] POST /identity/v3/users => generated 289 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:43:57.780824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dd898-7ab3-49bc-b14b-c67f58eb63dc service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:57.821040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129dd898-7ab3-49bc-b14b-c67f58eb63dc service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:57.834040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936f946-c8a5-44e3-bfdb-597385794a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:57.836000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936f946-c8a5-44e3-bfdb-597385794a8b admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:57.837082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936f946-c8a5-44e3-bfdb-597385794a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:57.838026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b936f946-c8a5-44e3-bfdb-597385794a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:57.838781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936f946-c8a5-44e3-bfdb-597385794a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:57.843498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b936f946-c8a5-44e3-bfdb-597385794a8b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:57.898400 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3675/7447] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:43:57.899178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989af995-1848-43d1-9dbe-92a2c7f01bb6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:57.918793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989af995-1848-43d1-9dbe-92a2c7f01bb6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:57.941632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70e78e7-d27b-464f-b112-75ff912c7e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:57.942367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e78e7-d27b-464f-b112-75ff912c7e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:57.942664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e78e7-d27b-464f-b112-75ff912c7e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:57.942951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70e78e7-d27b-464f-b112-75ff912c7e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:57.943776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e78e7-d27b-464f-b112-75ff912c7e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:57.945428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70e78e7-d27b-464f-b112-75ff912c7e2f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:58.019800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936f946-c8a5-44e3-bfdb-597385794a8b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:58.029188 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3773/7448] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:43:58.037589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b936f946-c8a5-44e3-bfdb-597385794a8b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:58.067962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e704bb2-ab7d-422e-9692-8d803278423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:58.076944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e704bb2-ab7d-422e-9692-8d803278423e admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:58.077246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e704bb2-ab7d-422e-9692-8d803278423e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:58.077648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e704bb2-ab7d-422e-9692-8d803278423e admin admin] PATH_INFO: `/v3/projects/5e041e59f11d4765b600bf625dddef6b/users/b600661989544d8aa2ba414611be0b37/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:58.107085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e704bb2-ab7d-422e-9692-8d803278423e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e041e59f11d4765b600bf625dddef6b, user_id=b600661989544d8aa2ba414611be0b37, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:58.117982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e704bb2-ab7d-422e-9692-8d803278423e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:58.224132 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3676/7449] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:43:58 2022] PUT /identity/v3/projects/5e041e59f11d4765b600bf625dddef6b/users/b600661989544d8aa2ba414611be0b37/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:58.231952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591624db-0e74-4bf2-a6c1-a425cfceca6e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:58.232372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591624db-0e74-4bf2-a6c1-a425cfceca6e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:58.232667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591624db-0e74-4bf2-a6c1-a425cfceca6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:58.272332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-591624db-0e74-4bf2-a6c1-a425cfceca6e None None] MFA Rules not processed for user `b600661989544d8aa2ba414611be0b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:58.273658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-591624db-0e74-4bf2-a6c1-a425cfceca6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:58.479649 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3774/7450] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:58.484281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e704bb2-ab7d-422e-9692-8d803278423e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:58.490857 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:58.513283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e704bb2-ab7d-422e-9692-8d803278423e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:58.515531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591624db-0e74-4bf2-a6c1-a425cfceca6e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:58.528286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-591624db-0e74-4bf2-a6c1-a425cfceca6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:58.535980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ff6b3-e5e8-4575-8080-426ee00fa7dd tempest-DefaultDomainTestJSON-515719938 tempest-DefaultDomainTestJSON-515719938-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b600661989544d8aa2ba414611be0b37', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e041e59f11d4765b600bf625dddef6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:58.539252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ff6b3-e5e8-4575-8080-426ee00fa7dd tempest-DefaultDomainTestJSON-515719938 tempest-DefaultDomainTestJSON-515719938-project] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:58.540173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ff6b3-e5e8-4575-8080-426ee00fa7dd tempest-DefaultDomainTestJSON-515719938 tempest-DefaultDomainTestJSON-515719938-project] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:58.542051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ff6b3-e5e8-4575-8080-426ee00fa7dd tempest-DefaultDomainTestJSON-515719938 tempest-DefaultDomainTestJSON-515719938-project] PATH_INFO: `/v3/domains/default` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:58.544036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ff6b3-e5e8-4575-8080-426ee00fa7dd tempest-DefaultDomainTestJSON-515719938 tempest-DefaultDomainTestJSON-515719938-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:58.549633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0ff6b3-e5e8-4575-8080-426ee00fa7dd tempest-DefaultDomainTestJSON-515719938 tempest-DefaultDomainTestJSON-515719938-project] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:58.559953 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3677/7451] 10.222.0.43 () {58 vars in 1151 bytes} [Tue Jul 19 14:43:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:43:58.564807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ff6b3-e5e8-4575-8080-426ee00fa7dd tempest-DefaultDomainTestJSON-515719938 tempest-DefaultDomainTestJSON-515719938-project] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:58.793240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591624db-0e74-4bf2-a6c1-a425cfceca6e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:58.806879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc73bbf-748b-4008-829c-de530466a0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:58.807953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc73bbf-748b-4008-829c-de530466a0dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:58.808342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc73bbf-748b-4008-829c-de530466a0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:58.808746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc73bbf-748b-4008-829c-de530466a0dc admin admin] PATH_INFO: `/v3/projects/00211e7217264ff28c401766ae88bcf4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:58.810353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc73bbf-748b-4008-829c-de530466a0dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=00211e7217264ff28c401766ae88bcf4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:58.812465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc73bbf-748b-4008-829c-de530466a0dc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:58.838339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ff6b3-e5e8-4575-8080-426ee00fa7dd tempest-DefaultDomainTestJSON-515719938 tempest-DefaultDomainTestJSON-515719938-project] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:58.845627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249b8cc-de87-49e0-a0f3-8b6555a4b305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:58.847632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249b8cc-de87-49e0-a0f3-8b6555a4b305 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:58.847966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249b8cc-de87-49e0-a0f3-8b6555a4b305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:58.848277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249b8cc-de87-49e0-a0f3-8b6555a4b305 admin admin] PATH_INFO: `/v3/users/b600661989544d8aa2ba414611be0b37` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:58.849946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249b8cc-de87-49e0-a0f3-8b6555a4b305 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b600661989544d8aa2ba414611be0b37)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:58.852958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249b8cc-de87-49e0-a0f3-8b6555a4b305 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:59.048682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cfc73bbf-748b-4008-829c-de530466a0dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00211e7217264ff28c401766ae88bcf4', 'request_id': 'req-cfc73bbf-748b-4008-829c-de530466a0dc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:59.071632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cfc73bbf-748b-4008-829c-de530466a0dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00211e7217264ff28c401766ae88bcf4', 'request_id': 'req-cfc73bbf-748b-4008-829c-de530466a0dc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:59.101004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cfc73bbf-748b-4008-829c-de530466a0dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00211e7217264ff28c401766ae88bcf4', 'request_id': 'req-cfc73bbf-748b-4008-829c-de530466a0dc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:59.124073 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:59.162439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8249b8cc-de87-49e0-a0f3-8b6555a4b305 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b600661989544d8aa2ba414611be0b37'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:59.227090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8249b8cc-de87-49e0-a0f3-8b6555a4b305 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b600661989544d8aa2ba414611be0b37'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:59.235692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8249b8cc-de87-49e0-a0f3-8b6555a4b305 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b600661989544d8aa2ba414611be0b37'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:59.237193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8249b8cc-de87-49e0-a0f3-8b6555a4b305 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b600661989544d8aa2ba414611be0b37'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:59.238782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cfc73bbf-748b-4008-829c-de530466a0dc admin admin] The token cache is being invalidate because project 00211e7217264ff28c401766ae88bcf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:43:59.240278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cfc73bbf-748b-4008-829c-de530466a0dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:59.244793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cfc73bbf-748b-4008-829c-de530466a0dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:59.247559 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3775/7452] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:43:58 2022] DELETE /identity/v3/projects/00211e7217264ff28c401766ae88bcf4 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:43:59.254304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a685990-2265-41d4-8dbf-38ee0d3fc04e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:59.255712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a685990-2265-41d4-8dbf-38ee0d3fc04e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:59.256154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a685990-2265-41d4-8dbf-38ee0d3fc04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:59.267153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8249b8cc-de87-49e0-a0f3-8b6555a4b305 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b600661989544d8aa2ba414611be0b37'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:43:59.306627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4a685990-2265-41d4-8dbf-38ee0d3fc04e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:59.310217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4a685990-2265-41d4-8dbf-38ee0d3fc04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:59.400186 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3678/7453] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:58 2022] DELETE /identity/v3/users/b600661989544d8aa2ba414611be0b37 => generated 0 bytes in 833 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:43:59.401728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fecd0f-8522-4d8e-812a-f09d160172eb None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:59.402028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fecd0f-8522-4d8e-812a-f09d160172eb None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:59.402354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fecd0f-8522-4d8e-812a-f09d160172eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:59.433024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-09fecd0f-8522-4d8e-812a-f09d160172eb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:59.443924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-09fecd0f-8522-4d8e-812a-f09d160172eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:59.451225 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3776/7454] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:59.455030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cd469-e7fb-4076-8425-4a2d989fefd8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:59.455324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cd469-e7fb-4076-8425-4a2d989fefd8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:59.455612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cd469-e7fb-4076-8425-4a2d989fefd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:59.560787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-063cd469-e7fb-4076-8425-4a2d989fefd8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:43:59.565312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-063cd469-e7fb-4076-8425-4a2d989fefd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:59.590996 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:43:59.773450 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3679/7455] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:59.782259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fecd0f-8522-4d8e-812a-f09d160172eb None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:59.784154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-09fecd0f-8522-4d8e-812a-f09d160172eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:59.805861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fecd0f-8522-4d8e-812a-f09d160172eb None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:59.807046 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3777/7456] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:43:59.807935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cd469-e7fb-4076-8425-4a2d989fefd8 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:43:59.815759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-063cd469-e7fb-4076-8425-4a2d989fefd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:43:59.824237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1257fcf8-cf5d-460e-b8e1-bd23d2012f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:59.825154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257fcf8-cf5d-460e-b8e1-bd23d2012f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:59.825438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257fcf8-cf5d-460e-b8e1-bd23d2012f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:59.825714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1257fcf8-cf5d-460e-b8e1-bd23d2012f49 admin admin] PATH_INFO: `/v3/users/14fb30b0015e41e6b809dfd90922f137` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:43:59.834654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257fcf8-cf5d-460e-b8e1-bd23d2012f49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14fb30b0015e41e6b809dfd90922f137)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:43:59.836621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1257fcf8-cf5d-460e-b8e1-bd23d2012f49 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:43:59.959441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cd469-e7fb-4076-8425-4a2d989fefd8 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:43:59.971473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fd085-c61b-4d28-aaf8-cc65d9bdf9af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:43:59.972869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fd085-c61b-4d28-aaf8-cc65d9bdf9af service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:43:59.973322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fd085-c61b-4d28-aaf8-cc65d9bdf9af service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:43:59.973775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28fd085-c61b-4d28-aaf8-cc65d9bdf9af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:00.002829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fd085-c61b-4d28-aaf8-cc65d9bdf9af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:00.005987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28fd085-c61b-4d28-aaf8-cc65d9bdf9af service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:00.035535 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3778/7457] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:43:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:44:00.050000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fd085-c61b-4d28-aaf8-cc65d9bdf9af service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:00.078421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28fd085-c61b-4d28-aaf8-cc65d9bdf9af service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:00.095939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f526dd-4c23-4f2e-8973-0083c24b762b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:00.097071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f526dd-4c23-4f2e-8973-0083c24b762b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:00.097541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f526dd-4c23-4f2e-8973-0083c24b762b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:00.097986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f526dd-4c23-4f2e-8973-0083c24b762b admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:00.100914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f526dd-4c23-4f2e-8973-0083c24b762b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:44:00.101716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f526dd-4c23-4f2e-8973-0083c24b762b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:00.107341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f526dd-4c23-4f2e-8973-0083c24b762b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:00.128188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1257fcf8-cf5d-460e-b8e1-bd23d2012f49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14fb30b0015e41e6b809dfd90922f137'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:00.139001 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3779/7458] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:44:00.143955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f526dd-4c23-4f2e-8973-0083c24b762b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:00.169228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1257fcf8-cf5d-460e-b8e1-bd23d2012f49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14fb30b0015e41e6b809dfd90922f137'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:00.170156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f526dd-4c23-4f2e-8973-0083c24b762b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:00.171528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1257fcf8-cf5d-460e-b8e1-bd23d2012f49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14fb30b0015e41e6b809dfd90922f137'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:00.172464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1257fcf8-cf5d-460e-b8e1-bd23d2012f49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14fb30b0015e41e6b809dfd90922f137'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:00.182556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1257fcf8-cf5d-460e-b8e1-bd23d2012f49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14fb30b0015e41e6b809dfd90922f137'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:00.187893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c7305-c0bc-455b-a979-132dd37a530e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:00.188592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c7305-c0bc-455b-a979-132dd37a530e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:00.189370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c7305-c0bc-455b-a979-132dd37a530e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:00.189671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c7305-c0bc-455b-a979-132dd37a530e admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:00.190583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c7305-c0bc-455b-a979-132dd37a530e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:00.192545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8c7305-c0bc-455b-a979-132dd37a530e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:00.289948 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3680/7459] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:43:59 2022] DELETE /identity/v3/users/14fb30b0015e41e6b809dfd90922f137 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:44:00.295754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ba3d8-6ecb-4d28-88cf-4bbebea06e3a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:00.296248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ba3d8-6ecb-4d28-88cf-4bbebea06e3a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:00.296693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ba3d8-6ecb-4d28-88cf-4bbebea06e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:00.325780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c18ba3d8-6ecb-4d28-88cf-4bbebea06e3a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:00.327344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c18ba3d8-6ecb-4d28-88cf-4bbebea06e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:00.353507 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3780/7460] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:44:00 2022] POST /identity/v3/projects => generated 383 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:00.355008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c7305-c0bc-455b-a979-132dd37a530e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:00.361921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8f8c7305-c0bc-455b-a979-132dd37a530e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:00.369342 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:00.460414 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3681/7461] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:00.491688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ba3d8-6ecb-4d28-88cf-4bbebea06e3a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:00.495093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c18ba3d8-6ecb-4d28-88cf-4bbebea06e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:00.504847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c7305-c0bc-455b-a979-132dd37a530e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:00.530727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d6238-b293-4481-9f63-56eb67b57f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:00.531440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d6238-b293-4481-9f63-56eb67b57f12 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:00.531726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d6238-b293-4481-9f63-56eb67b57f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:00.532004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d6238-b293-4481-9f63-56eb67b57f12 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:00.533312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d6238-b293-4481-9f63-56eb67b57f12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:00.539472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d6238-b293-4481-9f63-56eb67b57f12 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:00.672043 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3781/7462] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:44:00 2022] POST /identity/v3/users => generated 292 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:44:00.672043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d6238-b293-4481-9f63-56eb67b57f12 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:00.700021 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:00.700857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d6238-b293-4481-9f63-56eb67b57f12 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:00.727228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53ee16-c260-45ca-80c8-46147ac8491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:00.727828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53ee16-c260-45ca-80c8-46147ac8491c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:00.728204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53ee16-c260-45ca-80c8-46147ac8491c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:00.728493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53ee16-c260-45ca-80c8-46147ac8491c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:00.729255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53ee16-c260-45ca-80c8-46147ac8491c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:00.739989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a53ee16-c260-45ca-80c8-46147ac8491c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:00.772708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ba3d8-6ecb-4d28-88cf-4bbebea06e3a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:00.794431 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3782/7463] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:00.795409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53ee16-c260-45ca-80c8-46147ac8491c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:00.812431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a53ee16-c260-45ca-80c8-46147ac8491c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:00.827917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c87fdd-fbeb-4d1b-a0c5-4f33944b0605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:00.828610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c87fdd-fbeb-4d1b-a0c5-4f33944b0605 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:00.828951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c87fdd-fbeb-4d1b-a0c5-4f33944b0605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:00.829238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c87fdd-fbeb-4d1b-a0c5-4f33944b0605 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:00.830672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c87fdd-fbeb-4d1b-a0c5-4f33944b0605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:00.835165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c87fdd-fbeb-4d1b-a0c5-4f33944b0605 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:00.866687 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3783/7464] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:00.867628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c87fdd-fbeb-4d1b-a0c5-4f33944b0605 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:00.912818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c87fdd-fbeb-4d1b-a0c5-4f33944b0605 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:00.933514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800efa7c-a997-4fc5-bc1c-981cb2359024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:00.935106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800efa7c-a997-4fc5-bc1c-981cb2359024 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:00.942498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800efa7c-a997-4fc5-bc1c-981cb2359024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:00.942498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800efa7c-a997-4fc5-bc1c-981cb2359024 admin admin] PATH_INFO: `/v3/projects/49fffcdc5484482da1d3085fa74ecbca/users/de28f05cafd54c619315e5aed99d287b/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:00.942735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19295935-cd1a-46d7-851e-292e80c2447d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:00.942735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19295935-cd1a-46d7-851e-292e80c2447d service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:00.942735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19295935-cd1a-46d7-851e-292e80c2447d service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:00.942735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19295935-cd1a-46d7-851e-292e80c2447d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:00.952281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19295935-cd1a-46d7-851e-292e80c2447d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:00.954000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19295935-cd1a-46d7-851e-292e80c2447d service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:00.975414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800efa7c-a997-4fc5-bc1c-981cb2359024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49fffcdc5484482da1d3085fa74ecbca, user_id=de28f05cafd54c619315e5aed99d287b, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:00.975414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800efa7c-a997-4fc5-bc1c-981cb2359024 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:00.988738 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3682/7465] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:44:00.989654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19295935-cd1a-46d7-851e-292e80c2447d service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:00.996478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-19295935-cd1a-46d7-851e-292e80c2447d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:01.028560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19295935-cd1a-46d7-851e-292e80c2447d service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:01.040468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373e14f-18cf-434d-9fa8-81d5db344209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:01.042166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373e14f-18cf-434d-9fa8-81d5db344209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:01.042470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373e14f-18cf-434d-9fa8-81d5db344209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:01.042761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373e14f-18cf-434d-9fa8-81d5db344209 admin admin] PATH_INFO: `/v3/projects/5e041e59f11d4765b600bf625dddef6b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:01.045597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373e14f-18cf-434d-9fa8-81d5db344209 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e041e59f11d4765b600bf625dddef6b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:01.047590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373e14f-18cf-434d-9fa8-81d5db344209 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:01.056714 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3784/7466] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:44:00 2022] PUT /identity/v3/projects/49fffcdc5484482da1d3085fa74ecbca/users/de28f05cafd54c619315e5aed99d287b/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:01.070126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1279d-d082-4373-a1f0-3540c3dd5b3b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:01.070462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1279d-d082-4373-a1f0-3540c3dd5b3b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:01.070783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e1279d-d082-4373-a1f0-3540c3dd5b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:01.140764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-48e1279d-d082-4373-a1f0-3540c3dd5b3b None None] MFA Rules not processed for user `de28f05cafd54c619315e5aed99d287b`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:01.142215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-48e1279d-d082-4373-a1f0-3540c3dd5b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:01.242720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2373e14f-18cf-434d-9fa8-81d5db344209 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e041e59f11d4765b600bf625dddef6b', 'request_id': 'req-2373e14f-18cf-434d-9fa8-81d5db344209'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:01.315899 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3785/7467] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:01.327590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2373e14f-18cf-434d-9fa8-81d5db344209 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e041e59f11d4765b600bf625dddef6b', 'request_id': 'req-2373e14f-18cf-434d-9fa8-81d5db344209'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:01.339467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2373e14f-18cf-434d-9fa8-81d5db344209 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e041e59f11d4765b600bf625dddef6b', 'request_id': 'req-2373e14f-18cf-434d-9fa8-81d5db344209'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:01.357787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1279d-d082-4373-a1f0-3540c3dd5b3b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:01.359664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-48e1279d-d082-4373-a1f0-3540c3dd5b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:01.403533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2373e14f-18cf-434d-9fa8-81d5db344209 admin admin] The token cache is being invalidate because project 5e041e59f11d4765b600bf625dddef6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:44:01.406584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2373e14f-18cf-434d-9fa8-81d5db344209 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:01.410082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2373e14f-18cf-434d-9fa8-81d5db344209 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:01.421604 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3683/7468] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:44:00 2022] DELETE /identity/v3/projects/5e041e59f11d4765b600bf625dddef6b => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:01.427758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3c732-d310-4e91-821c-df68d1e7b891 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:01.429987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3c732-d310-4e91-821c-df68d1e7b891 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:01.432285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a3c732-d310-4e91-821c-df68d1e7b891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:01.545407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-57a3c732-d310-4e91-821c-df68d1e7b891 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:01.550011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-57a3c732-d310-4e91-821c-df68d1e7b891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:01.824185 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3684/7469] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:01.825674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3c732-d310-4e91-821c-df68d1e7b891 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:01.827315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-57a3c732-d310-4e91-821c-df68d1e7b891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:01.860114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a3c732-d310-4e91-821c-df68d1e7b891 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:01.876488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bea90-68c1-4d64-8be6-6e7b73caf23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:01.877516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bea90-68c1-4d64-8be6-6e7b73caf23a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:01.877910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bea90-68c1-4d64-8be6-6e7b73caf23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:01.878320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bea90-68c1-4d64-8be6-6e7b73caf23a admin admin] PATH_INFO: `/v3/projects/466f74eba5ee46f98cd8bac3510a47f0` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:01.879690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bea90-68c1-4d64-8be6-6e7b73caf23a admin admin] RBAC: Authorizing `identity:delete_project(project_id=466f74eba5ee46f98cd8bac3510a47f0)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:01.881723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bea90-68c1-4d64-8be6-6e7b73caf23a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:01.894078 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:01.922249 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:01.947828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e1279d-d082-4373-a1f0-3540c3dd5b3b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:02.017479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80df8be-8637-423b-9972-d8bd6c37907a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:02.019189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80df8be-8637-423b-9972-d8bd6c37907a service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:02.019579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80df8be-8637-423b-9972-d8bd6c37907a service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:02.019957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80df8be-8637-423b-9972-d8bd6c37907a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:02.022016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b80df8be-8637-423b-9972-d8bd6c37907a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:02.145083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b72bea90-68c1-4d64-8be6-6e7b73caf23a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '466f74eba5ee46f98cd8bac3510a47f0', 'request_id': 'req-b72bea90-68c1-4d64-8be6-6e7b73caf23a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:02.203092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80df8be-8637-423b-9972-d8bd6c37907a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:02.204790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80df8be-8637-423b-9972-d8bd6c37907a service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:02.231292 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3786/7470] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 869 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:44:02.231292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13ceae-83fa-4bab-b80a-e6a112e55f8c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:02.231292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13ceae-83fa-4bab-b80a-e6a112e55f8c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:02.231292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13ceae-83fa-4bab-b80a-e6a112e55f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:02.242775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b72bea90-68c1-4d64-8be6-6e7b73caf23a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '466f74eba5ee46f98cd8bac3510a47f0', 'request_id': 'req-b72bea90-68c1-4d64-8be6-6e7b73caf23a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:02.257432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b72bea90-68c1-4d64-8be6-6e7b73caf23a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '466f74eba5ee46f98cd8bac3510a47f0', 'request_id': 'req-b72bea90-68c1-4d64-8be6-6e7b73caf23a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:02.276242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2c13ceae-83fa-4bab-b80a-e6a112e55f8c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:02.277641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2c13ceae-83fa-4bab-b80a-e6a112e55f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:02.331283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b72bea90-68c1-4d64-8be6-6e7b73caf23a admin admin] The token cache is being invalidate because project 466f74eba5ee46f98cd8bac3510a47f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:44:02.332259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b72bea90-68c1-4d64-8be6-6e7b73caf23a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:02.334298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b72bea90-68c1-4d64-8be6-6e7b73caf23a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:02.336835 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3685/7471] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:44:01 2022] DELETE /identity/v3/projects/466f74eba5ee46f98cd8bac3510a47f0 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:02.341129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bea90-68c1-4d64-8be6-6e7b73caf23a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:02.349903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b72bea90-68c1-4d64-8be6-6e7b73caf23a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:02.519576 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3787/7472] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:02.520651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13ceae-83fa-4bab-b80a-e6a112e55f8c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:02.561048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13ceae-83fa-4bab-b80a-e6a112e55f8c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:02.599185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790b8e3-7cdf-48c0-9a13-c227ce9cb2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:02.599185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790b8e3-7cdf-48c0-9a13-c227ce9cb2bd admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:02.599185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790b8e3-7cdf-48c0-9a13-c227ce9cb2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:02.599185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f790b8e3-7cdf-48c0-9a13-c227ce9cb2bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:02.599653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790b8e3-7cdf-48c0-9a13-c227ce9cb2bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:44:02.599653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790b8e3-7cdf-48c0-9a13-c227ce9cb2bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:02.599653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f790b8e3-7cdf-48c0-9a13-c227ce9cb2bd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:02.627488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bea90-68c1-4d64-8be6-6e7b73caf23a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:02.651778 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3788/7473] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:44:02.652088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3e84c-bff2-4054-8f3c-d20d9ca9ba23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:02.652786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3e84c-bff2-4054-8f3c-d20d9ca9ba23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:02.653245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3e84c-bff2-4054-8f3c-d20d9ca9ba23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:02.654371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790b8e3-7cdf-48c0-9a13-c227ce9cb2bd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:02.654832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3e84c-bff2-4054-8f3c-d20d9ca9ba23 admin admin] PATH_INFO: `/v3/users/1d207885d56f470cabaa6a5810e3f0b6` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:02.656656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3e84c-bff2-4054-8f3c-d20d9ca9ba23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d207885d56f470cabaa6a5810e3f0b6)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:02.664228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3e84c-bff2-4054-8f3c-d20d9ca9ba23 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:02.678444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f790b8e3-7cdf-48c0-9a13-c227ce9cb2bd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:02.701591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd84c32-ff53-40f7-9280-f53fd8883697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:02.705510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd84c32-ff53-40f7-9280-f53fd8883697 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:02.705983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd84c32-ff53-40f7-9280-f53fd8883697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:02.707470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd84c32-ff53-40f7-9280-f53fd8883697 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:02.710051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd84c32-ff53-40f7-9280-f53fd8883697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:02.713781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd84c32-ff53-40f7-9280-f53fd8883697 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:02.906736 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3789/7474] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:44:02 2022] POST /identity/v3/projects => generated 369 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:02.908649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd84c32-ff53-40f7-9280-f53fd8883697 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:02.957008 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:02.959139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-12e3e84c-bff2-4054-8f3c-d20d9ca9ba23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d207885d56f470cabaa6a5810e3f0b6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:03.029590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-12e3e84c-bff2-4054-8f3c-d20d9ca9ba23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d207885d56f470cabaa6a5810e3f0b6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:03.030805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-12e3e84c-bff2-4054-8f3c-d20d9ca9ba23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d207885d56f470cabaa6a5810e3f0b6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:03.033222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-12e3e84c-bff2-4054-8f3c-d20d9ca9ba23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d207885d56f470cabaa6a5810e3f0b6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:03.070152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-12e3e84c-bff2-4054-8f3c-d20d9ca9ba23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d207885d56f470cabaa6a5810e3f0b6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:03.135704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd84c32-ff53-40f7-9280-f53fd8883697 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:03.164603 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3686/7475] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:44:02 2022] DELETE /identity/v3/users/1d207885d56f470cabaa6a5810e3f0b6 => generated 0 bytes in 824 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:44:03.168593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3e84c-bff2-4054-8f3c-d20d9ca9ba23 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:03.168593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-12e3e84c-bff2-4054-8f3c-d20d9ca9ba23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:03.174546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22de9ff-13d4-4bc5-a877-4a5849592c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:03.176911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22de9ff-13d4-4bc5-a877-4a5849592c69 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:03.179444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22de9ff-13d4-4bc5-a877-4a5849592c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:03.180486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22de9ff-13d4-4bc5-a877-4a5849592c69 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:03.182300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22de9ff-13d4-4bc5-a877-4a5849592c69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:03.186923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22de9ff-13d4-4bc5-a877-4a5849592c69 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:03.263142 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:03.341518 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3790/7476] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:44:02 2022] POST /identity/v3/users => generated 285 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:03.341518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22de9ff-13d4-4bc5-a877-4a5849592c69 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:03.344781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e22de9ff-13d4-4bc5-a877-4a5849592c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:03.374056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3e84c-bff2-4054-8f3c-d20d9ca9ba23 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:03.374834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22de9ff-13d4-4bc5-a877-4a5849592c69 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:03.385693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcb59a-75d1-443f-aea0-b7ac27744ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:03.385830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7947b99-f653-4980-8e87-58cfd8987581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:03.387622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcb59a-75d1-443f-aea0-b7ac27744ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:03.387898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcb59a-75d1-443f-aea0-b7ac27744ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:03.388179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcb59a-75d1-443f-aea0-b7ac27744ff7 admin admin] PATH_INFO: `/v3/users/de28f05cafd54c619315e5aed99d287b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:03.388740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7947b99-f653-4980-8e87-58cfd8987581 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:03.389036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7947b99-f653-4980-8e87-58cfd8987581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:03.389316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7947b99-f653-4980-8e87-58cfd8987581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:03.390065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7947b99-f653-4980-8e87-58cfd8987581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:03.393168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcb59a-75d1-443f-aea0-b7ac27744ff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de28f05cafd54c619315e5aed99d287b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:03.396256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcb59a-75d1-443f-aea0-b7ac27744ff7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:03.397344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7947b99-f653-4980-8e87-58cfd8987581 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:03.443313 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3791/7477] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:44:03.444344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7947b99-f653-4980-8e87-58cfd8987581 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:03.480614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7947b99-f653-4980-8e87-58cfd8987581 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:03.494376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068f87d-c0a8-4819-b1ec-c78f141b0776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:03.496712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068f87d-c0a8-4819-b1ec-c78f141b0776 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:03.498363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068f87d-c0a8-4819-b1ec-c78f141b0776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:03.506042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068f87d-c0a8-4819-b1ec-c78f141b0776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:03.506042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068f87d-c0a8-4819-b1ec-c78f141b0776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:03.506042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068f87d-c0a8-4819-b1ec-c78f141b0776 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:03.559076 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3792/7478] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:03 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:03.569763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068f87d-c0a8-4819-b1ec-c78f141b0776 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:03.606644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068f87d-c0a8-4819-b1ec-c78f141b0776 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:03.628745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61d724e-1991-4210-a7e3-c78b1f1edcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:03.629669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d724e-1991-4210-a7e3-c78b1f1edcff admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:03.629956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d724e-1991-4210-a7e3-c78b1f1edcff admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:03.635754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61d724e-1991-4210-a7e3-c78b1f1edcff admin admin] PATH_INFO: `/v3/projects/d2d263a3183142ad8e61aa65e8974c9d/users/5291036811124f94ab95e6a967593a87/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:03.673131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d724e-1991-4210-a7e3-c78b1f1edcff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d263a3183142ad8e61aa65e8974c9d, user_id=5291036811124f94ab95e6a967593a87, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:03.686530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61d724e-1991-4210-a7e3-c78b1f1edcff admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:03.707699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9bdcb59a-75d1-443f-aea0-b7ac27744ff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de28f05cafd54c619315e5aed99d287b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:03.777170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9bdcb59a-75d1-443f-aea0-b7ac27744ff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de28f05cafd54c619315e5aed99d287b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:03.782416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9bdcb59a-75d1-443f-aea0-b7ac27744ff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de28f05cafd54c619315e5aed99d287b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:03.790288 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3793/7479] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:44:03 2022] PUT /identity/v3/projects/d2d263a3183142ad8e61aa65e8974c9d/users/5291036811124f94ab95e6a967593a87/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:03.790801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9bdcb59a-75d1-443f-aea0-b7ac27744ff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de28f05cafd54c619315e5aed99d287b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:03.796273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586bbe7-e1b4-4c30-a27a-88300d07093f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:03.796589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586bbe7-e1b4-4c30-a27a-88300d07093f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:03.797077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e586bbe7-e1b4-4c30-a27a-88300d07093f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:03.801158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9bdcb59a-75d1-443f-aea0-b7ac27744ff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de28f05cafd54c619315e5aed99d287b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:03.890816 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3687/7480] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:44:03 2022] DELETE /identity/v3/users/de28f05cafd54c619315e5aed99d287b => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:03.892508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e586bbe7-e1b4-4c30-a27a-88300d07093f None None] MFA Rules not processed for user `5291036811124f94ab95e6a967593a87`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:03.894475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e586bbe7-e1b4-4c30-a27a-88300d07093f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:03.895964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27ddf3-f377-4959-a587-22dc986b7142 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:03.897188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27ddf3-f377-4959-a587-22dc986b7142 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:03.897520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a27ddf3-f377-4959-a587-22dc986b7142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:03.951826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8a27ddf3-f377-4959-a587-22dc986b7142 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:03.954056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8a27ddf3-f377-4959-a587-22dc986b7142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:04.151610 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3688/7481] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:44:04.152819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27ddf3-f377-4959-a587-22dc986b7142 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:04.154504 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3794/7482] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:04.155423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586bbe7-e1b4-4c30-a27a-88300d07093f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:04.168178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e586bbe7-e1b4-4c30-a27a-88300d07093f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:04.170975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8a27ddf3-f377-4959-a587-22dc986b7142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:04.215767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a27ddf3-f377-4959-a587-22dc986b7142 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:04.222213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e586bbe7-e1b4-4c30-a27a-88300d07093f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:04.225505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad88429-83bf-4f4f-88c1-0cdb1c1debc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:04.226438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad88429-83bf-4f4f-88c1-0cdb1c1debc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:04.226732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad88429-83bf-4f4f-88c1-0cdb1c1debc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:04.227016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad88429-83bf-4f4f-88c1-0cdb1c1debc6 admin admin] PATH_INFO: `/v3/projects/188e32a56f5b48c0b045449a353d7b1c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:04.232477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725b776-d426-4c46-b339-e2391b426833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:04.233220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725b776-d426-4c46-b339-e2391b426833 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:04.233517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725b776-d426-4c46-b339-e2391b426833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:04.233800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725b776-d426-4c46-b339-e2391b426833 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:04.234612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725b776-d426-4c46-b339-e2391b426833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:04.239558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad88429-83bf-4f4f-88c1-0cdb1c1debc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=188e32a56f5b48c0b045449a353d7b1c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:04.244551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad88429-83bf-4f4f-88c1-0cdb1c1debc6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:04.244670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725b776-d426-4c46-b339-e2391b426833 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:04.397264 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3795/7483] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:44:04 2022] POST /identity/v3/projects => generated 367 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:04.398337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725b776-d426-4c46-b339-e2391b426833 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:04.403430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2725b776-d426-4c46-b339-e2391b426833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:04.434464 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:04.473055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6ad88429-83bf-4f4f-88c1-0cdb1c1debc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188e32a56f5b48c0b045449a353d7b1c', 'request_id': 'req-6ad88429-83bf-4f4f-88c1-0cdb1c1debc6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:04.519352 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:04.561817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6ad88429-83bf-4f4f-88c1-0cdb1c1debc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188e32a56f5b48c0b045449a353d7b1c', 'request_id': 'req-6ad88429-83bf-4f4f-88c1-0cdb1c1debc6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:04.573219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6ad88429-83bf-4f4f-88c1-0cdb1c1debc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188e32a56f5b48c0b045449a353d7b1c', 'request_id': 'req-6ad88429-83bf-4f4f-88c1-0cdb1c1debc6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:04.603033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725b776-d426-4c46-b339-e2391b426833 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:04.609906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6ad88429-83bf-4f4f-88c1-0cdb1c1debc6 admin admin] The token cache is being invalidate because project 188e32a56f5b48c0b045449a353d7b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:44:04.613287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6ad88429-83bf-4f4f-88c1-0cdb1c1debc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:04.614637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6ad88429-83bf-4f4f-88c1-0cdb1c1debc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:04.623147 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3689/7484] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:44:04 2022] DELETE /identity/v3/projects/188e32a56f5b48c0b045449a353d7b1c => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:04.624071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad88429-83bf-4f4f-88c1-0cdb1c1debc6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:04.631212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6ad88429-83bf-4f4f-88c1-0cdb1c1debc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:04.739977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad88429-83bf-4f4f-88c1-0cdb1c1debc6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:04.745374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdae0fe-06ac-4bc7-8331-d93dfeebbb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:04.746079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdae0fe-06ac-4bc7-8331-d93dfeebbb84 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:04.746395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdae0fe-06ac-4bc7-8331-d93dfeebbb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:04.746679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdae0fe-06ac-4bc7-8331-d93dfeebbb84 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:04.747396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdae0fe-06ac-4bc7-8331-d93dfeebbb84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:04.750927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdae0fe-06ac-4bc7-8331-d93dfeebbb84 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:04.811838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcac6a4-2132-4817-9bf4-279030906708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:04.816775 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3690/7485] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:44:04 2022] POST /identity/v3/users => generated 284 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:04.819844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcac6a4-2132-4817-9bf4-279030906708 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:04.820853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdae0fe-06ac-4bc7-8331-d93dfeebbb84 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:04.821858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcac6a4-2132-4817-9bf4-279030906708 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:04.823173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcac6a4-2132-4817-9bf4-279030906708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:04.824940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bcdae0fe-06ac-4bc7-8331-d93dfeebbb84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:04.841504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6dcac6a4-2132-4817-9bf4-279030906708 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:04.900420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdae0fe-06ac-4bc7-8331-d93dfeebbb84 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:04.924364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcac6a4-2132-4817-9bf4-279030906708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:04.931226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcac6a4-2132-4817-9bf4-279030906708 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:04.946174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0334305-50d9-432d-b21b-fd00a8143445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:04.946174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0334305-50d9-432d-b21b-fd00a8143445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:04.946174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0334305-50d9-432d-b21b-fd00a8143445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:04.946174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0334305-50d9-432d-b21b-fd00a8143445 admin admin] PATH_INFO: `/v3/users/74703644d3d74af680dfc2f328ec251e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:04.953132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0334305-50d9-432d-b21b-fd00a8143445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74703644d3d74af680dfc2f328ec251e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:04.969342 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3796/7486] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:44:04.969342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcac6a4-2132-4817-9bf4-279030906708 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:04.975991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0334305-50d9-432d-b21b-fd00a8143445 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:05.009505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcac6a4-2132-4817-9bf4-279030906708 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:05.022837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45bcf3-ecd4-4c5a-b292-00bab434f206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:05.024761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45bcf3-ecd4-4c5a-b292-00bab434f206 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:05.025299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45bcf3-ecd4-4c5a-b292-00bab434f206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:05.025879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45bcf3-ecd4-4c5a-b292-00bab434f206 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:05.026902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45bcf3-ecd4-4c5a-b292-00bab434f206 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:05.028974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45bcf3-ecd4-4c5a-b292-00bab434f206 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:05.063562 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3797/7487] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:05.067304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45bcf3-ecd4-4c5a-b292-00bab434f206 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:05.095058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45bcf3-ecd4-4c5a-b292-00bab434f206 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:05.119159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901a021-3171-4062-92a5-1c504e340a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:05.119856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901a021-3171-4062-92a5-1c504e340a1c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:05.120151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901a021-3171-4062-92a5-1c504e340a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:05.120429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1901a021-3171-4062-92a5-1c504e340a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:05.128406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1901a021-3171-4062-92a5-1c504e340a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:05.130118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1901a021-3171-4062-92a5-1c504e340a1c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:05.174947 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3798/7488] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:05.181513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901a021-3171-4062-92a5-1c504e340a1c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:05.201624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1901a021-3171-4062-92a5-1c504e340a1c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:05.247721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301bc844-110a-4ef1-94ac-421538affcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:05.250978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bc844-110a-4ef1-94ac-421538affcc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:05.251968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bc844-110a-4ef1-94ac-421538affcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:05.253059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301bc844-110a-4ef1-94ac-421538affcc6 admin admin] PATH_INFO: `/v3/projects/95c8bb6eac104343aee7e2b7f2eb4ee6/users/751a1d28580649158a9631f42c6cf33d/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:05.270167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d0334305-50d9-432d-b21b-fd00a8143445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74703644d3d74af680dfc2f328ec251e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:05.281242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bc844-110a-4ef1-94ac-421538affcc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c8bb6eac104343aee7e2b7f2eb4ee6, user_id=751a1d28580649158a9631f42c6cf33d, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:05.286299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301bc844-110a-4ef1-94ac-421538affcc6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:05.312106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d0334305-50d9-432d-b21b-fd00a8143445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74703644d3d74af680dfc2f328ec251e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:05.316035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d0334305-50d9-432d-b21b-fd00a8143445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74703644d3d74af680dfc2f328ec251e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:05.318903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d0334305-50d9-432d-b21b-fd00a8143445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74703644d3d74af680dfc2f328ec251e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:05.341167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d0334305-50d9-432d-b21b-fd00a8143445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74703644d3d74af680dfc2f328ec251e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:05.461457 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3691/7489] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:44:04 2022] DELETE /identity/v3/users/74703644d3d74af680dfc2f328ec251e => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:05.462360 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3799/7490] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:44:05 2022] PUT /identity/v3/projects/95c8bb6eac104343aee7e2b7f2eb4ee6/users/751a1d28580649158a9631f42c6cf33d/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:05.462496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0334305-50d9-432d-b21b-fd00a8143445 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:05.463796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d0334305-50d9-432d-b21b-fd00a8143445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:05.578848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cebe7-c5d6-4dd4-8780-acbf8ca86f2a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:05.579057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cebe7-c5d6-4dd4-8780-acbf8ca86f2a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:05.579860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451cebe7-c5d6-4dd4-8780-acbf8ca86f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:05.613661 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=81,keystone:DELETE=14,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:05.656620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-451cebe7-c5d6-4dd4-8780-acbf8ca86f2a None None] MFA Rules not processed for user `751a1d28580649158a9631f42c6cf33d`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:05.663446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-451cebe7-c5d6-4dd4-8780-acbf8ca86f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:05.703647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0334305-50d9-432d-b21b-fd00a8143445 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:05.718001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cbdfa2-4f78-425f-892b-e509c37248cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:05.722298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbdfa2-4f78-425f-892b-e509c37248cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:05.722600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbdfa2-4f78-425f-892b-e509c37248cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:05.722881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cbdfa2-4f78-425f-892b-e509c37248cb admin admin] PATH_INFO: `/v3/users/8b0ae24648ff414994bc7de0fd58b830` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:05.725820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbdfa2-4f78-425f-892b-e509c37248cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b0ae24648ff414994bc7de0fd58b830)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:05.731921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cbdfa2-4f78-425f-892b-e509c37248cb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:05.822527 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3800/7491] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:44:05.834195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cebe7-c5d6-4dd4-8780-acbf8ca86f2a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:05.834195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-451cebe7-c5d6-4dd4-8780-acbf8ca86f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:05.915781 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:05.964469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-55cbdfa2-4f78-425f-892b-e509c37248cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b0ae24648ff414994bc7de0fd58b830'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:06.019928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-55cbdfa2-4f78-425f-892b-e509c37248cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b0ae24648ff414994bc7de0fd58b830'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:06.021855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-55cbdfa2-4f78-425f-892b-e509c37248cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b0ae24648ff414994bc7de0fd58b830'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:06.024709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-55cbdfa2-4f78-425f-892b-e509c37248cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b0ae24648ff414994bc7de0fd58b830'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:06.046404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451cebe7-c5d6-4dd4-8780-acbf8ca86f2a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:06.056450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-55cbdfa2-4f78-425f-892b-e509c37248cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b0ae24648ff414994bc7de0fd58b830'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:06.058491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae3761-39eb-4ecf-b818-4ede05462620 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:06.059476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae3761-39eb-4ecf-b818-4ede05462620 service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:06.059882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae3761-39eb-4ecf-b818-4ede05462620 service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:06.060429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ae3761-39eb-4ecf-b818-4ede05462620 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:06.068384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e2ae3761-39eb-4ecf-b818-4ede05462620 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:06.176731 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3692/7492] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:44:05 2022] DELETE /identity/v3/users/8b0ae24648ff414994bc7de0fd58b830 => generated 0 bytes in 715 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:06.183378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4f458-461d-4ee7-b4d1-986e291f51c1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:06.187306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4f458-461d-4ee7-b4d1-986e291f51c1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:06.189264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4f458-461d-4ee7-b4d1-986e291f51c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:06.236883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-98f4f458-461d-4ee7-b4d1-986e291f51c1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:06.247539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-98f4f458-461d-4ee7-b4d1-986e291f51c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:06.304121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae3761-39eb-4ecf-b818-4ede05462620 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:06.311517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ae3761-39eb-4ecf-b818-4ede05462620 service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:06.365526 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3801/7493] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:44:06.547791 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3693/7494] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:06.559143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae3761-39eb-4ecf-b818-4ede05462620 service glance] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:06.561045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e2ae3761-39eb-4ecf-b818-4ede05462620 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:06.657864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4f458-461d-4ee7-b4d1-986e291f51c1 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:06.657864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-98f4f458-461d-4ee7-b4d1-986e291f51c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:06.707622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4f458-461d-4ee7-b4d1-986e291f51c1 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:06.727915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d33abb4-c46f-41ec-a799-5da92db169e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:06.731847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33abb4-c46f-41ec-a799-5da92db169e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:06.732594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33abb4-c46f-41ec-a799-5da92db169e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:06.733865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d33abb4-c46f-41ec-a799-5da92db169e6 admin admin] PATH_INFO: `/v3/projects/42892b4d2fb2405aa983a1e25331c699` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:06.735561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33abb4-c46f-41ec-a799-5da92db169e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42892b4d2fb2405aa983a1e25331c699)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:06.741835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d33abb4-c46f-41ec-a799-5da92db169e6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:06.803666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ae3761-39eb-4ecf-b818-4ede05462620 service glance] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:06.908742 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:06.940479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6d33abb4-c46f-41ec-a799-5da92db169e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42892b4d2fb2405aa983a1e25331c699', 'request_id': 'req-6d33abb4-c46f-41ec-a799-5da92db169e6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:06.961280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead0855-f84d-457c-833a-5d98a4b3fb6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:06.962367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead0855-f84d-457c-833a-5d98a4b3fb6e service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:06.963199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead0855-f84d-457c-833a-5d98a4b3fb6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:06.963699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead0855-f84d-457c-833a-5d98a4b3fb6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:06.985193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead0855-f84d-457c-833a-5d98a4b3fb6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:06.988751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead0855-f84d-457c-833a-5d98a4b3fb6e service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:07.031192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6d33abb4-c46f-41ec-a799-5da92db169e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42892b4d2fb2405aa983a1e25331c699', 'request_id': 'req-6d33abb4-c46f-41ec-a799-5da92db169e6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:07.033139 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3802/7495] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:44:07.034971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead0855-f84d-457c-833a-5d98a4b3fb6e service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:07.040005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6d33abb4-c46f-41ec-a799-5da92db169e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42892b4d2fb2405aa983a1e25331c699', 'request_id': 'req-6d33abb4-c46f-41ec-a799-5da92db169e6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:07.042481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2ead0855-f84d-457c-833a-5d98a4b3fb6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:07.064791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6d33abb4-c46f-41ec-a799-5da92db169e6 admin admin] The token cache is being invalidate because project 42892b4d2fb2405aa983a1e25331c699 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:44:07.065396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6d33abb4-c46f-41ec-a799-5da92db169e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:07.069340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-6d33abb4-c46f-41ec-a799-5da92db169e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:07.075602 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3694/7496] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:44:06 2022] DELETE /identity/v3/projects/42892b4d2fb2405aa983a1e25331c699 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:44:07.081963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaac8f5-ad8f-49b0-8f76-1153de96d2b7 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:07.082735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaac8f5-ad8f-49b0-8f76-1153de96d2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:07.087593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaac8f5-ad8f-49b0-8f76-1153de96d2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:07.145979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-baaac8f5-ad8f-49b0-8f76-1153de96d2b7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:07.147243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-baaac8f5-ad8f-49b0-8f76-1153de96d2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:07.232334 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:07.371421 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3695/7497] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:07.373397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285531f5-67ef-492f-ba73-1b41658acb5a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:07.373828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285531f5-67ef-492f-ba73-1b41658acb5a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:07.374307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285531f5-67ef-492f-ba73-1b41658acb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:07.545030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead0855-f84d-457c-833a-5d98a4b3fb6e service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:07.545724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-285531f5-67ef-492f-ba73-1b41658acb5a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:07.545724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-285531f5-67ef-492f-ba73-1b41658acb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:07.545724 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3696/7498] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:07.551452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285531f5-67ef-492f-ba73-1b41658acb5a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:07.602294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285531f5-67ef-492f-ba73-1b41658acb5a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:07.624755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9fba5-c655-4900-bf7d-ee26dad11990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:07.625452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9fba5-c655-4900-bf7d-ee26dad11990 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:07.625739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9fba5-c655-4900-bf7d-ee26dad11990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:07.626022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9fba5-c655-4900-bf7d-ee26dad11990 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:07.629656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717b724-5a3c-4618-b783-079fc19c9eb3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:07.630369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717b724-5a3c-4618-b783-079fc19c9eb3 service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:07.630664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717b724-5a3c-4618-b783-079fc19c9eb3 service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:07.630807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9fba5-c655-4900-bf7d-ee26dad11990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:44:07.630924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4717b724-5a3c-4618-b783-079fc19c9eb3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:07.631138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9fba5-c655-4900-bf7d-ee26dad11990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:07.639635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4717b724-5a3c-4618-b783-079fc19c9eb3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:07.644197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9fba5-c655-4900-bf7d-ee26dad11990 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:07.674555 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3697/7499] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:44:07.677059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9fba5-c655-4900-bf7d-ee26dad11990 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:07.710061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9fba5-c655-4900-bf7d-ee26dad11990 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:07.725458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51963ae3-6f80-4e41-9652-baf954862d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:07.726959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51963ae3-6f80-4e41-9652-baf954862d17 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:07.728018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51963ae3-6f80-4e41-9652-baf954862d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:07.728463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51963ae3-6f80-4e41-9652-baf954862d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:07.730181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51963ae3-6f80-4e41-9652-baf954862d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:07.737777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51963ae3-6f80-4e41-9652-baf954862d17 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:07.832965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717b724-5a3c-4618-b783-079fc19c9eb3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:07.835144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4717b724-5a3c-4618-b783-079fc19c9eb3 service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:07.864869 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3803/7500] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 831 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:44:07.876616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717b724-5a3c-4618-b783-079fc19c9eb3 service glance] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:07.878714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4717b724-5a3c-4618-b783-079fc19c9eb3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:07.907408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4717b724-5a3c-4618-b783-079fc19c9eb3 service glance] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:07.921324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee392e7-f538-45e1-9192-4a20e7c857fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:07.921324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee392e7-f538-45e1-9192-4a20e7c857fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:07.921324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee392e7-f538-45e1-9192-4a20e7c857fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:07.921324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee392e7-f538-45e1-9192-4a20e7c857fb admin admin] PATH_INFO: `/v3/projects/49fffcdc5484482da1d3085fa74ecbca` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:07.922512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee392e7-f538-45e1-9192-4a20e7c857fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=49fffcdc5484482da1d3085fa74ecbca)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:07.924745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee392e7-f538-45e1-9192-4a20e7c857fb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:07.988974 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3698/7501] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:44:07 2022] POST /identity/v3/projects => generated 361 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:07.993505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51963ae3-6f80-4e41-9652-baf954862d17 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:08.118835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6ee392e7-f538-45e1-9192-4a20e7c857fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49fffcdc5484482da1d3085fa74ecbca', 'request_id': 'req-6ee392e7-f538-45e1-9192-4a20e7c857fb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:08.153583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6ee392e7-f538-45e1-9192-4a20e7c857fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49fffcdc5484482da1d3085fa74ecbca', 'request_id': 'req-6ee392e7-f538-45e1-9192-4a20e7c857fb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:08.187520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6ee392e7-f538-45e1-9192-4a20e7c857fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49fffcdc5484482da1d3085fa74ecbca', 'request_id': 'req-6ee392e7-f538-45e1-9192-4a20e7c857fb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:08.289078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6ee392e7-f538-45e1-9192-4a20e7c857fb admin admin] The token cache is being invalidate because project 49fffcdc5484482da1d3085fa74ecbca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:44:08.289078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6ee392e7-f538-45e1-9192-4a20e7c857fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:08.289078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6ee392e7-f538-45e1-9192-4a20e7c857fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:08.296385 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3804/7502] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:44:07 2022] DELETE /identity/v3/projects/49fffcdc5484482da1d3085fa74ecbca => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:08.300718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bc43b-4a3e-4ddb-b853-ee8c9f2f4dd5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:08.301002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bc43b-4a3e-4ddb-b853-ee8c9f2f4dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:08.301288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bc43b-4a3e-4ddb-b853-ee8c9f2f4dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:08.312708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51963ae3-6f80-4e41-9652-baf954862d17 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:08.384099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-630bc43b-4a3e-4ddb-b853-ee8c9f2f4dd5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:08.385954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-630bc43b-4a3e-4ddb-b853-ee8c9f2f4dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:08.442327 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:08.450302 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:08.519713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b2b7b-7ced-4364-bcd4-5294f918ca61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:08.520739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b2b7b-7ced-4364-bcd4-5294f918ca61 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:08.522585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b2b7b-7ced-4364-bcd4-5294f918ca61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:08.523555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4b2b7b-7ced-4364-bcd4-5294f918ca61 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:08.526674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b2b7b-7ced-4364-bcd4-5294f918ca61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:08.531106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4b2b7b-7ced-4364-bcd4-5294f918ca61 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:08.602636 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3805/7503] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:08.612212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe360c-e102-450b-b34f-7dadb0ac3535 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:08.612511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe360c-e102-450b-b34f-7dadb0ac3535 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:08.612879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe360c-e102-450b-b34f-7dadb0ac3535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:08.655313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-39fe360c-e102-450b-b34f-7dadb0ac3535 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:08.656664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-39fe360c-e102-450b-b34f-7dadb0ac3535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:08.683735 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3806/7504] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:44:08.684952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe360c-e102-450b-b34f-7dadb0ac3535 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:08.700031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe360c-e102-450b-b34f-7dadb0ac3535 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:08.711301 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3699/7505] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:44:07 2022] POST /identity/v3/users => generated 281 bytes in 716 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:08.713142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b2b7b-7ced-4364-bcd4-5294f918ca61 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:08.725624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c182ad-73c8-4cdf-a4ca-3b09db414985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:08.728361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c182ad-73c8-4cdf-a4ca-3b09db414985 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:08.728361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c182ad-73c8-4cdf-a4ca-3b09db414985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:08.728361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c182ad-73c8-4cdf-a4ca-3b09db414985 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:08.728361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c182ad-73c8-4cdf-a4ca-3b09db414985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:44:08.728361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c182ad-73c8-4cdf-a4ca-3b09db414985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:08.729978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c182ad-73c8-4cdf-a4ca-3b09db414985 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:08.736920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1b4b2b7b-7ced-4364-bcd4-5294f918ca61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:08.774597 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3807/7506] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:44:08.775657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c182ad-73c8-4cdf-a4ca-3b09db414985 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:08.789322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d8c182ad-73c8-4cdf-a4ca-3b09db414985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:08.803377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4b2b7b-7ced-4364-bcd4-5294f918ca61 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:08.827575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c182ad-73c8-4cdf-a4ca-3b09db414985 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:08.829063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c346ed-bf7d-4eae-a888-3355117974b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:08.835136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c346ed-bf7d-4eae-a888-3355117974b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:08.837215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c346ed-bf7d-4eae-a888-3355117974b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:08.837521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c346ed-bf7d-4eae-a888-3355117974b6 admin admin] PATH_INFO: `/v3/projects/89f067ab0960448b87d63427c9eb951e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:08.839112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c346ed-bf7d-4eae-a888-3355117974b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89f067ab0960448b87d63427c9eb951e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:08.840659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabbec0-9b9e-49e8-8617-dfd0513874d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:08.841543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabbec0-9b9e-49e8-8617-dfd0513874d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:08.841997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabbec0-9b9e-49e8-8617-dfd0513874d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:08.842470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabbec0-9b9e-49e8-8617-dfd0513874d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:08.843394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eabbec0-9b9e-49e8-8617-dfd0513874d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:08.850369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c346ed-bf7d-4eae-a888-3355117974b6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:08.858143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eabbec0-9b9e-49e8-8617-dfd0513874d9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:08.917507 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3808/7507] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:08.917507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabbec0-9b9e-49e8-8617-dfd0513874d9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:08.957562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabbec0-9b9e-49e8-8617-dfd0513874d9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:08.974614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e879d-aab3-4b8d-8ed2-6f31abb915ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:08.975601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e879d-aab3-4b8d-8ed2-6f31abb915ed admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:08.975601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e879d-aab3-4b8d-8ed2-6f31abb915ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:08.975851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e879d-aab3-4b8d-8ed2-6f31abb915ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:08.976744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e879d-aab3-4b8d-8ed2-6f31abb915ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:08.978876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e879d-aab3-4b8d-8ed2-6f31abb915ed admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:09.033936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c8c346ed-bf7d-4eae-a888-3355117974b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89f067ab0960448b87d63427c9eb951e', 'request_id': 'req-c8c346ed-bf7d-4eae-a888-3355117974b6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:09.116764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c8c346ed-bf7d-4eae-a888-3355117974b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89f067ab0960448b87d63427c9eb951e', 'request_id': 'req-c8c346ed-bf7d-4eae-a888-3355117974b6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:09.129606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c8c346ed-bf7d-4eae-a888-3355117974b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89f067ab0960448b87d63427c9eb951e', 'request_id': 'req-c8c346ed-bf7d-4eae-a888-3355117974b6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:09.130263 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3809/7508] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:44:08 2022] POST /identity/v3/projects => generated 357 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:09.131331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e879d-aab3-4b8d-8ed2-6f31abb915ed admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:09.214626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c8c346ed-bf7d-4eae-a888-3355117974b6 admin admin] The token cache is being invalidate because project 89f067ab0960448b87d63427c9eb951e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:44:09.217612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c8c346ed-bf7d-4eae-a888-3355117974b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:09.219243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c8c346ed-bf7d-4eae-a888-3355117974b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:09.226042 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3700/7509] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:44:08 2022] DELETE /identity/v3/projects/89f067ab0960448b87d63427c9eb951e => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:09.228300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c346ed-bf7d-4eae-a888-3355117974b6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:09.236633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c8c346ed-bf7d-4eae-a888-3355117974b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:09.285007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e879d-aab3-4b8d-8ed2-6f31abb915ed admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:09.303207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57337a-be44-4a46-bd94-8a2e72b2b435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:09.303900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57337a-be44-4a46-bd94-8a2e72b2b435 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:09.304193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57337a-be44-4a46-bd94-8a2e72b2b435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:09.304478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57337a-be44-4a46-bd94-8a2e72b2b435 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:09.305316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57337a-be44-4a46-bd94-8a2e72b2b435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:09.307720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da57337a-be44-4a46-bd94-8a2e72b2b435 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:09.347703 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3810/7510] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:09.348695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57337a-be44-4a46-bd94-8a2e72b2b435 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:09.355008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-da57337a-be44-4a46-bd94-8a2e72b2b435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:09.403459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da57337a-be44-4a46-bd94-8a2e72b2b435 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:09.422122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fc53c5-7dd2-4d2d-8b6a-8d5260051db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:09.423795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc53c5-7dd2-4d2d-8b6a-8d5260051db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:09.424570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc53c5-7dd2-4d2d-8b6a-8d5260051db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:09.424570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fc53c5-7dd2-4d2d-8b6a-8d5260051db9 admin admin] PATH_INFO: `/v3/users/fa6267c8ddd945bd88928dc250283001` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:09.431010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc53c5-7dd2-4d2d-8b6a-8d5260051db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6267c8ddd945bd88928dc250283001)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:09.433002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fc53c5-7dd2-4d2d-8b6a-8d5260051db9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:09.440762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c346ed-bf7d-4eae-a888-3355117974b6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:09.456064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7047fa0-f4f0-4a77-b7a3-6d2916f48aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:09.457447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7047fa0-f4f0-4a77-b7a3-6d2916f48aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:09.458603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7047fa0-f4f0-4a77-b7a3-6d2916f48aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:09.464924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7047fa0-f4f0-4a77-b7a3-6d2916f48aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:09.464924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7047fa0-f4f0-4a77-b7a3-6d2916f48aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:09.464924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7047fa0-f4f0-4a77-b7a3-6d2916f48aa2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:09.558075 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3701/7511] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:44:09 2022] POST /identity/v3/users => generated 279 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:09.560982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7047fa0-f4f0-4a77-b7a3-6d2916f48aa2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:09.564593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e7047fa0-f4f0-4a77-b7a3-6d2916f48aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:09.595343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7047fa0-f4f0-4a77-b7a3-6d2916f48aa2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:09.622087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cbfc3-fa81-4656-81ca-7a14085c1fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:09.623723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cbfc3-fa81-4656-81ca-7a14085c1fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:09.624543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cbfc3-fa81-4656-81ca-7a14085c1fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:09.625833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602cbfc3-fa81-4656-81ca-7a14085c1fa3 admin admin] PATH_INFO: `/v3/projects/8a74da77e6bc4bea88654c215f268d6b/users/e787ba47f6084b9f9775ea5fdadcb855/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:09.695888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e0fc53c5-7dd2-4d2d-8b6a-8d5260051db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6267c8ddd945bd88928dc250283001'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:09.705883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cbfc3-fa81-4656-81ca-7a14085c1fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a74da77e6bc4bea88654c215f268d6b, user_id=e787ba47f6084b9f9775ea5fdadcb855, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:09.710573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602cbfc3-fa81-4656-81ca-7a14085c1fa3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:09.729893 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:09.735160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e0fc53c5-7dd2-4d2d-8b6a-8d5260051db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6267c8ddd945bd88928dc250283001'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:09.753714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e0fc53c5-7dd2-4d2d-8b6a-8d5260051db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6267c8ddd945bd88928dc250283001'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:09.754779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e0fc53c5-7dd2-4d2d-8b6a-8d5260051db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6267c8ddd945bd88928dc250283001'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:09.788552 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3702/7512] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:44:09 2022] PUT /identity/v3/projects/8a74da77e6bc4bea88654c215f268d6b/users/e787ba47f6084b9f9775ea5fdadcb855/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:09.790229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cbfc3-fa81-4656-81ca-7a14085c1fa3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:09.843828 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=85,keystone:INSERT=8,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:09.852862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e0fc53c5-7dd2-4d2d-8b6a-8d5260051db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6267c8ddd945bd88928dc250283001'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:09.869024 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3811/7513] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:44:09 2022] DELETE /identity/v3/users/fa6267c8ddd945bd88928dc250283001 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:09.873946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edc937-2388-4e2f-a763-82637c15fc23 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:09.873946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edc937-2388-4e2f-a763-82637c15fc23 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:09.873946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1edc937-2388-4e2f-a763-82637c15fc23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:09.964067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e1edc937-2388-4e2f-a763-82637c15fc23 None None] MFA Rules not processed for user `e787ba47f6084b9f9775ea5fdadcb855`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:09.969532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e1edc937-2388-4e2f-a763-82637c15fc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:09.981218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602cbfc3-fa81-4656-81ca-7a14085c1fa3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:10.108329 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3812/7514] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:10.115012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edc937-2388-4e2f-a763-82637c15fc23 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:10.118912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e1edc937-2388-4e2f-a763-82637c15fc23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:10.139206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5414c-9d59-405e-a153-5b9ebdafa2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:10.145007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5414c-9d59-405e-a153-5b9ebdafa2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:10.145007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5414c-9d59-405e-a153-5b9ebdafa2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:10.145007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5414c-9d59-405e-a153-5b9ebdafa2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:10.145007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5414c-9d59-405e-a153-5b9ebdafa2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:10.145007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5414c-9d59-405e-a153-5b9ebdafa2c2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:10.191945 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3703/7515] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:10.194842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5414c-9d59-405e-a153-5b9ebdafa2c2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:10.204933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0dd5414c-9d59-405e-a153-5b9ebdafa2c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:10.250862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5414c-9d59-405e-a153-5b9ebdafa2c2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:10.271612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75682fa4-76ee-4ba0-b7de-1210c5ec6268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:10.272662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75682fa4-76ee-4ba0-b7de-1210c5ec6268 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:10.273054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75682fa4-76ee-4ba0-b7de-1210c5ec6268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:10.273806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75682fa4-76ee-4ba0-b7de-1210c5ec6268 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:10.275590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75682fa4-76ee-4ba0-b7de-1210c5ec6268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:10.308881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75682fa4-76ee-4ba0-b7de-1210c5ec6268 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:10.315642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1edc937-2388-4e2f-a763-82637c15fc23 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:10.330614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafb750-be88-4b0a-a448-9b531a9b16d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:10.333686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafb750-be88-4b0a-a448-9b531a9b16d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:10.333686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafb750-be88-4b0a-a448-9b531a9b16d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:10.333686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafb750-be88-4b0a-a448-9b531a9b16d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:10.336941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bafb750-be88-4b0a-a448-9b531a9b16d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:10.348497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bafb750-be88-4b0a-a448-9b531a9b16d9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:10.348708 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3704/7516] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:10.351118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75682fa4-76ee-4ba0-b7de-1210c5ec6268 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:10.402830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75682fa4-76ee-4ba0-b7de-1210c5ec6268 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:10.411644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d0239-cec7-4810-bb5f-f2b537be56c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:10.412858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d0239-cec7-4810-bb5f-f2b537be56c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:10.413157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d0239-cec7-4810-bb5f-f2b537be56c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:10.413452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d0239-cec7-4810-bb5f-f2b537be56c1 admin admin] PATH_INFO: `/v3/projects/d9ecbd061e9f471892310ea3eb9b1c02/users/104970c47a6046a3ad62d885c207918e/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:10.451286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d0239-cec7-4810-bb5f-f2b537be56c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ecbd061e9f471892310ea3eb9b1c02, user_id=104970c47a6046a3ad62d885c207918e, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:10.456846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d0239-cec7-4810-bb5f-f2b537be56c1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:10.565364 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3813/7517] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:44:10 2022] POST /identity/v3/projects => generated 363 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:10.576655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafb750-be88-4b0a-a448-9b531a9b16d9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:10.654323 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3705/7518] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:44:10 2022] PUT /identity/v3/projects/d9ecbd061e9f471892310ea3eb9b1c02/users/104970c47a6046a3ad62d885c207918e/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:10.663854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb54eb7-c674-403a-aefc-96b68c55718a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:10.664148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb54eb7-c674-403a-aefc-96b68c55718a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:10.665182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb54eb7-c674-403a-aefc-96b68c55718a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:10.757425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-adb54eb7-c674-403a-aefc-96b68c55718a None None] MFA Rules not processed for user `104970c47a6046a3ad62d885c207918e`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:10.758907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-adb54eb7-c674-403a-aefc-96b68c55718a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:10.812561 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:10.859755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafb750-be88-4b0a-a448-9b531a9b16d9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:10.868037 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3706/7519] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:10 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:44:10.951926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb54eb7-c674-403a-aefc-96b68c55718a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:10.963180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-adb54eb7-c674-403a-aefc-96b68c55718a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:10.995431 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:11.047285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ea27b-4602-4b7e-ab82-29fa0fc7fb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:11.050514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ea27b-4602-4b7e-ab82-29fa0fc7fb58 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:11.052315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ea27b-4602-4b7e-ab82-29fa0fc7fb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:11.055840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ea27b-4602-4b7e-ab82-29fa0fc7fb58 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:11.057946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ea27b-4602-4b7e-ab82-29fa0fc7fb58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:11.067833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047ea27b-4602-4b7e-ab82-29fa0fc7fb58 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:11.114620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb54eb7-c674-403a-aefc-96b68c55718a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:11.124301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c90634-5068-4c73-acbc-5b39da01f787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:11.125242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c90634-5068-4c73-acbc-5b39da01f787 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:11.125717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c90634-5068-4c73-acbc-5b39da01f787 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:11.126920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c90634-5068-4c73-acbc-5b39da01f787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:11.151808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c90634-5068-4c73-acbc-5b39da01f787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:11.160854 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3814/7520] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:44:10 2022] POST /identity/v3/users => generated 288 bytes in 587 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:11.160854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ea27b-4602-4b7e-ab82-29fa0fc7fb58 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:11.161077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c90634-5068-4c73-acbc-5b39da01f787 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:11.161186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-047ea27b-4602-4b7e-ab82-29fa0fc7fb58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:11.180586 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3707/7521] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:10 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:44:11.182886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c90634-5068-4c73-acbc-5b39da01f787 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:11.201572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ea27b-4602-4b7e-ab82-29fa0fc7fb58 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:11.214913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c90634-5068-4c73-acbc-5b39da01f787 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:11.232952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd28f7-9304-47a4-a4b8-b705a5583336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:11.236955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd28f7-9304-47a4-a4b8-b705a5583336 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:11.236955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd28f7-9304-47a4-a4b8-b705a5583336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:11.236955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dd28f7-9304-47a4-a4b8-b705a5583336 admin admin] PATH_INFO: `/v3/projects/17491a0e97614237bc6395cb9dcc14fa` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:11.237294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd28f7-9304-47a4-a4b8-b705a5583336 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17491a0e97614237bc6395cb9dcc14fa)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:11.239111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dd28f7-9304-47a4-a4b8-b705a5583336 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:11.242216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9732224-a844-43f0-99fa-9268c4273775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:11.246084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9732224-a844-43f0-99fa-9268c4273775 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:11.248534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9732224-a844-43f0-99fa-9268c4273775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:11.250540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9732224-a844-43f0-99fa-9268c4273775 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:11.253709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9732224-a844-43f0-99fa-9268c4273775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:11.268421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9732224-a844-43f0-99fa-9268c4273775 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:11.310550 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3708/7522] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:11.318650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9732224-a844-43f0-99fa-9268c4273775 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:11.357395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9732224-a844-43f0-99fa-9268c4273775 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:11.377300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14b9f4-cf70-4710-a746-b0b68647bafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:11.377300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14b9f4-cf70-4710-a746-b0b68647bafc admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:11.377300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14b9f4-cf70-4710-a746-b0b68647bafc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:11.377300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14b9f4-cf70-4710-a746-b0b68647bafc admin admin] PATH_INFO: `/v3/projects/9c8ae6bc577449de987f8da524037723/users/de3f284209364ae8ad2a2f0104d14946/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:11.399293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14b9f4-cf70-4710-a746-b0b68647bafc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c8ae6bc577449de987f8da524037723, user_id=de3f284209364ae8ad2a2f0104d14946, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:11.404011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14b9f4-cf70-4710-a746-b0b68647bafc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:11.451111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-73dd28f7-9304-47a4-a4b8-b705a5583336 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17491a0e97614237bc6395cb9dcc14fa', 'request_id': 'req-73dd28f7-9304-47a4-a4b8-b705a5583336'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:11.460251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-73dd28f7-9304-47a4-a4b8-b705a5583336 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17491a0e97614237bc6395cb9dcc14fa', 'request_id': 'req-73dd28f7-9304-47a4-a4b8-b705a5583336'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:11.468590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-73dd28f7-9304-47a4-a4b8-b705a5583336 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17491a0e97614237bc6395cb9dcc14fa', 'request_id': 'req-73dd28f7-9304-47a4-a4b8-b705a5583336'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:11.520505 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3709/7523] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:44:11 2022] PUT /identity/v3/projects/9c8ae6bc577449de987f8da524037723/users/de3f284209364ae8ad2a2f0104d14946/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:11.525445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14b9f4-cf70-4710-a746-b0b68647bafc admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:11.559095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-73dd28f7-9304-47a4-a4b8-b705a5583336 admin admin] The token cache is being invalidate because project 17491a0e97614237bc6395cb9dcc14fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:44:11.559416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-73dd28f7-9304-47a4-a4b8-b705a5583336 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:11.561165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-73dd28f7-9304-47a4-a4b8-b705a5583336 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:11.563436 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3815/7524] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:44:11 2022] DELETE /identity/v3/projects/17491a0e97614237bc6395cb9dcc14fa => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:11.567657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd28f7-9304-47a4-a4b8-b705a5583336 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:11.576337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-73dd28f7-9304-47a4-a4b8-b705a5583336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:11.708858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dd28f7-9304-47a4-a4b8-b705a5583336 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:11.726242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4e04e-81af-4299-b72d-20477caadc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:11.727163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4e04e-81af-4299-b72d-20477caadc4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:11.727508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4e04e-81af-4299-b72d-20477caadc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:11.727807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4e04e-81af-4299-b72d-20477caadc4d admin admin] PATH_INFO: `/v3/users/92c1b7aa934a4df2be67991fba0ab3e2` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:11.729761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4e04e-81af-4299-b72d-20477caadc4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=92c1b7aa934a4df2be67991fba0ab3e2)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:11.736114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4e04e-81af-4299-b72d-20477caadc4d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:11.754076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14b9f4-cf70-4710-a746-b0b68647bafc admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:11.758040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40f73c-a978-4fa1-8db3-3e16d3eb781e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:11.758960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40f73c-a978-4fa1-8db3-3e16d3eb781e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:11.759630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40f73c-a978-4fa1-8db3-3e16d3eb781e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:11.760270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40f73c-a978-4fa1-8db3-3e16d3eb781e admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:11.761155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40f73c-a978-4fa1-8db3-3e16d3eb781e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:11.763171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40f73c-a978-4fa1-8db3-3e16d3eb781e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:11.768571 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:11.788521 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3710/7525] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:11.792589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40f73c-a978-4fa1-8db3-3e16d3eb781e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:11.797036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2a40f73c-a978-4fa1-8db3-3e16d3eb781e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:11.813044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40f73c-a978-4fa1-8db3-3e16d3eb781e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:11.826052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeb7cb5-2219-40ca-8b65-0b3d705a2655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:11.827663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb7cb5-2219-40ca-8b65-0b3d705a2655 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:11.828186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb7cb5-2219-40ca-8b65-0b3d705a2655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:11.828707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeb7cb5-2219-40ca-8b65-0b3d705a2655 admin admin] PATH_INFO: `/v3/projects/9c8ae6bc577449de987f8da524037723/users/de3f284209364ae8ad2a2f0104d14946/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:11.831417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb7cb5-2219-40ca-8b65-0b3d705a2655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c8ae6bc577449de987f8da524037723, user_id=de3f284209364ae8ad2a2f0104d14946, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:11.835079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeb7cb5-2219-40ca-8b65-0b3d705a2655 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:11.847688 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3711/7526] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:44:11 2022] PUT /identity/v3/projects/9c8ae6bc577449de987f8da524037723/users/de3f284209364ae8ad2a2f0104d14946/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:44:11.861506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705a26e-539f-439f-ae8a-29273c11cad2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:11.862314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705a26e-539f-439f-ae8a-29273c11cad2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:11.862911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705a26e-539f-439f-ae8a-29273c11cad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:11.911759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9705a26e-539f-439f-ae8a-29273c11cad2 None None] MFA Rules not processed for user `de3f284209364ae8ad2a2f0104d14946`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:11.913467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9705a26e-539f-439f-ae8a-29273c11cad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:12.004206 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:12.045259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-56e4e04e-81af-4299-b72d-20477caadc4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92c1b7aa934a4df2be67991fba0ab3e2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:12.076364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-56e4e04e-81af-4299-b72d-20477caadc4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92c1b7aa934a4df2be67991fba0ab3e2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:12.086701 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3712/7527] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:11 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:12.107601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-56e4e04e-81af-4299-b72d-20477caadc4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92c1b7aa934a4df2be67991fba0ab3e2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:12.108510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705a26e-539f-439f-ae8a-29273c11cad2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:12.111408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-56e4e04e-81af-4299-b72d-20477caadc4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92c1b7aa934a4df2be67991fba0ab3e2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:12.111949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9705a26e-539f-439f-ae8a-29273c11cad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:12.240265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-56e4e04e-81af-4299-b72d-20477caadc4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92c1b7aa934a4df2be67991fba0ab3e2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:12.256055 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3816/7528] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:44:11 2022] DELETE /identity/v3/users/92c1b7aa934a4df2be67991fba0ab3e2 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:12.337974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705a26e-539f-439f-ae8a-29273c11cad2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:12.575886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1349c1-1ad1-4f91-b162-b427330d4d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:12.586718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1349c1-1ad1-4f91-b162-b427330d4d16 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:12.591025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1349c1-1ad1-4f91-b162-b427330d4d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:12.591683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1349c1-1ad1-4f91-b162-b427330d4d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:12.610339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bb1349c1-1ad1-4f91-b162-b427330d4d16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:12.743225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4e04e-81af-4299-b72d-20477caadc4d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:12.755896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-56e4e04e-81af-4299-b72d-20477caadc4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:12.829699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1349c1-1ad1-4f91-b162-b427330d4d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:12.832620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1349c1-1ad1-4f91-b162-b427330d4d16 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:12.852695 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3713/7529] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:12 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 745 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:44:12.891183 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4e04e-81af-4299-b72d-20477caadc4d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:12.897239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237aadb-ea81-4505-8e24-970dd0864c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:12.898180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237aadb-ea81-4505-8e24-970dd0864c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:12.898466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237aadb-ea81-4505-8e24-970dd0864c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:12.899241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237aadb-ea81-4505-8e24-970dd0864c52 admin admin] PATH_INFO: `/v3/users/5291036811124f94ab95e6a967593a87` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:12.900034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237aadb-ea81-4505-8e24-970dd0864c52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5291036811124f94ab95e6a967593a87)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:12.902124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237aadb-ea81-4505-8e24-970dd0864c52 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:13.187892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e237aadb-ea81-4505-8e24-970dd0864c52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5291036811124f94ab95e6a967593a87'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:13.222759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e237aadb-ea81-4505-8e24-970dd0864c52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5291036811124f94ab95e6a967593a87'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:13.237944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e237aadb-ea81-4505-8e24-970dd0864c52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5291036811124f94ab95e6a967593a87'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:13.240055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e237aadb-ea81-4505-8e24-970dd0864c52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5291036811124f94ab95e6a967593a87'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:13.323157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e237aadb-ea81-4505-8e24-970dd0864c52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5291036811124f94ab95e6a967593a87'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:13.339467 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3817/7530] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:44:12 2022] DELETE /identity/v3/users/5291036811124f94ab95e6a967593a87 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:13.344055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79512b-6793-4f69-85ad-7626977014b0 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:13.347127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79512b-6793-4f69-85ad-7626977014b0 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:13.347768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79512b-6793-4f69-85ad-7626977014b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:13.427480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6f79512b-6793-4f69-85ad-7626977014b0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:13.431538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6f79512b-6793-4f69-85ad-7626977014b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:13.626140 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:13.666492 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3714/7531] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:44:13.677606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237aadb-ea81-4505-8e24-970dd0864c52 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:13.679338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e237aadb-ea81-4505-8e24-970dd0864c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:13.714831 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:13.952169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237aadb-ea81-4505-8e24-970dd0864c52 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:13.994493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0353a6-bebb-44dc-8da6-2db988de55da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:14.000635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0353a6-bebb-44dc-8da6-2db988de55da service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:14.003583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0353a6-bebb-44dc-8da6-2db988de55da service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:14.010620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0353a6-bebb-44dc-8da6-2db988de55da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:14.070827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0353a6-bebb-44dc-8da6-2db988de55da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:14.092036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0353a6-bebb-44dc-8da6-2db988de55da service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:14.134841 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3818/7532] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:44:14.225951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79512b-6793-4f69-85ad-7626977014b0 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:14.228141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6f79512b-6793-4f69-85ad-7626977014b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:14.294117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79512b-6793-4f69-85ad-7626977014b0 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:14.320092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a29aec-4c84-428a-bae6-bb9918ac287b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:14.321980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a29aec-4c84-428a-bae6-bb9918ac287b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:14.322979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a29aec-4c84-428a-bae6-bb9918ac287b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:14.323292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a29aec-4c84-428a-bae6-bb9918ac287b admin admin] PATH_INFO: `/v3/projects/6c39bb0e5b8740e4a0e011c12eaccf6e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:14.328138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a29aec-4c84-428a-bae6-bb9918ac287b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c39bb0e5b8740e4a0e011c12eaccf6e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:14.333541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a29aec-4c84-428a-bae6-bb9918ac287b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:14.566019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-56a29aec-4c84-428a-bae6-bb9918ac287b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c39bb0e5b8740e4a0e011c12eaccf6e', 'request_id': 'req-56a29aec-4c84-428a-bae6-bb9918ac287b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:14.659990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-56a29aec-4c84-428a-bae6-bb9918ac287b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c39bb0e5b8740e4a0e011c12eaccf6e', 'request_id': 'req-56a29aec-4c84-428a-bae6-bb9918ac287b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:14.671953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-56a29aec-4c84-428a-bae6-bb9918ac287b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c39bb0e5b8740e4a0e011c12eaccf6e', 'request_id': 'req-56a29aec-4c84-428a-bae6-bb9918ac287b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:14.711431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-56a29aec-4c84-428a-bae6-bb9918ac287b admin admin] The token cache is being invalidate because project 6c39bb0e5b8740e4a0e011c12eaccf6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:44:14.711662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-56a29aec-4c84-428a-bae6-bb9918ac287b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:14.713434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-56a29aec-4c84-428a-bae6-bb9918ac287b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:14.726022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73896145-4f3a-4f72-88c3-e970e5386091 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:14.726561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73896145-4f3a-4f72-88c3-e970e5386091 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:14.726665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73896145-4f3a-4f72-88c3-e970e5386091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:14.733755 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3715/7533] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:44:14 2022] DELETE /identity/v3/projects/6c39bb0e5b8740e4a0e011c12eaccf6e => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:14.762626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-73896145-4f3a-4f72-88c3-e970e5386091 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:14.764058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-73896145-4f3a-4f72-88c3-e970e5386091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:14.928264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439f98e-23fc-428f-b74b-22a75c5c7932 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:14.928491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439f98e-23fc-428f-b74b-22a75c5c7932 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:14.928781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439f98e-23fc-428f-b74b-22a75c5c7932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:14.929191 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3819/7534] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:14.972718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d439f98e-23fc-428f-b74b-22a75c5c7932 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:14.973795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d439f98e-23fc-428f-b74b-22a75c5c7932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:14.997205 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3716/7535] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:15.000509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73896145-4f3a-4f72-88c3-e970e5386091 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:15.031865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73896145-4f3a-4f72-88c3-e970e5386091 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:15.051215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0a349-693e-4df9-ac65-1f14a0659fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:15.056180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0a349-693e-4df9-ac65-1f14a0659fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:15.056695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0a349-693e-4df9-ac65-1f14a0659fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:15.057644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0a349-693e-4df9-ac65-1f14a0659fc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:15.059578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0a349-693e-4df9-ac65-1f14a0659fc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:44:15.065625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0a349-693e-4df9-ac65-1f14a0659fc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:15.069979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0a349-693e-4df9-ac65-1f14a0659fc1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:15.138866 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3820/7536] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:44:15.139429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439f98e-23fc-428f-b74b-22a75c5c7932 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:15.177975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439f98e-23fc-428f-b74b-22a75c5c7932 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:15.236700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8261749-24e6-4b14-93da-d1a7f5528b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:15.236700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8261749-24e6-4b14-93da-d1a7f5528b5b admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:15.236700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8261749-24e6-4b14-93da-d1a7f5528b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:15.236700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8261749-24e6-4b14-93da-d1a7f5528b5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:15.237799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8261749-24e6-4b14-93da-d1a7f5528b5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:15.237799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8261749-24e6-4b14-93da-d1a7f5528b5b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:15.364331 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3717/7537] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:44:15 2022] POST /identity/v3/projects => generated 373 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:44:15.368663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0a349-693e-4df9-ac65-1f14a0659fc1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:15.385708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0a349-693e-4df9-ac65-1f14a0659fc1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:15.584247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660642a-4e5a-49e2-9672-7c0b4e5f9978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:15.585280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660642a-4e5a-49e2-9672-7c0b4e5f9978 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:15.586049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660642a-4e5a-49e2-9672-7c0b4e5f9978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:15.586590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660642a-4e5a-49e2-9672-7c0b4e5f9978 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:15.589083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660642a-4e5a-49e2-9672-7c0b4e5f9978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:15.595964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660642a-4e5a-49e2-9672-7c0b4e5f9978 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:15.700708 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3821/7538] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:44:15 2022] POST /identity/v3/users => generated 287 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:15.705570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8261749-24e6-4b14-93da-d1a7f5528b5b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:15.721881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8261749-24e6-4b14-93da-d1a7f5528b5b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:15.734978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3752b29-ed69-4314-ada0-c90ea084a466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:15.736478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3752b29-ed69-4314-ada0-c90ea084a466 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:15.736834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3752b29-ed69-4314-ada0-c90ea084a466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:15.737672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3752b29-ed69-4314-ada0-c90ea084a466 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:15.740684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3752b29-ed69-4314-ada0-c90ea084a466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:15.742705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3752b29-ed69-4314-ada0-c90ea084a466 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:15.775717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660642a-4e5a-49e2-9672-7c0b4e5f9978 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:15.787167 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3718/7539] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:15.796681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660642a-4e5a-49e2-9672-7c0b4e5f9978 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:15.816612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5826817-fc56-4d9c-bee2-746ac374f2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:15.817317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5826817-fc56-4d9c-bee2-746ac374f2eb admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:15.817607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5826817-fc56-4d9c-bee2-746ac374f2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:15.817889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5826817-fc56-4d9c-bee2-746ac374f2eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:15.826533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5826817-fc56-4d9c-bee2-746ac374f2eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:15.834723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5826817-fc56-4d9c-bee2-746ac374f2eb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:15.851624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3752b29-ed69-4314-ada0-c90ea084a466 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:15.853677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e3752b29-ed69-4314-ada0-c90ea084a466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:15.869887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3752b29-ed69-4314-ada0-c90ea084a466 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:15.870169 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3822/7540] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:15 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:15.873922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5826817-fc56-4d9c-bee2-746ac374f2eb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:15.887737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5826817-fc56-4d9c-bee2-746ac374f2eb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:15.889363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813d61f-1f8c-4a4e-808b-0d5aad4df54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:15.890484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813d61f-1f8c-4a4e-808b-0d5aad4df54d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:15.890934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813d61f-1f8c-4a4e-808b-0d5aad4df54d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:15.891380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813d61f-1f8c-4a4e-808b-0d5aad4df54d admin admin] PATH_INFO: `/v3/projects/d2d263a3183142ad8e61aa65e8974c9d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:15.894257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813d61f-1f8c-4a4e-808b-0d5aad4df54d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d263a3183142ad8e61aa65e8974c9d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:15.896366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2813d61f-1f8c-4a4e-808b-0d5aad4df54d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:15.924849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978ddeb5-2e53-45bf-83d1-faded6ed5095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:15.924849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ddeb5-2e53-45bf-83d1-faded6ed5095 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:15.924849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ddeb5-2e53-45bf-83d1-faded6ed5095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:15.924849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978ddeb5-2e53-45bf-83d1-faded6ed5095 admin admin] PATH_INFO: `/v3/projects/6d40b6e554ac436d81da31040276a530/users/8ac8b601e5cc4737acb6b9b8ab5b515f/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:15.992016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ddeb5-2e53-45bf-83d1-faded6ed5095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d40b6e554ac436d81da31040276a530, user_id=8ac8b601e5cc4737acb6b9b8ab5b515f, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:15.995132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978ddeb5-2e53-45bf-83d1-faded6ed5095 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:16.007142 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:16.110374 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3823/7541] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:44:15 2022] PUT /identity/v3/projects/6d40b6e554ac436d81da31040276a530/users/8ac8b601e5cc4737acb6b9b8ab5b515f/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:44:16.115788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e2318-0c9e-437f-b278-13ef936f2aef None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:16.117230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e2318-0c9e-437f-b278-13ef936f2aef None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:16.117928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e2318-0c9e-437f-b278-13ef936f2aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:16.159286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2813d61f-1f8c-4a4e-808b-0d5aad4df54d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d263a3183142ad8e61aa65e8974c9d', 'request_id': 'req-2813d61f-1f8c-4a4e-808b-0d5aad4df54d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:16.191248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-bb1e2318-0c9e-437f-b278-13ef936f2aef None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:16.197786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bb1e2318-0c9e-437f-b278-13ef936f2aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:16.248397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2813d61f-1f8c-4a4e-808b-0d5aad4df54d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d263a3183142ad8e61aa65e8974c9d', 'request_id': 'req-2813d61f-1f8c-4a4e-808b-0d5aad4df54d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:16.258546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2813d61f-1f8c-4a4e-808b-0d5aad4df54d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d263a3183142ad8e61aa65e8974c9d', 'request_id': 'req-2813d61f-1f8c-4a4e-808b-0d5aad4df54d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:16.304639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2813d61f-1f8c-4a4e-808b-0d5aad4df54d admin admin] The token cache is being invalidate because project d2d263a3183142ad8e61aa65e8974c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:44:16.304944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2813d61f-1f8c-4a4e-808b-0d5aad4df54d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:16.318883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2813d61f-1f8c-4a4e-808b-0d5aad4df54d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:16.323512 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3719/7542] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:44:15 2022] DELETE /identity/v3/projects/d2d263a3183142ad8e61aa65e8974c9d => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:44:16.327945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813d61f-1f8c-4a4e-808b-0d5aad4df54d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:16.334938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2813d61f-1f8c-4a4e-808b-0d5aad4df54d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:16.378583 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:16.473330 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3824/7543] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:16.505853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813d61f-1f8c-4a4e-808b-0d5aad4df54d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:16.511516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e5525-76be-48f9-bab2-4fa8c6598ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:16.512684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e5525-76be-48f9-bab2-4fa8c6598ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:16.512978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e5525-76be-48f9-bab2-4fa8c6598ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:16.513308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e5525-76be-48f9-bab2-4fa8c6598ee5 admin admin] PATH_INFO: `/v3/users/751a1d28580649158a9631f42c6cf33d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:16.514705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e5525-76be-48f9-bab2-4fa8c6598ee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=751a1d28580649158a9631f42c6cf33d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:16.517644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e5525-76be-48f9-bab2-4fa8c6598ee5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:16.534636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e2318-0c9e-437f-b278-13ef936f2aef None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:16.536253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bb1e2318-0c9e-437f-b278-13ef936f2aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:16.706295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e2318-0c9e-437f-b278-13ef936f2aef None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:16.711991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a7242-06d6-43a6-92d3-7959fcf6bdd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:16.713571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a7242-06d6-43a6-92d3-7959fcf6bdd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:16.713874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a7242-06d6-43a6-92d3-7959fcf6bdd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:16.714464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a7242-06d6-43a6-92d3-7959fcf6bdd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:16.738230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a7242-06d6-43a6-92d3-7959fcf6bdd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:16.738887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a66e5525-76be-48f9-bab2-4fa8c6598ee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '751a1d28580649158a9631f42c6cf33d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:16.741060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a7242-06d6-43a6-92d3-7959fcf6bdd3 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:16.768025 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3825/7544] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:44:16.777839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a66e5525-76be-48f9-bab2-4fa8c6598ee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '751a1d28580649158a9631f42c6cf33d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:16.778810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a66e5525-76be-48f9-bab2-4fa8c6598ee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '751a1d28580649158a9631f42c6cf33d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:16.779595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a66e5525-76be-48f9-bab2-4fa8c6598ee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '751a1d28580649158a9631f42c6cf33d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:16.789594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a66e5525-76be-48f9-bab2-4fa8c6598ee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '751a1d28580649158a9631f42c6cf33d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:16.881857 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3720/7545] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:44:16 2022] DELETE /identity/v3/users/751a1d28580649158a9631f42c6cf33d => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:44:18.363454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cae32-47cd-485c-b440-15cdcf0e488c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:18.363940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cae32-47cd-485c-b440-15cdcf0e488c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:18.364547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cae32-47cd-485c-b440-15cdcf0e488c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:18.407922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4d3cae32-47cd-485c-b440-15cdcf0e488c None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:18.413537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4d3cae32-47cd-485c-b440-15cdcf0e488c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:18.551815 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3826/7546] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:44:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:18.562183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e5525-76be-48f9-bab2-4fa8c6598ee5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:18.564212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a66e5525-76be-48f9-bab2-4fa8c6598ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:18.567692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3cae32-47cd-485c-b440-15cdcf0e488c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:18.572218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4d3cae32-47cd-485c-b440-15cdcf0e488c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:18.698720 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:18.764514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e5525-76be-48f9-bab2-4fa8c6598ee5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:18.770536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3cae32-47cd-485c-b440-15cdcf0e488c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:18.778331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2b35f-a653-4317-803e-41616f949952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:18.780185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2b35f-a653-4317-803e-41616f949952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:18.780293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2b35f-a653-4317-803e-41616f949952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:18.780555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2b35f-a653-4317-803e-41616f949952 admin admin] PATH_INFO: `/v3/projects/95c8bb6eac104343aee7e2b7f2eb4ee6` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:18.784332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2b35f-a653-4317-803e-41616f949952 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95c8bb6eac104343aee7e2b7f2eb4ee6)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:18.788093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa263352-bb9a-4752-935b-1473f102ba4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:18.789203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa263352-bb9a-4752-935b-1473f102ba4a service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:18.789512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa263352-bb9a-4752-935b-1473f102ba4a service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:18.789965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa263352-bb9a-4752-935b-1473f102ba4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:18.790758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba2b35f-a653-4317-803e-41616f949952 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:18.815877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa263352-bb9a-4752-935b-1473f102ba4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:18.820751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa263352-bb9a-4752-935b-1473f102ba4a service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:18.849892 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3827/7547] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:44:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:44:18.979407 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:18.998183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2ba2b35f-a653-4317-803e-41616f949952 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95c8bb6eac104343aee7e2b7f2eb4ee6', 'request_id': 'req-2ba2b35f-a653-4317-803e-41616f949952'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:19.066705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2ba2b35f-a653-4317-803e-41616f949952 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95c8bb6eac104343aee7e2b7f2eb4ee6', 'request_id': 'req-2ba2b35f-a653-4317-803e-41616f949952'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:19.079822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2ba2b35f-a653-4317-803e-41616f949952 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95c8bb6eac104343aee7e2b7f2eb4ee6', 'request_id': 'req-2ba2b35f-a653-4317-803e-41616f949952'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:19.108733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2ba2b35f-a653-4317-803e-41616f949952 admin admin] The token cache is being invalidate because project 95c8bb6eac104343aee7e2b7f2eb4ee6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:44:19.109234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2ba2b35f-a653-4317-803e-41616f949952 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:19.111515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2ba2b35f-a653-4317-803e-41616f949952 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:19.113877 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3721/7548] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:44:18 2022] DELETE /identity/v3/projects/95c8bb6eac104343aee7e2b7f2eb4ee6 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:19.121223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c3c21-a557-499b-a2a0-34c9065c7ae3 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:19.121599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c3c21-a557-499b-a2a0-34c9065c7ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:19.121886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c3c21-a557-499b-a2a0-34c9065c7ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:19.160023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ba9c3c21-a557-499b-a2a0-34c9065c7ae3 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:19.161484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ba9c3c21-a557-499b-a2a0-34c9065c7ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:19.403898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2b35f-a653-4317-803e-41616f949952 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:19.405501 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3828/7549] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:19.407075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2ba2b35f-a653-4317-803e-41616f949952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:19.407863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18e4df-d094-482c-85ad-3fecbce73b79 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:19.408433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18e4df-d094-482c-85ad-3fecbce73b79 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:19.408884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18e4df-d094-482c-85ad-3fecbce73b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:19.460742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6f18e4df-d094-482c-85ad-3fecbce73b79 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:19.465737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6f18e4df-d094-482c-85ad-3fecbce73b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:19.529931 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3829/7550] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:19.530240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18e4df-d094-482c-85ad-3fecbce73b79 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:19.567492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18e4df-d094-482c-85ad-3fecbce73b79 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:19.604039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15512e8-754d-4b73-8799-3614ba5a30e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:19.604515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15512e8-754d-4b73-8799-3614ba5a30e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:19.608812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15512e8-754d-4b73-8799-3614ba5a30e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:19.609121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15512e8-754d-4b73-8799-3614ba5a30e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:19.609986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15512e8-754d-4b73-8799-3614ba5a30e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:44:19.611257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15512e8-754d-4b73-8799-3614ba5a30e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:19.620117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15512e8-754d-4b73-8799-3614ba5a30e6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:19.658673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2b35f-a653-4317-803e-41616f949952 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:19.666747 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3830/7551] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:44:19.668164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15512e8-754d-4b73-8799-3614ba5a30e6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:19.675638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70ad77-e399-4d26-aa2c-0fc95895f13c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:19.679263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70ad77-e399-4d26-aa2c-0fc95895f13c service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:19.679263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70ad77-e399-4d26-aa2c-0fc95895f13c service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:19.679263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70ad77-e399-4d26-aa2c-0fc95895f13c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:19.687220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0b70ad77-e399-4d26-aa2c-0fc95895f13c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:19.712810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15512e8-754d-4b73-8799-3614ba5a30e6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:19.725221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c95532-b0db-4e15-b357-94c5e69fa5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:19.734985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c95532-b0db-4e15-b357-94c5e69fa5cc admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:19.741287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c95532-b0db-4e15-b357-94c5e69fa5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:19.741287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c95532-b0db-4e15-b357-94c5e69fa5cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:19.743060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c95532-b0db-4e15-b357-94c5e69fa5cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:19.754236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c95532-b0db-4e15-b357-94c5e69fa5cc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:19.875501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70ad77-e399-4d26-aa2c-0fc95895f13c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:19.894326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70ad77-e399-4d26-aa2c-0fc95895f13c service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:19.936129 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3831/7552] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:44:19 2022] POST /identity/v3/projects => generated 371 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:19.937994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c95532-b0db-4e15-b357-94c5e69fa5cc admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:19.966938 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3722/7553] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:44:20.032311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f14a6-5981-4305-9109-5930e34242ca None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:20.032826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f14a6-5981-4305-9109-5930e34242ca None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:20.033119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f14a6-5981-4305-9109-5930e34242ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:20.102181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-042f14a6-5981-4305-9109-5930e34242ca None None] MFA Rules not processed for user `8ac8b601e5cc4737acb6b9b8ab5b515f`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:20.103842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-042f14a6-5981-4305-9109-5930e34242ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:20.130960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c95532-b0db-4e15-b357-94c5e69fa5cc admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:20.154153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176ea39-dd3c-4e7b-b01e-c9b218aefcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:20.155171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176ea39-dd3c-4e7b-b01e-c9b218aefcb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:20.156123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176ea39-dd3c-4e7b-b01e-c9b218aefcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:20.156480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176ea39-dd3c-4e7b-b01e-c9b218aefcb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:20.164238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176ea39-dd3c-4e7b-b01e-c9b218aefcb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:20.166320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3176ea39-dd3c-4e7b-b01e-c9b218aefcb1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:20.279177 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3832/7554] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:44:19 2022] POST /identity/v3/users => generated 286 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:20.287868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176ea39-dd3c-4e7b-b01e-c9b218aefcb1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:20.319286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176ea39-dd3c-4e7b-b01e-c9b218aefcb1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:20.339035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cceca-c98f-47d5-8449-27f1b67aedb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:20.339742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cceca-c98f-47d5-8449-27f1b67aedb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:20.340033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cceca-c98f-47d5-8449-27f1b67aedb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:20.340316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cceca-c98f-47d5-8449-27f1b67aedb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:20.341564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771cceca-c98f-47d5-8449-27f1b67aedb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:20.342849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771cceca-c98f-47d5-8449-27f1b67aedb6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:20.364503 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3833/7555] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:44:20.368402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cceca-c98f-47d5-8449-27f1b67aedb6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:20.389151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cceca-c98f-47d5-8449-27f1b67aedb6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:20.402522 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3723/7556] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:20.406920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152ac2f-733d-4e9e-aeee-274a304bb109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:20.412658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f14a6-5981-4305-9109-5930e34242ca None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:20.418066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-042f14a6-5981-4305-9109-5930e34242ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:20.437511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152ac2f-733d-4e9e-aeee-274a304bb109 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:20.437511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152ac2f-733d-4e9e-aeee-274a304bb109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:20.437511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152ac2f-733d-4e9e-aeee-274a304bb109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:20.437511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152ac2f-733d-4e9e-aeee-274a304bb109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:20.437511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152ac2f-733d-4e9e-aeee-274a304bb109 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:20.437511 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:20.450720 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3834/7557] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:44:20.453728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152ac2f-733d-4e9e-aeee-274a304bb109 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:20.467377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152ac2f-733d-4e9e-aeee-274a304bb109 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:20.473788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebcf6d-bb4f-47d6-b508-e0b9203bb150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:20.474901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebcf6d-bb4f-47d6-b508-e0b9203bb150 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:20.478282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebcf6d-bb4f-47d6-b508-e0b9203bb150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:20.478282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebcf6d-bb4f-47d6-b508-e0b9203bb150 admin admin] PATH_INFO: `/v3/projects/44a97a374a514f40a9e89dcdf519ff3f/users/a14b8c4de76246d9bc54d2f6a1256315/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:20.498278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f14a6-5981-4305-9109-5930e34242ca None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:20.506239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebcf6d-bb4f-47d6-b508-e0b9203bb150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44a97a374a514f40a9e89dcdf519ff3f, user_id=a14b8c4de76246d9bc54d2f6a1256315, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:20.507584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdad0c-33bb-4a5d-a1f0-8d693e045015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:20.508853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdad0c-33bb-4a5d-a1f0-8d693e045015 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:20.510911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdad0c-33bb-4a5d-a1f0-8d693e045015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:20.512391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cdad0c-33bb-4a5d-a1f0-8d693e045015 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:20.513429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebcf6d-bb4f-47d6-b508-e0b9203bb150 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:20.517161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdad0c-33bb-4a5d-a1f0-8d693e045015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:20.523933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cdad0c-33bb-4a5d-a1f0-8d693e045015 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:20.549234 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:20.636311 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3835/7558] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:44:20 2022] PUT /identity/v3/projects/44a97a374a514f40a9e89dcdf519ff3f/users/a14b8c4de76246d9bc54d2f6a1256315/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:20.649508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb556999-d66f-40ce-ac2f-8383ad17e89b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:20.657072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb556999-d66f-40ce-ac2f-8383ad17e89b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:20.657072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb556999-d66f-40ce-ac2f-8383ad17e89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:20.677789 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3724/7559] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:44:20 2022] POST /identity/v3/projects => generated 371 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:20.681015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdad0c-33bb-4a5d-a1f0-8d693e045015 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:20.713398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-eb556999-d66f-40ce-ac2f-8383ad17e89b None None] MFA Rules not processed for user `a14b8c4de76246d9bc54d2f6a1256315`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:20.714921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-eb556999-d66f-40ce-ac2f-8383ad17e89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:20.801033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cdad0c-33bb-4a5d-a1f0-8d693e045015 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:20.812243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728d9c7-5352-4b63-b51d-2a136420f4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:20.812961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728d9c7-5352-4b63-b51d-2a136420f4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:20.815522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728d9c7-5352-4b63-b51d-2a136420f4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:20.818120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728d9c7-5352-4b63-b51d-2a136420f4c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:20.818120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728d9c7-5352-4b63-b51d-2a136420f4c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:20.823217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728d9c7-5352-4b63-b51d-2a136420f4c1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:20.858042 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3836/7560] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:20.878701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb556999-d66f-40ce-ac2f-8383ad17e89b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:20.881931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-eb556999-d66f-40ce-ac2f-8383ad17e89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:20.942875 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3725/7561] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:44:20 2022] POST /identity/v3/users => generated 292 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:44:20.946938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728d9c7-5352-4b63-b51d-2a136420f4c1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:20.968694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728d9c7-5352-4b63-b51d-2a136420f4c1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:20.981061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fd2ec-2b79-4e8d-bc22-5c1c74d4624d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:20.981762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fd2ec-2b79-4e8d-bc22-5c1c74d4624d admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:20.984090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fd2ec-2b79-4e8d-bc22-5c1c74d4624d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:20.984559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1fd2ec-2b79-4e8d-bc22-5c1c74d4624d admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:21.001704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fd2ec-2b79-4e8d-bc22-5c1c74d4624d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:21.008513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1fd2ec-2b79-4e8d-bc22-5c1c74d4624d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:21.039452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb556999-d66f-40ce-ac2f-8383ad17e89b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:21.049218 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3726/7562] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:21.065286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dec39-a6ca-4ea0-89ec-d54370c14120 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:21.065286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dec39-a6ca-4ea0-89ec-d54370c14120 service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:21.065286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dec39-a6ca-4ea0-89ec-d54370c14120 service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:21.065286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484dec39-a6ca-4ea0-89ec-d54370c14120 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:21.065920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fd2ec-2b79-4e8d-bc22-5c1c74d4624d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:21.103773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1fd2ec-2b79-4e8d-bc22-5c1c74d4624d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:21.107267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484dec39-a6ca-4ea0-89ec-d54370c14120 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:21.107267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484dec39-a6ca-4ea0-89ec-d54370c14120 service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:21.117267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74414d43-2798-455a-98df-9238bdcf7b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:21.124269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74414d43-2798-455a-98df-9238bdcf7b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:21.124564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74414d43-2798-455a-98df-9238bdcf7b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:21.125224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74414d43-2798-455a-98df-9238bdcf7b20 admin admin] PATH_INFO: `/v3/projects/87ecc2b854484a44ba7f1de4ed20a07b/users/1d39bda49b7f4729ac192c974e2e036f/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:21.131585 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3837/7563] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:44:21.172281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74414d43-2798-455a-98df-9238bdcf7b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ecc2b854484a44ba7f1de4ed20a07b, user_id=1d39bda49b7f4729ac192c974e2e036f, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:21.180794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74414d43-2798-455a-98df-9238bdcf7b20 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:21.286769 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3727/7564] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:44:21 2022] PUT /identity/v3/projects/87ecc2b854484a44ba7f1de4ed20a07b/users/1d39bda49b7f4729ac192c974e2e036f/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:21.292960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dec39-a6ca-4ea0-89ec-d54370c14120 service glance] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:21.309394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74414d43-2798-455a-98df-9238bdcf7b20 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:21.333510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484dec39-a6ca-4ea0-89ec-d54370c14120 service glance] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:21.465970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5288e57-67e6-4d91-bf70-a17c653929bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:21.465970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5288e57-67e6-4d91-bf70-a17c653929bb admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:21.465970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5288e57-67e6-4d91-bf70-a17c653929bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:21.470324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5288e57-67e6-4d91-bf70-a17c653929bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:21.470941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5288e57-67e6-4d91-bf70-a17c653929bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:21.473041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5288e57-67e6-4d91-bf70-a17c653929bb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:21.494141 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3838/7565] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:21.498025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5288e57-67e6-4d91-bf70-a17c653929bb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:21.506645 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:21.518951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5288e57-67e6-4d91-bf70-a17c653929bb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:21.521959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74414d43-2798-455a-98df-9238bdcf7b20 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:21.524491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36542d97-b954-465b-8266-7f962a1a648c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:21.525551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36542d97-b954-465b-8266-7f962a1a648c admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:21.525866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36542d97-b954-465b-8266-7f962a1a648c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:21.526205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36542d97-b954-465b-8266-7f962a1a648c admin admin] PATH_INFO: `/v3/projects/87ecc2b854484a44ba7f1de4ed20a07b/users/1d39bda49b7f4729ac192c974e2e036f/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:21.535457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e48cb-fb61-4cf8-9080-4801aaa7d42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:21.535670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36542d97-b954-465b-8266-7f962a1a648c admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ecc2b854484a44ba7f1de4ed20a07b, user_id=1d39bda49b7f4729ac192c974e2e036f, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:21.536889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e48cb-fb61-4cf8-9080-4801aaa7d42e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:21.537971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e48cb-fb61-4cf8-9080-4801aaa7d42e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:21.538759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36542d97-b954-465b-8266-7f962a1a648c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:21.539234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e48cb-fb61-4cf8-9080-4801aaa7d42e admin admin] PATH_INFO: `/v3/users/a14b8c4de76246d9bc54d2f6a1256315` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:21.541846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e48cb-fb61-4cf8-9080-4801aaa7d42e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a14b8c4de76246d9bc54d2f6a1256315)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:21.547770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e48cb-fb61-4cf8-9080-4801aaa7d42e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:21.558144 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3839/7566] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:44:21 2022] PUT /identity/v3/projects/87ecc2b854484a44ba7f1de4ed20a07b/users/1d39bda49b7f4729ac192c974e2e036f/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:21.889264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4d2e48cb-fb61-4cf8-9080-4801aaa7d42e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a14b8c4de76246d9bc54d2f6a1256315'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:21.891096 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:21.920155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4d2e48cb-fb61-4cf8-9080-4801aaa7d42e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a14b8c4de76246d9bc54d2f6a1256315'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:21.922728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4d2e48cb-fb61-4cf8-9080-4801aaa7d42e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a14b8c4de76246d9bc54d2f6a1256315'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:21.929170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4d2e48cb-fb61-4cf8-9080-4801aaa7d42e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a14b8c4de76246d9bc54d2f6a1256315'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:21.971521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4d2e48cb-fb61-4cf8-9080-4801aaa7d42e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a14b8c4de76246d9bc54d2f6a1256315'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:22.083456 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3728/7567] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:44:21 2022] DELETE /identity/v3/users/a14b8c4de76246d9bc54d2f6a1256315 => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:22.088266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb7370-283b-4ac8-bcf7-dce5dcc42957 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:22.088506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb7370-283b-4ac8-bcf7-dce5dcc42957 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:22.088793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb7370-283b-4ac8-bcf7-dce5dcc42957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:22.131235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-25cb7370-283b-4ac8-bcf7-dce5dcc42957 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:22.132642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-25cb7370-283b-4ac8-bcf7-dce5dcc42957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:22.299200 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3840/7568] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:22.321039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e48cb-fb61-4cf8-9080-4801aaa7d42e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:22.325213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4d2e48cb-fb61-4cf8-9080-4801aaa7d42e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:22.429532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e48cb-fb61-4cf8-9080-4801aaa7d42e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:22.438023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf9676-91aa-494e-b428-cbd7f062ef1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:22.439489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf9676-91aa-494e-b428-cbd7f062ef1e service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:22.439810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf9676-91aa-494e-b428-cbd7f062ef1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:22.440396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf9676-91aa-494e-b428-cbd7f062ef1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:22.459174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf9676-91aa-494e-b428-cbd7f062ef1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:22.460857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf9676-91aa-494e-b428-cbd7f062ef1e service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:22.480338 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3729/7569] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:44:23.474750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb7370-283b-4ac8-bcf7-dce5dcc42957 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:23.477347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-25cb7370-283b-4ac8-bcf7-dce5dcc42957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:23.494622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb7370-283b-4ac8-bcf7-dce5dcc42957 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:23.500231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5afb1-a4a2-498c-9d0b-96f20b5838e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:23.503751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5afb1-a4a2-498c-9d0b-96f20b5838e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:23.503751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5afb1-a4a2-498c-9d0b-96f20b5838e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:23.503751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5afb1-a4a2-498c-9d0b-96f20b5838e8 admin admin] PATH_INFO: `/v3/users/e787ba47f6084b9f9775ea5fdadcb855` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:23.503751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5afb1-a4a2-498c-9d0b-96f20b5838e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e787ba47f6084b9f9775ea5fdadcb855)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:23.509593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5afb1-a4a2-498c-9d0b-96f20b5838e8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:23.607731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf9676-91aa-494e-b428-cbd7f062ef1e service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:23.607731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-52cf9676-91aa-494e-b428-cbd7f062ef1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:23.631670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf9676-91aa-494e-b428-cbd7f062ef1e service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:23.644448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6093f-500a-4bb0-9bda-bf82defd9dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:23.645315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6093f-500a-4bb0-9bda-bf82defd9dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:23.645609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6093f-500a-4bb0-9bda-bf82defd9dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:23.645918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6093f-500a-4bb0-9bda-bf82defd9dac admin admin] PATH_INFO: `/v3/projects/44a97a374a514f40a9e89dcdf519ff3f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:23.647145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6093f-500a-4bb0-9bda-bf82defd9dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=44a97a374a514f40a9e89dcdf519ff3f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:23.649146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6093f-500a-4bb0-9bda-bf82defd9dac admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:23.746061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-aff5afb1-a4a2-498c-9d0b-96f20b5838e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e787ba47f6084b9f9775ea5fdadcb855'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:23.764688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-aff5afb1-a4a2-498c-9d0b-96f20b5838e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e787ba47f6084b9f9775ea5fdadcb855'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:23.772638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-aff5afb1-a4a2-498c-9d0b-96f20b5838e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e787ba47f6084b9f9775ea5fdadcb855'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:23.773429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-aff5afb1-a4a2-498c-9d0b-96f20b5838e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e787ba47f6084b9f9775ea5fdadcb855'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:23.877208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-aff5afb1-a4a2-498c-9d0b-96f20b5838e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e787ba47f6084b9f9775ea5fdadcb855'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:23.892323 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3841/7570] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:44:23 2022] DELETE /identity/v3/users/e787ba47f6084b9f9775ea5fdadcb855 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:23.897295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddf8a8-e4de-444a-a738-78f8e113ac33 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:23.897541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddf8a8-e4de-444a-a738-78f8e113ac33 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:23.897904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddf8a8-e4de-444a-a738-78f8e113ac33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:23.920490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f1f6093f-500a-4bb0-9bda-bf82defd9dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44a97a374a514f40a9e89dcdf519ff3f', 'request_id': 'req-f1f6093f-500a-4bb0-9bda-bf82defd9dac'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:23.920718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-42ddf8a8-e4de-444a-a738-78f8e113ac33 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:23.930989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-42ddf8a8-e4de-444a-a738-78f8e113ac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:24.035376 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3842/7571] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:44:24.043558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddf8a8-e4de-444a-a738-78f8e113ac33 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:24.045311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-42ddf8a8-e4de-444a-a738-78f8e113ac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:24.047349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f1f6093f-500a-4bb0-9bda-bf82defd9dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44a97a374a514f40a9e89dcdf519ff3f', 'request_id': 'req-f1f6093f-500a-4bb0-9bda-bf82defd9dac'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:24.058593 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:24.067894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f1f6093f-500a-4bb0-9bda-bf82defd9dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44a97a374a514f40a9e89dcdf519ff3f', 'request_id': 'req-f1f6093f-500a-4bb0-9bda-bf82defd9dac'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:24.085761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f1f6093f-500a-4bb0-9bda-bf82defd9dac admin admin] The token cache is being invalidate because project 44a97a374a514f40a9e89dcdf519ff3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:44:24.086056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f1f6093f-500a-4bb0-9bda-bf82defd9dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:24.086774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f1f6093f-500a-4bb0-9bda-bf82defd9dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:24.089084 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3730/7572] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:44:23 2022] DELETE /identity/v3/projects/44a97a374a514f40a9e89dcdf519ff3f => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:24.097097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f935103-b96a-4eec-8e7f-2151a16198cf None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:24.098518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f935103-b96a-4eec-8e7f-2151a16198cf None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:24.099889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f935103-b96a-4eec-8e7f-2151a16198cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:24.137887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3f935103-b96a-4eec-8e7f-2151a16198cf None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:24.139236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3f935103-b96a-4eec-8e7f-2151a16198cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:24.151293 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3731/7573] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:44:24.164682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c27cd4-1058-46ac-950d-b912110f9b99 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:24.165147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c27cd4-1058-46ac-950d-b912110f9b99 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:24.189349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c27cd4-1058-46ac-950d-b912110f9b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:24.190627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddf8a8-e4de-444a-a738-78f8e113ac33 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:24.190627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca84ac8-2324-48f0-b73c-e0c4a79d1dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:24.190627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca84ac8-2324-48f0-b73c-e0c4a79d1dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:24.190627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca84ac8-2324-48f0-b73c-e0c4a79d1dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:24.191099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca84ac8-2324-48f0-b73c-e0c4a79d1dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:24.191099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-aca84ac8-2324-48f0-b73c-e0c4a79d1dc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:24.193847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c9c27cd4-1058-46ac-950d-b912110f9b99 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:24.193847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c9c27cd4-1058-46ac-950d-b912110f9b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:24.200868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca84ac8-2324-48f0-b73c-e0c4a79d1dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:24.201836 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3732/7574] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:44:24.205849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca84ac8-2324-48f0-b73c-e0c4a79d1dc0 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:24.216072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c27cd4-1058-46ac-950d-b912110f9b99 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:24.220415 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3843/7575] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:44:24.246489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c27cd4-1058-46ac-950d-b912110f9b99 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:24.259854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90908f2-c22c-4509-b780-809c7f62f530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:24.260767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90908f2-c22c-4509-b780-809c7f62f530 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:24.261070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90908f2-c22c-4509-b780-809c7f62f530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:24.261721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90908f2-c22c-4509-b780-809c7f62f530 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:24.262643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90908f2-c22c-4509-b780-809c7f62f530 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:44:24.262962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90908f2-c22c-4509-b780-809c7f62f530 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:24.264910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90908f2-c22c-4509-b780-809c7f62f530 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:24.289944 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3733/7576] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:44:24.294273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca84ac8-2324-48f0-b73c-e0c4a79d1dc0 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:24.309718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca84ac8-2324-48f0-b73c-e0c4a79d1dc0 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:24.316423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02967bfb-474f-4d1d-972f-a0f7d763c86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:24.318367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02967bfb-474f-4d1d-972f-a0f7d763c86e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:24.318664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02967bfb-474f-4d1d-972f-a0f7d763c86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:24.319237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02967bfb-474f-4d1d-972f-a0f7d763c86e admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:24.320426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02967bfb-474f-4d1d-972f-a0f7d763c86e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:24.322856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02967bfb-474f-4d1d-972f-a0f7d763c86e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:24.510461 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3844/7577] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:44:24 2022] POST /identity/v3/projects => generated 409 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:24.514906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90908f2-c22c-4509-b780-809c7f62f530 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:24.545358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90908f2-c22c-4509-b780-809c7f62f530 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:24.571449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906815a7-8d82-4e94-920b-3b3d7700908d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:24.571773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906815a7-8d82-4e94-920b-3b3d7700908d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:24.572024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906815a7-8d82-4e94-920b-3b3d7700908d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:24.635135 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:24.646254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-906815a7-8d82-4e94-920b-3b3d7700908d None None] MFA Rules not processed for user `1d39bda49b7f4729ac192c974e2e036f`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:24.656011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-906815a7-8d82-4e94-920b-3b3d7700908d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:24.724192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b213b-a395-4cca-8076-9e3fe8e27e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:24.724948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b213b-a395-4cca-8076-9e3fe8e27e8a admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:24.725191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b213b-a395-4cca-8076-9e3fe8e27e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:24.725472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b213b-a395-4cca-8076-9e3fe8e27e8a admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:24.726241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b213b-a395-4cca-8076-9e3fe8e27e8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:24.731757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b213b-a395-4cca-8076-9e3fe8e27e8a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:24.825215 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3734/7578] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:44:24 2022] POST /identity/v3/users => generated 305 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:44:24.826422 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3845/7579] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:24 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:24.830046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b213b-a395-4cca-8076-9e3fe8e27e8a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:24.837877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c564f-6894-4995-9283-1453df5d9455 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:24.838211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c564f-6894-4995-9283-1453df5d9455 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:24.838553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c564f-6894-4995-9283-1453df5d9455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:24.865175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b213b-a395-4cca-8076-9e3fe8e27e8a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:24.868605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b17c564f-6894-4995-9283-1453df5d9455 None None] MFA Rules not processed for user `8ac8b601e5cc4737acb6b9b8ab5b515f`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:24.869856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b17c564f-6894-4995-9283-1453df5d9455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:24.872853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b4552-56f2-43fd-95ae-0841db9e14f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:24.874863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b4552-56f2-43fd-95ae-0841db9e14f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:24.875159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b4552-56f2-43fd-95ae-0841db9e14f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:24.875442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b4552-56f2-43fd-95ae-0841db9e14f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:24.878978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b4552-56f2-43fd-95ae-0841db9e14f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:24.881537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b4552-56f2-43fd-95ae-0841db9e14f2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:24.915464 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3735/7580] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:44:24.919276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b4552-56f2-43fd-95ae-0841db9e14f2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:24.948240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b4552-56f2-43fd-95ae-0841db9e14f2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:24.961669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb7cd8-984e-419b-b732-26aeb7e4f81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:24.961669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb7cd8-984e-419b-b732-26aeb7e4f81b admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:24.961669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb7cd8-984e-419b-b732-26aeb7e4f81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:24.961669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb7cd8-984e-419b-b732-26aeb7e4f81b admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:24.962333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb7cd8-984e-419b-b732-26aeb7e4f81b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:24.965196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb7cd8-984e-419b-b732-26aeb7e4f81b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:24.990150 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3846/7581] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:24.991242 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3736/7582] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:44:24.995638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c564f-6894-4995-9283-1453df5d9455 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:25.005447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb7cd8-984e-419b-b732-26aeb7e4f81b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:25.007388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6dbb7cd8-984e-419b-b732-26aeb7e4f81b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:25.017712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c564f-6894-4995-9283-1453df5d9455 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:25.035053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93d5cf-f7f2-403f-a808-6b4fe24001aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:25.036384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93d5cf-f7f2-403f-a808-6b4fe24001aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:25.036914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93d5cf-f7f2-403f-a808-6b4fe24001aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:25.037421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93d5cf-f7f2-403f-a808-6b4fe24001aa admin admin] PATH_INFO: `/v3/projects/d90f073fcbcd4b66b8fc7b9965048820/users/33d9fbf0f0924b76bc39ec244830bd1a/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:25.074234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93d5cf-f7f2-403f-a808-6b4fe24001aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90f073fcbcd4b66b8fc7b9965048820, user_id=33d9fbf0f0924b76bc39ec244830bd1a, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:25.083176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f93d5cf-f7f2-403f-a808-6b4fe24001aa admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:25.178662 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3847/7583] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:44:24 2022] PUT /identity/v3/projects/d90f073fcbcd4b66b8fc7b9965048820/users/33d9fbf0f0924b76bc39ec244830bd1a/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:44:25.190430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb7cd8-984e-419b-b732-26aeb7e4f81b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:25.193172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93d5cf-f7f2-403f-a808-6b4fe24001aa admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:25.200735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9f93d5cf-f7f2-403f-a808-6b4fe24001aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:25.363978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e686af0-1cc5-4887-8a3f-0971ab50d8c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:25.364867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e686af0-1cc5-4887-8a3f-0971ab50d8c5 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:25.365145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e686af0-1cc5-4887-8a3f-0971ab50d8c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:25.365423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e686af0-1cc5-4887-8a3f-0971ab50d8c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:25.369794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8e686af0-1cc5-4887-8a3f-0971ab50d8c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:25.388372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f93d5cf-f7f2-403f-a808-6b4fe24001aa admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:25.402481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea168453-7fd0-4529-820d-7d75b182ac7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:25.403376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea168453-7fd0-4529-820d-7d75b182ac7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:25.403658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea168453-7fd0-4529-820d-7d75b182ac7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:25.403953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea168453-7fd0-4529-820d-7d75b182ac7e admin admin] PATH_INFO: `/v3/projects/8a74da77e6bc4bea88654c215f268d6b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:25.408959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea168453-7fd0-4529-820d-7d75b182ac7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a74da77e6bc4bea88654c215f268d6b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:25.411052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea168453-7fd0-4529-820d-7d75b182ac7e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:25.484028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e686af0-1cc5-4887-8a3f-0971ab50d8c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:25.485790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e686af0-1cc5-4887-8a3f-0971ab50d8c5 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:25.499605 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3737/7584] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:44:25.502560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbac682-41c3-43e1-b7bc-bd41439a25de None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:25.502807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbac682-41c3-43e1-b7bc-bd41439a25de None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:25.503326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbac682-41c3-43e1-b7bc-bd41439a25de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:25.546778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-cdbac682-41c3-43e1-b7bc-bd41439a25de None None] MFA Rules not processed for user `33d9fbf0f0924b76bc39ec244830bd1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:25.550783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cdbac682-41c3-43e1-b7bc-bd41439a25de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:25.635645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ea168453-7fd0-4529-820d-7d75b182ac7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a74da77e6bc4bea88654c215f268d6b', 'request_id': 'req-ea168453-7fd0-4529-820d-7d75b182ac7e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:25.655993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ea168453-7fd0-4529-820d-7d75b182ac7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a74da77e6bc4bea88654c215f268d6b', 'request_id': 'req-ea168453-7fd0-4529-820d-7d75b182ac7e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:25.672486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ea168453-7fd0-4529-820d-7d75b182ac7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a74da77e6bc4bea88654c215f268d6b', 'request_id': 'req-ea168453-7fd0-4529-820d-7d75b182ac7e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:25.709726 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3738/7585] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:25 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:25.717776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbac682-41c3-43e1-b7bc-bd41439a25de None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:25.736945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbac682-41c3-43e1-b7bc-bd41439a25de None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:25.767934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ea168453-7fd0-4529-820d-7d75b182ac7e admin admin] The token cache is being invalidate because project 8a74da77e6bc4bea88654c215f268d6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:44:25.768346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ea168453-7fd0-4529-820d-7d75b182ac7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:25.778220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ea168453-7fd0-4529-820d-7d75b182ac7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:25.778220 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3848/7586] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:44:25 2022] DELETE /identity/v3/projects/8a74da77e6bc4bea88654c215f268d6b => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:25.781040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea168453-7fd0-4529-820d-7d75b182ac7e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:25.783086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ea168453-7fd0-4529-820d-7d75b182ac7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:25.866083 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:25.895272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d6bac-540d-4fc1-bec7-c058d6b881c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:25.895967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d6bac-540d-4fc1-bec7-c058d6b881c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:25.896261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d6bac-540d-4fc1-bec7-c058d6b881c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:25.896546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d6bac-540d-4fc1-bec7-c058d6b881c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:25.897577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d6bac-540d-4fc1-bec7-c058d6b881c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:25.899866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d6bac-540d-4fc1-bec7-c058d6b881c7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:25.934700 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:25.989777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea168453-7fd0-4529-820d-7d75b182ac7e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:26.003170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de13ffd-d746-4601-8af4-39f4f2ce7709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:26.012524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de13ffd-d746-4601-8af4-39f4f2ce7709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:26.012524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de13ffd-d746-4601-8af4-39f4f2ce7709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:26.012524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de13ffd-d746-4601-8af4-39f4f2ce7709 admin admin] PATH_INFO: `/v3/users/de3f284209364ae8ad2a2f0104d14946` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:26.012524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de13ffd-d746-4601-8af4-39f4f2ce7709 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de3f284209364ae8ad2a2f0104d14946)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:26.014453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de13ffd-d746-4601-8af4-39f4f2ce7709 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:26.064499 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3739/7587] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:44:25 2022] POST /identity/v3/projects => generated 409 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:26.068454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d6bac-540d-4fc1-bec7-c058d6b881c7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:26.075273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f79d6bac-540d-4fc1-bec7-c058d6b881c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:26.232870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d6bac-540d-4fc1-bec7-c058d6b881c7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:26.241081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57a84e-ed13-4590-843f-3bf28e072748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:26.241800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57a84e-ed13-4590-843f-3bf28e072748 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:26.242125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57a84e-ed13-4590-843f-3bf28e072748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:26.246759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57a84e-ed13-4590-843f-3bf28e072748 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:26.246759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57a84e-ed13-4590-843f-3bf28e072748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:26.246759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57a84e-ed13-4590-843f-3bf28e072748 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:26.294557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3de13ffd-d746-4601-8af4-39f4f2ce7709 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de3f284209364ae8ad2a2f0104d14946'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:26.310756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3de13ffd-d746-4601-8af4-39f4f2ce7709 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de3f284209364ae8ad2a2f0104d14946'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:26.319367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3de13ffd-d746-4601-8af4-39f4f2ce7709 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de3f284209364ae8ad2a2f0104d14946'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:26.320243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3de13ffd-d746-4601-8af4-39f4f2ce7709 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de3f284209364ae8ad2a2f0104d14946'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:26.372882 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3740/7588] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:44:26 2022] POST /identity/v3/users => generated 311 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:26.377633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57a84e-ed13-4590-843f-3bf28e072748 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:26.395661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57a84e-ed13-4590-843f-3bf28e072748 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:26.402504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3de13ffd-d746-4601-8af4-39f4f2ce7709 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de3f284209364ae8ad2a2f0104d14946'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:26.402694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fecd9-4b84-4cc5-8eae-1df5d75af099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:26.404393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fecd9-4b84-4cc5-8eae-1df5d75af099 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:26.405657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fecd9-4b84-4cc5-8eae-1df5d75af099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:26.413451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fecd9-4b84-4cc5-8eae-1df5d75af099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:26.413451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fecd9-4b84-4cc5-8eae-1df5d75af099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:26.413451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fecd9-4b84-4cc5-8eae-1df5d75af099 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:26.420434 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3849/7589] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:44:25 2022] DELETE /identity/v3/users/de3f284209364ae8ad2a2f0104d14946 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:44:26.432249 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3741/7590] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:26.433422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de13ffd-d746-4601-8af4-39f4f2ce7709 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:26.435494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3de13ffd-d746-4601-8af4-39f4f2ce7709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:26.540388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de13ffd-d746-4601-8af4-39f4f2ce7709 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:26.545599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfac53f-c363-4fc0-a793-ac52a8c01efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:26.546545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfac53f-c363-4fc0-a793-ac52a8c01efe admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:26.546840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfac53f-c363-4fc0-a793-ac52a8c01efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:26.559879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfac53f-c363-4fc0-a793-ac52a8c01efe admin admin] PATH_INFO: `/v3/projects/ce88d71502b4430ea66d38c8df0d3084/users/22d282aac5d24b70bf218fe5c530fc65/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:26.561479 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:26.602508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfac53f-c363-4fc0-a793-ac52a8c01efe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce88d71502b4430ea66d38c8df0d3084, user_id=22d282aac5d24b70bf218fe5c530fc65, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:26.605795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfac53f-c363-4fc0-a793-ac52a8c01efe admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:26.695832 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3850/7591] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:44:26 2022] PUT /identity/v3/projects/ce88d71502b4430ea66d38c8df0d3084/users/22d282aac5d24b70bf218fe5c530fc65/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:44:26.700521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fecd9-4b84-4cc5-8eae-1df5d75af099 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:26.714195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fecd9-4b84-4cc5-8eae-1df5d75af099 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:26.759285 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:26.819342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9016da0-0672-46ba-8b10-e1789f6fe540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:26.819811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9016da0-0672-46ba-8b10-e1789f6fe540 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:26.820105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9016da0-0672-46ba-8b10-e1789f6fe540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:26.820466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9016da0-0672-46ba-8b10-e1789f6fe540 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:26.825352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9016da0-0672-46ba-8b10-e1789f6fe540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:26.826113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9016da0-0672-46ba-8b10-e1789f6fe540 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:26.850148 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3742/7592] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:26.853478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfac53f-c363-4fc0-a793-ac52a8c01efe admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:26.872067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfac53f-c363-4fc0-a793-ac52a8c01efe admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:26.882014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd3569-7644-41e1-bfb4-fe43a706d9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:26.883001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd3569-7644-41e1-bfb4-fe43a706d9dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:26.883297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd3569-7644-41e1-bfb4-fe43a706d9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:26.883588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd3569-7644-41e1-bfb4-fe43a706d9dc admin admin] PATH_INFO: `/v3/projects/ce88d71502b4430ea66d38c8df0d3084/users/22d282aac5d24b70bf218fe5c530fc65/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:26.886403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd3569-7644-41e1-bfb4-fe43a706d9dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce88d71502b4430ea66d38c8df0d3084, user_id=22d282aac5d24b70bf218fe5c530fc65, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:26.894629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd3569-7644-41e1-bfb4-fe43a706d9dc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:26.926833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9016da0-0672-46ba-8b10-e1789f6fe540 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:26.926833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e9016da0-0672-46ba-8b10-e1789f6fe540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:26.931055 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3851/7593] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:44:26 2022] PUT /identity/v3/projects/ce88d71502b4430ea66d38c8df0d3084/users/22d282aac5d24b70bf218fe5c530fc65/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:26.932850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea23b8-0f24-4621-b722-90953d0facf2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:26.933347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea23b8-0f24-4621-b722-90953d0facf2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:26.933848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea23b8-0f24-4621-b722-90953d0facf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:26.950653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9016da0-0672-46ba-8b10-e1789f6fe540 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:26.980751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-82ea23b8-0f24-4621-b722-90953d0facf2 None None] MFA Rules not processed for user `22d282aac5d24b70bf218fe5c530fc65`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:26.987315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-82ea23b8-0f24-4621-b722-90953d0facf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:27.085112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de684a7-7a19-409c-ab88-d28fc8a4de09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:27.086253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de684a7-7a19-409c-ab88-d28fc8a4de09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:27.086538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de684a7-7a19-409c-ab88-d28fc8a4de09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:27.086817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de684a7-7a19-409c-ab88-d28fc8a4de09 admin admin] PATH_INFO: `/v3/users/4da804ebc57f46ee99a1eb94cf59fded` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:27.088055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de684a7-7a19-409c-ab88-d28fc8a4de09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4da804ebc57f46ee99a1eb94cf59fded)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:27.089977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de684a7-7a19-409c-ab88-d28fc8a4de09 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:27.128210 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3852/7594] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:26 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:27.178727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea23b8-0f24-4621-b722-90953d0facf2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:27.180357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-82ea23b8-0f24-4621-b722-90953d0facf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:27.256643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea23b8-0f24-4621-b722-90953d0facf2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:27.261871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889d2b1-165f-4072-9987-d4e8c7edbafa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:27.264857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889d2b1-165f-4072-9987-d4e8c7edbafa service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:27.264857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889d2b1-165f-4072-9987-d4e8c7edbafa service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:27.264857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c889d2b1-165f-4072-9987-d4e8c7edbafa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:27.278654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889d2b1-165f-4072-9987-d4e8c7edbafa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:27.280499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c889d2b1-165f-4072-9987-d4e8c7edbafa service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:27.294247 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3853/7595] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:27 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:44:27.333686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3de684a7-7a19-409c-ab88-d28fc8a4de09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4da804ebc57f46ee99a1eb94cf59fded'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:27.352896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3de684a7-7a19-409c-ab88-d28fc8a4de09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4da804ebc57f46ee99a1eb94cf59fded'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:27.354384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3de684a7-7a19-409c-ab88-d28fc8a4de09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4da804ebc57f46ee99a1eb94cf59fded'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:27.358826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3de684a7-7a19-409c-ab88-d28fc8a4de09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4da804ebc57f46ee99a1eb94cf59fded'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:27.367325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3de684a7-7a19-409c-ab88-d28fc8a4de09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4da804ebc57f46ee99a1eb94cf59fded'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:27.402209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889d2b1-165f-4072-9987-d4e8c7edbafa service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:27.405063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c889d2b1-165f-4072-9987-d4e8c7edbafa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:27.474057 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3743/7596] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:44:26 2022] DELETE /identity/v3/users/4da804ebc57f46ee99a1eb94cf59fded => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:44:27.509493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c889d2b1-165f-4072-9987-d4e8c7edbafa service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:27.614131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f6aa2-8a34-4f85-b9d6-3dec738c4395 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:27.615286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f6aa2-8a34-4f85-b9d6-3dec738c4395 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:27.615286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f6aa2-8a34-4f85-b9d6-3dec738c4395 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:27.618386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f6aa2-8a34-4f85-b9d6-3dec738c4395 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:27.619702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d15f6aa2-8a34-4f85-b9d6-3dec738c4395 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:27.642841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f6aa2-8a34-4f85-b9d6-3dec738c4395 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:27.644881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f6aa2-8a34-4f85-b9d6-3dec738c4395 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:27.700663 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3854/7597] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:44:27.882491 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:28.104882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de684a7-7a19-409c-ab88-d28fc8a4de09 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:28.106390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3de684a7-7a19-409c-ab88-d28fc8a4de09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:28.168878 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:28.250174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de684a7-7a19-409c-ab88-d28fc8a4de09 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:28.255761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfef29-d3b1-4937-8e35-61b09576a302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:28.256877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfef29-d3b1-4937-8e35-61b09576a302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:28.260960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfef29-d3b1-4937-8e35-61b09576a302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:28.261420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfef29-d3b1-4937-8e35-61b09576a302 admin admin] PATH_INFO: `/v3/projects/9c8ae6bc577449de987f8da524037723` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:28.263522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfef29-d3b1-4937-8e35-61b09576a302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c8ae6bc577449de987f8da524037723)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:28.265682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfef29-d3b1-4937-8e35-61b09576a302 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:28.460688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-95dfef29-d3b1-4937-8e35-61b09576a302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c8ae6bc577449de987f8da524037723', 'request_id': 'req-95dfef29-d3b1-4937-8e35-61b09576a302'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:28.540036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-95dfef29-d3b1-4937-8e35-61b09576a302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c8ae6bc577449de987f8da524037723', 'request_id': 'req-95dfef29-d3b1-4937-8e35-61b09576a302'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:28.556069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-95dfef29-d3b1-4937-8e35-61b09576a302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c8ae6bc577449de987f8da524037723', 'request_id': 'req-95dfef29-d3b1-4937-8e35-61b09576a302'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:28.603462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-95dfef29-d3b1-4937-8e35-61b09576a302 admin admin] The token cache is being invalidate because project 9c8ae6bc577449de987f8da524037723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:44:28.603942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-95dfef29-d3b1-4937-8e35-61b09576a302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:28.605454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-95dfef29-d3b1-4937-8e35-61b09576a302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:28.608547 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3744/7598] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:44:28 2022] DELETE /identity/v3/projects/9c8ae6bc577449de987f8da524037723 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:28.615227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeae2db-999e-4ba5-810c-b347e161f5ff None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:28.616322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeae2db-999e-4ba5-810c-b347e161f5ff None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:28.616322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeae2db-999e-4ba5-810c-b347e161f5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:28.669342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-aaeae2db-999e-4ba5-810c-b347e161f5ff None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:28.670739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-aaeae2db-999e-4ba5-810c-b347e161f5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:28.782133 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3855/7599] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:44:28.787756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba238492-5d9b-46ac-9e27-6de6b99feed7 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:28.788325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba238492-5d9b-46ac-9e27-6de6b99feed7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:28.789061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba238492-5d9b-46ac-9e27-6de6b99feed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:28.798839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeae2db-999e-4ba5-810c-b347e161f5ff None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:28.801133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-aaeae2db-999e-4ba5-810c-b347e161f5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:28.817679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ba238492-5d9b-46ac-9e27-6de6b99feed7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:28.820080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ba238492-5d9b-46ac-9e27-6de6b99feed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:28.821047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeae2db-999e-4ba5-810c-b347e161f5ff None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:28.828258 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b317d-a669-4cc0-b437-cd9e0fff1213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:28.837272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b317d-a669-4cc0-b437-cd9e0fff1213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:28.837272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b317d-a669-4cc0-b437-cd9e0fff1213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:28.837272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b317d-a669-4cc0-b437-cd9e0fff1213 admin admin] PATH_INFO: `/v3/projects/2203333572c24b229d3efb0e58d4b84c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:28.837272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b317d-a669-4cc0-b437-cd9e0fff1213 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2203333572c24b229d3efb0e58d4b84c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:28.837904 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3745/7600] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:28.839037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b317d-a669-4cc0-b437-cd9e0fff1213 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:28.839662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba238492-5d9b-46ac-9e27-6de6b99feed7 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:28.850689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba238492-5d9b-46ac-9e27-6de6b99feed7 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:28.860213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b244b-9f14-46a9-be70-19d3e4773d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:28.862393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b244b-9f14-46a9-be70-19d3e4773d4e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:28.862916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b244b-9f14-46a9-be70-19d3e4773d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:28.863353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b244b-9f14-46a9-be70-19d3e4773d4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:28.868238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b244b-9f14-46a9-be70-19d3e4773d4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:44:28.868645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b244b-9f14-46a9-be70-19d3e4773d4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:28.870613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b244b-9f14-46a9-be70-19d3e4773d4e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:28.885952 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3746/7601] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:44:28.890710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b244b-9f14-46a9-be70-19d3e4773d4e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:28.903112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b244b-9f14-46a9-be70-19d3e4773d4e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:28.909574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631705ec-cda4-487c-87b6-d3693073b08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:28.910433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631705ec-cda4-487c-87b6-d3693073b08f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:28.910743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631705ec-cda4-487c-87b6-d3693073b08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:28.911036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631705ec-cda4-487c-87b6-d3693073b08f admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:28.911737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631705ec-cda4-487c-87b6-d3693073b08f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:28.913636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631705ec-cda4-487c-87b6-d3693073b08f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:29.034857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4a2b317d-a669-4cc0-b437-cd9e0fff1213 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2203333572c24b229d3efb0e58d4b84c', 'request_id': 'req-4a2b317d-a669-4cc0-b437-cd9e0fff1213'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:29.059194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4a2b317d-a669-4cc0-b437-cd9e0fff1213 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2203333572c24b229d3efb0e58d4b84c', 'request_id': 'req-4a2b317d-a669-4cc0-b437-cd9e0fff1213'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:29.068243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4a2b317d-a669-4cc0-b437-cd9e0fff1213 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2203333572c24b229d3efb0e58d4b84c', 'request_id': 'req-4a2b317d-a669-4cc0-b437-cd9e0fff1213'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:29.106914 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3747/7602] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:44:28 2022] POST /identity/v3/projects => generated 373 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:44:29.111751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631705ec-cda4-487c-87b6-d3693073b08f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:29.198511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4a2b317d-a669-4cc0-b437-cd9e0fff1213 admin admin] The token cache is being invalidate because project 2203333572c24b229d3efb0e58d4b84c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:44:29.198511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4a2b317d-a669-4cc0-b437-cd9e0fff1213 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:29.198511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4a2b317d-a669-4cc0-b437-cd9e0fff1213 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:29.205364 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3856/7603] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:44:28 2022] DELETE /identity/v3/projects/2203333572c24b229d3efb0e58d4b84c => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:29.207177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90911e1e-b6fd-4710-a894-4e33562eef0a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:29.210079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90911e1e-b6fd-4710-a894-4e33562eef0a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:29.210504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90911e1e-b6fd-4710-a894-4e33562eef0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:29.247738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631705ec-cda4-487c-87b6-d3693073b08f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:29.257438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c41a45-c130-411e-973f-593c5ebcea90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:29.258658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c41a45-c130-411e-973f-593c5ebcea90 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:29.258951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c41a45-c130-411e-973f-593c5ebcea90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:29.259235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c41a45-c130-411e-973f-593c5ebcea90 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:29.260004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c41a45-c130-411e-973f-593c5ebcea90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:29.262832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c41a45-c130-411e-973f-593c5ebcea90 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:29.263484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-90911e1e-b6fd-4710-a894-4e33562eef0a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:29.264791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-90911e1e-b6fd-4710-a894-4e33562eef0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:29.294004 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3857/7604] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:29.303464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07450d98-619f-4e85-9407-14ce64ba85f9 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:29.306145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07450d98-619f-4e85-9407-14ce64ba85f9 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:29.307192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07450d98-619f-4e85-9407-14ce64ba85f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:29.349705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-07450d98-619f-4e85-9407-14ce64ba85f9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:29.351135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-07450d98-619f-4e85-9407-14ce64ba85f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:29.374143 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3858/7605] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:29.380234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07450d98-619f-4e85-9407-14ce64ba85f9 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:29.413841 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3748/7606] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:44:29 2022] POST /identity/v3/users => generated 287 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:29.418499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c41a45-c130-411e-973f-593c5ebcea90 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:29.425565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-38c41a45-c130-411e-973f-593c5ebcea90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:29.427441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07450d98-619f-4e85-9407-14ce64ba85f9 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:29.432873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cfbeb2-9548-4d4f-9664-0d11787f6af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:29.433696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfbeb2-9548-4d4f-9664-0d11787f6af5 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:29.434135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfbeb2-9548-4d4f-9664-0d11787f6af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:29.434522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfbeb2-9548-4d4f-9664-0d11787f6af5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:29.435525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cfbeb2-9548-4d4f-9664-0d11787f6af5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:44:29.435934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cfbeb2-9548-4d4f-9664-0d11787f6af5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:29.437978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cfbeb2-9548-4d4f-9664-0d11787f6af5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:29.445168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c41a45-c130-411e-973f-593c5ebcea90 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:29.450683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ba81b-4650-4988-a652-9b39e02ae586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:29.452032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ba81b-4650-4988-a652-9b39e02ae586 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:29.452685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ba81b-4650-4988-a652-9b39e02ae586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:29.453198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ba81b-4650-4988-a652-9b39e02ae586 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:29.457600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ba81b-4650-4988-a652-9b39e02ae586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:29.460186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ba81b-4650-4988-a652-9b39e02ae586 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:29.474751 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3859/7607] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:44:29.475776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cfbeb2-9548-4d4f-9664-0d11787f6af5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:29.482952 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3749/7608] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:29.484458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ba81b-4650-4988-a652-9b39e02ae586 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:29.496499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cfbeb2-9548-4d4f-9664-0d11787f6af5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:29.504156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ba81b-4650-4988-a652-9b39e02ae586 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:29.509346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f9772-4268-469f-8c62-044b50779d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:29.511636 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:29.511821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f9772-4268-469f-8c62-044b50779d93 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:29.512321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f9772-4268-469f-8c62-044b50779d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:29.512649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f9772-4268-469f-8c62-044b50779d93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:29.513376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f9772-4268-469f-8c62-044b50779d93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:29.516050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f9772-4268-469f-8c62-044b50779d93 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:29.516466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765ce3c-3f13-4541-bd81-9a9105366c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:29.518934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765ce3c-3f13-4541-bd81-9a9105366c99 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:29.520860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765ce3c-3f13-4541-bd81-9a9105366c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:29.521219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765ce3c-3f13-4541-bd81-9a9105366c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:29.523171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765ce3c-3f13-4541-bd81-9a9105366c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:29.534548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765ce3c-3f13-4541-bd81-9a9105366c99 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:29.558434 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3750/7609] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:29.559546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765ce3c-3f13-4541-bd81-9a9105366c99 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:29.576221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765ce3c-3f13-4541-bd81-9a9105366c99 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:29.594582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccab843-51f1-489d-9dfc-8bbac9f6ba8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:29.595894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccab843-51f1-489d-9dfc-8bbac9f6ba8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:29.596294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccab843-51f1-489d-9dfc-8bbac9f6ba8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:29.596673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccab843-51f1-489d-9dfc-8bbac9f6ba8c admin admin] PATH_INFO: `/v3/projects/4efd0fa2a10c4d8faa56dbfb82cad24f/users/754268e5833e4305873832be26859da7/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:29.636216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccab843-51f1-489d-9dfc-8bbac9f6ba8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4efd0fa2a10c4d8faa56dbfb82cad24f, user_id=754268e5833e4305873832be26859da7, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:29.639806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccab843-51f1-489d-9dfc-8bbac9f6ba8c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:29.642612 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3860/7610] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:44:29 2022] POST /identity/v3/projects => generated 369 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:29.651267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f9772-4268-469f-8c62-044b50779d93 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:29.773513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f9772-4268-469f-8c62-044b50779d93 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:29.790593 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3751/7611] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:44:29 2022] PUT /identity/v3/projects/4efd0fa2a10c4d8faa56dbfb82cad24f/users/754268e5833e4305873832be26859da7/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:29.797199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd6d8f-ddb3-4fb0-8f5a-154f23f8e6a4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:29.797864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd6d8f-ddb3-4fb0-8f5a-154f23f8e6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:29.799215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd6d8f-ddb3-4fb0-8f5a-154f23f8e6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:29.851637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3bfd6d8f-ddb3-4fb0-8f5a-154f23f8e6a4 None None] MFA Rules not processed for user `754268e5833e4305873832be26859da7`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:29.851637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3bfd6d8f-ddb3-4fb0-8f5a-154f23f8e6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:29.871166 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:29.921968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227f2d0-abfc-4b20-bdcc-827fb9f00368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:29.921968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227f2d0-abfc-4b20-bdcc-827fb9f00368 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:29.921968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227f2d0-abfc-4b20-bdcc-827fb9f00368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:29.921968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f227f2d0-abfc-4b20-bdcc-827fb9f00368 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:29.922697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227f2d0-abfc-4b20-bdcc-827fb9f00368 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:29.932438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f227f2d0-abfc-4b20-bdcc-827fb9f00368 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:30.006164 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3752/7612] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:30.022546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd6d8f-ddb3-4fb0-8f5a-154f23f8e6a4 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:30.025513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3bfd6d8f-ddb3-4fb0-8f5a-154f23f8e6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:30.080178 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3861/7613] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:44:29 2022] POST /identity/v3/users => generated 285 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:30.084248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227f2d0-abfc-4b20-bdcc-827fb9f00368 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:30.124885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f227f2d0-abfc-4b20-bdcc-827fb9f00368 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:30.133241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f66176-4b1d-4164-8d79-80db4c3a8a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:30.134941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f66176-4b1d-4164-8d79-80db4c3a8a8c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:30.135673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f66176-4b1d-4164-8d79-80db4c3a8a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:30.136283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f66176-4b1d-4164-8d79-80db4c3a8a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:30.137886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f66176-4b1d-4164-8d79-80db4c3a8a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:30.144181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f66176-4b1d-4164-8d79-80db4c3a8a8c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:30.167572 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3862/7614] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:30.172358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f66176-4b1d-4164-8d79-80db4c3a8a8c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:30.185193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd6d8f-ddb3-4fb0-8f5a-154f23f8e6a4 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:30.192200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc441d48-6a04-46ee-8499-5f104826ac4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:30.197631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc441d48-6a04-46ee-8499-5f104826ac4d service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:30.197631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc441d48-6a04-46ee-8499-5f104826ac4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:30.197631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc441d48-6a04-46ee-8499-5f104826ac4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:30.203952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f66176-4b1d-4164-8d79-80db4c3a8a8c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:30.208030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc441d48-6a04-46ee-8499-5f104826ac4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:30.210850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc441d48-6a04-46ee-8499-5f104826ac4d service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:30.237922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb61938-049e-408d-adec-214c9d4ceed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:30.240743 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3753/7615] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:44:30.252241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb61938-049e-408d-adec-214c9d4ceed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:30.253027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb61938-049e-408d-adec-214c9d4ceed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:30.253027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb61938-049e-408d-adec-214c9d4ceed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:30.253824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb61938-049e-408d-adec-214c9d4ceed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:30.255541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb61938-049e-408d-adec-214c9d4ceed2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:30.274141 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3863/7616] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:30.277769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc441d48-6a04-46ee-8499-5f104826ac4d service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:30.304347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc441d48-6a04-46ee-8499-5f104826ac4d service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:30.312363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f795cb-1101-4b14-82ed-4ee2349ded71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:30.313284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f795cb-1101-4b14-82ed-4ee2349ded71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:30.313656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f795cb-1101-4b14-82ed-4ee2349ded71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:30.313946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f795cb-1101-4b14-82ed-4ee2349ded71 admin admin] PATH_INFO: `/v3/projects/773bb2d8b4e24a6e82d5aed31d776761/users/ca7f1681db2c4079bae65f1e23093480/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:30.335462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f795cb-1101-4b14-82ed-4ee2349ded71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=773bb2d8b4e24a6e82d5aed31d776761, user_id=ca7f1681db2c4079bae65f1e23093480, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:30.338340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f795cb-1101-4b14-82ed-4ee2349ded71 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:30.490845 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3754/7617] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:44:30 2022] PUT /identity/v3/projects/773bb2d8b4e24a6e82d5aed31d776761/users/ca7f1681db2c4079bae65f1e23093480/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:30.500883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862a856-66d9-4f2a-83da-65bf160e7af2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:30.501728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862a856-66d9-4f2a-83da-65bf160e7af2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:30.502075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1862a856-66d9-4f2a-83da-65bf160e7af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:30.525168 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:30.555180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1862a856-66d9-4f2a-83da-65bf160e7af2 None None] MFA Rules not processed for user `ca7f1681db2c4079bae65f1e23093480`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:30.559834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1862a856-66d9-4f2a-83da-65bf160e7af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:30.668973 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3864/7618] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:30.677575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f795cb-1101-4b14-82ed-4ee2349ded71 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:30.680531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-74f795cb-1101-4b14-82ed-4ee2349ded71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:30.875707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f795cb-1101-4b14-82ed-4ee2349ded71 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:30.875707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514eec01-014b-40c5-9484-0320aaabda52 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:30.883803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eec01-014b-40c5-9484-0320aaabda52 service glance] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:30.884141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eec01-014b-40c5-9484-0320aaabda52 service glance] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:30.885483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514eec01-014b-40c5-9484-0320aaabda52 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:30.941565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514eec01-014b-40c5-9484-0320aaabda52 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:30.969244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514eec01-014b-40c5-9484-0320aaabda52 service glance] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:31.007826 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3755/7619] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:30 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:44:31.390907 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:33.475340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862a856-66d9-4f2a-83da-65bf160e7af2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:33.478963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1862a856-66d9-4f2a-83da-65bf160e7af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:33.607588 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1862a856-66d9-4f2a-83da-65bf160e7af2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:33.631970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01c2f6-84e2-47ca-bf31-df0aa4f08a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:33.635465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01c2f6-84e2-47ca-bf31-df0aa4f08a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:33.635788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01c2f6-84e2-47ca-bf31-df0aa4f08a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:33.636055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01c2f6-84e2-47ca-bf31-df0aa4f08a7e admin admin] PATH_INFO: `/v3/users/33d9fbf0f0924b76bc39ec244830bd1a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:33.644358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01c2f6-84e2-47ca-bf31-df0aa4f08a7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d9fbf0f0924b76bc39ec244830bd1a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:33.650521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01c2f6-84e2-47ca-bf31-df0aa4f08a7e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:33.658145 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:34.040443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3b01c2f6-84e2-47ca-bf31-df0aa4f08a7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d9fbf0f0924b76bc39ec244830bd1a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:34.126894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3b01c2f6-84e2-47ca-bf31-df0aa4f08a7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d9fbf0f0924b76bc39ec244830bd1a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:34.168860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3b01c2f6-84e2-47ca-bf31-df0aa4f08a7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d9fbf0f0924b76bc39ec244830bd1a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:34.170145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3b01c2f6-84e2-47ca-bf31-df0aa4f08a7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d9fbf0f0924b76bc39ec244830bd1a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:34.265463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3b01c2f6-84e2-47ca-bf31-df0aa4f08a7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d9fbf0f0924b76bc39ec244830bd1a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:34.277823 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3865/7620] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:44:33 2022] DELETE /identity/v3/users/33d9fbf0f0924b76bc39ec244830bd1a => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:34.284912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e90c7-5c99-4e20-83e3-bc7496a3cc6d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:34.284912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e90c7-5c99-4e20-83e3-bc7496a3cc6d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:34.284912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e90c7-5c99-4e20-83e3-bc7496a3cc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:34.348573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a50e90c7-5c99-4e20-83e3-bc7496a3cc6d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:34.352321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a50e90c7-5c99-4e20-83e3-bc7496a3cc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:34.594015 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3756/7621] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:34.660846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01c2f6-84e2-47ca-bf31-df0aa4f08a7e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:34.662990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3b01c2f6-84e2-47ca-bf31-df0aa4f08a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:34.884720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01c2f6-84e2-47ca-bf31-df0aa4f08a7e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:34.889611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40704700-8649-492b-b271-0cef24312709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:34.890770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40704700-8649-492b-b271-0cef24312709 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:34.891064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40704700-8649-492b-b271-0cef24312709 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:34.891414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40704700-8649-492b-b271-0cef24312709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:34.926578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40704700-8649-492b-b271-0cef24312709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:34.928343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40704700-8649-492b-b271-0cef24312709 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:34.956721 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3866/7622] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:44:36.083765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e90c7-5c99-4e20-83e3-bc7496a3cc6d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:36.085915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a50e90c7-5c99-4e20-83e3-bc7496a3cc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:36.116147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e90c7-5c99-4e20-83e3-bc7496a3cc6d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:36.121854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce20ca9-e345-4951-8f60-9d01dd1552c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:36.123002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce20ca9-e345-4951-8f60-9d01dd1552c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:36.123556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce20ca9-e345-4951-8f60-9d01dd1552c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:36.124233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce20ca9-e345-4951-8f60-9d01dd1552c4 admin admin] PATH_INFO: `/v3/users/104970c47a6046a3ad62d885c207918e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:36.125774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce20ca9-e345-4951-8f60-9d01dd1552c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=104970c47a6046a3ad62d885c207918e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:36.128331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce20ca9-e345-4951-8f60-9d01dd1552c4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:36.530619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8ce20ca9-e345-4951-8f60-9d01dd1552c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '104970c47a6046a3ad62d885c207918e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:36.553974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8ce20ca9-e345-4951-8f60-9d01dd1552c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '104970c47a6046a3ad62d885c207918e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:36.555250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8ce20ca9-e345-4951-8f60-9d01dd1552c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '104970c47a6046a3ad62d885c207918e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:36.556151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8ce20ca9-e345-4951-8f60-9d01dd1552c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '104970c47a6046a3ad62d885c207918e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:36.570801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8ce20ca9-e345-4951-8f60-9d01dd1552c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '104970c47a6046a3ad62d885c207918e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:36.573144 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:36.679647 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3757/7623] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:44:36 2022] DELETE /identity/v3/users/104970c47a6046a3ad62d885c207918e => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:36.681597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554200c-d50a-4ed0-adf3-0991b921b88d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:36.682262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554200c-d50a-4ed0-adf3-0991b921b88d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:36.682262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a554200c-d50a-4ed0-adf3-0991b921b88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:36.711314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce20ca9-e345-4951-8f60-9d01dd1552c4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:36.712801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8ce20ca9-e345-4951-8f60-9d01dd1552c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:36.739777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a554200c-d50a-4ed0-adf3-0991b921b88d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:36.742609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a554200c-d50a-4ed0-adf3-0991b921b88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:36.848440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce20ca9-e345-4951-8f60-9d01dd1552c4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:36.861575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eab8b8-a726-48d8-8858-474199913a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:36.863018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eab8b8-a726-48d8-8858-474199913a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:36.863018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eab8b8-a726-48d8-8858-474199913a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:36.864314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eab8b8-a726-48d8-8858-474199913a82 admin admin] PATH_INFO: `/v3/projects/d90f073fcbcd4b66b8fc7b9965048820` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:36.866836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eab8b8-a726-48d8-8858-474199913a82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d90f073fcbcd4b66b8fc7b9965048820)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:36.869473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eab8b8-a726-48d8-8858-474199913a82 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:36.920137 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3867/7624] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:36.977944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554200c-d50a-4ed0-adf3-0991b921b88d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:36.980760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a554200c-d50a-4ed0-adf3-0991b921b88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:37.072176 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:37.129836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-74eab8b8-a726-48d8-8858-474199913a82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd90f073fcbcd4b66b8fc7b9965048820', 'request_id': 'req-74eab8b8-a726-48d8-8858-474199913a82'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:37.169961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a554200c-d50a-4ed0-adf3-0991b921b88d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:37.279325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08352075-da5c-4424-a139-2b781ddb0e54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:37.280533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08352075-da5c-4424-a139-2b781ddb0e54 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:37.281064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08352075-da5c-4424-a139-2b781ddb0e54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:37.281599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08352075-da5c-4424-a139-2b781ddb0e54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:37.300513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-74eab8b8-a726-48d8-8858-474199913a82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd90f073fcbcd4b66b8fc7b9965048820', 'request_id': 'req-74eab8b8-a726-48d8-8858-474199913a82'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:37.323015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-74eab8b8-a726-48d8-8858-474199913a82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd90f073fcbcd4b66b8fc7b9965048820', 'request_id': 'req-74eab8b8-a726-48d8-8858-474199913a82'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:37.353458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-74eab8b8-a726-48d8-8858-474199913a82 admin admin] The token cache is being invalidate because project d90f073fcbcd4b66b8fc7b9965048820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:44:37.354091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-74eab8b8-a726-48d8-8858-474199913a82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:37.354988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-74eab8b8-a726-48d8-8858-474199913a82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:37.357193 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3758/7625] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:44:36 2022] DELETE /identity/v3/projects/d90f073fcbcd4b66b8fc7b9965048820 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:37.363675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eab8b8-a726-48d8-8858-474199913a82 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:37.374067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-74eab8b8-a726-48d8-8858-474199913a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:37.536209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08352075-da5c-4424-a139-2b781ddb0e54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:37.538143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08352075-da5c-4424-a139-2b781ddb0e54 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:37.592868 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3868/7626] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:44:37.602480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eab8b8-a726-48d8-8858-474199913a82 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:37.615659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ce7d4-c124-4dc7-8f5f-124c6adce17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:37.618027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ce7d4-c124-4dc7-8f5f-124c6adce17c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:37.618505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ce7d4-c124-4dc7-8f5f-124c6adce17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:37.618977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687ce7d4-c124-4dc7-8f5f-124c6adce17c admin admin] PATH_INFO: `/v3/users/22d282aac5d24b70bf218fe5c530fc65` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:37.620559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ce7d4-c124-4dc7-8f5f-124c6adce17c admin admin] RBAC: Authorizing `identity:delete_user(user_id=22d282aac5d24b70bf218fe5c530fc65)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:37.622730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687ce7d4-c124-4dc7-8f5f-124c6adce17c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:37.903608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-687ce7d4-c124-4dc7-8f5f-124c6adce17c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22d282aac5d24b70bf218fe5c530fc65'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:37.935158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-687ce7d4-c124-4dc7-8f5f-124c6adce17c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22d282aac5d24b70bf218fe5c530fc65'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:37.940999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-687ce7d4-c124-4dc7-8f5f-124c6adce17c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22d282aac5d24b70bf218fe5c530fc65'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:37.942126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-687ce7d4-c124-4dc7-8f5f-124c6adce17c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22d282aac5d24b70bf218fe5c530fc65'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:37.955472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-687ce7d4-c124-4dc7-8f5f-124c6adce17c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22d282aac5d24b70bf218fe5c530fc65'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:38.100453 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3759/7627] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:44:37 2022] DELETE /identity/v3/users/22d282aac5d24b70bf218fe5c530fc65 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:38.190262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08352075-da5c-4424-a139-2b781ddb0e54 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:38.191937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-08352075-da5c-4424-a139-2b781ddb0e54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:38.217729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08352075-da5c-4424-a139-2b781ddb0e54 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:38.423523 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:38.463865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc161a06-430d-4733-aa2f-1f2967a23188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:38.465291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc161a06-430d-4733-aa2f-1f2967a23188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:38.465930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc161a06-430d-4733-aa2f-1f2967a23188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:38.466503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc161a06-430d-4733-aa2f-1f2967a23188 admin admin] PATH_INFO: `/v3/projects/d9ecbd061e9f471892310ea3eb9b1c02` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:38.468106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc161a06-430d-4733-aa2f-1f2967a23188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9ecbd061e9f471892310ea3eb9b1c02)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:38.471225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc161a06-430d-4733-aa2f-1f2967a23188 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:38.660128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dc161a06-430d-4733-aa2f-1f2967a23188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9ecbd061e9f471892310ea3eb9b1c02', 'request_id': 'req-dc161a06-430d-4733-aa2f-1f2967a23188'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:38.671564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dc161a06-430d-4733-aa2f-1f2967a23188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9ecbd061e9f471892310ea3eb9b1c02', 'request_id': 'req-dc161a06-430d-4733-aa2f-1f2967a23188'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:38.689925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ce7d4-c124-4dc7-8f5f-124c6adce17c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:38.689925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-687ce7d4-c124-4dc7-8f5f-124c6adce17c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:38.703851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dc161a06-430d-4733-aa2f-1f2967a23188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9ecbd061e9f471892310ea3eb9b1c02', 'request_id': 'req-dc161a06-430d-4733-aa2f-1f2967a23188'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:38.728205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687ce7d4-c124-4dc7-8f5f-124c6adce17c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:38.803616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dc161a06-430d-4733-aa2f-1f2967a23188 admin admin] The token cache is being invalidate because project d9ecbd061e9f471892310ea3eb9b1c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:44:38.804192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dc161a06-430d-4733-aa2f-1f2967a23188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:38.805472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dc161a06-430d-4733-aa2f-1f2967a23188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:38.807458 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3869/7628] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:44:38 2022] DELETE /identity/v3/projects/d9ecbd061e9f471892310ea3eb9b1c02 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:38.815624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c043be-250b-4b4e-82be-2bb884afb000 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:38.818966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c043be-250b-4b4e-82be-2bb884afb000 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:38.819451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c043be-250b-4b4e-82be-2bb884afb000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:38.915033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c9c043be-250b-4b4e-82be-2bb884afb000 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:38.923915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c9c043be-250b-4b4e-82be-2bb884afb000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:38.976738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bb906-38e8-4f4f-8683-671298910b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:38.981989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bb906-38e8-4f4f-8683-671298910b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:38.983994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bb906-38e8-4f4f-8683-671298910b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:38.984651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bb906-38e8-4f4f-8683-671298910b3b admin admin] PATH_INFO: `/v3/projects/ce88d71502b4430ea66d38c8df0d3084` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:38.992689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bb906-38e8-4f4f-8683-671298910b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce88d71502b4430ea66d38c8df0d3084)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:39.004419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bb906-38e8-4f4f-8683-671298910b3b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:39.093978 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:39.147441 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3870/7629] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:39.156612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370735df-9d46-4d75-8b0b-896e4641fe49 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:39.156911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370735df-9d46-4d75-8b0b-896e4641fe49 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:39.157331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370735df-9d46-4d75-8b0b-896e4641fe49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:39.202045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-625bb906-38e8-4f4f-8683-671298910b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce88d71502b4430ea66d38c8df0d3084', 'request_id': 'req-625bb906-38e8-4f4f-8683-671298910b3b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:39.234299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-370735df-9d46-4d75-8b0b-896e4641fe49 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:39.234299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-370735df-9d46-4d75-8b0b-896e4641fe49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:39.301950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-625bb906-38e8-4f4f-8683-671298910b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce88d71502b4430ea66d38c8df0d3084', 'request_id': 'req-625bb906-38e8-4f4f-8683-671298910b3b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:39.319745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-625bb906-38e8-4f4f-8683-671298910b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce88d71502b4430ea66d38c8df0d3084', 'request_id': 'req-625bb906-38e8-4f4f-8683-671298910b3b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:39.345510 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3871/7630] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:39.350038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370735df-9d46-4d75-8b0b-896e4641fe49 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:39.351103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-625bb906-38e8-4f4f-8683-671298910b3b admin admin] The token cache is being invalidate because project ce88d71502b4430ea66d38c8df0d3084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:44:39.354613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-625bb906-38e8-4f4f-8683-671298910b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:39.366568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-625bb906-38e8-4f4f-8683-671298910b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:39.368266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370735df-9d46-4d75-8b0b-896e4641fe49 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:39.384914 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3760/7631] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:44:38 2022] DELETE /identity/v3/projects/ce88d71502b4430ea66d38c8df0d3084 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:44:39.385632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfb206-73b2-4acb-a12e-9b6357fa9b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:39.387166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfb206-73b2-4acb-a12e-9b6357fa9b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:39.393250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfb206-73b2-4acb-a12e-9b6357fa9b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:39.393250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfb206-73b2-4acb-a12e-9b6357fa9b6e admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:39.393493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea41959-482b-4ef1-a376-7571cc2da7e5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:39.393493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea41959-482b-4ef1-a376-7571cc2da7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:39.393493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea41959-482b-4ef1-a376-7571cc2da7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:39.397434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfb206-73b2-4acb-a12e-9b6357fa9b6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:44:39.398162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfb206-73b2-4acb-a12e-9b6357fa9b6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:39.400102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfb206-73b2-4acb-a12e-9b6357fa9b6e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:39.426280 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3872/7632] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:44:39.428581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfb206-73b2-4acb-a12e-9b6357fa9b6e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:39.433501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b1bfb206-73b2-4acb-a12e-9b6357fa9b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:39.451317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3ea41959-482b-4ef1-a376-7571cc2da7e5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:39.455399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3ea41959-482b-4ef1-a376-7571cc2da7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:39.464833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfb206-73b2-4acb-a12e-9b6357fa9b6e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:39.471780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0c432-b0bc-4d91-b714-a0c3df39e25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:39.473374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0c432-b0bc-4d91-b714-a0c3df39e25c admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:39.473720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0c432-b0bc-4d91-b714-a0c3df39e25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:39.474017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0c432-b0bc-4d91-b714-a0c3df39e25c admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:39.478492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0c432-b0bc-4d91-b714-a0c3df39e25c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:39.478492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f0c432-b0bc-4d91-b714-a0c3df39e25c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:39.518249 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3761/7633] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:39.522234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faeaf9-ca9d-4890-ab50-30b5657f2709 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:39.522768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faeaf9-ca9d-4890-ab50-30b5657f2709 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:39.549848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68faeaf9-ca9d-4890-ab50-30b5657f2709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:39.560636 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3873/7634] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:44:39 2022] POST /identity/v3/projects => generated 377 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:39.565558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0c432-b0bc-4d91-b714-a0c3df39e25c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:39.614439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-68faeaf9-ca9d-4890-ab50-30b5657f2709 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:39.614439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-68faeaf9-ca9d-4890-ab50-30b5657f2709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:39.722525 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3762/7635] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:39.733053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faeaf9-ca9d-4890-ab50-30b5657f2709 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:39.745686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68faeaf9-ca9d-4890-ab50-30b5657f2709 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:39.754047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0c432-b0bc-4d91-b714-a0c3df39e25c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:39.766977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4da20-037a-4e9b-bed8-f14c43de59c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:39.772304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4da20-037a-4e9b-bed8-f14c43de59c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:39.772304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4da20-037a-4e9b-bed8-f14c43de59c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:39.772304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4da20-037a-4e9b-bed8-f14c43de59c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:39.772304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4da20-037a-4e9b-bed8-f14c43de59c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:44:39.772304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4da20-037a-4e9b-bed8-f14c43de59c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:39.772960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4da20-037a-4e9b-bed8-f14c43de59c9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:39.779844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c5f65-fc26-4f5d-84a3-82fcc01ddb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:39.781911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c5f65-fc26-4f5d-84a3-82fcc01ddb7a admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:39.784608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c5f65-fc26-4f5d-84a3-82fcc01ddb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:39.785269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c5f65-fc26-4f5d-84a3-82fcc01ddb7a admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:39.786917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c5f65-fc26-4f5d-84a3-82fcc01ddb7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:39.789404 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3763/7636] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:44:39.793598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4da20-037a-4e9b-bed8-f14c43de59c9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:39.795254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c5f65-fc26-4f5d-84a3-82fcc01ddb7a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:39.820204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4da20-037a-4e9b-bed8-f14c43de59c9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:39.827882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c70b6c-1e05-4d5c-9f49-1d289af91d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:39.829372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c70b6c-1e05-4d5c-9f49-1d289af91d3a admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:39.829683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c70b6c-1e05-4d5c-9f49-1d289af91d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:39.830069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c70b6c-1e05-4d5c-9f49-1d289af91d3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:39.830830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c70b6c-1e05-4d5c-9f49-1d289af91d3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:39.833158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c70b6c-1e05-4d5c-9f49-1d289af91d3a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:39.973526 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3764/7637] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:44:39 2022] POST /identity/v3/projects => generated 371 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:39.974733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c70b6c-1e05-4d5c-9f49-1d289af91d3a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:40.124028 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:40.170230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c70b6c-1e05-4d5c-9f49-1d289af91d3a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:40.177371 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3874/7638] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:44:39 2022] POST /identity/v3/users => generated 289 bytes in 612 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:40.181696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c5f65-fc26-4f5d-84a3-82fcc01ddb7a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:40.192434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91fc39-63e7-47cb-9725-e30d43c26be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:40.194227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91fc39-63e7-47cb-9725-e30d43c26be6 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:40.194896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91fc39-63e7-47cb-9725-e30d43c26be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:40.195558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91fc39-63e7-47cb-9725-e30d43c26be6 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:40.196523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91fc39-63e7-47cb-9725-e30d43c26be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:40.201564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91fc39-63e7-47cb-9725-e30d43c26be6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:40.244152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c5f65-fc26-4f5d-84a3-82fcc01ddb7a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:40.271916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2471b96-58e1-48ac-96bc-9af415ee06a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:40.293927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2471b96-58e1-48ac-96bc-9af415ee06a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:40.297936 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3765/7639] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:44:39 2022] POST /identity/v3/users => generated 286 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:40.299157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91fc39-63e7-47cb-9725-e30d43c26be6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:40.300538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2471b96-58e1-48ac-96bc-9af415ee06a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:40.301646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2471b96-58e1-48ac-96bc-9af415ee06a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:40.308286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2471b96-58e1-48ac-96bc-9af415ee06a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:40.316221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2471b96-58e1-48ac-96bc-9af415ee06a0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:40.323518 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:40.332526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91fc39-63e7-47cb-9725-e30d43c26be6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:40.348941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c396a-891b-4e45-bbda-91d071d993c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:40.350002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c396a-891b-4e45-bbda-91d071d993c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:40.350324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c396a-891b-4e45-bbda-91d071d993c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:40.350611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c396a-891b-4e45-bbda-91d071d993c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:40.356613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c396a-891b-4e45-bbda-91d071d993c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:40.357628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c396a-891b-4e45-bbda-91d071d993c1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:40.360787 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3875/7640] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:40.362965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2471b96-58e1-48ac-96bc-9af415ee06a0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:40.381800 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3766/7641] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:44:40.401331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2471b96-58e1-48ac-96bc-9af415ee06a0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:40.402476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c396a-891b-4e45-bbda-91d071d993c1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:40.415449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa8c56-9d1f-4363-948a-61730811377b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:40.417887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa8c56-9d1f-4363-948a-61730811377b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:40.418279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa8c56-9d1f-4363-948a-61730811377b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:40.419468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa8c56-9d1f-4363-948a-61730811377b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:40.420892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa8c56-9d1f-4363-948a-61730811377b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:40.429488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa8c56-9d1f-4363-948a-61730811377b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:40.440115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c396a-891b-4e45-bbda-91d071d993c1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:40.460712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47292ff8-1cba-4961-8818-fbe9932dcb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:40.461727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47292ff8-1cba-4961-8818-fbe9932dcb6d admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:40.462896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47292ff8-1cba-4961-8818-fbe9932dcb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:40.464078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47292ff8-1cba-4961-8818-fbe9932dcb6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:40.465683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47292ff8-1cba-4961-8818-fbe9932dcb6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:40.467433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47292ff8-1cba-4961-8818-fbe9932dcb6d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:40.474158 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3876/7642] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:40.481996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa8c56-9d1f-4363-948a-61730811377b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:40.497577 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3767/7643] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:40.502225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47292ff8-1cba-4961-8818-fbe9932dcb6d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:40.522087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa8c56-9d1f-4363-948a-61730811377b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:40.529185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e40551-8fdc-4fea-9155-bf08a212cb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:40.530455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e40551-8fdc-4fea-9155-bf08a212cb8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:40.530928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e40551-8fdc-4fea-9155-bf08a212cb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:40.531398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e40551-8fdc-4fea-9155-bf08a212cb8d admin admin] PATH_INFO: `/v3/projects/e6e3fe4acd9b492caa8c2dc6e193aa7a/users/bd3e0d7158c843ccbdc56eee594fd7a8/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:40.562728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47292ff8-1cba-4961-8818-fbe9932dcb6d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:40.574615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e40551-8fdc-4fea-9155-bf08a212cb8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6e3fe4acd9b492caa8c2dc6e193aa7a, user_id=bd3e0d7158c843ccbdc56eee594fd7a8, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:40.589622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a0a1e-3556-401f-bd0f-53dd694d6859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:40.592117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e40551-8fdc-4fea-9155-bf08a212cb8d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:40.599783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a0a1e-3556-401f-bd0f-53dd694d6859 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:40.600916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a0a1e-3556-401f-bd0f-53dd694d6859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:40.602592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a0a1e-3556-401f-bd0f-53dd694d6859 admin admin] PATH_INFO: `/v3/projects/1d8cebadb9314bd2a533726305682660/users/715815a826db409ea3903f045600fd4b/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:40.668072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a0a1e-3556-401f-bd0f-53dd694d6859 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d8cebadb9314bd2a533726305682660, user_id=715815a826db409ea3903f045600fd4b, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:40.680133 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3877/7644] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:44:40 2022] PUT /identity/v3/projects/e6e3fe4acd9b492caa8c2dc6e193aa7a/users/bd3e0d7158c843ccbdc56eee594fd7a8/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:40.694701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff0345-661f-402e-998d-9f9ec467765e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:40.695205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18a0a1e-3556-401f-bd0f-53dd694d6859 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:40.695330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff0345-661f-402e-998d-9f9ec467765e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:40.695530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff0345-661f-402e-998d-9f9ec467765e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:40.800572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-aaff0345-661f-402e-998d-9f9ec467765e None None] MFA Rules not processed for user `bd3e0d7158c843ccbdc56eee594fd7a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:40.807129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-aaff0345-661f-402e-998d-9f9ec467765e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:40.821712 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3768/7645] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:44:40 2022] PUT /identity/v3/projects/1d8cebadb9314bd2a533726305682660/users/715815a826db409ea3903f045600fd4b/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:40.833223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12520136-3cac-48cb-835a-1a709c3bfa07 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:40.833573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12520136-3cac-48cb-835a-1a709c3bfa07 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:40.833801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12520136-3cac-48cb-835a-1a709c3bfa07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:40.906291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-12520136-3cac-48cb-835a-1a709c3bfa07 None None] MFA Rules not processed for user `715815a826db409ea3903f045600fd4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:40.910989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-12520136-3cac-48cb-835a-1a709c3bfa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:41.087676 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3878/7646] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:41.096351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff0345-661f-402e-998d-9f9ec467765e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:41.191561 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3769/7647] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:44:41.247859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12520136-3cac-48cb-835a-1a709c3bfa07 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:41.251472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-12520136-3cac-48cb-835a-1a709c3bfa07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:41.348261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff0345-661f-402e-998d-9f9ec467765e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:41.426014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12520136-3cac-48cb-835a-1a709c3bfa07 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:41.441028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559c689-526f-4cca-9e1f-527d801b94d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:41.441756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559c689-526f-4cca-9e1f-527d801b94d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:41.442129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559c689-526f-4cca-9e1f-527d801b94d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:41.442488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559c689-526f-4cca-9e1f-527d801b94d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:41.462036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559c689-526f-4cca-9e1f-527d801b94d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:41.465684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559c689-526f-4cca-9e1f-527d801b94d1 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:41.493630 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3770/7648] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:41 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:44:41.538483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a826ec-f532-424b-a488-d5aa4b5b6507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:41.539404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a826ec-f532-424b-a488-d5aa4b5b6507 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:41.539873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a826ec-f532-424b-a488-d5aa4b5b6507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:41.541933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a826ec-f532-424b-a488-d5aa4b5b6507 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:41.542780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a826ec-f532-424b-a488-d5aa4b5b6507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:41.547175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a826ec-f532-424b-a488-d5aa4b5b6507 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:41.756292 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:41.757651 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3879/7649] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:44:41 2022] POST /identity/v3/projects => generated 377 bytes in 663 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:41.761909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559c689-526f-4cca-9e1f-527d801b94d1 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:41.783889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559c689-526f-4cca-9e1f-527d801b94d1 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:41.802798 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:41.995963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ab79b-e550-4dc4-a25d-21c89d34058e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:41.997230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ab79b-e550-4dc4-a25d-21c89d34058e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:41.998130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ab79b-e550-4dc4-a25d-21c89d34058e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:41.998512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6ab79b-e550-4dc4-a25d-21c89d34058e admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:41.999495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ab79b-e550-4dc4-a25d-21c89d34058e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:42.003022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6ab79b-e550-4dc4-a25d-21c89d34058e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:42.112285 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3771/7650] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:44:41 2022] POST /identity/v3/users => generated 295 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:42.113199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a826ec-f532-424b-a488-d5aa4b5b6507 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:42.132820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a826ec-f532-424b-a488-d5aa4b5b6507 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:42.153140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185339d2-1c96-4e22-812c-d1a5875d5590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:42.153140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185339d2-1c96-4e22-812c-d1a5875d5590 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:42.153140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185339d2-1c96-4e22-812c-d1a5875d5590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:42.153140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185339d2-1c96-4e22-812c-d1a5875d5590 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:42.153618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185339d2-1c96-4e22-812c-d1a5875d5590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:42.159040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185339d2-1c96-4e22-812c-d1a5875d5590 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:42.189977 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3880/7651] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:42.190302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ab79b-e550-4dc4-a25d-21c89d34058e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:42.210351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6ab79b-e550-4dc4-a25d-21c89d34058e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:42.239066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6063f-9645-40a4-b9ac-01d9aef71da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:42.240232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6063f-9645-40a4-b9ac-01d9aef71da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:42.240526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6063f-9645-40a4-b9ac-01d9aef71da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:42.240827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6063f-9645-40a4-b9ac-01d9aef71da1 admin admin] PATH_INFO: `/v3/projects/dcbace3a353348e6928a0ddf2cd955cb/users/3aebadd67dff4318aea87aa185d63866/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:42.285271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6063f-9645-40a4-b9ac-01d9aef71da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcbace3a353348e6928a0ddf2cd955cb, user_id=3aebadd67dff4318aea87aa185d63866, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:42.288474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6063f-9645-40a4-b9ac-01d9aef71da1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:42.370063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185339d2-1c96-4e22-812c-d1a5875d5590 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:42.371994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-185339d2-1c96-4e22-812c-d1a5875d5590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:42.392787 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3772/7652] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:44:42 2022] PUT /identity/v3/projects/dcbace3a353348e6928a0ddf2cd955cb/users/3aebadd67dff4318aea87aa185d63866/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:42.396417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6063f-9645-40a4-b9ac-01d9aef71da1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:42.608385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185339d2-1c96-4e22-812c-d1a5875d5590 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:42.617345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6063f-9645-40a4-b9ac-01d9aef71da1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:42.634471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63392b03-3bd9-41ce-99c2-7a5c307fa3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:42.635263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63392b03-3bd9-41ce-99c2-7a5c307fa3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:42.635558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63392b03-3bd9-41ce-99c2-7a5c307fa3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:42.635843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63392b03-3bd9-41ce-99c2-7a5c307fa3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:42.636594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63392b03-3bd9-41ce-99c2-7a5c307fa3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:42.638645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63392b03-3bd9-41ce-99c2-7a5c307fa3d9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:42.654484 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3773/7653] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:42 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:42.657114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63392b03-3bd9-41ce-99c2-7a5c307fa3d9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:42.687350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63392b03-3bd9-41ce-99c2-7a5c307fa3d9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:42.702466 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:42.709628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dec38c-040e-47cf-9e7f-b5d413110a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:42.709628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dec38c-040e-47cf-9e7f-b5d413110a12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:42.709628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dec38c-040e-47cf-9e7f-b5d413110a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:42.709628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dec38c-040e-47cf-9e7f-b5d413110a12 admin admin] PATH_INFO: `/v3/projects/dcbace3a353348e6928a0ddf2cd955cb/users/3aebadd67dff4318aea87aa185d63866/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:42.710197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dec38c-040e-47cf-9e7f-b5d413110a12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcbace3a353348e6928a0ddf2cd955cb, user_id=3aebadd67dff4318aea87aa185d63866, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:42.716675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dec38c-040e-47cf-9e7f-b5d413110a12 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:42.770825 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3774/7654] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:44:42 2022] PUT /identity/v3/projects/dcbace3a353348e6928a0ddf2cd955cb/users/3aebadd67dff4318aea87aa185d63866/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:42.783589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27991c-9998-4ec1-99dd-e08c1d490655 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:42.787721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27991c-9998-4ec1-99dd-e08c1d490655 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:42.788325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27991c-9998-4ec1-99dd-e08c1d490655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:42.810873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d38a6e-260f-47d3-8e47-726e454de6c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:42.811591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d38a6e-260f-47d3-8e47-726e454de6c2 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:42.812206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d38a6e-260f-47d3-8e47-726e454de6c2 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:42.813577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d38a6e-260f-47d3-8e47-726e454de6c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:42.816978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e4d38a6e-260f-47d3-8e47-726e454de6c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:42.858936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d38a6e-260f-47d3-8e47-726e454de6c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:42.860807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d38a6e-260f-47d3-8e47-726e454de6c2 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:42.874803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-cf27991c-9998-4ec1-99dd-e08c1d490655 None None] MFA Rules not processed for user `3aebadd67dff4318aea87aa185d63866`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:42.878236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cf27991c-9998-4ec1-99dd-e08c1d490655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:42.906061 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3881/7655] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:44:43.474440 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3775/7656] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 697 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:43.491554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d38a6e-260f-47d3-8e47-726e454de6c2 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:43.494239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e4d38a6e-260f-47d3-8e47-726e454de6c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:43.528903 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:43.603394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27991c-9998-4ec1-99dd-e08c1d490655 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:43.651948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d38a6e-260f-47d3-8e47-726e454de6c2 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:43.760397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e120731-a7d6-41f6-8811-016dcc3ee0cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:43.761361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e120731-a7d6-41f6-8811-016dcc3ee0cb service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:43.761679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e120731-a7d6-41f6-8811-016dcc3ee0cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:43.762067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e120731-a7d6-41f6-8811-016dcc3ee0cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:43.763752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27991c-9998-4ec1-99dd-e08c1d490655 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:43.773288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f6c01-f8fb-4877-bf25-56d0724cb840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:43.774255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f6c01-f8fb-4877-bf25-56d0724cb840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:43.774545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f6c01-f8fb-4877-bf25-56d0724cb840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:43.774825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f6c01-f8fb-4877-bf25-56d0724cb840 admin admin] PATH_INFO: `/v3/users/715815a826db409ea3903f045600fd4b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:43.783070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f6c01-f8fb-4877-bf25-56d0724cb840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=715815a826db409ea3903f045600fd4b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:43.783070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f6c01-f8fb-4877-bf25-56d0724cb840 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:43.846461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e120731-a7d6-41f6-8811-016dcc3ee0cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:43.848573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e120731-a7d6-41f6-8811-016dcc3ee0cb service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:43.878935 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3882/7657] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:44:43.986748 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:43.994900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a04f6c01-f8fb-4877-bf25-56d0724cb840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '715815a826db409ea3903f045600fd4b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:44.017542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a04f6c01-f8fb-4877-bf25-56d0724cb840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '715815a826db409ea3903f045600fd4b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:44.017961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a04f6c01-f8fb-4877-bf25-56d0724cb840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '715815a826db409ea3903f045600fd4b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:44.018727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a04f6c01-f8fb-4877-bf25-56d0724cb840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '715815a826db409ea3903f045600fd4b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:44.027214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a04f6c01-f8fb-4877-bf25-56d0724cb840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '715815a826db409ea3903f045600fd4b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:44.120508 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3776/7658] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:44:43 2022] DELETE /identity/v3/users/715815a826db409ea3903f045600fd4b => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:44.129249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7d17a-8d90-4186-bc83-6568d3ffd56b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:44.129826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7d17a-8d90-4186-bc83-6568d3ffd56b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:44.130388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7d17a-8d90-4186-bc83-6568d3ffd56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:44.207278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d5c7d17a-8d90-4186-bc83-6568d3ffd56b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:44.208695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d5c7d17a-8d90-4186-bc83-6568d3ffd56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:44.352305 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3883/7659] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:44.469084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f6c01-f8fb-4877-bf25-56d0724cb840 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:44.471430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a04f6c01-f8fb-4877-bf25-56d0724cb840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:44.617512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f6c01-f8fb-4877-bf25-56d0724cb840 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:44.617512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371d519-6170-4601-b431-69d4671d65e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:44.617512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371d519-6170-4601-b431-69d4671d65e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:44.617512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371d519-6170-4601-b431-69d4671d65e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:44.617876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371d519-6170-4601-b431-69d4671d65e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:44.627031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371d519-6170-4601-b431-69d4671d65e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:44.628874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371d519-6170-4601-b431-69d4671d65e7 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:44.647998 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3777/7660] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:44:46.002750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7d17a-8d90-4186-bc83-6568d3ffd56b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:46.005113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d5c7d17a-8d90-4186-bc83-6568d3ffd56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:46.105017 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:46.162348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371d519-6170-4601-b431-69d4671d65e7 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:46.163123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4371d519-6170-4601-b431-69d4671d65e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:46.192457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371d519-6170-4601-b431-69d4671d65e7 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:46.227494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc31f1-d504-4889-a978-d3749d40ffb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:46.228638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc31f1-d504-4889-a978-d3749d40ffb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:46.229854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc31f1-d504-4889-a978-d3749d40ffb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:46.231723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc31f1-d504-4889-a978-d3749d40ffb6 admin admin] PATH_INFO: `/v3/projects/1d8cebadb9314bd2a533726305682660` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:46.240622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc31f1-d504-4889-a978-d3749d40ffb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d8cebadb9314bd2a533726305682660)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:46.243017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc31f1-d504-4889-a978-d3749d40ffb6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:46.247071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7d17a-8d90-4186-bc83-6568d3ffd56b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:46.256077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf1115-e963-420d-a85c-6eb07a62bc30 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:46.256766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf1115-e963-420d-a85c-6eb07a62bc30 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:46.257305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf1115-e963-420d-a85c-6eb07a62bc30 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:46.257597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf1115-e963-420d-a85c-6eb07a62bc30 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:46.260233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-aeaf1115-e963-420d-a85c-6eb07a62bc30 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:46.288729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf1115-e963-420d-a85c-6eb07a62bc30 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:46.307954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf1115-e963-420d-a85c-6eb07a62bc30 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:46.350433 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3884/7661] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:44:46.459903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f8bc31f1-d504-4889-a978-d3749d40ffb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d8cebadb9314bd2a533726305682660', 'request_id': 'req-f8bc31f1-d504-4889-a978-d3749d40ffb6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:46.551721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f8bc31f1-d504-4889-a978-d3749d40ffb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d8cebadb9314bd2a533726305682660', 'request_id': 'req-f8bc31f1-d504-4889-a978-d3749d40ffb6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:46.559552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f8bc31f1-d504-4889-a978-d3749d40ffb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d8cebadb9314bd2a533726305682660', 'request_id': 'req-f8bc31f1-d504-4889-a978-d3749d40ffb6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:46.648142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f8bc31f1-d504-4889-a978-d3749d40ffb6 admin admin] The token cache is being invalidate because project 1d8cebadb9314bd2a533726305682660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:44:46.652590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f8bc31f1-d504-4889-a978-d3749d40ffb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:46.655423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f8bc31f1-d504-4889-a978-d3749d40ffb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:44:46.656936 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3778/7662] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:44:46 2022] DELETE /identity/v3/projects/1d8cebadb9314bd2a533726305682660 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:46.663047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f7a18-3180-4ce5-942a-b050db6717b1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:46.664035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f7a18-3180-4ce5-942a-b050db6717b1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:46.664497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34f7a18-3180-4ce5-942a-b050db6717b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:46.734938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b34f7a18-3180-4ce5-942a-b050db6717b1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:46.737011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b34f7a18-3180-4ce5-942a-b050db6717b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:46.973651 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3885/7663] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:46.982472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a19d4-1600-4d78-83d3-ccd24df7bea8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:46.982784 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a19d4-1600-4d78-83d3-ccd24df7bea8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:46.983067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066a19d4-1600-4d78-83d3-ccd24df7bea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:47.016232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-066a19d4-1600-4d78-83d3-ccd24df7bea8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:47.018386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-066a19d4-1600-4d78-83d3-ccd24df7bea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:47.035163 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3779/7664] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:44:47.043308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f7a18-3180-4ce5-942a-b050db6717b1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:47.068623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34f7a18-3180-4ce5-942a-b050db6717b1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:47.103650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d5faa-e443-4398-a4e4-4bf09433300b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:47.103650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d5faa-e443-4398-a4e4-4bf09433300b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:47.104266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d5faa-e443-4398-a4e4-4bf09433300b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:47.104841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d5faa-e443-4398-a4e4-4bf09433300b admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:47.110134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d5faa-e443-4398-a4e4-4bf09433300b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:44:47.116935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d5faa-e443-4398-a4e4-4bf09433300b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:47.116935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d5faa-e443-4398-a4e4-4bf09433300b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:47.167436 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3886/7665] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:44:47.171693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a19d4-1600-4d78-83d3-ccd24df7bea8 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:47.191963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066a19d4-1600-4d78-83d3-ccd24df7bea8 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:47.206888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e473069-cb3c-4530-87fc-92b1ecdcec84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:47.207842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e473069-cb3c-4530-87fc-92b1ecdcec84 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:47.208537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e473069-cb3c-4530-87fc-92b1ecdcec84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:47.208983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e473069-cb3c-4530-87fc-92b1ecdcec84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:47.209841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e473069-cb3c-4530-87fc-92b1ecdcec84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:47.212009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e473069-cb3c-4530-87fc-92b1ecdcec84 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:47.348311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d5faa-e443-4398-a4e4-4bf09433300b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:47.350355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-473d5faa-e443-4398-a4e4-4bf09433300b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:47.353203 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3780/7666] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:44:47 2022] POST /identity/v3/projects => generated 371 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:47.354767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e473069-cb3c-4530-87fc-92b1ecdcec84 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:47.437198 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:47.565781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e473069-cb3c-4530-87fc-92b1ecdcec84 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:47.584635 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6413a4-262b-4fda-b121-5db7bcb85110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:47.585494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6413a4-262b-4fda-b121-5db7bcb85110 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:47.585779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6413a4-262b-4fda-b121-5db7bcb85110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:47.586058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6413a4-262b-4fda-b121-5db7bcb85110 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:47.586798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6413a4-262b-4fda-b121-5db7bcb85110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:47.587446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d5faa-e443-4398-a4e4-4bf09433300b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:47.590498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6413a4-262b-4fda-b121-5db7bcb85110 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:47.695048 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3781/7667] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:44:47 2022] POST /identity/v3/users => generated 286 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:44:47.702643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6413a4-262b-4fda-b121-5db7bcb85110 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:47.749658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def7c90-6981-4556-9f25-0afdcf178416 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:47.749885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6413a4-262b-4fda-b121-5db7bcb85110 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:47.749995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def7c90-6981-4556-9f25-0afdcf178416 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:47.749995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def7c90-6981-4556-9f25-0afdcf178416 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:47.749995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def7c90-6981-4556-9f25-0afdcf178416 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:47.751659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5def7c90-6981-4556-9f25-0afdcf178416 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:47.761507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae6ba7-e1ee-49e7-a224-f7c1743a186a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:47.762248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae6ba7-e1ee-49e7-a224-f7c1743a186a admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:47.762778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae6ba7-e1ee-49e7-a224-f7c1743a186a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:47.763069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae6ba7-e1ee-49e7-a224-f7c1743a186a admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:47.763815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae6ba7-e1ee-49e7-a224-f7c1743a186a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:47.765432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ae6ba7-e1ee-49e7-a224-f7c1743a186a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:47.791590 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:47.803262 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3782/7668] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:47.807128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae6ba7-e1ee-49e7-a224-f7c1743a186a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:47.818735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae6ba7-e1ee-49e7-a224-f7c1743a186a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:47.824250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaa7ad-d1cf-49f4-b2f3-8d6dae9b4d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:47.824934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaa7ad-d1cf-49f4-b2f3-8d6dae9b4d32 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:47.825236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaa7ad-d1cf-49f4-b2f3-8d6dae9b4d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:47.825800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbaa7ad-d1cf-49f4-b2f3-8d6dae9b4d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:47.826971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbaa7ad-d1cf-49f4-b2f3-8d6dae9b4d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:47.828590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbaa7ad-d1cf-49f4-b2f3-8d6dae9b4d32 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:47.851011 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3783/7669] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:44:47.852973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaa7ad-d1cf-49f4-b2f3-8d6dae9b4d32 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:47.868432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbaa7ad-d1cf-49f4-b2f3-8d6dae9b4d32 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:47.878265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8cf84-5071-41fc-be53-617bdaa45c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:47.879193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8cf84-5071-41fc-be53-617bdaa45c5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:47.879473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8cf84-5071-41fc-be53-617bdaa45c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:47.879751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a8cf84-5071-41fc-be53-617bdaa45c5a admin admin] PATH_INFO: `/v3/projects/27722d70d7d146248968e92ea57f3888/users/c1063412fb8740d888a12ca14eea85e7/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:47.897001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def7c90-6981-4556-9f25-0afdcf178416 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:47.897001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def7c90-6981-4556-9f25-0afdcf178416 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:47.904568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8cf84-5071-41fc-be53-617bdaa45c5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=27722d70d7d146248968e92ea57f3888, user_id=c1063412fb8740d888a12ca14eea85e7, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:47.915118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a8cf84-5071-41fc-be53-617bdaa45c5a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:47.919619 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3887/7670] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:44:48.012004 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3784/7671] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:44:47 2022] PUT /identity/v3/projects/27722d70d7d146248968e92ea57f3888/users/c1063412fb8740d888a12ca14eea85e7/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:44:48.024421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaa859-92f3-4a7f-b787-673017fe9637 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:48.024827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaa859-92f3-4a7f-b787-673017fe9637 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:48.025185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadaa859-92f3-4a7f-b787-673017fe9637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:48.107824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-fadaa859-92f3-4a7f-b787-673017fe9637 None None] MFA Rules not processed for user `c1063412fb8740d888a12ca14eea85e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:44:48.110959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fadaa859-92f3-4a7f-b787-673017fe9637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:48.316669 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3888/7672] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:44:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:44:48.319375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8cf84-5071-41fc-be53-617bdaa45c5a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:48.320906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d9a8cf84-5071-41fc-be53-617bdaa45c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:48.460466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a8cf84-5071-41fc-be53-617bdaa45c5a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:48.469258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f6fbe-c320-4891-9ed0-873d29ca2bdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:48.470084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f6fbe-c320-4891-9ed0-873d29ca2bdb service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:48.470698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f6fbe-c320-4891-9ed0-873d29ca2bdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:48.471057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0f6fbe-c320-4891-9ed0-873d29ca2bdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:48.488163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f6fbe-c320-4891-9ed0-873d29ca2bdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:48.494084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0f6fbe-c320-4891-9ed0-873d29ca2bdb service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:48.520413 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3785/7673] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:44:52.641066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaa859-92f3-4a7f-b787-673017fe9637 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:44:52.761976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadaa859-92f3-4a7f-b787-673017fe9637 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:44:52.786395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb5bc2-3139-46ae-886f-6b3adc687594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:44:52.789864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb5bc2-3139-46ae-886f-6b3adc687594 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:44:52.790542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb5bc2-3139-46ae-886f-6b3adc687594 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:44:52.791135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb5bc2-3139-46ae-886f-6b3adc687594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:44:52.799192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8cdb5bc2-3139-46ae-886f-6b3adc687594 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:44:52.940972 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:44:52.980160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb5bc2-3139-46ae-886f-6b3adc687594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:44:52.981648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdb5bc2-3139-46ae-886f-6b3adc687594 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:44:53.006743 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3889/7674] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:44:52 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:44:58.508599 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=68,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:45:02.593792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f6fbe-c320-4891-9ed0-873d29ca2bdb service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:02.595233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8a0f6fbe-c320-4891-9ed0-873d29ca2bdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:02.803073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0f6fbe-c320-4891-9ed0-873d29ca2bdb service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:02.807974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad067a-f0af-4376-b34d-c59e09d79f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:02.809117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad067a-f0af-4376-b34d-c59e09d79f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:02.809571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad067a-f0af-4376-b34d-c59e09d79f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:02.810687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad067a-f0af-4376-b34d-c59e09d79f72 admin admin] PATH_INFO: `/v3/users/bd3e0d7158c843ccbdc56eee594fd7a8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:02.812558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad067a-f0af-4376-b34d-c59e09d79f72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd3e0d7158c843ccbdc56eee594fd7a8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:02.816353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad067a-f0af-4376-b34d-c59e09d79f72 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:03.075494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a5ad067a-f0af-4376-b34d-c59e09d79f72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd3e0d7158c843ccbdc56eee594fd7a8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:03.092183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a5ad067a-f0af-4376-b34d-c59e09d79f72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd3e0d7158c843ccbdc56eee594fd7a8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:03.093567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a5ad067a-f0af-4376-b34d-c59e09d79f72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd3e0d7158c843ccbdc56eee594fd7a8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:03.093740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a5ad067a-f0af-4376-b34d-c59e09d79f72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd3e0d7158c843ccbdc56eee594fd7a8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:03.104564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a5ad067a-f0af-4376-b34d-c59e09d79f72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd3e0d7158c843ccbdc56eee594fd7a8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:03.162732 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:45:03.175079 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3786/7675] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:45:02 2022] DELETE /identity/v3/users/bd3e0d7158c843ccbdc56eee594fd7a8 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:45:03.175921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb738d3-3350-4415-be5a-ba90763f2e9a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:03.176231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb738d3-3350-4415-be5a-ba90763f2e9a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:03.176523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb738d3-3350-4415-be5a-ba90763f2e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:03.226259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ebb738d3-3350-4415-be5a-ba90763f2e9a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:45:03.227987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ebb738d3-3350-4415-be5a-ba90763f2e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:03.362703 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3890/7676] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:45:03.385263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad067a-f0af-4376-b34d-c59e09d79f72 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:03.387582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a5ad067a-f0af-4376-b34d-c59e09d79f72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:03.620770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad067a-f0af-4376-b34d-c59e09d79f72 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:03.637304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd919fb5-8c93-4f76-a50e-0858666ced50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:03.639210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd919fb5-8c93-4f76-a50e-0858666ced50 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:03.639210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd919fb5-8c93-4f76-a50e-0858666ced50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:03.639210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd919fb5-8c93-4f76-a50e-0858666ced50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:03.659392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd919fb5-8c93-4f76-a50e-0858666ced50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:03.660921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd919fb5-8c93-4f76-a50e-0858666ced50 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:03.675269 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3787/7677] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:45:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:45:04.970795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb738d3-3350-4415-be5a-ba90763f2e9a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:04.973042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ebb738d3-3350-4415-be5a-ba90763f2e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:05.003251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb738d3-3350-4415-be5a-ba90763f2e9a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:05.013292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eeafba-0645-4481-83a0-6741038e2169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:05.014238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeafba-0645-4481-83a0-6741038e2169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:05.014626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeafba-0645-4481-83a0-6741038e2169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:05.014881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eeafba-0645-4481-83a0-6741038e2169 admin admin] PATH_INFO: `/v3/projects/e6e3fe4acd9b492caa8c2dc6e193aa7a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:05.016187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eeafba-0645-4481-83a0-6741038e2169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6e3fe4acd9b492caa8c2dc6e193aa7a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:05.019502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eeafba-0645-4481-83a0-6741038e2169 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:05.194835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-89eeafba-0645-4481-83a0-6741038e2169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6e3fe4acd9b492caa8c2dc6e193aa7a', 'request_id': 'req-89eeafba-0645-4481-83a0-6741038e2169'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:05.206515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-89eeafba-0645-4481-83a0-6741038e2169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6e3fe4acd9b492caa8c2dc6e193aa7a', 'request_id': 'req-89eeafba-0645-4481-83a0-6741038e2169'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:05.223739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-89eeafba-0645-4481-83a0-6741038e2169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6e3fe4acd9b492caa8c2dc6e193aa7a', 'request_id': 'req-89eeafba-0645-4481-83a0-6741038e2169'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:05.311697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-89eeafba-0645-4481-83a0-6741038e2169 admin admin] The token cache is being invalidate because project e6e3fe4acd9b492caa8c2dc6e193aa7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:45:05.312416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-89eeafba-0645-4481-83a0-6741038e2169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:05.314349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-89eeafba-0645-4481-83a0-6741038e2169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:05.318411 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3891/7678] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:45:04 2022] DELETE /identity/v3/projects/e6e3fe4acd9b492caa8c2dc6e193aa7a => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:45:05.322378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd919fb5-8c93-4f76-a50e-0858666ced50 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:05.333307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd919fb5-8c93-4f76-a50e-0858666ced50 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:05.377017 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:45:05.471744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990ed433-6d54-4f63-bd19-c95490fc4b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:05.472649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ed433-6d54-4f63-bd19-c95490fc4b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:05.472937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ed433-6d54-4f63-bd19-c95490fc4b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:05.473218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990ed433-6d54-4f63-bd19-c95490fc4b60 admin admin] PATH_INFO: `/v3/users/3aebadd67dff4318aea87aa185d63866` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:05.475222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ed433-6d54-4f63-bd19-c95490fc4b60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aebadd67dff4318aea87aa185d63866)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:05.478092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990ed433-6d54-4f63-bd19-c95490fc4b60 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:05.706029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-990ed433-6d54-4f63-bd19-c95490fc4b60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aebadd67dff4318aea87aa185d63866'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:05.728477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-990ed433-6d54-4f63-bd19-c95490fc4b60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aebadd67dff4318aea87aa185d63866'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:05.729719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-990ed433-6d54-4f63-bd19-c95490fc4b60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aebadd67dff4318aea87aa185d63866'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:05.730569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-990ed433-6d54-4f63-bd19-c95490fc4b60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aebadd67dff4318aea87aa185d63866'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:05.740640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-990ed433-6d54-4f63-bd19-c95490fc4b60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aebadd67dff4318aea87aa185d63866'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:05.831688 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3788/7679] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:45:05 2022] DELETE /identity/v3/users/3aebadd67dff4318aea87aa185d63866 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:45:09.633483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eeafba-0645-4481-83a0-6741038e2169 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:09.635114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-89eeafba-0645-4481-83a0-6741038e2169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:09.660289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eeafba-0645-4481-83a0-6741038e2169 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:09.904142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb4ec7-aa9f-4113-b08e-4436357a23be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:09.904979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb4ec7-aa9f-4113-b08e-4436357a23be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:09.905271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb4ec7-aa9f-4113-b08e-4436357a23be admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:09.905562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb4ec7-aa9f-4113-b08e-4436357a23be admin admin] PATH_INFO: `/v3/projects/dcbace3a353348e6928a0ddf2cd955cb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:09.912560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb4ec7-aa9f-4113-b08e-4436357a23be admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcbace3a353348e6928a0ddf2cd955cb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:09.914592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb4ec7-aa9f-4113-b08e-4436357a23be admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:10.105023 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:45:10.169308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a5fb4ec7-aa9f-4113-b08e-4436357a23be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcbace3a353348e6928a0ddf2cd955cb', 'request_id': 'req-a5fb4ec7-aa9f-4113-b08e-4436357a23be'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:10.186788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a5fb4ec7-aa9f-4113-b08e-4436357a23be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcbace3a353348e6928a0ddf2cd955cb', 'request_id': 'req-a5fb4ec7-aa9f-4113-b08e-4436357a23be'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:10.227467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a5fb4ec7-aa9f-4113-b08e-4436357a23be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcbace3a353348e6928a0ddf2cd955cb', 'request_id': 'req-a5fb4ec7-aa9f-4113-b08e-4436357a23be'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:10.321183 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a5fb4ec7-aa9f-4113-b08e-4436357a23be admin admin] The token cache is being invalidate because project dcbace3a353348e6928a0ddf2cd955cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:45:10.321514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a5fb4ec7-aa9f-4113-b08e-4436357a23be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:10.324462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a5fb4ec7-aa9f-4113-b08e-4436357a23be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:10.333440 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3892/7680] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:45:09 2022] DELETE /identity/v3/projects/dcbace3a353348e6928a0ddf2cd955cb => generated 0 bytes in 700 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:45:10.339071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09126d-5cbc-4fbd-8152-18a45dc65e01 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:10.340216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09126d-5cbc-4fbd-8152-18a45dc65e01 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:10.340734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09126d-5cbc-4fbd-8152-18a45dc65e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:10.403749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7c09126d-5cbc-4fbd-8152-18a45dc65e01 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:45:10.405410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7c09126d-5cbc-4fbd-8152-18a45dc65e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:10.608368 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3789/7681] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:45:10.615922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863fc5d-b003-418f-a01d-a2c38d2c1ce9 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:10.616219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863fc5d-b003-418f-a01d-a2c38d2c1ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:10.616504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e863fc5d-b003-418f-a01d-a2c38d2c1ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:10.676654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e863fc5d-b003-418f-a01d-a2c38d2c1ce9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:45:10.680631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e863fc5d-b003-418f-a01d-a2c38d2c1ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:10.700683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09126d-5cbc-4fbd-8152-18a45dc65e01 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:10.708862 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3893/7682] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:45:10.716146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09126d-5cbc-4fbd-8152-18a45dc65e01 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:10.721964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a67a5-d15b-4cf1-aff3-b45dd2d3bc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:10.722938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a67a5-d15b-4cf1-aff3-b45dd2d3bc2f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:10.723393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a67a5-d15b-4cf1-aff3-b45dd2d3bc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:10.726582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a67a5-d15b-4cf1-aff3-b45dd2d3bc2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:10.726582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a67a5-d15b-4cf1-aff3-b45dd2d3bc2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:45:10.726582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a67a5-d15b-4cf1-aff3-b45dd2d3bc2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:10.728286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a67a5-d15b-4cf1-aff3-b45dd2d3bc2f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:10.753819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863fc5d-b003-418f-a01d-a2c38d2c1ce9 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:10.765445 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3790/7683] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:45:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:45:10.768100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e863fc5d-b003-418f-a01d-a2c38d2c1ce9 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:10.785981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0180b-b88c-423d-88dd-368e8c484489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:10.787502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0180b-b88c-423d-88dd-368e8c484489 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:10.788374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0180b-b88c-423d-88dd-368e8c484489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:10.789134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0180b-b88c-423d-88dd-368e8c484489 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:10.790048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0180b-b88c-423d-88dd-368e8c484489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:10.792239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0180b-b88c-423d-88dd-368e8c484489 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:10.940500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a67a5-d15b-4cf1-aff3-b45dd2d3bc2f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:10.951605 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3894/7684] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:45:10 2022] POST /identity/v3/projects => generated 383 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:45:10.969227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a67a5-d15b-4cf1-aff3-b45dd2d3bc2f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:11.042714 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:45:11.140128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eaa92b-3cbd-4ec4-a4a2-633d86efe70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:11.140858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eaa92b-3cbd-4ec4-a4a2-633d86efe70e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:11.141154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eaa92b-3cbd-4ec4-a4a2-633d86efe70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:11.141511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4eaa92b-3cbd-4ec4-a4a2-633d86efe70e admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:11.142681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eaa92b-3cbd-4ec4-a4a2-633d86efe70e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:11.152679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4eaa92b-3cbd-4ec4-a4a2-633d86efe70e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:11.277270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0180b-b88c-423d-88dd-368e8c484489 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:11.285281 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3791/7685] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:45:10 2022] POST /identity/v3/users => generated 292 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:45:11.291842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0180b-b88c-423d-88dd-368e8c484489 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:11.310077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15a3db-cf37-49cd-896f-99985dc8d11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:11.310077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15a3db-cf37-49cd-896f-99985dc8d11f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:11.310077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15a3db-cf37-49cd-896f-99985dc8d11f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:11.310077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15a3db-cf37-49cd-896f-99985dc8d11f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:11.310666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15a3db-cf37-49cd-896f-99985dc8d11f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:11.313989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15a3db-cf37-49cd-896f-99985dc8d11f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:11.350035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eaa92b-3cbd-4ec4-a4a2-633d86efe70e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:11.361248 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3895/7686] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:45:11.365651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4eaa92b-3cbd-4ec4-a4a2-633d86efe70e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:11.379941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43100947-8e2e-47f2-8c50-600ffbe7dbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:11.380888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43100947-8e2e-47f2-8c50-600ffbe7dbba admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:11.381214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43100947-8e2e-47f2-8c50-600ffbe7dbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:11.381506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43100947-8e2e-47f2-8c50-600ffbe7dbba admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:11.382292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43100947-8e2e-47f2-8c50-600ffbe7dbba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:11.387545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43100947-8e2e-47f2-8c50-600ffbe7dbba admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:11.426581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15a3db-cf37-49cd-896f-99985dc8d11f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:11.435133 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3792/7687] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:45:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:45:11.455818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15a3db-cf37-49cd-896f-99985dc8d11f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:11.466081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404658d2-d539-4f73-ab27-d480f4ed533f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:11.472097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404658d2-d539-4f73-ab27-d480f4ed533f admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:11.473041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404658d2-d539-4f73-ab27-d480f4ed533f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:11.474347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404658d2-d539-4f73-ab27-d480f4ed533f admin admin] PATH_INFO: `/v3/projects/d6509c96ffd3493b9105e8481a93bfa2/users/a4e2852dc4dd4353987ba4a7068373f9/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:11.546597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404658d2-d539-4f73-ab27-d480f4ed533f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6509c96ffd3493b9105e8481a93bfa2, user_id=a4e2852dc4dd4353987ba4a7068373f9, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:11.552355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404658d2-d539-4f73-ab27-d480f4ed533f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:11.681582 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3896/7688] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:45:11 2022] PUT /identity/v3/projects/d6509c96ffd3493b9105e8481a93bfa2/users/a4e2852dc4dd4353987ba4a7068373f9/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:45:11.694651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61323131-4790-4ae9-ac55-e195214eb4a2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:11.694940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61323131-4790-4ae9-ac55-e195214eb4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:11.695225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61323131-4790-4ae9-ac55-e195214eb4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:11.769019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-61323131-4790-4ae9-ac55-e195214eb4a2 None None] MFA Rules not processed for user `a4e2852dc4dd4353987ba4a7068373f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:45:11.771629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-61323131-4790-4ae9-ac55-e195214eb4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:11.924752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404658d2-d539-4f73-ab27-d480f4ed533f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:11.934004 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3793/7689] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:45:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:45:12.088756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404658d2-d539-4f73-ab27-d480f4ed533f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:12.108284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c4a3e-49f0-4dbd-9e26-d028882b032d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:12.109059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c4a3e-49f0-4dbd-9e26-d028882b032d admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:12.109416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c4a3e-49f0-4dbd-9e26-d028882b032d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:12.109762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c4a3e-49f0-4dbd-9e26-d028882b032d admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:12.111601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c4a3e-49f0-4dbd-9e26-d028882b032d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:12.118658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c4a3e-49f0-4dbd-9e26-d028882b032d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:12.252409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61323131-4790-4ae9-ac55-e195214eb4a2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:12.254847 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3897/7690] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:45:11 2022] POST /identity/v3/projects => generated 383 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:45:12.272308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61323131-4790-4ae9-ac55-e195214eb4a2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:12.447480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085965a-9c3a-4089-892d-2675b05b3f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:12.450259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085965a-9c3a-4089-892d-2675b05b3f2f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:12.450565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085965a-9c3a-4089-892d-2675b05b3f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:12.450853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085965a-9c3a-4089-892d-2675b05b3f2f admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:12.451578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085965a-9c3a-4089-892d-2675b05b3f2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:12.465014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085965a-9c3a-4089-892d-2675b05b3f2f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:12.579604 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3794/7691] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:45:12 2022] POST /identity/v3/users => generated 298 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:45:12.581058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c4a3e-49f0-4dbd-9e26-d028882b032d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:12.611058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c4a3e-49f0-4dbd-9e26-d028882b032d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:12.627485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ef5d0-5ac7-43be-b9cb-b4ce28d372a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:12.628279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ef5d0-5ac7-43be-b9cb-b4ce28d372a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:12.628811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ef5d0-5ac7-43be-b9cb-b4ce28d372a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:12.629283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289ef5d0-5ac7-43be-b9cb-b4ce28d372a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:12.633317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ef5d0-5ac7-43be-b9cb-b4ce28d372a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:12.641385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289ef5d0-5ac7-43be-b9cb-b4ce28d372a6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:12.667408 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3898/7692] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:45:12.671348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085965a-9c3a-4089-892d-2675b05b3f2f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:12.691466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085965a-9c3a-4089-892d-2675b05b3f2f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:12.730763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43abfc-1284-45bc-9e64-15a13e6cf4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:12.732360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43abfc-1284-45bc-9e64-15a13e6cf4cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:12.733087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43abfc-1284-45bc-9e64-15a13e6cf4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:12.733563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43abfc-1284-45bc-9e64-15a13e6cf4cc admin admin] PATH_INFO: `/v3/projects/8a9e289eb84c41018ff8aa3f15835fc5/users/5437e39b3ca7496f9c66a7a5d7ba66ff/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:12.795229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43abfc-1284-45bc-9e64-15a13e6cf4cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9e289eb84c41018ff8aa3f15835fc5, user_id=5437e39b3ca7496f9c66a7a5d7ba66ff, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:12.799554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43abfc-1284-45bc-9e64-15a13e6cf4cc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:12.925420 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3795/7693] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:45:12 2022] PUT /identity/v3/projects/8a9e289eb84c41018ff8aa3f15835fc5/users/5437e39b3ca7496f9c66a7a5d7ba66ff/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:45:12.929314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ef5d0-5ac7-43be-b9cb-b4ce28d372a6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:12.946153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289ef5d0-5ac7-43be-b9cb-b4ce28d372a6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:12.998464 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:45:13.101217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d195a8b-0042-49dd-90f2-8045d84a7efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:13.102135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d195a8b-0042-49dd-90f2-8045d84a7efb admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:13.102540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d195a8b-0042-49dd-90f2-8045d84a7efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:13.102945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d195a8b-0042-49dd-90f2-8045d84a7efb admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:13.103863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d195a8b-0042-49dd-90f2-8045d84a7efb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:13.105684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d195a8b-0042-49dd-90f2-8045d84a7efb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:13.156451 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3899/7694] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:45:12 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:45:13.158397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43abfc-1284-45bc-9e64-15a13e6cf4cc admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:13.164785 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:45:13.172850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43abfc-1284-45bc-9e64-15a13e6cf4cc admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:13.184424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82736edc-3dea-4cb2-987b-66cc48a4e0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:13.190037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82736edc-3dea-4cb2-987b-66cc48a4e0fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:13.190372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82736edc-3dea-4cb2-987b-66cc48a4e0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:13.190660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82736edc-3dea-4cb2-987b-66cc48a4e0fb admin admin] PATH_INFO: `/v3/projects/8a9e289eb84c41018ff8aa3f15835fc5/users/5437e39b3ca7496f9c66a7a5d7ba66ff/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:13.197544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82736edc-3dea-4cb2-987b-66cc48a4e0fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a9e289eb84c41018ff8aa3f15835fc5, user_id=5437e39b3ca7496f9c66a7a5d7ba66ff, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:13.199561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82736edc-3dea-4cb2-987b-66cc48a4e0fb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:13.229593 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3796/7695] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:45:13 2022] PUT /identity/v3/projects/8a9e289eb84c41018ff8aa3f15835fc5/users/5437e39b3ca7496f9c66a7a5d7ba66ff/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:45:13.237210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e0e06-6a30-42df-b48a-5bd6fbd3256a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:13.237210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e0e06-6a30-42df-b48a-5bd6fbd3256a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:13.237210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e0e06-6a30-42df-b48a-5bd6fbd3256a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:13.311986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ad2e0e06-6a30-42df-b48a-5bd6fbd3256a None None] MFA Rules not processed for user `5437e39b3ca7496f9c66a7a5d7ba66ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:45:13.316845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ad2e0e06-6a30-42df-b48a-5bd6fbd3256a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:13.526547 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3900/7696] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:45:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:45:13.541947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82736edc-3dea-4cb2-987b-66cc48a4e0fb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:13.541947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-82736edc-3dea-4cb2-987b-66cc48a4e0fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:13.687969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82736edc-3dea-4cb2-987b-66cc48a4e0fb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:13.696824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aca1e5-7317-4094-ad82-97073cd0a9f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:13.697534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aca1e5-7317-4094-ad82-97073cd0a9f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:13.697815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aca1e5-7317-4094-ad82-97073cd0a9f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:13.698130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aca1e5-7317-4094-ad82-97073cd0a9f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:13.740392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aca1e5-7317-4094-ad82-97073cd0a9f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:13.746052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aca1e5-7317-4094-ad82-97073cd0a9f4 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:13.783799 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3797/7697] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:45:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:45:14.292428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e0e06-6a30-42df-b48a-5bd6fbd3256a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:14.293220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ad2e0e06-6a30-42df-b48a-5bd6fbd3256a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:14.327832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e0e06-6a30-42df-b48a-5bd6fbd3256a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:14.346857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700da466-4d3a-434a-b42f-398cbf8fa91e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:14.347547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700da466-4d3a-434a-b42f-398cbf8fa91e service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:14.348091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700da466-4d3a-434a-b42f-398cbf8fa91e service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:14.348389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700da466-4d3a-434a-b42f-398cbf8fa91e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:14.480488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700da466-4d3a-434a-b42f-398cbf8fa91e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:14.481996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700da466-4d3a-434a-b42f-398cbf8fa91e service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:14.512926 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3901/7698] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:45:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:45:15.596242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aca1e5-7317-4094-ad82-97073cd0a9f4 service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:15.802557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aca1e5-7317-4094-ad82-97073cd0a9f4 service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:15.819469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae30d02-c524-457f-80a7-94a007b52a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:15.822736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae30d02-c524-457f-80a7-94a007b52a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:15.823656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae30d02-c524-457f-80a7-94a007b52a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:15.829564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae30d02-c524-457f-80a7-94a007b52a91 admin admin] PATH_INFO: `/v3/users/a4e2852dc4dd4353987ba4a7068373f9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:15.833692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae30d02-c524-457f-80a7-94a007b52a91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4e2852dc4dd4353987ba4a7068373f9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:15.841194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae30d02-c524-457f-80a7-94a007b52a91 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:16.196699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cae30d02-c524-457f-80a7-94a007b52a91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4e2852dc4dd4353987ba4a7068373f9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:16.230378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cae30d02-c524-457f-80a7-94a007b52a91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4e2852dc4dd4353987ba4a7068373f9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:16.231179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cae30d02-c524-457f-80a7-94a007b52a91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4e2852dc4dd4353987ba4a7068373f9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:16.231992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cae30d02-c524-457f-80a7-94a007b52a91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4e2852dc4dd4353987ba4a7068373f9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:16.247035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cae30d02-c524-457f-80a7-94a007b52a91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4e2852dc4dd4353987ba4a7068373f9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:17.446326 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3798/7699] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:45:15 2022] DELETE /identity/v3/users/a4e2852dc4dd4353987ba4a7068373f9 => generated 0 bytes in 1851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:45:17.452454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d405e-ae7e-44cc-90cc-53ce442e2018 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:17.452454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d405e-ae7e-44cc-90cc-53ce442e2018 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:17.452454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125d405e-ae7e-44cc-90cc-53ce442e2018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:17.477914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-125d405e-ae7e-44cc-90cc-53ce442e2018 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:45:17.479730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-125d405e-ae7e-44cc-90cc-53ce442e2018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:17.569045 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:45:17.614657 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3902/7700] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:45:17.633015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae30d02-c524-457f-80a7-94a007b52a91 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:17.634595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cae30d02-c524-457f-80a7-94a007b52a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:17.697607 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:45:17.814128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae30d02-c524-457f-80a7-94a007b52a91 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:17.817810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29584db4-44f0-4067-be2c-21519bc153e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:17.818853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29584db4-44f0-4067-be2c-21519bc153e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:17.819395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29584db4-44f0-4067-be2c-21519bc153e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:17.819913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29584db4-44f0-4067-be2c-21519bc153e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:17.832499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29584db4-44f0-4067-be2c-21519bc153e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:17.834542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29584db4-44f0-4067-be2c-21519bc153e6 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:17.903564 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3799/7701] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:45:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:45:19.152827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d405e-ae7e-44cc-90cc-53ce442e2018 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:19.153511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-125d405e-ae7e-44cc-90cc-53ce442e2018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:19.184661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125d405e-ae7e-44cc-90cc-53ce442e2018 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:19.203273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef7769-135a-4a8c-8345-f9929d78967e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:19.209813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef7769-135a-4a8c-8345-f9929d78967e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:19.210544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef7769-135a-4a8c-8345-f9929d78967e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:19.212605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef7769-135a-4a8c-8345-f9929d78967e admin admin] PATH_INFO: `/v3/projects/d6509c96ffd3493b9105e8481a93bfa2` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:19.216557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef7769-135a-4a8c-8345-f9929d78967e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6509c96ffd3493b9105e8481a93bfa2)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:19.234545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ef7769-135a-4a8c-8345-f9929d78967e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:19.449709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c3ef7769-135a-4a8c-8345-f9929d78967e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6509c96ffd3493b9105e8481a93bfa2', 'request_id': 'req-c3ef7769-135a-4a8c-8345-f9929d78967e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:19.484887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c3ef7769-135a-4a8c-8345-f9929d78967e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6509c96ffd3493b9105e8481a93bfa2', 'request_id': 'req-c3ef7769-135a-4a8c-8345-f9929d78967e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:19.518977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c3ef7769-135a-4a8c-8345-f9929d78967e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6509c96ffd3493b9105e8481a93bfa2', 'request_id': 'req-c3ef7769-135a-4a8c-8345-f9929d78967e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:19.635302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c3ef7769-135a-4a8c-8345-f9929d78967e admin admin] The token cache is being invalidate because project d6509c96ffd3493b9105e8481a93bfa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:45:19.639915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c3ef7769-135a-4a8c-8345-f9929d78967e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:19.639915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c3ef7769-135a-4a8c-8345-f9929d78967e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:19.639915 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3903/7702] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:45:19 2022] DELETE /identity/v3/projects/d6509c96ffd3493b9105e8481a93bfa2 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:45:19.643009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29584db4-44f0-4067-be2c-21519bc153e6 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:19.666727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29584db4-44f0-4067-be2c-21519bc153e6 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:19.841284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c7f47-b169-4cb7-8280-7071fe9bcad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:19.842752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c7f47-b169-4cb7-8280-7071fe9bcad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:19.843226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c7f47-b169-4cb7-8280-7071fe9bcad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:19.843690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c7f47-b169-4cb7-8280-7071fe9bcad1 admin admin] PATH_INFO: `/v3/users/5437e39b3ca7496f9c66a7a5d7ba66ff` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:19.851230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c7f47-b169-4cb7-8280-7071fe9bcad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5437e39b3ca7496f9c66a7a5d7ba66ff)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:19.855128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c7f47-b169-4cb7-8280-7071fe9bcad1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:20.272217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-377c7f47-b169-4cb7-8280-7071fe9bcad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5437e39b3ca7496f9c66a7a5d7ba66ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:20.322188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-377c7f47-b169-4cb7-8280-7071fe9bcad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5437e39b3ca7496f9c66a7a5d7ba66ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:20.330324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-377c7f47-b169-4cb7-8280-7071fe9bcad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5437e39b3ca7496f9c66a7a5d7ba66ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:20.330324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-377c7f47-b169-4cb7-8280-7071fe9bcad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5437e39b3ca7496f9c66a7a5d7ba66ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:20.341641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-377c7f47-b169-4cb7-8280-7071fe9bcad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5437e39b3ca7496f9c66a7a5d7ba66ff'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:20.482896 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3800/7703] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:45:19 2022] DELETE /identity/v3/users/5437e39b3ca7496f9c66a7a5d7ba66ff => generated 0 bytes in 840 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:45:22.034038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef7769-135a-4a8c-8345-f9929d78967e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:22.040772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c3ef7769-135a-4a8c-8345-f9929d78967e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:22.076856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef7769-135a-4a8c-8345-f9929d78967e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:22.360171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb3b07-e8ed-4ec5-8f99-f46079cb6c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:22.362403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb3b07-e8ed-4ec5-8f99-f46079cb6c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:22.362893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb3b07-e8ed-4ec5-8f99-f46079cb6c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:22.363248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb3b07-e8ed-4ec5-8f99-f46079cb6c90 admin admin] PATH_INFO: `/v3/projects/8a9e289eb84c41018ff8aa3f15835fc5` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:22.364746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb3b07-e8ed-4ec5-8f99-f46079cb6c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a9e289eb84c41018ff8aa3f15835fc5)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:22.366992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb3b07-e8ed-4ec5-8f99-f46079cb6c90 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:22.643126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-94bb3b07-e8ed-4ec5-8f99-f46079cb6c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a9e289eb84c41018ff8aa3f15835fc5', 'request_id': 'req-94bb3b07-e8ed-4ec5-8f99-f46079cb6c90'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:22.668734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-94bb3b07-e8ed-4ec5-8f99-f46079cb6c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a9e289eb84c41018ff8aa3f15835fc5', 'request_id': 'req-94bb3b07-e8ed-4ec5-8f99-f46079cb6c90'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:22.692578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-94bb3b07-e8ed-4ec5-8f99-f46079cb6c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a9e289eb84c41018ff8aa3f15835fc5', 'request_id': 'req-94bb3b07-e8ed-4ec5-8f99-f46079cb6c90'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:22.800517 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:45:22.807589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-94bb3b07-e8ed-4ec5-8f99-f46079cb6c90 admin admin] The token cache is being invalidate because project 8a9e289eb84c41018ff8aa3f15835fc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:45:22.807940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-94bb3b07-e8ed-4ec5-8f99-f46079cb6c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:22.808833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-94bb3b07-e8ed-4ec5-8f99-f46079cb6c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:22.818361 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3904/7704] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:45:22 2022] DELETE /identity/v3/projects/8a9e289eb84c41018ff8aa3f15835fc5 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:45:22.818586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ac7e0-3905-40ad-ab93-cbdca8165ea1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:22.819070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ac7e0-3905-40ad-ab93-cbdca8165ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:22.819070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ac7e0-3905-40ad-ab93-cbdca8165ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:22.867956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-cd7ac7e0-3905-40ad-ab93-cbdca8165ea1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:45:22.869213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cd7ac7e0-3905-40ad-ab93-cbdca8165ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:22.926133 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:45:22.974264 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3801/7705] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:45:22.983401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926af086-4291-49ce-8ec6-6e9c4ac5a241 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:22.983747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926af086-4291-49ce-8ec6-6e9c4ac5a241 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:22.984036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926af086-4291-49ce-8ec6-6e9c4ac5a241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:23.007784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-926af086-4291-49ce-8ec6-6e9c4ac5a241 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:45:23.009496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-926af086-4291-49ce-8ec6-6e9c4ac5a241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:23.023714 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3905/7706] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:45:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:45:23.024469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ac7e0-3905-40ad-ab93-cbdca8165ea1 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:23.046061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ac7e0-3905-40ad-ab93-cbdca8165ea1 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:23.058489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ddd1c-b123-4a1b-944b-88099dab647d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:23.059780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ddd1c-b123-4a1b-944b-88099dab647d admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:23.060308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ddd1c-b123-4a1b-944b-88099dab647d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:23.060836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ddd1c-b123-4a1b-944b-88099dab647d admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:23.062252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ddd1c-b123-4a1b-944b-88099dab647d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:45:23.062785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ddd1c-b123-4a1b-944b-88099dab647d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:23.075086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ddd1c-b123-4a1b-944b-88099dab647d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:23.129344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926af086-4291-49ce-8ec6-6e9c4ac5a241 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:23.136316 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3802/7707] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:45:23.143637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926af086-4291-49ce-8ec6-6e9c4ac5a241 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:23.158266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1483bf0-29e8-42a7-8dcb-6d78f7e33d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:23.158824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1483bf0-29e8-42a7-8dcb-6d78f7e33d22 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:23.159568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1483bf0-29e8-42a7-8dcb-6d78f7e33d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:23.160021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1483bf0-29e8-42a7-8dcb-6d78f7e33d22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:23.161544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1483bf0-29e8-42a7-8dcb-6d78f7e33d22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:23.164122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1483bf0-29e8-42a7-8dcb-6d78f7e33d22 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:23.304918 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3906/7708] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:45:23 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:45:23.305963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ddd1c-b123-4a1b-944b-88099dab647d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:23.319382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ddd1c-b123-4a1b-944b-88099dab647d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:23.434308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55450db5-105d-4b0c-a8fc-f339b5ec9227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:23.435263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55450db5-105d-4b0c-a8fc-f339b5ec9227 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:23.435740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55450db5-105d-4b0c-a8fc-f339b5ec9227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:23.436192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55450db5-105d-4b0c-a8fc-f339b5ec9227 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:23.437079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55450db5-105d-4b0c-a8fc-f339b5ec9227 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:23.440245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55450db5-105d-4b0c-a8fc-f339b5ec9227 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:23.574949 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3803/7709] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:45:23 2022] POST /identity/v3/users => generated 287 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:45:23.580870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1483bf0-29e8-42a7-8dcb-6d78f7e33d22 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:23.612224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1483bf0-29e8-42a7-8dcb-6d78f7e33d22 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:23.629496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c30b31-56a1-411e-bf4a-16d7915cc2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:23.637833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c30b31-56a1-411e-bf4a-16d7915cc2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:23.637833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c30b31-56a1-411e-bf4a-16d7915cc2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:23.637833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c30b31-56a1-411e-bf4a-16d7915cc2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:23.637833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c30b31-56a1-411e-bf4a-16d7915cc2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:23.637833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c30b31-56a1-411e-bf4a-16d7915cc2b9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:23.669959 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3907/7710] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:45:23.676406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55450db5-105d-4b0c-a8fc-f339b5ec9227 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:23.690135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55450db5-105d-4b0c-a8fc-f339b5ec9227 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:23.711767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad044a-7ac2-4d13-8484-861de4027ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:23.713474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad044a-7ac2-4d13-8484-861de4027ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:23.713933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad044a-7ac2-4d13-8484-861de4027ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:23.714692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad044a-7ac2-4d13-8484-861de4027ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:23.717541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad044a-7ac2-4d13-8484-861de4027ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:23.721241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad044a-7ac2-4d13-8484-861de4027ed5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:23.749384 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3804/7711] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:45:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:45:23.756991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c30b31-56a1-411e-bf4a-16d7915cc2b9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:23.770876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c30b31-56a1-411e-bf4a-16d7915cc2b9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:23.795332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c4867-58ab-419a-a8a6-f6d5ff34f28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:23.797586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c4867-58ab-419a-a8a6-f6d5ff34f28b admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:23.797876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c4867-58ab-419a-a8a6-f6d5ff34f28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:23.798250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c4867-58ab-419a-a8a6-f6d5ff34f28b admin admin] PATH_INFO: `/v3/projects/1d2bd58113e546f79d6f4cf82dcc639e/users/1641d627b94b425fa89ed5b5f5b5df0c/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:23.856005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c4867-58ab-419a-a8a6-f6d5ff34f28b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d2bd58113e546f79d6f4cf82dcc639e, user_id=1641d627b94b425fa89ed5b5f5b5df0c, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:23.858618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1c4867-58ab-419a-a8a6-f6d5ff34f28b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:24.049869 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3908/7712] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:45:23 2022] PUT /identity/v3/projects/1d2bd58113e546f79d6f4cf82dcc639e/users/1641d627b94b425fa89ed5b5f5b5df0c/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:45:24.059897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6219d66-b045-4a4a-a564-f41fcd84db73 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:24.060444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6219d66-b045-4a4a-a564-f41fcd84db73 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:24.060876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6219d66-b045-4a4a-a564-f41fcd84db73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:24.132375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c6219d66-b045-4a4a-a564-f41fcd84db73 None None] MFA Rules not processed for user `1641d627b94b425fa89ed5b5f5b5df0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:45:24.134307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c6219d66-b045-4a4a-a564-f41fcd84db73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:24.310416 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3805/7713] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:45:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:45:24.401149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c4867-58ab-419a-a8a6-f6d5ff34f28b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:24.403179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ad1c4867-58ab-419a-a8a6-f6d5ff34f28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:24.589273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c4867-58ab-419a-a8a6-f6d5ff34f28b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:24.603563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d171d0-7258-4264-8bfc-e850dca23a38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:24.605336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d171d0-7258-4264-8bfc-e850dca23a38 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:24.606947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d171d0-7258-4264-8bfc-e850dca23a38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:24.608187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d171d0-7258-4264-8bfc-e850dca23a38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:24.638551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d171d0-7258-4264-8bfc-e850dca23a38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:24.640429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d171d0-7258-4264-8bfc-e850dca23a38 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:24.671973 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3909/7714] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:45:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:45:34.654553 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:45:34.797958 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:45:40.061939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6219d66-b045-4a4a-a564-f41fcd84db73 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:40.259282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6219d66-b045-4a4a-a564-f41fcd84db73 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:40.279657 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e74a2-d5d9-4e82-8b7f-02a1690a7200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:40.283070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e74a2-d5d9-4e82-8b7f-02a1690a7200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:40.286590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e74a2-d5d9-4e82-8b7f-02a1690a7200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:40.287091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e74a2-d5d9-4e82-8b7f-02a1690a7200 admin admin] PATH_INFO: `/v3/users/1641d627b94b425fa89ed5b5f5b5df0c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:40.290426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e74a2-d5d9-4e82-8b7f-02a1690a7200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1641d627b94b425fa89ed5b5f5b5df0c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:40.300648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e74a2-d5d9-4e82-8b7f-02a1690a7200 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:40.590628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1d1e74a2-d5d9-4e82-8b7f-02a1690a7200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1641d627b94b425fa89ed5b5f5b5df0c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:40.640131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1d1e74a2-d5d9-4e82-8b7f-02a1690a7200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1641d627b94b425fa89ed5b5f5b5df0c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:40.640903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1d1e74a2-d5d9-4e82-8b7f-02a1690a7200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1641d627b94b425fa89ed5b5f5b5df0c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:40.641589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1d1e74a2-d5d9-4e82-8b7f-02a1690a7200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1641d627b94b425fa89ed5b5f5b5df0c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:40.660853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1d1e74a2-d5d9-4e82-8b7f-02a1690a7200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1641d627b94b425fa89ed5b5f5b5df0c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:40.740934 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3806/7715] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:45:40 2022] DELETE /identity/v3/users/1641d627b94b425fa89ed5b5f5b5df0c => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:45:40.745445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4714a1-659b-4883-b4fd-aaab4d3317a3 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:40.746354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4714a1-659b-4883-b4fd-aaab4d3317a3 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:40.746818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4714a1-659b-4883-b4fd-aaab4d3317a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:40.794493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ee4714a1-659b-4883-b4fd-aaab4d3317a3 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:45:40.802887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ee4714a1-659b-4883-b4fd-aaab4d3317a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:40.959667 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3910/7716] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:45:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:45:40.971201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e74a2-d5d9-4e82-8b7f-02a1690a7200 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:40.972766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1d1e74a2-d5d9-4e82-8b7f-02a1690a7200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:41.202938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e74a2-d5d9-4e82-8b7f-02a1690a7200 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:41.211940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc354c-7e07-4f5b-8d5a-4b4a5f2f97cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:41.216065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc354c-7e07-4f5b-8d5a-4b4a5f2f97cb service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:41.220355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc354c-7e07-4f5b-8d5a-4b4a5f2f97cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:41.222136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc354c-7e07-4f5b-8d5a-4b4a5f2f97cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:41.238864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc354c-7e07-4f5b-8d5a-4b4a5f2f97cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:41.242208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc354c-7e07-4f5b-8d5a-4b4a5f2f97cb service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:41.271337 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3807/7717] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:45:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:45:43.383801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4714a1-659b-4883-b4fd-aaab4d3317a3 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:43.385708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ee4714a1-659b-4883-b4fd-aaab4d3317a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:43.443718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4714a1-659b-4883-b4fd-aaab4d3317a3 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:43.476088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f60387-0626-440f-91b7-dcadfa9c0d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:43.477221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f60387-0626-440f-91b7-dcadfa9c0d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:43.478431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f60387-0626-440f-91b7-dcadfa9c0d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:43.486965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f60387-0626-440f-91b7-dcadfa9c0d6d admin admin] PATH_INFO: `/v3/projects/1d2bd58113e546f79d6f4cf82dcc639e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:43.489679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f60387-0626-440f-91b7-dcadfa9c0d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d2bd58113e546f79d6f4cf82dcc639e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:43.491961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f60387-0626-440f-91b7-dcadfa9c0d6d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:43.710577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f5f60387-0626-440f-91b7-dcadfa9c0d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d2bd58113e546f79d6f4cf82dcc639e', 'request_id': 'req-f5f60387-0626-440f-91b7-dcadfa9c0d6d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:43.732119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f5f60387-0626-440f-91b7-dcadfa9c0d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d2bd58113e546f79d6f4cf82dcc639e', 'request_id': 'req-f5f60387-0626-440f-91b7-dcadfa9c0d6d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:43.753125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f5f60387-0626-440f-91b7-dcadfa9c0d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d2bd58113e546f79d6f4cf82dcc639e', 'request_id': 'req-f5f60387-0626-440f-91b7-dcadfa9c0d6d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:43.878625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f5f60387-0626-440f-91b7-dcadfa9c0d6d admin admin] The token cache is being invalidate because project 1d2bd58113e546f79d6f4cf82dcc639e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:45:43.879067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f5f60387-0626-440f-91b7-dcadfa9c0d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:43.880184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f5f60387-0626-440f-91b7-dcadfa9c0d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:45:43.881592 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3911/7718] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:45:43 2022] DELETE /identity/v3/projects/1d2bd58113e546f79d6f4cf82dcc639e => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:45:43.888787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dc949-c16a-4974-8d2a-581371cef8c0 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:43.888787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dc949-c16a-4974-8d2a-581371cef8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:43.892926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78dc949-c16a-4974-8d2a-581371cef8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:43.923906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d78dc949-c16a-4974-8d2a-581371cef8c0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:45:43.925809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d78dc949-c16a-4974-8d2a-581371cef8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:43.960675 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:45:44.092665 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3808/7719] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:45:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:45:44.100978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35ced0-d8f2-41c1-932f-359e2fffeb85 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:44.101525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35ced0-d8f2-41c1-932f-359e2fffeb85 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:44.101977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35ced0-d8f2-41c1-932f-359e2fffeb85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:44.150456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-bd35ced0-d8f2-41c1-932f-359e2fffeb85 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:45:44.151981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bd35ced0-d8f2-41c1-932f-359e2fffeb85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:44.173883 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3912/7720] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:45:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:45:44.178229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dc949-c16a-4974-8d2a-581371cef8c0 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:44.197078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78dc949-c16a-4974-8d2a-581371cef8c0 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:44.216595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb1a49-b467-4fc8-892c-67c1603c6253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:44.217620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb1a49-b467-4fc8-892c-67c1603c6253 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:44.218074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb1a49-b467-4fc8-892c-67c1603c6253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:44.220316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb1a49-b467-4fc8-892c-67c1603c6253 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:44.223857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb1a49-b467-4fc8-892c-67c1603c6253 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:45:44.224454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb1a49-b467-4fc8-892c-67c1603c6253 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:44.226383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb1a49-b467-4fc8-892c-67c1603c6253 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:44.268170 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3809/7721] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:45:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:45:44.273795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35ced0-d8f2-41c1-932f-359e2fffeb85 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:44.291968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35ced0-d8f2-41c1-932f-359e2fffeb85 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:44.300134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fb719-0086-430c-a368-45582b5a108c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:44.300978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fb719-0086-430c-a368-45582b5a108c admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:44.301345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fb719-0086-430c-a368-45582b5a108c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:44.301703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9fb719-0086-430c-a368-45582b5a108c admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:44.302590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fb719-0086-430c-a368-45582b5a108c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:44.304626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9fb719-0086-430c-a368-45582b5a108c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:44.477932 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3913/7722] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:45:44 2022] POST /identity/v3/projects => generated 385 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:45:44.482390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb1a49-b467-4fc8-892c-67c1603c6253 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:44.504104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb1a49-b467-4fc8-892c-67c1603c6253 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:44.677054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de4ade-f9af-44aa-bbbe-ec1d0ac6101c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:44.677914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de4ade-f9af-44aa-bbbe-ec1d0ac6101c admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:44.678335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de4ade-f9af-44aa-bbbe-ec1d0ac6101c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:44.678683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98de4ade-f9af-44aa-bbbe-ec1d0ac6101c admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:44.679482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de4ade-f9af-44aa-bbbe-ec1d0ac6101c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:44.681502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98de4ade-f9af-44aa-bbbe-ec1d0ac6101c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:44.811675 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3810/7723] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:45:44 2022] POST /identity/v3/users => generated 293 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:45:44.818382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fb719-0086-430c-a368-45582b5a108c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:44.842667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9fb719-0086-430c-a368-45582b5a108c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:44.873135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e64e2-1828-4866-8051-99c97897155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:44.873987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e64e2-1828-4866-8051-99c97897155f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:44.874589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e64e2-1828-4866-8051-99c97897155f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:44.875097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e64e2-1828-4866-8051-99c97897155f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:44.882440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e64e2-1828-4866-8051-99c97897155f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:44.891019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263e64e2-1828-4866-8051-99c97897155f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:44.952459 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3914/7724] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:45:44.957008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de4ade-f9af-44aa-bbbe-ec1d0ac6101c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:44.975101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98de4ade-f9af-44aa-bbbe-ec1d0ac6101c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:44.992943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300cd53-b18b-4f2d-a1a4-76cfb8c1b5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:44.993796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300cd53-b18b-4f2d-a1a4-76cfb8c1b5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:44.994233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300cd53-b18b-4f2d-a1a4-76cfb8c1b5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:44.995096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300cd53-b18b-4f2d-a1a4-76cfb8c1b5f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:45.010528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300cd53-b18b-4f2d-a1a4-76cfb8c1b5f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:45.010528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300cd53-b18b-4f2d-a1a4-76cfb8c1b5f3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:45.070591 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3811/7725] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:45:44 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:45:45.073768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e64e2-1828-4866-8051-99c97897155f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:45.091816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e64e2-1828-4866-8051-99c97897155f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:45.110873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c0ad0-1a75-4a5e-88e0-2ca6465faa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:45.133809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c0ad0-1a75-4a5e-88e0-2ca6465faa35 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:45.136684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c0ad0-1a75-4a5e-88e0-2ca6465faa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:45.137960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c0ad0-1a75-4a5e-88e0-2ca6465faa35 admin admin] PATH_INFO: `/v3/projects/e038cda4ddd84e24a176296dfa430245/users/443e665c74094946b7efc0ff03be93da/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:45.251677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c0ad0-1a75-4a5e-88e0-2ca6465faa35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e038cda4ddd84e24a176296dfa430245, user_id=443e665c74094946b7efc0ff03be93da, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:45.254714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c0ad0-1a75-4a5e-88e0-2ca6465faa35 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:45.392915 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3915/7726] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:45:45 2022] PUT /identity/v3/projects/e038cda4ddd84e24a176296dfa430245/users/443e665c74094946b7efc0ff03be93da/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:45:45.404704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11666c4d-0ef8-4fba-b806-7c8bc16f18a9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:45.405006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11666c4d-0ef8-4fba-b806-7c8bc16f18a9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:45.406270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11666c4d-0ef8-4fba-b806-7c8bc16f18a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:45.490234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-11666c4d-0ef8-4fba-b806-7c8bc16f18a9 None None] MFA Rules not processed for user `443e665c74094946b7efc0ff03be93da`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:45:45.498823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-11666c4d-0ef8-4fba-b806-7c8bc16f18a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:45.714281 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3812/7727] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:45:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:45:45.715436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c0ad0-1a75-4a5e-88e0-2ca6465faa35 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:45.757216 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:45:45.852639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c0ad0-1a75-4a5e-88e0-2ca6465faa35 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:45.862900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d200704-67f3-4884-a842-c285b9d12600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:45.864009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d200704-67f3-4884-a842-c285b9d12600 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:45.864517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d200704-67f3-4884-a842-c285b9d12600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:45.865036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d200704-67f3-4884-a842-c285b9d12600 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:45.865994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d200704-67f3-4884-a842-c285b9d12600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:45.868193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d200704-67f3-4884-a842-c285b9d12600 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:46.022066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11666c4d-0ef8-4fba-b806-7c8bc16f18a9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:46.022617 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3916/7728] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:45:45 2022] POST /identity/v3/projects => generated 383 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:45:46.040251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11666c4d-0ef8-4fba-b806-7c8bc16f18a9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:46.070592 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:45:46.203187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6592a7-5f92-4101-a055-c3cf5571fcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:46.204156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6592a7-5f92-4101-a055-c3cf5571fcde admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:46.207000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6592a7-5f92-4101-a055-c3cf5571fcde admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:46.207776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6592a7-5f92-4101-a055-c3cf5571fcde admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:46.208874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6592a7-5f92-4101-a055-c3cf5571fcde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:46.211137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6592a7-5f92-4101-a055-c3cf5571fcde admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:46.391079 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3813/7729] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:45:46 2022] POST /identity/v3/users => generated 292 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:45:46.394820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d200704-67f3-4884-a842-c285b9d12600 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:46.412828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d200704-67f3-4884-a842-c285b9d12600 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:46.428581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2abe55-62bb-48ad-a414-738380d9875c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:46.430903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2abe55-62bb-48ad-a414-738380d9875c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:46.430903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2abe55-62bb-48ad-a414-738380d9875c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:46.430903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2abe55-62bb-48ad-a414-738380d9875c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:46.434649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2abe55-62bb-48ad-a414-738380d9875c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:46.436304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2abe55-62bb-48ad-a414-738380d9875c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:46.473538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6592a7-5f92-4101-a055-c3cf5571fcde admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:46.482544 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3917/7730] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:45:46.509276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6592a7-5f92-4101-a055-c3cf5571fcde admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:46.526925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d1e44a-54ff-4797-959d-9e4a55f9ea68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:46.527910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1e44a-54ff-4797-959d-9e4a55f9ea68 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:46.528380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1e44a-54ff-4797-959d-9e4a55f9ea68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:46.528939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1e44a-54ff-4797-959d-9e4a55f9ea68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:46.529853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1e44a-54ff-4797-959d-9e4a55f9ea68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:46.536728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d1e44a-54ff-4797-959d-9e4a55f9ea68 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:46.559587 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3814/7731] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:45:46.564129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2abe55-62bb-48ad-a414-738380d9875c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:46.586902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2abe55-62bb-48ad-a414-738380d9875c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:46.592517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84859772-70e4-45d9-944f-f6bc7cc4f2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:46.593467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84859772-70e4-45d9-944f-f6bc7cc4f2bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:46.593792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84859772-70e4-45d9-944f-f6bc7cc4f2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:46.594044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84859772-70e4-45d9-944f-f6bc7cc4f2bd admin admin] PATH_INFO: `/v3/projects/b81af2ae0d824c108fe7f4f9905ac9a8/users/435ecb70188646bfae632e210d907d57/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:46.637227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84859772-70e4-45d9-944f-f6bc7cc4f2bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81af2ae0d824c108fe7f4f9905ac9a8, user_id=435ecb70188646bfae632e210d907d57, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:46.640298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84859772-70e4-45d9-944f-f6bc7cc4f2bd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:46.835741 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3918/7732] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:45:46 2022] PUT /identity/v3/projects/b81af2ae0d824c108fe7f4f9905ac9a8/users/435ecb70188646bfae632e210d907d57/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:45:46.845568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491a0b8-dfae-44d3-92cd-64a9d1311bee None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:46.845892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491a0b8-dfae-44d3-92cd-64a9d1311bee None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:46.846190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491a0b8-dfae-44d3-92cd-64a9d1311bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:46.920666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d491a0b8-dfae-44d3-92cd-64a9d1311bee None None] MFA Rules not processed for user `435ecb70188646bfae632e210d907d57`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:45:46.922079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d491a0b8-dfae-44d3-92cd-64a9d1311bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:47.104595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84859772-70e4-45d9-944f-f6bc7cc4f2bd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:47.105133 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3815/7733] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:45:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:45:47.287437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84859772-70e4-45d9-944f-f6bc7cc4f2bd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:47.310609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ae557-2c63-4f28-940c-ae0e29eca5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:47.311817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ae557-2c63-4f28-940c-ae0e29eca5f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:47.313315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ae557-2c63-4f28-940c-ae0e29eca5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:47.313771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ae557-2c63-4f28-940c-ae0e29eca5f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:47.314678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ae557-2c63-4f28-940c-ae0e29eca5f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:47.318488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ae557-2c63-4f28-940c-ae0e29eca5f1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:47.477019 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3919/7734] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:45:47 2022] POST /identity/v3/projects => generated 383 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:45:47.478452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491a0b8-dfae-44d3-92cd-64a9d1311bee None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:47.505748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491a0b8-dfae-44d3-92cd-64a9d1311bee None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:47.653767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda808e-8fc2-40af-a91c-33ba5052de50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:47.654490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda808e-8fc2-40af-a91c-33ba5052de50 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:47.654776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda808e-8fc2-40af-a91c-33ba5052de50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:47.655060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fda808e-8fc2-40af-a91c-33ba5052de50 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:47.655786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda808e-8fc2-40af-a91c-33ba5052de50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:47.658582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fda808e-8fc2-40af-a91c-33ba5052de50 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:47.822135 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3816/7735] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:45:47 2022] POST /identity/v3/users => generated 298 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:45:47.826171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ae557-2c63-4f28-940c-ae0e29eca5f1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:47.842679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ae557-2c63-4f28-940c-ae0e29eca5f1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:47.855991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ed439-b5a3-4ec6-9aea-a1f4f2676b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:47.859655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ed439-b5a3-4ec6-9aea-a1f4f2676b86 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:47.860790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ed439-b5a3-4ec6-9aea-a1f4f2676b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:47.861305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ed439-b5a3-4ec6-9aea-a1f4f2676b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:47.862473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ed439-b5a3-4ec6-9aea-a1f4f2676b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:47.867854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ed439-b5a3-4ec6-9aea-a1f4f2676b86 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:47.924748 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3920/7736] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:45:47 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:45:47.962322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda808e-8fc2-40af-a91c-33ba5052de50 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:47.989713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fda808e-8fc2-40af-a91c-33ba5052de50 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:48.026491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e49d0f-286e-4582-9ea0-944d02d09724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:48.027425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e49d0f-286e-4582-9ea0-944d02d09724 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:48.027765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e49d0f-286e-4582-9ea0-944d02d09724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:48.032654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e49d0f-286e-4582-9ea0-944d02d09724 admin admin] PATH_INFO: `/v3/projects/93f63aa367e44d289073f628fe43c4b6/users/1de593d8e65449f69723ff418583affd/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:48.055866 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:45:48.064968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e49d0f-286e-4582-9ea0-944d02d09724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f63aa367e44d289073f628fe43c4b6, user_id=1de593d8e65449f69723ff418583affd, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:48.069153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e49d0f-286e-4582-9ea0-944d02d09724 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:48.479215 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3817/7737] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:45:47 2022] PUT /identity/v3/projects/93f63aa367e44d289073f628fe43c4b6/users/1de593d8e65449f69723ff418583affd/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:45:48.483452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ed439-b5a3-4ec6-9aea-a1f4f2676b86 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:48.506816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ed439-b5a3-4ec6-9aea-a1f4f2676b86 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:48.622956 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:45:48.646556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b83b2-972d-42e4-a5dc-83c4b62b38d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:48.647672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b83b2-972d-42e4-a5dc-83c4b62b38d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:48.648369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b83b2-972d-42e4-a5dc-83c4b62b38d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:48.648685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b83b2-972d-42e4-a5dc-83c4b62b38d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:48.660712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b83b2-972d-42e4-a5dc-83c4b62b38d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:48.666334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b83b2-972d-42e4-a5dc-83c4b62b38d1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:48.697650 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3921/7738] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:45:48 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:45:48.702879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e49d0f-286e-4582-9ea0-944d02d09724 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:48.727027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e49d0f-286e-4582-9ea0-944d02d09724 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:48.768592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15d2bb-894a-4d4d-be50-87a44d5d170f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:48.771413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15d2bb-894a-4d4d-be50-87a44d5d170f admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:48.774540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15d2bb-894a-4d4d-be50-87a44d5d170f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:48.782536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15d2bb-894a-4d4d-be50-87a44d5d170f admin admin] PATH_INFO: `/v3/projects/93f63aa367e44d289073f628fe43c4b6/users/1de593d8e65449f69723ff418583affd/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:48.783217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15d2bb-894a-4d4d-be50-87a44d5d170f admin admin] RBAC: Authorizing `identity:create_grant(project_id=93f63aa367e44d289073f628fe43c4b6, user_id=1de593d8e65449f69723ff418583affd, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:48.786210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15d2bb-894a-4d4d-be50-87a44d5d170f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:48.816332 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3818/7739] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:45:48 2022] PUT /identity/v3/projects/93f63aa367e44d289073f628fe43c4b6/users/1de593d8e65449f69723ff418583affd/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:45:48.829487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0f168-b32c-41b4-ae60-5e7721382ae4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:48.830293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0f168-b32c-41b4-ae60-5e7721382ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:48.830864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0f168-b32c-41b4-ae60-5e7721382ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:48.933045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-64d0f168-b32c-41b4-ae60-5e7721382ae4 None None] MFA Rules not processed for user `1de593d8e65449f69723ff418583affd`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:45:48.935024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-64d0f168-b32c-41b4-ae60-5e7721382ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:49.108105 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3922/7740] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:45:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:45:49.125258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15d2bb-894a-4d4d-be50-87a44d5d170f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:49.127324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0e15d2bb-894a-4d4d-be50-87a44d5d170f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:45:49.254387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15d2bb-894a-4d4d-be50-87a44d5d170f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:49.259485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cd505-9fd0-4514-9a35-ed4c41369fbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:49.260936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cd505-9fd0-4514-9a35-ed4c41369fbd service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:49.261249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cd505-9fd0-4514-9a35-ed4c41369fbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:49.261666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2cd505-9fd0-4514-9a35-ed4c41369fbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:49.358967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2cd505-9fd0-4514-9a35-ed4c41369fbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:49.360816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2cd505-9fd0-4514-9a35-ed4c41369fbd service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:49.380524 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3819/7741] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:45:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:45:54.676240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0f168-b32c-41b4-ae60-5e7721382ae4 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:54.699431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0f168-b32c-41b4-ae60-5e7721382ae4 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:54.709957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66300d0c-75b1-4a21-b2b4-49b13bb00b75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:54.712665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66300d0c-75b1-4a21-b2b4-49b13bb00b75 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:54.714404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66300d0c-75b1-4a21-b2b4-49b13bb00b75 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:54.714404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66300d0c-75b1-4a21-b2b4-49b13bb00b75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:54.948895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66300d0c-75b1-4a21-b2b4-49b13bb00b75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:54.955804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66300d0c-75b1-4a21-b2b4-49b13bb00b75 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:54.971112 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3923/7742] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:45:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:45:57.729003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cd505-9fd0-4514-9a35-ed4c41369fbd service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:45:57.742086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2cd505-9fd0-4514-9a35-ed4c41369fbd service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:45:57.763221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad599e-020a-4374-a504-3d4eae143daf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:45:57.767040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad599e-020a-4374-a504-3d4eae143daf service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:45:57.770861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad599e-020a-4374-a504-3d4eae143daf service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:45:57.772270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad599e-020a-4374-a504-3d4eae143daf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:45:57.841138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad599e-020a-4374-a504-3d4eae143daf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:45:57.860548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad599e-020a-4374-a504-3d4eae143daf service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:45:57.966856 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3820/7743] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:45:57 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:46:04.962570 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=71 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:07.905257 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=62,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:12.936663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66300d0c-75b1-4a21-b2b4-49b13bb00b75 service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:12.940167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-66300d0c-75b1-4a21-b2b4-49b13bb00b75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:13.185202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66300d0c-75b1-4a21-b2b4-49b13bb00b75 service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:13.195544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad9e6f-0e3c-4f78-8529-640f0a987dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:13.196559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad9e6f-0e3c-4f78-8529-640f0a987dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:13.196951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad9e6f-0e3c-4f78-8529-640f0a987dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:13.197331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad9e6f-0e3c-4f78-8529-640f0a987dde admin admin] PATH_INFO: `/v3/users/8ac8b601e5cc4737acb6b9b8ab5b515f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:13.202519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad9e6f-0e3c-4f78-8529-640f0a987dde admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ac8b601e5cc4737acb6b9b8ab5b515f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:13.206464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad9e6f-0e3c-4f78-8529-640f0a987dde admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:13.417716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-04ad9e6f-0e3c-4f78-8529-640f0a987dde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ac8b601e5cc4737acb6b9b8ab5b515f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:13.449818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-04ad9e6f-0e3c-4f78-8529-640f0a987dde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ac8b601e5cc4737acb6b9b8ab5b515f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:13.481822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-04ad9e6f-0e3c-4f78-8529-640f0a987dde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ac8b601e5cc4737acb6b9b8ab5b515f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:13.481822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-04ad9e6f-0e3c-4f78-8529-640f0a987dde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ac8b601e5cc4737acb6b9b8ab5b515f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:13.550720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-04ad9e6f-0e3c-4f78-8529-640f0a987dde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ac8b601e5cc4737acb6b9b8ab5b515f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:13.559304 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3924/7744] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:46:12 2022] DELETE /identity/v3/users/8ac8b601e5cc4737acb6b9b8ab5b515f => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:46:15.278289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad599e-020a-4374-a504-3d4eae143daf service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:15.307366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad599e-020a-4374-a504-3d4eae143daf service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:15.437484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9e92d-90dd-4be2-9321-16d7474058a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:15.439039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9e92d-90dd-4be2-9321-16d7474058a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:15.439386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9e92d-90dd-4be2-9321-16d7474058a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:15.439606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9e92d-90dd-4be2-9321-16d7474058a4 admin admin] PATH_INFO: `/v3/projects/6d40b6e554ac436d81da31040276a530` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:15.440922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9e92d-90dd-4be2-9321-16d7474058a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d40b6e554ac436d81da31040276a530)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:15.443084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9e92d-90dd-4be2-9321-16d7474058a4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:15.675086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-abc9e92d-90dd-4be2-9321-16d7474058a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d40b6e554ac436d81da31040276a530', 'request_id': 'req-abc9e92d-90dd-4be2-9321-16d7474058a4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:15.768321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-abc9e92d-90dd-4be2-9321-16d7474058a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d40b6e554ac436d81da31040276a530', 'request_id': 'req-abc9e92d-90dd-4be2-9321-16d7474058a4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:15.775785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-abc9e92d-90dd-4be2-9321-16d7474058a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d40b6e554ac436d81da31040276a530', 'request_id': 'req-abc9e92d-90dd-4be2-9321-16d7474058a4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:15.804937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-abc9e92d-90dd-4be2-9321-16d7474058a4 admin admin] The token cache is being invalidate because project 6d40b6e554ac436d81da31040276a530 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:46:15.810742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-abc9e92d-90dd-4be2-9321-16d7474058a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:15.810742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-abc9e92d-90dd-4be2-9321-16d7474058a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:15.815635 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3821/7745] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:46:15 2022] DELETE /identity/v3/projects/6d40b6e554ac436d81da31040276a530 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:46:15.819547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad9e6f-0e3c-4f78-8529-640f0a987dde admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:15.821199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-04ad9e6f-0e3c-4f78-8529-640f0a987dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:15.863208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad9e6f-0e3c-4f78-8529-640f0a987dde admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:16.118844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d53ea-62e6-4d36-9699-82aee0eed854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:16.119778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d53ea-62e6-4d36-9699-82aee0eed854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:16.125393 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d53ea-62e6-4d36-9699-82aee0eed854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:16.128858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d53ea-62e6-4d36-9699-82aee0eed854 admin admin] PATH_INFO: `/v3/users/1d39bda49b7f4729ac192c974e2e036f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:16.132728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d53ea-62e6-4d36-9699-82aee0eed854 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d39bda49b7f4729ac192c974e2e036f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:16.141495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d53ea-62e6-4d36-9699-82aee0eed854 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:16.285532 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:16.467707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-899d53ea-62e6-4d36-9699-82aee0eed854 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d39bda49b7f4729ac192c974e2e036f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:16.518343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-899d53ea-62e6-4d36-9699-82aee0eed854 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d39bda49b7f4729ac192c974e2e036f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:16.544019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-899d53ea-62e6-4d36-9699-82aee0eed854 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d39bda49b7f4729ac192c974e2e036f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:16.548406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-899d53ea-62e6-4d36-9699-82aee0eed854 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d39bda49b7f4729ac192c974e2e036f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:16.648514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-899d53ea-62e6-4d36-9699-82aee0eed854 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d39bda49b7f4729ac192c974e2e036f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:16.659172 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3925/7746] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:46:15 2022] DELETE /identity/v3/users/1d39bda49b7f4729ac192c974e2e036f => generated 0 bytes in 837 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:46:18.002390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9e92d-90dd-4be2-9321-16d7474058a4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:18.004051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-abc9e92d-90dd-4be2-9321-16d7474058a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:18.040433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9e92d-90dd-4be2-9321-16d7474058a4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:18.359175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c43cc-83b0-4319-b29f-a6337f40ddd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:18.363095 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c43cc-83b0-4319-b29f-a6337f40ddd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:18.366013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c43cc-83b0-4319-b29f-a6337f40ddd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:18.368826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c43cc-83b0-4319-b29f-a6337f40ddd9 admin admin] PATH_INFO: `/v3/projects/87ecc2b854484a44ba7f1de4ed20a07b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:18.370974 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c43cc-83b0-4319-b29f-a6337f40ddd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87ecc2b854484a44ba7f1de4ed20a07b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:18.378152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c43cc-83b0-4319-b29f-a6337f40ddd9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:18.586505 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:18.622641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2c8c43cc-83b0-4319-b29f-a6337f40ddd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87ecc2b854484a44ba7f1de4ed20a07b', 'request_id': 'req-2c8c43cc-83b0-4319-b29f-a6337f40ddd9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:18.722562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2c8c43cc-83b0-4319-b29f-a6337f40ddd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87ecc2b854484a44ba7f1de4ed20a07b', 'request_id': 'req-2c8c43cc-83b0-4319-b29f-a6337f40ddd9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:18.730394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2c8c43cc-83b0-4319-b29f-a6337f40ddd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87ecc2b854484a44ba7f1de4ed20a07b', 'request_id': 'req-2c8c43cc-83b0-4319-b29f-a6337f40ddd9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:18.770169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2c8c43cc-83b0-4319-b29f-a6337f40ddd9 admin admin] The token cache is being invalidate because project 87ecc2b854484a44ba7f1de4ed20a07b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:46:18.770949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2c8c43cc-83b0-4319-b29f-a6337f40ddd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:18.773789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2c8c43cc-83b0-4319-b29f-a6337f40ddd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:18.782387 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3822/7747] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:46:18 2022] DELETE /identity/v3/projects/87ecc2b854484a44ba7f1de4ed20a07b => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:46:18.787712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59bb4e-3746-482c-89b7-64fdc95f3f1e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:18.788717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59bb4e-3746-482c-89b7-64fdc95f3f1e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:18.789578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff59bb4e-3746-482c-89b7-64fdc95f3f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:18.855030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ff59bb4e-3746-482c-89b7-64fdc95f3f1e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:46:18.857432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ff59bb4e-3746-482c-89b7-64fdc95f3f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:19.039989 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3926/7748] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:46:19.049220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad579324-2f3a-430a-9d5a-ff0dd515cb7d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:19.050417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad579324-2f3a-430a-9d5a-ff0dd515cb7d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:19.050888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad579324-2f3a-430a-9d5a-ff0dd515cb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:19.104561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ad579324-2f3a-430a-9d5a-ff0dd515cb7d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:46:19.105940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ad579324-2f3a-430a-9d5a-ff0dd515cb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:19.132583 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3823/7749] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:46:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:46:19.136951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59bb4e-3746-482c-89b7-64fdc95f3f1e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:19.158560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff59bb4e-3746-482c-89b7-64fdc95f3f1e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:19.195835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3ca37-6129-480d-80a1-128590e0283d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:19.196547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3ca37-6129-480d-80a1-128590e0283d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:19.196842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3ca37-6129-480d-80a1-128590e0283d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:19.197123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3ca37-6129-480d-80a1-128590e0283d admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:19.198087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3ca37-6129-480d-80a1-128590e0283d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:46:19.198428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3ca37-6129-480d-80a1-128590e0283d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:19.200546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3ca37-6129-480d-80a1-128590e0283d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:19.247344 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3927/7750] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:46:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:46:19.248645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad579324-2f3a-430a-9d5a-ff0dd515cb7d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:19.259759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad579324-2f3a-430a-9d5a-ff0dd515cb7d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:19.291829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a34393-1956-4e12-a354-fad04f83610f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:19.295727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a34393-1956-4e12-a354-fad04f83610f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:19.295727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a34393-1956-4e12-a354-fad04f83610f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:19.295727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a34393-1956-4e12-a354-fad04f83610f admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:19.295727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a34393-1956-4e12-a354-fad04f83610f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:19.307074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a34393-1956-4e12-a354-fad04f83610f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:19.397322 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3824/7751] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:46:19 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:46:19.401223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3ca37-6129-480d-80a1-128590e0283d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:19.420657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3ca37-6129-480d-80a1-128590e0283d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:19.755075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc0f0c-1b99-43ba-9720-395c17c820c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:19.755784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc0f0c-1b99-43ba-9720-395c17c820c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:19.756072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc0f0c-1b99-43ba-9720-395c17c820c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:19.764472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addc0f0c-1b99-43ba-9720-395c17c820c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:19.764472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc0f0c-1b99-43ba-9720-395c17c820c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:19.772930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addc0f0c-1b99-43ba-9720-395c17c820c5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:19.827664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a34393-1956-4e12-a354-fad04f83610f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:19.830744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-59a34393-1956-4e12-a354-fad04f83610f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:19.882576 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3928/7752] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:46:19 2022] POST /identity/v3/users => generated 292 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:46:19.884182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc0f0c-1b99-43ba-9720-395c17c820c5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:19.885161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a34393-1956-4e12-a354-fad04f83610f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:19.906304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a3071-32f5-4686-b922-fe0a22649539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:19.912460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addc0f0c-1b99-43ba-9720-395c17c820c5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:19.913001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a3071-32f5-4686-b922-fe0a22649539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:19.914580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a3071-32f5-4686-b922-fe0a22649539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:19.915090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a3071-32f5-4686-b922-fe0a22649539 admin admin] PATH_INFO: `/v3/users/443e665c74094946b7efc0ff03be93da` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:19.922405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a3071-32f5-4686-b922-fe0a22649539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=443e665c74094946b7efc0ff03be93da)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:19.923267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999232d9-4618-4b72-b357-8cb1d2afa52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:19.924003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999232d9-4618-4b72-b357-8cb1d2afa52c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:19.924183 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999232d9-4618-4b72-b357-8cb1d2afa52c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:19.924461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999232d9-4618-4b72-b357-8cb1d2afa52c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:19.925206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999232d9-4618-4b72-b357-8cb1d2afa52c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:19.926877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999232d9-4618-4b72-b357-8cb1d2afa52c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:19.932336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23a3071-32f5-4686-b922-fe0a22649539 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:19.988551 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3929/7753] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:46:19.989511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999232d9-4618-4b72-b357-8cb1d2afa52c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:20.030163 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:20.046082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999232d9-4618-4b72-b357-8cb1d2afa52c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:20.068069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf714e-43df-44ec-8442-2e03d038b4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:20.068812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf714e-43df-44ec-8442-2e03d038b4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:20.069105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf714e-43df-44ec-8442-2e03d038b4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:20.069388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf714e-43df-44ec-8442-2e03d038b4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:20.070190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf714e-43df-44ec-8442-2e03d038b4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:20.071791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf714e-43df-44ec-8442-2e03d038b4e4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:20.158899 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3930/7754] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:46:20.160349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf714e-43df-44ec-8442-2e03d038b4e4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:20.200752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c23a3071-32f5-4686-b922-fe0a22649539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '443e665c74094946b7efc0ff03be93da'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:20.229670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf714e-43df-44ec-8442-2e03d038b4e4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:20.244194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c23a3071-32f5-4686-b922-fe0a22649539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '443e665c74094946b7efc0ff03be93da'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:20.246600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c23a3071-32f5-4686-b922-fe0a22649539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '443e665c74094946b7efc0ff03be93da'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:20.247586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c23a3071-32f5-4686-b922-fe0a22649539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '443e665c74094946b7efc0ff03be93da'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:20.256865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536a12e-5c3e-4cc2-8fd1-620cb428cafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:20.258151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536a12e-5c3e-4cc2-8fd1-620cb428cafb admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:20.260155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536a12e-5c3e-4cc2-8fd1-620cb428cafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:20.260636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536a12e-5c3e-4cc2-8fd1-620cb428cafb admin admin] PATH_INFO: `/v3/projects/c3a64eb87e1f4ba59cce4f88f0a6689f/users/09278987e4f54cf9a6527b33bd60bff8/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:20.284564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c23a3071-32f5-4686-b922-fe0a22649539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '443e665c74094946b7efc0ff03be93da'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:20.302167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8536a12e-5c3e-4cc2-8fd1-620cb428cafb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3a64eb87e1f4ba59cce4f88f0a6689f, user_id=09278987e4f54cf9a6527b33bd60bff8, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:20.307254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8536a12e-5c3e-4cc2-8fd1-620cb428cafb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:20.405964 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3825/7755] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:46:19 2022] DELETE /identity/v3/users/443e665c74094946b7efc0ff03be93da => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:46:20.408993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b47bc-fec3-4a66-bddd-78da80832517 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:20.409292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b47bc-fec3-4a66-bddd-78da80832517 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:20.409574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b47bc-fec3-4a66-bddd-78da80832517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:20.432268 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3931/7756] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:46:20 2022] PUT /identity/v3/projects/c3a64eb87e1f4ba59cce4f88f0a6689f/users/09278987e4f54cf9a6527b33bd60bff8/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:46:20.451929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751e70f-43f4-4380-bea5-60896b3ce700 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:20.452612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751e70f-43f4-4380-bea5-60896b3ce700 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:20.453124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4751e70f-43f4-4380-bea5-60896b3ce700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:20.502618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-190b47bc-fec3-4a66-bddd-78da80832517 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:46:20.510754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-190b47bc-fec3-4a66-bddd-78da80832517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:20.546689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4751e70f-43f4-4380-bea5-60896b3ce700 None None] MFA Rules not processed for user `09278987e4f54cf9a6527b33bd60bff8`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:46:20.554038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4751e70f-43f4-4380-bea5-60896b3ce700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:20.816582 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3932/7757] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:46:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:46:20.820477 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3826/7758] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:46:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:46:20.833924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b47bc-fec3-4a66-bddd-78da80832517 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:20.835430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-190b47bc-fec3-4a66-bddd-78da80832517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:20.851745 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:20.907910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751e70f-43f4-4380-bea5-60896b3ce700 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:20.909595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4751e70f-43f4-4380-bea5-60896b3ce700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:21.050518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190b47bc-fec3-4a66-bddd-78da80832517 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:21.068434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecafe83-6a12-4dd5-9343-6468e2f79ab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:21.069183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecafe83-6a12-4dd5-9343-6468e2f79ab4 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:21.069622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecafe83-6a12-4dd5-9343-6468e2f79ab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:21.069816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecafe83-6a12-4dd5-9343-6468e2f79ab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:21.107185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecafe83-6a12-4dd5-9343-6468e2f79ab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:21.111946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecafe83-6a12-4dd5-9343-6468e2f79ab4 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:21.156402 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3827/7759] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:46:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:46:21.159239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4751e70f-43f4-4380-bea5-60896b3ce700 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:21.175979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bea1a2-dacb-4366-b6a3-0ccd8ebc825e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:21.176974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bea1a2-dacb-4366-b6a3-0ccd8ebc825e service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:21.177511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bea1a2-dacb-4366-b6a3-0ccd8ebc825e service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:21.178019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bea1a2-dacb-4366-b6a3-0ccd8ebc825e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:21.191332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecafe83-6a12-4dd5-9343-6468e2f79ab4 service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:21.192835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7ecafe83-6a12-4dd5-9343-6468e2f79ab4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:21.224016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bea1a2-dacb-4366-b6a3-0ccd8ebc825e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:21.229254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bea1a2-dacb-4366-b6a3-0ccd8ebc825e service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:21.252251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecafe83-6a12-4dd5-9343-6468e2f79ab4 service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:21.258672 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3933/7760] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:46:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:46:21.278392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dad6ba-9ab0-4e2e-9b57-90121a151420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:21.279295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dad6ba-9ab0-4e2e-9b57-90121a151420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:21.279580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dad6ba-9ab0-4e2e-9b57-90121a151420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:21.280010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dad6ba-9ab0-4e2e-9b57-90121a151420 admin admin] PATH_INFO: `/v3/users/09278987e4f54cf9a6527b33bd60bff8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:21.282706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dad6ba-9ab0-4e2e-9b57-90121a151420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09278987e4f54cf9a6527b33bd60bff8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:21.293945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dad6ba-9ab0-4e2e-9b57-90121a151420 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:21.634425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c7dad6ba-9ab0-4e2e-9b57-90121a151420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09278987e4f54cf9a6527b33bd60bff8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:21.687661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c7dad6ba-9ab0-4e2e-9b57-90121a151420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09278987e4f54cf9a6527b33bd60bff8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:21.692806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c7dad6ba-9ab0-4e2e-9b57-90121a151420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09278987e4f54cf9a6527b33bd60bff8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:21.692806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c7dad6ba-9ab0-4e2e-9b57-90121a151420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09278987e4f54cf9a6527b33bd60bff8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:21.709791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-c7dad6ba-9ab0-4e2e-9b57-90121a151420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09278987e4f54cf9a6527b33bd60bff8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:21.837589 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3828/7761] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:46:21 2022] DELETE /identity/v3/users/09278987e4f54cf9a6527b33bd60bff8 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:46:21.839355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d23dc-06b5-4049-be22-59b5a81ad539 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:21.839677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d23dc-06b5-4049-be22-59b5a81ad539 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:21.840359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d23dc-06b5-4049-be22-59b5a81ad539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:21.894514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1a9d23dc-06b5-4049-be22-59b5a81ad539 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:46:21.895863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1a9d23dc-06b5-4049-be22-59b5a81ad539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:22.116017 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3934/7762] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:46:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:46:22.212863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dad6ba-9ab0-4e2e-9b57-90121a151420 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:22.216955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c7dad6ba-9ab0-4e2e-9b57-90121a151420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:22.481578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dad6ba-9ab0-4e2e-9b57-90121a151420 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:22.501749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1522212-fd05-462b-9695-26fa4d91ad07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:22.502230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1522212-fd05-462b-9695-26fa4d91ad07 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:22.502524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1522212-fd05-462b-9695-26fa4d91ad07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:22.502809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1522212-fd05-462b-9695-26fa4d91ad07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:22.544152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1522212-fd05-462b-9695-26fa4d91ad07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:22.555509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1522212-fd05-462b-9695-26fa4d91ad07 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:22.573653 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3829/7763] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:46:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:46:23.362636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d23dc-06b5-4049-be22-59b5a81ad539 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:23.365420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1a9d23dc-06b5-4049-be22-59b5a81ad539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:23.382463 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:23.392122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d23dc-06b5-4049-be22-59b5a81ad539 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:23.397284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33babd-909d-43df-9eed-4bdcb7925cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:23.399193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33babd-909d-43df-9eed-4bdcb7925cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:23.399715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33babd-909d-43df-9eed-4bdcb7925cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:23.400261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33babd-909d-43df-9eed-4bdcb7925cc2 admin admin] PATH_INFO: `/v3/users/eb6677b6e4084aba9da6fb0728040fe9` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:23.402815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33babd-909d-43df-9eed-4bdcb7925cc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb6677b6e4084aba9da6fb0728040fe9)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:23.405282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b33babd-909d-43df-9eed-4bdcb7925cc2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:23.408230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1522212-fd05-462b-9695-26fa4d91ad07 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:23.409808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f1522212-fd05-462b-9695-26fa4d91ad07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:23.440355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1522212-fd05-462b-9695-26fa4d91ad07 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:23.445443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7290651-7a0a-4a5c-a95b-0c7c3ca5e731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:23.446795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7290651-7a0a-4a5c-a95b-0c7c3ca5e731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:23.447085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7290651-7a0a-4a5c-a95b-0c7c3ca5e731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:23.447363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7290651-7a0a-4a5c-a95b-0c7c3ca5e731 admin admin] PATH_INFO: `/v3/projects/e038cda4ddd84e24a176296dfa430245` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:23.449033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7290651-7a0a-4a5c-a95b-0c7c3ca5e731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e038cda4ddd84e24a176296dfa430245)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:23.452390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7290651-7a0a-4a5c-a95b-0c7c3ca5e731 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:23.481307 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:23.707546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7290651-7a0a-4a5c-a95b-0c7c3ca5e731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e038cda4ddd84e24a176296dfa430245', 'request_id': 'req-f7290651-7a0a-4a5c-a95b-0c7c3ca5e731'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:23.721829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0b33babd-909d-43df-9eed-4bdcb7925cc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb6677b6e4084aba9da6fb0728040fe9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:23.757068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0b33babd-909d-43df-9eed-4bdcb7925cc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb6677b6e4084aba9da6fb0728040fe9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:23.782006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0b33babd-909d-43df-9eed-4bdcb7925cc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb6677b6e4084aba9da6fb0728040fe9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:23.783568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0b33babd-909d-43df-9eed-4bdcb7925cc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb6677b6e4084aba9da6fb0728040fe9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:23.826874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7290651-7a0a-4a5c-a95b-0c7c3ca5e731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e038cda4ddd84e24a176296dfa430245', 'request_id': 'req-f7290651-7a0a-4a5c-a95b-0c7c3ca5e731'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:23.838470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7290651-7a0a-4a5c-a95b-0c7c3ca5e731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e038cda4ddd84e24a176296dfa430245', 'request_id': 'req-f7290651-7a0a-4a5c-a95b-0c7c3ca5e731'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:23.871038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7290651-7a0a-4a5c-a95b-0c7c3ca5e731 admin admin] The token cache is being invalidate because project e038cda4ddd84e24a176296dfa430245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:46:23.872374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7290651-7a0a-4a5c-a95b-0c7c3ca5e731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:23.875956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7290651-7a0a-4a5c-a95b-0c7c3ca5e731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:23.881103 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3830/7764] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:46:23 2022] DELETE /identity/v3/projects/e038cda4ddd84e24a176296dfa430245 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:46:23.882544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7290651-7a0a-4a5c-a95b-0c7c3ca5e731 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:23.884374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f7290651-7a0a-4a5c-a95b-0c7c3ca5e731 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:23.899246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0b33babd-909d-43df-9eed-4bdcb7925cc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb6677b6e4084aba9da6fb0728040fe9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:23.907935 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3935/7765] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:46:23 2022] DELETE /identity/v3/users/eb6677b6e4084aba9da6fb0728040fe9 => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:46:23.913273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b45244-279d-4d71-bc15-d9d73d2994a2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:23.913661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b45244-279d-4d71-bc15-d9d73d2994a2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:23.914236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b45244-279d-4d71-bc15-d9d73d2994a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:23.974200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-71b45244-279d-4d71-bc15-d9d73d2994a2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:46:23.976013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-71b45244-279d-4d71-bc15-d9d73d2994a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:24.008682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7290651-7a0a-4a5c-a95b-0c7c3ca5e731 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:24.145663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a67eb8b-2bc3-4acd-85f7-626994101bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:24.147257 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3936/7766] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:46:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:46:24.149121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67eb8b-2bc3-4acd-85f7-626994101bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:24.149593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67eb8b-2bc3-4acd-85f7-626994101bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:24.149924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a67eb8b-2bc3-4acd-85f7-626994101bd1 admin admin] PATH_INFO: `/v3/users/435ecb70188646bfae632e210d907d57` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:24.152938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67eb8b-2bc3-4acd-85f7-626994101bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=435ecb70188646bfae632e210d907d57)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:24.166120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a67eb8b-2bc3-4acd-85f7-626994101bd1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:24.174010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b45244-279d-4d71-bc15-d9d73d2994a2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:24.175777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-71b45244-279d-4d71-bc15-d9d73d2994a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:24.355021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b45244-279d-4d71-bc15-d9d73d2994a2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:24.371452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5a408-78c3-479c-83a8-a25e965d5dd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:24.372065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5a408-78c3-479c-83a8-a25e965d5dd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:24.372277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5a408-78c3-479c-83a8-a25e965d5dd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:24.372560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5a408-78c3-479c-83a8-a25e965d5dd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:24.411802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5a408-78c3-479c-83a8-a25e965d5dd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:24.412790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5a408-78c3-479c-83a8-a25e965d5dd1 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:24.438555 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3937/7767] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:46:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:46:24.494669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7a67eb8b-2bc3-4acd-85f7-626994101bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '435ecb70188646bfae632e210d907d57'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:24.512595 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:24.533045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7a67eb8b-2bc3-4acd-85f7-626994101bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '435ecb70188646bfae632e210d907d57'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:24.534569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7a67eb8b-2bc3-4acd-85f7-626994101bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '435ecb70188646bfae632e210d907d57'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:24.534876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7a67eb8b-2bc3-4acd-85f7-626994101bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '435ecb70188646bfae632e210d907d57'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:24.563392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7a67eb8b-2bc3-4acd-85f7-626994101bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '435ecb70188646bfae632e210d907d57'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:24.661983 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3831/7768] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:46:23 2022] DELETE /identity/v3/users/435ecb70188646bfae632e210d907d57 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:46:24.665819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5a408-78c3-479c-83a8-a25e965d5dd1 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:24.667648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2ef5a408-78c3-479c-83a8-a25e965d5dd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:24.699072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5a408-78c3-479c-83a8-a25e965d5dd1 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:24.739531 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:24.859540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfde9ac-3923-4d91-a6fc-7eabb4a97400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:24.860483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfde9ac-3923-4d91-a6fc-7eabb4a97400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:24.860777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfde9ac-3923-4d91-a6fc-7eabb4a97400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:24.861059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfde9ac-3923-4d91-a6fc-7eabb4a97400 admin admin] PATH_INFO: `/v3/projects/c3a64eb87e1f4ba59cce4f88f0a6689f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:24.865839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfde9ac-3923-4d91-a6fc-7eabb4a97400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3a64eb87e1f4ba59cce4f88f0a6689f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:24.870630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfde9ac-3923-4d91-a6fc-7eabb4a97400 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:25.081845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0bfde9ac-3923-4d91-a6fc-7eabb4a97400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3a64eb87e1f4ba59cce4f88f0a6689f', 'request_id': 'req-0bfde9ac-3923-4d91-a6fc-7eabb4a97400'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:25.105296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0bfde9ac-3923-4d91-a6fc-7eabb4a97400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3a64eb87e1f4ba59cce4f88f0a6689f', 'request_id': 'req-0bfde9ac-3923-4d91-a6fc-7eabb4a97400'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:25.122232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0bfde9ac-3923-4d91-a6fc-7eabb4a97400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3a64eb87e1f4ba59cce4f88f0a6689f', 'request_id': 'req-0bfde9ac-3923-4d91-a6fc-7eabb4a97400'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:25.214052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0bfde9ac-3923-4d91-a6fc-7eabb4a97400 admin admin] The token cache is being invalidate because project c3a64eb87e1f4ba59cce4f88f0a6689f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:46:25.214388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0bfde9ac-3923-4d91-a6fc-7eabb4a97400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:25.220646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0bfde9ac-3923-4d91-a6fc-7eabb4a97400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:25.220646 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3938/7769] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:46:24 2022] DELETE /identity/v3/projects/c3a64eb87e1f4ba59cce4f88f0a6689f => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:46:25.226656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30e750-8ca7-46dd-b109-d5ae7049bbab None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:25.226656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30e750-8ca7-46dd-b109-d5ae7049bbab None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:25.226656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b30e750-8ca7-46dd-b109-d5ae7049bbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:25.265311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3b30e750-8ca7-46dd-b109-d5ae7049bbab None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:46:25.267376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3b30e750-8ca7-46dd-b109-d5ae7049bbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:25.446923 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3832/7770] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:46:25.451855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3d461-cf6a-49bf-96f9-81f08687b10e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:25.452881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3d461-cf6a-49bf-96f9-81f08687b10e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:25.453784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e3d461-cf6a-49bf-96f9-81f08687b10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:25.488712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-64e3d461-cf6a-49bf-96f9-81f08687b10e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:46:25.490377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-64e3d461-cf6a-49bf-96f9-81f08687b10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:25.519539 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3939/7771] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:46:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:46:25.524064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30e750-8ca7-46dd-b109-d5ae7049bbab None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:25.538151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b30e750-8ca7-46dd-b109-d5ae7049bbab None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:25.550858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999b1ec-10c4-429b-b773-3f65cd34fd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:25.552106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999b1ec-10c4-429b-b773-3f65cd34fd32 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:25.552581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999b1ec-10c4-429b-b773-3f65cd34fd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:25.556207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999b1ec-10c4-429b-b773-3f65cd34fd32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:25.556207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999b1ec-10c4-429b-b773-3f65cd34fd32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:46:25.556207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999b1ec-10c4-429b-b773-3f65cd34fd32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:25.556207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999b1ec-10c4-429b-b773-3f65cd34fd32 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:25.582010 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3833/7772] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:46:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:46:25.585804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3d461-cf6a-49bf-96f9-81f08687b10e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:25.597145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e3d461-cf6a-49bf-96f9-81f08687b10e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:25.619037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27772f4-aa0d-45c2-931d-5edd63f701ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:25.619752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27772f4-aa0d-45c2-931d-5edd63f701ed admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:25.620039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27772f4-aa0d-45c2-931d-5edd63f701ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:25.620311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27772f4-aa0d-45c2-931d-5edd63f701ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:25.621031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27772f4-aa0d-45c2-931d-5edd63f701ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:25.623005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27772f4-aa0d-45c2-931d-5edd63f701ed admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:25.755077 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3940/7773] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:46:25 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:46:25.759507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999b1ec-10c4-429b-b773-3f65cd34fd32 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:25.776702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999b1ec-10c4-429b-b773-3f65cd34fd32 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:25.815038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27772f4-aa0d-45c2-931d-5edd63f701ed admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:25.816802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e27772f4-aa0d-45c2-931d-5edd63f701ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:25.983534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa677615-3671-40cc-8b9e-4503bcbfb4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:25.985783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa677615-3671-40cc-8b9e-4503bcbfb4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:25.986083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa677615-3671-40cc-8b9e-4503bcbfb4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:25.988023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa677615-3671-40cc-8b9e-4503bcbfb4c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:25.990542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa677615-3671-40cc-8b9e-4503bcbfb4c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:25.996115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa677615-3671-40cc-8b9e-4503bcbfb4c2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:26.038880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27772f4-aa0d-45c2-931d-5edd63f701ed admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:26.058747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc809385-b4a6-48d8-82c2-f6c7f28d16c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:26.059805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc809385-b4a6-48d8-82c2-f6c7f28d16c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:26.060218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc809385-b4a6-48d8-82c2-f6c7f28d16c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:26.060565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc809385-b4a6-48d8-82c2-f6c7f28d16c6 admin admin] PATH_INFO: `/v3/projects/cb2e3ac979ea4076a72333ca492aabc4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:26.062300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc809385-b4a6-48d8-82c2-f6c7f28d16c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb2e3ac979ea4076a72333ca492aabc4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:26.065111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc809385-b4a6-48d8-82c2-f6c7f28d16c6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:26.119582 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:26.148303 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3834/7774] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:46:25 2022] POST /identity/v3/users => generated 288 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:46:26.152103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa677615-3671-40cc-8b9e-4503bcbfb4c2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:26.175854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa677615-3671-40cc-8b9e-4503bcbfb4c2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:26.200157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675ca50-a614-45c9-be14-6c3b55cd0a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:26.200157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675ca50-a614-45c9-be14-6c3b55cd0a97 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:26.200157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675ca50-a614-45c9-be14-6c3b55cd0a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:26.200157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8675ca50-a614-45c9-be14-6c3b55cd0a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:26.200900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675ca50-a614-45c9-be14-6c3b55cd0a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:26.204728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8675ca50-a614-45c9-be14-6c3b55cd0a97 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:26.242014 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3835/7775] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:46:26.244024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675ca50-a614-45c9-be14-6c3b55cd0a97 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:26.265339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cc809385-b4a6-48d8-82c2-f6c7f28d16c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb2e3ac979ea4076a72333ca492aabc4', 'request_id': 'req-cc809385-b4a6-48d8-82c2-f6c7f28d16c6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:26.285707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8675ca50-a614-45c9-be14-6c3b55cd0a97 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:26.285934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cc809385-b4a6-48d8-82c2-f6c7f28d16c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb2e3ac979ea4076a72333ca492aabc4', 'request_id': 'req-cc809385-b4a6-48d8-82c2-f6c7f28d16c6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:26.300825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cc809385-b4a6-48d8-82c2-f6c7f28d16c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb2e3ac979ea4076a72333ca492aabc4', 'request_id': 'req-cc809385-b4a6-48d8-82c2-f6c7f28d16c6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:26.354508 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:26.393701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af57c5-61a9-4b6d-891e-e12f46bc7ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:26.394875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af57c5-61a9-4b6d-891e-e12f46bc7ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:26.395007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af57c5-61a9-4b6d-891e-e12f46bc7ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:26.395360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af57c5-61a9-4b6d-891e-e12f46bc7ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:26.402080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af57c5-61a9-4b6d-891e-e12f46bc7ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:26.402080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af57c5-61a9-4b6d-891e-e12f46bc7ae0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:26.402408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cc809385-b4a6-48d8-82c2-f6c7f28d16c6 admin admin] The token cache is being invalidate because project cb2e3ac979ea4076a72333ca492aabc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:46:26.402408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cc809385-b4a6-48d8-82c2-f6c7f28d16c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:26.403029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cc809385-b4a6-48d8-82c2-f6c7f28d16c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:26.411350 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3941/7776] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:46:25 2022] DELETE /identity/v3/projects/cb2e3ac979ea4076a72333ca492aabc4 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:46:26.412929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef924bc-96a0-44cd-9012-68398b999276 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:26.413232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef924bc-96a0-44cd-9012-68398b999276 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:26.413521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef924bc-96a0-44cd-9012-68398b999276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:26.415306 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3836/7777] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:46:26 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:46:26.416327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af57c5-61a9-4b6d-891e-e12f46bc7ae0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:26.418468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b8af57c5-61a9-4b6d-891e-e12f46bc7ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:26.433910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af57c5-61a9-4b6d-891e-e12f46bc7ae0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:26.440410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6147af3-e89e-468d-9a1d-e0e705cb3bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:26.441457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6147af3-e89e-468d-9a1d-e0e705cb3bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:26.442357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6147af3-e89e-468d-9a1d-e0e705cb3bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:26.442357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6147af3-e89e-468d-9a1d-e0e705cb3bf6 admin admin] PATH_INFO: `/v3/projects/8e42cca24c9547fab662221000c32f16/users/2ae4462cbb694f55ba983ed324d00be9/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:26.457796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-eef924bc-96a0-44cd-9012-68398b999276 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:46:26.459589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-eef924bc-96a0-44cd-9012-68398b999276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:26.477607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6147af3-e89e-468d-9a1d-e0e705cb3bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e42cca24c9547fab662221000c32f16, user_id=2ae4462cbb694f55ba983ed324d00be9, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:26.481354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6147af3-e89e-468d-9a1d-e0e705cb3bf6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:26.481852 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3942/7778] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:46:26.492219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d6271-eb87-4c03-a04b-5c69ddc1c1eb None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:26.492219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d6271-eb87-4c03-a04b-5c69ddc1c1eb None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:26.492219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7d6271-eb87-4c03-a04b-5c69ddc1c1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:26.533459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0d7d6271-eb87-4c03-a04b-5c69ddc1c1eb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:46:26.536567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0d7d6271-eb87-4c03-a04b-5c69ddc1c1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:26.557230 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3943/7779] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:46:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:46:26.559020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d6271-eb87-4c03-a04b-5c69ddc1c1eb None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:26.577837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7d6271-eb87-4c03-a04b-5c69ddc1c1eb None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:26.578264 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3837/7780] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:46:26 2022] PUT /identity/v3/projects/8e42cca24c9547fab662221000c32f16/users/2ae4462cbb694f55ba983ed324d00be9/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:46:26.596151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899e37e-59f3-4466-82b7-41c893fc9e99 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:26.596151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899e37e-59f3-4466-82b7-41c893fc9e99 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:26.596151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899e37e-59f3-4466-82b7-41c893fc9e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:26.775743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6899e37e-59f3-4466-82b7-41c893fc9e99 None None] MFA Rules not processed for user `2ae4462cbb694f55ba983ed324d00be9`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:46:26.784310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1986620-02d7-4d77-b32d-3445024c7695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:26.789697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6899e37e-59f3-4466-82b7-41c893fc9e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:26.790620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1986620-02d7-4d77-b32d-3445024c7695 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:26.795386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1986620-02d7-4d77-b32d-3445024c7695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:26.797842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1986620-02d7-4d77-b32d-3445024c7695 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:26.801932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1986620-02d7-4d77-b32d-3445024c7695 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:46:26.804504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1986620-02d7-4d77-b32d-3445024c7695 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:26.807734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1986620-02d7-4d77-b32d-3445024c7695 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:26.863923 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3944/7781] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:46:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:46:26.865006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1986620-02d7-4d77-b32d-3445024c7695 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:26.881120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1986620-02d7-4d77-b32d-3445024c7695 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:26.895700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc54397-9022-4e3f-bcd1-6aa9292f7eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:26.896418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc54397-9022-4e3f-bcd1-6aa9292f7eb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:26.896712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc54397-9022-4e3f-bcd1-6aa9292f7eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:26.896996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc54397-9022-4e3f-bcd1-6aa9292f7eb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:26.898076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc54397-9022-4e3f-bcd1-6aa9292f7eb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:26.900077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc54397-9022-4e3f-bcd1-6aa9292f7eb8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:26.987299 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3838/7782] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:46:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:46:27.011263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899e37e-59f3-4466-82b7-41c893fc9e99 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:27.015091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6899e37e-59f3-4466-82b7-41c893fc9e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:27.052627 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3945/7783] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:46:26 2022] POST /identity/v3/projects => generated 373 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:46:27.056974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc54397-9022-4e3f-bcd1-6aa9292f7eb8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:27.193904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899e37e-59f3-4466-82b7-41c893fc9e99 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:27.272211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc54397-9022-4e3f-bcd1-6aa9292f7eb8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:27.283806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9056e-79c3-42c9-ba37-4e473e86ffc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:27.285725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9056e-79c3-42c9-ba37-4e473e86ffc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:27.286625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9056e-79c3-42c9-ba37-4e473e86ffc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:27.287767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9056e-79c3-42c9-ba37-4e473e86ffc4 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:27.288792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9056e-79c3-42c9-ba37-4e473e86ffc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:27.292186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a9056e-79c3-42c9-ba37-4e473e86ffc4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:27.322873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afeccb2-d2df-48fc-96cb-9d1c8f6a02b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:27.323690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeccb2-d2df-48fc-96cb-9d1c8f6a02b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:27.330492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeccb2-d2df-48fc-96cb-9d1c8f6a02b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:27.330492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afeccb2-d2df-48fc-96cb-9d1c8f6a02b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:27.337589 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:27.399367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afeccb2-d2df-48fc-96cb-9d1c8f6a02b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:27.400953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afeccb2-d2df-48fc-96cb-9d1c8f6a02b6 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:27.409404 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:27.416844 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3946/7784] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:46:27 2022] POST /identity/v3/users => generated 287 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:46:27.418213 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3839/7785] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:46:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:46:27.421124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9056e-79c3-42c9-ba37-4e473e86ffc4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:27.436512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9056e-79c3-42c9-ba37-4e473e86ffc4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:27.446649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d2368-01bb-413f-9b42-8c650ad1087e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:27.446649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d2368-01bb-413f-9b42-8c650ad1087e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:27.446649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d2368-01bb-413f-9b42-8c650ad1087e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:27.446649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d2368-01bb-413f-9b42-8c650ad1087e admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:27.447044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d2368-01bb-413f-9b42-8c650ad1087e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:27.447390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d2368-01bb-413f-9b42-8c650ad1087e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:27.462333 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3947/7786] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:46:27.466560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afeccb2-d2df-48fc-96cb-9d1c8f6a02b6 service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:27.486496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afeccb2-d2df-48fc-96cb-9d1c8f6a02b6 service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:27.492702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbec955c-0b8c-4984-ae9a-ef98fbf9c132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:27.493530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec955c-0b8c-4984-ae9a-ef98fbf9c132 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:27.497016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec955c-0b8c-4984-ae9a-ef98fbf9c132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:27.497016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbec955c-0b8c-4984-ae9a-ef98fbf9c132 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:27.500690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec955c-0b8c-4984-ae9a-ef98fbf9c132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:27.506172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbec955c-0b8c-4984-ae9a-ef98fbf9c132 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:27.536636 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3840/7787] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:46:27 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:46:27.540373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d2368-01bb-413f-9b42-8c650ad1087e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:27.556026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d2368-01bb-413f-9b42-8c650ad1087e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:27.572776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1aec4-3881-417b-a0de-d67818192e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:27.574671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1aec4-3881-417b-a0de-d67818192e59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:27.575481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1aec4-3881-417b-a0de-d67818192e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:27.575978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1aec4-3881-417b-a0de-d67818192e59 admin admin] PATH_INFO: `/v3/projects/971c24dcdb3144b18a89dbd18f5a296f/users/8c7cb7b594df432e9a2bd3f61d56e8cc/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:27.627433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1aec4-3881-417b-a0de-d67818192e59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=971c24dcdb3144b18a89dbd18f5a296f, user_id=8c7cb7b594df432e9a2bd3f61d56e8cc, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:27.646768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1aec4-3881-417b-a0de-d67818192e59 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:27.731332 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3948/7788] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:46:27 2022] PUT /identity/v3/projects/971c24dcdb3144b18a89dbd18f5a296f/users/8c7cb7b594df432e9a2bd3f61d56e8cc/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:46:27.742666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d559a-7a07-4fe2-b920-1fd140903d3b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:27.742962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d559a-7a07-4fe2-b920-1fd140903d3b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:27.743487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d559a-7a07-4fe2-b920-1fd140903d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:27.816339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7c3d559a-7a07-4fe2-b920-1fd140903d3b None None] MFA Rules not processed for user `8c7cb7b594df432e9a2bd3f61d56e8cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:46:27.824175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7c3d559a-7a07-4fe2-b920-1fd140903d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:28.024745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1aec4-3881-417b-a0de-d67818192e59 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:28.026605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-abb1aec4-3881-417b-a0de-d67818192e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:28.049240 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3841/7789] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:46:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:46:28.058737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d559a-7a07-4fe2-b920-1fd140903d3b None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:28.063558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7c3d559a-7a07-4fe2-b920-1fd140903d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:28.226872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1aec4-3881-417b-a0de-d67818192e59 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:28.232377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79104b6e-190a-404b-a316-f033a94042c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:28.234061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79104b6e-190a-404b-a316-f033a94042c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:28.234935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79104b6e-190a-404b-a316-f033a94042c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:28.234935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79104b6e-190a-404b-a316-f033a94042c3 admin admin] PATH_INFO: `/v3/projects/b81af2ae0d824c108fe7f4f9905ac9a8` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:28.236325 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79104b6e-190a-404b-a316-f033a94042c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b81af2ae0d824c108fe7f4f9905ac9a8)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:28.238670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79104b6e-190a-404b-a316-f033a94042c3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:28.315690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d559a-7a07-4fe2-b920-1fd140903d3b None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:28.324679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba3585-a871-4870-a2c4-0a1f838605d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:28.329257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba3585-a871-4870-a2c4-0a1f838605d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:28.329884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba3585-a871-4870-a2c4-0a1f838605d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:28.330715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba3585-a871-4870-a2c4-0a1f838605d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:28.349038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba3585-a871-4870-a2c4-0a1f838605d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:28.350574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba3585-a871-4870-a2c4-0a1f838605d6 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:28.364848 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3842/7790] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:46:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:46:28.485953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-79104b6e-190a-404b-a316-f033a94042c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b81af2ae0d824c108fe7f4f9905ac9a8', 'request_id': 'req-79104b6e-190a-404b-a316-f033a94042c3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:28.503143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-79104b6e-190a-404b-a316-f033a94042c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b81af2ae0d824c108fe7f4f9905ac9a8', 'request_id': 'req-79104b6e-190a-404b-a316-f033a94042c3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:28.527667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-79104b6e-190a-404b-a316-f033a94042c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b81af2ae0d824c108fe7f4f9905ac9a8', 'request_id': 'req-79104b6e-190a-404b-a316-f033a94042c3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:28.643062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-79104b6e-190a-404b-a316-f033a94042c3 admin admin] The token cache is being invalidate because project b81af2ae0d824c108fe7f4f9905ac9a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:46:28.643444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-79104b6e-190a-404b-a316-f033a94042c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:28.645763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-79104b6e-190a-404b-a316-f033a94042c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:28.651488 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3949/7791] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:46:28 2022] DELETE /identity/v3/projects/b81af2ae0d824c108fe7f4f9905ac9a8 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:46:28.652828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba3585-a871-4870-a2c4-0a1f838605d6 service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:28.671370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba3585-a871-4870-a2c4-0a1f838605d6 service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:28.847756 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:28.949263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda89b59-9184-4061-b9a5-7d6d4244057f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:28.954059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda89b59-9184-4061-b9a5-7d6d4244057f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:28.954829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda89b59-9184-4061-b9a5-7d6d4244057f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:28.966570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda89b59-9184-4061-b9a5-7d6d4244057f admin admin] PATH_INFO: `/v3/users/1de593d8e65449f69723ff418583affd` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:28.988031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda89b59-9184-4061-b9a5-7d6d4244057f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1de593d8e65449f69723ff418583affd)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:28.992320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda89b59-9184-4061-b9a5-7d6d4244057f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:29.242812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fda89b59-9184-4061-b9a5-7d6d4244057f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1de593d8e65449f69723ff418583affd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:29.293295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fda89b59-9184-4061-b9a5-7d6d4244057f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1de593d8e65449f69723ff418583affd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:29.296311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fda89b59-9184-4061-b9a5-7d6d4244057f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1de593d8e65449f69723ff418583affd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:29.297580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fda89b59-9184-4061-b9a5-7d6d4244057f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1de593d8e65449f69723ff418583affd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:29.327971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fda89b59-9184-4061-b9a5-7d6d4244057f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1de593d8e65449f69723ff418583affd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:29.482945 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3843/7792] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:46:28 2022] DELETE /identity/v3/users/1de593d8e65449f69723ff418583affd => generated 0 bytes in 828 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:46:29.778177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79104b6e-190a-404b-a316-f033a94042c3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:29.781026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-79104b6e-190a-404b-a316-f033a94042c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:29.980062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79104b6e-190a-404b-a316-f033a94042c3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:29.996195 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:30.073994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076e56f-af8f-4a17-a56a-592c1c92f5ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:30.074736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076e56f-af8f-4a17-a56a-592c1c92f5ec service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:30.075027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076e56f-af8f-4a17-a56a-592c1c92f5ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:30.075975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7076e56f-af8f-4a17-a56a-592c1c92f5ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:30.081086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7076e56f-af8f-4a17-a56a-592c1c92f5ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:30.125594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda89b59-9184-4061-b9a5-7d6d4244057f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:30.134952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fda89b59-9184-4061-b9a5-7d6d4244057f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:30.278128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076e56f-af8f-4a17-a56a-592c1c92f5ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:30.280351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7076e56f-af8f-4a17-a56a-592c1c92f5ec service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:30.318691 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3950/7793] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:46:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:46:30.443177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda89b59-9184-4061-b9a5-7d6d4244057f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:30.459953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace4f3d-69b1-468a-8b2b-517186e92952 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:30.464436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace4f3d-69b1-468a-8b2b-517186e92952 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:30.464932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace4f3d-69b1-468a-8b2b-517186e92952 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:30.473650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace4f3d-69b1-468a-8b2b-517186e92952 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:30.481396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aace4f3d-69b1-468a-8b2b-517186e92952 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:30.522268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace4f3d-69b1-468a-8b2b-517186e92952 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:30.524742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace4f3d-69b1-468a-8b2b-517186e92952 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:30.567405 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3844/7794] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:46:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:46:32.049739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076e56f-af8f-4a17-a56a-592c1c92f5ec service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:32.051996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7076e56f-af8f-4a17-a56a-592c1c92f5ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:32.077088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7076e56f-af8f-4a17-a56a-592c1c92f5ec service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:32.091619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3285cfd-1976-4eb7-a952-b5c687d16bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:32.093532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3285cfd-1976-4eb7-a952-b5c687d16bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:32.094758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3285cfd-1976-4eb7-a952-b5c687d16bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:32.096534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3285cfd-1976-4eb7-a952-b5c687d16bb3 admin admin] PATH_INFO: `/v3/projects/93f63aa367e44d289073f628fe43c4b6` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:32.103349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3285cfd-1976-4eb7-a952-b5c687d16bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93f63aa367e44d289073f628fe43c4b6)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:32.107536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3285cfd-1976-4eb7-a952-b5c687d16bb3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:32.170945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12f4fd-1273-499e-8d48-30ae9f044015 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:32.171943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12f4fd-1273-499e-8d48-30ae9f044015 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:32.172868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12f4fd-1273-499e-8d48-30ae9f044015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:32.207151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2b12f4fd-1273-499e-8d48-30ae9f044015 None None] MFA Rules not processed for user `2ae4462cbb694f55ba983ed324d00be9`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:46:32.208872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2b12f4fd-1273-499e-8d48-30ae9f044015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:32.275110 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:32.317183 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3845/7795] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:46:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:46:32.335423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f3285cfd-1976-4eb7-a952-b5c687d16bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93f63aa367e44d289073f628fe43c4b6', 'request_id': 'req-f3285cfd-1976-4eb7-a952-b5c687d16bb3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:32.349772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f3285cfd-1976-4eb7-a952-b5c687d16bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93f63aa367e44d289073f628fe43c4b6', 'request_id': 'req-f3285cfd-1976-4eb7-a952-b5c687d16bb3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:32.367531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f3285cfd-1976-4eb7-a952-b5c687d16bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93f63aa367e44d289073f628fe43c4b6', 'request_id': 'req-f3285cfd-1976-4eb7-a952-b5c687d16bb3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:32.467973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f3285cfd-1976-4eb7-a952-b5c687d16bb3 admin admin] The token cache is being invalidate because project 93f63aa367e44d289073f628fe43c4b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:46:32.468861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f3285cfd-1976-4eb7-a952-b5c687d16bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:32.469852 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f3285cfd-1976-4eb7-a952-b5c687d16bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:32.472765 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3951/7796] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:46:32 2022] DELETE /identity/v3/projects/93f63aa367e44d289073f628fe43c4b6 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:46:32.477903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19ab80-b3bd-406b-aab2-8edd07187c0e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:32.478263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19ab80-b3bd-406b-aab2-8edd07187c0e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:32.478532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19ab80-b3bd-406b-aab2-8edd07187c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:32.519410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4b19ab80-b3bd-406b-aab2-8edd07187c0e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:46:32.520407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4b19ab80-b3bd-406b-aab2-8edd07187c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:32.654538 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3846/7797] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:46:32.662581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa758dc-7964-4c83-b03d-f9d9d56ec5d1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:32.664501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa758dc-7964-4c83-b03d-f9d9d56ec5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:32.664501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa758dc-7964-4c83-b03d-f9d9d56ec5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:32.688943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-aaa758dc-7964-4c83-b03d-f9d9d56ec5d1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:46:32.691386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-aaa758dc-7964-4c83-b03d-f9d9d56ec5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:32.702250 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3952/7798] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:46:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:46:32.707463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19ab80-b3bd-406b-aab2-8edd07187c0e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:32.730737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19ab80-b3bd-406b-aab2-8edd07187c0e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:32.737681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec51f53-8e3c-4075-8199-9cb0a46fbc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:32.738640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec51f53-8e3c-4075-8199-9cb0a46fbc0a admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:32.738870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec51f53-8e3c-4075-8199-9cb0a46fbc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:32.739283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec51f53-8e3c-4075-8199-9cb0a46fbc0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:32.740284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec51f53-8e3c-4075-8199-9cb0a46fbc0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:46:32.740597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec51f53-8e3c-4075-8199-9cb0a46fbc0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:32.742545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec51f53-8e3c-4075-8199-9cb0a46fbc0a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:32.760234 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3847/7799] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:46:32.764278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa758dc-7964-4c83-b03d-f9d9d56ec5d1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:32.784452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa758dc-7964-4c83-b03d-f9d9d56ec5d1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:32.794028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd262a83-b1ab-4ea9-a446-ffa6bb511833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:32.794873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd262a83-b1ab-4ea9-a446-ffa6bb511833 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:32.795332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd262a83-b1ab-4ea9-a446-ffa6bb511833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:32.795719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd262a83-b1ab-4ea9-a446-ffa6bb511833 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:32.796427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd262a83-b1ab-4ea9-a446-ffa6bb511833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:32.799917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd262a83-b1ab-4ea9-a446-ffa6bb511833 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:32.954804 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3953/7800] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:46:32 2022] POST /identity/v3/projects => generated 391 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:46:32.959113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec51f53-8e3c-4075-8199-9cb0a46fbc0a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:32.983644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec51f53-8e3c-4075-8199-9cb0a46fbc0a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:33.106987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd262a83-b1ab-4ea9-a446-ffa6bb511833 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:33.109300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dd262a83-b1ab-4ea9-a446-ffa6bb511833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:33.133438 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:33.200849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc888b2-40ed-4ab3-a74b-8c9752e3fd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:33.204139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc888b2-40ed-4ab3-a74b-8c9752e3fd96 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:33.208121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc888b2-40ed-4ab3-a74b-8c9752e3fd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:33.208121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc888b2-40ed-4ab3-a74b-8c9752e3fd96 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:33.208121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc888b2-40ed-4ab3-a74b-8c9752e3fd96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:33.211679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc888b2-40ed-4ab3-a74b-8c9752e3fd96 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:33.275680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd262a83-b1ab-4ea9-a446-ffa6bb511833 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:33.292120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42c151-392a-478d-927e-62173e61ef3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:33.293211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42c151-392a-478d-927e-62173e61ef3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:33.293561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42c151-392a-478d-927e-62173e61ef3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:33.293846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42c151-392a-478d-927e-62173e61ef3c admin admin] PATH_INFO: `/v3/users/20cc5d36e4004359903122049a88079f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:33.295265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42c151-392a-478d-927e-62173e61ef3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=20cc5d36e4004359903122049a88079f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:33.297336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42c151-392a-478d-927e-62173e61ef3c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:33.343149 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3848/7801] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:46:32 2022] POST /identity/v3/users => generated 296 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:46:33.344237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc888b2-40ed-4ab3-a74b-8c9752e3fd96 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:33.360884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc888b2-40ed-4ab3-a74b-8c9752e3fd96 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:33.373720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50eb52-0a67-4e96-ac36-a1407b247158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:33.377718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50eb52-0a67-4e96-ac36-a1407b247158 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:33.379235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50eb52-0a67-4e96-ac36-a1407b247158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:33.379683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50eb52-0a67-4e96-ac36-a1407b247158 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:33.380531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50eb52-0a67-4e96-ac36-a1407b247158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:33.382269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50eb52-0a67-4e96-ac36-a1407b247158 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:33.401298 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3849/7802] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:46:33.406580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50eb52-0a67-4e96-ac36-a1407b247158 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:33.424312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50eb52-0a67-4e96-ac36-a1407b247158 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:33.434246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5973e2-1a8c-4ce2-9677-334122e39606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:33.438535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5973e2-1a8c-4ce2-9677-334122e39606 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:33.438535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5973e2-1a8c-4ce2-9677-334122e39606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:33.442129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5973e2-1a8c-4ce2-9677-334122e39606 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:33.442129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5973e2-1a8c-4ce2-9677-334122e39606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:33.442129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5973e2-1a8c-4ce2-9677-334122e39606 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:33.462663 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3850/7803] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:46:33 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:46:33.464884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5973e2-1a8c-4ce2-9677-334122e39606 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:33.485142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5973e2-1a8c-4ce2-9677-334122e39606 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:33.498046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d695945-1234-4d9b-8919-683220946989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:33.499348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d695945-1234-4d9b-8919-683220946989 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:33.499838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d695945-1234-4d9b-8919-683220946989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:33.501161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d695945-1234-4d9b-8919-683220946989 admin admin] PATH_INFO: `/v3/projects/d92fb53ce1c44d21b11d2e2937cb2a55/users/6bf7ea43659c44a4b3ba36fd920ae5eb/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:33.530867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d695945-1234-4d9b-8919-683220946989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d92fb53ce1c44d21b11d2e2937cb2a55, user_id=6bf7ea43659c44a4b3ba36fd920ae5eb, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:33.534545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d695945-1234-4d9b-8919-683220946989 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:33.626234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd42c151-392a-478d-927e-62173e61ef3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20cc5d36e4004359903122049a88079f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:33.653927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd42c151-392a-478d-927e-62173e61ef3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20cc5d36e4004359903122049a88079f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:33.667547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd42c151-392a-478d-927e-62173e61ef3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20cc5d36e4004359903122049a88079f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:33.668985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd42c151-392a-478d-927e-62173e61ef3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20cc5d36e4004359903122049a88079f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:33.705755 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3851/7804] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:46:33 2022] PUT /identity/v3/projects/d92fb53ce1c44d21b11d2e2937cb2a55/users/6bf7ea43659c44a4b3ba36fd920ae5eb/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:46:33.719209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0892f52-8358-432d-9da6-c69b3efe98d2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:33.720056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0892f52-8358-432d-9da6-c69b3efe98d2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:33.720900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0892f52-8358-432d-9da6-c69b3efe98d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:33.792897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-dd42c151-392a-478d-927e-62173e61ef3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20cc5d36e4004359903122049a88079f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:33.824243 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3954/7805] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:46:33 2022] DELETE /identity/v3/users/20cc5d36e4004359903122049a88079f => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:46:33.844721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b0892f52-8358-432d-9da6-c69b3efe98d2 None None] MFA Rules not processed for user `6bf7ea43659c44a4b3ba36fd920ae5eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:46:33.859433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b0892f52-8358-432d-9da6-c69b3efe98d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:33.865647 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:34.101778 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3852/7806] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:46:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:46:34.128265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42c151-392a-478d-927e-62173e61ef3c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:34.129803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dd42c151-392a-478d-927e-62173e61ef3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:34.336269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42c151-392a-478d-927e-62173e61ef3c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:34.348157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8a2618-e0c0-4960-a48d-e5f2a376fd4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:34.348157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a2618-e0c0-4960-a48d-e5f2a376fd4b service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:34.348157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a2618-e0c0-4960-a48d-e5f2a376fd4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:34.348157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8a2618-e0c0-4960-a48d-e5f2a376fd4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:34.378209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a2618-e0c0-4960-a48d-e5f2a376fd4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:34.379998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8a2618-e0c0-4960-a48d-e5f2a376fd4b service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:34.398071 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3955/7807] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:46:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:46:34.982633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0892f52-8358-432d-9da6-c69b3efe98d2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:34.984005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b0892f52-8358-432d-9da6-c69b3efe98d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:35.240864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0892f52-8358-432d-9da6-c69b3efe98d2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:35.272792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e3b0d-f345-493b-9a56-112b0b30313a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:35.273693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e3b0d-f345-493b-9a56-112b0b30313a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:35.274067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e3b0d-f345-493b-9a56-112b0b30313a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:35.274496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e3b0d-f345-493b-9a56-112b0b30313a admin admin] PATH_INFO: `/v3/projects/227629482fef4bd28e68bf3574b1154c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:35.278687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e3b0d-f345-493b-9a56-112b0b30313a admin admin] RBAC: Authorizing `identity:delete_project(project_id=227629482fef4bd28e68bf3574b1154c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:35.283059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e3b0d-f345-493b-9a56-112b0b30313a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:35.761736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-678e3b0d-f345-493b-9a56-112b0b30313a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '227629482fef4bd28e68bf3574b1154c', 'request_id': 'req-678e3b0d-f345-493b-9a56-112b0b30313a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:35.867774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-678e3b0d-f345-493b-9a56-112b0b30313a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '227629482fef4bd28e68bf3574b1154c', 'request_id': 'req-678e3b0d-f345-493b-9a56-112b0b30313a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:35.881168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-678e3b0d-f345-493b-9a56-112b0b30313a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '227629482fef4bd28e68bf3574b1154c', 'request_id': 'req-678e3b0d-f345-493b-9a56-112b0b30313a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:35.916968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-678e3b0d-f345-493b-9a56-112b0b30313a admin admin] The token cache is being invalidate because project 227629482fef4bd28e68bf3574b1154c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:46:35.917267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-678e3b0d-f345-493b-9a56-112b0b30313a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:35.918091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-678e3b0d-f345-493b-9a56-112b0b30313a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:46:35.921424 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3853/7808] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:46:34 2022] DELETE /identity/v3/projects/227629482fef4bd28e68bf3574b1154c => generated 0 bytes in 938 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:46:35.928340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89f318-12b8-4acd-88ee-86a54b5f46ee None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:35.929220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89f318-12b8-4acd-88ee-86a54b5f46ee None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:35.930927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e89f318-12b8-4acd-88ee-86a54b5f46ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:35.979688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5e89f318-12b8-4acd-88ee-86a54b5f46ee None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:46:35.980994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5e89f318-12b8-4acd-88ee-86a54b5f46ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:36.061030 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:36.139532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd4451-538b-404c-8bbb-4290f0795855 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:36.140101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd4451-538b-404c-8bbb-4290f0795855 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:36.140101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd4451-538b-404c-8bbb-4290f0795855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:36.142971 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3956/7809] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:46:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:46:36.176232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-28cd4451-538b-404c-8bbb-4290f0795855 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:46:36.178729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-28cd4451-538b-404c-8bbb-4290f0795855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:36.237620 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3854/7810] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:46:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:46:36.241462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89f318-12b8-4acd-88ee-86a54b5f46ee None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:36.273339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e89f318-12b8-4acd-88ee-86a54b5f46ee None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:36.294690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ca7ca-1494-488b-aa4d-fc8e40409dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:36.297609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ca7ca-1494-488b-aa4d-fc8e40409dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:36.299294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ca7ca-1494-488b-aa4d-fc8e40409dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:36.304439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576ca7ca-1494-488b-aa4d-fc8e40409dc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:36.304439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ca7ca-1494-488b-aa4d-fc8e40409dc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:46:36.304439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ca7ca-1494-488b-aa4d-fc8e40409dc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:36.304439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576ca7ca-1494-488b-aa4d-fc8e40409dc5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:36.391970 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3957/7811] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:46:36.395365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd4451-538b-404c-8bbb-4290f0795855 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:36.411647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd4451-538b-404c-8bbb-4290f0795855 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:36.432554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6a077-ff19-4cea-9c73-3b72b084ccff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:36.433247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6a077-ff19-4cea-9c73-3b72b084ccff admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:36.433535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6a077-ff19-4cea-9c73-3b72b084ccff admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:36.433899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6a077-ff19-4cea-9c73-3b72b084ccff admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:36.434524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6a077-ff19-4cea-9c73-3b72b084ccff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:36.436440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6a077-ff19-4cea-9c73-3b72b084ccff admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:36.567856 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3855/7812] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:46:36 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:46:36.572106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ca7ca-1494-488b-aa4d-fc8e40409dc5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:36.586324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576ca7ca-1494-488b-aa4d-fc8e40409dc5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:36.763725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbde32-b4b9-4c93-8b2c-8c171c9412f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:36.764630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbde32-b4b9-4c93-8b2c-8c171c9412f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:36.765083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbde32-b4b9-4c93-8b2c-8c171c9412f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:36.765521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbde32-b4b9-4c93-8b2c-8c171c9412f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:36.776066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbde32-b4b9-4c93-8b2c-8c171c9412f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:36.786822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbde32-b4b9-4c93-8b2c-8c171c9412f3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:36.900892 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3958/7813] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:46:36 2022] POST /identity/v3/users => generated 290 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:46:36.905602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6a077-ff19-4cea-9c73-3b72b084ccff admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:36.924507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6a077-ff19-4cea-9c73-3b72b084ccff admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:36.952671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de82fe-973a-4745-912f-e803ae7dd636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:36.952671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de82fe-973a-4745-912f-e803ae7dd636 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:36.952671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de82fe-973a-4745-912f-e803ae7dd636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:36.952671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de82fe-973a-4745-912f-e803ae7dd636 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:36.953505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de82fe-973a-4745-912f-e803ae7dd636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:36.956408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05de82fe-973a-4745-912f-e803ae7dd636 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:36.961367 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:36.987392 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3856/7814] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:46:36.991366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbde32-b4b9-4c93-8b2c-8c171c9412f3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:37.008443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbde32-b4b9-4c93-8b2c-8c171c9412f3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:37.024042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f28b7-d15c-48da-99bb-556666aa41e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:37.025009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f28b7-d15c-48da-99bb-556666aa41e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:37.028198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f28b7-d15c-48da-99bb-556666aa41e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:37.028198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f28b7-d15c-48da-99bb-556666aa41e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:37.028198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f28b7-d15c-48da-99bb-556666aa41e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:37.028198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2f28b7-d15c-48da-99bb-556666aa41e1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:37.060190 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3959/7815] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:46:36 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:46:37.064706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de82fe-973a-4745-912f-e803ae7dd636 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:37.082357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05de82fe-973a-4745-912f-e803ae7dd636 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:37.101323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34e4d1-b832-4876-b2da-a0bdaa430ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:37.102277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34e4d1-b832-4876-b2da-a0bdaa430ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:37.102585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34e4d1-b832-4876-b2da-a0bdaa430ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:37.102958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f34e4d1-b832-4876-b2da-a0bdaa430ffb admin admin] PATH_INFO: `/v3/projects/269da2d705dc4f11a7fd9b97426ab087/users/31e36cabec4a4528a290cfe3c667df64/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:37.144301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34e4d1-b832-4876-b2da-a0bdaa430ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=269da2d705dc4f11a7fd9b97426ab087, user_id=31e36cabec4a4528a290cfe3c667df64, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:37.147671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f34e4d1-b832-4876-b2da-a0bdaa430ffb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:37.355526 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3857/7816] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:46:37 2022] PUT /identity/v3/projects/269da2d705dc4f11a7fd9b97426ab087/users/31e36cabec4a4528a290cfe3c667df64/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:46:37.358842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ba18b-3dfa-4893-8b76-986ef851976c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:37.359324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ba18b-3dfa-4893-8b76-986ef851976c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:37.360558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3ba18b-3dfa-4893-8b76-986ef851976c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:37.388902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0c3ba18b-3dfa-4893-8b76-986ef851976c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:46:37.390488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0c3ba18b-3dfa-4893-8b76-986ef851976c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:37.525754 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3960/7817] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:46:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:46:37.574713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34e4d1-b832-4876-b2da-a0bdaa430ffb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:37.577591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6f34e4d1-b832-4876-b2da-a0bdaa430ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:37.879083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f34e4d1-b832-4876-b2da-a0bdaa430ffb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:37.935940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669a822-c23f-4fc8-be49-65c02ea67a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:37.935940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669a822-c23f-4fc8-be49-65c02ea67a7e service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:37.935940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669a822-c23f-4fc8-be49-65c02ea67a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:37.935940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669a822-c23f-4fc8-be49-65c02ea67a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:38.030116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669a822-c23f-4fc8-be49-65c02ea67a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:38.035969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669a822-c23f-4fc8-be49-65c02ea67a7e service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:38.091490 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3858/7818] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:46:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:46:44.474716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ba18b-3dfa-4893-8b76-986ef851976c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:44.485280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0c3ba18b-3dfa-4893-8b76-986ef851976c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:44.502436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3ba18b-3dfa-4893-8b76-986ef851976c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:44.517580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ddd87e-e822-49b1-a744-7466c7bd0d10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:44.518423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddd87e-e822-49b1-a744-7466c7bd0d10 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:44.518893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddd87e-e822-49b1-a744-7466c7bd0d10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:44.519370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ddd87e-e822-49b1-a744-7466c7bd0d10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:44.521712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-95ddd87e-e822-49b1-a744-7466c7bd0d10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:44.611119 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:44.690316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ddd87e-e822-49b1-a744-7466c7bd0d10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:44.692906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ddd87e-e822-49b1-a744-7466c7bd0d10 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:44.718008 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3961/7819] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:46:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:46:46.695483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669a822-c23f-4fc8-be49-65c02ea67a7e service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:46:46.715224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669a822-c23f-4fc8-be49-65c02ea67a7e service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:46:46.727420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cb3d0-1a22-49ef-b79d-45ba870bdf4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:46:46.728113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cb3d0-1a22-49ef-b79d-45ba870bdf4e service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:46:46.728397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cb3d0-1a22-49ef-b79d-45ba870bdf4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:46:46.728679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10cb3d0-1a22-49ef-b79d-45ba870bdf4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:46:46.733138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b10cb3d0-1a22-49ef-b79d-45ba870bdf4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:46:46.781041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cb3d0-1a22-49ef-b79d-45ba870bdf4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:46:46.787239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10cb3d0-1a22-49ef-b79d-45ba870bdf4e service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:46:46.836449 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3859/7820] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:46:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:46:55.088111 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=15 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:46:56.821132 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=44,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:02.039850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28cc53-774d-4b8d-90f8-f22c27d7d3d7 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:02.040430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28cc53-774d-4b8d-90f8-f22c27d7d3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:02.040430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28cc53-774d-4b8d-90f8-f22c27d7d3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:02.088648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1a28cc53-774d-4b8d-90f8-f22c27d7d3d7 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:02.093573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1a28cc53-774d-4b8d-90f8-f22c27d7d3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:02.237780 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3962/7821] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:47:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:02.393029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cb3d0-1a22-49ef-b79d-45ba870bdf4e service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:02.395154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b10cb3d0-1a22-49ef-b79d-45ba870bdf4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:02.543158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10cb3d0-1a22-49ef-b79d-45ba870bdf4e service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:02.557556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae535cae-0ef6-42a4-9052-e66f71c703d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:02.558284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae535cae-0ef6-42a4-9052-e66f71c703d8 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:02.558786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae535cae-0ef6-42a4-9052-e66f71c703d8 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:02.559252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae535cae-0ef6-42a4-9052-e66f71c703d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:02.569421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae535cae-0ef6-42a4-9052-e66f71c703d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:02.571885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae535cae-0ef6-42a4-9052-e66f71c703d8 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:02.605998 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3860/7822] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:47:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:47:03.354794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28cc53-774d-4b8d-90f8-f22c27d7d3d7 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:03.356378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1a28cc53-774d-4b8d-90f8-f22c27d7d3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:03.417500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28cc53-774d-4b8d-90f8-f22c27d7d3d7 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:03.433197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb0b62d-a10f-468a-a64b-85fad36cec28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:03.434492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0b62d-a10f-468a-a64b-85fad36cec28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:03.434597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0b62d-a10f-468a-a64b-85fad36cec28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:03.434829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb0b62d-a10f-468a-a64b-85fad36cec28 admin admin] PATH_INFO: `/v3/users/8c7cb7b594df432e9a2bd3f61d56e8cc` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:03.437177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0b62d-a10f-468a-a64b-85fad36cec28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c7cb7b594df432e9a2bd3f61d56e8cc)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:03.475925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb0b62d-a10f-468a-a64b-85fad36cec28 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:03.801584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ceb0b62d-a10f-468a-a64b-85fad36cec28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c7cb7b594df432e9a2bd3f61d56e8cc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:03.839013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ceb0b62d-a10f-468a-a64b-85fad36cec28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c7cb7b594df432e9a2bd3f61d56e8cc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:03.872916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ceb0b62d-a10f-468a-a64b-85fad36cec28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c7cb7b594df432e9a2bd3f61d56e8cc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:03.874205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ceb0b62d-a10f-468a-a64b-85fad36cec28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c7cb7b594df432e9a2bd3f61d56e8cc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:03.974410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ceb0b62d-a10f-468a-a64b-85fad36cec28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c7cb7b594df432e9a2bd3f61d56e8cc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:03.983097 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3963/7823] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:47:03 2022] DELETE /identity/v3/users/8c7cb7b594df432e9a2bd3f61d56e8cc => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:03.988367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65597a85-04d9-44fa-9cd0-b62cadfb6faa None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:03.988841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65597a85-04d9-44fa-9cd0-b62cadfb6faa None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:03.988968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65597a85-04d9-44fa-9cd0-b62cadfb6faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:04.072297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-65597a85-04d9-44fa-9cd0-b62cadfb6faa None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:04.079959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-65597a85-04d9-44fa-9cd0-b62cadfb6faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:04.095934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494fa2a-b7a6-4734-b6e4-63a60b5ad532 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:04.096562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494fa2a-b7a6-4734-b6e4-63a60b5ad532 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:04.097084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4494fa2a-b7a6-4734-b6e4-63a60b5ad532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:04.189646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4494fa2a-b7a6-4734-b6e4-63a60b5ad532 None None] MFA Rules not processed for user `31e36cabec4a4528a290cfe3c667df64`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:04.197547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4494fa2a-b7a6-4734-b6e4-63a60b5ad532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:04.351246 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3861/7824] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:04.365814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d83246-0255-4a4c-955f-8919c679396a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:04.366273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d83246-0255-4a4c-955f-8919c679396a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:04.366892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d83246-0255-4a4c-955f-8919c679396a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:04.439254 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3964/7825] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:04.439254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494fa2a-b7a6-4734-b6e4-63a60b5ad532 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:04.449377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-37d83246-0255-4a4c-955f-8919c679396a None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:04.449491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4494fa2a-b7a6-4734-b6e4-63a60b5ad532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:04.449593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-37d83246-0255-4a4c-955f-8919c679396a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:04.484525 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:04.634549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4494fa2a-b7a6-4734-b6e4-63a60b5ad532 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:04.644178 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3862/7826] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:47:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:04.645670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d83246-0255-4a4c-955f-8919c679396a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:04.648241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-37d83246-0255-4a4c-955f-8919c679396a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:04.654918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e01b9-83b1-408a-a3a0-c7bd6e0a2d42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:04.655579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e01b9-83b1-408a-a3a0-c7bd6e0a2d42 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:04.656055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e01b9-83b1-408a-a3a0-c7bd6e0a2d42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:04.657030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e01b9-83b1-408a-a3a0-c7bd6e0a2d42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:04.695540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e01b9-83b1-408a-a3a0-c7bd6e0a2d42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:04.696958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42e01b9-83b1-408a-a3a0-c7bd6e0a2d42 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:04.699324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d83246-0255-4a4c-955f-8919c679396a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:04.710567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903e64c-19b7-40ab-81c7-f37d60b18ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:04.711897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903e64c-19b7-40ab-81c7-f37d60b18ddd admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:04.714402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903e64c-19b7-40ab-81c7-f37d60b18ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:04.714959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1903e64c-19b7-40ab-81c7-f37d60b18ddd admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:04.715930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903e64c-19b7-40ab-81c7-f37d60b18ddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:04.720943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1903e64c-19b7-40ab-81c7-f37d60b18ddd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:04.733483 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3965/7827] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:47:04.734641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e01b9-83b1-408a-a3a0-c7bd6e0a2d42 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:04.735894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f42e01b9-83b1-408a-a3a0-c7bd6e0a2d42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:04.874725 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3863/7828] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:47:04 2022] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:04.880610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903e64c-19b7-40ab-81c7-f37d60b18ddd admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:04.913035 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:04.976534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e01b9-83b1-408a-a3a0-c7bd6e0a2d42 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:05.052226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1903e64c-19b7-40ab-81c7-f37d60b18ddd admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:05.067139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae4f47-85a7-4cf5-a408-50e27cfa7c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:05.067846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae4f47-85a7-4cf5-a408-50e27cfa7c9b admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:05.068135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae4f47-85a7-4cf5-a408-50e27cfa7c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:05.068416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eae4f47-85a7-4cf5-a408-50e27cfa7c9b admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:05.069128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae4f47-85a7-4cf5-a408-50e27cfa7c9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:05.071164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eae4f47-85a7-4cf5-a408-50e27cfa7c9b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:05.133465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882454d2-fc7b-494d-9edb-1804d3dc9374 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:05.134171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882454d2-fc7b-494d-9edb-1804d3dc9374 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:05.134469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882454d2-fc7b-494d-9edb-1804d3dc9374 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:05.134758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882454d2-fc7b-494d-9edb-1804d3dc9374 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:05.243570 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3864/7829] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:47:04 2022] POST /identity/v3/users => generated 298 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:05.262709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae4f47-85a7-4cf5-a408-50e27cfa7c9b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:05.306530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eae4f47-85a7-4cf5-a408-50e27cfa7c9b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:05.331010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ede641-9416-41c3-9cb9-03e9466bd2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:05.331713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ede641-9416-41c3-9cb9-03e9466bd2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:05.332005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ede641-9416-41c3-9cb9-03e9466bd2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:05.332290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ede641-9416-41c3-9cb9-03e9466bd2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:05.333044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ede641-9416-41c3-9cb9-03e9466bd2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:05.334754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ede641-9416-41c3-9cb9-03e9466bd2c6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:05.352683 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:05.354562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882454d2-fc7b-494d-9edb-1804d3dc9374 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:05.358480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882454d2-fc7b-494d-9edb-1804d3dc9374 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:05.379980 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3966/7830] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:47:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:47:05.411232 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3865/7831] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:05.412451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882454d2-fc7b-494d-9edb-1804d3dc9374 service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:05.433319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882454d2-fc7b-494d-9edb-1804d3dc9374 service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:05.456584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e02a8a-4a75-462f-b969-fdf8109e5cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:05.458463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e02a8a-4a75-462f-b969-fdf8109e5cae admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:05.458760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e02a8a-4a75-462f-b969-fdf8109e5cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:05.459259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e02a8a-4a75-462f-b969-fdf8109e5cae admin admin] PATH_INFO: `/v3/projects/056afd7c92eb4af4856d7a0d569fb95f/users/e1bbec617b204476983c35cb018a8d96/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:05.522825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e02a8a-4a75-462f-b969-fdf8109e5cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=056afd7c92eb4af4856d7a0d569fb95f, user_id=e1bbec617b204476983c35cb018a8d96, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:05.544563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e02a8a-4a75-462f-b969-fdf8109e5cae admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:05.657186 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3967/7832] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:47:05 2022] PUT /identity/v3/projects/056afd7c92eb4af4856d7a0d569fb95f/users/e1bbec617b204476983c35cb018a8d96/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:47:05.659923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ede641-9416-41c3-9cb9-03e9466bd2c6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:05.675370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ede641-9416-41c3-9cb9-03e9466bd2c6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:05.949276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006059ac-9a9b-4929-8a56-072a51369e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:05.950009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006059ac-9a9b-4929-8a56-072a51369e1a admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:05.950347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006059ac-9a9b-4929-8a56-072a51369e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:05.950628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006059ac-9a9b-4929-8a56-072a51369e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:05.951381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006059ac-9a9b-4929-8a56-072a51369e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:05.953054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006059ac-9a9b-4929-8a56-072a51369e1a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:05.991510 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3866/7833] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:05 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:05.995693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e02a8a-4a75-462f-b969-fdf8109e5cae admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:06.017982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e02a8a-4a75-462f-b969-fdf8109e5cae admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:06.049343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00053c10-0ca5-44b5-8f73-016852998903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:06.050321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00053c10-0ca5-44b5-8f73-016852998903 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:06.050600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00053c10-0ca5-44b5-8f73-016852998903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:06.050922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00053c10-0ca5-44b5-8f73-016852998903 admin admin] PATH_INFO: `/v3/projects/056afd7c92eb4af4856d7a0d569fb95f/users/e1bbec617b204476983c35cb018a8d96/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:06.065269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00053c10-0ca5-44b5-8f73-016852998903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=056afd7c92eb4af4856d7a0d569fb95f, user_id=e1bbec617b204476983c35cb018a8d96, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:06.068285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00053c10-0ca5-44b5-8f73-016852998903 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:06.106446 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3968/7834] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:47:05 2022] PUT /identity/v3/projects/056afd7c92eb4af4856d7a0d569fb95f/users/e1bbec617b204476983c35cb018a8d96/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:06.185872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330b9ff-070d-4f86-be33-86186bd18bb9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:06.186862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330b9ff-070d-4f86-be33-86186bd18bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:06.187325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0330b9ff-070d-4f86-be33-86186bd18bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:06.240655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0330b9ff-070d-4f86-be33-86186bd18bb9 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:06.242336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0330b9ff-070d-4f86-be33-86186bd18bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:06.502505 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3867/7835] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:47:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:06.516935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00053c10-0ca5-44b5-8f73-016852998903 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:06.736125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00053c10-0ca5-44b5-8f73-016852998903 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:06.765865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebee65-c98a-4fb1-ad52-7ce34e713094 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:06.765865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebee65-c98a-4fb1-ad52-7ce34e713094 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:06.765865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebee65-c98a-4fb1-ad52-7ce34e713094 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:06.765865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebee65-c98a-4fb1-ad52-7ce34e713094 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:06.787100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebee65-c98a-4fb1-ad52-7ce34e713094 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:06.788937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebee65-c98a-4fb1-ad52-7ce34e713094 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:06.820827 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3969/7836] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:47:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:47:07.896387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea72ea7-e724-4471-bfe3-38641d656c3d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:07.897957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea72ea7-e724-4471-bfe3-38641d656c3d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:07.898462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea72ea7-e724-4471-bfe3-38641d656c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:07.973207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9ea72ea7-e724-4471-bfe3-38641d656c3d None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:07.974502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9ea72ea7-e724-4471-bfe3-38641d656c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:08.025825 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3868/7837] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:47:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:08.034809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebee65-c98a-4fb1-ad52-7ce34e713094 service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:08.037394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d7ebee65-c98a-4fb1-ad52-7ce34e713094 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:08.041564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea72ea7-e724-4471-bfe3-38641d656c3d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:08.103455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea72ea7-e724-4471-bfe3-38641d656c3d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:08.122803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c5524-2239-45c5-ba87-9e71a2e63487 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:08.123486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c5524-2239-45c5-ba87-9e71a2e63487 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:08.123779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c5524-2239-45c5-ba87-9e71a2e63487 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:08.124063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c5524-2239-45c5-ba87-9e71a2e63487 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:08.151322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c5524-2239-45c5-ba87-9e71a2e63487 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:08.152947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c5524-2239-45c5-ba87-9e71a2e63487 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:08.189413 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3869/7838] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:47:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 14:47:08.397640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebee65-c98a-4fb1-ad52-7ce34e713094 service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:08.418038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765bb2a-faa1-49be-a8af-7a0e23f98747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:08.418982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765bb2a-faa1-49be-a8af-7a0e23f98747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:08.419266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765bb2a-faa1-49be-a8af-7a0e23f98747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:08.419543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765bb2a-faa1-49be-a8af-7a0e23f98747 admin admin] PATH_INFO: `/v3/users/754268e5833e4305873832be26859da7` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:08.434679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765bb2a-faa1-49be-a8af-7a0e23f98747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=754268e5833e4305873832be26859da7)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:08.436677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765bb2a-faa1-49be-a8af-7a0e23f98747 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:08.701664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3765bb2a-faa1-49be-a8af-7a0e23f98747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '754268e5833e4305873832be26859da7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:08.710544 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:08.720058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3765bb2a-faa1-49be-a8af-7a0e23f98747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '754268e5833e4305873832be26859da7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:08.739348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3765bb2a-faa1-49be-a8af-7a0e23f98747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '754268e5833e4305873832be26859da7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:08.740451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3765bb2a-faa1-49be-a8af-7a0e23f98747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '754268e5833e4305873832be26859da7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:08.780189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c5524-2239-45c5-ba87-9e71a2e63487 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:08.782220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d30c5524-2239-45c5-ba87-9e71a2e63487 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:08.827029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c5524-2239-45c5-ba87-9e71a2e63487 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:08.830849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3765bb2a-faa1-49be-a8af-7a0e23f98747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '754268e5833e4305873832be26859da7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:08.845926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cebafe-b73c-4527-a736-e809ca2f5cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:08.846979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cebafe-b73c-4527-a736-e809ca2f5cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:08.847336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cebafe-b73c-4527-a736-e809ca2f5cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:08.847729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cebafe-b73c-4527-a736-e809ca2f5cea admin admin] PATH_INFO: `/v3/projects/971c24dcdb3144b18a89dbd18f5a296f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:08.850123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cebafe-b73c-4527-a736-e809ca2f5cea admin admin] RBAC: Authorizing `identity:delete_project(project_id=971c24dcdb3144b18a89dbd18f5a296f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:08.852262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cebafe-b73c-4527-a736-e809ca2f5cea admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:08.861585 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3970/7839] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:47:08 2022] DELETE /identity/v3/users/754268e5833e4305873832be26859da7 => generated 0 bytes in 825 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:08.874943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e41b50-2b85-4cf7-b2e0-713ac016571c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:08.880258 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e41b50-2b85-4cf7-b2e0-713ac016571c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:08.886154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e41b50-2b85-4cf7-b2e0-713ac016571c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:08.888976 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:08.992028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-45e41b50-2b85-4cf7-b2e0-713ac016571c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:08.993287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-45e41b50-2b85-4cf7-b2e0-713ac016571c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:09.057928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-02cebafe-b73c-4527-a736-e809ca2f5cea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '971c24dcdb3144b18a89dbd18f5a296f', 'request_id': 'req-02cebafe-b73c-4527-a736-e809ca2f5cea'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:09.132571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-02cebafe-b73c-4527-a736-e809ca2f5cea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '971c24dcdb3144b18a89dbd18f5a296f', 'request_id': 'req-02cebafe-b73c-4527-a736-e809ca2f5cea'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:09.137195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-02cebafe-b73c-4527-a736-e809ca2f5cea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '971c24dcdb3144b18a89dbd18f5a296f', 'request_id': 'req-02cebafe-b73c-4527-a736-e809ca2f5cea'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:09.164454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-02cebafe-b73c-4527-a736-e809ca2f5cea admin admin] The token cache is being invalidate because project 971c24dcdb3144b18a89dbd18f5a296f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:47:09.165092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-02cebafe-b73c-4527-a736-e809ca2f5cea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:09.167910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-02cebafe-b73c-4527-a736-e809ca2f5cea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:09.171695 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3870/7840] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:47:08 2022] DELETE /identity/v3/projects/971c24dcdb3144b18a89dbd18f5a296f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:47:09.180726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53656ca-6cdf-4f90-b718-0c6abc79b041 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:09.181246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53656ca-6cdf-4f90-b718-0c6abc79b041 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:09.181747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53656ca-6cdf-4f90-b718-0c6abc79b041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:09.263267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b53656ca-6cdf-4f90-b718-0c6abc79b041 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:09.264704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b53656ca-6cdf-4f90-b718-0c6abc79b041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:09.349305 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3971/7841] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:09.360781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e41b50-2b85-4cf7-b2e0-713ac016571c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:09.362859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-45e41b50-2b85-4cf7-b2e0-713ac016571c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:09.448207 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3871/7842] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:09.462122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6e622-36a9-4e6d-bcb1-0fcf793087fc None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:09.462425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6e622-36a9-4e6d-bcb1-0fcf793087fc None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:09.462709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6e622-36a9-4e6d-bcb1-0fcf793087fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:09.554638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-fab6e622-36a9-4e6d-bcb1-0fcf793087fc None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:09.573428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fab6e622-36a9-4e6d-bcb1-0fcf793087fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:09.610620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e41b50-2b85-4cf7-b2e0-713ac016571c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:09.619137 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3872/7843] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:09.622391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6e622-36a9-4e6d-bcb1-0fcf793087fc None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:09.672144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6e622-36a9-4e6d-bcb1-0fcf793087fc None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:09.695028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c6b97-6e10-4932-9cbf-00879fcdb72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:09.695733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c6b97-6e10-4932-9cbf-00879fcdb72e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:09.696041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c6b97-6e10-4932-9cbf-00879fcdb72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:09.696795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c6b97-6e10-4932-9cbf-00879fcdb72e admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:09.703537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c6b97-6e10-4932-9cbf-00879fcdb72e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:47:09.703537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c6b97-6e10-4932-9cbf-00879fcdb72e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:09.703537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708c6b97-6e10-4932-9cbf-00879fcdb72e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:09.767733 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3873/7844] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:47:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:47:09.773616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c6b97-6e10-4932-9cbf-00879fcdb72e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:09.820863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c6b97-6e10-4932-9cbf-00879fcdb72e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:09.841422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e2227-30c2-4e63-984e-5ab459822848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:09.842143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e2227-30c2-4e63-984e-5ab459822848 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:09.842439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e2227-30c2-4e63-984e-5ab459822848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:09.842718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03e2227-30c2-4e63-984e-5ab459822848 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:09.847485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e2227-30c2-4e63-984e-5ab459822848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:09.849521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03e2227-30c2-4e63-984e-5ab459822848 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:09.860043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155ff1c-4d79-42bc-be09-5e8075c93dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:09.860737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155ff1c-4d79-42bc-be09-5e8075c93dff service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:09.861026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155ff1c-4d79-42bc-be09-5e8075c93dff service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:09.861306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155ff1c-4d79-42bc-be09-5e8075c93dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:09.892791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155ff1c-4d79-42bc-be09-5e8075c93dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:09.896937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155ff1c-4d79-42bc-be09-5e8075c93dff service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:09.920823 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3972/7845] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:47:09.929573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155ff1c-4d79-42bc-be09-5e8075c93dff service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:09.939238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0155ff1c-4d79-42bc-be09-5e8075c93dff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:10.010970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155ff1c-4d79-42bc-be09-5e8075c93dff service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:10.046284 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3874/7846] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:47:09 2022] POST /identity/v3/projects => generated 399 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:10.051059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e2227-30c2-4e63-984e-5ab459822848 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:10.056702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a78b05-0e1c-4056-9f5d-188852ac5f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:10.063142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a78b05-0e1c-4056-9f5d-188852ac5f21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:10.063142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a78b05-0e1c-4056-9f5d-188852ac5f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:10.063142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a78b05-0e1c-4056-9f5d-188852ac5f21 admin admin] PATH_INFO: `/v3/users/ca7f1681db2c4079bae65f1e23093480` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:10.070161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a78b05-0e1c-4056-9f5d-188852ac5f21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca7f1681db2c4079bae65f1e23093480)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:10.072248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a78b05-0e1c-4056-9f5d-188852ac5f21 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:10.135891 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:10.335875 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:10.349321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03e2227-30c2-4e63-984e-5ab459822848 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:10.363430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a1a78b05-0e1c-4056-9f5d-188852ac5f21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca7f1681db2c4079bae65f1e23093480'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:10.384540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079132b-4b13-4522-bc1c-0e52737048c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:10.386543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079132b-4b13-4522-bc1c-0e52737048c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:10.388583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079132b-4b13-4522-bc1c-0e52737048c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:10.388881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6079132b-4b13-4522-bc1c-0e52737048c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:10.391960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079132b-4b13-4522-bc1c-0e52737048c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:10.406642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6079132b-4b13-4522-bc1c-0e52737048c7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:10.418904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a1a78b05-0e1c-4056-9f5d-188852ac5f21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca7f1681db2c4079bae65f1e23093480'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:10.453051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a1a78b05-0e1c-4056-9f5d-188852ac5f21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca7f1681db2c4079bae65f1e23093480'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:10.456626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a1a78b05-0e1c-4056-9f5d-188852ac5f21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca7f1681db2c4079bae65f1e23093480'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:10.558079 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3875/7847] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:47:10 2022] POST /identity/v3/users => generated 300 bytes in 508 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:10.559439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079132b-4b13-4522-bc1c-0e52737048c7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:10.563276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6079132b-4b13-4522-bc1c-0e52737048c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:10.579382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6079132b-4b13-4522-bc1c-0e52737048c7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:10.586351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a1a78b05-0e1c-4056-9f5d-188852ac5f21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca7f1681db2c4079bae65f1e23093480'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:10.588515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c324ffc-75b8-4839-9284-b6a60e42e46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:10.590230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c324ffc-75b8-4839-9284-b6a60e42e46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:10.594356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c324ffc-75b8-4839-9284-b6a60e42e46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:10.594356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c324ffc-75b8-4839-9284-b6a60e42e46a admin admin] PATH_INFO: `/v3/users/7a090334034e4dc790a36c3283f7561d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:10.594356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c324ffc-75b8-4839-9284-b6a60e42e46a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a090334034e4dc790a36c3283f7561d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:10.597075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c324ffc-75b8-4839-9284-b6a60e42e46a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:10.597781 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3973/7848] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:47:09 2022] DELETE /identity/v3/users/ca7f1681db2c4079bae65f1e23093480 => generated 0 bytes in 667 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:10.598822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a78b05-0e1c-4056-9f5d-188852ac5f21 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:10.605739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a1a78b05-0e1c-4056-9f5d-188852ac5f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:10.805587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a78b05-0e1c-4056-9f5d-188852ac5f21 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:10.813090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d0bbe-afab-47e7-ab2e-5d77849c08ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:10.813814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d0bbe-afab-47e7-ab2e-5d77849c08ec admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:10.814130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d0bbe-afab-47e7-ab2e-5d77849c08ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:10.817420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d0bbe-afab-47e7-ab2e-5d77849c08ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:10.818621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d0bbe-afab-47e7-ab2e-5d77849c08ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:10.824737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2d0bbe-afab-47e7-ab2e-5d77849c08ec admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:10.849034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1c324ffc-75b8-4839-9284-b6a60e42e46a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a090334034e4dc790a36c3283f7561d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:10.854882 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3974/7849] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:10.858896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d9650-d754-4036-b6da-73f76fecdb92 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:10.859185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d9650-d754-4036-b6da-73f76fecdb92 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:10.860073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76d9650-d754-4036-b6da-73f76fecdb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:10.914656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e76d9650-d754-4036-b6da-73f76fecdb92 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:10.920506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e76d9650-d754-4036-b6da-73f76fecdb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:10.925894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1c324ffc-75b8-4839-9284-b6a60e42e46a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a090334034e4dc790a36c3283f7561d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:10.927782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1c324ffc-75b8-4839-9284-b6a60e42e46a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a090334034e4dc790a36c3283f7561d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:10.929599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1c324ffc-75b8-4839-9284-b6a60e42e46a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a090334034e4dc790a36c3283f7561d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:10.934143 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3975/7850] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:10.934143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d9650-d754-4036-b6da-73f76fecdb92 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:10.956191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1c324ffc-75b8-4839-9284-b6a60e42e46a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a090334034e4dc790a36c3283f7561d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:10.971398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76d9650-d754-4036-b6da-73f76fecdb92 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:10.986978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06478fde-9865-43a8-a214-8a5e50c49635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:10.987909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06478fde-9865-43a8-a214-8a5e50c49635 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:10.988198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06478fde-9865-43a8-a214-8a5e50c49635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:10.990189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06478fde-9865-43a8-a214-8a5e50c49635 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:10.992314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06478fde-9865-43a8-a214-8a5e50c49635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:10.994029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06478fde-9865-43a8-a214-8a5e50c49635 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:11.024447 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3976/7851] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:11.025406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06478fde-9865-43a8-a214-8a5e50c49635 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:11.029473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-06478fde-9865-43a8-a214-8a5e50c49635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:11.070541 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3876/7852] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:47:10 2022] DELETE /identity/v3/users/7a090334034e4dc790a36c3283f7561d => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:11.071661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c324ffc-75b8-4839-9284-b6a60e42e46a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:11.075742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1c324ffc-75b8-4839-9284-b6a60e42e46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:11.137708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06478fde-9865-43a8-a214-8a5e50c49635 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:11.191114 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:11.218708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ed67b-18fe-4468-bf49-7bf31a478f50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:11.219660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ed67b-18fe-4468-bf49-7bf31a478f50 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:11.222804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ed67b-18fe-4468-bf49-7bf31a478f50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:11.223115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ed67b-18fe-4468-bf49-7bf31a478f50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:11.231024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c73ed67b-18fe-4468-bf49-7bf31a478f50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:11.254910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c324ffc-75b8-4839-9284-b6a60e42e46a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:11.261346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ed67b-18fe-4468-bf49-7bf31a478f50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:11.262840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ed67b-18fe-4468-bf49-7bf31a478f50 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:11.263252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30ac42-cdc8-4f63-9327-fdeb1e15c79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:11.264534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30ac42-cdc8-4f63-9327-fdeb1e15c79d admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:11.269518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30ac42-cdc8-4f63-9327-fdeb1e15c79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:11.269518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa30ac42-cdc8-4f63-9327-fdeb1e15c79d admin admin] PATH_INFO: `/v3/projects/cce12cce446d44deb6e465c5f180c821/users/05b84993c58d49ce9b37713ccbb7925e/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:11.292054 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3977/7853] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:47:11.292951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75661c-216e-4f53-992e-9a7305e482e7 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:11.293364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75661c-216e-4f53-992e-9a7305e482e7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:11.293659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75661c-216e-4f53-992e-9a7305e482e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:11.307579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30ac42-cdc8-4f63-9327-fdeb1e15c79d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cce12cce446d44deb6e465c5f180c821, user_id=05b84993c58d49ce9b37713ccbb7925e, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:11.311879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa30ac42-cdc8-4f63-9327-fdeb1e15c79d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:11.334241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5f75661c-216e-4f53-992e-9a7305e482e7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:11.334241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5f75661c-216e-4f53-992e-9a7305e482e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:11.367776 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3978/7854] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:11.368697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75661c-216e-4f53-992e-9a7305e482e7 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:11.371396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5f75661c-216e-4f53-992e-9a7305e482e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:11.390867 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3877/7855] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:47:11 2022] PUT /identity/v3/projects/cce12cce446d44deb6e465c5f180c821/users/05b84993c58d49ce9b37713ccbb7925e/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:11.390867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30ac42-cdc8-4f63-9327-fdeb1e15c79d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:11.404996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75661c-216e-4f53-992e-9a7305e482e7 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:11.524458 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:11.545143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9514a-5889-4011-a425-0448a84ce90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:11.554728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9514a-5889-4011-a425-0448a84ce90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:11.554728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9514a-5889-4011-a425-0448a84ce90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:11.554728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9514a-5889-4011-a425-0448a84ce90b admin admin] PATH_INFO: `/v3/projects/4efd0fa2a10c4d8faa56dbfb82cad24f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:11.554728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9514a-5889-4011-a425-0448a84ce90b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4efd0fa2a10c4d8faa56dbfb82cad24f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:11.554728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9514a-5889-4011-a425-0448a84ce90b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:11.563563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa30ac42-cdc8-4f63-9327-fdeb1e15c79d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:11.573571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9267e05-6297-4f8a-bc7d-9c33aee985a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:11.575562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9267e05-6297-4f8a-bc7d-9c33aee985a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:11.576123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9267e05-6297-4f8a-bc7d-9c33aee985a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:11.576599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9267e05-6297-4f8a-bc7d-9c33aee985a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:11.588439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9267e05-6297-4f8a-bc7d-9c33aee985a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:11.589532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9267e05-6297-4f8a-bc7d-9c33aee985a3 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:11.605193 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3878/7856] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:47:11.616223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42d129-9f58-4b9b-a8fc-c87b39ae7d4a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:11.619774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42d129-9f58-4b9b-a8fc-c87b39ae7d4a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:11.620387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42d129-9f58-4b9b-a8fc-c87b39ae7d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:11.671823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1c42d129-9f58-4b9b-a8fc-c87b39ae7d4a None None] MFA Rules not processed for user `05b84993c58d49ce9b37713ccbb7925e`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:11.674123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1c42d129-9f58-4b9b-a8fc-c87b39ae7d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:11.759696 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3879/7857] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:11.776856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42d129-9f58-4b9b-a8fc-c87b39ae7d4a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:11.779214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1c42d129-9f58-4b9b-a8fc-c87b39ae7d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:11.796426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d6e9514a-5889-4011-a425-0448a84ce90b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4efd0fa2a10c4d8faa56dbfb82cad24f', 'request_id': 'req-d6e9514a-5889-4011-a425-0448a84ce90b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:11.821367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d6e9514a-5889-4011-a425-0448a84ce90b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4efd0fa2a10c4d8faa56dbfb82cad24f', 'request_id': 'req-d6e9514a-5889-4011-a425-0448a84ce90b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:11.830429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d6e9514a-5889-4011-a425-0448a84ce90b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4efd0fa2a10c4d8faa56dbfb82cad24f', 'request_id': 'req-d6e9514a-5889-4011-a425-0448a84ce90b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:11.909794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d6e9514a-5889-4011-a425-0448a84ce90b admin admin] The token cache is being invalidate because project 4efd0fa2a10c4d8faa56dbfb82cad24f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:47:11.910366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d6e9514a-5889-4011-a425-0448a84ce90b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:11.913785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d6e9514a-5889-4011-a425-0448a84ce90b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:11.918997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42d129-9f58-4b9b-a8fc-c87b39ae7d4a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:11.924015 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3979/7858] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:47:11 2022] DELETE /identity/v3/projects/4efd0fa2a10c4d8faa56dbfb82cad24f => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:11.925725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52897f-1741-45ae-897a-b750aaba7e99 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:11.927033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52897f-1741-45ae-897a-b750aaba7e99 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:11.927326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52897f-1741-45ae-897a-b750aaba7e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:11.980982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-db52897f-1741-45ae-897a-b750aaba7e99 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:11.982369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-db52897f-1741-45ae-897a-b750aaba7e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:12.033925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8a789-1369-4b53-83da-0e12e7e0726f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:12.035383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8a789-1369-4b53-83da-0e12e7e0726f service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:12.035684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8a789-1369-4b53-83da-0e12e7e0726f service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:12.035967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8a789-1369-4b53-83da-0e12e7e0726f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:12.041567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-55a8a789-1369-4b53-83da-0e12e7e0726f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:12.105351 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:12.124074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8a789-1369-4b53-83da-0e12e7e0726f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:12.126506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8a789-1369-4b53-83da-0e12e7e0726f service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:12.137282 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3880/7859] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:47:12.166550 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:12.202696 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3980/7860] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:12.211722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b37b70-4e85-4da4-b558-d440f288b680 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:12.212086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b37b70-4e85-4da4-b558-d440f288b680 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:12.212296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b37b70-4e85-4da4-b558-d440f288b680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:12.259150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a1b37b70-4e85-4da4-b558-d440f288b680 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:12.265309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a1b37b70-4e85-4da4-b558-d440f288b680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:12.293494 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3881/7861] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:12.298892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52897f-1741-45ae-897a-b750aaba7e99 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:12.318392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52897f-1741-45ae-897a-b750aaba7e99 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:12.333071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10081ba-4653-463a-82d2-d5391ca3d825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:12.334243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10081ba-4653-463a-82d2-d5391ca3d825 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:12.334544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10081ba-4653-463a-82d2-d5391ca3d825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:12.334818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10081ba-4653-463a-82d2-d5391ca3d825 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:12.335703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10081ba-4653-463a-82d2-d5391ca3d825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:47:12.336024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10081ba-4653-463a-82d2-d5391ca3d825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:12.337658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10081ba-4653-463a-82d2-d5391ca3d825 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:12.385267 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3981/7862] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:47:12.387147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b37b70-4e85-4da4-b558-d440f288b680 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:12.399853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b37b70-4e85-4da4-b558-d440f288b680 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:12.414724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92c787-96c4-45d1-b380-fd6ee5c19deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:12.415937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92c787-96c4-45d1-b380-fd6ee5c19deb admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:12.416224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92c787-96c4-45d1-b380-fd6ee5c19deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:12.416565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92c787-96c4-45d1-b380-fd6ee5c19deb admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:12.417267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92c787-96c4-45d1-b380-fd6ee5c19deb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:12.421383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92c787-96c4-45d1-b380-fd6ee5c19deb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:12.579858 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3882/7863] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:47:12 2022] POST /identity/v3/projects => generated 383 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:12.583670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10081ba-4653-463a-82d2-d5391ca3d825 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:12.599483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10081ba-4653-463a-82d2-d5391ca3d825 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:12.813320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e25e77-8526-4768-b121-91998af1a92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:12.814164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e25e77-8526-4768-b121-91998af1a92f admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:12.814464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e25e77-8526-4768-b121-91998af1a92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:12.814758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e25e77-8526-4768-b121-91998af1a92f admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:12.819242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e25e77-8526-4768-b121-91998af1a92f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:12.824814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e25e77-8526-4768-b121-91998af1a92f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:12.914748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92c787-96c4-45d1-b380-fd6ee5c19deb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:12.917089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ba92c787-96c4-45d1-b380-fd6ee5c19deb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:12.948724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92c787-96c4-45d1-b380-fd6ee5c19deb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:12.961564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ed093-c1e4-4d96-b162-90e631b34bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:12.964484 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3982/7864] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:47:12 2022] POST /identity/v3/users => generated 292 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:12.968455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e25e77-8526-4768-b121-91998af1a92f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:12.971881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f4e25e77-8526-4768-b121-91998af1a92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:12.989667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ed093-c1e4-4d96-b162-90e631b34bf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:12.995107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ed093-c1e4-4d96-b162-90e631b34bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:12.995107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ed093-c1e4-4d96-b162-90e631b34bf6 admin admin] PATH_INFO: `/v3/projects/773bb2d8b4e24a6e82d5aed31d776761` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:12.995903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ed093-c1e4-4d96-b162-90e631b34bf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=773bb2d8b4e24a6e82d5aed31d776761)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:12.997970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ed093-c1e4-4d96-b162-90e631b34bf6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:13.011366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e25e77-8526-4768-b121-91998af1a92f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:13.026981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b62ea19-6ee1-448b-a063-b57a9f36354d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:13.027880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62ea19-6ee1-448b-a063-b57a9f36354d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:13.028172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62ea19-6ee1-448b-a063-b57a9f36354d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:13.028458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62ea19-6ee1-448b-a063-b57a9f36354d admin admin] PATH_INFO: `/v3/projects/6458913670bf4854a1d9e98d19e39e3f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:13.031678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62ea19-6ee1-448b-a063-b57a9f36354d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6458913670bf4854a1d9e98d19e39e3f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:13.033760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b62ea19-6ee1-448b-a063-b57a9f36354d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:13.226290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c2ed093-c1e4-4d96-b162-90e631b34bf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '773bb2d8b4e24a6e82d5aed31d776761', 'request_id': 'req-4c2ed093-c1e4-4d96-b162-90e631b34bf6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:13.246459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b62ea19-6ee1-448b-a063-b57a9f36354d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6458913670bf4854a1d9e98d19e39e3f', 'request_id': 'req-7b62ea19-6ee1-448b-a063-b57a9f36354d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:13.262419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b62ea19-6ee1-448b-a063-b57a9f36354d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6458913670bf4854a1d9e98d19e39e3f', 'request_id': 'req-7b62ea19-6ee1-448b-a063-b57a9f36354d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:13.277793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b62ea19-6ee1-448b-a063-b57a9f36354d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6458913670bf4854a1d9e98d19e39e3f', 'request_id': 'req-7b62ea19-6ee1-448b-a063-b57a9f36354d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:13.294299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c2ed093-c1e4-4d96-b162-90e631b34bf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '773bb2d8b4e24a6e82d5aed31d776761', 'request_id': 'req-4c2ed093-c1e4-4d96-b162-90e631b34bf6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:13.306614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c2ed093-c1e4-4d96-b162-90e631b34bf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '773bb2d8b4e24a6e82d5aed31d776761', 'request_id': 'req-4c2ed093-c1e4-4d96-b162-90e631b34bf6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:13.326559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c2ed093-c1e4-4d96-b162-90e631b34bf6 admin admin] The token cache is being invalidate because project 773bb2d8b4e24a6e82d5aed31d776761 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:47:13.331773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c2ed093-c1e4-4d96-b162-90e631b34bf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:13.331773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c2ed093-c1e4-4d96-b162-90e631b34bf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:13.331773 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3883/7865] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:47:12 2022] DELETE /identity/v3/projects/773bb2d8b4e24a6e82d5aed31d776761 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:13.332716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ed093-c1e4-4d96-b162-90e631b34bf6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:13.334501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4c2ed093-c1e4-4d96-b162-90e631b34bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:13.389635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b62ea19-6ee1-448b-a063-b57a9f36354d admin admin] The token cache is being invalidate because project 6458913670bf4854a1d9e98d19e39e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:47:13.389635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b62ea19-6ee1-448b-a063-b57a9f36354d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:13.390149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b62ea19-6ee1-448b-a063-b57a9f36354d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:13.401772 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3983/7866] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:47:12 2022] DELETE /identity/v3/projects/6458913670bf4854a1d9e98d19e39e3f => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:13.410687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84ac9f-0e90-42ce-8d22-31341a8991e9 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:13.410986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84ac9f-0e90-42ce-8d22-31341a8991e9 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:13.411462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa84ac9f-0e90-42ce-8d22-31341a8991e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:13.482923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-fa84ac9f-0e90-42ce-8d22-31341a8991e9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:13.487193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fa84ac9f-0e90-42ce-8d22-31341a8991e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:13.535248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ed093-c1e4-4d96-b162-90e631b34bf6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:13.631068 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:13.648887 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:13.673877 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3984/7867] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:13.683008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b2712-c3fe-4e62-ab7a-7b525833d12c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:13.683568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b2712-c3fe-4e62-ab7a-7b525833d12c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:13.683568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b2712-c3fe-4e62-ab7a-7b525833d12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:13.690221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64df0c-bde1-4870-9152-0e8f7a6c7fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:13.690936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64df0c-bde1-4870-9152-0e8f7a6c7fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:13.691228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64df0c-bde1-4870-9152-0e8f7a6c7fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:13.691535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64df0c-bde1-4870-9152-0e8f7a6c7fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:13.692425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64df0c-bde1-4870-9152-0e8f7a6c7fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:13.694133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d64df0c-bde1-4870-9152-0e8f7a6c7fa9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:13.721605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-429b2712-c3fe-4e62-ab7a-7b525833d12c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:13.722877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-429b2712-c3fe-4e62-ab7a-7b525833d12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:13.729205 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3884/7868] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:13.730673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95e44d-c060-4d4c-a107-23b59afa3398 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:13.730969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95e44d-c060-4d4c-a107-23b59afa3398 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:13.731250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95e44d-c060-4d4c-a107-23b59afa3398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:13.752071 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3985/7869] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:13.752896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b2712-c3fe-4e62-ab7a-7b525833d12c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:13.754323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-429b2712-c3fe-4e62-ab7a-7b525833d12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:13.775480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-fd95e44d-c060-4d4c-a107-23b59afa3398 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:13.776176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b2712-c3fe-4e62-ab7a-7b525833d12c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:13.776697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fd95e44d-c060-4d4c-a107-23b59afa3398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:13.791847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a43a31-4b4a-47ab-bfea-439cf608861a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:13.792520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a43a31-4b4a-47ab-bfea-439cf608861a admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:13.792812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a43a31-4b4a-47ab-bfea-439cf608861a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:13.793097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a43a31-4b4a-47ab-bfea-439cf608861a admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:13.793847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a43a31-4b4a-47ab-bfea-439cf608861a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:13.795679 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a43a31-4b4a-47ab-bfea-439cf608861a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:13.805094 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3885/7870] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:13.805094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c904d-8765-4dd2-a887-3b1e3c8af186 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:13.805094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c904d-8765-4dd2-a887-3b1e3c8af186 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:13.805094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c904d-8765-4dd2-a887-3b1e3c8af186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:13.846185 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3986/7871] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:13.847369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a43a31-4b4a-47ab-bfea-439cf608861a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:13.881145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a43a31-4b4a-47ab-bfea-439cf608861a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:13.887403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da6442-60dd-48c3-af73-0f100dfef5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:13.888512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da6442-60dd-48c3-af73-0f100dfef5c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:13.889912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da6442-60dd-48c3-af73-0f100dfef5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:13.891117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da6442-60dd-48c3-af73-0f100dfef5c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:13.893039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da6442-60dd-48c3-af73-0f100dfef5c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:47:13.895433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da6442-60dd-48c3-af73-0f100dfef5c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:13.898879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da6442-60dd-48c3-af73-0f100dfef5c0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:13.912808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-909c904d-8765-4dd2-a887-3b1e3c8af186 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:13.923543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-909c904d-8765-4dd2-a887-3b1e3c8af186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:13.932838 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3987/7872] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:47:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:47:13.934004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da6442-60dd-48c3-af73-0f100dfef5c0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:13.947745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da6442-60dd-48c3-af73-0f100dfef5c0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:13.954402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d954cc-8b9e-4263-87be-40132ef1637b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:13.967903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d954cc-8b9e-4263-87be-40132ef1637b admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:13.969628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d954cc-8b9e-4263-87be-40132ef1637b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:13.971737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d954cc-8b9e-4263-87be-40132ef1637b admin admin] PATH_INFO: `/v3/projects/841ccaca154c4143b58ac9bb162f72b7/users/c787dc6ce1df4d378f54af37ef188a06/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:13.981682 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3886/7873] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:13.987073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c904d-8765-4dd2-a887-3b1e3c8af186 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:14.035822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d954cc-8b9e-4263-87be-40132ef1637b admin admin] RBAC: Authorizing `identity:create_grant(project_id=841ccaca154c4143b58ac9bb162f72b7, user_id=c787dc6ce1df4d378f54af37ef188a06, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:14.042936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c904d-8765-4dd2-a887-3b1e3c8af186 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:14.046517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d954cc-8b9e-4263-87be-40132ef1637b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:14.064028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f10704-dbdc-4b7f-877d-b02789ce5825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:14.064730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f10704-dbdc-4b7f-877d-b02789ce5825 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:14.065055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f10704-dbdc-4b7f-877d-b02789ce5825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:14.065396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f10704-dbdc-4b7f-877d-b02789ce5825 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:14.066134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f10704-dbdc-4b7f-877d-b02789ce5825 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:14.068102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f10704-dbdc-4b7f-877d-b02789ce5825 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:14.181254 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3988/7874] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:47:13 2022] PUT /identity/v3/projects/841ccaca154c4143b58ac9bb162f72b7/users/c787dc6ce1df4d378f54af37ef188a06/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:14.182252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d954cc-8b9e-4263-87be-40132ef1637b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:14.209641 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3887/7875] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:47:13 2022] POST /identity/v3/projects => generated 381 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:14.211651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13332b3b-5f67-4e4b-9581-5af17addc5f7 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:14.213455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13332b3b-5f67-4e4b-9581-5af17addc5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:14.217477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13332b3b-5f67-4e4b-9581-5af17addc5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:14.274252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-13332b3b-5f67-4e4b-9581-5af17addc5f7 None None] MFA Rules not processed for user `c787dc6ce1df4d378f54af37ef188a06`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:14.275640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-13332b3b-5f67-4e4b-9581-5af17addc5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:14.411784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d954cc-8b9e-4263-87be-40132ef1637b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:14.445898 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3888/7876] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:14.445898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13332b3b-5f67-4e4b-9581-5af17addc5f7 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:14.534651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492e010-2808-4088-a913-6b4cccf28211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:14.535351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492e010-2808-4088-a913-6b4cccf28211 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:14.535638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492e010-2808-4088-a913-6b4cccf28211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:14.535919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492e010-2808-4088-a913-6b4cccf28211 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:14.536676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492e010-2808-4088-a913-6b4cccf28211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:47:14.536977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492e010-2808-4088-a913-6b4cccf28211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:14.539144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492e010-2808-4088-a913-6b4cccf28211 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:14.573637 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3989/7877] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:47:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:47:14.574980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492e010-2808-4088-a913-6b4cccf28211 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:14.580741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d492e010-2808-4088-a913-6b4cccf28211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:14.604314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13332b3b-5f67-4e4b-9581-5af17addc5f7 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:14.620902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ba507-6150-4a1c-a63d-b36443a197e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:14.625605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ba507-6150-4a1c-a63d-b36443a197e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:14.626185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ba507-6150-4a1c-a63d-b36443a197e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:14.626824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ba507-6150-4a1c-a63d-b36443a197e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:14.627674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ba507-6150-4a1c-a63d-b36443a197e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:14.632239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ba507-6150-4a1c-a63d-b36443a197e5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:14.707559 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:14.723859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492e010-2808-4088-a913-6b4cccf28211 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:14.727975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6985cb0-dd16-4c3c-a7c9-79c1c16225dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:14.728651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6985cb0-dd16-4c3c-a7c9-79c1c16225dc service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:14.728937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6985cb0-dd16-4c3c-a7c9-79c1c16225dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:14.729269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6985cb0-dd16-4c3c-a7c9-79c1c16225dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:14.741405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6985cb0-dd16-4c3c-a7c9-79c1c16225dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:14.743233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6985cb0-dd16-4c3c-a7c9-79c1c16225dc service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:14.744953 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3889/7878] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:47:14 2022] POST /identity/v3/users => generated 291 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:14.745918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ba507-6150-4a1c-a63d-b36443a197e5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:14.764969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ba507-6150-4a1c-a63d-b36443a197e5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:14.767303 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3990/7879] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:47:14.769387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6985cb0-dd16-4c3c-a7c9-79c1c16225dc service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:14.779466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc381a77-6bcf-41da-a57a-5ba234f79f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:14.780349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc381a77-6bcf-41da-a57a-5ba234f79f0c admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:14.780742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc381a77-6bcf-41da-a57a-5ba234f79f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:14.782031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc381a77-6bcf-41da-a57a-5ba234f79f0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:14.782909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc381a77-6bcf-41da-a57a-5ba234f79f0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:14.788563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc381a77-6bcf-41da-a57a-5ba234f79f0c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:14.802687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6985cb0-dd16-4c3c-a7c9-79c1c16225dc service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:14.817051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d72c3-1a58-422c-a169-92c65f640d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:14.818981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d72c3-1a58-422c-a169-92c65f640d39 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:14.820310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d72c3-1a58-422c-a169-92c65f640d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:14.821368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d72c3-1a58-422c-a169-92c65f640d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:14.823899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d72c3-1a58-422c-a169-92c65f640d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:14.829833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d72c3-1a58-422c-a169-92c65f640d39 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:14.857072 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3991/7880] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:14.857929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d72c3-1a58-422c-a169-92c65f640d39 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:14.888842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d72c3-1a58-422c-a169-92c65f640d39 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:14.903267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3311d-bae7-48a9-9d42-c197c3fbffb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:14.903892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3311d-bae7-48a9-9d42-c197c3fbffb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:14.904182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3311d-bae7-48a9-9d42-c197c3fbffb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:14.904463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3311d-bae7-48a9-9d42-c197c3fbffb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:14.905212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3311d-bae7-48a9-9d42-c197c3fbffb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:14.919180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3311d-bae7-48a9-9d42-c197c3fbffb1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:14.933792 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3890/7881] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:47:14 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:14.939173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc381a77-6bcf-41da-a57a-5ba234f79f0c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:14.942771 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:14.948839 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3992/7882] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:14 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:14.953794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3311d-bae7-48a9-9d42-c197c3fbffb1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:14.984816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3311d-bae7-48a9-9d42-c197c3fbffb1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:15.093003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc381a77-6bcf-41da-a57a-5ba234f79f0c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:15.105607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a7ed0-5fac-410c-99a1-615cdf22d96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:15.106475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a7ed0-5fac-410c-99a1-615cdf22d96a admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:15.109650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a7ed0-5fac-410c-99a1-615cdf22d96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:15.110124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a7ed0-5fac-410c-99a1-615cdf22d96a admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:15.112430 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a7ed0-5fac-410c-99a1-615cdf22d96a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:15.126629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a7ed0-5fac-410c-99a1-615cdf22d96a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:15.144266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7d703-d8fc-474c-9735-58297cdf50ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:15.145271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7d703-d8fc-474c-9735-58297cdf50ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:15.145566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7d703-d8fc-474c-9735-58297cdf50ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:15.145847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7d703-d8fc-474c-9735-58297cdf50ad admin admin] PATH_INFO: `/v3/projects/53fcba9449254fce9485acc10118d3b3/users/1bcd6722719e4807b66f15cd3542c1ff/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:15.185322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7d703-d8fc-474c-9735-58297cdf50ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=53fcba9449254fce9485acc10118d3b3, user_id=1bcd6722719e4807b66f15cd3542c1ff, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:15.189314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7d703-d8fc-474c-9735-58297cdf50ad admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:15.296418 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3891/7883] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:47:14 2022] POST /identity/v3/users => generated 289 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:15.300309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a7ed0-5fac-410c-99a1-615cdf22d96a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:15.304755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d26a7ed0-5fac-410c-99a1-615cdf22d96a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:15.338244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a7ed0-5fac-410c-99a1-615cdf22d96a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:15.354624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88156e35-9c9e-4012-b50d-34b4d9021668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:15.355690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88156e35-9c9e-4012-b50d-34b4d9021668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:15.356101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88156e35-9c9e-4012-b50d-34b4d9021668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:15.356617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88156e35-9c9e-4012-b50d-34b4d9021668 admin admin] PATH_INFO: `/v3/users/6bf7ea43659c44a4b3ba36fd920ae5eb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:15.358836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88156e35-9c9e-4012-b50d-34b4d9021668 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bf7ea43659c44a4b3ba36fd920ae5eb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:15.361709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88156e35-9c9e-4012-b50d-34b4d9021668 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:15.367861 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3993/7884] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:47:14 2022] PUT /identity/v3/projects/53fcba9449254fce9485acc10118d3b3/users/1bcd6722719e4807b66f15cd3542c1ff/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:15.379786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7d703-d8fc-474c-9735-58297cdf50ad admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:15.575353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-88156e35-9c9e-4012-b50d-34b4d9021668 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bf7ea43659c44a4b3ba36fd920ae5eb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:15.595129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-88156e35-9c9e-4012-b50d-34b4d9021668 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bf7ea43659c44a4b3ba36fd920ae5eb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:15.596282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-88156e35-9c9e-4012-b50d-34b4d9021668 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bf7ea43659c44a4b3ba36fd920ae5eb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:15.597623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-88156e35-9c9e-4012-b50d-34b4d9021668 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bf7ea43659c44a4b3ba36fd920ae5eb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:15.612730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-88156e35-9c9e-4012-b50d-34b4d9021668 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bf7ea43659c44a4b3ba36fd920ae5eb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:15.629732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7d703-d8fc-474c-9735-58297cdf50ad admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:15.645770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2761418-d14b-4fb9-8968-dcff9485dde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:15.647051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2761418-d14b-4fb9-8968-dcff9485dde8 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:15.647179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2761418-d14b-4fb9-8968-dcff9485dde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:15.648012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2761418-d14b-4fb9-8968-dcff9485dde8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:15.648546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2761418-d14b-4fb9-8968-dcff9485dde8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:15.654833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2761418-d14b-4fb9-8968-dcff9485dde8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:15.680314 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3892/7885] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:47:15 2022] DELETE /identity/v3/users/6bf7ea43659c44a4b3ba36fd920ae5eb => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:15.680314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7d768-7d9f-44ef-84c8-dd4608862789 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:15.680314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7d768-7d9f-44ef-84c8-dd4608862789 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:15.680314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa7d768-7d9f-44ef-84c8-dd4608862789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:15.682606 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3994/7886] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:15.682606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ec45b-6a8c-4b86-9542-b0e2d145ad69 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:15.682958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ec45b-6a8c-4b86-9542-b0e2d145ad69 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:15.690533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ec45b-6a8c-4b86-9542-b0e2d145ad69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:15.728166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b35ec45b-6a8c-4b86-9542-b0e2d145ad69 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:15.729726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b35ec45b-6a8c-4b86-9542-b0e2d145ad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:15.741268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9aa7d768-7d9f-44ef-84c8-dd4608862789 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:15.742625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9aa7d768-7d9f-44ef-84c8-dd4608862789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:15.865360 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:15.941246 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3995/7887] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:15.945329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ec45b-6a8c-4b86-9542-b0e2d145ad69 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:15.948717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b35ec45b-6a8c-4b86-9542-b0e2d145ad69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:15.978004 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3893/7888] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:15.980624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ec45b-6a8c-4b86-9542-b0e2d145ad69 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:15.987461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d073e9c-7303-40da-a420-8adf191408bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:15.988440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d073e9c-7303-40da-a420-8adf191408bf admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:15.988958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d073e9c-7303-40da-a420-8adf191408bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:15.989491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d073e9c-7303-40da-a420-8adf191408bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:15.991786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d073e9c-7303-40da-a420-8adf191408bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:15.994523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d073e9c-7303-40da-a420-8adf191408bf admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:16.008944 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3996/7889] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:16.012948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7d768-7d9f-44ef-84c8-dd4608862789 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:16.022285 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:16.034080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa7d768-7d9f-44ef-84c8-dd4608862789 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:16.048344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b395999-97f9-4dcb-bb9b-910a5cd1d1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:16.049808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b395999-97f9-4dcb-bb9b-910a5cd1d1d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:16.050457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b395999-97f9-4dcb-bb9b-910a5cd1d1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:16.050691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b395999-97f9-4dcb-bb9b-910a5cd1d1d4 admin admin] PATH_INFO: `/v3/projects/312120d7bdbe4996a0ce12c839513362/users/5c24f6e876a242d58371fc2659e1bd24/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:16.095241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b395999-97f9-4dcb-bb9b-910a5cd1d1d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=312120d7bdbe4996a0ce12c839513362, user_id=5c24f6e876a242d58371fc2659e1bd24, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:16.098186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b395999-97f9-4dcb-bb9b-910a5cd1d1d4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:16.176208 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3894/7890] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:47:16 2022] PUT /identity/v3/projects/312120d7bdbe4996a0ce12c839513362/users/5c24f6e876a242d58371fc2659e1bd24/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:16.186310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d1405-3239-4765-b4eb-037211da1a5e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:16.186608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d1405-3239-4765-b4eb-037211da1a5e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:16.186886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48d1405-3239-4765-b4eb-037211da1a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:16.275109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a48d1405-3239-4765-b4eb-037211da1a5e None None] MFA Rules not processed for user `5c24f6e876a242d58371fc2659e1bd24`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:16.276652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a48d1405-3239-4765-b4eb-037211da1a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:16.368139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b395999-97f9-4dcb-bb9b-910a5cd1d1d4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:16.369625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5b395999-97f9-4dcb-bb9b-910a5cd1d1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:16.416795 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3997/7891] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:16.417795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d1405-3239-4765-b4eb-037211da1a5e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:16.419411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a48d1405-3239-4765-b4eb-037211da1a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:16.490663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b395999-97f9-4dcb-bb9b-910a5cd1d1d4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:16.506199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14bb3e-d365-4202-8190-ec0fcd5c7649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:16.506884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14bb3e-d365-4202-8190-ec0fcd5c7649 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:16.507203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14bb3e-d365-4202-8190-ec0fcd5c7649 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:16.507477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14bb3e-d365-4202-8190-ec0fcd5c7649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:16.549372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48d1405-3239-4765-b4eb-037211da1a5e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:16.559288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ebbf2-f3ce-44b4-b57c-9e19360b1d4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:16.560089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ebbf2-f3ce-44b4-b57c-9e19360b1d4b service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:16.560387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ebbf2-f3ce-44b4-b57c-9e19360b1d4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:16.560673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ebbf2-f3ce-44b4-b57c-9e19360b1d4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:16.685439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14bb3e-d365-4202-8190-ec0fcd5c7649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:16.689115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14bb3e-d365-4202-8190-ec0fcd5c7649 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:16.705631 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3895/7892] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:47:16.706554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14bb3e-d365-4202-8190-ec0fcd5c7649 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:16.739254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ebbf2-f3ce-44b4-b57c-9e19360b1d4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:16.740797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17ebbf2-f3ce-44b4-b57c-9e19360b1d4b service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:16.748336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14bb3e-d365-4202-8190-ec0fcd5c7649 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:16.760478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a7e16-2321-4867-a7b9-126e017ec6a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:16.761079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a7e16-2321-4867-a7b9-126e017ec6a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:16.761388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a7e16-2321-4867-a7b9-126e017ec6a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:16.761662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a7e16-2321-4867-a7b9-126e017ec6a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:16.772883 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3998/7893] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:47:16.791325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a7e16-2321-4867-a7b9-126e017ec6a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:16.792787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a7e16-2321-4867-a7b9-126e017ec6a7 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:16.814038 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3896/7894] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:47:16.957352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ebbf2-f3ce-44b4-b57c-9e19360b1d4b service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:16.972646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ebbf2-f3ce-44b4-b57c-9e19360b1d4b service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:16.981451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3043b59d-33f9-4981-a454-ef386a77148b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:16.982383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043b59d-33f9-4981-a454-ef386a77148b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:16.982676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043b59d-33f9-4981-a454-ef386a77148b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:16.982963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3043b59d-33f9-4981-a454-ef386a77148b admin admin] PATH_INFO: `/v3/users/5c24f6e876a242d58371fc2659e1bd24` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:16.995198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043b59d-33f9-4981-a454-ef386a77148b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c24f6e876a242d58371fc2659e1bd24)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:16.997156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3043b59d-33f9-4981-a454-ef386a77148b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:17.006195 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:17.284333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a7e16-2321-4867-a7b9-126e017ec6a7 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:17.286044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-069a7e16-2321-4867-a7b9-126e017ec6a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:17.328762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a7e16-2321-4867-a7b9-126e017ec6a7 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:17.329743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3043b59d-33f9-4981-a454-ef386a77148b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c24f6e876a242d58371fc2659e1bd24'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:17.348599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4bf48-87eb-47c6-a015-f671f735dbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:17.349507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4bf48-87eb-47c6-a015-f671f735dbe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:17.349796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4bf48-87eb-47c6-a015-f671f735dbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:17.350086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad4bf48-87eb-47c6-a015-f671f735dbe6 admin admin] PATH_INFO: `/v3/users/2ae4462cbb694f55ba983ed324d00be9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:17.354833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4bf48-87eb-47c6-a015-f671f735dbe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ae4462cbb694f55ba983ed324d00be9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:17.356788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad4bf48-87eb-47c6-a015-f671f735dbe6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:17.374022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3043b59d-33f9-4981-a454-ef386a77148b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c24f6e876a242d58371fc2659e1bd24'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:17.391869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3043b59d-33f9-4981-a454-ef386a77148b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c24f6e876a242d58371fc2659e1bd24'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:17.395097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3043b59d-33f9-4981-a454-ef386a77148b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c24f6e876a242d58371fc2659e1bd24'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:17.508661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3043b59d-33f9-4981-a454-ef386a77148b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c24f6e876a242d58371fc2659e1bd24'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:17.527913 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 3999/7895] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:47:16 2022] DELETE /identity/v3/users/5c24f6e876a242d58371fc2659e1bd24 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:17.529492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f2cc7-5113-4f7e-8e51-c1eb6bce52e6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:17.530230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f2cc7-5113-4f7e-8e51-c1eb6bce52e6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:17.531304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f2cc7-5113-4f7e-8e51-c1eb6bce52e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:17.605868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8d2f2cc7-5113-4f7e-8e51-c1eb6bce52e6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:17.609903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8d2f2cc7-5113-4f7e-8e51-c1eb6bce52e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:17.621078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ad4bf48-87eb-47c6-a015-f671f735dbe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ae4462cbb694f55ba983ed324d00be9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:17.651455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ad4bf48-87eb-47c6-a015-f671f735dbe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ae4462cbb694f55ba983ed324d00be9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:17.653971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ad4bf48-87eb-47c6-a015-f671f735dbe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ae4462cbb694f55ba983ed324d00be9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:17.659833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ad4bf48-87eb-47c6-a015-f671f735dbe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ae4462cbb694f55ba983ed324d00be9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:17.666959 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:17.672804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ad4bf48-87eb-47c6-a015-f671f735dbe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ae4462cbb694f55ba983ed324d00be9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:17.763904 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4000/7896] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:47:17.779558 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3897/7897] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:47:17 2022] DELETE /identity/v3/users/2ae4462cbb694f55ba983ed324d00be9 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:47:17.785465 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d4240-5d55-4b1e-afe4-6b6bd5b3a7e2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:17.786067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d4240-5d55-4b1e-afe4-6b6bd5b3a7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:17.786642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d4240-5d55-4b1e-afe4-6b6bd5b3a7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:17.814604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-762d4240-5d55-4b1e-afe4-6b6bd5b3a7e2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:17.816770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-762d4240-5d55-4b1e-afe4-6b6bd5b3a7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:17.942619 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4001/7898] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:17.944494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4bf48-87eb-47c6-a015-f671f735dbe6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:17.946366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7ad4bf48-87eb-47c6-a015-f671f735dbe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:18.069493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad4bf48-87eb-47c6-a015-f671f735dbe6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:18.083091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4d1e2-89f8-406e-8552-89f5092c121e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:18.083825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4d1e2-89f8-406e-8552-89f5092c121e service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:18.084061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4d1e2-89f8-406e-8552-89f5092c121e service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:18.084348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d4d1e2-89f8-406e-8552-89f5092c121e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:18.102080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4d1e2-89f8-406e-8552-89f5092c121e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:18.103570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d4d1e2-89f8-406e-8552-89f5092c121e service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:18.127964 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3898/7899] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:47:18.146915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d4240-5d55-4b1e-afe4-6b6bd5b3a7e2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:18.165034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d4240-5d55-4b1e-afe4-6b6bd5b3a7e2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:18.174813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a05a0-92a8-4ed2-9049-41b6690417fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:18.177477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a05a0-92a8-4ed2-9049-41b6690417fe service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:18.177477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a05a0-92a8-4ed2-9049-41b6690417fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:18.177477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a05a0-92a8-4ed2-9049-41b6690417fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:18.199642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a05a0-92a8-4ed2-9049-41b6690417fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:18.201282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a05a0-92a8-4ed2-9049-41b6690417fe service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:18.225082 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4002/7900] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:47:19.006533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4d1e2-89f8-406e-8552-89f5092c121e service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:19.010924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e5d4d1e2-89f8-406e-8552-89f5092c121e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:19.043054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d4d1e2-89f8-406e-8552-89f5092c121e service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:19.069643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a6843-3658-49aa-b1a7-d88bd80a5ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:19.071300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a6843-3658-49aa-b1a7-d88bd80a5ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:19.071601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a6843-3658-49aa-b1a7-d88bd80a5ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:19.071890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a6843-3658-49aa-b1a7-d88bd80a5ab6 admin admin] PATH_INFO: `/v3/projects/d92fb53ce1c44d21b11d2e2937cb2a55` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:19.078851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a6843-3658-49aa-b1a7-d88bd80a5ab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d92fb53ce1c44d21b11d2e2937cb2a55)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:19.080821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826a6843-3658-49aa-b1a7-d88bd80a5ab6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:19.125172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a05a0-92a8-4ed2-9049-41b6690417fe service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:19.128306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-da0a05a0-92a8-4ed2-9049-41b6690417fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:19.163994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a05a0-92a8-4ed2-9049-41b6690417fe service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:19.175500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81880d-c979-4dea-a50d-71ee1de0585f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:19.176709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81880d-c979-4dea-a50d-71ee1de0585f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:19.177080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81880d-c979-4dea-a50d-71ee1de0585f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:19.177770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81880d-c979-4dea-a50d-71ee1de0585f admin admin] PATH_INFO: `/v3/projects/8e42cca24c9547fab662221000c32f16` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:19.181892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81880d-c979-4dea-a50d-71ee1de0585f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e42cca24c9547fab662221000c32f16)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:19.196029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b81880d-c979-4dea-a50d-71ee1de0585f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:19.224702 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:19.289288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-826a6843-3658-49aa-b1a7-d88bd80a5ab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd92fb53ce1c44d21b11d2e2937cb2a55', 'request_id': 'req-826a6843-3658-49aa-b1a7-d88bd80a5ab6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:19.405563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-826a6843-3658-49aa-b1a7-d88bd80a5ab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd92fb53ce1c44d21b11d2e2937cb2a55', 'request_id': 'req-826a6843-3658-49aa-b1a7-d88bd80a5ab6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:19.439884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3b81880d-c979-4dea-a50d-71ee1de0585f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e42cca24c9547fab662221000c32f16', 'request_id': 'req-3b81880d-c979-4dea-a50d-71ee1de0585f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:19.452892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3b81880d-c979-4dea-a50d-71ee1de0585f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e42cca24c9547fab662221000c32f16', 'request_id': 'req-3b81880d-c979-4dea-a50d-71ee1de0585f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:19.456418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-826a6843-3658-49aa-b1a7-d88bd80a5ab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd92fb53ce1c44d21b11d2e2937cb2a55', 'request_id': 'req-826a6843-3658-49aa-b1a7-d88bd80a5ab6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:19.465369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3b81880d-c979-4dea-a50d-71ee1de0585f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e42cca24c9547fab662221000c32f16', 'request_id': 'req-3b81880d-c979-4dea-a50d-71ee1de0585f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:19.491662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-826a6843-3658-49aa-b1a7-d88bd80a5ab6 admin admin] The token cache is being invalidate because project d92fb53ce1c44d21b11d2e2937cb2a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:47:19.491662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-826a6843-3658-49aa-b1a7-d88bd80a5ab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:19.492378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-826a6843-3658-49aa-b1a7-d88bd80a5ab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:19.502999 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3899/7901] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:47:19 2022] DELETE /identity/v3/projects/d92fb53ce1c44d21b11d2e2937cb2a55 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:19.523305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7a1cc-f1ac-4b14-bdc2-c3bd5acaf8ac None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:19.523305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7a1cc-f1ac-4b14-bdc2-c3bd5acaf8ac None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:19.523305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf7a1cc-f1ac-4b14-bdc2-c3bd5acaf8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:19.566638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-caf7a1cc-f1ac-4b14-bdc2-c3bd5acaf8ac None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:19.568228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-caf7a1cc-f1ac-4b14-bdc2-c3bd5acaf8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:19.578862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3b81880d-c979-4dea-a50d-71ee1de0585f admin admin] The token cache is being invalidate because project 8e42cca24c9547fab662221000c32f16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:47:19.579165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3b81880d-c979-4dea-a50d-71ee1de0585f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:19.580154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3b81880d-c979-4dea-a50d-71ee1de0585f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:19.585140 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4003/7902] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:47:19 2022] DELETE /identity/v3/projects/8e42cca24c9547fab662221000c32f16 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:19.593852 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20213468-5b6e-43e6-90d9-0935760dc3cc None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:19.594748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20213468-5b6e-43e6-90d9-0935760dc3cc None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:19.595215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20213468-5b6e-43e6-90d9-0935760dc3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:19.680777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-20213468-5b6e-43e6-90d9-0935760dc3cc None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:19.682326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-20213468-5b6e-43e6-90d9-0935760dc3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:19.850601 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3900/7903] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:19.859841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f4860-0146-467c-a95f-c50b1c4be63f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:19.860596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f4860-0146-467c-a95f-c50b1c4be63f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:19.861165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43f4860-0146-467c-a95f-c50b1c4be63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:19.893738 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4004/7904] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:19.897141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c43f4860-0146-467c-a95f-c50b1c4be63f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:19.898838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c43f4860-0146-467c-a95f-c50b1c4be63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:19.938173 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3901/7905] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:19.943098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20213468-5b6e-43e6-90d9-0935760dc3cc None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:19.963838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20213468-5b6e-43e6-90d9-0935760dc3cc None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:19.997196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab96886-6a03-43a2-9d8e-9db73ba09a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:19.999126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab96886-6a03-43a2-9d8e-9db73ba09a32 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:19.999551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab96886-6a03-43a2-9d8e-9db73ba09a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:20.000185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab96886-6a03-43a2-9d8e-9db73ba09a32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:20.001199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab96886-6a03-43a2-9d8e-9db73ba09a32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:47:20.002369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab96886-6a03-43a2-9d8e-9db73ba09a32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:20.005005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab96886-6a03-43a2-9d8e-9db73ba09a32 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:20.019995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7129a4-3ecc-4e8a-950d-1165065e662b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:20.020996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7129a4-3ecc-4e8a-950d-1165065e662b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:20.021546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7129a4-3ecc-4e8a-950d-1165065e662b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:20.053548 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4005/7906] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:47:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:47:20.054078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ec7129a4-3ecc-4e8a-950d-1165065e662b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:20.056625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab96886-6a03-43a2-9d8e-9db73ba09a32 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:20.058220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ec7129a4-3ecc-4e8a-950d-1165065e662b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:20.072822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab96886-6a03-43a2-9d8e-9db73ba09a32 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:20.076596 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3902/7907] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:20.081463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7129a4-3ecc-4e8a-950d-1165065e662b None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:20.086058 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:20.089382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dad1f3-def4-4710-9b19-b2eb177d2ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:20.090073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dad1f3-def4-4710-9b19-b2eb177d2ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:20.090395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dad1f3-def4-4710-9b19-b2eb177d2ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:20.090773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dad1f3-def4-4710-9b19-b2eb177d2ff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:20.091491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dad1f3-def4-4710-9b19-b2eb177d2ff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:20.094363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dad1f3-def4-4710-9b19-b2eb177d2ff9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:20.100077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7129a4-3ecc-4e8a-950d-1165065e662b None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:20.110427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111973f-c321-4a25-b76d-14c9dc7b7b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:20.111736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111973f-c321-4a25-b76d-14c9dc7b7b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:20.112103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111973f-c321-4a25-b76d-14c9dc7b7b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:20.113290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111973f-c321-4a25-b76d-14c9dc7b7b80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:20.114763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111973f-c321-4a25-b76d-14c9dc7b7b80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:47:20.115161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111973f-c321-4a25-b76d-14c9dc7b7b80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:20.117371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8111973f-c321-4a25-b76d-14c9dc7b7b80 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:20.135878 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3903/7908] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:47:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:47:20.136676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111973f-c321-4a25-b76d-14c9dc7b7b80 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:20.148569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111973f-c321-4a25-b76d-14c9dc7b7b80 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:20.154445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e730416-5122-4379-bf7f-5a93511ea4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:20.155003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e730416-5122-4379-bf7f-5a93511ea4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:20.155295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e730416-5122-4379-bf7f-5a93511ea4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:20.161676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e730416-5122-4379-bf7f-5a93511ea4e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:20.161676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e730416-5122-4379-bf7f-5a93511ea4e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:20.161676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e730416-5122-4379-bf7f-5a93511ea4e1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:20.199967 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4006/7909] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:47:20 2022] POST /identity/v3/projects => generated 393 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:20.201598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dad1f3-def4-4710-9b19-b2eb177d2ff9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:20.207398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-17dad1f3-def4-4710-9b19-b2eb177d2ff9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:20.272172 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3904/7910] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:47:20 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:20.278451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e730416-5122-4379-bf7f-5a93511ea4e1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:20.348242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dad1f3-def4-4710-9b19-b2eb177d2ff9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:20.360721 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:20.443077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e730416-5122-4379-bf7f-5a93511ea4e1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:20.452750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37414695-5974-4683-a82b-c2e8dff9b379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:20.454237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37414695-5974-4683-a82b-c2e8dff9b379 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:20.454237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37414695-5974-4683-a82b-c2e8dff9b379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:20.454237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37414695-5974-4683-a82b-c2e8dff9b379 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:20.456792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37414695-5974-4683-a82b-c2e8dff9b379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:20.461762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37414695-5974-4683-a82b-c2e8dff9b379 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:20.491030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67f147-096f-4c45-aa72-dad96a4577bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:20.491943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f147-096f-4c45-aa72-dad96a4577bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:20.492240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f147-096f-4c45-aa72-dad96a4577bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:20.492525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a67f147-096f-4c45-aa72-dad96a4577bd admin admin] PATH_INFO: `/v3/projects/312120d7bdbe4996a0ce12c839513362` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:20.494208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67f147-096f-4c45-aa72-dad96a4577bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=312120d7bdbe4996a0ce12c839513362)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:20.496600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a67f147-096f-4c45-aa72-dad96a4577bd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:20.581542 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3905/7911] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:47:20 2022] POST /identity/v3/users => generated 297 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:20.582366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37414695-5974-4683-a82b-c2e8dff9b379 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:20.592515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37414695-5974-4683-a82b-c2e8dff9b379 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:20.597450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340c96e-39b3-45ed-85ca-35978d670045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:20.598426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340c96e-39b3-45ed-85ca-35978d670045 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:20.598625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340c96e-39b3-45ed-85ca-35978d670045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:20.598926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340c96e-39b3-45ed-85ca-35978d670045 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:20.599629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340c96e-39b3-45ed-85ca-35978d670045 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:20.606326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340c96e-39b3-45ed-85ca-35978d670045 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:20.623103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6a67f147-096f-4c45-aa72-dad96a4577bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '312120d7bdbe4996a0ce12c839513362', 'request_id': 'req-6a67f147-096f-4c45-aa72-dad96a4577bd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:20.633126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6a67f147-096f-4c45-aa72-dad96a4577bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '312120d7bdbe4996a0ce12c839513362', 'request_id': 'req-6a67f147-096f-4c45-aa72-dad96a4577bd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:20.641173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6a67f147-096f-4c45-aa72-dad96a4577bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '312120d7bdbe4996a0ce12c839513362', 'request_id': 'req-6a67f147-096f-4c45-aa72-dad96a4577bd'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:20.704478 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3906/7912] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:47:20 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:20.712916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340c96e-39b3-45ed-85ca-35978d670045 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:20.741100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6a67f147-096f-4c45-aa72-dad96a4577bd admin admin] The token cache is being invalidate because project 312120d7bdbe4996a0ce12c839513362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:47:20.743658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6a67f147-096f-4c45-aa72-dad96a4577bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:20.744398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6a67f147-096f-4c45-aa72-dad96a4577bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:20.746034 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4007/7913] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:47:20 2022] DELETE /identity/v3/projects/312120d7bdbe4996a0ce12c839513362 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:20.747084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67f147-096f-4c45-aa72-dad96a4577bd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:20.749747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6a67f147-096f-4c45-aa72-dad96a4577bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:20.755513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340c96e-39b3-45ed-85ca-35978d670045 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:20.861926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a67f147-096f-4c45-aa72-dad96a4577bd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:20.883044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216954a-aebf-4fa7-b4e4-7405b94d8749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:20.883836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216954a-aebf-4fa7-b4e4-7405b94d8749 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:20.884126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216954a-aebf-4fa7-b4e4-7405b94d8749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:20.884415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216954a-aebf-4fa7-b4e4-7405b94d8749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:20.885234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216954a-aebf-4fa7-b4e4-7405b94d8749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:20.891180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4426ba2-dd2a-4dd2-b627-082f94aa176a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:20.893108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216954a-aebf-4fa7-b4e4-7405b94d8749 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:20.894334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4426ba2-dd2a-4dd2-b627-082f94aa176a admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:20.896022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4426ba2-dd2a-4dd2-b627-082f94aa176a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:20.897932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4426ba2-dd2a-4dd2-b627-082f94aa176a admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:20.898955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4426ba2-dd2a-4dd2-b627-082f94aa176a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:21.003658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4426ba2-dd2a-4dd2-b627-082f94aa176a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:21.005447 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4008/7914] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:21.005447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce174b1b-af26-41cb-b1b8-3d6fb6f3ccf6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:21.005447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce174b1b-af26-41cb-b1b8-3d6fb6f3ccf6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:21.005447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce174b1b-af26-41cb-b1b8-3d6fb6f3ccf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:21.006055 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3907/7915] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:21.006832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ce174b1b-af26-41cb-b1b8-3d6fb6f3ccf6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:21.006832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ce174b1b-af26-41cb-b1b8-3d6fb6f3ccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:21.006832 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4009/7916] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:21.007278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4426ba2-dd2a-4dd2-b627-082f94aa176a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:21.007409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce174b1b-af26-41cb-b1b8-3d6fb6f3ccf6 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:21.020144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4426ba2-dd2a-4dd2-b627-082f94aa176a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:21.026688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ce174b1b-af26-41cb-b1b8-3d6fb6f3ccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:21.033672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7df404-c16d-4081-831b-ef5142032e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:21.034409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7df404-c16d-4081-831b-ef5142032e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:21.034727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7df404-c16d-4081-831b-ef5142032e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:21.034988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7df404-c16d-4081-831b-ef5142032e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:21.035735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7df404-c16d-4081-831b-ef5142032e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:21.037386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7df404-c16d-4081-831b-ef5142032e2f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:21.058547 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3908/7917] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:21.063596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a929f-6040-48d9-ba24-80830476c613 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:21.063893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a929f-6040-48d9-ba24-80830476c613 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:21.064182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a929f-6040-48d9-ba24-80830476c613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:21.070742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce174b1b-af26-41cb-b1b8-3d6fb6f3ccf6 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:21.088289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ee921-31cb-41d1-913f-5163bc23908b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:21.089231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ee921-31cb-41d1-913f-5163bc23908b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:21.089729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ee921-31cb-41d1-913f-5163bc23908b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:21.090076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ee921-31cb-41d1-913f-5163bc23908b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:21.091046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ee921-31cb-41d1-913f-5163bc23908b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:21.092758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ee921-31cb-41d1-913f-5163bc23908b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:21.098450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-545a929f-6040-48d9-ba24-80830476c613 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:21.099906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-545a929f-6040-48d9-ba24-80830476c613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:21.113301 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3909/7918] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:21.115162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a929f-6040-48d9-ba24-80830476c613 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:21.133974 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4010/7919] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:21 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:21.135111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ee921-31cb-41d1-913f-5163bc23908b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:21.135846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a929f-6040-48d9-ba24-80830476c613 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:21.149906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b943b1-07a3-4471-947a-dee67dfe47ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:21.151189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b943b1-07a3-4471-947a-dee67dfe47ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:21.151778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b943b1-07a3-4471-947a-dee67dfe47ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:21.152240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b943b1-07a3-4471-947a-dee67dfe47ee admin admin] PATH_INFO: `/v3/projects/498418c507f749439f0b15c58cbe6c67/users/f933a71a6d5d45db993a430166f49c95/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:21.166487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ee921-31cb-41d1-913f-5163bc23908b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:21.173578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ac378-d831-4364-af4a-23539e3985ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:21.175053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ac378-d831-4364-af4a-23539e3985ef admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:21.175521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ac378-d831-4364-af4a-23539e3985ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:21.175957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ac378-d831-4364-af4a-23539e3985ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:21.176830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ac378-d831-4364-af4a-23539e3985ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:47:21.177912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ac378-d831-4364-af4a-23539e3985ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:21.180379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ac378-d831-4364-af4a-23539e3985ef admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:21.210041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b943b1-07a3-4471-947a-dee67dfe47ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=498418c507f749439f0b15c58cbe6c67, user_id=f933a71a6d5d45db993a430166f49c95, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:21.217995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b943b1-07a3-4471-947a-dee67dfe47ee admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:21.218764 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4011/7920] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:47:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:47:21.219976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ac378-d831-4364-af4a-23539e3985ef admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:21.252438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ac378-d831-4364-af4a-23539e3985ef admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:21.261999 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a8368-dab1-4f06-85d7-779252456003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:21.263332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a8368-dab1-4f06-85d7-779252456003 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:21.263802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a8368-dab1-4f06-85d7-779252456003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:21.264259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a8368-dab1-4f06-85d7-779252456003 admin admin] PATH_INFO: `/v3/projects/14099dd7e4f54b398e110ad2bd2c4f21/users/eee4c63b80eb407395e862126b73d6d9/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:21.301754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a8368-dab1-4f06-85d7-779252456003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14099dd7e4f54b398e110ad2bd2c4f21, user_id=eee4c63b80eb407395e862126b73d6d9, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:21.305047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a8368-dab1-4f06-85d7-779252456003 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:21.666656 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4012/7921] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:47:21 2022] PUT /identity/v3/projects/14099dd7e4f54b398e110ad2bd2c4f21/users/eee4c63b80eb407395e862126b73d6d9/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:21.679478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a8368-dab1-4f06-85d7-779252456003 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:21.682152 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3910/7922] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:47:21 2022] PUT /identity/v3/projects/498418c507f749439f0b15c58cbe6c67/users/f933a71a6d5d45db993a430166f49c95/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:21.691412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822e4e7-a058-406e-8268-db23a8f2b090 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:21.691412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822e4e7-a058-406e-8268-db23a8f2b090 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:21.691412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f822e4e7-a058-406e-8268-db23a8f2b090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:21.767369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f822e4e7-a058-406e-8268-db23a8f2b090 None None] MFA Rules not processed for user `eee4c63b80eb407395e862126b73d6d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:21.771559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f822e4e7-a058-406e-8268-db23a8f2b090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:21.813493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a8368-dab1-4f06-85d7-779252456003 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:21.909428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80146a40-8985-4625-9fa5-915a71beb8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:21.910668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80146a40-8985-4625-9fa5-915a71beb8ea admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:21.911309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80146a40-8985-4625-9fa5-915a71beb8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:21.911596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80146a40-8985-4625-9fa5-915a71beb8ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:21.912362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80146a40-8985-4625-9fa5-915a71beb8ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:21.918315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80146a40-8985-4625-9fa5-915a71beb8ea admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:21.936327 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3911/7923] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:21.940280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfaea03-07a9-452f-ba17-5cc93c033109 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:21.940573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfaea03-07a9-452f-ba17-5cc93c033109 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:21.941531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfaea03-07a9-452f-ba17-5cc93c033109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:21.973947 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:22.018125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ecfaea03-07a9-452f-ba17-5cc93c033109 None None] MFA Rules not processed for user `f933a71a6d5d45db993a430166f49c95`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:22.021052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ecfaea03-07a9-452f-ba17-5cc93c033109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:22.047532 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4013/7924] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:47:21 2022] POST /identity/v3/projects => generated 379 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:22.051836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80146a40-8985-4625-9fa5-915a71beb8ea admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:22.151138 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3912/7925] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:22.152394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfaea03-07a9-452f-ba17-5cc93c033109 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:22.166251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfaea03-07a9-452f-ba17-5cc93c033109 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:22.204454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80146a40-8985-4625-9fa5-915a71beb8ea admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:22.228448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62255ed-b21e-4218-bdb0-d05852568fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:22.229037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62255ed-b21e-4218-bdb0-d05852568fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:22.229146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62255ed-b21e-4218-bdb0-d05852568fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:22.229412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62255ed-b21e-4218-bdb0-d05852568fa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:22.230149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62255ed-b21e-4218-bdb0-d05852568fa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:22.232062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62255ed-b21e-4218-bdb0-d05852568fa3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:22.317560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc52841-ca2e-47b8-9393-7cf6f9fc5ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:22.318119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc52841-ca2e-47b8-9393-7cf6f9fc5ee0 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:22.324413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc52841-ca2e-47b8-9393-7cf6f9fc5ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:22.324413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc52841-ca2e-47b8-9393-7cf6f9fc5ee0 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:22.324413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc52841-ca2e-47b8-9393-7cf6f9fc5ee0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:22.327196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc52841-ca2e-47b8-9393-7cf6f9fc5ee0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:22.393587 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4014/7926] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:47:22 2022] POST /identity/v3/projects => generated 393 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:22.393587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62255ed-b21e-4218-bdb0-d05852568fa3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:22.485436 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3913/7927] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:47:22 2022] POST /identity/v3/users => generated 290 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:22.486505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc52841-ca2e-47b8-9393-7cf6f9fc5ee0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:22.499140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc52841-ca2e-47b8-9393-7cf6f9fc5ee0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:22.528061 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:22.538848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62255ed-b21e-4218-bdb0-d05852568fa3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:22.552051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d5429-f72f-4fe7-8af5-5856a2d40b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:22.552757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d5429-f72f-4fe7-8af5-5856a2d40b2d admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:22.553040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d5429-f72f-4fe7-8af5-5856a2d40b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:22.553328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d5429-f72f-4fe7-8af5-5856a2d40b2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:22.554045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d5429-f72f-4fe7-8af5-5856a2d40b2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:22.556096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d5429-f72f-4fe7-8af5-5856a2d40b2d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:22.640147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b3cca-540e-42d2-81bd-fcbd8c829162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:22.641700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b3cca-540e-42d2-81bd-fcbd8c829162 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:22.642419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b3cca-540e-42d2-81bd-fcbd8c829162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:22.642936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508b3cca-540e-42d2-81bd-fcbd8c829162 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:22.644280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b3cca-540e-42d2-81bd-fcbd8c829162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:22.647195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508b3cca-540e-42d2-81bd-fcbd8c829162 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:22.690495 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4015/7928] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:47:22 2022] POST /identity/v3/projects => generated 375 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:22.690495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d5429-f72f-4fe7-8af5-5856a2d40b2d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:22.792111 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3914/7929] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:47:22 2022] POST /identity/v3/users => generated 303 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:22.793589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b3cca-540e-42d2-81bd-fcbd8c829162 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:22.816452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508b3cca-540e-42d2-81bd-fcbd8c829162 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:22.900435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d5429-f72f-4fe7-8af5-5856a2d40b2d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:22.925413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5dd39-caf9-44ac-b921-aff6f1fef9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:22.926519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5dd39-caf9-44ac-b921-aff6f1fef9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:22.926812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5dd39-caf9-44ac-b921-aff6f1fef9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:22.927097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5dd39-caf9-44ac-b921-aff6f1fef9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:22.927854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5dd39-caf9-44ac-b921-aff6f1fef9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:22.929536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5dd39-caf9-44ac-b921-aff6f1fef9f0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:22.962457 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4016/7930] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:22.963424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43ab34-8a0d-4552-805e-9e39b37d26f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:22.969114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43ab34-8a0d-4552-805e-9e39b37d26f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:22.969718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43ab34-8a0d-4552-805e-9e39b37d26f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:22.970325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43ab34-8a0d-4552-805e-9e39b37d26f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:22.971729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43ab34-8a0d-4552-805e-9e39b37d26f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:22.974164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43ab34-8a0d-4552-805e-9e39b37d26f9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:22.976219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5dd39-caf9-44ac-b921-aff6f1fef9f0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:22.996652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5dd39-caf9-44ac-b921-aff6f1fef9f0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:23.007831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da9e19-be66-4e2a-8f0d-53eaf4720341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:23.008532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da9e19-be66-4e2a-8f0d-53eaf4720341 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:23.008818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da9e19-be66-4e2a-8f0d-53eaf4720341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:23.009102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da9e19-be66-4e2a-8f0d-53eaf4720341 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:23.009848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da9e19-be66-4e2a-8f0d-53eaf4720341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:23.011537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da9e19-be66-4e2a-8f0d-53eaf4720341 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:23.041484 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4017/7931] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:22 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:23.041989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da9e19-be66-4e2a-8f0d-53eaf4720341 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:23.071958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da9e19-be66-4e2a-8f0d-53eaf4720341 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:23.082222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7823a-e0f6-4849-b147-35fe8ecdd269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:23.082920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7823a-e0f6-4849-b147-35fe8ecdd269 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:23.087054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7823a-e0f6-4849-b147-35fe8ecdd269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:23.087054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7823a-e0f6-4849-b147-35fe8ecdd269 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:23.094318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7823a-e0f6-4849-b147-35fe8ecdd269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:23.096033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7823a-e0f6-4849-b147-35fe8ecdd269 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:23.107164 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3915/7932] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:47:22 2022] POST /identity/v3/users => generated 294 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:23.108118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43ab34-8a0d-4552-805e-9e39b37d26f9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:23.127361 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4018/7933] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:23.128346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7823a-e0f6-4849-b147-35fe8ecdd269 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:23.131233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43ab34-8a0d-4552-805e-9e39b37d26f9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:23.140542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7823a-e0f6-4849-b147-35fe8ecdd269 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:23.146613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d178e2-778c-4b03-a953-a1650ac96b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:23.147604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d178e2-778c-4b03-a953-a1650ac96b06 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:23.147778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d178e2-778c-4b03-a953-a1650ac96b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:23.148073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f5722-8dd0-4fb8-879d-97304dffbad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:23.148234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d178e2-778c-4b03-a953-a1650ac96b06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:23.149115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f5722-8dd0-4fb8-879d-97304dffbad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:23.149473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f5722-8dd0-4fb8-879d-97304dffbad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:23.149823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230f5722-8dd0-4fb8-879d-97304dffbad9 admin admin] PATH_INFO: `/v3/projects/7ae1339993c34a6c92993165699f395b/users/a680d46b964e4e30bf5d50d60a9e5bf1/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:23.149958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d178e2-778c-4b03-a953-a1650ac96b06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:23.151911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d178e2-778c-4b03-a953-a1650ac96b06 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:23.165830 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4019/7934] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:23.167821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d178e2-778c-4b03-a953-a1650ac96b06 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:23.182134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d178e2-778c-4b03-a953-a1650ac96b06 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:23.185007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f5722-8dd0-4fb8-879d-97304dffbad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ae1339993c34a6c92993165699f395b, user_id=a680d46b964e4e30bf5d50d60a9e5bf1, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:23.188873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230f5722-8dd0-4fb8-879d-97304dffbad9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:23.194218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b437ff38-cba1-46e3-8540-20d1ec997e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:23.195341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437ff38-cba1-46e3-8540-20d1ec997e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:23.195641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437ff38-cba1-46e3-8540-20d1ec997e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:23.195928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437ff38-cba1-46e3-8540-20d1ec997e9b admin admin] PATH_INFO: `/v3/projects/915605f8dcd5461c8a4132538e99438b/users/8918279c3079423181ca1d8974ec1377/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:23.237912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437ff38-cba1-46e3-8540-20d1ec997e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=915605f8dcd5461c8a4132538e99438b, user_id=8918279c3079423181ca1d8974ec1377, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:23.240839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b437ff38-cba1-46e3-8540-20d1ec997e9b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:23.281898 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3916/7935] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:47:23 2022] PUT /identity/v3/projects/7ae1339993c34a6c92993165699f395b/users/a680d46b964e4e30bf5d50d60a9e5bf1/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:23.284548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f5722-8dd0-4fb8-879d-97304dffbad9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:23.355853 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4020/7936] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:47:23 2022] PUT /identity/v3/projects/915605f8dcd5461c8a4132538e99438b/users/8918279c3079423181ca1d8974ec1377/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:23.357699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aefb8a-aba9-43ae-aba5-478beda77bb4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:23.358127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aefb8a-aba9-43ae-aba5-478beda77bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:23.358689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aefb8a-aba9-43ae-aba5-478beda77bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:23.373220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230f5722-8dd0-4fb8-879d-97304dffbad9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:23.377042 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:23.419279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-53aefb8a-aba9-43ae-aba5-478beda77bb4 None None] MFA Rules not processed for user `e1bbec617b204476983c35cb018a8d96`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:23.420526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-53aefb8a-aba9-43ae-aba5-478beda77bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:23.491305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6531dc6-91f0-4bbb-a6fe-394462a47d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:23.493607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6531dc6-91f0-4bbb-a6fe-394462a47d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:23.494035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6531dc6-91f0-4bbb-a6fe-394462a47d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:23.499931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6531dc6-91f0-4bbb-a6fe-394462a47d66 admin admin] PATH_INFO: `/v3/projects/17c3b97d2fc14203a643db69ebca606b/users/1aa4a04125194ed782b5f1dca0dc9705/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:23.526519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6531dc6-91f0-4bbb-a6fe-394462a47d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c3b97d2fc14203a643db69ebca606b, user_id=1aa4a04125194ed782b5f1dca0dc9705, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:23.532372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6531dc6-91f0-4bbb-a6fe-394462a47d66 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:23.612516 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4021/7937] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:23.614857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aefb8a-aba9-43ae-aba5-478beda77bb4 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:23.648325 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3917/7938] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:47:23 2022] PUT /identity/v3/projects/17c3b97d2fc14203a643db69ebca606b/users/1aa4a04125194ed782b5f1dca0dc9705/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:23.651642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45505e9-258b-40ca-898d-5c125335ea23 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:23.653844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45505e9-258b-40ca-898d-5c125335ea23 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:23.654722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aefb8a-aba9-43ae-aba5-478beda77bb4 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:23.657937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45505e9-258b-40ca-898d-5c125335ea23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:23.712211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e45505e9-258b-40ca-898d-5c125335ea23 None None] MFA Rules not processed for user `8918279c3079423181ca1d8974ec1377`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:23.714921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e45505e9-258b-40ca-898d-5c125335ea23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:23.836397 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3918/7939] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:23.836397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45505e9-258b-40ca-898d-5c125335ea23 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:23.836397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e45505e9-258b-40ca-898d-5c125335ea23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:23.837915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c1aff-051e-4fdf-9b92-8e2ff010d845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:23.838784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c1aff-051e-4fdf-9b92-8e2ff010d845 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:23.839307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c1aff-051e-4fdf-9b92-8e2ff010d845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:23.839692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c1aff-051e-4fdf-9b92-8e2ff010d845 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:23.840822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c1aff-051e-4fdf-9b92-8e2ff010d845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:23.842620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c1aff-051e-4fdf-9b92-8e2ff010d845 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:23.866547 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4022/7940] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:23.866547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c1aff-051e-4fdf-9b92-8e2ff010d845 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:23.870436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c1aff-051e-4fdf-9b92-8e2ff010d845 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:23.877699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616987d5-f1a8-41ae-9088-ec41fbd5c0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:23.878700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616987d5-f1a8-41ae-9088-ec41fbd5c0ae admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:23.879063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616987d5-f1a8-41ae-9088-ec41fbd5c0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:23.879408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616987d5-f1a8-41ae-9088-ec41fbd5c0ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:23.880639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616987d5-f1a8-41ae-9088-ec41fbd5c0ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:23.882654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616987d5-f1a8-41ae-9088-ec41fbd5c0ae admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:23.896549 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4023/7941] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:23.897927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616987d5-f1a8-41ae-9088-ec41fbd5c0ae admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:23.913255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616987d5-f1a8-41ae-9088-ec41fbd5c0ae admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:23.926891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dc3fd-f843-40fb-b1d3-e9db61a376fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:23.927693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dc3fd-f843-40fb-b1d3-e9db61a376fe admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:23.929788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dc3fd-f843-40fb-b1d3-e9db61a376fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:23.930349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764dc3fd-f843-40fb-b1d3-e9db61a376fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:23.931188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764dc3fd-f843-40fb-b1d3-e9db61a376fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:23.941694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764dc3fd-f843-40fb-b1d3-e9db61a376fe admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:23.986425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45505e9-258b-40ca-898d-5c125335ea23 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:23.990847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cf971-4dae-4694-a7f1-c69695bf03b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:23.991538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cf971-4dae-4694-a7f1-c69695bf03b4 service glance] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:23.992368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cf971-4dae-4694-a7f1-c69695bf03b4 service glance] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:23.993011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876cf971-4dae-4694-a7f1-c69695bf03b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:23.995869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-876cf971-4dae-4694-a7f1-c69695bf03b4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:24.063299 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4024/7942] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:47:23 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:24.065781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dc3fd-f843-40fb-b1d3-e9db61a376fe admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:24.068374 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:24.090467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876cf971-4dae-4694-a7f1-c69695bf03b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:24.092041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876cf971-4dae-4694-a7f1-c69695bf03b4 service glance] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:24.131603 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3919/7943] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:47:24.132633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cf971-4dae-4694-a7f1-c69695bf03b4 service glance] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:24.145124 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:24.196868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876cf971-4dae-4694-a7f1-c69695bf03b4 service glance] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:24.235835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764dc3fd-f843-40fb-b1d3-e9db61a376fe admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:24.257873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d59e1a-f927-4001-9157-8d903679478d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:24.284690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d59e1a-f927-4001-9157-8d903679478d admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:24.285286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d59e1a-f927-4001-9157-8d903679478d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:24.285758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d59e1a-f927-4001-9157-8d903679478d admin admin] PATH_INFO: `/v3/projects/7ae1339993c34a6c92993165699f395b/users/a680d46b964e4e30bf5d50d60a9e5bf1/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:24.289055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d59e1a-f927-4001-9157-8d903679478d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ae1339993c34a6c92993165699f395b, user_id=a680d46b964e4e30bf5d50d60a9e5bf1, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:24.292047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d59e1a-f927-4001-9157-8d903679478d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:24.373692 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4025/7944] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:47:24 2022] PUT /identity/v3/projects/7ae1339993c34a6c92993165699f395b/users/a680d46b964e4e30bf5d50d60a9e5bf1/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:24.375477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d59e1a-f927-4001-9157-8d903679478d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:24.377782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b19255e-9f65-4bf9-bf57-203af1ff2a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:24.378756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19255e-9f65-4bf9-bf57-203af1ff2a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:24.380284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19255e-9f65-4bf9-bf57-203af1ff2a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:24.380284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b19255e-9f65-4bf9-bf57-203af1ff2a57 admin admin] PATH_INFO: `/v3/projects/17c3b97d2fc14203a643db69ebca606b/users/1aa4a04125194ed782b5f1dca0dc9705/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:24.385584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19255e-9f65-4bf9-bf57-203af1ff2a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c3b97d2fc14203a643db69ebca606b, user_id=1aa4a04125194ed782b5f1dca0dc9705, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:24.388895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b19255e-9f65-4bf9-bf57-203af1ff2a57 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:24.413902 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3920/7945] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:47:24 2022] PUT /identity/v3/projects/17c3b97d2fc14203a643db69ebca606b/users/1aa4a04125194ed782b5f1dca0dc9705/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:24.415733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e87a3b-c31d-4ee2-9f35-7cffbdd38e31 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:24.416030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e87a3b-c31d-4ee2-9f35-7cffbdd38e31 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:24.416311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e87a3b-c31d-4ee2-9f35-7cffbdd38e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:24.474648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-11e87a3b-c31d-4ee2-9f35-7cffbdd38e31 None None] MFA Rules not processed for user `a680d46b964e4e30bf5d50d60a9e5bf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:24.476146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-11e87a3b-c31d-4ee2-9f35-7cffbdd38e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:24.507360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d59e1a-f927-4001-9157-8d903679478d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:24.658366 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3921/7946] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:24 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:24.659772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1e435-4ede-4183-a5b5-43ae794affd6 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:24.660070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1e435-4ede-4183-a5b5-43ae794affd6 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:24.660355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1e435-4ede-4183-a5b5-43ae794affd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:24.755531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4f2b2-20f8-45bf-9bf7-f69457cb258d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:24.756452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4f2b2-20f8-45bf-9bf7-f69457cb258d admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:24.756844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4f2b2-20f8-45bf-9bf7-f69457cb258d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:24.757310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4f2b2-20f8-45bf-9bf7-f69457cb258d admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:24.759251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4f2b2-20f8-45bf-9bf7-f69457cb258d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:24.769135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4f2b2-20f8-45bf-9bf7-f69457cb258d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:24.769331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4db1e435-4ede-4183-a5b5-43ae794affd6 None None] MFA Rules not processed for user `1aa4a04125194ed782b5f1dca0dc9705`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:24.769331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4db1e435-4ede-4183-a5b5-43ae794affd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:24.899256 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4026/7947] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:47:24 2022] POST /identity/v3/users => generated 297 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:24.900538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4f2b2-20f8-45bf-9bf7-f69457cb258d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:24.906821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-23a4f2b2-20f8-45bf-9bf7-f69457cb258d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:24.934566 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3922/7948] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:24.935440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1e435-4ede-4183-a5b5-43ae794affd6 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:24.964745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1e435-4ede-4183-a5b5-43ae794affd6 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:24.978751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b861cb-71f8-4216-93a6-31629a9ac8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:24.979491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b861cb-71f8-4216-93a6-31629a9ac8cd admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:24.979786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b861cb-71f8-4216-93a6-31629a9ac8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:24.980072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b861cb-71f8-4216-93a6-31629a9ac8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:24.980831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b861cb-71f8-4216-93a6-31629a9ac8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:24.982519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b861cb-71f8-4216-93a6-31629a9ac8cd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:25.027211 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3923/7949] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:25.028167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b861cb-71f8-4216-93a6-31629a9ac8cd admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:25.042001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-05b861cb-71f8-4216-93a6-31629a9ac8cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:25.101372 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:25.237006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4f2b2-20f8-45bf-9bf7-f69457cb258d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:25.269388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdaab8-f762-48f6-ae60-14cd89bb047a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:25.270081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdaab8-f762-48f6-ae60-14cd89bb047a service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:25.270635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdaab8-f762-48f6-ae60-14cd89bb047a service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:25.272865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdaab8-f762-48f6-ae60-14cd89bb047a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:25.274035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b861cb-71f8-4216-93a6-31629a9ac8cd admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:25.292411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c661bf5-4113-4c03-b9bf-18aade820fbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:25.299318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c661bf5-4113-4c03-b9bf-18aade820fbc service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:25.299972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c661bf5-4113-4c03-b9bf-18aade820fbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:25.300362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c661bf5-4113-4c03-b9bf-18aade820fbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:25.398005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c661bf5-4113-4c03-b9bf-18aade820fbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:25.399524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c661bf5-4113-4c03-b9bf-18aade820fbc service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:25.427966 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3924/7950] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:47:25.428837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c661bf5-4113-4c03-b9bf-18aade820fbc service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:25.451352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c661bf5-4113-4c03-b9bf-18aade820fbc service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:25.453705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bdaab8-f762-48f6-ae60-14cd89bb047a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:25.455905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bdaab8-f762-48f6-ae60-14cd89bb047a service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:25.462866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95af9de-f0c1-474d-886b-3ef42aa16886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:25.463845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95af9de-f0c1-474d-886b-3ef42aa16886 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:25.464628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95af9de-f0c1-474d-886b-3ef42aa16886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:25.464628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95af9de-f0c1-474d-886b-3ef42aa16886 admin admin] PATH_INFO: `/v3/projects/6cec271fb73b4675ac59eb58492996b3/users/f291b370a5d147f594c3789cd619559b/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:25.489712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95af9de-f0c1-474d-886b-3ef42aa16886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cec271fb73b4675ac59eb58492996b3, user_id=f291b370a5d147f594c3789cd619559b, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:25.492523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95af9de-f0c1-474d-886b-3ef42aa16886 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:25.518471 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4027/7951] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:47:25.554925 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:25.591214 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3925/7952] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:47:25 2022] PUT /identity/v3/projects/6cec271fb73b4675ac59eb58492996b3/users/f291b370a5d147f594c3789cd619559b/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:25.592928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdaab8-f762-48f6-ae60-14cd89bb047a service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:25.619864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdaab8-f762-48f6-ae60-14cd89bb047a service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:25.762475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b555451b-0af7-4df0-b573-737737ff2948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:25.764136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555451b-0af7-4df0-b573-737737ff2948 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:25.764577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555451b-0af7-4df0-b573-737737ff2948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:25.765169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555451b-0af7-4df0-b573-737737ff2948 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:25.765953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555451b-0af7-4df0-b573-737737ff2948 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:25.768153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b555451b-0af7-4df0-b573-737737ff2948 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:25.794248 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4028/7953] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:25.794406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95af9de-f0c1-474d-886b-3ef42aa16886 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:25.822897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95af9de-f0c1-474d-886b-3ef42aa16886 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:25.846603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06696d30-a734-404d-97cb-51ea18613931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:25.847528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06696d30-a734-404d-97cb-51ea18613931 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:25.847810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06696d30-a734-404d-97cb-51ea18613931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:25.848084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06696d30-a734-404d-97cb-51ea18613931 admin admin] PATH_INFO: `/v3/projects/6cec271fb73b4675ac59eb58492996b3/users/f291b370a5d147f594c3789cd619559b/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:25.864326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06696d30-a734-404d-97cb-51ea18613931 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cec271fb73b4675ac59eb58492996b3, user_id=f291b370a5d147f594c3789cd619559b, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:25.875929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06696d30-a734-404d-97cb-51ea18613931 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:25.900546 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3926/7954] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:47:25 2022] PUT /identity/v3/projects/6cec271fb73b4675ac59eb58492996b3/users/f291b370a5d147f594c3789cd619559b/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:25.914892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17f7e4-99ef-4843-81e5-3502d6b7c114 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:25.915189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17f7e4-99ef-4843-81e5-3502d6b7c114 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:25.915671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17f7e4-99ef-4843-81e5-3502d6b7c114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:25.982443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7c17f7e4-99ef-4843-81e5-3502d6b7c114 None None] MFA Rules not processed for user `f291b370a5d147f594c3789cd619559b`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:25.989190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7c17f7e4-99ef-4843-81e5-3502d6b7c114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:26.157049 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4029/7955] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:26.165446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06696d30-a734-404d-97cb-51ea18613931 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:26.167186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-06696d30-a734-404d-97cb-51ea18613931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:26.356108 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:26.357892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06696d30-a734-404d-97cb-51ea18613931 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:26.368851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a193aa-3a93-4c24-8aed-0e616f070eda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:26.370271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a193aa-3a93-4c24-8aed-0e616f070eda service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:26.370525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a193aa-3a93-4c24-8aed-0e616f070eda service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:26.371144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a193aa-3a93-4c24-8aed-0e616f070eda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:26.400435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a193aa-3a93-4c24-8aed-0e616f070eda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:26.402236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a193aa-3a93-4c24-8aed-0e616f070eda service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:26.444330 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3927/7956] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:47:26.745004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17f7e4-99ef-4843-81e5-3502d6b7c114 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:26.769614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17f7e4-99ef-4843-81e5-3502d6b7c114 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:26.773985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b1fc53-38a7-4026-aaa5-5e21cecd82f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:26.774934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1fc53-38a7-4026-aaa5-5e21cecd82f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:26.775424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1fc53-38a7-4026-aaa5-5e21cecd82f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:26.775893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1fc53-38a7-4026-aaa5-5e21cecd82f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:26.940483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1fc53-38a7-4026-aaa5-5e21cecd82f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:26.947425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b1fc53-38a7-4026-aaa5-5e21cecd82f3 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:26.982747 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4030/7957] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:47:27.088542 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:27.791729 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:28.172565 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:28.857918 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:29.892475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a193aa-3a93-4c24-8aed-0e616f070eda service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:29.895798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d9a193aa-3a93-4c24-8aed-0e616f070eda service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:30.182578 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a193aa-3a93-4c24-8aed-0e616f070eda service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:30.193217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83061922-ab2e-4a4c-b000-4eb9a7e8ca32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:30.211261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83061922-ab2e-4a4c-b000-4eb9a7e8ca32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:30.215726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83061922-ab2e-4a4c-b000-4eb9a7e8ca32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:30.221888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83061922-ab2e-4a4c-b000-4eb9a7e8ca32 admin admin] PATH_INFO: `/v3/users/05b84993c58d49ce9b37713ccbb7925e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:30.230239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83061922-ab2e-4a4c-b000-4eb9a7e8ca32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b84993c58d49ce9b37713ccbb7925e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:30.238951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83061922-ab2e-4a4c-b000-4eb9a7e8ca32 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:30.591014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-83061922-ab2e-4a4c-b000-4eb9a7e8ca32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b84993c58d49ce9b37713ccbb7925e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:30.634381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-83061922-ab2e-4a4c-b000-4eb9a7e8ca32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b84993c58d49ce9b37713ccbb7925e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:30.637255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-83061922-ab2e-4a4c-b000-4eb9a7e8ca32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b84993c58d49ce9b37713ccbb7925e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:30.643136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-83061922-ab2e-4a4c-b000-4eb9a7e8ca32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b84993c58d49ce9b37713ccbb7925e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:30.667101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-83061922-ab2e-4a4c-b000-4eb9a7e8ca32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b84993c58d49ce9b37713ccbb7925e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:30.812740 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3928/7958] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:47:29 2022] DELETE /identity/v3/users/05b84993c58d49ce9b37713ccbb7925e => generated 0 bytes in 921 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:30.817147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79df82-9f1c-4333-8266-16cc3b97c6b5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:30.819128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79df82-9f1c-4333-8266-16cc3b97c6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:30.819668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79df82-9f1c-4333-8266-16cc3b97c6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:30.856288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6d79df82-9f1c-4333-8266-16cc3b97c6b5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:30.861175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6d79df82-9f1c-4333-8266-16cc3b97c6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:31.098261 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4031/7959] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:31.109761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83061922-ab2e-4a4c-b000-4eb9a7e8ca32 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:31.110870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-83061922-ab2e-4a4c-b000-4eb9a7e8ca32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:31.294672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83061922-ab2e-4a4c-b000-4eb9a7e8ca32 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:31.313230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a149b-5f5b-4ed9-bf34-15bf705a589f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:31.313960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a149b-5f5b-4ed9-bf34-15bf705a589f service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:31.314278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a149b-5f5b-4ed9-bf34-15bf705a589f service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:31.314566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a149b-5f5b-4ed9-bf34-15bf705a589f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:31.343016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a149b-5f5b-4ed9-bf34-15bf705a589f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:31.344750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a149b-5f5b-4ed9-bf34-15bf705a589f service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:31.393859 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3929/7960] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:47:32.715287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79df82-9f1c-4333-8266-16cc3b97c6b5 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:32.716770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6d79df82-9f1c-4333-8266-16cc3b97c6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:32.743841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79df82-9f1c-4333-8266-16cc3b97c6b5 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:32.776420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcf877e-0465-4000-9f03-26387109ef83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:32.777301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf877e-0465-4000-9f03-26387109ef83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:32.777608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf877e-0465-4000-9f03-26387109ef83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:32.777877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf877e-0465-4000-9f03-26387109ef83 admin admin] PATH_INFO: `/v3/projects/cce12cce446d44deb6e465c5f180c821` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:32.779233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf877e-0465-4000-9f03-26387109ef83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cce12cce446d44deb6e465c5f180c821)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:32.781892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcf877e-0465-4000-9f03-26387109ef83 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:32.990235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4fcf877e-0465-4000-9f03-26387109ef83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cce12cce446d44deb6e465c5f180c821', 'request_id': 'req-4fcf877e-0465-4000-9f03-26387109ef83'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:33.015448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4fcf877e-0465-4000-9f03-26387109ef83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cce12cce446d44deb6e465c5f180c821', 'request_id': 'req-4fcf877e-0465-4000-9f03-26387109ef83'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:33.035506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4fcf877e-0465-4000-9f03-26387109ef83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cce12cce446d44deb6e465c5f180c821', 'request_id': 'req-4fcf877e-0465-4000-9f03-26387109ef83'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:33.138848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4fcf877e-0465-4000-9f03-26387109ef83 admin admin] The token cache is being invalidate because project cce12cce446d44deb6e465c5f180c821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:47:33.139491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4fcf877e-0465-4000-9f03-26387109ef83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:33.149257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4fcf877e-0465-4000-9f03-26387109ef83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:33.152213 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4032/7961] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:47:32 2022] DELETE /identity/v3/projects/cce12cce446d44deb6e465c5f180c821 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:47:34.481032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a149b-5f5b-4ed9-bf34-15bf705a589f service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:34.510436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a149b-5f5b-4ed9-bf34-15bf705a589f service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:34.538767 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:34.655909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69466f-e81f-4de6-a8ef-162d5e44215d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:34.655909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69466f-e81f-4de6-a8ef-162d5e44215d service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:34.656157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69466f-e81f-4de6-a8ef-162d5e44215d service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:34.656432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa69466f-e81f-4de6-a8ef-162d5e44215d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:34.660220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fa69466f-e81f-4de6-a8ef-162d5e44215d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:34.865601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69466f-e81f-4de6-a8ef-162d5e44215d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:34.869711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa69466f-e81f-4de6-a8ef-162d5e44215d service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:34.909621 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3930/7962] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:47:38.295612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef07ddf-bff2-4e64-bf12-e438e507dc77 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:38.299351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef07ddf-bff2-4e64-bf12-e438e507dc77 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:38.299351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef07ddf-bff2-4e64-bf12-e438e507dc77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:38.406011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4ef07ddf-bff2-4e64-bf12-e438e507dc77 None None] MFA Rules not processed for user `1bcd6722719e4807b66f15cd3542c1ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:38.409851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4ef07ddf-bff2-4e64-bf12-e438e507dc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:38.590948 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4033/7963] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:38.595947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69466f-e81f-4de6-a8ef-162d5e44215d service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:38.597492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fa69466f-e81f-4de6-a8ef-162d5e44215d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:38.770819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa69466f-e81f-4de6-a8ef-162d5e44215d service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:38.781396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489e8e6-0dba-4855-8f11-f9408ffe037a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:38.786457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489e8e6-0dba-4855-8f11-f9408ffe037a admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:38.786457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489e8e6-0dba-4855-8f11-f9408ffe037a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:38.787162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d489e8e6-0dba-4855-8f11-f9408ffe037a admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:38.788098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489e8e6-0dba-4855-8f11-f9408ffe037a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:38.791438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d489e8e6-0dba-4855-8f11-f9408ffe037a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:38.994386 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3931/7964] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:47:38 2022] POST /identity/v3/projects => generated 379 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:38.998396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef07ddf-bff2-4e64-bf12-e438e507dc77 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:39.020116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef07ddf-bff2-4e64-bf12-e438e507dc77 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:39.060724 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:39.191431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101494e2-d886-4df0-8b65-978282f91a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:39.192141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101494e2-d886-4df0-8b65-978282f91a5d admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:39.192435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101494e2-d886-4df0-8b65-978282f91a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:39.192724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101494e2-d886-4df0-8b65-978282f91a5d admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:39.198653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101494e2-d886-4df0-8b65-978282f91a5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:39.221164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101494e2-d886-4df0-8b65-978282f91a5d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:39.316735 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4034/7965] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:47:38 2022] POST /identity/v3/users => generated 296 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:39.321123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489e8e6-0dba-4855-8f11-f9408ffe037a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:39.348165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d489e8e6-0dba-4855-8f11-f9408ffe037a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:39.358014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f58d2-a9fa-4a64-bd6f-7a4570ffb84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:39.359333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f58d2-a9fa-4a64-bd6f-7a4570ffb84f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:39.362351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f58d2-a9fa-4a64-bd6f-7a4570ffb84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:39.362351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826f58d2-a9fa-4a64-bd6f-7a4570ffb84f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:39.362351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f58d2-a9fa-4a64-bd6f-7a4570ffb84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:39.363097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826f58d2-a9fa-4a64-bd6f-7a4570ffb84f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:39.396593 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3932/7966] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:39.405440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101494e2-d886-4df0-8b65-978282f91a5d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:39.418309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101494e2-d886-4df0-8b65-978282f91a5d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:39.428423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32493fe1-4208-468a-88b8-aa3be630aa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:39.430573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32493fe1-4208-468a-88b8-aa3be630aa8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:39.431071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32493fe1-4208-468a-88b8-aa3be630aa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:39.431527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32493fe1-4208-468a-88b8-aa3be630aa8d admin admin] PATH_INFO: `/v3/projects/51173238ee1048689f6f0a9c723f3161/users/acbe0705a9444204a6788175892f252e/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:39.454300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32493fe1-4208-468a-88b8-aa3be630aa8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=51173238ee1048689f6f0a9c723f3161, user_id=acbe0705a9444204a6788175892f252e, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:39.457641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32493fe1-4208-468a-88b8-aa3be630aa8d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:39.569136 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4035/7967] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:47:39 2022] PUT /identity/v3/projects/51173238ee1048689f6f0a9c723f3161/users/acbe0705a9444204a6788175892f252e/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:39.571463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f58d2-a9fa-4a64-bd6f-7a4570ffb84f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:39.587099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826f58d2-a9fa-4a64-bd6f-7a4570ffb84f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:39.683414 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:39.779402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edf641-34b5-4c2f-ab6b-4d7f072645c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:39.782023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edf641-34b5-4c2f-ab6b-4d7f072645c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:39.786535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edf641-34b5-4c2f-ab6b-4d7f072645c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:39.786535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01edf641-34b5-4c2f-ab6b-4d7f072645c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:39.786535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edf641-34b5-4c2f-ab6b-4d7f072645c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:39.786535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01edf641-34b5-4c2f-ab6b-4d7f072645c6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:39.820907 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3933/7968] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:39.824284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32493fe1-4208-468a-88b8-aa3be630aa8d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:39.843524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32493fe1-4208-468a-88b8-aa3be630aa8d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:39.865518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b606e24-e5b9-45dc-af71-c870c3a9fbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:39.868326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b606e24-e5b9-45dc-af71-c870c3a9fbdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:39.869995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b606e24-e5b9-45dc-af71-c870c3a9fbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:39.872001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b606e24-e5b9-45dc-af71-c870c3a9fbdb admin admin] PATH_INFO: `/v3/projects/51173238ee1048689f6f0a9c723f3161/users/acbe0705a9444204a6788175892f252e/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:39.881674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b606e24-e5b9-45dc-af71-c870c3a9fbdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=51173238ee1048689f6f0a9c723f3161, user_id=acbe0705a9444204a6788175892f252e, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:39.889904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b606e24-e5b9-45dc-af71-c870c3a9fbdb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:39.921174 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4036/7969] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:47:39 2022] PUT /identity/v3/projects/51173238ee1048689f6f0a9c723f3161/users/acbe0705a9444204a6788175892f252e/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:49.410741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edf641-34b5-4c2f-ab6b-4d7f072645c6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:49.416252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-01edf641-34b5-4c2f-ab6b-4d7f072645c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:49.564766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01edf641-34b5-4c2f-ab6b-4d7f072645c6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:49.631924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cdcd98-c99b-499e-bbc0-0023cd70a808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:49.632629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdcd98-c99b-499e-bbc0-0023cd70a808 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:49.633708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdcd98-c99b-499e-bbc0-0023cd70a808 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:49.633708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cdcd98-c99b-499e-bbc0-0023cd70a808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:49.636066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-50cdcd98-c99b-499e-bbc0-0023cd70a808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:49.760391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdcd98-c99b-499e-bbc0-0023cd70a808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:49.762066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cdcd98-c99b-499e-bbc0-0023cd70a808 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:49.815348 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3934/7970] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:47:49.907097 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=39,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:51.884216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b606e24-e5b9-45dc-af71-c870c3a9fbdb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:51.886555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3b606e24-e5b9-45dc-af71-c870c3a9fbdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:52.044513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b606e24-e5b9-45dc-af71-c870c3a9fbdb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:52.056523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511f9b4-b400-45c0-985d-8ca998b7eea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:52.057452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511f9b4-b400-45c0-985d-8ca998b7eea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:52.061921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511f9b4-b400-45c0-985d-8ca998b7eea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:52.062348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511f9b4-b400-45c0-985d-8ca998b7eea2 admin admin] PATH_INFO: `/v3/users/8918279c3079423181ca1d8974ec1377` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:52.066501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511f9b4-b400-45c0-985d-8ca998b7eea2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8918279c3079423181ca1d8974ec1377)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:52.068500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e511f9b4-b400-45c0-985d-8ca998b7eea2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:52.334321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e511f9b4-b400-45c0-985d-8ca998b7eea2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8918279c3079423181ca1d8974ec1377'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:52.366124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e511f9b4-b400-45c0-985d-8ca998b7eea2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8918279c3079423181ca1d8974ec1377'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:52.386642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e511f9b4-b400-45c0-985d-8ca998b7eea2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8918279c3079423181ca1d8974ec1377'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:52.388265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e511f9b4-b400-45c0-985d-8ca998b7eea2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8918279c3079423181ca1d8974ec1377'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:52.527970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e511f9b4-b400-45c0-985d-8ca998b7eea2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8918279c3079423181ca1d8974ec1377'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:52.544203 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4037/7971] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:47:51 2022] DELETE /identity/v3/users/8918279c3079423181ca1d8974ec1377 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:52.547127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e37929-8ae5-4b5c-abca-3aff54fa7469 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:52.547938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e37929-8ae5-4b5c-abca-3aff54fa7469 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:52.548417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e37929-8ae5-4b5c-abca-3aff54fa7469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:52.626309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-11e37929-8ae5-4b5c-abca-3aff54fa7469 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:52.630770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-11e37929-8ae5-4b5c-abca-3aff54fa7469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:52.719122 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:52.788253 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3935/7972] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:52.998774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511f9b4-b400-45c0-985d-8ca998b7eea2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:53.001153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e511f9b4-b400-45c0-985d-8ca998b7eea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:53.274601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511f9b4-b400-45c0-985d-8ca998b7eea2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:53.283603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23179865-f401-4113-98b6-dd79d4b8cb7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:53.285349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23179865-f401-4113-98b6-dd79d4b8cb7f service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:53.285844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23179865-f401-4113-98b6-dd79d4b8cb7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:53.286331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23179865-f401-4113-98b6-dd79d4b8cb7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:53.307890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23179865-f401-4113-98b6-dd79d4b8cb7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:53.311557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23179865-f401-4113-98b6-dd79d4b8cb7f service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:53.345639 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4038/7973] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:47:54.461425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e37929-8ae5-4b5c-abca-3aff54fa7469 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:54.463313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-11e37929-8ae5-4b5c-abca-3aff54fa7469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:54.486526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e37929-8ae5-4b5c-abca-3aff54fa7469 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:54.495401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7528c04-9acf-49d1-86ff-f3d79e185e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:54.496370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7528c04-9acf-49d1-86ff-f3d79e185e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:54.500064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7528c04-9acf-49d1-86ff-f3d79e185e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:54.500248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7528c04-9acf-49d1-86ff-f3d79e185e14 admin admin] PATH_INFO: `/v3/projects/915605f8dcd5461c8a4132538e99438b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:54.503981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7528c04-9acf-49d1-86ff-f3d79e185e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=915605f8dcd5461c8a4132538e99438b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:54.505947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7528c04-9acf-49d1-86ff-f3d79e185e14 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:54.734086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7528c04-9acf-49d1-86ff-f3d79e185e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '915605f8dcd5461c8a4132538e99438b', 'request_id': 'req-f7528c04-9acf-49d1-86ff-f3d79e185e14'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:54.735730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05335bbe-cda5-47ab-bceb-d78796d0b378 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:54.736211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05335bbe-cda5-47ab-bceb-d78796d0b378 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:54.736323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05335bbe-cda5-47ab-bceb-d78796d0b378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:54.795576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-05335bbe-cda5-47ab-bceb-d78796d0b378 None None] MFA Rules not processed for user `acbe0705a9444204a6788175892f252e`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:54.796990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-05335bbe-cda5-47ab-bceb-d78796d0b378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:54.821669 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:54.842389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7528c04-9acf-49d1-86ff-f3d79e185e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '915605f8dcd5461c8a4132538e99438b', 'request_id': 'req-f7528c04-9acf-49d1-86ff-f3d79e185e14'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:54.865418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7528c04-9acf-49d1-86ff-f3d79e185e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '915605f8dcd5461c8a4132538e99438b', 'request_id': 'req-f7528c04-9acf-49d1-86ff-f3d79e185e14'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:54.943310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7528c04-9acf-49d1-86ff-f3d79e185e14 admin admin] The token cache is being invalidate because project 915605f8dcd5461c8a4132538e99438b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:47:54.943966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7528c04-9acf-49d1-86ff-f3d79e185e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:54.944901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7528c04-9acf-49d1-86ff-f3d79e185e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:54.951361 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3936/7974] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:47:54 2022] DELETE /identity/v3/projects/915605f8dcd5461c8a4132538e99438b => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:54.955283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7528c04-9acf-49d1-86ff-f3d79e185e14 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:54.957150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f7528c04-9acf-49d1-86ff-f3d79e185e14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:54.993395 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4039/7975] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:55.021700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05335bbe-cda5-47ab-bceb-d78796d0b378 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:55.023933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-05335bbe-cda5-47ab-bceb-d78796d0b378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:55.137065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05335bbe-cda5-47ab-bceb-d78796d0b378 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:55.152635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fa999-b8b0-4172-b3e5-3040b1fb2839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:55.153619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fa999-b8b0-4172-b3e5-3040b1fb2839 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:55.155876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fa999-b8b0-4172-b3e5-3040b1fb2839 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:55.156749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4fa999-b8b0-4172-b3e5-3040b1fb2839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:55.184265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fa999-b8b0-4172-b3e5-3040b1fb2839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:55.190847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4fa999-b8b0-4172-b3e5-3040b1fb2839 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:55.252759 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4040/7976] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:47:55.335476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7528c04-9acf-49d1-86ff-f3d79e185e14 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:55.358577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6552626-192e-410a-913b-3ca54d575c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:55.362511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6552626-192e-410a-913b-3ca54d575c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:55.364032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6552626-192e-410a-913b-3ca54d575c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:55.365344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6552626-192e-410a-913b-3ca54d575c28 admin admin] PATH_INFO: `/v3/users/f291b370a5d147f594c3789cd619559b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:55.370532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6552626-192e-410a-913b-3ca54d575c28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f291b370a5d147f594c3789cd619559b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:55.375605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6552626-192e-410a-913b-3ca54d575c28 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:55.671294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6552626-192e-410a-913b-3ca54d575c28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f291b370a5d147f594c3789cd619559b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:55.699776 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:55.716224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6552626-192e-410a-913b-3ca54d575c28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f291b370a5d147f594c3789cd619559b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:55.720043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6552626-192e-410a-913b-3ca54d575c28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f291b370a5d147f594c3789cd619559b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:55.722670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6552626-192e-410a-913b-3ca54d575c28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f291b370a5d147f594c3789cd619559b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:55.748003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6552626-192e-410a-913b-3ca54d575c28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f291b370a5d147f594c3789cd619559b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:55.864816 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3937/7977] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:47:54 2022] DELETE /identity/v3/users/f291b370a5d147f594c3789cd619559b => generated 0 bytes in 907 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:55.924786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fa999-b8b0-4172-b3e5-3040b1fb2839 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:55.927060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ca4fa999-b8b0-4172-b3e5-3040b1fb2839 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:56.072501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4fa999-b8b0-4172-b3e5-3040b1fb2839 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:56.112499 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:56.148396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a2448-3991-43ec-b0ee-c9b56cfdb410 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:56.149351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a2448-3991-43ec-b0ee-c9b56cfdb410 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:56.149958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a2448-3991-43ec-b0ee-c9b56cfdb410 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:56.150460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a2448-3991-43ec-b0ee-c9b56cfdb410 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:56.152806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-aa2a2448-3991-43ec-b0ee-c9b56cfdb410 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:56.170907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a2448-3991-43ec-b0ee-c9b56cfdb410 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:56.173036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a2448-3991-43ec-b0ee-c9b56cfdb410 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:56.189572 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4041/7978] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:47:56.855038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6552626-192e-410a-913b-3ca54d575c28 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:56.859129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f6552626-192e-410a-913b-3ca54d575c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:56.917493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6552626-192e-410a-913b-3ca54d575c28 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:56.941352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547fdfa-cd97-46e5-b2d5-1769834ded63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:56.946273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547fdfa-cd97-46e5-b2d5-1769834ded63 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:56.946273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547fdfa-cd97-46e5-b2d5-1769834ded63 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:56.946273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547fdfa-cd97-46e5-b2d5-1769834ded63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:56.951641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a547fdfa-cd97-46e5-b2d5-1769834ded63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:56.992018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547fdfa-cd97-46e5-b2d5-1769834ded63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:56.995500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547fdfa-cd97-46e5-b2d5-1769834ded63 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:57.039949 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3938/7979] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:47:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:47:57.246993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a2448-3991-43ec-b0ee-c9b56cfdb410 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:57.254943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-aa2a2448-3991-43ec-b0ee-c9b56cfdb410 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:57.412206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a2448-3991-43ec-b0ee-c9b56cfdb410 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:57.422009 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e42498-dd03-465e-8575-930fafc2ac7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:57.423010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e42498-dd03-465e-8575-930fafc2ac7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:57.423396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e42498-dd03-465e-8575-930fafc2ac7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:57.423686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e42498-dd03-465e-8575-930fafc2ac7a admin admin] PATH_INFO: `/v3/projects/6cec271fb73b4675ac59eb58492996b3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:57.439073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e42498-dd03-465e-8575-930fafc2ac7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cec271fb73b4675ac59eb58492996b3)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:57.445352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e42498-dd03-465e-8575-930fafc2ac7a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:57.718853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f2e42498-dd03-465e-8575-930fafc2ac7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cec271fb73b4675ac59eb58492996b3', 'request_id': 'req-f2e42498-dd03-465e-8575-930fafc2ac7a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:57.773583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f2e42498-dd03-465e-8575-930fafc2ac7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cec271fb73b4675ac59eb58492996b3', 'request_id': 'req-f2e42498-dd03-465e-8575-930fafc2ac7a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:57.792300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f2e42498-dd03-465e-8575-930fafc2ac7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cec271fb73b4675ac59eb58492996b3', 'request_id': 'req-f2e42498-dd03-465e-8575-930fafc2ac7a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:57.910575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f2e42498-dd03-465e-8575-930fafc2ac7a admin admin] The token cache is being invalidate because project 6cec271fb73b4675ac59eb58492996b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:47:57.911192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f2e42498-dd03-465e-8575-930fafc2ac7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:57.915298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f2e42498-dd03-465e-8575-930fafc2ac7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:47:57.927128 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4042/7980] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:47:57 2022] DELETE /identity/v3/projects/6cec271fb73b4675ac59eb58492996b3 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:57.927294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9f370-f06d-43d0-be0d-4e4a88481c46 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:57.927294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9f370-f06d-43d0-be0d-4e4a88481c46 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:57.927294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e9f370-f06d-43d0-be0d-4e4a88481c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:57.981633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e7e9f370-f06d-43d0-be0d-4e4a88481c46 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:57.983611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e7e9f370-f06d-43d0-be0d-4e4a88481c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:58.216561 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3939/7981] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:58.223610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e18a61-3d9d-4627-b3e4-440b97b6cc2d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:58.223923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e18a61-3d9d-4627-b3e4-440b97b6cc2d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:58.224210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e18a61-3d9d-4627-b3e4-440b97b6cc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:58.264885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b1e18a61-3d9d-4627-b3e4-440b97b6cc2d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:58.268912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b1e18a61-3d9d-4627-b3e4-440b97b6cc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:58.308065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9f370-f06d-43d0-be0d-4e4a88481c46 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:58.308957 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4043/7982] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:58.327368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e9f370-f06d-43d0-be0d-4e4a88481c46 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:58.347024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c7993-c11d-4d2e-b95e-231c4de23d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:58.347765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c7993-c11d-4d2e-b95e-231c4de23d9b admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:58.348057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c7993-c11d-4d2e-b95e-231c4de23d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:58.348347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c7993-c11d-4d2e-b95e-231c4de23d9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:58.349225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c7993-c11d-4d2e-b95e-231c4de23d9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:47:58.349518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c7993-c11d-4d2e-b95e-231c4de23d9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:58.351197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c7993-c11d-4d2e-b95e-231c4de23d9b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:58.393371 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3940/7983] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:47:58.399017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e18a61-3d9d-4627-b3e4-440b97b6cc2d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:58.415334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e18a61-3d9d-4627-b3e4-440b97b6cc2d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:58.433450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fd0cd-3f02-452e-800a-b45e1892efcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:58.436126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fd0cd-3f02-452e-800a-b45e1892efcc admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:58.436662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fd0cd-3f02-452e-800a-b45e1892efcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:58.437557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fd0cd-3f02-452e-800a-b45e1892efcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:58.438651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fd0cd-3f02-452e-800a-b45e1892efcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:58.443478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fd0cd-3f02-452e-800a-b45e1892efcc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:58.603825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c7993-c11d-4d2e-b95e-231c4de23d9b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:58.611277 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4044/7984] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:47:58 2022] POST /identity/v3/projects => generated 381 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:47:58.621572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c7993-c11d-4d2e-b95e-231c4de23d9b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:58.834967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04496145-06c0-4dad-8fc0-b8659fdb25c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:58.839749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04496145-06c0-4dad-8fc0-b8659fdb25c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:58.842871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04496145-06c0-4dad-8fc0-b8659fdb25c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:58.843269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04496145-06c0-4dad-8fc0-b8659fdb25c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:58.845060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04496145-06c0-4dad-8fc0-b8659fdb25c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:58.847369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04496145-06c0-4dad-8fc0-b8659fdb25c1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:58.973997 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3941/7985] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:47:58 2022] POST /identity/v3/users => generated 291 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:47:58.978879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fd0cd-3f02-452e-800a-b45e1892efcc admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:58.996301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fd0cd-3f02-452e-800a-b45e1892efcc admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:59.019225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749efc4-c540-4195-9e56-3810b0967444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:59.020348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749efc4-c540-4195-9e56-3810b0967444 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:59.020884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749efc4-c540-4195-9e56-3810b0967444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:59.021422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e749efc4-c540-4195-9e56-3810b0967444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:59.026403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749efc4-c540-4195-9e56-3810b0967444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:59.029140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e749efc4-c540-4195-9e56-3810b0967444 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:59.065833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04496145-06c0-4dad-8fc0-b8659fdb25c1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:59.078801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04496145-06c0-4dad-8fc0-b8659fdb25c1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:59.082983 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4045/7986] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:59.095031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b3598-885d-4153-b0ed-2c8d310d92f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:59.097170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b3598-885d-4153-b0ed-2c8d310d92f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:59.099830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b3598-885d-4153-b0ed-2c8d310d92f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:59.100425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b3598-885d-4153-b0ed-2c8d310d92f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:59.101512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b3598-885d-4153-b0ed-2c8d310d92f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:59.106148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b3598-885d-4153-b0ed-2c8d310d92f3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:59.141670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749efc4-c540-4195-9e56-3810b0967444 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:59.151767 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3942/7987] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:47:59.157180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e749efc4-c540-4195-9e56-3810b0967444 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:59.172804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f42ab-18e8-4ae5-91f8-41b6cbffaf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:59.174864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f42ab-18e8-4ae5-91f8-41b6cbffaf01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:59.175471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f42ab-18e8-4ae5-91f8-41b6cbffaf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:59.175992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f42ab-18e8-4ae5-91f8-41b6cbffaf01 admin admin] PATH_INFO: `/v3/projects/f17920cd79924331a407f62f3f38c390/users/879f1fbb64994712a3a770a16037af4d/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:59.209064 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:59.219399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f42ab-18e8-4ae5-91f8-41b6cbffaf01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f17920cd79924331a407f62f3f38c390, user_id=879f1fbb64994712a3a770a16037af4d, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:59.225076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f42ab-18e8-4ae5-91f8-41b6cbffaf01 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:59.346534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfbb17-c2de-4099-bb56-42b7f7b52949 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:59.346925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfbb17-c2de-4099-bb56-42b7f7b52949 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:59.347315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cfbb17-c2de-4099-bb56-42b7f7b52949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:59.349235 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4046/7988] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:47:59 2022] PUT /identity/v3/projects/f17920cd79924331a407f62f3f38c390/users/879f1fbb64994712a3a770a16037af4d/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:47:59.396718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-36cfbb17-c2de-4099-bb56-42b7f7b52949 None None] MFA Rules not processed for user `879f1fbb64994712a3a770a16037af4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:47:59.398175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-36cfbb17-c2de-4099-bb56-42b7f7b52949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:47:59.432113 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:47:59.574270 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3943/7989] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:47:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:47:59.576314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f42ab-18e8-4ae5-91f8-41b6cbffaf01 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:59.719974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f42ab-18e8-4ae5-91f8-41b6cbffaf01 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:47:59.734524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56aa51-5f4b-43f4-ac76-062f94044dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:47:59.735309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56aa51-5f4b-43f4-ac76-062f94044dee admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:47:59.735604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56aa51-5f4b-43f4-ac76-062f94044dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:47:59.735886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56aa51-5f4b-43f4-ac76-062f94044dee admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:47:59.736607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56aa51-5f4b-43f4-ac76-062f94044dee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:47:59.743469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e56aa51-5f4b-43f4-ac76-062f94044dee admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:47:59.879513 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4047/7990] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:47:59 2022] POST /identity/v3/projects => generated 383 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:47:59.884209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfbb17-c2de-4099-bb56-42b7f7b52949 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:47:59.907641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cfbb17-c2de-4099-bb56-42b7f7b52949 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:00.110522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39026c-59c1-4bde-8a0f-20949183e1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:00.111148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39026c-59c1-4bde-8a0f-20949183e1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:00.112318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39026c-59c1-4bde-8a0f-20949183e1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:00.112619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed39026c-59c1-4bde-8a0f-20949183e1d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:00.113351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39026c-59c1-4bde-8a0f-20949183e1d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:00.120702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed39026c-59c1-4bde-8a0f-20949183e1d8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:00.250923 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3944/7991] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:47:59 2022] POST /identity/v3/users => generated 298 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:48:00.252397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56aa51-5f4b-43f4-ac76-062f94044dee admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:00.275489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56aa51-5f4b-43f4-ac76-062f94044dee admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:00.286118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66146b95-2000-4d3d-8831-3faf73f9a595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:00.286877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66146b95-2000-4d3d-8831-3faf73f9a595 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:00.287175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66146b95-2000-4d3d-8831-3faf73f9a595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:00.287461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66146b95-2000-4d3d-8831-3faf73f9a595 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:00.290391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66146b95-2000-4d3d-8831-3faf73f9a595 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:00.292675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66146b95-2000-4d3d-8831-3faf73f9a595 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:00.329978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39026c-59c1-4bde-8a0f-20949183e1d8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:00.343325 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4048/7992] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:48:00.344566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed39026c-59c1-4bde-8a0f-20949183e1d8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:00.402500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc854fb-a240-4d84-b1e6-f7b50e9a10bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:00.404531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc854fb-a240-4d84-b1e6-f7b50e9a10bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:00.404829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc854fb-a240-4d84-b1e6-f7b50e9a10bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:00.405101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc854fb-a240-4d84-b1e6-f7b50e9a10bc admin admin] PATH_INFO: `/v3/projects/4a92158f078e4c97bd4911c547913a42/users/c92e937885984382a80693cdcb382582/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:00.462884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc854fb-a240-4d84-b1e6-f7b50e9a10bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a92158f078e4c97bd4911c547913a42, user_id=c92e937885984382a80693cdcb382582, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:00.475333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc854fb-a240-4d84-b1e6-f7b50e9a10bc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:00.556413 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3945/7993] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:48:00 2022] PUT /identity/v3/projects/4a92158f078e4c97bd4911c547913a42/users/c92e937885984382a80693cdcb382582/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:48:00.563118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66146b95-2000-4d3d-8831-3faf73f9a595 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:00.594359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66146b95-2000-4d3d-8831-3faf73f9a595 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:00.725488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd4661d-9e5d-4c84-8977-24ff69cc0e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:00.726253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4661d-9e5d-4c84-8977-24ff69cc0e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:00.726545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4661d-9e5d-4c84-8977-24ff69cc0e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:00.726827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd4661d-9e5d-4c84-8977-24ff69cc0e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:00.727576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4661d-9e5d-4c84-8977-24ff69cc0e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:00.730332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd4661d-9e5d-4c84-8977-24ff69cc0e2f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:00.751451 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4049/7994] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:00 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:48:00.752674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc854fb-a240-4d84-b1e6-f7b50e9a10bc admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:00.766297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc854fb-a240-4d84-b1e6-f7b50e9a10bc admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:00.773580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215ce33-0e56-4ac0-9194-ad5621bc041d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:00.776199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215ce33-0e56-4ac0-9194-ad5621bc041d admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:00.776550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215ce33-0e56-4ac0-9194-ad5621bc041d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:00.776890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215ce33-0e56-4ac0-9194-ad5621bc041d admin admin] PATH_INFO: `/v3/projects/4a92158f078e4c97bd4911c547913a42/users/c92e937885984382a80693cdcb382582/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:00.780365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215ce33-0e56-4ac0-9194-ad5621bc041d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a92158f078e4c97bd4911c547913a42, user_id=c92e937885984382a80693cdcb382582, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:00.785306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215ce33-0e56-4ac0-9194-ad5621bc041d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:00.812013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99af899-82b2-4d4d-8426-4dcb34508368 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:00.812336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99af899-82b2-4d4d-8426-4dcb34508368 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:00.815045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99af899-82b2-4d4d-8426-4dcb34508368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:00.815375 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3946/7995] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:48:00 2022] PUT /identity/v3/projects/4a92158f078e4c97bd4911c547913a42/users/c92e937885984382a80693cdcb382582/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:00.864730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a99af899-82b2-4d4d-8426-4dcb34508368 None None] MFA Rules not processed for user `c92e937885984382a80693cdcb382582`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:00.867316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a99af899-82b2-4d4d-8426-4dcb34508368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:00.945543 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:00.978552 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4050/7996] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:00.991250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215ce33-0e56-4ac0-9194-ad5621bc041d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:00.993306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f215ce33-0e56-4ac0-9194-ad5621bc041d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:01.149179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215ce33-0e56-4ac0-9194-ad5621bc041d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:01.162127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc0ba1-c3a9-4dbc-ab80-9df397f2005a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:01.163085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc0ba1-c3a9-4dbc-ab80-9df397f2005a service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:01.163545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc0ba1-c3a9-4dbc-ab80-9df397f2005a service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:01.164168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc0ba1-c3a9-4dbc-ab80-9df397f2005a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:01.227643 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:01.276857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc0ba1-c3a9-4dbc-ab80-9df397f2005a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:01.279628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc0ba1-c3a9-4dbc-ab80-9df397f2005a service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:01.292164 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3947/7997] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:04.518075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189757e-c02c-4ba4-a66c-f9543a3ca2de None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:04.518599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189757e-c02c-4ba4-a66c-f9543a3ca2de None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:04.518707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189757e-c02c-4ba4-a66c-f9543a3ca2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:04.571274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1189757e-c02c-4ba4-a66c-f9543a3ca2de None None] MFA Rules not processed for user `eee4c63b80eb407395e862126b73d6d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:04.574209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1189757e-c02c-4ba4-a66c-f9543a3ca2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:04.724550 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4051/7998] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:05.833274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fd76a-85a0-4d25-a0e7-5f36fe18482a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:05.833777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fd76a-85a0-4d25-a0e7-5f36fe18482a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:05.833873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89fd76a-85a0-4d25-a0e7-5f36fe18482a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:05.882870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e89fd76a-85a0-4d25-a0e7-5f36fe18482a None None] MFA Rules not processed for user `f933a71a6d5d45db993a430166f49c95`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:05.884420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e89fd76a-85a0-4d25-a0e7-5f36fe18482a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:06.115821 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3948/7999] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:06.539217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189757e-c02c-4ba4-a66c-f9543a3ca2de None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:06.540963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1189757e-c02c-4ba4-a66c-f9543a3ca2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:06.725326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189757e-c02c-4ba4-a66c-f9543a3ca2de None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:06.738440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e6b1c-82d4-455e-beb1-a14bd910322d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:06.739186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e6b1c-82d4-455e-beb1-a14bd910322d service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:06.740914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e6b1c-82d4-455e-beb1-a14bd910322d service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:06.741219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e6b1c-82d4-455e-beb1-a14bd910322d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:06.747444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e07e6b1c-82d4-455e-beb1-a14bd910322d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:06.776097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e6b1c-82d4-455e-beb1-a14bd910322d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:06.777643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e6b1c-82d4-455e-beb1-a14bd910322d service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:06.809222 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4052/8000] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:08.359364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fd76a-85a0-4d25-a0e7-5f36fe18482a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:08.362859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e89fd76a-85a0-4d25-a0e7-5f36fe18482a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:08.391554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89fd76a-85a0-4d25-a0e7-5f36fe18482a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:08.399706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98982c8b-9da5-4643-aa2a-6c2ad4be8010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:08.404410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98982c8b-9da5-4643-aa2a-6c2ad4be8010 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:08.404894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98982c8b-9da5-4643-aa2a-6c2ad4be8010 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:08.405281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98982c8b-9da5-4643-aa2a-6c2ad4be8010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:08.410423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-98982c8b-9da5-4643-aa2a-6c2ad4be8010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:08.459042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98982c8b-9da5-4643-aa2a-6c2ad4be8010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:08.465317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98982c8b-9da5-4643-aa2a-6c2ad4be8010 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:08.497964 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3949/8001] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:08.703936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e6b1c-82d4-455e-beb1-a14bd910322d service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:08.705730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e07e6b1c-82d4-455e-beb1-a14bd910322d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:08.916212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e6b1c-82d4-455e-beb1-a14bd910322d service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:08.922846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a46c1a-511f-4769-9b60-13542e0697aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:08.923916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a46c1a-511f-4769-9b60-13542e0697aa service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:08.924295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a46c1a-511f-4769-9b60-13542e0697aa service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:08.924815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a46c1a-511f-4769-9b60-13542e0697aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:08.927006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-28a46c1a-511f-4769-9b60-13542e0697aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:08.953840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a46c1a-511f-4769-9b60-13542e0697aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:08.958934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a46c1a-511f-4769-9b60-13542e0697aa service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:09.002571 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4053/8002] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:10.954957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98982c8b-9da5-4643-aa2a-6c2ad4be8010 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:10.974314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98982c8b-9da5-4643-aa2a-6c2ad4be8010 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:10.984816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be442e6-5fb8-415c-b56a-dacd400b9f42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:10.985765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be442e6-5fb8-415c-b56a-dacd400b9f42 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:10.986262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be442e6-5fb8-415c-b56a-dacd400b9f42 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:10.986736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be442e6-5fb8-415c-b56a-dacd400b9f42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:10.988652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8be442e6-5fb8-415c-b56a-dacd400b9f42 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:11.017426 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be442e6-5fb8-415c-b56a-dacd400b9f42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:11.025618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be442e6-5fb8-415c-b56a-dacd400b9f42 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:11.052439 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3950/8003] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:11.257913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a46c1a-511f-4769-9b60-13542e0697aa service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:11.297249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a46c1a-511f-4769-9b60-13542e0697aa service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:11.318370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec31f1-8f54-48de-884e-8d4b1fe20c5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:11.319264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec31f1-8f54-48de-884e-8d4b1fe20c5c service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:11.319725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec31f1-8f54-48de-884e-8d4b1fe20c5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:11.320610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec31f1-8f54-48de-884e-8d4b1fe20c5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:11.362043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec31f1-8f54-48de-884e-8d4b1fe20c5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:11.363553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dec31f1-8f54-48de-884e-8d4b1fe20c5c service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:11.390349 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4054/8004] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:15.636742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be442e6-5fb8-415c-b56a-dacd400b9f42 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:15.667570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be442e6-5fb8-415c-b56a-dacd400b9f42 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:15.677701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936391c3-3936-4641-81f3-fc9b871d2dbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:15.678474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936391c3-3936-4641-81f3-fc9b871d2dbf service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:15.678763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936391c3-3936-4641-81f3-fc9b871d2dbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:15.679046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936391c3-3936-4641-81f3-fc9b871d2dbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:15.695756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-936391c3-3936-4641-81f3-fc9b871d2dbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:15.710445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936391c3-3936-4641-81f3-fc9b871d2dbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:15.713160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936391c3-3936-4641-81f3-fc9b871d2dbf service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:15.726989 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3951/8005] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:19.523429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec31f1-8f54-48de-884e-8d4b1fe20c5c service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:19.523429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6dec31f1-8f54-48de-884e-8d4b1fe20c5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:19.559300 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:19.735849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec31f1-8f54-48de-884e-8d4b1fe20c5c service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:19.755702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f29ef-7235-44b1-9707-86cc67c9bef1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:19.758452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f29ef-7235-44b1-9707-86cc67c9bef1 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:19.759016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f29ef-7235-44b1-9707-86cc67c9bef1 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:19.760490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f29ef-7235-44b1-9707-86cc67c9bef1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:19.769811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-603f29ef-7235-44b1-9707-86cc67c9bef1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:19.801534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f29ef-7235-44b1-9707-86cc67c9bef1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:19.808297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603f29ef-7235-44b1-9707-86cc67c9bef1 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:19.832682 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4055/8006] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:22.060118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936391c3-3936-4641-81f3-fc9b871d2dbf service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:22.063610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-936391c3-3936-4641-81f3-fc9b871d2dbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:22.201085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936391c3-3936-4641-81f3-fc9b871d2dbf service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:22.213771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986e3fb-a001-4d2b-ac7c-10d36aad533f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:22.216352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986e3fb-a001-4d2b-ac7c-10d36aad533f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:22.216352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986e3fb-a001-4d2b-ac7c-10d36aad533f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:22.216352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986e3fb-a001-4d2b-ac7c-10d36aad533f admin admin] PATH_INFO: `/v3/users/c1063412fb8740d888a12ca14eea85e7` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:22.224972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986e3fb-a001-4d2b-ac7c-10d36aad533f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1063412fb8740d888a12ca14eea85e7)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:22.236468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986e3fb-a001-4d2b-ac7c-10d36aad533f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:22.441838 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:22.467480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d986e3fb-a001-4d2b-ac7c-10d36aad533f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1063412fb8740d888a12ca14eea85e7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:22.515200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d986e3fb-a001-4d2b-ac7c-10d36aad533f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1063412fb8740d888a12ca14eea85e7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:22.516720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d986e3fb-a001-4d2b-ac7c-10d36aad533f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1063412fb8740d888a12ca14eea85e7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:22.517637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d986e3fb-a001-4d2b-ac7c-10d36aad533f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1063412fb8740d888a12ca14eea85e7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:22.535913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d986e3fb-a001-4d2b-ac7c-10d36aad533f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1063412fb8740d888a12ca14eea85e7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:22.631108 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3952/8007] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:48:22 2022] DELETE /identity/v3/users/c1063412fb8740d888a12ca14eea85e7 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:22.633047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af899b1-605f-44a0-9e09-17a367734cbf None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:22.633527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af899b1-605f-44a0-9e09-17a367734cbf None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:22.633845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af899b1-605f-44a0-9e09-17a367734cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:22.656049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0af899b1-605f-44a0-9e09-17a367734cbf None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:22.657580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0af899b1-605f-44a0-9e09-17a367734cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:22.793621 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4056/8008] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:22.826326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986e3fb-a001-4d2b-ac7c-10d36aad533f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:22.828174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d986e3fb-a001-4d2b-ac7c-10d36aad533f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:22.960790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986e3fb-a001-4d2b-ac7c-10d36aad533f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:22.976339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0a119-05f3-4505-92ee-b51e1a800ff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:22.977088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0a119-05f3-4505-92ee-b51e1a800ff8 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:22.977377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0a119-05f3-4505-92ee-b51e1a800ff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:22.977846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0a119-05f3-4505-92ee-b51e1a800ff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:23.002822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0a119-05f3-4505-92ee-b51e1a800ff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:23.005066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0a119-05f3-4505-92ee-b51e1a800ff8 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:23.039152 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3953/8009] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:23.379459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af899b1-605f-44a0-9e09-17a367734cbf None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:23.381025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0af899b1-605f-44a0-9e09-17a367734cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:23.563676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af899b1-605f-44a0-9e09-17a367734cbf None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:23.576766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c2059-f1d6-4d5e-9298-fbf3d46f7e6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:23.577461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c2059-f1d6-4d5e-9298-fbf3d46f7e6d service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:23.577754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c2059-f1d6-4d5e-9298-fbf3d46f7e6d service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:23.578040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c2059-f1d6-4d5e-9298-fbf3d46f7e6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:23.588599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c41c2059-f1d6-4d5e-9298-fbf3d46f7e6d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:23.669663 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:23.725117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c2059-f1d6-4d5e-9298-fbf3d46f7e6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:23.729360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c2059-f1d6-4d5e-9298-fbf3d46f7e6d service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:23.764639 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4057/8010] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:48:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:48:24.053892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0a119-05f3-4505-92ee-b51e1a800ff8 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:24.055444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-30b0a119-05f3-4505-92ee-b51e1a800ff8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:24.066935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c2059-f1d6-4d5e-9298-fbf3d46f7e6d service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:24.068405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c41c2059-f1d6-4d5e-9298-fbf3d46f7e6d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:24.073886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0a119-05f3-4505-92ee-b51e1a800ff8 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:24.080101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812e24d8-9bcf-4c8c-bda6-a58b48d60f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:24.082754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e24d8-9bcf-4c8c-bda6-a58b48d60f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:24.083246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e24d8-9bcf-4c8c-bda6-a58b48d60f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:24.085526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812e24d8-9bcf-4c8c-bda6-a58b48d60f31 admin admin] PATH_INFO: `/v3/users/c787dc6ce1df4d378f54af37ef188a06` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:24.098396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e24d8-9bcf-4c8c-bda6-a58b48d60f31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c787dc6ce1df4d378f54af37ef188a06)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:24.101172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812e24d8-9bcf-4c8c-bda6-a58b48d60f31 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:24.103591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c2059-f1d6-4d5e-9298-fbf3d46f7e6d service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:24.137577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b5456-85d0-40f8-9694-b2158f1bd4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:24.142255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b5456-85d0-40f8-9694-b2158f1bd4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:24.145063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b5456-85d0-40f8-9694-b2158f1bd4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:24.145063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b5456-85d0-40f8-9694-b2158f1bd4e6 admin admin] PATH_INFO: `/v3/projects/27722d70d7d146248968e92ea57f3888` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:24.145843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b5456-85d0-40f8-9694-b2158f1bd4e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27722d70d7d146248968e92ea57f3888)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:24.148096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b5456-85d0-40f8-9694-b2158f1bd4e6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:24.337771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e40b5456-85d0-40f8-9694-b2158f1bd4e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27722d70d7d146248968e92ea57f3888', 'request_id': 'req-e40b5456-85d0-40f8-9694-b2158f1bd4e6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:24.352744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e40b5456-85d0-40f8-9694-b2158f1bd4e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27722d70d7d146248968e92ea57f3888', 'request_id': 'req-e40b5456-85d0-40f8-9694-b2158f1bd4e6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:24.366199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-812e24d8-9bcf-4c8c-bda6-a58b48d60f31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c787dc6ce1df4d378f54af37ef188a06'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:24.373847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e40b5456-85d0-40f8-9694-b2158f1bd4e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27722d70d7d146248968e92ea57f3888', 'request_id': 'req-e40b5456-85d0-40f8-9694-b2158f1bd4e6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:24.412585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-812e24d8-9bcf-4c8c-bda6-a58b48d60f31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c787dc6ce1df4d378f54af37ef188a06'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:24.416445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-812e24d8-9bcf-4c8c-bda6-a58b48d60f31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c787dc6ce1df4d378f54af37ef188a06'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:24.417188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-812e24d8-9bcf-4c8c-bda6-a58b48d60f31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c787dc6ce1df4d378f54af37ef188a06'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:24.428209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-812e24d8-9bcf-4c8c-bda6-a58b48d60f31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c787dc6ce1df4d378f54af37ef188a06'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:24.469507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e40b5456-85d0-40f8-9694-b2158f1bd4e6 admin admin] The token cache is being invalidate because project 27722d70d7d146248968e92ea57f3888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:48:24.469812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e40b5456-85d0-40f8-9694-b2158f1bd4e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:24.470930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e40b5456-85d0-40f8-9694-b2158f1bd4e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:24.478604 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4058/8011] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:48:24 2022] DELETE /identity/v3/projects/27722d70d7d146248968e92ea57f3888 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:24.479579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b5456-85d0-40f8-9694-b2158f1bd4e6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:24.481637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e40b5456-85d0-40f8-9694-b2158f1bd4e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:24.531393 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3954/8012] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:48:24 2022] DELETE /identity/v3/users/c787dc6ce1df4d378f54af37ef188a06 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:24.531393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7179f05-8f6e-4176-9d4e-d32d13339145 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:24.531393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7179f05-8f6e-4176-9d4e-d32d13339145 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:24.531393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7179f05-8f6e-4176-9d4e-d32d13339145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:24.564462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e7179f05-8f6e-4176-9d4e-d32d13339145 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:24.566978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e7179f05-8f6e-4176-9d4e-d32d13339145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:24.575958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b5456-85d0-40f8-9694-b2158f1bd4e6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:24.597032 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:24.653499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cfb94-9e81-4720-8c0d-b299d2b85509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:24.654460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cfb94-9e81-4720-8c0d-b299d2b85509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:24.654977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cfb94-9e81-4720-8c0d-b299d2b85509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:24.655577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cfb94-9e81-4720-8c0d-b299d2b85509 admin admin] PATH_INFO: `/v3/users/1bcd6722719e4807b66f15cd3542c1ff` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:24.657041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cfb94-9e81-4720-8c0d-b299d2b85509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bcd6722719e4807b66f15cd3542c1ff)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:24.659021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cfb94-9e81-4720-8c0d-b299d2b85509 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:24.666295 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3955/8013] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:24.667660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5919d-5380-464e-8ccb-360beae38a0f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:24.668526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5919d-5380-464e-8ccb-360beae38a0f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:24.670491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc5919d-5380-464e-8ccb-360beae38a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:24.673876 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:24.694331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3bc5919d-5380-464e-8ccb-360beae38a0f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:24.695832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3bc5919d-5380-464e-8ccb-360beae38a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:24.707717 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3956/8014] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:24.713053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78a10e-69c4-48c2-ab10-b6cf191a964d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:24.713347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78a10e-69c4-48c2-ab10-b6cf191a964d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:24.713627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78a10e-69c4-48c2-ab10-b6cf191a964d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:24.737569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-fa78a10e-69c4-48c2-ab10-b6cf191a964d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:24.738799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fa78a10e-69c4-48c2-ab10-b6cf191a964d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:24.748119 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3957/8015] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:24.748970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78a10e-69c4-48c2-ab10-b6cf191a964d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:24.750359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fa78a10e-69c4-48c2-ab10-b6cf191a964d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:24.820237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78a10e-69c4-48c2-ab10-b6cf191a964d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:24.821501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aec42-7018-4fc9-8b4b-163cd72f6b59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:24.822284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aec42-7018-4fc9-8b4b-163cd72f6b59 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:24.822652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aec42-7018-4fc9-8b4b-163cd72f6b59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:24.823011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553aec42-7018-4fc9-8b4b-163cd72f6b59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:24.835559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553aec42-7018-4fc9-8b4b-163cd72f6b59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:24.837281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553aec42-7018-4fc9-8b4b-163cd72f6b59 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:24.851788 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3958/8016] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:24.852846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aec42-7018-4fc9-8b4b-163cd72f6b59 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:24.854376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-553aec42-7018-4fc9-8b4b-163cd72f6b59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:24.868876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553aec42-7018-4fc9-8b4b-163cd72f6b59 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:24.874550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc34efd-e286-4e2f-b9cf-6d5fd0a564a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:24.875917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc34efd-e286-4e2f-b9cf-6d5fd0a564a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:24.876418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc34efd-e286-4e2f-b9cf-6d5fd0a564a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:24.876882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc34efd-e286-4e2f-b9cf-6d5fd0a564a9 admin admin] PATH_INFO: `/v3/users/879f1fbb64994712a3a770a16037af4d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:24.879043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc34efd-e286-4e2f-b9cf-6d5fd0a564a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=879f1fbb64994712a3a770a16037af4d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:24.881863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc34efd-e286-4e2f-b9cf-6d5fd0a564a9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:24.885975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-767cfb94-9e81-4720-8c0d-b299d2b85509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bcd6722719e4807b66f15cd3542c1ff'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:24.915294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-767cfb94-9e81-4720-8c0d-b299d2b85509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bcd6722719e4807b66f15cd3542c1ff'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:24.926379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-767cfb94-9e81-4720-8c0d-b299d2b85509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bcd6722719e4807b66f15cd3542c1ff'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:24.927727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-767cfb94-9e81-4720-8c0d-b299d2b85509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bcd6722719e4807b66f15cd3542c1ff'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:25.017049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-767cfb94-9e81-4720-8c0d-b299d2b85509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bcd6722719e4807b66f15cd3542c1ff'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:25.026043 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4059/8017] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:48:24 2022] DELETE /identity/v3/users/1bcd6722719e4807b66f15cd3542c1ff => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:25.031758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cfb94-9e81-4720-8c0d-b299d2b85509 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:25.033780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-767cfb94-9e81-4720-8c0d-b299d2b85509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:25.150554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cfb94-9e81-4720-8c0d-b299d2b85509 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:25.165603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec284722-3a58-4989-8d9b-20c7ece8d004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:25.167580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec284722-3a58-4989-8d9b-20c7ece8d004 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:25.169696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec284722-3a58-4989-8d9b-20c7ece8d004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:25.169990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec284722-3a58-4989-8d9b-20c7ece8d004 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:25.172102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec284722-3a58-4989-8d9b-20c7ece8d004 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:48:25.174081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec284722-3a58-4989-8d9b-20c7ece8d004 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:25.182732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec284722-3a58-4989-8d9b-20c7ece8d004 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:25.189577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dcc34efd-e286-4e2f-b9cf-6d5fd0a564a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '879f1fbb64994712a3a770a16037af4d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:25.214667 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4060/8018] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:48:25.218968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec284722-3a58-4989-8d9b-20c7ece8d004 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:25.229035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dcc34efd-e286-4e2f-b9cf-6d5fd0a564a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '879f1fbb64994712a3a770a16037af4d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:25.229782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dcc34efd-e286-4e2f-b9cf-6d5fd0a564a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '879f1fbb64994712a3a770a16037af4d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:25.230447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dcc34efd-e286-4e2f-b9cf-6d5fd0a564a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '879f1fbb64994712a3a770a16037af4d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:25.234880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec284722-3a58-4989-8d9b-20c7ece8d004 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:25.241307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe0c1d3-3e46-424c-9feb-640251d08355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:25.241616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dcc34efd-e286-4e2f-b9cf-6d5fd0a564a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '879f1fbb64994712a3a770a16037af4d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:25.243304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0c1d3-3e46-424c-9feb-640251d08355 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:25.243718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0c1d3-3e46-424c-9feb-640251d08355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:25.244140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe0c1d3-3e46-424c-9feb-640251d08355 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:25.245410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0c1d3-3e46-424c-9feb-640251d08355 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:25.250013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe0c1d3-3e46-424c-9feb-640251d08355 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:25.335799 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3959/8019] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:48:24 2022] DELETE /identity/v3/users/879f1fbb64994712a3a770a16037af4d => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:25.338989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc34efd-e286-4e2f-b9cf-6d5fd0a564a9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:25.339624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-dcc34efd-e286-4e2f-b9cf-6d5fd0a564a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:25.435681 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:25.444661 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4061/8020] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:48:25 2022] POST /identity/v3/projects => generated 361 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:48:25.446239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb70ae-2844-450c-80c1-047e789b2c9a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:25.448419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb70ae-2844-450c-80c1-047e789b2c9a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:25.448819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb70ae-2844-450c-80c1-047e789b2c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:25.505437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc34efd-e286-4e2f-b9cf-6d5fd0a564a9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:25.508702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-29cb70ae-2844-450c-80c1-047e789b2c9a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:25.509940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-29cb70ae-2844-450c-80c1-047e789b2c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:25.568686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c4d48-f065-408a-a6f5-c98e0a2dc4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:25.569853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c4d48-f065-408a-a6f5-c98e0a2dc4cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:25.570378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c4d48-f065-408a-a6f5-c98e0a2dc4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:25.570850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c4d48-f065-408a-a6f5-c98e0a2dc4cc admin admin] PATH_INFO: `/v3/projects/841ccaca154c4143b58ac9bb162f72b7` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:25.572389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c4d48-f065-408a-a6f5-c98e0a2dc4cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=841ccaca154c4143b58ac9bb162f72b7)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:25.575135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c4d48-f065-408a-a6f5-c98e0a2dc4cc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:25.645261 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4062/8021] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:25.646180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb70ae-2844-450c-80c1-047e789b2c9a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:25.647595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-29cb70ae-2844-450c-80c1-047e789b2c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:25.661900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb70ae-2844-450c-80c1-047e789b2c9a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:25.665155 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:25.670472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3223f-9a10-48ea-92bf-23e432c774a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:25.671162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3223f-9a10-48ea-92bf-23e432c774a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:25.671484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3223f-9a10-48ea-92bf-23e432c774a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:25.671775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb3223f-9a10-48ea-92bf-23e432c774a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:25.672484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3223f-9a10-48ea-92bf-23e432c774a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:25.674882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb3223f-9a10-48ea-92bf-23e432c774a5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:25.725159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-934c4d48-f065-408a-a6f5-c98e0a2dc4cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '841ccaca154c4143b58ac9bb162f72b7', 'request_id': 'req-934c4d48-f065-408a-a6f5-c98e0a2dc4cc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:25.758632 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4063/8022] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:48:25 2022] POST /identity/v3/users => generated 281 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:48:25.759318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3223f-9a10-48ea-92bf-23e432c774a5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:25.762480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-efb3223f-9a10-48ea-92bf-23e432c774a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:25.776779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb3223f-9a10-48ea-92bf-23e432c774a5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:25.823460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-934c4d48-f065-408a-a6f5-c98e0a2dc4cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '841ccaca154c4143b58ac9bb162f72b7', 'request_id': 'req-934c4d48-f065-408a-a6f5-c98e0a2dc4cc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:25.834256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-934c4d48-f065-408a-a6f5-c98e0a2dc4cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '841ccaca154c4143b58ac9bb162f72b7', 'request_id': 'req-934c4d48-f065-408a-a6f5-c98e0a2dc4cc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:25.853872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-934c4d48-f065-408a-a6f5-c98e0a2dc4cc admin admin] The token cache is being invalidate because project 841ccaca154c4143b58ac9bb162f72b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:48:25.854374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-934c4d48-f065-408a-a6f5-c98e0a2dc4cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:25.855475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-934c4d48-f065-408a-a6f5-c98e0a2dc4cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:25.857862 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3960/8023] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:48:25 2022] DELETE /identity/v3/projects/841ccaca154c4143b58ac9bb162f72b7 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:25.860261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c4d48-f065-408a-a6f5-c98e0a2dc4cc admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:25.861990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-934c4d48-f065-408a-a6f5-c98e0a2dc4cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:25.868107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3f476-ac1d-4314-8286-d444e056198c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:25.869090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3f476-ac1d-4314-8286-d444e056198c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:25.869437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3f476-ac1d-4314-8286-d444e056198c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:25.869905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3f476-ac1d-4314-8286-d444e056198c admin admin] PATH_INFO: `/v3/projects/53fcba9449254fce9485acc10118d3b3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:25.873161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3f476-ac1d-4314-8286-d444e056198c admin admin] RBAC: Authorizing `identity:delete_project(project_id=53fcba9449254fce9485acc10118d3b3)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:25.875521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3f476-ac1d-4314-8286-d444e056198c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:25.975036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c4d48-f065-408a-a6f5-c98e0a2dc4cc admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:26.004198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e1f3f476-ac1d-4314-8286-d444e056198c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53fcba9449254fce9485acc10118d3b3', 'request_id': 'req-e1f3f476-ac1d-4314-8286-d444e056198c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:26.020801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e1f3f476-ac1d-4314-8286-d444e056198c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53fcba9449254fce9485acc10118d3b3', 'request_id': 'req-e1f3f476-ac1d-4314-8286-d444e056198c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:26.033973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e1f3f476-ac1d-4314-8286-d444e056198c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53fcba9449254fce9485acc10118d3b3', 'request_id': 'req-e1f3f476-ac1d-4314-8286-d444e056198c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:26.065475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09d9cc-f837-4b7e-beb4-46f8ef6ed976 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:26.066175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09d9cc-f837-4b7e-beb4-46f8ef6ed976 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:26.066468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09d9cc-f837-4b7e-beb4-46f8ef6ed976 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:26.066750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09d9cc-f837-4b7e-beb4-46f8ef6ed976 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:26.068558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0e09d9cc-f837-4b7e-beb4-46f8ef6ed976 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:26.138743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09d9cc-f837-4b7e-beb4-46f8ef6ed976 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:26.140935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09d9cc-f837-4b7e-beb4-46f8ef6ed976 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:26.152111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e1f3f476-ac1d-4314-8286-d444e056198c admin admin] The token cache is being invalidate because project 53fcba9449254fce9485acc10118d3b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:48:26.152609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e1f3f476-ac1d-4314-8286-d444e056198c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:26.154921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e1f3f476-ac1d-4314-8286-d444e056198c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:26.159391 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4064/8024] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:48:25 2022] DELETE /identity/v3/projects/53fcba9449254fce9485acc10118d3b3 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:26.159391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3f476-ac1d-4314-8286-d444e056198c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:26.162158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e1f3f476-ac1d-4314-8286-d444e056198c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:26.174929 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3961/8025] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:26.174929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a5942-f667-4dd6-a11b-359b52ac6d9e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:26.174929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a5942-f667-4dd6-a11b-359b52ac6d9e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:26.174929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a5942-f667-4dd6-a11b-359b52ac6d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:26.184855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3f476-ac1d-4314-8286-d444e056198c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:26.191520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db6937-fd20-4483-b310-870f7dcdd855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:26.192338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db6937-fd20-4483-b310-870f7dcdd855 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:26.192667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db6937-fd20-4483-b310-870f7dcdd855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:26.193068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db6937-fd20-4483-b310-870f7dcdd855 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:26.193817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db6937-fd20-4483-b310-870f7dcdd855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:26.195617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db6937-fd20-4483-b310-870f7dcdd855 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:26.205091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b83a5942-f667-4dd6-a11b-359b52ac6d9e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:26.206729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b83a5942-f667-4dd6-a11b-359b52ac6d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:26.224312 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4065/8026] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:48:26.225432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db6937-fd20-4483-b310-870f7dcdd855 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:26.235329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-77db6937-fd20-4483-b310-870f7dcdd855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:26.237132 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3962/8027] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:26.243231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a5942-f667-4dd6-a11b-359b52ac6d9e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:26.244897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b83a5942-f667-4dd6-a11b-359b52ac6d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:26.263952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a5942-f667-4dd6-a11b-359b52ac6d9e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:26.272027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295706af-dbb5-49fe-b65a-cdfbe688b618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:26.273008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295706af-dbb5-49fe-b65a-cdfbe688b618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:26.273301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295706af-dbb5-49fe-b65a-cdfbe688b618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:26.273583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295706af-dbb5-49fe-b65a-cdfbe688b618 admin admin] PATH_INFO: `/v3/users/acbe0705a9444204a6788175892f252e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:26.278036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295706af-dbb5-49fe-b65a-cdfbe688b618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acbe0705a9444204a6788175892f252e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:26.280020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295706af-dbb5-49fe-b65a-cdfbe688b618 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:26.331413 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:26.422601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db6937-fd20-4483-b310-870f7dcdd855 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:26.431560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf91221-3de0-4328-8202-eda7bfb6b5b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:26.445855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf91221-3de0-4328-8202-eda7bfb6b5b9 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:26.447875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf91221-3de0-4328-8202-eda7bfb6b5b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:26.448339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf91221-3de0-4328-8202-eda7bfb6b5b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:26.455795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cbf91221-3de0-4328-8202-eda7bfb6b5b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:26.492798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf91221-3de0-4328-8202-eda7bfb6b5b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:26.494512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf91221-3de0-4328-8202-eda7bfb6b5b9 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:26.548436 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4066/8028] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:26.556709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf91221-3de0-4328-8202-eda7bfb6b5b9 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:26.566507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-295706af-dbb5-49fe-b65a-cdfbe688b618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acbe0705a9444204a6788175892f252e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:26.574625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf91221-3de0-4328-8202-eda7bfb6b5b9 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:26.581341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51815f56-5614-41ec-9d35-1a8a3e42c467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:26.582350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51815f56-5614-41ec-9d35-1a8a3e42c467 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:26.582814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51815f56-5614-41ec-9d35-1a8a3e42c467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:26.583269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51815f56-5614-41ec-9d35-1a8a3e42c467 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:26.584213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51815f56-5614-41ec-9d35-1a8a3e42c467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:26.587437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51815f56-5614-41ec-9d35-1a8a3e42c467 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:26.592577 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:26.604781 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4067/8029] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:48:26.606522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac3128-82d1-4c94-8b54-3942d4f26b0f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:26.607103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac3128-82d1-4c94-8b54-3942d4f26b0f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:26.607849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac3128-82d1-4c94-8b54-3942d4f26b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:26.618549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-295706af-dbb5-49fe-b65a-cdfbe688b618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acbe0705a9444204a6788175892f252e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:26.619049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-295706af-dbb5-49fe-b65a-cdfbe688b618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acbe0705a9444204a6788175892f252e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:26.622644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-295706af-dbb5-49fe-b65a-cdfbe688b618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acbe0705a9444204a6788175892f252e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:26.635358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b1ac3128-82d1-4c94-8b54-3942d4f26b0f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:26.637132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b1ac3128-82d1-4c94-8b54-3942d4f26b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:26.651521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-295706af-dbb5-49fe-b65a-cdfbe688b618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acbe0705a9444204a6788175892f252e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:26.656485 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4068/8030] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:26.657461 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac3128-82d1-4c94-8b54-3942d4f26b0f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:26.661977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b1ac3128-82d1-4c94-8b54-3942d4f26b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:26.677957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac3128-82d1-4c94-8b54-3942d4f26b0f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:26.685778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a00472b-19ca-42e8-8beb-660004453b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:26.687806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00472b-19ca-42e8-8beb-660004453b22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:26.688726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00472b-19ca-42e8-8beb-660004453b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:26.689228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a00472b-19ca-42e8-8beb-660004453b22 admin admin] PATH_INFO: `/v3/projects/fd11ee85ef9e4d18a87921c9fbc7d0c2/users/3f5e6f491ae643469188f9f1d2d8fa3e/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:26.712560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00472b-19ca-42e8-8beb-660004453b22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd11ee85ef9e4d18a87921c9fbc7d0c2, user_id=3f5e6f491ae643469188f9f1d2d8fa3e, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:26.716377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a00472b-19ca-42e8-8beb-660004453b22 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:26.760944 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3963/8031] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:48:26 2022] DELETE /identity/v3/users/acbe0705a9444204a6788175892f252e => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:26.762927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295706af-dbb5-49fe-b65a-cdfbe688b618 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:26.828830 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4069/8032] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:48:26 2022] PUT /identity/v3/projects/fd11ee85ef9e4d18a87921c9fbc7d0c2/users/3f5e6f491ae643469188f9f1d2d8fa3e/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:26.839768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa71f90-61b8-4133-b9bb-6c9474d4c807 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:26.840559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa71f90-61b8-4133-b9bb-6c9474d4c807 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:26.840879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa71f90-61b8-4133-b9bb-6c9474d4c807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:26.897690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-bfa71f90-61b8-4133-b9bb-6c9474d4c807 None None] MFA Rules not processed for user `3f5e6f491ae643469188f9f1d2d8fa3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:26.899117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bfa71f90-61b8-4133-b9bb-6c9474d4c807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:26.911744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295706af-dbb5-49fe-b65a-cdfbe688b618 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:27.000901 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4070/8033] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:26 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:27.022057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb059184-15f4-4133-b34d-6048ead5bcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:27.022456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa71f90-61b8-4133-b9bb-6c9474d4c807 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:27.022589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb059184-15f4-4133-b34d-6048ead5bcac admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:27.022589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb059184-15f4-4133-b34d-6048ead5bcac admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:27.022589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb059184-15f4-4133-b34d-6048ead5bcac admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:27.022833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bfa71f90-61b8-4133-b9bb-6c9474d4c807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:27.022920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb059184-15f4-4133-b34d-6048ead5bcac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:48:27.022920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb059184-15f4-4133-b34d-6048ead5bcac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:27.024684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb059184-15f4-4133-b34d-6048ead5bcac admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:27.051504 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3964/8034] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:48:27.053112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb059184-15f4-4133-b34d-6048ead5bcac admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:27.055906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eb059184-15f4-4133-b34d-6048ead5bcac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:27.095881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb059184-15f4-4133-b34d-6048ead5bcac admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:27.103702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf174d95-b1fa-48ca-9ad1-9be8593c558a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:27.109935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf174d95-b1fa-48ca-9ad1-9be8593c558a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:27.109935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf174d95-b1fa-48ca-9ad1-9be8593c558a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:27.109935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf174d95-b1fa-48ca-9ad1-9be8593c558a admin admin] PATH_INFO: `/v3/projects/f17920cd79924331a407f62f3f38c390` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:27.109935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf174d95-b1fa-48ca-9ad1-9be8593c558a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f17920cd79924331a407f62f3f38c390)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:27.111509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf174d95-b1fa-48ca-9ad1-9be8593c558a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:27.147176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa71f90-61b8-4133-b9bb-6c9474d4c807 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:27.153427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed09c7a-985f-46b3-a6b1-9fb52ef24dcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:27.154191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed09c7a-985f-46b3-a6b1-9fb52ef24dcd service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:27.154490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed09c7a-985f-46b3-a6b1-9fb52ef24dcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:27.154772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed09c7a-985f-46b3-a6b1-9fb52ef24dcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:27.166688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed09c7a-985f-46b3-a6b1-9fb52ef24dcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:27.169060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed09c7a-985f-46b3-a6b1-9fb52ef24dcd service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:27.181012 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4071/8035] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:27 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:27.181881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed09c7a-985f-46b3-a6b1-9fb52ef24dcd service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:27.194555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed09c7a-985f-46b3-a6b1-9fb52ef24dcd service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:27.203132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e8ffc-cad9-4904-9b9c-ef16cfa000ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:27.203799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e8ffc-cad9-4904-9b9c-ef16cfa000ac admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:27.204088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e8ffc-cad9-4904-9b9c-ef16cfa000ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:27.204366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e8ffc-cad9-4904-9b9c-ef16cfa000ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:27.205059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e8ffc-cad9-4904-9b9c-ef16cfa000ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:27.207409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e8ffc-cad9-4904-9b9c-ef16cfa000ac admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:27.239175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bf174d95-b1fa-48ca-9ad1-9be8593c558a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f17920cd79924331a407f62f3f38c390', 'request_id': 'req-bf174d95-b1fa-48ca-9ad1-9be8593c558a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:27.331560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bf174d95-b1fa-48ca-9ad1-9be8593c558a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f17920cd79924331a407f62f3f38c390', 'request_id': 'req-bf174d95-b1fa-48ca-9ad1-9be8593c558a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:27.334400 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:27.341347 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4072/8036] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:48:27 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:48:27.342345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e8ffc-cad9-4904-9b9c-ef16cfa000ac admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:27.345451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ef4e8ffc-cad9-4904-9b9c-ef16cfa000ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:27.346937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bf174d95-b1fa-48ca-9ad1-9be8593c558a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f17920cd79924331a407f62f3f38c390', 'request_id': 'req-bf174d95-b1fa-48ca-9ad1-9be8593c558a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:27.361539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bf174d95-b1fa-48ca-9ad1-9be8593c558a admin admin] The token cache is being invalidate because project f17920cd79924331a407f62f3f38c390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:48:27.361834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bf174d95-b1fa-48ca-9ad1-9be8593c558a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:27.362551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bf174d95-b1fa-48ca-9ad1-9be8593c558a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:27.364856 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3965/8037] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:48:27 2022] DELETE /identity/v3/projects/f17920cd79924331a407f62f3f38c390 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:27.365708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf174d95-b1fa-48ca-9ad1-9be8593c558a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:27.368833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bf174d95-b1fa-48ca-9ad1-9be8593c558a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:27.427405 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:27.448180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf174d95-b1fa-48ca-9ad1-9be8593c558a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:27.484267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e8ffc-cad9-4904-9b9c-ef16cfa000ac admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:27.491605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbf1b8-e5fb-4556-a1a3-1831ac0199f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:27.493355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbf1b8-e5fb-4556-a1a3-1831ac0199f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:27.493648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbf1b8-e5fb-4556-a1a3-1831ac0199f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:27.493930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbf1b8-e5fb-4556-a1a3-1831ac0199f7 admin admin] PATH_INFO: `/v3/projects/51173238ee1048689f6f0a9c723f3161` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:27.495245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cbf1b8-e5fb-4556-a1a3-1831ac0199f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51173238ee1048689f6f0a9c723f3161)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:27.498284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cbf1b8-e5fb-4556-a1a3-1831ac0199f7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:27.517832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a00557-34ab-4bdc-874e-a7974949e29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:27.523565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a00557-34ab-4bdc-874e-a7974949e29d admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:27.523565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a00557-34ab-4bdc-874e-a7974949e29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:27.523565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a00557-34ab-4bdc-874e-a7974949e29d admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:27.523565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a00557-34ab-4bdc-874e-a7974949e29d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:27.523565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a00557-34ab-4bdc-874e-a7974949e29d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:27.621938 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3966/8038] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:48:27 2022] POST /identity/v3/users => generated 293 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:48:27.621938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a00557-34ab-4bdc-874e-a7974949e29d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:27.626767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-32a00557-34ab-4bdc-874e-a7974949e29d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:27.635228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a00557-34ab-4bdc-874e-a7974949e29d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:27.641259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e88d28-58d6-4aa3-9d1a-0ae75aaa9c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:27.642184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e88d28-58d6-4aa3-9d1a-0ae75aaa9c48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:27.642474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e88d28-58d6-4aa3-9d1a-0ae75aaa9c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:27.642763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e88d28-58d6-4aa3-9d1a-0ae75aaa9c48 admin admin] PATH_INFO: `/v3/users/c92e937885984382a80693cdcb382582` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:27.643986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e88d28-58d6-4aa3-9d1a-0ae75aaa9c48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c92e937885984382a80693cdcb382582)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:27.645914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e88d28-58d6-4aa3-9d1a-0ae75aaa9c48 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:27.696973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a5cbf1b8-e5fb-4556-a1a3-1831ac0199f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51173238ee1048689f6f0a9c723f3161', 'request_id': 'req-a5cbf1b8-e5fb-4556-a1a3-1831ac0199f7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:27.704765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a5cbf1b8-e5fb-4556-a1a3-1831ac0199f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51173238ee1048689f6f0a9c723f3161', 'request_id': 'req-a5cbf1b8-e5fb-4556-a1a3-1831ac0199f7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:27.712524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a5cbf1b8-e5fb-4556-a1a3-1831ac0199f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51173238ee1048689f6f0a9c723f3161', 'request_id': 'req-a5cbf1b8-e5fb-4556-a1a3-1831ac0199f7'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:27.855074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a5cbf1b8-e5fb-4556-a1a3-1831ac0199f7 admin admin] The token cache is being invalidate because project 51173238ee1048689f6f0a9c723f3161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:48:27.855368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a5cbf1b8-e5fb-4556-a1a3-1831ac0199f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:27.856365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a5cbf1b8-e5fb-4556-a1a3-1831ac0199f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:27.858510 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4073/8039] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:48:27 2022] DELETE /identity/v3/projects/51173238ee1048689f6f0a9c723f3161 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:27.873016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbf1b8-e5fb-4556-a1a3-1831ac0199f7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:27.895335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a5cbf1b8-e5fb-4556-a1a3-1831ac0199f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:28.038302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-65e88d28-58d6-4aa3-9d1a-0ae75aaa9c48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c92e937885984382a80693cdcb382582'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:28.062113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-65e88d28-58d6-4aa3-9d1a-0ae75aaa9c48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c92e937885984382a80693cdcb382582'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:28.063000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-65e88d28-58d6-4aa3-9d1a-0ae75aaa9c48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c92e937885984382a80693cdcb382582'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:28.063667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-65e88d28-58d6-4aa3-9d1a-0ae75aaa9c48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c92e937885984382a80693cdcb382582'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:28.074934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-65e88d28-58d6-4aa3-9d1a-0ae75aaa9c48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c92e937885984382a80693cdcb382582'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:28.134559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbf1b8-e5fb-4556-a1a3-1831ac0199f7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:28.141025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3736ae-2305-4ef1-917a-5fc0c7f17d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:28.141573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3736ae-2305-4ef1-917a-5fc0c7f17d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:28.141972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3736ae-2305-4ef1-917a-5fc0c7f17d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:28.142299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3736ae-2305-4ef1-917a-5fc0c7f17d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:28.143240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3736ae-2305-4ef1-917a-5fc0c7f17d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:28.145591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3736ae-2305-4ef1-917a-5fc0c7f17d8a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:28.157739 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3967/8040] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:48:27 2022] DELETE /identity/v3/users/c92e937885984382a80693cdcb382582 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:28.164200 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4074/8041] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:27 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:48:28.169224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e88d28-58d6-4aa3-9d1a-0ae75aaa9c48 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:28.171628 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:28.176767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-65e88d28-58d6-4aa3-9d1a-0ae75aaa9c48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:28.338837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e88d28-58d6-4aa3-9d1a-0ae75aaa9c48 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:28.344290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66923089-d626-4865-9163-2c770aebbfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:28.345405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66923089-d626-4865-9163-2c770aebbfcb admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:28.345808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66923089-d626-4865-9163-2c770aebbfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:28.346224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66923089-d626-4865-9163-2c770aebbfcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:28.357689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66923089-d626-4865-9163-2c770aebbfcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:28.360651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66923089-d626-4865-9163-2c770aebbfcb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:28.375766 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3968/8042] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:28 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:48:28.379133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3736ae-2305-4ef1-917a-5fc0c7f17d8a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:28.399617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3736ae-2305-4ef1-917a-5fc0c7f17d8a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:28.405668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909aadd-6748-481f-abc6-3c5fd9ef479b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:28.406684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909aadd-6748-481f-abc6-3c5fd9ef479b admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:28.406975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909aadd-6748-481f-abc6-3c5fd9ef479b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:28.407309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b909aadd-6748-481f-abc6-3c5fd9ef479b admin admin] PATH_INFO: `/v3/projects/4d87ab2b909e42e3a5f334948f84ed92/users/424f70fc779e46fea861fedcdf3360de/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:28.426628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909aadd-6748-481f-abc6-3c5fd9ef479b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d87ab2b909e42e3a5f334948f84ed92, user_id=424f70fc779e46fea861fedcdf3360de, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:28.429618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b909aadd-6748-481f-abc6-3c5fd9ef479b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:28.546782 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4075/8043] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:48:28 2022] PUT /identity/v3/projects/4d87ab2b909e42e3a5f334948f84ed92/users/424f70fc779e46fea861fedcdf3360de/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:28.557189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252506c-aaa6-421b-a361-46671889ecb9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:28.557488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252506c-aaa6-421b-a361-46671889ecb9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:28.557769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252506c-aaa6-421b-a361-46671889ecb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:28.586887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7252506c-aaa6-421b-a361-46671889ecb9 None None] MFA Rules not processed for user `424f70fc779e46fea861fedcdf3360de`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:28.588194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7252506c-aaa6-421b-a361-46671889ecb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:28.706572 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3969/8044] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:48:28.714032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909aadd-6748-481f-abc6-3c5fd9ef479b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:28.716474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b909aadd-6748-481f-abc6-3c5fd9ef479b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:28.788080 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:28.846666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b909aadd-6748-481f-abc6-3c5fd9ef479b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:28.854257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca37d3-bfdb-43ee-98a9-da9f79716a24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:28.855586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca37d3-bfdb-43ee-98a9-da9f79716a24 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:28.856122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca37d3-bfdb-43ee-98a9-da9f79716a24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:28.856947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca37d3-bfdb-43ee-98a9-da9f79716a24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:28.878427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca37d3-bfdb-43ee-98a9-da9f79716a24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:28.878427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca37d3-bfdb-43ee-98a9-da9f79716a24 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:28.891591 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4076/8045] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:28.950682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252506c-aaa6-421b-a361-46671889ecb9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:28.952373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7252506c-aaa6-421b-a361-46671889ecb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:29.050918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252506c-aaa6-421b-a361-46671889ecb9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:29.056439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cebcd9-a3e1-4867-9042-edeebc7879ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:29.057675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cebcd9-a3e1-4867-9042-edeebc7879ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:29.058051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cebcd9-a3e1-4867-9042-edeebc7879ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:29.059005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cebcd9-a3e1-4867-9042-edeebc7879ab admin admin] PATH_INFO: `/v3/projects/4a92158f078e4c97bd4911c547913a42` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:29.060377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cebcd9-a3e1-4867-9042-edeebc7879ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a92158f078e4c97bd4911c547913a42)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:29.062862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cebcd9-a3e1-4867-9042-edeebc7879ab admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:29.215028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d5cebcd9-a3e1-4867-9042-edeebc7879ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a92158f078e4c97bd4911c547913a42', 'request_id': 'req-d5cebcd9-a3e1-4867-9042-edeebc7879ab'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:29.328726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d5cebcd9-a3e1-4867-9042-edeebc7879ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a92158f078e4c97bd4911c547913a42', 'request_id': 'req-d5cebcd9-a3e1-4867-9042-edeebc7879ab'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:29.341931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d5cebcd9-a3e1-4867-9042-edeebc7879ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a92158f078e4c97bd4911c547913a42', 'request_id': 'req-d5cebcd9-a3e1-4867-9042-edeebc7879ab'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:29.358575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d5cebcd9-a3e1-4867-9042-edeebc7879ab admin admin] The token cache is being invalidate because project 4a92158f078e4c97bd4911c547913a42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:48:29.358844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d5cebcd9-a3e1-4867-9042-edeebc7879ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:29.360354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d5cebcd9-a3e1-4867-9042-edeebc7879ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:29.362425 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3970/8046] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:48:28 2022] DELETE /identity/v3/projects/4a92158f078e4c97bd4911c547913a42 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:29.373320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a838fc-6e2e-4961-b04a-8a22e92ae0e8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:29.373608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a838fc-6e2e-4961-b04a-8a22e92ae0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:29.373887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a838fc-6e2e-4961-b04a-8a22e92ae0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:29.395090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-58a838fc-6e2e-4961-b04a-8a22e92ae0e8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:29.396731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-58a838fc-6e2e-4961-b04a-8a22e92ae0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:29.476144 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4077/8047] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:48:29.484217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850812e8-d73d-4b9c-bea9-7dd8b55e10a7 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:29.484630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850812e8-d73d-4b9c-bea9-7dd8b55e10a7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:29.485003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850812e8-d73d-4b9c-bea9-7dd8b55e10a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:29.507770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-850812e8-d73d-4b9c-bea9-7dd8b55e10a7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:29.509222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-850812e8-d73d-4b9c-bea9-7dd8b55e10a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:29.524143 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3971/8048] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:29.526594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a838fc-6e2e-4961-b04a-8a22e92ae0e8 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:29.538662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a838fc-6e2e-4961-b04a-8a22e92ae0e8 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:29.558522 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:29.558693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92767913-b713-44a7-8d98-d3c85fe2695f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:29.558693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92767913-b713-44a7-8d98-d3c85fe2695f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:29.558693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92767913-b713-44a7-8d98-d3c85fe2695f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:29.558693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92767913-b713-44a7-8d98-d3c85fe2695f admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:29.559056 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92767913-b713-44a7-8d98-d3c85fe2695f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:48:29.559319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92767913-b713-44a7-8d98-d3c85fe2695f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:29.562771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92767913-b713-44a7-8d98-d3c85fe2695f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:29.582150 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4078/8049] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:48:29.584872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850812e8-d73d-4b9c-bea9-7dd8b55e10a7 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:29.595470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850812e8-d73d-4b9c-bea9-7dd8b55e10a7 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:29.602217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c812c51-5977-47d3-974a-7470de8b9705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:29.603116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c812c51-5977-47d3-974a-7470de8b9705 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:29.616778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c812c51-5977-47d3-974a-7470de8b9705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:29.617307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c812c51-5977-47d3-974a-7470de8b9705 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:29.618274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c812c51-5977-47d3-974a-7470de8b9705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:29.620313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c812c51-5977-47d3-974a-7470de8b9705 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:29.744850 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3972/8050] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:48:29 2022] POST /identity/v3/projects => generated 375 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:48:29.748551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92767913-b713-44a7-8d98-d3c85fe2695f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:29.760284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92767913-b713-44a7-8d98-d3c85fe2695f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:29.821123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba53d15-afdd-4883-8754-382fa2a8bc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:29.821817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba53d15-afdd-4883-8754-382fa2a8bc62 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:29.830973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba53d15-afdd-4883-8754-382fa2a8bc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:29.830973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba53d15-afdd-4883-8754-382fa2a8bc62 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:29.830973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba53d15-afdd-4883-8754-382fa2a8bc62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:29.830973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba53d15-afdd-4883-8754-382fa2a8bc62 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:29.948221 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4079/8051] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:48:29 2022] POST /identity/v3/users => generated 288 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:48:29.950957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c812c51-5977-47d3-974a-7470de8b9705 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:29.966439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c812c51-5977-47d3-974a-7470de8b9705 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:29.986581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfff34-79ea-45a5-8b3d-42360de89911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:29.987299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfff34-79ea-45a5-8b3d-42360de89911 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:29.987574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfff34-79ea-45a5-8b3d-42360de89911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:29.987853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfff34-79ea-45a5-8b3d-42360de89911 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:29.988663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfff34-79ea-45a5-8b3d-42360de89911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:29.990321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfff34-79ea-45a5-8b3d-42360de89911 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:30.013936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba53d15-afdd-4883-8754-382fa2a8bc62 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:30.014988 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3973/8052] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:48:30.034338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba53d15-afdd-4883-8754-382fa2a8bc62 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:30.044345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ac6df-b60c-4760-ba69-e07505ebf8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:30.044954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ac6df-b60c-4760-ba69-e07505ebf8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:30.045248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ac6df-b60c-4760-ba69-e07505ebf8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:30.045530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ac6df-b60c-4760-ba69-e07505ebf8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:30.046858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ac6df-b60c-4760-ba69-e07505ebf8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:30.048771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ac6df-b60c-4760-ba69-e07505ebf8b2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:30.060909 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4080/8053] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:48:30.064712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfff34-79ea-45a5-8b3d-42360de89911 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:30.076196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfff34-79ea-45a5-8b3d-42360de89911 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:30.082711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc94f9-2c5c-4f44-b83c-f31b9715e593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:30.084030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc94f9-2c5c-4f44-b83c-f31b9715e593 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:30.084030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc94f9-2c5c-4f44-b83c-f31b9715e593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:30.084274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc94f9-2c5c-4f44-b83c-f31b9715e593 admin admin] PATH_INFO: `/v3/projects/96a7b775cd3348ea816fc0ddc04fbcb9/users/ebc56be93e704a3e9e0985d4796d9500/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:30.108424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc94f9-2c5c-4f44-b83c-f31b9715e593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a7b775cd3348ea816fc0ddc04fbcb9, user_id=ebc56be93e704a3e9e0985d4796d9500, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:30.111374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc94f9-2c5c-4f44-b83c-f31b9715e593 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:30.236373 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3974/8054] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:48:30 2022] PUT /identity/v3/projects/96a7b775cd3348ea816fc0ddc04fbcb9/users/ebc56be93e704a3e9e0985d4796d9500/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:30.247908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fab391-5948-4cdd-a23a-3a0976353d06 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:30.248292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fab391-5948-4cdd-a23a-3a0976353d06 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:30.248583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fab391-5948-4cdd-a23a-3a0976353d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:30.280789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-55fab391-5948-4cdd-a23a-3a0976353d06 None None] MFA Rules not processed for user `ebc56be93e704a3e9e0985d4796d9500`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:30.282064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-55fab391-5948-4cdd-a23a-3a0976353d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:30.327725 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:30.369458 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4081/8055] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:48:30.376238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc94f9-2c5c-4f44-b83c-f31b9715e593 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:30.471150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc94f9-2c5c-4f44-b83c-f31b9715e593 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:30.476524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72a4be-bc94-43d4-832f-9016bcb18459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:30.477190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72a4be-bc94-43d4-832f-9016bcb18459 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:30.477475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72a4be-bc94-43d4-832f-9016bcb18459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:30.477801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72a4be-bc94-43d4-832f-9016bcb18459 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:30.478715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72a4be-bc94-43d4-832f-9016bcb18459 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:30.481160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc72a4be-bc94-43d4-832f-9016bcb18459 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:30.601010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fab391-5948-4cdd-a23a-3a0976353d06 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:30.601748 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3975/8056] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:48:30 2022] POST /identity/v3/projects => generated 375 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:48:30.613160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fab391-5948-4cdd-a23a-3a0976353d06 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:30.696557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5897c2a-9ea5-4b76-bcdd-e21db4e27725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:30.697259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5897c2a-9ea5-4b76-bcdd-e21db4e27725 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:30.697610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5897c2a-9ea5-4b76-bcdd-e21db4e27725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:30.697828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5897c2a-9ea5-4b76-bcdd-e21db4e27725 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:30.698570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5897c2a-9ea5-4b76-bcdd-e21db4e27725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:30.701927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5897c2a-9ea5-4b76-bcdd-e21db4e27725 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:30.828968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72a4be-bc94-43d4-832f-9016bcb18459 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:30.840970 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4082/8057] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:48:30 2022] POST /identity/v3/users => generated 294 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:48:30.846235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72a4be-bc94-43d4-832f-9016bcb18459 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:30.857118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536c3c1-0f51-44ab-bae4-b724a5c3884f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:30.858435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536c3c1-0f51-44ab-bae4-b724a5c3884f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:30.858726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536c3c1-0f51-44ab-bae4-b724a5c3884f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:30.859017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b536c3c1-0f51-44ab-bae4-b724a5c3884f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:30.861854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536c3c1-0f51-44ab-bae4-b724a5c3884f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:30.863917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b536c3c1-0f51-44ab-bae4-b724a5c3884f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:30.881187 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3976/8058] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:48:30.888048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5897c2a-9ea5-4b76-bcdd-e21db4e27725 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:30.900663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5897c2a-9ea5-4b76-bcdd-e21db4e27725 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:30.906285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802ab64-7154-4263-99c1-fd4ba6414bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:30.907543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802ab64-7154-4263-99c1-fd4ba6414bae admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:30.908070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802ab64-7154-4263-99c1-fd4ba6414bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:30.908346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802ab64-7154-4263-99c1-fd4ba6414bae admin admin] PATH_INFO: `/v3/projects/f1d14a0089c8469699cdefbb2610be11/users/5af2b7504a4d4a718efe4c639a18dbbb/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:30.931712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802ab64-7154-4263-99c1-fd4ba6414bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d14a0089c8469699cdefbb2610be11, user_id=5af2b7504a4d4a718efe4c639a18dbbb, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:30.936278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802ab64-7154-4263-99c1-fd4ba6414bae admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:31.078827 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:31.088652 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4083/8059] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:48:30 2022] PUT /identity/v3/projects/f1d14a0089c8469699cdefbb2610be11/users/5af2b7504a4d4a718efe4c639a18dbbb/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:31.094016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536c3c1-0f51-44ab-bae4-b724a5c3884f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:31.106308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b536c3c1-0f51-44ab-bae4-b724a5c3884f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:31.203425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a7459c-f886-4b82-8bc1-eb0c8fc0313d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:31.210191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7459c-f886-4b82-8bc1-eb0c8fc0313d admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:31.210696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7459c-f886-4b82-8bc1-eb0c8fc0313d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:31.213218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a7459c-f886-4b82-8bc1-eb0c8fc0313d admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:31.214334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7459c-f886-4b82-8bc1-eb0c8fc0313d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:31.217097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a7459c-f886-4b82-8bc1-eb0c8fc0313d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:31.243940 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3977/8060] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:48:31.248175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802ab64-7154-4263-99c1-fd4ba6414bae admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:31.268251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802ab64-7154-4263-99c1-fd4ba6414bae admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:31.273581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffce452-1906-4fc0-9199-7fbf95a87020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:31.275043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffce452-1906-4fc0-9199-7fbf95a87020 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:31.275510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffce452-1906-4fc0-9199-7fbf95a87020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:31.275966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffce452-1906-4fc0-9199-7fbf95a87020 admin admin] PATH_INFO: `/v3/projects/f1d14a0089c8469699cdefbb2610be11/users/5af2b7504a4d4a718efe4c639a18dbbb/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:31.278984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffce452-1906-4fc0-9199-7fbf95a87020 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1d14a0089c8469699cdefbb2610be11, user_id=5af2b7504a4d4a718efe4c639a18dbbb, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:31.282147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffce452-1906-4fc0-9199-7fbf95a87020 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:31.295664 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4084/8061] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:48:31 2022] PUT /identity/v3/projects/f1d14a0089c8469699cdefbb2610be11/users/5af2b7504a4d4a718efe4c639a18dbbb/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:31.306867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22116e19-e9dd-4a59-b1d1-1b806cdc81ea None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:31.307164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22116e19-e9dd-4a59-b1d1-1b806cdc81ea None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:31.307449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22116e19-e9dd-4a59-b1d1-1b806cdc81ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:31.339184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-22116e19-e9dd-4a59-b1d1-1b806cdc81ea None None] MFA Rules not processed for user `5af2b7504a4d4a718efe4c639a18dbbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:31.342001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-22116e19-e9dd-4a59-b1d1-1b806cdc81ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:31.428065 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3978/8062] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:31.440201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffce452-1906-4fc0-9199-7fbf95a87020 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:31.442431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7ffce452-1906-4fc0-9199-7fbf95a87020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:31.547988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffce452-1906-4fc0-9199-7fbf95a87020 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:31.553100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8aaa1-814e-4dae-bbd7-bf801c18c824 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:31.554271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8aaa1-814e-4dae-bbd7-bf801c18c824 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:31.554820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8aaa1-814e-4dae-bbd7-bf801c18c824 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:31.555348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8aaa1-814e-4dae-bbd7-bf801c18c824 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:31.569858 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:31.633177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8aaa1-814e-4dae-bbd7-bf801c18c824 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:31.635031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae8aaa1-814e-4dae-bbd7-bf801c18c824 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:31.651119 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4085/8063] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:32.120240 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:38.492955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22116e19-e9dd-4a59-b1d1-1b806cdc81ea None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:38.505537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22116e19-e9dd-4a59-b1d1-1b806cdc81ea None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:38.510549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb1c87-6f41-4b28-8848-20733053ddff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:38.511538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb1c87-6f41-4b28-8848-20733053ddff service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:38.511931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb1c87-6f41-4b28-8848-20733053ddff service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:38.512275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb1c87-6f41-4b28-8848-20733053ddff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:38.522787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb1c87-6f41-4b28-8848-20733053ddff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:38.524536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb1c87-6f41-4b28-8848-20733053ddff service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:38.540866 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3979/8064] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:42.374493 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=22 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:43.540748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8aaa1-814e-4dae-bbd7-bf801c18c824 service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:43.542299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2ae8aaa1-814e-4dae-bbd7-bf801c18c824 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:43.644394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae8aaa1-814e-4dae-bbd7-bf801c18c824 service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:43.649532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae5cdb-46b6-4c0d-ba72-dfb26e951dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:43.650939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae5cdb-46b6-4c0d-ba72-dfb26e951dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:43.651964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae5cdb-46b6-4c0d-ba72-dfb26e951dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:43.652482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcae5cdb-46b6-4c0d-ba72-dfb26e951dc1 admin admin] PATH_INFO: `/v3/users/424f70fc779e46fea861fedcdf3360de` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:43.654018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae5cdb-46b6-4c0d-ba72-dfb26e951dc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=424f70fc779e46fea861fedcdf3360de)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:43.657893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcae5cdb-46b6-4c0d-ba72-dfb26e951dc1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:43.910896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fcae5cdb-46b6-4c0d-ba72-dfb26e951dc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '424f70fc779e46fea861fedcdf3360de'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:43.924418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fcae5cdb-46b6-4c0d-ba72-dfb26e951dc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '424f70fc779e46fea861fedcdf3360de'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:43.931760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fcae5cdb-46b6-4c0d-ba72-dfb26e951dc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '424f70fc779e46fea861fedcdf3360de'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:43.932493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fcae5cdb-46b6-4c0d-ba72-dfb26e951dc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '424f70fc779e46fea861fedcdf3360de'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:44.045398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fcae5cdb-46b6-4c0d-ba72-dfb26e951dc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '424f70fc779e46fea861fedcdf3360de'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:44.048581 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4086/8065] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:48:43 2022] DELETE /identity/v3/users/424f70fc779e46fea861fedcdf3360de => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:44.050302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3bda9-f672-412e-8ae2-12df55fb77dd None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:44.050760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3bda9-f672-412e-8ae2-12df55fb77dd None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:44.051049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3bda9-f672-412e-8ae2-12df55fb77dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:44.079587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-aaf3bda9-f672-412e-8ae2-12df55fb77dd None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:44.080827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aaf3bda9-f672-412e-8ae2-12df55fb77dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:44.161471 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3980/8066] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:44.168844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae5cdb-46b6-4c0d-ba72-dfb26e951dc1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:44.170334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fcae5cdb-46b6-4c0d-ba72-dfb26e951dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:44.242297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcae5cdb-46b6-4c0d-ba72-dfb26e951dc1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:44.247077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57778f12-a500-4664-8223-2ca75593f803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:44.248040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57778f12-a500-4664-8223-2ca75593f803 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:44.248393 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57778f12-a500-4664-8223-2ca75593f803 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:44.249359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57778f12-a500-4664-8223-2ca75593f803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:44.264022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57778f12-a500-4664-8223-2ca75593f803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:44.264022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57778f12-a500-4664-8223-2ca75593f803 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:44.277950 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4087/8067] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:44.894566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3bda9-f672-412e-8ae2-12df55fb77dd None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:44.894566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aaf3bda9-f672-412e-8ae2-12df55fb77dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:44.894566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3bda9-f672-412e-8ae2-12df55fb77dd None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:44.896048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacbd785-9a19-4cde-a8e7-6c15456c25f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:44.896048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbd785-9a19-4cde-a8e7-6c15456c25f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:44.896048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbd785-9a19-4cde-a8e7-6c15456c25f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:44.896048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacbd785-9a19-4cde-a8e7-6c15456c25f9 admin admin] PATH_INFO: `/v3/projects/4d87ab2b909e42e3a5f334948f84ed92` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:44.896677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbd785-9a19-4cde-a8e7-6c15456c25f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d87ab2b909e42e3a5f334948f84ed92)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:44.896677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacbd785-9a19-4cde-a8e7-6c15456c25f9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:44.956795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eacbd785-9a19-4cde-a8e7-6c15456c25f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d87ab2b909e42e3a5f334948f84ed92', 'request_id': 'req-eacbd785-9a19-4cde-a8e7-6c15456c25f9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:45.103587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eacbd785-9a19-4cde-a8e7-6c15456c25f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d87ab2b909e42e3a5f334948f84ed92', 'request_id': 'req-eacbd785-9a19-4cde-a8e7-6c15456c25f9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:45.113238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eacbd785-9a19-4cde-a8e7-6c15456c25f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d87ab2b909e42e3a5f334948f84ed92', 'request_id': 'req-eacbd785-9a19-4cde-a8e7-6c15456c25f9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:45.124770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eacbd785-9a19-4cde-a8e7-6c15456c25f9 admin admin] The token cache is being invalidate because project 4d87ab2b909e42e3a5f334948f84ed92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:48:45.125190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eacbd785-9a19-4cde-a8e7-6c15456c25f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:45.125949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eacbd785-9a19-4cde-a8e7-6c15456c25f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:45.127634 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3981/8068] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:48:44 2022] DELETE /identity/v3/projects/4d87ab2b909e42e3a5f334948f84ed92 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:45.132502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e4f32-204f-4def-98fe-4341572dbe01 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:45.132971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e4f32-204f-4def-98fe-4341572dbe01 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:45.133066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e4f32-204f-4def-98fe-4341572dbe01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:45.154548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e79e4f32-204f-4def-98fe-4341572dbe01 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:45.155365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e79e4f32-204f-4def-98fe-4341572dbe01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:45.176771 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:45.256198 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4088/8069] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:48:45.265833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245de4a-c391-4269-bf2b-fb00dbc9ed42 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:45.266141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245de4a-c391-4269-bf2b-fb00dbc9ed42 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:45.266432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1245de4a-c391-4269-bf2b-fb00dbc9ed42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:45.297318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1245de4a-c391-4269-bf2b-fb00dbc9ed42 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:45.298645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1245de4a-c391-4269-bf2b-fb00dbc9ed42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:45.313002 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3982/8070] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:45.313168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e4f32-204f-4def-98fe-4341572dbe01 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:45.326049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79e4f32-204f-4def-98fe-4341572dbe01 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:45.337545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d50cb2-ce46-4b6b-b5d6-3a31338acc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:45.337545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d50cb2-ce46-4b6b-b5d6-3a31338acc74 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:45.337545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d50cb2-ce46-4b6b-b5d6-3a31338acc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:45.337545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d50cb2-ce46-4b6b-b5d6-3a31338acc74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:45.337887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d50cb2-ce46-4b6b-b5d6-3a31338acc74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:48:45.337887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d50cb2-ce46-4b6b-b5d6-3a31338acc74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:45.337887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d50cb2-ce46-4b6b-b5d6-3a31338acc74 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:45.367330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245de4a-c391-4269-bf2b-fb00dbc9ed42 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:45.374945 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4089/8071] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:48:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:48:45.386798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1245de4a-c391-4269-bf2b-fb00dbc9ed42 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:45.386798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aef682-e336-421f-a5da-0d128d9b9c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:45.386798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aef682-e336-421f-a5da-0d128d9b9c30 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:45.386798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aef682-e336-421f-a5da-0d128d9b9c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:45.387221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aef682-e336-421f-a5da-0d128d9b9c30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:45.387776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aef682-e336-421f-a5da-0d128d9b9c30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:45.389839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aef682-e336-421f-a5da-0d128d9b9c30 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:45.514919 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:45.535046 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3983/8072] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:48:45 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:48:45.536962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d50cb2-ce46-4b6b-b5d6-3a31338acc74 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:45.554864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d50cb2-ce46-4b6b-b5d6-3a31338acc74 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:45.622212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850368c-2797-4f5d-9300-8f8762794a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:45.622928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850368c-2797-4f5d-9300-8f8762794a66 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:45.623283 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850368c-2797-4f5d-9300-8f8762794a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:45.623585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850368c-2797-4f5d-9300-8f8762794a66 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:45.624310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850368c-2797-4f5d-9300-8f8762794a66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:45.626285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850368c-2797-4f5d-9300-8f8762794a66 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:45.756217 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4090/8073] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:48:45 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:48:45.760457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aef682-e336-421f-a5da-0d128d9b9c30 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:45.773602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aef682-e336-421f-a5da-0d128d9b9c30 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:45.779736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6c334-a8a2-413f-acbe-a4ed60504936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:45.780518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6c334-a8a2-413f-acbe-a4ed60504936 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:45.784149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6c334-a8a2-413f-acbe-a4ed60504936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:45.784149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf6c334-a8a2-413f-acbe-a4ed60504936 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:45.784149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6c334-a8a2-413f-acbe-a4ed60504936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:45.784149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf6c334-a8a2-413f-acbe-a4ed60504936 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:45.797147 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3984/8074] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:48:45.801202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850368c-2797-4f5d-9300-8f8762794a66 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:45.813031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850368c-2797-4f5d-9300-8f8762794a66 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:45.817997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cfda9-fcbd-426d-b23f-137aff33fb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:45.818783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cfda9-fcbd-426d-b23f-137aff33fb86 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:45.819130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cfda9-fcbd-426d-b23f-137aff33fb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:45.819580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cfda9-fcbd-426d-b23f-137aff33fb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:45.820397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cfda9-fcbd-426d-b23f-137aff33fb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:45.822065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cfda9-fcbd-426d-b23f-137aff33fb86 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:45.836254 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4091/8075] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:48:45.840940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6c334-a8a2-413f-acbe-a4ed60504936 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:45.858636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf6c334-a8a2-413f-acbe-a4ed60504936 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:45.872699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b9362-4993-4a33-ab4e-0719d38aff67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:45.873759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b9362-4993-4a33-ab4e-0719d38aff67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:45.874171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b9362-4993-4a33-ab4e-0719d38aff67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:45.874711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b9362-4993-4a33-ab4e-0719d38aff67 admin admin] PATH_INFO: `/v3/projects/08c745ab8f0549cdaf4f04cd04c30139/users/f162767e685342638fde0fd0e9818a13/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:45.897370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b9362-4993-4a33-ab4e-0719d38aff67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c745ab8f0549cdaf4f04cd04c30139, user_id=f162767e685342638fde0fd0e9818a13, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:45.900417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b9362-4993-4a33-ab4e-0719d38aff67 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:45.989968 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3985/8076] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:48:45 2022] PUT /identity/v3/projects/08c745ab8f0549cdaf4f04cd04c30139/users/f162767e685342638fde0fd0e9818a13/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:48:46.005369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab56606-3a0d-42dc-95b7-b4e5029a5058 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:46.005667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab56606-3a0d-42dc-95b7-b4e5029a5058 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:46.005953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab56606-3a0d-42dc-95b7-b4e5029a5058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:46.034507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-aab56606-3a0d-42dc-95b7-b4e5029a5058 None None] MFA Rules not processed for user `f162767e685342638fde0fd0e9818a13`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:46.035876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-aab56606-3a0d-42dc-95b7-b4e5029a5058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:46.107516 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4092/8077] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:46.117975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b9362-4993-4a33-ab4e-0719d38aff67 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:46.119887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bb9b9362-4993-4a33-ab4e-0719d38aff67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:46.194133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b9362-4993-4a33-ab4e-0719d38aff67 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:46.198047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e8eb5e-ba3f-416c-baa0-1661ddd3bdd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:46.198848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8eb5e-ba3f-416c-baa0-1661ddd3bdd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:46.199132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8eb5e-ba3f-416c-baa0-1661ddd3bdd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:46.199422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e8eb5e-ba3f-416c-baa0-1661ddd3bdd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:46.210966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8eb5e-ba3f-416c-baa0-1661ddd3bdd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:46.213218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e8eb5e-ba3f-416c-baa0-1661ddd3bdd2 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:46.223573 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3986/8078] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:46.991654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab56606-3a0d-42dc-95b7-b4e5029a5058 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:46.993198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-aab56606-3a0d-42dc-95b7-b4e5029a5058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:47.016761 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:47.070223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab56606-3a0d-42dc-95b7-b4e5029a5058 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:47.075180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590e6e5-8fc4-4b83-8bfe-db188f10e15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:47.076074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590e6e5-8fc4-4b83-8bfe-db188f10e15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:47.076361 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590e6e5-8fc4-4b83-8bfe-db188f10e15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:47.076633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590e6e5-8fc4-4b83-8bfe-db188f10e15b admin admin] PATH_INFO: `/v3/users/3f5e6f491ae643469188f9f1d2d8fa3e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:47.079712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590e6e5-8fc4-4b83-8bfe-db188f10e15b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f5e6f491ae643469188f9f1d2d8fa3e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:47.081974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590e6e5-8fc4-4b83-8bfe-db188f10e15b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:47.327419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a590e6e5-8fc4-4b83-8bfe-db188f10e15b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f5e6f491ae643469188f9f1d2d8fa3e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:47.339791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a590e6e5-8fc4-4b83-8bfe-db188f10e15b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f5e6f491ae643469188f9f1d2d8fa3e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:47.347309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a590e6e5-8fc4-4b83-8bfe-db188f10e15b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f5e6f491ae643469188f9f1d2d8fa3e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:47.348018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a590e6e5-8fc4-4b83-8bfe-db188f10e15b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f5e6f491ae643469188f9f1d2d8fa3e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:47.410058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a590e6e5-8fc4-4b83-8bfe-db188f10e15b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f5e6f491ae643469188f9f1d2d8fa3e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:47.417086 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4093/8079] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:48:46 2022] DELETE /identity/v3/users/3f5e6f491ae643469188f9f1d2d8fa3e => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:47.421699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa45828-0901-4d12-bab9-e60ebd3949d2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:47.422187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa45828-0901-4d12-bab9-e60ebd3949d2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:47.422303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa45828-0901-4d12-bab9-e60ebd3949d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:47.441444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-eaa45828-0901-4d12-bab9-e60ebd3949d2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:47.442749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eaa45828-0901-4d12-bab9-e60ebd3949d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:47.513270 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3987/8080] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:47.523166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590e6e5-8fc4-4b83-8bfe-db188f10e15b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:47.524587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a590e6e5-8fc4-4b83-8bfe-db188f10e15b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:47.601053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590e6e5-8fc4-4b83-8bfe-db188f10e15b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:47.606607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f25453-a228-4978-8c05-a7e4d6ee7069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:47.607269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f25453-a228-4978-8c05-a7e4d6ee7069 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:47.607562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f25453-a228-4978-8c05-a7e4d6ee7069 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:47.607846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f25453-a228-4978-8c05-a7e4d6ee7069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:47.617789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f25453-a228-4978-8c05-a7e4d6ee7069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:47.619376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f25453-a228-4978-8c05-a7e4d6ee7069 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:47.633519 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4094/8081] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:47.974329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa45828-0901-4d12-bab9-e60ebd3949d2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:47.976231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eaa45828-0901-4d12-bab9-e60ebd3949d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:48.009184 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa45828-0901-4d12-bab9-e60ebd3949d2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:48.015707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26f655-bfc6-4d4b-8deb-bc0ba15d4ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:48.016603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26f655-bfc6-4d4b-8deb-bc0ba15d4ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:48.017511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26f655-bfc6-4d4b-8deb-bc0ba15d4ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:48.017803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26f655-bfc6-4d4b-8deb-bc0ba15d4ac0 admin admin] PATH_INFO: `/v3/projects/fd11ee85ef9e4d18a87921c9fbc7d0c2` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:48.019116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26f655-bfc6-4d4b-8deb-bc0ba15d4ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd11ee85ef9e4d18a87921c9fbc7d0c2)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:48.021046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26f655-bfc6-4d4b-8deb-bc0ba15d4ac0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:48.187314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7a26f655-bfc6-4d4b-8deb-bc0ba15d4ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd11ee85ef9e4d18a87921c9fbc7d0c2', 'request_id': 'req-7a26f655-bfc6-4d4b-8deb-bc0ba15d4ac0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:48.253415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7a26f655-bfc6-4d4b-8deb-bc0ba15d4ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd11ee85ef9e4d18a87921c9fbc7d0c2', 'request_id': 'req-7a26f655-bfc6-4d4b-8deb-bc0ba15d4ac0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:48.261929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7a26f655-bfc6-4d4b-8deb-bc0ba15d4ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd11ee85ef9e4d18a87921c9fbc7d0c2', 'request_id': 'req-7a26f655-bfc6-4d4b-8deb-bc0ba15d4ac0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:48.264583 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:48.277392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7a26f655-bfc6-4d4b-8deb-bc0ba15d4ac0 admin admin] The token cache is being invalidate because project fd11ee85ef9e4d18a87921c9fbc7d0c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:48:48.277958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7a26f655-bfc6-4d4b-8deb-bc0ba15d4ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:48.278869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7a26f655-bfc6-4d4b-8deb-bc0ba15d4ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:48.281384 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3988/8082] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:48:47 2022] DELETE /identity/v3/projects/fd11ee85ef9e4d18a87921c9fbc7d0c2 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:48.288226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265766b-c45c-449a-ac1e-b2953c8d1ae1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:48.289044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265766b-c45c-449a-ac1e-b2953c8d1ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:48.289496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1265766b-c45c-449a-ac1e-b2953c8d1ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:48.319177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1265766b-c45c-449a-ac1e-b2953c8d1ae1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:48.320690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1265766b-c45c-449a-ac1e-b2953c8d1ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:48.362803 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:48.396144 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4095/8083] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:48:48.398010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639d471-8dfe-438c-93c6-ba4aee6af4ed None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:48.398550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639d471-8dfe-438c-93c6-ba4aee6af4ed None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:48.401779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639d471-8dfe-438c-93c6-ba4aee6af4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:48.432434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2639d471-8dfe-438c-93c6-ba4aee6af4ed None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:48.434474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2639d471-8dfe-438c-93c6-ba4aee6af4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:48.444423 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3989/8084] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:48.449550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265766b-c45c-449a-ac1e-b2953c8d1ae1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:48.460786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1265766b-c45c-449a-ac1e-b2953c8d1ae1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:48.466319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0370c9-b986-4a1b-8c04-883a97223155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:48.467225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0370c9-b986-4a1b-8c04-883a97223155 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:48.467765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0370c9-b986-4a1b-8c04-883a97223155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:48.468170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0370c9-b986-4a1b-8c04-883a97223155 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:48.469154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0370c9-b986-4a1b-8c04-883a97223155 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:48:48.469564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0370c9-b986-4a1b-8c04-883a97223155 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:48.471470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0370c9-b986-4a1b-8c04-883a97223155 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:48.489551 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4096/8085] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:48:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:48:48.494124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639d471-8dfe-438c-93c6-ba4aee6af4ed None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:48.505827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639d471-8dfe-438c-93c6-ba4aee6af4ed None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:48.511803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5b5dc-d7ff-4e21-8db6-ff225b0cbaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:48.512648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5b5dc-d7ff-4e21-8db6-ff225b0cbaab admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:48.513228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5b5dc-d7ff-4e21-8db6-ff225b0cbaab admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:48.513653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed5b5dc-d7ff-4e21-8db6-ff225b0cbaab admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:48.514837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5b5dc-d7ff-4e21-8db6-ff225b0cbaab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:48.517180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed5b5dc-d7ff-4e21-8db6-ff225b0cbaab admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:48.604213 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3990/8086] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:48:48 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:48:48.609412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0370c9-b986-4a1b-8c04-883a97223155 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:48.622026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0370c9-b986-4a1b-8c04-883a97223155 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:48.712556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f371d33-14f7-4a26-993d-da94f835d143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:48.713847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f371d33-14f7-4a26-993d-da94f835d143 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:48.714752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f371d33-14f7-4a26-993d-da94f835d143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:48.715292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f371d33-14f7-4a26-993d-da94f835d143 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:48.716116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f371d33-14f7-4a26-993d-da94f835d143 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:48.718367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f371d33-14f7-4a26-993d-da94f835d143 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:48.858890 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4097/8087] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:48:48 2022] POST /identity/v3/users => generated 286 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:48:48.862887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5b5dc-d7ff-4e21-8db6-ff225b0cbaab admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:48.874243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed5b5dc-d7ff-4e21-8db6-ff225b0cbaab admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:48.896178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94528eb9-5586-4d2b-b8e4-c71aabf8160f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:48.897119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94528eb9-5586-4d2b-b8e4-c71aabf8160f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:48.899217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94528eb9-5586-4d2b-b8e4-c71aabf8160f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:48.899660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94528eb9-5586-4d2b-b8e4-c71aabf8160f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:48.900557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94528eb9-5586-4d2b-b8e4-c71aabf8160f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:48.905951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94528eb9-5586-4d2b-b8e4-c71aabf8160f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:48.930348 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3991/8088] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:48:48.930502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f371d33-14f7-4a26-993d-da94f835d143 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:48.948369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f371d33-14f7-4a26-993d-da94f835d143 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:48.959054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07570b4f-887c-4d4b-b14a-6c25576e8e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:48.959911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07570b4f-887c-4d4b-b14a-6c25576e8e2d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:48.960242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07570b4f-887c-4d4b-b14a-6c25576e8e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:49.016525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07570b4f-887c-4d4b-b14a-6c25576e8e2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:49.016525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07570b4f-887c-4d4b-b14a-6c25576e8e2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:49.016525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07570b4f-887c-4d4b-b14a-6c25576e8e2d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:49.016525 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4098/8089] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:48:49.021136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94528eb9-5586-4d2b-b8e4-c71aabf8160f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:49.032710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94528eb9-5586-4d2b-b8e4-c71aabf8160f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:49.037357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a57f58-3b3e-473a-9d1d-b934320d02eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:49.038278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a57f58-3b3e-473a-9d1d-b934320d02eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:49.038572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a57f58-3b3e-473a-9d1d-b934320d02eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:49.038855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a57f58-3b3e-473a-9d1d-b934320d02eb admin admin] PATH_INFO: `/v3/projects/5d77ece6161a47eab639ba9dbd0fbcbf/users/e7402a8ddfb14c0f877bd2d64eaf9068/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:49.056752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a57f58-3b3e-473a-9d1d-b934320d02eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d77ece6161a47eab639ba9dbd0fbcbf, user_id=e7402a8ddfb14c0f877bd2d64eaf9068, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:49.060082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a57f58-3b3e-473a-9d1d-b934320d02eb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:49.155925 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3992/8090] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:48:49 2022] PUT /identity/v3/projects/5d77ece6161a47eab639ba9dbd0fbcbf/users/e7402a8ddfb14c0f877bd2d64eaf9068/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:49.168061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc4cb7-f229-476b-91c2-927676d10f9d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:49.169903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc4cb7-f229-476b-91c2-927676d10f9d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:49.169903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc4cb7-f229-476b-91c2-927676d10f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:49.196228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0cbc4cb7-f229-476b-91c2-927676d10f9d None None] MFA Rules not processed for user `e7402a8ddfb14c0f877bd2d64eaf9068`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:49.197439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0cbc4cb7-f229-476b-91c2-927676d10f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:49.311588 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4099/8091] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:49.315779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a57f58-3b3e-473a-9d1d-b934320d02eb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:49.413775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a57f58-3b3e-473a-9d1d-b934320d02eb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:49.426764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb045e9e-5cd6-411f-8bb2-bee67da0438e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:49.427460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb045e9e-5cd6-411f-8bb2-bee67da0438e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:49.428594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb045e9e-5cd6-411f-8bb2-bee67da0438e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:49.428594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb045e9e-5cd6-411f-8bb2-bee67da0438e admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:49.428824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb045e9e-5cd6-411f-8bb2-bee67da0438e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:49.430681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb045e9e-5cd6-411f-8bb2-bee67da0438e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:49.538564 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3993/8092] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:48:49 2022] POST /identity/v3/projects => generated 373 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:48:49.542742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc4cb7-f229-476b-91c2-927676d10f9d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:49.560878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc4cb7-f229-476b-91c2-927676d10f9d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:49.601096 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:49.639065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263765a-b71b-426d-b548-6b5b167b2eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:49.639917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263765a-b71b-426d-b548-6b5b167b2eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:49.640656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263765a-b71b-426d-b548-6b5b167b2eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:49.641035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e263765a-b71b-426d-b548-6b5b167b2eb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:49.641843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263765a-b71b-426d-b548-6b5b167b2eb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:49.644079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e263765a-b71b-426d-b548-6b5b167b2eb0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:49.732646 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4100/8093] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:48:49 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:48:49.737649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb045e9e-5cd6-411f-8bb2-bee67da0438e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:49.752568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb045e9e-5cd6-411f-8bb2-bee67da0438e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:49.757610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701372b0-8bfb-4aa7-aab8-610eecd8733f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:49.759643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701372b0-8bfb-4aa7-aab8-610eecd8733f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:49.759643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701372b0-8bfb-4aa7-aab8-610eecd8733f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:49.759643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701372b0-8bfb-4aa7-aab8-610eecd8733f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:49.759853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701372b0-8bfb-4aa7-aab8-610eecd8733f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:49.762451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701372b0-8bfb-4aa7-aab8-610eecd8733f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:49.779867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263765a-b71b-426d-b548-6b5b167b2eb0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:49.781636 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3994/8094] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:48:49.792650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e263765a-b71b-426d-b548-6b5b167b2eb0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:49.797875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262d64c-159f-42fb-9567-92d47193f02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:49.798887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262d64c-159f-42fb-9567-92d47193f02c admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:49.799247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262d64c-159f-42fb-9567-92d47193f02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:49.799633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262d64c-159f-42fb-9567-92d47193f02c admin admin] PATH_INFO: `/v3/projects/2af93910be0342fcbeedc6544538d245/users/1248a25c27f645aeb8a805ab7a43aaad/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:49.826001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262d64c-159f-42fb-9567-92d47193f02c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af93910be0342fcbeedc6544538d245, user_id=1248a25c27f645aeb8a805ab7a43aaad, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:49.828774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3262d64c-159f-42fb-9567-92d47193f02c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:49.970800 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4101/8095] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:48:49 2022] PUT /identity/v3/projects/2af93910be0342fcbeedc6544538d245/users/1248a25c27f645aeb8a805ab7a43aaad/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:48:49.974870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701372b0-8bfb-4aa7-aab8-610eecd8733f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:49.992418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701372b0-8bfb-4aa7-aab8-610eecd8733f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:50.102888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea9c5b-8232-4ce9-afb7-b0e52ae6fbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:50.104118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea9c5b-8232-4ce9-afb7-b0e52ae6fbbc admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:50.104579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea9c5b-8232-4ce9-afb7-b0e52ae6fbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:50.105006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea9c5b-8232-4ce9-afb7-b0e52ae6fbbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:50.106006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea9c5b-8232-4ce9-afb7-b0e52ae6fbbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:50.107927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea9c5b-8232-4ce9-afb7-b0e52ae6fbbc admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:50.109590 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:50.120305 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3995/8096] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:48:50.130715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262d64c-159f-42fb-9567-92d47193f02c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:50.143966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262d64c-159f-42fb-9567-92d47193f02c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:50.149079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33dc87-2fda-4796-aa7a-8cd29c44f7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:50.150135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33dc87-2fda-4796-aa7a-8cd29c44f7c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:50.150525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33dc87-2fda-4796-aa7a-8cd29c44f7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:50.150905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c33dc87-2fda-4796-aa7a-8cd29c44f7c0 admin admin] PATH_INFO: `/v3/projects/2af93910be0342fcbeedc6544538d245/users/1248a25c27f645aeb8a805ab7a43aaad/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:50.154013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33dc87-2fda-4796-aa7a-8cd29c44f7c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2af93910be0342fcbeedc6544538d245, user_id=1248a25c27f645aeb8a805ab7a43aaad, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:50.156886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c33dc87-2fda-4796-aa7a-8cd29c44f7c0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:50.168989 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4102/8097] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:48:50 2022] PUT /identity/v3/projects/2af93910be0342fcbeedc6544538d245/users/1248a25c27f645aeb8a805ab7a43aaad/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:50.186541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf440e-eb15-47aa-9868-f582b6621ff2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:50.187089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf440e-eb15-47aa-9868-f582b6621ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:50.187484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf440e-eb15-47aa-9868-f582b6621ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:50.221865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-becf440e-eb15-47aa-9868-f582b6621ff2 None None] MFA Rules not processed for user `1248a25c27f645aeb8a805ab7a43aaad`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:50.223581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-becf440e-eb15-47aa-9868-f582b6621ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:50.309945 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3996/8098] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:50.324669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33dc87-2fda-4796-aa7a-8cd29c44f7c0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:50.327262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0c33dc87-2fda-4796-aa7a-8cd29c44f7c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:50.399170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c33dc87-2fda-4796-aa7a-8cd29c44f7c0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:50.404369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b93b6f-0991-4850-8835-9a3b215aa718 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:50.405127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b93b6f-0991-4850-8835-9a3b215aa718 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:50.405530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b93b6f-0991-4850-8835-9a3b215aa718 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:50.405888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b93b6f-0991-4850-8835-9a3b215aa718 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:50.417671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b93b6f-0991-4850-8835-9a3b215aa718 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:50.419615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b93b6f-0991-4850-8835-9a3b215aa718 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:50.432139 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4103/8099] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:51.465045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf440e-eb15-47aa-9868-f582b6621ff2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:51.532281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf440e-eb15-47aa-9868-f582b6621ff2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:51.536875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d5a15-b818-4bb5-a83d-eb8fb41bf93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:51.537806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d5a15-b818-4bb5-a83d-eb8fb41bf93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:51.538091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d5a15-b818-4bb5-a83d-eb8fb41bf93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:51.538398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d5a15-b818-4bb5-a83d-eb8fb41bf93e admin admin] PATH_INFO: `/v3/users/e7402a8ddfb14c0f877bd2d64eaf9068` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:51.539602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d5a15-b818-4bb5-a83d-eb8fb41bf93e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7402a8ddfb14c0f877bd2d64eaf9068)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:51.541575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d5a15-b818-4bb5-a83d-eb8fb41bf93e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:51.770945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f70d5a15-b818-4bb5-a83d-eb8fb41bf93e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7402a8ddfb14c0f877bd2d64eaf9068'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:51.803320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f70d5a15-b818-4bb5-a83d-eb8fb41bf93e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7402a8ddfb14c0f877bd2d64eaf9068'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:51.804092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f70d5a15-b818-4bb5-a83d-eb8fb41bf93e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7402a8ddfb14c0f877bd2d64eaf9068'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:51.807677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f70d5a15-b818-4bb5-a83d-eb8fb41bf93e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7402a8ddfb14c0f877bd2d64eaf9068'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:51.829728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f70d5a15-b818-4bb5-a83d-eb8fb41bf93e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7402a8ddfb14c0f877bd2d64eaf9068'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:51.933287 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:51.938337 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3997/8100] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:48:51 2022] DELETE /identity/v3/users/e7402a8ddfb14c0f877bd2d64eaf9068 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:48:51.942996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37dd26-58ea-4c29-9bdd-09f435b7b63c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:51.943802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37dd26-58ea-4c29-9bdd-09f435b7b63c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:51.944128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec37dd26-58ea-4c29-9bdd-09f435b7b63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:51.964188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ec37dd26-58ea-4c29-9bdd-09f435b7b63c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:51.965524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ec37dd26-58ea-4c29-9bdd-09f435b7b63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:52.032300 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4104/8101] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:48:52.041966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d5a15-b818-4bb5-a83d-eb8fb41bf93e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:52.050916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f70d5a15-b818-4bb5-a83d-eb8fb41bf93e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:52.131255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d5a15-b818-4bb5-a83d-eb8fb41bf93e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:52.136593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29cb31-8cb3-41d0-9c05-1b81a72f24b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:52.137572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29cb31-8cb3-41d0-9c05-1b81a72f24b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:52.137863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29cb31-8cb3-41d0-9c05-1b81a72f24b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:52.138179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29cb31-8cb3-41d0-9c05-1b81a72f24b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:52.150559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29cb31-8cb3-41d0-9c05-1b81a72f24b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:52.152195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29cb31-8cb3-41d0-9c05-1b81a72f24b8 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:52.162309 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3998/8102] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:52.778088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37dd26-58ea-4c29-9bdd-09f435b7b63c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:52.779560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ec37dd26-58ea-4c29-9bdd-09f435b7b63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:52.811971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec37dd26-58ea-4c29-9bdd-09f435b7b63c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:52.817079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab1faa-3c75-4fa5-a7d5-2ef014a2c2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:52.818292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab1faa-3c75-4fa5-a7d5-2ef014a2c2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:52.818726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab1faa-3c75-4fa5-a7d5-2ef014a2c2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:52.819162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab1faa-3c75-4fa5-a7d5-2ef014a2c2c5 admin admin] PATH_INFO: `/v3/projects/5d77ece6161a47eab639ba9dbd0fbcbf` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:52.820459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab1faa-3c75-4fa5-a7d5-2ef014a2c2c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d77ece6161a47eab639ba9dbd0fbcbf)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:52.822585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feab1faa-3c75-4fa5-a7d5-2ef014a2c2c5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:52.934475 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:52.954491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-feab1faa-3c75-4fa5-a7d5-2ef014a2c2c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d77ece6161a47eab639ba9dbd0fbcbf', 'request_id': 'req-feab1faa-3c75-4fa5-a7d5-2ef014a2c2c5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:52.960811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-feab1faa-3c75-4fa5-a7d5-2ef014a2c2c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d77ece6161a47eab639ba9dbd0fbcbf', 'request_id': 'req-feab1faa-3c75-4fa5-a7d5-2ef014a2c2c5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:52.968149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-feab1faa-3c75-4fa5-a7d5-2ef014a2c2c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d77ece6161a47eab639ba9dbd0fbcbf', 'request_id': 'req-feab1faa-3c75-4fa5-a7d5-2ef014a2c2c5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:53.081496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-feab1faa-3c75-4fa5-a7d5-2ef014a2c2c5 admin admin] The token cache is being invalidate because project 5d77ece6161a47eab639ba9dbd0fbcbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:48:53.081875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-feab1faa-3c75-4fa5-a7d5-2ef014a2c2c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:53.082595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-feab1faa-3c75-4fa5-a7d5-2ef014a2c2c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:53.084368 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4105/8103] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:48:52 2022] DELETE /identity/v3/projects/5d77ece6161a47eab639ba9dbd0fbcbf => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:53.089077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29cb31-8cb3-41d0-9c05-1b81a72f24b8 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:53.107802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29cb31-8cb3-41d0-9c05-1b81a72f24b8 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:53.180322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e31334-1c13-4bb2-bf76-4496e64322ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:53.181675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e31334-1c13-4bb2-bf76-4496e64322ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:53.182181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e31334-1c13-4bb2-bf76-4496e64322ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:53.182812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e31334-1c13-4bb2-bf76-4496e64322ea admin admin] PATH_INFO: `/v3/users/1248a25c27f645aeb8a805ab7a43aaad` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:53.185103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e31334-1c13-4bb2-bf76-4496e64322ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=1248a25c27f645aeb8a805ab7a43aaad)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:53.187494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e31334-1c13-4bb2-bf76-4496e64322ea admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:53.379480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-29e31334-1c13-4bb2-bf76-4496e64322ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1248a25c27f645aeb8a805ab7a43aaad'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:53.395997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-29e31334-1c13-4bb2-bf76-4496e64322ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1248a25c27f645aeb8a805ab7a43aaad'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:53.396733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-29e31334-1c13-4bb2-bf76-4496e64322ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1248a25c27f645aeb8a805ab7a43aaad'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:53.397618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-29e31334-1c13-4bb2-bf76-4496e64322ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1248a25c27f645aeb8a805ab7a43aaad'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:53.405811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-29e31334-1c13-4bb2-bf76-4496e64322ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1248a25c27f645aeb8a805ab7a43aaad'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:53.502144 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 3999/8104] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:48:53 2022] DELETE /identity/v3/users/1248a25c27f645aeb8a805ab7a43aaad => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:54.043383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab1faa-3c75-4fa5-a7d5-2ef014a2c2c5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:54.046317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-feab1faa-3c75-4fa5-a7d5-2ef014a2c2c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:54.063163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feab1faa-3c75-4fa5-a7d5-2ef014a2c2c5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:54.152189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7be1ae-6814-4b99-b81a-07d5c7697732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:54.152189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7be1ae-6814-4b99-b81a-07d5c7697732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:54.152189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7be1ae-6814-4b99-b81a-07d5c7697732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:54.152189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7be1ae-6814-4b99-b81a-07d5c7697732 admin admin] PATH_INFO: `/v3/projects/2af93910be0342fcbeedc6544538d245` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:54.152510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7be1ae-6814-4b99-b81a-07d5c7697732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2af93910be0342fcbeedc6544538d245)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:54.154910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7be1ae-6814-4b99-b81a-07d5c7697732 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:54.341568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3e7be1ae-6814-4b99-b81a-07d5c7697732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2af93910be0342fcbeedc6544538d245', 'request_id': 'req-3e7be1ae-6814-4b99-b81a-07d5c7697732'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:54.348596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3e7be1ae-6814-4b99-b81a-07d5c7697732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2af93910be0342fcbeedc6544538d245', 'request_id': 'req-3e7be1ae-6814-4b99-b81a-07d5c7697732'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:54.355815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3e7be1ae-6814-4b99-b81a-07d5c7697732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2af93910be0342fcbeedc6544538d245', 'request_id': 'req-3e7be1ae-6814-4b99-b81a-07d5c7697732'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:54.458207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3e7be1ae-6814-4b99-b81a-07d5c7697732 admin admin] The token cache is being invalidate because project 2af93910be0342fcbeedc6544538d245 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:48:54.458501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3e7be1ae-6814-4b99-b81a-07d5c7697732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:54.459142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3e7be1ae-6814-4b99-b81a-07d5c7697732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:54.460725 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4106/8105] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:48:54 2022] DELETE /identity/v3/projects/2af93910be0342fcbeedc6544538d245 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:54.465953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e78f26-6f33-42fc-bbcc-580bc8aeb4c8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:54.466443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e78f26-6f33-42fc-bbcc-580bc8aeb4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:54.466711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e78f26-6f33-42fc-bbcc-580bc8aeb4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:54.486008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-09e78f26-6f33-42fc-bbcc-580bc8aeb4c8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:54.487456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-09e78f26-6f33-42fc-bbcc-580bc8aeb4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:54.507462 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:54.551214 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4000/8106] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:54.560276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01e8f2-9791-4a74-bd70-09a580b087e0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:54.560651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01e8f2-9791-4a74-bd70-09a580b087e0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:54.561004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea01e8f2-9791-4a74-bd70-09a580b087e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:54.580225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ea01e8f2-9791-4a74-bd70-09a580b087e0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:54.581530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ea01e8f2-9791-4a74-bd70-09a580b087e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:54.593405 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4107/8107] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:54.594616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e78f26-6f33-42fc-bbcc-580bc8aeb4c8 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:54.606941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e78f26-6f33-42fc-bbcc-580bc8aeb4c8 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:54.612074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746738e-56e1-4546-887e-385e0596bc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:54.612828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746738e-56e1-4546-887e-385e0596bc11 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:54.613187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746738e-56e1-4546-887e-385e0596bc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:54.613438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746738e-56e1-4546-887e-385e0596bc11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:54.614237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746738e-56e1-4546-887e-385e0596bc11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:48:54.614547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746738e-56e1-4546-887e-385e0596bc11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:54.616160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746738e-56e1-4546-887e-385e0596bc11 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:54.657981 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4001/8108] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:48:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:48:54.660214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01e8f2-9791-4a74-bd70-09a580b087e0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:54.674796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea01e8f2-9791-4a74-bd70-09a580b087e0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:54.680308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b0026-690a-4085-b7dd-a69526f22979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:54.681047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b0026-690a-4085-b7dd-a69526f22979 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:54.681388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b0026-690a-4085-b7dd-a69526f22979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:54.681740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413b0026-690a-4085-b7dd-a69526f22979 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:54.682730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b0026-690a-4085-b7dd-a69526f22979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:54.685286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413b0026-690a-4085-b7dd-a69526f22979 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:54.811754 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4108/8109] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:48:54 2022] POST /identity/v3/projects => generated 363 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:48:54.813138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746738e-56e1-4546-887e-385e0596bc11 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:54.824105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746738e-56e1-4546-887e-385e0596bc11 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:54.893493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286d364-ac13-4b1a-a0b9-51e2b0eea67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:54.893493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286d364-ac13-4b1a-a0b9-51e2b0eea67c admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:54.893493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286d364-ac13-4b1a-a0b9-51e2b0eea67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:54.893493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286d364-ac13-4b1a-a0b9-51e2b0eea67c admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:54.893887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286d364-ac13-4b1a-a0b9-51e2b0eea67c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:54.893887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b286d364-ac13-4b1a-a0b9-51e2b0eea67c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:55.004468 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4002/8110] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:48:54 2022] POST /identity/v3/users => generated 282 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:48:55.008496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b0026-690a-4085-b7dd-a69526f22979 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:55.021954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413b0026-690a-4085-b7dd-a69526f22979 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:55.027322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59e04f-0912-4e5a-a07d-ed84525854b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:55.027992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59e04f-0912-4e5a-a07d-ed84525854b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:55.031426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59e04f-0912-4e5a-a07d-ed84525854b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:55.031426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59e04f-0912-4e5a-a07d-ed84525854b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:55.031426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59e04f-0912-4e5a-a07d-ed84525854b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:55.031426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59e04f-0912-4e5a-a07d-ed84525854b0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:55.042351 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4109/8111] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:48:55.051665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286d364-ac13-4b1a-a0b9-51e2b0eea67c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:55.062211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286d364-ac13-4b1a-a0b9-51e2b0eea67c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:55.067011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd52ac-3cc7-4b7c-b977-7d02b48b5720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:55.067688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd52ac-3cc7-4b7c-b977-7d02b48b5720 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:55.067997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd52ac-3cc7-4b7c-b977-7d02b48b5720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:55.068263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd52ac-3cc7-4b7c-b977-7d02b48b5720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:55.069002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd52ac-3cc7-4b7c-b977-7d02b48b5720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:55.070638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd52ac-3cc7-4b7c-b977-7d02b48b5720 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:55.081845 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4003/8112] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:48:55.086087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59e04f-0912-4e5a-a07d-ed84525854b0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:55.093229 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:55.097285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59e04f-0912-4e5a-a07d-ed84525854b0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:55.102066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f002c53-9d52-49ab-a15b-d6195ba0df0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:55.102988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f002c53-9d52-49ab-a15b-d6195ba0df0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:55.103591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f002c53-9d52-49ab-a15b-d6195ba0df0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:55.103671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f002c53-9d52-49ab-a15b-d6195ba0df0b admin admin] PATH_INFO: `/v3/projects/4855611feb9e426f91443b642bbd825b/users/0ff507c1ed4f425daf1b5edfc9afaf8b/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:55.120636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f002c53-9d52-49ab-a15b-d6195ba0df0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4855611feb9e426f91443b642bbd825b, user_id=0ff507c1ed4f425daf1b5edfc9afaf8b, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:55.123496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f002c53-9d52-49ab-a15b-d6195ba0df0b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:55.234134 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4110/8113] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:48:55 2022] PUT /identity/v3/projects/4855611feb9e426f91443b642bbd825b/users/0ff507c1ed4f425daf1b5edfc9afaf8b/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:55.241679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b841d-d8fe-42f5-b668-241f49f399e6 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:55.241976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b841d-d8fe-42f5-b668-241f49f399e6 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:55.242294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b841d-d8fe-42f5-b668-241f49f399e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:55.288473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-326b841d-d8fe-42f5-b668-241f49f399e6 None None] MFA Rules not processed for user `0ff507c1ed4f425daf1b5edfc9afaf8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:55.289768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-326b841d-d8fe-42f5-b668-241f49f399e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:55.379370 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4004/8114] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:55.384078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f002c53-9d52-49ab-a15b-d6195ba0df0b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:55.470874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f002c53-9d52-49ab-a15b-d6195ba0df0b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:55.475834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62423ca-35a4-4898-8ccc-5c7eb1a77c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:55.476496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62423ca-35a4-4898-8ccc-5c7eb1a77c4a admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:55.480499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62423ca-35a4-4898-8ccc-5c7eb1a77c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:55.480499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62423ca-35a4-4898-8ccc-5c7eb1a77c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:55.480499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62423ca-35a4-4898-8ccc-5c7eb1a77c4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:55.480890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62423ca-35a4-4898-8ccc-5c7eb1a77c4a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:55.572236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b841d-d8fe-42f5-b668-241f49f399e6 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:55.575311 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4111/8115] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:48:55 2022] POST /identity/v3/projects => generated 361 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:48:55.587064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b841d-d8fe-42f5-b668-241f49f399e6 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:55.603103 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:55.649554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af5343-4681-47fc-8370-9f694b04c1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:55.650462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af5343-4681-47fc-8370-9f694b04c1d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:55.651346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af5343-4681-47fc-8370-9f694b04c1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:55.651688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af5343-4681-47fc-8370-9f694b04c1d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:55.652457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af5343-4681-47fc-8370-9f694b04c1d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:55.654619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af5343-4681-47fc-8370-9f694b04c1d1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:55.813460 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4005/8116] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:48:55 2022] POST /identity/v3/users => generated 287 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:48:55.815001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62423ca-35a4-4898-8ccc-5c7eb1a77c4a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:55.830591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62423ca-35a4-4898-8ccc-5c7eb1a77c4a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:55.835885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10952b4f-6778-4255-af69-cdf7cd8c3a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:55.836832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10952b4f-6778-4255-af69-cdf7cd8c3a76 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:55.836929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10952b4f-6778-4255-af69-cdf7cd8c3a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:55.837211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10952b4f-6778-4255-af69-cdf7cd8c3a76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:55.838015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10952b4f-6778-4255-af69-cdf7cd8c3a76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:55.840263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10952b4f-6778-4255-af69-cdf7cd8c3a76 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:55.851516 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4112/8117] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:48:55.856429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af5343-4681-47fc-8370-9f694b04c1d1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:55.866680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af5343-4681-47fc-8370-9f694b04c1d1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:55.871588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50befc12-5ff0-438a-89eb-67cfdc9cef58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:55.872495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50befc12-5ff0-438a-89eb-67cfdc9cef58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:55.872810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50befc12-5ff0-438a-89eb-67cfdc9cef58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:55.873095 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50befc12-5ff0-438a-89eb-67cfdc9cef58 admin admin] PATH_INFO: `/v3/projects/6adff4f339c64414a1c7cfe6fd5a52b5/users/13d36b1782834882ab64d9f6fbac8c06/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:55.888293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50befc12-5ff0-438a-89eb-67cfdc9cef58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6adff4f339c64414a1c7cfe6fd5a52b5, user_id=13d36b1782834882ab64d9f6fbac8c06, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:55.891534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50befc12-5ff0-438a-89eb-67cfdc9cef58 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:55.972992 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4006/8118] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:48:55 2022] PUT /identity/v3/projects/6adff4f339c64414a1c7cfe6fd5a52b5/users/13d36b1782834882ab64d9f6fbac8c06/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:55.977362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10952b4f-6778-4255-af69-cdf7cd8c3a76 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:55.999319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10952b4f-6778-4255-af69-cdf7cd8c3a76 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:56.063873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01796a-9321-4baf-912b-1330342812c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:56.064563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01796a-9321-4baf-912b-1330342812c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:56.064851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01796a-9321-4baf-912b-1330342812c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:56.065132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01796a-9321-4baf-912b-1330342812c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:56.065912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01796a-9321-4baf-912b-1330342812c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:56.067843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01796a-9321-4baf-912b-1330342812c3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:56.082144 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4113/8119] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:48:56.083870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50befc12-5ff0-438a-89eb-67cfdc9cef58 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:56.104625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50befc12-5ff0-438a-89eb-67cfdc9cef58 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:56.111694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970067f-369d-4255-9eba-1c9f85007761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:56.113412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970067f-369d-4255-9eba-1c9f85007761 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:56.113699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970067f-369d-4255-9eba-1c9f85007761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:56.115041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3970067f-369d-4255-9eba-1c9f85007761 admin admin] PATH_INFO: `/v3/projects/6adff4f339c64414a1c7cfe6fd5a52b5/users/13d36b1782834882ab64d9f6fbac8c06/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:56.117400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970067f-369d-4255-9eba-1c9f85007761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6adff4f339c64414a1c7cfe6fd5a52b5, user_id=13d36b1782834882ab64d9f6fbac8c06, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:56.120380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3970067f-369d-4255-9eba-1c9f85007761 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:56.134715 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4007/8120] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:48:56 2022] PUT /identity/v3/projects/6adff4f339c64414a1c7cfe6fd5a52b5/users/13d36b1782834882ab64d9f6fbac8c06/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:56.147524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ab266-daa4-4f7f-bf81-9732827b5dbc None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:56.147918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ab266-daa4-4f7f-bf81-9732827b5dbc None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:56.148167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ab266-daa4-4f7f-bf81-9732827b5dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:56.178611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-479ab266-daa4-4f7f-bf81-9732827b5dbc None None] MFA Rules not processed for user `13d36b1782834882ab64d9f6fbac8c06`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:56.179743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-479ab266-daa4-4f7f-bf81-9732827b5dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:56.243592 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:56.286144 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4114/8121] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:56 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:56.300747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970067f-369d-4255-9eba-1c9f85007761 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:56.303101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3970067f-369d-4255-9eba-1c9f85007761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:56.389902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3970067f-369d-4255-9eba-1c9f85007761 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:56.395719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2c3f3-dffe-4416-ac1e-626b05908341 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:56.396816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2c3f3-dffe-4416-ac1e-626b05908341 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:56.397166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2c3f3-dffe-4416-ac1e-626b05908341 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:56.397515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2c3f3-dffe-4416-ac1e-626b05908341 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:56.408489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2c3f3-dffe-4416-ac1e-626b05908341 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:56.410041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c2c3f3-dffe-4416-ac1e-626b05908341 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:56.420667 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4008/8122] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:56 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:56.613463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ab266-daa4-4f7f-bf81-9732827b5dbc None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:56.615300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-479ab266-daa4-4f7f-bf81-9732827b5dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:56.702632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ab266-daa4-4f7f-bf81-9732827b5dbc None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:56.706413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd3208-3cdc-486f-8ff1-fb00946dd502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:56.707305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd3208-3cdc-486f-8ff1-fb00946dd502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:56.707595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd3208-3cdc-486f-8ff1-fb00946dd502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:56.707883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd3208-3cdc-486f-8ff1-fb00946dd502 admin admin] PATH_INFO: `/v3/users/f162767e685342638fde0fd0e9818a13` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:56.709282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd3208-3cdc-486f-8ff1-fb00946dd502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f162767e685342638fde0fd0e9818a13)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:56.711483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd3208-3cdc-486f-8ff1-fb00946dd502 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:56.940755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6bdd3208-3cdc-486f-8ff1-fb00946dd502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f162767e685342638fde0fd0e9818a13'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:56.955678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6bdd3208-3cdc-486f-8ff1-fb00946dd502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f162767e685342638fde0fd0e9818a13'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:56.964105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6bdd3208-3cdc-486f-8ff1-fb00946dd502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f162767e685342638fde0fd0e9818a13'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:56.964580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6bdd3208-3cdc-486f-8ff1-fb00946dd502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f162767e685342638fde0fd0e9818a13'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:57.061412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6bdd3208-3cdc-486f-8ff1-fb00946dd502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f162767e685342638fde0fd0e9818a13'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:57.082273 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4115/8123] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:48:56 2022] DELETE /identity/v3/users/f162767e685342638fde0fd0e9818a13 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:57.087033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dcd87-4c90-4715-987c-e0f3576caa2a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:57.087523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dcd87-4c90-4715-987c-e0f3576caa2a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:57.087611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dcd87-4c90-4715-987c-e0f3576caa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:57.106632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-811dcd87-4c90-4715-987c-e0f3576caa2a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:57.107848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-811dcd87-4c90-4715-987c-e0f3576caa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:57.181139 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4009/8124] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:57.191458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd3208-3cdc-486f-8ff1-fb00946dd502 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:57.193117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6bdd3208-3cdc-486f-8ff1-fb00946dd502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:57.262640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd3208-3cdc-486f-8ff1-fb00946dd502 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:57.266695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fc9a3-a6d9-42e8-b488-c73f0592c9aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:57.267358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fc9a3-a6d9-42e8-b488-c73f0592c9aa service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:57.267650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fc9a3-a6d9-42e8-b488-c73f0592c9aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:57.267932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128fc9a3-a6d9-42e8-b488-c73f0592c9aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:57.278416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fc9a3-a6d9-42e8-b488-c73f0592c9aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:57.279786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128fc9a3-a6d9-42e8-b488-c73f0592c9aa service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:57.283812 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:57.292099 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4116/8125] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:57.428618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811dcd87-4c90-4715-987c-e0f3576caa2a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:57.431543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-811dcd87-4c90-4715-987c-e0f3576caa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:57.470331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811dcd87-4c90-4715-987c-e0f3576caa2a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:57.477398 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb2e5f4-a8a0-466d-a42d-3bcee004fe5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:57.480512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2e5f4-a8a0-466d-a42d-3bcee004fe5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:57.481118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2e5f4-a8a0-466d-a42d-3bcee004fe5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:57.481551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb2e5f4-a8a0-466d-a42d-3bcee004fe5b admin admin] PATH_INFO: `/v3/users/0ff507c1ed4f425daf1b5edfc9afaf8b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:57.486140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2e5f4-a8a0-466d-a42d-3bcee004fe5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ff507c1ed4f425daf1b5edfc9afaf8b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:57.488021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb2e5f4-a8a0-466d-a42d-3bcee004fe5b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:57.497637 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:57.701032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fc9a3-a6d9-42e8-b488-c73f0592c9aa service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:57.703215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-128fc9a3-a6d9-42e8-b488-c73f0592c9aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:57.715502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9fb2e5f4-a8a0-466d-a42d-3bcee004fe5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ff507c1ed4f425daf1b5edfc9afaf8b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:57.722892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128fc9a3-a6d9-42e8-b488-c73f0592c9aa service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:57.731487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988c829-258c-459d-a395-c42a679c9676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:57.734749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988c829-258c-459d-a395-c42a679c9676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:57.735171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988c829-258c-459d-a395-c42a679c9676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:57.736122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988c829-258c-459d-a395-c42a679c9676 admin admin] PATH_INFO: `/v3/projects/08c745ab8f0549cdaf4f04cd04c30139` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:57.739125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988c829-258c-459d-a395-c42a679c9676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08c745ab8f0549cdaf4f04cd04c30139)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:57.740768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9fb2e5f4-a8a0-466d-a42d-3bcee004fe5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ff507c1ed4f425daf1b5edfc9afaf8b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:57.742562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9fb2e5f4-a8a0-466d-a42d-3bcee004fe5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ff507c1ed4f425daf1b5edfc9afaf8b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:57.743178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9fb2e5f4-a8a0-466d-a42d-3bcee004fe5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ff507c1ed4f425daf1b5edfc9afaf8b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:57.745095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988c829-258c-459d-a395-c42a679c9676 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:57.761244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9fb2e5f4-a8a0-466d-a42d-3bcee004fe5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ff507c1ed4f425daf1b5edfc9afaf8b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:57.876312 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4010/8126] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:48:57 2022] DELETE /identity/v3/users/0ff507c1ed4f425daf1b5edfc9afaf8b => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:57.880739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb8a8e-bf03-4435-a89e-0c57429753f6 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:57.881036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb8a8e-bf03-4435-a89e-0c57429753f6 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:57.881358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb8a8e-bf03-4435-a89e-0c57429753f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:57.894198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c988c829-258c-459d-a395-c42a679c9676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08c745ab8f0549cdaf4f04cd04c30139', 'request_id': 'req-c988c829-258c-459d-a395-c42a679c9676'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:57.900338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c988c829-258c-459d-a395-c42a679c9676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08c745ab8f0549cdaf4f04cd04c30139', 'request_id': 'req-c988c829-258c-459d-a395-c42a679c9676'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:57.902679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-44bb8a8e-bf03-4435-a89e-0c57429753f6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:57.903902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-44bb8a8e-bf03-4435-a89e-0c57429753f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:57.907970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c988c829-258c-459d-a395-c42a679c9676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08c745ab8f0549cdaf4f04cd04c30139', 'request_id': 'req-c988c829-258c-459d-a395-c42a679c9676'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:57.967776 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4011/8127] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:48:57.978298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb8a8e-bf03-4435-a89e-0c57429753f6 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:57.980500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-44bb8a8e-bf03-4435-a89e-0c57429753f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:57.982780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c988c829-258c-459d-a395-c42a679c9676 admin admin] The token cache is being invalidate because project 08c745ab8f0549cdaf4f04cd04c30139 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:48:57.983077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c988c829-258c-459d-a395-c42a679c9676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:57.983754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c988c829-258c-459d-a395-c42a679c9676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:57.985668 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4117/8128] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:48:57 2022] DELETE /identity/v3/projects/08c745ab8f0549cdaf4f04cd04c30139 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:57.996716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de9c71-43fe-490b-9003-e0b30aedca03 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:57.997332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de9c71-43fe-490b-9003-e0b30aedca03 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:57.997624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de9c71-43fe-490b-9003-e0b30aedca03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:58.016886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-12de9c71-43fe-490b-9003-e0b30aedca03 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:58.018090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-12de9c71-43fe-490b-9003-e0b30aedca03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:58.034250 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4118/8129] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:48:58.035691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237a448-a126-40a8-8973-2f1914479fed None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:58.035979 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237a448-a126-40a8-8973-2f1914479fed None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:58.036256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237a448-a126-40a8-8973-2f1914479fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:58.055617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb8a8e-bf03-4435-a89e-0c57429753f6 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:58.059996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67736e4e-cdf2-4e65-b515-e7fff3859346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:58.060769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67736e4e-cdf2-4e65-b515-e7fff3859346 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:58.061150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67736e4e-cdf2-4e65-b515-e7fff3859346 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:58.061867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67736e4e-cdf2-4e65-b515-e7fff3859346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:58.063922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-67736e4e-cdf2-4e65-b515-e7fff3859346 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:58.075554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5237a448-a126-40a8-8973-2f1914479fed None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:58.076747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5237a448-a126-40a8-8973-2f1914479fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:58.085031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67736e4e-cdf2-4e65-b515-e7fff3859346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:58.085156 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4119/8130] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:58.086649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67736e4e-cdf2-4e65-b515-e7fff3859346 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:58.089519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237a448-a126-40a8-8973-2f1914479fed None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:58.098471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237a448-a126-40a8-8973-2f1914479fed None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:58.102280 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4012/8131] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:48:58.103171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa624149-32eb-4d19-87a9-f0d1f7176e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:58.103856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa624149-32eb-4d19-87a9-f0d1f7176e84 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:58.104800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa624149-32eb-4d19-87a9-f0d1f7176e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:58.105092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa624149-32eb-4d19-87a9-f0d1f7176e84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:58.105827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa624149-32eb-4d19-87a9-f0d1f7176e84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:48:58.106305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa624149-32eb-4d19-87a9-f0d1f7176e84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:58.108005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa624149-32eb-4d19-87a9-f0d1f7176e84 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:58.121136 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4120/8132] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:48:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:48:58.125613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67736e4e-cdf2-4e65-b515-e7fff3859346 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:58.137431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67736e4e-cdf2-4e65-b515-e7fff3859346 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:58.143171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f01f1-8249-4a70-8b64-9d445932e8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:58.143998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f01f1-8249-4a70-8b64-9d445932e8c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:58.144428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f01f1-8249-4a70-8b64-9d445932e8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:58.144944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f01f1-8249-4a70-8b64-9d445932e8c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:58.145779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f01f1-8249-4a70-8b64-9d445932e8c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:58.147875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f01f1-8249-4a70-8b64-9d445932e8c8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:58.250510 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4013/8133] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:48:58 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:48:58.251591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa624149-32eb-4d19-87a9-f0d1f7176e84 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:58.264620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa624149-32eb-4d19-87a9-f0d1f7176e84 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:58.335433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afddff-8d3a-415b-8d89-5fa2944510ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:58.336253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afddff-8d3a-415b-8d89-5fa2944510ba admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:58.336579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afddff-8d3a-415b-8d89-5fa2944510ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:58.336814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afddff-8d3a-415b-8d89-5fa2944510ba admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:58.337997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afddff-8d3a-415b-8d89-5fa2944510ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:58.340810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afddff-8d3a-415b-8d89-5fa2944510ba admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:58.445653 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4121/8134] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:48:58 2022] POST /identity/v3/users => generated 285 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:48:58.450633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f01f1-8249-4a70-8b64-9d445932e8c8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:58.461219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f01f1-8249-4a70-8b64-9d445932e8c8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:58.466471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3245e4-5604-40a1-871b-020edb6e75ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:58.467127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3245e4-5604-40a1-871b-020edb6e75ec admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:58.467448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3245e4-5604-40a1-871b-020edb6e75ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:58.467939 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3245e4-5604-40a1-871b-020edb6e75ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:58.468609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3245e4-5604-40a1-871b-020edb6e75ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:58.470221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3245e4-5604-40a1-871b-020edb6e75ec admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:58.471496 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:58.481886 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4014/8135] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:48:58.485797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afddff-8d3a-415b-8d89-5fa2944510ba admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:58.496064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afddff-8d3a-415b-8d89-5fa2944510ba admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:58.501012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52be49-6e44-46d5-9c85-4ae9a216f5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:58.506580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52be49-6e44-46d5-9c85-4ae9a216f5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:58.506580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52be49-6e44-46d5-9c85-4ae9a216f5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:58.506580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52be49-6e44-46d5-9c85-4ae9a216f5b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:58.506580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52be49-6e44-46d5-9c85-4ae9a216f5b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:58.506580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52be49-6e44-46d5-9c85-4ae9a216f5b1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:58.519234 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4122/8136] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:48:58.520794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3245e4-5604-40a1-871b-020edb6e75ec admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:58.533643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3245e4-5604-40a1-871b-020edb6e75ec admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:58.536081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52be49-6e44-46d5-9c85-4ae9a216f5b1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:58.538062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4d52be49-6e44-46d5-9c85-4ae9a216f5b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:58.538703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8da191-d1b8-46fe-bbf0-32dbf5266168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:58.539710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8da191-d1b8-46fe-bbf0-32dbf5266168 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:58.540006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8da191-d1b8-46fe-bbf0-32dbf5266168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:58.540381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8da191-d1b8-46fe-bbf0-32dbf5266168 admin admin] PATH_INFO: `/v3/projects/b9a88c1eedc14ab4a7158ec00ea2d9ed/users/ef284e97ce57433aa45dd0ad3250b97f/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:58.566256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8da191-d1b8-46fe-bbf0-32dbf5266168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a88c1eedc14ab4a7158ec00ea2d9ed, user_id=ef284e97ce57433aa45dd0ad3250b97f, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:58.568824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8da191-d1b8-46fe-bbf0-32dbf5266168 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:58.570430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52be49-6e44-46d5-9c85-4ae9a216f5b1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:58.576628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3808b-d1ae-4da9-85bb-f5762139424a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:58.577578 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3808b-d1ae-4da9-85bb-f5762139424a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:58.577872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3808b-d1ae-4da9-85bb-f5762139424a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:58.578185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3808b-d1ae-4da9-85bb-f5762139424a admin admin] PATH_INFO: `/v3/projects/4855611feb9e426f91443b642bbd825b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:58.579383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3808b-d1ae-4da9-85bb-f5762139424a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4855611feb9e426f91443b642bbd825b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:58.581466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3808b-d1ae-4da9-85bb-f5762139424a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:58.664116 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4015/8137] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:48:58 2022] PUT /identity/v3/projects/b9a88c1eedc14ab4a7158ec00ea2d9ed/users/ef284e97ce57433aa45dd0ad3250b97f/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:58.675404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d866ba-5992-4bef-bb2f-e212f57e9944 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:58.675699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d866ba-5992-4bef-bb2f-e212f57e9944 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:58.675983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d866ba-5992-4bef-bb2f-e212f57e9944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:58.692423 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:58.706645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e9d866ba-5992-4bef-bb2f-e212f57e9944 None None] MFA Rules not processed for user `ef284e97ce57433aa45dd0ad3250b97f`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:58.707912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e9d866ba-5992-4bef-bb2f-e212f57e9944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:58.710471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-29f3808b-d1ae-4da9-85bb-f5762139424a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4855611feb9e426f91443b642bbd825b', 'request_id': 'req-29f3808b-d1ae-4da9-85bb-f5762139424a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:58.717915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-29f3808b-d1ae-4da9-85bb-f5762139424a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4855611feb9e426f91443b642bbd825b', 'request_id': 'req-29f3808b-d1ae-4da9-85bb-f5762139424a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:58.725059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-29f3808b-d1ae-4da9-85bb-f5762139424a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4855611feb9e426f91443b642bbd825b', 'request_id': 'req-29f3808b-d1ae-4da9-85bb-f5762139424a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:58.789743 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4016/8138] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:48:58.792559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d866ba-5992-4bef-bb2f-e212f57e9944 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:58.800996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-29f3808b-d1ae-4da9-85bb-f5762139424a admin admin] The token cache is being invalidate because project 4855611feb9e426f91443b642bbd825b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:48:58.801620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-29f3808b-d1ae-4da9-85bb-f5762139424a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:58.802444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-29f3808b-d1ae-4da9-85bb-f5762139424a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:58.809413 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4123/8139] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:48:58 2022] DELETE /identity/v3/projects/4855611feb9e426f91443b642bbd825b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:58.812922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3808b-d1ae-4da9-85bb-f5762139424a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:58.812922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-29f3808b-d1ae-4da9-85bb-f5762139424a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:58.878649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d866ba-5992-4bef-bb2f-e212f57e9944 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:58.884011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320487e-d583-4852-8f96-05358a3304c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:58.884990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320487e-d583-4852-8f96-05358a3304c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:58.885551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320487e-d583-4852-8f96-05358a3304c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:58.886010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320487e-d583-4852-8f96-05358a3304c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:58.887098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320487e-d583-4852-8f96-05358a3304c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:58.889442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320487e-d583-4852-8f96-05358a3304c6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:58.907301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3808b-d1ae-4da9-85bb-f5762139424a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:58.911973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2779ad-2d93-4a7c-8602-41442b3b6c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:58.912871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2779ad-2d93-4a7c-8602-41442b3b6c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:58.913140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2779ad-2d93-4a7c-8602-41442b3b6c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:58.913447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2779ad-2d93-4a7c-8602-41442b3b6c70 admin admin] PATH_INFO: `/v3/users/13d36b1782834882ab64d9f6fbac8c06` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:58.914695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2779ad-2d93-4a7c-8602-41442b3b6c70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13d36b1782834882ab64d9f6fbac8c06)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:58.917300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2779ad-2d93-4a7c-8602-41442b3b6c70 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:58.977225 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4017/8140] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:48:58 2022] POST /identity/v3/projects => generated 369 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:48:58.981352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320487e-d583-4852-8f96-05358a3304c6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:58.983419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b320487e-d583-4852-8f96-05358a3304c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:59.039265 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:59.054796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320487e-d583-4852-8f96-05358a3304c6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:59.059869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd883dd0-ae7c-4a14-b745-3e9a6613dde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:59.060543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd883dd0-ae7c-4a14-b745-3e9a6613dde8 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:59.060827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd883dd0-ae7c-4a14-b745-3e9a6613dde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:59.061103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd883dd0-ae7c-4a14-b745-3e9a6613dde8 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:59.061796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd883dd0-ae7c-4a14-b745-3e9a6613dde8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:59.063772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd883dd0-ae7c-4a14-b745-3e9a6613dde8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:59.078922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2c2779ad-2d93-4a7c-8602-41442b3b6c70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13d36b1782834882ab64d9f6fbac8c06'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:59.094882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2c2779ad-2d93-4a7c-8602-41442b3b6c70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13d36b1782834882ab64d9f6fbac8c06'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:59.109248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2c2779ad-2d93-4a7c-8602-41442b3b6c70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13d36b1782834882ab64d9f6fbac8c06'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:59.109893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2c2779ad-2d93-4a7c-8602-41442b3b6c70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13d36b1782834882ab64d9f6fbac8c06'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:59.163331 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4018/8141] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:48:58 2022] POST /identity/v3/users => generated 291 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:48:59.169411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd883dd0-ae7c-4a14-b745-3e9a6613dde8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:59.179917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd883dd0-ae7c-4a14-b745-3e9a6613dde8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:59.184197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2c2779ad-2d93-4a7c-8602-41442b3b6c70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13d36b1782834882ab64d9f6fbac8c06'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:48:59.187000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1f193-c857-44d8-bd77-968acbf892a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:59.187727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1f193-c857-44d8-bd77-968acbf892a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:59.188015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1f193-c857-44d8-bd77-968acbf892a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:59.190981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1f193-c857-44d8-bd77-968acbf892a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:59.190981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1f193-c857-44d8-bd77-968acbf892a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:59.190981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1f193-c857-44d8-bd77-968acbf892a1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:59.194981 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4124/8142] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:48:58 2022] DELETE /identity/v3/users/13d36b1782834882ab64d9f6fbac8c06 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:59.216133 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4019/8143] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:48:59.222554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2779ad-2d93-4a7c-8602-41442b3b6c70 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:59.224103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2c2779ad-2d93-4a7c-8602-41442b3b6c70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:59.277165 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:59.308156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2779ad-2d93-4a7c-8602-41442b3b6c70 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:59.314328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4acc3-b6ce-44fa-921b-cd26c3567c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:59.315241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4acc3-b6ce-44fa-921b-cd26c3567c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:59.315537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4acc3-b6ce-44fa-921b-cd26c3567c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:59.316415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4acc3-b6ce-44fa-921b-cd26c3567c62 admin admin] PATH_INFO: `/v3/projects/941a21b8f2634742978702381749f0de/users/d46b69e2b61146dba69bfa2d76b77529/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:59.334612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4acc3-b6ce-44fa-921b-cd26c3567c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=941a21b8f2634742978702381749f0de, user_id=d46b69e2b61146dba69bfa2d76b77529, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:59.337351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c4acc3-b6ce-44fa-921b-cd26c3567c62 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:59.420223 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4125/8144] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:48:59 2022] PUT /identity/v3/projects/941a21b8f2634742978702381749f0de/users/d46b69e2b61146dba69bfa2d76b77529/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:59.424227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1f193-c857-44d8-bd77-968acbf892a1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:59.441490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1f193-c857-44d8-bd77-968acbf892a1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:59.547020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed80dac2-2f54-41d3-9a4f-3c01de38be71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:59.547671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80dac2-2f54-41d3-9a4f-3c01de38be71 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:59.547965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80dac2-2f54-41d3-9a4f-3c01de38be71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:59.548253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed80dac2-2f54-41d3-9a4f-3c01de38be71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:59.549042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80dac2-2f54-41d3-9a4f-3c01de38be71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:59.551145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed80dac2-2f54-41d3-9a4f-3c01de38be71 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:59.570057 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4020/8145] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:48:59 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:48:59.574952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4acc3-b6ce-44fa-921b-cd26c3567c62 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:59.586647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4acc3-b6ce-44fa-921b-cd26c3567c62 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:59.592696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67be4f5-3221-4679-9494-7263347153f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:59.593179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67be4f5-3221-4679-9494-7263347153f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:59.593540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67be4f5-3221-4679-9494-7263347153f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:59.593912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67be4f5-3221-4679-9494-7263347153f5 admin admin] PATH_INFO: `/v3/projects/941a21b8f2634742978702381749f0de/users/d46b69e2b61146dba69bfa2d76b77529/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:59.596293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67be4f5-3221-4679-9494-7263347153f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=941a21b8f2634742978702381749f0de, user_id=d46b69e2b61146dba69bfa2d76b77529, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:59.599137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67be4f5-3221-4679-9494-7263347153f5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:59.612385 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4126/8146] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:48:59 2022] PUT /identity/v3/projects/941a21b8f2634742978702381749f0de/users/d46b69e2b61146dba69bfa2d76b77529/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:48:59.623186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af514b-6207-495a-b0e8-2ea1686d7a85 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:59.623485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af514b-6207-495a-b0e8-2ea1686d7a85 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:59.623782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af514b-6207-495a-b0e8-2ea1686d7a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:59.665001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-09af514b-6207-495a-b0e8-2ea1686d7a85 None None] MFA Rules not processed for user `d46b69e2b61146dba69bfa2d76b77529`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:48:59.666989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-09af514b-6207-495a-b0e8-2ea1686d7a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:59.739058 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4021/8147] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:48:59 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:48:59.752770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67be4f5-3221-4679-9494-7263347153f5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:59.754845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e67be4f5-3221-4679-9494-7263347153f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:59.846203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67be4f5-3221-4679-9494-7263347153f5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:59.852717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430df92-120d-45c0-a856-15022da578ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:59.853418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430df92-120d-45c0-a856-15022da578ec service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:59.853752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430df92-120d-45c0-a856-15022da578ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:59.854003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430df92-120d-45c0-a856-15022da578ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:59.857551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af514b-6207-495a-b0e8-2ea1686d7a85 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:48:59.863721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-09af514b-6207-495a-b0e8-2ea1686d7a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:48:59.867149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430df92-120d-45c0-a856-15022da578ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:59.870382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2430df92-120d-45c0-a856-15022da578ec service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:48:59.882852 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4127/8148] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:48:59 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:48:59.950162 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:48:59.967397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09af514b-6207-495a-b0e8-2ea1686d7a85 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:48:59.972249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ab951-7ac6-4d38-860f-0dfd8d80dcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:48:59.973121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ab951-7ac6-4d38-860f-0dfd8d80dcae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:48:59.973412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ab951-7ac6-4d38-860f-0dfd8d80dcae admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:48:59.974674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ab951-7ac6-4d38-860f-0dfd8d80dcae admin admin] PATH_INFO: `/v3/projects/6adff4f339c64414a1c7cfe6fd5a52b5` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:48:59.975032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ab951-7ac6-4d38-860f-0dfd8d80dcae admin admin] RBAC: Authorizing `identity:delete_project(project_id=6adff4f339c64414a1c7cfe6fd5a52b5)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:48:59.976979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ab951-7ac6-4d38-860f-0dfd8d80dcae admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:00.016387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430df92-120d-45c0-a856-15022da578ec service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:00.017853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2430df92-120d-45c0-a856-15022da578ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:00.033363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430df92-120d-45c0-a856-15022da578ec service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:00.037237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c6b26-55c4-4b5d-b687-3947b9fef4e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:00.037955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c6b26-55c4-4b5d-b687-3947b9fef4e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:00.038519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c6b26-55c4-4b5d-b687-3947b9fef4e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:00.038626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c6b26-55c4-4b5d-b687-3947b9fef4e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:00.040430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-492c6b26-55c4-4b5d-b687-3947b9fef4e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:00.125892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c6b26-55c4-4b5d-b687-3947b9fef4e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:00.131748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c6b26-55c4-4b5d-b687-3947b9fef4e7 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:00.154421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e23ab951-7ac6-4d38-860f-0dfd8d80dcae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6adff4f339c64414a1c7cfe6fd5a52b5', 'request_id': 'req-e23ab951-7ac6-4d38-860f-0dfd8d80dcae'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:00.186592 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4128/8149] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:00 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:49:00.255360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e23ab951-7ac6-4d38-860f-0dfd8d80dcae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6adff4f339c64414a1c7cfe6fd5a52b5', 'request_id': 'req-e23ab951-7ac6-4d38-860f-0dfd8d80dcae'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:00.267112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e23ab951-7ac6-4d38-860f-0dfd8d80dcae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6adff4f339c64414a1c7cfe6fd5a52b5', 'request_id': 'req-e23ab951-7ac6-4d38-860f-0dfd8d80dcae'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:00.289318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e23ab951-7ac6-4d38-860f-0dfd8d80dcae admin admin] The token cache is being invalidate because project 6adff4f339c64414a1c7cfe6fd5a52b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:00.289634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e23ab951-7ac6-4d38-860f-0dfd8d80dcae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:00.290316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e23ab951-7ac6-4d38-860f-0dfd8d80dcae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:00.292710 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4022/8150] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:48:59 2022] DELETE /identity/v3/projects/6adff4f339c64414a1c7cfe6fd5a52b5 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:00.298600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c017e83-dbed-4f52-8b99-78503b3492a4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:00.299068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c017e83-dbed-4f52-8b99-78503b3492a4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:00.299617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c017e83-dbed-4f52-8b99-78503b3492a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:00.321320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7c017e83-dbed-4f52-8b99-78503b3492a4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:00.322676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7c017e83-dbed-4f52-8b99-78503b3492a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:00.378157 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:00.410866 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4129/8151] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:00.419728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b6515-9637-48d9-9fac-becf7dec5e01 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:00.420023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b6515-9637-48d9-9fac-becf7dec5e01 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:00.420309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b6515-9637-48d9-9fac-becf7dec5e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:00.457956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b15b6515-9637-48d9-9fac-becf7dec5e01 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:00.460814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b15b6515-9637-48d9-9fac-becf7dec5e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:00.471061 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4023/8152] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:00.475246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c017e83-dbed-4f52-8b99-78503b3492a4 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:00.493620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c017e83-dbed-4f52-8b99-78503b3492a4 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:00.501950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99056ad-efd4-41aa-be48-5a44d371dae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:00.501950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99056ad-efd4-41aa-be48-5a44d371dae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:00.501950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99056ad-efd4-41aa-be48-5a44d371dae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:00.502417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99056ad-efd4-41aa-be48-5a44d371dae4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:00.503050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99056ad-efd4-41aa-be48-5a44d371dae4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:49:00.503362 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99056ad-efd4-41aa-be48-5a44d371dae4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:00.505275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99056ad-efd4-41aa-be48-5a44d371dae4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:00.519718 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4130/8153] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:49:00.523816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b6515-9637-48d9-9fac-becf7dec5e01 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:00.534683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b6515-9637-48d9-9fac-becf7dec5e01 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:00.539875 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d469fde-15e8-4f77-91a2-ce46510957e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:00.540553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d469fde-15e8-4f77-91a2-ce46510957e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:00.540870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d469fde-15e8-4f77-91a2-ce46510957e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:00.541338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d469fde-15e8-4f77-91a2-ce46510957e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:00.542258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d469fde-15e8-4f77-91a2-ce46510957e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:00.544876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d469fde-15e8-4f77-91a2-ce46510957e4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:00.647458 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4024/8154] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:49:00 2022] POST /identity/v3/projects => generated 357 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:00.648603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99056ad-efd4-41aa-be48-5a44d371dae4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:00.660923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99056ad-efd4-41aa-be48-5a44d371dae4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:00.740614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff1a1f-cce3-4508-a9e1-b966f9a7acbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:00.741313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff1a1f-cce3-4508-a9e1-b966f9a7acbd admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:00.741612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff1a1f-cce3-4508-a9e1-b966f9a7acbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:00.741923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff1a1f-cce3-4508-a9e1-b966f9a7acbd admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:00.742651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff1a1f-cce3-4508-a9e1-b966f9a7acbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:00.744643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff1a1f-cce3-4508-a9e1-b966f9a7acbd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:00.857679 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4131/8155] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:49:00 2022] POST /identity/v3/users => generated 279 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:00.874009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d469fde-15e8-4f77-91a2-ce46510957e4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:00.875538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d469fde-15e8-4f77-91a2-ce46510957e4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:00.880740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8d36d-8216-4d9b-841f-bac2285a0c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:00.881530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8d36d-8216-4d9b-841f-bac2285a0c5e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:00.881742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8d36d-8216-4d9b-841f-bac2285a0c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:00.882025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8d36d-8216-4d9b-841f-bac2285a0c5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:00.883066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8d36d-8216-4d9b-841f-bac2285a0c5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:00.884478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8d36d-8216-4d9b-841f-bac2285a0c5e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:00.898575 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4025/8156] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:00.901101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff1a1f-cce3-4508-a9e1-b966f9a7acbd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:00.918996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff1a1f-cce3-4508-a9e1-b966f9a7acbd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:00.925144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8635399b-ba7d-44ac-94aa-e92351083f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:00.925858 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635399b-ba7d-44ac-94aa-e92351083f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:00.926190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635399b-ba7d-44ac-94aa-e92351083f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:00.926477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8635399b-ba7d-44ac-94aa-e92351083f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:00.927231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635399b-ba7d-44ac-94aa-e92351083f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:00.928882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8635399b-ba7d-44ac-94aa-e92351083f08 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:00.945036 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4132/8157] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:00 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:00.950678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8d36d-8216-4d9b-841f-bac2285a0c5e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:00.962666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8d36d-8216-4d9b-841f-bac2285a0c5e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:00.968306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc7365-acb0-4080-8ecd-1a90b0e76b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:00.969176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc7365-acb0-4080-8ecd-1a90b0e76b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:00.969960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc7365-acb0-4080-8ecd-1a90b0e76b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:00.969960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc7365-acb0-4080-8ecd-1a90b0e76b5a admin admin] PATH_INFO: `/v3/projects/ec29e27dc72e4c3593ff6ff4ae20ce69/users/cb76abea9c994abdb6eba724ec322493/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:00.988659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc7365-acb0-4080-8ecd-1a90b0e76b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec29e27dc72e4c3593ff6ff4ae20ce69, user_id=cb76abea9c994abdb6eba724ec322493, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:00.999210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc7365-acb0-4080-8ecd-1a90b0e76b5a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:01.102742 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4026/8158] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:00 2022] PUT /identity/v3/projects/ec29e27dc72e4c3593ff6ff4ae20ce69/users/cb76abea9c994abdb6eba724ec322493/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:01.115200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d928d-799b-445c-9256-280b01e5a346 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:01.115483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d928d-799b-445c-9256-280b01e5a346 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:01.115765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d928d-799b-445c-9256-280b01e5a346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:01.143617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-db2d928d-799b-445c-9256-280b01e5a346 None None] MFA Rules not processed for user `cb76abea9c994abdb6eba724ec322493`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:01.144843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-db2d928d-799b-445c-9256-280b01e5a346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:01.223373 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4133/8159] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:01 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:01.230443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc7365-acb0-4080-8ecd-1a90b0e76b5a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:01.304607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc7365-acb0-4080-8ecd-1a90b0e76b5a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:01.310462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871a596-9c79-494f-81c3-90b85848287f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:01.311124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871a596-9c79-494f-81c3-90b85848287f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:01.311407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871a596-9c79-494f-81c3-90b85848287f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:01.311682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871a596-9c79-494f-81c3-90b85848287f admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:01.312373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871a596-9c79-494f-81c3-90b85848287f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:01.314364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871a596-9c79-494f-81c3-90b85848287f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:01.396497 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:01.413694 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4027/8160] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:49:01 2022] POST /identity/v3/projects => generated 357 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:01.417648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d928d-799b-445c-9256-280b01e5a346 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:01.429811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d928d-799b-445c-9256-280b01e5a346 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:01.470822 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:01.487871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed1bfd-e2e0-4a6b-8f73-ae3792badf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:01.488714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed1bfd-e2e0-4a6b-8f73-ae3792badf0e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:01.489012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed1bfd-e2e0-4a6b-8f73-ae3792badf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:01.489300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed1bfd-e2e0-4a6b-8f73-ae3792badf0e admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:01.490006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed1bfd-e2e0-4a6b-8f73-ae3792badf0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:01.492243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed1bfd-e2e0-4a6b-8f73-ae3792badf0e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:01.575638 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4134/8161] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:49:01 2022] POST /identity/v3/users => generated 285 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:01.580128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871a596-9c79-494f-81c3-90b85848287f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:01.591984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871a596-9c79-494f-81c3-90b85848287f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:01.596730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ccaeb-4268-43fd-9911-0caf66aa5a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:01.597494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ccaeb-4268-43fd-9911-0caf66aa5a68 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:01.597847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ccaeb-4268-43fd-9911-0caf66aa5a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:01.598230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ccaeb-4268-43fd-9911-0caf66aa5a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:01.599033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ccaeb-4268-43fd-9911-0caf66aa5a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:01.600719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ccaeb-4268-43fd-9911-0caf66aa5a68 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:01.613309 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4028/8162] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:49:01.617492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed1bfd-e2e0-4a6b-8f73-ae3792badf0e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:01.629288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed1bfd-e2e0-4a6b-8f73-ae3792badf0e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:01.634243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b693b6d-f231-4783-9693-185ea644a647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:01.635201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b693b6d-f231-4783-9693-185ea644a647 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:01.636166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b693b6d-f231-4783-9693-185ea644a647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:01.636513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b693b6d-f231-4783-9693-185ea644a647 admin admin] PATH_INFO: `/v3/projects/cac7e52d2b3b481fa701f51a29e2922f/users/cc6815a263fc48e89cfa17c33ee91dbb/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:01.662677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b693b6d-f231-4783-9693-185ea644a647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cac7e52d2b3b481fa701f51a29e2922f, user_id=cc6815a263fc48e89cfa17c33ee91dbb, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:01.662677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b693b6d-f231-4783-9693-185ea644a647 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:01.753188 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4135/8163] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:01 2022] PUT /identity/v3/projects/cac7e52d2b3b481fa701f51a29e2922f/users/cc6815a263fc48e89cfa17c33ee91dbb/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:49:01.757421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ccaeb-4268-43fd-9911-0caf66aa5a68 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:01.768048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ccaeb-4268-43fd-9911-0caf66aa5a68 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:01.830623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c73de2-88a7-407d-9d55-fe12c676986b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:01.831319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c73de2-88a7-407d-9d55-fe12c676986b admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:01.831624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c73de2-88a7-407d-9d55-fe12c676986b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:01.831878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c73de2-88a7-407d-9d55-fe12c676986b admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:01.832670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c73de2-88a7-407d-9d55-fe12c676986b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:01.834344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c73de2-88a7-407d-9d55-fe12c676986b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:01.847017 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4029/8164] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:01.851590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b693b6d-f231-4783-9693-185ea644a647 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:01.870983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b693b6d-f231-4783-9693-185ea644a647 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:01.875945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8e503-809b-4877-920e-b7a53488e36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:01.877079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8e503-809b-4877-920e-b7a53488e36b admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:01.877510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8e503-809b-4877-920e-b7a53488e36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:01.881953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8e503-809b-4877-920e-b7a53488e36b admin admin] PATH_INFO: `/v3/projects/cac7e52d2b3b481fa701f51a29e2922f/users/cc6815a263fc48e89cfa17c33ee91dbb/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:01.881953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8e503-809b-4877-920e-b7a53488e36b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cac7e52d2b3b481fa701f51a29e2922f, user_id=cc6815a263fc48e89cfa17c33ee91dbb, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:01.883856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8e503-809b-4877-920e-b7a53488e36b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:01.898646 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4136/8165] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:01 2022] PUT /identity/v3/projects/cac7e52d2b3b481fa701f51a29e2922f/users/cc6815a263fc48e89cfa17c33ee91dbb/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:01.908406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fc7a3-cd8c-430e-8882-9d092f152e9d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:01.908700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fc7a3-cd8c-430e-8882-9d092f152e9d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:01.908977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077fc7a3-cd8c-430e-8882-9d092f152e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:01.941697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-077fc7a3-cd8c-430e-8882-9d092f152e9d None None] MFA Rules not processed for user `cc6815a263fc48e89cfa17c33ee91dbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:01.943043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-077fc7a3-cd8c-430e-8882-9d092f152e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:02.038185 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4030/8166] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:01 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:02.096517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8e503-809b-4877-920e-b7a53488e36b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:02.098264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f8a8e503-809b-4877-920e-b7a53488e36b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:02.185489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8e503-809b-4877-920e-b7a53488e36b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:02.186994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c5c30-503d-4c56-a615-9fb998c4f60d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:02.187653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c5c30-503d-4c56-a615-9fb998c4f60d service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:02.187940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c5c30-503d-4c56-a615-9fb998c4f60d service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:02.188221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c5c30-503d-4c56-a615-9fb998c4f60d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:02.198030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c5c30-503d-4c56-a615-9fb998c4f60d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:02.199731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c5c30-503d-4c56-a615-9fb998c4f60d service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:02.223265 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4137/8167] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:02 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:02.442910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fc7a3-cd8c-430e-8882-9d092f152e9d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:02.457185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077fc7a3-cd8c-430e-8882-9d092f152e9d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:02.461408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144bbb9e-9df9-4f7c-8c98-347a310cbb3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:02.462065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bbb9e-9df9-4f7c-8c98-347a310cbb3e service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:02.462386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bbb9e-9df9-4f7c-8c98-347a310cbb3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:02.462671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144bbb9e-9df9-4f7c-8c98-347a310cbb3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:02.529075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144bbb9e-9df9-4f7c-8c98-347a310cbb3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:02.530626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144bbb9e-9df9-4f7c-8c98-347a310cbb3e service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:02.542988 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4031/8168] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:02 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:05.691775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c5c30-503d-4c56-a615-9fb998c4f60d service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:05.693861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a64c5c30-503d-4c56-a615-9fb998c4f60d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:05.857562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c5c30-503d-4c56-a615-9fb998c4f60d service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:05.864369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10306f-2c82-474c-b161-bc40d059d3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:05.865300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10306f-2c82-474c-b161-bc40d059d3c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:05.865585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10306f-2c82-474c-b161-bc40d059d3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:05.865866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e10306f-2c82-474c-b161-bc40d059d3c5 admin admin] PATH_INFO: `/v3/users/ef284e97ce57433aa45dd0ad3250b97f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:05.867626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10306f-2c82-474c-b161-bc40d059d3c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef284e97ce57433aa45dd0ad3250b97f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:05.878355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e10306f-2c82-474c-b161-bc40d059d3c5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:05.894960 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:06.105998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4e10306f-2c82-474c-b161-bc40d059d3c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef284e97ce57433aa45dd0ad3250b97f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:06.134058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4e10306f-2c82-474c-b161-bc40d059d3c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef284e97ce57433aa45dd0ad3250b97f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:06.150167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4e10306f-2c82-474c-b161-bc40d059d3c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef284e97ce57433aa45dd0ad3250b97f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:06.152984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4e10306f-2c82-474c-b161-bc40d059d3c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef284e97ce57433aa45dd0ad3250b97f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:06.246746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4e10306f-2c82-474c-b161-bc40d059d3c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef284e97ce57433aa45dd0ad3250b97f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:06.254826 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4138/8169] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:05 2022] DELETE /identity/v3/users/ef284e97ce57433aa45dd0ad3250b97f => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:49:06.259598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7250f5e-2c46-4860-b416-e9636a5a06b0 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:06.260543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7250f5e-2c46-4860-b416-e9636a5a06b0 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:06.261057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7250f5e-2c46-4860-b416-e9636a5a06b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:06.277167 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:06.284206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d7250f5e-2c46-4860-b416-e9636a5a06b0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:06.285670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d7250f5e-2c46-4860-b416-e9636a5a06b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:06.493364 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4032/8170] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:49:06.503847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10306f-2c82-474c-b161-bc40d059d3c5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:06.505566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4e10306f-2c82-474c-b161-bc40d059d3c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:06.617421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e10306f-2c82-474c-b161-bc40d059d3c5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:06.624535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a02fb-831e-46ec-8eee-adb7d5c9a331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:06.625254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a02fb-831e-46ec-8eee-adb7d5c9a331 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:06.625586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a02fb-831e-46ec-8eee-adb7d5c9a331 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:06.625866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a02fb-831e-46ec-8eee-adb7d5c9a331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:06.637145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a02fb-831e-46ec-8eee-adb7d5c9a331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:06.638893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a02fb-831e-46ec-8eee-adb7d5c9a331 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:06.651381 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4139/8171] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:07.189494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7250f5e-2c46-4860-b416-e9636a5a06b0 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:07.192088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d7250f5e-2c46-4860-b416-e9636a5a06b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:07.223153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7250f5e-2c46-4860-b416-e9636a5a06b0 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:07.245660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bc2ff-c399-44bd-a566-c5216e6be775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:07.246617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bc2ff-c399-44bd-a566-c5216e6be775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:07.246911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bc2ff-c399-44bd-a566-c5216e6be775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:07.247197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bc2ff-c399-44bd-a566-c5216e6be775 admin admin] PATH_INFO: `/v3/projects/b9a88c1eedc14ab4a7158ec00ea2d9ed` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:07.250801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bc2ff-c399-44bd-a566-c5216e6be775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a88c1eedc14ab4a7158ec00ea2d9ed)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:07.252825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4bc2ff-c399-44bd-a566-c5216e6be775 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:07.350130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a02fb-831e-46ec-8eee-adb7d5c9a331 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:07.353088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3e1a02fb-831e-46ec-8eee-adb7d5c9a331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:07.393391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1d4bc2ff-c399-44bd-a566-c5216e6be775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a88c1eedc14ab4a7158ec00ea2d9ed', 'request_id': 'req-1d4bc2ff-c399-44bd-a566-c5216e6be775'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:07.475873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1d4bc2ff-c399-44bd-a566-c5216e6be775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a88c1eedc14ab4a7158ec00ea2d9ed', 'request_id': 'req-1d4bc2ff-c399-44bd-a566-c5216e6be775'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:07.485209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1d4bc2ff-c399-44bd-a566-c5216e6be775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a88c1eedc14ab4a7158ec00ea2d9ed', 'request_id': 'req-1d4bc2ff-c399-44bd-a566-c5216e6be775'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:07.516345 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1d4bc2ff-c399-44bd-a566-c5216e6be775 admin admin] The token cache is being invalidate because project b9a88c1eedc14ab4a7158ec00ea2d9ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:07.520441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1d4bc2ff-c399-44bd-a566-c5216e6be775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:07.521590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1d4bc2ff-c399-44bd-a566-c5216e6be775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:07.524925 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4033/8172] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:49:07 2022] DELETE /identity/v3/projects/b9a88c1eedc14ab4a7158ec00ea2d9ed => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:07.530583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bc2ff-c399-44bd-a566-c5216e6be775 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:07.533401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1d4bc2ff-c399-44bd-a566-c5216e6be775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:07.548535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a02fb-831e-46ec-8eee-adb7d5c9a331 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:07.623266 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:07.663590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bc2ff-c399-44bd-a566-c5216e6be775 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:07.669257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72c692-8cbb-400c-87e5-811157504189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:07.670521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72c692-8cbb-400c-87e5-811157504189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:07.670935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72c692-8cbb-400c-87e5-811157504189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:07.671286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d72c692-8cbb-400c-87e5-811157504189 admin admin] PATH_INFO: `/v3/users/d46b69e2b61146dba69bfa2d76b77529` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:07.672785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72c692-8cbb-400c-87e5-811157504189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d46b69e2b61146dba69bfa2d76b77529)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:07.675934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d72c692-8cbb-400c-87e5-811157504189 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:07.686380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0cb0b-43f6-4560-aed9-99a16038531b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:07.687213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0cb0b-43f6-4560-aed9-99a16038531b service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:07.687505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0cb0b-43f6-4560-aed9-99a16038531b service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:07.687881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0cb0b-43f6-4560-aed9-99a16038531b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:07.692007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cad0cb0b-43f6-4560-aed9-99a16038531b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:07.717778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0cb0b-43f6-4560-aed9-99a16038531b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:07.719801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0cb0b-43f6-4560-aed9-99a16038531b service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:07.734914 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4140/8173] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:07.895547 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:07.933360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0d72c692-8cbb-400c-87e5-811157504189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd46b69e2b61146dba69bfa2d76b77529'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:07.955342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0cb0b-43f6-4560-aed9-99a16038531b service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:07.957038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cad0cb0b-43f6-4560-aed9-99a16038531b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:07.958866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0d72c692-8cbb-400c-87e5-811157504189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd46b69e2b61146dba69bfa2d76b77529'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:07.959700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0d72c692-8cbb-400c-87e5-811157504189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd46b69e2b61146dba69bfa2d76b77529'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:07.960404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0d72c692-8cbb-400c-87e5-811157504189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd46b69e2b61146dba69bfa2d76b77529'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:07.980380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0d72c692-8cbb-400c-87e5-811157504189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd46b69e2b61146dba69bfa2d76b77529'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:07.988721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0cb0b-43f6-4560-aed9-99a16038531b service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:08.005453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d96ae-b6d0-43cc-9f7a-e3492e3d9ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:08.007439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d96ae-b6d0-43cc-9f7a-e3492e3d9ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:08.007739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d96ae-b6d0-43cc-9f7a-e3492e3d9ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:08.008022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d96ae-b6d0-43cc-9f7a-e3492e3d9ffc admin admin] PATH_INFO: `/v3/users/ebc56be93e704a3e9e0985d4796d9500` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:08.012568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d96ae-b6d0-43cc-9f7a-e3492e3d9ffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebc56be93e704a3e9e0985d4796d9500)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:08.014590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d96ae-b6d0-43cc-9f7a-e3492e3d9ffc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:08.131500 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4034/8174] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:07 2022] DELETE /identity/v3/users/d46b69e2b61146dba69bfa2d76b77529 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:08.237316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-592d96ae-b6d0-43cc-9f7a-e3492e3d9ffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebc56be93e704a3e9e0985d4796d9500'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:08.252143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-592d96ae-b6d0-43cc-9f7a-e3492e3d9ffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebc56be93e704a3e9e0985d4796d9500'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:08.260827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-592d96ae-b6d0-43cc-9f7a-e3492e3d9ffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebc56be93e704a3e9e0985d4796d9500'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:08.261589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-592d96ae-b6d0-43cc-9f7a-e3492e3d9ffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebc56be93e704a3e9e0985d4796d9500'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:08.315808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72c692-8cbb-400c-87e5-811157504189 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:08.317883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0d72c692-8cbb-400c-87e5-811157504189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:08.343682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-592d96ae-b6d0-43cc-9f7a-e3492e3d9ffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebc56be93e704a3e9e0985d4796d9500'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:08.353937 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4141/8175] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:07 2022] DELETE /identity/v3/users/ebc56be93e704a3e9e0985d4796d9500 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:49:08.357744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474b822-8986-4fba-81af-354be131819b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:08.361792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474b822-8986-4fba-81af-354be131819b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:08.365541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474b822-8986-4fba-81af-354be131819b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:08.431274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a474b822-8986-4fba-81af-354be131819b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:08.437698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a474b822-8986-4fba-81af-354be131819b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:08.442962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d72c692-8cbb-400c-87e5-811157504189 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:08.501619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d55a9d-2f8c-42b8-9ec4-722cff7cfb33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:08.503918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d55a9d-2f8c-42b8-9ec4-722cff7cfb33 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:08.503918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d55a9d-2f8c-42b8-9ec4-722cff7cfb33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:08.503918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d55a9d-2f8c-42b8-9ec4-722cff7cfb33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:08.504811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f5d55a9d-2f8c-42b8-9ec4-722cff7cfb33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:08.545231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d55a9d-2f8c-42b8-9ec4-722cff7cfb33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:08.545335 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4142/8176] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:08.545488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d55a9d-2f8c-42b8-9ec4-722cff7cfb33 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:08.550132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474b822-8986-4fba-81af-354be131819b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:08.551918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a474b822-8986-4fba-81af-354be131819b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:08.574218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474b822-8986-4fba-81af-354be131819b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:08.575133 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4035/8177] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:49:08.583821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaba729e-3591-4462-a8c1-d16d98244914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:08.584646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba729e-3591-4462-a8c1-d16d98244914 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:08.585119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba729e-3591-4462-a8c1-d16d98244914 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:08.585836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaba729e-3591-4462-a8c1-d16d98244914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:08.613659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba729e-3591-4462-a8c1-d16d98244914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:08.615392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaba729e-3591-4462-a8c1-d16d98244914 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:08.632077 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4143/8178] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:49:08.813944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3996a-e0ad-41e5-a41b-355c1b682216 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:08.814298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3996a-e0ad-41e5-a41b-355c1b682216 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:08.814551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc3996a-e0ad-41e5-a41b-355c1b682216 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:08.816112 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4036/8179] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:49:08.825807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4b2ec-56c5-460e-979c-9ffabb4663dd None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:08.826124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4b2ec-56c5-460e-979c-9ffabb4663dd None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:08.826412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4b2ec-56c5-460e-979c-9ffabb4663dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:08.908381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0ea4b2ec-56c5-460e-979c-9ffabb4663dd None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:08.908381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0ea4b2ec-56c5-460e-979c-9ffabb4663dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:08.920102 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:09.049962 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4144/8180] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:49:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:09.102242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3996a-e0ad-41e5-a41b-355c1b682216 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:09.104201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cdc3996a-e0ad-41e5-a41b-355c1b682216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:09.139547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc3996a-e0ad-41e5-a41b-355c1b682216 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:09.153573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d93ad4-9edb-4c9e-ad80-1059ae42f77c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:09.154963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d93ad4-9edb-4c9e-ad80-1059ae42f77c service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:09.155252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d93ad4-9edb-4c9e-ad80-1059ae42f77c service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:09.155539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d93ad4-9edb-4c9e-ad80-1059ae42f77c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:09.168347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d93ad4-9edb-4c9e-ad80-1059ae42f77c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:09.171004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d93ad4-9edb-4c9e-ad80-1059ae42f77c service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:09.184698 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4037/8181] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:09.254928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4b2ec-56c5-460e-979c-9ffabb4663dd None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:09.256422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0ea4b2ec-56c5-460e-979c-9ffabb4663dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:09.297113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4b2ec-56c5-460e-979c-9ffabb4663dd None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:09.312749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b829dff5-09f4-40f2-9286-3a386f0440b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:09.313791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829dff5-09f4-40f2-9286-3a386f0440b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:09.313936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829dff5-09f4-40f2-9286-3a386f0440b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:09.314216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b829dff5-09f4-40f2-9286-3a386f0440b2 admin admin] PATH_INFO: `/v3/projects/941a21b8f2634742978702381749f0de` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:09.315460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829dff5-09f4-40f2-9286-3a386f0440b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=941a21b8f2634742978702381749f0de)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:09.317402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b829dff5-09f4-40f2-9286-3a386f0440b2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:09.456188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d93ad4-9edb-4c9e-ad80-1059ae42f77c service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:09.458277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-93d93ad4-9edb-4c9e-ad80-1059ae42f77c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:09.496565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d93ad4-9edb-4c9e-ad80-1059ae42f77c service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:09.510576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe9032-971e-45b1-929a-9b1a447f263d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:09.525025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe9032-971e-45b1-929a-9b1a447f263d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:09.525954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe9032-971e-45b1-929a-9b1a447f263d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:09.526847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe9032-971e-45b1-929a-9b1a447f263d admin admin] PATH_INFO: `/v3/projects/96a7b775cd3348ea816fc0ddc04fbcb9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:09.532690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe9032-971e-45b1-929a-9b1a447f263d admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a7b775cd3348ea816fc0ddc04fbcb9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:09.543067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe9032-971e-45b1-929a-9b1a447f263d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:09.565663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b829dff5-09f4-40f2-9286-3a386f0440b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '941a21b8f2634742978702381749f0de', 'request_id': 'req-b829dff5-09f4-40f2-9286-3a386f0440b2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:09.573241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b829dff5-09f4-40f2-9286-3a386f0440b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '941a21b8f2634742978702381749f0de', 'request_id': 'req-b829dff5-09f4-40f2-9286-3a386f0440b2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:09.581974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b829dff5-09f4-40f2-9286-3a386f0440b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '941a21b8f2634742978702381749f0de', 'request_id': 'req-b829dff5-09f4-40f2-9286-3a386f0440b2'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:09.664781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b829dff5-09f4-40f2-9286-3a386f0440b2 admin admin] The token cache is being invalidate because project 941a21b8f2634742978702381749f0de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:09.665100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b829dff5-09f4-40f2-9286-3a386f0440b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:09.665777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b829dff5-09f4-40f2-9286-3a386f0440b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:09.668659 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4145/8182] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:49:09 2022] DELETE /identity/v3/projects/941a21b8f2634742978702381749f0de => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:09.675083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b61d2a-84b2-484a-bc33-20eea9681495 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:09.675355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b61d2a-84b2-484a-bc33-20eea9681495 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:09.675633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b61d2a-84b2-484a-bc33-20eea9681495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:09.708399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f8fe9032-971e-45b1-929a-9b1a447f263d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a7b775cd3348ea816fc0ddc04fbcb9', 'request_id': 'req-f8fe9032-971e-45b1-929a-9b1a447f263d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:09.710853 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:09.723053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e8b61d2a-84b2-484a-bc33-20eea9681495 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:09.726732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e8b61d2a-84b2-484a-bc33-20eea9681495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:09.776622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f8fe9032-971e-45b1-929a-9b1a447f263d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a7b775cd3348ea816fc0ddc04fbcb9', 'request_id': 'req-f8fe9032-971e-45b1-929a-9b1a447f263d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:09.789854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f8fe9032-971e-45b1-929a-9b1a447f263d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a7b775cd3348ea816fc0ddc04fbcb9', 'request_id': 'req-f8fe9032-971e-45b1-929a-9b1a447f263d'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:09.821785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f8fe9032-971e-45b1-929a-9b1a447f263d admin admin] The token cache is being invalidate because project 96a7b775cd3348ea816fc0ddc04fbcb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:09.822837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f8fe9032-971e-45b1-929a-9b1a447f263d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:09.824359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f8fe9032-971e-45b1-929a-9b1a447f263d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:09.828184 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4038/8183] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:49:09 2022] DELETE /identity/v3/projects/96a7b775cd3348ea816fc0ddc04fbcb9 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:49:09.832126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe9032-971e-45b1-929a-9b1a447f263d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:09.833705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f8fe9032-971e-45b1-929a-9b1a447f263d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:09.865885 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4146/8184] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:09.866901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b61d2a-84b2-484a-bc33-20eea9681495 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:09.868227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e8b61d2a-84b2-484a-bc33-20eea9681495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:09.881459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b61d2a-84b2-484a-bc33-20eea9681495 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:09.887161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ff5c7-21a4-4cd7-992e-304d74e779c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:09.888094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ff5c7-21a4-4cd7-992e-304d74e779c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:09.889437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ff5c7-21a4-4cd7-992e-304d74e779c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:09.889437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144ff5c7-21a4-4cd7-992e-304d74e779c1 admin admin] PATH_INFO: `/v3/users/5af2b7504a4d4a718efe4c639a18dbbb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:09.890180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ff5c7-21a4-4cd7-992e-304d74e779c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5af2b7504a4d4a718efe4c639a18dbbb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:09.893280 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144ff5c7-21a4-4cd7-992e-304d74e779c1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:09.925604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe9032-971e-45b1-929a-9b1a447f263d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:09.929966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1d275-faba-44ae-a853-2bf5b16ff31f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:09.930724 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1d275-faba-44ae-a853-2bf5b16ff31f service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:09.931088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1d275-faba-44ae-a853-2bf5b16ff31f service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:09.931604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1d275-faba-44ae-a853-2bf5b16ff31f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:09.934874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a2d1d275-faba-44ae-a853-2bf5b16ff31f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:10.030270 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:10.079341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1d275-faba-44ae-a853-2bf5b16ff31f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:10.084156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1d275-faba-44ae-a853-2bf5b16ff31f service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:10.143141 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4039/8185] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:10.146046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c455623-b7b8-402d-b68a-373474c4650b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:10.146876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c455623-b7b8-402d-b68a-373474c4650b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:10.147423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c455623-b7b8-402d-b68a-373474c4650b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:10.180867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-144ff5c7-21a4-4cd7-992e-304d74e779c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5af2b7504a4d4a718efe4c639a18dbbb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:10.192190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9c455623-b7b8-402d-b68a-373474c4650b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:10.195573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9c455623-b7b8-402d-b68a-373474c4650b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:10.201115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-144ff5c7-21a4-4cd7-992e-304d74e779c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5af2b7504a4d4a718efe4c639a18dbbb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:10.209095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-144ff5c7-21a4-4cd7-992e-304d74e779c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5af2b7504a4d4a718efe4c639a18dbbb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:10.209794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-144ff5c7-21a4-4cd7-992e-304d74e779c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5af2b7504a4d4a718efe4c639a18dbbb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:10.219399 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4040/8186] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:10.224096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c455623-b7b8-402d-b68a-373474c4650b None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:10.239108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c455623-b7b8-402d-b68a-373474c4650b None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:10.244682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538965b4-af42-4c3d-a1ec-2d49cf165afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:10.245483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538965b4-af42-4c3d-a1ec-2d49cf165afb admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:10.245870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538965b4-af42-4c3d-a1ec-2d49cf165afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:10.246284 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538965b4-af42-4c3d-a1ec-2d49cf165afb admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:10.247260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538965b4-af42-4c3d-a1ec-2d49cf165afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:49:10.247749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538965b4-af42-4c3d-a1ec-2d49cf165afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:10.249455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538965b4-af42-4c3d-a1ec-2d49cf165afb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:10.265090 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4041/8187] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:49:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:49:10.269311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538965b4-af42-4c3d-a1ec-2d49cf165afb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:10.283727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538965b4-af42-4c3d-a1ec-2d49cf165afb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:10.289242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6cb73-aba1-452a-bc4d-b68badee86b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:10.292048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6cb73-aba1-452a-bc4d-b68badee86b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:10.292454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6cb73-aba1-452a-bc4d-b68badee86b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:10.292926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6cb73-aba1-452a-bc4d-b68badee86b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:10.293783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6cb73-aba1-452a-bc4d-b68badee86b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:10.295982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb6cb73-aba1-452a-bc4d-b68badee86b4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:10.309480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-144ff5c7-21a4-4cd7-992e-304d74e779c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5af2b7504a4d4a718efe4c639a18dbbb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:10.317983 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4147/8188] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:09 2022] DELETE /identity/v3/users/5af2b7504a4d4a718efe4c639a18dbbb => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:10.437873 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4042/8189] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:49:10 2022] POST /identity/v3/projects => generated 399 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:49:10.442021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ff5c7-21a4-4cd7-992e-304d74e779c1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:10.443582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-144ff5c7-21a4-4cd7-992e-304d74e779c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:10.570451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144ff5c7-21a4-4cd7-992e-304d74e779c1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:10.644650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293c656-bdd0-4653-8d98-36de6537af56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:10.645870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293c656-bdd0-4653-8d98-36de6537af56 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:10.645870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293c656-bdd0-4653-8d98-36de6537af56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:10.646135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293c656-bdd0-4653-8d98-36de6537af56 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:10.646991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293c656-bdd0-4653-8d98-36de6537af56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:10.649123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293c656-bdd0-4653-8d98-36de6537af56 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:10.871754 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4148/8190] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:49:10 2022] POST /identity/v3/users => generated 300 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:10.875545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6cb73-aba1-452a-bc4d-b68badee86b4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:10.892307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb6cb73-aba1-452a-bc4d-b68badee86b4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:10.910799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e430f08-4da7-40e0-b40f-c5494a0b333b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:10.913898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e430f08-4da7-40e0-b40f-c5494a0b333b admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:10.914239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e430f08-4da7-40e0-b40f-c5494a0b333b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:10.914528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e430f08-4da7-40e0-b40f-c5494a0b333b admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:10.915315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e430f08-4da7-40e0-b40f-c5494a0b333b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:10.919585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e430f08-4da7-40e0-b40f-c5494a0b333b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:10.944459 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4043/8191] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:10.945639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293c656-bdd0-4653-8d98-36de6537af56 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:10.962458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293c656-bdd0-4653-8d98-36de6537af56 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:10.967776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599baf9-70c9-46c9-932c-2d3d2e20bb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:10.968721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599baf9-70c9-46c9-932c-2d3d2e20bb70 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:10.973598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599baf9-70c9-46c9-932c-2d3d2e20bb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:10.973598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599baf9-70c9-46c9-932c-2d3d2e20bb70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:10.973598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599baf9-70c9-46c9-932c-2d3d2e20bb70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:10.975288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599baf9-70c9-46c9-932c-2d3d2e20bb70 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:10.988807 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4149/8192] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:10.993038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e430f08-4da7-40e0-b40f-c5494a0b333b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:11.006251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e430f08-4da7-40e0-b40f-c5494a0b333b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:11.013529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde86f2-554d-427b-b2cc-a7d87771f068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:11.014779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde86f2-554d-427b-b2cc-a7d87771f068 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:11.015424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde86f2-554d-427b-b2cc-a7d87771f068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:11.015810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde86f2-554d-427b-b2cc-a7d87771f068 admin admin] PATH_INFO: `/v3/projects/dcd488fe19f44244977e8479ec79b078/users/6263d212728741beb9a6580fe105ba0b/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:11.039221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde86f2-554d-427b-b2cc-a7d87771f068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcd488fe19f44244977e8479ec79b078, user_id=6263d212728741beb9a6580fe105ba0b, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:11.043143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde86f2-554d-427b-b2cc-a7d87771f068 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:11.156611 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4044/8193] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:10 2022] PUT /identity/v3/projects/dcd488fe19f44244977e8479ec79b078/users/6263d212728741beb9a6580fe105ba0b/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:11.169695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d8598-966b-4afc-8883-4b524f41c8a2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:11.170198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d8598-966b-4afc-8883-4b524f41c8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:11.170616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d8598-966b-4afc-8883-4b524f41c8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:11.273207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-580d8598-966b-4afc-8883-4b524f41c8a2 None None] MFA Rules not processed for user `6263d212728741beb9a6580fe105ba0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:11.274595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-580d8598-966b-4afc-8883-4b524f41c8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:11.312112 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:11.419368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde86f2-554d-427b-b2cc-a7d87771f068 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:11.421331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0bde86f2-554d-427b-b2cc-a7d87771f068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:11.426780 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:11.469929 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4150/8194] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:11.470974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d8598-966b-4afc-8883-4b524f41c8a2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:11.601068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d8598-966b-4afc-8883-4b524f41c8a2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:11.607544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a698b5a-a3f8-4420-a6a7-51bbd48cab8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:11.608237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a698b5a-a3f8-4420-a6a7-51bbd48cab8e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:11.608591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a698b5a-a3f8-4420-a6a7-51bbd48cab8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:11.612888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a698b5a-a3f8-4420-a6a7-51bbd48cab8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:11.612888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a698b5a-a3f8-4420-a6a7-51bbd48cab8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:11.612888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a698b5a-a3f8-4420-a6a7-51bbd48cab8e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:11.613166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde86f2-554d-427b-b2cc-a7d87771f068 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:11.619591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de1fb46-6da7-4442-a79b-f1768f8920d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:11.620745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1fb46-6da7-4442-a79b-f1768f8920d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:11.621287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1fb46-6da7-4442-a79b-f1768f8920d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:11.621714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de1fb46-6da7-4442-a79b-f1768f8920d3 admin admin] PATH_INFO: `/v3/projects/f1d14a0089c8469699cdefbb2610be11` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:11.623793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1fb46-6da7-4442-a79b-f1768f8920d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1d14a0089c8469699cdefbb2610be11)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:11.627019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de1fb46-6da7-4442-a79b-f1768f8920d3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:11.743119 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4151/8195] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:49:11 2022] POST /identity/v3/projects => generated 401 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:49:11.748300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a698b5a-a3f8-4420-a6a7-51bbd48cab8e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:11.835414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5de1fb46-6da7-4442-a79b-f1768f8920d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1d14a0089c8469699cdefbb2610be11', 'request_id': 'req-5de1fb46-6da7-4442-a79b-f1768f8920d3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:11.863388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a698b5a-a3f8-4420-a6a7-51bbd48cab8e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:11.941066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5de1fb46-6da7-4442-a79b-f1768f8920d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1d14a0089c8469699cdefbb2610be11', 'request_id': 'req-5de1fb46-6da7-4442-a79b-f1768f8920d3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:11.951136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5de1fb46-6da7-4442-a79b-f1768f8920d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1d14a0089c8469699cdefbb2610be11', 'request_id': 'req-5de1fb46-6da7-4442-a79b-f1768f8920d3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:11.962617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b65c41-1b39-44ad-9ac8-fe044423bda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:11.965153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b65c41-1b39-44ad-9ac8-fe044423bda1 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:11.965815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b65c41-1b39-44ad-9ac8-fe044423bda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:11.967508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b65c41-1b39-44ad-9ac8-fe044423bda1 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:11.969512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b65c41-1b39-44ad-9ac8-fe044423bda1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:11.972714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b65c41-1b39-44ad-9ac8-fe044423bda1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:11.973965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5de1fb46-6da7-4442-a79b-f1768f8920d3 admin admin] The token cache is being invalidate because project f1d14a0089c8469699cdefbb2610be11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:11.974645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5de1fb46-6da7-4442-a79b-f1768f8920d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:11.975716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5de1fb46-6da7-4442-a79b-f1768f8920d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:11.978082 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4045/8196] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:49:11 2022] DELETE /identity/v3/projects/f1d14a0089c8469699cdefbb2610be11 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:11.983320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ed83b-d4ac-467c-9f2a-cbe05d936789 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:11.983793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ed83b-d4ac-467c-9f2a-cbe05d936789 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:11.984217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ed83b-d4ac-467c-9f2a-cbe05d936789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:12.006691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-295ed83b-d4ac-467c-9f2a-cbe05d936789 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:12.008005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-295ed83b-d4ac-467c-9f2a-cbe05d936789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:12.018151 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4046/8197] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:12.033650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa62eb3-be1f-4288-847c-4a79d595e1ff None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:12.034222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa62eb3-be1f-4288-847c-4a79d595e1ff None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:12.034654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa62eb3-be1f-4288-847c-4a79d595e1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:12.058268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3aa62eb3-be1f-4288-847c-4a79d595e1ff None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:12.059638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3aa62eb3-be1f-4288-847c-4a79d595e1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:12.075689 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4047/8198] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:12.077272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa62eb3-be1f-4288-847c-4a79d595e1ff None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:12.089930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa62eb3-be1f-4288-847c-4a79d595e1ff None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:12.098400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65352215-5fe9-4fd4-80a3-6fa50e758e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:12.099296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65352215-5fe9-4fd4-80a3-6fa50e758e80 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:12.099688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65352215-5fe9-4fd4-80a3-6fa50e758e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:12.100084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65352215-5fe9-4fd4-80a3-6fa50e758e80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:12.101049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65352215-5fe9-4fd4-80a3-6fa50e758e80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:49:12.101481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65352215-5fe9-4fd4-80a3-6fa50e758e80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:12.103265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65352215-5fe9-4fd4-80a3-6fa50e758e80 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:12.116906 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4152/8199] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:49:11 2022] POST /identity/v3/users => generated 307 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:49:12.118364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b65c41-1b39-44ad-9ac8-fe044423bda1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:12.125505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b9b65c41-1b39-44ad-9ac8-fe044423bda1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:12.140880 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4048/8200] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:49:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:49:12.145070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65352215-5fe9-4fd4-80a3-6fa50e758e80 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:12.168932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65352215-5fe9-4fd4-80a3-6fa50e758e80 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:12.173651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b65c41-1b39-44ad-9ac8-fe044423bda1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:12.176805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ad213-df51-498c-bf2a-d132ee59aa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:12.177678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ad213-df51-498c-bf2a-d132ee59aa98 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:12.178444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ad213-df51-498c-bf2a-d132ee59aa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:12.179369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ad213-df51-498c-bf2a-d132ee59aa98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:12.179696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ad213-df51-498c-bf2a-d132ee59aa98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:12.182729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ad213-df51-498c-bf2a-d132ee59aa98 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:12.194398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6154516-c730-4872-89bb-9148e492f348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:12.195144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6154516-c730-4872-89bb-9148e492f348 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:12.195439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6154516-c730-4872-89bb-9148e492f348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:12.195720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6154516-c730-4872-89bb-9148e492f348 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:12.196463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6154516-c730-4872-89bb-9148e492f348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:12.200316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6154516-c730-4872-89bb-9148e492f348 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:12.225101 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4153/8201] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:12.229015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6154516-c730-4872-89bb-9148e492f348 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:12.245537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6154516-c730-4872-89bb-9148e492f348 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:12.251817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f954e-25d4-4ccd-a7c7-c8becc4c12cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:12.252728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f954e-25d4-4ccd-a7c7-c8becc4c12cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:12.253245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f954e-25d4-4ccd-a7c7-c8becc4c12cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:12.253541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3f954e-25d4-4ccd-a7c7-c8becc4c12cd admin admin] PATH_INFO: `/v3/projects/d69ae958fcc64ad39669d8943d431a5e/users/1fa60c329461478c9be369b14efeed97/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:12.274253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f954e-25d4-4ccd-a7c7-c8becc4c12cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d69ae958fcc64ad39669d8943d431a5e, user_id=1fa60c329461478c9be369b14efeed97, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:12.277124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3f954e-25d4-4ccd-a7c7-c8becc4c12cd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:12.317841 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4049/8202] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:49:12 2022] POST /identity/v3/projects => generated 391 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:49:12.320304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ad213-df51-498c-bf2a-d132ee59aa98 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:12.387855 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4154/8203] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:12 2022] PUT /identity/v3/projects/d69ae958fcc64ad39669d8943d431a5e/users/1fa60c329461478c9be369b14efeed97/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:49:12.392565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f954e-25d4-4ccd-a7c7-c8becc4c12cd admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:12.491098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ad213-df51-498c-bf2a-d132ee59aa98 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:12.506552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a87d37-210c-4c6e-82aa-c3c1a6d3f174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:12.508796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a87d37-210c-4c6e-82aa-c3c1a6d3f174 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:12.511153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a87d37-210c-4c6e-82aa-c3c1a6d3f174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:12.511153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a87d37-210c-4c6e-82aa-c3c1a6d3f174 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:12.511524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a87d37-210c-4c6e-82aa-c3c1a6d3f174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:12.514690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a87d37-210c-4c6e-82aa-c3c1a6d3f174 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:12.518956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3f954e-25d4-4ccd-a7c7-c8becc4c12cd admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:12.527010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520984b-fbde-451e-961d-303d8e9a2e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:12.527794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520984b-fbde-451e-961d-303d8e9a2e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:12.528158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520984b-fbde-451e-961d-303d8e9a2e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:12.528508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520984b-fbde-451e-961d-303d8e9a2e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:12.529341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520984b-fbde-451e-961d-303d8e9a2e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:12.531445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520984b-fbde-451e-961d-303d8e9a2e3b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:12.554426 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:12.571237 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4155/8204] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:49:12.573715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520984b-fbde-451e-961d-303d8e9a2e3b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:12.594447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520984b-fbde-451e-961d-303d8e9a2e3b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:12.601519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbc060f-df01-464e-bdd3-bdd477f82a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:12.603099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc060f-df01-464e-bdd3-bdd477f82a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:12.603267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc060f-df01-464e-bdd3-bdd477f82a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:12.603633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbc060f-df01-464e-bdd3-bdd477f82a3b admin admin] PATH_INFO: `/v3/projects/d69ae958fcc64ad39669d8943d431a5e/users/1fa60c329461478c9be369b14efeed97/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:12.606449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc060f-df01-464e-bdd3-bdd477f82a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d69ae958fcc64ad39669d8943d431a5e, user_id=1fa60c329461478c9be369b14efeed97, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:12.610081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbc060f-df01-464e-bdd3-bdd477f82a3b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:12.630233 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4156/8205] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:12 2022] PUT /identity/v3/projects/d69ae958fcc64ad39669d8943d431a5e/users/1fa60c329461478c9be369b14efeed97/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:12.651409 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4050/8206] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:49:12 2022] POST /identity/v3/users => generated 296 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:49:12.652917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d544ef7-c965-4bac-a0e2-653ec26b79df None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:12.655720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a87d37-210c-4c6e-82aa-c3c1a6d3f174 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:12.656349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d544ef7-c965-4bac-a0e2-653ec26b79df None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:12.656738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d544ef7-c965-4bac-a0e2-653ec26b79df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:12.672162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a87d37-210c-4c6e-82aa-c3c1a6d3f174 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:12.674596 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:12.724245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5d544ef7-c965-4bac-a0e2-653ec26b79df None None] MFA Rules not processed for user `1fa60c329461478c9be369b14efeed97`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:12.725491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5d544ef7-c965-4bac-a0e2-653ec26b79df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:12.822995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce963d-dc17-4a4f-8b6b-657ccbac0324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:12.826753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce963d-dc17-4a4f-8b6b-657ccbac0324 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:12.827607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce963d-dc17-4a4f-8b6b-657ccbac0324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:12.829410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce963d-dc17-4a4f-8b6b-657ccbac0324 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:12.830366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce963d-dc17-4a4f-8b6b-657ccbac0324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:12.848074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce963d-dc17-4a4f-8b6b-657ccbac0324 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:12.903514 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4051/8207] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:12.907938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce963d-dc17-4a4f-8b6b-657ccbac0324 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:12.920895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce963d-dc17-4a4f-8b6b-657ccbac0324 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:12.927300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e82483-b806-4706-a6f4-869d243f2c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:12.928095 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e82483-b806-4706-a6f4-869d243f2c7f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:12.928461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e82483-b806-4706-a6f4-869d243f2c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:12.928815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e82483-b806-4706-a6f4-869d243f2c7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:12.929678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e82483-b806-4706-a6f4-869d243f2c7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:12.931932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e82483-b806-4706-a6f4-869d243f2c7f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:12.947490 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4157/8208] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:12 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:12.960604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d544ef7-c965-4bac-a0e2-653ec26b79df None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:12.965098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5d544ef7-c965-4bac-a0e2-653ec26b79df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:12.976644 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4052/8209] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:12.981347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e82483-b806-4706-a6f4-869d243f2c7f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:13.017375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e82483-b806-4706-a6f4-869d243f2c7f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:13.035805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625233b5-a2e3-44c8-9e36-9c21dcb1b288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:13.037435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625233b5-a2e3-44c8-9e36-9c21dcb1b288 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:13.038507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625233b5-a2e3-44c8-9e36-9c21dcb1b288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:13.043307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625233b5-a2e3-44c8-9e36-9c21dcb1b288 admin admin] PATH_INFO: `/v3/projects/750998afbee94741a62a5528cd1ba498/users/9390d01a0f454568938ffcfb5ab2c0dc/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:13.051157 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:13.088086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625233b5-a2e3-44c8-9e36-9c21dcb1b288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=750998afbee94741a62a5528cd1ba498, user_id=9390d01a0f454568938ffcfb5ab2c0dc, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:13.097541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625233b5-a2e3-44c8-9e36-9c21dcb1b288 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:13.111899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d544ef7-c965-4bac-a0e2-653ec26b79df None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:13.116214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff3d011-b051-47e5-b731-f611f4f31fa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:13.116940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3d011-b051-47e5-b731-f611f4f31fa1 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:13.117327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3d011-b051-47e5-b731-f611f4f31fa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:13.118820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff3d011-b051-47e5-b731-f611f4f31fa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:13.143889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3d011-b051-47e5-b731-f611f4f31fa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:13.149566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff3d011-b051-47e5-b731-f611f4f31fa1 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:13.174259 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4158/8210] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:12 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:49:13.219384 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4053/8211] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:12 2022] PUT /identity/v3/projects/750998afbee94741a62a5528cd1ba498/users/9390d01a0f454568938ffcfb5ab2c0dc/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:13.230877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf894d3-fe1a-4a2a-aab2-6f45a3d39c77 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:13.231173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf894d3-fe1a-4a2a-aab2-6f45a3d39c77 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:13.231456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf894d3-fe1a-4a2a-aab2-6f45a3d39c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:13.269128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0cf894d3-fe1a-4a2a-aab2-6f45a3d39c77 None None] MFA Rules not processed for user `9390d01a0f454568938ffcfb5ab2c0dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:13.270619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0cf894d3-fe1a-4a2a-aab2-6f45a3d39c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:13.360534 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4159/8212] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:13.365306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625233b5-a2e3-44c8-9e36-9c21dcb1b288 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:13.467564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf894d3-fe1a-4a2a-aab2-6f45a3d39c77 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:13.486868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625233b5-a2e3-44c8-9e36-9c21dcb1b288 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:13.501539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a895ae5-5a42-472c-bb7b-3a71203799b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:13.504161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a895ae5-5a42-472c-bb7b-3a71203799b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:13.504507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a895ae5-5a42-472c-bb7b-3a71203799b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:13.504798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a895ae5-5a42-472c-bb7b-3a71203799b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:13.505632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a895ae5-5a42-472c-bb7b-3a71203799b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:13.512120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a895ae5-5a42-472c-bb7b-3a71203799b4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:13.558629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf894d3-fe1a-4a2a-aab2-6f45a3d39c77 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:13.563281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0dcc9-daa9-4ca5-8bf9-c98b44de3210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:13.564012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0dcc9-daa9-4ca5-8bf9-c98b44de3210 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:13.564370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0dcc9-daa9-4ca5-8bf9-c98b44de3210 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:13.564769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b0dcc9-daa9-4ca5-8bf9-c98b44de3210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:13.566839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b3b0dcc9-daa9-4ca5-8bf9-c98b44de3210 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:13.647600 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4054/8213] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:49:13 2022] POST /identity/v3/projects => generated 393 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:49:13.650697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a895ae5-5a42-472c-bb7b-3a71203799b4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:13.665823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0dcc9-daa9-4ca5-8bf9-c98b44de3210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:13.667959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b0dcc9-daa9-4ca5-8bf9-c98b44de3210 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:13.679550 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4160/8214] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:13.731747 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:13.732370 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:13.829340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a895ae5-5a42-472c-bb7b-3a71203799b4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:13.847701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842af4e0-025c-410d-b0ae-b091f80851c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:13.849659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842af4e0-025c-410d-b0ae-b091f80851c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:13.853860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842af4e0-025c-410d-b0ae-b091f80851c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:13.854453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842af4e0-025c-410d-b0ae-b091f80851c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:13.855296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842af4e0-025c-410d-b0ae-b091f80851c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:13.860460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842af4e0-025c-410d-b0ae-b091f80851c0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:13.974881 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4055/8215] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:49:13 2022] POST /identity/v3/users => generated 303 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:13.975973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0dcc9-daa9-4ca5-8bf9-c98b44de3210 service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:13.992351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b0dcc9-daa9-4ca5-8bf9-c98b44de3210 service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:14.010415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9e7d7-2ba9-414e-bacd-3e94cad03c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:14.011136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9e7d7-2ba9-414e-bacd-3e94cad03c0b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:14.012257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9e7d7-2ba9-414e-bacd-3e94cad03c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:14.012598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9e7d7-2ba9-414e-bacd-3e94cad03c0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:14.013357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9e7d7-2ba9-414e-bacd-3e94cad03c0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:14.015488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9e7d7-2ba9-414e-bacd-3e94cad03c0b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:14.030532 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4161/8216] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:14.036136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842af4e0-025c-410d-b0ae-b091f80851c0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:14.049502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842af4e0-025c-410d-b0ae-b091f80851c0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:14.057488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb394814-0fa0-4439-8016-68828a3dd6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:14.058570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb394814-0fa0-4439-8016-68828a3dd6b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:14.058855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb394814-0fa0-4439-8016-68828a3dd6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:14.059262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb394814-0fa0-4439-8016-68828a3dd6b2 admin admin] PATH_INFO: `/v3/projects/c562426d02dd4c6c87363d92d9c52bf6/users/d0dc4d07aea84defa29518797831c1b1/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:14.092963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb394814-0fa0-4439-8016-68828a3dd6b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c562426d02dd4c6c87363d92d9c52bf6, user_id=d0dc4d07aea84defa29518797831c1b1, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:14.102600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb394814-0fa0-4439-8016-68828a3dd6b2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:14.211242 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4056/8217] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:14 2022] PUT /identity/v3/projects/c562426d02dd4c6c87363d92d9c52bf6/users/d0dc4d07aea84defa29518797831c1b1/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:49:14.215812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9e7d7-2ba9-414e-bacd-3e94cad03c0b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:14.252749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9e7d7-2ba9-414e-bacd-3e94cad03c0b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:14.370028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f2b2d-f3a7-40f9-aaca-a7fe06810775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:14.371243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f2b2d-f3a7-40f9-aaca-a7fe06810775 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:14.371633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f2b2d-f3a7-40f9-aaca-a7fe06810775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:14.372019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f2b2d-f3a7-40f9-aaca-a7fe06810775 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:14.373160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f2b2d-f3a7-40f9-aaca-a7fe06810775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:14.375075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f2b2d-f3a7-40f9-aaca-a7fe06810775 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:14.391702 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4162/8218] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:14.395667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb394814-0fa0-4439-8016-68828a3dd6b2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:14.417004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb394814-0fa0-4439-8016-68828a3dd6b2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:14.420997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652329f-631f-4a8b-909e-ce80fa194217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:14.422180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652329f-631f-4a8b-909e-ce80fa194217 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:14.422491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652329f-631f-4a8b-909e-ce80fa194217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:14.422779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652329f-631f-4a8b-909e-ce80fa194217 admin admin] PATH_INFO: `/v3/projects/c562426d02dd4c6c87363d92d9c52bf6/users/d0dc4d07aea84defa29518797831c1b1/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:14.424982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652329f-631f-4a8b-909e-ce80fa194217 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c562426d02dd4c6c87363d92d9c52bf6, user_id=d0dc4d07aea84defa29518797831c1b1, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:14.428098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652329f-631f-4a8b-909e-ce80fa194217 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:14.452310 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4057/8219] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:14 2022] PUT /identity/v3/projects/c562426d02dd4c6c87363d92d9c52bf6/users/d0dc4d07aea84defa29518797831c1b1/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:14.454268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97cd06-d35a-4785-a16c-6b4be12d2fd8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:14.454572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97cd06-d35a-4785-a16c-6b4be12d2fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:14.454862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b97cd06-d35a-4785-a16c-6b4be12d2fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:14.495281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3b97cd06-d35a-4785-a16c-6b4be12d2fd8 None None] MFA Rules not processed for user `d0dc4d07aea84defa29518797831c1b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:14.496703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3b97cd06-d35a-4785-a16c-6b4be12d2fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:14.586954 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4163/8220] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:14 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:14.604157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652329f-631f-4a8b-909e-ce80fa194217 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:14.607761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4652329f-631f-4a8b-909e-ce80fa194217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:14.818194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652329f-631f-4a8b-909e-ce80fa194217 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:14.820380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5930c-af2b-40eb-a65a-4a550e185005 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:14.821425 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5930c-af2b-40eb-a65a-4a550e185005 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:14.822367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5930c-af2b-40eb-a65a-4a550e185005 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:14.822730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5930c-af2b-40eb-a65a-4a550e185005 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:14.838442 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5930c-af2b-40eb-a65a-4a550e185005 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:14.842035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5930c-af2b-40eb-a65a-4a550e185005 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:14.857267 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4058/8221] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:14 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:14.937229 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97cd06-d35a-4785-a16c-6b4be12d2fd8 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:14.950649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b97cd06-d35a-4785-a16c-6b4be12d2fd8 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:14.954519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15891d40-0db1-475b-82d3-fb0fb5999764 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:14.955180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15891d40-0db1-475b-82d3-fb0fb5999764 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:14.955474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15891d40-0db1-475b-82d3-fb0fb5999764 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:14.955758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15891d40-0db1-475b-82d3-fb0fb5999764 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:15.090489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15891d40-0db1-475b-82d3-fb0fb5999764 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:15.090489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15891d40-0db1-475b-82d3-fb0fb5999764 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:15.110959 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4164/8222] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:15.346019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0a962-cd69-4d6c-8563-14f2a45f644e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:15.346494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0a962-cd69-4d6c-8563-14f2a45f644e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:15.346684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f0a962-cd69-4d6c-8563-14f2a45f644e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:15.450457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-67f0a962-cd69-4d6c-8563-14f2a45f644e None None] MFA Rules not processed for user `f933a71a6d5d45db993a430166f49c95`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:15.451809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-67f0a962-cd69-4d6c-8563-14f2a45f644e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:15.612511 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4059/8223] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:22.357572 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15891d40-0db1-475b-82d3-fb0fb5999764 service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:22.360272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-15891d40-0db1-475b-82d3-fb0fb5999764 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:22.363901 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:22.490457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15891d40-0db1-475b-82d3-fb0fb5999764 service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:22.495309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e8eab-7cb1-491e-a5ff-85eba2430d28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:22.496477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e8eab-7cb1-491e-a5ff-85eba2430d28 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:22.497708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e8eab-7cb1-491e-a5ff-85eba2430d28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:22.497931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e8eab-7cb1-491e-a5ff-85eba2430d28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:22.500167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c49e8eab-7cb1-491e-a5ff-85eba2430d28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:22.517652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e8eab-7cb1-491e-a5ff-85eba2430d28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:22.519287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e8eab-7cb1-491e-a5ff-85eba2430d28 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:22.551197 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4165/8224] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:25.565412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0a962-cd69-4d6c-8563-14f2a45f644e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:25.589921 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:25.596673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e8eab-7cb1-491e-a5ff-85eba2430d28 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:25.711640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e8eab-7cb1-491e-a5ff-85eba2430d28 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:25.719548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9506c68b-4e12-4593-bc16-7a15a6552457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:25.719720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f0a962-cd69-4d6c-8563-14f2a45f644e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:25.720685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506c68b-4e12-4593-bc16-7a15a6552457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:25.721077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506c68b-4e12-4593-bc16-7a15a6552457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:25.721514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9506c68b-4e12-4593-bc16-7a15a6552457 admin admin] PATH_INFO: `/v3/users/6263d212728741beb9a6580fe105ba0b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:25.723820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506c68b-4e12-4593-bc16-7a15a6552457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6263d212728741beb9a6580fe105ba0b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:25.727837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9506c68b-4e12-4593-bc16-7a15a6552457 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:25.728659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8805ade5-a11b-40fa-a881-611a90835d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:25.729678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805ade5-a11b-40fa-a881-611a90835d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:25.734450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805ade5-a11b-40fa-a881-611a90835d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:25.734855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8805ade5-a11b-40fa-a881-611a90835d4b admin admin] PATH_INFO: `/v3/users/9390d01a0f454568938ffcfb5ab2c0dc` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:25.737456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805ade5-a11b-40fa-a881-611a90835d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9390d01a0f454568938ffcfb5ab2c0dc)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:25.741780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8805ade5-a11b-40fa-a881-611a90835d4b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:26.023422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8805ade5-a11b-40fa-a881-611a90835d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9390d01a0f454568938ffcfb5ab2c0dc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:26.036039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9506c68b-4e12-4593-bc16-7a15a6552457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6263d212728741beb9a6580fe105ba0b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:26.045147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8805ade5-a11b-40fa-a881-611a90835d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9390d01a0f454568938ffcfb5ab2c0dc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:26.046071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8805ade5-a11b-40fa-a881-611a90835d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9390d01a0f454568938ffcfb5ab2c0dc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:26.046765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8805ade5-a11b-40fa-a881-611a90835d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9390d01a0f454568938ffcfb5ab2c0dc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:26.050847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9506c68b-4e12-4593-bc16-7a15a6552457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6263d212728741beb9a6580fe105ba0b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:26.060748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-8805ade5-a11b-40fa-a881-611a90835d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9390d01a0f454568938ffcfb5ab2c0dc'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:26.065701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9506c68b-4e12-4593-bc16-7a15a6552457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6263d212728741beb9a6580fe105ba0b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:26.069129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9506c68b-4e12-4593-bc16-7a15a6552457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6263d212728741beb9a6580fe105ba0b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:26.193717 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4060/8225] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:25 2022] DELETE /identity/v3/users/9390d01a0f454568938ffcfb5ab2c0dc => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:26.198837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d68ff5-2907-4659-becf-a83a25d5a1fb None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:26.199202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d68ff5-2907-4659-becf-a83a25d5a1fb None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:26.200059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d68ff5-2907-4659-becf-a83a25d5a1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:26.223406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-34d68ff5-2907-4659-becf-a83a25d5a1fb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:26.223406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-34d68ff5-2907-4659-becf-a83a25d5a1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:26.237358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9506c68b-4e12-4593-bc16-7a15a6552457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6263d212728741beb9a6580fe105ba0b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:26.255169 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4166/8226] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:25 2022] DELETE /identity/v3/users/6263d212728741beb9a6580fe105ba0b => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:26.257003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9c41d-7bf5-429b-bf97-0b8ced41ea9d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:26.257330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9c41d-7bf5-429b-bf97-0b8ced41ea9d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:26.257577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe9c41d-7bf5-429b-bf97-0b8ced41ea9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:26.281499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0fe9c41d-7bf5-429b-bf97-0b8ced41ea9d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:26.283400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0fe9c41d-7bf5-429b-bf97-0b8ced41ea9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:26.286440 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4061/8227] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:49:26.287598 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:26.298166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d68ff5-2907-4659-becf-a83a25d5a1fb None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:26.299600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-34d68ff5-2907-4659-becf-a83a25d5a1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:26.350130 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:26.365703 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4167/8228] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:26.376348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9c41d-7bf5-429b-bf97-0b8ced41ea9d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:26.378376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0fe9c41d-7bf5-429b-bf97-0b8ced41ea9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:26.378490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d68ff5-2907-4659-becf-a83a25d5a1fb None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:26.452394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f5887-3033-4d28-9e26-19616a1c2f7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:26.452951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f5887-3033-4d28-9e26-19616a1c2f7b service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:26.453552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f5887-3033-4d28-9e26-19616a1c2f7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:26.453827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f5887-3033-4d28-9e26-19616a1c2f7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:26.454634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe9c41d-7bf5-429b-bf97-0b8ced41ea9d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:26.463399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7b302-9fd8-4182-8263-b8f80839c38e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:26.463399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7b302-9fd8-4182-8263-b8f80839c38e service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:26.463399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7b302-9fd8-4182-8263-b8f80839c38e service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:26.463399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7b302-9fd8-4182-8263-b8f80839c38e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:26.469891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f5887-3033-4d28-9e26-19616a1c2f7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:26.469891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f5887-3033-4d28-9e26-19616a1c2f7b service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:26.480563 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4062/8229] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:26.502324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7b302-9fd8-4182-8263-b8f80839c38e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:26.504239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7b302-9fd8-4182-8263-b8f80839c38e service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:26.516652 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4168/8230] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:49:27.213142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f5887-3033-4d28-9e26-19616a1c2f7b service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:27.214743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e24f5887-3033-4d28-9e26-19616a1c2f7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:27.234892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f5887-3033-4d28-9e26-19616a1c2f7b service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:27.267130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a485912-937d-4c52-834b-4007fd0bab0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:27.268336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a485912-937d-4c52-834b-4007fd0bab0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:27.268868 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a485912-937d-4c52-834b-4007fd0bab0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:27.269700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a485912-937d-4c52-834b-4007fd0bab0a admin admin] PATH_INFO: `/v3/projects/dcd488fe19f44244977e8479ec79b078` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:27.273115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a485912-937d-4c52-834b-4007fd0bab0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcd488fe19f44244977e8479ec79b078)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:27.277788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a485912-937d-4c52-834b-4007fd0bab0a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:27.563322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5a485912-937d-4c52-834b-4007fd0bab0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcd488fe19f44244977e8479ec79b078', 'request_id': 'req-5a485912-937d-4c52-834b-4007fd0bab0a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:28.044938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5a485912-937d-4c52-834b-4007fd0bab0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcd488fe19f44244977e8479ec79b078', 'request_id': 'req-5a485912-937d-4c52-834b-4007fd0bab0a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:28.051749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7b302-9fd8-4182-8263-b8f80839c38e service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:28.054697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5a485912-937d-4c52-834b-4007fd0bab0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcd488fe19f44244977e8479ec79b078', 'request_id': 'req-5a485912-937d-4c52-834b-4007fd0bab0a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:28.055207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-26a7b302-9fd8-4182-8263-b8f80839c38e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:28.069447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5a485912-937d-4c52-834b-4007fd0bab0a admin admin] The token cache is being invalidate because project dcd488fe19f44244977e8479ec79b078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:28.069749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5a485912-937d-4c52-834b-4007fd0bab0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:28.070455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5a485912-937d-4c52-834b-4007fd0bab0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:28.072208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7b302-9fd8-4182-8263-b8f80839c38e service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:28.076528 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4063/8231] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:49:27 2022] DELETE /identity/v3/projects/dcd488fe19f44244977e8479ec79b078 => generated 0 bytes in 861 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:28.077458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a485912-937d-4c52-834b-4007fd0bab0a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:28.079004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5a485912-937d-4c52-834b-4007fd0bab0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:28.179257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6848999-3ab8-4d06-aefe-23598d7bcf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:28.181397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6848999-3ab8-4d06-aefe-23598d7bcf48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:28.181716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6848999-3ab8-4d06-aefe-23598d7bcf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:28.182240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6848999-3ab8-4d06-aefe-23598d7bcf48 admin admin] PATH_INFO: `/v3/projects/750998afbee94741a62a5528cd1ba498` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:28.187923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6848999-3ab8-4d06-aefe-23598d7bcf48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=750998afbee94741a62a5528cd1ba498)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:28.189835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6848999-3ab8-4d06-aefe-23598d7bcf48 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:28.203490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a485912-937d-4c52-834b-4007fd0bab0a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:28.248803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc05bcd-afc9-46d0-b1cc-09740800a475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:28.250029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc05bcd-afc9-46d0-b1cc-09740800a475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:28.250598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc05bcd-afc9-46d0-b1cc-09740800a475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:28.251109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc05bcd-afc9-46d0-b1cc-09740800a475 admin admin] PATH_INFO: `/v3/users/1fa60c329461478c9be369b14efeed97` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:28.252948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc05bcd-afc9-46d0-b1cc-09740800a475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa60c329461478c9be369b14efeed97)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:28.255300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc05bcd-afc9-46d0-b1cc-09740800a475 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:28.276997 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:28.349721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b6848999-3ab8-4d06-aefe-23598d7bcf48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '750998afbee94741a62a5528cd1ba498', 'request_id': 'req-b6848999-3ab8-4d06-aefe-23598d7bcf48'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:28.355506 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:28.373057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b6848999-3ab8-4d06-aefe-23598d7bcf48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '750998afbee94741a62a5528cd1ba498', 'request_id': 'req-b6848999-3ab8-4d06-aefe-23598d7bcf48'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:28.382378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b6848999-3ab8-4d06-aefe-23598d7bcf48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '750998afbee94741a62a5528cd1ba498', 'request_id': 'req-b6848999-3ab8-4d06-aefe-23598d7bcf48'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:28.474527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b6848999-3ab8-4d06-aefe-23598d7bcf48 admin admin] The token cache is being invalidate because project 750998afbee94741a62a5528cd1ba498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:28.474821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b6848999-3ab8-4d06-aefe-23598d7bcf48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:28.475724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b6848999-3ab8-4d06-aefe-23598d7bcf48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:28.481335 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4169/8232] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:49:28 2022] DELETE /identity/v3/projects/750998afbee94741a62a5528cd1ba498 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:28.482441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6848999-3ab8-4d06-aefe-23598d7bcf48 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:28.484017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b6848999-3ab8-4d06-aefe-23598d7bcf48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:28.503125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5cc05bcd-afc9-46d0-b1cc-09740800a475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa60c329461478c9be369b14efeed97'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:28.532652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5cc05bcd-afc9-46d0-b1cc-09740800a475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa60c329461478c9be369b14efeed97'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:28.533781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5cc05bcd-afc9-46d0-b1cc-09740800a475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa60c329461478c9be369b14efeed97'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:28.534616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5cc05bcd-afc9-46d0-b1cc-09740800a475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa60c329461478c9be369b14efeed97'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:28.548553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-5cc05bcd-afc9-46d0-b1cc-09740800a475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa60c329461478c9be369b14efeed97'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:28.596287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6848999-3ab8-4d06-aefe-23598d7bcf48 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:28.604056 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4a4cb-ac41-4bac-b9df-062ba8b0c308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:28.605989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4a4cb-ac41-4bac-b9df-062ba8b0c308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:28.606666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4a4cb-ac41-4bac-b9df-062ba8b0c308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:28.607143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a4a4cb-ac41-4bac-b9df-062ba8b0c308 admin admin] PATH_INFO: `/v3/users/d0dc4d07aea84defa29518797831c1b1` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:28.608727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4a4cb-ac41-4bac-b9df-062ba8b0c308 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0dc4d07aea84defa29518797831c1b1)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:28.610773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a4a4cb-ac41-4bac-b9df-062ba8b0c308 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:28.640487 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4064/8233] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:28 2022] DELETE /identity/v3/users/1fa60c329461478c9be369b14efeed97 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:28.840435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-27a4a4cb-ac41-4bac-b9df-062ba8b0c308 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0dc4d07aea84defa29518797831c1b1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:28.858595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-27a4a4cb-ac41-4bac-b9df-062ba8b0c308 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0dc4d07aea84defa29518797831c1b1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:28.880898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-27a4a4cb-ac41-4bac-b9df-062ba8b0c308 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0dc4d07aea84defa29518797831c1b1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:28.882291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-27a4a4cb-ac41-4bac-b9df-062ba8b0c308 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0dc4d07aea84defa29518797831c1b1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:28.986614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-27a4a4cb-ac41-4bac-b9df-062ba8b0c308 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0dc4d07aea84defa29518797831c1b1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:28.995053 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4170/8234] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:28 2022] DELETE /identity/v3/users/d0dc4d07aea84defa29518797831c1b1 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:29.663704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc05bcd-afc9-46d0-b1cc-09740800a475 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:29.667528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5cc05bcd-afc9-46d0-b1cc-09740800a475 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:29.698590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4a4cb-ac41-4bac-b9df-062ba8b0c308 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:29.700206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-27a4a4cb-ac41-4bac-b9df-062ba8b0c308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:29.827616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc05bcd-afc9-46d0-b1cc-09740800a475 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:29.833599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc83baf-c1fa-4da1-b8de-676de368f469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:29.834527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc83baf-c1fa-4da1-b8de-676de368f469 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:29.834814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc83baf-c1fa-4da1-b8de-676de368f469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:29.835135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc83baf-c1fa-4da1-b8de-676de368f469 admin admin] PATH_INFO: `/v3/projects/c562426d02dd4c6c87363d92d9c52bf6` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:29.838577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc83baf-c1fa-4da1-b8de-676de368f469 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c562426d02dd4c6c87363d92d9c52bf6)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:29.841059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc83baf-c1fa-4da1-b8de-676de368f469 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:29.847754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a4a4cb-ac41-4bac-b9df-062ba8b0c308 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:29.863514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fe3240-be4d-46b6-94c6-2099a4fef849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:29.864794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe3240-be4d-46b6-94c6-2099a4fef849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:29.865088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe3240-be4d-46b6-94c6-2099a4fef849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:29.866061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fe3240-be4d-46b6-94c6-2099a4fef849 admin admin] PATH_INFO: `/v3/projects/d69ae958fcc64ad39669d8943d431a5e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:29.866746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe3240-be4d-46b6-94c6-2099a4fef849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d69ae958fcc64ad39669d8943d431a5e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:29.868974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fe3240-be4d-46b6-94c6-2099a4fef849 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:29.878456 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:30.056237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cbc83baf-c1fa-4da1-b8de-676de368f469 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c562426d02dd4c6c87363d92d9c52bf6', 'request_id': 'req-cbc83baf-c1fa-4da1-b8de-676de368f469'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:30.131714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-69fe3240-be4d-46b6-94c6-2099a4fef849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd69ae958fcc64ad39669d8943d431a5e', 'request_id': 'req-69fe3240-be4d-46b6-94c6-2099a4fef849'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:30.139041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-69fe3240-be4d-46b6-94c6-2099a4fef849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd69ae958fcc64ad39669d8943d431a5e', 'request_id': 'req-69fe3240-be4d-46b6-94c6-2099a4fef849'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:30.154633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cbc83baf-c1fa-4da1-b8de-676de368f469 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c562426d02dd4c6c87363d92d9c52bf6', 'request_id': 'req-cbc83baf-c1fa-4da1-b8de-676de368f469'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:30.155431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-69fe3240-be4d-46b6-94c6-2099a4fef849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd69ae958fcc64ad39669d8943d431a5e', 'request_id': 'req-69fe3240-be4d-46b6-94c6-2099a4fef849'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:30.164630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cbc83baf-c1fa-4da1-b8de-676de368f469 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c562426d02dd4c6c87363d92d9c52bf6', 'request_id': 'req-cbc83baf-c1fa-4da1-b8de-676de368f469'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:30.188368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cbc83baf-c1fa-4da1-b8de-676de368f469 admin admin] The token cache is being invalidate because project c562426d02dd4c6c87363d92d9c52bf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:30.188661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cbc83baf-c1fa-4da1-b8de-676de368f469 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:30.194551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cbc83baf-c1fa-4da1-b8de-676de368f469 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:30.203276 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4065/8235] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:49:29 2022] DELETE /identity/v3/projects/c562426d02dd4c6c87363d92d9c52bf6 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:30.203837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5f787-7caf-4916-81d8-1f7ea2df2604 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:30.204180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5f787-7caf-4916-81d8-1f7ea2df2604 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:30.204457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5f787-7caf-4916-81d8-1f7ea2df2604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:30.268601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-03a5f787-7caf-4916-81d8-1f7ea2df2604 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:30.269833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-03a5f787-7caf-4916-81d8-1f7ea2df2604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:30.283819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-69fe3240-be4d-46b6-94c6-2099a4fef849 admin admin] The token cache is being invalidate because project d69ae958fcc64ad39669d8943d431a5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:30.284330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-69fe3240-be4d-46b6-94c6-2099a4fef849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:30.285271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-69fe3240-be4d-46b6-94c6-2099a4fef849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:30.287320 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4171/8236] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:49:29 2022] DELETE /identity/v3/projects/d69ae958fcc64ad39669d8943d431a5e => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:30.294734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1389e-4881-439b-ab2a-1a5ec3fc8ddd None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:30.295899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1389e-4881-439b-ab2a-1a5ec3fc8ddd None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:30.297016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a1389e-4881-439b-ab2a-1a5ec3fc8ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:30.341603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-96a1389e-4881-439b-ab2a-1a5ec3fc8ddd None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:30.343592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-96a1389e-4881-439b-ab2a-1a5ec3fc8ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:30.358948 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:30.453336 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4172/8237] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:30.465399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d5984-8677-41a2-b3b6-6db25ed238bd None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:30.465703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d5984-8677-41a2-b3b6-6db25ed238bd None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:30.465976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d5984-8677-41a2-b3b6-6db25ed238bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:30.494590 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4066/8238] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:49:30.495864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7bdcb-785b-4918-a0f8-97822f63a6b9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:30.496328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7bdcb-785b-4918-a0f8-97822f63a6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:30.496670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7bdcb-785b-4918-a0f8-97822f63a6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:30.515670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-da3d5984-8677-41a2-b3b6-6db25ed238bd None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:30.516913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-da3d5984-8677-41a2-b3b6-6db25ed238bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:30.517587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-50c7bdcb-785b-4918-a0f8-97822f63a6b9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:30.519706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-50c7bdcb-785b-4918-a0f8-97822f63a6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:30.529964 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4067/8239] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:30.534047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7bdcb-785b-4918-a0f8-97822f63a6b9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:30.546374 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4173/8240] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:30.546978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7bdcb-785b-4918-a0f8-97822f63a6b9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:30.547426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d5984-8677-41a2-b3b6-6db25ed238bd None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:30.552804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbceaae-6d56-4ac5-bf4a-b8d69e4630a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:30.553447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbceaae-6d56-4ac5-bf4a-b8d69e4630a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:30.553834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbceaae-6d56-4ac5-bf4a-b8d69e4630a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:30.554259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbceaae-6d56-4ac5-bf4a-b8d69e4630a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:30.555233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbceaae-6d56-4ac5-bf4a-b8d69e4630a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:49:30.556197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbceaae-6d56-4ac5-bf4a-b8d69e4630a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:30.558002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbceaae-6d56-4ac5-bf4a-b8d69e4630a3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:30.569074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d5984-8677-41a2-b3b6-6db25ed238bd None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:30.575714 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4068/8241] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:49:30.576824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbceaae-6d56-4ac5-bf4a-b8d69e4630a3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:30.588169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae78781-324e-430d-9aea-c06186c848eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:30.588873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae78781-324e-430d-9aea-c06186c848eb admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:30.589164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae78781-324e-430d-9aea-c06186c848eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:30.589447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae78781-324e-430d-9aea-c06186c848eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:30.589846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbceaae-6d56-4ac5-bf4a-b8d69e4630a3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:30.590257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae78781-324e-430d-9aea-c06186c848eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:49:30.590573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae78781-324e-430d-9aea-c06186c848eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:30.592511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae78781-324e-430d-9aea-c06186c848eb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:30.596056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aa4ec-3560-48d9-9265-3460aab93c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:30.596961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aa4ec-3560-48d9-9265-3460aab93c64 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:30.597464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aa4ec-3560-48d9-9265-3460aab93c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:30.597937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46aa4ec-3560-48d9-9265-3460aab93c64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:30.600813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aa4ec-3560-48d9-9265-3460aab93c64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:30.603837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46aa4ec-3560-48d9-9265-3460aab93c64 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:30.633279 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4174/8242] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:49:30.638334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae78781-324e-430d-9aea-c06186c848eb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:30.659769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae78781-324e-430d-9aea-c06186c848eb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:30.665630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a57d00-bb26-4907-9578-cbc237c10318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:30.666545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a57d00-bb26-4907-9578-cbc237c10318 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:30.666844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a57d00-bb26-4907-9578-cbc237c10318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:30.674508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a57d00-bb26-4907-9578-cbc237c10318 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:30.674508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a57d00-bb26-4907-9578-cbc237c10318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:30.674508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a57d00-bb26-4907-9578-cbc237c10318 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:30.712985 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4069/8243] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:49:30 2022] POST /identity/v3/projects => generated 365 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:30.717343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aa4ec-3560-48d9-9265-3460aab93c64 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:30.767253 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4175/8244] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:49:30 2022] POST /identity/v3/projects => generated 409 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:30.768803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a57d00-bb26-4907-9578-cbc237c10318 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:30.799706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46aa4ec-3560-48d9-9265-3460aab93c64 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:30.888355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a57d00-bb26-4907-9578-cbc237c10318 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:30.894914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c06b1-1fbe-4c9e-926a-5a08ad3574d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:30.895604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c06b1-1fbe-4c9e-926a-5a08ad3574d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:30.895726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b160def-7216-4a9e-94fb-3d0c1db185be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:30.895929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c06b1-1fbe-4c9e-926a-5a08ad3574d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:30.896166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c06b1-1fbe-4c9e-926a-5a08ad3574d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:30.896394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b160def-7216-4a9e-94fb-3d0c1db185be admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:30.896682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b160def-7216-4a9e-94fb-3d0c1db185be admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:30.896871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c06b1-1fbe-4c9e-926a-5a08ad3574d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:30.897029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b160def-7216-4a9e-94fb-3d0c1db185be admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:30.897716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b160def-7216-4a9e-94fb-3d0c1db185be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:30.898911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c06b1-1fbe-4c9e-926a-5a08ad3574d0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:30.900152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b160def-7216-4a9e-94fb-3d0c1db185be admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:31.015955 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4070/8245] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:49:30 2022] POST /identity/v3/users => generated 283 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:31.017080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b160def-7216-4a9e-94fb-3d0c1db185be admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:31.030938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b160def-7216-4a9e-94fb-3d0c1db185be admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:31.034479 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4176/8246] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:49:30 2022] POST /identity/v3/users => generated 305 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:31.037947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c06b1-1fbe-4c9e-926a-5a08ad3574d0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:31.046239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a388ce-4c6d-47d7-82ff-cbaabc71bdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:31.047065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a388ce-4c6d-47d7-82ff-cbaabc71bdff admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:31.047414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a388ce-4c6d-47d7-82ff-cbaabc71bdff admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:31.047648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a388ce-4c6d-47d7-82ff-cbaabc71bdff admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:31.048418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a388ce-4c6d-47d7-82ff-cbaabc71bdff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:31.050503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a388ce-4c6d-47d7-82ff-cbaabc71bdff admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:31.060732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c06b1-1fbe-4c9e-926a-5a08ad3574d0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:31.069968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1135e83-25de-46c5-9178-ba66e368706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:31.071053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1135e83-25de-46c5-9178-ba66e368706b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:31.071184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1135e83-25de-46c5-9178-ba66e368706b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:31.071415 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4071/8247] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:31.074570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1135e83-25de-46c5-9178-ba66e368706b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:31.075372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1135e83-25de-46c5-9178-ba66e368706b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:31.077004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1135e83-25de-46c5-9178-ba66e368706b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:31.079169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a388ce-4c6d-47d7-82ff-cbaabc71bdff admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:31.089681 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4177/8248] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:31.092837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a388ce-4c6d-47d7-82ff-cbaabc71bdff admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:31.094305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1135e83-25de-46c5-9178-ba66e368706b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:31.098815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39882c4e-4fa8-4bc3-81d4-e92fb9e76b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:31.099508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39882c4e-4fa8-4bc3-81d4-e92fb9e76b4b admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:31.099799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39882c4e-4fa8-4bc3-81d4-e92fb9e76b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:31.100085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39882c4e-4fa8-4bc3-81d4-e92fb9e76b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:31.100826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39882c4e-4fa8-4bc3-81d4-e92fb9e76b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:31.102936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39882c4e-4fa8-4bc3-81d4-e92fb9e76b4b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:31.108123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1135e83-25de-46c5-9178-ba66e368706b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:31.114171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdadd5e-f4b5-4bbd-8f62-37383af0b867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:31.114171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdadd5e-f4b5-4bbd-8f62-37383af0b867 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:31.114171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdadd5e-f4b5-4bbd-8f62-37383af0b867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:31.114171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdadd5e-f4b5-4bbd-8f62-37383af0b867 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:31.114921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdadd5e-f4b5-4bbd-8f62-37383af0b867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:31.116511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdadd5e-f4b5-4bbd-8f62-37383af0b867 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:31.119074 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4072/8249] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:31.120245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39882c4e-4fa8-4bc3-81d4-e92fb9e76b4b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:31.128999 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4178/8250] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:49:31.131191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39882c4e-4fa8-4bc3-81d4-e92fb9e76b4b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:31.137275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f36af-8265-435f-8c1f-8a23877918a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:31.143469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f36af-8265-435f-8c1f-8a23877918a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:31.143469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f36af-8265-435f-8c1f-8a23877918a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:31.143469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f36af-8265-435f-8c1f-8a23877918a8 admin admin] PATH_INFO: `/v3/projects/4d91ae3310734ee2a612564e6587c9ef/users/58c54379fbce49c7b46ed7d57f009880/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:31.143758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdadd5e-f4b5-4bbd-8f62-37383af0b867 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:31.153851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdadd5e-f4b5-4bbd-8f62-37383af0b867 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:31.155668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f36af-8265-435f-8c1f-8a23877918a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d91ae3310734ee2a612564e6587c9ef, user_id=58c54379fbce49c7b46ed7d57f009880, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:31.158502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f36af-8265-435f-8c1f-8a23877918a8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:31.158975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20329453-ce5e-48bd-b5b9-75b0558aae4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:31.160214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20329453-ce5e-48bd-b5b9-75b0558aae4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:31.160610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20329453-ce5e-48bd-b5b9-75b0558aae4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:31.160971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20329453-ce5e-48bd-b5b9-75b0558aae4e admin admin] PATH_INFO: `/v3/projects/15176274560149248146480a6010d23d/users/3ee575816456473aaa301d11fa8981e0/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:31.184864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20329453-ce5e-48bd-b5b9-75b0558aae4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=15176274560149248146480a6010d23d, user_id=3ee575816456473aaa301d11fa8981e0, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:31.184864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20329453-ce5e-48bd-b5b9-75b0558aae4e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:31.234154 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4073/8251] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:31 2022] PUT /identity/v3/projects/4d91ae3310734ee2a612564e6587c9ef/users/58c54379fbce49c7b46ed7d57f009880/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:31.246718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd82b4-1edc-4f46-96f0-6fc40b47f8a7 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:31.247117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd82b4-1edc-4f46-96f0-6fc40b47f8a7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:31.247544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd82b4-1edc-4f46-96f0-6fc40b47f8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:31.296661 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4179/8252] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:31 2022] PUT /identity/v3/projects/15176274560149248146480a6010d23d/users/3ee575816456473aaa301d11fa8981e0/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:31.296763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-58fd82b4-1edc-4f46-96f0-6fc40b47f8a7 None None] MFA Rules not processed for user `58c54379fbce49c7b46ed7d57f009880`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:31.296763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-58fd82b4-1edc-4f46-96f0-6fc40b47f8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:31.298014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39e329-357a-4649-8364-e489d12f4e3e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:31.298460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39e329-357a-4649-8364-e489d12f4e3e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:31.298843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f39e329-357a-4649-8364-e489d12f4e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:31.310572 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:31.353339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2f39e329-357a-4649-8364-e489d12f4e3e None None] MFA Rules not processed for user `3ee575816456473aaa301d11fa8981e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:31.356136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2f39e329-357a-4649-8364-e489d12f4e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:31.394737 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4074/8253] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:49:31.400107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd82b4-1edc-4f46-96f0-6fc40b47f8a7 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:31.450970 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4180/8254] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:31 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:49:31.452353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39e329-357a-4649-8364-e489d12f4e3e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:31.454701 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:31.567623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd82b4-1edc-4f46-96f0-6fc40b47f8a7 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:31.575354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f39e329-357a-4649-8364-e489d12f4e3e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:31.581995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba7dd3-f001-4a29-bc55-c40843853baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:31.582821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba7dd3-f001-4a29-bc55-c40843853baa admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:31.583157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba7dd3-f001-4a29-bc55-c40843853baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:31.583486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba7dd3-f001-4a29-bc55-c40843853baa admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:31.584295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba7dd3-f001-4a29-bc55-c40843853baa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:31.589526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba7dd3-f001-4a29-bc55-c40843853baa admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:31.594232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45caee-f06e-4fc7-945c-50ca5caaafdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:31.595808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45caee-f06e-4fc7-945c-50ca5caaafdb admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:31.596101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45caee-f06e-4fc7-945c-50ca5caaafdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:31.597691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45caee-f06e-4fc7-945c-50ca5caaafdb admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:31.600212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45caee-f06e-4fc7-945c-50ca5caaafdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:31.607104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d45caee-f06e-4fc7-945c-50ca5caaafdb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:31.761464 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4075/8255] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:49:31 2022] POST /identity/v3/projects => generated 365 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:49:31.769326 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4181/8256] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:49:31 2022] POST /identity/v3/projects => generated 409 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:31.770054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba7dd3-f001-4a29-bc55-c40843853baa admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:31.775924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45caee-f06e-4fc7-945c-50ca5caaafdb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:31.795247 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:31.912963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d45caee-f06e-4fc7-945c-50ca5caaafdb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:31.919745 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:31.950212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffae99-b3ff-460a-844e-1d7c63cff988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:31.953535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffae99-b3ff-460a-844e-1d7c63cff988 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:31.953535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffae99-b3ff-460a-844e-1d7c63cff988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:31.953725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba7dd3-f001-4a29-bc55-c40843853baa admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:31.953810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffae99-b3ff-460a-844e-1d7c63cff988 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:31.955427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffae99-b3ff-460a-844e-1d7c63cff988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:31.958611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffae99-b3ff-460a-844e-1d7c63cff988 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:31.968683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744503d1-d042-4290-a441-98dda2ce04c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:31.969397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744503d1-d042-4290-a441-98dda2ce04c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:31.969806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744503d1-d042-4290-a441-98dda2ce04c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:31.970044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744503d1-d042-4290-a441-98dda2ce04c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:31.976396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744503d1-d042-4290-a441-98dda2ce04c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:31.976396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744503d1-d042-4290-a441-98dda2ce04c6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:32.101041 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4182/8257] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:49:31 2022] POST /identity/v3/users => generated 311 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:32.105728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffae99-b3ff-460a-844e-1d7c63cff988 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:32.116557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffae99-b3ff-460a-844e-1d7c63cff988 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:32.124209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce31c9-aa95-445c-acd8-7d66c6b232ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:32.124209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce31c9-aa95-445c-acd8-7d66c6b232ea admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:32.126142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce31c9-aa95-445c-acd8-7d66c6b232ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:32.126142 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce31c9-aa95-445c-acd8-7d66c6b232ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:32.127735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce31c9-aa95-445c-acd8-7d66c6b232ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:32.134183 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4076/8258] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:49:31 2022] POST /identity/v3/users => generated 289 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:32.135261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dce31c9-aa95-445c-acd8-7d66c6b232ea admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:32.138618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744503d1-d042-4290-a441-98dda2ce04c6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:32.152991 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4183/8259] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:49:32.156448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744503d1-d042-4290-a441-98dda2ce04c6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:32.157707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce31c9-aa95-445c-acd8-7d66c6b232ea admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:32.170831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca081e8b-541b-4058-9805-0e6761b751dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:32.171525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca081e8b-541b-4058-9805-0e6761b751dd admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:32.172980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca081e8b-541b-4058-9805-0e6761b751dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:32.173362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca081e8b-541b-4058-9805-0e6761b751dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:32.174270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca081e8b-541b-4058-9805-0e6761b751dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:32.175319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce31c9-aa95-445c-acd8-7d66c6b232ea admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:32.176583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca081e8b-541b-4058-9805-0e6761b751dd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:32.181635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472578e0-8b23-4937-8e1e-6e70f47359d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:32.182158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472578e0-8b23-4937-8e1e-6e70f47359d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:32.184481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472578e0-8b23-4937-8e1e-6e70f47359d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:32.184481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472578e0-8b23-4937-8e1e-6e70f47359d3 admin admin] PATH_INFO: `/v3/projects/c83e47ce79cf4fef84f50252ac5023fb/users/308d12ee7a124f89b1246ebbdbb2ef18/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:32.193453 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4077/8260] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:32.194768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca081e8b-541b-4058-9805-0e6761b751dd admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:32.207857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472578e0-8b23-4937-8e1e-6e70f47359d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c83e47ce79cf4fef84f50252ac5023fb, user_id=308d12ee7a124f89b1246ebbdbb2ef18, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:32.208826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca081e8b-541b-4058-9805-0e6761b751dd admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:32.217127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472578e0-8b23-4937-8e1e-6e70f47359d3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:32.217252 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1202bbe-a7ea-453f-be38-eef2164b511b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:32.218427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1202bbe-a7ea-453f-be38-eef2164b511b admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:32.218717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1202bbe-a7ea-453f-be38-eef2164b511b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:32.218999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1202bbe-a7ea-453f-be38-eef2164b511b admin admin] PATH_INFO: `/v3/projects/71ffb46c7a504fecbc110eea5d586071/users/58fbc71611bd4e3ba2ca17ad0dcbee4c/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:32.245004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1202bbe-a7ea-453f-be38-eef2164b511b admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ffb46c7a504fecbc110eea5d586071, user_id=58fbc71611bd4e3ba2ca17ad0dcbee4c, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:32.247958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1202bbe-a7ea-453f-be38-eef2164b511b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:32.324160 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4184/8261] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:32 2022] PUT /identity/v3/projects/c83e47ce79cf4fef84f50252ac5023fb/users/308d12ee7a124f89b1246ebbdbb2ef18/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:32.328174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472578e0-8b23-4937-8e1e-6e70f47359d3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:32.362278 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4078/8262] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:32 2022] PUT /identity/v3/projects/71ffb46c7a504fecbc110eea5d586071/users/58fbc71611bd4e3ba2ca17ad0dcbee4c/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:49:32.386331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1202bbe-a7ea-453f-be38-eef2164b511b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:32.486040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472578e0-8b23-4937-8e1e-6e70f47359d3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:32.518180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1202bbe-a7ea-453f-be38-eef2164b511b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:32.524538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115a5c9-9a7f-43a4-93fa-19a7625795a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:32.528080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115a5c9-9a7f-43a4-93fa-19a7625795a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:32.528080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115a5c9-9a7f-43a4-93fa-19a7625795a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:32.528080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115a5c9-9a7f-43a4-93fa-19a7625795a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:32.528080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115a5c9-9a7f-43a4-93fa-19a7625795a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:32.530651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115a5c9-9a7f-43a4-93fa-19a7625795a3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:32.547599 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4079/8263] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:32.548830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115a5c9-9a7f-43a4-93fa-19a7625795a3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:32.560248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115a5c9-9a7f-43a4-93fa-19a7625795a3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:32.562932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baa072-9530-4273-b28b-3664c1e641fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:32.563630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baa072-9530-4273-b28b-3664c1e641fe admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:32.563991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baa072-9530-4273-b28b-3664c1e641fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:32.564340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64baa072-9530-4273-b28b-3664c1e641fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:32.565182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64baa072-9530-4273-b28b-3664c1e641fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:32.566058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511bbfc-5d1d-41d8-b518-d46adbfc0ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:32.567031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64baa072-9530-4273-b28b-3664c1e641fe admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:32.567341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511bbfc-5d1d-41d8-b518-d46adbfc0ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:32.572881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511bbfc-5d1d-41d8-b518-d46adbfc0ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:32.572881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511bbfc-5d1d-41d8-b518-d46adbfc0ab5 admin admin] PATH_INFO: `/v3/projects/71ffb46c7a504fecbc110eea5d586071/users/58fbc71611bd4e3ba2ca17ad0dcbee4c/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:32.572881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511bbfc-5d1d-41d8-b518-d46adbfc0ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71ffb46c7a504fecbc110eea5d586071, user_id=58fbc71611bd4e3ba2ca17ad0dcbee4c, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:32.574629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511bbfc-5d1d-41d8-b518-d46adbfc0ab5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:32.579156 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4185/8264] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:32.589459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baa072-9530-4273-b28b-3664c1e641fe admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:32.591856 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4080/8265] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:32 2022] PUT /identity/v3/projects/71ffb46c7a504fecbc110eea5d586071/users/58fbc71611bd4e3ba2ca17ad0dcbee4c/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:32.605877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaff11-70fc-41d6-b18b-bdf286a34e5b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:32.606189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaff11-70fc-41d6-b18b-bdf286a34e5b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:32.606483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaff11-70fc-41d6-b18b-bdf286a34e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:32.617509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64baa072-9530-4273-b28b-3664c1e641fe admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:32.624291 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:32.652401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7ddaff11-70fc-41d6-b18b-bdf286a34e5b None None] MFA Rules not processed for user `58fbc71611bd4e3ba2ca17ad0dcbee4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:32.654377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7ddaff11-70fc-41d6-b18b-bdf286a34e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:32.710812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e025d-7fbb-4bd0-b9c3-31895dee88a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:32.710812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e025d-7fbb-4bd0-b9c3-31895dee88a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:32.710812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e025d-7fbb-4bd0-b9c3-31895dee88a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:32.710812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e025d-7fbb-4bd0-b9c3-31895dee88a8 admin admin] PATH_INFO: `/v3/projects/c83e47ce79cf4fef84f50252ac5023fb/users/308d12ee7a124f89b1246ebbdbb2ef18/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:32.717268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e025d-7fbb-4bd0-b9c3-31895dee88a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c83e47ce79cf4fef84f50252ac5023fb, user_id=308d12ee7a124f89b1246ebbdbb2ef18, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:32.717268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e025d-7fbb-4bd0-b9c3-31895dee88a8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:32.735492 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4186/8266] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:32 2022] PUT /identity/v3/projects/c83e47ce79cf4fef84f50252ac5023fb/users/308d12ee7a124f89b1246ebbdbb2ef18/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:32.744905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd944ea-7bf8-4b22-b569-417aba2a3b38 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:32.744905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd944ea-7bf8-4b22-b569-417aba2a3b38 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:32.744905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd944ea-7bf8-4b22-b569-417aba2a3b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:32.786772 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4081/8267] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:32 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:49:32.793060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-cbd944ea-7bf8-4b22-b569-417aba2a3b38 None None] MFA Rules not processed for user `308d12ee7a124f89b1246ebbdbb2ef18`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:32.794314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cbd944ea-7bf8-4b22-b569-417aba2a3b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:32.797300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddaff11-70fc-41d6-b18b-bdf286a34e5b None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:32.799073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7ddaff11-70fc-41d6-b18b-bdf286a34e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:32.826236 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:32.894563 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4187/8268] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:32 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:49:32.908621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd944ea-7bf8-4b22-b569-417aba2a3b38 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:32.912225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cbd944ea-7bf8-4b22-b569-417aba2a3b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:32.920125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddaff11-70fc-41d6-b18b-bdf286a34e5b None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:32.984887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455f0ee-86a1-402c-b6b2-bdf35faa2bca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:32.985848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455f0ee-86a1-402c-b6b2-bdf35faa2bca service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:32.986745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455f0ee-86a1-402c-b6b2-bdf35faa2bca service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:32.987193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455f0ee-86a1-402c-b6b2-bdf35faa2bca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:33.001731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd944ea-7bf8-4b22-b569-417aba2a3b38 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:33.016350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118ad77-3e61-4059-8090-01bd7b02d6ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:33.017359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118ad77-3e61-4059-8090-01bd7b02d6ec service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:33.017725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118ad77-3e61-4059-8090-01bd7b02d6ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:33.018017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8118ad77-3e61-4059-8090-01bd7b02d6ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:33.032406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118ad77-3e61-4059-8090-01bd7b02d6ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:33.034630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8118ad77-3e61-4059-8090-01bd7b02d6ec service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:33.048957 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4188/8269] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:32 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:33.118457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455f0ee-86a1-402c-b6b2-bdf35faa2bca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:33.122666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455f0ee-86a1-402c-b6b2-bdf35faa2bca service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:33.152630 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4082/8270] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:32 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:49:33.438557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118ad77-3e61-4059-8090-01bd7b02d6ec service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:33.467610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8118ad77-3e61-4059-8090-01bd7b02d6ec service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:33.481026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a34bd-2d7e-41b3-bd48-d86eb096996a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:33.481704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a34bd-2d7e-41b3-bd48-d86eb096996a service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:33.481990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a34bd-2d7e-41b3-bd48-d86eb096996a service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:33.482297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a34bd-2d7e-41b3-bd48-d86eb096996a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:33.533726 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:33.578481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a34bd-2d7e-41b3-bd48-d86eb096996a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:33.580178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a34bd-2d7e-41b3-bd48-d86eb096996a service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:33.592276 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4189/8271] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:33.700121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455f0ee-86a1-402c-b6b2-bdf35faa2bca service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:33.731339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455f0ee-86a1-402c-b6b2-bdf35faa2bca service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:33.742477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336daca5-6d88-4fc3-a8ff-2d76962ebf9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:33.744884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336daca5-6d88-4fc3-a8ff-2d76962ebf9e service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:33.748038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336daca5-6d88-4fc3-a8ff-2d76962ebf9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:33.748404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336daca5-6d88-4fc3-a8ff-2d76962ebf9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:33.884463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336daca5-6d88-4fc3-a8ff-2d76962ebf9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:33.885984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336daca5-6d88-4fc3-a8ff-2d76962ebf9e service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:33.903864 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4083/8272] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:33 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:37.967198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a34bd-2d7e-41b3-bd48-d86eb096996a service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:37.968945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-375a34bd-2d7e-41b3-bd48-d86eb096996a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:38.049716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a34bd-2d7e-41b3-bd48-d86eb096996a service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:38.056125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051b629-83cc-4ea3-a3f3-573e0921fc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:38.057131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051b629-83cc-4ea3-a3f3-573e0921fc86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:38.057519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051b629-83cc-4ea3-a3f3-573e0921fc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:38.057892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051b629-83cc-4ea3-a3f3-573e0921fc86 admin admin] PATH_INFO: `/v3/users/cb76abea9c994abdb6eba724ec322493` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:38.059580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051b629-83cc-4ea3-a3f3-573e0921fc86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb76abea9c994abdb6eba724ec322493)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:38.062227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051b629-83cc-4ea3-a3f3-573e0921fc86 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:38.335810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7051b629-83cc-4ea3-a3f3-573e0921fc86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb76abea9c994abdb6eba724ec322493'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:38.358156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7051b629-83cc-4ea3-a3f3-573e0921fc86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb76abea9c994abdb6eba724ec322493'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:38.402586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7051b629-83cc-4ea3-a3f3-573e0921fc86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb76abea9c994abdb6eba724ec322493'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:38.402586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7051b629-83cc-4ea3-a3f3-573e0921fc86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb76abea9c994abdb6eba724ec322493'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:38.545639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7051b629-83cc-4ea3-a3f3-573e0921fc86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb76abea9c994abdb6eba724ec322493'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:38.552885 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4190/8273] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:37 2022] DELETE /identity/v3/users/cb76abea9c994abdb6eba724ec322493 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:38.558525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9121c-0c0b-46f6-9148-2c5eeed8102f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:38.559104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9121c-0c0b-46f6-9148-2c5eeed8102f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:38.559104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9121c-0c0b-46f6-9148-2c5eeed8102f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:38.579106 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-41f9121c-0c0b-46f6-9148-2c5eeed8102f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:38.580340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-41f9121c-0c0b-46f6-9148-2c5eeed8102f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:38.595403 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:38.655656 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4084/8274] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:49:38.669981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051b629-83cc-4ea3-a3f3-573e0921fc86 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:38.673866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7051b629-83cc-4ea3-a3f3-573e0921fc86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:38.769133 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:38.785138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051b629-83cc-4ea3-a3f3-573e0921fc86 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:38.795043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a8689-6c19-44c7-89ca-52c676a13af2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:38.796378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a8689-6c19-44c7-89ca-52c676a13af2 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:38.797620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a8689-6c19-44c7-89ca-52c676a13af2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:38.798256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a8689-6c19-44c7-89ca-52c676a13af2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:38.824379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a8689-6c19-44c7-89ca-52c676a13af2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:38.825960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a8689-6c19-44c7-89ca-52c676a13af2 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:38.843582 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4191/8275] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:39.680738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9121c-0c0b-46f6-9148-2c5eeed8102f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:39.682809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-41f9121c-0c0b-46f6-9148-2c5eeed8102f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:39.709725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9121c-0c0b-46f6-9148-2c5eeed8102f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:39.728073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85190f-c374-47b9-b35e-f2590de65372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:39.729310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85190f-c374-47b9-b35e-f2590de65372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:39.729659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85190f-c374-47b9-b35e-f2590de65372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:39.730302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85190f-c374-47b9-b35e-f2590de65372 admin admin] PATH_INFO: `/v3/projects/ec29e27dc72e4c3593ff6ff4ae20ce69` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:39.733089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85190f-c374-47b9-b35e-f2590de65372 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec29e27dc72e4c3593ff6ff4ae20ce69)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:39.736260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85190f-c374-47b9-b35e-f2590de65372 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:39.979745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0c85190f-c374-47b9-b35e-f2590de65372 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec29e27dc72e4c3593ff6ff4ae20ce69', 'request_id': 'req-0c85190f-c374-47b9-b35e-f2590de65372'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:40.069517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0c85190f-c374-47b9-b35e-f2590de65372 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec29e27dc72e4c3593ff6ff4ae20ce69', 'request_id': 'req-0c85190f-c374-47b9-b35e-f2590de65372'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:40.087394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0c85190f-c374-47b9-b35e-f2590de65372 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec29e27dc72e4c3593ff6ff4ae20ce69', 'request_id': 'req-0c85190f-c374-47b9-b35e-f2590de65372'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:40.116192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0c85190f-c374-47b9-b35e-f2590de65372 admin admin] The token cache is being invalidate because project ec29e27dc72e4c3593ff6ff4ae20ce69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:40.116753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0c85190f-c374-47b9-b35e-f2590de65372 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:40.118215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0c85190f-c374-47b9-b35e-f2590de65372 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:40.120222 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4085/8276] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:49:39 2022] DELETE /identity/v3/projects/ec29e27dc72e4c3593ff6ff4ae20ce69 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:40.131469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a8689-6c19-44c7-89ca-52c676a13af2 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:40.152082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a8689-6c19-44c7-89ca-52c676a13af2 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:40.255478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19eb5b9-e3c7-46db-868d-2fe6c95d8f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:40.256173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19eb5b9-e3c7-46db-868d-2fe6c95d8f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:40.256590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19eb5b9-e3c7-46db-868d-2fe6c95d8f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:40.256991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19eb5b9-e3c7-46db-868d-2fe6c95d8f3a admin admin] PATH_INFO: `/v3/users/cc6815a263fc48e89cfa17c33ee91dbb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:40.258974 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19eb5b9-e3c7-46db-868d-2fe6c95d8f3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc6815a263fc48e89cfa17c33ee91dbb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:40.261592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19eb5b9-e3c7-46db-868d-2fe6c95d8f3a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:40.527109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b19eb5b9-e3c7-46db-868d-2fe6c95d8f3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc6815a263fc48e89cfa17c33ee91dbb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:40.545907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b19eb5b9-e3c7-46db-868d-2fe6c95d8f3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc6815a263fc48e89cfa17c33ee91dbb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:40.554773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b19eb5b9-e3c7-46db-868d-2fe6c95d8f3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc6815a263fc48e89cfa17c33ee91dbb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:40.556845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b19eb5b9-e3c7-46db-868d-2fe6c95d8f3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc6815a263fc48e89cfa17c33ee91dbb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:40.651127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b19eb5b9-e3c7-46db-868d-2fe6c95d8f3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc6815a263fc48e89cfa17c33ee91dbb'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:40.674625 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4192/8277] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:40 2022] DELETE /identity/v3/users/cc6815a263fc48e89cfa17c33ee91dbb => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:41.438885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85190f-c374-47b9-b35e-f2590de65372 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:41.440431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0c85190f-c374-47b9-b35e-f2590de65372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:41.478965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85190f-c374-47b9-b35e-f2590de65372 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:41.570342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c09a5-cd25-4113-a000-998d0a340c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:41.571563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c09a5-cd25-4113-a000-998d0a340c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:41.571851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c09a5-cd25-4113-a000-998d0a340c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:41.572290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c09a5-cd25-4113-a000-998d0a340c42 admin admin] PATH_INFO: `/v3/projects/cac7e52d2b3b481fa701f51a29e2922f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:41.573725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c09a5-cd25-4113-a000-998d0a340c42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cac7e52d2b3b481fa701f51a29e2922f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:41.576408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3c09a5-cd25-4113-a000-998d0a340c42 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:41.715217 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:41.730863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c3c09a5-cd25-4113-a000-998d0a340c42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cac7e52d2b3b481fa701f51a29e2922f', 'request_id': 'req-4c3c09a5-cd25-4113-a000-998d0a340c42'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:41.825661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c3c09a5-cd25-4113-a000-998d0a340c42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cac7e52d2b3b481fa701f51a29e2922f', 'request_id': 'req-4c3c09a5-cd25-4113-a000-998d0a340c42'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:41.834361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c3c09a5-cd25-4113-a000-998d0a340c42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cac7e52d2b3b481fa701f51a29e2922f', 'request_id': 'req-4c3c09a5-cd25-4113-a000-998d0a340c42'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:41.853438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c3c09a5-cd25-4113-a000-998d0a340c42 admin admin] The token cache is being invalidate because project cac7e52d2b3b481fa701f51a29e2922f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:41.853778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c3c09a5-cd25-4113-a000-998d0a340c42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:41.854448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4c3c09a5-cd25-4113-a000-998d0a340c42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:41.859647 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4086/8278] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:49:41 2022] DELETE /identity/v3/projects/cac7e52d2b3b481fa701f51a29e2922f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:41.864479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa30f9-2d51-45fd-8ead-cde1c4028948 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:41.864942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa30f9-2d51-45fd-8ead-cde1c4028948 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:41.865120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa30f9-2d51-45fd-8ead-cde1c4028948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:41.917225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-50aa30f9-2d51-45fd-8ead-cde1c4028948 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:41.918597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-50aa30f9-2d51-45fd-8ead-cde1c4028948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:42.014431 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4193/8279] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:42.017842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14d50d-0b18-4531-8228-a7d3c37b9558 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:42.018158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14d50d-0b18-4531-8228-a7d3c37b9558 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:42.018453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14d50d-0b18-4531-8228-a7d3c37b9558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:42.045156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3e14d50d-0b18-4531-8228-a7d3c37b9558 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:42.046420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3e14d50d-0b18-4531-8228-a7d3c37b9558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:42.056349 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4087/8280] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:42.060171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa30f9-2d51-45fd-8ead-cde1c4028948 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:42.073143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa30f9-2d51-45fd-8ead-cde1c4028948 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:42.085254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f56b5b-e9ca-412b-9786-9aeaa7c8c65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:42.085863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f56b5b-e9ca-412b-9786-9aeaa7c8c65c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:42.086686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f56b5b-e9ca-412b-9786-9aeaa7c8c65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:42.087141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f56b5b-e9ca-412b-9786-9aeaa7c8c65c admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:42.088261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f56b5b-e9ca-412b-9786-9aeaa7c8c65c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:49:42.088573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f56b5b-e9ca-412b-9786-9aeaa7c8c65c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:42.090221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f56b5b-e9ca-412b-9786-9aeaa7c8c65c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:42.098271 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:42.117591 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4194/8281] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:49:42.122448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14d50d-0b18-4531-8228-a7d3c37b9558 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:42.133199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14d50d-0b18-4531-8228-a7d3c37b9558 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:42.142344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d63525-02ec-4a25-b57d-8ed64d2fe7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:42.143802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d63525-02ec-4a25-b57d-8ed64d2fe7d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:42.144299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d63525-02ec-4a25-b57d-8ed64d2fe7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:42.144891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d63525-02ec-4a25-b57d-8ed64d2fe7d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:42.146113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d63525-02ec-4a25-b57d-8ed64d2fe7d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:42.148381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d63525-02ec-4a25-b57d-8ed64d2fe7d8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:42.269639 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4088/8282] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:49:42 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:42.274318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f56b5b-e9ca-412b-9786-9aeaa7c8c65c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:42.296114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f56b5b-e9ca-412b-9786-9aeaa7c8c65c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:42.382922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a0e0e-260e-4afa-88f5-30e2316d6c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:42.382922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a0e0e-260e-4afa-88f5-30e2316d6c5f admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:42.382922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a0e0e-260e-4afa-88f5-30e2316d6c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:42.382922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a0e0e-260e-4afa-88f5-30e2316d6c5f admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:42.383831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a0e0e-260e-4afa-88f5-30e2316d6c5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:42.384805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a0e0e-260e-4afa-88f5-30e2316d6c5f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:42.488570 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4195/8283] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:49:42 2022] POST /identity/v3/users => generated 294 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:42.492497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d63525-02ec-4a25-b57d-8ed64d2fe7d8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:42.504513 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d63525-02ec-4a25-b57d-8ed64d2fe7d8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:42.510266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322518ef-b42f-4782-998c-7321eca8b9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:42.511060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322518ef-b42f-4782-998c-7321eca8b9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:42.511427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322518ef-b42f-4782-998c-7321eca8b9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:42.511782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322518ef-b42f-4782-998c-7321eca8b9e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:42.512706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322518ef-b42f-4782-998c-7321eca8b9e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:42.514464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322518ef-b42f-4782-998c-7321eca8b9e4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:42.546532 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4089/8284] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:49:42.547750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a0e0e-260e-4afa-88f5-30e2316d6c5f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:42.561310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a0e0e-260e-4afa-88f5-30e2316d6c5f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:42.576065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd00d1-02d8-44a8-941b-a7093b62811c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:42.576745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd00d1-02d8-44a8-941b-a7093b62811c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:42.577033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd00d1-02d8-44a8-941b-a7093b62811c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:42.577311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd00d1-02d8-44a8-941b-a7093b62811c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:42.578125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd00d1-02d8-44a8-941b-a7093b62811c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:42.580347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd00d1-02d8-44a8-941b-a7093b62811c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:42.603272 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4196/8285] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:42 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:42.607429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322518ef-b42f-4782-998c-7321eca8b9e4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:42.619679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322518ef-b42f-4782-998c-7321eca8b9e4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:42.632277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb215ca5-683c-466c-b28c-271b8ac6e93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:42.634952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb215ca5-683c-466c-b28c-271b8ac6e93c admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:42.637155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb215ca5-683c-466c-b28c-271b8ac6e93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:42.637727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb215ca5-683c-466c-b28c-271b8ac6e93c admin admin] PATH_INFO: `/v3/projects/8e5dd071c7014c179ac9b63312ae08f7/users/d34138f8c52d44dfb14f9709de475abb/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:42.670867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb215ca5-683c-466c-b28c-271b8ac6e93c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e5dd071c7014c179ac9b63312ae08f7, user_id=d34138f8c52d44dfb14f9709de475abb, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:42.673850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb215ca5-683c-466c-b28c-271b8ac6e93c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:42.752039 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4090/8286] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:42 2022] PUT /identity/v3/projects/8e5dd071c7014c179ac9b63312ae08f7/users/d34138f8c52d44dfb14f9709de475abb/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:42.763550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cb7fb-fe19-4bab-a7ad-8b055bbc3739 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:42.763929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cb7fb-fe19-4bab-a7ad-8b055bbc3739 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:42.764212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cb7fb-fe19-4bab-a7ad-8b055bbc3739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:42.827427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e60cb7fb-fe19-4bab-a7ad-8b055bbc3739 None None] MFA Rules not processed for user `d34138f8c52d44dfb14f9709de475abb`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:42.830768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e60cb7fb-fe19-4bab-a7ad-8b055bbc3739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:42.934170 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4197/8287] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:42.936115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb215ca5-683c-466c-b28c-271b8ac6e93c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:43.027794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb215ca5-683c-466c-b28c-271b8ac6e93c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:43.033880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a14e8-5f43-4f3e-92a8-8beb914ddef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:43.034737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a14e8-5f43-4f3e-92a8-8beb914ddef6 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:43.035172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a14e8-5f43-4f3e-92a8-8beb914ddef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:43.035558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70a14e8-5f43-4f3e-92a8-8beb914ddef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:43.036350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a14e8-5f43-4f3e-92a8-8beb914ddef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:43.038382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70a14e8-5f43-4f3e-92a8-8beb914ddef6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:43.137481 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4091/8288] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:49:42 2022] POST /identity/v3/projects => generated 387 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:49:43.141202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cb7fb-fe19-4bab-a7ad-8b055bbc3739 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:43.156217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cb7fb-fe19-4bab-a7ad-8b055bbc3739 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:43.262934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de9e69-9e92-4c8f-a07a-e082f627c17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:43.263866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de9e69-9e92-4c8f-a07a-e082f627c17b admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:43.264161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de9e69-9e92-4c8f-a07a-e082f627c17b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:43.264445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de9e69-9e92-4c8f-a07a-e082f627c17b admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:43.265405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de9e69-9e92-4c8f-a07a-e082f627c17b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:43.267967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de9e69-9e92-4c8f-a07a-e082f627c17b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:43.279078 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:43.380837 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4198/8289] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:49:43 2022] POST /identity/v3/users => generated 300 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:43.382075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a14e8-5f43-4f3e-92a8-8beb914ddef6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:43.399337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70a14e8-5f43-4f3e-92a8-8beb914ddef6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:43.423540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413b152-0869-4ebe-9b46-a7b0cafc95aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:43.424445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413b152-0869-4ebe-9b46-a7b0cafc95aa admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:43.424739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413b152-0869-4ebe-9b46-a7b0cafc95aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:43.425027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413b152-0869-4ebe-9b46-a7b0cafc95aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:43.425774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413b152-0869-4ebe-9b46-a7b0cafc95aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:43.429825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413b152-0869-4ebe-9b46-a7b0cafc95aa admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:43.460111 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4092/8290] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:49:43.460290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de9e69-9e92-4c8f-a07a-e082f627c17b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:43.478308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de9e69-9e92-4c8f-a07a-e082f627c17b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:43.491246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e7521-b2d2-460d-8433-d7cbfcb342aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:43.495328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e7521-b2d2-460d-8433-d7cbfcb342aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:43.497039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e7521-b2d2-460d-8433-d7cbfcb342aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:43.497532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e7521-b2d2-460d-8433-d7cbfcb342aa admin admin] PATH_INFO: `/v3/projects/0969d169dec946e1b16720c7e8d21c98/users/20a1a08bc00b4521ba3354fcff8d3d71/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:43.543621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e7521-b2d2-460d-8433-d7cbfcb342aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0969d169dec946e1b16720c7e8d21c98, user_id=20a1a08bc00b4521ba3354fcff8d3d71, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:43.547357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e7521-b2d2-460d-8433-d7cbfcb342aa admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:43.626715 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4199/8291] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:43 2022] PUT /identity/v3/projects/0969d169dec946e1b16720c7e8d21c98/users/20a1a08bc00b4521ba3354fcff8d3d71/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:43.630557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413b152-0869-4ebe-9b46-a7b0cafc95aa admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:43.644312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413b152-0869-4ebe-9b46-a7b0cafc95aa admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:43.715808 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:43.738445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43ac159-8706-4e0b-b7a4-f87d9b862847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:43.739280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ac159-8706-4e0b-b7a4-f87d9b862847 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:43.739685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ac159-8706-4e0b-b7a4-f87d9b862847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:43.740061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43ac159-8706-4e0b-b7a4-f87d9b862847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:43.740895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ac159-8706-4e0b-b7a4-f87d9b862847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:43.742793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43ac159-8706-4e0b-b7a4-f87d9b862847 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:43.758266 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4093/8292] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:43.759851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e7521-b2d2-460d-8433-d7cbfcb342aa admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:43.777784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e7521-b2d2-460d-8433-d7cbfcb342aa admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:43.794694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396133c-1c2f-443a-9dff-5785e6e6e542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:43.796030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396133c-1c2f-443a-9dff-5785e6e6e542 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:43.796418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396133c-1c2f-443a-9dff-5785e6e6e542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:43.796806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396133c-1c2f-443a-9dff-5785e6e6e542 admin admin] PATH_INFO: `/v3/projects/0969d169dec946e1b16720c7e8d21c98/users/20a1a08bc00b4521ba3354fcff8d3d71/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:43.802173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396133c-1c2f-443a-9dff-5785e6e6e542 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0969d169dec946e1b16720c7e8d21c98, user_id=20a1a08bc00b4521ba3354fcff8d3d71, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:43.806282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396133c-1c2f-443a-9dff-5785e6e6e542 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:43.819916 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4200/8293] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:43 2022] PUT /identity/v3/projects/0969d169dec946e1b16720c7e8d21c98/users/20a1a08bc00b4521ba3354fcff8d3d71/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:43.831097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35da923-1405-4258-82b0-375b0a7391b2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:43.831394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35da923-1405-4258-82b0-375b0a7391b2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:43.831692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35da923-1405-4258-82b0-375b0a7391b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:43.860467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d35da923-1405-4258-82b0-375b0a7391b2 None None] MFA Rules not processed for user `20a1a08bc00b4521ba3354fcff8d3d71`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:43.861750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d35da923-1405-4258-82b0-375b0a7391b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:43.946222 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4094/8294] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:43.957748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396133c-1c2f-443a-9dff-5785e6e6e542 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:43.959552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7396133c-1c2f-443a-9dff-5785e6e6e542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:44.061051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396133c-1c2f-443a-9dff-5785e6e6e542 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:44.067353 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa37c08-8db7-4a41-aad1-66baf44947b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:44.068427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa37c08-8db7-4a41-aad1-66baf44947b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:44.068823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa37c08-8db7-4a41-aad1-66baf44947b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:44.069211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa37c08-8db7-4a41-aad1-66baf44947b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:44.084147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa37c08-8db7-4a41-aad1-66baf44947b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:44.086007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa37c08-8db7-4a41-aad1-66baf44947b8 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:44.101212 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4201/8295] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:44.313047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35da923-1405-4258-82b0-375b0a7391b2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:44.385993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35da923-1405-4258-82b0-375b0a7391b2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:44.392844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f77fe-897c-44ae-bb23-95f7a0b05636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:44.393904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f77fe-897c-44ae-bb23-95f7a0b05636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:44.394370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f77fe-897c-44ae-bb23-95f7a0b05636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:44.394655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f77fe-897c-44ae-bb23-95f7a0b05636 admin admin] PATH_INFO: `/v3/users/d34138f8c52d44dfb14f9709de475abb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:44.395948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f77fe-897c-44ae-bb23-95f7a0b05636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d34138f8c52d44dfb14f9709de475abb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:44.398055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f77fe-897c-44ae-bb23-95f7a0b05636 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:44.626851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-210f77fe-897c-44ae-bb23-95f7a0b05636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd34138f8c52d44dfb14f9709de475abb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:44.640827 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:44.642941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-210f77fe-897c-44ae-bb23-95f7a0b05636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd34138f8c52d44dfb14f9709de475abb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:44.643816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-210f77fe-897c-44ae-bb23-95f7a0b05636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd34138f8c52d44dfb14f9709de475abb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:44.644610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-210f77fe-897c-44ae-bb23-95f7a0b05636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd34138f8c52d44dfb14f9709de475abb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:44.653738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-210f77fe-897c-44ae-bb23-95f7a0b05636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd34138f8c52d44dfb14f9709de475abb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:44.787444 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4095/8296] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:44 2022] DELETE /identity/v3/users/d34138f8c52d44dfb14f9709de475abb => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:44.792647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3da207-f225-4a3e-a042-905ddedc9a99 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:44.793059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3da207-f225-4a3e-a042-905ddedc9a99 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:44.793285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3da207-f225-4a3e-a042-905ddedc9a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:44.827090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4a3da207-f225-4a3e-a042-905ddedc9a99 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:44.828539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4a3da207-f225-4a3e-a042-905ddedc9a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:44.923892 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4202/8297] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:44.934267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f77fe-897c-44ae-bb23-95f7a0b05636 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:44.935715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-210f77fe-897c-44ae-bb23-95f7a0b05636 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:45.055524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f77fe-897c-44ae-bb23-95f7a0b05636 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:45.059826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bed38d-c7df-41b4-8e64-cfe8721b1b60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:45.060714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bed38d-c7df-41b4-8e64-cfe8721b1b60 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:45.061008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bed38d-c7df-41b4-8e64-cfe8721b1b60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:45.061293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bed38d-c7df-41b4-8e64-cfe8721b1b60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:45.073676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bed38d-c7df-41b4-8e64-cfe8721b1b60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:45.079144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bed38d-c7df-41b4-8e64-cfe8721b1b60 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:45.110882 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4096/8298] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:45.174422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3da207-f225-4a3e-a042-905ddedc9a99 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:45.176842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4a3da207-f225-4a3e-a042-905ddedc9a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:45.189846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3da207-f225-4a3e-a042-905ddedc9a99 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:45.198387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6680fd7-4029-458b-959b-151b65fcc06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:45.199625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6680fd7-4029-458b-959b-151b65fcc06b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:45.199802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6680fd7-4029-458b-959b-151b65fcc06b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:45.200184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6680fd7-4029-458b-959b-151b65fcc06b admin admin] PATH_INFO: `/v3/users/58c54379fbce49c7b46ed7d57f009880` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:45.201721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6680fd7-4029-458b-959b-151b65fcc06b admin admin] RBAC: Authorizing `identity:delete_user(user_id=58c54379fbce49c7b46ed7d57f009880)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:45.203912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6680fd7-4029-458b-959b-151b65fcc06b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:45.434057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d6680fd7-4029-458b-959b-151b65fcc06b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58c54379fbce49c7b46ed7d57f009880'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:45.451046 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:45.460070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d6680fd7-4029-458b-959b-151b65fcc06b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58c54379fbce49c7b46ed7d57f009880'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:45.475474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d6680fd7-4029-458b-959b-151b65fcc06b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58c54379fbce49c7b46ed7d57f009880'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:45.476313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d6680fd7-4029-458b-959b-151b65fcc06b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58c54379fbce49c7b46ed7d57f009880'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:45.542635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d6680fd7-4029-458b-959b-151b65fcc06b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58c54379fbce49c7b46ed7d57f009880'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:45.549652 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4203/8299] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:45 2022] DELETE /identity/v3/users/58c54379fbce49c7b46ed7d57f009880 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:45.554295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882432fe-8bdd-4def-b51b-9ca53fdcd6e3 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:45.554594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882432fe-8bdd-4def-b51b-9ca53fdcd6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:45.554941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882432fe-8bdd-4def-b51b-9ca53fdcd6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:45.573652 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-882432fe-8bdd-4def-b51b-9ca53fdcd6e3 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:45.574903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-882432fe-8bdd-4def-b51b-9ca53fdcd6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:45.612671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6680fd7-4029-458b-959b-151b65fcc06b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:45.617069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d6680fd7-4029-458b-959b-151b65fcc06b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:45.688341 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4097/8300] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:45.699720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882432fe-8bdd-4def-b51b-9ca53fdcd6e3 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:45.701700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-882432fe-8bdd-4def-b51b-9ca53fdcd6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:45.774642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6680fd7-4029-458b-959b-151b65fcc06b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:45.792217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d3a45-3f2f-44b4-a2ce-606c9a004caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:45.793124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d3a45-3f2f-44b4-a2ce-606c9a004caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:45.793437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d3a45-3f2f-44b4-a2ce-606c9a004caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:45.793721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5d3a45-3f2f-44b4-a2ce-606c9a004caf admin admin] PATH_INFO: `/v3/projects/8e5dd071c7014c179ac9b63312ae08f7` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:45.799053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d3a45-3f2f-44b4-a2ce-606c9a004caf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e5dd071c7014c179ac9b63312ae08f7)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:45.799053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5d3a45-3f2f-44b4-a2ce-606c9a004caf admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:45.831628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882432fe-8bdd-4def-b51b-9ca53fdcd6e3 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:45.835580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec99a8-dc6f-46d4-a1ee-1f81accf109e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:45.836281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec99a8-dc6f-46d4-a1ee-1f81accf109e service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:45.836580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec99a8-dc6f-46d4-a1ee-1f81accf109e service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:45.836889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ec99a8-dc6f-46d4-a1ee-1f81accf109e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:45.848706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec99a8-dc6f-46d4-a1ee-1f81accf109e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:45.850399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ec99a8-dc6f-46d4-a1ee-1f81accf109e service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:45.864946 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4098/8301] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:45.940225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2e5d3a45-3f2f-44b4-a2ce-606c9a004caf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e5dd071c7014c179ac9b63312ae08f7', 'request_id': 'req-2e5d3a45-3f2f-44b4-a2ce-606c9a004caf'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:45.947146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2e5d3a45-3f2f-44b4-a2ce-606c9a004caf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e5dd071c7014c179ac9b63312ae08f7', 'request_id': 'req-2e5d3a45-3f2f-44b4-a2ce-606c9a004caf'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:45.953586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2e5d3a45-3f2f-44b4-a2ce-606c9a004caf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e5dd071c7014c179ac9b63312ae08f7', 'request_id': 'req-2e5d3a45-3f2f-44b4-a2ce-606c9a004caf'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:46.125163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2e5d3a45-3f2f-44b4-a2ce-606c9a004caf admin admin] The token cache is being invalidate because project 8e5dd071c7014c179ac9b63312ae08f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:46.125802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2e5d3a45-3f2f-44b4-a2ce-606c9a004caf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:46.126616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2e5d3a45-3f2f-44b4-a2ce-606c9a004caf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:46.129219 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4204/8302] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:49:45 2022] DELETE /identity/v3/projects/8e5dd071c7014c179ac9b63312ae08f7 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:49:46.133994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec99a8-dc6f-46d4-a1ee-1f81accf109e service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:46.146969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ec99a8-dc6f-46d4-a1ee-1f81accf109e service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:46.180699 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:46.258490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e09f7-f9ee-44bb-bd88-6f0280e73310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:46.259686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e09f7-f9ee-44bb-bd88-6f0280e73310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:46.260306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e09f7-f9ee-44bb-bd88-6f0280e73310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:46.260811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8e09f7-f9ee-44bb-bd88-6f0280e73310 admin admin] PATH_INFO: `/v3/users/20a1a08bc00b4521ba3354fcff8d3d71` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:46.262885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e09f7-f9ee-44bb-bd88-6f0280e73310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20a1a08bc00b4521ba3354fcff8d3d71)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:46.266011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8e09f7-f9ee-44bb-bd88-6f0280e73310 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:46.433531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d3a45-3f2f-44b4-a2ce-606c9a004caf admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:46.433531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2e5d3a45-3f2f-44b4-a2ce-606c9a004caf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:46.450983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5d3a45-3f2f-44b4-a2ce-606c9a004caf admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:46.456438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87ce42-e83e-45dd-9055-0db26b8b8b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:46.457867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87ce42-e83e-45dd-9055-0db26b8b8b1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:46.458609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87ce42-e83e-45dd-9055-0db26b8b8b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:46.468089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b87ce42-e83e-45dd-9055-0db26b8b8b1b admin admin] PATH_INFO: `/v3/projects/4d91ae3310734ee2a612564e6587c9ef` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:46.468089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87ce42-e83e-45dd-9055-0db26b8b8b1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d91ae3310734ee2a612564e6587c9ef)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:46.468089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b87ce42-e83e-45dd-9055-0db26b8b8b1b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:46.517983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3a8e09f7-f9ee-44bb-bd88-6f0280e73310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20a1a08bc00b4521ba3354fcff8d3d71'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:46.551913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3a8e09f7-f9ee-44bb-bd88-6f0280e73310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20a1a08bc00b4521ba3354fcff8d3d71'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:46.551913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3a8e09f7-f9ee-44bb-bd88-6f0280e73310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20a1a08bc00b4521ba3354fcff8d3d71'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:46.551913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3a8e09f7-f9ee-44bb-bd88-6f0280e73310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20a1a08bc00b4521ba3354fcff8d3d71'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:46.554635 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-3a8e09f7-f9ee-44bb-bd88-6f0280e73310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20a1a08bc00b4521ba3354fcff8d3d71'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:46.582811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0b87ce42-e83e-45dd-9055-0db26b8b8b1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d91ae3310734ee2a612564e6587c9ef', 'request_id': 'req-0b87ce42-e83e-45dd-9055-0db26b8b8b1b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:46.589196 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:46.590417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0b87ce42-e83e-45dd-9055-0db26b8b8b1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d91ae3310734ee2a612564e6587c9ef', 'request_id': 'req-0b87ce42-e83e-45dd-9055-0db26b8b8b1b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:46.597181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0b87ce42-e83e-45dd-9055-0db26b8b8b1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d91ae3310734ee2a612564e6587c9ef', 'request_id': 'req-0b87ce42-e83e-45dd-9055-0db26b8b8b1b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:46.643458 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4099/8303] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:46 2022] DELETE /identity/v3/users/20a1a08bc00b4521ba3354fcff8d3d71 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:49:46.715363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0b87ce42-e83e-45dd-9055-0db26b8b8b1b admin admin] The token cache is being invalidate because project 4d91ae3310734ee2a612564e6587c9ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:46.715882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0b87ce42-e83e-45dd-9055-0db26b8b8b1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:46.716389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0b87ce42-e83e-45dd-9055-0db26b8b8b1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:46.718272 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4205/8304] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:49:46 2022] DELETE /identity/v3/projects/4d91ae3310734ee2a612564e6587c9ef => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:46.721951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e09f7-f9ee-44bb-bd88-6f0280e73310 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:46.723491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3a8e09f7-f9ee-44bb-bd88-6f0280e73310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:46.798911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8e09f7-f9ee-44bb-bd88-6f0280e73310 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:46.804055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7989ce6-6180-4975-97eb-416a953e2007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:46.805071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7989ce6-6180-4975-97eb-416a953e2007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:46.805493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7989ce6-6180-4975-97eb-416a953e2007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:46.806104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7989ce6-6180-4975-97eb-416a953e2007 admin admin] PATH_INFO: `/v3/users/58fbc71611bd4e3ba2ca17ad0dcbee4c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:46.807608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7989ce6-6180-4975-97eb-416a953e2007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58fbc71611bd4e3ba2ca17ad0dcbee4c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:46.809764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7989ce6-6180-4975-97eb-416a953e2007 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:47.005143 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:47.013526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7989ce6-6180-4975-97eb-416a953e2007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58fbc71611bd4e3ba2ca17ad0dcbee4c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:47.030450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7989ce6-6180-4975-97eb-416a953e2007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58fbc71611bd4e3ba2ca17ad0dcbee4c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:47.031647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7989ce6-6180-4975-97eb-416a953e2007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58fbc71611bd4e3ba2ca17ad0dcbee4c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:47.032330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7989ce6-6180-4975-97eb-416a953e2007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58fbc71611bd4e3ba2ca17ad0dcbee4c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:47.043328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7989ce6-6180-4975-97eb-416a953e2007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58fbc71611bd4e3ba2ca17ad0dcbee4c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:47.099272 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4100/8305] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:46 2022] DELETE /identity/v3/users/58fbc71611bd4e3ba2ca17ad0dcbee4c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:47.161787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87ce42-e83e-45dd-9055-0db26b8b8b1b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:47.164462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0b87ce42-e83e-45dd-9055-0db26b8b8b1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:47.280238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b87ce42-e83e-45dd-9055-0db26b8b8b1b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:47.371003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999abcb-83b7-40ea-8501-225b9c4bef00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:47.372146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999abcb-83b7-40ea-8501-225b9c4bef00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:47.372586 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999abcb-83b7-40ea-8501-225b9c4bef00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:47.375510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999abcb-83b7-40ea-8501-225b9c4bef00 admin admin] PATH_INFO: `/v3/projects/0969d169dec946e1b16720c7e8d21c98` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:47.378228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999abcb-83b7-40ea-8501-225b9c4bef00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0969d169dec946e1b16720c7e8d21c98)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:47.380495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999abcb-83b7-40ea-8501-225b9c4bef00 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:47.531378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c999abcb-83b7-40ea-8501-225b9c4bef00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0969d169dec946e1b16720c7e8d21c98', 'request_id': 'req-c999abcb-83b7-40ea-8501-225b9c4bef00'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:47.541908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c999abcb-83b7-40ea-8501-225b9c4bef00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0969d169dec946e1b16720c7e8d21c98', 'request_id': 'req-c999abcb-83b7-40ea-8501-225b9c4bef00'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:47.550144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c999abcb-83b7-40ea-8501-225b9c4bef00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0969d169dec946e1b16720c7e8d21c98', 'request_id': 'req-c999abcb-83b7-40ea-8501-225b9c4bef00'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:47.571470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7989ce6-6180-4975-97eb-416a953e2007 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:47.573164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f7989ce6-6180-4975-97eb-416a953e2007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:47.630773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c999abcb-83b7-40ea-8501-225b9c4bef00 admin admin] The token cache is being invalidate because project 0969d169dec946e1b16720c7e8d21c98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:47.631305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c999abcb-83b7-40ea-8501-225b9c4bef00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:47.632322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c999abcb-83b7-40ea-8501-225b9c4bef00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:47.634999 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4206/8306] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:49:47 2022] DELETE /identity/v3/projects/0969d169dec946e1b16720c7e8d21c98 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:47.636380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999abcb-83b7-40ea-8501-225b9c4bef00 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:47.643580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c999abcb-83b7-40ea-8501-225b9c4bef00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:47.670711 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:47.716602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7989ce6-6180-4975-97eb-416a953e2007 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:47.733542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999abcb-83b7-40ea-8501-225b9c4bef00 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:47.738476 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a187e3-4a3d-4479-87b7-352bd1048358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:47.739424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a187e3-4a3d-4479-87b7-352bd1048358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:47.739780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a187e3-4a3d-4479-87b7-352bd1048358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:47.740124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a187e3-4a3d-4479-87b7-352bd1048358 admin admin] PATH_INFO: `/v3/projects/71ffb46c7a504fecbc110eea5d586071` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:47.741389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a187e3-4a3d-4479-87b7-352bd1048358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71ffb46c7a504fecbc110eea5d586071)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:47.744321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a187e3-4a3d-4479-87b7-352bd1048358 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:47.785647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0586e01-fbfe-46d5-981f-db5866b6e3a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:47.786351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0586e01-fbfe-46d5-981f-db5866b6e3a8 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:47.786644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0586e01-fbfe-46d5-981f-db5866b6e3a8 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:47.786929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0586e01-fbfe-46d5-981f-db5866b6e3a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:47.788795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b0586e01-fbfe-46d5-981f-db5866b6e3a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:47.803572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0586e01-fbfe-46d5-981f-db5866b6e3a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:47.805405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0586e01-fbfe-46d5-981f-db5866b6e3a8 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:47.819089 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4101/8307] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:47.820977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71eef1d-accb-4f8f-af41-c61174b9710f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:47.821296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71eef1d-accb-4f8f-af41-c61174b9710f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:47.821568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71eef1d-accb-4f8f-af41-c61174b9710f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:47.857645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b71eef1d-accb-4f8f-af41-c61174b9710f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:47.858936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b71eef1d-accb-4f8f-af41-c61174b9710f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:47.875883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-67a187e3-4a3d-4479-87b7-352bd1048358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71ffb46c7a504fecbc110eea5d586071', 'request_id': 'req-67a187e3-4a3d-4479-87b7-352bd1048358'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:47.883503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-67a187e3-4a3d-4479-87b7-352bd1048358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71ffb46c7a504fecbc110eea5d586071', 'request_id': 'req-67a187e3-4a3d-4479-87b7-352bd1048358'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:47.891955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-67a187e3-4a3d-4479-87b7-352bd1048358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71ffb46c7a504fecbc110eea5d586071', 'request_id': 'req-67a187e3-4a3d-4479-87b7-352bd1048358'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:47.915374 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:47.955113 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4102/8308] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:47.969174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-67a187e3-4a3d-4479-87b7-352bd1048358 admin admin] The token cache is being invalidate because project 71ffb46c7a504fecbc110eea5d586071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:47.969569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-67a187e3-4a3d-4479-87b7-352bd1048358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:47.971727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-67a187e3-4a3d-4479-87b7-352bd1048358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:47.973287 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4207/8309] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:49:47 2022] DELETE /identity/v3/projects/71ffb46c7a504fecbc110eea5d586071 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:47.973404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06fb8-694f-4fbe-ac52-4852521e1c3d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:47.973731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06fb8-694f-4fbe-ac52-4852521e1c3d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:47.974080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f06fb8-694f-4fbe-ac52-4852521e1c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:47.978740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef4336-18c1-428f-9cfc-512070b3f3fd None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:47.979508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef4336-18c1-428f-9cfc-512070b3f3fd None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:47.980091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ef4336-18c1-428f-9cfc-512070b3f3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:48.001160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-24f06fb8-694f-4fbe-ac52-4852521e1c3d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:48.003574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-24f06fb8-694f-4fbe-ac52-4852521e1c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:48.016989 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4103/8310] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:49:48.017214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-75ef4336-18c1-428f-9cfc-512070b3f3fd None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:48.018023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06fb8-694f-4fbe-ac52-4852521e1c3d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:48.018485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-75ef4336-18c1-428f-9cfc-512070b3f3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:48.029022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f06fb8-694f-4fbe-ac52-4852521e1c3d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:48.030171 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4208/8311] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:48.043936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0173ea5-06f3-4e18-8ff1-7a97e965f3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:48.045326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0173ea5-06f3-4e18-8ff1-7a97e965f3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:48.045678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0173ea5-06f3-4e18-8ff1-7a97e965f3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:48.046268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0173ea5-06f3-4e18-8ff1-7a97e965f3c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:48.047461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0173ea5-06f3-4e18-8ff1-7a97e965f3c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:49:48.048258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0173ea5-06f3-4e18-8ff1-7a97e965f3c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:48.050183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0173ea5-06f3-4e18-8ff1-7a97e965f3c8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:48.066343 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4104/8312] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:49:48.071766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef4336-18c1-428f-9cfc-512070b3f3fd None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:48.084644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ef4336-18c1-428f-9cfc-512070b3f3fd None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:48.092373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0c7b8-be34-48ad-a4e6-e3118a15ab25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:48.093428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0c7b8-be34-48ad-a4e6-e3118a15ab25 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:48.093932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0c7b8-be34-48ad-a4e6-e3118a15ab25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:48.094400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0c7b8-be34-48ad-a4e6-e3118a15ab25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:48.095315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0c7b8-be34-48ad-a4e6-e3118a15ab25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:48.097788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0c7b8-be34-48ad-a4e6-e3118a15ab25 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:48.146320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9b968-62a3-4303-b640-06273a7a836e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:48.146616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9b968-62a3-4303-b640-06273a7a836e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:48.146897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9b968-62a3-4303-b640-06273a7a836e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:48.167639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d6f9b968-62a3-4303-b640-06273a7a836e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:48.168923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d6f9b968-62a3-4303-b640-06273a7a836e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:48.182036 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4105/8313] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:48.182698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9b968-62a3-4303-b640-06273a7a836e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:48.192285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9b968-62a3-4303-b640-06273a7a836e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:48.197871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598caa1-7801-4f0e-bfeb-81744ff7be1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:48.198634 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598caa1-7801-4f0e-bfeb-81744ff7be1f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:48.198921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598caa1-7801-4f0e-bfeb-81744ff7be1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:48.199202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598caa1-7801-4f0e-bfeb-81744ff7be1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:48.199945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598caa1-7801-4f0e-bfeb-81744ff7be1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:49:48.200253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598caa1-7801-4f0e-bfeb-81744ff7be1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:48.201853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9598caa1-7801-4f0e-bfeb-81744ff7be1f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:48.220246 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4209/8314] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:49:48 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:48.221478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0c7b8-be34-48ad-a4e6-e3118a15ab25 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:48.222966 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4106/8315] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:49:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:49:48.227259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598caa1-7801-4f0e-bfeb-81744ff7be1f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:48.237930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598caa1-7801-4f0e-bfeb-81744ff7be1f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:48.290063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0c7b8-be34-48ad-a4e6-e3118a15ab25 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:48.294806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee58db2-57e5-4b3e-afed-4081f06007c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:48.295528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee58db2-57e5-4b3e-afed-4081f06007c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:48.295774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee58db2-57e5-4b3e-afed-4081f06007c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:48.296050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee58db2-57e5-4b3e-afed-4081f06007c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:48.296890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee58db2-57e5-4b3e-afed-4081f06007c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:48.298548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33071b5b-ac00-45e2-8e82-16a91898b596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:48.298808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee58db2-57e5-4b3e-afed-4081f06007c0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:48.299374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33071b5b-ac00-45e2-8e82-16a91898b596 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:48.299840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33071b5b-ac00-45e2-8e82-16a91898b596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:48.300108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33071b5b-ac00-45e2-8e82-16a91898b596 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:48.300860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33071b5b-ac00-45e2-8e82-16a91898b596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:48.303074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33071b5b-ac00-45e2-8e82-16a91898b596 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:48.405709 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4210/8316] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:49:48 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:48.409640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee58db2-57e5-4b3e-afed-4081f06007c0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:48.415304 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:48.420297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee58db2-57e5-4b3e-afed-4081f06007c0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:48.426186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f56693-b0a9-4130-a0cd-89e0e1d59a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:48.426186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f56693-b0a9-4130-a0cd-89e0e1d59a07 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:48.426186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f56693-b0a9-4130-a0cd-89e0e1d59a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:48.426474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f56693-b0a9-4130-a0cd-89e0e1d59a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:48.427266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f56693-b0a9-4130-a0cd-89e0e1d59a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:48.428926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f56693-b0a9-4130-a0cd-89e0e1d59a07 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:48.439994 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4211/8317] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:49:48.443649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f56693-b0a9-4130-a0cd-89e0e1d59a07 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:48.455452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f56693-b0a9-4130-a0cd-89e0e1d59a07 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:48.459077 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4107/8318] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:49:48 2022] POST /identity/v3/projects => generated 373 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:49:48.461769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f3728-c215-4776-9407-140af440689a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:48.461892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f3728-c215-4776-9407-140af440689a admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:48.462162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f3728-c215-4776-9407-140af440689a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:48.462544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f3728-c215-4776-9407-140af440689a admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:48.463351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f3728-c215-4776-9407-140af440689a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:48.465058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f3728-c215-4776-9407-140af440689a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:48.465327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33071b5b-ac00-45e2-8e82-16a91898b596 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:48.476336 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4212/8319] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:49:48.480539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f3728-c215-4776-9407-140af440689a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:48.492583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f3728-c215-4776-9407-140af440689a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:48.531528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33071b5b-ac00-45e2-8e82-16a91898b596 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:48.536350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a226db0-b482-4bbe-823d-e0c5f68c6cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:48.537022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a226db0-b482-4bbe-823d-e0c5f68c6cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:48.537315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a226db0-b482-4bbe-823d-e0c5f68c6cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:48.537601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a226db0-b482-4bbe-823d-e0c5f68c6cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:48.538332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a226db0-b482-4bbe-823d-e0c5f68c6cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:48.540764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a226db0-b482-4bbe-823d-e0c5f68c6cb4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:48.556166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7445b520-f02a-4b74-90c5-ae9053b75442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:48.557674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445b520-f02a-4b74-90c5-ae9053b75442 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:48.558057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445b520-f02a-4b74-90c5-ae9053b75442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:48.558468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7445b520-f02a-4b74-90c5-ae9053b75442 admin admin] PATH_INFO: `/v3/projects/262817e9ee0e4e5b9ef62076e02bfe73/users/de0fb64497a34e1981255ba0826e7df1/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:48.579194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445b520-f02a-4b74-90c5-ae9053b75442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=262817e9ee0e4e5b9ef62076e02bfe73, user_id=de0fb64497a34e1981255ba0826e7df1, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:48.582028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7445b520-f02a-4b74-90c5-ae9053b75442 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:48.669362 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4108/8320] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:49:48 2022] POST /identity/v3/users => generated 287 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:48.677195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a226db0-b482-4bbe-823d-e0c5f68c6cb4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:48.689862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a226db0-b482-4bbe-823d-e0c5f68c6cb4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:48.691231 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4213/8321] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:48 2022] PUT /identity/v3/projects/262817e9ee0e4e5b9ef62076e02bfe73/users/de0fb64497a34e1981255ba0826e7df1/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:49:48.692804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e22ef-9ae5-4519-9378-553429401c52 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:48.693102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e22ef-9ae5-4519-9378-553429401c52 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:48.693568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e22ef-9ae5-4519-9378-553429401c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:48.696459 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:48.725434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5f6e22ef-9ae5-4519-9378-553429401c52 None None] MFA Rules not processed for user `de0fb64497a34e1981255ba0826e7df1`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:48.726803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5f6e22ef-9ae5-4519-9378-553429401c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:48.779680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5631a-29bd-4611-a244-fc0d0a7db4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:48.780373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5631a-29bd-4611-a244-fc0d0a7db4ba admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:48.780661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5631a-29bd-4611-a244-fc0d0a7db4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:48.780959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5631a-29bd-4611-a244-fc0d0a7db4ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:48.781720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5631a-29bd-4611-a244-fc0d0a7db4ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:48.783374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5631a-29bd-4611-a244-fc0d0a7db4ba admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:48.797282 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4109/8322] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:48.797975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5631a-29bd-4611-a244-fc0d0a7db4ba admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:48.813942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5631a-29bd-4611-a244-fc0d0a7db4ba admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:48.819659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557506b-34b2-4f6d-ae03-4d7c2cf75605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:48.820642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557506b-34b2-4f6d-ae03-4d7c2cf75605 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:48.820774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557506b-34b2-4f6d-ae03-4d7c2cf75605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:48.820963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557506b-34b2-4f6d-ae03-4d7c2cf75605 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:48.821709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557506b-34b2-4f6d-ae03-4d7c2cf75605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:48.823362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557506b-34b2-4f6d-ae03-4d7c2cf75605 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:48.829579 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4214/8323] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:48.835135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e22ef-9ae5-4519-9378-553429401c52 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:48.841072 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4110/8324] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:48.845338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557506b-34b2-4f6d-ae03-4d7c2cf75605 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:48.884233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e22ef-9ae5-4519-9378-553429401c52 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:48.884450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557506b-34b2-4f6d-ae03-4d7c2cf75605 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:48.884553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348a77d-35c2-4042-9a21-8002327dbf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:48.884553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348a77d-35c2-4042-9a21-8002327dbf78 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:48.884553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348a77d-35c2-4042-9a21-8002327dbf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:48.884553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348a77d-35c2-4042-9a21-8002327dbf78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:48.884909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348a77d-35c2-4042-9a21-8002327dbf78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:48.885002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e789e-df94-41af-970a-8fae5c24134c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:48.885002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e789e-df94-41af-970a-8fae5c24134c admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:48.885175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b348a77d-35c2-4042-9a21-8002327dbf78 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:48.885264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e789e-df94-41af-970a-8fae5c24134c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:48.885264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e789e-df94-41af-970a-8fae5c24134c admin admin] PATH_INFO: `/v3/projects/d66a68bb18184b8f8d2b06df9571c9eb/users/e1f5eff2944941e592a100faead09009/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:48.890737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e789e-df94-41af-970a-8fae5c24134c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d66a68bb18184b8f8d2b06df9571c9eb, user_id=e1f5eff2944941e592a100faead09009, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:48.893391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e789e-df94-41af-970a-8fae5c24134c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:49.077181 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4215/8325] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:49:48 2022] POST /identity/v3/projects => generated 387 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:49.083383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348a77d-35c2-4042-9a21-8002327dbf78 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:49.120776 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:49.151819 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4111/8326] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:48 2022] PUT /identity/v3/projects/d66a68bb18184b8f8d2b06df9571c9eb/users/e1f5eff2944941e592a100faead09009/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:49:49.163841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4f04e-1eca-4a1e-b519-39f9d8220d87 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:49.164884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4f04e-1eca-4a1e-b519-39f9d8220d87 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:49.165536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b4f04e-1eca-4a1e-b519-39f9d8220d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:49.170317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348a77d-35c2-4042-9a21-8002327dbf78 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:49.204409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-36b4f04e-1eca-4a1e-b519-39f9d8220d87 None None] MFA Rules not processed for user `e1f5eff2944941e592a100faead09009`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:49.205787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-36b4f04e-1eca-4a1e-b519-39f9d8220d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:49.282129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a0015-381e-499f-8ad7-3884ce0d7e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:49.283202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a0015-381e-499f-8ad7-3884ce0d7e11 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:49.283566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a0015-381e-499f-8ad7-3884ce0d7e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:49.283849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a0015-381e-499f-8ad7-3884ce0d7e11 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:49.284880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a0015-381e-499f-8ad7-3884ce0d7e11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:49.287834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04a0015-381e-499f-8ad7-3884ce0d7e11 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:49.312512 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4112/8327] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:49.317335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4f04e-1eca-4a1e-b519-39f9d8220d87 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:49.329675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b4f04e-1eca-4a1e-b519-39f9d8220d87 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:49.334921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91445bda-1e14-4680-a942-c31f34b23e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:49.342267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91445bda-1e14-4680-a942-c31f34b23e90 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:49.342267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91445bda-1e14-4680-a942-c31f34b23e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:49.342267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91445bda-1e14-4680-a942-c31f34b23e90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:49.342267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91445bda-1e14-4680-a942-c31f34b23e90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:49.342267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91445bda-1e14-4680-a942-c31f34b23e90 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:49.399262 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4216/8328] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:49:49 2022] POST /identity/v3/users => generated 300 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:49.403434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a0015-381e-499f-8ad7-3884ce0d7e11 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:49.422545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04a0015-381e-499f-8ad7-3884ce0d7e11 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:49.429293 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4113/8329] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:49:49 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:49:49.431932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91445bda-1e14-4680-a942-c31f34b23e90 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:49.432617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c00a8-b4dc-4f87-8c6c-7363741389b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:49.433306 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c00a8-b4dc-4f87-8c6c-7363741389b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:49.433668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c00a8-b4dc-4f87-8c6c-7363741389b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:49.433877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c00a8-b4dc-4f87-8c6c-7363741389b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:49.434655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c00a8-b4dc-4f87-8c6c-7363741389b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:49.436253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c00a8-b4dc-4f87-8c6c-7363741389b2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:49.448656 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4217/8330] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:49.452552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c00a8-b4dc-4f87-8c6c-7363741389b2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:49.475801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c00a8-b4dc-4f87-8c6c-7363741389b2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:49.491700 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:49.521794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91445bda-1e14-4680-a942-c31f34b23e90 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:49.543383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547acf97-8750-4d32-b439-a3bd9de3110d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:49.544360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547acf97-8750-4d32-b439-a3bd9de3110d admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:49.544817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547acf97-8750-4d32-b439-a3bd9de3110d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:49.545255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547acf97-8750-4d32-b439-a3bd9de3110d admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:49.546315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547acf97-8750-4d32-b439-a3bd9de3110d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:49.548539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547acf97-8750-4d32-b439-a3bd9de3110d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:49.554123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abf8bf-edb7-4884-8c4d-0daee2173a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:49.555079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abf8bf-edb7-4884-8c4d-0daee2173a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:49.555431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abf8bf-edb7-4884-8c4d-0daee2173a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:49.555840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90abf8bf-edb7-4884-8c4d-0daee2173a31 admin admin] PATH_INFO: `/v3/projects/c3b7228daf284ae9a21216c03f50144b/users/89ad911da5f743daa996c4582f76546e/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:49.572716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abf8bf-edb7-4884-8c4d-0daee2173a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b7228daf284ae9a21216c03f50144b, user_id=89ad911da5f743daa996c4582f76546e, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:49.575645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90abf8bf-edb7-4884-8c4d-0daee2173a31 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:49.655056 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4218/8331] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:49 2022] PUT /identity/v3/projects/c3b7228daf284ae9a21216c03f50144b/users/89ad911da5f743daa996c4582f76546e/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:49:49.656149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abf8bf-edb7-4884-8c4d-0daee2173a31 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:49.659082 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4114/8332] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:49:49 2022] POST /identity/v3/users => generated 294 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:49.663259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547acf97-8750-4d32-b439-a3bd9de3110d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:49.701630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547acf97-8750-4d32-b439-a3bd9de3110d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:49.712587 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:49.731680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90abf8bf-edb7-4884-8c4d-0daee2173a31 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:49.736982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4704682-bdc7-4e52-8112-74e4f1b88e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:49.742787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4704682-bdc7-4e52-8112-74e4f1b88e4f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:49.742787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4704682-bdc7-4e52-8112-74e4f1b88e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:49.742787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4704682-bdc7-4e52-8112-74e4f1b88e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:49.742787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4704682-bdc7-4e52-8112-74e4f1b88e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:49.742787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4704682-bdc7-4e52-8112-74e4f1b88e4f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:49.753126 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4219/8333] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:49.754145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4704682-bdc7-4e52-8112-74e4f1b88e4f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:49.759634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c4704682-bdc7-4e52-8112-74e4f1b88e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:49.776017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c147e-76b5-41a0-8fc2-adf836707a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:49.777541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c147e-76b5-41a0-8fc2-adf836707a2e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:49.777998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c147e-76b5-41a0-8fc2-adf836707a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:49.778413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c147e-76b5-41a0-8fc2-adf836707a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:49.778840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4704682-bdc7-4e52-8112-74e4f1b88e4f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:49.779348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c147e-76b5-41a0-8fc2-adf836707a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:49.781415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c147e-76b5-41a0-8fc2-adf836707a2e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:49.785546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfde79-4278-405b-8e76-b3eb4e85f318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:49.786503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfde79-4278-405b-8e76-b3eb4e85f318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:49.786939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfde79-4278-405b-8e76-b3eb4e85f318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:49.787692 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccfde79-4278-405b-8e76-b3eb4e85f318 admin admin] PATH_INFO: `/v3/users/3ee575816456473aaa301d11fa8981e0` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:49.790136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccfde79-4278-405b-8e76-b3eb4e85f318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ee575816456473aaa301d11fa8981e0)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:49.792097 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccfde79-4278-405b-8e76-b3eb4e85f318 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:49.794286 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4115/8334] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:49:49.795403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c147e-76b5-41a0-8fc2-adf836707a2e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:49.819900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c147e-76b5-41a0-8fc2-adf836707a2e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:49.832136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9980eff-aa35-480a-b4fe-349537f1c073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:49.833207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9980eff-aa35-480a-b4fe-349537f1c073 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:49.833597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9980eff-aa35-480a-b4fe-349537f1c073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:49.834023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9980eff-aa35-480a-b4fe-349537f1c073 admin admin] PATH_INFO: `/v3/projects/c3b7228daf284ae9a21216c03f50144b/users/89ad911da5f743daa996c4582f76546e/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:49.836297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9980eff-aa35-480a-b4fe-349537f1c073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b7228daf284ae9a21216c03f50144b, user_id=89ad911da5f743daa996c4582f76546e, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:49.839606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9980eff-aa35-480a-b4fe-349537f1c073 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:49.855201 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4116/8335] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:49 2022] PUT /identity/v3/projects/c3b7228daf284ae9a21216c03f50144b/users/89ad911da5f743daa996c4582f76546e/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:49.856149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9980eff-aa35-480a-b4fe-349537f1c073 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:49.951866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9980eff-aa35-480a-b4fe-349537f1c073 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:49.956976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f01c7-2c2b-4598-8ed4-f68be68faa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:49.957902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f01c7-2c2b-4598-8ed4-f68be68faa6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:49.958360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f01c7-2c2b-4598-8ed4-f68be68faa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:49.958648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f01c7-2c2b-4598-8ed4-f68be68faa6e admin admin] PATH_INFO: `/v3/projects/b8fa49314df14aaba05d138ebf7b7f38/users/7f61e9bb1b854546aec618697636dde5/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:49.984508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4ccfde79-4278-405b-8e76-b3eb4e85f318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ee575816456473aaa301d11fa8981e0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:49.987821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f01c7-2c2b-4598-8ed4-f68be68faa6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8fa49314df14aaba05d138ebf7b7f38, user_id=7f61e9bb1b854546aec618697636dde5, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:49.990793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1f01c7-2c2b-4598-8ed4-f68be68faa6e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:50.007580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4ccfde79-4278-405b-8e76-b3eb4e85f318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ee575816456473aaa301d11fa8981e0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:50.015976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4ccfde79-4278-405b-8e76-b3eb4e85f318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ee575816456473aaa301d11fa8981e0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:50.016754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4ccfde79-4278-405b-8e76-b3eb4e85f318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ee575816456473aaa301d11fa8981e0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:50.076119 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4117/8336] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:49 2022] PUT /identity/v3/projects/b8fa49314df14aaba05d138ebf7b7f38/users/7f61e9bb1b854546aec618697636dde5/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:50.078338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24756072-8751-4c65-aae4-fb2112a6fbae None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:50.079021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24756072-8751-4c65-aae4-fb2112a6fbae None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:50.079192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24756072-8751-4c65-aae4-fb2112a6fbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:50.089607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4ccfde79-4278-405b-8e76-b3eb4e85f318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ee575816456473aaa301d11fa8981e0'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:50.097765 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4220/8337] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:49 2022] DELETE /identity/v3/users/3ee575816456473aaa301d11fa8981e0 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:50.098982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfde79-4278-405b-8e76-b3eb4e85f318 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:50.100964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4ccfde79-4278-405b-8e76-b3eb4e85f318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:50.119176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-24756072-8751-4c65-aae4-fb2112a6fbae None None] MFA Rules not processed for user `89ad911da5f743daa996c4582f76546e`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:50.120352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-24756072-8751-4c65-aae4-fb2112a6fbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:50.145456 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:50.209403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccfde79-4278-405b-8e76-b3eb4e85f318 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:50.219744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909db7ef-b7d0-40b1-b0c0-29061f7ec081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:50.220893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909db7ef-b7d0-40b1-b0c0-29061f7ec081 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:50.223467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909db7ef-b7d0-40b1-b0c0-29061f7ec081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:50.223723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909db7ef-b7d0-40b1-b0c0-29061f7ec081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:50.224587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909db7ef-b7d0-40b1-b0c0-29061f7ec081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:50.227867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909db7ef-b7d0-40b1-b0c0-29061f7ec081 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:50.233162 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4118/8338] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:50.234452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd3d49-a706-492b-88d7-b58e8293e1bd None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:50.234860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd3d49-a706-492b-88d7-b58e8293e1bd None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:50.235155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fd3d49-a706-492b-88d7-b58e8293e1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:50.247896 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4221/8339] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:50.249596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909db7ef-b7d0-40b1-b0c0-29061f7ec081 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:50.252547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-909db7ef-b7d0-40b1-b0c0-29061f7ec081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:50.271114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c4fd3d49-a706-492b-88d7-b58e8293e1bd None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:50.272336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c4fd3d49-a706-492b-88d7-b58e8293e1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:50.283127 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4119/8340] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:50.283940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd3d49-a706-492b-88d7-b58e8293e1bd None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:50.299191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fd3d49-a706-492b-88d7-b58e8293e1bd None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:50.308167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b6e59-16c3-40ba-babf-44777d405fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:50.310239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b6e59-16c3-40ba-babf-44777d405fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:50.310681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b6e59-16c3-40ba-babf-44777d405fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:50.311148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b6e59-16c3-40ba-babf-44777d405fe9 admin admin] PATH_INFO: `/v3/projects/b8fa49314df14aaba05d138ebf7b7f38/users/7f61e9bb1b854546aec618697636dde5/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:50.315780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b6e59-16c3-40ba-babf-44777d405fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8fa49314df14aaba05d138ebf7b7f38, user_id=7f61e9bb1b854546aec618697636dde5, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:50.318458 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:50.321126 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b6e59-16c3-40ba-babf-44777d405fe9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:50.334930 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4120/8341] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:50 2022] PUT /identity/v3/projects/b8fa49314df14aaba05d138ebf7b7f38/users/7f61e9bb1b854546aec618697636dde5/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:50.335772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909db7ef-b7d0-40b1-b0c0-29061f7ec081 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:50.337029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b6e59-16c3-40ba-babf-44777d405fe9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:50.339469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-054b6e59-16c3-40ba-babf-44777d405fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:50.416218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef7c02-6ec2-448b-a848-982c4262d8d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:50.416923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef7c02-6ec2-448b-a848-982c4262d8d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:50.417213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef7c02-6ec2-448b-a848-982c4262d8d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:50.417497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef7c02-6ec2-448b-a848-982c4262d8d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:50.423256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b6e59-16c3-40ba-babf-44777d405fe9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:50.427035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090325c6-3eb0-48cf-b16c-117822b71012 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:50.427764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090325c6-3eb0-48cf-b16c-117822b71012 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:50.428120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090325c6-3eb0-48cf-b16c-117822b71012 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:50.428675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090325c6-3eb0-48cf-b16c-117822b71012 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:50.485065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef7c02-6ec2-448b-a848-982c4262d8d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:50.493513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef7c02-6ec2-448b-a848-982c4262d8d1 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:50.501522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090325c6-3eb0-48cf-b16c-117822b71012 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:50.506818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090325c6-3eb0-48cf-b16c-117822b71012 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:50.506951 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4222/8342] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:50.507200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9bce2-3d6f-430e-8b5b-019d8a7f4cb4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:50.507823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9bce2-3d6f-430e-8b5b-019d8a7f4cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:50.508210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e9bce2-3d6f-430e-8b5b-019d8a7f4cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:50.515143 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4121/8343] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:50.541324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e9e9bce2-3d6f-430e-8b5b-019d8a7f4cb4 None None] MFA Rules not processed for user `7f61e9bb1b854546aec618697636dde5`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:50.542752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e9e9bce2-3d6f-430e-8b5b-019d8a7f4cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:50.605690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090325c6-3eb0-48cf-b16c-117822b71012 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:50.608360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-090325c6-3eb0-48cf-b16c-117822b71012 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:50.630732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090325c6-3eb0-48cf-b16c-117822b71012 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:50.642307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc161a-71f7-4a59-8f52-55729d79f455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:50.642307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc161a-71f7-4a59-8f52-55729d79f455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:50.642307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc161a-71f7-4a59-8f52-55729d79f455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:50.642307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc161a-71f7-4a59-8f52-55729d79f455 admin admin] PATH_INFO: `/v3/users/de0fb64497a34e1981255ba0826e7df1` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:50.643346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc161a-71f7-4a59-8f52-55729d79f455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de0fb64497a34e1981255ba0826e7df1)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:50.646256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc161a-71f7-4a59-8f52-55729d79f455 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:50.653539 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4223/8344] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:50.669527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9bce2-3d6f-430e-8b5b-019d8a7f4cb4 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:50.682886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e9bce2-3d6f-430e-8b5b-019d8a7f4cb4 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:50.687559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e22f00-0584-4732-84ed-2d72303f68ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:50.689508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e22f00-0584-4732-84ed-2d72303f68ae service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:50.690250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e22f00-0584-4732-84ed-2d72303f68ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:50.690548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e22f00-0584-4732-84ed-2d72303f68ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:50.692654 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c4e22f00-0584-4732-84ed-2d72303f68ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:50.774433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e22f00-0584-4732-84ed-2d72303f68ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:50.776136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e22f00-0584-4732-84ed-2d72303f68ae service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:50.789114 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4224/8345] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:49:50.802859 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:50.824584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e22f00-0584-4732-84ed-2d72303f68ae service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:50.826277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c4e22f00-0584-4732-84ed-2d72303f68ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:50.854842 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:50.866079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a2bc161a-71f7-4a59-8f52-55729d79f455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de0fb64497a34e1981255ba0826e7df1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:50.885783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a2bc161a-71f7-4a59-8f52-55729d79f455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de0fb64497a34e1981255ba0826e7df1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:50.886871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a2bc161a-71f7-4a59-8f52-55729d79f455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de0fb64497a34e1981255ba0826e7df1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:50.897074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a2bc161a-71f7-4a59-8f52-55729d79f455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de0fb64497a34e1981255ba0826e7df1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:50.906795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a2bc161a-71f7-4a59-8f52-55729d79f455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de0fb64497a34e1981255ba0826e7df1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:50.934299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e22f00-0584-4732-84ed-2d72303f68ae service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:50.940264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2564865b-11f7-46aa-8708-fa941556f717 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:50.940934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564865b-11f7-46aa-8708-fa941556f717 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:50.941225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564865b-11f7-46aa-8708-fa941556f717 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:50.941511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2564865b-11f7-46aa-8708-fa941556f717 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:50.943431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2564865b-11f7-46aa-8708-fa941556f717 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:50.961195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564865b-11f7-46aa-8708-fa941556f717 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:50.963482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2564865b-11f7-46aa-8708-fa941556f717 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:50.979116 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4225/8346] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:51.002441 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4122/8347] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:50 2022] DELETE /identity/v3/users/de0fb64497a34e1981255ba0826e7df1 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:51.004139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6cdc0-42a8-4358-a807-befe93191fc7 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:51.004439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6cdc0-42a8-4358-a807-befe93191fc7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:51.004724 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd6cdc0-42a8-4358-a807-befe93191fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:51.029514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ccd6cdc0-42a8-4358-a807-befe93191fc7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:51.029514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ccd6cdc0-42a8-4358-a807-befe93191fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:51.057775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc161a-71f7-4a59-8f52-55729d79f455 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:51.062915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a2bc161a-71f7-4a59-8f52-55729d79f455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:51.113576 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4226/8348] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:51.126116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6cdc0-42a8-4358-a807-befe93191fc7 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:51.127595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ccd6cdc0-42a8-4358-a807-befe93191fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:51.170321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc161a-71f7-4a59-8f52-55729d79f455 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:51.175206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12319e07-f0ee-40c6-ae7e-920ce78761e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:51.176091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12319e07-f0ee-40c6-ae7e-920ce78761e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:51.176382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12319e07-f0ee-40c6-ae7e-920ce78761e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:51.176798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12319e07-f0ee-40c6-ae7e-920ce78761e4 admin admin] PATH_INFO: `/v3/projects/15176274560149248146480a6010d23d` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:51.178073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12319e07-f0ee-40c6-ae7e-920ce78761e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15176274560149248146480a6010d23d)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:51.180617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12319e07-f0ee-40c6-ae7e-920ce78761e4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:51.215807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd6cdc0-42a8-4358-a807-befe93191fc7 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:51.227212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631c9ca-33d3-4382-b150-83ec15f5a488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:51.227966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631c9ca-33d3-4382-b150-83ec15f5a488 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:51.228331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631c9ca-33d3-4382-b150-83ec15f5a488 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:51.228681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631c9ca-33d3-4382-b150-83ec15f5a488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:51.240563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631c9ca-33d3-4382-b150-83ec15f5a488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:51.242623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631c9ca-33d3-4382-b150-83ec15f5a488 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:51.255310 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4227/8349] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:51.309008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-12319e07-f0ee-40c6-ae7e-920ce78761e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15176274560149248146480a6010d23d', 'request_id': 'req-12319e07-f0ee-40c6-ae7e-920ce78761e4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:51.425185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-12319e07-f0ee-40c6-ae7e-920ce78761e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15176274560149248146480a6010d23d', 'request_id': 'req-12319e07-f0ee-40c6-ae7e-920ce78761e4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:51.432893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-12319e07-f0ee-40c6-ae7e-920ce78761e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15176274560149248146480a6010d23d', 'request_id': 'req-12319e07-f0ee-40c6-ae7e-920ce78761e4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:51.443186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-12319e07-f0ee-40c6-ae7e-920ce78761e4 admin admin] The token cache is being invalidate because project 15176274560149248146480a6010d23d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:51.443470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-12319e07-f0ee-40c6-ae7e-920ce78761e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:51.444108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-12319e07-f0ee-40c6-ae7e-920ce78761e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:51.445827 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4123/8350] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:49:51 2022] DELETE /identity/v3/projects/15176274560149248146480a6010d23d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:51.449653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631c9ca-33d3-4382-b150-83ec15f5a488 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:51.459895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631c9ca-33d3-4382-b150-83ec15f5a488 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:51.464199 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:51.528376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f4929-42c4-4d8c-a772-c4e2339fefa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:51.529288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f4929-42c4-4d8c-a772-c4e2339fefa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:51.529576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f4929-42c4-4d8c-a772-c4e2339fefa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:51.529929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f4929-42c4-4d8c-a772-c4e2339fefa0 admin admin] PATH_INFO: `/v3/users/308d12ee7a124f89b1246ebbdbb2ef18` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:51.531186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f4929-42c4-4d8c-a772-c4e2339fefa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=308d12ee7a124f89b1246ebbdbb2ef18)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:51.533505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24f4929-42c4-4d8c-a772-c4e2339fefa0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:51.694649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e24f4929-42c4-4d8c-a772-c4e2339fefa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '308d12ee7a124f89b1246ebbdbb2ef18'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:51.709895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e24f4929-42c4-4d8c-a772-c4e2339fefa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '308d12ee7a124f89b1246ebbdbb2ef18'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:51.717865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e24f4929-42c4-4d8c-a772-c4e2339fefa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '308d12ee7a124f89b1246ebbdbb2ef18'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:51.718801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e24f4929-42c4-4d8c-a772-c4e2339fefa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '308d12ee7a124f89b1246ebbdbb2ef18'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:51.764095 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12319e07-f0ee-40c6-ae7e-920ce78761e4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:51.766397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-12319e07-f0ee-40c6-ae7e-920ce78761e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:51.780632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12319e07-f0ee-40c6-ae7e-920ce78761e4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:51.785569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7aa68-523c-4b17-9112-5afc75866021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:51.786486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7aa68-523c-4b17-9112-5afc75866021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:51.786783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7aa68-523c-4b17-9112-5afc75866021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:51.787066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7aa68-523c-4b17-9112-5afc75866021 admin admin] PATH_INFO: `/v3/projects/262817e9ee0e4e5b9ef62076e02bfe73` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:51.788295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7aa68-523c-4b17-9112-5afc75866021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=262817e9ee0e4e5b9ef62076e02bfe73)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:51.790821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea7aa68-523c-4b17-9112-5afc75866021 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:51.791318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e24f4929-42c4-4d8c-a772-c4e2339fefa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '308d12ee7a124f89b1246ebbdbb2ef18'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:51.801157 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4228/8351] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:51 2022] DELETE /identity/v3/users/308d12ee7a124f89b1246ebbdbb2ef18 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:51.979604 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:51.983340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bea7aa68-523c-4b17-9112-5afc75866021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '262817e9ee0e4e5b9ef62076e02bfe73', 'request_id': 'req-bea7aa68-523c-4b17-9112-5afc75866021'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:52.082309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bea7aa68-523c-4b17-9112-5afc75866021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '262817e9ee0e4e5b9ef62076e02bfe73', 'request_id': 'req-bea7aa68-523c-4b17-9112-5afc75866021'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:52.095575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bea7aa68-523c-4b17-9112-5afc75866021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '262817e9ee0e4e5b9ef62076e02bfe73', 'request_id': 'req-bea7aa68-523c-4b17-9112-5afc75866021'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:52.113640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bea7aa68-523c-4b17-9112-5afc75866021 admin admin] The token cache is being invalidate because project 262817e9ee0e4e5b9ef62076e02bfe73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:52.114005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bea7aa68-523c-4b17-9112-5afc75866021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:52.116589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bea7aa68-523c-4b17-9112-5afc75866021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:52.121389 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4124/8352] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:49:51 2022] DELETE /identity/v3/projects/262817e9ee0e4e5b9ef62076e02bfe73 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:49:52.122513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f4929-42c4-4d8c-a772-c4e2339fefa0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:52.123958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e24f4929-42c4-4d8c-a772-c4e2339fefa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:52.204158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24f4929-42c4-4d8c-a772-c4e2339fefa0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:52.245830 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:52.258333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7aa68-523c-4b17-9112-5afc75866021 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:52.260092 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bea7aa68-523c-4b17-9112-5afc75866021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:52.283302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd78ae-40bb-47c1-a212-734dec512f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:52.284671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd78ae-40bb-47c1-a212-734dec512f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:52.284899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd78ae-40bb-47c1-a212-734dec512f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:52.285178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd78ae-40bb-47c1-a212-734dec512f00 admin admin] PATH_INFO: `/v3/users/89ad911da5f743daa996c4582f76546e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:52.287193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd78ae-40bb-47c1-a212-734dec512f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ad911da5f743daa996c4582f76546e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:52.289159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd78ae-40bb-47c1-a212-734dec512f00 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:52.366815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea7aa68-523c-4b17-9112-5afc75866021 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:52.373470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68cc587-6830-4853-b6dc-3ae651a1a621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:52.374674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cc587-6830-4853-b6dc-3ae651a1a621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:52.375112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cc587-6830-4853-b6dc-3ae651a1a621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:52.375564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68cc587-6830-4853-b6dc-3ae651a1a621 admin admin] PATH_INFO: `/v3/projects/c83e47ce79cf4fef84f50252ac5023fb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:52.377088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cc587-6830-4853-b6dc-3ae651a1a621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c83e47ce79cf4fef84f50252ac5023fb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:52.380612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68cc587-6830-4853-b6dc-3ae651a1a621 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:52.533052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b68cc587-6830-4853-b6dc-3ae651a1a621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c83e47ce79cf4fef84f50252ac5023fb', 'request_id': 'req-b68cc587-6830-4853-b6dc-3ae651a1a621'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:52.533417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d7cd78ae-40bb-47c1-a212-734dec512f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ad911da5f743daa996c4582f76546e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:52.548665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d7cd78ae-40bb-47c1-a212-734dec512f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ad911da5f743daa996c4582f76546e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:52.556769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d7cd78ae-40bb-47c1-a212-734dec512f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ad911da5f743daa996c4582f76546e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:52.557761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d7cd78ae-40bb-47c1-a212-734dec512f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ad911da5f743daa996c4582f76546e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:52.604159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b68cc587-6830-4853-b6dc-3ae651a1a621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c83e47ce79cf4fef84f50252ac5023fb', 'request_id': 'req-b68cc587-6830-4853-b6dc-3ae651a1a621'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:52.611534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b68cc587-6830-4853-b6dc-3ae651a1a621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c83e47ce79cf4fef84f50252ac5023fb', 'request_id': 'req-b68cc587-6830-4853-b6dc-3ae651a1a621'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:52.633324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b68cc587-6830-4853-b6dc-3ae651a1a621 admin admin] The token cache is being invalidate because project c83e47ce79cf4fef84f50252ac5023fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:52.633980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b68cc587-6830-4853-b6dc-3ae651a1a621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:52.634910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-b68cc587-6830-4853-b6dc-3ae651a1a621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:52.637319 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4125/8353] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:49:52 2022] DELETE /identity/v3/projects/c83e47ce79cf4fef84f50252ac5023fb => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:52.643470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf1730-230f-45e0-84e4-efb2b7c4344a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:52.645542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf1730-230f-45e0-84e4-efb2b7c4344a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:52.645542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdf1730-230f-45e0-84e4-efb2b7c4344a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:52.681508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d7cd78ae-40bb-47c1-a212-734dec512f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ad911da5f743daa996c4582f76546e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:52.694253 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4229/8354] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:52 2022] DELETE /identity/v3/users/89ad911da5f743daa996c4582f76546e => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:52.702225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-acdf1730-230f-45e0-84e4-efb2b7c4344a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:52.704002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-acdf1730-230f-45e0-84e4-efb2b7c4344a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:52.747783 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:52.785532 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4126/8355] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:52.793732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa75a31-8c7c-4f9c-8888-12b9b4d73203 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:52.794266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa75a31-8c7c-4f9c-8888-12b9b4d73203 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:52.794381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa75a31-8c7c-4f9c-8888-12b9b4d73203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:52.817354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7fa75a31-8c7c-4f9c-8888-12b9b4d73203 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:52.819037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7fa75a31-8c7c-4f9c-8888-12b9b4d73203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:52.832015 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4230/8356] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:52.832942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf1730-230f-45e0-84e4-efb2b7c4344a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:52.844706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdf1730-230f-45e0-84e4-efb2b7c4344a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:52.850297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dec6fd-4c54-4b4d-9f14-0c4b28ecf2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:52.864805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dec6fd-4c54-4b4d-9f14-0c4b28ecf2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:52.864805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dec6fd-4c54-4b4d-9f14-0c4b28ecf2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:52.864805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dec6fd-4c54-4b4d-9f14-0c4b28ecf2a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:52.864805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dec6fd-4c54-4b4d-9f14-0c4b28ecf2a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:49:52.864805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dec6fd-4c54-4b4d-9f14-0c4b28ecf2a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:52.864805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dec6fd-4c54-4b4d-9f14-0c4b28ecf2a3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:52.870133 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4127/8357] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:49:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:49:52.872773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa75a31-8c7c-4f9c-8888-12b9b4d73203 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:52.882513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa75a31-8c7c-4f9c-8888-12b9b4d73203 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:52.887832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2158ab-5634-45ec-91dd-b33c2fa29772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:52.888950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2158ab-5634-45ec-91dd-b33c2fa29772 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:52.888950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2158ab-5634-45ec-91dd-b33c2fa29772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:52.888950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2158ab-5634-45ec-91dd-b33c2fa29772 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:52.892905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2158ab-5634-45ec-91dd-b33c2fa29772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:52.892905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2158ab-5634-45ec-91dd-b33c2fa29772 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:53.075146 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4231/8358] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:49:52 2022] POST /identity/v3/projects => generated 361 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:53.079891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dec6fd-4c54-4b4d-9f14-0c4b28ecf2a3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:53.095040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dec6fd-4c54-4b4d-9f14-0c4b28ecf2a3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:53.164524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffaf9fb-e64a-4218-925b-4c89c479ffc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:53.164946 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffaf9fb-e64a-4218-925b-4c89c479ffc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:53.165645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffaf9fb-e64a-4218-925b-4c89c479ffc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:53.165757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffaf9fb-e64a-4218-925b-4c89c479ffc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:53.167012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffaf9fb-e64a-4218-925b-4c89c479ffc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:53.168819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffaf9fb-e64a-4218-925b-4c89c479ffc9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:53.267930 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4128/8359] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:49:53 2022] POST /identity/v3/users => generated 281 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:53.272274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2158ab-5634-45ec-91dd-b33c2fa29772 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:53.284000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2158ab-5634-45ec-91dd-b33c2fa29772 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:53.297193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7c2aa-75ca-40d5-804e-299cdb31a29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:53.297193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7c2aa-75ca-40d5-804e-299cdb31a29c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:53.297193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7c2aa-75ca-40d5-804e-299cdb31a29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:53.297193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d7c2aa-75ca-40d5-804e-299cdb31a29c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:53.297521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7c2aa-75ca-40d5-804e-299cdb31a29c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:53.297521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d7c2aa-75ca-40d5-804e-299cdb31a29c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:53.299668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffaf9fb-e64a-4218-925b-4c89c479ffc9 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:53.305147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cffaf9fb-e64a-4218-925b-4c89c479ffc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:53.308390 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4232/8360] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:53.312083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7c2aa-75ca-40d5-804e-299cdb31a29c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:53.327606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffaf9fb-e64a-4218-925b-4c89c479ffc9 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:53.333750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d7c2aa-75ca-40d5-804e-299cdb31a29c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:53.339121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220580ea-f8c3-4665-875b-afe04ae8f7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:53.339771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220580ea-f8c3-4665-875b-afe04ae8f7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:53.340064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220580ea-f8c3-4665-875b-afe04ae8f7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:53.340347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220580ea-f8c3-4665-875b-afe04ae8f7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:53.341105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220580ea-f8c3-4665-875b-afe04ae8f7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:53.342809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220580ea-f8c3-4665-875b-afe04ae8f7e7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:53.342967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9d199-c518-4d01-b81c-db61610b0801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:53.343867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9d199-c518-4d01-b81c-db61610b0801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:53.344291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9d199-c518-4d01-b81c-db61610b0801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:53.344580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9d199-c518-4d01-b81c-db61610b0801 admin admin] PATH_INFO: `/v3/projects/c3b7228daf284ae9a21216c03f50144b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:53.346070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9d199-c518-4d01-b81c-db61610b0801 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3b7228daf284ae9a21216c03f50144b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:53.348372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9d199-c518-4d01-b81c-db61610b0801 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:53.358749 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4233/8361] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:53.359570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220580ea-f8c3-4665-875b-afe04ae8f7e7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:53.373454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220580ea-f8c3-4665-875b-afe04ae8f7e7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:53.380728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5e06b-1bf9-4fe0-98f9-a8c4f15f3b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:53.381779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5e06b-1bf9-4fe0-98f9-a8c4f15f3b1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:53.382141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5e06b-1bf9-4fe0-98f9-a8c4f15f3b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:53.382412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5e06b-1bf9-4fe0-98f9-a8c4f15f3b1a admin admin] PATH_INFO: `/v3/projects/e238d505674b46278b419751dafbab49/users/87faa383463a4aa6aaa5e902ac0d6276/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:53.399732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5e06b-1bf9-4fe0-98f9-a8c4f15f3b1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e238d505674b46278b419751dafbab49, user_id=87faa383463a4aa6aaa5e902ac0d6276, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:53.402481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5e06b-1bf9-4fe0-98f9-a8c4f15f3b1a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:53.519623 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4234/8362] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:53 2022] PUT /identity/v3/projects/e238d505674b46278b419751dafbab49/users/87faa383463a4aa6aaa5e902ac0d6276/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:49:53.521290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091c8db-b14d-4fa6-a3dc-e6c8be2761de None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:53.521671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091c8db-b14d-4fa6-a3dc-e6c8be2761de None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:53.521947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091c8db-b14d-4fa6-a3dc-e6c8be2761de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:53.526237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ce9d199-c518-4d01-b81c-db61610b0801 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3b7228daf284ae9a21216c03f50144b', 'request_id': 'req-7ce9d199-c518-4d01-b81c-db61610b0801'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:53.553216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c091c8db-b14d-4fa6-a3dc-e6c8be2761de None None] MFA Rules not processed for user `87faa383463a4aa6aaa5e902ac0d6276`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:53.555044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c091c8db-b14d-4fa6-a3dc-e6c8be2761de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:53.588336 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:53.610860 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ce9d199-c518-4d01-b81c-db61610b0801 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3b7228daf284ae9a21216c03f50144b', 'request_id': 'req-7ce9d199-c518-4d01-b81c-db61610b0801'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:53.619994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ce9d199-c518-4d01-b81c-db61610b0801 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3b7228daf284ae9a21216c03f50144b', 'request_id': 'req-7ce9d199-c518-4d01-b81c-db61610b0801'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:53.632357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ce9d199-c518-4d01-b81c-db61610b0801 admin admin] The token cache is being invalidate because project c3b7228daf284ae9a21216c03f50144b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:53.633261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ce9d199-c518-4d01-b81c-db61610b0801 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:53.634130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7ce9d199-c518-4d01-b81c-db61610b0801 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:53.636254 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4129/8363] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:49:53 2022] DELETE /identity/v3/projects/c3b7228daf284ae9a21216c03f50144b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:53.641223 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4235/8364] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:53.641377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48cb7d-fdbe-45ea-a1c2-718d4df6f361 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:53.641377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48cb7d-fdbe-45ea-a1c2-718d4df6f361 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:53.646306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a48cb7d-fdbe-45ea-a1c2-718d4df6f361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:53.688907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9a48cb7d-fdbe-45ea-a1c2-718d4df6f361 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:53.688907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9a48cb7d-fdbe-45ea-a1c2-718d4df6f361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:53.689150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091c8db-b14d-4fa6-a3dc-e6c8be2761de None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:53.689150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c091c8db-b14d-4fa6-a3dc-e6c8be2761de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:53.705426 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:53.738162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091c8db-b14d-4fa6-a3dc-e6c8be2761de None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:53.742604 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4130/8365] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:49:53.746486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccd197-a512-4820-979a-2dbe00d6b795 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:53.747093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f59b6-7186-4ad0-85af-eafebb385ba3 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:53.747457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f59b6-7186-4ad0-85af-eafebb385ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:53.747736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f59b6-7186-4ad0-85af-eafebb385ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:53.748090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccd197-a512-4820-979a-2dbe00d6b795 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:53.748387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccd197-a512-4820-979a-2dbe00d6b795 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:53.748669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eccd197-a512-4820-979a-2dbe00d6b795 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:53.750508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4eccd197-a512-4820-979a-2dbe00d6b795 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:53.764156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccd197-a512-4820-979a-2dbe00d6b795 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:53.765766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eccd197-a512-4820-979a-2dbe00d6b795 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:53.768718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-945f59b6-7186-4ad0-85af-eafebb385ba3 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:53.769972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-945f59b6-7186-4ad0-85af-eafebb385ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:53.791205 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4236/8366] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:49:53.791651 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4131/8367] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:53.792315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccd197-a512-4820-979a-2dbe00d6b795 service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:53.799806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eccd197-a512-4820-979a-2dbe00d6b795 service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:53.800522 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f59b6-7186-4ad0-85af-eafebb385ba3 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:53.802083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-945f59b6-7186-4ad0-85af-eafebb385ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:53.807455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873aa229-276d-4a57-a752-1a6e5dd7f0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:53.809106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873aa229-276d-4a57-a752-1a6e5dd7f0ed admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:53.809106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873aa229-276d-4a57-a752-1a6e5dd7f0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:53.814091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873aa229-276d-4a57-a752-1a6e5dd7f0ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:53.814091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873aa229-276d-4a57-a752-1a6e5dd7f0ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:49:53.814091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873aa229-276d-4a57-a752-1a6e5dd7f0ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:53.814091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873aa229-276d-4a57-a752-1a6e5dd7f0ed admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:53.824073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f59b6-7186-4ad0-85af-eafebb385ba3 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:53.833428 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4237/8368] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:49:53.839313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5d122-8ae9-4fc9-9dbb-4dd02f72387c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:53.839313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5d122-8ae9-4fc9-9dbb-4dd02f72387c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:53.839313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5d122-8ae9-4fc9-9dbb-4dd02f72387c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:53.839313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5d122-8ae9-4fc9-9dbb-4dd02f72387c admin admin] PATH_INFO: `/v3/users/87faa383463a4aa6aaa5e902ac0d6276` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:53.839604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5d122-8ae9-4fc9-9dbb-4dd02f72387c admin admin] RBAC: Authorizing `identity:delete_user(user_id=87faa383463a4aa6aaa5e902ac0d6276)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:53.839604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5d122-8ae9-4fc9-9dbb-4dd02f72387c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:53.841033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873aa229-276d-4a57-a752-1a6e5dd7f0ed admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:53.857501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873aa229-276d-4a57-a752-1a6e5dd7f0ed admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:53.863632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb908e33-cd8e-46a8-ac5d-ebc56917b4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:53.864686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb908e33-cd8e-46a8-ac5d-ebc56917b4e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:53.865483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb908e33-cd8e-46a8-ac5d-ebc56917b4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:53.866198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb908e33-cd8e-46a8-ac5d-ebc56917b4e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:53.867211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb908e33-cd8e-46a8-ac5d-ebc56917b4e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:53.869374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb908e33-cd8e-46a8-ac5d-ebc56917b4e6 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:54.012925 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4238/8369] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:49:53 2022] POST /identity/v3/projects => generated 389 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:49:54.017181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb908e33-cd8e-46a8-ac5d-ebc56917b4e6 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:54.087869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb908e33-cd8e-46a8-ac5d-ebc56917b4e6 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:54.093562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dacbc6-2ec1-4109-941d-b51315f3c461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:54.094255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dacbc6-2ec1-4109-941d-b51315f3c461 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:54.094538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dacbc6-2ec1-4109-941d-b51315f3c461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:54.094817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dacbc6-2ec1-4109-941d-b51315f3c461 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:54.095516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dacbc6-2ec1-4109-941d-b51315f3c461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:54.097445 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dacbc6-2ec1-4109-941d-b51315f3c461 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:54.139032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a2b5d122-8ae9-4fc9-9dbb-4dd02f72387c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87faa383463a4aa6aaa5e902ac0d6276'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:54.152080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a2b5d122-8ae9-4fc9-9dbb-4dd02f72387c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87faa383463a4aa6aaa5e902ac0d6276'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:54.152878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a2b5d122-8ae9-4fc9-9dbb-4dd02f72387c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87faa383463a4aa6aaa5e902ac0d6276'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:54.153489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a2b5d122-8ae9-4fc9-9dbb-4dd02f72387c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87faa383463a4aa6aaa5e902ac0d6276'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:54.161172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a2b5d122-8ae9-4fc9-9dbb-4dd02f72387c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87faa383463a4aa6aaa5e902ac0d6276'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:54.211522 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4239/8370] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:49:54 2022] POST /identity/v3/users => generated 295 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:49:54.215829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dacbc6-2ec1-4109-941d-b51315f3c461 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:54.218298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a1dacbc6-2ec1-4109-941d-b51315f3c461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:54.235230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dacbc6-2ec1-4109-941d-b51315f3c461 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:54.240565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fc072-5ba1-4ba3-9391-261577d1847d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:54.241535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fc072-5ba1-4ba3-9391-261577d1847d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:54.241744 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fc072-5ba1-4ba3-9391-261577d1847d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:54.242561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fc072-5ba1-4ba3-9391-261577d1847d admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:54.243740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fc072-5ba1-4ba3-9391-261577d1847d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:54.246946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fc072-5ba1-4ba3-9391-261577d1847d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:54.260013 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4240/8371] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:54.264237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fc072-5ba1-4ba3-9391-261577d1847d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:54.267204 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4132/8372] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:53 2022] DELETE /identity/v3/users/87faa383463a4aa6aaa5e902ac0d6276 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:54.271707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43bdf6-246f-4abb-9e23-e56ded852f60 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:54.272627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43bdf6-246f-4abb-9e23-e56ded852f60 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:54.272912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb43bdf6-246f-4abb-9e23-e56ded852f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:54.277112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fc072-5ba1-4ba3-9391-261577d1847d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:54.286623 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:54.292581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-eb43bdf6-246f-4abb-9e23-e56ded852f60 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:54.293802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eb43bdf6-246f-4abb-9e23-e56ded852f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:54.340862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea23f1-dcb5-4117-9c75-5fe7aad8aa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:54.341606 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea23f1-dcb5-4117-9c75-5fe7aad8aa38 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:54.342890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea23f1-dcb5-4117-9c75-5fe7aad8aa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:54.342890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acea23f1-dcb5-4117-9c75-5fe7aad8aa38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:54.343646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea23f1-dcb5-4117-9c75-5fe7aad8aa38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:54.346069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acea23f1-dcb5-4117-9c75-5fe7aad8aa38 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:54.360192 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4241/8373] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:54.361489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea23f1-dcb5-4117-9c75-5fe7aad8aa38 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:54.365221 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4133/8374] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:49:54.373742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acea23f1-dcb5-4117-9c75-5fe7aad8aa38 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:54.378393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43bdf6-246f-4abb-9e23-e56ded852f60 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:54.379746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eb43bdf6-246f-4abb-9e23-e56ded852f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:54.380065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504552d-a3f1-4132-899f-2729261c9863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:54.381301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504552d-a3f1-4132-899f-2729261c9863 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:54.381745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504552d-a3f1-4132-899f-2729261c9863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:54.382187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504552d-a3f1-4132-899f-2729261c9863 admin admin] PATH_INFO: `/v3/projects/397a73a1051f49aebe0e0b1baab79335/users/b871deadb0cf491e94e88b11e46e9db1/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:54.403743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504552d-a3f1-4132-899f-2729261c9863 admin admin] RBAC: Authorizing `identity:create_grant(project_id=397a73a1051f49aebe0e0b1baab79335, user_id=b871deadb0cf491e94e88b11e46e9db1, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:54.407846 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504552d-a3f1-4132-899f-2729261c9863 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:54.431370 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:54.445506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb43bdf6-246f-4abb-9e23-e56ded852f60 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:54.449535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7a896-240d-4888-9a4a-71d622eb88f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:54.450216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7a896-240d-4888-9a4a-71d622eb88f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:54.450502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7a896-240d-4888-9a4a-71d622eb88f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:54.450777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7a896-240d-4888-9a4a-71d622eb88f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:54.461540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7a896-240d-4888-9a4a-71d622eb88f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:54.463170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7a896-240d-4888-9a4a-71d622eb88f2 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:54.472967 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4134/8375] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:49:54.499443 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4242/8376] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:54 2022] PUT /identity/v3/projects/397a73a1051f49aebe0e0b1baab79335/users/b871deadb0cf491e94e88b11e46e9db1/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:49:54.501685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e37bf-97a8-4ef1-8d6c-639b07467f54 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:54.502217 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e37bf-97a8-4ef1-8d6c-639b07467f54 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:54.502503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e37bf-97a8-4ef1-8d6c-639b07467f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:54.539113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-333e37bf-97a8-4ef1-8d6c-639b07467f54 None None] MFA Rules not processed for user `b871deadb0cf491e94e88b11e46e9db1`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:54.540699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-333e37bf-97a8-4ef1-8d6c-639b07467f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:54.615625 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4135/8377] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:49:54.620246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504552d-a3f1-4132-899f-2729261c9863 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:54.706326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504552d-a3f1-4132-899f-2729261c9863 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:54.711495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97bf1a-e58f-4ea2-864d-2b482589668a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:54.712167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97bf1a-e58f-4ea2-864d-2b482589668a admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:54.712508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97bf1a-e58f-4ea2-864d-2b482589668a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:54.712816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97bf1a-e58f-4ea2-864d-2b482589668a admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:54.713531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97bf1a-e58f-4ea2-864d-2b482589668a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:54.715627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97bf1a-e58f-4ea2-864d-2b482589668a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:54.802150 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4243/8378] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:49:54 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:54.805410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e37bf-97a8-4ef1-8d6c-639b07467f54 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:54.816998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e37bf-97a8-4ef1-8d6c-639b07467f54 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:54.883949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e78ad-1cdb-41e2-bf8d-6f6987b20c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:54.884763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e78ad-1cdb-41e2-bf8d-6f6987b20c1b admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:54.885056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e78ad-1cdb-41e2-bf8d-6f6987b20c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:54.885449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e78ad-1cdb-41e2-bf8d-6f6987b20c1b admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:54.886069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e78ad-1cdb-41e2-bf8d-6f6987b20c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:54.888236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e78ad-1cdb-41e2-bf8d-6f6987b20c1b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:54.983166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97bf1a-e58f-4ea2-864d-2b482589668a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:54.985161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cf97bf1a-e58f-4ea2-864d-2b482589668a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:55.009462 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4136/8379] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:49:54 2022] POST /identity/v3/users => generated 300 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:49:55.010899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e78ad-1cdb-41e2-bf8d-6f6987b20c1b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:55.020775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97bf1a-e58f-4ea2-864d-2b482589668a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:55.032188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e78ad-1cdb-41e2-bf8d-6f6987b20c1b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:55.035100 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bdfc1-878c-49b0-8652-cd39e957ce65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:55.036230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bdfc1-878c-49b0-8652-cd39e957ce65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:55.036587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bdfc1-878c-49b0-8652-cd39e957ce65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:55.036874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bdfc1-878c-49b0-8652-cd39e957ce65 admin admin] PATH_INFO: `/v3/projects/e238d505674b46278b419751dafbab49` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:55.038557 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3bdfc1-878c-49b0-8652-cd39e957ce65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e238d505674b46278b419751dafbab49)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:55.042404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3bdfc1-878c-49b0-8652-cd39e957ce65 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:55.047073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180ddb3-8076-4ca7-9ee3-64355909f852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:55.047789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180ddb3-8076-4ca7-9ee3-64355909f852 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:55.048083 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180ddb3-8076-4ca7-9ee3-64355909f852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:55.048372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180ddb3-8076-4ca7-9ee3-64355909f852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:55.049124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180ddb3-8076-4ca7-9ee3-64355909f852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:55.051002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180ddb3-8076-4ca7-9ee3-64355909f852 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:55.070689 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4137/8380] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:55.076148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180ddb3-8076-4ca7-9ee3-64355909f852 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:55.085526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180ddb3-8076-4ca7-9ee3-64355909f852 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:55.095133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf1408-0f2b-4e6e-a961-567e55905fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:55.096105 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf1408-0f2b-4e6e-a961-567e55905fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:55.099140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf1408-0f2b-4e6e-a961-567e55905fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:55.099140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf1408-0f2b-4e6e-a961-567e55905fcf admin admin] PATH_INFO: `/v3/projects/e8fa620c63cc4006a9bbef3153f34989/users/c67a4a1c0583472baba970391c907e54/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:55.113406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf1408-0f2b-4e6e-a961-567e55905fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8fa620c63cc4006a9bbef3153f34989, user_id=c67a4a1c0583472baba970391c907e54, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:55.116232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf1408-0f2b-4e6e-a961-567e55905fcf admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:55.224453 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4138/8381] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:55 2022] PUT /identity/v3/projects/e8fa620c63cc4006a9bbef3153f34989/users/c67a4a1c0583472baba970391c907e54/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:55.229321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf1408-0f2b-4e6e-a961-567e55905fcf admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:55.248032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5d3bdfc1-878c-49b0-8652-cd39e957ce65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e238d505674b46278b419751dafbab49', 'request_id': 'req-5d3bdfc1-878c-49b0-8652-cd39e957ce65'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:55.255996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5d3bdfc1-878c-49b0-8652-cd39e957ce65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e238d505674b46278b419751dafbab49', 'request_id': 'req-5d3bdfc1-878c-49b0-8652-cd39e957ce65'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:55.266132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5d3bdfc1-878c-49b0-8652-cd39e957ce65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e238d505674b46278b419751dafbab49', 'request_id': 'req-5d3bdfc1-878c-49b0-8652-cd39e957ce65'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:55.269559 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:55.281207 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:55.315269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf1408-0f2b-4e6e-a961-567e55905fcf admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:55.353770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5d3bdfc1-878c-49b0-8652-cd39e957ce65 admin admin] The token cache is being invalidate because project e238d505674b46278b419751dafbab49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:55.354126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5d3bdfc1-878c-49b0-8652-cd39e957ce65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:55.354811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5d3bdfc1-878c-49b0-8652-cd39e957ce65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:55.358140 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4244/8382] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:49:54 2022] DELETE /identity/v3/projects/e238d505674b46278b419751dafbab49 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:49:55.361515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329d003-7739-4e60-ac3d-9219703c721b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:55.362088 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329d003-7739-4e60-ac3d-9219703c721b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:55.362704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329d003-7739-4e60-ac3d-9219703c721b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:55.374421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efd85e-8208-482c-b6b7-4745128cda43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:55.375107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efd85e-8208-482c-b6b7-4745128cda43 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:55.375395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efd85e-8208-482c-b6b7-4745128cda43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:55.375818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efd85e-8208-482c-b6b7-4745128cda43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:55.376559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efd85e-8208-482c-b6b7-4745128cda43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:55.378197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6efd85e-8208-482c-b6b7-4745128cda43 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:55.381041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2329d003-7739-4e60-ac3d-9219703c721b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:55.382346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2329d003-7739-4e60-ac3d-9219703c721b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:55.390469 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4139/8383] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:55.394143 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4245/8384] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:55.395017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efd85e-8208-482c-b6b7-4745128cda43 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:55.396771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f6efd85e-8208-482c-b6b7-4745128cda43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:55.401754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9714b-3b03-4d94-9c6c-fcc7a3ff781c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:55.402046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9714b-3b03-4d94-9c6c-fcc7a3ff781c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:55.402376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9714b-3b03-4d94-9c6c-fcc7a3ff781c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:55.414319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6efd85e-8208-482c-b6b7-4745128cda43 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:55.421043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a0a85-4616-4d3f-8b1b-3ac5c265239e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:55.421950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a0a85-4616-4d3f-8b1b-3ac5c265239e admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:55.422293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a0a85-4616-4d3f-8b1b-3ac5c265239e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:55.422581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a0a85-4616-4d3f-8b1b-3ac5c265239e admin admin] PATH_INFO: `/v3/projects/e8fa620c63cc4006a9bbef3153f34989/users/c67a4a1c0583472baba970391c907e54/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:55.424699 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a0a85-4616-4d3f-8b1b-3ac5c265239e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8fa620c63cc4006a9bbef3153f34989, user_id=c67a4a1c0583472baba970391c907e54, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:55.424813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8ec9714b-3b03-4d94-9c6c-fcc7a3ff781c None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:55.425896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8ec9714b-3b03-4d94-9c6c-fcc7a3ff781c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:55.427420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a0a85-4616-4d3f-8b1b-3ac5c265239e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:55.437589 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4246/8385] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:55.441991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9714b-3b03-4d94-9c6c-fcc7a3ff781c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:55.444541 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4140/8386] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:55 2022] PUT /identity/v3/projects/e8fa620c63cc4006a9bbef3153f34989/users/c67a4a1c0583472baba970391c907e54/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:55.452453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9714b-3b03-4d94-9c6c-fcc7a3ff781c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:55.520123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7660f661-aef8-4836-b5b9-c6ec6f06a8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:55.520837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660f661-aef8-4836-b5b9-c6ec6f06a8af admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:55.521128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660f661-aef8-4836-b5b9-c6ec6f06a8af admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:55.521411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7660f661-aef8-4836-b5b9-c6ec6f06a8af admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:55.522556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660f661-aef8-4836-b5b9-c6ec6f06a8af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:49:55.522874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660f661-aef8-4836-b5b9-c6ec6f06a8af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:55.525273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7660f661-aef8-4836-b5b9-c6ec6f06a8af admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:55.547030 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4247/8387] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:49:55.552986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a0a85-4616-4d3f-8b1b-3ac5c265239e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:55.554040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc432e67-2355-4167-b85e-68b065a2f3d0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:55.554893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc432e67-2355-4167-b85e-68b065a2f3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:55.555189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc432e67-2355-4167-b85e-68b065a2f3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:55.577985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a0a85-4616-4d3f-8b1b-3ac5c265239e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:55.585777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d645b65-cc6f-46b1-b68a-c55d92665b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:55.586685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d645b65-cc6f-46b1-b68a-c55d92665b2d admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:55.586970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d645b65-cc6f-46b1-b68a-c55d92665b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:55.587286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d645b65-cc6f-46b1-b68a-c55d92665b2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:55.587989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d645b65-cc6f-46b1-b68a-c55d92665b2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:55.589561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-fc432e67-2355-4167-b85e-68b065a2f3d0 None None] MFA Rules not processed for user `c67a4a1c0583472baba970391c907e54`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:55.589947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d645b65-cc6f-46b1-b68a-c55d92665b2d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:55.590824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fc432e67-2355-4167-b85e-68b065a2f3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:55.674697 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4248/8388] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:49:55.687824 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4141/8389] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:49:55 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:55.688309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc432e67-2355-4167-b85e-68b065a2f3d0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:55.688716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d645b65-cc6f-46b1-b68a-c55d92665b2d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:55.690625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0d645b65-cc6f-46b1-b68a-c55d92665b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:55.703463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc432e67-2355-4167-b85e-68b065a2f3d0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:55.764937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d645b65-cc6f-46b1-b68a-c55d92665b2d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:55.769125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1cb70-2b59-4466-a97c-2150463b4afd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:55.770325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1cb70-2b59-4466-a97c-2150463b4afd service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:55.770679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1cb70-2b59-4466-a97c-2150463b4afd service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:55.771033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1cb70-2b59-4466-a97c-2150463b4afd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:55.781040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d315a-ed8b-40d8-bf16-7c14d15d3a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:55.782051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d315a-ed8b-40d8-bf16-7c14d15d3a9b admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:55.782567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d315a-ed8b-40d8-bf16-7c14d15d3a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:55.786031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346d315a-ed8b-40d8-bf16-7c14d15d3a9b admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:55.786031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d315a-ed8b-40d8-bf16-7c14d15d3a9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:55.786433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346d315a-ed8b-40d8-bf16-7c14d15d3a9b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:55.795998 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:55.831108 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:55.844340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1cb70-2b59-4466-a97c-2150463b4afd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:55.845793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1cb70-2b59-4466-a97c-2150463b4afd service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:55.856375 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4142/8390] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:55.896001 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4249/8391] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:49:55 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:55.900406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1cb70-2b59-4466-a97c-2150463b4afd service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:55.911952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1cb70-2b59-4466-a97c-2150463b4afd service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:55.922182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601453b-9d56-4dbc-8611-23ec63797b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:55.922182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601453b-9d56-4dbc-8611-23ec63797b50 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:55.922182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601453b-9d56-4dbc-8611-23ec63797b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:55.922182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5601453b-9d56-4dbc-8611-23ec63797b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:55.922630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601453b-9d56-4dbc-8611-23ec63797b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:55.922630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5601453b-9d56-4dbc-8611-23ec63797b50 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:55.949375 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4143/8392] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:55.949823 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d315a-ed8b-40d8-bf16-7c14d15d3a9b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:55.966598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346d315a-ed8b-40d8-bf16-7c14d15d3a9b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:55.980771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aef1e5-1406-4ee5-a312-e2437137624d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:55.980771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aef1e5-1406-4ee5-a312-e2437137624d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:55.980771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aef1e5-1406-4ee5-a312-e2437137624d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:55.980771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aef1e5-1406-4ee5-a312-e2437137624d admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:55.981108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aef1e5-1406-4ee5-a312-e2437137624d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:55.982589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aef1e5-1406-4ee5-a312-e2437137624d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:56.008567 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4250/8393] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:56.015519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aef1e5-1406-4ee5-a312-e2437137624d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:56.015752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601453b-9d56-4dbc-8611-23ec63797b50 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:56.028100 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5601453b-9d56-4dbc-8611-23ec63797b50 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:56.035222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aef1e5-1406-4ee5-a312-e2437137624d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:56.035762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3bb82-0796-4d9c-8aab-330f51f13147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:56.037853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3bb82-0796-4d9c-8aab-330f51f13147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:56.038365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3bb82-0796-4d9c-8aab-330f51f13147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:56.039074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3bb82-0796-4d9c-8aab-330f51f13147 admin admin] PATH_INFO: `/v3/users/b871deadb0cf491e94e88b11e46e9db1` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:56.041308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ded1896-b3f0-4308-a860-6dc4bc3d32bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:56.041678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3bb82-0796-4d9c-8aab-330f51f13147 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b871deadb0cf491e94e88b11e46e9db1)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:56.042241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded1896-b3f0-4308-a860-6dc4bc3d32bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:56.042529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded1896-b3f0-4308-a860-6dc4bc3d32bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:56.043094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ded1896-b3f0-4308-a860-6dc4bc3d32bd admin admin] PATH_INFO: `/v3/projects/f04dbc2f64b74c48a3c3f06f72a1cd43/users/bb9d8515ff6441608c16619e530028d4/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:56.045120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3bb82-0796-4d9c-8aab-330f51f13147 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:56.067975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded1896-b3f0-4308-a860-6dc4bc3d32bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f04dbc2f64b74c48a3c3f06f72a1cd43, user_id=bb9d8515ff6441608c16619e530028d4, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:56.072937 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ded1896-b3f0-4308-a860-6dc4bc3d32bd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:56.142789 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4251/8394] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:56 2022] PUT /identity/v3/projects/f04dbc2f64b74c48a3c3f06f72a1cd43/users/bb9d8515ff6441608c16619e530028d4/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:56.155291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f84ee-6276-4efb-972d-aa78d23ef12d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:56.155577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f84ee-6276-4efb-972d-aa78d23ef12d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:56.155849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f84ee-6276-4efb-972d-aa78d23ef12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:56.183976 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4c8f84ee-6276-4efb-972d-aa78d23ef12d None None] MFA Rules not processed for user `bb9d8515ff6441608c16619e530028d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:56.185177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4c8f84ee-6276-4efb-972d-aa78d23ef12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:56.257994 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4252/8395] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:56.269881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f84ee-6276-4efb-972d-aa78d23ef12d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:56.283149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0db3bb82-0796-4d9c-8aab-330f51f13147 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b871deadb0cf491e94e88b11e46e9db1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:56.302353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0db3bb82-0796-4d9c-8aab-330f51f13147 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b871deadb0cf491e94e88b11e46e9db1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:56.306761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0db3bb82-0796-4d9c-8aab-330f51f13147 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b871deadb0cf491e94e88b11e46e9db1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:56.307921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0db3bb82-0796-4d9c-8aab-330f51f13147 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b871deadb0cf491e94e88b11e46e9db1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:56.317140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0db3bb82-0796-4d9c-8aab-330f51f13147 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b871deadb0cf491e94e88b11e46e9db1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:56.352496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f84ee-6276-4efb-972d-aa78d23ef12d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:56.356697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9879eb-6ae8-43d8-8c01-5e6043504652 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:56.357652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9879eb-6ae8-43d8-8c01-5e6043504652 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:56.358030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9879eb-6ae8-43d8-8c01-5e6043504652 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:56.358276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9879eb-6ae8-43d8-8c01-5e6043504652 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:56.360841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1c9879eb-6ae8-43d8-8c01-5e6043504652 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:56.374493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9879eb-6ae8-43d8-8c01-5e6043504652 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:56.375963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9879eb-6ae8-43d8-8c01-5e6043504652 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:56.388795 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4253/8396] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:49:56.410062 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4144/8397] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:56 2022] DELETE /identity/v3/users/b871deadb0cf491e94e88b11e46e9db1 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:56.412383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f796a90-5de5-4223-b5b0-a6cb9627b577 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:56.412672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f796a90-5de5-4223-b5b0-a6cb9627b577 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:56.412952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f796a90-5de5-4223-b5b0-a6cb9627b577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:56.431963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9f796a90-5de5-4223-b5b0-a6cb9627b577 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:56.433167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9f796a90-5de5-4223-b5b0-a6cb9627b577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:56.484495 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:56.508535 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4254/8398] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:56.519202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3bb82-0796-4d9c-8aab-330f51f13147 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:56.520897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0db3bb82-0796-4d9c-8aab-330f51f13147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:56.597987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3bb82-0796-4d9c-8aab-330f51f13147 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:56.602595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe804ba-ef51-43d5-b519-5f2ee609c32b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:56.603309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe804ba-ef51-43d5-b519-5f2ee609c32b service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:56.603599 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe804ba-ef51-43d5-b519-5f2ee609c32b service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:56.603911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe804ba-ef51-43d5-b519-5f2ee609c32b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:56.613511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe804ba-ef51-43d5-b519-5f2ee609c32b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:56.614970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe804ba-ef51-43d5-b519-5f2ee609c32b service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:56.624741 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4145/8399] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:49:57.126667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f796a90-5de5-4223-b5b0-a6cb9627b577 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:57.131449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9f796a90-5de5-4223-b5b0-a6cb9627b577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:57.143907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f796a90-5de5-4223-b5b0-a6cb9627b577 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:57.152303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da681b79-a5cd-48f0-8fa5-463dde57a323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:57.153681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da681b79-a5cd-48f0-8fa5-463dde57a323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:57.153681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da681b79-a5cd-48f0-8fa5-463dde57a323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:57.154147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da681b79-a5cd-48f0-8fa5-463dde57a323 admin admin] PATH_INFO: `/v3/projects/397a73a1051f49aebe0e0b1baab79335` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:57.155727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da681b79-a5cd-48f0-8fa5-463dde57a323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=397a73a1051f49aebe0e0b1baab79335)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:57.158327 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da681b79-a5cd-48f0-8fa5-463dde57a323 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:57.186996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe804ba-ef51-43d5-b519-5f2ee609c32b service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:57.189124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3fe804ba-ef51-43d5-b519-5f2ee609c32b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:57.214843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe804ba-ef51-43d5-b519-5f2ee609c32b service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:57.220317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2274bb-4ee0-46af-95a1-dabc738629e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:57.221296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2274bb-4ee0-46af-95a1-dabc738629e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:57.221630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2274bb-4ee0-46af-95a1-dabc738629e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:57.222294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2274bb-4ee0-46af-95a1-dabc738629e0 admin admin] PATH_INFO: `/v3/users/e1f5eff2944941e592a100faead09009` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:57.223667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2274bb-4ee0-46af-95a1-dabc738629e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1f5eff2944941e592a100faead09009)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:57.227291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2274bb-4ee0-46af-95a1-dabc738629e0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:57.312309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-da681b79-a5cd-48f0-8fa5-463dde57a323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '397a73a1051f49aebe0e0b1baab79335', 'request_id': 'req-da681b79-a5cd-48f0-8fa5-463dde57a323'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:57.318023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-da681b79-a5cd-48f0-8fa5-463dde57a323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '397a73a1051f49aebe0e0b1baab79335', 'request_id': 'req-da681b79-a5cd-48f0-8fa5-463dde57a323'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:57.325230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-da681b79-a5cd-48f0-8fa5-463dde57a323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '397a73a1051f49aebe0e0b1baab79335', 'request_id': 'req-da681b79-a5cd-48f0-8fa5-463dde57a323'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:57.424577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-da681b79-a5cd-48f0-8fa5-463dde57a323 admin admin] The token cache is being invalidate because project 397a73a1051f49aebe0e0b1baab79335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:57.425032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-da681b79-a5cd-48f0-8fa5-463dde57a323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:57.425794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-da681b79-a5cd-48f0-8fa5-463dde57a323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:57.431253 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4255/8400] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:49:57 2022] DELETE /identity/v3/projects/397a73a1051f49aebe0e0b1baab79335 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:57.432301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da681b79-a5cd-48f0-8fa5-463dde57a323 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:57.433693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-da681b79-a5cd-48f0-8fa5-463dde57a323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:57.489337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9c2274bb-4ee0-46af-95a1-dabc738629e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1f5eff2944941e592a100faead09009'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:57.490813 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:57.504312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9c2274bb-4ee0-46af-95a1-dabc738629e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1f5eff2944941e592a100faead09009'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:57.505150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9c2274bb-4ee0-46af-95a1-dabc738629e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1f5eff2944941e592a100faead09009'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:57.506244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9c2274bb-4ee0-46af-95a1-dabc738629e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1f5eff2944941e592a100faead09009'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:57.511170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da681b79-a5cd-48f0-8fa5-463dde57a323 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:57.515013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9c2274bb-4ee0-46af-95a1-dabc738629e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1f5eff2944941e592a100faead09009'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:57.516690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71112050-0647-430a-a329-a22a4a35c708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:57.517793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71112050-0647-430a-a329-a22a4a35c708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:57.517793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71112050-0647-430a-a329-a22a4a35c708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:57.518263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71112050-0647-430a-a329-a22a4a35c708 admin admin] PATH_INFO: `/v3/users/c67a4a1c0583472baba970391c907e54` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:57.519688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71112050-0647-430a-a329-a22a4a35c708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c67a4a1c0583472baba970391c907e54)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:57.521598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71112050-0647-430a-a329-a22a4a35c708 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:57.626323 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4146/8401] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:57 2022] DELETE /identity/v3/users/e1f5eff2944941e592a100faead09009 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:49:57.631371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1395c2-f9ae-4e07-8afd-bd1122d9cb83 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:57.632193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1395c2-f9ae-4e07-8afd-bd1122d9cb83 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:57.633134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1395c2-f9ae-4e07-8afd-bd1122d9cb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:57.654777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7d1395c2-f9ae-4e07-8afd-bd1122d9cb83 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:57.656314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7d1395c2-f9ae-4e07-8afd-bd1122d9cb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:57.722500 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4147/8402] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:49:57.733645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1395c2-f9ae-4e07-8afd-bd1122d9cb83 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:57.735621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7d1395c2-f9ae-4e07-8afd-bd1122d9cb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:57.796134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-71112050-0647-430a-a329-a22a4a35c708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c67a4a1c0583472baba970391c907e54'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:57.825409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1395c2-f9ae-4e07-8afd-bd1122d9cb83 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:57.835865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acf5c5-2fcd-4881-88e7-215492b50bd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:57.836544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acf5c5-2fcd-4881-88e7-215492b50bd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:57.836831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acf5c5-2fcd-4881-88e7-215492b50bd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:57.837112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acf5c5-2fcd-4881-88e7-215492b50bd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:57.865301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-71112050-0647-430a-a329-a22a4a35c708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c67a4a1c0583472baba970391c907e54'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:57.875044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6acf5c5-2fcd-4881-88e7-215492b50bd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:57.876539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6acf5c5-2fcd-4881-88e7-215492b50bd9 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:57.881999 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:57.889857 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4148/8403] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:49:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:49:57.890351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-71112050-0647-430a-a329-a22a4a35c708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c67a4a1c0583472baba970391c907e54'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:57.891554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-71112050-0647-430a-a329-a22a4a35c708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c67a4a1c0583472baba970391c907e54'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:57.993755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-71112050-0647-430a-a329-a22a4a35c708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c67a4a1c0583472baba970391c907e54'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:58.002003 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4256/8404] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:57 2022] DELETE /identity/v3/users/c67a4a1c0583472baba970391c907e54 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:58.593476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acf5c5-2fcd-4881-88e7-215492b50bd9 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:58.595844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b6acf5c5-2fcd-4881-88e7-215492b50bd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:58.598770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71112050-0647-430a-a329-a22a4a35c708 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:58.600728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-71112050-0647-430a-a329-a22a4a35c708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:58.637261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acf5c5-2fcd-4881-88e7-215492b50bd9 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:58.693901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71112050-0647-430a-a329-a22a4a35c708 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:58.698836 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:58.700139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0d3da-0e0a-408b-8db2-9b38139c2792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:58.701007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0d3da-0e0a-408b-8db2-9b38139c2792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:58.701300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0d3da-0e0a-408b-8db2-9b38139c2792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:58.701589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0d3da-0e0a-408b-8db2-9b38139c2792 admin admin] PATH_INFO: `/v3/projects/d66a68bb18184b8f8d2b06df9571c9eb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:58.702896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0d3da-0e0a-408b-8db2-9b38139c2792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d66a68bb18184b8f8d2b06df9571c9eb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:58.705333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0d3da-0e0a-408b-8db2-9b38139c2792 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:58.706218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e39411-70f0-4f9a-a3b7-c715cc822e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:58.707304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e39411-70f0-4f9a-a3b7-c715cc822e57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:58.707413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e39411-70f0-4f9a-a3b7-c715cc822e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:58.707661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e39411-70f0-4f9a-a3b7-c715cc822e57 admin admin] PATH_INFO: `/v3/projects/e8fa620c63cc4006a9bbef3153f34989` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:58.708934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e39411-70f0-4f9a-a3b7-c715cc822e57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8fa620c63cc4006a9bbef3153f34989)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:58.711808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e39411-70f0-4f9a-a3b7-c715cc822e57 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:58.870068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-67e39411-70f0-4f9a-a3b7-c715cc822e57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8fa620c63cc4006a9bbef3153f34989', 'request_id': 'req-67e39411-70f0-4f9a-a3b7-c715cc822e57'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:58.872163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3fa0d3da-0e0a-408b-8db2-9b38139c2792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd66a68bb18184b8f8d2b06df9571c9eb', 'request_id': 'req-3fa0d3da-0e0a-408b-8db2-9b38139c2792'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:58.879121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3fa0d3da-0e0a-408b-8db2-9b38139c2792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd66a68bb18184b8f8d2b06df9571c9eb', 'request_id': 'req-3fa0d3da-0e0a-408b-8db2-9b38139c2792'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:58.888137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3fa0d3da-0e0a-408b-8db2-9b38139c2792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd66a68bb18184b8f8d2b06df9571c9eb', 'request_id': 'req-3fa0d3da-0e0a-408b-8db2-9b38139c2792'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:58.939242 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-67e39411-70f0-4f9a-a3b7-c715cc822e57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8fa620c63cc4006a9bbef3153f34989', 'request_id': 'req-67e39411-70f0-4f9a-a3b7-c715cc822e57'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:58.946618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-67e39411-70f0-4f9a-a3b7-c715cc822e57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8fa620c63cc4006a9bbef3153f34989', 'request_id': 'req-67e39411-70f0-4f9a-a3b7-c715cc822e57'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:58.957603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-67e39411-70f0-4f9a-a3b7-c715cc822e57 admin admin] The token cache is being invalidate because project e8fa620c63cc4006a9bbef3153f34989 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:58.957893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-67e39411-70f0-4f9a-a3b7-c715cc822e57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:58.958903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-67e39411-70f0-4f9a-a3b7-c715cc822e57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:58.960545 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4149/8405] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:49:58 2022] DELETE /identity/v3/projects/e8fa620c63cc4006a9bbef3153f34989 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:58.965475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6aeae6-e3b4-47bb-81a0-e15c40b4aca1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:58.965766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6aeae6-e3b4-47bb-81a0-e15c40b4aca1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:58.966049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6aeae6-e3b4-47bb-81a0-e15c40b4aca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:58.990702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8c6aeae6-e3b4-47bb-81a0-e15c40b4aca1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:58.992709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8c6aeae6-e3b4-47bb-81a0-e15c40b4aca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:59.028699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3fa0d3da-0e0a-408b-8db2-9b38139c2792 admin admin] The token cache is being invalidate because project d66a68bb18184b8f8d2b06df9571c9eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:49:59.029129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3fa0d3da-0e0a-408b-8db2-9b38139c2792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:59.029888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-3fa0d3da-0e0a-408b-8db2-9b38139c2792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:59.033660 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4257/8406] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:49:58 2022] DELETE /identity/v3/projects/d66a68bb18184b8f8d2b06df9571c9eb => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:49:59.036615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0d3da-0e0a-408b-8db2-9b38139c2792 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:59.039215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3fa0d3da-0e0a-408b-8db2-9b38139c2792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:59.070529 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4150/8407] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:59.072158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81ee12-f313-408f-9722-2b0bf6df2a36 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:59.072532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81ee12-f313-408f-9722-2b0bf6df2a36 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:59.072885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81ee12-f313-408f-9722-2b0bf6df2a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:59.093344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-cd81ee12-f313-408f-9722-2b0bf6df2a36 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:59.094773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cd81ee12-f313-408f-9722-2b0bf6df2a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:59.107519 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4151/8408] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:59.108995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81ee12-f313-408f-9722-2b0bf6df2a36 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:59.120570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81ee12-f313-408f-9722-2b0bf6df2a36 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:59.125855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661cf42-d220-4271-82bc-639a52718fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:59.126567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661cf42-d220-4271-82bc-639a52718fbf admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:59.126852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661cf42-d220-4271-82bc-639a52718fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:59.127128 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661cf42-d220-4271-82bc-639a52718fbf admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:59.127355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0d3da-0e0a-408b-8db2-9b38139c2792 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:59.127891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661cf42-d220-4271-82bc-639a52718fbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:49:59.128220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661cf42-d220-4271-82bc-639a52718fbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:59.129937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661cf42-d220-4271-82bc-639a52718fbf admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:59.132392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d508c02a-c141-4215-b8b5-ceb3b8bde309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:59.133287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508c02a-c141-4215-b8b5-ceb3b8bde309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:59.133949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508c02a-c141-4215-b8b5-ceb3b8bde309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:59.133949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d508c02a-c141-4215-b8b5-ceb3b8bde309 admin admin] PATH_INFO: `/v3/users/7f61e9bb1b854546aec618697636dde5` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:59.135107 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508c02a-c141-4215-b8b5-ceb3b8bde309 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f61e9bb1b854546aec618697636dde5)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:59.137037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d508c02a-c141-4215-b8b5-ceb3b8bde309 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:59.149089 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4152/8409] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:49:59.150299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661cf42-d220-4271-82bc-639a52718fbf admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:59.163105 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:59.165159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661cf42-d220-4271-82bc-639a52718fbf admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:59.170208 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76884e9-755f-4c30-b254-19559ea767a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:59.171023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76884e9-755f-4c30-b254-19559ea767a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:59.171321 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76884e9-755f-4c30-b254-19559ea767a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:59.171600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76884e9-755f-4c30-b254-19559ea767a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:59.172876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76884e9-755f-4c30-b254-19559ea767a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:59.174838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76884e9-755f-4c30-b254-19559ea767a0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:59.272765 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4153/8410] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:49:59 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:59.277894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76884e9-755f-4c30-b254-19559ea767a0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:59.316518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d508c02a-c141-4215-b8b5-ceb3b8bde309 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f61e9bb1b854546aec618697636dde5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:59.331788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d508c02a-c141-4215-b8b5-ceb3b8bde309 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f61e9bb1b854546aec618697636dde5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:59.334489 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:49:59.339886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d508c02a-c141-4215-b8b5-ceb3b8bde309 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f61e9bb1b854546aec618697636dde5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:59.340736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d508c02a-c141-4215-b8b5-ceb3b8bde309 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f61e9bb1b854546aec618697636dde5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:59.350587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76884e9-755f-4c30-b254-19559ea767a0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:59.355506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2424c1a-a69f-4666-b8c9-4a02f42d1baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:59.356457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2424c1a-a69f-4666-b8c9-4a02f42d1baa admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:59.356457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2424c1a-a69f-4666-b8c9-4a02f42d1baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:59.356737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2424c1a-a69f-4666-b8c9-4a02f42d1baa admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:59.357441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2424c1a-a69f-4666-b8c9-4a02f42d1baa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:59.360969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2424c1a-a69f-4666-b8c9-4a02f42d1baa admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:59.413389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d508c02a-c141-4215-b8b5-ceb3b8bde309 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f61e9bb1b854546aec618697636dde5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:49:59.424253 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4258/8411] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:49:59 2022] DELETE /identity/v3/users/7f61e9bb1b854546aec618697636dde5 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:49:59.430340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa79d2e-c704-4ce2-ac3f-508f3ad7ef3f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:59.431015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa79d2e-c704-4ce2-ac3f-508f3ad7ef3f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:59.431531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa79d2e-c704-4ce2-ac3f-508f3ad7ef3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:59.451137 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4154/8412] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:49:59 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:49:59.453151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8aa79d2e-c704-4ce2-ac3f-508f3ad7ef3f None None] MFA Rules not processed for user `bb9d8515ff6441608c16619e530028d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:59.458255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8aa79d2e-c704-4ce2-ac3f-508f3ad7ef3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:59.459385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2424c1a-a69f-4666-b8c9-4a02f42d1baa admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:59.461467 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d2424c1a-a69f-4666-b8c9-4a02f42d1baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:59.477262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2424c1a-a69f-4666-b8c9-4a02f42d1baa admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:59.521906 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4259/8413] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:59.562541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c5ad3-e88e-40dc-9173-6d7948920460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:59.563333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c5ad3-e88e-40dc-9173-6d7948920460 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:59.563739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c5ad3-e88e-40dc-9173-6d7948920460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:59.564118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200c5ad3-e88e-40dc-9173-6d7948920460 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:59.565025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c5ad3-e88e-40dc-9173-6d7948920460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:59.567086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200c5ad3-e88e-40dc-9173-6d7948920460 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:59.579957 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4155/8414] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:49:59.583983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa79d2e-c704-4ce2-ac3f-508f3ad7ef3f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:59.599295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa79d2e-c704-4ce2-ac3f-508f3ad7ef3f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:59.604196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977b846-3e7a-4561-a6e8-07a045806cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:59.604889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977b846-3e7a-4561-a6e8-07a045806cb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:59.605175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977b846-3e7a-4561-a6e8-07a045806cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:59.605457 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977b846-3e7a-4561-a6e8-07a045806cb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:59.606394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977b846-3e7a-4561-a6e8-07a045806cb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:59.608022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6977b846-3e7a-4561-a6e8-07a045806cb9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:59.632982 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4260/8415] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:49:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:49:59.635710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c5ad3-e88e-40dc-9173-6d7948920460 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:49:59.647055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200c5ad3-e88e-40dc-9173-6d7948920460 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:49:59.653018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc127995-ed68-4a42-84b8-96d4e633560d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:49:59.653971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc127995-ed68-4a42-84b8-96d4e633560d admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:59.654288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc127995-ed68-4a42-84b8-96d4e633560d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:59.657012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc127995-ed68-4a42-84b8-96d4e633560d admin admin] PATH_INFO: `/v3/projects/9c76cbf5f4584a3089b733ad094f2a20/users/cc31f8dc956e4452a69ef481ab9be992/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:59.673432 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc127995-ed68-4a42-84b8-96d4e633560d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c76cbf5f4584a3089b733ad094f2a20, user_id=cc31f8dc956e4452a69ef481ab9be992, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:49:59.676632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc127995-ed68-4a42-84b8-96d4e633560d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:49:59.763171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8378be8-250e-443f-800c-7c0de73ca8b6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:49:59.763882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8378be8-250e-443f-800c-7c0de73ca8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:49:59.764354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8378be8-250e-443f-800c-7c0de73ca8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:49:59.775631 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4156/8416] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:49:59 2022] PUT /identity/v3/projects/9c76cbf5f4584a3089b733ad094f2a20/users/cc31f8dc956e4452a69ef481ab9be992/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:49:59.801136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f8378be8-250e-443f-800c-7c0de73ca8b6 None None] MFA Rules not processed for user `cc31f8dc956e4452a69ef481ab9be992`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:49:59.802922 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f8378be8-250e-443f-800c-7c0de73ca8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:49:59.913346 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4261/8417] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:49:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:49:59.919325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc127995-ed68-4a42-84b8-96d4e633560d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:00.006796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc127995-ed68-4a42-84b8-96d4e633560d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:00.012992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5a1af-c3a1-4791-ada8-cfe9e13d7912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:00.013757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5a1af-c3a1-4791-ada8-cfe9e13d7912 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:00.014055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5a1af-c3a1-4791-ada8-cfe9e13d7912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:00.014731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5a1af-c3a1-4791-ada8-cfe9e13d7912 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:00.015664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5a1af-c3a1-4791-ada8-cfe9e13d7912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:00.017598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5a1af-c3a1-4791-ada8-cfe9e13d7912 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:00.048969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8378be8-250e-443f-800c-7c0de73ca8b6 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:00.048969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f8378be8-250e-443f-800c-7c0de73ca8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:00.072685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8378be8-250e-443f-800c-7c0de73ca8b6 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:00.077925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c0e89-8d57-486d-957d-ed843f31182a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:00.079571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c0e89-8d57-486d-957d-ed843f31182a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:00.079571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c0e89-8d57-486d-957d-ed843f31182a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:00.089331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c0e89-8d57-486d-957d-ed843f31182a admin admin] PATH_INFO: `/v3/projects/b8fa49314df14aaba05d138ebf7b7f38` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:00.090279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c0e89-8d57-486d-957d-ed843f31182a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8fa49314df14aaba05d138ebf7b7f38)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:00.092314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c0e89-8d57-486d-957d-ed843f31182a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:00.112119 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:50:00.114506 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4157/8418] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:49:59 2022] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:50:00.119016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5a1af-c3a1-4791-ada8-cfe9e13d7912 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:00.167964 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:50:00.202307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5a1af-c3a1-4791-ada8-cfe9e13d7912 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:00.244389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e15c0e89-8d57-486d-957d-ed843f31182a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8fa49314df14aaba05d138ebf7b7f38', 'request_id': 'req-e15c0e89-8d57-486d-957d-ed843f31182a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:00.252383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e15c0e89-8d57-486d-957d-ed843f31182a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8fa49314df14aaba05d138ebf7b7f38', 'request_id': 'req-e15c0e89-8d57-486d-957d-ed843f31182a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:00.261729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e15c0e89-8d57-486d-957d-ed843f31182a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8fa49314df14aaba05d138ebf7b7f38', 'request_id': 'req-e15c0e89-8d57-486d-957d-ed843f31182a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:00.298254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc5595-c87c-47ba-9442-bd4caae0c6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:00.299145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc5595-c87c-47ba-9442-bd4caae0c6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:00.299930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc5595-c87c-47ba-9442-bd4caae0c6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:00.299930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc5595-c87c-47ba-9442-bd4caae0c6f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:00.300826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc5595-c87c-47ba-9442-bd4caae0c6f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:00.303027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc5595-c87c-47ba-9442-bd4caae0c6f3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:00.350438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e15c0e89-8d57-486d-957d-ed843f31182a admin admin] The token cache is being invalidate because project b8fa49314df14aaba05d138ebf7b7f38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:50:00.350438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e15c0e89-8d57-486d-957d-ed843f31182a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:00.353925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e15c0e89-8d57-486d-957d-ed843f31182a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:00.353925 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4262/8419] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:50:00 2022] DELETE /identity/v3/projects/b8fa49314df14aaba05d138ebf7b7f38 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:50:00.359547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d777e90-c973-4a99-ab35-e42a389e7b92 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:00.360164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d777e90-c973-4a99-ab35-e42a389e7b92 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:00.360685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d777e90-c973-4a99-ab35-e42a389e7b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:00.384661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7d777e90-c973-4a99-ab35-e42a389e7b92 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:50:00.385740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7d777e90-c973-4a99-ab35-e42a389e7b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:00.387647 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4158/8420] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:50:00 2022] POST /identity/v3/users => generated 296 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:50:00.389076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc5595-c87c-47ba-9442-bd4caae0c6f3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:00.391551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e8fc5595-c87c-47ba-9442-bd4caae0c6f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:00.396640 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4263/8421] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:50:00.407258 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d8881-87f9-489e-a798-e5e2069d7077 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:00.407730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d8881-87f9-489e-a798-e5e2069d7077 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:00.408199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d8881-87f9-489e-a798-e5e2069d7077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:00.412533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc5595-c87c-47ba-9442-bd4caae0c6f3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:00.420181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862ed9c-5288-4fa1-8987-d55bc442bcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:00.421009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862ed9c-5288-4fa1-8987-d55bc442bcee admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:00.421437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862ed9c-5288-4fa1-8987-d55bc442bcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:00.421923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8862ed9c-5288-4fa1-8987-d55bc442bcee admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:00.423196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862ed9c-5288-4fa1-8987-d55bc442bcee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:00.425318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8862ed9c-5288-4fa1-8987-d55bc442bcee admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:00.436577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-395d8881-87f9-489e-a798-e5e2069d7077 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:50:00.438038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-395d8881-87f9-489e-a798-e5e2069d7077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:00.440711 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4159/8422] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:50:00.444373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862ed9c-5288-4fa1-8987-d55bc442bcee admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:00.448058 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4264/8423] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:50:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:50:00.453108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d8881-87f9-489e-a798-e5e2069d7077 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:00.457878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8862ed9c-5288-4fa1-8987-d55bc442bcee admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:00.463576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cb165-0f6c-4978-bda6-4371d7281c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:00.476746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d8881-87f9-489e-a798-e5e2069d7077 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:00.476909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cb165-0f6c-4978-bda6-4371d7281c31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:00.476909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cb165-0f6c-4978-bda6-4371d7281c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:00.476909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cb165-0f6c-4978-bda6-4371d7281c31 admin admin] PATH_INFO: `/v3/projects/4d469d778be647b7b140ca2bc47e63c9/users/804c64e5c4294d029ee6b4b523d94eca/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:00.477102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22592c28-8afb-48ae-b345-a80a8dc3dbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:00.477102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22592c28-8afb-48ae-b345-a80a8dc3dbef admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:00.477102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22592c28-8afb-48ae-b345-a80a8dc3dbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:00.477102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22592c28-8afb-48ae-b345-a80a8dc3dbef admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:00.477585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22592c28-8afb-48ae-b345-a80a8dc3dbef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:50:00.477585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22592c28-8afb-48ae-b345-a80a8dc3dbef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:00.477585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22592c28-8afb-48ae-b345-a80a8dc3dbef admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:00.488550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cb165-0f6c-4978-bda6-4371d7281c31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d469d778be647b7b140ca2bc47e63c9, user_id=804c64e5c4294d029ee6b4b523d94eca, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:00.493139 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4265/8424] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:50:00.493322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cb165-0f6c-4978-bda6-4371d7281c31 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:00.494464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22592c28-8afb-48ae-b345-a80a8dc3dbef admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:00.506648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22592c28-8afb-48ae-b345-a80a8dc3dbef admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:00.514080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8c594-a1b6-46f2-ad66-5b40290a162a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:00.515144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8c594-a1b6-46f2-ad66-5b40290a162a admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:00.515431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8c594-a1b6-46f2-ad66-5b40290a162a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:00.515711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8c594-a1b6-46f2-ad66-5b40290a162a admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:00.516462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8c594-a1b6-46f2-ad66-5b40290a162a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:00.518698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8c594-a1b6-46f2-ad66-5b40290a162a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:00.619839 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4160/8425] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:50:00 2022] PUT /identity/v3/projects/4d469d778be647b7b140ca2bc47e63c9/users/804c64e5c4294d029ee6b4b523d94eca/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:50:00.627999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cb165-0f6c-4978-bda6-4371d7281c31 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:00.664854 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4266/8426] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:50:00 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:50:00.669050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8c594-a1b6-46f2-ad66-5b40290a162a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:00.755880 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cb165-0f6c-4978-bda6-4371d7281c31 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:00.779540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8c594-a1b6-46f2-ad66-5b40290a162a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:00.795299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1aa24-86aa-4ab5-9fbf-9dda36769335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:00.795998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1aa24-86aa-4ab5-9fbf-9dda36769335 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:00.796284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1aa24-86aa-4ab5-9fbf-9dda36769335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:00.796570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1aa24-86aa-4ab5-9fbf-9dda36769335 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:00.797267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1aa24-86aa-4ab5-9fbf-9dda36769335 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:00.799242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1aa24-86aa-4ab5-9fbf-9dda36769335 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:00.824418 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:50:00.848728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db8935-7f74-45e3-9c72-e85db096e0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:00.849518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db8935-7f74-45e3-9c72-e85db096e0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:00.849980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db8935-7f74-45e3-9c72-e85db096e0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:00.850362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db8935-7f74-45e3-9c72-e85db096e0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:00.851749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db8935-7f74-45e3-9c72-e85db096e0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:00.853428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db8935-7f74-45e3-9c72-e85db096e0d2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:00.865357 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4161/8427] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:50:00.869461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db8935-7f74-45e3-9c72-e85db096e0d2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:00.879257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db8935-7f74-45e3-9c72-e85db096e0d2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:00.887900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bea5a05-b305-463c-88be-b2df6a888992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:00.888891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea5a05-b305-463c-88be-b2df6a888992 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:00.889245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea5a05-b305-463c-88be-b2df6a888992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:00.889839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bea5a05-b305-463c-88be-b2df6a888992 admin admin] PATH_INFO: `/v3/projects/4d469d778be647b7b140ca2bc47e63c9/users/804c64e5c4294d029ee6b4b523d94eca/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:00.891959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea5a05-b305-463c-88be-b2df6a888992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d469d778be647b7b140ca2bc47e63c9, user_id=804c64e5c4294d029ee6b4b523d94eca, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:00.894703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bea5a05-b305-463c-88be-b2df6a888992 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:00.909187 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4162/8428] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:50:00 2022] PUT /identity/v3/projects/4d469d778be647b7b140ca2bc47e63c9/users/804c64e5c4294d029ee6b4b523d94eca/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:50:00.921805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed20ef9-206d-4e2c-85a0-33b60adf7c48 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:00.922314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed20ef9-206d-4e2c-85a0-33b60adf7c48 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:00.922752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed20ef9-206d-4e2c-85a0-33b60adf7c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:00.924780 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4267/8429] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:50:00 2022] POST /identity/v3/users => generated 287 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:50:00.928517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1aa24-86aa-4ab5-9fbf-9dda36769335 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:00.944492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1aa24-86aa-4ab5-9fbf-9dda36769335 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:00.959204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0ed20ef9-206d-4e2c-85a0-33b60adf7c48 None None] MFA Rules not processed for user `804c64e5c4294d029ee6b4b523d94eca`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:50:00.960531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0ed20ef9-206d-4e2c-85a0-33b60adf7c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:01.021499 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:50:01.042910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e31755-61a2-4b66-b359-e85252e92c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:01.043737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e31755-61a2-4b66-b359-e85252e92c01 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:01.044127 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e31755-61a2-4b66-b359-e85252e92c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:01.044509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e31755-61a2-4b66-b359-e85252e92c01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:01.046340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e31755-61a2-4b66-b359-e85252e92c01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:01.048135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e31755-61a2-4b66-b359-e85252e92c01 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:01.065265 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4268/8430] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:50:01.068878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e31755-61a2-4b66-b359-e85252e92c01 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:01.074983 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4163/8431] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:50:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:50:01.084856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed20ef9-206d-4e2c-85a0-33b60adf7c48 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:01.088667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0ed20ef9-206d-4e2c-85a0-33b60adf7c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:01.091384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e31755-61a2-4b66-b359-e85252e92c01 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:01.097053 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaefe03-f097-4e65-ba4d-ba5ffa13cb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:01.097938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaefe03-f097-4e65-ba4d-ba5ffa13cb4d admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:01.098267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaefe03-f097-4e65-ba4d-ba5ffa13cb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:01.098589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaefe03-f097-4e65-ba4d-ba5ffa13cb4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:01.099497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaefe03-f097-4e65-ba4d-ba5ffa13cb4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:01.102626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaefe03-f097-4e65-ba4d-ba5ffa13cb4d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:01.114058 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4269/8432] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:50:01.118739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaefe03-f097-4e65-ba4d-ba5ffa13cb4d admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:01.134062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaefe03-f097-4e65-ba4d-ba5ffa13cb4d admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:01.147473 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a214cb0-4031-4456-9326-1d6671f2d509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:01.149443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a214cb0-4031-4456-9326-1d6671f2d509 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:01.149443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a214cb0-4031-4456-9326-1d6671f2d509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:01.149856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a214cb0-4031-4456-9326-1d6671f2d509 admin admin] PATH_INFO: `/v3/projects/aec779a03e1c4b5ca59a8557943e709f/users/7e622a9048934b399acaf65a32e96bb3/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:01.171062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a214cb0-4031-4456-9326-1d6671f2d509 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aec779a03e1c4b5ca59a8557943e709f, user_id=7e622a9048934b399acaf65a32e96bb3, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:01.179570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a214cb0-4031-4456-9326-1d6671f2d509 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:01.187004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed20ef9-206d-4e2c-85a0-33b60adf7c48 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:01.191954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec99719-aef8-41ee-8622-5d0ac9989cbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:01.193220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec99719-aef8-41ee-8622-5d0ac9989cbc service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:01.193825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec99719-aef8-41ee-8622-5d0ac9989cbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:01.195343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec99719-aef8-41ee-8622-5d0ac9989cbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:01.218517 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec99719-aef8-41ee-8622-5d0ac9989cbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:01.220049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec99719-aef8-41ee-8622-5d0ac9989cbc service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:01.235610 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4164/8433] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:50:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:50:01.268323 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4270/8434] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:50:01 2022] PUT /identity/v3/projects/aec779a03e1c4b5ca59a8557943e709f/users/7e622a9048934b399acaf65a32e96bb3/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:50:01.274043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411d016-0d80-4f39-bc27-cde63f2515c8 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:01.274734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411d016-0d80-4f39-bc27-cde63f2515c8 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:01.275086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9411d016-0d80-4f39-bc27-cde63f2515c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:01.295269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9411d016-0d80-4f39-bc27-cde63f2515c8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:50:01.296642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9411d016-0d80-4f39-bc27-cde63f2515c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:01.350608 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:50:01.364069 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4165/8435] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:50:01.375645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a214cb0-4031-4456-9326-1d6671f2d509 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:01.378430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6a214cb0-4031-4456-9326-1d6671f2d509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:01.501144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a214cb0-4031-4456-9326-1d6671f2d509 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:01.510067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ccd22-99aa-4cc5-8ea1-3448e9360d8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:01.510067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ccd22-99aa-4cc5-8ea1-3448e9360d8e service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:01.510067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ccd22-99aa-4cc5-8ea1-3448e9360d8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:01.510067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ccd22-99aa-4cc5-8ea1-3448e9360d8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:01.522513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ccd22-99aa-4cc5-8ea1-3448e9360d8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:01.525494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ccd22-99aa-4cc5-8ea1-3448e9360d8e service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:01.540440 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4271/8436] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:50:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:50:01.940034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411d016-0d80-4f39-bc27-cde63f2515c8 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:01.950337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9411d016-0d80-4f39-bc27-cde63f2515c8 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:01.955177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c7a7f-d674-4873-8688-4a47f1e3f31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:01.956118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c7a7f-d674-4873-8688-4a47f1e3f31e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:01.956393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c7a7f-d674-4873-8688-4a47f1e3f31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:01.956668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528c7a7f-d674-4873-8688-4a47f1e3f31e admin admin] PATH_INFO: `/v3/users/cc31f8dc956e4452a69ef481ab9be992` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:01.958147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c7a7f-d674-4873-8688-4a47f1e3f31e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc31f8dc956e4452a69ef481ab9be992)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:01.959996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528c7a7f-d674-4873-8688-4a47f1e3f31e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:02.248114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-528c7a7f-d674-4873-8688-4a47f1e3f31e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc31f8dc956e4452a69ef481ab9be992'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:02.301444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-528c7a7f-d674-4873-8688-4a47f1e3f31e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc31f8dc956e4452a69ef481ab9be992'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:02.305301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-528c7a7f-d674-4873-8688-4a47f1e3f31e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc31f8dc956e4452a69ef481ab9be992'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:02.305301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-528c7a7f-d674-4873-8688-4a47f1e3f31e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc31f8dc956e4452a69ef481ab9be992'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:02.320318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-528c7a7f-d674-4873-8688-4a47f1e3f31e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc31f8dc956e4452a69ef481ab9be992'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:02.456562 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4166/8437] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:50:01 2022] DELETE /identity/v3/users/cc31f8dc956e4452a69ef481ab9be992 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:50:02.461755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb7c30-0434-4b35-924f-a3f487657092 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:02.462312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb7c30-0434-4b35-924f-a3f487657092 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:02.462624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb7c30-0434-4b35-924f-a3f487657092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:02.486313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-35fb7c30-0434-4b35-924f-a3f487657092 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:50:02.487770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-35fb7c30-0434-4b35-924f-a3f487657092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:02.596950 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4272/8438] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:50:02.635115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c7a7f-d674-4873-8688-4a47f1e3f31e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:02.636927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-528c7a7f-d674-4873-8688-4a47f1e3f31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:02.750884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528c7a7f-d674-4873-8688-4a47f1e3f31e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:02.755496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273ff26-138a-4232-b112-1748c5ad2e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:02.756697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273ff26-138a-4232-b112-1748c5ad2e9a service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:02.757736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273ff26-138a-4232-b112-1748c5ad2e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:02.759051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273ff26-138a-4232-b112-1748c5ad2e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:02.796273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273ff26-138a-4232-b112-1748c5ad2e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:02.800385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d273ff26-138a-4232-b112-1748c5ad2e9a service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:02.827486 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4167/8439] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:50:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:50:03.643519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb7c30-0434-4b35-924f-a3f487657092 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:03.645104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-35fb7c30-0434-4b35-924f-a3f487657092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:03.663687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb7c30-0434-4b35-924f-a3f487657092 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:03.670676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c8b62-c008-4ec9-a83a-fee7fd981032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:03.671859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c8b62-c008-4ec9-a83a-fee7fd981032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:03.672383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c8b62-c008-4ec9-a83a-fee7fd981032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:03.672822 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6c8b62-c008-4ec9-a83a-fee7fd981032 admin admin] PATH_INFO: `/v3/projects/9c76cbf5f4584a3089b733ad094f2a20` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:03.674483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c8b62-c008-4ec9-a83a-fee7fd981032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c76cbf5f4584a3089b733ad094f2a20)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:03.678198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6c8b62-c008-4ec9-a83a-fee7fd981032 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:03.826818 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:50:03.832720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ca6c8b62-c008-4ec9-a83a-fee7fd981032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c76cbf5f4584a3089b733ad094f2a20', 'request_id': 'req-ca6c8b62-c008-4ec9-a83a-fee7fd981032'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:03.844780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ca6c8b62-c008-4ec9-a83a-fee7fd981032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c76cbf5f4584a3089b733ad094f2a20', 'request_id': 'req-ca6c8b62-c008-4ec9-a83a-fee7fd981032'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:03.854518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ca6c8b62-c008-4ec9-a83a-fee7fd981032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c76cbf5f4584a3089b733ad094f2a20', 'request_id': 'req-ca6c8b62-c008-4ec9-a83a-fee7fd981032'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:04.017901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ca6c8b62-c008-4ec9-a83a-fee7fd981032 admin admin] The token cache is being invalidate because project 9c76cbf5f4584a3089b733ad094f2a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:50:04.018205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ca6c8b62-c008-4ec9-a83a-fee7fd981032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:04.018864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ca6c8b62-c008-4ec9-a83a-fee7fd981032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:04.020735 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4273/8440] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:50:03 2022] DELETE /identity/v3/projects/9c76cbf5f4584a3089b733ad094f2a20 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:50:04.025276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273ff26-138a-4232-b112-1748c5ad2e9a service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:04.044506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273ff26-138a-4232-b112-1748c5ad2e9a service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:04.160739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c13968-97a2-43af-a052-b4a348ed4d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:04.161766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c13968-97a2-43af-a052-b4a348ed4d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:04.162149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c13968-97a2-43af-a052-b4a348ed4d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:04.162418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c13968-97a2-43af-a052-b4a348ed4d75 admin admin] PATH_INFO: `/v3/users/804c64e5c4294d029ee6b4b523d94eca` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:04.164255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c13968-97a2-43af-a052-b4a348ed4d75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=804c64e5c4294d029ee6b4b523d94eca)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:04.166307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c13968-97a2-43af-a052-b4a348ed4d75 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:04.177500 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:50:04.409468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-43c13968-97a2-43af-a052-b4a348ed4d75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '804c64e5c4294d029ee6b4b523d94eca'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:04.442744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-43c13968-97a2-43af-a052-b4a348ed4d75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '804c64e5c4294d029ee6b4b523d94eca'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:04.445683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-43c13968-97a2-43af-a052-b4a348ed4d75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '804c64e5c4294d029ee6b4b523d94eca'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:04.447259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-43c13968-97a2-43af-a052-b4a348ed4d75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '804c64e5c4294d029ee6b4b523d94eca'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:04.482891 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-43c13968-97a2-43af-a052-b4a348ed4d75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '804c64e5c4294d029ee6b4b523d94eca'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:04.579771 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4168/8441] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:50:04 2022] DELETE /identity/v3/users/804c64e5c4294d029ee6b4b523d94eca => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:50:06.018164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c8b62-c008-4ec9-a83a-fee7fd981032 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:06.020801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ca6c8b62-c008-4ec9-a83a-fee7fd981032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:06.068868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6c8b62-c008-4ec9-a83a-fee7fd981032 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:06.308688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb3c9eb-4c3d-4fe1-8cc1-e512879e561a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:06.310630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c9eb-4c3d-4fe1-8cc1-e512879e561a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:06.310941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c9eb-4c3d-4fe1-8cc1-e512879e561a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:06.311230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb3c9eb-4c3d-4fe1-8cc1-e512879e561a admin admin] PATH_INFO: `/v3/projects/4d469d778be647b7b140ca2bc47e63c9` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:06.315068 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3c9eb-4c3d-4fe1-8cc1-e512879e561a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d469d778be647b7b140ca2bc47e63c9)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:06.319025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb3c9eb-4c3d-4fe1-8cc1-e512879e561a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:06.592273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5bb3c9eb-4c3d-4fe1-8cc1-e512879e561a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d469d778be647b7b140ca2bc47e63c9', 'request_id': 'req-5bb3c9eb-4c3d-4fe1-8cc1-e512879e561a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:06.615589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5bb3c9eb-4c3d-4fe1-8cc1-e512879e561a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d469d778be647b7b140ca2bc47e63c9', 'request_id': 'req-5bb3c9eb-4c3d-4fe1-8cc1-e512879e561a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:06.633173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5bb3c9eb-4c3d-4fe1-8cc1-e512879e561a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d469d778be647b7b140ca2bc47e63c9', 'request_id': 'req-5bb3c9eb-4c3d-4fe1-8cc1-e512879e561a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:06.758395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5bb3c9eb-4c3d-4fe1-8cc1-e512879e561a admin admin] The token cache is being invalidate because project 4d469d778be647b7b140ca2bc47e63c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:50:06.758789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5bb3c9eb-4c3d-4fe1-8cc1-e512879e561a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:06.762487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-5bb3c9eb-4c3d-4fe1-8cc1-e512879e561a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:50:06.764201 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4274/8442] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:50:06 2022] DELETE /identity/v3/projects/4d469d778be647b7b140ca2bc47e63c9 => generated 0 bytes in 747 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:50:06.769538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbf11d-140c-4b98-bb9e-c6d3e432797d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:06.769908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbf11d-140c-4b98-bb9e-c6d3e432797d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:06.770060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbf11d-140c-4b98-bb9e-c6d3e432797d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:06.826151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d4fbf11d-140c-4b98-bb9e-c6d3e432797d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:50:06.827888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d4fbf11d-140c-4b98-bb9e-c6d3e432797d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:07.024270 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4169/8443] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:50:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:50:07.032410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8eba92-734e-432a-9834-c81a5ebb9066 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:07.032949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8eba92-734e-432a-9834-c81a5ebb9066 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:07.032949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8eba92-734e-432a-9834-c81a5ebb9066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:07.064349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ff8eba92-734e-432a-9834-c81a5ebb9066 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:50:07.065827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ff8eba92-734e-432a-9834-c81a5ebb9066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:07.076998 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4275/8444] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:50:07.081396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbf11d-140c-4b98-bb9e-c6d3e432797d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:07.096686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbf11d-140c-4b98-bb9e-c6d3e432797d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:07.113320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a4f49-167f-4d90-bc13-f4d44d8e8c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:07.126496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a4f49-167f-4d90-bc13-f4d44d8e8c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:07.126496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a4f49-167f-4d90-bc13-f4d44d8e8c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:07.126496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56a4f49-167f-4d90-bc13-f4d44d8e8c93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:07.126496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a4f49-167f-4d90-bc13-f4d44d8e8c93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:50:07.126496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a4f49-167f-4d90-bc13-f4d44d8e8c93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:07.126496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56a4f49-167f-4d90-bc13-f4d44d8e8c93 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:07.141456 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4170/8445] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:50:07.146047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8eba92-734e-432a-9834-c81a5ebb9066 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:07.158211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8eba92-734e-432a-9834-c81a5ebb9066 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:07.182709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbceb8-d957-4cc0-9eb3-488f25dc6f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:07.183492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbceb8-d957-4cc0-9eb3-488f25dc6f82 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:07.184181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbceb8-d957-4cc0-9eb3-488f25dc6f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:07.184181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bbceb8-d957-4cc0-9eb3-488f25dc6f82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:07.185086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbceb8-d957-4cc0-9eb3-488f25dc6f82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:07.187599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bbceb8-d957-4cc0-9eb3-488f25dc6f82 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:07.351853 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4276/8446] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:50:07 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:50:07.353550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a4f49-167f-4d90-bc13-f4d44d8e8c93 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:07.372088 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56a4f49-167f-4d90-bc13-f4d44d8e8c93 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:07.567143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0e198-bcb2-487d-91ef-534283762f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:07.568193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0e198-bcb2-487d-91ef-534283762f9e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:07.568679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0e198-bcb2-487d-91ef-534283762f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:07.569068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0e198-bcb2-487d-91ef-534283762f9e admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:07.569977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0e198-bcb2-487d-91ef-534283762f9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:07.575142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0e198-bcb2-487d-91ef-534283762f9e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:07.692586 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4171/8447] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:50:07 2022] POST /identity/v3/users => generated 291 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:50:07.697211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbceb8-d957-4cc0-9eb3-488f25dc6f82 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:07.714263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bbceb8-d957-4cc0-9eb3-488f25dc6f82 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:07.733158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b8cd0-129b-45b4-bbd0-e18cf5c579af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:07.733862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b8cd0-129b-45b4-bbd0-e18cf5c579af admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:07.734174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b8cd0-129b-45b4-bbd0-e18cf5c579af admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:07.734455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b8cd0-129b-45b4-bbd0-e18cf5c579af admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:07.735196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b8cd0-129b-45b4-bbd0-e18cf5c579af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:07.736817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928b8cd0-129b-45b4-bbd0-e18cf5c579af admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:07.785422 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4277/8448] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:50:07.789223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0e198-bcb2-487d-91ef-534283762f9e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:07.800923 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:50:07.810061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0e198-bcb2-487d-91ef-534283762f9e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:07.821792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28cd729-42d5-4e93-978d-33e315c36369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:07.822612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cd729-42d5-4e93-978d-33e315c36369 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:07.823641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cd729-42d5-4e93-978d-33e315c36369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:07.824071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cd729-42d5-4e93-978d-33e315c36369 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:07.825025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cd729-42d5-4e93-978d-33e315c36369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:07.830479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28cd729-42d5-4e93-978d-33e315c36369 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:07.845459 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4172/8449] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:50:07.845853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b8cd0-129b-45b4-bbd0-e18cf5c579af admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:07.860535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b8cd0-129b-45b4-bbd0-e18cf5c579af admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:07.896949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a757c2d-3a77-4cbb-bc87-152f5d419cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:07.899276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a757c2d-3a77-4cbb-bc87-152f5d419cab admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:07.899682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a757c2d-3a77-4cbb-bc87-152f5d419cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:07.900766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a757c2d-3a77-4cbb-bc87-152f5d419cab admin admin] PATH_INFO: `/v3/projects/504b31731dbc4d4b828048da6ce8cf88/users/657d6749cb974f159384f43c102eabc1/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:07.928756 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a757c2d-3a77-4cbb-bc87-152f5d419cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=504b31731dbc4d4b828048da6ce8cf88, user_id=657d6749cb974f159384f43c102eabc1, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:07.932073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a757c2d-3a77-4cbb-bc87-152f5d419cab admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:08.014610 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:50:08.024279 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4278/8450] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:50:07 2022] PUT /identity/v3/projects/504b31731dbc4d4b828048da6ce8cf88/users/657d6749cb974f159384f43c102eabc1/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:50:08.039850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1918a-ffac-49d8-a2b5-6d9087655a86 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:08.040181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1918a-ffac-49d8-a2b5-6d9087655a86 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:08.040471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1918a-ffac-49d8-a2b5-6d9087655a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:08.126658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b4d1918a-ffac-49d8-a2b5-6d9087655a86 None None] MFA Rules not processed for user `657d6749cb974f159384f43c102eabc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:50:08.127920 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b4d1918a-ffac-49d8-a2b5-6d9087655a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:08.386939 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4173/8451] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:50:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:50:08.393167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a757c2d-3a77-4cbb-bc87-152f5d419cab admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:08.646382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a757c2d-3a77-4cbb-bc87-152f5d419cab admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:08.665832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bed17-78d1-4727-92c8-43174c1ed728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:08.668696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bed17-78d1-4727-92c8-43174c1ed728 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:08.669119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bed17-78d1-4727-92c8-43174c1ed728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:08.670234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bed17-78d1-4727-92c8-43174c1ed728 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:08.671206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bed17-78d1-4727-92c8-43174c1ed728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:08.676318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bed17-78d1-4727-92c8-43174c1ed728 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:08.909218 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4279/8452] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:50:08 2022] POST /identity/v3/projects => generated 383 bytes in 516 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:50:08.912823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1918a-ffac-49d8-a2b5-6d9087655a86 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:08.928608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1918a-ffac-49d8-a2b5-6d9087655a86 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:09.005758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ed07e-5a5f-4133-bfaa-12235a685fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:09.006666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ed07e-5a5f-4133-bfaa-12235a685fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:09.007992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ed07e-5a5f-4133-bfaa-12235a685fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:09.008392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ed07e-5a5f-4133-bfaa-12235a685fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:09.009216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ed07e-5a5f-4133-bfaa-12235a685fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:09.011474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ed07e-5a5f-4133-bfaa-12235a685fe8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:09.195803 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4174/8453] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:50:08 2022] POST /identity/v3/users => generated 298 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:50:09.210939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bed17-78d1-4727-92c8-43174c1ed728 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:09.226652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bed17-78d1-4727-92c8-43174c1ed728 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:09.234972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f3612-d612-46f3-a7bb-903f5db07fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:09.237272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f3612-d612-46f3-a7bb-903f5db07fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:09.237796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f3612-d612-46f3-a7bb-903f5db07fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:09.238300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f3612-d612-46f3-a7bb-903f5db07fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:09.240534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f3612-d612-46f3-a7bb-903f5db07fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:09.250921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f3612-d612-46f3-a7bb-903f5db07fc0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:09.289015 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4280/8454] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:50:09.293332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ed07e-5a5f-4133-bfaa-12235a685fe8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:09.317645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ed07e-5a5f-4133-bfaa-12235a685fe8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:09.336686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23703849-e985-4536-b778-0aa67a2a3c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:09.337619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23703849-e985-4536-b778-0aa67a2a3c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:09.338051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23703849-e985-4536-b778-0aa67a2a3c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:09.338372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23703849-e985-4536-b778-0aa67a2a3c19 admin admin] PATH_INFO: `/v3/projects/f555fa67554c48968a129daacf84fd17/users/14853bcf3cbb4588af37623ff7024a69/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:09.362524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23703849-e985-4536-b778-0aa67a2a3c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f555fa67554c48968a129daacf84fd17, user_id=14853bcf3cbb4588af37623ff7024a69, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:09.366064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23703849-e985-4536-b778-0aa67a2a3c19 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:09.466503 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4175/8455] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:50:09 2022] PUT /identity/v3/projects/f555fa67554c48968a129daacf84fd17/users/14853bcf3cbb4588af37623ff7024a69/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:50:09.470333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f3612-d612-46f3-a7bb-903f5db07fc0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:09.482023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f3612-d612-46f3-a7bb-903f5db07fc0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:09.656628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced53ac6-9094-4f63-9df0-c346f0d58e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:09.657625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced53ac6-9094-4f63-9df0-c346f0d58e69 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:09.657928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced53ac6-9094-4f63-9df0-c346f0d58e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:09.658242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced53ac6-9094-4f63-9df0-c346f0d58e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:09.659049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced53ac6-9094-4f63-9df0-c346f0d58e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:09.661813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23703849-e985-4536-b778-0aa67a2a3c19 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:09.664225 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-23703849-e985-4536-b778-0aa67a2a3c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:09.667969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced53ac6-9094-4f63-9df0-c346f0d58e69 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:09.732014 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4281/8456] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:50:09.735640 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced53ac6-9094-4f63-9df0-c346f0d58e69 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:09.767468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced53ac6-9094-4f63-9df0-c346f0d58e69 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:09.775970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cfc14-fa15-4ebd-a55b-1c1048bbba2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:09.776951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cfc14-fa15-4ebd-a55b-1c1048bbba2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:09.777674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cfc14-fa15-4ebd-a55b-1c1048bbba2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:09.778411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cfc14-fa15-4ebd-a55b-1c1048bbba2d admin admin] PATH_INFO: `/v3/projects/f555fa67554c48968a129daacf84fd17/users/14853bcf3cbb4588af37623ff7024a69/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:09.782344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cfc14-fa15-4ebd-a55b-1c1048bbba2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f555fa67554c48968a129daacf84fd17, user_id=14853bcf3cbb4588af37623ff7024a69, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:09.786619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cfc14-fa15-4ebd-a55b-1c1048bbba2d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:09.787200 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:50:09.815375 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4282/8457] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:50:09 2022] PUT /identity/v3/projects/f555fa67554c48968a129daacf84fd17/users/14853bcf3cbb4588af37623ff7024a69/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:50:09.832152 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b16325-2838-4ba6-8b10-7f90b13e2154 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:09.838134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b16325-2838-4ba6-8b10-7f90b13e2154 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:09.838134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b16325-2838-4ba6-8b10-7f90b13e2154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:09.838404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23703849-e985-4536-b778-0aa67a2a3c19 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:09.892751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-11b16325-2838-4ba6-8b10-7f90b13e2154 None None] MFA Rules not processed for user `14853bcf3cbb4588af37623ff7024a69`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:50:09.895773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-11b16325-2838-4ba6-8b10-7f90b13e2154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:09.959915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5283620-b8e9-47bc-bade-5c1bb947133e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:09.961415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5283620-b8e9-47bc-bade-5c1bb947133e service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:09.961714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5283620-b8e9-47bc-bade-5c1bb947133e service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:09.962001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5283620-b8e9-47bc-bade-5c1bb947133e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:09.966329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e5283620-b8e9-47bc-bade-5c1bb947133e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:09.985196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5283620-b8e9-47bc-bade-5c1bb947133e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:09.988232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5283620-b8e9-47bc-bade-5c1bb947133e service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:10.018342 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4176/8458] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:50:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:50:10.024770 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:50:10.074447 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4283/8459] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:50:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:50:10.094205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5283620-b8e9-47bc-bade-5c1bb947133e service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:10.098023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e5283620-b8e9-47bc-bade-5c1bb947133e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:10.239309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5283620-b8e9-47bc-bade-5c1bb947133e service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:10.262235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd1a44-6efa-47b1-a816-65a50d9e5175 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:10.267331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd1a44-6efa-47b1-a816-65a50d9e5175 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:10.267331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd1a44-6efa-47b1-a816-65a50d9e5175 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:10.267331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd1a44-6efa-47b1-a816-65a50d9e5175 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:10.419030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd1a44-6efa-47b1-a816-65a50d9e5175 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:10.422069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd1a44-6efa-47b1-a816-65a50d9e5175 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:10.447624 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4177/8460] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:50:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:50:14.357106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b14d5-6c72-4538-aae8-717f07bf8db0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:14.357587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b14d5-6c72-4538-aae8-717f07bf8db0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:14.357678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b14d5-6c72-4538-aae8-717f07bf8db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:14.414341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-dd7b14d5-6c72-4538-aae8-717f07bf8db0 None None] MFA Rules not processed for user `7e622a9048934b399acaf65a32e96bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:50:14.415871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dd7b14d5-6c72-4538-aae8-717f07bf8db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:14.523993 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4284/8461] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:50:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:50:14.528416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd1a44-6efa-47b1-a816-65a50d9e5175 service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:14.530167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-81cd1a44-6efa-47b1-a816-65a50d9e5175 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:14.629347 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:50:14.709416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd1a44-6efa-47b1-a816-65a50d9e5175 service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:14.716231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a04a4-7c9a-478e-a790-67ce1923690c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:14.717506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a04a4-7c9a-478e-a790-67ce1923690c admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:14.718142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a04a4-7c9a-478e-a790-67ce1923690c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:14.718849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854a04a4-7c9a-478e-a790-67ce1923690c admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:14.720008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a04a4-7c9a-478e-a790-67ce1923690c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:14.722229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854a04a4-7c9a-478e-a790-67ce1923690c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:14.926469 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4178/8462] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:50:14 2022] POST /identity/v3/projects => generated 373 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:50:14.933521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b14d5-6c72-4538-aae8-717f07bf8db0 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:14.950648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b14d5-6c72-4538-aae8-717f07bf8db0 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:15.256389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f415765-163b-4e84-88f5-a4441c2c8d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:15.260575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f415765-163b-4e84-88f5-a4441c2c8d8f admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:15.264793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f415765-163b-4e84-88f5-a4441c2c8d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:15.264793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f415765-163b-4e84-88f5-a4441c2c8d8f admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:15.279698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f415765-163b-4e84-88f5-a4441c2c8d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:15.281699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f415765-163b-4e84-88f5-a4441c2c8d8f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:15.399907 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4285/8463] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:50:14 2022] POST /identity/v3/users => generated 293 bytes in 467 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:50:15.404002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a04a4-7c9a-478e-a790-67ce1923690c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:15.424273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854a04a4-7c9a-478e-a790-67ce1923690c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:15.436290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a8cf3-ef72-4f1b-961e-5fe95cc7ec2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:15.437829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a8cf3-ef72-4f1b-961e-5fe95cc7ec2a admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:15.438280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a8cf3-ef72-4f1b-961e-5fe95cc7ec2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:15.439550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a8cf3-ef72-4f1b-961e-5fe95cc7ec2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:15.439550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a8cf3-ef72-4f1b-961e-5fe95cc7ec2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:15.445624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a8cf3-ef72-4f1b-961e-5fe95cc7ec2a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:15.461848 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4179/8464] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:50:15.466178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f415765-163b-4e84-88f5-a4441c2c8d8f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:15.478706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f415765-163b-4e84-88f5-a4441c2c8d8f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:15.494456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f931a-7cfd-44a2-a739-b7dfb5cc039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:15.497060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f931a-7cfd-44a2-a739-b7dfb5cc039e admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:15.497060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f931a-7cfd-44a2-a739-b7dfb5cc039e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:15.497060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657f931a-7cfd-44a2-a739-b7dfb5cc039e admin admin] PATH_INFO: `/v3/projects/70af181370be4dc0b5896444668b9027/users/68083e9fdb7642f4be5944f1358681b8/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:15.523651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f931a-7cfd-44a2-a739-b7dfb5cc039e admin admin] RBAC: Authorizing `identity:create_grant(project_id=70af181370be4dc0b5896444668b9027, user_id=68083e9fdb7642f4be5944f1358681b8, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:15.528528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657f931a-7cfd-44a2-a739-b7dfb5cc039e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:15.641183 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4286/8465] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:50:15 2022] PUT /identity/v3/projects/70af181370be4dc0b5896444668b9027/users/68083e9fdb7642f4be5944f1358681b8/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:50:15.642188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a8cf3-ef72-4f1b-961e-5fe95cc7ec2a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:15.667532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a8cf3-ef72-4f1b-961e-5fe95cc7ec2a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:15.803338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587a3549-a739-4df3-bce3-bff0e081756f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:15.807606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a3549-a739-4df3-bce3-bff0e081756f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:15.807606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a3549-a739-4df3-bce3-bff0e081756f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:15.807606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587a3549-a739-4df3-bce3-bff0e081756f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:15.815326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a3549-a739-4df3-bce3-bff0e081756f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:15.823769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587a3549-a739-4df3-bce3-bff0e081756f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:15.859237 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4180/8466] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:50:15 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:50:15.861391 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f931a-7cfd-44a2-a739-b7dfb5cc039e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:15.894803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657f931a-7cfd-44a2-a739-b7dfb5cc039e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:15.908966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aecb42-82ca-442b-9554-b90ab5468f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:15.910593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aecb42-82ca-442b-9554-b90ab5468f47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:15.910884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aecb42-82ca-442b-9554-b90ab5468f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:15.911203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aecb42-82ca-442b-9554-b90ab5468f47 admin admin] PATH_INFO: `/v3/projects/70af181370be4dc0b5896444668b9027/users/68083e9fdb7642f4be5944f1358681b8/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:15.927436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aecb42-82ca-442b-9554-b90ab5468f47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70af181370be4dc0b5896444668b9027, user_id=68083e9fdb7642f4be5944f1358681b8, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:15.934646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aecb42-82ca-442b-9554-b90ab5468f47 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:15.970395 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4287/8467] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:50:15 2022] PUT /identity/v3/projects/70af181370be4dc0b5896444668b9027/users/68083e9fdb7642f4be5944f1358681b8/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:50:25.846882 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=55,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:50:25.961335 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=84,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:50:26.883384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a137c1-3a31-4c59-87b1-b5e8a77b5ac2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:26.884212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a137c1-3a31-4c59-87b1-b5e8a77b5ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:26.885270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a137c1-3a31-4c59-87b1-b5e8a77b5ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:26.960115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-92a137c1-3a31-4c59-87b1-b5e8a77b5ac2 None None] MFA Rules not processed for user `68083e9fdb7642f4be5944f1358681b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:50:26.968895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-92a137c1-3a31-4c59-87b1-b5e8a77b5ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:27.155656 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4181/8468] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:50:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:50:27.166860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aecb42-82ca-442b-9554-b90ab5468f47 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:27.168814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-72aecb42-82ca-442b-9554-b90ab5468f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:27.366378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aecb42-82ca-442b-9554-b90ab5468f47 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:27.389948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f848e4b-a235-4e0f-921b-50917fab72ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:27.391954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f848e4b-a235-4e0f-921b-50917fab72ba service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:27.392357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f848e4b-a235-4e0f-921b-50917fab72ba service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:27.393659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f848e4b-a235-4e0f-921b-50917fab72ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:27.425956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f848e4b-a235-4e0f-921b-50917fab72ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:27.428032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f848e4b-a235-4e0f-921b-50917fab72ba service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:27.483258 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4288/8469] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:50:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:50:27.604385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea6089-bf86-4aa9-9356-caf3f5b6f737 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:27.606585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea6089-bf86-4aa9-9356-caf3f5b6f737 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:27.606585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ea6089-bf86-4aa9-9356-caf3f5b6f737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:27.665051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-58ea6089-bf86-4aa9-9356-caf3f5b6f737 None None] MFA Rules not processed for user `7e622a9048934b399acaf65a32e96bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:50:27.670003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-58ea6089-bf86-4aa9-9356-caf3f5b6f737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:27.850638 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4182/8470] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:50:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:50:28.119326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f848e4b-a235-4e0f-921b-50917fab72ba service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:50:28.122453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0f848e4b-a235-4e0f-921b-50917fab72ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:28.343554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f848e4b-a235-4e0f-921b-50917fab72ba service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:50:28.352863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd38121-34df-4b78-85cf-7f8c1d6bfeb5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:50:28.354027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd38121-34df-4b78-85cf-7f8c1d6bfeb5 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:28.354589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd38121-34df-4b78-85cf-7f8c1d6bfeb5 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:28.355082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd38121-34df-4b78-85cf-7f8c1d6bfeb5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:28.490667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd38121-34df-4b78-85cf-7f8c1d6bfeb5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:50:28.492975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd38121-34df-4b78-85cf-7f8c1d6bfeb5 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:50:28.513991 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4289/8471] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:50:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:50:37.839571 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=59 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:50:38.504691 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:50:48.753559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2715b-9598-4876-9407-0ca1899a9d91 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:48.754155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2715b-9598-4876-9407-0ca1899a9d91 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:48.754155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad2715b-9598-4876-9407-0ca1899a9d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:48.800023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0ad2715b-9598-4876-9407-0ca1899a9d91 None None] MFA Rules not processed for user `eee4c63b80eb407395e862126b73d6d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:50:48.826317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0ad2715b-9598-4876-9407-0ca1899a9d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:49.043992 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4183/8472] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:50:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:50:51.843880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb52793-7839-4a85-bd1f-20f0adb80170 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:51.845120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb52793-7839-4a85-bd1f-20f0adb80170 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:51.845806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb52793-7839-4a85-bd1f-20f0adb80170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:51.891926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0fb52793-7839-4a85-bd1f-20f0adb80170 None None] MFA Rules not processed for user `f933a71a6d5d45db993a430166f49c95`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:50:51.893537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0fb52793-7839-4a85-bd1f-20f0adb80170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:52.094992 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4290/8473] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:50:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:50:52.952690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b080e2b-3621-47d8-9538-10cce33f3ae9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:52.953668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b080e2b-3621-47d8-9538-10cce33f3ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:52.954199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b080e2b-3621-47d8-9538-10cce33f3ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:52.985763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5b080e2b-3621-47d8-9538-10cce33f3ae9 None None] MFA Rules not processed for user `7e622a9048934b399acaf65a32e96bb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:50:52.987381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5b080e2b-3621-47d8-9538-10cce33f3ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:53.000122 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4184/8474] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:50:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:50:54.347591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33da01-f318-467d-9281-d8d1804a41ba None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:50:54.348125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33da01-f318-467d-9281-d8d1804a41ba None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:50:54.348125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33da01-f318-467d-9281-d8d1804a41ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:50:54.387701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0f33da01-f318-467d-9281-d8d1804a41ba None None] MFA Rules not processed for user `31e36cabec4a4528a290cfe3c667df64`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:50:54.389451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0f33da01-f318-467d-9281-d8d1804a41ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:50:54.513174 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4291/8475] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:50:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:51:02.975238 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=28 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:51:04.494461 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=50 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:51:21.276290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b080e2b-3621-47d8-9538-10cce33f3ae9 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:51:21.295162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b080e2b-3621-47d8-9538-10cce33f3ae9 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:51:21.300597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb320a-2e6a-4ff1-a2b1-aee2012ed455 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:51:21.301452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb320a-2e6a-4ff1-a2b1-aee2012ed455 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:51:21.302038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb320a-2e6a-4ff1-a2b1-aee2012ed455 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:51:21.302202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb320a-2e6a-4ff1-a2b1-aee2012ed455 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:51:21.304201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6bbb320a-2e6a-4ff1-a2b1-aee2012ed455 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:51:21.393739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb320a-2e6a-4ff1-a2b1-aee2012ed455 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:51:21.396285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb320a-2e6a-4ff1-a2b1-aee2012ed455 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:51:21.408658 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4185/8476] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:51:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 659 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:51:22.239057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33da01-f318-467d-9281-d8d1804a41ba None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:51:22.240653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0f33da01-f318-467d-9281-d8d1804a41ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:51:22.337025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33da01-f318-467d-9281-d8d1804a41ba None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:51:22.343156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ec3f0-9bf4-48d5-8277-5605232bb7b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:51:22.344276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ec3f0-9bf4-48d5-8277-5605232bb7b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:51:22.344719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ec3f0-9bf4-48d5-8277-5605232bb7b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:51:22.345166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460ec3f0-9bf4-48d5-8277-5605232bb7b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:51:22.347225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-460ec3f0-9bf4-48d5-8277-5605232bb7b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:51:22.439282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ec3f0-9bf4-48d5-8277-5605232bb7b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:51:22.440871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460ec3f0-9bf4-48d5-8277-5605232bb7b6 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:51:22.472591 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4292/8477] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:51:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:51:31.070210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb320a-2e6a-4ff1-a2b1-aee2012ed455 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:51:31.177330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb320a-2e6a-4ff1-a2b1-aee2012ed455 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:51:31.183055 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fe640-6716-454d-a5ff-39c45f33386e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:51:31.184700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fe640-6716-454d-a5ff-39c45f33386e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:51:31.185041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fe640-6716-454d-a5ff-39c45f33386e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:51:31.185369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fe640-6716-454d-a5ff-39c45f33386e admin admin] PATH_INFO: `/v3/users/7e622a9048934b399acaf65a32e96bb3` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:51:31.187042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fe640-6716-454d-a5ff-39c45f33386e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e622a9048934b399acaf65a32e96bb3)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:51:31.189533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fe640-6716-454d-a5ff-39c45f33386e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:51:31.461351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e85fe640-6716-454d-a5ff-39c45f33386e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e622a9048934b399acaf65a32e96bb3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:51:31.491042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e85fe640-6716-454d-a5ff-39c45f33386e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e622a9048934b399acaf65a32e96bb3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:51:31.491042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e85fe640-6716-454d-a5ff-39c45f33386e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e622a9048934b399acaf65a32e96bb3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:51:31.491042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e85fe640-6716-454d-a5ff-39c45f33386e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e622a9048934b399acaf65a32e96bb3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:51:31.491412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e85fe640-6716-454d-a5ff-39c45f33386e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e622a9048934b399acaf65a32e96bb3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:51:31.590147 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4186/8478] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:51:31 2022] DELETE /identity/v3/users/7e622a9048934b399acaf65a32e96bb3 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:51:32.056197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ec3f0-9bf4-48d5-8277-5605232bb7b6 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:51:32.089225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460ec3f0-9bf4-48d5-8277-5605232bb7b6 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:51:32.174789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38ff97-9458-4094-a67e-58dc2bd3cddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:51:32.177034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38ff97-9458-4094-a67e-58dc2bd3cddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:51:32.177386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38ff97-9458-4094-a67e-58dc2bd3cddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:51:32.177729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e38ff97-9458-4094-a67e-58dc2bd3cddc admin admin] PATH_INFO: `/v3/projects/aec779a03e1c4b5ca59a8557943e709f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:51:32.179375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38ff97-9458-4094-a67e-58dc2bd3cddc admin admin] RBAC: Authorizing `identity:delete_project(project_id=aec779a03e1c4b5ca59a8557943e709f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:51:32.182254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e38ff97-9458-4094-a67e-58dc2bd3cddc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:51:32.319161 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:51:32.323163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0e38ff97-9458-4094-a67e-58dc2bd3cddc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aec779a03e1c4b5ca59a8557943e709f', 'request_id': 'req-0e38ff97-9458-4094-a67e-58dc2bd3cddc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:51:32.328951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0e38ff97-9458-4094-a67e-58dc2bd3cddc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aec779a03e1c4b5ca59a8557943e709f', 'request_id': 'req-0e38ff97-9458-4094-a67e-58dc2bd3cddc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:51:32.336432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0e38ff97-9458-4094-a67e-58dc2bd3cddc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aec779a03e1c4b5ca59a8557943e709f', 'request_id': 'req-0e38ff97-9458-4094-a67e-58dc2bd3cddc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:51:32.413910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0e38ff97-9458-4094-a67e-58dc2bd3cddc admin admin] The token cache is being invalidate because project aec779a03e1c4b5ca59a8557943e709f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:51:32.415936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0e38ff97-9458-4094-a67e-58dc2bd3cddc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:51:32.415936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-0e38ff97-9458-4094-a67e-58dc2bd3cddc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:51:32.420326 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4293/8479] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:51:32 2022] DELETE /identity/v3/projects/aec779a03e1c4b5ca59a8557943e709f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:51:32.427404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fe640-6716-454d-a5ff-39c45f33386e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:51:32.429396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e85fe640-6716-454d-a5ff-39c45f33386e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:51:32.457858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fe640-6716-454d-a5ff-39c45f33386e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:51:32.465647 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:51:32.527471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0123e4-62e4-4af9-9876-8a400c2ff8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:51:32.528844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0123e4-62e4-4af9-9876-8a400c2ff8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:51:32.529230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0123e4-62e4-4af9-9876-8a400c2ff8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:51:32.529631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0123e4-62e4-4af9-9876-8a400c2ff8c2 admin admin] PATH_INFO: `/v3/users/68083e9fdb7642f4be5944f1358681b8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:51:32.531175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0123e4-62e4-4af9-9876-8a400c2ff8c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68083e9fdb7642f4be5944f1358681b8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:51:32.533150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0123e4-62e4-4af9-9876-8a400c2ff8c2 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:51:32.810415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dc0123e4-62e4-4af9-9876-8a400c2ff8c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68083e9fdb7642f4be5944f1358681b8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:51:32.826312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dc0123e4-62e4-4af9-9876-8a400c2ff8c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68083e9fdb7642f4be5944f1358681b8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:51:32.827324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dc0123e4-62e4-4af9-9876-8a400c2ff8c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68083e9fdb7642f4be5944f1358681b8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:51:32.827978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dc0123e4-62e4-4af9-9876-8a400c2ff8c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68083e9fdb7642f4be5944f1358681b8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:51:32.856404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-dc0123e4-62e4-4af9-9876-8a400c2ff8c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68083e9fdb7642f4be5944f1358681b8'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:51:32.938673 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4187/8480] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:51:32 2022] DELETE /identity/v3/users/68083e9fdb7642f4be5944f1358681b8 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:51:33.208145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38ff97-9458-4094-a67e-58dc2bd3cddc admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:51:33.209716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0e38ff97-9458-4094-a67e-58dc2bd3cddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:51:33.239538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e38ff97-9458-4094-a67e-58dc2bd3cddc admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:51:33.324168 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea672e-3136-44ee-b014-4aa8b948e993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:51:33.325467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea672e-3136-44ee-b014-4aa8b948e993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:51:33.325716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea672e-3136-44ee-b014-4aa8b948e993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:51:33.326166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea672e-3136-44ee-b014-4aa8b948e993 admin admin] PATH_INFO: `/v3/projects/70af181370be4dc0b5896444668b9027` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:51:33.332292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea672e-3136-44ee-b014-4aa8b948e993 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70af181370be4dc0b5896444668b9027)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:51:33.336370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea672e-3136-44ee-b014-4aa8b948e993 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:51:33.437251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-76ea672e-3136-44ee-b014-4aa8b948e993 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70af181370be4dc0b5896444668b9027', 'request_id': 'req-76ea672e-3136-44ee-b014-4aa8b948e993'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:51:33.445199 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-76ea672e-3136-44ee-b014-4aa8b948e993 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70af181370be4dc0b5896444668b9027', 'request_id': 'req-76ea672e-3136-44ee-b014-4aa8b948e993'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:51:33.453023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-76ea672e-3136-44ee-b014-4aa8b948e993 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70af181370be4dc0b5896444668b9027', 'request_id': 'req-76ea672e-3136-44ee-b014-4aa8b948e993'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:51:33.521002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-76ea672e-3136-44ee-b014-4aa8b948e993 admin admin] The token cache is being invalidate because project 70af181370be4dc0b5896444668b9027 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:51:33.521297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-76ea672e-3136-44ee-b014-4aa8b948e993 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:51:33.521936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-76ea672e-3136-44ee-b014-4aa8b948e993 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:51:33.523543 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4294/8481] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:51:33 2022] DELETE /identity/v3/projects/70af181370be4dc0b5896444668b9027 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:51:36.834744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0123e4-62e4-4af9-9876-8a400c2ff8c2 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:51:36.836330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-dc0123e4-62e4-4af9-9876-8a400c2ff8c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:51:36.902029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0123e4-62e4-4af9-9876-8a400c2ff8c2 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:51:36.946326 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:51:36.954038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c472a85-82eb-4e71-a5e9-f8035c1fb337 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:51:36.954727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c472a85-82eb-4e71-a5e9-f8035c1fb337 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:51:36.955017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c472a85-82eb-4e71-a5e9-f8035c1fb337 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:51:36.955302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c472a85-82eb-4e71-a5e9-f8035c1fb337 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:51:36.957450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8c472a85-82eb-4e71-a5e9-f8035c1fb337 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:51:37.023620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c472a85-82eb-4e71-a5e9-f8035c1fb337 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:51:37.025060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c472a85-82eb-4e71-a5e9-f8035c1fb337 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:51:37.035783 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4188/8482] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:51:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:51:43.517261 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=59,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:51:44.901017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea672e-3136-44ee-b014-4aa8b948e993 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:51:44.902676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-76ea672e-3136-44ee-b014-4aa8b948e993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:51:45.005028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea672e-3136-44ee-b014-4aa8b948e993 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:51:45.008726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c0b9f6-2e30-49be-819e-225f3ab072fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:51:45.009384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0b9f6-2e30-49be-819e-225f3ab072fc service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:51:45.009676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0b9f6-2e30-49be-819e-225f3ab072fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:51:45.009960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c0b9f6-2e30-49be-819e-225f3ab072fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:51:45.011766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-07c0b9f6-2e30-49be-819e-225f3ab072fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:51:45.140244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0b9f6-2e30-49be-819e-225f3ab072fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:51:45.141797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c0b9f6-2e30-49be-819e-225f3ab072fc service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:51:45.168872 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4295/8483] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:51:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:51:46.602537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dcb61-1b54-4150-9bdb-23b9a0fc1645 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:51:46.603138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dcb61-1b54-4150-9bdb-23b9a0fc1645 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:51:46.603138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dcb61-1b54-4150-9bdb-23b9a0fc1645 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:51:46.604502 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4189/8484] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:51:46.610066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc7ad4-df78-4fc5-ae96-0976902bee33 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:51:46.610631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc7ad4-df78-4fc5-ae96-0976902bee33 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:51:46.610833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc7ad4-df78-4fc5-ae96-0976902bee33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:51:46.641644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8dbc7ad4-df78-4fc5-ae96-0976902bee33 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:51:46.643171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8dbc7ad4-df78-4fc5-ae96-0976902bee33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:51:46.714757 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4296/8485] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:51:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:51:46.736579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196dcb61-1b54-4150-9bdb-23b9a0fc1645 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:51:46.738348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-196dcb61-1b54-4150-9bdb-23b9a0fc1645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:51:46.760542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196dcb61-1b54-4150-9bdb-23b9a0fc1645 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:51:46.765980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172f367-fd67-46c7-93cc-c0251cb86ff3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:51:46.767174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172f367-fd67-46c7-93cc-c0251cb86ff3 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:51:46.767174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172f367-fd67-46c7-93cc-c0251cb86ff3 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:51:46.767362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172f367-fd67-46c7-93cc-c0251cb86ff3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:51:46.776773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172f367-fd67-46c7-93cc-c0251cb86ff3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:51:46.778364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172f367-fd67-46c7-93cc-c0251cb86ff3 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:51:46.788699 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4190/8486] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:51:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:51:47.508344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc7ad4-df78-4fc5-ae96-0976902bee33 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:51:47.509947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8dbc7ad4-df78-4fc5-ae96-0976902bee33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:51:47.525330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc7ad4-df78-4fc5-ae96-0976902bee33 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:51:47.529266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943e9fa-26ac-471b-b1b2-d28b7de93e93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:51:47.529994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943e9fa-26ac-471b-b1b2-d28b7de93e93 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:51:47.530410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943e9fa-26ac-471b-b1b2-d28b7de93e93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:51:47.530759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943e9fa-26ac-471b-b1b2-d28b7de93e93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:51:47.532648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e943e9fa-26ac-471b-b1b2-d28b7de93e93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:51:47.557912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943e9fa-26ac-471b-b1b2-d28b7de93e93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:51:47.559429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943e9fa-26ac-471b-b1b2-d28b7de93e93 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:51:47.564901 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:51:47.577512 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4297/8487] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:51:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:51:56.784081 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=36 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:51:57.760296 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:52:01.008215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172f367-fd67-46c7-93cc-c0251cb86ff3 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:01.010392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7172f367-fd67-46c7-93cc-c0251cb86ff3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:01.033112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172f367-fd67-46c7-93cc-c0251cb86ff3 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:01.040001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5bb23-b5e1-48df-9e14-06b79c9eecb9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:01.041011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5bb23-b5e1-48df-9e14-06b79c9eecb9 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:01.041727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5bb23-b5e1-48df-9e14-06b79c9eecb9 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:01.042636 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5bb23-b5e1-48df-9e14-06b79c9eecb9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:01.044943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-35c5bb23-b5e1-48df-9e14-06b79c9eecb9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:01.064908 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5bb23-b5e1-48df-9e14-06b79c9eecb9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:01.068528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5bb23-b5e1-48df-9e14-06b79c9eecb9 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:01.094488 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4191/8488] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:52:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:52:01.555234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943e9fa-26ac-471b-b1b2-d28b7de93e93 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:01.563803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e943e9fa-26ac-471b-b1b2-d28b7de93e93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:01.658286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943e9fa-26ac-471b-b1b2-d28b7de93e93 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:01.666343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30148cf-85cf-4df4-bcdd-00f4110f53ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:01.667526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30148cf-85cf-4df4-bcdd-00f4110f53ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:01.667885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30148cf-85cf-4df4-bcdd-00f4110f53ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:01.668239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30148cf-85cf-4df4-bcdd-00f4110f53ba admin admin] PATH_INFO: `/v3/users/f933a71a6d5d45db993a430166f49c95` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:01.669738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30148cf-85cf-4df4-bcdd-00f4110f53ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=f933a71a6d5d45db993a430166f49c95)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:01.672125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30148cf-85cf-4df4-bcdd-00f4110f53ba admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:01.916980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f30148cf-85cf-4df4-bcdd-00f4110f53ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f933a71a6d5d45db993a430166f49c95'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:01.931650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f30148cf-85cf-4df4-bcdd-00f4110f53ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f933a71a6d5d45db993a430166f49c95'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:01.939296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f30148cf-85cf-4df4-bcdd-00f4110f53ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f933a71a6d5d45db993a430166f49c95'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:01.941698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f30148cf-85cf-4df4-bcdd-00f4110f53ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f933a71a6d5d45db993a430166f49c95'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:02.016428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f30148cf-85cf-4df4-bcdd-00f4110f53ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f933a71a6d5d45db993a430166f49c95'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:02.024827 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4298/8489] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:52:01 2022] DELETE /identity/v3/users/f933a71a6d5d45db993a430166f49c95 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:52:02.031544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51227252-b56f-41f8-97b6-4ad4b0a2087a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:02.032185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51227252-b56f-41f8-97b6-4ad4b0a2087a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:02.032185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51227252-b56f-41f8-97b6-4ad4b0a2087a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:02.060729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-51227252-b56f-41f8-97b6-4ad4b0a2087a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:52:02.062532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-51227252-b56f-41f8-97b6-4ad4b0a2087a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:02.141465 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4192/8490] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:52:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:52:02.151885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30148cf-85cf-4df4-bcdd-00f4110f53ba admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:02.153294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f30148cf-85cf-4df4-bcdd-00f4110f53ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:02.217559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30148cf-85cf-4df4-bcdd-00f4110f53ba admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:02.221969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168fb71-c792-455d-aa6e-6ab2f31c46b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:02.223329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168fb71-c792-455d-aa6e-6ab2f31c46b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:02.226255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168fb71-c792-455d-aa6e-6ab2f31c46b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:02.226255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168fb71-c792-455d-aa6e-6ab2f31c46b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:02.234180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168fb71-c792-455d-aa6e-6ab2f31c46b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:02.235630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168fb71-c792-455d-aa6e-6ab2f31c46b1 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:02.246405 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4299/8491] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:52:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:52:02.604349 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51227252-b56f-41f8-97b6-4ad4b0a2087a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:02.606028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-51227252-b56f-41f8-97b6-4ad4b0a2087a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:02.630152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51227252-b56f-41f8-97b6-4ad4b0a2087a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:02.635212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8e76b-615c-4b9a-891b-3f18c34282f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:02.636289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8e76b-615c-4b9a-891b-3f18c34282f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:02.636581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8e76b-615c-4b9a-891b-3f18c34282f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:02.636865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8e76b-615c-4b9a-891b-3f18c34282f5 admin admin] PATH_INFO: `/v3/projects/498418c507f749439f0b15c58cbe6c67` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:02.640671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8e76b-615c-4b9a-891b-3f18c34282f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=498418c507f749439f0b15c58cbe6c67)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:02.640671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8e76b-615c-4b9a-891b-3f18c34282f5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:02.795637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-15b8e76b-615c-4b9a-891b-3f18c34282f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '498418c507f749439f0b15c58cbe6c67', 'request_id': 'req-15b8e76b-615c-4b9a-891b-3f18c34282f5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:02.983819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-15b8e76b-615c-4b9a-891b-3f18c34282f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '498418c507f749439f0b15c58cbe6c67', 'request_id': 'req-15b8e76b-615c-4b9a-891b-3f18c34282f5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:03.024231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-15b8e76b-615c-4b9a-891b-3f18c34282f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '498418c507f749439f0b15c58cbe6c67', 'request_id': 'req-15b8e76b-615c-4b9a-891b-3f18c34282f5'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:03.024231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-15b8e76b-615c-4b9a-891b-3f18c34282f5 admin admin] The token cache is being invalidate because project 498418c507f749439f0b15c58cbe6c67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:52:03.024231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-15b8e76b-615c-4b9a-891b-3f18c34282f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:03.024231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-15b8e76b-615c-4b9a-891b-3f18c34282f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:03.024231 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4193/8492] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:52:02 2022] DELETE /identity/v3/projects/498418c507f749439f0b15c58cbe6c67 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:52:03.027371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168fb71-c792-455d-aa6e-6ab2f31c46b1 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:03.031066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168fb71-c792-455d-aa6e-6ab2f31c46b1 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:03.058238 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:52:03.108617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e26ba-354c-402e-a9de-d69fd8906512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:03.123777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e26ba-354c-402e-a9de-d69fd8906512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:03.123777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e26ba-354c-402e-a9de-d69fd8906512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:03.123777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e26ba-354c-402e-a9de-d69fd8906512 admin admin] PATH_INFO: `/v3/users/1aa4a04125194ed782b5f1dca0dc9705` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:03.123777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e26ba-354c-402e-a9de-d69fd8906512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aa4a04125194ed782b5f1dca0dc9705)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:03.123777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5e26ba-354c-402e-a9de-d69fd8906512 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:03.446211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9e5e26ba-354c-402e-a9de-d69fd8906512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aa4a04125194ed782b5f1dca0dc9705'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:03.460952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9e5e26ba-354c-402e-a9de-d69fd8906512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aa4a04125194ed782b5f1dca0dc9705'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:03.470909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9e5e26ba-354c-402e-a9de-d69fd8906512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aa4a04125194ed782b5f1dca0dc9705'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:03.471695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9e5e26ba-354c-402e-a9de-d69fd8906512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aa4a04125194ed782b5f1dca0dc9705'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:03.577947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9e5e26ba-354c-402e-a9de-d69fd8906512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aa4a04125194ed782b5f1dca0dc9705'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:03.591164 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4300/8493] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:52:03 2022] DELETE /identity/v3/users/1aa4a04125194ed782b5f1dca0dc9705 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:52:04.088248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8e76b-615c-4b9a-891b-3f18c34282f5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:04.089806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-15b8e76b-615c-4b9a-891b-3f18c34282f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:04.114611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8e76b-615c-4b9a-891b-3f18c34282f5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:04.178854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed179b-5564-42cf-8dfe-d43c911e43d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:04.178854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed179b-5564-42cf-8dfe-d43c911e43d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:04.178854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed179b-5564-42cf-8dfe-d43c911e43d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:04.178854 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed179b-5564-42cf-8dfe-d43c911e43d0 admin admin] PATH_INFO: `/v3/projects/17c3b97d2fc14203a643db69ebca606b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:04.180114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed179b-5564-42cf-8dfe-d43c911e43d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17c3b97d2fc14203a643db69ebca606b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:04.181932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed179b-5564-42cf-8dfe-d43c911e43d0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:04.196999 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:52:04.321967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eaed179b-5564-42cf-8dfe-d43c911e43d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17c3b97d2fc14203a643db69ebca606b', 'request_id': 'req-eaed179b-5564-42cf-8dfe-d43c911e43d0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:04.423009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eaed179b-5564-42cf-8dfe-d43c911e43d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17c3b97d2fc14203a643db69ebca606b', 'request_id': 'req-eaed179b-5564-42cf-8dfe-d43c911e43d0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:04.430899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eaed179b-5564-42cf-8dfe-d43c911e43d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17c3b97d2fc14203a643db69ebca606b', 'request_id': 'req-eaed179b-5564-42cf-8dfe-d43c911e43d0'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:04.446663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eaed179b-5564-42cf-8dfe-d43c911e43d0 admin admin] The token cache is being invalidate because project 17c3b97d2fc14203a643db69ebca606b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:52:04.446663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eaed179b-5564-42cf-8dfe-d43c911e43d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:04.446663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-eaed179b-5564-42cf-8dfe-d43c911e43d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:04.450893 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4194/8494] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:52:04 2022] DELETE /identity/v3/projects/17c3b97d2fc14203a643db69ebca606b => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:52:04.452519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425fa76-c3cb-4e8d-ab13-8687d3fff405 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:04.453043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425fa76-c3cb-4e8d-ab13-8687d3fff405 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:04.453136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425fa76-c3cb-4e8d-ab13-8687d3fff405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:04.482028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5425fa76-c3cb-4e8d-ab13-8687d3fff405 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:52:04.483286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5425fa76-c3cb-4e8d-ab13-8687d3fff405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:04.550119 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4301/8495] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:52:04.560318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13240226-90fa-4df6-ab8c-5083afd50a32 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:04.560614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13240226-90fa-4df6-ab8c-5083afd50a32 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:04.560928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13240226-90fa-4df6-ab8c-5083afd50a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:04.582785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-13240226-90fa-4df6-ab8c-5083afd50a32 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:52:04.584008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-13240226-90fa-4df6-ab8c-5083afd50a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:04.597026 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4195/8496] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:52:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:52:04.598020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425fa76-c3cb-4e8d-ab13-8687d3fff405 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:04.613831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425fa76-c3cb-4e8d-ab13-8687d3fff405 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:04.619727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f6e65-98cd-4521-9300-0c1356df060c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:04.619727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f6e65-98cd-4521-9300-0c1356df060c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:04.619727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f6e65-98cd-4521-9300-0c1356df060c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:04.619727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f6e65-98cd-4521-9300-0c1356df060c admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:04.620135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f6e65-98cd-4521-9300-0c1356df060c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:52:04.620135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f6e65-98cd-4521-9300-0c1356df060c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:04.620135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037f6e65-98cd-4521-9300-0c1356df060c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:04.637993 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4302/8497] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:52:04.640774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13240226-90fa-4df6-ab8c-5083afd50a32 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:04.651934 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13240226-90fa-4df6-ab8c-5083afd50a32 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:04.657337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb6f67-7f22-43e3-b699-d6426a8417f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:04.658040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb6f67-7f22-43e3-b699-d6426a8417f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:04.658394 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb6f67-7f22-43e3-b699-d6426a8417f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:04.658700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb6f67-7f22-43e3-b699-d6426a8417f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:04.659501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb6f67-7f22-43e3-b699-d6426a8417f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:04.662468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb6f67-7f22-43e3-b699-d6426a8417f5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:04.762966 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4196/8498] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:52:04 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:52:04.767853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f6e65-98cd-4521-9300-0c1356df060c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:04.783567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037f6e65-98cd-4521-9300-0c1356df060c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:04.834505 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:52:04.874849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d065a8-87f0-4048-940b-4c4a64355ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:04.875434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d065a8-87f0-4048-940b-4c4a64355ebf admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:04.875723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d065a8-87f0-4048-940b-4c4a64355ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:04.876169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d065a8-87f0-4048-940b-4c4a64355ebf admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:04.876851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d065a8-87f0-4048-940b-4c4a64355ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:04.879388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d065a8-87f0-4048-940b-4c4a64355ebf admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:04.954358 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4303/8499] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:52:04 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:52:04.958629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb6f67-7f22-43e3-b699-d6426a8417f5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:04.974032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb6f67-7f22-43e3-b699-d6426a8417f5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:04.979361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d5978-114f-4f26-b1bc-9d022d6b4ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:04.980110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d5978-114f-4f26-b1bc-9d022d6b4ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:04.980447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d5978-114f-4f26-b1bc-9d022d6b4ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:04.980733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d5978-114f-4f26-b1bc-9d022d6b4ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:04.981525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d5978-114f-4f26-b1bc-9d022d6b4ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:04.983403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d5978-114f-4f26-b1bc-9d022d6b4ac8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:04.998768 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4197/8500] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:52:05.000083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d065a8-87f0-4048-940b-4c4a64355ebf admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:05.019603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d065a8-87f0-4048-940b-4c4a64355ebf admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:05.032962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2605e-040e-4afc-b005-93a6e8a339da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:05.033781 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2605e-040e-4afc-b005-93a6e8a339da admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:05.034177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2605e-040e-4afc-b005-93a6e8a339da admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:05.034535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2605e-040e-4afc-b005-93a6e8a339da admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:05.035892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2605e-040e-4afc-b005-93a6e8a339da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:05.037848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2605e-040e-4afc-b005-93a6e8a339da admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:05.053378 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4304/8501] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:52:05.059273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d5978-114f-4f26-b1bc-9d022d6b4ac8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:05.070772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d5978-114f-4f26-b1bc-9d022d6b4ac8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:05.075909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02db16-6a22-413e-a167-70cf532dc643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:05.077053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02db16-6a22-413e-a167-70cf532dc643 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:05.077509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02db16-6a22-413e-a167-70cf532dc643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:05.077885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af02db16-6a22-413e-a167-70cf532dc643 admin admin] PATH_INFO: `/v3/projects/34051e763de44b4abb899f6313f4a713/users/1dd6cc06206a48dcb6948c118f3b0fa9/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:05.096893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02db16-6a22-413e-a167-70cf532dc643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34051e763de44b4abb899f6313f4a713, user_id=1dd6cc06206a48dcb6948c118f3b0fa9, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:05.101062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af02db16-6a22-413e-a167-70cf532dc643 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:05.184509 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4198/8502] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:52:05 2022] PUT /identity/v3/projects/34051e763de44b4abb899f6313f4a713/users/1dd6cc06206a48dcb6948c118f3b0fa9/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:52:05.195440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d1b42-0496-40bc-83d9-7c9cfe2d73a5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:05.195740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d1b42-0496-40bc-83d9-7c9cfe2d73a5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:05.196022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0d1b42-0496-40bc-83d9-7c9cfe2d73a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:05.234342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0f0d1b42-0496-40bc-83d9-7c9cfe2d73a5 None None] MFA Rules not processed for user `1dd6cc06206a48dcb6948c118f3b0fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:52:05.235684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0f0d1b42-0496-40bc-83d9-7c9cfe2d73a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:05.309869 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4305/8503] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:52:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:52:05.315039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02db16-6a22-413e-a167-70cf532dc643 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:05.389624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af02db16-6a22-413e-a167-70cf532dc643 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:05.395883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5acc67-7429-4063-bfe1-091dda0fd1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:05.396608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5acc67-7429-4063-bfe1-091dda0fd1ed admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:05.396902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5acc67-7429-4063-bfe1-091dda0fd1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:05.397185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5acc67-7429-4063-bfe1-091dda0fd1ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:05.397888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5acc67-7429-4063-bfe1-091dda0fd1ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:05.399830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5acc67-7429-4063-bfe1-091dda0fd1ed admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:05.525168 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4199/8504] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:52:05 2022] POST /identity/v3/projects => generated 387 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:52:05.526416 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d1b42-0496-40bc-83d9-7c9cfe2d73a5 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:05.537459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0d1b42-0496-40bc-83d9-7c9cfe2d73a5 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:05.596830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f1654-ee69-43eb-825f-937db6af87ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:05.597647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f1654-ee69-43eb-825f-937db6af87ef admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:05.597978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f1654-ee69-43eb-825f-937db6af87ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:05.598265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63f1654-ee69-43eb-825f-937db6af87ef admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:05.599008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f1654-ee69-43eb-825f-937db6af87ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:05.600963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63f1654-ee69-43eb-825f-937db6af87ef admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:05.794564 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4306/8505] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:52:05 2022] POST /identity/v3/users => generated 301 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:52:05.798300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5acc67-7429-4063-bfe1-091dda0fd1ed admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:05.810144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5acc67-7429-4063-bfe1-091dda0fd1ed admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:05.818847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fba5f6-8213-4b63-a307-960178392983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:05.819538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fba5f6-8213-4b63-a307-960178392983 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:05.819823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fba5f6-8213-4b63-a307-960178392983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:05.820100 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fba5f6-8213-4b63-a307-960178392983 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:05.820927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fba5f6-8213-4b63-a307-960178392983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:05.822689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fba5f6-8213-4b63-a307-960178392983 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:05.834808 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4200/8506] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:52:05.839367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f1654-ee69-43eb-825f-937db6af87ef admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:05.850645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63f1654-ee69-43eb-825f-937db6af87ef admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:05.855326 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58619f8-53ef-4947-b5cd-a4d5f819287c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:05.856221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58619f8-53ef-4947-b5cd-a4d5f819287c admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:05.856506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58619f8-53ef-4947-b5cd-a4d5f819287c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:05.856783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58619f8-53ef-4947-b5cd-a4d5f819287c admin admin] PATH_INFO: `/v3/projects/c9ce0bcf74be405590583d099a7363c7/users/e008bbd1b2494cd2bbd4c86c5ed09432/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:05.873701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58619f8-53ef-4947-b5cd-a4d5f819287c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9ce0bcf74be405590583d099a7363c7, user_id=e008bbd1b2494cd2bbd4c86c5ed09432, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:05.876477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58619f8-53ef-4947-b5cd-a4d5f819287c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:06.034583 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4307/8507] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:52:05 2022] PUT /identity/v3/projects/c9ce0bcf74be405590583d099a7363c7/users/e008bbd1b2494cd2bbd4c86c5ed09432/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:52:06.041342 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2262ee-24e2-4555-8e3b-ce8f6c020825 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:06.041573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2262ee-24e2-4555-8e3b-ce8f6c020825 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:06.041851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2262ee-24e2-4555-8e3b-ce8f6c020825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:06.049932 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:52:06.079816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8d2262ee-24e2-4555-8e3b-ce8f6c020825 None None] MFA Rules not processed for user `e008bbd1b2494cd2bbd4c86c5ed09432`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:52:06.085644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8d2262ee-24e2-4555-8e3b-ce8f6c020825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:06.181872 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4201/8508] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:52:06 2022] POST /identity/v3/auth/tokens => generated 3261 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:52:06.218243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58619f8-53ef-4947-b5cd-a4d5f819287c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:06.222073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d58619f8-53ef-4947-b5cd-a4d5f819287c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:06.229394 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:52:06.348263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58619f8-53ef-4947-b5cd-a4d5f819287c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:06.355054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9444f85-4d4c-4565-b61e-d6a432c5edda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:06.356570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9444f85-4d4c-4565-b61e-d6a432c5edda service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:06.357034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9444f85-4d4c-4565-b61e-d6a432c5edda service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:06.357614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9444f85-4d4c-4565-b61e-d6a432c5edda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:06.370625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9444f85-4d4c-4565-b61e-d6a432c5edda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:06.376659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9444f85-4d4c-4565-b61e-d6a432c5edda service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:06.384668 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4308/8509] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:52:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:52:10.834557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2262ee-24e2-4555-8e3b-ce8f6c020825 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:10.965172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2262ee-24e2-4555-8e3b-ce8f6c020825 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:10.974819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0a98f-0ac1-4ea1-9bfe-68e7c2e65fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:10.975881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0a98f-0ac1-4ea1-9bfe-68e7c2e65fcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:10.976176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0a98f-0ac1-4ea1-9bfe-68e7c2e65fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:10.976456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0a98f-0ac1-4ea1-9bfe-68e7c2e65fcb admin admin] PATH_INFO: `/v3/users/1dd6cc06206a48dcb6948c118f3b0fa9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:10.977691 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0a98f-0ac1-4ea1-9bfe-68e7c2e65fcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dd6cc06206a48dcb6948c118f3b0fa9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:10.979841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0a98f-0ac1-4ea1-9bfe-68e7c2e65fcb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:11.276732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cee0a98f-0ac1-4ea1-9bfe-68e7c2e65fcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dd6cc06206a48dcb6948c118f3b0fa9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:11.301301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cee0a98f-0ac1-4ea1-9bfe-68e7c2e65fcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dd6cc06206a48dcb6948c118f3b0fa9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:11.302064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cee0a98f-0ac1-4ea1-9bfe-68e7c2e65fcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dd6cc06206a48dcb6948c118f3b0fa9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:11.302753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cee0a98f-0ac1-4ea1-9bfe-68e7c2e65fcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dd6cc06206a48dcb6948c118f3b0fa9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:11.311152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-cee0a98f-0ac1-4ea1-9bfe-68e7c2e65fcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dd6cc06206a48dcb6948c118f3b0fa9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:11.377206 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4202/8510] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:52:10 2022] DELETE /identity/v3/users/1dd6cc06206a48dcb6948c118f3b0fa9 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:52:11.383038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad619ad-0328-4af1-a1f0-4a3703f6bb1e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:11.383564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad619ad-0328-4af1-a1f0-4a3703f6bb1e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:11.383648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad619ad-0328-4af1-a1f0-4a3703f6bb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:11.403826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-cad619ad-0328-4af1-a1f0-4a3703f6bb1e None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:52:11.405181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cad619ad-0328-4af1-a1f0-4a3703f6bb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:11.492689 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4309/8511] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:52:11.503080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0a98f-0ac1-4ea1-9bfe-68e7c2e65fcb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:11.505856 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cee0a98f-0ac1-4ea1-9bfe-68e7c2e65fcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:11.522964 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:52:11.582895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0a98f-0ac1-4ea1-9bfe-68e7c2e65fcb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:11.586746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8322e6c-ed4c-4e65-953e-bde79c0368a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:11.587580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8322e6c-ed4c-4e65-953e-bde79c0368a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:11.593757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8322e6c-ed4c-4e65-953e-bde79c0368a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:11.593757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8322e6c-ed4c-4e65-953e-bde79c0368a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:11.599179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8322e6c-ed4c-4e65-953e-bde79c0368a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:11.600653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8322e6c-ed4c-4e65-953e-bde79c0368a5 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:11.612578 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4203/8512] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:52:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:52:12.151881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad619ad-0328-4af1-a1f0-4a3703f6bb1e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:12.153414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cad619ad-0328-4af1-a1f0-4a3703f6bb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:12.174777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad619ad-0328-4af1-a1f0-4a3703f6bb1e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:12.182620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bd995-e324-4494-8386-7fd232e9d3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:12.183597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bd995-e324-4494-8386-7fd232e9d3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:12.184132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bd995-e324-4494-8386-7fd232e9d3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:12.184569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bd995-e324-4494-8386-7fd232e9d3d3 admin admin] PATH_INFO: `/v3/projects/34051e763de44b4abb899f6313f4a713` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:12.186126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8bd995-e324-4494-8386-7fd232e9d3d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34051e763de44b4abb899f6313f4a713)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:12.202434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8bd995-e324-4494-8386-7fd232e9d3d3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:12.374007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9a8bd995-e324-4494-8386-7fd232e9d3d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34051e763de44b4abb899f6313f4a713', 'request_id': 'req-9a8bd995-e324-4494-8386-7fd232e9d3d3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:12.381147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9a8bd995-e324-4494-8386-7fd232e9d3d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34051e763de44b4abb899f6313f4a713', 'request_id': 'req-9a8bd995-e324-4494-8386-7fd232e9d3d3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:12.387957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9a8bd995-e324-4494-8386-7fd232e9d3d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34051e763de44b4abb899f6313f4a713', 'request_id': 'req-9a8bd995-e324-4494-8386-7fd232e9d3d3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:12.491227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9a8bd995-e324-4494-8386-7fd232e9d3d3 admin admin] The token cache is being invalidate because project 34051e763de44b4abb899f6313f4a713 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:52:12.491523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9a8bd995-e324-4494-8386-7fd232e9d3d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:12.492198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-9a8bd995-e324-4494-8386-7fd232e9d3d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:12.493970 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4310/8513] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:52:12 2022] DELETE /identity/v3/projects/34051e763de44b4abb899f6313f4a713 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:52:12.498033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8322e6c-ed4c-4e65-953e-bde79c0368a5 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:12.508780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8322e6c-ed4c-4e65-953e-bde79c0368a5 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:12.582497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffb7d6-f711-4579-981b-9917bd7048ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:12.582497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffb7d6-f711-4579-981b-9917bd7048ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:12.582497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffb7d6-f711-4579-981b-9917bd7048ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:12.582497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffb7d6-f711-4579-981b-9917bd7048ab admin admin] PATH_INFO: `/v3/users/e008bbd1b2494cd2bbd4c86c5ed09432` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:12.582905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffb7d6-f711-4579-981b-9917bd7048ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e008bbd1b2494cd2bbd4c86c5ed09432)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:12.583642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffb7d6-f711-4579-981b-9917bd7048ab admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:12.796753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-97ffb7d6-f711-4579-981b-9917bd7048ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e008bbd1b2494cd2bbd4c86c5ed09432'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:12.814286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-97ffb7d6-f711-4579-981b-9917bd7048ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e008bbd1b2494cd2bbd4c86c5ed09432'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:12.816373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-97ffb7d6-f711-4579-981b-9917bd7048ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e008bbd1b2494cd2bbd4c86c5ed09432'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:12.817459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-97ffb7d6-f711-4579-981b-9917bd7048ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e008bbd1b2494cd2bbd4c86c5ed09432'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:12.827581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-97ffb7d6-f711-4579-981b-9917bd7048ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e008bbd1b2494cd2bbd4c86c5ed09432'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:12.919931 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4204/8514] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:52:12 2022] DELETE /identity/v3/users/e008bbd1b2494cd2bbd4c86c5ed09432 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:52:13.686571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bd995-e324-4494-8386-7fd232e9d3d3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:13.688125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9a8bd995-e324-4494-8386-7fd232e9d3d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:13.713925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bd995-e324-4494-8386-7fd232e9d3d3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:13.737361 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:52:13.815323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263730af-a866-4c21-b3d3-22b97e80e50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:13.818621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263730af-a866-4c21-b3d3-22b97e80e50c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:13.818923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263730af-a866-4c21-b3d3-22b97e80e50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:13.819213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263730af-a866-4c21-b3d3-22b97e80e50c admin admin] PATH_INFO: `/v3/projects/c9ce0bcf74be405590583d099a7363c7` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:13.820555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263730af-a866-4c21-b3d3-22b97e80e50c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9ce0bcf74be405590583d099a7363c7)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:13.822839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263730af-a866-4c21-b3d3-22b97e80e50c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:13.971363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-263730af-a866-4c21-b3d3-22b97e80e50c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9ce0bcf74be405590583d099a7363c7', 'request_id': 'req-263730af-a866-4c21-b3d3-22b97e80e50c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:13.982006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-263730af-a866-4c21-b3d3-22b97e80e50c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9ce0bcf74be405590583d099a7363c7', 'request_id': 'req-263730af-a866-4c21-b3d3-22b97e80e50c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:13.992038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-263730af-a866-4c21-b3d3-22b97e80e50c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9ce0bcf74be405590583d099a7363c7', 'request_id': 'req-263730af-a866-4c21-b3d3-22b97e80e50c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:14.069148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-263730af-a866-4c21-b3d3-22b97e80e50c admin admin] The token cache is being invalidate because project c9ce0bcf74be405590583d099a7363c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:52:14.069745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-263730af-a866-4c21-b3d3-22b97e80e50c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:14.071378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-263730af-a866-4c21-b3d3-22b97e80e50c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:14.085203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686543b-19cb-4e43-a43a-6a51bd65443f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:14.086089 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686543b-19cb-4e43-a43a-6a51bd65443f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:14.086539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c686543b-19cb-4e43-a43a-6a51bd65443f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:14.088299 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4311/8515] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:52:13 2022] DELETE /identity/v3/projects/c9ce0bcf74be405590583d099a7363c7 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:52:14.108462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c686543b-19cb-4e43-a43a-6a51bd65443f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:52:14.110379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c686543b-19cb-4e43-a43a-6a51bd65443f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:14.148234 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:52:14.184131 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4205/8516] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:52:14.193346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d58e5-6e3d-4ed7-a35c-99f36afde6ea None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:14.193636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d58e5-6e3d-4ed7-a35c-99f36afde6ea None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:14.193918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d58e5-6e3d-4ed7-a35c-99f36afde6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:14.220821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6d4d58e5-6e3d-4ed7-a35c-99f36afde6ea None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:52:14.222386 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6d4d58e5-6e3d-4ed7-a35c-99f36afde6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:14.239222 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4312/8517] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:52:14.246741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686543b-19cb-4e43-a43a-6a51bd65443f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:14.257927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c686543b-19cb-4e43-a43a-6a51bd65443f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:14.262883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84e210-3c88-43a9-9d5f-be662264f8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:14.265158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84e210-3c88-43a9-9d5f-be662264f8fb admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:14.265158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84e210-3c88-43a9-9d5f-be662264f8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:14.265158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84e210-3c88-43a9-9d5f-be662264f8fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:14.265411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84e210-3c88-43a9-9d5f-be662264f8fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:52:14.265502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84e210-3c88-43a9-9d5f-be662264f8fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:14.267780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84e210-3c88-43a9-9d5f-be662264f8fb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:14.284457 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4206/8518] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:52:14.286243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d58e5-6e3d-4ed7-a35c-99f36afde6ea None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:14.296397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d58e5-6e3d-4ed7-a35c-99f36afde6ea None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:14.302210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43710d73-19b6-4079-8174-abfce8056c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:14.302917 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43710d73-19b6-4079-8174-abfce8056c4b admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:14.303209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43710d73-19b6-4079-8174-abfce8056c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:14.303490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43710d73-19b6-4079-8174-abfce8056c4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:14.304194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43710d73-19b6-4079-8174-abfce8056c4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:14.306151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43710d73-19b6-4079-8174-abfce8056c4b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:14.453311 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4313/8519] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:52:14 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:52:14.457535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84e210-3c88-43a9-9d5f-be662264f8fb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:14.473004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84e210-3c88-43a9-9d5f-be662264f8fb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:14.549492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaeb84-662d-444c-b969-8166ed806699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:14.551124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaeb84-662d-444c-b969-8166ed806699 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:14.551416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaeb84-662d-444c-b969-8166ed806699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:14.551697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aaeb84-662d-444c-b969-8166ed806699 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:14.552399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aaeb84-662d-444c-b969-8166ed806699 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:14.554375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aaeb84-662d-444c-b969-8166ed806699 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:14.663420 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4207/8520] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:52:14 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:52:14.667701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43710d73-19b6-4079-8174-abfce8056c4b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:14.679935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43710d73-19b6-4079-8174-abfce8056c4b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:14.687662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e1471-c434-43f9-97b9-9085dc4885c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:14.688405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e1471-c434-43f9-97b9-9085dc4885c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:14.688686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e1471-c434-43f9-97b9-9085dc4885c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:14.689056 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e1471-c434-43f9-97b9-9085dc4885c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:14.689847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e1471-c434-43f9-97b9-9085dc4885c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:14.691552 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e1471-c434-43f9-97b9-9085dc4885c0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:14.705448 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4314/8521] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:52:14.710161 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaeb84-662d-444c-b969-8166ed806699 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:14.721309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aaeb84-662d-444c-b969-8166ed806699 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:14.729483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc626e2-0325-43ee-bd5c-821c09e7c5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:14.730327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc626e2-0325-43ee-bd5c-821c09e7c5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:14.730901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc626e2-0325-43ee-bd5c-821c09e7c5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:14.731457 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc626e2-0325-43ee-bd5c-821c09e7c5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:14.732639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc626e2-0325-43ee-bd5c-821c09e7c5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:14.734890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc626e2-0325-43ee-bd5c-821c09e7c5b0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:14.751316 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4208/8522] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:52:14.757271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e1471-c434-43f9-97b9-9085dc4885c0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:14.769570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e1471-c434-43f9-97b9-9085dc4885c0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:14.774569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f17b1-56f6-49bd-a4ea-648c41f1d431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:14.775729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f17b1-56f6-49bd-a4ea-648c41f1d431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:14.776119 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f17b1-56f6-49bd-a4ea-648c41f1d431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:14.776404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f17b1-56f6-49bd-a4ea-648c41f1d431 admin admin] PATH_INFO: `/v3/projects/19c31b13bc8f48eb816b00202a8360f4/users/7e38a2b8eba348cf8e03acb298c3ae1a/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:14.803609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f17b1-56f6-49bd-a4ea-648c41f1d431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19c31b13bc8f48eb816b00202a8360f4, user_id=7e38a2b8eba348cf8e03acb298c3ae1a, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:14.806502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9f17b1-56f6-49bd-a4ea-648c41f1d431 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:14.951279 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4315/8523] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:52:14 2022] PUT /identity/v3/projects/19c31b13bc8f48eb816b00202a8360f4/users/7e38a2b8eba348cf8e03acb298c3ae1a/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:52:14.957317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab214f-b081-4af1-8c79-24a316e0b8d0 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:14.957827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab214f-b081-4af1-8c79-24a316e0b8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:14.958423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab214f-b081-4af1-8c79-24a316e0b8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:14.977872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7cab214f-b081-4af1-8c79-24a316e0b8d0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:52:14.979028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7cab214f-b081-4af1-8c79-24a316e0b8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:15.078675 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4209/8524] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:52:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:52:15.090508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f17b1-56f6-49bd-a4ea-648c41f1d431 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:15.092566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6a9f17b1-56f6-49bd-a4ea-648c41f1d431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:15.188650 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:52:15.221309 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9f17b1-56f6-49bd-a4ea-648c41f1d431 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:15.229933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f2a10-1c4b-4590-847f-0b564481a874 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:15.230342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f2a10-1c4b-4590-847f-0b564481a874 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:15.230788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f2a10-1c4b-4590-847f-0b564481a874 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:15.231078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5f2a10-1c4b-4590-847f-0b564481a874 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:15.243824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f2a10-1c4b-4590-847f-0b564481a874 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:15.246664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5f2a10-1c4b-4590-847f-0b564481a874 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:15.260185 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4316/8525] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:52:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:52:16.961031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f1830-55a8-4dc4-b782-deaafd624401 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:16.961876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f1830-55a8-4dc4-b782-deaafd624401 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:16.963818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f1830-55a8-4dc4-b782-deaafd624401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:17.013204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f2a10-1c4b-4590-847f-0b564481a874 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:17.015622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2c5f2a10-1c4b-4590-847f-0b564481a874 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:17.035826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b99f1830-55a8-4dc4-b782-deaafd624401 None None] MFA Rules not processed for user `7e38a2b8eba348cf8e03acb298c3ae1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:52:17.037521 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b99f1830-55a8-4dc4-b782-deaafd624401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:17.122863 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:52:17.158263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5f2a10-1c4b-4590-847f-0b564481a874 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:17.169439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125114dc-797c-47f2-8fbc-772953670550 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:17.172254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125114dc-797c-47f2-8fbc-772953670550 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:17.173111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125114dc-797c-47f2-8fbc-772953670550 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:17.173785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125114dc-797c-47f2-8fbc-772953670550 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:17.180985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-125114dc-797c-47f2-8fbc-772953670550 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:17.202817 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4210/8526] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:52:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:52:17.206852 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f1830-55a8-4dc4-b782-deaafd624401 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:17.234604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f1830-55a8-4dc4-b782-deaafd624401 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:17.241867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71749720-33d2-4156-a4b8-5f66f6531d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:17.242988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71749720-33d2-4156-a4b8-5f66f6531d36 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:17.243557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71749720-33d2-4156-a4b8-5f66f6531d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:17.244056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71749720-33d2-4156-a4b8-5f66f6531d36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:17.245798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71749720-33d2-4156-a4b8-5f66f6531d36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:17.248209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71749720-33d2-4156-a4b8-5f66f6531d36 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:17.319845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125114dc-797c-47f2-8fbc-772953670550 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:17.323623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125114dc-797c-47f2-8fbc-772953670550 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:17.361364 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4317/8527] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:52:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 736 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 14:52:17.421804 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4211/8528] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:52:17 2022] POST /identity/v3/projects => generated 379 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:52:17.425741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125114dc-797c-47f2-8fbc-772953670550 service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:17.443049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125114dc-797c-47f2-8fbc-772953670550 service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:17.517635 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30e29-cce5-4564-948d-3f1c74520efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:17.518768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30e29-cce5-4564-948d-3f1c74520efa admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:17.519124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30e29-cce5-4564-948d-3f1c74520efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:17.519450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd30e29-cce5-4564-948d-3f1c74520efa admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:17.520254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd30e29-cce5-4564-948d-3f1c74520efa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:17.522365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd30e29-cce5-4564-948d-3f1c74520efa admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:17.760115 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4318/8529] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:52:17 2022] POST /identity/v3/users => generated 296 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:52:17.772648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71749720-33d2-4156-a4b8-5f66f6531d36 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:17.775863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71749720-33d2-4156-a4b8-5f66f6531d36 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:17.781194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b125957-0c2f-44e3-99d7-587d9751f2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:17.781874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b125957-0c2f-44e3-99d7-587d9751f2e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:17.782207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b125957-0c2f-44e3-99d7-587d9751f2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:17.782487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b125957-0c2f-44e3-99d7-587d9751f2e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:17.783250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b125957-0c2f-44e3-99d7-587d9751f2e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:17.786136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b125957-0c2f-44e3-99d7-587d9751f2e8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:17.801390 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4212/8530] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:52:17.802675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30e29-cce5-4564-948d-3f1c74520efa admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:17.808044 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:52:17.813462 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd30e29-cce5-4564-948d-3f1c74520efa admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:17.818929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706a708-88cc-46c9-9a3e-caf57f16d7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:17.819868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706a708-88cc-46c9-9a3e-caf57f16d7b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:17.820160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706a708-88cc-46c9-9a3e-caf57f16d7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:17.820435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706a708-88cc-46c9-9a3e-caf57f16d7b1 admin admin] PATH_INFO: `/v3/projects/2ada8379f654423680def407e5237f2d/users/121d146d9374491e97a7df8745c4d97f/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:17.840851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b706a708-88cc-46c9-9a3e-caf57f16d7b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ada8379f654423680def407e5237f2d, user_id=121d146d9374491e97a7df8745c4d97f, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:17.843673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b706a708-88cc-46c9-9a3e-caf57f16d7b1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:18.047604 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4319/8531] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:52:17 2022] PUT /identity/v3/projects/2ada8379f654423680def407e5237f2d/users/121d146d9374491e97a7df8745c4d97f/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:52:18.052406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b125957-0c2f-44e3-99d7-587d9751f2e8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:18.067428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b125957-0c2f-44e3-99d7-587d9751f2e8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:18.236405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218eda4-cebb-4ad6-8ea2-60a6c04754f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:18.237739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218eda4-cebb-4ad6-8ea2-60a6c04754f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:18.238143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218eda4-cebb-4ad6-8ea2-60a6c04754f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:18.238459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218eda4-cebb-4ad6-8ea2-60a6c04754f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:18.239463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218eda4-cebb-4ad6-8ea2-60a6c04754f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:18.241782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218eda4-cebb-4ad6-8ea2-60a6c04754f5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:18.260877 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4213/8532] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:52:18.265251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706a708-88cc-46c9-9a3e-caf57f16d7b1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:18.292429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706a708-88cc-46c9-9a3e-caf57f16d7b1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:18.303311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233472b-54a4-4a14-9ce3-2fcd0d00b773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:18.304470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233472b-54a4-4a14-9ce3-2fcd0d00b773 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:18.304927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233472b-54a4-4a14-9ce3-2fcd0d00b773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:18.305414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233472b-54a4-4a14-9ce3-2fcd0d00b773 admin admin] PATH_INFO: `/v3/projects/2ada8379f654423680def407e5237f2d/users/121d146d9374491e97a7df8745c4d97f/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:18.307801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233472b-54a4-4a14-9ce3-2fcd0d00b773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ada8379f654423680def407e5237f2d, user_id=121d146d9374491e97a7df8745c4d97f, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:18.320180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233472b-54a4-4a14-9ce3-2fcd0d00b773 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:18.346049 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4320/8533] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:52:18 2022] PUT /identity/v3/projects/2ada8379f654423680def407e5237f2d/users/121d146d9374491e97a7df8745c4d97f/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:52:20.229508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b627e-0f53-462e-8dbc-36db7b1bfb21 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:20.230078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b627e-0f53-462e-8dbc-36db7b1bfb21 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:20.230078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084b627e-0f53-462e-8dbc-36db7b1bfb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:20.299338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-084b627e-0f53-462e-8dbc-36db7b1bfb21 None None] MFA Rules not processed for user `121d146d9374491e97a7df8745c4d97f`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:52:20.300642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-084b627e-0f53-462e-8dbc-36db7b1bfb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:20.474261 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4214/8534] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:52:20 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:52:20.485332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24c0bd-40b6-4380-ad05-5df0b76d6303 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:20.485843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24c0bd-40b6-4380-ad05-5df0b76d6303 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:20.485924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c24c0bd-40b6-4380-ad05-5df0b76d6303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:20.507670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5c24c0bd-40b6-4380-ad05-5df0b76d6303 None None] MFA Rules not processed for user `7e38a2b8eba348cf8e03acb298c3ae1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:52:20.508906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5c24c0bd-40b6-4380-ad05-5df0b76d6303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:20.582212 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4321/8535] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:52:20 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:52:20.594335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b627e-0f53-462e-8dbc-36db7b1bfb21 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:20.597972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-084b627e-0f53-462e-8dbc-36db7b1bfb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:20.621399 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:52:20.692153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084b627e-0f53-462e-8dbc-36db7b1bfb21 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:20.698376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474fa37-aa76-447f-b185-1502a842f02e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:20.699049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474fa37-aa76-447f-b185-1502a842f02e service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:20.699338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474fa37-aa76-447f-b185-1502a842f02e service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:20.699620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474fa37-aa76-447f-b185-1502a842f02e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:20.710619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474fa37-aa76-447f-b185-1502a842f02e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:20.712476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474fa37-aa76-447f-b185-1502a842f02e service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:20.726610 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4215/8536] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:52:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:52:30.567926 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=39,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:52:30.718366 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=26 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:52:39.203426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24c0bd-40b6-4380-ad05-5df0b76d6303 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:39.321696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c24c0bd-40b6-4380-ad05-5df0b76d6303 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:39.327774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e86e7-fa8d-4261-a79f-0ad125fadd56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:39.328661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e86e7-fa8d-4261-a79f-0ad125fadd56 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:39.329120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e86e7-fa8d-4261-a79f-0ad125fadd56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:39.329581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e86e7-fa8d-4261-a79f-0ad125fadd56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:39.341986 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-762e86e7-fa8d-4261-a79f-0ad125fadd56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:39.407963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e86e7-fa8d-4261-a79f-0ad125fadd56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:39.409503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762e86e7-fa8d-4261-a79f-0ad125fadd56 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:39.419942 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4322/8537] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:52:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:52:48.352107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474fa37-aa76-447f-b185-1502a842f02e service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:48.354464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6474fa37-aa76-447f-b185-1502a842f02e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:48.374897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474fa37-aa76-447f-b185-1502a842f02e service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:48.380630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04a3ab-5b75-4f8c-8664-9c24e897c03b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:48.381291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04a3ab-5b75-4f8c-8664-9c24e897c03b service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:48.381580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04a3ab-5b75-4f8c-8664-9c24e897c03b service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:48.381906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04a3ab-5b75-4f8c-8664-9c24e897c03b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:48.384274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0d04a3ab-5b75-4f8c-8664-9c24e897c03b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:48.457220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04a3ab-5b75-4f8c-8664-9c24e897c03b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:48.460051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04a3ab-5b75-4f8c-8664-9c24e897c03b service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:48.474260 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4216/8538] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:52:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:52:49.415248 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=48 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:52:53.727540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e86e7-fa8d-4261-a79f-0ad125fadd56 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:53.834308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e86e7-fa8d-4261-a79f-0ad125fadd56 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:53.845354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d5762-24fc-48c4-b9d6-11485a6646b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:53.846690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d5762-24fc-48c4-b9d6-11485a6646b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:53.847138 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d5762-24fc-48c4-b9d6-11485a6646b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:53.847631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d5762-24fc-48c4-b9d6-11485a6646b1 admin admin] PATH_INFO: `/v3/users/7e38a2b8eba348cf8e03acb298c3ae1a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:53.849489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d5762-24fc-48c4-b9d6-11485a6646b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e38a2b8eba348cf8e03acb298c3ae1a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:53.852697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d5762-24fc-48c4-b9d6-11485a6646b1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:54.118012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-845d5762-24fc-48c4-b9d6-11485a6646b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e38a2b8eba348cf8e03acb298c3ae1a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:54.151130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-845d5762-24fc-48c4-b9d6-11485a6646b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e38a2b8eba348cf8e03acb298c3ae1a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:54.159775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-845d5762-24fc-48c4-b9d6-11485a6646b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e38a2b8eba348cf8e03acb298c3ae1a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:54.160728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-845d5762-24fc-48c4-b9d6-11485a6646b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e38a2b8eba348cf8e03acb298c3ae1a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:54.220737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-845d5762-24fc-48c4-b9d6-11485a6646b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e38a2b8eba348cf8e03acb298c3ae1a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:54.230371 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4323/8539] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:52:53 2022] DELETE /identity/v3/users/7e38a2b8eba348cf8e03acb298c3ae1a => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:52:54.732620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04a3ab-5b75-4f8c-8664-9c24e897c03b service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:54.756143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04a3ab-5b75-4f8c-8664-9c24e897c03b service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:54.923718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d64609-054f-47c3-9b8b-b0667a44a034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:54.925799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d64609-054f-47c3-9b8b-b0667a44a034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:54.926297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d64609-054f-47c3-9b8b-b0667a44a034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:54.926594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d5762-24fc-48c4-b9d6-11485a6646b1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:54.927093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d64609-054f-47c3-9b8b-b0667a44a034 admin admin] PATH_INFO: `/v3/projects/19c31b13bc8f48eb816b00202a8360f4` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:54.928148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d64609-054f-47c3-9b8b-b0667a44a034 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19c31b13bc8f48eb816b00202a8360f4)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:54.928290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-845d5762-24fc-48c4-b9d6-11485a6646b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:54.930346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d64609-054f-47c3-9b8b-b0667a44a034 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:55.111999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-13d64609-054f-47c3-9b8b-b0667a44a034 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19c31b13bc8f48eb816b00202a8360f4', 'request_id': 'req-13d64609-054f-47c3-9b8b-b0667a44a034'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:55.151071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d5762-24fc-48c4-b9d6-11485a6646b1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:55.190307 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:52:55.233056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-13d64609-054f-47c3-9b8b-b0667a44a034 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19c31b13bc8f48eb816b00202a8360f4', 'request_id': 'req-13d64609-054f-47c3-9b8b-b0667a44a034'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:55.244400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-13d64609-054f-47c3-9b8b-b0667a44a034 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19c31b13bc8f48eb816b00202a8360f4', 'request_id': 'req-13d64609-054f-47c3-9b8b-b0667a44a034'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:55.258260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-13d64609-054f-47c3-9b8b-b0667a44a034 admin admin] The token cache is being invalidate because project 19c31b13bc8f48eb816b00202a8360f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:52:55.258944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-13d64609-054f-47c3-9b8b-b0667a44a034 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:55.259876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-13d64609-054f-47c3-9b8b-b0667a44a034 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:55.261975 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4217/8540] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:52:54 2022] DELETE /identity/v3/projects/19c31b13bc8f48eb816b00202a8360f4 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:52:55.266941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d64609-054f-47c3-9b8b-b0667a44a034 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:55.268767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-13d64609-054f-47c3-9b8b-b0667a44a034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:55.346931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed97e6-29cf-4491-ae60-01e69ddad79e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:55.348500 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:52:55.350232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed97e6-29cf-4491-ae60-01e69ddad79e service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:55.353760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed97e6-29cf-4491-ae60-01e69ddad79e service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:55.354211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed97e6-29cf-4491-ae60-01e69ddad79e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:55.365388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a6ed97e6-29cf-4491-ae60-01e69ddad79e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:55.423751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d64609-054f-47c3-9b8b-b0667a44a034 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:55.429336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c4f9c-6966-4d16-bb51-1b01c667adb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:55.430583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c4f9c-6966-4d16-bb51-1b01c667adb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:55.430971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c4f9c-6966-4d16-bb51-1b01c667adb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:55.431306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c4f9c-6966-4d16-bb51-1b01c667adb5 admin admin] PATH_INFO: `/v3/users/121d146d9374491e97a7df8745c4d97f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:55.433000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c4f9c-6966-4d16-bb51-1b01c667adb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=121d146d9374491e97a7df8745c4d97f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:55.435034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07c4f9c-6966-4d16-bb51-1b01c667adb5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:55.508398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed97e6-29cf-4491-ae60-01e69ddad79e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:55.510438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed97e6-29cf-4491-ae60-01e69ddad79e service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:55.524544 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4324/8541] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:52:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:52:55.733957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f07c4f9c-6966-4d16-bb51-1b01c667adb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '121d146d9374491e97a7df8745c4d97f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:55.766187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f07c4f9c-6966-4d16-bb51-1b01c667adb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '121d146d9374491e97a7df8745c4d97f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:55.767458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f07c4f9c-6966-4d16-bb51-1b01c667adb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '121d146d9374491e97a7df8745c4d97f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:55.768980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f07c4f9c-6966-4d16-bb51-1b01c667adb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '121d146d9374491e97a7df8745c4d97f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:55.779509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f07c4f9c-6966-4d16-bb51-1b01c667adb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '121d146d9374491e97a7df8745c4d97f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:55.918810 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4218/8542] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:52:55 2022] DELETE /identity/v3/users/121d146d9374491e97a7df8745c4d97f => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:52:56.235247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed97e6-29cf-4491-ae60-01e69ddad79e service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:56.254241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed97e6-29cf-4491-ae60-01e69ddad79e service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:56.434208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe978468-6a02-4ae4-91e0-6ffb7a927041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:56.434208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe978468-6a02-4ae4-91e0-6ffb7a927041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:56.434208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe978468-6a02-4ae4-91e0-6ffb7a927041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:56.434208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe978468-6a02-4ae4-91e0-6ffb7a927041 admin admin] PATH_INFO: `/v3/projects/2ada8379f654423680def407e5237f2d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:56.435492 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe978468-6a02-4ae4-91e0-6ffb7a927041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ada8379f654423680def407e5237f2d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:56.442766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe978468-6a02-4ae4-91e0-6ffb7a927041 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:56.611251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fe978468-6a02-4ae4-91e0-6ffb7a927041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ada8379f654423680def407e5237f2d', 'request_id': 'req-fe978468-6a02-4ae4-91e0-6ffb7a927041'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:56.617005 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:52:56.626661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fe978468-6a02-4ae4-91e0-6ffb7a927041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ada8379f654423680def407e5237f2d', 'request_id': 'req-fe978468-6a02-4ae4-91e0-6ffb7a927041'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:56.645850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fe978468-6a02-4ae4-91e0-6ffb7a927041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ada8379f654423680def407e5237f2d', 'request_id': 'req-fe978468-6a02-4ae4-91e0-6ffb7a927041'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:56.724595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fe978468-6a02-4ae4-91e0-6ffb7a927041 admin admin] The token cache is being invalidate because project 2ada8379f654423680def407e5237f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:52:56.725020 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fe978468-6a02-4ae4-91e0-6ffb7a927041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:56.726468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-fe978468-6a02-4ae4-91e0-6ffb7a927041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:52:56.728557 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4325/8543] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:52:56 2022] DELETE /identity/v3/projects/2ada8379f654423680def407e5237f2d => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:52:56.733434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064bb1d-e3e6-46fd-8532-3b2631752473 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:56.733913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064bb1d-e3e6-46fd-8532-3b2631752473 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:56.735648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1064bb1d-e3e6-46fd-8532-3b2631752473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:56.787466 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1064bb1d-e3e6-46fd-8532-3b2631752473 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:52:56.791097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1064bb1d-e3e6-46fd-8532-3b2631752473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:56.963793 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4219/8544] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:52:56.972883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c046f-80aa-4196-9869-782a95bd5242 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:56.973265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c046f-80aa-4196-9869-782a95bd5242 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:56.973650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c046f-80aa-4196-9869-782a95bd5242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:57.014661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e09c046f-80aa-4196-9869-782a95bd5242 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:52:57.016563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e09c046f-80aa-4196-9869-782a95bd5242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:57.037868 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4326/8545] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:52:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:52:57.041445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064bb1d-e3e6-46fd-8532-3b2631752473 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:57.051779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1064bb1d-e3e6-46fd-8532-3b2631752473 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:57.087347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc672d-3dcd-4dfc-ba68-6a5b66ce3008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:57.088826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc672d-3dcd-4dfc-ba68-6a5b66ce3008 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:57.090983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc672d-3dcd-4dfc-ba68-6a5b66ce3008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:57.091328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc672d-3dcd-4dfc-ba68-6a5b66ce3008 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:57.092093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc672d-3dcd-4dfc-ba68-6a5b66ce3008 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:52:57.092405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc672d-3dcd-4dfc-ba68-6a5b66ce3008 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:57.094034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc672d-3dcd-4dfc-ba68-6a5b66ce3008 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:57.115434 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4220/8546] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:52:57.119729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c046f-80aa-4196-9869-782a95bd5242 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:57.133531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c046f-80aa-4196-9869-782a95bd5242 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:57.155002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a1111-2bf8-4d2f-8538-14ddf70fa03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:57.156678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a1111-2bf8-4d2f-8538-14ddf70fa03c admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:57.157137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a1111-2bf8-4d2f-8538-14ddf70fa03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:57.157628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791a1111-2bf8-4d2f-8538-14ddf70fa03c admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:57.158522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a1111-2bf8-4d2f-8538-14ddf70fa03c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:57.162594 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791a1111-2bf8-4d2f-8538-14ddf70fa03c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:57.261371 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4327/8547] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:52:57 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:52:57.265554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc672d-3dcd-4dfc-ba68-6a5b66ce3008 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:57.289344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc672d-3dcd-4dfc-ba68-6a5b66ce3008 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:57.370390 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:52:57.428558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe9790-2bc3-47e0-a3c7-f7afc2e2a1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:57.430867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9790-2bc3-47e0-a3c7-f7afc2e2a1ef admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:57.431424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9790-2bc3-47e0-a3c7-f7afc2e2a1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:57.431881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe9790-2bc3-47e0-a3c7-f7afc2e2a1ef admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:57.432670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe9790-2bc3-47e0-a3c7-f7afc2e2a1ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:57.436159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe9790-2bc3-47e0-a3c7-f7afc2e2a1ef admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:57.573015 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4221/8548] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:52:57 2022] POST /identity/v3/users => generated 289 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:52:57.577677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a1111-2bf8-4d2f-8538-14ddf70fa03c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:57.600935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791a1111-2bf8-4d2f-8538-14ddf70fa03c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:57.615355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62829ae7-a8a5-4928-afc4-4e83d2d10dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:57.616067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62829ae7-a8a5-4928-afc4-4e83d2d10dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:57.616895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62829ae7-a8a5-4928-afc4-4e83d2d10dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:57.617598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62829ae7-a8a5-4928-afc4-4e83d2d10dc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:57.626814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62829ae7-a8a5-4928-afc4-4e83d2d10dc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:57.631338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62829ae7-a8a5-4928-afc4-4e83d2d10dc4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:57.666689 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4328/8549] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:52:57.670610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe9790-2bc3-47e0-a3c7-f7afc2e2a1ef admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:57.691993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe9790-2bc3-47e0-a3c7-f7afc2e2a1ef admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:57.702757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a1d20-00e5-4317-8ffc-365ffd3227c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:57.703456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a1d20-00e5-4317-8ffc-365ffd3227c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:57.703741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a1d20-00e5-4317-8ffc-365ffd3227c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:57.707899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a1d20-00e5-4317-8ffc-365ffd3227c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:57.707899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a1d20-00e5-4317-8ffc-365ffd3227c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:57.707899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3a1d20-00e5-4317-8ffc-365ffd3227c9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:57.749637 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4222/8550] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:52:57.753478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62829ae7-a8a5-4928-afc4-4e83d2d10dc4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:57.773884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62829ae7-a8a5-4928-afc4-4e83d2d10dc4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:57.790734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc820a-427b-4edb-92de-6c0f9d8fb125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:57.792120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc820a-427b-4edb-92de-6c0f9d8fb125 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:57.792821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc820a-427b-4edb-92de-6c0f9d8fb125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:57.792821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc820a-427b-4edb-92de-6c0f9d8fb125 admin admin] PATH_INFO: `/v3/projects/60be7513d86b491ab63fda935d3bd472/users/a572e84b1e57481fa882845e927983ec/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:57.863208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc820a-427b-4edb-92de-6c0f9d8fb125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60be7513d86b491ab63fda935d3bd472, user_id=a572e84b1e57481fa882845e927983ec, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:57.864613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc820a-427b-4edb-92de-6c0f9d8fb125 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:57.988789 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4329/8551] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:52:57 2022] PUT /identity/v3/projects/60be7513d86b491ab63fda935d3bd472/users/a572e84b1e57481fa882845e927983ec/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:52:57.994413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b4c4a-abad-4454-b308-ef75a2086568 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:57.995007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b4c4a-abad-4454-b308-ef75a2086568 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:57.995719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b4c4a-abad-4454-b308-ef75a2086568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:58.057193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e13b4c4a-abad-4454-b308-ef75a2086568 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:52:58.057193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e13b4c4a-abad-4454-b308-ef75a2086568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:58.258982 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4223/8552] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:52:58.266837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc820a-427b-4edb-92de-6c0f9d8fb125 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:52:58.268599 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-59dc820a-427b-4edb-92de-6c0f9d8fb125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:52:58.384729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc820a-427b-4edb-92de-6c0f9d8fb125 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:52:58.409059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da2b66-91dd-46f9-80d5-9c8b3525ced5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:52:58.409704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da2b66-91dd-46f9-80d5-9c8b3525ced5 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:52:58.409963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da2b66-91dd-46f9-80d5-9c8b3525ced5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:52:58.414885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da2b66-91dd-46f9-80d5-9c8b3525ced5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:52:58.450035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da2b66-91dd-46f9-80d5-9c8b3525ced5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:52:58.451549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da2b66-91dd-46f9-80d5-9c8b3525ced5 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:52:58.484282 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4330/8553] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:52:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:53:00.636434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b4c4a-abad-4454-b308-ef75a2086568 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:53:00.650033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b4c4a-abad-4454-b308-ef75a2086568 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:53:00.656893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bb93a-6124-4377-ae45-b99b7cb1e620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:53:00.657788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bb93a-6124-4377-ae45-b99b7cb1e620 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:00.658081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bb93a-6124-4377-ae45-b99b7cb1e620 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:00.658411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6bb93a-6124-4377-ae45-b99b7cb1e620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:00.661759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6f6bb93a-6124-4377-ae45-b99b7cb1e620 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:53:00.682914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bb93a-6124-4377-ae45-b99b7cb1e620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:53:00.686330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6bb93a-6124-4377-ae45-b99b7cb1e620 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:53:00.703144 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4224/8554] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:53:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:53:08.460512 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=59,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:53:09.167980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54625d-ebb9-40a9-9a21-09fba340a57e None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:09.168273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54625d-ebb9-40a9-9a21-09fba340a57e None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:09.168574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f54625d-ebb9-40a9-9a21-09fba340a57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:09.285865 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9f54625d-ebb9-40a9-9a21-09fba340a57e None None] MFA Rules not processed for user `a572e84b1e57481fa882845e927983ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:53:09.289803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9f54625d-ebb9-40a9-9a21-09fba340a57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:53:09.525168 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4331/8555] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:53:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:53:09.529918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bb93a-6124-4377-ae45-b99b7cb1e620 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:53:09.543614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6bb93a-6124-4377-ae45-b99b7cb1e620 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:53:09.553085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43917137-2a82-41c7-b554-458858cb7efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:53:09.554261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43917137-2a82-41c7-b554-458858cb7efe admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:09.555391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43917137-2a82-41c7-b554-458858cb7efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:09.556534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43917137-2a82-41c7-b554-458858cb7efe admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:09.561945 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43917137-2a82-41c7-b554-458858cb7efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:53:09.567383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43917137-2a82-41c7-b554-458858cb7efe admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:53:09.731916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54625d-ebb9-40a9-9a21-09fba340a57e None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:53:09.732087 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4225/8556] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:53:09 2022] POST /identity/v3/projects => generated 379 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:53:09.764222 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f54625d-ebb9-40a9-9a21-09fba340a57e None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:53:09.916120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e063d-fae8-473e-96ab-2ab73874f7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:53:09.916925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e063d-fae8-473e-96ab-2ab73874f7a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:09.917244 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e063d-fae8-473e-96ab-2ab73874f7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:09.917537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e063d-fae8-473e-96ab-2ab73874f7a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:09.932055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e063d-fae8-473e-96ab-2ab73874f7a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:53:09.932055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99e063d-fae8-473e-96ab-2ab73874f7a4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:53:10.096100 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4332/8557] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:53:09 2022] POST /identity/v3/users => generated 296 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:53:10.096741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43917137-2a82-41c7-b554-458858cb7efe admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:53:10.113743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43917137-2a82-41c7-b554-458858cb7efe admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:53:10.120796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627bc1-adaf-4459-a15d-2f492084b498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:53:10.127802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627bc1-adaf-4459-a15d-2f492084b498 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:10.127802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627bc1-adaf-4459-a15d-2f492084b498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:10.127802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e627bc1-adaf-4459-a15d-2f492084b498 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:10.127802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e627bc1-adaf-4459-a15d-2f492084b498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:53:10.141407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e627bc1-adaf-4459-a15d-2f492084b498 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:53:10.170684 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4226/8558] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:53:10.174894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e063d-fae8-473e-96ab-2ab73874f7a4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:53:10.199116 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e063d-fae8-473e-96ab-2ab73874f7a4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:53:10.209504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562d187-e92b-4e8e-9819-49ee1125ca90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:53:10.213658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562d187-e92b-4e8e-9819-49ee1125ca90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:10.217268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562d187-e92b-4e8e-9819-49ee1125ca90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:10.217950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3562d187-e92b-4e8e-9819-49ee1125ca90 admin admin] PATH_INFO: `/v3/projects/4ac6fc727cc544f4b8bc6b8fa743595c/users/a07859e08c4c45d097d6ed0bb85ae5eb/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:10.260816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562d187-e92b-4e8e-9819-49ee1125ca90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac6fc727cc544f4b8bc6b8fa743595c, user_id=a07859e08c4c45d097d6ed0bb85ae5eb, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:53:10.263734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3562d187-e92b-4e8e-9819-49ee1125ca90 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:53:10.391201 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4333/8559] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:53:10 2022] PUT /identity/v3/projects/4ac6fc727cc544f4b8bc6b8fa743595c/users/a07859e08c4c45d097d6ed0bb85ae5eb/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:53:10.395439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627bc1-adaf-4459-a15d-2f492084b498 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:53:10.421830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e627bc1-adaf-4459-a15d-2f492084b498 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:53:10.598138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61862e-0fe1-45b0-a6f7-a23376d61351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:53:10.599545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61862e-0fe1-45b0-a6f7-a23376d61351 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:10.599545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61862e-0fe1-45b0-a6f7-a23376d61351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:10.599545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed61862e-0fe1-45b0-a6f7-a23376d61351 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:10.602754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61862e-0fe1-45b0-a6f7-a23376d61351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:53:10.607018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed61862e-0fe1-45b0-a6f7-a23376d61351 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:53:10.644094 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4227/8560] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:53:10 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:53:10.648616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562d187-e92b-4e8e-9819-49ee1125ca90 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:53:10.673456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3562d187-e92b-4e8e-9819-49ee1125ca90 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:53:10.686861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c156277-177d-4a4a-af73-403d0478b226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:53:10.687794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c156277-177d-4a4a-af73-403d0478b226 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:10.688086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c156277-177d-4a4a-af73-403d0478b226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:10.688853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c156277-177d-4a4a-af73-403d0478b226 admin admin] PATH_INFO: `/v3/projects/4ac6fc727cc544f4b8bc6b8fa743595c/users/a07859e08c4c45d097d6ed0bb85ae5eb/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:10.690570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c156277-177d-4a4a-af73-403d0478b226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac6fc727cc544f4b8bc6b8fa743595c, user_id=a07859e08c4c45d097d6ed0bb85ae5eb, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:53:10.696360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c156277-177d-4a4a-af73-403d0478b226 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:53:10.752427 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4334/8561] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:53:10 2022] PUT /identity/v3/projects/4ac6fc727cc544f4b8bc6b8fa743595c/users/a07859e08c4c45d097d6ed0bb85ae5eb/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:53:18.364767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61862e-0fe1-45b0-a6f7-a23376d61351 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:53:18.375276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ed61862e-0fe1-45b0-a6f7-a23376d61351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:53:18.390850 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:53:18.402940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed61862e-0fe1-45b0-a6f7-a23376d61351 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:53:18.505376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb93e43-046f-4e65-b868-418f23bce39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:53:18.507889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb93e43-046f-4e65-b868-418f23bce39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:18.511997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb93e43-046f-4e65-b868-418f23bce39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:18.511997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb93e43-046f-4e65-b868-418f23bce39f admin admin] PATH_INFO: `/v3/users/31e36cabec4a4528a290cfe3c667df64` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:18.516486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb93e43-046f-4e65-b868-418f23bce39f admin admin] RBAC: Authorizing `identity:delete_user(user_id=31e36cabec4a4528a290cfe3c667df64)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:53:18.527515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb93e43-046f-4e65-b868-418f23bce39f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:53:18.795727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fbb93e43-046f-4e65-b868-418f23bce39f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31e36cabec4a4528a290cfe3c667df64'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:53:18.833866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fbb93e43-046f-4e65-b868-418f23bce39f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31e36cabec4a4528a290cfe3c667df64'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:53:18.837193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fbb93e43-046f-4e65-b868-418f23bce39f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31e36cabec4a4528a290cfe3c667df64'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:53:18.837983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fbb93e43-046f-4e65-b868-418f23bce39f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31e36cabec4a4528a290cfe3c667df64'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:53:18.855530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fbb93e43-046f-4e65-b868-418f23bce39f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31e36cabec4a4528a290cfe3c667df64'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:53:18.925282 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4228/8562] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:53:18 2022] DELETE /identity/v3/users/31e36cabec4a4528a290cfe3c667df64 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:53:19.500925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c156277-177d-4a4a-af73-403d0478b226 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:53:19.500925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6c156277-177d-4a4a-af73-403d0478b226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:53:19.532767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c156277-177d-4a4a-af73-403d0478b226 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:53:19.634511 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:53:19.664905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3e821-243a-4e4c-8e43-52e4ef33de3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:53:19.666236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3e821-243a-4e4c-8e43-52e4ef33de3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:19.666850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3e821-243a-4e4c-8e43-52e4ef33de3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:19.667480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3e821-243a-4e4c-8e43-52e4ef33de3b admin admin] PATH_INFO: `/v3/projects/269da2d705dc4f11a7fd9b97426ab087` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:19.669171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3e821-243a-4e4c-8e43-52e4ef33de3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=269da2d705dc4f11a7fd9b97426ab087)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:53:19.671352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3e821-243a-4e4c-8e43-52e4ef33de3b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:53:19.822677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-10d3e821-243a-4e4c-8e43-52e4ef33de3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '269da2d705dc4f11a7fd9b97426ab087', 'request_id': 'req-10d3e821-243a-4e4c-8e43-52e4ef33de3b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:53:19.830634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-10d3e821-243a-4e4c-8e43-52e4ef33de3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '269da2d705dc4f11a7fd9b97426ab087', 'request_id': 'req-10d3e821-243a-4e4c-8e43-52e4ef33de3b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:53:19.853535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-10d3e821-243a-4e4c-8e43-52e4ef33de3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '269da2d705dc4f11a7fd9b97426ab087', 'request_id': 'req-10d3e821-243a-4e4c-8e43-52e4ef33de3b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:53:19.934972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-10d3e821-243a-4e4c-8e43-52e4ef33de3b admin admin] The token cache is being invalidate because project 269da2d705dc4f11a7fd9b97426ab087 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:53:19.936178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-10d3e821-243a-4e4c-8e43-52e4ef33de3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:53:19.936178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-10d3e821-243a-4e4c-8e43-52e4ef33de3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:53:19.941480 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4335/8563] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:53:19 2022] DELETE /identity/v3/projects/269da2d705dc4f11a7fd9b97426ab087 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:53:19.945214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb93e43-046f-4e65-b868-418f23bce39f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:53:19.958065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb93e43-046f-4e65-b868-418f23bce39f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:53:20.098580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d14d3-3b12-4b58-a60f-edc894f55adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:53:20.100490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d14d3-3b12-4b58-a60f-edc894f55adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:20.101415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d14d3-3b12-4b58-a60f-edc894f55adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:20.101853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d14d3-3b12-4b58-a60f-edc894f55adb admin admin] PATH_INFO: `/v3/users/e1bbec617b204476983c35cb018a8d96` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:20.103446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d14d3-3b12-4b58-a60f-edc894f55adb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1bbec617b204476983c35cb018a8d96)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:53:20.106259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5d14d3-3b12-4b58-a60f-edc894f55adb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:53:20.250150 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:53:21.509818 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce5d14d3-3b12-4b58-a60f-edc894f55adb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1bbec617b204476983c35cb018a8d96'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:53:21.529735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce5d14d3-3b12-4b58-a60f-edc894f55adb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1bbec617b204476983c35cb018a8d96'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:53:21.530739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce5d14d3-3b12-4b58-a60f-edc894f55adb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1bbec617b204476983c35cb018a8d96'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:53:21.531524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce5d14d3-3b12-4b58-a60f-edc894f55adb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1bbec617b204476983c35cb018a8d96'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:53:21.540459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce5d14d3-3b12-4b58-a60f-edc894f55adb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1bbec617b204476983c35cb018a8d96'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:53:21.660275 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4229/8564] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:53:19 2022] DELETE /identity/v3/users/e1bbec617b204476983c35cb018a8d96 => generated 0 bytes in 1718 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:53:22.145147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936af18-8fe7-4aa5-a513-28b7bcb2279c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:22.145607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936af18-8fe7-4aa5-a513-28b7bcb2279c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:22.145736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6936af18-8fe7-4aa5-a513-28b7bcb2279c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:22.218522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6936af18-8fe7-4aa5-a513-28b7bcb2279c None None] MFA Rules not processed for user `a07859e08c4c45d097d6ed0bb85ae5eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:53:22.221851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6936af18-8fe7-4aa5-a513-28b7bcb2279c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:53:22.447092 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4336/8565] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:53:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:53:22.470618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d14d3-3b12-4b58-a60f-edc894f55adb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:53:22.470618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ce5d14d3-3b12-4b58-a60f-edc894f55adb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:53:22.621090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d14d3-3b12-4b58-a60f-edc894f55adb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:53:22.629380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bb968-86dc-43a1-aa92-b1b6bd63d050 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:53:22.630070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bb968-86dc-43a1-aa92-b1b6bd63d050 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:22.630376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bb968-86dc-43a1-aa92-b1b6bd63d050 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:22.630659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bb968-86dc-43a1-aa92-b1b6bd63d050 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:22.657763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bb968-86dc-43a1-aa92-b1b6bd63d050 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:53:22.659274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3bb968-86dc-43a1-aa92-b1b6bd63d050 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:53:22.671017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936af18-8fe7-4aa5-a513-28b7bcb2279c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:53:22.672721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6936af18-8fe7-4aa5-a513-28b7bcb2279c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:53:22.679898 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4230/8566] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:53:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:53:22.907801 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:53:22.917561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6936af18-8fe7-4aa5-a513-28b7bcb2279c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:53:22.932460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10100e87-5cf0-4417-988f-d24dde310dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:53:22.936355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10100e87-5cf0-4417-988f-d24dde310dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:22.936697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10100e87-5cf0-4417-988f-d24dde310dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:22.937274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10100e87-5cf0-4417-988f-d24dde310dc5 admin admin] PATH_INFO: `/v3/projects/056afd7c92eb4af4856d7a0d569fb95f` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:22.939941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10100e87-5cf0-4417-988f-d24dde310dc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=056afd7c92eb4af4856d7a0d569fb95f)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:53:22.942691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10100e87-5cf0-4417-988f-d24dde310dc5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:53:23.126360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bb968-86dc-43a1-aa92-b1b6bd63d050 service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:53:23.127700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2e3bb968-86dc-43a1-aa92-b1b6bd63d050 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:53:23.155445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bb968-86dc-43a1-aa92-b1b6bd63d050 service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:53:23.172374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-10100e87-5cf0-4417-988f-d24dde310dc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '056afd7c92eb4af4856d7a0d569fb95f', 'request_id': 'req-10100e87-5cf0-4417-988f-d24dde310dc5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:53:23.187820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-10100e87-5cf0-4417-988f-d24dde310dc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '056afd7c92eb4af4856d7a0d569fb95f', 'request_id': 'req-10100e87-5cf0-4417-988f-d24dde310dc5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:53:23.205141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-10100e87-5cf0-4417-988f-d24dde310dc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '056afd7c92eb4af4856d7a0d569fb95f', 'request_id': 'req-10100e87-5cf0-4417-988f-d24dde310dc5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:53:23.227667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bdd482-0a19-49d6-a1e4-896aeee2ab69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:53:23.229333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdd482-0a19-49d6-a1e4-896aeee2ab69 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:23.229558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdd482-0a19-49d6-a1e4-896aeee2ab69 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:23.229843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bdd482-0a19-49d6-a1e4-896aeee2ab69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:23.231849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-24bdd482-0a19-49d6-a1e4-896aeee2ab69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:53:23.290703 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:53:23.311678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bdd482-0a19-49d6-a1e4-896aeee2ab69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:53:23.314539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bdd482-0a19-49d6-a1e4-896aeee2ab69 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:53:23.343182 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4231/8567] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:53:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:53:23.371274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-10100e87-5cf0-4417-988f-d24dde310dc5 admin admin] The token cache is being invalidate because project 056afd7c92eb4af4856d7a0d569fb95f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:53:23.372029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-10100e87-5cf0-4417-988f-d24dde310dc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:53:23.372961 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-10100e87-5cf0-4417-988f-d24dde310dc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:53:23.375538 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4337/8568] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:53:22 2022] DELETE /identity/v3/projects/056afd7c92eb4af4856d7a0d569fb95f => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:53:26.776000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b7bb7-c271-45da-96fe-228ed607339c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:26.776979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b7bb7-c271-45da-96fe-228ed607339c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:26.777419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b7bb7-c271-45da-96fe-228ed607339c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:26.816730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-bd0b7bb7-c271-45da-96fe-228ed607339c None None] MFA Rules not processed for user `a572e84b1e57481fa882845e927983ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:53:26.821334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bd0b7bb7-c271-45da-96fe-228ed607339c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:53:26.842137 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4232/8569] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:53:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:53:27.491915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10100e87-5cf0-4417-988f-d24dde310dc5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:53:27.494047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-10100e87-5cf0-4417-988f-d24dde310dc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:53:27.594064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10100e87-5cf0-4417-988f-d24dde310dc5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:53:27.598815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097af95-174c-4cce-9680-5abafc3066a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:53:27.600243 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097af95-174c-4cce-9680-5abafc3066a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:27.600871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097af95-174c-4cce-9680-5abafc3066a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:27.601334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097af95-174c-4cce-9680-5abafc3066a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:27.603853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b097af95-174c-4cce-9680-5abafc3066a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:53:27.630372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097af95-174c-4cce-9680-5abafc3066a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:53:27.632229 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097af95-174c-4cce-9680-5abafc3066a2 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:53:27.648694 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4338/8570] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:53:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:53:29.385994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b7bb7-c271-45da-96fe-228ed607339c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:53:29.388670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bd0b7bb7-c271-45da-96fe-228ed607339c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:53:29.597714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0b7bb7-c271-45da-96fe-228ed607339c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:53:29.606476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236f134-580f-42b0-9a0c-37426603a9b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:53:29.607524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236f134-580f-42b0-9a0c-37426603a9b2 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:29.608620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236f134-580f-42b0-9a0c-37426603a9b2 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:29.609078 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236f134-580f-42b0-9a0c-37426603a9b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:29.611835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6236f134-580f-42b0-9a0c-37426603a9b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:53:29.635350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236f134-580f-42b0-9a0c-37426603a9b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:53:29.637525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236f134-580f-42b0-9a0c-37426603a9b2 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:53:29.667868 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4233/8571] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:53:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:53:31.010044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f96ad9-df9d-4c83-a58d-9e12e774e712 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:31.017541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f96ad9-df9d-4c83-a58d-9e12e774e712 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:31.018427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f96ad9-df9d-4c83-a58d-9e12e774e712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:31.062798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-61f96ad9-df9d-4c83-a58d-9e12e774e712 None None] MFA Rules not processed for user `eee4c63b80eb407395e862126b73d6d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:53:31.062798 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-61f96ad9-df9d-4c83-a58d-9e12e774e712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:53:31.185579 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4339/8572] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:53:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:53:32.166183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236f134-580f-42b0-9a0c-37426603a9b2 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:53:32.168640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6236f134-580f-42b0-9a0c-37426603a9b2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:53:32.184436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236f134-580f-42b0-9a0c-37426603a9b2 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:53:32.189120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b45aa-29d1-45a9-8299-b12e2a544b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:53:32.190194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b45aa-29d1-45a9-8299-b12e2a544b1c service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:32.190670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b45aa-29d1-45a9-8299-b12e2a544b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:32.191135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b45aa-29d1-45a9-8299-b12e2a544b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:32.194903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0b9b45aa-29d1-45a9-8299-b12e2a544b1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:53:32.210255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b45aa-29d1-45a9-8299-b12e2a544b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:53:32.213357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b45aa-29d1-45a9-8299-b12e2a544b1c service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:53:32.227893 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4234/8573] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:53:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:53:34.407519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f96ad9-df9d-4c83-a58d-9e12e774e712 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:53:34.454644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f96ad9-df9d-4c83-a58d-9e12e774e712 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:53:34.467889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d6b16-4663-495d-b15f-5031a8ce6e0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:53:34.468838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d6b16-4663-495d-b15f-5031a8ce6e0d service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:34.469286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d6b16-4663-495d-b15f-5031a8ce6e0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:34.471401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d6b16-4663-495d-b15f-5031a8ce6e0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:34.482195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7e7d6b16-4663-495d-b15f-5031a8ce6e0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:53:34.526494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d6b16-4663-495d-b15f-5031a8ce6e0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:53:34.535281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d6b16-4663-495d-b15f-5031a8ce6e0d service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:53:34.558766 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4340/8574] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:53:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:53:38.633158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b45aa-29d1-45a9-8299-b12e2a544b1c service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:53:38.633158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0b9b45aa-29d1-45a9-8299-b12e2a544b1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:53:38.861539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b45aa-29d1-45a9-8299-b12e2a544b1c service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:53:38.870930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260db0a6-e405-44ae-953f-aa655384ea94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:53:38.871804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260db0a6-e405-44ae-953f-aa655384ea94 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:38.872261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260db0a6-e405-44ae-953f-aa655384ea94 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:38.872805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260db0a6-e405-44ae-953f-aa655384ea94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:38.877967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-260db0a6-e405-44ae-953f-aa655384ea94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:53:38.917361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260db0a6-e405-44ae-953f-aa655384ea94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:53:38.919544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260db0a6-e405-44ae-953f-aa655384ea94 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:53:38.970197 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4235/8575] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:53:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:53:44.455633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d6b16-4663-495d-b15f-5031a8ce6e0d service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:53:44.472255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d6b16-4663-495d-b15f-5031a8ce6e0d service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:53:44.478686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b238dca-c37f-4391-8d28-3e1473389156 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:53:44.479376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b238dca-c37f-4391-8d28-3e1473389156 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:53:44.479747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b238dca-c37f-4391-8d28-3e1473389156 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:53:44.480216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b238dca-c37f-4391-8d28-3e1473389156 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:53:44.482083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2b238dca-c37f-4391-8d28-3e1473389156 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:53:44.499234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b238dca-c37f-4391-8d28-3e1473389156 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:53:44.500835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b238dca-c37f-4391-8d28-3e1473389156 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:53:44.514907 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4341/8576] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:53:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:53:48.947856 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=83 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:53:54.507431 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:54:16.394012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260db0a6-e405-44ae-953f-aa655384ea94 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:16.401444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-260db0a6-e405-44ae-953f-aa655384ea94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:16.496065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260db0a6-e405-44ae-953f-aa655384ea94 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:16.504300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc828e-ba1c-4a6e-99c3-ea6b9586e9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:16.505334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc828e-ba1c-4a6e-99c3-ea6b9586e9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:16.505686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc828e-ba1c-4a6e-99c3-ea6b9586e9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:16.506299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc828e-ba1c-4a6e-99c3-ea6b9586e9ca admin admin] PATH_INFO: `/v3/users/657d6749cb974f159384f43c102eabc1` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:16.507596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc828e-ba1c-4a6e-99c3-ea6b9586e9ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=657d6749cb974f159384f43c102eabc1)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:16.510127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cc828e-ba1c-4a6e-99c3-ea6b9586e9ca admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:16.693296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a9cc828e-ba1c-4a6e-99c3-ea6b9586e9ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '657d6749cb974f159384f43c102eabc1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:16.715957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a9cc828e-ba1c-4a6e-99c3-ea6b9586e9ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '657d6749cb974f159384f43c102eabc1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:16.717748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a9cc828e-ba1c-4a6e-99c3-ea6b9586e9ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '657d6749cb974f159384f43c102eabc1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:16.718518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a9cc828e-ba1c-4a6e-99c3-ea6b9586e9ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '657d6749cb974f159384f43c102eabc1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:16.728681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-a9cc828e-ba1c-4a6e-99c3-ea6b9586e9ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '657d6749cb974f159384f43c102eabc1'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:16.810480 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4236/8577] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:54:16 2022] DELETE /identity/v3/users/657d6749cb974f159384f43c102eabc1 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:54:16.812729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b89021-fd4b-4597-8d27-0e87d0a325ba None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:16.813220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b89021-fd4b-4597-8d27-0e87d0a325ba None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:16.813333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b89021-fd4b-4597-8d27-0e87d0a325ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:16.839125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-88b89021-fd4b-4597-8d27-0e87d0a325ba None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:54:16.841508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-88b89021-fd4b-4597-8d27-0e87d0a325ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:16.914749 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4342/8578] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:54:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:54:16.926054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc828e-ba1c-4a6e-99c3-ea6b9586e9ca admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:16.927890 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a9cc828e-ba1c-4a6e-99c3-ea6b9586e9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:16.997839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cc828e-ba1c-4a6e-99c3-ea6b9586e9ca admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:17.001739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba07d73-6d13-40df-bce0-9730170fe25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:17.002561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba07d73-6d13-40df-bce0-9730170fe25d service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:17.003065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba07d73-6d13-40df-bce0-9730170fe25d service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:17.003450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba07d73-6d13-40df-bce0-9730170fe25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:17.014995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba07d73-6d13-40df-bce0-9730170fe25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:17.016531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba07d73-6d13-40df-bce0-9730170fe25d service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:17.028064 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4237/8579] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:54:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:54:17.587549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b89021-fd4b-4597-8d27-0e87d0a325ba None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:17.588737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-88b89021-fd4b-4597-8d27-0e87d0a325ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:17.618541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b89021-fd4b-4597-8d27-0e87d0a325ba None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:17.622478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5cd50-87f2-4429-a9a2-241c677c63d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:17.623351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5cd50-87f2-4429-a9a2-241c677c63d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:17.623892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5cd50-87f2-4429-a9a2-241c677c63d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:17.624180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5cd50-87f2-4429-a9a2-241c677c63d9 admin admin] PATH_INFO: `/v3/projects/504b31731dbc4d4b828048da6ce8cf88` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:17.625370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5cd50-87f2-4429-a9a2-241c677c63d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=504b31731dbc4d4b828048da6ce8cf88)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:17.627397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5cd50-87f2-4429-a9a2-241c677c63d9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:17.742428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8cc5cd50-87f2-4429-a9a2-241c677c63d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '504b31731dbc4d4b828048da6ce8cf88', 'request_id': 'req-8cc5cd50-87f2-4429-a9a2-241c677c63d9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:17.750786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8cc5cd50-87f2-4429-a9a2-241c677c63d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '504b31731dbc4d4b828048da6ce8cf88', 'request_id': 'req-8cc5cd50-87f2-4429-a9a2-241c677c63d9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:17.758246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8cc5cd50-87f2-4429-a9a2-241c677c63d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '504b31731dbc4d4b828048da6ce8cf88', 'request_id': 'req-8cc5cd50-87f2-4429-a9a2-241c677c63d9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:17.841177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8cc5cd50-87f2-4429-a9a2-241c677c63d9 admin admin] The token cache is being invalidate because project 504b31731dbc4d4b828048da6ce8cf88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:54:17.842203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8cc5cd50-87f2-4429-a9a2-241c677c63d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:17.842848 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8cc5cd50-87f2-4429-a9a2-241c677c63d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:17.848836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba07d73-6d13-40df-bce0-9730170fe25d service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:17.854176 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4343/8580] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:54:17 2022] DELETE /identity/v3/projects/504b31731dbc4d4b828048da6ce8cf88 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:54:17.859401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba07d73-6d13-40df-bce0-9730170fe25d service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:17.883803 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:54:17.925420 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b213a-0437-45e2-b50c-9a3090fa4c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:17.926454 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b213a-0437-45e2-b50c-9a3090fa4c4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:17.927409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b213a-0437-45e2-b50c-9a3090fa4c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:17.927762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b213a-0437-45e2-b50c-9a3090fa4c4a admin admin] PATH_INFO: `/v3/users/14853bcf3cbb4588af37623ff7024a69` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:17.929059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b213a-0437-45e2-b50c-9a3090fa4c4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=14853bcf3cbb4588af37623ff7024a69)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:17.931170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b213a-0437-45e2-b50c-9a3090fa4c4a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:18.151710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-520b213a-0437-45e2-b50c-9a3090fa4c4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14853bcf3cbb4588af37623ff7024a69'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:18.167798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-520b213a-0437-45e2-b50c-9a3090fa4c4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14853bcf3cbb4588af37623ff7024a69'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:18.168555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-520b213a-0437-45e2-b50c-9a3090fa4c4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14853bcf3cbb4588af37623ff7024a69'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:18.169416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-520b213a-0437-45e2-b50c-9a3090fa4c4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14853bcf3cbb4588af37623ff7024a69'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:18.181623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-520b213a-0437-45e2-b50c-9a3090fa4c4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14853bcf3cbb4588af37623ff7024a69'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:18.298527 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4238/8581] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:54:17 2022] DELETE /identity/v3/users/14853bcf3cbb4588af37623ff7024a69 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:54:18.740730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5cd50-87f2-4429-a9a2-241c677c63d9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:18.744670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8cc5cd50-87f2-4429-a9a2-241c677c63d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:18.768421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5cd50-87f2-4429-a9a2-241c677c63d9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:18.838175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47d8bfa-295c-4eea-ba60-1209875c61ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:18.839423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d8bfa-295c-4eea-ba60-1209875c61ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:18.839745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d8bfa-295c-4eea-ba60-1209875c61ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:18.840010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47d8bfa-295c-4eea-ba60-1209875c61ee admin admin] PATH_INFO: `/v3/projects/f555fa67554c48968a129daacf84fd17` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:18.841233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d8bfa-295c-4eea-ba60-1209875c61ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=f555fa67554c48968a129daacf84fd17)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:18.843285 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47d8bfa-295c-4eea-ba60-1209875c61ee admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:18.968865 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:54:18.986957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b47d8bfa-295c-4eea-ba60-1209875c61ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f555fa67554c48968a129daacf84fd17', 'request_id': 'req-b47d8bfa-295c-4eea-ba60-1209875c61ee'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:18.992877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b47d8bfa-295c-4eea-ba60-1209875c61ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f555fa67554c48968a129daacf84fd17', 'request_id': 'req-b47d8bfa-295c-4eea-ba60-1209875c61ee'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:18.999860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b47d8bfa-295c-4eea-ba60-1209875c61ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f555fa67554c48968a129daacf84fd17', 'request_id': 'req-b47d8bfa-295c-4eea-ba60-1209875c61ee'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:19.092689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b47d8bfa-295c-4eea-ba60-1209875c61ee admin admin] The token cache is being invalidate because project f555fa67554c48968a129daacf84fd17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:54:19.093067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b47d8bfa-295c-4eea-ba60-1209875c61ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:19.093674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-b47d8bfa-295c-4eea-ba60-1209875c61ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:19.095306 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4344/8582] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:54:18 2022] DELETE /identity/v3/projects/f555fa67554c48968a129daacf84fd17 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:54:19.101204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d654e00-aac3-4e13-9682-a1df5c803507 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:19.101709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d654e00-aac3-4e13-9682-a1df5c803507 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:19.101802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d654e00-aac3-4e13-9682-a1df5c803507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:19.122981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9d654e00-aac3-4e13-9682-a1df5c803507 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:54:19.128976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9d654e00-aac3-4e13-9682-a1df5c803507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:19.200228 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4239/8583] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:54:19.208069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02092f11-bc31-448f-ba35-096f5b7961a5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:19.208843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02092f11-bc31-448f-ba35-096f5b7961a5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:19.209192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02092f11-bc31-448f-ba35-096f5b7961a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:19.234496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-02092f11-bc31-448f-ba35-096f5b7961a5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:54:19.235919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-02092f11-bc31-448f-ba35-096f5b7961a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:19.248960 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4345/8584] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:54:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:54:19.249969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d654e00-aac3-4e13-9682-a1df5c803507 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:19.270281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d654e00-aac3-4e13-9682-a1df5c803507 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:19.278331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93307ecc-b926-4b96-8ecb-c7d679b939bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:19.279333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93307ecc-b926-4b96-8ecb-c7d679b939bb admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:19.280099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93307ecc-b926-4b96-8ecb-c7d679b939bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:19.280451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93307ecc-b926-4b96-8ecb-c7d679b939bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:19.281937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93307ecc-b926-4b96-8ecb-c7d679b939bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:54:19.282773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93307ecc-b926-4b96-8ecb-c7d679b939bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:19.285115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93307ecc-b926-4b96-8ecb-c7d679b939bb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:19.306195 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4240/8585] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:54:19.309051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02092f11-bc31-448f-ba35-096f5b7961a5 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:19.320758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02092f11-bc31-448f-ba35-096f5b7961a5 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:19.326474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435447a-5109-4367-aaa0-f3f9b5961465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:19.327151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435447a-5109-4367-aaa0-f3f9b5961465 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:19.327441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435447a-5109-4367-aaa0-f3f9b5961465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:19.327721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435447a-5109-4367-aaa0-f3f9b5961465 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:19.328435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435447a-5109-4367-aaa0-f3f9b5961465 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:19.330797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435447a-5109-4367-aaa0-f3f9b5961465 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:19.426014 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4346/8586] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:54:19 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:54:19.431608 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93307ecc-b926-4b96-8ecb-c7d679b939bb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:19.443024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93307ecc-b926-4b96-8ecb-c7d679b939bb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:19.470191 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:54:19.502687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ab77c-369b-4d5f-9c26-991d0144f222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:19.503320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ab77c-369b-4d5f-9c26-991d0144f222 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:19.503607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ab77c-369b-4d5f-9c26-991d0144f222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:19.503887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ab77c-369b-4d5f-9c26-991d0144f222 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:19.504596 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ab77c-369b-4d5f-9c26-991d0144f222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:19.506655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ab77c-369b-4d5f-9c26-991d0144f222 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:19.580215 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4241/8587] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:54:19 2022] POST /identity/v3/users => generated 293 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:54:19.588665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435447a-5109-4367-aaa0-f3f9b5961465 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:19.600856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435447a-5109-4367-aaa0-f3f9b5961465 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:19.606034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77461b60-1a66-4c68-a653-8b19c734fb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:19.606743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77461b60-1a66-4c68-a653-8b19c734fb2a admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:19.607028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77461b60-1a66-4c68-a653-8b19c734fb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:19.607308 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77461b60-1a66-4c68-a653-8b19c734fb2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:19.608047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77461b60-1a66-4c68-a653-8b19c734fb2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:19.609650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77461b60-1a66-4c68-a653-8b19c734fb2a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:19.625448 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4347/8588] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:54:19.626190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ab77c-369b-4d5f-9c26-991d0144f222 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:19.640739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ab77c-369b-4d5f-9c26-991d0144f222 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:19.645592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0208b6c8-6db1-4242-8c7f-661ac873a2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:19.646296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208b6c8-6db1-4242-8c7f-661ac873a2fd admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:19.646581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208b6c8-6db1-4242-8c7f-661ac873a2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:19.646879 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0208b6c8-6db1-4242-8c7f-661ac873a2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:19.647617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208b6c8-6db1-4242-8c7f-661ac873a2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:19.652545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0208b6c8-6db1-4242-8c7f-661ac873a2fd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:19.667418 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4242/8589] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:54:19.671745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77461b60-1a66-4c68-a653-8b19c734fb2a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:19.693104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77461b60-1a66-4c68-a653-8b19c734fb2a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:19.697719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016fd19-6ae5-4753-b568-f5797f748c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:19.698852 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016fd19-6ae5-4753-b568-f5797f748c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:19.699135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016fd19-6ae5-4753-b568-f5797f748c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:19.699420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016fd19-6ae5-4753-b568-f5797f748c4c admin admin] PATH_INFO: `/v3/projects/65ba844953664fe9ac18a7c587665bed/users/1177509de31d407fb82092720af4b97f/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:19.716360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016fd19-6ae5-4753-b568-f5797f748c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=65ba844953664fe9ac18a7c587665bed, user_id=1177509de31d407fb82092720af4b97f, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:19.719084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016fd19-6ae5-4753-b568-f5797f748c4c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:19.808814 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4348/8590] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:54:19 2022] PUT /identity/v3/projects/65ba844953664fe9ac18a7c587665bed/users/1177509de31d407fb82092720af4b97f/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:54:19.820544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c010592-fe29-4085-b84e-d1f83381cc22 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:19.820840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c010592-fe29-4085-b84e-d1f83381cc22 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:19.821278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c010592-fe29-4085-b84e-d1f83381cc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:19.852151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6c010592-fe29-4085-b84e-d1f83381cc22 None None] MFA Rules not processed for user `1177509de31d407fb82092720af4b97f`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:54:19.853376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6c010592-fe29-4085-b84e-d1f83381cc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:19.921272 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4243/8591] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:54:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:54:19.933252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016fd19-6ae5-4753-b568-f5797f748c4c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:19.934819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c016fd19-6ae5-4753-b568-f5797f748c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:19.999564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016fd19-6ae5-4753-b568-f5797f748c4c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:20.005893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c76e4-920f-4c66-b8d9-3262bc438905 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:20.006608 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c76e4-920f-4c66-b8d9-3262bc438905 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:20.006897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c76e4-920f-4c66-b8d9-3262bc438905 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:20.007184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c76e4-920f-4c66-b8d9-3262bc438905 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:20.017369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c76e4-920f-4c66-b8d9-3262bc438905 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:20.018801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c76e4-920f-4c66-b8d9-3262bc438905 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:20.028436 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4349/8592] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:54:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:54:24.391045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eaddda-ff6f-4b97-95d2-9519f2b2c038 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:24.391649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eaddda-ff6f-4b97-95d2-9519f2b2c038 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:24.391649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eaddda-ff6f-4b97-95d2-9519f2b2c038 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:24.393314 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4244/8593] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 14:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 14:54:24.404290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a6f09-3d5a-469f-b60e-95bb45973f31 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:24.405938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a6f09-3d5a-469f-b60e-95bb45973f31 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:24.406691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a6f09-3d5a-469f-b60e-95bb45973f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:24.440995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-774a6f09-3d5a-469f-b60e-95bb45973f31 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:54:24.443324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-774a6f09-3d5a-469f-b60e-95bb45973f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:24.496767 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:54:24.525895 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4350/8594] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 14:54:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:54:24.557235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eaddda-ff6f-4b97-95d2-9519f2b2c038 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:24.559154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-81eaddda-ff6f-4b97-95d2-9519f2b2c038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:24.584631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eaddda-ff6f-4b97-95d2-9519f2b2c038 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:24.592245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bd500-42ba-441c-af9a-933d7163bfb4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:24.593090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bd500-42ba-441c-af9a-933d7163bfb4 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:24.593639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bd500-42ba-441c-af9a-933d7163bfb4 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:24.594075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bd500-42ba-441c-af9a-933d7163bfb4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:24.610214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bd500-42ba-441c-af9a-933d7163bfb4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:24.612098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bd500-42ba-441c-af9a-933d7163bfb4 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:24.624809 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4245/8595] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:54:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:54:25.528370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a6f09-3d5a-469f-b60e-95bb45973f31 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:25.528370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-774a6f09-3d5a-469f-b60e-95bb45973f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:25.548500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a6f09-3d5a-469f-b60e-95bb45973f31 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:25.552347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efb589-e339-4f2d-8bd2-14d73c8eeb67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:25.553022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efb589-e339-4f2d-8bd2-14d73c8eeb67 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:25.553311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efb589-e339-4f2d-8bd2-14d73c8eeb67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:25.553590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26efb589-e339-4f2d-8bd2-14d73c8eeb67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:25.555516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-26efb589-e339-4f2d-8bd2-14d73c8eeb67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:25.570774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efb589-e339-4f2d-8bd2-14d73c8eeb67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:25.572624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26efb589-e339-4f2d-8bd2-14d73c8eeb67 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:25.587058 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4351/8596] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:54:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:54:25.689306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bd500-42ba-441c-af9a-933d7163bfb4 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:25.691039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d05bd500-42ba-441c-af9a-933d7163bfb4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:25.729142 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bd500-42ba-441c-af9a-933d7163bfb4 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:25.746702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f4396-c48b-4e3e-b1df-39d6dca07623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:25.747899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f4396-c48b-4e3e-b1df-39d6dca07623 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:25.748278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f4396-c48b-4e3e-b1df-39d6dca07623 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:25.748597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f4396-c48b-4e3e-b1df-39d6dca07623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:25.751226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8c9f4396-c48b-4e3e-b1df-39d6dca07623 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:25.876147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f4396-c48b-4e3e-b1df-39d6dca07623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:25.877779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f4396-c48b-4e3e-b1df-39d6dca07623 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:25.898800 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4246/8597] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:54:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:54:31.898556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efb589-e339-4f2d-8bd2-14d73c8eeb67 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:31.912554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26efb589-e339-4f2d-8bd2-14d73c8eeb67 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:31.920607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5590e12-5cfe-44c8-b70c-fabe08a6d233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:31.921669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5590e12-5cfe-44c8-b70c-fabe08a6d233 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:31.922313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5590e12-5cfe-44c8-b70c-fabe08a6d233 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:31.922814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5590e12-5cfe-44c8-b70c-fabe08a6d233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:31.925721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a5590e12-5cfe-44c8-b70c-fabe08a6d233 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:31.947182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5590e12-5cfe-44c8-b70c-fabe08a6d233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:31.948875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5590e12-5cfe-44c8-b70c-fabe08a6d233 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:31.965375 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4352/8598] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:54:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:54:33.664940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f4396-c48b-4e3e-b1df-39d6dca07623 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:33.675973 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:54:33.756960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f4396-c48b-4e3e-b1df-39d6dca07623 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:33.762688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1a709-52f9-44b3-a33f-71d439a80589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:33.763667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1a709-52f9-44b3-a33f-71d439a80589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:33.763957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1a709-52f9-44b3-a33f-71d439a80589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:33.764241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a1a709-52f9-44b3-a33f-71d439a80589 admin admin] PATH_INFO: `/v3/users/1177509de31d407fb82092720af4b97f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:33.766222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1a709-52f9-44b3-a33f-71d439a80589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1177509de31d407fb82092720af4b97f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:33.768016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a1a709-52f9-44b3-a33f-71d439a80589 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:34.000104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-18a1a709-52f9-44b3-a33f-71d439a80589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1177509de31d407fb82092720af4b97f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:34.014607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-18a1a709-52f9-44b3-a33f-71d439a80589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1177509de31d407fb82092720af4b97f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:34.015435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-18a1a709-52f9-44b3-a33f-71d439a80589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1177509de31d407fb82092720af4b97f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:34.016166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-18a1a709-52f9-44b3-a33f-71d439a80589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1177509de31d407fb82092720af4b97f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:34.025950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-18a1a709-52f9-44b3-a33f-71d439a80589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1177509de31d407fb82092720af4b97f'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:34.123983 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4247/8599] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:54:33 2022] DELETE /identity/v3/users/1177509de31d407fb82092720af4b97f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:54:34.128413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c7ebe-1bcf-4a00-91b4-90aabc89ac0b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:34.128918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c7ebe-1bcf-4a00-91b4-90aabc89ac0b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:34.129113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663c7ebe-1bcf-4a00-91b4-90aabc89ac0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:34.151467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-663c7ebe-1bcf-4a00-91b4-90aabc89ac0b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:54:34.152741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-663c7ebe-1bcf-4a00-91b4-90aabc89ac0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:34.238540 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4353/8600] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:54:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:54:34.248632 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1a709-52f9-44b3-a33f-71d439a80589 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:34.250201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-18a1a709-52f9-44b3-a33f-71d439a80589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:34.328590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a1a709-52f9-44b3-a33f-71d439a80589 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:34.335063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e232078-60ec-45b2-b2b4-4514f9324e3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:34.336589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e232078-60ec-45b2-b2b4-4514f9324e3a service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:34.337118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e232078-60ec-45b2-b2b4-4514f9324e3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:34.337603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e232078-60ec-45b2-b2b4-4514f9324e3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:34.350796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e232078-60ec-45b2-b2b4-4514f9324e3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:34.352964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e232078-60ec-45b2-b2b4-4514f9324e3a service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:34.381762 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4248/8601] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:54:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:54:34.916151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c7ebe-1bcf-4a00-91b4-90aabc89ac0b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:34.918128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-663c7ebe-1bcf-4a00-91b4-90aabc89ac0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:34.932267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663c7ebe-1bcf-4a00-91b4-90aabc89ac0b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:34.937740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4bb74-72d8-4e2c-bf6b-10bb6c039d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:34.938763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4bb74-72d8-4e2c-bf6b-10bb6c039d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:34.938960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4bb74-72d8-4e2c-bf6b-10bb6c039d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:34.939233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4bb74-72d8-4e2c-bf6b-10bb6c039d1c admin admin] PATH_INFO: `/v3/projects/65ba844953664fe9ac18a7c587665bed` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:34.940511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4bb74-72d8-4e2c-bf6b-10bb6c039d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=65ba844953664fe9ac18a7c587665bed)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:34.943843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4bb74-72d8-4e2c-bf6b-10bb6c039d1c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:35.068091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6ae4bb74-72d8-4e2c-bf6b-10bb6c039d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65ba844953664fe9ac18a7c587665bed', 'request_id': 'req-6ae4bb74-72d8-4e2c-bf6b-10bb6c039d1c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:35.074181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6ae4bb74-72d8-4e2c-bf6b-10bb6c039d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65ba844953664fe9ac18a7c587665bed', 'request_id': 'req-6ae4bb74-72d8-4e2c-bf6b-10bb6c039d1c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:35.080747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6ae4bb74-72d8-4e2c-bf6b-10bb6c039d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65ba844953664fe9ac18a7c587665bed', 'request_id': 'req-6ae4bb74-72d8-4e2c-bf6b-10bb6c039d1c'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:35.085369 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:54:35.201025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6ae4bb74-72d8-4e2c-bf6b-10bb6c039d1c admin admin] The token cache is being invalidate because project 65ba844953664fe9ac18a7c587665bed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:54:35.201571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6ae4bb74-72d8-4e2c-bf6b-10bb6c039d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:35.202154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-6ae4bb74-72d8-4e2c-bf6b-10bb6c039d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:54:35.203845 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4354/8602] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:54:34 2022] DELETE /identity/v3/projects/65ba844953664fe9ac18a7c587665bed => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:54:35.210417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dc8d4-ebca-4f12-9300-be46a369c61d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:35.210921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dc8d4-ebca-4f12-9300-be46a369c61d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:35.211270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dc8d4-ebca-4f12-9300-be46a369c61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:35.234992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-dc1dc8d4-ebca-4f12-9300-be46a369c61d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:54:35.236283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-dc1dc8d4-ebca-4f12-9300-be46a369c61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:35.271472 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:54:35.309984 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4249/8603] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:54:35.319035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ef2f9-7a07-43dd-8a20-d8f76b6705c8 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:35.319458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ef2f9-7a07-43dd-8a20-d8f76b6705c8 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:35.320363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71ef2f9-7a07-43dd-8a20-d8f76b6705c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:35.340240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a71ef2f9-7a07-43dd-8a20-d8f76b6705c8 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:54:35.347063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a71ef2f9-7a07-43dd-8a20-d8f76b6705c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:35.356845 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4355/8604] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:54:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:54:35.361519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1dc8d4-ebca-4f12-9300-be46a369c61d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:35.372655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1dc8d4-ebca-4f12-9300-be46a369c61d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:35.377778 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee523fb-0509-409d-872c-8089179f988e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:35.378472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee523fb-0509-409d-872c-8089179f988e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:35.378767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee523fb-0509-409d-872c-8089179f988e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:35.379051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee523fb-0509-409d-872c-8089179f988e admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:35.379840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee523fb-0509-409d-872c-8089179f988e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:54:35.380146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee523fb-0509-409d-872c-8089179f988e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:35.381806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee523fb-0509-409d-872c-8089179f988e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:35.394765 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4250/8605] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:54:35.400370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ef2f9-7a07-43dd-8a20-d8f76b6705c8 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:35.411570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71ef2f9-7a07-43dd-8a20-d8f76b6705c8 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:35.417065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279cc35-21ce-4d19-aa1a-aabe45efb54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:35.417856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279cc35-21ce-4d19-aa1a-aabe45efb54a admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:35.418273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279cc35-21ce-4d19-aa1a-aabe45efb54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:35.418621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279cc35-21ce-4d19-aa1a-aabe45efb54a admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:35.419330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279cc35-21ce-4d19-aa1a-aabe45efb54a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:35.421270 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279cc35-21ce-4d19-aa1a-aabe45efb54a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:35.536619 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4356/8606] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:54:35 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:54:35.541676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee523fb-0509-409d-872c-8089179f988e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:35.558915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee523fb-0509-409d-872c-8089179f988e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:35.651026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2fa5a-775e-4ff5-90c0-99a291c83e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:35.651721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2fa5a-775e-4ff5-90c0-99a291c83e83 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:35.652014 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2fa5a-775e-4ff5-90c0-99a291c83e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:35.652292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c2fa5a-775e-4ff5-90c0-99a291c83e83 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:35.653008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2fa5a-775e-4ff5-90c0-99a291c83e83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:35.654952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c2fa5a-775e-4ff5-90c0-99a291c83e83 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:35.733375 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4251/8607] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:54:35 2022] POST /identity/v3/users => generated 289 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:54:35.737598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279cc35-21ce-4d19-aa1a-aabe45efb54a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:35.755189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279cc35-21ce-4d19-aa1a-aabe45efb54a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:35.761301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e2088-43bd-411a-9d12-877ed68a64a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:35.762541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e2088-43bd-411a-9d12-877ed68a64a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:35.763069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e2088-43bd-411a-9d12-877ed68a64a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:35.763565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e2088-43bd-411a-9d12-877ed68a64a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:35.765494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e2088-43bd-411a-9d12-877ed68a64a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:35.767460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e2088-43bd-411a-9d12-877ed68a64a4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:35.781050 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4357/8608] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:54:35.785215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2fa5a-775e-4ff5-90c0-99a291c83e83 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:35.798120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c2fa5a-775e-4ff5-90c0-99a291c83e83 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:35.803876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd605fa5-27fe-4d4b-88b9-01db10c886cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:35.804561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd605fa5-27fe-4d4b-88b9-01db10c886cd admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:35.804850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd605fa5-27fe-4d4b-88b9-01db10c886cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:35.805136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd605fa5-27fe-4d4b-88b9-01db10c886cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:35.805964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd605fa5-27fe-4d4b-88b9-01db10c886cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:35.808160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd605fa5-27fe-4d4b-88b9-01db10c886cd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:35.822644 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4252/8609] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:54:35.827340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e2088-43bd-411a-9d12-877ed68a64a4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:35.846395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e2088-43bd-411a-9d12-877ed68a64a4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:35.854228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2d8b6-ab2a-4467-883b-1ed3e5d355d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:35.855179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2d8b6-ab2a-4467-883b-1ed3e5d355d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:35.855491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2d8b6-ab2a-4467-883b-1ed3e5d355d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:35.858163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2d8b6-ab2a-4467-883b-1ed3e5d355d0 admin admin] PATH_INFO: `/v3/projects/8c83bdf47ab34dacb67d0d81d1e878b1/users/c6418edc8570499fbdcab89c8e038306/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:35.888871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2d8b6-ab2a-4467-883b-1ed3e5d355d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c83bdf47ab34dacb67d0d81d1e878b1, user_id=c6418edc8570499fbdcab89c8e038306, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:35.893468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b2d8b6-ab2a-4467-883b-1ed3e5d355d0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:35.992900 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4358/8610] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:54:35 2022] PUT /identity/v3/projects/8c83bdf47ab34dacb67d0d81d1e878b1/users/c6418edc8570499fbdcab89c8e038306/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:54:36.003718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d14783-e3af-47b3-9cd0-2217a6ed02bc None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:36.004020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d14783-e3af-47b3-9cd0-2217a6ed02bc None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:36.004936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d14783-e3af-47b3-9cd0-2217a6ed02bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:36.040293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-65d14783-e3af-47b3-9cd0-2217a6ed02bc None None] MFA Rules not processed for user `c6418edc8570499fbdcab89c8e038306`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:54:36.041761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-65d14783-e3af-47b3-9cd0-2217a6ed02bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:36.126784 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4253/8611] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:54:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:54:36.138475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2d8b6-ab2a-4467-883b-1ed3e5d355d0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:36.140478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-97b2d8b6-ab2a-4467-883b-1ed3e5d355d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:36.205720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2d8b6-ab2a-4467-883b-1ed3e5d355d0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:36.210784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cc0ea-36e3-451e-bfd7-a29053eecad5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:36.211452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cc0ea-36e3-451e-bfd7-a29053eecad5 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:36.211827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cc0ea-36e3-451e-bfd7-a29053eecad5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:36.212003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cc0ea-36e3-451e-bfd7-a29053eecad5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:36.222207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20cc0ea-36e3-451e-bfd7-a29053eecad5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:36.223729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20cc0ea-36e3-451e-bfd7-a29053eecad5 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:36.234205 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4359/8612] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:54:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:54:42.198999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ad334-591e-4a6f-81bc-f2e73bcedd91 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:42.199441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ad334-591e-4a6f-81bc-f2e73bcedd91 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:42.199747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ad334-591e-4a6f-81bc-f2e73bcedd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:42.233550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e57ad334-591e-4a6f-81bc-f2e73bcedd91 None None] MFA Rules not processed for user `a572e84b1e57481fa882845e927983ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:54:42.234803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e57ad334-591e-4a6f-81bc-f2e73bcedd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:42.257073 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:54:42.298415 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4254/8613] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:54:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:54:46.230048 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=1,keystone:SELECT=55,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:54:48.395092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cc0ea-36e3-451e-bfd7-a29053eecad5 service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:48.397805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c20cc0ea-36e3-451e-bfd7-a29053eecad5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:48.588305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cc0ea-36e3-451e-bfd7-a29053eecad5 service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:48.597202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81c2ad-db76-405a-95c2-44a22275eb84 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:48.598921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81c2ad-db76-405a-95c2-44a22275eb84 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:48.599671 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81c2ad-db76-405a-95c2-44a22275eb84 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:48.600474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81c2ad-db76-405a-95c2-44a22275eb84 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:48.614840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81c2ad-db76-405a-95c2-44a22275eb84 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:48.617342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81c2ad-db76-405a-95c2-44a22275eb84 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:48.631185 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4360/8614] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:54:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 663 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:54:50.300431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ad334-591e-4a6f-81bc-f2e73bcedd91 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:50.303140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e57ad334-591e-4a6f-81bc-f2e73bcedd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:50.468210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ad334-591e-4a6f-81bc-f2e73bcedd91 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:50.498295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a07f30-f7d1-4930-8c6a-f4b9f13e5467 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:50.498971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a07f30-f7d1-4930-8c6a-f4b9f13e5467 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:50.499378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a07f30-f7d1-4930-8c6a-f4b9f13e5467 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:50.499706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a07f30-f7d1-4930-8c6a-f4b9f13e5467 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:50.502277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-79a07f30-f7d1-4930-8c6a-f4b9f13e5467 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:50.523392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a07f30-f7d1-4930-8c6a-f4b9f13e5467 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:50.525582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a07f30-f7d1-4930-8c6a-f4b9f13e5467 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:50.557887 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4255/8615] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:54:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:54:54.839783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81c2ad-db76-405a-95c2-44a22275eb84 service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:54.841491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bf81c2ad-db76-405a-95c2-44a22275eb84 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:54.874607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81c2ad-db76-405a-95c2-44a22275eb84 service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:54.886542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33afb0-9fd6-49e0-86b9-a3d412da21ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:54.887224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33afb0-9fd6-49e0-86b9-a3d412da21ea service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:54.887718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33afb0-9fd6-49e0-86b9-a3d412da21ea service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:54.888302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33afb0-9fd6-49e0-86b9-a3d412da21ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:54.892265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9e33afb0-9fd6-49e0-86b9-a3d412da21ea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:54.915359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33afb0-9fd6-49e0-86b9-a3d412da21ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:54.917253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33afb0-9fd6-49e0-86b9-a3d412da21ea service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:54.938391 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4361/8616] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:54:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:54:56.672282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a07f30-f7d1-4930-8c6a-f4b9f13e5467 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:54:56.673685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-79a07f30-f7d1-4930-8c6a-f4b9f13e5467 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:56.689962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a07f30-f7d1-4930-8c6a-f4b9f13e5467 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:54:56.693846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b7df8-e57a-4d16-9eb9-01453d44ab6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:54:56.694526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b7df8-e57a-4d16-9eb9-01453d44ab6e service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:54:56.694816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b7df8-e57a-4d16-9eb9-01453d44ab6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:54:56.695095 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b7df8-e57a-4d16-9eb9-01453d44ab6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:54:56.696898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1f2b7df8-e57a-4d16-9eb9-01453d44ab6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:54:56.770888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b7df8-e57a-4d16-9eb9-01453d44ab6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:54:56.772336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2b7df8-e57a-4d16-9eb9-01453d44ab6e service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:54:56.781733 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4256/8617] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:54:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:55:04.924195 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=43 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:55:05.363780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb0b7d-8b3a-4eff-9cf1-927e464cb82c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:55:05.367960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb0b7d-8b3a-4eff-9cf1-927e464cb82c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:55:05.367960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbb0b7d-8b3a-4eff-9cf1-927e464cb82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:55:05.400339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6cbb0b7d-8b3a-4eff-9cf1-927e464cb82c None None] MFA Rules not processed for user `eee4c63b80eb407395e862126b73d6d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:55:05.405033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6cbb0b7d-8b3a-4eff-9cf1-927e464cb82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:55:05.531220 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4362/8618] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:55:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:55:06.778342 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=73 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:55:15.521848 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=25 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:55:24.305520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b7df8-e57a-4d16-9eb9-01453d44ab6e service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:55:24.307095 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1f2b7df8-e57a-4d16-9eb9-01453d44ab6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:55:24.410792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b7df8-e57a-4d16-9eb9-01453d44ab6e service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:55:24.433876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb514d9-2dd7-4ff3-9b25-5a8bf5b81a71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:55:24.434973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb514d9-2dd7-4ff3-9b25-5a8bf5b81a71 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:55:24.435266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb514d9-2dd7-4ff3-9b25-5a8bf5b81a71 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:55:24.435550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb514d9-2dd7-4ff3-9b25-5a8bf5b81a71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:55:24.445339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-cdb514d9-2dd7-4ff3-9b25-5a8bf5b81a71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:55:24.482824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb514d9-2dd7-4ff3-9b25-5a8bf5b81a71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:55:24.484459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb514d9-2dd7-4ff3-9b25-5a8bf5b81a71 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:55:24.524245 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4257/8619] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:55:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:55:34.515824 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=34 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:56:05.917289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb0b7d-8b3a-4eff-9cf1-927e464cb82c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:56:06.043921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbb0b7d-8b3a-4eff-9cf1-927e464cb82c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:56:06.058528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cae16-10c4-447b-9a48-2da29af20618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:56:06.060581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cae16-10c4-447b-9a48-2da29af20618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:06.062585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cae16-10c4-447b-9a48-2da29af20618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:06.062978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cae16-10c4-447b-9a48-2da29af20618 admin admin] PATH_INFO: `/v3/users/c6418edc8570499fbdcab89c8e038306` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:06.068407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cae16-10c4-447b-9a48-2da29af20618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6418edc8570499fbdcab89c8e038306)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:56:06.077425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cae16-10c4-447b-9a48-2da29af20618 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:56:06.404266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cb1cae16-10c4-447b-9a48-2da29af20618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6418edc8570499fbdcab89c8e038306'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:56:06.421713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cb1cae16-10c4-447b-9a48-2da29af20618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6418edc8570499fbdcab89c8e038306'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:56:06.436490 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cb1cae16-10c4-447b-9a48-2da29af20618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6418edc8570499fbdcab89c8e038306'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:56:06.437478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cb1cae16-10c4-447b-9a48-2da29af20618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6418edc8570499fbdcab89c8e038306'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:56:06.565495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cb1cae16-10c4-447b-9a48-2da29af20618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6418edc8570499fbdcab89c8e038306'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:56:06.572855 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4363/8620] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:56:05 2022] DELETE /identity/v3/users/c6418edc8570499fbdcab89c8e038306 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:56:06.579681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f572154-9a7f-47ad-aa2a-4bd752f06874 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:06.580463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f572154-9a7f-47ad-aa2a-4bd752f06874 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:06.580463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f572154-9a7f-47ad-aa2a-4bd752f06874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:06.603348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-8f572154-9a7f-47ad-aa2a-4bd752f06874 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:56:06.603348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8f572154-9a7f-47ad-aa2a-4bd752f06874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:56:06.714165 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4258/8621] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:56:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:56:06.721455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cae16-10c4-447b-9a48-2da29af20618 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:56:06.723060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cb1cae16-10c4-447b-9a48-2da29af20618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:56:06.800204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cae16-10c4-447b-9a48-2da29af20618 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:56:06.811544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd886950-6c2b-47b7-b71b-d22e34c00e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:56:06.812232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd886950-6c2b-47b7-b71b-d22e34c00e03 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:06.812523 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd886950-6c2b-47b7-b71b-d22e34c00e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:06.812808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd886950-6c2b-47b7-b71b-d22e34c00e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:06.843570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd886950-6c2b-47b7-b71b-d22e34c00e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:56:06.846147 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd886950-6c2b-47b7-b71b-d22e34c00e03 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:56:06.864271 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4364/8622] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:56:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:56:07.444986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f572154-9a7f-47ad-aa2a-4bd752f06874 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:56:07.446663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8f572154-9a7f-47ad-aa2a-4bd752f06874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:56:07.460591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f572154-9a7f-47ad-aa2a-4bd752f06874 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:56:07.465572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afaeb5-07a5-4ee8-8f7e-bba8059db2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:56:07.466573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afaeb5-07a5-4ee8-8f7e-bba8059db2ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:07.467045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afaeb5-07a5-4ee8-8f7e-bba8059db2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:07.467549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afaeb5-07a5-4ee8-8f7e-bba8059db2ba admin admin] PATH_INFO: `/v3/projects/8c83bdf47ab34dacb67d0d81d1e878b1` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:07.469154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afaeb5-07a5-4ee8-8f7e-bba8059db2ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c83bdf47ab34dacb67d0d81d1e878b1)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:56:07.471577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afaeb5-07a5-4ee8-8f7e-bba8059db2ba admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:56:07.617298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7afaeb5-07a5-4ee8-8f7e-bba8059db2ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c83bdf47ab34dacb67d0d81d1e878b1', 'request_id': 'req-f7afaeb5-07a5-4ee8-8f7e-bba8059db2ba'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:56:07.742410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7afaeb5-07a5-4ee8-8f7e-bba8059db2ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c83bdf47ab34dacb67d0d81d1e878b1', 'request_id': 'req-f7afaeb5-07a5-4ee8-8f7e-bba8059db2ba'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:56:07.749445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7afaeb5-07a5-4ee8-8f7e-bba8059db2ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c83bdf47ab34dacb67d0d81d1e878b1', 'request_id': 'req-f7afaeb5-07a5-4ee8-8f7e-bba8059db2ba'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:56:07.761722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7afaeb5-07a5-4ee8-8f7e-bba8059db2ba admin admin] The token cache is being invalidate because project 8c83bdf47ab34dacb67d0d81d1e878b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:56:07.762131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7afaeb5-07a5-4ee8-8f7e-bba8059db2ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:56:07.762796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f7afaeb5-07a5-4ee8-8f7e-bba8059db2ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:56:07.764359 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4259/8623] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:56:07 2022] DELETE /identity/v3/projects/8c83bdf47ab34dacb67d0d81d1e878b1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:56:07.769675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a70483-05b3-49d5-a29f-d54de87dfe8b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:07.770240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a70483-05b3-49d5-a29f-d54de87dfe8b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:07.770414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a70483-05b3-49d5-a29f-d54de87dfe8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:07.789675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-31a70483-05b3-49d5-a29f-d54de87dfe8b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:56:07.790918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-31a70483-05b3-49d5-a29f-d54de87dfe8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:56:07.809771 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:56:07.864923 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4365/8624] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:56:07.872910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcb77c-486d-4cb7-884d-fac8270b334a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:07.873199 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcb77c-486d-4cb7-884d-fac8270b334a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:07.873480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcb77c-486d-4cb7-884d-fac8270b334a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:07.893629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3afcb77c-486d-4cb7-884d-fac8270b334a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:56:07.895180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3afcb77c-486d-4cb7-884d-fac8270b334a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:56:07.904165 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4260/8625] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:56:07.909114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a70483-05b3-49d5-a29f-d54de87dfe8b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:56:07.926864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a70483-05b3-49d5-a29f-d54de87dfe8b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:56:07.930778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383cd2c-f067-4d21-8649-8fa602ce8f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:56:07.931731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383cd2c-f067-4d21-8649-8fa602ce8f0b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:07.931968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383cd2c-f067-4d21-8649-8fa602ce8f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:07.932249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a383cd2c-f067-4d21-8649-8fa602ce8f0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:07.933215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383cd2c-f067-4d21-8649-8fa602ce8f0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:56:07.933626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383cd2c-f067-4d21-8649-8fa602ce8f0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:56:07.935255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a383cd2c-f067-4d21-8649-8fa602ce8f0b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:56:07.948349 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4366/8626] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:56:07.952648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcb77c-486d-4cb7-884d-fac8270b334a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:56:07.962210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcb77c-486d-4cb7-884d-fac8270b334a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:56:07.967062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22764d5d-fd74-4da5-bc44-5ba8b2f01fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:56:07.967727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22764d5d-fd74-4da5-bc44-5ba8b2f01fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:07.968019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22764d5d-fd74-4da5-bc44-5ba8b2f01fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:07.968310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22764d5d-fd74-4da5-bc44-5ba8b2f01fe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:07.969073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22764d5d-fd74-4da5-bc44-5ba8b2f01fe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:56:07.971693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22764d5d-fd74-4da5-bc44-5ba8b2f01fe5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:56:08.115399 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4261/8627] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:56:07 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:56:08.116788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383cd2c-f067-4d21-8649-8fa602ce8f0b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:56:08.127620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a383cd2c-f067-4d21-8649-8fa602ce8f0b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:56:08.191031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80363de-7e66-4f82-86de-a328990d8c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:56:08.191750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80363de-7e66-4f82-86de-a328990d8c04 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:08.192061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80363de-7e66-4f82-86de-a328990d8c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:08.192345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80363de-7e66-4f82-86de-a328990d8c04 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:08.193103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80363de-7e66-4f82-86de-a328990d8c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:56:08.195337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80363de-7e66-4f82-86de-a328990d8c04 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:56:08.298540 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4367/8628] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:56:08 2022] POST /identity/v3/users => generated 292 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:56:08.301640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22764d5d-fd74-4da5-bc44-5ba8b2f01fe5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:56:08.313293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22764d5d-fd74-4da5-bc44-5ba8b2f01fe5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:56:08.318830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f423098-6e56-49e5-a717-b5e23c37f883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:56:08.320968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f423098-6e56-49e5-a717-b5e23c37f883 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:08.320968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f423098-6e56-49e5-a717-b5e23c37f883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:08.320968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f423098-6e56-49e5-a717-b5e23c37f883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:08.320968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f423098-6e56-49e5-a717-b5e23c37f883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:56:08.322670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f423098-6e56-49e5-a717-b5e23c37f883 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:56:08.337105 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4262/8629] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:56:08.341388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80363de-7e66-4f82-86de-a328990d8c04 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:56:08.352575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80363de-7e66-4f82-86de-a328990d8c04 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:56:08.357474 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad4c94-4b71-42fa-bd8b-c06ca8704ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:56:08.358259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad4c94-4b71-42fa-bd8b-c06ca8704ffd admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:08.358554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad4c94-4b71-42fa-bd8b-c06ca8704ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:08.358847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad4c94-4b71-42fa-bd8b-c06ca8704ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:08.359614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad4c94-4b71-42fa-bd8b-c06ca8704ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:56:08.361302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad4c94-4b71-42fa-bd8b-c06ca8704ffd admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:56:08.373474 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4368/8630] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:56:08.378057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f423098-6e56-49e5-a717-b5e23c37f883 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:56:08.389111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f423098-6e56-49e5-a717-b5e23c37f883 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:56:08.395541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7102d-388e-4f69-ad8a-d6ae00074748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:56:08.396464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7102d-388e-4f69-ad8a-d6ae00074748 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:08.396757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7102d-388e-4f69-ad8a-d6ae00074748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:08.397048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7102d-388e-4f69-ad8a-d6ae00074748 admin admin] PATH_INFO: `/v3/projects/eea42020a9934297a869d885a6857a9a/users/0a26347fd8b04ab8b67f8f1f5f906cb4/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:08.413688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7102d-388e-4f69-ad8a-d6ae00074748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea42020a9934297a869d885a6857a9a, user_id=0a26347fd8b04ab8b67f8f1f5f906cb4, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:56:08.416535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7102d-388e-4f69-ad8a-d6ae00074748 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:56:08.482912 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4263/8631] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:56:08 2022] PUT /identity/v3/projects/eea42020a9934297a869d885a6857a9a/users/0a26347fd8b04ab8b67f8f1f5f906cb4/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:56:08.494475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aed296-0c8a-4303-951d-b503aadb8303 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:08.494766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aed296-0c8a-4303-951d-b503aadb8303 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:08.495051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aed296-0c8a-4303-951d-b503aadb8303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:08.531055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f0aed296-0c8a-4303-951d-b503aadb8303 None None] MFA Rules not processed for user `0a26347fd8b04ab8b67f8f1f5f906cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:56:08.532377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f0aed296-0c8a-4303-951d-b503aadb8303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:56:08.620530 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4369/8632] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:56:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:56:08.632962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7102d-388e-4f69-ad8a-d6ae00074748 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:56:08.634707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-44d7102d-388e-4f69-ad8a-d6ae00074748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:56:08.659009 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:56:08.710971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7102d-388e-4f69-ad8a-d6ae00074748 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:56:08.715233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6c31c-db6f-405a-8179-e6ff63bb994e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:56:08.715233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6c31c-db6f-405a-8179-e6ff63bb994e service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:08.715539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6c31c-db6f-405a-8179-e6ff63bb994e service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:08.715824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6c31c-db6f-405a-8179-e6ff63bb994e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:08.724382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6c31c-db6f-405a-8179-e6ff63bb994e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:56:08.725815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d6c31c-db6f-405a-8179-e6ff63bb994e service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:56:08.735752 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4264/8633] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:56:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:56:15.096966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aed296-0c8a-4303-951d-b503aadb8303 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:56:15.121473 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:56:15.203613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aed296-0c8a-4303-951d-b503aadb8303 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:56:15.211413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0a341-1486-4615-bd61-fd88aaa8791a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:56:15.211413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0a341-1486-4615-bd61-fd88aaa8791a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:15.211413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0a341-1486-4615-bd61-fd88aaa8791a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:15.211413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0a341-1486-4615-bd61-fd88aaa8791a admin admin] PATH_INFO: `/v3/users/0a26347fd8b04ab8b67f8f1f5f906cb4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:15.212793 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0a341-1486-4615-bd61-fd88aaa8791a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a26347fd8b04ab8b67f8f1f5f906cb4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:56:15.214942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0a341-1486-4615-bd61-fd88aaa8791a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:56:16.394792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f3e0a341-1486-4615-bd61-fd88aaa8791a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a26347fd8b04ab8b67f8f1f5f906cb4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:56:16.407401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f3e0a341-1486-4615-bd61-fd88aaa8791a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a26347fd8b04ab8b67f8f1f5f906cb4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:56:16.416785 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f3e0a341-1486-4615-bd61-fd88aaa8791a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a26347fd8b04ab8b67f8f1f5f906cb4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:56:16.417700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f3e0a341-1486-4615-bd61-fd88aaa8791a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a26347fd8b04ab8b67f8f1f5f906cb4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:56:16.527502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f3e0a341-1486-4615-bd61-fd88aaa8791a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a26347fd8b04ab8b67f8f1f5f906cb4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:56:16.529677 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4370/8634] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:56:15 2022] DELETE /identity/v3/users/0a26347fd8b04ab8b67f8f1f5f906cb4 => generated 0 bytes in 1433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:56:16.534917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516590f-fec8-4224-9b7c-7e9c4e9ed421 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:16.535399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516590f-fec8-4224-9b7c-7e9c4e9ed421 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:16.535536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516590f-fec8-4224-9b7c-7e9c4e9ed421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:16.552926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-5516590f-fec8-4224-9b7c-7e9c4e9ed421 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:56:16.554195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5516590f-fec8-4224-9b7c-7e9c4e9ed421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:56:16.621011 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4265/8635] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:56:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:56:16.631683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0a341-1486-4615-bd61-fd88aaa8791a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:56:16.633217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f3e0a341-1486-4615-bd61-fd88aaa8791a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:56:16.698841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0a341-1486-4615-bd61-fd88aaa8791a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:56:16.702952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaaa6ef-1074-4152-ba0f-126e7db8866f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:56:16.703223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaa6ef-1074-4152-ba0f-126e7db8866f service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:16.703510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaa6ef-1074-4152-ba0f-126e7db8866f service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:16.703788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaaa6ef-1074-4152-ba0f-126e7db8866f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:16.715755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaaa6ef-1074-4152-ba0f-126e7db8866f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:56:16.717065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaaa6ef-1074-4152-ba0f-126e7db8866f service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:56:16.734542 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4371/8636] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:56:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:56:17.212938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516590f-fec8-4224-9b7c-7e9c4e9ed421 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:56:17.216054 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5516590f-fec8-4224-9b7c-7e9c4e9ed421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:56:17.258947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516590f-fec8-4224-9b7c-7e9c4e9ed421 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:56:17.265461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef2f30-ed23-4311-8f1d-85c292b04d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:56:17.266446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef2f30-ed23-4311-8f1d-85c292b04d54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:17.266758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef2f30-ed23-4311-8f1d-85c292b04d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:17.267110 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef2f30-ed23-4311-8f1d-85c292b04d54 admin admin] PATH_INFO: `/v3/projects/eea42020a9934297a869d885a6857a9a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:17.269906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef2f30-ed23-4311-8f1d-85c292b04d54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea42020a9934297a869d885a6857a9a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:56:17.272338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef2f30-ed23-4311-8f1d-85c292b04d54 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:56:17.435448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-69ef2f30-ed23-4311-8f1d-85c292b04d54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea42020a9934297a869d885a6857a9a', 'request_id': 'req-69ef2f30-ed23-4311-8f1d-85c292b04d54'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:56:17.513278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-69ef2f30-ed23-4311-8f1d-85c292b04d54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea42020a9934297a869d885a6857a9a', 'request_id': 'req-69ef2f30-ed23-4311-8f1d-85c292b04d54'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:56:17.521290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-69ef2f30-ed23-4311-8f1d-85c292b04d54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea42020a9934297a869d885a6857a9a', 'request_id': 'req-69ef2f30-ed23-4311-8f1d-85c292b04d54'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:56:17.532257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-69ef2f30-ed23-4311-8f1d-85c292b04d54 admin admin] The token cache is being invalidate because project eea42020a9934297a869d885a6857a9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:56:17.532549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-69ef2f30-ed23-4311-8f1d-85c292b04d54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:56:17.533853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-69ef2f30-ed23-4311-8f1d-85c292b04d54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:56:17.535463 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4266/8637] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:56:17 2022] DELETE /identity/v3/projects/eea42020a9934297a869d885a6857a9a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:56:26.728600 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:56:27.529430 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:56:29.626086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaaa6ef-1074-4152-ba0f-126e7db8866f service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:56:29.627534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dbaaa6ef-1074-4152-ba0f-126e7db8866f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:56:29.700641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaaa6ef-1074-4152-ba0f-126e7db8866f service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:56:29.760702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791bc82-c7d4-47bf-886e-1586a6b4368d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:56:29.761299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791bc82-c7d4-47bf-886e-1586a6b4368d service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:29.761589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791bc82-c7d4-47bf-886e-1586a6b4368d service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:29.761873 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8791bc82-c7d4-47bf-886e-1586a6b4368d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:29.763745 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8791bc82-c7d4-47bf-886e-1586a6b4368d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:56:29.825633 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791bc82-c7d4-47bf-886e-1586a6b4368d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:56:29.827259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8791bc82-c7d4-47bf-886e-1586a6b4368d service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:56:29.836585 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4372/8638] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:56:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 659 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:56:34.744175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b89125-5a46-4615-a34c-e21a58473a83 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:34.744729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b89125-5a46-4615-a34c-e21a58473a83 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:34.744729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b89125-5a46-4615-a34c-e21a58473a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:34.763267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-05b89125-5a46-4615-a34c-e21a58473a83 None None] MFA Rules not processed for user `a572e84b1e57481fa882845e927983ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:56:34.764476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-05b89125-5a46-4615-a34c-e21a58473a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:56:34.822186 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4267/8639] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:56:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:56:39.832678 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=80 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:56:44.814864 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=25 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:56:45.299130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791bc82-c7d4-47bf-886e-1586a6b4368d service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:56:45.300605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8791bc82-c7d4-47bf-886e-1586a6b4368d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:56:45.364439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8791bc82-c7d4-47bf-886e-1586a6b4368d service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:56:45.374031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3013e2-b96f-400d-aa94-7b6455e0899a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:56:45.374754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3013e2-b96f-400d-aa94-7b6455e0899a service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:45.375045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3013e2-b96f-400d-aa94-7b6455e0899a service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:45.375330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3013e2-b96f-400d-aa94-7b6455e0899a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:45.377206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-de3013e2-b96f-400d-aa94-7b6455e0899a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:56:45.457089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3013e2-b96f-400d-aa94-7b6455e0899a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:56:45.458530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3013e2-b96f-400d-aa94-7b6455e0899a service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:56:45.472638 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4373/8640] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:56:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:56:47.813170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b89125-5a46-4615-a34c-e21a58473a83 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:56:47.814668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-05b89125-5a46-4615-a34c-e21a58473a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:56:47.829312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b89125-5a46-4615-a34c-e21a58473a83 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:56:47.832896 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf7433-1c0c-42be-85ad-a250847b5553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:56:47.833575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf7433-1c0c-42be-85ad-a250847b5553 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:47.833864 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf7433-1c0c-42be-85ad-a250847b5553 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:47.834179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bf7433-1c0c-42be-85ad-a250847b5553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:47.835969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-19bf7433-1c0c-42be-85ad-a250847b5553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:56:47.853640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf7433-1c0c-42be-85ad-a250847b5553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:56:47.855157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bf7433-1c0c-42be-85ad-a250847b5553 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:56:47.871260 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4268/8641] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:56:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:56:55.465016 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=54 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:56:57.861969 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:56:59.239862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf5c26-b929-43fa-b044-b675c3e233ba None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:59.240351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf5c26-b929-43fa-b044-b675c3e233ba None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:59.242980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaf5c26-b929-43fa-b044-b675c3e233ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:59.318625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-abaf5c26-b929-43fa-b044-b675c3e233ba None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:56:59.319862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-abaf5c26-b929-43fa-b044-b675c3e233ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:56:59.440281 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4374/8642] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 14:56:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:56:59.650545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf7433-1c0c-42be-85ad-a250847b5553 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:56:59.652056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-19bf7433-1c0c-42be-85ad-a250847b5553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:56:59.676571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bf7433-1c0c-42be-85ad-a250847b5553 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:56:59.685646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92856055-8144-4ef6-9187-c2d3672b5357 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:56:59.686630 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92856055-8144-4ef6-9187-c2d3672b5357 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:56:59.687090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92856055-8144-4ef6-9187-c2d3672b5357 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:56:59.687537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92856055-8144-4ef6-9187-c2d3672b5357 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:56:59.698340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92856055-8144-4ef6-9187-c2d3672b5357 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:56:59.700719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92856055-8144-4ef6-9187-c2d3672b5357 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:56:59.720491 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4269/8643] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:56:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:57:01.193890 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a40ba0-80c8-416c-8a6c-0b4e3fade9ed None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:01.194401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a40ba0-80c8-416c-8a6c-0b4e3fade9ed None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:01.194562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a40ba0-80c8-416c-8a6c-0b4e3fade9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:01.214056 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-96a40ba0-80c8-416c-8a6c-0b4e3fade9ed None None] MFA Rules not processed for user `a572e84b1e57481fa882845e927983ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:57:01.215289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-96a40ba0-80c8-416c-8a6c-0b4e3fade9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:57:01.222422 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4375/8644] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:57:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:57:07.634877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92856055-8144-4ef6-9187-c2d3672b5357 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:07.637832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-92856055-8144-4ef6-9187-c2d3672b5357 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:57:07.848388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92856055-8144-4ef6-9187-c2d3672b5357 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:07.858022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6265f77-deaf-4326-bee1-f845a25a6776 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:07.859025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6265f77-deaf-4326-bee1-f845a25a6776 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:07.859487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6265f77-deaf-4326-bee1-f845a25a6776 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:07.859936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6265f77-deaf-4326-bee1-f845a25a6776 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:07.862194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b6265f77-deaf-4326-bee1-f845a25a6776 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:57:07.895506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6265f77-deaf-4326-bee1-f845a25a6776 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:07.897099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6265f77-deaf-4326-bee1-f845a25a6776 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:07.941157 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4270/8645] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:57:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:57:09.596631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a40ba0-80c8-416c-8a6c-0b4e3fade9ed None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:09.598205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-96a40ba0-80c8-416c-8a6c-0b4e3fade9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:57:09.673295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a40ba0-80c8-416c-8a6c-0b4e3fade9ed None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:09.678347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c282df2-72e5-4846-8a36-8516674aaf01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:09.679425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c282df2-72e5-4846-8a36-8516674aaf01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:09.679787 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c282df2-72e5-4846-8a36-8516674aaf01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:09.680151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c282df2-72e5-4846-8a36-8516674aaf01 admin admin] PATH_INFO: `/v3/users/eee4c63b80eb407395e862126b73d6d9` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:09.682927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c282df2-72e5-4846-8a36-8516674aaf01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eee4c63b80eb407395e862126b73d6d9)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:09.685078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c282df2-72e5-4846-8a36-8516674aaf01 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:09.931328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8c282df2-72e5-4846-8a36-8516674aaf01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eee4c63b80eb407395e862126b73d6d9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:57:09.954771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8c282df2-72e5-4846-8a36-8516674aaf01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eee4c63b80eb407395e862126b73d6d9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:57:09.957672 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:57:09.963805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8c282df2-72e5-4846-8a36-8516674aaf01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eee4c63b80eb407395e862126b73d6d9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:57:09.972601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8c282df2-72e5-4846-8a36-8516674aaf01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eee4c63b80eb407395e862126b73d6d9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:57:10.056715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8c282df2-72e5-4846-8a36-8516674aaf01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eee4c63b80eb407395e862126b73d6d9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:57:10.063939 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4376/8646] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:57:09 2022] DELETE /identity/v3/users/eee4c63b80eb407395e862126b73d6d9 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:57:10.068603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17683b45-9766-40ae-9b32-5439b363d95b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:10.069132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17683b45-9766-40ae-9b32-5439b363d95b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:10.069404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17683b45-9766-40ae-9b32-5439b363d95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:10.087978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-17683b45-9766-40ae-9b32-5439b363d95b None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:57:10.089150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-17683b45-9766-40ae-9b32-5439b363d95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:57:10.161718 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4271/8647] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:57:10.173388 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c282df2-72e5-4846-8a36-8516674aaf01 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:10.176705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8c282df2-72e5-4846-8a36-8516674aaf01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:57:10.247672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c282df2-72e5-4846-8a36-8516674aaf01 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:10.252264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3c42d-4343-41d7-8b0b-17dfb788fe97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:10.253117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3c42d-4343-41d7-8b0b-17dfb788fe97 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:10.253478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3c42d-4343-41d7-8b0b-17dfb788fe97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:10.253830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3c42d-4343-41d7-8b0b-17dfb788fe97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:10.264794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3c42d-4343-41d7-8b0b-17dfb788fe97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:10.266520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3c42d-4343-41d7-8b0b-17dfb788fe97 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:10.277264 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4377/8648] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:57:10.640829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17683b45-9766-40ae-9b32-5439b363d95b None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:10.642386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-17683b45-9766-40ae-9b32-5439b363d95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:57:10.663037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17683b45-9766-40ae-9b32-5439b363d95b None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:10.669739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0103bf-b5be-46cd-a57b-3a7695f50d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:10.670803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0103bf-b5be-46cd-a57b-3a7695f50d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:10.671235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0103bf-b5be-46cd-a57b-3a7695f50d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:10.671617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0103bf-b5be-46cd-a57b-3a7695f50d38 admin admin] PATH_INFO: `/v3/projects/14099dd7e4f54b398e110ad2bd2c4f21` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:10.673792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0103bf-b5be-46cd-a57b-3a7695f50d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14099dd7e4f54b398e110ad2bd2c4f21)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:10.676052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0103bf-b5be-46cd-a57b-3a7695f50d38 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:10.836485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-db0103bf-b5be-46cd-a57b-3a7695f50d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14099dd7e4f54b398e110ad2bd2c4f21', 'request_id': 'req-db0103bf-b5be-46cd-a57b-3a7695f50d38'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:57:10.912113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-db0103bf-b5be-46cd-a57b-3a7695f50d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14099dd7e4f54b398e110ad2bd2c4f21', 'request_id': 'req-db0103bf-b5be-46cd-a57b-3a7695f50d38'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:57:10.918863 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-db0103bf-b5be-46cd-a57b-3a7695f50d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14099dd7e4f54b398e110ad2bd2c4f21', 'request_id': 'req-db0103bf-b5be-46cd-a57b-3a7695f50d38'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:57:10.933031 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:57:10.938545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-db0103bf-b5be-46cd-a57b-3a7695f50d38 admin admin] The token cache is being invalidate because project 14099dd7e4f54b398e110ad2bd2c4f21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:57:10.938865 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-db0103bf-b5be-46cd-a57b-3a7695f50d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:57:10.939549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-db0103bf-b5be-46cd-a57b-3a7695f50d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:57:10.941402 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4272/8649] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:57:10 2022] DELETE /identity/v3/projects/14099dd7e4f54b398e110ad2bd2c4f21 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:57:10.946604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3c42d-4343-41d7-8b0b-17dfb788fe97 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:10.959382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3c42d-4343-41d7-8b0b-17dfb788fe97 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:11.035400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20662fa-5340-45a8-840f-aee99d4577da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:11.035665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20662fa-5340-45a8-840f-aee99d4577da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:11.035951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20662fa-5340-45a8-840f-aee99d4577da admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:11.036292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20662fa-5340-45a8-840f-aee99d4577da admin admin] PATH_INFO: `/v3/users/a680d46b964e4e30bf5d50d60a9e5bf1` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:11.038419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20662fa-5340-45a8-840f-aee99d4577da admin admin] RBAC: Authorizing `identity:delete_user(user_id=a680d46b964e4e30bf5d50d60a9e5bf1)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:11.041867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20662fa-5340-45a8-840f-aee99d4577da admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:11.341206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c20662fa-5340-45a8-840f-aee99d4577da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a680d46b964e4e30bf5d50d60a9e5bf1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:57:11.356022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c20662fa-5340-45a8-840f-aee99d4577da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a680d46b964e4e30bf5d50d60a9e5bf1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:57:11.366371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c20662fa-5340-45a8-840f-aee99d4577da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a680d46b964e4e30bf5d50d60a9e5bf1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:57:11.367122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c20662fa-5340-45a8-840f-aee99d4577da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a680d46b964e4e30bf5d50d60a9e5bf1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:57:11.444130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c20662fa-5340-45a8-840f-aee99d4577da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a680d46b964e4e30bf5d50d60a9e5bf1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:57:11.452839 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4378/8650] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:57:10 2022] DELETE /identity/v3/users/a680d46b964e4e30bf5d50d60a9e5bf1 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:57:11.697446 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0103bf-b5be-46cd-a57b-3a7695f50d38 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:11.699508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-db0103bf-b5be-46cd-a57b-3a7695f50d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:57:11.718125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0103bf-b5be-46cd-a57b-3a7695f50d38 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:11.783257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db9e8f-2921-412d-9c78-b0893c18bc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:11.784077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db9e8f-2921-412d-9c78-b0893c18bc7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:11.784365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db9e8f-2921-412d-9c78-b0893c18bc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:11.784645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db9e8f-2921-412d-9c78-b0893c18bc7a admin admin] PATH_INFO: `/v3/projects/7ae1339993c34a6c92993165699f395b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:11.785887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db9e8f-2921-412d-9c78-b0893c18bc7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ae1339993c34a6c92993165699f395b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:11.787895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db9e8f-2921-412d-9c78-b0893c18bc7a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:11.922188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-91db9e8f-2921-412d-9c78-b0893c18bc7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ae1339993c34a6c92993165699f395b', 'request_id': 'req-91db9e8f-2921-412d-9c78-b0893c18bc7a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:57:12.039116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-91db9e8f-2921-412d-9c78-b0893c18bc7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ae1339993c34a6c92993165699f395b', 'request_id': 'req-91db9e8f-2921-412d-9c78-b0893c18bc7a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:57:12.047183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-91db9e8f-2921-412d-9c78-b0893c18bc7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ae1339993c34a6c92993165699f395b', 'request_id': 'req-91db9e8f-2921-412d-9c78-b0893c18bc7a'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:57:12.059583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-91db9e8f-2921-412d-9c78-b0893c18bc7a admin admin] The token cache is being invalidate because project 7ae1339993c34a6c92993165699f395b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:57:12.059944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-91db9e8f-2921-412d-9c78-b0893c18bc7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:57:12.060677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-91db9e8f-2921-412d-9c78-b0893c18bc7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:57:12.062792 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4273/8651] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:57:11 2022] DELETE /identity/v3/projects/7ae1339993c34a6c92993165699f395b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:57:12.068161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d6e37-6f47-425a-a81d-adc256e13188 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:12.068161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d6e37-6f47-425a-a81d-adc256e13188 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:12.070040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d6e37-6f47-425a-a81d-adc256e13188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:12.088428 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:57:12.096290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8b0d6e37-6f47-425a-a81d-adc256e13188 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:57:12.097634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8b0d6e37-6f47-425a-a81d-adc256e13188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:57:12.172665 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4379/8652] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:57:12.181308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c0f5b-7432-4482-9ad3-64e1fa966fc6 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:12.181308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c0f5b-7432-4482-9ad3-64e1fa966fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:12.181519 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c0f5b-7432-4482-9ad3-64e1fa966fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:12.210169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f67c0f5b-7432-4482-9ad3-64e1fa966fc6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:57:12.212230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f67c0f5b-7432-4482-9ad3-64e1fa966fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:57:12.226220 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4274/8653] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:57:12.231159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d6e37-6f47-425a-a81d-adc256e13188 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:12.246183 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d6e37-6f47-425a-a81d-adc256e13188 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:12.251045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ea319-fd82-4e50-ad28-ff6c7512e9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:12.251795 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ea319-fd82-4e50-ad28-ff6c7512e9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:12.252143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ea319-fd82-4e50-ad28-ff6c7512e9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:12.252563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ea319-fd82-4e50-ad28-ff6c7512e9c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:12.253397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ea319-fd82-4e50-ad28-ff6c7512e9c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:57:12.253766 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ea319-fd82-4e50-ad28-ff6c7512e9c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:12.256269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09ea319-fd82-4e50-ad28-ff6c7512e9c2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:12.271540 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4380/8654] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:57:12.278555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c0f5b-7432-4482-9ad3-64e1fa966fc6 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:12.288646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c0f5b-7432-4482-9ad3-64e1fa966fc6 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:12.294750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabd2b1-a64b-4ad4-82f8-28beb3a31566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:12.295363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabd2b1-a64b-4ad4-82f8-28beb3a31566 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:12.295756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabd2b1-a64b-4ad4-82f8-28beb3a31566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:12.296042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabd2b1-a64b-4ad4-82f8-28beb3a31566 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:12.296796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabd2b1-a64b-4ad4-82f8-28beb3a31566 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:12.298848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabd2b1-a64b-4ad4-82f8-28beb3a31566 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:12.397430 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4275/8655] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:57:12 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:57:12.403993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ea319-fd82-4e50-ad28-ff6c7512e9c2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:12.414040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ea319-fd82-4e50-ad28-ff6c7512e9c2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:12.479278 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec009aa-e3c4-4c27-a7da-af3eab7bc582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:12.479968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec009aa-e3c4-4c27-a7da-af3eab7bc582 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:12.480282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec009aa-e3c4-4c27-a7da-af3eab7bc582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:12.480625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec009aa-e3c4-4c27-a7da-af3eab7bc582 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:12.481350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec009aa-e3c4-4c27-a7da-af3eab7bc582 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:12.483329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec009aa-e3c4-4c27-a7da-af3eab7bc582 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:12.776911 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4381/8656] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:57:12 2022] POST /identity/v3/users => generated 294 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:57:12.781013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabd2b1-a64b-4ad4-82f8-28beb3a31566 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:12.791554 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabd2b1-a64b-4ad4-82f8-28beb3a31566 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:12.796621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742775f5-e158-44f4-8f0e-05944b34b0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:12.797373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742775f5-e158-44f4-8f0e-05944b34b0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:12.797659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742775f5-e158-44f4-8f0e-05944b34b0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:12.797937 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742775f5-e158-44f4-8f0e-05944b34b0b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:12.798711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742775f5-e158-44f4-8f0e-05944b34b0b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:12.800314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742775f5-e158-44f4-8f0e-05944b34b0b0 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:12.811914 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4276/8657] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:57:12.816166 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec009aa-e3c4-4c27-a7da-af3eab7bc582 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:12.828691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec009aa-e3c4-4c27-a7da-af3eab7bc582 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:12.834369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f128c278-7094-4813-99e4-2d89a8eb9879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:12.834656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128c278-7094-4813-99e4-2d89a8eb9879 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:12.834949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128c278-7094-4813-99e4-2d89a8eb9879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:12.835230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f128c278-7094-4813-99e4-2d89a8eb9879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:12.836078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128c278-7094-4813-99e4-2d89a8eb9879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:12.837564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f128c278-7094-4813-99e4-2d89a8eb9879 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:12.851294 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4382/8658] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:57:12.855957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742775f5-e158-44f4-8f0e-05944b34b0b0 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:12.869606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742775f5-e158-44f4-8f0e-05944b34b0b0 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:12.875629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2ff29-f028-4470-8ae3-77748eadd995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:12.876677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2ff29-f028-4470-8ae3-77748eadd995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:12.877035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2ff29-f028-4470-8ae3-77748eadd995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:12.877416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a2ff29-f028-4470-8ae3-77748eadd995 admin admin] PATH_INFO: `/v3/projects/5d68f454bc184686869e07a777c88bfd/users/c3425cdf552349dc90e5d449fde6107c/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:12.900411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2ff29-f028-4470-8ae3-77748eadd995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d68f454bc184686869e07a777c88bfd, user_id=c3425cdf552349dc90e5d449fde6107c, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:12.900411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a2ff29-f028-4470-8ae3-77748eadd995 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:13.039362 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4277/8659] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:57:12 2022] PUT /identity/v3/projects/5d68f454bc184686869e07a777c88bfd/users/c3425cdf552349dc90e5d449fde6107c/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:57:13.050759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d9b0a-c0ad-42a9-95a9-e1db72975331 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:13.051075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d9b0a-c0ad-42a9-95a9-e1db72975331 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:13.051358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3d9b0a-c0ad-42a9-95a9-e1db72975331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:13.083907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8f3d9b0a-c0ad-42a9-95a9-e1db72975331 None None] MFA Rules not processed for user `c3425cdf552349dc90e5d449fde6107c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:57:13.085144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8f3d9b0a-c0ad-42a9-95a9-e1db72975331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:57:13.157313 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4383/8660] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:57:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:57:13.162328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2ff29-f028-4470-8ae3-77748eadd995 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:13.197173 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:57:13.241649 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a2ff29-f028-4470-8ae3-77748eadd995 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:13.251459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabe3ca-30c5-4132-91f2-af164135a1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:13.267981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabe3ca-30c5-4132-91f2-af164135a1fb admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:13.267981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabe3ca-30c5-4132-91f2-af164135a1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:13.267981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabe3ca-30c5-4132-91f2-af164135a1fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:13.267981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccabe3ca-30c5-4132-91f2-af164135a1fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:13.267981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccabe3ca-30c5-4132-91f2-af164135a1fb admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:13.396089 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4278/8661] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:57:13 2022] POST /identity/v3/projects => generated 389 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:57:13.406468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d9b0a-c0ad-42a9-95a9-e1db72975331 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:13.406468 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:57:13.418537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3d9b0a-c0ad-42a9-95a9-e1db72975331 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:13.493111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f7c21-09a6-4015-8a7f-181e4f295551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:13.493871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f7c21-09a6-4015-8a7f-181e4f295551 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:13.494993 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f7c21-09a6-4015-8a7f-181e4f295551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:13.495294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f7c21-09a6-4015-8a7f-181e4f295551 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:13.496095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f7c21-09a6-4015-8a7f-181e4f295551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:13.498087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1f7c21-09a6-4015-8a7f-181e4f295551 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:13.631782 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4384/8662] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:57:13 2022] POST /identity/v3/users => generated 295 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:57:13.636422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabe3ca-30c5-4132-91f2-af164135a1fb admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:13.658148 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabe3ca-30c5-4132-91f2-af164135a1fb admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:13.661629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a58a39-1457-4b0a-a83e-91375e3c61f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:13.662480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a58a39-1457-4b0a-a83e-91375e3c61f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:13.662740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a58a39-1457-4b0a-a83e-91375e3c61f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:13.663070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a58a39-1457-4b0a-a83e-91375e3c61f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:13.667445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a58a39-1457-4b0a-a83e-91375e3c61f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:13.667445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a58a39-1457-4b0a-a83e-91375e3c61f1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:13.684481 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4279/8663] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:57:13.689898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f7c21-09a6-4015-8a7f-181e4f295551 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:13.698931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f7c21-09a6-4015-8a7f-181e4f295551 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:13.703915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc31fc8-844f-48f7-ae35-586efad1826c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:13.704615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc31fc8-844f-48f7-ae35-586efad1826c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:13.704900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc31fc8-844f-48f7-ae35-586efad1826c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:13.705176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc31fc8-844f-48f7-ae35-586efad1826c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:13.705913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc31fc8-844f-48f7-ae35-586efad1826c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:13.707900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc31fc8-844f-48f7-ae35-586efad1826c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:13.724897 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4385/8664] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:57:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:57:13.725733 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a58a39-1457-4b0a-a83e-91375e3c61f1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:13.737794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a58a39-1457-4b0a-a83e-91375e3c61f1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:13.743376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263ab5e-ac97-4213-8269-6c548613119c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:13.744462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263ab5e-ac97-4213-8269-6c548613119c admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:13.744768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263ab5e-ac97-4213-8269-6c548613119c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:13.745172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263ab5e-ac97-4213-8269-6c548613119c admin admin] PATH_INFO: `/v3/projects/ccf78f3fa14f46918f80c0862fc52adc/users/d12cd2b4b5364d7bbc351711dd2fd674/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:13.763568 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263ab5e-ac97-4213-8269-6c548613119c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccf78f3fa14f46918f80c0862fc52adc, user_id=d12cd2b4b5364d7bbc351711dd2fd674, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:13.766766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263ab5e-ac97-4213-8269-6c548613119c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:13.848822 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4280/8665] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:57:13 2022] PUT /identity/v3/projects/ccf78f3fa14f46918f80c0862fc52adc/users/d12cd2b4b5364d7bbc351711dd2fd674/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:57:13.859942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b5f99-057d-4afa-96f2-450a9e2b32dd None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:13.860251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b5f99-057d-4afa-96f2-450a9e2b32dd None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:13.860497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b5f99-057d-4afa-96f2-450a9e2b32dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:13.890054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8e6b5f99-057d-4afa-96f2-450a9e2b32dd None None] MFA Rules not processed for user `d12cd2b4b5364d7bbc351711dd2fd674`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:57:13.891573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8e6b5f99-057d-4afa-96f2-450a9e2b32dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:57:13.968419 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4386/8666] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:57:13 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:57:13.973805 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263ab5e-ac97-4213-8269-6c548613119c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:14.065493 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263ab5e-ac97-4213-8269-6c548613119c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:14.070373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed486fb-0f35-4ffd-88d2-9e3b4b2f207e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:14.071059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed486fb-0f35-4ffd-88d2-9e3b4b2f207e admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:14.074034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed486fb-0f35-4ffd-88d2-9e3b4b2f207e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:14.074034 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed486fb-0f35-4ffd-88d2-9e3b4b2f207e admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:14.074505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed486fb-0f35-4ffd-88d2-9e3b4b2f207e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:14.076595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed486fb-0f35-4ffd-88d2-9e3b4b2f207e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:14.228636 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4281/8667] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:57:13 2022] POST /identity/v3/projects => generated 385 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:57:14.233534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b5f99-057d-4afa-96f2-450a9e2b32dd None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:14.246669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b5f99-057d-4afa-96f2-450a9e2b32dd None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:14.316247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726e4d1-f4dd-486d-947d-3656f05557b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:14.316936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726e4d1-f4dd-486d-947d-3656f05557b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:14.317255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726e4d1-f4dd-486d-947d-3656f05557b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:14.317538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f726e4d1-f4dd-486d-947d-3656f05557b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:14.318292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726e4d1-f4dd-486d-947d-3656f05557b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:14.320389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f726e4d1-f4dd-486d-947d-3656f05557b1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:14.449539 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:57:14.457119 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4387/8668] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:57:14 2022] POST /identity/v3/users => generated 299 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:57:14.462306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed486fb-0f35-4ffd-88d2-9e3b4b2f207e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:14.475855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed486fb-0f35-4ffd-88d2-9e3b4b2f207e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:14.480961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b4ced-52f8-468c-851c-fa4eb2718b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:14.485397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b4ced-52f8-468c-851c-fa4eb2718b41 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:14.485397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b4ced-52f8-468c-851c-fa4eb2718b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:14.485397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b4ced-52f8-468c-851c-fa4eb2718b41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:14.485397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b4ced-52f8-468c-851c-fa4eb2718b41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:14.485397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b4ced-52f8-468c-851c-fa4eb2718b41 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:14.500346 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4282/8669] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:57:14.502161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726e4d1-f4dd-486d-947d-3656f05557b1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:14.516383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f726e4d1-f4dd-486d-947d-3656f05557b1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:14.521259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67586f-1b58-4844-a0f7-a30333abf6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:14.522373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67586f-1b58-4844-a0f7-a30333abf6d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:14.523026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67586f-1b58-4844-a0f7-a30333abf6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:14.523246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff67586f-1b58-4844-a0f7-a30333abf6d8 admin admin] PATH_INFO: `/v3/projects/9372b1e85ecd48c3bca90a7968446c05/users/7948138eec03473790a6f9fc3e59a8a4/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:14.542046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67586f-1b58-4844-a0f7-a30333abf6d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9372b1e85ecd48c3bca90a7968446c05, user_id=7948138eec03473790a6f9fc3e59a8a4, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:14.546287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff67586f-1b58-4844-a0f7-a30333abf6d8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:14.619100 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4388/8670] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:57:14 2022] PUT /identity/v3/projects/9372b1e85ecd48c3bca90a7968446c05/users/7948138eec03473790a6f9fc3e59a8a4/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:57:14.624815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b4ced-52f8-468c-851c-fa4eb2718b41 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:14.639861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b4ced-52f8-468c-851c-fa4eb2718b41 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:14.724304 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:57:14.737577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be42050-80f2-4e24-acc8-4841ecd6f341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:14.738378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be42050-80f2-4e24-acc8-4841ecd6f341 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:14.738684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be42050-80f2-4e24-acc8-4841ecd6f341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:14.738976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be42050-80f2-4e24-acc8-4841ecd6f341 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:14.739746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be42050-80f2-4e24-acc8-4841ecd6f341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:14.741507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be42050-80f2-4e24-acc8-4841ecd6f341 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:14.758321 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4283/8671] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 14:57:14.759213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67586f-1b58-4844-a0f7-a30333abf6d8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:14.772550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff67586f-1b58-4844-a0f7-a30333abf6d8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:14.778956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148bf54-3b8a-45d8-9461-fed1d43f8eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:14.780399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148bf54-3b8a-45d8-9461-fed1d43f8eea admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:14.780913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148bf54-3b8a-45d8-9461-fed1d43f8eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:14.781370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148bf54-3b8a-45d8-9461-fed1d43f8eea admin admin] PATH_INFO: `/v3/projects/9372b1e85ecd48c3bca90a7968446c05/users/7948138eec03473790a6f9fc3e59a8a4/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:14.784037 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148bf54-3b8a-45d8-9461-fed1d43f8eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9372b1e85ecd48c3bca90a7968446c05, user_id=7948138eec03473790a6f9fc3e59a8a4, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:14.787376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9148bf54-3b8a-45d8-9461-fed1d43f8eea admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:14.802446 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4389/8672] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:57:14 2022] PUT /identity/v3/projects/9372b1e85ecd48c3bca90a7968446c05/users/7948138eec03473790a6f9fc3e59a8a4/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:57:14.812892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96fcbc-fa8c-4f72-8ab2-de7656c7e1b2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:14.814899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96fcbc-fa8c-4f72-8ab2-de7656c7e1b2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:14.814899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96fcbc-fa8c-4f72-8ab2-de7656c7e1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:14.848701 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6b96fcbc-fa8c-4f72-8ab2-de7656c7e1b2 None None] MFA Rules not processed for user `7948138eec03473790a6f9fc3e59a8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:57:14.858435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6b96fcbc-fa8c-4f72-8ab2-de7656c7e1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:57:14.935615 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4284/8673] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:57:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:57:14.951710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148bf54-3b8a-45d8-9461-fed1d43f8eea admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:14.961511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9148bf54-3b8a-45d8-9461-fed1d43f8eea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:57:15.068718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148bf54-3b8a-45d8-9461-fed1d43f8eea admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:15.076538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb5236-da5f-4e72-b889-426a26e095a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:15.077354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb5236-da5f-4e72-b889-426a26e095a5 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:15.080409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb5236-da5f-4e72-b889-426a26e095a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:15.080409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb5236-da5f-4e72-b889-426a26e095a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:15.154157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb5236-da5f-4e72-b889-426a26e095a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:15.156449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbb5236-da5f-4e72-b889-426a26e095a5 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:15.168273 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4390/8674] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:57:14 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:57:18.804042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96fcbc-fa8c-4f72-8ab2-de7656c7e1b2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:57:18.805523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6b96fcbc-fa8c-4f72-8ab2-de7656c7e1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:57:18.873713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96fcbc-fa8c-4f72-8ab2-de7656c7e1b2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:57:18.878712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31819599-f79b-490b-9382-f53d534eaadb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:57:18.879867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31819599-f79b-490b-9382-f53d534eaadb service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:18.879867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31819599-f79b-490b-9382-f53d534eaadb service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:18.880125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31819599-f79b-490b-9382-f53d534eaadb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:18.894318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31819599-f79b-490b-9382-f53d534eaadb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:57:18.895952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31819599-f79b-490b-9382-f53d534eaadb service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:57:18.907198 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4285/8675] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:57:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:57:24.516534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45654e-67b8-4e62-8858-c147d909fcf7 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:57:24.516996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45654e-67b8-4e62-8858-c147d909fcf7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:57:24.517099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45654e-67b8-4e62-8858-c147d909fcf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:57:24.538511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7c45654e-67b8-4e62-8858-c147d909fcf7 None None] MFA Rules not processed for user `c3425cdf552349dc90e5d449fde6107c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:57:24.544274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7c45654e-67b8-4e62-8858-c147d909fcf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:57:24.564875 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4391/8676] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:57:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:57:28.902434 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=66 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:57:34.534122 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=74,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:58:19.390389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31819599-f79b-490b-9382-f53d534eaadb service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:19.392206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-31819599-f79b-490b-9382-f53d534eaadb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:19.513607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31819599-f79b-490b-9382-f53d534eaadb service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:19.524094 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ea058-6e66-46a8-b833-64b37190d2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:19.525402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ea058-6e66-46a8-b833-64b37190d2ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:19.526299 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ea058-6e66-46a8-b833-64b37190d2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:19.528057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ea058-6e66-46a8-b833-64b37190d2ff admin admin] PATH_INFO: `/v3/users/bb9d8515ff6441608c16619e530028d4` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:19.532751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ea058-6e66-46a8-b833-64b37190d2ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb9d8515ff6441608c16619e530028d4)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:19.536113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ea058-6e66-46a8-b833-64b37190d2ff admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:19.880815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1e4ea058-6e66-46a8-b833-64b37190d2ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb9d8515ff6441608c16619e530028d4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:58:19.901499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1e4ea058-6e66-46a8-b833-64b37190d2ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb9d8515ff6441608c16619e530028d4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:58:19.905164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1e4ea058-6e66-46a8-b833-64b37190d2ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb9d8515ff6441608c16619e530028d4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:58:19.907018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1e4ea058-6e66-46a8-b833-64b37190d2ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb9d8515ff6441608c16619e530028d4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:58:19.918038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-1e4ea058-6e66-46a8-b833-64b37190d2ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb9d8515ff6441608c16619e530028d4'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:58:20.042626 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4286/8677] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:58:19 2022] DELETE /identity/v3/users/bb9d8515ff6441608c16619e530028d4 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:58:20.047811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922f2c2-984b-4ad7-8f5e-7a9bb18c3ea5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:20.047811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922f2c2-984b-4ad7-8f5e-7a9bb18c3ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:20.048478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8922f2c2-984b-4ad7-8f5e-7a9bb18c3ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:20.074046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-8922f2c2-984b-4ad7-8f5e-7a9bb18c3ea5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:58:20.075643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8922f2c2-984b-4ad7-8f5e-7a9bb18c3ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:20.147633 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4392/8678] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:58:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:58:20.158806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ea058-6e66-46a8-b833-64b37190d2ff admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:20.160399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1e4ea058-6e66-46a8-b833-64b37190d2ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:20.287144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ea058-6e66-46a8-b833-64b37190d2ff admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:20.291356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b170c85-bf79-45fd-a4c7-87ffe4736412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:20.295537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b170c85-bf79-45fd-a4c7-87ffe4736412 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:20.295537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b170c85-bf79-45fd-a4c7-87ffe4736412 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:20.295537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b170c85-bf79-45fd-a4c7-87ffe4736412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:20.305270 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b170c85-bf79-45fd-a4c7-87ffe4736412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:20.306914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b170c85-bf79-45fd-a4c7-87ffe4736412 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:20.345166 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4287/8679] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:58:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 14:58:20.710286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922f2c2-984b-4ad7-8f5e-7a9bb18c3ea5 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:20.712935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8922f2c2-984b-4ad7-8f5e-7a9bb18c3ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:20.730346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8922f2c2-984b-4ad7-8f5e-7a9bb18c3ea5 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:20.736382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f26621e-18cc-4905-b073-4e723b3ca37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:20.737638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26621e-18cc-4905-b073-4e723b3ca37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:20.738275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26621e-18cc-4905-b073-4e723b3ca37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:20.738877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f26621e-18cc-4905-b073-4e723b3ca37d admin admin] PATH_INFO: `/v3/projects/f04dbc2f64b74c48a3c3f06f72a1cd43` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:20.741135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26621e-18cc-4905-b073-4e723b3ca37d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f04dbc2f64b74c48a3c3f06f72a1cd43)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:20.744710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f26621e-18cc-4905-b073-4e723b3ca37d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:20.923998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8f26621e-18cc-4905-b073-4e723b3ca37d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f04dbc2f64b74c48a3c3f06f72a1cd43', 'request_id': 'req-8f26621e-18cc-4905-b073-4e723b3ca37d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:58:20.931596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8f26621e-18cc-4905-b073-4e723b3ca37d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f04dbc2f64b74c48a3c3f06f72a1cd43', 'request_id': 'req-8f26621e-18cc-4905-b073-4e723b3ca37d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:58:20.944784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8f26621e-18cc-4905-b073-4e723b3ca37d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f04dbc2f64b74c48a3c3f06f72a1cd43', 'request_id': 'req-8f26621e-18cc-4905-b073-4e723b3ca37d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:58:21.205034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8f26621e-18cc-4905-b073-4e723b3ca37d admin admin] The token cache is being invalidate because project f04dbc2f64b74c48a3c3f06f72a1cd43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:58:21.205593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8f26621e-18cc-4905-b073-4e723b3ca37d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:58:21.212801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-8f26621e-18cc-4905-b073-4e723b3ca37d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:58:21.224472 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4393/8680] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:58:20 2022] DELETE /identity/v3/projects/f04dbc2f64b74c48a3c3f06f72a1cd43 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:58:21.230292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44c8a3-e6bb-4b8b-84c3-33f74dbf72fa None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:21.231143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44c8a3-e6bb-4b8b-84c3-33f74dbf72fa None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:21.231618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb44c8a3-e6bb-4b8b-84c3-33f74dbf72fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:21.297007 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-eb44c8a3-e6bb-4b8b-84c3-33f74dbf72fa None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:58:21.298119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eb44c8a3-e6bb-4b8b-84c3-33f74dbf72fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:21.351316 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:58:21.440642 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4288/8681] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:58:21.449652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8db1a5-dd23-4a5a-9014-cc252aeb70b9 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:21.449931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8db1a5-dd23-4a5a-9014-cc252aeb70b9 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:21.450289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8db1a5-dd23-4a5a-9014-cc252aeb70b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:21.483347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0e8db1a5-dd23-4a5a-9014-cc252aeb70b9 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:58:21.493952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0e8db1a5-dd23-4a5a-9014-cc252aeb70b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:21.507922 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4394/8682] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:58:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:58:21.513507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44c8a3-e6bb-4b8b-84c3-33f74dbf72fa None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:21.528924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb44c8a3-e6bb-4b8b-84c3-33f74dbf72fa None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:21.544661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710256fa-30eb-44f4-b488-21710bc8df8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:21.545374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710256fa-30eb-44f4-b488-21710bc8df8b admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:21.546030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710256fa-30eb-44f4-b488-21710bc8df8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:21.546501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710256fa-30eb-44f4-b488-21710bc8df8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:21.547450 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710256fa-30eb-44f4-b488-21710bc8df8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:58:21.547935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710256fa-30eb-44f4-b488-21710bc8df8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:21.549764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710256fa-30eb-44f4-b488-21710bc8df8b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:21.582646 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4289/8683] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 14:58:21.583657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8db1a5-dd23-4a5a-9014-cc252aeb70b9 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:21.598967 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8db1a5-dd23-4a5a-9014-cc252aeb70b9 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:21.617322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969af4da-f9e7-467c-80cd-0578d006b3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:21.619458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969af4da-f9e7-467c-80cd-0578d006b3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:21.619754 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969af4da-f9e7-467c-80cd-0578d006b3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:21.620029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969af4da-f9e7-467c-80cd-0578d006b3b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:21.629027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969af4da-f9e7-467c-80cd-0578d006b3b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:21.631072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969af4da-f9e7-467c-80cd-0578d006b3b2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:21.793885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710256fa-30eb-44f4-b488-21710bc8df8b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:21.794541 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4395/8684] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:58:21 2022] POST /identity/v3/projects => generated 371 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:58:21.820644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710256fa-30eb-44f4-b488-21710bc8df8b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:21.962673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28399db9-81c3-4d82-9a94-2ad5efd28060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:21.963235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28399db9-81c3-4d82-9a94-2ad5efd28060 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:21.963528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28399db9-81c3-4d82-9a94-2ad5efd28060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:21.963813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28399db9-81c3-4d82-9a94-2ad5efd28060 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:21.964986 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28399db9-81c3-4d82-9a94-2ad5efd28060 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:21.966995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28399db9-81c3-4d82-9a94-2ad5efd28060 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:22.077667 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4290/8685] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:58:21 2022] POST /identity/v3/users => generated 286 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:58:22.081794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969af4da-f9e7-467c-80cd-0578d006b3b2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:22.106514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969af4da-f9e7-467c-80cd-0578d006b3b2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:22.120288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43160e08-bf41-435c-8cf0-fd3191db1e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:22.122915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43160e08-bf41-435c-8cf0-fd3191db1e39 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:22.122915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43160e08-bf41-435c-8cf0-fd3191db1e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:22.122915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43160e08-bf41-435c-8cf0-fd3191db1e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:22.122915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43160e08-bf41-435c-8cf0-fd3191db1e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:22.127940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43160e08-bf41-435c-8cf0-fd3191db1e39 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:22.158092 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4396/8686] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:58:22.162350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28399db9-81c3-4d82-9a94-2ad5efd28060 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:22.180332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28399db9-81c3-4d82-9a94-2ad5efd28060 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:22.186877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258cf6fd-f9e8-4977-bbc8-8d85b5ce5f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:22.187683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cf6fd-f9e8-4977-bbc8-8d85b5ce5f45 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:22.188200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cf6fd-f9e8-4977-bbc8-8d85b5ce5f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:22.188561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258cf6fd-f9e8-4977-bbc8-8d85b5ce5f45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:22.190677 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cf6fd-f9e8-4977-bbc8-8d85b5ce5f45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:22.198598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258cf6fd-f9e8-4977-bbc8-8d85b5ce5f45 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:22.234222 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4291/8687] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:58:22 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:58:22.237999 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43160e08-bf41-435c-8cf0-fd3191db1e39 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:22.251266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43160e08-bf41-435c-8cf0-fd3191db1e39 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:22.257314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5014f-dfe2-4c7c-a1b6-ba4ee73b6e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:22.259225 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5014f-dfe2-4c7c-a1b6-ba4ee73b6e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:22.259636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5014f-dfe2-4c7c-a1b6-ba4ee73b6e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:22.260025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5014f-dfe2-4c7c-a1b6-ba4ee73b6e49 admin admin] PATH_INFO: `/v3/projects/64b378a03dfe490e90fed8b91a813fab/users/a16fcd34687d40ebbd3a06270d30d275/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:22.280610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5014f-dfe2-4c7c-a1b6-ba4ee73b6e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64b378a03dfe490e90fed8b91a813fab, user_id=a16fcd34687d40ebbd3a06270d30d275, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:22.283939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5014f-dfe2-4c7c-a1b6-ba4ee73b6e49 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:22.520434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324792ff-724e-490d-9e48-d92ce8173b2a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:22.521998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324792ff-724e-490d-9e48-d92ce8173b2a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:22.522534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324792ff-724e-490d-9e48-d92ce8173b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:22.522870 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4397/8688] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:58:22 2022] PUT /identity/v3/projects/64b378a03dfe490e90fed8b91a813fab/users/a16fcd34687d40ebbd3a06270d30d275/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:58:22.574902 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-324792ff-724e-490d-9e48-d92ce8173b2a None None] MFA Rules not processed for user `a16fcd34687d40ebbd3a06270d30d275`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:58:22.576150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-324792ff-724e-490d-9e48-d92ce8173b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:22.670400 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4292/8689] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:58:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:58:22.683454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5014f-dfe2-4c7c-a1b6-ba4ee73b6e49 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:22.685506 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-38f5014f-dfe2-4c7c-a1b6-ba4ee73b6e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:22.719170 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:58:22.775279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5014f-dfe2-4c7c-a1b6-ba4ee73b6e49 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:22.780883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19724b-342d-42f4-b33a-666b465f5ffe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:22.781668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19724b-342d-42f4-b33a-666b465f5ffe service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:22.781957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19724b-342d-42f4-b33a-666b465f5ffe service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:22.783089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19724b-342d-42f4-b33a-666b465f5ffe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:22.794910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19724b-342d-42f4-b33a-666b465f5ffe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:22.796591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19724b-342d-42f4-b33a-666b465f5ffe service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:22.809353 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4398/8690] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:58:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:58:22.837930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324792ff-724e-490d-9e48-d92ce8173b2a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:22.859672 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:58:22.957779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324792ff-724e-490d-9e48-d92ce8173b2a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:22.978589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22ba7c-4cc9-41d6-b12d-a8ee541e8756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:22.978589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22ba7c-4cc9-41d6-b12d-a8ee541e8756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:22.978589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22ba7c-4cc9-41d6-b12d-a8ee541e8756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:22.978589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc22ba7c-4cc9-41d6-b12d-a8ee541e8756 admin admin] PATH_INFO: `/v3/users/a16fcd34687d40ebbd3a06270d30d275` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:22.983312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22ba7c-4cc9-41d6-b12d-a8ee541e8756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a16fcd34687d40ebbd3a06270d30d275)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:22.985402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc22ba7c-4cc9-41d6-b12d-a8ee541e8756 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:23.240335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fc22ba7c-4cc9-41d6-b12d-a8ee541e8756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a16fcd34687d40ebbd3a06270d30d275'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:58:23.258355 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fc22ba7c-4cc9-41d6-b12d-a8ee541e8756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a16fcd34687d40ebbd3a06270d30d275'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:58:23.259449 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fc22ba7c-4cc9-41d6-b12d-a8ee541e8756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a16fcd34687d40ebbd3a06270d30d275'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:58:23.260271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fc22ba7c-4cc9-41d6-b12d-a8ee541e8756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a16fcd34687d40ebbd3a06270d30d275'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:58:23.277992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fc22ba7c-4cc9-41d6-b12d-a8ee541e8756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a16fcd34687d40ebbd3a06270d30d275'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:58:23.400802 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4293/8691] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:58:22 2022] DELETE /identity/v3/users/a16fcd34687d40ebbd3a06270d30d275 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:58:23.405623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771122a-edb9-4555-b903-d0ed68a78e54 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:23.406137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771122a-edb9-4555-b903-d0ed68a78e54 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:23.406263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771122a-edb9-4555-b903-d0ed68a78e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:23.428282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-f771122a-edb9-4555-b903-d0ed68a78e54 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:58:23.431427 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f771122a-edb9-4555-b903-d0ed68a78e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:23.513707 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4399/8692] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:58:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:58:23.525267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22ba7c-4cc9-41d6-b12d-a8ee541e8756 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:23.526914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fc22ba7c-4cc9-41d6-b12d-a8ee541e8756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:23.603203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc22ba7c-4cc9-41d6-b12d-a8ee541e8756 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:23.607231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d880f63-cae6-4c0d-b35a-88d2a9a3b31f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:23.609490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d880f63-cae6-4c0d-b35a-88d2a9a3b31f service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:23.609490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d880f63-cae6-4c0d-b35a-88d2a9a3b31f service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:23.609490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d880f63-cae6-4c0d-b35a-88d2a9a3b31f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:23.620736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d880f63-cae6-4c0d-b35a-88d2a9a3b31f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:23.622351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d880f63-cae6-4c0d-b35a-88d2a9a3b31f service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:23.634702 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4294/8693] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:58:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:58:24.011539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771122a-edb9-4555-b903-d0ed68a78e54 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:24.013670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f771122a-edb9-4555-b903-d0ed68a78e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:24.103950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771122a-edb9-4555-b903-d0ed68a78e54 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:24.111896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae487c11-0809-43a7-988d-71c95e8c4f6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:24.111896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae487c11-0809-43a7-988d-71c95e8c4f6b service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:24.111896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae487c11-0809-43a7-988d-71c95e8c4f6b service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:24.111896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae487c11-0809-43a7-988d-71c95e8c4f6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:24.112480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ae487c11-0809-43a7-988d-71c95e8c4f6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:24.145282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea894c-87f4-4382-8972-11d9eeb7f868 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:24.146696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea894c-87f4-4382-8972-11d9eeb7f868 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:24.147080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea894c-87f4-4382-8972-11d9eeb7f868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:24.188253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0aea894c-87f4-4382-8972-11d9eeb7f868 None None] MFA Rules not processed for user `c3425cdf552349dc90e5d449fde6107c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:58:24.189680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0aea894c-87f4-4382-8972-11d9eeb7f868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:24.230211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae487c11-0809-43a7-988d-71c95e8c4f6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:24.232627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae487c11-0809-43a7-988d-71c95e8c4f6b service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:24.237322 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:58:24.255030 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4400/8694] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:58:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:58:24.277240 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4295/8695] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:58:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:58:24.498320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae487c11-0809-43a7-988d-71c95e8c4f6b service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:24.500396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ae487c11-0809-43a7-988d-71c95e8c4f6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:24.522123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae487c11-0809-43a7-988d-71c95e8c4f6b service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:24.540999 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf50d2b-f2b6-49d5-ba87-679a3a76021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:24.542236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf50d2b-f2b6-49d5-ba87-679a3a76021d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:24.543924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf50d2b-f2b6-49d5-ba87-679a3a76021d admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:24.544194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf50d2b-f2b6-49d5-ba87-679a3a76021d admin admin] PATH_INFO: `/v3/projects/64b378a03dfe490e90fed8b91a813fab` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:24.546256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf50d2b-f2b6-49d5-ba87-679a3a76021d admin admin] RBAC: Authorizing `identity:delete_project(project_id=64b378a03dfe490e90fed8b91a813fab)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:24.548569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf50d2b-f2b6-49d5-ba87-679a3a76021d admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:24.568531 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:58:24.775198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-caf50d2b-f2b6-49d5-ba87-679a3a76021d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64b378a03dfe490e90fed8b91a813fab', 'request_id': 'req-caf50d2b-f2b6-49d5-ba87-679a3a76021d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:58:24.787977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-caf50d2b-f2b6-49d5-ba87-679a3a76021d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64b378a03dfe490e90fed8b91a813fab', 'request_id': 'req-caf50d2b-f2b6-49d5-ba87-679a3a76021d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:58:24.823497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-caf50d2b-f2b6-49d5-ba87-679a3a76021d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64b378a03dfe490e90fed8b91a813fab', 'request_id': 'req-caf50d2b-f2b6-49d5-ba87-679a3a76021d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:58:24.999914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-caf50d2b-f2b6-49d5-ba87-679a3a76021d admin admin] The token cache is being invalidate because project 64b378a03dfe490e90fed8b91a813fab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:58:25.002478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-caf50d2b-f2b6-49d5-ba87-679a3a76021d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:58:25.003627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-caf50d2b-f2b6-49d5-ba87-679a3a76021d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:58:25.015454 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4401/8696] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:58:24 2022] DELETE /identity/v3/projects/64b378a03dfe490e90fed8b91a813fab => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:58:25.021233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d96c8-b28d-4d00-96e8-c1881a7637dd None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:25.021748 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d96c8-b28d-4d00-96e8-c1881a7637dd None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:25.022073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d96c8-b28d-4d00-96e8-c1881a7637dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:25.051557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4a3d96c8-b28d-4d00-96e8-c1881a7637dd None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:58:25.056901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4a3d96c8-b28d-4d00-96e8-c1881a7637dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:25.160817 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4296/8697] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:58:25.162656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c2631-ae34-4bb3-846d-11364734b902 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:25.162951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c2631-ae34-4bb3-846d-11364734b902 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:25.163240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c2631-ae34-4bb3-846d-11364734b902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:25.197926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7a2c2631-ae34-4bb3-846d-11364734b902 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:58:25.199566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7a2c2631-ae34-4bb3-846d-11364734b902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:25.213196 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4402/8698] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:58:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:58:25.217515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d96c8-b28d-4d00-96e8-c1881a7637dd None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:25.228006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d96c8-b28d-4d00-96e8-c1881a7637dd None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:25.232737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e333a60-0d91-48c1-9d69-fc70bbbe180a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:25.233402 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e333a60-0d91-48c1-9d69-fc70bbbe180a admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:25.233688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e333a60-0d91-48c1-9d69-fc70bbbe180a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:25.233969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e333a60-0d91-48c1-9d69-fc70bbbe180a admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:25.234744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e333a60-0d91-48c1-9d69-fc70bbbe180a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 14:58:25.235057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e333a60-0d91-48c1-9d69-fc70bbbe180a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:25.236731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e333a60-0d91-48c1-9d69-fc70bbbe180a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:25.253464 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4297/8699] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 14:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 14:58:25.254678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c2631-ae34-4bb3-846d-11364734b902 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:25.280809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c2631-ae34-4bb3-846d-11364734b902 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:25.286736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba37f1-bd18-4968-9d3c-21c4d6057972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:25.287548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba37f1-bd18-4968-9d3c-21c4d6057972 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:25.287939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba37f1-bd18-4968-9d3c-21c4d6057972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:25.288291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba37f1-bd18-4968-9d3c-21c4d6057972 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:25.289201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba37f1-bd18-4968-9d3c-21c4d6057972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:25.291464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba37f1-bd18-4968-9d3c-21c4d6057972 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:25.460188 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4403/8700] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:58:25 2022] POST /identity/v3/projects => generated 371 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:58:25.464204 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e333a60-0d91-48c1-9d69-fc70bbbe180a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:25.475172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e333a60-0d91-48c1-9d69-fc70bbbe180a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:25.544571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616e3d1-7078-46a9-b47c-3710892504d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:25.544571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616e3d1-7078-46a9-b47c-3710892504d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:25.544571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616e3d1-7078-46a9-b47c-3710892504d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:25.544571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616e3d1-7078-46a9-b47c-3710892504d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:25.545124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616e3d1-7078-46a9-b47c-3710892504d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:25.545124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616e3d1-7078-46a9-b47c-3710892504d5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:25.720489 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4298/8701] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:58:25 2022] POST /identity/v3/users => generated 286 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:58:25.724417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba37f1-bd18-4968-9d3c-21c4d6057972 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:25.739016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba37f1-bd18-4968-9d3c-21c4d6057972 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:25.757159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978cf60-833f-4ee1-95e4-3682aefc551e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:25.758653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978cf60-833f-4ee1-95e4-3682aefc551e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:25.758868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978cf60-833f-4ee1-95e4-3682aefc551e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:25.759215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978cf60-833f-4ee1-95e4-3682aefc551e admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:25.759799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978cf60-833f-4ee1-95e4-3682aefc551e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:25.761458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978cf60-833f-4ee1-95e4-3682aefc551e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:25.808115 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4404/8702] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:58:25.809445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616e3d1-7078-46a9-b47c-3710892504d5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:25.820314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616e3d1-7078-46a9-b47c-3710892504d5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:25.826262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c2d23b-2684-4ac9-93ac-23b909d957d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:25.827090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2d23b-2684-4ac9-93ac-23b909d957d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:25.827316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2d23b-2684-4ac9-93ac-23b909d957d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:25.828070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2d23b-2684-4ac9-93ac-23b909d957d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:25.829228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2d23b-2684-4ac9-93ac-23b909d957d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:25.831189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c2d23b-2684-4ac9-93ac-23b909d957d1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:25.846656 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4299/8703] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:58:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:58:25.851207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978cf60-833f-4ee1-95e4-3682aefc551e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:25.862758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978cf60-833f-4ee1-95e4-3682aefc551e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:25.868343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5a530-4816-43c2-9cc9-e9fe55c79fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:25.870801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5a530-4816-43c2-9cc9-e9fe55c79fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:25.870801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5a530-4816-43c2-9cc9-e9fe55c79fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:25.870801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e5a530-4816-43c2-9cc9-e9fe55c79fa3 admin admin] PATH_INFO: `/v3/projects/8bddf0796be14b7f9d58192d290a19bb/users/76ebe1229e114a1399e84b48718224da/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:25.888087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5a530-4816-43c2-9cc9-e9fe55c79fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bddf0796be14b7f9d58192d290a19bb, user_id=76ebe1229e114a1399e84b48718224da, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:25.893871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e5a530-4816-43c2-9cc9-e9fe55c79fa3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:26.041642 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4405/8704] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:58:25 2022] PUT /identity/v3/projects/8bddf0796be14b7f9d58192d290a19bb/users/76ebe1229e114a1399e84b48718224da/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:58:26.046923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e15eab-19ee-4e2f-afa6-49f3d70d3b80 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:26.047226 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e15eab-19ee-4e2f-afa6-49f3d70d3b80 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:26.047508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e15eab-19ee-4e2f-afa6-49f3d70d3b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:26.066227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a4e15eab-19ee-4e2f-afa6-49f3d70d3b80 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:58:26.067361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a4e15eab-19ee-4e2f-afa6-49f3d70d3b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:26.146669 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:58:26.176730 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4300/8705] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:58:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:58:26.187348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5a530-4816-43c2-9cc9-e9fe55c79fa3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:26.189171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-09e5a530-4816-43c2-9cc9-e9fe55c79fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:26.294498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e5a530-4816-43c2-9cc9-e9fe55c79fa3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:26.298571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae30b08-7f56-4931-9b41-35666390bc21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:26.299249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae30b08-7f56-4931-9b41-35666390bc21 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:26.299539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae30b08-7f56-4931-9b41-35666390bc21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:26.299821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae30b08-7f56-4931-9b41-35666390bc21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:26.315509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae30b08-7f56-4931-9b41-35666390bc21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:26.317039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae30b08-7f56-4931-9b41-35666390bc21 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:26.330163 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4406/8706] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:58:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:58:34.685329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca14f-c84c-4502-bc15-7d424fd8eead None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:34.685885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca14f-c84c-4502-bc15-7d424fd8eead None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:34.685982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9ca14f-c84c-4502-bc15-7d424fd8eead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:34.734081 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1e9ca14f-c84c-4502-bc15-7d424fd8eead None None] MFA Rules not processed for user `76ebe1229e114a1399e84b48718224da`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:58:34.739798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1e9ca14f-c84c-4502-bc15-7d424fd8eead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:34.819766 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4301/8707] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:58:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:58:34.824175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae30b08-7f56-4931-9b41-35666390bc21 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:34.836415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae30b08-7f56-4931-9b41-35666390bc21 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:34.842354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9b4b7-7c6e-42bd-916d-8e470a8f547a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:34.843685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9b4b7-7c6e-42bd-916d-8e470a8f547a admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:34.844137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9b4b7-7c6e-42bd-916d-8e470a8f547a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:34.844612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b9b4b7-7c6e-42bd-916d-8e470a8f547a admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:34.845505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9b4b7-7c6e-42bd-916d-8e470a8f547a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:34.848294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b9b4b7-7c6e-42bd-916d-8e470a8f547a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:34.975128 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4407/8708] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 14:58:34 2022] POST /identity/v3/projects => generated 371 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 14:58:34.979884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ca14f-c84c-4502-bc15-7d424fd8eead None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:34.992218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9ca14f-c84c-4502-bc15-7d424fd8eead None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:35.057734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd62a0-7355-415a-add5-992674cb2853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:35.058490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd62a0-7355-415a-add5-992674cb2853 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:35.058777 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd62a0-7355-415a-add5-992674cb2853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:35.059064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd62a0-7355-415a-add5-992674cb2853 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:35.059802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd62a0-7355-415a-add5-992674cb2853 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:35.061833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd62a0-7355-415a-add5-992674cb2853 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:35.167065 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4302/8709] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 14:58:34 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 14:58:35.171139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9b4b7-7c6e-42bd-916d-8e470a8f547a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:35.184564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b9b4b7-7c6e-42bd-916d-8e470a8f547a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:35.190338 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719af13-4306-4193-8b6b-35c5fbe4435b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:35.191771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719af13-4306-4193-8b6b-35c5fbe4435b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:35.192296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719af13-4306-4193-8b6b-35c5fbe4435b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:35.193185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719af13-4306-4193-8b6b-35c5fbe4435b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:35.194198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719af13-4306-4193-8b6b-35c5fbe4435b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:35.197501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719af13-4306-4193-8b6b-35c5fbe4435b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:35.219484 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4408/8710] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:58:35.223499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd62a0-7355-415a-add5-992674cb2853 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:35.235927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd62a0-7355-415a-add5-992674cb2853 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:35.240850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b947fcd-a6ca-4d62-8534-e98039e2be31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:35.241895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b947fcd-a6ca-4d62-8534-e98039e2be31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:35.242463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b947fcd-a6ca-4d62-8534-e98039e2be31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:35.242826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b947fcd-a6ca-4d62-8534-e98039e2be31 admin admin] PATH_INFO: `/v3/projects/068d7ad085c84e96ac6c596358a93cd0/users/bb2c690abfa848018f42ed8f67d9b618/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:35.262753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b947fcd-a6ca-4d62-8534-e98039e2be31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=068d7ad085c84e96ac6c596358a93cd0, user_id=bb2c690abfa848018f42ed8f67d9b618, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:35.265539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b947fcd-a6ca-4d62-8534-e98039e2be31 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:35.368342 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4303/8711] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:58:35 2022] PUT /identity/v3/projects/068d7ad085c84e96ac6c596358a93cd0/users/bb2c690abfa848018f42ed8f67d9b618/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:58:35.372367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719af13-4306-4193-8b6b-35c5fbe4435b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:35.384954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719af13-4306-4193-8b6b-35c5fbe4435b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:35.389836 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:58:35.453544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c126bc4e-8e35-4743-a24a-3323cb6ccc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:35.454252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126bc4e-8e35-4743-a24a-3323cb6ccc12 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:35.454541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126bc4e-8e35-4743-a24a-3323cb6ccc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:35.454820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c126bc4e-8e35-4743-a24a-3323cb6ccc12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:35.456662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126bc4e-8e35-4743-a24a-3323cb6ccc12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:35.457143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c126bc4e-8e35-4743-a24a-3323cb6ccc12 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:35.470080 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4409/8712] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 14:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 14:58:35.474005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b947fcd-a6ca-4d62-8534-e98039e2be31 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:35.485560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b947fcd-a6ca-4d62-8534-e98039e2be31 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:35.490917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86970e68-e347-4230-b3be-2b31b1bcee47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:35.491909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86970e68-e347-4230-b3be-2b31b1bcee47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:35.493681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86970e68-e347-4230-b3be-2b31b1bcee47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:35.494129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86970e68-e347-4230-b3be-2b31b1bcee47 admin admin] PATH_INFO: `/v3/projects/068d7ad085c84e96ac6c596358a93cd0/users/bb2c690abfa848018f42ed8f67d9b618/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:35.496760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86970e68-e347-4230-b3be-2b31b1bcee47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=068d7ad085c84e96ac6c596358a93cd0, user_id=bb2c690abfa848018f42ed8f67d9b618, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:35.499647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86970e68-e347-4230-b3be-2b31b1bcee47 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:35.515734 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4304/8713] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 14:58:35 2022] PUT /identity/v3/projects/068d7ad085c84e96ac6c596358a93cd0/users/bb2c690abfa848018f42ed8f67d9b618/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:58:36.779882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a37d87-3260-4767-855d-4c1dddcced8a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:36.780433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a37d87-3260-4767-855d-4c1dddcced8a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:36.780433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a37d87-3260-4767-855d-4c1dddcced8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:36.811820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b7a37d87-3260-4767-855d-4c1dddcced8a None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:58:36.813505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b7a37d87-3260-4767-855d-4c1dddcced8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:36.881553 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4410/8714] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 14:58:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:58:37.097882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86970e68-e347-4230-b3be-2b31b1bcee47 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:37.099798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-86970e68-e347-4230-b3be-2b31b1bcee47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:37.184850 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:58:37.252537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86970e68-e347-4230-b3be-2b31b1bcee47 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:37.258381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5640ad-caa4-4258-945c-cebe43fc268a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:37.259388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5640ad-caa4-4258-945c-cebe43fc268a service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:37.259825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5640ad-caa4-4258-945c-cebe43fc268a service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:37.260265 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5640ad-caa4-4258-945c-cebe43fc268a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:37.270473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5640ad-caa4-4258-945c-cebe43fc268a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:37.272181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5640ad-caa4-4258-945c-cebe43fc268a service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:37.283123 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4305/8715] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 14:58:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 14:58:41.037650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a37d87-3260-4767-855d-4c1dddcced8a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:41.140022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a37d87-3260-4767-855d-4c1dddcced8a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:41.152794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf8dc5-26d7-4dff-ab85-8957e7935d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:41.153828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf8dc5-26d7-4dff-ab85-8957e7935d54 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:41.154315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf8dc5-26d7-4dff-ab85-8957e7935d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:41.154760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf8dc5-26d7-4dff-ab85-8957e7935d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:41.158065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-34bf8dc5-26d7-4dff-ab85-8957e7935d54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:41.175963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf8dc5-26d7-4dff-ab85-8957e7935d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:41.177699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf8dc5-26d7-4dff-ab85-8957e7935d54 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:41.197804 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4411/8716] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:58:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:58:43.270369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba3f88-1b74-4f1c-8ca8-1085e68a15f4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:43.271396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba3f88-1b74-4f1c-8ca8-1085e68a15f4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:43.275247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba3f88-1b74-4f1c-8ca8-1085e68a15f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:43.340637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-49ba3f88-1b74-4f1c-8ca8-1085e68a15f4 None None] MFA Rules not processed for user `bb2c690abfa848018f42ed8f67d9b618`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:58:43.342053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-49ba3f88-1b74-4f1c-8ca8-1085e68a15f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:43.466413 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4306/8717] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:58:43 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:58:43.481364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf8dc5-26d7-4dff-ab85-8957e7935d54 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:43.482957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-34bf8dc5-26d7-4dff-ab85-8957e7935d54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:43.551051 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=100 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:58:43.580093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf8dc5-26d7-4dff-ab85-8957e7935d54 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:43.589104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac21a3-878f-40ef-98bd-7d0f3ac2cca3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:43.590261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac21a3-878f-40ef-98bd-7d0f3ac2cca3 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:43.590903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac21a3-878f-40ef-98bd-7d0f3ac2cca3 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:43.591298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac21a3-878f-40ef-98bd-7d0f3ac2cca3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:43.686469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac21a3-878f-40ef-98bd-7d0f3ac2cca3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:43.689597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac21a3-878f-40ef-98bd-7d0f3ac2cca3 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:43.700614 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4412/8718] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:58:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:58:46.873550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b5cf7-2edf-47a6-9481-8edeacc69911 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:46.874062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b5cf7-2edf-47a6-9481-8edeacc69911 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:46.874193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b5cf7-2edf-47a6-9481-8edeacc69911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:46.923403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-794b5cf7-2edf-47a6-9481-8edeacc69911 None None] MFA Rules not processed for user `76ebe1229e114a1399e84b48718224da`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:58:46.924610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-794b5cf7-2edf-47a6-9481-8edeacc69911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:46.959533 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4307/8719] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:58:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 14:58:47.902206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac21a3-878f-40ef-98bd-7d0f3ac2cca3 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:47.903321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1aac21a3-878f-40ef-98bd-7d0f3ac2cca3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:47.926075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac21a3-878f-40ef-98bd-7d0f3ac2cca3 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:47.932024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a7b38-c3aa-430c-be93-fb0cc65de310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:47.932950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a7b38-c3aa-430c-be93-fb0cc65de310 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:47.933559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a7b38-c3aa-430c-be93-fb0cc65de310 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:47.934522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a7b38-c3aa-430c-be93-fb0cc65de310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:47.938143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e65a7b38-c3aa-430c-be93-fb0cc65de310 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:47.957291 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a7b38-c3aa-430c-be93-fb0cc65de310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:47.959076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a7b38-c3aa-430c-be93-fb0cc65de310 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:47.986728 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4413/8720] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:58:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:58:48.547374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b5cf7-2edf-47a6-9481-8edeacc69911 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:58:48.549646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-794b5cf7-2edf-47a6-9481-8edeacc69911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:48.716648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b5cf7-2edf-47a6-9481-8edeacc69911 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:58:48.730774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9910c20-b402-4f28-9042-843b157e78e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:58:48.731043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9910c20-b402-4f28-9042-843b157e78e6 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:58:48.731276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9910c20-b402-4f28-9042-843b157e78e6 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:58:48.732397 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9910c20-b402-4f28-9042-843b157e78e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:58:48.742534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d9910c20-b402-4f28-9042-843b157e78e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:58:48.776418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9910c20-b402-4f28-9042-843b157e78e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:58:48.778280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9910c20-b402-4f28-9042-843b157e78e6 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:58:48.802189 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4308/8721] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:58:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:58:57.975455 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=39 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:58:58.791015 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=86 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:59:00.529297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a7b38-c3aa-430c-be93-fb0cc65de310 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:59:00.531777 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e65a7b38-c3aa-430c-be93-fb0cc65de310 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:00.551370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a7b38-c3aa-430c-be93-fb0cc65de310 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:59:00.557978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdd324f-bd63-42d1-89bd-4b7b82335c5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:59:00.558742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd324f-bd63-42d1-89bd-4b7b82335c5a service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:59:00.559039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd324f-bd63-42d1-89bd-4b7b82335c5a service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:59:00.559324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdd324f-bd63-42d1-89bd-4b7b82335c5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:59:00.561234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fcdd324f-bd63-42d1-89bd-4b7b82335c5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:00.579140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd324f-bd63-42d1-89bd-4b7b82335c5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:59:00.580864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdd324f-bd63-42d1-89bd-4b7b82335c5a service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:59:00.596900 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4414/8722] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:59:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:59:00.820108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9910c20-b402-4f28-9042-843b157e78e6 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:59:00.822087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d9910c20-b402-4f28-9042-843b157e78e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:00.896571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9910c20-b402-4f28-9042-843b157e78e6 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:59:00.901483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7e71d-4c67-4c61-9069-d5d3f5d73601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:59:00.902404 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7e71d-4c67-4c61-9069-d5d3f5d73601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:59:00.902688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7e71d-4c67-4c61-9069-d5d3f5d73601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:59:00.902964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7e71d-4c67-4c61-9069-d5d3f5d73601 admin admin] PATH_INFO: `/v3/users/c3425cdf552349dc90e5d449fde6107c` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:59:00.904159 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7e71d-4c67-4c61-9069-d5d3f5d73601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3425cdf552349dc90e5d449fde6107c)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:59:00.906222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da7e71d-4c67-4c61-9069-d5d3f5d73601 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:59:01.122950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7da7e71d-4c67-4c61-9069-d5d3f5d73601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3425cdf552349dc90e5d449fde6107c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:01.137574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7da7e71d-4c67-4c61-9069-d5d3f5d73601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3425cdf552349dc90e5d449fde6107c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:01.137753 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7da7e71d-4c67-4c61-9069-d5d3f5d73601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3425cdf552349dc90e5d449fde6107c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:01.138401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7da7e71d-4c67-4c61-9069-d5d3f5d73601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3425cdf552349dc90e5d449fde6107c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:01.147352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-7da7e71d-4c67-4c61-9069-d5d3f5d73601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3425cdf552349dc90e5d449fde6107c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:01.239422 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4309/8723] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:59:00 2022] DELETE /identity/v3/users/c3425cdf552349dc90e5d449fde6107c => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:59:01.243857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e925be5-6374-45d3-a658-24a960bf5526 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:59:01.244149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e925be5-6374-45d3-a658-24a960bf5526 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:59:01.244429 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e925be5-6374-45d3-a658-24a960bf5526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:59:01.265406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0e925be5-6374-45d3-a658-24a960bf5526 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:59:01.267190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0e925be5-6374-45d3-a658-24a960bf5526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:01.345150 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4415/8724] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:59:01.355637 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7e71d-4c67-4c61-9069-d5d3f5d73601 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:59:01.357030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7da7e71d-4c67-4c61-9069-d5d3f5d73601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:01.420808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7e71d-4c67-4c61-9069-d5d3f5d73601 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:59:01.424607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccee53-046d-41d2-a798-bb10b1c58b6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:59:01.425302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccee53-046d-41d2-a798-bb10b1c58b6d service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:59:01.425616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccee53-046d-41d2-a798-bb10b1c58b6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:59:01.425898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dccee53-046d-41d2-a798-bb10b1c58b6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:59:01.435943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dccee53-046d-41d2-a798-bb10b1c58b6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:59:01.437346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dccee53-046d-41d2-a798-bb10b1c58b6d service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:59:01.447974 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4310/8725] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:59:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:59:01.733677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e925be5-6374-45d3-a658-24a960bf5526 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:59:01.735980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0e925be5-6374-45d3-a658-24a960bf5526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:01.754546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e925be5-6374-45d3-a658-24a960bf5526 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:59:01.760048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfcdea-1010-4fc2-948d-c8da1b7d0157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:59:01.761184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfcdea-1010-4fc2-948d-c8da1b7d0157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:59:01.761478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfcdea-1010-4fc2-948d-c8da1b7d0157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:59:01.761755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfcdea-1010-4fc2-948d-c8da1b7d0157 admin admin] PATH_INFO: `/v3/projects/5d68f454bc184686869e07a777c88bfd` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:59:01.763176 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfcdea-1010-4fc2-948d-c8da1b7d0157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d68f454bc184686869e07a777c88bfd)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:59:01.765149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfcdea-1010-4fc2-948d-c8da1b7d0157 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:59:01.890001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-55bfcdea-1010-4fc2-948d-c8da1b7d0157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d68f454bc184686869e07a777c88bfd', 'request_id': 'req-55bfcdea-1010-4fc2-948d-c8da1b7d0157'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:01.898579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-55bfcdea-1010-4fc2-948d-c8da1b7d0157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d68f454bc184686869e07a777c88bfd', 'request_id': 'req-55bfcdea-1010-4fc2-948d-c8da1b7d0157'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:01.905267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-55bfcdea-1010-4fc2-948d-c8da1b7d0157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d68f454bc184686869e07a777c88bfd', 'request_id': 'req-55bfcdea-1010-4fc2-948d-c8da1b7d0157'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:01.984154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccee53-046d-41d2-a798-bb10b1c58b6d service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:59:01.985705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3dccee53-046d-41d2-a798-bb10b1c58b6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:01.988422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-55bfcdea-1010-4fc2-948d-c8da1b7d0157 admin admin] The token cache is being invalidate because project 5d68f454bc184686869e07a777c88bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:59:01.988726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-55bfcdea-1010-4fc2-948d-c8da1b7d0157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:01.989583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-55bfcdea-1010-4fc2-948d-c8da1b7d0157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:01.992529 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4416/8726] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:59:01 2022] DELETE /identity/v3/projects/5d68f454bc184686869e07a777c88bfd => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:59:01.996820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfcdea-1010-4fc2-948d-c8da1b7d0157 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:59:01.998236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-55bfcdea-1010-4fc2-948d-c8da1b7d0157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:02.020035 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:59:02.075856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfcdea-1010-4fc2-948d-c8da1b7d0157 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:59:02.076356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dccee53-046d-41d2-a798-bb10b1c58b6d service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:59:02.083518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d943936-7b28-4531-9e3a-91832bc79bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:59:02.084433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d943936-7b28-4531-9e3a-91832bc79bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:59:02.084718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d943936-7b28-4531-9e3a-91832bc79bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:59:02.084997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d943936-7b28-4531-9e3a-91832bc79bf3 admin admin] PATH_INFO: `/v3/users/d12cd2b4b5364d7bbc351711dd2fd674` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:59:02.086365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d943936-7b28-4531-9e3a-91832bc79bf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d12cd2b4b5364d7bbc351711dd2fd674)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:59:02.088302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d943936-7b28-4531-9e3a-91832bc79bf3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:59:02.104274 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:59:02.154022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cbc95-5a12-4ad7-a6bf-108ab0d7834d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:59:02.154735 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cbc95-5a12-4ad7-a6bf-108ab0d7834d service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:59:02.155019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cbc95-5a12-4ad7-a6bf-108ab0d7834d service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:59:02.155295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4cbc95-5a12-4ad7-a6bf-108ab0d7834d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:59:02.157049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-df4cbc95-5a12-4ad7-a6bf-108ab0d7834d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:02.172766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4cbc95-5a12-4ad7-a6bf-108ab0d7834d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:59:02.174396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4cbc95-5a12-4ad7-a6bf-108ab0d7834d service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:59:02.188678 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4311/8727] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:59:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:59:02.285889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4d943936-7b28-4531-9e3a-91832bc79bf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd12cd2b4b5364d7bbc351711dd2fd674'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:02.298349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4d943936-7b28-4531-9e3a-91832bc79bf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd12cd2b4b5364d7bbc351711dd2fd674'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:02.306072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4d943936-7b28-4531-9e3a-91832bc79bf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd12cd2b4b5364d7bbc351711dd2fd674'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:02.307027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4d943936-7b28-4531-9e3a-91832bc79bf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd12cd2b4b5364d7bbc351711dd2fd674'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:02.376101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4d943936-7b28-4531-9e3a-91832bc79bf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd12cd2b4b5364d7bbc351711dd2fd674'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:02.383949 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4417/8728] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:59:01 2022] DELETE /identity/v3/users/d12cd2b4b5364d7bbc351711dd2fd674 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 14:59:03.052798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cbc95-5a12-4ad7-a6bf-108ab0d7834d service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:59:03.065104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4cbc95-5a12-4ad7-a6bf-108ab0d7834d service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:59:03.126314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242b924-a974-427c-89c9-70e5a0e72a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:59:03.130812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242b924-a974-427c-89c9-70e5a0e72a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:59:03.130812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242b924-a974-427c-89c9-70e5a0e72a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:59:03.130812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0242b924-a974-427c-89c9-70e5a0e72a94 admin admin] PATH_INFO: `/v3/projects/ccf78f3fa14f46918f80c0862fc52adc` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:59:03.130812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242b924-a974-427c-89c9-70e5a0e72a94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccf78f3fa14f46918f80c0862fc52adc)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:59:03.131249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0242b924-a974-427c-89c9-70e5a0e72a94 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:59:03.267429 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:59:03.268745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0242b924-a974-427c-89c9-70e5a0e72a94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccf78f3fa14f46918f80c0862fc52adc', 'request_id': 'req-0242b924-a974-427c-89c9-70e5a0e72a94'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:03.342149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0242b924-a974-427c-89c9-70e5a0e72a94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccf78f3fa14f46918f80c0862fc52adc', 'request_id': 'req-0242b924-a974-427c-89c9-70e5a0e72a94'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:03.349107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0242b924-a974-427c-89c9-70e5a0e72a94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccf78f3fa14f46918f80c0862fc52adc', 'request_id': 'req-0242b924-a974-427c-89c9-70e5a0e72a94'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:03.361933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0242b924-a974-427c-89c9-70e5a0e72a94 admin admin] The token cache is being invalidate because project ccf78f3fa14f46918f80c0862fc52adc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:59:03.368241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0242b924-a974-427c-89c9-70e5a0e72a94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:03.368241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0242b924-a974-427c-89c9-70e5a0e72a94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:03.368241 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4312/8729] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:59:03 2022] DELETE /identity/v3/projects/ccf78f3fa14f46918f80c0862fc52adc => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:59:03.369519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d943936-7b28-4531-9e3a-91832bc79bf3 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:59:03.371011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4d943936-7b28-4531-9e3a-91832bc79bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:03.385249 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d943936-7b28-4531-9e3a-91832bc79bf3 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:59:03.446438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13cced-17d2-463a-bb15-17c52116e686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:59:03.447328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13cced-17d2-463a-bb15-17c52116e686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:59:03.447611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13cced-17d2-463a-bb15-17c52116e686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:59:03.447889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13cced-17d2-463a-bb15-17c52116e686 admin admin] PATH_INFO: `/v3/users/7948138eec03473790a6f9fc3e59a8a4` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:59:03.449245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13cced-17d2-463a-bb15-17c52116e686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7948138eec03473790a6f9fc3e59a8a4)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:59:03.451238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13cced-17d2-463a-bb15-17c52116e686 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:59:03.712655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bd13cced-17d2-463a-bb15-17c52116e686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7948138eec03473790a6f9fc3e59a8a4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:03.725433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bd13cced-17d2-463a-bb15-17c52116e686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7948138eec03473790a6f9fc3e59a8a4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:03.733709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bd13cced-17d2-463a-bb15-17c52116e686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7948138eec03473790a6f9fc3e59a8a4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:03.734705 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bd13cced-17d2-463a-bb15-17c52116e686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7948138eec03473790a6f9fc3e59a8a4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:03.816368 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-bd13cced-17d2-463a-bb15-17c52116e686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7948138eec03473790a6f9fc3e59a8a4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:03.823149 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4418/8730] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 14:59:03 2022] DELETE /identity/v3/users/7948138eec03473790a6f9fc3e59a8a4 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:59:04.104084 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242b924-a974-427c-89c9-70e5a0e72a94 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:59:04.105639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0242b924-a974-427c-89c9-70e5a0e72a94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:04.119973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0242b924-a974-427c-89c9-70e5a0e72a94 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:59:04.180063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abed15-237f-49b2-bbf3-5c713dc05e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:59:04.180431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abed15-237f-49b2-bbf3-5c713dc05e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:59:04.180720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abed15-237f-49b2-bbf3-5c713dc05e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:59:04.181003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36abed15-237f-49b2-bbf3-5c713dc05e28 admin admin] PATH_INFO: `/v3/projects/9372b1e85ecd48c3bca90a7968446c05` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:59:04.182237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abed15-237f-49b2-bbf3-5c713dc05e28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9372b1e85ecd48c3bca90a7968446c05)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:59:04.184362 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36abed15-237f-49b2-bbf3-5c713dc05e28 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:59:04.350927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-36abed15-237f-49b2-bbf3-5c713dc05e28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9372b1e85ecd48c3bca90a7968446c05', 'request_id': 'req-36abed15-237f-49b2-bbf3-5c713dc05e28'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:04.460241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-36abed15-237f-49b2-bbf3-5c713dc05e28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9372b1e85ecd48c3bca90a7968446c05', 'request_id': 'req-36abed15-237f-49b2-bbf3-5c713dc05e28'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:04.468171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-36abed15-237f-49b2-bbf3-5c713dc05e28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9372b1e85ecd48c3bca90a7968446c05', 'request_id': 'req-36abed15-237f-49b2-bbf3-5c713dc05e28'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:04.478976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-36abed15-237f-49b2-bbf3-5c713dc05e28 admin admin] The token cache is being invalidate because project 9372b1e85ecd48c3bca90a7968446c05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 14:59:04.479335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-36abed15-237f-49b2-bbf3-5c713dc05e28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:04.480065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-36abed15-237f-49b2-bbf3-5c713dc05e28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 14:59:04.481644 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4313/8731] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 14:59:04 2022] DELETE /identity/v3/projects/9372b1e85ecd48c3bca90a7968446c05 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 14:59:05.365399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13cced-17d2-463a-bb15-17c52116e686 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:59:05.367511 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bd13cced-17d2-463a-bb15-17c52116e686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:05.378314 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:59:05.429085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13cced-17d2-463a-bb15-17c52116e686 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:59:05.481223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f6e53-9682-4de5-8480-d0c322fb523d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:59:05.481876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f6e53-9682-4de5-8480-d0c322fb523d service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:59:05.482257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f6e53-9682-4de5-8480-d0c322fb523d service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:59:05.482539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f6e53-9682-4de5-8480-d0c322fb523d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:59:05.484295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c21f6e53-9682-4de5-8480-d0c322fb523d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:05.553443 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f6e53-9682-4de5-8480-d0c322fb523d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:59:05.555673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f6e53-9682-4de5-8480-d0c322fb523d service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:59:05.565481 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4419/8732] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:59:05 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:59:07.791076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abed15-237f-49b2-bbf3-5c713dc05e28 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:59:07.792883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-36abed15-237f-49b2-bbf3-5c713dc05e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:07.863375 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:59:07.906515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36abed15-237f-49b2-bbf3-5c713dc05e28 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:59:07.913369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24bf7d-7c2c-4a6a-bb3c-be1c5dab1e92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:59:07.914844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24bf7d-7c2c-4a6a-bb3c-be1c5dab1e92 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:59:07.915305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24bf7d-7c2c-4a6a-bb3c-be1c5dab1e92 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:59:07.915755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c24bf7d-7c2c-4a6a-bb3c-be1c5dab1e92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:59:07.917809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2c24bf7d-7c2c-4a6a-bb3c-be1c5dab1e92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:07.935239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24bf7d-7c2c-4a6a-bb3c-be1c5dab1e92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:59:07.936837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c24bf7d-7c2c-4a6a-bb3c-be1c5dab1e92 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:59:07.951893 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4314/8733] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:59:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:59:09.295770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42463a85-29e2-4f44-ba32-3aabea2b25e4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:59:09.296302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42463a85-29e2-4f44-ba32-3aabea2b25e4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:59:09.296302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42463a85-29e2-4f44-ba32-3aabea2b25e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:59:09.314641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-42463a85-29e2-4f44-ba32-3aabea2b25e4 None None] MFA Rules not processed for user `a572e84b1e57481fa882845e927983ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:59:09.315836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-42463a85-29e2-4f44-ba32-3aabea2b25e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:09.371517 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4420/8734] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 14:59:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:59:09.688716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24bf7d-7c2c-4a6a-bb3c-be1c5dab1e92 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:59:09.690038 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2c24bf7d-7c2c-4a6a-bb3c-be1c5dab1e92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:09.703921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c24bf7d-7c2c-4a6a-bb3c-be1c5dab1e92 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:59:09.707482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41020214-c1d6-418e-84cb-e9a7bbdfe525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:59:09.708122 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41020214-c1d6-418e-84cb-e9a7bbdfe525 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:59:09.708439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41020214-c1d6-418e-84cb-e9a7bbdfe525 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:59:09.708725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41020214-c1d6-418e-84cb-e9a7bbdfe525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:59:09.710497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-41020214-c1d6-418e-84cb-e9a7bbdfe525 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:09.722302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41020214-c1d6-418e-84cb-e9a7bbdfe525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:59:09.723715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41020214-c1d6-418e-84cb-e9a7bbdfe525 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:59:09.735363 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4315/8735] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:59:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:59:19.364341 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:59:19.729343 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=22 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:59:31.637786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42463a85-29e2-4f44-ba32-3aabea2b25e4 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:59:31.658642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42463a85-29e2-4f44-ba32-3aabea2b25e4 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:59:31.662424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc7b10-87b4-4549-afc4-ee0f30a46114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:59:31.666139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc7b10-87b4-4549-afc4-ee0f30a46114 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:59:31.666139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc7b10-87b4-4549-afc4-ee0f30a46114 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:59:31.666139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc7b10-87b4-4549-afc4-ee0f30a46114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:59:31.666139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b7cc7b10-87b4-4549-afc4-ee0f30a46114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:31.737395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc7b10-87b4-4549-afc4-ee0f30a46114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:59:31.738833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc7b10-87b4-4549-afc4-ee0f30a46114 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:59:31.749676 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4421/8736] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:59:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:59:41.745233 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=36 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:59:43.127350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41020214-c1d6-418e-84cb-e9a7bbdfe525 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:59:43.147692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41020214-c1d6-418e-84cb-e9a7bbdfe525 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:59:43.150080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89802e0-f912-4434-b609-6cfc8fd284c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:59:43.150832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89802e0-f912-4434-b609-6cfc8fd284c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:59:43.151146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89802e0-f912-4434-b609-6cfc8fd284c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:59:43.151424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89802e0-f912-4434-b609-6cfc8fd284c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:59:43.153239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f89802e0-f912-4434-b609-6cfc8fd284c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:43.176254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89802e0-f912-4434-b609-6cfc8fd284c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:59:43.177676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89802e0-f912-4434-b609-6cfc8fd284c7 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:59:43.188122 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4316/8737] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:59:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:59:53.182447 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=13 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 14:59:54.236423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc7b10-87b4-4549-afc4-ee0f30a46114 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:59:54.237850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b7cc7b10-87b4-4549-afc4-ee0f30a46114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:54.324057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc7b10-87b4-4549-afc4-ee0f30a46114 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:59:54.329098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db79bf-e2bb-453f-8c5f-5fac7c313618 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:59:54.329752 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db79bf-e2bb-453f-8c5f-5fac7c313618 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:59:54.330044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db79bf-e2bb-453f-8c5f-5fac7c313618 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:59:54.330354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db79bf-e2bb-453f-8c5f-5fac7c313618 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:59:54.332214 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-25db79bf-e2bb-453f-8c5f-5fac7c313618 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:54.347450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db79bf-e2bb-453f-8c5f-5fac7c313618 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:59:54.349272 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db79bf-e2bb-453f-8c5f-5fac7c313618 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:59:54.362577 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4422/8738] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:59:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:59:58.533681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e79e57-7740-4580-8db3-766d61021615 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:59:58.534260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e79e57-7740-4580-8db3-766d61021615 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:59:58.534260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e79e57-7740-4580-8db3-766d61021615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:59:58.592325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-64e79e57-7740-4580-8db3-766d61021615 None None] MFA Rules not processed for user `e997b70d7158446daa1dfa225eb7afca`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 14:59:58.593551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-64e79e57-7740-4580-8db3-766d61021615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:58.600288 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4317/8739] 10.222.0.43 () {58 vars in 1062 bytes} [Tue Jul 19 14:59:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 14:59:58.606940 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db79bf-e2bb-453f-8c5f-5fac7c313618 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:59:58.620982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db79bf-e2bb-453f-8c5f-5fac7c313618 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:59:58.624731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc71561-6a95-4577-b6ea-26eeddb84697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:59:58.627089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc71561-6a95-4577-b6ea-26eeddb84697 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:59:58.627089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc71561-6a95-4577-b6ea-26eeddb84697 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:59:58.627089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc71561-6a95-4577-b6ea-26eeddb84697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:59:58.627707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9dc71561-6a95-4577-b6ea-26eeddb84697 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:58.639893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc71561-6a95-4577-b6ea-26eeddb84697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:59:58.641305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc71561-6a95-4577-b6ea-26eeddb84697 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:59:58.652743 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4423/8740] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:59:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 14:59:59.659474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e79e57-7740-4580-8db3-766d61021615 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 14:59:59.660936 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-64e79e57-7740-4580-8db3-766d61021615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:59.678670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e79e57-7740-4580-8db3-766d61021615 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 14:59:59.684356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fdadc-aa27-4b45-93c9-0cc820549f55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 14:59:59.685006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fdadc-aa27-4b45-93c9-0cc820549f55 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 14:59:59.685305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fdadc-aa27-4b45-93c9-0cc820549f55 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 14:59:59.685576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99fdadc-aa27-4b45-93c9-0cc820549f55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 14:59:59.687328 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f99fdadc-aa27-4b45-93c9-0cc820549f55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 14:59:59.702201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99fdadc-aa27-4b45-93c9-0cc820549f55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 14:59:59.706510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99fdadc-aa27-4b45-93c9-0cc820549f55 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 14:59:59.716781 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4318/8741] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 14:59:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:00:08.646263 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=43 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:00:09.709681 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=24 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:02:00.723073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9624d9-0d38-49e9-8469-9dc95fcc929f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:02:00.723721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9624d9-0d38-49e9-8469-9dc95fcc929f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:02:00.723861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9624d9-0d38-49e9-8469-9dc95fcc929f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:02:00.743485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3d9624d9-0d38-49e9-8469-9dc95fcc929f None None] MFA Rules not processed for user `e997b70d7158446daa1dfa225eb7afca`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:02:00.744826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3d9624d9-0d38-49e9-8469-9dc95fcc929f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:02:00.763879 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4424/8742] 10.222.0.43 () {58 vars in 1062 bytes} [Tue Jul 19 15:02:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:02:00.771150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fdadc-aa27-4b45-93c9-0cc820549f55 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:02:00.781053 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99fdadc-aa27-4b45-93c9-0cc820549f55 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:02:00.785102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfb6f7-94b9-4585-941b-9a9dded0c024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:02:00.790324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfb6f7-94b9-4585-941b-9a9dded0c024 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:02:00.790324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfb6f7-94b9-4585-941b-9a9dded0c024 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:02:00.790324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfb6f7-94b9-4585-941b-9a9dded0c024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:02:00.790324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-55cfb6f7-94b9-4585-941b-9a9dded0c024 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:02:00.826529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfb6f7-94b9-4585-941b-9a9dded0c024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:02:00.827983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfb6f7-94b9-4585-941b-9a9dded0c024 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:02:00.855516 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4319/8743] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:02:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:02:02.051104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9624d9-0d38-49e9-8469-9dc95fcc929f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:02:02.059482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9624d9-0d38-49e9-8469-9dc95fcc929f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:02:02.063090 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab155da-5b41-4300-a9cf-fa47f50768e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:02:02.063730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab155da-5b41-4300-a9cf-fa47f50768e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:02:02.064017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab155da-5b41-4300-a9cf-fa47f50768e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:02:02.064459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab155da-5b41-4300-a9cf-fa47f50768e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:02:02.066389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2ab155da-5b41-4300-a9cf-fa47f50768e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:02:02.084206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab155da-5b41-4300-a9cf-fa47f50768e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:02:02.085644 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab155da-5b41-4300-a9cf-fa47f50768e0 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:02:02.100382 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4425/8744] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:02:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:02:03.151424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfb6f7-94b9-4585-941b-9a9dded0c024 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:02:03.153289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-55cfb6f7-94b9-4585-941b-9a9dded0c024 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:02:03.184806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfb6f7-94b9-4585-941b-9a9dded0c024 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:02:03.184806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42a1ef-46d8-4410-a126-63b4decf8c7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:02:03.184806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42a1ef-46d8-4410-a126-63b4decf8c7e service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:02:03.184806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42a1ef-46d8-4410-a126-63b4decf8c7e service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:02:03.185427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42a1ef-46d8-4410-a126-63b4decf8c7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:02:03.185427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0d42a1ef-46d8-4410-a126-63b4decf8c7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:02:03.196139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42a1ef-46d8-4410-a126-63b4decf8c7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:02:03.197874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42a1ef-46d8-4410-a126-63b4decf8c7e service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:02:03.214252 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4320/8745] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:02:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:02:08.856077 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303bba2-c26a-43ac-bbec-228467454aea None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:02:08.856657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303bba2-c26a-43ac-bbec-228467454aea None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:02:08.856780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1303bba2-c26a-43ac-bbec-228467454aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:02:08.874933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1303bba2-c26a-43ac-bbec-228467454aea None None] MFA Rules not processed for user `a572e84b1e57481fa882845e927983ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:02:08.876136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1303bba2-c26a-43ac-bbec-228467454aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:02:08.883706 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4426/8746] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:02:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:02:09.873534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ac8df-c0ae-4d4f-986e-6dd3d929292c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:02:09.874015 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ac8df-c0ae-4d4f-986e-6dd3d929292c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:02:09.874180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ac8df-c0ae-4d4f-986e-6dd3d929292c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:02:09.914921 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2a2ac8df-c0ae-4d4f-986e-6dd3d929292c None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:02:09.916277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2a2ac8df-c0ae-4d4f-986e-6dd3d929292c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:02:09.925829 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4321/8747] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 15:02:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:02:09.937062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303bba2-c26a-43ac-bbec-228467454aea None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:02:09.952035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1303bba2-c26a-43ac-bbec-228467454aea None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:02:09.957809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87860e-f09a-45cd-9c27-a4e9e2f14328 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:02:09.958487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87860e-f09a-45cd-9c27-a4e9e2f14328 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:02:09.958776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87860e-f09a-45cd-9c27-a4e9e2f14328 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:02:09.959057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87860e-f09a-45cd-9c27-a4e9e2f14328 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:02:09.967528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87860e-f09a-45cd-9c27-a4e9e2f14328 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:02:09.969102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87860e-f09a-45cd-9c27-a4e9e2f14328 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:02:09.978946 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4427/8748] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:02:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:02:19.912348 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=33 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:02:19.974825 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=22 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:03:44.954874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ac8df-c0ae-4d4f-986e-6dd3d929292c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:03:44.964301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ac8df-c0ae-4d4f-986e-6dd3d929292c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:03:44.967938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cf07a-04e5-4905-bd64-c8e991204df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:03:44.968587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cf07a-04e5-4905-bd64-c8e991204df8 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:03:44.968874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cf07a-04e5-4905-bd64-c8e991204df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:03:44.969154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cf07a-04e5-4905-bd64-c8e991204df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:03:44.970968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b34cf07a-04e5-4905-bd64-c8e991204df8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:03:44.983411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cf07a-04e5-4905-bd64-c8e991204df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:03:44.984832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cf07a-04e5-4905-bd64-c8e991204df8 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:03:44.996190 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4322/8749] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:03:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:03:47.960728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87860e-f09a-45cd-9c27-a4e9e2f14328 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:03:47.976560 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87860e-f09a-45cd-9c27-a4e9e2f14328 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:03:47.982829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d1b4c-c700-4154-a3cf-54dd2b3f03de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:03:47.983471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d1b4c-c700-4154-a3cf-54dd2b3f03de service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:03:47.983760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d1b4c-c700-4154-a3cf-54dd2b3f03de service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:03:47.984041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d1b4c-c700-4154-a3cf-54dd2b3f03de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:03:47.985814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8e8d1b4c-c700-4154-a3cf-54dd2b3f03de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:03:48.045836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d1b4c-c700-4154-a3cf-54dd2b3f03de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:03:48.047535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d1b4c-c700-4154-a3cf-54dd2b3f03de service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:03:48.058310 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4428/8750] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:03:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:03:52.854462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cf07a-04e5-4905-bd64-c8e991204df8 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:03:52.863173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cf07a-04e5-4905-bd64-c8e991204df8 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:03:52.866817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837d38d-d53f-483f-aede-030fb84bda6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:03:52.867492 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837d38d-d53f-483f-aede-030fb84bda6e service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:03:52.867772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837d38d-d53f-483f-aede-030fb84bda6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:03:52.868050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a837d38d-d53f-483f-aede-030fb84bda6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:03:52.870465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a837d38d-d53f-483f-aede-030fb84bda6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:03:52.960582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837d38d-d53f-483f-aede-030fb84bda6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:03:52.962027 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a837d38d-d53f-483f-aede-030fb84bda6e service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:03:52.982046 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4323/8751] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:03:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:03:58.052793 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=28 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:04:00.119251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d1b4c-c700-4154-a3cf-54dd2b3f03de service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:00.147065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d1b4c-c700-4154-a3cf-54dd2b3f03de service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:00.153096 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd402c-5483-4638-843c-e596a236e780 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:00.153939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd402c-5483-4638-843c-e596a236e780 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:00.154258 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd402c-5483-4638-843c-e596a236e780 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:00.154538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd402c-5483-4638-843c-e596a236e780 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:00.156495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fecd402c-5483-4638-843c-e596a236e780 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:04:00.174925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd402c-5483-4638-843c-e596a236e780 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:00.177252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecd402c-5483-4638-843c-e596a236e780 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:00.191723 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4429/8752] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:04:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:04:00.220337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837d38d-d53f-483f-aede-030fb84bda6e service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:00.222384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a837d38d-d53f-483f-aede-030fb84bda6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:04:00.240747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a837d38d-d53f-483f-aede-030fb84bda6e service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:00.246882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dd16b-223e-4b8e-a551-e579fdbe1d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:00.248604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dd16b-223e-4b8e-a551-e579fdbe1d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:00.248898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dd16b-223e-4b8e-a551-e579fdbe1d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:00.249178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dd16b-223e-4b8e-a551-e579fdbe1d68 admin admin] PATH_INFO: `/v3/users/76ebe1229e114a1399e84b48718224da` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:00.250468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7dd16b-223e-4b8e-a551-e579fdbe1d68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76ebe1229e114a1399e84b48718224da)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:00.252393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7dd16b-223e-4b8e-a551-e579fdbe1d68 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:00.406693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bf7dd16b-223e-4b8e-a551-e579fdbe1d68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76ebe1229e114a1399e84b48718224da'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:00.419267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bf7dd16b-223e-4b8e-a551-e579fdbe1d68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76ebe1229e114a1399e84b48718224da'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:00.420065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bf7dd16b-223e-4b8e-a551-e579fdbe1d68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76ebe1229e114a1399e84b48718224da'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:00.420690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bf7dd16b-223e-4b8e-a551-e579fdbe1d68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76ebe1229e114a1399e84b48718224da'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:00.427869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bf7dd16b-223e-4b8e-a551-e579fdbe1d68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76ebe1229e114a1399e84b48718224da'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:00.519626 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4324/8753] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:04:00 2022] DELETE /identity/v3/users/76ebe1229e114a1399e84b48718224da => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:04:00.738845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd402c-5483-4638-843c-e596a236e780 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:00.750550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd402c-5483-4638-843c-e596a236e780 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:00.811972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9391ab1-1c91-46af-9004-9b50072795ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:00.812877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9391ab1-1c91-46af-9004-9b50072795ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:00.813164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9391ab1-1c91-46af-9004-9b50072795ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:00.813447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9391ab1-1c91-46af-9004-9b50072795ab admin admin] PATH_INFO: `/v3/projects/8bddf0796be14b7f9d58192d290a19bb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:00.814757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9391ab1-1c91-46af-9004-9b50072795ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bddf0796be14b7f9d58192d290a19bb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:00.816680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9391ab1-1c91-46af-9004-9b50072795ab admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:00.922839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d9391ab1-1c91-46af-9004-9b50072795ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bddf0796be14b7f9d58192d290a19bb', 'request_id': 'req-d9391ab1-1c91-46af-9004-9b50072795ab'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:00.928479 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d9391ab1-1c91-46af-9004-9b50072795ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bddf0796be14b7f9d58192d290a19bb', 'request_id': 'req-d9391ab1-1c91-46af-9004-9b50072795ab'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:00.935561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d9391ab1-1c91-46af-9004-9b50072795ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bddf0796be14b7f9d58192d290a19bb', 'request_id': 'req-d9391ab1-1c91-46af-9004-9b50072795ab'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:01.005878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d9391ab1-1c91-46af-9004-9b50072795ab admin admin] The token cache is being invalidate because project 8bddf0796be14b7f9d58192d290a19bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:04:01.006106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d9391ab1-1c91-46af-9004-9b50072795ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:01.006758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d9391ab1-1c91-46af-9004-9b50072795ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:01.008349 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4430/8754] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:04:00 2022] DELETE /identity/v3/projects/8bddf0796be14b7f9d58192d290a19bb => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:04:01.012829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dd16b-223e-4b8e-a551-e579fdbe1d68 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:01.014366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bf7dd16b-223e-4b8e-a551-e579fdbe1d68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:04:01.027886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7dd16b-223e-4b8e-a551-e579fdbe1d68 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:01.048472 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:04:01.085530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb274a9a-ea37-4503-95b7-5d6f8d85c383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:01.086441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb274a9a-ea37-4503-95b7-5d6f8d85c383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:01.086730 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb274a9a-ea37-4503-95b7-5d6f8d85c383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:01.087011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb274a9a-ea37-4503-95b7-5d6f8d85c383 admin admin] PATH_INFO: `/v3/users/bb2c690abfa848018f42ed8f67d9b618` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:01.088221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb274a9a-ea37-4503-95b7-5d6f8d85c383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb2c690abfa848018f42ed8f67d9b618)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:01.090550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb274a9a-ea37-4503-95b7-5d6f8d85c383 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:01.261409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bb274a9a-ea37-4503-95b7-5d6f8d85c383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb2c690abfa848018f42ed8f67d9b618'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:01.273817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bb274a9a-ea37-4503-95b7-5d6f8d85c383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb2c690abfa848018f42ed8f67d9b618'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:01.274533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bb274a9a-ea37-4503-95b7-5d6f8d85c383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb2c690abfa848018f42ed8f67d9b618'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:01.275250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bb274a9a-ea37-4503-95b7-5d6f8d85c383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb2c690abfa848018f42ed8f67d9b618'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:01.283098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-bb274a9a-ea37-4503-95b7-5d6f8d85c383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb2c690abfa848018f42ed8f67d9b618'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:01.361205 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4325/8755] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:04:01 2022] DELETE /identity/v3/users/bb2c690abfa848018f42ed8f67d9b618 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:04:01.659905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9391ab1-1c91-46af-9004-9b50072795ab admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:01.661379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d9391ab1-1c91-46af-9004-9b50072795ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:04:01.677315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9391ab1-1c91-46af-9004-9b50072795ab admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:01.737856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b96578-2dc4-4fac-9abe-26bc8ba3e203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:01.739043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b96578-2dc4-4fac-9abe-26bc8ba3e203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:01.739330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b96578-2dc4-4fac-9abe-26bc8ba3e203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:01.739604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b96578-2dc4-4fac-9abe-26bc8ba3e203 admin admin] PATH_INFO: `/v3/projects/068d7ad085c84e96ac6c596358a93cd0` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:01.740797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b96578-2dc4-4fac-9abe-26bc8ba3e203 admin admin] RBAC: Authorizing `identity:delete_project(project_id=068d7ad085c84e96ac6c596358a93cd0)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:01.742889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b96578-2dc4-4fac-9abe-26bc8ba3e203 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:01.753473 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:04:01.862628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-16b96578-2dc4-4fac-9abe-26bc8ba3e203 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068d7ad085c84e96ac6c596358a93cd0', 'request_id': 'req-16b96578-2dc4-4fac-9abe-26bc8ba3e203'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:01.868295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-16b96578-2dc4-4fac-9abe-26bc8ba3e203 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068d7ad085c84e96ac6c596358a93cd0', 'request_id': 'req-16b96578-2dc4-4fac-9abe-26bc8ba3e203'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:01.875238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-16b96578-2dc4-4fac-9abe-26bc8ba3e203 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068d7ad085c84e96ac6c596358a93cd0', 'request_id': 'req-16b96578-2dc4-4fac-9abe-26bc8ba3e203'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:01.930301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-16b96578-2dc4-4fac-9abe-26bc8ba3e203 admin admin] The token cache is being invalidate because project 068d7ad085c84e96ac6c596358a93cd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:04:01.930589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-16b96578-2dc4-4fac-9abe-26bc8ba3e203 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:01.931206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-16b96578-2dc4-4fac-9abe-26bc8ba3e203 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:01.933235 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4431/8756] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:04:01 2022] DELETE /identity/v3/projects/068d7ad085c84e96ac6c596358a93cd0 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:04:01.938274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7223e0-c837-4a5e-baa1-d60657b2f077 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:01.938576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7223e0-c837-4a5e-baa1-d60657b2f077 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:01.938844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7223e0-c837-4a5e-baa1-d60657b2f077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:01.989824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4f7223e0-c837-4a5e-baa1-d60657b2f077 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:04:01.991068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4f7223e0-c837-4a5e-baa1-d60657b2f077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:04:02.049729 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4326/8757] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:04:02.057978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207acedb-903b-46cf-94e6-15d60546c2a4 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:02.058411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207acedb-903b-46cf-94e6-15d60546c2a4 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:02.058723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207acedb-903b-46cf-94e6-15d60546c2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:02.077765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-207acedb-903b-46cf-94e6-15d60546c2a4 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:04:02.078998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-207acedb-903b-46cf-94e6-15d60546c2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:04:02.086961 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4432/8758] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:04:02.091051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7223e0-c837-4a5e-baa1-d60657b2f077 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:02.101032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7223e0-c837-4a5e-baa1-d60657b2f077 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:02.105613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e02b28-4055-41c8-a8c5-154734af48b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:02.106301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e02b28-4055-41c8-a8c5-154734af48b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:02.106589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e02b28-4055-41c8-a8c5-154734af48b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:02.106867 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e02b28-4055-41c8-a8c5-154734af48b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:02.107592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e02b28-4055-41c8-a8c5-154734af48b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:04:02.107897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e02b28-4055-41c8-a8c5-154734af48b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:02.109506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e02b28-4055-41c8-a8c5-154734af48b6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:02.121811 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4327/8759] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 15:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:04:02.125929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207acedb-903b-46cf-94e6-15d60546c2a4 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:02.135171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207acedb-903b-46cf-94e6-15d60546c2a4 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:02.140962 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9b3f8-bb0b-4ac6-814b-d29c9e749139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:02.141609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9b3f8-bb0b-4ac6-814b-d29c9e749139 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:02.141942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9b3f8-bb0b-4ac6-814b-d29c9e749139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:02.142248 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9b3f8-bb0b-4ac6-814b-d29c9e749139 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:02.142930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9b3f8-bb0b-4ac6-814b-d29c9e749139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:02.144825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9b3f8-bb0b-4ac6-814b-d29c9e749139 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:02.259237 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4433/8760] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 15:04:02 2022] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:04:02.263956 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e02b28-4055-41c8-a8c5-154734af48b6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:02.275145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e02b28-4055-41c8-a8c5-154734af48b6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:02.281858 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:04:02.334389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919fe4c-e11b-4f08-ad97-a299b6a87e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:02.335067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919fe4c-e11b-4f08-ad97-a299b6a87e56 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:02.335361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919fe4c-e11b-4f08-ad97-a299b6a87e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:02.335642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7919fe4c-e11b-4f08-ad97-a299b6a87e56 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:02.336327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919fe4c-e11b-4f08-ad97-a299b6a87e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:02.338258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7919fe4c-e11b-4f08-ad97-a299b6a87e56 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:02.415762 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4328/8761] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 15:04:02 2022] POST /identity/v3/users => generated 283 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:04:02.420407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9b3f8-bb0b-4ac6-814b-d29c9e749139 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:02.430878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9b3f8-bb0b-4ac6-814b-d29c9e749139 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:02.436118 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afca82a-adcc-4bad-8de8-95706b9644cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:02.437218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afca82a-adcc-4bad-8de8-95706b9644cb admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:02.437218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afca82a-adcc-4bad-8de8-95706b9644cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:02.437400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afca82a-adcc-4bad-8de8-95706b9644cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:02.438025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afca82a-adcc-4bad-8de8-95706b9644cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:02.439673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afca82a-adcc-4bad-8de8-95706b9644cb admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:02.449697 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4434/8762] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:04:02.453601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919fe4c-e11b-4f08-ad97-a299b6a87e56 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:02.463715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7919fe4c-e11b-4f08-ad97-a299b6a87e56 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:02.468393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e976300-baa0-4e94-8b18-e9eb00ca7afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:02.469052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e976300-baa0-4e94-8b18-e9eb00ca7afd admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:02.469339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e976300-baa0-4e94-8b18-e9eb00ca7afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:02.469618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e976300-baa0-4e94-8b18-e9eb00ca7afd admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:02.470383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e976300-baa0-4e94-8b18-e9eb00ca7afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:02.471968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e976300-baa0-4e94-8b18-e9eb00ca7afd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:02.482713 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4329/8763] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:04:02.486616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afca82a-adcc-4bad-8de8-95706b9644cb admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:02.497385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afca82a-adcc-4bad-8de8-95706b9644cb admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:02.502067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eae0e8-47b0-428e-99a5-274d7a770621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:02.502965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eae0e8-47b0-428e-99a5-274d7a770621 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:02.503253 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eae0e8-47b0-428e-99a5-274d7a770621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:02.503533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eae0e8-47b0-428e-99a5-274d7a770621 admin admin] PATH_INFO: `/v3/projects/a9e583e1dce04f2b9e99e45cf1c7e205/users/b92b757485f54b7a8b5123f7e1b97eb5/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:02.518450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eae0e8-47b0-428e-99a5-274d7a770621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9e583e1dce04f2b9e99e45cf1c7e205, user_id=b92b757485f54b7a8b5123f7e1b97eb5, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:02.521124 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eae0e8-47b0-428e-99a5-274d7a770621 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:02.617300 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4435/8764] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:04:02 2022] PUT /identity/v3/projects/a9e583e1dce04f2b9e99e45cf1c7e205/users/b92b757485f54b7a8b5123f7e1b97eb5/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:04:02.623675 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3b700-6d5d-47ee-bf91-27a8ad6a0753 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:02.623972 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3b700-6d5d-47ee-bf91-27a8ad6a0753 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:02.624256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3b700-6d5d-47ee-bf91-27a8ad6a0753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:02.642289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-eef3b700-6d5d-47ee-bf91-27a8ad6a0753 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:04:02.643486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-eef3b700-6d5d-47ee-bf91-27a8ad6a0753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:04:02.704043 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4330/8765] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:04:02.713803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eae0e8-47b0-428e-99a5-274d7a770621 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:02.716024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-74eae0e8-47b0-428e-99a5-274d7a770621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:04:02.773372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eae0e8-47b0-428e-99a5-274d7a770621 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:02.778194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6bf70-d955-4556-8120-f6fd01f88467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:02.778845 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6bf70-d955-4556-8120-f6fd01f88467 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:02.779129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6bf70-d955-4556-8120-f6fd01f88467 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:02.779406 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6bf70-d955-4556-8120-f6fd01f88467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:02.788972 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6bf70-d955-4556-8120-f6fd01f88467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:02.790436 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6bf70-d955-4556-8120-f6fd01f88467 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:02.801455 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4436/8766] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:04:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:04:08.509765 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8e513-4011-46bf-98f1-1192b839cb3d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:08.510278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8e513-4011-46bf-98f1-1192b839cb3d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:08.510523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b8e513-4011-46bf-98f1-1192b839cb3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:08.542243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c1b8e513-4011-46bf-98f1-1192b839cb3d None None] MFA Rules not processed for user `b92b757485f54b7a8b5123f7e1b97eb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:04:08.544147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c1b8e513-4011-46bf-98f1-1192b839cb3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:04:08.636019 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4331/8767] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:04:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:04:08.641636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6bf70-d955-4556-8120-f6fd01f88467 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:08.652030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6bf70-d955-4556-8120-f6fd01f88467 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:08.657647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb85c7-b296-4699-8d1b-ac9e05fa26e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:08.658537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb85c7-b296-4699-8d1b-ac9e05fa26e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:08.658901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb85c7-b296-4699-8d1b-ac9e05fa26e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:08.659254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb85c7-b296-4699-8d1b-ac9e05fa26e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:08.660039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb85c7-b296-4699-8d1b-ac9e05fa26e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:08.662065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb85c7-b296-4699-8d1b-ac9e05fa26e9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:08.771946 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4437/8768] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 15:04:08 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:04:08.776011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8e513-4011-46bf-98f1-1192b839cb3d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:08.787924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b8e513-4011-46bf-98f1-1192b839cb3d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:08.793136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1988619-8d66-4ebd-9a1f-32eecffa5358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:08.794997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1988619-8d66-4ebd-9a1f-32eecffa5358 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:08.794997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1988619-8d66-4ebd-9a1f-32eecffa5358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:08.795309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1988619-8d66-4ebd-9a1f-32eecffa5358 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:08.795877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1988619-8d66-4ebd-9a1f-32eecffa5358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:08.797561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1988619-8d66-4ebd-9a1f-32eecffa5358 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:08.820826 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4332/8769] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:04:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:04:08.824375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb85c7-b296-4699-8d1b-ac9e05fa26e9 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:08.842631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb85c7-b296-4699-8d1b-ac9e05fa26e9 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:08.847792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2135a3-bdf0-4ec8-839a-c6f04b129705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:08.848921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2135a3-bdf0-4ec8-839a-c6f04b129705 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:08.849364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2135a3-bdf0-4ec8-839a-c6f04b129705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:08.849647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2135a3-bdf0-4ec8-839a-c6f04b129705 admin admin] PATH_INFO: `/v3/system/users/46bf95f3569a4dc29af10240548669f8/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:08.859989 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:04:08.866800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2135a3-bdf0-4ec8-839a-c6f04b129705 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=46bf95f3569a4dc29af10240548669f8, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:08.868776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2135a3-bdf0-4ec8-839a-c6f04b129705 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:08.958754 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4438/8770] 10.222.0.43 () {60 vars in 1377 bytes} [Tue Jul 19 15:04:08 2022] PUT /identity/v3/system/users/46bf95f3569a4dc29af10240548669f8/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:04:08.960850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5dc649-5c84-4ce4-b68e-27ad43964956 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:08.961151 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5dc649-5c84-4ce4-b68e-27ad43964956 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:08.961437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5dc649-5c84-4ce4-b68e-27ad43964956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:08.973910 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:04:08.991239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9d5dc649-5c84-4ce4-b68e-27ad43964956 None None] MFA Rules not processed for user `46bf95f3569a4dc29af10240548669f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:04:08.992618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9d5dc649-5c84-4ce4-b68e-27ad43964956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:04:09.082987 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4333/8771] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:04:08 2022] POST /identity/v3/auth/tokens => generated 2405 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 15:04:09.087150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2135a3-bdf0-4ec8-839a-c6f04b129705 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:09.206010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2135a3-bdf0-4ec8-839a-c6f04b129705 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:09.247864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf8cb7-4be8-463d-95e8-3ac1ddde7836 None tempest-ImageQuotaTest-2078194309-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46bf95f3569a4dc29af10240548669f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:09.248340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf8cb7-4be8-463d-95e8-3ac1ddde7836 None tempest-ImageQuotaTest-2078194309-system-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:09.248639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf8cb7-4be8-463d-95e8-3ac1ddde7836 None tempest-ImageQuotaTest-2078194309-system-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:09.248924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cf8cb7-4be8-463d-95e8-3ac1ddde7836 None tempest-ImageQuotaTest-2078194309-system-admin] PATH_INFO: `/v3/services` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:09.249629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf8cb7-4be8-463d-95e8-3ac1ddde7836 None tempest-ImageQuotaTest-2078194309-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:09.251129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cf8cb7-4be8-463d-95e8-3ac1ddde7836 None tempest-ImageQuotaTest-2078194309-system-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:09.258756 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4439/8772] 10.222.0.43 () {58 vars in 1109 bytes} [Tue Jul 19 15:04:09 2022] GET /identity/v3/services => generated 2191 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:04:09.263502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5dc649-5c84-4ce4-b68e-27ad43964956 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:09.378684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5dc649-5c84-4ce4-b68e-27ad43964956 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:09.405718 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:04:09.414720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de553d1-70b2-482e-9539-354e061c02df None tempest-ImageQuotaTest-2078194309-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46bf95f3569a4dc29af10240548669f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:09.415387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de553d1-70b2-482e-9539-354e061c02df None tempest-ImageQuotaTest-2078194309-system-admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:09.415837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de553d1-70b2-482e-9539-354e061c02df None tempest-ImageQuotaTest-2078194309-system-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:09.416144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de553d1-70b2-482e-9539-354e061c02df None tempest-ImageQuotaTest-2078194309-system-admin] PATH_INFO: `/v3/limits` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:09.416911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de553d1-70b2-482e-9539-354e061c02df None tempest-ImageQuotaTest-2078194309-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:09.418240 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de553d1-70b2-482e-9539-354e061c02df None tempest-ImageQuotaTest-2078194309-system-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:09.464714 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-8de553d1-70b2-482e-9539-354e061c02df None tempest-ImageQuotaTest-2078194309-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jul 19 15:04:09.464714 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:04:09.464714 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:04:09.464714 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:04:09.464714 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:04:09.464714 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:04:09.464714 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:04:09.464714 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:04:09.464714 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:04:09.464714 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:04:09.464714 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:04:09.464714 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:04:09.464714 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Jul 19 15:04:09.464714 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Jul 19 15:04:09.466292 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:04:09.466292 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:04:09.466292 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Jul 19 15:04:09.466292 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Jul 19 15:04:09.466292 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 15:04:09.466292 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 15:04:09.466292 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Jul 19 15:04:09.466292 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Jul 19 15:04:09.466292 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Jul 19 15:04:09.466292 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.NoLimitReference Jul 19 15:04:09.466292 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jul 19 15:04:09.466292 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 15:04:09.468210 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4334/8773] 10.222.0.43 () {60 vars in 1125 bytes} [Tue Jul 19 15:04:09 2022] POST /identity/v3/limits => generated 124 bytes in 205 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Jul 19 15:04:09.473305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf8cb7-4be8-463d-95e8-3ac1ddde7836 None tempest-ImageQuotaTest-2078194309-system-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:09.535828 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:04:09.582713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cf8cb7-4be8-463d-95e8-3ac1ddde7836 None tempest-ImageQuotaTest-2078194309-system-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:09.618965 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f3fc2-b936-4eda-902a-34b5a0b079b0 None tempest-ImageQuotaTest-2078194309-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46bf95f3569a4dc29af10240548669f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:09.619626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f3fc2-b936-4eda-902a-34b5a0b079b0 None tempest-ImageQuotaTest-2078194309-system-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:09.619914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f3fc2-b936-4eda-902a-34b5a0b079b0 None tempest-ImageQuotaTest-2078194309-system-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:09.620193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f3fc2-b936-4eda-902a-34b5a0b079b0 None tempest-ImageQuotaTest-2078194309-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:09.620892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f3fc2-b936-4eda-902a-34b5a0b079b0 None tempest-ImageQuotaTest-2078194309-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:09.622031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495f3fc2-b936-4eda-902a-34b5a0b079b0 None tempest-ImageQuotaTest-2078194309-system-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:09.628928 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4440/8774] 10.222.0.43 () {58 vars in 1136 bytes} [Tue Jul 19 15:04:09 2022] GET /identity/v3/registered_limits => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:04:09.635413 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de553d1-70b2-482e-9539-354e061c02df None tempest-ImageQuotaTest-2078194309-system-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:09.742843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de553d1-70b2-482e-9539-354e061c02df None tempest-ImageQuotaTest-2078194309-system-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:09.778480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca4498-4c07-4fcf-a0a7-c79214772c85 None tempest-ImageQuotaTest-2078194309-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '46bf95f3569a4dc29af10240548669f8', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:09.779091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca4498-4c07-4fcf-a0a7-c79214772c85 None tempest-ImageQuotaTest-2078194309-system-admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:09.779380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca4498-4c07-4fcf-a0a7-c79214772c85 None tempest-ImageQuotaTest-2078194309-system-admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:09.779665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca4498-4c07-4fcf-a0a7-c79214772c85 None tempest-ImageQuotaTest-2078194309-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:09.780373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca4498-4c07-4fcf-a0a7-c79214772c85 None tempest-ImageQuotaTest-2078194309-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:09.781455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca4498-4c07-4fcf-a0a7-c79214772c85 None tempest-ImageQuotaTest-2078194309-system-admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:09.786656 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4335/8775] 10.222.0.43 () {58 vars in 1136 bytes} [Tue Jul 19 15:04:09 2022] GET /identity/v3/registered_limits => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:04:13.328423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f3fc2-b936-4eda-902a-34b5a0b079b0 None tempest-ImageQuotaTest-2078194309-system-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:13.340289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f3fc2-b936-4eda-902a-34b5a0b079b0 None tempest-ImageQuotaTest-2078194309-system-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:13.345685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f1ce2-8ebe-4e3c-943d-1a3bebf82c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:13.346600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f1ce2-8ebe-4e3c-943d-1a3bebf82c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:13.346884 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f1ce2-8ebe-4e3c-943d-1a3bebf82c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:13.347163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f1ce2-8ebe-4e3c-943d-1a3bebf82c42 admin admin] PATH_INFO: `/v3/users/b92b757485f54b7a8b5123f7e1b97eb5` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:13.348363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f1ce2-8ebe-4e3c-943d-1a3bebf82c42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b92b757485f54b7a8b5123f7e1b97eb5)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:13.350354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0f1ce2-8ebe-4e3c-943d-1a3bebf82c42 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:13.551680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cc0f1ce2-8ebe-4e3c-943d-1a3bebf82c42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b92b757485f54b7a8b5123f7e1b97eb5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:13.564803 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cc0f1ce2-8ebe-4e3c-943d-1a3bebf82c42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b92b757485f54b7a8b5123f7e1b97eb5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:13.571721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cc0f1ce2-8ebe-4e3c-943d-1a3bebf82c42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b92b757485f54b7a8b5123f7e1b97eb5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:13.572414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cc0f1ce2-8ebe-4e3c-943d-1a3bebf82c42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b92b757485f54b7a8b5123f7e1b97eb5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:13.649925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-cc0f1ce2-8ebe-4e3c-943d-1a3bebf82c42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b92b757485f54b7a8b5123f7e1b97eb5'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:13.657259 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4441/8776] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:04:13 2022] DELETE /identity/v3/users/b92b757485f54b7a8b5123f7e1b97eb5 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:04:13.922533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca4498-4c07-4fcf-a0a7-c79214772c85 None tempest-ImageQuotaTest-2078194309-system-admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:13.924556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-03ca4498-4c07-4fcf-a0a7-c79214772c85 None tempest-ImageQuotaTest-2078194309-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:04:13.983134 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:04:13.996458 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca4498-4c07-4fcf-a0a7-c79214772c85 None tempest-ImageQuotaTest-2078194309-system-admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:14.001410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510648d0-69a0-4917-bea5-e4b72c88d19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:14.002312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510648d0-69a0-4917-bea5-e4b72c88d19c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:14.002627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510648d0-69a0-4917-bea5-e4b72c88d19c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:14.002907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510648d0-69a0-4917-bea5-e4b72c88d19c admin admin] PATH_INFO: `/v3/projects/a9e583e1dce04f2b9e99e45cf1c7e205` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:14.004093 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510648d0-69a0-4917-bea5-e4b72c88d19c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9e583e1dce04f2b9e99e45cf1c7e205)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:14.005987 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510648d0-69a0-4917-bea5-e4b72c88d19c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:14.097579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-510648d0-69a0-4917-bea5-e4b72c88d19c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9e583e1dce04f2b9e99e45cf1c7e205', 'request_id': 'req-510648d0-69a0-4917-bea5-e4b72c88d19c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:14.187335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-510648d0-69a0-4917-bea5-e4b72c88d19c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9e583e1dce04f2b9e99e45cf1c7e205', 'request_id': 'req-510648d0-69a0-4917-bea5-e4b72c88d19c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:14.193739 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-510648d0-69a0-4917-bea5-e4b72c88d19c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9e583e1dce04f2b9e99e45cf1c7e205', 'request_id': 'req-510648d0-69a0-4917-bea5-e4b72c88d19c'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:14.204287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-510648d0-69a0-4917-bea5-e4b72c88d19c admin admin] The token cache is being invalidate because project a9e583e1dce04f2b9e99e45cf1c7e205 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:04:14.204600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-510648d0-69a0-4917-bea5-e4b72c88d19c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:14.205246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-510648d0-69a0-4917-bea5-e4b72c88d19c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:14.206973 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4336/8777] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:04:13 2022] DELETE /identity/v3/projects/a9e583e1dce04f2b9e99e45cf1c7e205 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:04:14.211159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f1ce2-8ebe-4e3c-943d-1a3bebf82c42 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:14.222509 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f1ce2-8ebe-4e3c-943d-1a3bebf82c42 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:14.264763 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:04:14.280494 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40a2839-7ec2-444d-8dfe-ce99f92b93b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:14.281369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a2839-7ec2-444d-8dfe-ce99f92b93b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:14.281663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a2839-7ec2-444d-8dfe-ce99f92b93b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:14.281949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40a2839-7ec2-444d-8dfe-ce99f92b93b5 admin admin] PATH_INFO: `/v3/users/46bf95f3569a4dc29af10240548669f8` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:14.283177 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a2839-7ec2-444d-8dfe-ce99f92b93b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46bf95f3569a4dc29af10240548669f8)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:14.285086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40a2839-7ec2-444d-8dfe-ce99f92b93b5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:14.452060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e40a2839-7ec2-444d-8dfe-ce99f92b93b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46bf95f3569a4dc29af10240548669f8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:14.464284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e40a2839-7ec2-444d-8dfe-ce99f92b93b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46bf95f3569a4dc29af10240548669f8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:14.472678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e40a2839-7ec2-444d-8dfe-ce99f92b93b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46bf95f3569a4dc29af10240548669f8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:14.473375 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e40a2839-7ec2-444d-8dfe-ce99f92b93b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46bf95f3569a4dc29af10240548669f8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:14.530399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-e40a2839-7ec2-444d-8dfe-ce99f92b93b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46bf95f3569a4dc29af10240548669f8'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:04:14.536801 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4442/8778] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:04:14 2022] DELETE /identity/v3/users/46bf95f3569a4dc29af10240548669f8 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:04:14.967200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510648d0-69a0-4917-bea5-e4b72c88d19c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:14.968694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-510648d0-69a0-4917-bea5-e4b72c88d19c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:04:14.982155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510648d0-69a0-4917-bea5-e4b72c88d19c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:15.039924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14e8b5-751a-47f4-bfda-57e7053ee4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:15.040719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14e8b5-751a-47f4-bfda-57e7053ee4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:15.041011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14e8b5-751a-47f4-bfda-57e7053ee4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:15.041294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14e8b5-751a-47f4-bfda-57e7053ee4ff admin admin] PATH_INFO: `/v3/projects/None` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:15.047964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14e8b5-751a-47f4-bfda-57e7053ee4ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:15.049798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14e8b5-751a-47f4-bfda-57e7053ee4ff admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:15.063330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application [None req-5e14e8b5-751a-47f4-bfda-57e7053ee4ff admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Jul 19 15:04:15.063330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 15:04:15.063330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 15:04:15.063330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 15:04:15.063330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 15:04:15.063330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 15:04:15.063330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 15:04:15.063330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 15:04:15.063330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 15:04:15.063330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 15:04:15.063330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 15:04:15.063330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 15:04:15.063330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 19 15:04:15.063330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 19 15:04:15.063330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 15:04:15.063330 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 15:04:15.064354 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 19 15:04:15.064354 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 19 15:04:15.064354 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 15:04:15.064354 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 15:04:15.064354 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 15:04:15.064354 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 15:04:15.064354 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Jul 19 15:04:15.064354 n-d-master-1 devstack@keystone.service[80679]: ERROR keystone.server.flask.application Jul 19 15:04:15.066586 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4337/8779] 10.222.0.43 () {58 vars in 1148 bytes} [Tue Jul 19 15:04:14 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 15:04:24.532972 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=37,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:04:25.052287 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=58,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:04:31.085928 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b849d8-b4e1-42fb-b571-8a365813c6c0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:31.086384 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b849d8-b4e1-42fb-b571-8a365813c6c0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:31.086554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b849d8-b4e1-42fb-b571-8a365813c6c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:31.147397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a6b849d8-b4e1-42fb-b571-8a365813c6c0 None None] MFA Rules not processed for user `ef77d9ec7712434287347d959dcf1cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:04:31.148623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a6b849d8-b4e1-42fb-b571-8a365813c6c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:04:31.209866 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4443/8780] 10.222.0.43 () {58 vars in 1061 bytes} [Tue Jul 19 15:04:31 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:04:31.215884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14e8b5-751a-47f4-bfda-57e7053ee4ff admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:04:31.227314 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14e8b5-751a-47f4-bfda-57e7053ee4ff admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:04:31.230893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed153744-2aa3-491e-b4f8-6d66371ec333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:04:31.231531 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed153744-2aa3-491e-b4f8-6d66371ec333 service cinder] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:31.231820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed153744-2aa3-491e-b4f8-6d66371ec333 service cinder] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:31.232098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed153744-2aa3-491e-b4f8-6d66371ec333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:31.233882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ed153744-2aa3-491e-b4f8-6d66371ec333 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:04:31.314553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed153744-2aa3-491e-b4f8-6d66371ec333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:04:31.315977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed153744-2aa3-491e-b4f8-6d66371ec333 service cinder] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:04:31.344614 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4338/8781] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:04:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:04:41.205283 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=42 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:04:41.331886 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=41 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:04:59.645566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f07e0a-97f3-41ee-9bfe-25f9eee30310 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:04:59.646197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f07e0a-97f3-41ee-9bfe-25f9eee30310 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:04:59.646197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f07e0a-97f3-41ee-9bfe-25f9eee30310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:04:59.673236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-44f07e0a-97f3-41ee-9bfe-25f9eee30310 None None] MFA Rules not processed for user `a572e84b1e57481fa882845e927983ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:04:59.674570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-44f07e0a-97f3-41ee-9bfe-25f9eee30310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:04:59.681683 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4444/8782] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:04:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:05:00.009977 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed153744-2aa3-491e-b4f8-6d66371ec333 service cinder] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:05:00.011473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ed153744-2aa3-491e-b4f8-6d66371ec333 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:05:00.069131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed153744-2aa3-491e-b4f8-6d66371ec333 service cinder] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:05:00.072798 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9de81f-612b-4081-abdc-16595840dc31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:05:00.073452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9de81f-612b-4081-abdc-16595840dc31 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:05:00.073741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9de81f-612b-4081-abdc-16595840dc31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:05:00.074024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9de81f-612b-4081-abdc-16595840dc31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:05:00.075909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0e9de81f-612b-4081-abdc-16595840dc31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:05:00.088354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9de81f-612b-4081-abdc-16595840dc31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:05:00.090215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9de81f-612b-4081-abdc-16595840dc31 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:05:00.100464 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4339/8783] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:05:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:05:00.197063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f07e0a-97f3-41ee-9bfe-25f9eee30310 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:05:00.198503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-44f07e0a-97f3-41ee-9bfe-25f9eee30310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:05:00.274403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f07e0a-97f3-41ee-9bfe-25f9eee30310 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:05:00.279527 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73f02c-84f7-4cca-9722-f9873a18f251 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:05:00.280185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73f02c-84f7-4cca-9722-f9873a18f251 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:05:00.280467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73f02c-84f7-4cca-9722-f9873a18f251 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:05:00.280740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73f02c-84f7-4cca-9722-f9873a18f251 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:05:00.282535 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0e73f02c-84f7-4cca-9722-f9873a18f251 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:05:00.298519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73f02c-84f7-4cca-9722-f9873a18f251 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:05:00.300802 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73f02c-84f7-4cca-9722-f9873a18f251 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:05:00.313805 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4445/8784] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:05:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:05:01.888838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15680e-4c7a-408b-858b-6da64f6debd4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:05:01.889295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15680e-4c7a-408b-858b-6da64f6debd4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:05:01.889389 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c15680e-4c7a-408b-858b-6da64f6debd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:05:01.908586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0c15680e-4c7a-408b-858b-6da64f6debd4 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:05:01.910326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0c15680e-4c7a-408b-858b-6da64f6debd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:05:01.918860 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4340/8785] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 15:05:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:05:01.931727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73f02c-84f7-4cca-9722-f9873a18f251 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:05:01.933201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0e73f02c-84f7-4cca-9722-f9873a18f251 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:05:01.949316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73f02c-84f7-4cca-9722-f9873a18f251 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:05:01.954592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cdf51-2aac-4dda-bdf4-7df5e3e4cb62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:05:01.955257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cdf51-2aac-4dda-bdf4-7df5e3e4cb62 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:05:01.955547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cdf51-2aac-4dda-bdf4-7df5e3e4cb62 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:05:01.955835 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874cdf51-2aac-4dda-bdf4-7df5e3e4cb62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:05:01.964809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874cdf51-2aac-4dda-bdf4-7df5e3e4cb62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:05:01.967595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874cdf51-2aac-4dda-bdf4-7df5e3e4cb62 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:05:01.977159 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4446/8786] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:05:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:05:02.997229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15680e-4c7a-408b-858b-6da64f6debd4 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:05:03.010661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c15680e-4c7a-408b-858b-6da64f6debd4 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:05:03.015801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956bd46-01c9-4bbf-9604-03ea23de2e1a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:05:03.016391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956bd46-01c9-4bbf-9604-03ea23de2e1a service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:05:03.016679 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956bd46-01c9-4bbf-9604-03ea23de2e1a service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:05:03.016964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2956bd46-01c9-4bbf-9604-03ea23de2e1a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:05:03.018760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2956bd46-01c9-4bbf-9604-03ea23de2e1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:05:03.035933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956bd46-01c9-4bbf-9604-03ea23de2e1a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:05:03.036117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2956bd46-01c9-4bbf-9604-03ea23de2e1a service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:05:03.049081 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4341/8787] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:05:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:05:06.308516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cdf51-2aac-4dda-bdf4-7df5e3e4cb62 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:05:06.310409 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-874cdf51-2aac-4dda-bdf4-7df5e3e4cb62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:05:06.325678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874cdf51-2aac-4dda-bdf4-7df5e3e4cb62 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:05:06.329526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8606a-8aae-40be-810e-a1d1811c328d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:05:06.330333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8606a-8aae-40be-810e-a1d1811c328d service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:05:06.330620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8606a-8aae-40be-810e-a1d1811c328d service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:05:06.330900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8606a-8aae-40be-810e-a1d1811c328d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:05:06.332828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fac8606a-8aae-40be-810e-a1d1811c328d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:05:06.347615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8606a-8aae-40be-810e-a1d1811c328d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:05:06.347615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8606a-8aae-40be-810e-a1d1811c328d service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:05:06.362369 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4447/8788] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:05:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:05:13.042332 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=35 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:05:16.354696 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=50 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:05:19.850804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956bd46-01c9-4bbf-9604-03ea23de2e1a service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:05:19.852237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2956bd46-01c9-4bbf-9604-03ea23de2e1a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:05:19.930572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2956bd46-01c9-4bbf-9604-03ea23de2e1a service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:05:19.937002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8388eab-c1c2-4ffa-b7f5-cdb5e4c7ca9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:05:19.937667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8388eab-c1c2-4ffa-b7f5-cdb5e4c7ca9d service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:05:19.937958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8388eab-c1c2-4ffa-b7f5-cdb5e4c7ca9d service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:05:19.938272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8388eab-c1c2-4ffa-b7f5-cdb5e4c7ca9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:05:19.940087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c8388eab-c1c2-4ffa-b7f5-cdb5e4c7ca9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:05:19.955687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8388eab-c1c2-4ffa-b7f5-cdb5e4c7ca9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:05:19.957344 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8388eab-c1c2-4ffa-b7f5-cdb5e4c7ca9d service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:05:19.972815 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4342/8789] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:05:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:05:22.022209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8606a-8aae-40be-810e-a1d1811c328d service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:05:22.031311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8606a-8aae-40be-810e-a1d1811c328d service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:05:22.035028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2fa79-68c2-49fe-9f1f-b3e30db172d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:05:22.035697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2fa79-68c2-49fe-9f1f-b3e30db172d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:05:22.036012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2fa79-68c2-49fe-9f1f-b3e30db172d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:05:22.036292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2fa79-68c2-49fe-9f1f-b3e30db172d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:05:22.038041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-27a2fa79-68c2-49fe-9f1f-b3e30db172d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:05:22.123252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2fa79-68c2-49fe-9f1f-b3e30db172d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:05:22.124721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2fa79-68c2-49fe-9f1f-b3e30db172d1 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:05:22.143987 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4448/8790] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:05:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:05:29.964120 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=34 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:05:32.141320 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=43 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:07:05.876658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a59d6f-6304-485f-afc1-fdc2bbdbf9ac None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:07:05.877251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a59d6f-6304-485f-afc1-fdc2bbdbf9ac None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:07:05.877251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a59d6f-6304-485f-afc1-fdc2bbdbf9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:07:05.895416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e3a59d6f-6304-485f-afc1-fdc2bbdbf9ac None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:07:05.896616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e3a59d6f-6304-485f-afc1-fdc2bbdbf9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:07:05.906118 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4343/8791] 10.222.0.39 () {58 vars in 1015 bytes} [Tue Jul 19 15:07:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:07:05.933216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2fa79-68c2-49fe-9f1f-b3e30db172d1 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:07:05.948227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2fa79-68c2-49fe-9f1f-b3e30db172d1 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:07:05.953263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af075e80-360d-43bc-a62d-9d8647271a13 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:07:05.953913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af075e80-360d-43bc-a62d-9d8647271a13 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:07:05.954233 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af075e80-360d-43bc-a62d-9d8647271a13 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:07:05.954546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af075e80-360d-43bc-a62d-9d8647271a13 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:07:05.964504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af075e80-360d-43bc-a62d-9d8647271a13 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:07:05.966069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af075e80-360d-43bc-a62d-9d8647271a13 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:07:05.977609 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4449/8792] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:07:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:07:15.890203 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:07:15.972602 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:07:28.451178 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a59d6f-6304-485f-afc1-fdc2bbdbf9ac None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:07:28.467693 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a59d6f-6304-485f-afc1-fdc2bbdbf9ac None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:07:28.473676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdddd55-5c71-40fd-80a7-55db22fc8bbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:07:28.474562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdddd55-5c71-40fd-80a7-55db22fc8bbf service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:07:28.475003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdddd55-5c71-40fd-80a7-55db22fc8bbf service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:07:28.475285 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdddd55-5c71-40fd-80a7-55db22fc8bbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:07:28.477280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0bdddd55-5c71-40fd-80a7-55db22fc8bbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:07:28.495115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdddd55-5c71-40fd-80a7-55db22fc8bbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:07:28.496716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdddd55-5c71-40fd-80a7-55db22fc8bbf service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:07:28.511967 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4344/8793] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:07:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:07:28.934058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af075e80-360d-43bc-a62d-9d8647271a13 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:07:28.943768 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af075e80-360d-43bc-a62d-9d8647271a13 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:07:28.948103 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb04404-1a7e-4561-b9f9-2c62505caa7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:07:28.952240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb04404-1a7e-4561-b9f9-2c62505caa7b service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:07:28.952240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb04404-1a7e-4561-b9f9-2c62505caa7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:07:28.952240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb04404-1a7e-4561-b9f9-2c62505caa7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:07:28.952240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3cb04404-1a7e-4561-b9f9-2c62505caa7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:07:28.968439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb04404-1a7e-4561-b9f9-2c62505caa7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:07:28.970092 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb04404-1a7e-4561-b9f9-2c62505caa7b service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:07:28.985376 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4450/8794] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:07:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:07:30.183044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdddd55-5c71-40fd-80a7-55db22fc8bbf service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:07:30.192424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdddd55-5c71-40fd-80a7-55db22fc8bbf service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:07:30.196073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79612294-27fc-42e9-8820-6d256cf8693c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:07:30.196712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79612294-27fc-42e9-8820-6d256cf8693c service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:07:30.196997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79612294-27fc-42e9-8820-6d256cf8693c service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:07:30.197275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79612294-27fc-42e9-8820-6d256cf8693c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:07:30.199074 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-79612294-27fc-42e9-8820-6d256cf8693c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:07:30.215648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79612294-27fc-42e9-8820-6d256cf8693c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:07:30.221567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79612294-27fc-42e9-8820-6d256cf8693c service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:07:30.234026 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4345/8795] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:07:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:07:31.222304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb04404-1a7e-4561-b9f9-2c62505caa7b service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:07:31.236748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb04404-1a7e-4561-b9f9-2c62505caa7b service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:07:31.243709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22019767-8842-4a3c-bb54-1bfee361c04b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:07:31.244360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22019767-8842-4a3c-bb54-1bfee361c04b service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:07:31.244650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22019767-8842-4a3c-bb54-1bfee361c04b service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:07:31.244925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22019767-8842-4a3c-bb54-1bfee361c04b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:07:31.246780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-22019767-8842-4a3c-bb54-1bfee361c04b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:07:31.261624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22019767-8842-4a3c-bb54-1bfee361c04b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:07:31.263310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22019767-8842-4a3c-bb54-1bfee361c04b service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:07:31.277838 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4451/8796] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:07:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:07:40.225032 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=12 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:07:41.269478 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=12 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:07:49.954185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18695708-6824-4850-8af1-dc1ba68802ce None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:07:49.954756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18695708-6824-4850-8af1-dc1ba68802ce None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:07:49.954838 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18695708-6824-4850-8af1-dc1ba68802ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:07:49.973380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-18695708-6824-4850-8af1-dc1ba68802ce None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:07:49.974660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-18695708-6824-4850-8af1-dc1ba68802ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:07:49.983449 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4346/8797] 10.222.0.52 () {58 vars in 1015 bytes} [Tue Jul 19 15:07:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:07:49.995265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c4986-5ad7-4cc1-9e00-6ed9dff56f9d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:07:49.995711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c4986-5ad7-4cc1-9e00-6ed9dff56f9d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:07:49.995831 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c4986-5ad7-4cc1-9e00-6ed9dff56f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:07:50.014295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-4f5c4986-5ad7-4cc1-9e00-6ed9dff56f9d None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:07:50.015491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4f5c4986-5ad7-4cc1-9e00-6ed9dff56f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:07:50.024467 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4452/8798] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Jul 19 15:07:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:07:50.030671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18695708-6824-4850-8af1-dc1ba68802ce None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:07:50.041922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18695708-6824-4850-8af1-dc1ba68802ce None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:07:50.046996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb455ad-0138-4850-b2d3-6f0cde83788c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:07:50.047628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb455ad-0138-4850-b2d3-6f0cde83788c service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:07:50.047913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb455ad-0138-4850-b2d3-6f0cde83788c service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:07:50.048191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb455ad-0138-4850-b2d3-6f0cde83788c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:07:50.057491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb455ad-0138-4850-b2d3-6f0cde83788c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:07:50.059091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb455ad-0138-4850-b2d3-6f0cde83788c service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:07:50.068983 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4347/8799] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:07:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:07:55.138696 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c4986-5ad7-4cc1-9e00-6ed9dff56f9d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:07:55.148442 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c4986-5ad7-4cc1-9e00-6ed9dff56f9d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:07:55.153033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89372a6d-91bc-46fa-87a6-77bc652a7100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:07:55.153687 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89372a6d-91bc-46fa-87a6-77bc652a7100 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:07:55.153969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89372a6d-91bc-46fa-87a6-77bc652a7100 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:07:55.154277 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89372a6d-91bc-46fa-87a6-77bc652a7100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:07:55.156055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-89372a6d-91bc-46fa-87a6-77bc652a7100 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:07:55.167850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89372a6d-91bc-46fa-87a6-77bc652a7100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:07:55.169273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89372a6d-91bc-46fa-87a6-77bc652a7100 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:07:55.178971 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4453/8800] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:07:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:07:58.511133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5dba1-1d8c-41cf-8860-c734a6a6dea7 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:07:58.514373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5dba1-1d8c-41cf-8860-c734a6a6dea7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:07:58.514373 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5dba1-1d8c-41cf-8860-c734a6a6dea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:07:58.530183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e8b5dba1-1d8c-41cf-8860-c734a6a6dea7 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:07:58.531381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e8b5dba1-1d8c-41cf-8860-c734a6a6dea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:07:58.539978 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4348/8801] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Jul 19 15:07:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:07:58.547261 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89372a6d-91bc-46fa-87a6-77bc652a7100 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:07:58.559232 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89372a6d-91bc-46fa-87a6-77bc652a7100 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:07:58.564862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf58bfb-bc1b-4acc-b49f-e446126678f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:07:58.565522 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf58bfb-bc1b-4acc-b49f-e446126678f0 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:07:58.565806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf58bfb-bc1b-4acc-b49f-e446126678f0 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:07:58.566085 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf58bfb-bc1b-4acc-b49f-e446126678f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:07:58.567984 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9cf58bfb-bc1b-4acc-b49f-e446126678f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:07:58.583207 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf58bfb-bc1b-4acc-b49f-e446126678f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:07:58.584776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf58bfb-bc1b-4acc-b49f-e446126678f0 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:07:58.597583 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4454/8802] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:07:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:08:02.379292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5dba1-1d8c-41cf-8860-c734a6a6dea7 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:02.380720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e8b5dba1-1d8c-41cf-8860-c734a6a6dea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:02.397219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5dba1-1d8c-41cf-8860-c734a6a6dea7 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:02.400899 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5f99b-cabf-4a95-9286-39342399423a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:02.402215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5f99b-cabf-4a95-9286-39342399423a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:02.402504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5f99b-cabf-4a95-9286-39342399423a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:02.402787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5f99b-cabf-4a95-9286-39342399423a admin admin] PATH_INFO: `/v3/users/a572e84b1e57481fa882845e927983ec` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:02.403999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5f99b-cabf-4a95-9286-39342399423a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a572e84b1e57481fa882845e927983ec)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:02.405957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5f99b-cabf-4a95-9286-39342399423a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:02.591278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-25b5f99b-cabf-4a95-9286-39342399423a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a572e84b1e57481fa882845e927983ec'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:02.604577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-25b5f99b-cabf-4a95-9286-39342399423a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a572e84b1e57481fa882845e927983ec'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:02.605308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-25b5f99b-cabf-4a95-9286-39342399423a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a572e84b1e57481fa882845e927983ec'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:02.605962 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-25b5f99b-cabf-4a95-9286-39342399423a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a572e84b1e57481fa882845e927983ec'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:02.613537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-25b5f99b-cabf-4a95-9286-39342399423a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a572e84b1e57481fa882845e927983ec'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:02.691661 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4349/8803] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:08:02 2022] DELETE /identity/v3/users/a572e84b1e57481fa882845e927983ec => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:08:02.946013 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf58bfb-bc1b-4acc-b49f-e446126678f0 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:02.961562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf58bfb-bc1b-4acc-b49f-e446126678f0 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:03.027378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814cd34-744b-47e1-bc80-b662ec779f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:03.028257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814cd34-744b-47e1-bc80-b662ec779f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:03.028547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814cd34-744b-47e1-bc80-b662ec779f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:03.028829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814cd34-744b-47e1-bc80-b662ec779f64 admin admin] PATH_INFO: `/v3/projects/60be7513d86b491ab63fda935d3bd472` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:03.030028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814cd34-744b-47e1-bc80-b662ec779f64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60be7513d86b491ab63fda935d3bd472)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:03.032007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814cd34-744b-47e1-bc80-b662ec779f64 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:03.121171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4814cd34-744b-47e1-bc80-b662ec779f64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60be7513d86b491ab63fda935d3bd472', 'request_id': 'req-4814cd34-744b-47e1-bc80-b662ec779f64'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:03.127019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4814cd34-744b-47e1-bc80-b662ec779f64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60be7513d86b491ab63fda935d3bd472', 'request_id': 'req-4814cd34-744b-47e1-bc80-b662ec779f64'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:03.133236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4814cd34-744b-47e1-bc80-b662ec779f64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60be7513d86b491ab63fda935d3bd472', 'request_id': 'req-4814cd34-744b-47e1-bc80-b662ec779f64'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:03.200609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4814cd34-744b-47e1-bc80-b662ec779f64 admin admin] The token cache is being invalidate because project 60be7513d86b491ab63fda935d3bd472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:08:03.200834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4814cd34-744b-47e1-bc80-b662ec779f64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:03.201464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-4814cd34-744b-47e1-bc80-b662ec779f64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:03.203104 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4455/8804] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:08:02 2022] DELETE /identity/v3/projects/60be7513d86b491ab63fda935d3bd472 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:08:03.210520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5f99b-cabf-4a95-9286-39342399423a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:03.211942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-25b5f99b-cabf-4a95-9286-39342399423a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:03.225606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5f99b-cabf-4a95-9286-39342399423a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:03.282141 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5851d2b-bcf3-4a69-bb77-f8aead14a267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:03.283022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5851d2b-bcf3-4a69-bb77-f8aead14a267 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:03.283313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5851d2b-bcf3-4a69-bb77-f8aead14a267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:03.283595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5851d2b-bcf3-4a69-bb77-f8aead14a267 admin admin] PATH_INFO: `/v3/users/a07859e08c4c45d097d6ed0bb85ae5eb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:03.284799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5851d2b-bcf3-4a69-bb77-f8aead14a267 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07859e08c4c45d097d6ed0bb85ae5eb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:03.286757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5851d2b-bcf3-4a69-bb77-f8aead14a267 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:03.488562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e5851d2b-bcf3-4a69-bb77-f8aead14a267 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07859e08c4c45d097d6ed0bb85ae5eb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:03.489663 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:08:03.501831 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e5851d2b-bcf3-4a69-bb77-f8aead14a267 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07859e08c4c45d097d6ed0bb85ae5eb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:03.502527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e5851d2b-bcf3-4a69-bb77-f8aead14a267 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07859e08c4c45d097d6ed0bb85ae5eb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:03.503144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e5851d2b-bcf3-4a69-bb77-f8aead14a267 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07859e08c4c45d097d6ed0bb85ae5eb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:03.511001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e5851d2b-bcf3-4a69-bb77-f8aead14a267 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07859e08c4c45d097d6ed0bb85ae5eb'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:03.600486 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4350/8805] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:08:03 2022] DELETE /identity/v3/users/a07859e08c4c45d097d6ed0bb85ae5eb => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:08:03.840799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814cd34-744b-47e1-bc80-b662ec779f64 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:03.844057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4814cd34-744b-47e1-bc80-b662ec779f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:03.855924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814cd34-744b-47e1-bc80-b662ec779f64 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:03.910505 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:08:03.916531 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c84414-8681-40b4-8344-616cdf439c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:03.918623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c84414-8681-40b4-8344-616cdf439c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:03.918623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c84414-8681-40b4-8344-616cdf439c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:03.918623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c84414-8681-40b4-8344-616cdf439c1a admin admin] PATH_INFO: `/v3/projects/4ac6fc727cc544f4b8bc6b8fa743595c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:03.919171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c84414-8681-40b4-8344-616cdf439c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac6fc727cc544f4b8bc6b8fa743595c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:03.921083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c84414-8681-40b4-8344-616cdf439c1a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:04.035044 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a9c84414-8681-40b4-8344-616cdf439c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac6fc727cc544f4b8bc6b8fa743595c', 'request_id': 'req-a9c84414-8681-40b4-8344-616cdf439c1a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:04.040653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a9c84414-8681-40b4-8344-616cdf439c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac6fc727cc544f4b8bc6b8fa743595c', 'request_id': 'req-a9c84414-8681-40b4-8344-616cdf439c1a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:04.047032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a9c84414-8681-40b4-8344-616cdf439c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac6fc727cc544f4b8bc6b8fa743595c', 'request_id': 'req-a9c84414-8681-40b4-8344-616cdf439c1a'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:04.136217 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a9c84414-8681-40b4-8344-616cdf439c1a admin admin] The token cache is being invalidate because project 4ac6fc727cc544f4b8bc6b8fa743595c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:08:04.136402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a9c84414-8681-40b4-8344-616cdf439c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:04.136994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-a9c84414-8681-40b4-8344-616cdf439c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:04.138657 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4456/8806] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:08:03 2022] DELETE /identity/v3/projects/4ac6fc727cc544f4b8bc6b8fa743595c => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:08:13.674924 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=12,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:08:13.984504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89338a0c-f044-4cb2-ad19-7473a4890781 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:13.984716 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89338a0c-f044-4cb2-ad19-7473a4890781 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:13.985002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89338a0c-f044-4cb2-ad19-7473a4890781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:14.003603 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-89338a0c-f044-4cb2-ad19-7473a4890781 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:08:14.004802 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-89338a0c-f044-4cb2-ad19-7473a4890781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:14.065228 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4351/8807] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:08:14.074612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664e441-805d-48d9-933e-fe635954a916 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:14.075093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664e441-805d-48d9-933e-fe635954a916 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:14.075192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664e441-805d-48d9-933e-fe635954a916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:14.093513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c664e441-805d-48d9-933e-fe635954a916 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:08:14.094747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c664e441-805d-48d9-933e-fe635954a916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:14.102638 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4457/8808] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:08:14.108437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89338a0c-f044-4cb2-ad19-7473a4890781 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:14.118179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89338a0c-f044-4cb2-ad19-7473a4890781 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:14.123501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79d20b-82a8-45d2-a064-2ad8ad3b9615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:14.124154 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79d20b-82a8-45d2-a064-2ad8ad3b9615 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:14.124438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79d20b-82a8-45d2-a064-2ad8ad3b9615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:14.124713 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e79d20b-82a8-45d2-a064-2ad8ad3b9615 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:14.125433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79d20b-82a8-45d2-a064-2ad8ad3b9615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:08:14.125738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79d20b-82a8-45d2-a064-2ad8ad3b9615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:14.127354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e79d20b-82a8-45d2-a064-2ad8ad3b9615 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:14.139543 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4352/8809] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 15:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:08:14.151901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664e441-805d-48d9-933e-fe635954a916 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:14.161193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664e441-805d-48d9-933e-fe635954a916 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:14.166376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038ede7-ff59-477c-a3b4-3eea8dbe0f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:14.169089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038ede7-ff59-477c-a3b4-3eea8dbe0f12 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:14.169089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038ede7-ff59-477c-a3b4-3eea8dbe0f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:14.169089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038ede7-ff59-477c-a3b4-3eea8dbe0f12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:14.169089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038ede7-ff59-477c-a3b4-3eea8dbe0f12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:14.170136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038ede7-ff59-477c-a3b4-3eea8dbe0f12 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:14.282660 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4458/8810] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 15:08:14 2022] POST /identity/v3/projects => generated 393 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:08:14.286947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79d20b-82a8-45d2-a064-2ad8ad3b9615 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:14.297501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e79d20b-82a8-45d2-a064-2ad8ad3b9615 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:14.354469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba35f6-b147-4dbb-9107-342f2ad9c038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:14.355174 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba35f6-b147-4dbb-9107-342f2ad9c038 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:14.355465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba35f6-b147-4dbb-9107-342f2ad9c038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:14.355744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba35f6-b147-4dbb-9107-342f2ad9c038 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:14.356444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba35f6-b147-4dbb-9107-342f2ad9c038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:14.358387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba35f6-b147-4dbb-9107-342f2ad9c038 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:14.435612 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4353/8811] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 15:08:14 2022] POST /identity/v3/users => generated 297 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:08:14.439799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038ede7-ff59-477c-a3b4-3eea8dbe0f12 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:14.450666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038ede7-ff59-477c-a3b4-3eea8dbe0f12 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:14.455575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9826c-3194-4d04-a554-7a1d75d5de82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:14.456451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9826c-3194-4d04-a554-7a1d75d5de82 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:14.456614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9826c-3194-4d04-a554-7a1d75d5de82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:14.456896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9826c-3194-4d04-a554-7a1d75d5de82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:14.457627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9826c-3194-4d04-a554-7a1d75d5de82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:14.459271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c9826c-3194-4d04-a554-7a1d75d5de82 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:14.471486 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4459/8812] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:08:14.475645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba35f6-b147-4dbb-9107-342f2ad9c038 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:14.486643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba35f6-b147-4dbb-9107-342f2ad9c038 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:14.491308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217076b-b891-4580-aeb7-45104b5c5f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:14.492686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217076b-b891-4580-aeb7-45104b5c5f7c admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:14.492978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217076b-b891-4580-aeb7-45104b5c5f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:14.493452 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217076b-b891-4580-aeb7-45104b5c5f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:14.494259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217076b-b891-4580-aeb7-45104b5c5f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:14.495869 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217076b-b891-4580-aeb7-45104b5c5f7c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:14.507902 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4354/8813] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:08:14.511105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9826c-3194-4d04-a554-7a1d75d5de82 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:14.521650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c9826c-3194-4d04-a554-7a1d75d5de82 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:14.527733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef48f0-2fe8-4d5f-bb1f-c55abbe597ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:14.528613 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef48f0-2fe8-4d5f-bb1f-c55abbe597ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:14.528902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef48f0-2fe8-4d5f-bb1f-c55abbe597ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:14.529182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ef48f0-2fe8-4d5f-bb1f-c55abbe597ca admin admin] PATH_INFO: `/v3/projects/008f32b0f4eb4050a3e9d6d854f37010/users/0c4bd164a4904220b7b5f3558e717229/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:14.545376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef48f0-2fe8-4d5f-bb1f-c55abbe597ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=008f32b0f4eb4050a3e9d6d854f37010, user_id=0c4bd164a4904220b7b5f3558e717229, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:14.547983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ef48f0-2fe8-4d5f-bb1f-c55abbe597ca admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:14.622239 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4460/8814] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:08:14 2022] PUT /identity/v3/projects/008f32b0f4eb4050a3e9d6d854f37010/users/0c4bd164a4904220b7b5f3558e717229/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:08:14.635416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76189c-8a40-46e2-8528-322e639ae116 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:14.635711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76189c-8a40-46e2-8528-322e639ae116 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:14.635994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db76189c-8a40-46e2-8528-322e639ae116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:14.663322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-db76189c-8a40-46e2-8528-322e639ae116 None None] MFA Rules not processed for user `0c4bd164a4904220b7b5f3558e717229`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:08:14.664516 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-db76189c-8a40-46e2-8528-322e639ae116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:14.720321 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:08:14.729968 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4355/8815] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:08:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:08:14.734600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef48f0-2fe8-4d5f-bb1f-c55abbe597ca admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:14.796892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ef48f0-2fe8-4d5f-bb1f-c55abbe597ca admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:14.801628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e92e5-d0fb-47e9-8a79-7faaf05ce807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:14.802324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e92e5-d0fb-47e9-8a79-7faaf05ce807 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:14.802621 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e92e5-d0fb-47e9-8a79-7faaf05ce807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:14.802900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e92e5-d0fb-47e9-8a79-7faaf05ce807 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:14.803605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e92e5-d0fb-47e9-8a79-7faaf05ce807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:14.805529 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e92e5-d0fb-47e9-8a79-7faaf05ce807 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:14.869931 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4461/8816] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 15:08:14 2022] POST /identity/v3/projects => generated 393 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:08:14.874300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76189c-8a40-46e2-8528-322e639ae116 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:14.885768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db76189c-8a40-46e2-8528-322e639ae116 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:14.943019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf8ddc-40d5-4aa8-a57e-b509de27aac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:14.943700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf8ddc-40d5-4aa8-a57e-b509de27aac8 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:14.943993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf8ddc-40d5-4aa8-a57e-b509de27aac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:14.944279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf8ddc-40d5-4aa8-a57e-b509de27aac8 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:14.944992 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf8ddc-40d5-4aa8-a57e-b509de27aac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:14.947907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf8ddc-40d5-4aa8-a57e-b509de27aac8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:15.033660 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4356/8817] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 15:08:14 2022] POST /identity/v3/users => generated 303 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:08:15.037908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e92e5-d0fb-47e9-8a79-7faaf05ce807 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:15.048566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e92e5-d0fb-47e9-8a79-7faaf05ce807 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:15.053418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9d941-8dde-480f-a928-a75c71a3e3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:15.054115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9d941-8dde-480f-a928-a75c71a3e3c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:15.054419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9d941-8dde-480f-a928-a75c71a3e3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:15.054775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9d941-8dde-480f-a928-a75c71a3e3c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:15.055519 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9d941-8dde-480f-a928-a75c71a3e3c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:15.057311 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9d941-8dde-480f-a928-a75c71a3e3c0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:15.059474 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:08:15.068654 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4462/8818] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:08:15.073626 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf8ddc-40d5-4aa8-a57e-b509de27aac8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:15.083584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf8ddc-40d5-4aa8-a57e-b509de27aac8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:15.089346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f67ef-0877-4dc0-a63d-226b83a7a064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:15.090276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f67ef-0877-4dc0-a63d-226b83a7a064 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:15.090564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f67ef-0877-4dc0-a63d-226b83a7a064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:15.090884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f67ef-0877-4dc0-a63d-226b83a7a064 admin admin] PATH_INFO: `/v3/projects/328a150d57bd428a9e50af62a1bb8f1a/users/c9e77f1f525547d180c197a6a0fa0cf1/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:15.105984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f67ef-0877-4dc0-a63d-226b83a7a064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=328a150d57bd428a9e50af62a1bb8f1a, user_id=c9e77f1f525547d180c197a6a0fa0cf1, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:15.108704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f67ef-0877-4dc0-a63d-226b83a7a064 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:15.188393 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4357/8819] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:08:15 2022] PUT /identity/v3/projects/328a150d57bd428a9e50af62a1bb8f1a/users/c9e77f1f525547d180c197a6a0fa0cf1/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:08:15.192381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9d941-8dde-480f-a928-a75c71a3e3c0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:15.203432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9d941-8dde-480f-a928-a75c71a3e3c0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:15.261772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d73bb3-61a6-4128-847a-f25e116789b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:15.262518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d73bb3-61a6-4128-847a-f25e116789b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:15.262804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d73bb3-61a6-4128-847a-f25e116789b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:15.263079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d73bb3-61a6-4128-847a-f25e116789b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:15.263834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d73bb3-61a6-4128-847a-f25e116789b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:15.265504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d73bb3-61a6-4128-847a-f25e116789b8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:15.276015 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4463/8820] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:08:15.280118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f67ef-0877-4dc0-a63d-226b83a7a064 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:15.290563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f67ef-0877-4dc0-a63d-226b83a7a064 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:15.295144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0b084-c4b1-4f0f-8957-0b567161e59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:15.296016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0b084-c4b1-4f0f-8957-0b567161e59d admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:15.296384 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0b084-c4b1-4f0f-8957-0b567161e59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:15.296623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0b084-c4b1-4f0f-8957-0b567161e59d admin admin] PATH_INFO: `/v3/projects/328a150d57bd428a9e50af62a1bb8f1a/users/c9e77f1f525547d180c197a6a0fa0cf1/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:15.298808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0b084-c4b1-4f0f-8957-0b567161e59d admin admin] RBAC: Authorizing `identity:create_grant(project_id=328a150d57bd428a9e50af62a1bb8f1a, user_id=c9e77f1f525547d180c197a6a0fa0cf1, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:15.301351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0b084-c4b1-4f0f-8957-0b567161e59d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:15.312224 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4358/8821] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:08:15 2022] PUT /identity/v3/projects/328a150d57bd428a9e50af62a1bb8f1a/users/c9e77f1f525547d180c197a6a0fa0cf1/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:08:15.323576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6fb87-ba2c-4cb3-8f77-eec0cc55f801 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:15.323868 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6fb87-ba2c-4cb3-8f77-eec0cc55f801 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:15.324160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa6fb87-ba2c-4cb3-8f77-eec0cc55f801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:15.350405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6aa6fb87-ba2c-4cb3-8f77-eec0cc55f801 None None] MFA Rules not processed for user `c9e77f1f525547d180c197a6a0fa0cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:08:15.351596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6aa6fb87-ba2c-4cb3-8f77-eec0cc55f801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:15.420994 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4464/8822] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:08:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:08:15.433453 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cf47d-dcbd-4c75-83d8-0394d1d970ed None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:15.433751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cf47d-dcbd-4c75-83d8-0394d1d970ed None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:15.434031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76cf47d-dcbd-4c75-83d8-0394d1d970ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:15.452378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c76cf47d-dcbd-4c75-83d8-0394d1d970ed None None] MFA Rules not processed for user `0c4bd164a4904220b7b5f3558e717229`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:08:15.453569 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c76cf47d-dcbd-4c75-83d8-0394d1d970ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:15.507709 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4359/8823] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:08:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:08:15.521677 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6fb87-ba2c-4cb3-8f77-eec0cc55f801 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:15.523112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6aa6fb87-ba2c-4cb3-8f77-eec0cc55f801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:15.599584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa6fb87-ba2c-4cb3-8f77-eec0cc55f801 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:15.605632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee72370-8f9a-40b3-8dc3-1e07ec54e44a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:15.606322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee72370-8f9a-40b3-8dc3-1e07ec54e44a service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:15.606610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee72370-8f9a-40b3-8dc3-1e07ec54e44a service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:15.606888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee72370-8f9a-40b3-8dc3-1e07ec54e44a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:15.614834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee72370-8f9a-40b3-8dc3-1e07ec54e44a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:15.616524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee72370-8f9a-40b3-8dc3-1e07ec54e44a service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:15.627086 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4465/8824] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:08:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:08:16.199670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cf47d-dcbd-4c75-83d8-0394d1d970ed None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:16.201079 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c76cf47d-dcbd-4c75-83d8-0394d1d970ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:16.266143 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:08:16.283444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76cf47d-dcbd-4c75-83d8-0394d1d970ed None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:16.288306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ab9ff0-4512-4080-bb7b-d2365565611d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:16.288957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab9ff0-4512-4080-bb7b-d2365565611d service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:16.289244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab9ff0-4512-4080-bb7b-d2365565611d service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:16.289525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ab9ff0-4512-4080-bb7b-d2365565611d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:16.291423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-56ab9ff0-4512-4080-bb7b-d2365565611d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:16.302494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab9ff0-4512-4080-bb7b-d2365565611d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:16.304359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ab9ff0-4512-4080-bb7b-d2365565611d service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:16.314740 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4360/8825] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:08:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:08:25.622734 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:08:26.341772 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=8 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:08:28.133778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee72370-8f9a-40b3-8dc3-1e07ec54e44a service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:28.147949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee72370-8f9a-40b3-8dc3-1e07ec54e44a service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:28.154028 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095122c-2984-4e7d-9a75-c4609fd92293 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:28.154693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095122c-2984-4e7d-9a75-c4609fd92293 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:28.154978 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095122c-2984-4e7d-9a75-c4609fd92293 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:28.155254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095122c-2984-4e7d-9a75-c4609fd92293 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:28.164189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095122c-2984-4e7d-9a75-c4609fd92293 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:28.165791 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095122c-2984-4e7d-9a75-c4609fd92293 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:28.176509 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4466/8826] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:08:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:08:28.191158 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693c69f-5b57-4ed4-a7b7-c45ee1bd22b0 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:28.193654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693c69f-5b57-4ed4-a7b7-c45ee1bd22b0 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:28.193654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a693c69f-5b57-4ed4-a7b7-c45ee1bd22b0 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:28.193654 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4361/8827] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 15:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:08:28.198396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095122c-2984-4e7d-9a75-c4609fd92293 service nova] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 15:08:28.212746 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095122c-2984-4e7d-9a75-c4609fd92293 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:28.221484 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095122c-2984-4e7d-9a75-c4609fd92293 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:28.226951 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ebcad-f9b3-4c82-a69f-74fb2dbadab3 tempest-ServersAdminNegativeTestJSON-1784278288 tempest-ServersAdminNegativeTestJSON-1784278288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e77f1f525547d180c197a6a0fa0cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328a150d57bd428a9e50af62a1bb8f1a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:28.227812 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ebcad-f9b3-4c82-a69f-74fb2dbadab3 tempest-ServersAdminNegativeTestJSON-1784278288 tempest-ServersAdminNegativeTestJSON-1784278288-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:28.228099 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ebcad-f9b3-4c82-a69f-74fb2dbadab3 tempest-ServersAdminNegativeTestJSON-1784278288 tempest-ServersAdminNegativeTestJSON-1784278288-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:28.228380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ebcad-f9b3-4c82-a69f-74fb2dbadab3 tempest-ServersAdminNegativeTestJSON-1784278288 tempest-ServersAdminNegativeTestJSON-1784278288-project-admin] PATH_INFO: `/v3/projects/328a150d57bd428a9e50af62a1bb8f1a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:28.229570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ebcad-f9b3-4c82-a69f-74fb2dbadab3 tempest-ServersAdminNegativeTestJSON-1784278288 tempest-ServersAdminNegativeTestJSON-1784278288-project-admin] RBAC: Authorizing `identity:get_project(project_id=328a150d57bd428a9e50af62a1bb8f1a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:28.231398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ebcad-f9b3-4c82-a69f-74fb2dbadab3 tempest-ServersAdminNegativeTestJSON-1784278288 tempest-ServersAdminNegativeTestJSON-1784278288-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:28.233273 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4467/8828] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 15:08:28 2022] GET /identity/v3/projects/328a150d57bd428a9e50af62a1bb8f1a => generated 393 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:08:28.644260 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9217e1-db73-4690-8de3-f1e53fdc0d17 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:28.644551 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9217e1-db73-4690-8de3-f1e53fdc0d17 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:28.644849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9217e1-db73-4690-8de3-f1e53fdc0d17 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:28.646312 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4362/8829] 10.222.0.43 () {54 vars in 912 bytes} [Tue Jul 19 15:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:08:28.651163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ebcad-f9b3-4c82-a69f-74fb2dbadab3 tempest-ServersAdminNegativeTestJSON-1784278288 tempest-ServersAdminNegativeTestJSON-1784278288-project-admin] Authenticating service token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 15:08:28.653148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-862ebcad-f9b3-4c82-a69f-74fb2dbadab3 tempest-ServersAdminNegativeTestJSON-1784278288 tempest-ServersAdminNegativeTestJSON-1784278288-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:28.673328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ebcad-f9b3-4c82-a69f-74fb2dbadab3 tempest-ServersAdminNegativeTestJSON-1784278288 tempest-ServersAdminNegativeTestJSON-1784278288-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:28.681991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ebcad-f9b3-4c82-a69f-74fb2dbadab3 tempest-ServersAdminNegativeTestJSON-1784278288 tempest-ServersAdminNegativeTestJSON-1784278288-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:28.686590 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae04471-362a-42b0-a9d6-42d724eba974 tempest-ServersAdminNegativeTestJSON-1784278288 tempest-ServersAdminNegativeTestJSON-1784278288-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9e77f1f525547d180c197a6a0fa0cf1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '328a150d57bd428a9e50af62a1bb8f1a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:28.687487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae04471-362a-42b0-a9d6-42d724eba974 tempest-ServersAdminNegativeTestJSON-1784278288 tempest-ServersAdminNegativeTestJSON-1784278288-project-admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:28.687827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae04471-362a-42b0-a9d6-42d724eba974 tempest-ServersAdminNegativeTestJSON-1784278288 tempest-ServersAdminNegativeTestJSON-1784278288-project-admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:28.688111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae04471-362a-42b0-a9d6-42d724eba974 tempest-ServersAdminNegativeTestJSON-1784278288 tempest-ServersAdminNegativeTestJSON-1784278288-project-admin] PATH_INFO: `/v3/projects/328a150d57bd428a9e50af62a1bb8f1a` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:28.689310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae04471-362a-42b0-a9d6-42d724eba974 tempest-ServersAdminNegativeTestJSON-1784278288 tempest-ServersAdminNegativeTestJSON-1784278288-project-admin] RBAC: Authorizing `identity:get_project(project_id=328a150d57bd428a9e50af62a1bb8f1a)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:28.691131 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae04471-362a-42b0-a9d6-42d724eba974 tempest-ServersAdminNegativeTestJSON-1784278288 tempest-ServersAdminNegativeTestJSON-1784278288-project-admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:28.692824 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4468/8830] 10.222.0.43 () {58 vars in 1443 bytes} [Tue Jul 19 15:08:28 2022] GET /identity/v3/projects/328a150d57bd428a9e50af62a1bb8f1a => generated 393 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:08:28.893052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9217e1-db73-4690-8de3-f1e53fdc0d17 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:28.894842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fa9217e1-db73-4690-8de3-f1e53fdc0d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:28.952935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9217e1-db73-4690-8de3-f1e53fdc0d17 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:28.957150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7e6b0-028c-4248-92f6-8b4c9ec0a207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:28.957804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7e6b0-028c-4248-92f6-8b4c9ec0a207 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:28.958119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7e6b0-028c-4248-92f6-8b4c9ec0a207 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:28.958431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7e6b0-028c-4248-92f6-8b4c9ec0a207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:28.960182 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aea7e6b0-028c-4248-92f6-8b4c9ec0a207 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:28.972718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7e6b0-028c-4248-92f6-8b4c9ec0a207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:28.974176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea7e6b0-028c-4248-92f6-8b4c9ec0a207 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:28.984554 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4363/8831] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:08:28 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:08:32.969503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae04471-362a-42b0-a9d6-42d724eba974 tempest-ServersAdminNegativeTestJSON-1784278288 tempest-ServersAdminNegativeTestJSON-1784278288-project-admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:33.032771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae04471-362a-42b0-a9d6-42d724eba974 tempest-ServersAdminNegativeTestJSON-1784278288 tempest-ServersAdminNegativeTestJSON-1784278288-project-admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:33.037383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0dccf1-6cd7-4bcf-9ba5-1e81a6748ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:33.038292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dccf1-6cd7-4bcf-9ba5-1e81a6748ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:33.038583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dccf1-6cd7-4bcf-9ba5-1e81a6748ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:33.038924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dccf1-6cd7-4bcf-9ba5-1e81a6748ae0 admin admin] PATH_INFO: `/v3/users/0c4bd164a4904220b7b5f3558e717229` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:33.040121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0dccf1-6cd7-4bcf-9ba5-1e81a6748ae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c4bd164a4904220b7b5f3558e717229)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:33.042042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0dccf1-6cd7-4bcf-9ba5-1e81a6748ae0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:33.220775 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b0dccf1-6cd7-4bcf-9ba5-1e81a6748ae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c4bd164a4904220b7b5f3558e717229'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:33.232916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b0dccf1-6cd7-4bcf-9ba5-1e81a6748ae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c4bd164a4904220b7b5f3558e717229'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:33.240045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b0dccf1-6cd7-4bcf-9ba5-1e81a6748ae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c4bd164a4904220b7b5f3558e717229'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:33.240763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b0dccf1-6cd7-4bcf-9ba5-1e81a6748ae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c4bd164a4904220b7b5f3558e717229'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:33.303174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7b0dccf1-6cd7-4bcf-9ba5-1e81a6748ae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c4bd164a4904220b7b5f3558e717229'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:33.309549 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4469/8832] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:08:32 2022] DELETE /identity/v3/users/0c4bd164a4904220b7b5f3558e717229 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:08:33.314909 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1831c-ee51-48ef-a1df-0bf9eaa88a46 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:33.315399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1831c-ee51-48ef-a1df-0bf9eaa88a46 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:33.315501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1831c-ee51-48ef-a1df-0bf9eaa88a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:33.333030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-7bc1831c-ee51-48ef-a1df-0bf9eaa88a46 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:08:33.334264 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7bc1831c-ee51-48ef-a1df-0bf9eaa88a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:33.393374 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4364/8833] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:08:33.403447 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0dccf1-6cd7-4bcf-9ba5-1e81a6748ae0 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:33.404855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7b0dccf1-6cd7-4bcf-9ba5-1e81a6748ae0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:33.459349 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:08:33.462813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0dccf1-6cd7-4bcf-9ba5-1e81a6748ae0 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:33.466466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab09dae-3349-4bba-879e-ff2346a697be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:33.467864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab09dae-3349-4bba-879e-ff2346a697be service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:33.467864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab09dae-3349-4bba-879e-ff2346a697be service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:33.467864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab09dae-3349-4bba-879e-ff2346a697be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:33.476909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab09dae-3349-4bba-879e-ff2346a697be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:33.478317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab09dae-3349-4bba-879e-ff2346a697be service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:33.488549 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4470/8834] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:08:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:08:33.730844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1831c-ee51-48ef-a1df-0bf9eaa88a46 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:33.730844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-7bc1831c-ee51-48ef-a1df-0bf9eaa88a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:33.743530 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1831c-ee51-48ef-a1df-0bf9eaa88a46 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:33.749506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e93f9-9481-4b56-99a7-2962c63a40c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:33.750775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e93f9-9481-4b56-99a7-2962c63a40c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:33.753822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e93f9-9481-4b56-99a7-2962c63a40c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:33.753822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e93f9-9481-4b56-99a7-2962c63a40c7 admin admin] PATH_INFO: `/v3/projects/008f32b0f4eb4050a3e9d6d854f37010` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:33.753822 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e93f9-9481-4b56-99a7-2962c63a40c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=008f32b0f4eb4050a3e9d6d854f37010)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:33.755375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e93f9-9481-4b56-99a7-2962c63a40c7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:33.846980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce4e93f9-9481-4b56-99a7-2962c63a40c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '008f32b0f4eb4050a3e9d6d854f37010', 'request_id': 'req-ce4e93f9-9481-4b56-99a7-2962c63a40c7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:33.909755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce4e93f9-9481-4b56-99a7-2962c63a40c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '008f32b0f4eb4050a3e9d6d854f37010', 'request_id': 'req-ce4e93f9-9481-4b56-99a7-2962c63a40c7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:33.916478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce4e93f9-9481-4b56-99a7-2962c63a40c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '008f32b0f4eb4050a3e9d6d854f37010', 'request_id': 'req-ce4e93f9-9481-4b56-99a7-2962c63a40c7'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:33.928164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce4e93f9-9481-4b56-99a7-2962c63a40c7 admin admin] The token cache is being invalidate because project 008f32b0f4eb4050a3e9d6d854f37010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:08:33.928481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce4e93f9-9481-4b56-99a7-2962c63a40c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:33.929150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ce4e93f9-9481-4b56-99a7-2962c63a40c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:33.930755 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4365/8835] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:08:33 2022] DELETE /identity/v3/projects/008f32b0f4eb4050a3e9d6d854f37010 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:08:33.935317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab09dae-3349-4bba-879e-ff2346a697be service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:33.951157 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab09dae-3349-4bba-879e-ff2346a697be service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:34.024817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69017679-7e7e-4a18-a454-96c62bca13b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:34.024817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69017679-7e7e-4a18-a454-96c62bca13b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:34.024817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69017679-7e7e-4a18-a454-96c62bca13b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:34.024817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69017679-7e7e-4a18-a454-96c62bca13b0 admin admin] PATH_INFO: `/v3/users/c9e77f1f525547d180c197a6a0fa0cf1` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:34.025709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69017679-7e7e-4a18-a454-96c62bca13b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e77f1f525547d180c197a6a0fa0cf1)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:34.025709 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69017679-7e7e-4a18-a454-96c62bca13b0 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:34.227321 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-69017679-7e7e-4a18-a454-96c62bca13b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e77f1f525547d180c197a6a0fa0cf1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:34.239451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-69017679-7e7e-4a18-a454-96c62bca13b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e77f1f525547d180c197a6a0fa0cf1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:34.246319 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-69017679-7e7e-4a18-a454-96c62bca13b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e77f1f525547d180c197a6a0fa0cf1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:34.247004 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-69017679-7e7e-4a18-a454-96c62bca13b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e77f1f525547d180c197a6a0fa0cf1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:34.308977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-69017679-7e7e-4a18-a454-96c62bca13b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e77f1f525547d180c197a6a0fa0cf1'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:34.315832 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4471/8836] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:08:33 2022] DELETE /identity/v3/users/c9e77f1f525547d180c197a6a0fa0cf1 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:08:34.756316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e93f9-9481-4b56-99a7-2962c63a40c7 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:34.757786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ce4e93f9-9481-4b56-99a7-2962c63a40c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:34.770993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e93f9-9481-4b56-99a7-2962c63a40c7 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:34.796254 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:08:34.827873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa2c98-7ecc-403e-8ce7-b590fc9fa919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:34.828647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa2c98-7ecc-403e-8ce7-b590fc9fa919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:34.828930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa2c98-7ecc-403e-8ce7-b590fc9fa919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:34.829203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa2c98-7ecc-403e-8ce7-b590fc9fa919 admin admin] PATH_INFO: `/v3/projects/328a150d57bd428a9e50af62a1bb8f1a` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:34.831042 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa2c98-7ecc-403e-8ce7-b590fc9fa919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=328a150d57bd428a9e50af62a1bb8f1a)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:34.832928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa2c98-7ecc-403e-8ce7-b590fc9fa919 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:34.949198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9afa2c98-7ecc-403e-8ce7-b590fc9fa919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '328a150d57bd428a9e50af62a1bb8f1a', 'request_id': 'req-9afa2c98-7ecc-403e-8ce7-b590fc9fa919'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:35.028642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9afa2c98-7ecc-403e-8ce7-b590fc9fa919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '328a150d57bd428a9e50af62a1bb8f1a', 'request_id': 'req-9afa2c98-7ecc-403e-8ce7-b590fc9fa919'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:35.035980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9afa2c98-7ecc-403e-8ce7-b590fc9fa919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '328a150d57bd428a9e50af62a1bb8f1a', 'request_id': 'req-9afa2c98-7ecc-403e-8ce7-b590fc9fa919'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:35.046895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9afa2c98-7ecc-403e-8ce7-b590fc9fa919 admin admin] The token cache is being invalidate because project 328a150d57bd428a9e50af62a1bb8f1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:08:35.047197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9afa2c98-7ecc-403e-8ce7-b590fc9fa919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:35.047844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-9afa2c98-7ecc-403e-8ce7-b590fc9fa919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:08:35.049435 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4366/8837] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:08:34 2022] DELETE /identity/v3/projects/328a150d57bd428a9e50af62a1bb8f1a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:08:35.055530 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd3bcc-893b-485c-b16e-70597974ed2f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:35.056003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd3bcc-893b-485c-b16e-70597974ed2f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:35.056137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd3bcc-893b-485c-b16e-70597974ed2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:35.073998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-74bd3bcc-893b-485c-b16e-70597974ed2f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:08:35.075234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-74bd3bcc-893b-485c-b16e-70597974ed2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:35.133294 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4472/8838] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:08:35.141536 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c21ea4-b5a4-4d83-b281-5f7abceeaed3 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:35.141826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c21ea4-b5a4-4d83-b281-5f7abceeaed3 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:35.142628 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c21ea4-b5a4-4d83-b281-5f7abceeaed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:35.162388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e4c21ea4-b5a4-4d83-b281-5f7abceeaed3 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:08:35.163671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e4c21ea4-b5a4-4d83-b281-5f7abceeaed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:35.171539 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4367/8839] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:08:35.176178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd3bcc-893b-485c-b16e-70597974ed2f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:35.186130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd3bcc-893b-485c-b16e-70597974ed2f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:35.191350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c2642-1d02-41cc-99bf-40247272af63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:35.192010 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c2642-1d02-41cc-99bf-40247272af63 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:35.192296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c2642-1d02-41cc-99bf-40247272af63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:35.192575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c2642-1d02-41cc-99bf-40247272af63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:35.193333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c2642-1d02-41cc-99bf-40247272af63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:08:35.193642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c2642-1d02-41cc-99bf-40247272af63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:35.195301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c2642-1d02-41cc-99bf-40247272af63 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:35.201979 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:08:35.208969 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4473/8840] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 15:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:08:35.215185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c21ea4-b5a4-4d83-b281-5f7abceeaed3 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:35.225268 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c21ea4-b5a4-4d83-b281-5f7abceeaed3 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:35.230047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdba578-c363-490c-8a03-066eab1b6960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:35.234286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdba578-c363-490c-8a03-066eab1b6960 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:35.234286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdba578-c363-490c-8a03-066eab1b6960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:35.234286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdba578-c363-490c-8a03-066eab1b6960 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:35.234286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdba578-c363-490c-8a03-066eab1b6960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:35.234286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdba578-c363-490c-8a03-066eab1b6960 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:35.310391 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4368/8841] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 15:08:35 2022] POST /identity/v3/projects => generated 379 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:08:35.315209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c2642-1d02-41cc-99bf-40247272af63 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:35.325274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c2642-1d02-41cc-99bf-40247272af63 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:35.381196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6812f-d62f-42ff-bf08-e25b930d8977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:35.381869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6812f-d62f-42ff-bf08-e25b930d8977 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:35.382189 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6812f-d62f-42ff-bf08-e25b930d8977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:35.382475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6812f-d62f-42ff-bf08-e25b930d8977 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:35.383159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6812f-d62f-42ff-bf08-e25b930d8977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:35.385122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6812f-d62f-42ff-bf08-e25b930d8977 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:35.463105 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4474/8842] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 15:08:35 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:08:35.467382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdba578-c363-490c-8a03-066eab1b6960 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:35.477943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdba578-c363-490c-8a03-066eab1b6960 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:35.482606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113a036-99c5-4575-a3b6-ed9bbb01c078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:35.483267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113a036-99c5-4575-a3b6-ed9bbb01c078 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:35.483557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113a036-99c5-4575-a3b6-ed9bbb01c078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:35.483839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113a036-99c5-4575-a3b6-ed9bbb01c078 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:35.484601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113a036-99c5-4575-a3b6-ed9bbb01c078 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:35.486296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113a036-99c5-4575-a3b6-ed9bbb01c078 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:35.496716 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4369/8843] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:08:35.500533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6812f-d62f-42ff-bf08-e25b930d8977 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:35.511036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6812f-d62f-42ff-bf08-e25b930d8977 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:35.515646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd69f86-93cb-453f-92fe-44233ddad2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:35.516300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd69f86-93cb-453f-92fe-44233ddad2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:35.516585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd69f86-93cb-453f-92fe-44233ddad2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:35.516861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd69f86-93cb-453f-92fe-44233ddad2d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:35.518423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd69f86-93cb-453f-92fe-44233ddad2d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:35.520014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd69f86-93cb-453f-92fe-44233ddad2d4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:35.530349 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4475/8844] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:08:35.534876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113a036-99c5-4575-a3b6-ed9bbb01c078 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:35.544873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113a036-99c5-4575-a3b6-ed9bbb01c078 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:35.549988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d23953-e3ec-47ce-af18-0a42db4672c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:35.550904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d23953-e3ec-47ce-af18-0a42db4672c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:35.551191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d23953-e3ec-47ce-af18-0a42db4672c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:35.551469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d23953-e3ec-47ce-af18-0a42db4672c6 admin admin] PATH_INFO: `/v3/projects/53972aacaef54420b303eb48c6d8b721/users/a1b4b63474534bfb8b612d23530c738b/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:35.567866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d23953-e3ec-47ce-af18-0a42db4672c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53972aacaef54420b303eb48c6d8b721, user_id=a1b4b63474534bfb8b612d23530c738b, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:35.570625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d23953-e3ec-47ce-af18-0a42db4672c6 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:35.644210 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4370/8845] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:08:35 2022] PUT /identity/v3/projects/53972aacaef54420b303eb48c6d8b721/users/a1b4b63474534bfb8b612d23530c738b/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:08:35.646624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a304fd-cd99-40d4-96f1-2a51e7c07a80 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:35.646919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a304fd-cd99-40d4-96f1-2a51e7c07a80 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:35.647203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a304fd-cd99-40d4-96f1-2a51e7c07a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:35.666741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-07a304fd-cd99-40d4-96f1-2a51e7c07a80 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:08:35.667958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-07a304fd-cd99-40d4-96f1-2a51e7c07a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:35.729701 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4476/8846] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:08:35.740134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d23953-e3ec-47ce-af18-0a42db4672c6 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:35.741876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-74d23953-e3ec-47ce-af18-0a42db4672c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:35.800670 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d23953-e3ec-47ce-af18-0a42db4672c6 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:35.804306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe8595-3696-4880-8b86-5e54e0b5eb47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:35.804950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe8595-3696-4880-8b86-5e54e0b5eb47 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:35.805235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe8595-3696-4880-8b86-5e54e0b5eb47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:35.805512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe8595-3696-4880-8b86-5e54e0b5eb47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:35.812387 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:08:35.814858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe8595-3696-4880-8b86-5e54e0b5eb47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:35.816294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe8595-3696-4880-8b86-5e54e0b5eb47 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:35.825985 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4371/8847] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:08:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:08:41.431003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c99136-7d6e-48da-aead-ee7190d73a2a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:41.431471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c99136-7d6e-48da-aead-ee7190d73a2a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:41.431576 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c99136-7d6e-48da-aead-ee7190d73a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:41.466887 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-05c99136-7d6e-48da-aead-ee7190d73a2a None None] MFA Rules not processed for user `a1b4b63474534bfb8b612d23530c738b`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:08:41.468431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-05c99136-7d6e-48da-aead-ee7190d73a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:41.552484 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4477/8848] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:08:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:08:41.566291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58a778-38f7-4bd8-87a3-13477881d791 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:41.567200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58a778-38f7-4bd8-87a3-13477881d791 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:41.567480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58a778-38f7-4bd8-87a3-13477881d791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:41.586776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1c58a778-38f7-4bd8-87a3-13477881d791 None None] MFA Rules not processed for user `a1b4b63474534bfb8b612d23530c738b`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:08:41.588253 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1c58a778-38f7-4bd8-87a3-13477881d791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:41.595553 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4372/8849] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:08:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:08:41.610213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c99136-7d6e-48da-aead-ee7190d73a2a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:41.612284 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-05c99136-7d6e-48da-aead-ee7190d73a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:41.623583 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:08:41.699526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c99136-7d6e-48da-aead-ee7190d73a2a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:41.705224 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821faf58-2795-43fb-a873-5a3c9b02adee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:41.705882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821faf58-2795-43fb-a873-5a3c9b02adee service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:41.706197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821faf58-2795-43fb-a873-5a3c9b02adee service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:41.706477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821faf58-2795-43fb-a873-5a3c9b02adee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:41.714371 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821faf58-2795-43fb-a873-5a3c9b02adee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:41.715966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821faf58-2795-43fb-a873-5a3c9b02adee service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:41.725302 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4478/8850] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:08:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:08:45.364302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58a778-38f7-4bd8-87a3-13477881d791 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:45.365919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1c58a778-38f7-4bd8-87a3-13477881d791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:45.386367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58a778-38f7-4bd8-87a3-13477881d791 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:45.386367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a25c2-784b-4e9b-9f93-3f9fccfa837e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:45.386367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a25c2-784b-4e9b-9f93-3f9fccfa837e service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:45.386367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a25c2-784b-4e9b-9f93-3f9fccfa837e service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:45.386702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a25c2-784b-4e9b-9f93-3f9fccfa837e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:45.386702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-485a25c2-784b-4e9b-9f93-3f9fccfa837e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:45.400069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a25c2-784b-4e9b-9f93-3f9fccfa837e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:45.401504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a25c2-784b-4e9b-9f93-3f9fccfa837e service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:45.413163 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4373/8851] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:08:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:08:51.722486 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=31 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:08:54.419144 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821faf58-2795-43fb-a873-5a3c9b02adee service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:54.430039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821faf58-2795-43fb-a873-5a3c9b02adee service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:54.433670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0623bb2c-dd74-4b9d-80f8-af43affecf4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:54.434343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623bb2c-dd74-4b9d-80f8-af43affecf4b service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:54.434631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623bb2c-dd74-4b9d-80f8-af43affecf4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:54.434910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0623bb2c-dd74-4b9d-80f8-af43affecf4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:54.436710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0623bb2c-dd74-4b9d-80f8-af43affecf4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:54.453948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623bb2c-dd74-4b9d-80f8-af43affecf4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:54.455454 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0623bb2c-dd74-4b9d-80f8-af43affecf4b service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:54.466670 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4479/8852] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:08:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:08:54.633471 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b26b46-3d21-47fc-bd33-5dffce0d2048 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:54.634005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b26b46-3d21-47fc-bd33-5dffce0d2048 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:54.634005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b26b46-3d21-47fc-bd33-5dffce0d2048 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:54.635538 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4374/8853] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 15:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:08:54.640554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d81b0-c49e-410c-a76b-e1a3d6ae6d1d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:54.640849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d81b0-c49e-410c-a76b-e1a3d6ae6d1d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:54.641132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d81b0-c49e-410c-a76b-e1a3d6ae6d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:54.660897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2f9d81b0-c49e-410c-a76b-e1a3d6ae6d1d None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:08:54.662172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2f9d81b0-c49e-410c-a76b-e1a3d6ae6d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:54.729400 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4480/8854] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 15:08:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:08:54.750491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b26b46-3d21-47fc-bd33-5dffce0d2048 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:54.752177 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c6b26b46-3d21-47fc-bd33-5dffce0d2048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:54.768755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b26b46-3d21-47fc-bd33-5dffce0d2048 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:54.773650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeeddbb-79b3-42fb-a7ca-63e42d91e8aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:54.774333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeeddbb-79b3-42fb-a7ca-63e42d91e8aa service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:54.774726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeeddbb-79b3-42fb-a7ca-63e42d91e8aa service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:54.775013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeeddbb-79b3-42fb-a7ca-63e42d91e8aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:54.783571 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeeddbb-79b3-42fb-a7ca-63e42d91e8aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:54.785667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeeddbb-79b3-42fb-a7ca-63e42d91e8aa service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:54.795372 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4375/8855] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:08:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:08:55.061223 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d81b0-c49e-410c-a76b-e1a3d6ae6d1d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:08:55.071643 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d81b0-c49e-410c-a76b-e1a3d6ae6d1d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:08:55.075324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab001ab5-b8b9-45f2-be8d-2a852b0e4e7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:08:55.075981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab001ab5-b8b9-45f2-be8d-2a852b0e4e7a service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:08:55.076273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab001ab5-b8b9-45f2-be8d-2a852b0e4e7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:08:55.076558 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab001ab5-b8b9-45f2-be8d-2a852b0e4e7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:08:55.078373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ab001ab5-b8b9-45f2-be8d-2a852b0e4e7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:08:55.094938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab001ab5-b8b9-45f2-be8d-2a852b0e4e7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:08:55.096365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab001ab5-b8b9-45f2-be8d-2a852b0e4e7a service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:08:55.110666 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4481/8856] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:08:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:09:04.791360 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=17 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:09:05.103289 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=41 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:09:19.258816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea1da1-f71c-4caa-9fed-5026d8c343b7 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:19.259368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea1da1-f71c-4caa-9fed-5026d8c343b7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:19.259368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea1da1-f71c-4caa-9fed-5026d8c343b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:19.304543 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6aea1da1-f71c-4caa-9fed-5026d8c343b7 None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:09:19.305737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6aea1da1-f71c-4caa-9fed-5026d8c343b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:09:19.332640 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4376/8857] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Jul 19 15:09:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:09:22.838219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54667f-17bd-41ad-92bc-0e94239d9ca1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:22.838707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54667f-17bd-41ad-92bc-0e94239d9ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:22.838811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54667f-17bd-41ad-92bc-0e94239d9ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:22.857373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2a54667f-17bd-41ad-92bc-0e94239d9ca1 None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:09:22.858627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2a54667f-17bd-41ad-92bc-0e94239d9ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:09:22.867937 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4482/8858] 10.222.0.43 () {58 vars in 1059 bytes} [Tue Jul 19 15:09:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:09:26.383756 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596250e0-3ab5-49c6-950b-4f43ccdeee56 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:26.384281 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596250e0-3ab5-49c6-950b-4f43ccdeee56 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:26.384412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596250e0-3ab5-49c6-950b-4f43ccdeee56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:26.404408 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-596250e0-3ab5-49c6-950b-4f43ccdeee56 None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:09:26.405587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-596250e0-3ab5-49c6-950b-4f43ccdeee56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:09:26.414755 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4377/8859] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 15:09:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:09:26.425414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54667f-17bd-41ad-92bc-0e94239d9ca1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:09:26.434825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54667f-17bd-41ad-92bc-0e94239d9ca1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:09:26.438555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3d471-c018-4f49-b660-a235a51aa7bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:09:26.439196 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3d471-c018-4f49-b660-a235a51aa7bf service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:26.439482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3d471-c018-4f49-b660-a235a51aa7bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:26.439763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3d471-c018-4f49-b660-a235a51aa7bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:26.450399 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3d471-c018-4f49-b660-a235a51aa7bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:09:26.451828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3d471-c018-4f49-b660-a235a51aa7bf service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:09:26.462574 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4483/8860] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:09:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:09:29.969613 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a30abe-7f92-43f8-aad9-cb01d4bf76a3 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:29.972843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a30abe-7f92-43f8-aad9-cb01d4bf76a3 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:29.972843 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a30abe-7f92-43f8-aad9-cb01d4bf76a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:29.989388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-45a30abe-7f92-43f8-aad9-cb01d4bf76a3 None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:09:29.990648 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-45a30abe-7f92-43f8-aad9-cb01d4bf76a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:09:30.000434 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4378/8861] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 15:09:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:09:30.056743 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3d471-c018-4f49-b660-a235a51aa7bf service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:09:30.065463 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3d471-c018-4f49-b660-a235a51aa7bf service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:09:30.069187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6d7e0-d20a-4702-a151-98c6445c6092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:09:30.069958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6d7e0-d20a-4702-a151-98c6445c6092 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:30.070289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6d7e0-d20a-4702-a151-98c6445c6092 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:30.070568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6d7e0-d20a-4702-a151-98c6445c6092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:30.081611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6d7e0-d20a-4702-a151-98c6445c6092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:09:30.083082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6d7e0-d20a-4702-a151-98c6445c6092 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:09:30.094840 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4484/8862] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:09:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:09:39.984056 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=27 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:09:40.089314 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=15 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:09:43.371738 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a30abe-7f92-43f8-aad9-cb01d4bf76a3 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:09:43.392922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a30abe-7f92-43f8-aad9-cb01d4bf76a3 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:09:43.397575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6296ecd-d764-4546-89d5-acb1c52517dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:09:43.398486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6296ecd-d764-4546-89d5-acb1c52517dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:43.398779 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6296ecd-d764-4546-89d5-acb1c52517dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:43.399061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6296ecd-d764-4546-89d5-acb1c52517dd admin admin] PATH_INFO: `/v3/users/a1b4b63474534bfb8b612d23530c738b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:43.400262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6296ecd-d764-4546-89d5-acb1c52517dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b4b63474534bfb8b612d23530c738b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:09:43.402722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6296ecd-d764-4546-89d5-acb1c52517dd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:09:43.578744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6296ecd-d764-4546-89d5-acb1c52517dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b4b63474534bfb8b612d23530c738b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:09:43.590903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6296ecd-d764-4546-89d5-acb1c52517dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b4b63474534bfb8b612d23530c738b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:09:43.591584 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6296ecd-d764-4546-89d5-acb1c52517dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b4b63474534bfb8b612d23530c738b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:09:43.592231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6296ecd-d764-4546-89d5-acb1c52517dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b4b63474534bfb8b612d23530c738b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:09:43.599185 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-f6296ecd-d764-4546-89d5-acb1c52517dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b4b63474534bfb8b612d23530c738b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:09:43.719921 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4379/8863] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:09:43 2022] DELETE /identity/v3/users/a1b4b63474534bfb8b612d23530c738b => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:09:43.978305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6d7e0-d20a-4702-a151-98c6445c6092 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:09:44.000337 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6d7e0-d20a-4702-a151-98c6445c6092 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:09:44.061977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52a187-54d5-473b-88b8-7403ad559fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:09:44.062945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52a187-54d5-473b-88b8-7403ad559fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:44.063234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52a187-54d5-473b-88b8-7403ad559fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:44.063518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52a187-54d5-473b-88b8-7403ad559fc4 admin admin] PATH_INFO: `/v3/projects/53972aacaef54420b303eb48c6d8b721` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:44.064755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52a187-54d5-473b-88b8-7403ad559fc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53972aacaef54420b303eb48c6d8b721)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:09:44.066711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52a187-54d5-473b-88b8-7403ad559fc4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:09:44.173931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7c52a187-54d5-473b-88b8-7403ad559fc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53972aacaef54420b303eb48c6d8b721', 'request_id': 'req-7c52a187-54d5-473b-88b8-7403ad559fc4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:09:44.179990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7c52a187-54d5-473b-88b8-7403ad559fc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53972aacaef54420b303eb48c6d8b721', 'request_id': 'req-7c52a187-54d5-473b-88b8-7403ad559fc4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:09:44.187110 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7c52a187-54d5-473b-88b8-7403ad559fc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53972aacaef54420b303eb48c6d8b721', 'request_id': 'req-7c52a187-54d5-473b-88b8-7403ad559fc4'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:09:44.257666 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7c52a187-54d5-473b-88b8-7403ad559fc4 admin admin] The token cache is being invalidate because project 53972aacaef54420b303eb48c6d8b721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:09:44.257958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7c52a187-54d5-473b-88b8-7403ad559fc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:09:44.258678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-7c52a187-54d5-473b-88b8-7403ad559fc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:09:44.260711 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4485/8864] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:09:43 2022] DELETE /identity/v3/projects/53972aacaef54420b303eb48c6d8b721 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:09:44.267056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dda2d3-4440-4d61-85de-f9c32e881735 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:44.267434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dda2d3-4440-4d61-85de-f9c32e881735 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:44.269828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dda2d3-4440-4d61-85de-f9c32e881735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:44.289894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-03dda2d3-4440-4d61-85de-f9c32e881735 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:09:44.291130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-03dda2d3-4440-4d61-85de-f9c32e881735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:09:44.351811 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4380/8865] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:09:44.360318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fc891-d5ad-4ba4-8e27-b12310c89937 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:44.360602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fc891-d5ad-4ba4-8e27-b12310c89937 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:44.360908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49fc891-d5ad-4ba4-8e27-b12310c89937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:44.379990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b49fc891-d5ad-4ba4-8e27-b12310c89937 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:09:44.381192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b49fc891-d5ad-4ba4-8e27-b12310c89937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:09:44.389547 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4486/8866] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:09:44.393836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dda2d3-4440-4d61-85de-f9c32e881735 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:09:44.403942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dda2d3-4440-4d61-85de-f9c32e881735 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:09:44.408539 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8147b3-16a2-470d-9101-42045b14ca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:09:44.409198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8147b3-16a2-470d-9101-42045b14ca4f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:44.409486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8147b3-16a2-470d-9101-42045b14ca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:44.409771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8147b3-16a2-470d-9101-42045b14ca4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:44.410534 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8147b3-16a2-470d-9101-42045b14ca4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:09:44.410848 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8147b3-16a2-470d-9101-42045b14ca4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:09:44.412437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8147b3-16a2-470d-9101-42045b14ca4f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:09:44.425096 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4381/8867] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 15:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:09:44.428761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fc891-d5ad-4ba4-8e27-b12310c89937 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:09:44.439396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49fc891-d5ad-4ba4-8e27-b12310c89937 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:09:44.444074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cb42c-956f-4095-8fbf-5e14d6d62e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:09:44.444722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cb42c-956f-4095-8fbf-5e14d6d62e18 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:44.445007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cb42c-956f-4095-8fbf-5e14d6d62e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:44.445282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58cb42c-956f-4095-8fbf-5e14d6d62e18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:44.445977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cb42c-956f-4095-8fbf-5e14d6d62e18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:09:44.447898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58cb42c-956f-4095-8fbf-5e14d6d62e18 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:09:44.549365 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4487/8868] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 15:09:44 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:09:44.553764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8147b3-16a2-470d-9101-42045b14ca4f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:09:44.564769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8147b3-16a2-470d-9101-42045b14ca4f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:09:44.612409 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:09:44.621810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ed82c-dc78-4333-8a37-e194fcfa7565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:09:44.625407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ed82c-dc78-4333-8a37-e194fcfa7565 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:44.625407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ed82c-dc78-4333-8a37-e194fcfa7565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:44.625407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ed82c-dc78-4333-8a37-e194fcfa7565 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:44.625407 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ed82c-dc78-4333-8a37-e194fcfa7565 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:09:44.625799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ed82c-dc78-4333-8a37-e194fcfa7565 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:09:44.696530 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4382/8869] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 15:09:44 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:09:44.700758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cb42c-956f-4095-8fbf-5e14d6d62e18 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:09:44.711313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58cb42c-956f-4095-8fbf-5e14d6d62e18 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:09:44.717422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5491d5f-b27b-48c5-b2c9-80c36fdbea43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:09:44.718115 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5491d5f-b27b-48c5-b2c9-80c36fdbea43 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:44.718400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5491d5f-b27b-48c5-b2c9-80c36fdbea43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:44.718689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5491d5f-b27b-48c5-b2c9-80c36fdbea43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:44.719452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5491d5f-b27b-48c5-b2c9-80c36fdbea43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:09:44.721094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5491d5f-b27b-48c5-b2c9-80c36fdbea43 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:09:44.732811 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4488/8870] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:09:44.736808 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ed82c-dc78-4333-8a37-e194fcfa7565 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:09:44.746832 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ed82c-dc78-4333-8a37-e194fcfa7565 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:09:44.752165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5901873-ec97-49c0-9570-8fd096bbd2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:09:44.752836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5901873-ec97-49c0-9570-8fd096bbd2fe admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:44.753129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5901873-ec97-49c0-9570-8fd096bbd2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:44.753417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5901873-ec97-49c0-9570-8fd096bbd2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:44.754186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5901873-ec97-49c0-9570-8fd096bbd2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:09:44.755790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5901873-ec97-49c0-9570-8fd096bbd2fe admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:09:44.765975 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4383/8871] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:09:44.769980 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5491d5f-b27b-48c5-b2c9-80c36fdbea43 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:09:44.780649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5491d5f-b27b-48c5-b2c9-80c36fdbea43 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:09:44.785254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae6ace-f542-4534-992d-c63c45ea2f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:09:44.786145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae6ace-f542-4534-992d-c63c45ea2f7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:44.786433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae6ace-f542-4534-992d-c63c45ea2f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:44.786723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae6ace-f542-4534-992d-c63c45ea2f7f admin admin] PATH_INFO: `/v3/projects/5601d2727c2244ff8f26c9c902107c30/users/dc63e414c6884d4482b7930b296ed703/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:44.802019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae6ace-f542-4534-992d-c63c45ea2f7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5601d2727c2244ff8f26c9c902107c30, user_id=dc63e414c6884d4482b7930b296ed703, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:09:44.804663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae6ace-f542-4534-992d-c63c45ea2f7f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:09:44.862488 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4489/8872] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:09:44 2022] PUT /identity/v3/projects/5601d2727c2244ff8f26c9c902107c30/users/dc63e414c6884d4482b7930b296ed703/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:09:44.867564 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796b7d8-0f3d-45c5-9064-08415117cfc0 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:44.867858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796b7d8-0f3d-45c5-9064-08415117cfc0 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:44.868143 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796b7d8-0f3d-45c5-9064-08415117cfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:44.886076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1796b7d8-0f3d-45c5-9064-08415117cfc0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:09:44.887275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1796b7d8-0f3d-45c5-9064-08415117cfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:09:44.947199 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4384/8873] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:09:44.957483 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae6ace-f542-4534-992d-c63c45ea2f7f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:09:44.959287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a8ae6ace-f542-4534-992d-c63c45ea2f7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:09:44.984122 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:09:45.033844 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae6ace-f542-4534-992d-c63c45ea2f7f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:09:45.037583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74f961-c239-413e-9a3f-424b238c548d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:09:45.038616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74f961-c239-413e-9a3f-424b238c548d service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:45.039122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74f961-c239-413e-9a3f-424b238c548d service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:45.039769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74f961-c239-413e-9a3f-424b238c548d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:45.049737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74f961-c239-413e-9a3f-424b238c548d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:09:45.051211 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74f961-c239-413e-9a3f-424b238c548d service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:09:45.060823 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4490/8874] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:09:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:09:50.214695 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6e522-d7e0-43db-be85-258edcbfd24c None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:50.215482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6e522-d7e0-43db-be85-258edcbfd24c None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:50.215482 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6e522-d7e0-43db-be85-258edcbfd24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:50.253324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c4a6e522-d7e0-43db-be85-258edcbfd24c None None] MFA Rules not processed for user `dc63e414c6884d4482b7930b296ed703`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:09:50.254898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c4a6e522-d7e0-43db-be85-258edcbfd24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:09:50.327323 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4385/8875] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:09:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:09:50.337946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf007074-aca5-4765-99df-f2d9534d1d95 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:50.338512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf007074-aca5-4765-99df-f2d9534d1d95 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:50.338603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf007074-aca5-4765-99df-f2d9534d1d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:50.359664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-bf007074-aca5-4765-99df-f2d9534d1d95 None None] MFA Rules not processed for user `dc63e414c6884d4482b7930b296ed703`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:09:50.361067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bf007074-aca5-4765-99df-f2d9534d1d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:09:50.368390 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4491/8876] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:09:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:09:50.382587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6e522-d7e0-43db-be85-258edcbfd24c None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:09:50.384000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c4a6e522-d7e0-43db-be85-258edcbfd24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:09:50.452988 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:09:50.469656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6e522-d7e0-43db-be85-258edcbfd24c None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:09:50.475572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254042d-4786-44e1-b25a-52a9735103c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:09:50.476287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254042d-4786-44e1-b25a-52a9735103c2 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:50.476616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254042d-4786-44e1-b25a-52a9735103c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:50.476897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254042d-4786-44e1-b25a-52a9735103c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:50.486542 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254042d-4786-44e1-b25a-52a9735103c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:09:50.488187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254042d-4786-44e1-b25a-52a9735103c2 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:09:50.499025 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4386/8877] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:09:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:09:54.239141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076fc31-f6f1-43bb-bfe2-1939d1749d07 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:54.239711 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076fc31-f6f1-43bb-bfe2-1939d1749d07 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:54.239804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076fc31-f6f1-43bb-bfe2-1939d1749d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:54.259415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-1076fc31-f6f1-43bb-bfe2-1939d1749d07 None None] MFA Rules not processed for user `e997b70d7158446daa1dfa225eb7afca`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:09:54.260632 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1076fc31-f6f1-43bb-bfe2-1939d1749d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:09:54.268587 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4492/8878] 10.222.0.39 () {58 vars in 1015 bytes} [Tue Jul 19 15:09:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:09:54.291635 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254042d-4786-44e1-b25a-52a9735103c2 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:09:54.293109 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e254042d-4786-44e1-b25a-52a9735103c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:09:54.305597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254042d-4786-44e1-b25a-52a9735103c2 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:09:54.309294 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb999ab-0ad4-4b3a-86a2-c08729e5e316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:09:54.309950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb999ab-0ad4-4b3a-86a2-c08729e5e316 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:09:54.310395 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb999ab-0ad4-4b3a-86a2-c08729e5e316 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:09:54.310737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb999ab-0ad4-4b3a-86a2-c08729e5e316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:09:54.318259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb999ab-0ad4-4b3a-86a2-c08729e5e316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:09:54.319696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb999ab-0ad4-4b3a-86a2-c08729e5e316 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:09:54.328308 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4387/8879] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:09:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:10:01.108438 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e574185-db39-48f3-a22d-805ce7d17fd7 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:10:01.108915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e574185-db39-48f3-a22d-805ce7d17fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:10:01.109041 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e574185-db39-48f3-a22d-805ce7d17fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:10:01.140579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9e574185-db39-48f3-a22d-805ce7d17fd7 None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:10:01.140579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9e574185-db39-48f3-a22d-805ce7d17fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:10:01.149699 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4493/8880] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 15:10:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:10:01.162705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb999ab-0ad4-4b3a-86a2-c08729e5e316 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:10:01.169308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6eb999ab-0ad4-4b3a-86a2-c08729e5e316 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:10:01.181107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb999ab-0ad4-4b3a-86a2-c08729e5e316 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:10:01.187478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a16f163-857d-4655-ad3c-f85125e9edee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:10:01.188137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16f163-857d-4655-ad3c-f85125e9edee service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:10:01.188423 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16f163-857d-4655-ad3c-f85125e9edee service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:10:01.188703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a16f163-857d-4655-ad3c-f85125e9edee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:10:01.199341 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16f163-857d-4655-ad3c-f85125e9edee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:10:01.200932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a16f163-857d-4655-ad3c-f85125e9edee service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:10:01.218802 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4388/8881] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:10:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:10:04.166694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079cfbd-4d02-4227-8943-aa8a33e89828 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:10:04.167175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079cfbd-4d02-4227-8943-aa8a33e89828 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:10:04.167425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079cfbd-4d02-4227-8943-aa8a33e89828 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:10:04.168857 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4494/8882] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 15:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:10:04.174658 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738efb1-dc67-40bf-9623-caed577a89c4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:10:04.175155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738efb1-dc67-40bf-9623-caed577a89c4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:10:04.181982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738efb1-dc67-40bf-9623-caed577a89c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:10:04.205487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6738efb1-dc67-40bf-9623-caed577a89c4 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:10:04.206719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6738efb1-dc67-40bf-9623-caed577a89c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:10:04.271202 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4389/8883] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 15:10:04 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:10:04.292548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079cfbd-4d02-4227-8943-aa8a33e89828 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:10:04.294318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8079cfbd-4d02-4227-8943-aa8a33e89828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:10:04.311721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079cfbd-4d02-4227-8943-aa8a33e89828 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:10:04.316918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc9cd4-298b-46e6-ad68-79591fbd0a2a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:10:04.317559 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9cd4-298b-46e6-ad68-79591fbd0a2a service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:10:04.317849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9cd4-298b-46e6-ad68-79591fbd0a2a service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:10:04.318162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc9cd4-298b-46e6-ad68-79591fbd0a2a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:10:04.326548 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc9cd4-298b-46e6-ad68-79591fbd0a2a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:10:04.328121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc9cd4-298b-46e6-ad68-79591fbd0a2a service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:10:04.337923 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4495/8884] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:10:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:10:14.262238 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=52 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:10:14.333786 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=43 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:10:34.644290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c809039-a115-45b3-845a-b30de299139b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:10:34.644876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c809039-a115-45b3-845a-b30de299139b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:10:34.644876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c809039-a115-45b3-845a-b30de299139b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:10:34.693697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6c809039-a115-45b3-845a-b30de299139b None None] MFA Rules not processed for user `e997b70d7158446daa1dfa225eb7afca`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:10:34.694861 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6c809039-a115-45b3-845a-b30de299139b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:10:34.701384 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4390/8885] 10.222.0.52 () {58 vars in 1015 bytes} [Tue Jul 19 15:10:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:10:34.715060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc9cd4-298b-46e6-ad68-79591fbd0a2a service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:10:34.725350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc9cd4-298b-46e6-ad68-79591fbd0a2a service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:10:34.728954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181cfb7-c835-4a68-b8e1-66f54a5b3cc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:10:34.730263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181cfb7-c835-4a68-b8e1-66f54a5b3cc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:10:34.730575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181cfb7-c835-4a68-b8e1-66f54a5b3cc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:10:34.730843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181cfb7-c835-4a68-b8e1-66f54a5b3cc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:10:34.738175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181cfb7-c835-4a68-b8e1-66f54a5b3cc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:10:34.739603 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181cfb7-c835-4a68-b8e1-66f54a5b3cc9 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:10:34.747526 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4496/8886] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:10:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:10:35.139329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ec81b-3655-4805-ab52-af68bc8d3335 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:10:35.139587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ec81b-3655-4805-ab52-af68bc8d3335 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:10:35.139870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ec81b-3655-4805-ab52-af68bc8d3335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:10:35.160468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-1c4ec81b-3655-4805-ab52-af68bc8d3335 None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:10:35.161671 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-1c4ec81b-3655-4805-ab52-af68bc8d3335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:10:35.170952 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4391/8887] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 15:10:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:10:35.183720 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181cfb7-c835-4a68-b8e1-66f54a5b3cc9 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:10:35.197179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181cfb7-c835-4a68-b8e1-66f54a5b3cc9 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:10:35.202684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d70d8-301e-4861-8c7e-a2d9cc5f655f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:10:35.203329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d70d8-301e-4861-8c7e-a2d9cc5f655f service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:10:35.203616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d70d8-301e-4861-8c7e-a2d9cc5f655f service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:10:35.203897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d70d8-301e-4861-8c7e-a2d9cc5f655f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:10:35.214032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d70d8-301e-4861-8c7e-a2d9cc5f655f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:10:35.215667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d70d8-301e-4861-8c7e-a2d9cc5f655f service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:10:35.226635 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4497/8888] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:10:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:10:44.910312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd9b9b-b8d3-4df1-9c4d-f391c0be84f7 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:10:44.910312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd9b9b-b8d3-4df1-9c4d-f391c0be84f7 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:10:44.910312 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd9b9b-b8d3-4df1-9c4d-f391c0be84f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:10:44.926850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d9cd9b9b-b8d3-4df1-9c4d-f391c0be84f7 None None] MFA Rules not processed for user `dc63e414c6884d4482b7930b296ed703`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:10:44.928150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d9cd9b9b-b8d3-4df1-9c4d-f391c0be84f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:10:44.937247 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4392/8889] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:10:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:10:45.180236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e8be7-6067-485e-b842-c9f9e9f357d2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:10:45.180727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e8be7-6067-485e-b842-c9f9e9f357d2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:10:45.180818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e8be7-6067-485e-b842-c9f9e9f357d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:10:45.199014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-443e8be7-6067-485e-b842-c9f9e9f357d2 None None] MFA Rules not processed for user `e997b70d7158446daa1dfa225eb7afca`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:10:45.200259 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-443e8be7-6067-485e-b842-c9f9e9f357d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:10:45.212413 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4498/8890] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 15:10:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:10:45.224919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd9b9b-b8d3-4df1-9c4d-f391c0be84f7 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:10:45.235807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd9b9b-b8d3-4df1-9c4d-f391c0be84f7 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:10:45.239743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4ef68a-2d4d-4932-99d2-6883a3f76bde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:10:45.240390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ef68a-2d4d-4932-99d2-6883a3f76bde service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:10:45.240674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ef68a-2d4d-4932-99d2-6883a3f76bde service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:10:45.240973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4ef68a-2d4d-4932-99d2-6883a3f76bde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:10:45.248743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ef68a-2d4d-4932-99d2-6883a3f76bde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:10:45.250216 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4ef68a-2d4d-4932-99d2-6883a3f76bde service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:10:45.258683 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4393/8891] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:10:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:10:45.660755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e8be7-6067-485e-b842-c9f9e9f357d2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:10:45.662204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-443e8be7-6067-485e-b842-c9f9e9f357d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:10:45.677450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e8be7-6067-485e-b842-c9f9e9f357d2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:10:45.682501 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec595a5f-4a6c-4b03-9e17-5fa97fc24b45 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:10:45.683160 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec595a5f-4a6c-4b03-9e17-5fa97fc24b45 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:10:45.683448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec595a5f-4a6c-4b03-9e17-5fa97fc24b45 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:10:45.683728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec595a5f-4a6c-4b03-9e17-5fa97fc24b45 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:10:45.685525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ec595a5f-4a6c-4b03-9e17-5fa97fc24b45 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:10:45.698130 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec595a5f-4a6c-4b03-9e17-5fa97fc24b45 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:10:45.699734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec595a5f-4a6c-4b03-9e17-5fa97fc24b45 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:10:45.710994 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4499/8892] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:10:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:10:55.255009 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=26 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:10:55.705650 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=21 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:10:57.139821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86151b6a-e4bc-49c1-8c2b-ab611b9e0cd9 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:10:57.140347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86151b6a-e4bc-49c1-8c2b-ab611b9e0cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:10:57.140877 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86151b6a-e4bc-49c1-8c2b-ab611b9e0cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:10:57.159431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-86151b6a-e4bc-49c1-8c2b-ab611b9e0cd9 None None] MFA Rules not processed for user `e997b70d7158446daa1dfa225eb7afca`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:10:57.160855 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-86151b6a-e4bc-49c1-8c2b-ab611b9e0cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:10:57.167429 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4394/8893] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 15:10:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:10:57.179544 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec595a5f-4a6c-4b03-9e17-5fa97fc24b45 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:10:57.188800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec595a5f-4a6c-4b03-9e17-5fa97fc24b45 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:10:57.193089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90adc648-a28d-4c1a-818f-7b792befe35c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:10:57.193731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adc648-a28d-4c1a-818f-7b792befe35c service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:10:57.194019 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adc648-a28d-4c1a-818f-7b792befe35c service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:10:57.194407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90adc648-a28d-4c1a-818f-7b792befe35c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:10:57.201420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90adc648-a28d-4c1a-818f-7b792befe35c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:10:57.202897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90adc648-a28d-4c1a-818f-7b792befe35c service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:10:57.211177 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4500/8894] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:10:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:10:57.358673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45728ca7-fb88-4c19-a4b5-d52583090a66 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:10:57.358955 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45728ca7-fb88-4c19-a4b5-d52583090a66 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:10:57.359241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45728ca7-fb88-4c19-a4b5-d52583090a66 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:10:57.360663 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4395/8895] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 15:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:10:57.366579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b769c-2634-4454-9aae-3fe3633614dd None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:10:57.366876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b769c-2634-4454-9aae-3fe3633614dd None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:10:57.367158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b769c-2634-4454-9aae-3fe3633614dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:10:57.386003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b55b769c-2634-4454-9aae-3fe3633614dd None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:10:57.387292 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b55b769c-2634-4454-9aae-3fe3633614dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:10:57.396099 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4501/8896] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 15:10:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:10:57.416766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45728ca7-fb88-4c19-a4b5-d52583090a66 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:10:57.431475 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45728ca7-fb88-4c19-a4b5-d52583090a66 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:10:57.436412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb996c-d3e0-4393-96f6-c640b972c31e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:10:57.437080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb996c-d3e0-4393-96f6-c640b972c31e service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:10:57.437371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb996c-d3e0-4393-96f6-c640b972c31e service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:10:57.437655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb996c-d3e0-4393-96f6-c640b972c31e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:10:57.446192 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb996c-d3e0-4393-96f6-c640b972c31e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:10:57.447767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb996c-d3e0-4393-96f6-c640b972c31e service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:10:57.457858 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4396/8897] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:10:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:11:07.381251 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=9 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:11:07.453516 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=9 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:11:46.546453 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b769c-2634-4454-9aae-3fe3633614dd None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:11:46.558179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b769c-2634-4454-9aae-3fe3633614dd None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:11:46.562836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e23d3-c4c6-4a44-91c1-fc18b5512344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:11:46.563804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e23d3-c4c6-4a44-91c1-fc18b5512344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:11:46.564094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e23d3-c4c6-4a44-91c1-fc18b5512344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:11:46.564400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e23d3-c4c6-4a44-91c1-fc18b5512344 admin admin] PATH_INFO: `/v3/users/dc63e414c6884d4482b7930b296ed703` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:11:46.565591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e23d3-c4c6-4a44-91c1-fc18b5512344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc63e414c6884d4482b7930b296ed703)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:11:46.567540 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e23d3-c4c6-4a44-91c1-fc18b5512344 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:11:46.720345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-624e23d3-c4c6-4a44-91c1-fc18b5512344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc63e414c6884d4482b7930b296ed703'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:11:46.733083 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-624e23d3-c4c6-4a44-91c1-fc18b5512344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc63e414c6884d4482b7930b296ed703'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:11:46.740188 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-624e23d3-c4c6-4a44-91c1-fc18b5512344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc63e414c6884d4482b7930b296ed703'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:11:46.740916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-624e23d3-c4c6-4a44-91c1-fc18b5512344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc63e414c6884d4482b7930b296ed703'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:11:46.786480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-624e23d3-c4c6-4a44-91c1-fc18b5512344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc63e414c6884d4482b7930b296ed703'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:11:46.792965 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4502/8898] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:11:46 2022] DELETE /identity/v3/users/dc63e414c6884d4482b7930b296ed703 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:11:47.029614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb996c-d3e0-4393-96f6-c640b972c31e service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:11:47.051134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb996c-d3e0-4393-96f6-c640b972c31e service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:11:47.111750 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab0cca-889e-4ab8-8874-bfb39b6dda89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:11:47.112627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab0cca-889e-4ab8-8874-bfb39b6dda89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:11:47.112918 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab0cca-889e-4ab8-8874-bfb39b6dda89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:11:47.113197 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab0cca-889e-4ab8-8874-bfb39b6dda89 admin admin] PATH_INFO: `/v3/projects/5601d2727c2244ff8f26c9c902107c30` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:11:47.114421 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab0cca-889e-4ab8-8874-bfb39b6dda89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5601d2727c2244ff8f26c9c902107c30)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:11:47.116324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab0cca-889e-4ab8-8874-bfb39b6dda89 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:11:47.201214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-66ab0cca-889e-4ab8-8874-bfb39b6dda89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5601d2727c2244ff8f26c9c902107c30', 'request_id': 'req-66ab0cca-889e-4ab8-8874-bfb39b6dda89'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:11:47.244301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-66ab0cca-889e-4ab8-8874-bfb39b6dda89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5601d2727c2244ff8f26c9c902107c30', 'request_id': 'req-66ab0cca-889e-4ab8-8874-bfb39b6dda89'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:11:47.251953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-66ab0cca-889e-4ab8-8874-bfb39b6dda89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5601d2727c2244ff8f26c9c902107c30', 'request_id': 'req-66ab0cca-889e-4ab8-8874-bfb39b6dda89'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:11:47.262814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-66ab0cca-889e-4ab8-8874-bfb39b6dda89 admin admin] The token cache is being invalidate because project 5601d2727c2244ff8f26c9c902107c30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:11:47.263100 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-66ab0cca-889e-4ab8-8874-bfb39b6dda89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:11:47.263853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-66ab0cca-889e-4ab8-8874-bfb39b6dda89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:11:47.265437 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4397/8899] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:11:47 2022] DELETE /identity/v3/projects/5601d2727c2244ff8f26c9c902107c30 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:11:47.270513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588295d-d5a6-4985-b1c7-8ae4f15467f2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:11:47.270810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588295d-d5a6-4985-b1c7-8ae4f15467f2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:11:47.271094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588295d-d5a6-4985-b1c7-8ae4f15467f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:11:47.290281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b588295d-d5a6-4985-b1c7-8ae4f15467f2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:11:47.291541 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b588295d-d5a6-4985-b1c7-8ae4f15467f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:11:47.350712 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4503/8900] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:11:47.358410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673f827-791e-4c63-ac05-d96c1edcae49 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:11:47.358705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673f827-791e-4c63-ac05-d96c1edcae49 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:11:47.358989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673f827-791e-4c63-ac05-d96c1edcae49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:11:47.377552 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0673f827-791e-4c63-ac05-d96c1edcae49 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:11:47.378786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0673f827-791e-4c63-ac05-d96c1edcae49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:11:47.387570 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4398/8901] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:11:47.391904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588295d-d5a6-4985-b1c7-8ae4f15467f2 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:11:47.401830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588295d-d5a6-4985-b1c7-8ae4f15467f2 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:11:47.406764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e75995-fcae-40b8-8fd2-1d8bfdf1340b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:11:47.407419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e75995-fcae-40b8-8fd2-1d8bfdf1340b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:11:47.407707 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e75995-fcae-40b8-8fd2-1d8bfdf1340b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:11:47.407988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e75995-fcae-40b8-8fd2-1d8bfdf1340b admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:11:47.408713 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e75995-fcae-40b8-8fd2-1d8bfdf1340b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:11:47.409025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e75995-fcae-40b8-8fd2-1d8bfdf1340b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:11:47.410658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e75995-fcae-40b8-8fd2-1d8bfdf1340b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:11:47.425840 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4504/8902] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 15:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:11:47.427051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673f827-791e-4c63-ac05-d96c1edcae49 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:11:47.437248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673f827-791e-4c63-ac05-d96c1edcae49 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:11:47.441965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c9d42-ddfb-4ca4-a342-fdb1843e5a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:11:47.442656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c9d42-ddfb-4ca4-a342-fdb1843e5a28 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:11:47.442947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c9d42-ddfb-4ca4-a342-fdb1843e5a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:11:47.443230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226c9d42-ddfb-4ca4-a342-fdb1843e5a28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:11:47.443959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c9d42-ddfb-4ca4-a342-fdb1843e5a28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:11:47.445859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226c9d42-ddfb-4ca4-a342-fdb1843e5a28 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:11:47.525266 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4399/8903] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 15:11:47 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:11:47.529712 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e75995-fcae-40b8-8fd2-1d8bfdf1340b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:11:47.540179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e75995-fcae-40b8-8fd2-1d8bfdf1340b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:11:47.597392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6de266-0bb3-4dea-a9ac-8f25fb7b24e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:11:47.597995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6de266-0bb3-4dea-a9ac-8f25fb7b24e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:11:47.598299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6de266-0bb3-4dea-a9ac-8f25fb7b24e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:11:47.598581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6de266-0bb3-4dea-a9ac-8f25fb7b24e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:11:47.599289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6de266-0bb3-4dea-a9ac-8f25fb7b24e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:11:47.601209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6de266-0bb3-4dea-a9ac-8f25fb7b24e1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:11:47.608236 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:11:47.690018 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4505/8904] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 15:11:47 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:11:47.694241 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c9d42-ddfb-4ca4-a342-fdb1843e5a28 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:11:47.704707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226c9d42-ddfb-4ca4-a342-fdb1843e5a28 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:11:47.709291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeba4b3-1e61-42e8-af1d-a1dccfd8367e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:11:47.709951 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeba4b3-1e61-42e8-af1d-a1dccfd8367e admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:11:47.710283 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeba4b3-1e61-42e8-af1d-a1dccfd8367e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:11:47.710566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeba4b3-1e61-42e8-af1d-a1dccfd8367e admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:11:47.711366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeba4b3-1e61-42e8-af1d-a1dccfd8367e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:11:47.712961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeba4b3-1e61-42e8-af1d-a1dccfd8367e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:11:47.723534 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4400/8905] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:11:47.746193 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6de266-0bb3-4dea-a9ac-8f25fb7b24e1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:11:47.756751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6de266-0bb3-4dea-a9ac-8f25fb7b24e1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:11:47.761592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb2e840-a1f2-4579-af2a-8b3f38259b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:11:47.762347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2e840-a1f2-4579-af2a-8b3f38259b40 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:11:47.762651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2e840-a1f2-4579-af2a-8b3f38259b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:11:47.763226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb2e840-a1f2-4579-af2a-8b3f38259b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:11:47.764135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2e840-a1f2-4579-af2a-8b3f38259b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:11:47.766039 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb2e840-a1f2-4579-af2a-8b3f38259b40 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:11:47.776100 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4506/8906] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:11:47.780604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeba4b3-1e61-42e8-af1d-a1dccfd8367e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:11:47.790959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeba4b3-1e61-42e8-af1d-a1dccfd8367e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:11:47.796163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca812d-4dd8-4677-becd-e3f4006091c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:11:47.797046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca812d-4dd8-4677-becd-e3f4006091c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:11:47.797335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca812d-4dd8-4677-becd-e3f4006091c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:11:47.797620 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca812d-4dd8-4677-becd-e3f4006091c4 admin admin] PATH_INFO: `/v3/projects/ed05c6a1f1244873af3aa4c39cbb6b4f/users/5edc7d72172f46ae80656ea27bcb114d/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:11:47.812673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca812d-4dd8-4677-becd-e3f4006091c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed05c6a1f1244873af3aa4c39cbb6b4f, user_id=5edc7d72172f46ae80656ea27bcb114d, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:11:47.815363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca812d-4dd8-4677-becd-e3f4006091c4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:11:47.924475 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4401/8907] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:11:47 2022] PUT /identity/v3/projects/ed05c6a1f1244873af3aa4c39cbb6b4f/users/5edc7d72172f46ae80656ea27bcb114d/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:11:47.929684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ca2c3-bc6d-4974-9b5c-19c182954eb0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:11:47.929982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ca2c3-bc6d-4974-9b5c-19c182954eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:11:47.930299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ca2c3-bc6d-4974-9b5c-19c182954eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:11:47.947933 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-bd6ca2c3-bc6d-4974-9b5c-19c182954eb0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:11:47.949128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bd6ca2c3-bc6d-4974-9b5c-19c182954eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:11:48.007511 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4507/8908] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:11:48.017272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca812d-4dd8-4677-becd-e3f4006091c4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:11:48.018995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-97ca812d-4dd8-4677-becd-e3f4006091c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:11:48.050898 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:11:48.077464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca812d-4dd8-4677-becd-e3f4006091c4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:11:48.081244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32155b-1a78-46ba-aa4f-8ec340955fe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:11:48.081893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32155b-1a78-46ba-aa4f-8ec340955fe1 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:11:48.082212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32155b-1a78-46ba-aa4f-8ec340955fe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:11:48.082575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32155b-1a78-46ba-aa4f-8ec340955fe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:11:48.093075 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32155b-1a78-46ba-aa4f-8ec340955fe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:11:48.099409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32155b-1a78-46ba-aa4f-8ec340955fe1 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:11:48.104168 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4402/8909] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:11:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:11:53.527203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250e80d-7ac2-4974-a0fe-b9377c455fd6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:11:53.527663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250e80d-7ac2-4974-a0fe-b9377c455fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:11:53.528089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250e80d-7ac2-4974-a0fe-b9377c455fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:11:53.555722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-7250e80d-7ac2-4974-a0fe-b9377c455fd6 None None] MFA Rules not processed for user `5edc7d72172f46ae80656ea27bcb114d`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:11:53.556914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7250e80d-7ac2-4974-a0fe-b9377c455fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:11:53.631424 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4508/8910] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:11:53 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:11:53.647617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32155b-1a78-46ba-aa4f-8ec340955fe1 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:11:53.652135 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9f32155b-1a78-46ba-aa4f-8ec340955fe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:11:53.728484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32155b-1a78-46ba-aa4f-8ec340955fe1 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:11:53.734702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb0744-957b-4e21-92cd-c4aeda009435 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:11:53.735356 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb0744-957b-4e21-92cd-c4aeda009435 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:11:53.735646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb0744-957b-4e21-92cd-c4aeda009435 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:11:53.735930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb0744-957b-4e21-92cd-c4aeda009435 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:11:53.743806 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb0744-957b-4e21-92cd-c4aeda009435 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:11:53.745378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb0744-957b-4e21-92cd-c4aeda009435 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:11:53.755224 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4403/8911] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:11:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:11:56.184123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf9185-3d6f-40a8-b942-32ecfc7ce7c1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:11:56.184636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf9185-3d6f-40a8-b942-32ecfc7ce7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:11:56.184726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf9185-3d6f-40a8-b942-32ecfc7ce7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:11:56.203913 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-6baf9185-3d6f-40a8-b942-32ecfc7ce7c1 None None] MFA Rules not processed for user `5edc7d72172f46ae80656ea27bcb114d`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:11:56.205170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6baf9185-3d6f-40a8-b942-32ecfc7ce7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:11:56.213303 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4509/8912] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:11:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:11:56.546527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b7f2e-bbe7-48be-9db2-23c879d065a5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:11:56.546527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b7f2e-bbe7-48be-9db2-23c879d065a5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:11:56.546973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b7f2e-bbe7-48be-9db2-23c879d065a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:11:56.566887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e63b7f2e-bbe7-48be-9db2-23c879d065a5 None None] MFA Rules not processed for user `e997b70d7158446daa1dfa225eb7afca`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:11:56.568111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e63b7f2e-bbe7-48be-9db2-23c879d065a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:11:56.575488 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4404/8913] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 15:11:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:11:56.591855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf9185-3d6f-40a8-b942-32ecfc7ce7c1 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:11:56.601971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf9185-3d6f-40a8-b942-32ecfc7ce7c1 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:11:56.606074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cc62c-5fab-460c-b121-0b628c3cfe79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:11:56.606985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cc62c-5fab-460c-b121-0b628c3cfe79 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:11:56.607114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cc62c-5fab-460c-b121-0b628c3cfe79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:11:56.607346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cc62c-5fab-460c-b121-0b628c3cfe79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:11:56.615894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7cc62c-5fab-460c-b121-0b628c3cfe79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:11:56.617425 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7cc62c-5fab-460c-b121-0b628c3cfe79 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:11:56.626935 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4510/8914] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:11:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:12:06.560181 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=51 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:12:06.623027 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:INSERT=3,keystone:SELECT=75 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:12:07.818978 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b7f2e-bbe7-48be-9db2-23c879d065a5 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:12:07.820366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e63b7f2e-bbe7-48be-9db2-23c879d065a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:12:07.897108 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b7f2e-bbe7-48be-9db2-23c879d065a5 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:12:07.902489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d37fe-68a5-4387-8f35-781efd2c09dd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:12:07.903914 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d37fe-68a5-4387-8f35-781efd2c09dd service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:12:07.904196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d37fe-68a5-4387-8f35-781efd2c09dd service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:12:07.904481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d37fe-68a5-4387-8f35-781efd2c09dd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:12:07.906607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-218d37fe-68a5-4387-8f35-781efd2c09dd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:12:07.919221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d37fe-68a5-4387-8f35-781efd2c09dd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:12:07.920266 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d37fe-68a5-4387-8f35-781efd2c09dd service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:12:07.930477 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4405/8915] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:12:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:12:17.926066 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=32 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:12:48.027448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33225385-5e69-4a26-96a8-e97f1b458db6 None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:12:48.027989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33225385-5e69-4a26-96a8-e97f1b458db6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:12:48.027989 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33225385-5e69-4a26-96a8-e97f1b458db6 None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:12:48.029330 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4511/8916] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 15:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:12:48.034966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ab374-e97e-4740-be2a-4cb39b2ca618 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:12:48.035378 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ab374-e97e-4740-be2a-4cb39b2ca618 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:12:48.035518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ab374-e97e-4740-be2a-4cb39b2ca618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:12:48.072045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-165ab374-e97e-4740-be2a-4cb39b2ca618 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:12:48.073271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-165ab374-e97e-4740-be2a-4cb39b2ca618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:12:48.082782 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4406/8917] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 15:12:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:12:48.102950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33225385-5e69-4a26-96a8-e97f1b458db6 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:12:48.116864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33225385-5e69-4a26-96a8-e97f1b458db6 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:12:48.122014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008766b7-6a47-43cf-9cd4-dee79fe26fcd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:12:48.122738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008766b7-6a47-43cf-9cd4-dee79fe26fcd service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:12:48.123027 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008766b7-6a47-43cf-9cd4-dee79fe26fcd service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:12:48.123305 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008766b7-6a47-43cf-9cd4-dee79fe26fcd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:12:48.132464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008766b7-6a47-43cf-9cd4-dee79fe26fcd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:12:48.134030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008766b7-6a47-43cf-9cd4-dee79fe26fcd service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:12:48.144573 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4512/8918] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:12:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:12:49.143966 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ab374-e97e-4740-be2a-4cb39b2ca618 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:12:49.145431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-165ab374-e97e-4740-be2a-4cb39b2ca618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:12:49.159322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ab374-e97e-4740-be2a-4cb39b2ca618 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:12:49.164307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e332521-418e-46a9-a94a-9e6d02e3a9cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:12:49.164949 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e332521-418e-46a9-a94a-9e6d02e3a9cc service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:12:49.165235 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e332521-418e-46a9-a94a-9e6d02e3a9cc service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:12:49.165510 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e332521-418e-46a9-a94a-9e6d02e3a9cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:12:49.167254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6e332521-418e-46a9-a94a-9e6d02e3a9cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:12:49.178821 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e332521-418e-46a9-a94a-9e6d02e3a9cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:12:49.180383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e332521-418e-46a9-a94a-9e6d02e3a9cc service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:12:49.190069 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4407/8919] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:12:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:12:58.139695 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:12:59.185916 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=15 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:13:19.972136 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cf27d-7c6e-46d1-9559-ef22820f4675 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:13:19.972611 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cf27d-7c6e-46d1-9559-ef22820f4675 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:13:19.972727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cf27d-7c6e-46d1-9559-ef22820f4675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:13:19.990716 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-d35cf27d-7c6e-46d1-9559-ef22820f4675 None None] MFA Rules not processed for user `5edc7d72172f46ae80656ea27bcb114d`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:13:19.991916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d35cf27d-7c6e-46d1-9559-ef22820f4675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:13:19.998853 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4513/8920] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:13:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:13:29.986213 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:13:32.348660 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288259a-155f-4343-989a-12abd0696859 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:13:32.349172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288259a-155f-4343-989a-12abd0696859 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:13:32.349293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c288259a-155f-4343-989a-12abd0696859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:13:32.380527 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c288259a-155f-4343-989a-12abd0696859 None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:13:32.381785 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c288259a-155f-4343-989a-12abd0696859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:13:32.409904 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4408/8921] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 15:13:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:13:32.421910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cf27d-7c6e-46d1-9559-ef22820f4675 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:13:32.435414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cf27d-7c6e-46d1-9559-ef22820f4675 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:13:32.441805 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa0b632-c979-4151-8666-6736bd2a68e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:13:32.442440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0b632-c979-4151-8666-6736bd2a68e8 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:13:32.442732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0b632-c979-4151-8666-6736bd2a68e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:13:32.443012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa0b632-c979-4151-8666-6736bd2a68e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:13:32.452538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0b632-c979-4151-8666-6736bd2a68e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:13:32.454149 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa0b632-c979-4151-8666-6736bd2a68e8 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:13:32.465649 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4514/8922] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:13:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:13:42.406293 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=15 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:13:42.461032 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:14:14.257366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2017a99-c51c-4b43-80b4-0e8cba79ff3e None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:14:14.257884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2017a99-c51c-4b43-80b4-0e8cba79ff3e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:14:14.257884 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2017a99-c51c-4b43-80b4-0e8cba79ff3e None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:14:14.259280 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4409/8923] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 15:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:14:14.263966 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812c86c-9e1b-4083-8d3e-0fef703b70ae None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:14:14.264439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812c86c-9e1b-4083-8d3e-0fef703b70ae None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:14:14.264561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812c86c-9e1b-4083-8d3e-0fef703b70ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:14:14.283164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c812c86c-9e1b-4083-8d3e-0fef703b70ae None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:14:14.284618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c812c86c-9e1b-4083-8d3e-0fef703b70ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:14:14.304814 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4515/8924] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 15:14:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:14:14.325583 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2017a99-c51c-4b43-80b4-0e8cba79ff3e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:14:14.340134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2017a99-c51c-4b43-80b4-0e8cba79ff3e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:14:14.345629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe06a27-745a-4fd9-8d70-9e6761acfa0e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:14:14.346306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe06a27-745a-4fd9-8d70-9e6761acfa0e service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:14:14.346597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe06a27-745a-4fd9-8d70-9e6761acfa0e service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:14:14.346904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe06a27-745a-4fd9-8d70-9e6761acfa0e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:14:14.355303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe06a27-745a-4fd9-8d70-9e6761acfa0e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:14:14.356897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe06a27-745a-4fd9-8d70-9e6761acfa0e service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:14:14.366775 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4410/8925] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:14:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:14:14.674738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812c86c-9e1b-4083-8d3e-0fef703b70ae None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:14:14.695380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812c86c-9e1b-4083-8d3e-0fef703b70ae None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:14:14.699106 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351af639-386e-410d-912c-31356d3f8e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:14:14.699759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af639-386e-410d-912c-31356d3f8e2f service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:14:14.700047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af639-386e-410d-912c-31356d3f8e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:14:14.700329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351af639-386e-410d-912c-31356d3f8e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:14:14.702200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-351af639-386e-410d-912c-31356d3f8e2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:14:14.719615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351af639-386e-410d-912c-31356d3f8e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:14:14.721043 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351af639-386e-410d-912c-31356d3f8e2f service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:14:14.734774 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4516/8926] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:14:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:14:14.796250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe06a27-745a-4fd9-8d70-9e6761acfa0e service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:14:14.807073 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe06a27-745a-4fd9-8d70-9e6761acfa0e service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:14:14.811965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bb138-fedc-403c-ab2d-737dac31bf75 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:14:14.812598 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bb138-fedc-403c-ab2d-737dac31bf75 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:14:14.812883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bb138-fedc-403c-ab2d-737dac31bf75 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:14:14.813167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bb138-fedc-403c-ab2d-737dac31bf75 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:14:14.814919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-357bb138-fedc-403c-ab2d-737dac31bf75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:14:14.826686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bb138-fedc-403c-ab2d-737dac31bf75 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:14:14.828189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bb138-fedc-403c-ab2d-737dac31bf75 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:14:14.837890 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4411/8927] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:14:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:14:24.727421 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=17 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:14:24.833854 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=12 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:14:26.846726 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351af639-386e-410d-912c-31356d3f8e2f service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:14:26.856171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351af639-386e-410d-912c-31356d3f8e2f service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:14:26.859923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a5c6f-73c7-42a8-b2bd-28e9ae32f153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:14:26.860591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a5c6f-73c7-42a8-b2bd-28e9ae32f153 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:14:26.860879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a5c6f-73c7-42a8-b2bd-28e9ae32f153 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:14:26.861159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a5c6f-73c7-42a8-b2bd-28e9ae32f153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:14:26.863008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9c1a5c6f-73c7-42a8-b2bd-28e9ae32f153 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:14:26.876929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a5c6f-73c7-42a8-b2bd-28e9ae32f153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:14:26.878385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a5c6f-73c7-42a8-b2bd-28e9ae32f153 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:14:26.889341 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4517/8928] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:14:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:14:31.386319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bb138-fedc-403c-ab2d-737dac31bf75 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:14:31.387751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-357bb138-fedc-403c-ab2d-737dac31bf75 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:14:31.399097 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bb138-fedc-403c-ab2d-737dac31bf75 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:14:31.402650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6792931-a226-48f5-8c1f-a8a698a3e65c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:14:31.403313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6792931-a226-48f5-8c1f-a8a698a3e65c service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:14:31.403587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6792931-a226-48f5-8c1f-a8a698a3e65c service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:14:31.403873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6792931-a226-48f5-8c1f-a8a698a3e65c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:14:31.405600 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a6792931-a226-48f5-8c1f-a8a698a3e65c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:14:31.419375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6792931-a226-48f5-8c1f-a8a698a3e65c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:14:31.420783 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6792931-a226-48f5-8c1f-a8a698a3e65c service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:14:31.432138 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4412/8929] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:14:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:14:33.762271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fed262-dd62-475c-8eb6-ea7962561d84 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:14:33.762761 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fed262-dd62-475c-8eb6-ea7962561d84 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:14:33.762840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fed262-dd62-475c-8eb6-ea7962561d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:14:33.781731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e9fed262-dd62-475c-8eb6-ea7962561d84 None None] MFA Rules not processed for user `5edc7d72172f46ae80656ea27bcb114d`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:14:33.782990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e9fed262-dd62-475c-8eb6-ea7962561d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:14:33.791138 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4518/8930] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:14:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:14:41.426771 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:14:43.776867 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=9 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:15:20.009437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795135f1-2f60-4de1-af47-4ca75747c646 None None] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:15:20.010010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795135f1-2f60-4de1-af47-4ca75747c646 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:15:20.010010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795135f1-2f60-4de1-af47-4ca75747c646 None None] PATH_INFO: `/` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:15:20.011386 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4413/8931] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 15:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:15:20.016486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356271a-1e99-4675-b7a3-bb60ba2413f2 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:15:20.016921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356271a-1e99-4675-b7a3-bb60ba2413f2 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:15:20.017031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356271a-1e99-4675-b7a3-bb60ba2413f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:15:20.045504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c356271a-1e99-4675-b7a3-bb60ba2413f2 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:15:20.047573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c356271a-1e99-4675-b7a3-bb60ba2413f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:15:20.056884 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4519/8932] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 15:15:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:15:20.076793 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795135f1-2f60-4de1-af47-4ca75747c646 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:15:20.090330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795135f1-2f60-4de1-af47-4ca75747c646 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:15:20.095924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a426957-4c51-41dc-895c-720ba11434a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:15:20.096566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a426957-4c51-41dc-895c-720ba11434a0 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:15:20.096857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a426957-4c51-41dc-895c-720ba11434a0 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:15:20.097138 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a426957-4c51-41dc-895c-720ba11434a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:15:20.105794 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a426957-4c51-41dc-895c-720ba11434a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:15:20.107499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a426957-4c51-41dc-895c-720ba11434a0 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:15:20.117812 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4414/8933] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:15:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:15:20.433150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edc282-e3f5-45e7-9547-2e8fae4b3907 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:15:20.433452 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edc282-e3f5-45e7-9547-2e8fae4b3907 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:15:20.433737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edc282-e3f5-45e7-9547-2e8fae4b3907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:15:20.454331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-c0edc282-e3f5-45e7-9547-2e8fae4b3907 None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:15:20.455534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c0edc282-e3f5-45e7-9547-2e8fae4b3907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:15:20.464671 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4520/8934] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 15:15:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:15:20.474983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a426957-4c51-41dc-895c-720ba11434a0 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:15:20.484085 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a426957-4c51-41dc-895c-720ba11434a0 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:15:20.487567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5971291-ce65-49cf-8b39-aef900dc0f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:15:20.488196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5971291-ce65-49cf-8b39-aef900dc0f17 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:15:20.488479 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5971291-ce65-49cf-8b39-aef900dc0f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:15:20.488780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5971291-ce65-49cf-8b39-aef900dc0f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:15:20.498885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5971291-ce65-49cf-8b39-aef900dc0f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:15:20.500873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5971291-ce65-49cf-8b39-aef900dc0f17 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:15:20.512649 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4415/8935] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:15:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:15:30.447679 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=10 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:15:30.507754 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=12 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:15:39.479503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edc282-e3f5-45e7-9547-2e8fae4b3907 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:15:39.490419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edc282-e3f5-45e7-9547-2e8fae4b3907 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:15:39.494186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6a7d7-4cc8-4f39-bf18-36e0d57d41c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:15:39.494841 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6a7d7-4cc8-4f39-bf18-36e0d57d41c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:15:39.495125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6a7d7-4cc8-4f39-bf18-36e0d57d41c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:15:39.495403 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c6a7d7-4cc8-4f39-bf18-36e0d57d41c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:15:39.497192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f1c6a7d7-4cc8-4f39-bf18-36e0d57d41c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:15:39.506757 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6a7d7-4cc8-4f39-bf18-36e0d57d41c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:15:39.508180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c6a7d7-4cc8-4f39-bf18-36e0d57d41c3 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:15:39.516163 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4521/8936] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:15:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:15:40.024815 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5971291-ce65-49cf-8b39-aef900dc0f17 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:15:40.033206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5971291-ce65-49cf-8b39-aef900dc0f17 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:15:40.037251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8b509-3b40-4da1-a98a-5219db65858c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:15:40.037889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8b509-3b40-4da1-a98a-5219db65858c service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:15:40.038211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8b509-3b40-4da1-a98a-5219db65858c service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:15:40.038491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d8b509-3b40-4da1-a98a-5219db65858c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:15:40.040233 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d3d8b509-3b40-4da1-a98a-5219db65858c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:15:40.050039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8b509-3b40-4da1-a98a-5219db65858c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:15:40.051486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d8b509-3b40-4da1-a98a-5219db65858c service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:15:40.059293 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4416/8937] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:15:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:15:40.465317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6a7d7-4cc8-4f39-bf18-36e0d57d41c3 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:15:40.472121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f1c6a7d7-4cc8-4f39-bf18-36e0d57d41c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:15:40.483880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c6a7d7-4cc8-4f39-bf18-36e0d57d41c3 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:15:40.490497 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e5a8c-951b-4eb9-a769-fd19c1d63510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:15:40.491145 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e5a8c-951b-4eb9-a769-fd19c1d63510 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:15:40.491426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e5a8c-951b-4eb9-a769-fd19c1d63510 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:15:40.491702 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e5a8c-951b-4eb9-a769-fd19c1d63510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:15:40.493464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-963e5a8c-951b-4eb9-a769-fd19c1d63510 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:15:40.505970 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e5a8c-951b-4eb9-a769-fd19c1d63510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:15:40.507567 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e5a8c-951b-4eb9-a769-fd19c1d63510 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:15:40.518556 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4522/8938] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:15:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:15:46.718526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8b509-3b40-4da1-a98a-5219db65858c service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:15:46.731676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d8b509-3b40-4da1-a98a-5219db65858c service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:15:46.738114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ba69e-05ba-4f70-a186-edfee65e1cec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:15:46.738787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ba69e-05ba-4f70-a186-edfee65e1cec service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:15:46.739072 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ba69e-05ba-4f70-a186-edfee65e1cec service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:15:46.739348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ba69e-05ba-4f70-a186-edfee65e1cec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:15:46.741145 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8a0ba69e-05ba-4f70-a186-edfee65e1cec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:15:46.753997 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ba69e-05ba-4f70-a186-edfee65e1cec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:15:46.755540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0ba69e-05ba-4f70-a186-edfee65e1cec service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:15:46.765738 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4417/8939] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:15:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:15:50.513644 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=12 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:15:56.714146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfd37a-2e0f-4c7e-8141-d73c8c3bdd18 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:15:56.714699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfd37a-2e0f-4c7e-8141-d73c8c3bdd18 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:15:56.714699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decfd37a-2e0f-4c7e-8141-d73c8c3bdd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:15:56.732206 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-decfd37a-2e0f-4c7e-8141-d73c8c3bdd18 None None] MFA Rules not processed for user `5edc7d72172f46ae80656ea27bcb114d`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:15:56.733411 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-decfd37a-2e0f-4c7e-8141-d73c8c3bdd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:15:56.740566 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4523/8940] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:15:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:15:56.761468 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=12 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:15:57.047380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ba69e-05ba-4f70-a186-edfee65e1cec service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:15:57.057529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ba69e-05ba-4f70-a186-edfee65e1cec service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:15:57.061207 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885af44-0295-450f-8ba2-b9e426dd3ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:15:57.061842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885af44-0295-450f-8ba2-b9e426dd3ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:15:57.062163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885af44-0295-450f-8ba2-b9e426dd3ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:15:57.062443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885af44-0295-450f-8ba2-b9e426dd3ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:15:57.064165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5885af44-0295-450f-8ba2-b9e426dd3ff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:15:57.074491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885af44-0295-450f-8ba2-b9e426dd3ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:15:57.075894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885af44-0295-450f-8ba2-b9e426dd3ff5 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:15:57.084200 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4418/8941] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:15:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:15:57.478579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfd37a-2e0f-4c7e-8141-d73c8c3bdd18 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:15:57.493194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decfd37a-2e0f-4c7e-8141-d73c8c3bdd18 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:15:57.498565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b04e5d-2d0f-46d7-af83-ec3a8a6ffe95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:15:57.499200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b04e5d-2d0f-46d7-af83-ec3a8a6ffe95 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:15:57.499485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b04e5d-2d0f-46d7-af83-ec3a8a6ffe95 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:15:57.499764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b04e5d-2d0f-46d7-af83-ec3a8a6ffe95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:15:57.501581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c5b04e5d-2d0f-46d7-af83-ec3a8a6ffe95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:15:57.514172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b04e5d-2d0f-46d7-af83-ec3a8a6ffe95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:15:57.516038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b04e5d-2d0f-46d7-af83-ec3a8a6ffe95 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:15:57.527424 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4524/8942] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:15:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:16:07.080494 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:16:07.522384 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=9 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:16:52.951960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da10d2-f571-4195-870d-7dd7d5820d66 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:16:52.952392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da10d2-f571-4195-870d-7dd7d5820d66 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:16:52.952515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da10d2-f571-4195-870d-7dd7d5820d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:16:53.002274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-59da10d2-f571-4195-870d-7dd7d5820d66 None None] MFA Rules not processed for user `ef77d9ec7712434287347d959dcf1cc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:16:53.003494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-59da10d2-f571-4195-870d-7dd7d5820d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:16:53.064830 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4419/8943] 10.222.0.43 () {58 vars in 1061 bytes} [Tue Jul 19 15:16:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:16:53.070901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b04e5d-2d0f-46d7-af83-ec3a8a6ffe95 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:16:53.080198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b04e5d-2d0f-46d7-af83-ec3a8a6ffe95 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:16:53.083994 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1fe45-a9b8-4400-94cf-c35e8f4eaa93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:16:53.084626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1fe45-a9b8-4400-94cf-c35e8f4eaa93 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:16:53.084918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1fe45-a9b8-4400-94cf-c35e8f4eaa93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:16:53.085200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1fe45-a9b8-4400-94cf-c35e8f4eaa93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:16:53.093649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1fe45-a9b8-4400-94cf-c35e8f4eaa93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:16:53.095132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1fe45-a9b8-4400-94cf-c35e8f4eaa93 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:16:53.105162 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4525/8944] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:16:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:16:55.791642 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da10d2-f571-4195-870d-7dd7d5820d66 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:16:55.802049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da10d2-f571-4195-870d-7dd7d5820d66 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:16:55.805846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9143b-374a-4837-8760-19296cd05f5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:16:55.806546 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9143b-374a-4837-8760-19296cd05f5e service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:16:55.809176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9143b-374a-4837-8760-19296cd05f5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:16:55.809176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9143b-374a-4837-8760-19296cd05f5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:16:55.809176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3fa9143b-374a-4837-8760-19296cd05f5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:16:55.819357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9143b-374a-4837-8760-19296cd05f5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:16:55.820817 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa9143b-374a-4837-8760-19296cd05f5e service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:16:55.828675 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4420/8945] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:16:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:16:55.989662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d0812-8f3a-4979-b902-212b6563b20f None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:16:55.990239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d0812-8f3a-4979-b902-212b6563b20f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:16:55.990239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4d0812-8f3a-4979-b902-212b6563b20f None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:16:55.991686 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4526/8946] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 15:16:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:16:55.996396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20c6bf-6dcc-46bb-bef6-3600d9c130c2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:16:55.996685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20c6bf-6dcc-46bb-bef6-3600d9c130c2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:16:55.996971 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20c6bf-6dcc-46bb-bef6-3600d9c130c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:16:56.015481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-4b20c6bf-6dcc-46bb-bef6-3600d9c130c2 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:16:56.017601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4b20c6bf-6dcc-46bb-bef6-3600d9c130c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:16:56.025724 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4421/8947] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 15:16:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:16:56.047192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d0812-8f3a-4979-b902-212b6563b20f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:16:56.061609 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4d0812-8f3a-4979-b902-212b6563b20f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:16:56.066689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306fe3b-8a24-4cb8-ba46-3ecf90766358 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:16:56.067312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306fe3b-8a24-4cb8-ba46-3ecf90766358 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:16:56.067598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306fe3b-8a24-4cb8-ba46-3ecf90766358 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:16:56.067877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306fe3b-8a24-4cb8-ba46-3ecf90766358 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:16:56.076202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306fe3b-8a24-4cb8-ba46-3ecf90766358 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:16:56.077773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306fe3b-8a24-4cb8-ba46-3ecf90766358 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:16:56.087720 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4527/8948] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:16:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:17:06.010156 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=47 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:06.083688 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=12 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:13.861870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20c6bf-6dcc-46bb-bef6-3600d9c130c2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:13.873017 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20c6bf-6dcc-46bb-bef6-3600d9c130c2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:13.878071 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8bad5-1fd6-4842-91be-b200e3862ca0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:13.878727 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8bad5-1fd6-4842-91be-b200e3862ca0 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:13.879013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8bad5-1fd6-4842-91be-b200e3862ca0 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:13.879310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8bad5-1fd6-4842-91be-b200e3862ca0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:13.887764 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8bad5-1fd6-4842-91be-b200e3862ca0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:13.889340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd8bad5-1fd6-4842-91be-b200e3862ca0 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:13.900319 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4422/8949] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:17:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:17:23.896008 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:17:57.826394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306fe3b-8a24-4cb8-ba46-3ecf90766358 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:17:57.836714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306fe3b-8a24-4cb8-ba46-3ecf90766358 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:17:57.841715 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead7782-32a2-40a6-8675-4520420da9ea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:17:57.842387 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead7782-32a2-40a6-8675-4520420da9ea service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:17:57.842670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead7782-32a2-40a6-8675-4520420da9ea service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:17:57.842946 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead7782-32a2-40a6-8675-4520420da9ea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:17:57.851331 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead7782-32a2-40a6-8675-4520420da9ea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:17:57.852854 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead7782-32a2-40a6-8675-4520420da9ea service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:17:57.863207 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4528/8950] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:17:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:18:04.220859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8bad5-1fd6-4842-91be-b200e3862ca0 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:04.230505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8bad5-1fd6-4842-91be-b200e3862ca0 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:04.234771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb50fe-ee8e-47a8-a7c9-73c1f2e9c045 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:04.235697 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb50fe-ee8e-47a8-a7c9-73c1f2e9c045 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:04.236139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb50fe-ee8e-47a8-a7c9-73c1f2e9c045 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:04.236460 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb50fe-ee8e-47a8-a7c9-73c1f2e9c045 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:04.246221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb50fe-ee8e-47a8-a7c9-73c1f2e9c045 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:04.247686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb50fe-ee8e-47a8-a7c9-73c1f2e9c045 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:04.275575 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4423/8951] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:18:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:18:07.859334 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:07.936360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454d529-ea14-4db4-8301-41e8b71fd0df None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:07.936838 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454d529-ea14-4db4-8301-41e8b71fd0df None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:07.937183 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454d529-ea14-4db4-8301-41e8b71fd0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:07.957718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a454d529-ea14-4db4-8301-41e8b71fd0df None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:07.959029 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a454d529-ea14-4db4-8301-41e8b71fd0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:07.973286 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4529/8952] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 15:18:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:18:07.993501 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb50fe-ee8e-47a8-a7c9-73c1f2e9c045 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:08.005694 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb50fe-ee8e-47a8-a7c9-73c1f2e9c045 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:08.010979 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fee24-b9a8-4c27-b83d-9ad12def992c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:08.011627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fee24-b9a8-4c27-b83d-9ad12def992c service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:08.011916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fee24-b9a8-4c27-b83d-9ad12def992c service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:08.012196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7fee24-b9a8-4c27-b83d-9ad12def992c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:08.020842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fee24-b9a8-4c27-b83d-9ad12def992c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:08.022445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7fee24-b9a8-4c27-b83d-9ad12def992c service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:08.032926 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4424/8953] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:18:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:18:08.076065 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454d529-ea14-4db4-8301-41e8b71fd0df None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:08.088694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454d529-ea14-4db4-8301-41e8b71fd0df None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:08.093684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d3a73a-f5a6-47d7-9d05-4a8941f3dc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:08.094634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3a73a-f5a6-47d7-9d05-4a8941f3dc3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:08.094918 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3a73a-f5a6-47d7-9d05-4a8941f3dc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:08.095221 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d3a73a-f5a6-47d7-9d05-4a8941f3dc3a admin admin] PATH_INFO: `/v3/users/5edc7d72172f46ae80656ea27bcb114d` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:08.096435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3a73a-f5a6-47d7-9d05-4a8941f3dc3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5edc7d72172f46ae80656ea27bcb114d)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:08.098398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d3a73a-f5a6-47d7-9d05-4a8941f3dc3a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:08.275945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-17d3a73a-f5a6-47d7-9d05-4a8941f3dc3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5edc7d72172f46ae80656ea27bcb114d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:18:08.287958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-17d3a73a-f5a6-47d7-9d05-4a8941f3dc3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5edc7d72172f46ae80656ea27bcb114d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:18:08.295203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-17d3a73a-f5a6-47d7-9d05-4a8941f3dc3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5edc7d72172f46ae80656ea27bcb114d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:18:08.295895 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-17d3a73a-f5a6-47d7-9d05-4a8941f3dc3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5edc7d72172f46ae80656ea27bcb114d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:18:08.352294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-17d3a73a-f5a6-47d7-9d05-4a8941f3dc3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5edc7d72172f46ae80656ea27bcb114d'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:18:08.358649 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4530/8954] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:18:08 2022] DELETE /identity/v3/users/5edc7d72172f46ae80656ea27bcb114d => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:18:08.610991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fee24-b9a8-4c27-b83d-9ad12def992c service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:08.623678 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7fee24-b9a8-4c27-b83d-9ad12def992c service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:08.682548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3900e6-4a22-4fba-91e5-4046c81a7dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:08.683415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3900e6-4a22-4fba-91e5-4046c81a7dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:08.683708 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3900e6-4a22-4fba-91e5-4046c81a7dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:08.683999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3900e6-4a22-4fba-91e5-4046c81a7dcd admin admin] PATH_INFO: `/v3/projects/ed05c6a1f1244873af3aa4c39cbb6b4f` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:08.685186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3900e6-4a22-4fba-91e5-4046c81a7dcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed05c6a1f1244873af3aa4c39cbb6b4f)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:08.687153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3900e6-4a22-4fba-91e5-4046c81a7dcd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:08.781473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e3900e6-4a22-4fba-91e5-4046c81a7dcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed05c6a1f1244873af3aa4c39cbb6b4f', 'request_id': 'req-0e3900e6-4a22-4fba-91e5-4046c81a7dcd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:18:08.827170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e3900e6-4a22-4fba-91e5-4046c81a7dcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed05c6a1f1244873af3aa4c39cbb6b4f', 'request_id': 'req-0e3900e6-4a22-4fba-91e5-4046c81a7dcd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:18:08.833763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e3900e6-4a22-4fba-91e5-4046c81a7dcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed05c6a1f1244873af3aa4c39cbb6b4f', 'request_id': 'req-0e3900e6-4a22-4fba-91e5-4046c81a7dcd'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:18:08.856686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e3900e6-4a22-4fba-91e5-4046c81a7dcd admin admin] The token cache is being invalidate because project ed05c6a1f1244873af3aa4c39cbb6b4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:18:08.856970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e3900e6-4a22-4fba-91e5-4046c81a7dcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:18:08.857612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-0e3900e6-4a22-4fba-91e5-4046c81a7dcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:18:08.859313 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4425/8955] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:18:08 2022] DELETE /identity/v3/projects/ed05c6a1f1244873af3aa4c39cbb6b4f => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:18:08.864569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63734936-50bd-4d47-9b7e-e8022ffefb89 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:08.865064 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63734936-50bd-4d47-9b7e-e8022ffefb89 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:08.865172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63734936-50bd-4d47-9b7e-e8022ffefb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:08.910697 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-63734936-50bd-4d47-9b7e-e8022ffefb89 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:08.911908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-63734936-50bd-4d47-9b7e-e8022ffefb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:08.971572 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4531/8956] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:18:08.980211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7869a1-3830-4939-8106-ad9b1554b1bb None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:08.980643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7869a1-3830-4939-8106-ad9b1554b1bb None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:08.980930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7869a1-3830-4939-8106-ad9b1554b1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:08.999558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6d7869a1-3830-4939-8106-ad9b1554b1bb None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:09.000746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6d7869a1-3830-4939-8106-ad9b1554b1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:09.008532 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4426/8957] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:18:09.013417 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63734936-50bd-4d47-9b7e-e8022ffefb89 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:09.023151 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63734936-50bd-4d47-9b7e-e8022ffefb89 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:09.028336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e3a68-1760-4654-8a0e-7bd1539f38b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:09.028988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e3a68-1760-4654-8a0e-7bd1539f38b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:09.029273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e3a68-1760-4654-8a0e-7bd1539f38b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:09.029551 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e3a68-1760-4654-8a0e-7bd1539f38b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:09.030314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e3a68-1760-4654-8a0e-7bd1539f38b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:09.030624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e3a68-1760-4654-8a0e-7bd1539f38b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:09.032230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660e3a68-1760-4654-8a0e-7bd1539f38b5 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:09.044233 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4532/8958] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 15:18:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:18:09.048396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7869a1-3830-4939-8106-ad9b1554b1bb None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:09.057698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7869a1-3830-4939-8106-ad9b1554b1bb None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:09.062561 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0534259-f66a-43f6-8edb-3257c998d054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:09.063209 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0534259-f66a-43f6-8edb-3257c998d054 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:09.063495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0534259-f66a-43f6-8edb-3257c998d054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:09.063772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0534259-f66a-43f6-8edb-3257c998d054 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:09.064591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0534259-f66a-43f6-8edb-3257c998d054 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:09.066581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0534259-f66a-43f6-8edb-3257c998d054 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:09.138356 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:09.150876 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4427/8959] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 15:18:09 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:18:09.153128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e3a68-1760-4654-8a0e-7bd1539f38b5 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:09.163205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e3a68-1760-4654-8a0e-7bd1539f38b5 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:09.193303 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:09.227276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34370fe8-629b-49b7-b1bf-b5e99de88451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:09.227276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34370fe8-629b-49b7-b1bf-b5e99de88451 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:09.227276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34370fe8-629b-49b7-b1bf-b5e99de88451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:09.227276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34370fe8-629b-49b7-b1bf-b5e99de88451 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:09.229117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34370fe8-629b-49b7-b1bf-b5e99de88451 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:09.229313 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34370fe8-629b-49b7-b1bf-b5e99de88451 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:09.314181 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4533/8960] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 15:18:09 2022] POST /identity/v3/users => generated 291 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:18:09.319103 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0534259-f66a-43f6-8edb-3257c998d054 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:09.330695 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0534259-f66a-43f6-8edb-3257c998d054 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:09.335275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e5c51-4e5d-4ba5-9509-efb52a3e2012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:09.335938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e5c51-4e5d-4ba5-9509-efb52a3e2012 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:09.336219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e5c51-4e5d-4ba5-9509-efb52a3e2012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:09.336498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e5c51-4e5d-4ba5-9509-efb52a3e2012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:09.337222 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e5c51-4e5d-4ba5-9509-efb52a3e2012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:09.339368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e5c51-4e5d-4ba5-9509-efb52a3e2012 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:09.349285 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4428/8961] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:18:09.353762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34370fe8-629b-49b7-b1bf-b5e99de88451 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:09.364021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34370fe8-629b-49b7-b1bf-b5e99de88451 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:09.369258 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b5137-1ebb-4f05-9f74-4d5334b40b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:09.370521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b5137-1ebb-4f05-9f74-4d5334b40b94 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:09.370808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b5137-1ebb-4f05-9f74-4d5334b40b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:09.371082 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b5137-1ebb-4f05-9f74-4d5334b40b94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:09.371813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b5137-1ebb-4f05-9f74-4d5334b40b94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:09.373437 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b5137-1ebb-4f05-9f74-4d5334b40b94 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:09.383532 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4534/8962] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:18:09.388033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e5c51-4e5d-4ba5-9509-efb52a3e2012 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:09.401133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e5c51-4e5d-4ba5-9509-efb52a3e2012 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:09.406029 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ccc4af-3c32-4fb7-87cc-70eeff05d385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:09.406983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccc4af-3c32-4fb7-87cc-70eeff05d385 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:09.407269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccc4af-3c32-4fb7-87cc-70eeff05d385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:09.407549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ccc4af-3c32-4fb7-87cc-70eeff05d385 admin admin] PATH_INFO: `/v3/projects/402df934fedf412db96c54e9b4853625/users/f285374a4e1d46bc8cc5aebf5bb5851b/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:09.423577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ccc4af-3c32-4fb7-87cc-70eeff05d385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=402df934fedf412db96c54e9b4853625, user_id=f285374a4e1d46bc8cc5aebf5bb5851b, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:09.426250 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ccc4af-3c32-4fb7-87cc-70eeff05d385 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:09.501989 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4429/8963] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:18:09 2022] PUT /identity/v3/projects/402df934fedf412db96c54e9b4853625/users/f285374a4e1d46bc8cc5aebf5bb5851b/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:18:09.507491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367e108-6e7e-4f1d-8ae8-dc00caf8dd1a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:09.507814 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367e108-6e7e-4f1d-8ae8-dc00caf8dd1a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:09.508174 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367e108-6e7e-4f1d-8ae8-dc00caf8dd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:09.526554 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9367e108-6e7e-4f1d-8ae8-dc00caf8dd1a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:09.527755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9367e108-6e7e-4f1d-8ae8-dc00caf8dd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:09.586234 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4535/8964] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:18:09.596755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ccc4af-3c32-4fb7-87cc-70eeff05d385 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:09.598465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f5ccc4af-3c32-4fb7-87cc-70eeff05d385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:09.654655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ccc4af-3c32-4fb7-87cc-70eeff05d385 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:09.658223 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d795a-3375-4b5f-89eb-95d3df3a8c44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:09.658967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d795a-3375-4b5f-89eb-95d3df3a8c44 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:09.659259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d795a-3375-4b5f-89eb-95d3df3a8c44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:09.659540 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d795a-3375-4b5f-89eb-95d3df3a8c44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:09.669520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d795a-3375-4b5f-89eb-95d3df3a8c44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:09.670968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d795a-3375-4b5f-89eb-95d3df3a8c44 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:09.680389 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4430/8965] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:18:15.137545 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85c15e-7e89-4932-8598-b78d523f2765 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:15.138182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85c15e-7e89-4932-8598-b78d523f2765 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:15.138349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85c15e-7e89-4932-8598-b78d523f2765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:15.169698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9f85c15e-7e89-4932-8598-b78d523f2765 None None] MFA Rules not processed for user `f285374a4e1d46bc8cc5aebf5bb5851b`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:15.171046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9f85c15e-7e89-4932-8598-b78d523f2765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:15.256930 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4536/8966] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:18:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:18:15.266229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6630f-6b6a-409e-80c3-45ec64940f1b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:15.266702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6630f-6b6a-409e-80c3-45ec64940f1b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:15.266968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6630f-6b6a-409e-80c3-45ec64940f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:15.296904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-48c6630f-6b6a-409e-80c3-45ec64940f1b None None] MFA Rules not processed for user `f285374a4e1d46bc8cc5aebf5bb5851b`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:15.298213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-48c6630f-6b6a-409e-80c3-45ec64940f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:15.311621 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4431/8967] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:18:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:18:15.324686 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85c15e-7e89-4932-8598-b78d523f2765 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:15.326075 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9f85c15e-7e89-4932-8598-b78d523f2765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:15.378815 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:15.422674 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85c15e-7e89-4932-8598-b78d523f2765 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:15.428532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d138103-97ad-4df4-84cd-835c9fe4388c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:15.429397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d138103-97ad-4df4-84cd-835c9fe4388c service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:15.429683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d138103-97ad-4df4-84cd-835c9fe4388c service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:15.429958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d138103-97ad-4df4-84cd-835c9fe4388c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:15.438772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d138103-97ad-4df4-84cd-835c9fe4388c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:15.440377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d138103-97ad-4df4-84cd-835c9fe4388c service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:15.449815 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4537/8968] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:18:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:18:25.281452 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=44,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:25.489544 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=16 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:28.837333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e3d48-4405-4190-8a88-337e052403f5 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:28.837833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e3d48-4405-4190-8a88-337e052403f5 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:28.837940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e3d48-4405-4190-8a88-337e052403f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:28.855333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3e5e3d48-4405-4190-8a88-337e052403f5 None None] MFA Rules not processed for user `f285374a4e1d46bc8cc5aebf5bb5851b`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:28.856548 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3e5e3d48-4405-4190-8a88-337e052403f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:28.863505 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4432/8969] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:18:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:18:29.115587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d138103-97ad-4df4-84cd-835c9fe4388c service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:29.124875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d138103-97ad-4df4-84cd-835c9fe4388c service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:29.128471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf96517-bf94-4bc3-8188-e47ee22000a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:29.129109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf96517-bf94-4bc3-8188-e47ee22000a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:29.129398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf96517-bf94-4bc3-8188-e47ee22000a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:29.129680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf96517-bf94-4bc3-8188-e47ee22000a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:29.131584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dbf96517-bf94-4bc3-8188-e47ee22000a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:29.141543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf96517-bf94-4bc3-8188-e47ee22000a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:29.142996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf96517-bf94-4bc3-8188-e47ee22000a1 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:29.151087 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4538/8970] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:18:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:18:38.850200 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:39.147461 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:52.075668 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e730772-a1c0-4b08-84f0-3476f38c2f4a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:52.076246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e730772-a1c0-4b08-84f0-3476f38c2f4a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:52.076246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e730772-a1c0-4b08-84f0-3476f38c2f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:52.095036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2e730772-a1c0-4b08-84f0-3476f38c2f4a None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:52.096157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2e730772-a1c0-4b08-84f0-3476f38c2f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:52.162156 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4433/8971] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 15:18:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:18:52.174323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf96517-bf94-4bc3-8188-e47ee22000a1 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:52.175929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dbf96517-bf94-4bc3-8188-e47ee22000a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:52.187490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e730772-a1c0-4b08-84f0-3476f38c2f4a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:52.197262 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf96517-bf94-4bc3-8188-e47ee22000a1 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:52.199650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e730772-a1c0-4b08-84f0-3476f38c2f4a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:52.202790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0aa7d-5dfc-4be0-86ae-bf57f2c53c64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:52.204320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263b90b-776b-46dc-a14c-243cdb78ab9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:52.205193 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263b90b-776b-46dc-a14c-243cdb78ab9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:52.205480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263b90b-776b-46dc-a14c-243cdb78ab9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:52.205888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263b90b-776b-46dc-a14c-243cdb78ab9a admin admin] PATH_INFO: `/v3/users/f285374a4e1d46bc8cc5aebf5bb5851b` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:52.207507 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263b90b-776b-46dc-a14c-243cdb78ab9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f285374a4e1d46bc8cc5aebf5bb5851b)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:52.208520 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0aa7d-5dfc-4be0-86ae-bf57f2c53c64 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:52.209023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0aa7d-5dfc-4be0-86ae-bf57f2c53c64 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:52.209370 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a0aa7d-5dfc-4be0-86ae-bf57f2c53c64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:52.209488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263b90b-776b-46dc-a14c-243cdb78ab9a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:52.220532 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0aa7d-5dfc-4be0-86ae-bf57f2c53c64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:52.222171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a0aa7d-5dfc-4be0-86ae-bf57f2c53c64 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:52.233411 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4539/8972] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:18:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:18:52.462912 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2263b90b-776b-46dc-a14c-243cdb78ab9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f285374a4e1d46bc8cc5aebf5bb5851b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:18:52.475368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2263b90b-776b-46dc-a14c-243cdb78ab9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f285374a4e1d46bc8cc5aebf5bb5851b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:18:52.476040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2263b90b-776b-46dc-a14c-243cdb78ab9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f285374a4e1d46bc8cc5aebf5bb5851b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:18:52.476650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2263b90b-776b-46dc-a14c-243cdb78ab9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f285374a4e1d46bc8cc5aebf5bb5851b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:18:52.483672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-2263b90b-776b-46dc-a14c-243cdb78ab9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f285374a4e1d46bc8cc5aebf5bb5851b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:18:52.581075 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4434/8973] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:18:52 2022] DELETE /identity/v3/users/f285374a4e1d46bc8cc5aebf5bb5851b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:18:52.839776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0aa7d-5dfc-4be0-86ae-bf57f2c53c64 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:52.850428 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a0aa7d-5dfc-4be0-86ae-bf57f2c53c64 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:52.915584 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8978d-e092-429a-80c3-aab1684ac56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:52.916448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8978d-e092-429a-80c3-aab1684ac56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:52.916734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8978d-e092-429a-80c3-aab1684ac56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:52.917012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8978d-e092-429a-80c3-aab1684ac56e admin admin] PATH_INFO: `/v3/projects/402df934fedf412db96c54e9b4853625` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:52.918340 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8978d-e092-429a-80c3-aab1684ac56e admin admin] RBAC: Authorizing `identity:delete_project(project_id=402df934fedf412db96c54e9b4853625)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:52.920358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e8978d-e092-429a-80c3-aab1684ac56e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:53.032950 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-13e8978d-e092-429a-80c3-aab1684ac56e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '402df934fedf412db96c54e9b4853625', 'request_id': 'req-13e8978d-e092-429a-80c3-aab1684ac56e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:18:53.038860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-13e8978d-e092-429a-80c3-aab1684ac56e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '402df934fedf412db96c54e9b4853625', 'request_id': 'req-13e8978d-e092-429a-80c3-aab1684ac56e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:18:53.045864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-13e8978d-e092-429a-80c3-aab1684ac56e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '402df934fedf412db96c54e9b4853625', 'request_id': 'req-13e8978d-e092-429a-80c3-aab1684ac56e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:18:53.117250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-13e8978d-e092-429a-80c3-aab1684ac56e admin admin] The token cache is being invalidate because project 402df934fedf412db96c54e9b4853625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:18:53.117470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-13e8978d-e092-429a-80c3-aab1684ac56e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:18:53.118132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-13e8978d-e092-429a-80c3-aab1684ac56e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:18:53.119760 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4540/8974] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:18:52 2022] DELETE /identity/v3/projects/402df934fedf412db96c54e9b4853625 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:18:53.125605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bde51e-aad1-413e-a650-55150e45c2e1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:53.126130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bde51e-aad1-413e-a650-55150e45c2e1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:53.126232 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bde51e-aad1-413e-a650-55150e45c2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:53.144894 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a2bde51e-aad1-413e-a650-55150e45c2e1 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:53.146117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a2bde51e-aad1-413e-a650-55150e45c2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:53.205565 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4435/8975] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:18:53.213470 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a738413-4b20-4c60-a848-b8fd52c6fcc6 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:53.213942 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a738413-4b20-4c60-a848-b8fd52c6fcc6 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:53.214179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a738413-4b20-4c60-a848-b8fd52c6fcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:53.233198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2a738413-4b20-4c60-a848-b8fd52c6fcc6 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:53.234440 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2a738413-4b20-4c60-a848-b8fd52c6fcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:53.242460 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4541/8976] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:18:53.247390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bde51e-aad1-413e-a650-55150e45c2e1 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:53.257261 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bde51e-aad1-413e-a650-55150e45c2e1 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:53.262189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c360331-5020-4256-9201-fa6c15654620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:53.262866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c360331-5020-4256-9201-fa6c15654620 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:53.263149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c360331-5020-4256-9201-fa6c15654620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:53.263427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c360331-5020-4256-9201-fa6c15654620 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:53.264160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c360331-5020-4256-9201-fa6c15654620 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:18:53.264468 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c360331-5020-4256-9201-fa6c15654620 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:53.266077 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c360331-5020-4256-9201-fa6c15654620 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:53.273634 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:53.278663 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4436/8977] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 15:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:18:53.284369 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a738413-4b20-4c60-a848-b8fd52c6fcc6 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:53.295598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a738413-4b20-4c60-a848-b8fd52c6fcc6 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:53.300646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae4f98-1237-408e-859a-957d64f4f463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:53.301320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae4f98-1237-408e-859a-957d64f4f463 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:53.301607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae4f98-1237-408e-859a-957d64f4f463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:53.301885 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae4f98-1237-408e-859a-957d64f4f463 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:53.302650 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae4f98-1237-408e-859a-957d64f4f463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:53.304581 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae4f98-1237-408e-859a-957d64f4f463 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:53.388217 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4542/8978] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 15:18:53 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:18:53.392388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c360331-5020-4256-9201-fa6c15654620 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:53.403150 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c360331-5020-4256-9201-fa6c15654620 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:53.461136 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cdfdd-a782-462c-95b8-15d8bff120cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:53.461804 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cdfdd-a782-462c-95b8-15d8bff120cd admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:53.462087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cdfdd-a782-462c-95b8-15d8bff120cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:53.462431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9cdfdd-a782-462c-95b8-15d8bff120cd admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:53.463069 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cdfdd-a782-462c-95b8-15d8bff120cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:53.465591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9cdfdd-a782-462c-95b8-15d8bff120cd admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:53.564656 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4437/8979] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 15:18:53 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:18:53.568941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae4f98-1237-408e-859a-957d64f4f463 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:53.579431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae4f98-1237-408e-859a-957d64f4f463 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:53.584003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb69da9-2830-456a-b058-ec0f482fdd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:53.584673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb69da9-2830-456a-b058-ec0f482fdd7e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:53.584963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb69da9-2830-456a-b058-ec0f482fdd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:53.585240 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb69da9-2830-456a-b058-ec0f482fdd7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:53.585969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb69da9-2830-456a-b058-ec0f482fdd7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:53.587616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb69da9-2830-456a-b058-ec0f482fdd7e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:53.598850 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4543/8980] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:18:53.602985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cdfdd-a782-462c-95b8-15d8bff120cd admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:53.613723 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9cdfdd-a782-462c-95b8-15d8bff120cd admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:53.618491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf7473c-602c-4ea3-a6dd-9874d8576dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:53.619149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7473c-602c-4ea3-a6dd-9874d8576dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:53.619436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7473c-602c-4ea3-a6dd-9874d8576dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:53.619715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf7473c-602c-4ea3-a6dd-9874d8576dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:53.620443 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7473c-602c-4ea3-a6dd-9874d8576dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:53.622046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf7473c-602c-4ea3-a6dd-9874d8576dd7 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:53.631894 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4438/8981] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:18:53.635975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb69da9-2830-456a-b058-ec0f482fdd7e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:53.646537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb69da9-2830-456a-b058-ec0f482fdd7e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:53.651074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f85cc-0f3d-4f44-bc0d-d18887cb9b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:53.652477 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f85cc-0f3d-4f44-bc0d-d18887cb9b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:53.652760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f85cc-0f3d-4f44-bc0d-d18887cb9b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:53.653035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4f85cc-0f3d-4f44-bc0d-d18887cb9b93 admin admin] PATH_INFO: `/v3/projects/4c28c57e1e6840aeafca6ab2ba1bf6d7/users/14f8e5ebdfa844f19dbd11cb075ae4f6/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:53.668255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f85cc-0f3d-4f44-bc0d-d18887cb9b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c28c57e1e6840aeafca6ab2ba1bf6d7, user_id=14f8e5ebdfa844f19dbd11cb075ae4f6, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:53.670952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4f85cc-0f3d-4f44-bc0d-d18887cb9b93 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:53.735542 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4544/8982] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:18:53 2022] PUT /identity/v3/projects/4c28c57e1e6840aeafca6ab2ba1bf6d7/users/14f8e5ebdfa844f19dbd11cb075ae4f6/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:18:53.745688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259136c3-aa6e-4eb5-ae92-ab17fdd1d16d None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:53.745975 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259136c3-aa6e-4eb5-ae92-ab17fdd1d16d None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:53.746304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259136c3-aa6e-4eb5-ae92-ab17fdd1d16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:53.773172 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-259136c3-aa6e-4eb5-ae92-ab17fdd1d16d None None] MFA Rules not processed for user `14f8e5ebdfa844f19dbd11cb075ae4f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:18:53.774455 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-259136c3-aa6e-4eb5-ae92-ab17fdd1d16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:53.840049 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4439/8983] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:18:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:18:53.849602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f85cc-0f3d-4f44-bc0d-d18887cb9b93 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:18:53.851360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4e4f85cc-0f3d-4f44-bc0d-d18887cb9b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:18:53.865920 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:18:53.909533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4f85cc-0f3d-4f44-bc0d-d18887cb9b93 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:18:53.913162 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2bc9a-371a-40f5-8b3a-8c611705891f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:18:53.913811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2bc9a-371a-40f5-8b3a-8c611705891f service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:18:53.914110 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2bc9a-371a-40f5-8b3a-8c611705891f service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:18:53.914398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2bc9a-371a-40f5-8b3a-8c611705891f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:18:53.923316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2bc9a-371a-40f5-8b3a-8c611705891f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:18:53.924736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2bc9a-371a-40f5-8b3a-8c611705891f service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:18:53.934571 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4545/8984] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:18:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:19:03.835777 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=68,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:03.963537 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=20 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:11.754767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259136c3-aa6e-4eb5-ae92-ab17fdd1d16d None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:11.818472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259136c3-aa6e-4eb5-ae92-ab17fdd1d16d None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:11.823139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8413ce-2e2a-446b-9dd5-de664be96b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:11.824019 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8413ce-2e2a-446b-9dd5-de664be96b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:11.824305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8413ce-2e2a-446b-9dd5-de664be96b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:11.824588 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8413ce-2e2a-446b-9dd5-de664be96b5d admin admin] PATH_INFO: `/v3/users/14f8e5ebdfa844f19dbd11cb075ae4f6` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:11.825791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8413ce-2e2a-446b-9dd5-de664be96b5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=14f8e5ebdfa844f19dbd11cb075ae4f6)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:11.827786 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8413ce-2e2a-446b-9dd5-de664be96b5d admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:11.965187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fd8413ce-2e2a-446b-9dd5-de664be96b5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14f8e5ebdfa844f19dbd11cb075ae4f6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:19:11.977041 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fd8413ce-2e2a-446b-9dd5-de664be96b5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14f8e5ebdfa844f19dbd11cb075ae4f6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:19:11.977736 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fd8413ce-2e2a-446b-9dd5-de664be96b5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14f8e5ebdfa844f19dbd11cb075ae4f6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:19:11.978374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fd8413ce-2e2a-446b-9dd5-de664be96b5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14f8e5ebdfa844f19dbd11cb075ae4f6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:19:11.986090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-fd8413ce-2e2a-446b-9dd5-de664be96b5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14f8e5ebdfa844f19dbd11cb075ae4f6'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:19:12.043441 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4440/8985] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:19:11 2022] DELETE /identity/v3/users/14f8e5ebdfa844f19dbd11cb075ae4f6 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:19:12.047953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13831148-ee74-4b9a-a750-074616cc5f3d None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:12.050703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13831148-ee74-4b9a-a750-074616cc5f3d None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:12.050703 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13831148-ee74-4b9a-a750-074616cc5f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:12.066909 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-13831148-ee74-4b9a-a750-074616cc5f3d None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:12.068095 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-13831148-ee74-4b9a-a750-074616cc5f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:12.127158 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4546/8986] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:19:12.137557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8413ce-2e2a-446b-9dd5-de664be96b5d admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:12.139070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fd8413ce-2e2a-446b-9dd5-de664be96b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:12.196905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8413ce-2e2a-446b-9dd5-de664be96b5d admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:12.200669 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac28c1e-25e3-4a93-aaae-f7fa3728a847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:12.201316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac28c1e-25e3-4a93-aaae-f7fa3728a847 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:12.201606 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac28c1e-25e3-4a93-aaae-f7fa3728a847 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:12.201889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac28c1e-25e3-4a93-aaae-f7fa3728a847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:12.213101 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac28c1e-25e3-4a93-aaae-f7fa3728a847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:12.215275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac28c1e-25e3-4a93-aaae-f7fa3728a847 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:12.225061 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4441/8987] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:19:12.468204 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13831148-ee74-4b9a-a750-074616cc5f3d None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:12.471808 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-13831148-ee74-4b9a-a750-074616cc5f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:12.483051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13831148-ee74-4b9a-a750-074616cc5f3d None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:12.487915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2719fe8-e6a2-4f18-8cd9-2f9ccf7b7dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:12.488806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2719fe8-e6a2-4f18-8cd9-2f9ccf7b7dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:12.489098 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2719fe8-e6a2-4f18-8cd9-2f9ccf7b7dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:12.489380 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2719fe8-e6a2-4f18-8cd9-2f9ccf7b7dc9 admin admin] PATH_INFO: `/v3/projects/4c28c57e1e6840aeafca6ab2ba1bf6d7` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:12.490681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2719fe8-e6a2-4f18-8cd9-2f9ccf7b7dc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c28c57e1e6840aeafca6ab2ba1bf6d7)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:12.492721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2719fe8-e6a2-4f18-8cd9-2f9ccf7b7dc9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:12.604653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c2719fe8-e6a2-4f18-8cd9-2f9ccf7b7dc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c28c57e1e6840aeafca6ab2ba1bf6d7', 'request_id': 'req-c2719fe8-e6a2-4f18-8cd9-2f9ccf7b7dc9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:19:12.610066 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c2719fe8-e6a2-4f18-8cd9-2f9ccf7b7dc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c28c57e1e6840aeafca6ab2ba1bf6d7', 'request_id': 'req-c2719fe8-e6a2-4f18-8cd9-2f9ccf7b7dc9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:19:12.616431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c2719fe8-e6a2-4f18-8cd9-2f9ccf7b7dc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c28c57e1e6840aeafca6ab2ba1bf6d7', 'request_id': 'req-c2719fe8-e6a2-4f18-8cd9-2f9ccf7b7dc9'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:19:12.677021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c2719fe8-e6a2-4f18-8cd9-2f9ccf7b7dc9 admin admin] The token cache is being invalidate because project 4c28c57e1e6840aeafca6ab2ba1bf6d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:19:12.677318 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c2719fe8-e6a2-4f18-8cd9-2f9ccf7b7dc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:19:12.677957 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-c2719fe8-e6a2-4f18-8cd9-2f9ccf7b7dc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:19:12.679574 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4547/8988] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:19:12 2022] DELETE /identity/v3/projects/4c28c57e1e6840aeafca6ab2ba1bf6d7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:19:12.685332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36754e15-4920-4264-903b-d0a5af5aa822 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:12.685627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36754e15-4920-4264-903b-d0a5af5aa822 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:12.685929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36754e15-4920-4264-903b-d0a5af5aa822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:12.704666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-36754e15-4920-4264-903b-d0a5af5aa822 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:12.705930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-36754e15-4920-4264-903b-d0a5af5aa822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:12.723372 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:12.766005 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4442/8989] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:19:12.773749 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a126b-bdc3-44bd-bbc3-4463e5a72925 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:12.774036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a126b-bdc3-44bd-bbc3-4463e5a72925 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:12.774351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a126b-bdc3-44bd-bbc3-4463e5a72925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:12.794390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-858a126b-bdc3-44bd-bbc3-4463e5a72925 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:12.795583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-858a126b-bdc3-44bd-bbc3-4463e5a72925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:12.803585 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4548/8990] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:19:12.807982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36754e15-4920-4264-903b-d0a5af5aa822 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:12.817935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36754e15-4920-4264-903b-d0a5af5aa822 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:12.822559 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01229fb6-4ff5-4234-9d31-bafe2d5726f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:12.823220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01229fb6-4ff5-4234-9d31-bafe2d5726f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:12.824181 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01229fb6-4ff5-4234-9d31-bafe2d5726f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:12.824484 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01229fb6-4ff5-4234-9d31-bafe2d5726f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:12.825211 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01229fb6-4ff5-4234-9d31-bafe2d5726f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:12.825524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01229fb6-4ff5-4234-9d31-bafe2d5726f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:12.827169 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01229fb6-4ff5-4234-9d31-bafe2d5726f4 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:12.838672 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4443/8991] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 15:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 15:19:12.843899 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a126b-bdc3-44bd-bbc3-4463e5a72925 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:12.853183 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a126b-bdc3-44bd-bbc3-4463e5a72925 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:12.858161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f36859-fdb6-462c-80f4-17a62c568f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:12.858780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f36859-fdb6-462c-80f4-17a62c568f9b admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:12.859067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f36859-fdb6-462c-80f4-17a62c568f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:12.859343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f36859-fdb6-462c-80f4-17a62c568f9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:12.860026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f36859-fdb6-462c-80f4-17a62c568f9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:12.861910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f36859-fdb6-462c-80f4-17a62c568f9b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:13.033954 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4549/8992] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 15:19:12 2022] POST /identity/v3/projects => generated 375 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:19:13.037976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01229fb6-4ff5-4234-9d31-bafe2d5726f4 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:13.048929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01229fb6-4ff5-4234-9d31-bafe2d5726f4 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:13.107337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f32cc-6852-4119-a9c3-ee13eba6684f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:13.108008 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f32cc-6852-4119-a9c3-ee13eba6684f admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:13.108346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f32cc-6852-4119-a9c3-ee13eba6684f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:13.108577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968f32cc-6852-4119-a9c3-ee13eba6684f admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:13.109297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f32cc-6852-4119-a9c3-ee13eba6684f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:13.111368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968f32cc-6852-4119-a9c3-ee13eba6684f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:13.191819 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4444/8993] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 15:19:13 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:19:13.196015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f36859-fdb6-462c-80f4-17a62c568f9b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:13.208062 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f36859-fdb6-462c-80f4-17a62c568f9b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:13.212892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdfa5b-85e1-47fc-8f15-b649fe18cc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:13.213571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdfa5b-85e1-47fc-8f15-b649fe18cc09 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:13.213862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdfa5b-85e1-47fc-8f15-b649fe18cc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:13.214228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdfa5b-85e1-47fc-8f15-b649fe18cc09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:13.215571 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdfa5b-85e1-47fc-8f15-b649fe18cc09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:13.217183 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdfa5b-85e1-47fc-8f15-b649fe18cc09 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:13.229671 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4550/8994] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:19:13.234155 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f32cc-6852-4119-a9c3-ee13eba6684f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:13.244305 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968f32cc-6852-4119-a9c3-ee13eba6684f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:13.249722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fa48c-9aa7-4ee5-a010-789e8e76518a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:13.250415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fa48c-9aa7-4ee5-a010-789e8e76518a admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:13.250703 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fa48c-9aa7-4ee5-a010-789e8e76518a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:13.250981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fa48c-9aa7-4ee5-a010-789e8e76518a admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:13.251709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fa48c-9aa7-4ee5-a010-789e8e76518a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:13.253287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fa48c-9aa7-4ee5-a010-789e8e76518a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:13.264024 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4445/8995] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:19:13.268257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdfa5b-85e1-47fc-8f15-b649fe18cc09 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:13.278665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdfa5b-85e1-47fc-8f15-b649fe18cc09 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:13.283947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37655e-e30e-4ef4-a10c-16199fd6032b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:13.284830 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37655e-e30e-4ef4-a10c-16199fd6032b admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:13.285120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37655e-e30e-4ef4-a10c-16199fd6032b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:13.285397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37655e-e30e-4ef4-a10c-16199fd6032b admin admin] PATH_INFO: `/v3/projects/eeddb74e0d364f8681ee63193f7ac782/users/83de6c0f97504f3e9e346a6abbef2fa9/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:13.300806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37655e-e30e-4ef4-a10c-16199fd6032b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeddb74e0d364f8681ee63193f7ac782, user_id=83de6c0f97504f3e9e346a6abbef2fa9, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:13.303495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37655e-e30e-4ef4-a10c-16199fd6032b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:13.403688 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4551/8996] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:19:13 2022] PUT /identity/v3/projects/eeddb74e0d364f8681ee63193f7ac782/users/83de6c0f97504f3e9e346a6abbef2fa9/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:19:13.414317 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c11fb-348a-407d-8b1e-943b35a79297 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:13.414614 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c11fb-348a-407d-8b1e-943b35a79297 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:13.414898 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c11fb-348a-407d-8b1e-943b35a79297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:13.442162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-340c11fb-348a-407d-8b1e-943b35a79297 None None] MFA Rules not processed for user `83de6c0f97504f3e9e346a6abbef2fa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:13.443332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-340c11fb-348a-407d-8b1e-943b35a79297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:13.510587 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4446/8997] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:19:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:19:13.520988 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37655e-e30e-4ef4-a10c-16199fd6032b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:13.522755 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4f37655e-e30e-4ef4-a10c-16199fd6032b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:13.545373 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:13.581236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37655e-e30e-4ef4-a10c-16199fd6032b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:13.584949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d535b-4e0d-42cf-ac6d-1371db4f60fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:13.585600 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d535b-4e0d-42cf-ac6d-1371db4f60fd service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:13.585892 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d535b-4e0d-42cf-ac6d-1371db4f60fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:13.586317 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d535b-4e0d-42cf-ac6d-1371db4f60fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:13.594882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d535b-4e0d-42cf-ac6d-1371db4f60fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:13.596347 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d535b-4e0d-42cf-ac6d-1371db4f60fd service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:13.605818 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4552/8998] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:19:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:19:19.746825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c11fb-348a-407d-8b1e-943b35a79297 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:19.765836 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:19.825943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c11fb-348a-407d-8b1e-943b35a79297 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:19.830567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa778e-7c6b-4aab-8a22-df4ae5f235f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:19.831461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa778e-7c6b-4aab-8a22-df4ae5f235f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:19.831740 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa778e-7c6b-4aab-8a22-df4ae5f235f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:19.832026 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa778e-7c6b-4aab-8a22-df4ae5f235f1 admin admin] PATH_INFO: `/v3/users/83de6c0f97504f3e9e346a6abbef2fa9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:19.833228 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa778e-7c6b-4aab-8a22-df4ae5f235f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83de6c0f97504f3e9e346a6abbef2fa9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:19.835170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa778e-7c6b-4aab-8a22-df4ae5f235f1 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:20.033984 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-39aa778e-7c6b-4aab-8a22-df4ae5f235f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83de6c0f97504f3e9e346a6abbef2fa9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:19:20.046570 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-39aa778e-7c6b-4aab-8a22-df4ae5f235f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83de6c0f97504f3e9e346a6abbef2fa9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:19:20.047237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-39aa778e-7c6b-4aab-8a22-df4ae5f235f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83de6c0f97504f3e9e346a6abbef2fa9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:19:20.047845 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-39aa778e-7c6b-4aab-8a22-df4ae5f235f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83de6c0f97504f3e9e346a6abbef2fa9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:19:20.054640 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-39aa778e-7c6b-4aab-8a22-df4ae5f235f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83de6c0f97504f3e9e346a6abbef2fa9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:19:20.123446 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4447/8999] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:19:19 2022] DELETE /identity/v3/users/83de6c0f97504f3e9e346a6abbef2fa9 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:19:20.128195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ed002-e6e7-4ae9-92c8-b0f62ebaa7d7 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:20.128700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ed002-e6e7-4ae9-92c8-b0f62ebaa7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:20.128800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ed002-e6e7-4ae9-92c8-b0f62ebaa7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:20.156216 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-fb9ed002-e6e7-4ae9-92c8-b0f62ebaa7d7 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:20.157439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fb9ed002-e6e7-4ae9-92c8-b0f62ebaa7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:20.217751 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4553/9000] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:19:20.227469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa778e-7c6b-4aab-8a22-df4ae5f235f1 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:20.228893 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-39aa778e-7c6b-4aab-8a22-df4ae5f235f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:20.286298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa778e-7c6b-4aab-8a22-df4ae5f235f1 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:20.289871 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c69b003-8e98-47eb-913c-bdd5cead3ca8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:20.290556 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69b003-8e98-47eb-913c-bdd5cead3ca8 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:20.291100 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69b003-8e98-47eb-913c-bdd5cead3ca8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:20.291379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c69b003-8e98-47eb-913c-bdd5cead3ca8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:20.300906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69b003-8e98-47eb-913c-bdd5cead3ca8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:20.302386 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c69b003-8e98-47eb-913c-bdd5cead3ca8 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:20.312432 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4448/9001] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:19:20.548929 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ed002-e6e7-4ae9-92c8-b0f62ebaa7d7 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:20.555690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-fb9ed002-e6e7-4ae9-92c8-b0f62ebaa7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:20.564102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ed002-e6e7-4ae9-92c8-b0f62ebaa7d7 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:20.568826 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f213e50f-b70a-4fb2-aad9-63efa00a259f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:20.569699 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213e50f-b70a-4fb2-aad9-63efa00a259f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:20.569985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213e50f-b70a-4fb2-aad9-63efa00a259f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:20.570302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f213e50f-b70a-4fb2-aad9-63efa00a259f admin admin] PATH_INFO: `/v3/projects/eeddb74e0d364f8681ee63193f7ac782` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:20.571510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213e50f-b70a-4fb2-aad9-63efa00a259f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeddb74e0d364f8681ee63193f7ac782)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:20.573555 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f213e50f-b70a-4fb2-aad9-63efa00a259f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:20.701213 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f213e50f-b70a-4fb2-aad9-63efa00a259f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeddb74e0d364f8681ee63193f7ac782', 'request_id': 'req-f213e50f-b70a-4fb2-aad9-63efa00a259f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:19:20.706797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f213e50f-b70a-4fb2-aad9-63efa00a259f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeddb74e0d364f8681ee63193f7ac782', 'request_id': 'req-f213e50f-b70a-4fb2-aad9-63efa00a259f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:19:20.713063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f213e50f-b70a-4fb2-aad9-63efa00a259f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeddb74e0d364f8681ee63193f7ac782', 'request_id': 'req-f213e50f-b70a-4fb2-aad9-63efa00a259f'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:19:20.802239 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f213e50f-b70a-4fb2-aad9-63efa00a259f admin admin] The token cache is being invalidate because project eeddb74e0d364f8681ee63193f7ac782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:19:20.802533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f213e50f-b70a-4fb2-aad9-63efa00a259f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:19:20.803161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f213e50f-b70a-4fb2-aad9-63efa00a259f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:19:20.804750 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4554/9002] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:19:20 2022] DELETE /identity/v3/projects/eeddb74e0d364f8681ee63193f7ac782 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:19:20.810130 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908c4b7-5a41-4e40-9e57-2b903c96f1a0 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:20.810609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908c4b7-5a41-4e40-9e57-2b903c96f1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:20.810771 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c908c4b7-5a41-4e40-9e57-2b903c96f1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:20.829198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c908c4b7-5a41-4e40-9e57-2b903c96f1a0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:20.830444 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c908c4b7-5a41-4e40-9e57-2b903c96f1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:20.848190 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:20.891854 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4449/9003] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:19:20.899680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f56e66-c88d-4e1b-9ff0-3fe69f07b64f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:20.900049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f56e66-c88d-4e1b-9ff0-3fe69f07b64f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:20.900357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f56e66-c88d-4e1b-9ff0-3fe69f07b64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:20.919956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-13f56e66-c88d-4e1b-9ff0-3fe69f07b64f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:20.921219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-13f56e66-c88d-4e1b-9ff0-3fe69f07b64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:20.929060 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4555/9004] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:19:20.933291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908c4b7-5a41-4e40-9e57-2b903c96f1a0 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:20.943254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c908c4b7-5a41-4e40-9e57-2b903c96f1a0 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:20.947799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45422272-b04d-4399-985d-9e174a7d0922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:20.953292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45422272-b04d-4399-985d-9e174a7d0922 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:20.953292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45422272-b04d-4399-985d-9e174a7d0922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:20.953292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45422272-b04d-4399-985d-9e174a7d0922 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:20.953292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45422272-b04d-4399-985d-9e174a7d0922 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:19:20.953292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45422272-b04d-4399-985d-9e174a7d0922 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:20.953292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45422272-b04d-4399-985d-9e174a7d0922 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:20.964086 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4450/9005] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 15:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:19:20.969003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f56e66-c88d-4e1b-9ff0-3fe69f07b64f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:20.978230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f56e66-c88d-4e1b-9ff0-3fe69f07b64f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:20.983359 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a52304-82b6-4745-8f21-d1e416eed738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:20.984012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a52304-82b6-4745-8f21-d1e416eed738 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:20.984297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a52304-82b6-4745-8f21-d1e416eed738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:20.984575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a52304-82b6-4745-8f21-d1e416eed738 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:20.985267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a52304-82b6-4745-8f21-d1e416eed738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:20.987191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a52304-82b6-4745-8f21-d1e416eed738 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:21.055910 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4556/9006] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 15:19:20 2022] POST /identity/v3/projects => generated 389 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:19:21.060371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45422272-b04d-4399-985d-9e174a7d0922 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:21.076119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45422272-b04d-4399-985d-9e174a7d0922 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:21.131683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce4163-7e1a-436d-a4af-06a8ece3d336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:21.132480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce4163-7e1a-436d-a4af-06a8ece3d336 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:21.132790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce4163-7e1a-436d-a4af-06a8ece3d336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:21.133050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ce4163-7e1a-436d-a4af-06a8ece3d336 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:21.133775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce4163-7e1a-436d-a4af-06a8ece3d336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:21.135717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ce4163-7e1a-436d-a4af-06a8ece3d336 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:21.271187 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4451/9007] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 15:19:21 2022] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:19:21.271301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a52304-82b6-4745-8f21-d1e416eed738 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:21.276883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a52304-82b6-4745-8f21-d1e416eed738 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:21.281503 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c848511-c2c1-4296-8a6d-d21545df0624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:21.282220 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c848511-c2c1-4296-8a6d-d21545df0624 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:21.282508 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c848511-c2c1-4296-8a6d-d21545df0624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:21.282789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c848511-c2c1-4296-8a6d-d21545df0624 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:21.283543 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c848511-c2c1-4296-8a6d-d21545df0624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:21.285205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c848511-c2c1-4296-8a6d-d21545df0624 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:21.287331 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:21.296859 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4557/9008] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:19:21.300789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce4163-7e1a-436d-a4af-06a8ece3d336 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:21.312033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ce4163-7e1a-436d-a4af-06a8ece3d336 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:21.320009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a1c9a-77c7-43d7-aefc-5e038be7de98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:21.320009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a1c9a-77c7-43d7-aefc-5e038be7de98 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:21.320009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a1c9a-77c7-43d7-aefc-5e038be7de98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:21.320009 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a1c9a-77c7-43d7-aefc-5e038be7de98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:21.320411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a1c9a-77c7-43d7-aefc-5e038be7de98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:21.320411 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a1c9a-77c7-43d7-aefc-5e038be7de98 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:21.331179 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4452/9009] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:19:21.335354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c848511-c2c1-4296-8a6d-d21545df0624 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:21.346030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c848511-c2c1-4296-8a6d-d21545df0624 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:21.350701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfc0c2-5a8c-4ed8-8a34-97f060892de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:21.351583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfc0c2-5a8c-4ed8-8a34-97f060892de4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:21.352195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfc0c2-5a8c-4ed8-8a34-97f060892de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:21.352458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfc0c2-5a8c-4ed8-8a34-97f060892de4 admin admin] PATH_INFO: `/v3/projects/9e876d4ff2b844d98a25db9fd13c4046/users/507570e5d50a4b42b9f04d936a0a7550/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:21.367969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfc0c2-5a8c-4ed8-8a34-97f060892de4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e876d4ff2b844d98a25db9fd13c4046, user_id=507570e5d50a4b42b9f04d936a0a7550, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:21.374057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfc0c2-5a8c-4ed8-8a34-97f060892de4 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:21.426287 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4558/9010] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:19:21 2022] PUT /identity/v3/projects/9e876d4ff2b844d98a25db9fd13c4046/users/507570e5d50a4b42b9f04d936a0a7550/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:19:21.431623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21426fa-db56-4b65-b8bc-82f996066951 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:21.431922 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21426fa-db56-4b65-b8bc-82f996066951 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:21.432205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21426fa-db56-4b65-b8bc-82f996066951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:21.451047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-c21426fa-db56-4b65-b8bc-82f996066951 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:21.452247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c21426fa-db56-4b65-b8bc-82f996066951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:21.511971 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4453/9011] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:19:21.521583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfc0c2-5a8c-4ed8-8a34-97f060892de4 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:21.523363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2ccfc0c2-5a8c-4ed8-8a34-97f060892de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:21.581512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfc0c2-5a8c-4ed8-8a34-97f060892de4 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:21.585167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e263d-4bbd-400b-92b1-18ae9c16fb22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:21.585811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e263d-4bbd-400b-92b1-18ae9c16fb22 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:21.586114 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e263d-4bbd-400b-92b1-18ae9c16fb22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:21.586414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508e263d-4bbd-400b-92b1-18ae9c16fb22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:21.595780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e263d-4bbd-400b-92b1-18ae9c16fb22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:21.597209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508e263d-4bbd-400b-92b1-18ae9c16fb22 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:21.607325 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4559/9012] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:19:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:19:26.796968 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3486a-ecee-4a94-825e-c7080d63224a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:26.797481 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3486a-ecee-4a94-825e-c7080d63224a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:26.797666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f3486a-ecee-4a94-825e-c7080d63224a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:26.826429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a5f3486a-ecee-4a94-825e-c7080d63224a None None] MFA Rules not processed for user `507570e5d50a4b42b9f04d936a0a7550`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:26.827673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a5f3486a-ecee-4a94-825e-c7080d63224a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:26.847188 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:26.898831 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4454/9013] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:19:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:19:26.903763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e263d-4bbd-400b-92b1-18ae9c16fb22 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:26.914046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508e263d-4bbd-400b-92b1-18ae9c16fb22 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:26.919932 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56220d0d-9489-44b0-9de8-d988470179c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:26.920575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56220d0d-9489-44b0-9de8-d988470179c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:26.920864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56220d0d-9489-44b0-9de8-d988470179c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:26.921140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56220d0d-9489-44b0-9de8-d988470179c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:26.921947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56220d0d-9489-44b0-9de8-d988470179c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:26.923897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56220d0d-9489-44b0-9de8-d988470179c8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:27.014615 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4560/9014] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 15:19:26 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:19:27.015672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3486a-ecee-4a94-825e-c7080d63224a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:27.027173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f3486a-ecee-4a94-825e-c7080d63224a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:27.091018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73b8f0-21d1-4ae5-ac90-5d471c6aa7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:27.091833 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73b8f0-21d1-4ae5-ac90-5d471c6aa7be admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:27.092124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73b8f0-21d1-4ae5-ac90-5d471c6aa7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:27.092406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73b8f0-21d1-4ae5-ac90-5d471c6aa7be admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:27.093112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73b8f0-21d1-4ae5-ac90-5d471c6aa7be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:27.095137 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73b8f0-21d1-4ae5-ac90-5d471c6aa7be admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:27.176458 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4455/9015] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 15:19:27 2022] POST /identity/v3/users => generated 300 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:19:27.180493 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56220d0d-9489-44b0-9de8-d988470179c8 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:27.191242 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56220d0d-9489-44b0-9de8-d988470179c8 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:27.195825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183305e-9b6c-428e-bff0-8ecdeec54d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:27.196533 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183305e-9b6c-428e-bff0-8ecdeec54d4b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:27.196825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183305e-9b6c-428e-bff0-8ecdeec54d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:27.197104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3183305e-9b6c-428e-bff0-8ecdeec54d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:27.198021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183305e-9b6c-428e-bff0-8ecdeec54d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:27.199695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3183305e-9b6c-428e-bff0-8ecdeec54d4b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:27.211187 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4561/9016] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:19:27.215889 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73b8f0-21d1-4ae5-ac90-5d471c6aa7be admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:27.226472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73b8f0-21d1-4ae5-ac90-5d471c6aa7be admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:27.231900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a758ad3-e0e6-4d9f-926b-4776631c3532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:27.232795 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a758ad3-e0e6-4d9f-926b-4776631c3532 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:27.233082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a758ad3-e0e6-4d9f-926b-4776631c3532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:27.233368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a758ad3-e0e6-4d9f-926b-4776631c3532 admin admin] PATH_INFO: `/v3/projects/0bc2ea9ea38a4bb2917141e30e52c12e/users/c4fde83bc9624b408b74312f1b5681f3/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:27.248437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a758ad3-e0e6-4d9f-926b-4776631c3532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc2ea9ea38a4bb2917141e30e52c12e, user_id=c4fde83bc9624b408b74312f1b5681f3, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:27.251196 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a758ad3-e0e6-4d9f-926b-4776631c3532 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:27.331607 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4456/9017] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:19:27 2022] PUT /identity/v3/projects/0bc2ea9ea38a4bb2917141e30e52c12e/users/c4fde83bc9624b408b74312f1b5681f3/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:19:27.335634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183305e-9b6c-428e-bff0-8ecdeec54d4b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:27.347636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3183305e-9b6c-428e-bff0-8ecdeec54d4b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:27.408480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e985a8e3-9a92-4919-96ef-f4a5b9029dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:27.409605 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985a8e3-9a92-4919-96ef-f4a5b9029dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:27.409896 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985a8e3-9a92-4919-96ef-f4a5b9029dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:27.410210 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e985a8e3-9a92-4919-96ef-f4a5b9029dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:27.410955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985a8e3-9a92-4919-96ef-f4a5b9029dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:27.412564 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e985a8e3-9a92-4919-96ef-f4a5b9029dc7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:27.427804 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4562/9018] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:19:27.429016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a758ad3-e0e6-4d9f-926b-4776631c3532 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:27.440330 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a758ad3-e0e6-4d9f-926b-4776631c3532 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:27.445049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b7e02-8891-4d3c-8272-06a71d8b4145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:27.445938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b7e02-8891-4d3c-8272-06a71d8b4145 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:27.446257 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b7e02-8891-4d3c-8272-06a71d8b4145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:27.446537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26b7e02-8891-4d3c-8272-06a71d8b4145 admin admin] PATH_INFO: `/v3/projects/0bc2ea9ea38a4bb2917141e30e52c12e/users/c4fde83bc9624b408b74312f1b5681f3/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:27.449144 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b7e02-8891-4d3c-8272-06a71d8b4145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc2ea9ea38a4bb2917141e30e52c12e, user_id=c4fde83bc9624b408b74312f1b5681f3, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:27.452418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26b7e02-8891-4d3c-8272-06a71d8b4145 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:27.462959 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4457/9019] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:19:27 2022] PUT /identity/v3/projects/0bc2ea9ea38a4bb2917141e30e52c12e/users/c4fde83bc9624b408b74312f1b5681f3/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:19:33.141164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297fa79-6c5b-4ff8-86a0-85efc73803ca None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:33.141676 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297fa79-6c5b-4ff8-86a0-85efc73803ca None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:33.141772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297fa79-6c5b-4ff8-86a0-85efc73803ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:33.172393 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-b297fa79-6c5b-4ff8-86a0-85efc73803ca None None] MFA Rules not processed for user `c4fde83bc9624b408b74312f1b5681f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:33.173691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-b297fa79-6c5b-4ff8-86a0-85efc73803ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:33.224679 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:33.268694 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4563/9020] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:19:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:19:33.285115 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b7e02-8891-4d3c-8272-06a71d8b4145 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:33.287742 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b26b7e02-8891-4d3c-8272-06a71d8b4145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:33.388175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26b7e02-8891-4d3c-8272-06a71d8b4145 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:33.393807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64b4b5-3926-46bd-9972-e4a201db5300 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:33.394497 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64b4b5-3926-46bd-9972-e4a201db5300 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:33.394781 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64b4b5-3926-46bd-9972-e4a201db5300 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:33.395058 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64b4b5-3926-46bd-9972-e4a201db5300 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:33.400372 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:33.453276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64b4b5-3926-46bd-9972-e4a201db5300 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:33.454911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64b4b5-3926-46bd-9972-e4a201db5300 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:33.464208 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4458/9021] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:19:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:19:33.607003 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4596e8-335c-419a-8e45-ab46c6af2c60 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:33.607302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4596e8-335c-419a-8e45-ab46c6af2c60 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:33.607615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4596e8-335c-419a-8e45-ab46c6af2c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:33.625672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5d4596e8-335c-419a-8e45-ab46c6af2c60 None None] MFA Rules not processed for user `507570e5d50a4b42b9f04d936a0a7550`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:33.626925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5d4596e8-335c-419a-8e45-ab46c6af2c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:33.634671 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4564/9022] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:19:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:19:33.673337 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f01d8-5d53-4029-8eb3-a4614aa2b193 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:33.673633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f01d8-5d53-4029-8eb3-a4614aa2b193 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:33.673916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f01d8-5d53-4029-8eb3-a4614aa2b193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:33.724717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-047f01d8-5d53-4029-8eb3-a4614aa2b193 None None] MFA Rules not processed for user `75efea22b2484c1ea79a74e6793050f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:19:33.725847 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-047f01d8-5d53-4029-8eb3-a4614aa2b193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:33.798302 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4459/9023] 10.222.0.43 () {58 vars in 1058 bytes} [Tue Jul 19 15:19:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:19:33.800169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4596e8-335c-419a-8e45-ab46c6af2c60 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:33.811404 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4596e8-335c-419a-8e45-ab46c6af2c60 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:33.816689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac10d98-720c-4391-a748-9c0c8e71ff70 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:33.817455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac10d98-720c-4391-a748-9c0c8e71ff70 service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:33.817807 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac10d98-720c-4391-a748-9c0c8e71ff70 service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:33.818185 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac10d98-720c-4391-a748-9c0c8e71ff70 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:33.820018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3ac10d98-720c-4391-a748-9c0c8e71ff70 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:33.835514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac10d98-720c-4391-a748-9c0c8e71ff70 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:33.836948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac10d98-720c-4391-a748-9c0c8e71ff70 service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:33.849205 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4565/9024] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:19:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:19:34.486157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f01d8-5d53-4029-8eb3-a4614aa2b193 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:34.558447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f01d8-5d53-4029-8eb3-a4614aa2b193 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:34.562631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569430c1-783f-4211-90c3-fcc5acf78b5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:34.563720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569430c1-783f-4211-90c3-fcc5acf78b5e service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:34.563720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569430c1-783f-4211-90c3-fcc5acf78b5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:34.564037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569430c1-783f-4211-90c3-fcc5acf78b5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:34.566488 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-569430c1-783f-4211-90c3-fcc5acf78b5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:34.581654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569430c1-783f-4211-90c3-fcc5acf78b5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:34.583499 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569430c1-783f-4211-90c3-fcc5acf78b5e service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:34.601037 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4460/9025] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:19:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:19:43.843975 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=25 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:44.593085 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=88 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:19:46.727478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac10d98-720c-4391-a748-9c0c8e71ff70 service glance] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:19:46.728914 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3ac10d98-720c-4391-a748-9c0c8e71ff70 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:19:46.807900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac10d98-720c-4391-a748-9c0c8e71ff70 service glance] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:19:46.812691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27776ae-dde1-42de-8924-d7f370b175fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:19:46.813344 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27776ae-dde1-42de-8924-d7f370b175fd service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:19:46.813630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27776ae-dde1-42de-8924-d7f370b175fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:19:46.813904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27776ae-dde1-42de-8924-d7f370b175fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:19:46.831947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27776ae-dde1-42de-8924-d7f370b175fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:19:46.833390 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27776ae-dde1-42de-8924-d7f370b175fd service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:19:46.843966 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4566/9026] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:19:46 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:19:56.838902 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=36 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:15.462323 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2439178-0f69-4a7e-8697-cb40543f0ecc None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:15.463160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2439178-0f69-4a7e-8697-cb40543f0ecc None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:15.463160 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2439178-0f69-4a7e-8697-cb40543f0ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:15.480273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e2439178-0f69-4a7e-8697-cb40543f0ecc None None] MFA Rules not processed for user `507570e5d50a4b42b9f04d936a0a7550`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:20:15.481495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e2439178-0f69-4a7e-8697-cb40543f0ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:15.489360 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4461/9027] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:20:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:20:16.123201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27776ae-dde1-42de-8924-d7f370b175fd service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:16.124788 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c27776ae-dde1-42de-8924-d7f370b175fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:16.208958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27776ae-dde1-42de-8924-d7f370b175fd service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:16.213987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35255e20-6e4f-4aca-bea1-5a2c7d73f95c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:16.214810 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35255e20-6e4f-4aca-bea1-5a2c7d73f95c service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:16.215078 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35255e20-6e4f-4aca-bea1-5a2c7d73f95c service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:16.215356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35255e20-6e4f-4aca-bea1-5a2c7d73f95c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:16.217237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-35255e20-6e4f-4aca-bea1-5a2c7d73f95c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:16.230982 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35255e20-6e4f-4aca-bea1-5a2c7d73f95c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:16.232615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35255e20-6e4f-4aca-bea1-5a2c7d73f95c service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:16.243098 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4567/9028] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:20:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:20:25.475105 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:26.238913 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=37 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:20:55.972495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2439178-0f69-4a7e-8697-cb40543f0ecc None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:20:55.974035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e2439178-0f69-4a7e-8697-cb40543f0ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:55.990810 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2439178-0f69-4a7e-8697-cb40543f0ecc None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:20:55.996470 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6adc3f-57b5-4b72-bbed-4bccae548562 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:20:55.997118 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6adc3f-57b5-4b72-bbed-4bccae548562 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:20:55.997409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6adc3f-57b5-4b72-bbed-4bccae548562 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:20:55.997690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6adc3f-57b5-4b72-bbed-4bccae548562 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:20:55.999500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bf6adc3f-57b5-4b72-bbed-4bccae548562 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:20:56.012013 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6adc3f-57b5-4b72-bbed-4bccae548562 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:20:56.013623 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6adc3f-57b5-4b72-bbed-4bccae548562 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:20:56.024542 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4462/9029] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:20:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:21:04.988653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35255e20-6e4f-4aca-bea1-5a2c7d73f95c service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:05.054295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35255e20-6e4f-4aca-bea1-5a2c7d73f95c service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:05.058889 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a728fc8-4170-4685-9a8e-a8f41599fd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:05.059765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a728fc8-4170-4685-9a8e-a8f41599fd7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:05.060055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a728fc8-4170-4685-9a8e-a8f41599fd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:05.060333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a728fc8-4170-4685-9a8e-a8f41599fd7b admin admin] PATH_INFO: `/v3/users/507570e5d50a4b42b9f04d936a0a7550` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:05.061521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a728fc8-4170-4685-9a8e-a8f41599fd7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=507570e5d50a4b42b9f04d936a0a7550)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:05.064153 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a728fc8-4170-4685-9a8e-a8f41599fd7b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:05.297354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1a728fc8-4170-4685-9a8e-a8f41599fd7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '507570e5d50a4b42b9f04d936a0a7550'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:21:05.310148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1a728fc8-4170-4685-9a8e-a8f41599fd7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '507570e5d50a4b42b9f04d936a0a7550'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:21:05.317898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1a728fc8-4170-4685-9a8e-a8f41599fd7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '507570e5d50a4b42b9f04d936a0a7550'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:21:05.319875 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1a728fc8-4170-4685-9a8e-a8f41599fd7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '507570e5d50a4b42b9f04d936a0a7550'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:21:05.386281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-1a728fc8-4170-4685-9a8e-a8f41599fd7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '507570e5d50a4b42b9f04d936a0a7550'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:21:05.393040 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4568/9030] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:21:04 2022] DELETE /identity/v3/users/507570e5d50a4b42b9f04d936a0a7550 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:21:05.616888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6adc3f-57b5-4b72-bbed-4bccae548562 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:05.628969 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6adc3f-57b5-4b72-bbed-4bccae548562 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:05.686387 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc207bf-45bd-40fb-9676-3a362c6fc5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:05.687801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc207bf-45bd-40fb-9676-3a362c6fc5ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:05.688087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc207bf-45bd-40fb-9676-3a362c6fc5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:05.688367 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc207bf-45bd-40fb-9676-3a362c6fc5ad admin admin] PATH_INFO: `/v3/projects/9e876d4ff2b844d98a25db9fd13c4046` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:05.689558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc207bf-45bd-40fb-9676-3a362c6fc5ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e876d4ff2b844d98a25db9fd13c4046)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:05.691485 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc207bf-45bd-40fb-9676-3a362c6fc5ad admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:05.804099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-afc207bf-45bd-40fb-9676-3a362c6fc5ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e876d4ff2b844d98a25db9fd13c4046', 'request_id': 'req-afc207bf-45bd-40fb-9676-3a362c6fc5ad'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:21:05.854313 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-afc207bf-45bd-40fb-9676-3a362c6fc5ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e876d4ff2b844d98a25db9fd13c4046', 'request_id': 'req-afc207bf-45bd-40fb-9676-3a362c6fc5ad'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:21:05.861673 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-afc207bf-45bd-40fb-9676-3a362c6fc5ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e876d4ff2b844d98a25db9fd13c4046', 'request_id': 'req-afc207bf-45bd-40fb-9676-3a362c6fc5ad'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:21:05.872487 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-afc207bf-45bd-40fb-9676-3a362c6fc5ad admin admin] The token cache is being invalidate because project 9e876d4ff2b844d98a25db9fd13c4046 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:21:05.872776 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-afc207bf-45bd-40fb-9676-3a362c6fc5ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:21:05.873414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-afc207bf-45bd-40fb-9676-3a362c6fc5ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:21:05.875372 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4463/9031] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:21:05 2022] DELETE /identity/v3/projects/9e876d4ff2b844d98a25db9fd13c4046 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:21:05.879418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a728fc8-4170-4685-9a8e-a8f41599fd7b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:05.880860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1a728fc8-4170-4685-9a8e-a8f41599fd7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:05.894297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a728fc8-4170-4685-9a8e-a8f41599fd7b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:05.957849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca503e65-b380-4935-ba2f-01bc502851e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:05.958786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca503e65-b380-4935-ba2f-01bc502851e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:05.959072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca503e65-b380-4935-ba2f-01bc502851e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:05.959349 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca503e65-b380-4935-ba2f-01bc502851e3 admin admin] PATH_INFO: `/v3/users/c4fde83bc9624b408b74312f1b5681f3` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:05.960626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca503e65-b380-4935-ba2f-01bc502851e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4fde83bc9624b408b74312f1b5681f3)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:05.962728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca503e65-b380-4935-ba2f-01bc502851e3 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:05.987387 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:06.177789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ca503e65-b380-4935-ba2f-01bc502851e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4fde83bc9624b408b74312f1b5681f3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:21:06.190172 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ca503e65-b380-4935-ba2f-01bc502851e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4fde83bc9624b408b74312f1b5681f3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:21:06.198087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ca503e65-b380-4935-ba2f-01bc502851e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4fde83bc9624b408b74312f1b5681f3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:21:06.198815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ca503e65-b380-4935-ba2f-01bc502851e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4fde83bc9624b408b74312f1b5681f3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:21:06.271089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-ca503e65-b380-4935-ba2f-01bc502851e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4fde83bc9624b408b74312f1b5681f3'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:21:06.277562 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4569/9032] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:21:05 2022] DELETE /identity/v3/users/c4fde83bc9624b408b74312f1b5681f3 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:21:06.520117 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc207bf-45bd-40fb-9676-3a362c6fc5ad admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:06.521728 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-afc207bf-45bd-40fb-9676-3a362c6fc5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:06.560943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc207bf-45bd-40fb-9676-3a362c6fc5ad admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:06.617183 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1c86a-7c48-47d5-93f4-ce2f968aec4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:06.622405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1c86a-7c48-47d5-93f4-ce2f968aec4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:06.622405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1c86a-7c48-47d5-93f4-ce2f968aec4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:06.622405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1c86a-7c48-47d5-93f4-ce2f968aec4b admin admin] PATH_INFO: `/v3/projects/0bc2ea9ea38a4bb2917141e30e52c12e` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:06.622405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1c86a-7c48-47d5-93f4-ce2f968aec4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bc2ea9ea38a4bb2917141e30e52c12e)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:06.622405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1c86a-7c48-47d5-93f4-ce2f968aec4b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:06.644509 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:06.735352 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-07f1c86a-7c48-47d5-93f4-ce2f968aec4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bc2ea9ea38a4bb2917141e30e52c12e', 'request_id': 'req-07f1c86a-7c48-47d5-93f4-ce2f968aec4b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:21:06.814424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-07f1c86a-7c48-47d5-93f4-ce2f968aec4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bc2ea9ea38a4bb2917141e30e52c12e', 'request_id': 'req-07f1c86a-7c48-47d5-93f4-ce2f968aec4b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:21:06.821419 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-07f1c86a-7c48-47d5-93f4-ce2f968aec4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bc2ea9ea38a4bb2917141e30e52c12e', 'request_id': 'req-07f1c86a-7c48-47d5-93f4-ce2f968aec4b'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:21:06.832046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-07f1c86a-7c48-47d5-93f4-ce2f968aec4b admin admin] The token cache is being invalidate because project 0bc2ea9ea38a4bb2917141e30e52c12e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:21:06.832280 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-07f1c86a-7c48-47d5-93f4-ce2f968aec4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:21:06.832943 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-07f1c86a-7c48-47d5-93f4-ce2f968aec4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:21:06.834536 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4464/9033] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:21:06 2022] DELETE /identity/v3/projects/0bc2ea9ea38a4bb2917141e30e52c12e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:21:06.839601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fd14f-738a-41f2-90e0-0fed873028ff None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:06.839901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fd14f-738a-41f2-90e0-0fed873028ff None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:06.840184 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4fd14f-738a-41f2-90e0-0fed873028ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:06.869260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-cb4fd14f-738a-41f2-90e0-0fed873028ff None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:21:06.870524 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-cb4fd14f-738a-41f2-90e0-0fed873028ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:06.932010 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4570/9034] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:21:06.941012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a7739-10f7-43f2-bc3f-87f707b49b82 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:06.946303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a7739-10f7-43f2-bc3f-87f707b49b82 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:06.946303 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56a7739-10f7-43f2-bc3f-87f707b49b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:06.960200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-e56a7739-10f7-43f2-bc3f-87f707b49b82 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:21:06.961383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e56a7739-10f7-43f2-bc3f-87f707b49b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:06.970165 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4465/9035] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:21:06.974488 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fd14f-738a-41f2-90e0-0fed873028ff None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:06.985293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4fd14f-738a-41f2-90e0-0fed873028ff None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:06.989968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119308b2-c0b1-4cd6-93c4-65bcb683860a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:06.990661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119308b2-c0b1-4cd6-93c4-65bcb683860a admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:06.990954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119308b2-c0b1-4cd6-93c4-65bcb683860a admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:06.991236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119308b2-c0b1-4cd6-93c4-65bcb683860a admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:06.991968 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119308b2-c0b1-4cd6-93c4-65bcb683860a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:21:06.992274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119308b2-c0b1-4cd6-93c4-65bcb683860a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:06.993870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119308b2-c0b1-4cd6-93c4-65bcb683860a admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:07.006144 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4571/9036] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 15:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:21:07.010700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a7739-10f7-43f2-bc3f-87f707b49b82 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:07.020825 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56a7739-10f7-43f2-bc3f-87f707b49b82 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:07.025715 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdd5f9-6e12-4b37-8b44-a94c9e2e7612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:07.026415 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdd5f9-6e12-4b37-8b44-a94c9e2e7612 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:07.026700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdd5f9-6e12-4b37-8b44-a94c9e2e7612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:07.026976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdd5f9-6e12-4b37-8b44-a94c9e2e7612 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:07.027680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cdd5f9-6e12-4b37-8b44-a94c9e2e7612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:07.029702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cdd5f9-6e12-4b37-8b44-a94c9e2e7612 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:07.119191 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4466/9037] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 15:21:07 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:21:07.123475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119308b2-c0b1-4cd6-93c4-65bcb683860a admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:07.134582 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119308b2-c0b1-4cd6-93c4-65bcb683860a admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:07.197786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb96449-3c42-46d4-81a2-b9acbcda104c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:07.198500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb96449-3c42-46d4-81a2-b9acbcda104c admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:07.198783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb96449-3c42-46d4-81a2-b9acbcda104c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:07.199058 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb96449-3c42-46d4-81a2-b9acbcda104c admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:07.199759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb96449-3c42-46d4-81a2-b9acbcda104c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:07.201691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb96449-3c42-46d4-81a2-b9acbcda104c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:07.276691 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4572/9038] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 15:21:07 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:21:07.281236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdd5f9-6e12-4b37-8b44-a94c9e2e7612 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:07.291801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdd5f9-6e12-4b37-8b44-a94c9e2e7612 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:07.297692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f68b5-c1f9-416a-a199-159623719c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:07.298388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f68b5-c1f9-416a-a199-159623719c64 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:07.298676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f68b5-c1f9-416a-a199-159623719c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:07.298954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43f68b5-c1f9-416a-a199-159623719c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:07.299682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f68b5-c1f9-416a-a199-159623719c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:07.301593 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43f68b5-c1f9-416a-a199-159623719c64 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:07.313816 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4467/9039] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:21:07.317921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb96449-3c42-46d4-81a2-b9acbcda104c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:07.328432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb96449-3c42-46d4-81a2-b9acbcda104c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:07.333121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ac2427-76b8-49fe-a8ca-5b62156b079c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:07.333782 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac2427-76b8-49fe-a8ca-5b62156b079c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:07.334067 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac2427-76b8-49fe-a8ca-5b62156b079c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:07.334385 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ac2427-76b8-49fe-a8ca-5b62156b079c admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:07.335143 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac2427-76b8-49fe-a8ca-5b62156b079c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:07.336732 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ac2427-76b8-49fe-a8ca-5b62156b079c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:07.337991 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:07.348088 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4573/9040] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:21:07.356780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f68b5-c1f9-416a-a199-159623719c64 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:07.367858 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43f68b5-c1f9-416a-a199-159623719c64 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:07.372550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c14ec-ba92-4596-ba14-959fa9c7a3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:07.373409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c14ec-ba92-4596-ba14-959fa9c7a3a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:07.373690 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c14ec-ba92-4596-ba14-959fa9c7a3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:07.373964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c14ec-ba92-4596-ba14-959fa9c7a3a8 admin admin] PATH_INFO: `/v3/projects/e933229132ec421c9b88f3176d431882/users/5f67158b3b83445899fbefdd4d9d6e8b/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:07.388325 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c14ec-ba92-4596-ba14-959fa9c7a3a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e933229132ec421c9b88f3176d431882, user_id=5f67158b3b83445899fbefdd4d9d6e8b, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:07.391062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c14ec-ba92-4596-ba14-959fa9c7a3a8 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:07.447303 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4468/9041] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:21:07 2022] PUT /identity/v3/projects/e933229132ec421c9b88f3176d431882/users/5f67158b3b83445899fbefdd4d9d6e8b/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:21:07.452357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3affc-8d60-4577-b049-6578a754b1ed None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:07.452615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3affc-8d60-4577-b049-6578a754b1ed None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:07.453113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe3affc-8d60-4577-b049-6578a754b1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:07.471015 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-bbe3affc-8d60-4577-b049-6578a754b1ed None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:21:07.472420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bbe3affc-8d60-4577-b049-6578a754b1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:07.533426 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4574/9042] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:21:07.543396 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c14ec-ba92-4596-ba14-959fa9c7a3a8 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:07.545176 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-521c14ec-ba92-4596-ba14-959fa9c7a3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:07.615023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c14ec-ba92-4596-ba14-959fa9c7a3a8 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:07.618827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd167ab-52a7-4358-8084-b108f96e58aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:07.619473 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd167ab-52a7-4358-8084-b108f96e58aa service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:07.619788 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd167ab-52a7-4358-8084-b108f96e58aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:07.620068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd167ab-52a7-4358-8084-b108f96e58aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:07.629874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd167ab-52a7-4358-8084-b108f96e58aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:07.631416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd167ab-52a7-4358-8084-b108f96e58aa service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:07.641973 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4469/9043] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:21:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:21:13.035178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c3eda-a3c5-4c90-8936-9ddea36de774 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:13.035675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c3eda-a3c5-4c90-8936-9ddea36de774 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:13.036110 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c3eda-a3c5-4c90-8936-9ddea36de774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:13.072355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ad3c3eda-a3c5-4c90-8936-9ddea36de774 None None] MFA Rules not processed for user `5f67158b3b83445899fbefdd4d9d6e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:21:13.073992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ad3c3eda-a3c5-4c90-8936-9ddea36de774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:13.147399 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4575/9044] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:21:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:21:13.152104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd167ab-52a7-4358-8084-b108f96e58aa service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:13.162816 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd167ab-52a7-4358-8084-b108f96e58aa service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:13.167476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ff666-27c6-4169-b33a-8440ff04ff51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:13.168131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ff666-27c6-4169-b33a-8440ff04ff51 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:13.168674 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ff666-27c6-4169-b33a-8440ff04ff51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:13.168954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ff666-27c6-4169-b33a-8440ff04ff51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:13.169676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ff666-27c6-4169-b33a-8440ff04ff51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:13.171731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ff666-27c6-4169-b33a-8440ff04ff51 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:13.256862 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4470/9045] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 15:21:13 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:21:13.260990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c3eda-a3c5-4c90-8936-9ddea36de774 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:13.272886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c3eda-a3c5-4c90-8936-9ddea36de774 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:13.331750 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7df3d-c10c-4031-8fd8-61a7ae65de89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:13.332574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7df3d-c10c-4031-8fd8-61a7ae65de89 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:13.333002 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7df3d-c10c-4031-8fd8-61a7ae65de89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:13.333419 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7df3d-c10c-4031-8fd8-61a7ae65de89 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:13.334295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7df3d-c10c-4031-8fd8-61a7ae65de89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:13.337857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7df3d-c10c-4031-8fd8-61a7ae65de89 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:13.427053 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4576/9046] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 15:21:13 2022] POST /identity/v3/users => generated 299 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:21:13.431190 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ff666-27c6-4169-b33a-8440ff04ff51 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:13.442524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ff666-27c6-4169-b33a-8440ff04ff51 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:13.447116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77cda0-2898-4255-949a-78214d8e6581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:13.447835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77cda0-2898-4255-949a-78214d8e6581 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:13.448127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77cda0-2898-4255-949a-78214d8e6581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:13.448602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77cda0-2898-4255-949a-78214d8e6581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:13.449365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77cda0-2898-4255-949a-78214d8e6581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:13.451033 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77cda0-2898-4255-949a-78214d8e6581 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:13.466844 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4471/9047] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:21:13.467658 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7df3d-c10c-4031-8fd8-61a7ae65de89 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:13.479374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7df3d-c10c-4031-8fd8-61a7ae65de89 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:13.485156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4d546-3b90-473e-9d8f-61ba4ac44d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:13.486186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4d546-3b90-473e-9d8f-61ba4ac44d0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:13.486549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4d546-3b90-473e-9d8f-61ba4ac44d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:13.486905 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae4d546-3b90-473e-9d8f-61ba4ac44d0f admin admin] PATH_INFO: `/v3/projects/e07ed00aca3d4fe5812eda65527028f4/users/0d31653cd16840fdacd3b4211b245c1e/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:13.502792 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:13.506561 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4d546-3b90-473e-9d8f-61ba4ac44d0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e07ed00aca3d4fe5812eda65527028f4, user_id=0d31653cd16840fdacd3b4211b245c1e, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:13.509236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae4d546-3b90-473e-9d8f-61ba4ac44d0f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:13.604754 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4577/9048] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:21:13 2022] PUT /identity/v3/projects/e07ed00aca3d4fe5812eda65527028f4/users/0d31653cd16840fdacd3b4211b245c1e/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:21:13.609704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77cda0-2898-4255-949a-78214d8e6581 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:13.615294 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:13.621005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77cda0-2898-4255-949a-78214d8e6581 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:13.684767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2ff6c-70bf-4f46-bf22-29e9b3849496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:13.685463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2ff6c-70bf-4f46-bf22-29e9b3849496 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:13.685913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2ff6c-70bf-4f46-bf22-29e9b3849496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:13.686056 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2ff6c-70bf-4f46-bf22-29e9b3849496 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:13.686851 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2ff6c-70bf-4f46-bf22-29e9b3849496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:13.689086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2ff6c-70bf-4f46-bf22-29e9b3849496 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:13.700023 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4472/9049] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:21:13.704714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4d546-3b90-473e-9d8f-61ba4ac44d0f admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:13.715863 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae4d546-3b90-473e-9d8f-61ba4ac44d0f admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:13.720834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489a43a-6412-44f7-8104-7129cbb95ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:13.721817 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489a43a-6412-44f7-8104-7129cbb95ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:13.722123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489a43a-6412-44f7-8104-7129cbb95ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:13.722424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489a43a-6412-44f7-8104-7129cbb95ff2 admin admin] PATH_INFO: `/v3/projects/e07ed00aca3d4fe5812eda65527028f4/users/0d31653cd16840fdacd3b4211b245c1e/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:13.724464 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489a43a-6412-44f7-8104-7129cbb95ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e07ed00aca3d4fe5812eda65527028f4, user_id=0d31653cd16840fdacd3b4211b245c1e, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:13.727208 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489a43a-6412-44f7-8104-7129cbb95ff2 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:13.739531 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4578/9050] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:21:13 2022] PUT /identity/v3/projects/e07ed00aca3d4fe5812eda65527028f4/users/0d31653cd16840fdacd3b4211b245c1e/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:21:19.369070 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52f9c2-9d14-46a3-bec7-d7ae31bddc65 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:19.370000 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52f9c2-9d14-46a3-bec7-d7ae31bddc65 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:19.370502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52f9c2-9d14-46a3-bec7-d7ae31bddc65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:19.403957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-2a52f9c2-9d14-46a3-bec7-d7ae31bddc65 None None] MFA Rules not processed for user `0d31653cd16840fdacd3b4211b245c1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:21:19.405308 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2a52f9c2-9d14-46a3-bec7-d7ae31bddc65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:19.479230 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4473/9051] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:21:19 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:21:19.505069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489a43a-6412-44f7-8104-7129cbb95ff2 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:19.506919 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2489a43a-6412-44f7-8104-7129cbb95ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:19.574684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489a43a-6412-44f7-8104-7129cbb95ff2 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:19.578927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0b0b7-195e-4fb1-aa69-06bdad5bf1df service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:19.579607 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0b0b7-195e-4fb1-aa69-06bdad5bf1df service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:19.579898 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0b0b7-195e-4fb1-aa69-06bdad5bf1df service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:19.580179 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0b0b7-195e-4fb1-aa69-06bdad5bf1df service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:19.641601 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0b0b7-195e-4fb1-aa69-06bdad5bf1df service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:19.643091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0b0b7-195e-4fb1-aa69-06bdad5bf1df service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:19.652681 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4579/9052] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:21:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:21:19.959434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9e8d5-6458-4e1e-83fa-860a51864ad2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:19.959729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9e8d5-6458-4e1e-83fa-860a51864ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:19.960011 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9e8d5-6458-4e1e-83fa-860a51864ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:20.009162 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f0d9e8d5-6458-4e1e-83fa-860a51864ad2 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:21:20.010412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f0d9e8d5-6458-4e1e-83fa-860a51864ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:20.070701 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:20.083287 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4474/9053] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 15:21:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:21:20.219751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83026a35-f86d-46d9-9032-31f4b0839a32 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:20.220038 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83026a35-f86d-46d9-9032-31f4b0839a32 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:20.220315 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83026a35-f86d-46d9-9032-31f4b0839a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:20.281167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-83026a35-f86d-46d9-9032-31f4b0839a32 None None] MFA Rules not processed for user `0789b4be9dae4c05bb3ec4a5e0f1f308`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:21:20.282342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-83026a35-f86d-46d9-9032-31f4b0839a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:20.352008 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:20.364932 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4580/9054] 10.222.0.43 () {58 vars in 1040 bytes} [Tue Jul 19 15:21:20 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:21:20.369246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9e8d5-6458-4e1e-83fa-860a51864ad2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:20.382339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9e8d5-6458-4e1e-83fa-860a51864ad2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:20.387409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd5128-b01d-4ba3-b385-eb255fec0130 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:20.388062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd5128-b01d-4ba3-b385-eb255fec0130 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:20.388346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd5128-b01d-4ba3-b385-eb255fec0130 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:20.390480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd5128-b01d-4ba3-b385-eb255fec0130 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:20.398023 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd5128-b01d-4ba3-b385-eb255fec0130 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:20.399651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd5128-b01d-4ba3-b385-eb255fec0130 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:20.408762 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4475/9055] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 15:21:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:21:30.404584 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=8 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:30.408467 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=2 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:30.662971 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791668f-9954-4629-ac20-c2236e527440 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:30.663252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791668f-9954-4629-ac20-c2236e527440 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:30.663538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791668f-9954-4629-ac20-c2236e527440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:30.681431 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a791668f-9954-4629-ac20-c2236e527440 None None] MFA Rules not processed for user `5f67158b3b83445899fbefdd4d9d6e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:21:30.682678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a791668f-9954-4629-ac20-c2236e527440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:30.690330 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4581/9056] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:21:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:21:30.952661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd5128-b01d-4ba3-b385-eb255fec0130 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:30.954064 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2bdd5128-b01d-4ba3-b385-eb255fec0130 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:31.014320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd5128-b01d-4ba3-b385-eb255fec0130 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:31.018535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8b33ca-f63e-449e-9f11-74424ff7b6da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:31.019212 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b33ca-f63e-449e-9f11-74424ff7b6da service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:31.019496 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b33ca-f63e-449e-9f11-74424ff7b6da service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:31.019799 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8b33ca-f63e-449e-9f11-74424ff7b6da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:31.021520 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-be8b33ca-f63e-449e-9f11-74424ff7b6da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:31.031319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b33ca-f63e-449e-9f11-74424ff7b6da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:31.032725 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8b33ca-f63e-449e-9f11-74424ff7b6da service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:31.040596 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4476/9057] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:21:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:21:31.463647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791668f-9954-4629-ac20-c2236e527440 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:31.465032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a791668f-9954-4629-ac20-c2236e527440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:31.538516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791668f-9954-4629-ac20-c2236e527440 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:31.544008 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b07ca-61f5-43b6-8981-c92448eb685c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:31.544665 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b07ca-61f5-43b6-8981-c92448eb685c service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:31.544954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b07ca-61f5-43b6-8981-c92448eb685c service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:31.545234 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051b07ca-61f5-43b6-8981-c92448eb685c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:31.547651 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-051b07ca-61f5-43b6-8981-c92448eb685c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:31.559247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b07ca-61f5-43b6-8981-c92448eb685c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:31.560828 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051b07ca-61f5-43b6-8981-c92448eb685c service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:31.571147 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4582/9058] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:21:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:21:34.100601 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da87df-d7fe-4144-929c-60faacdec6f1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:34.101113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da87df-d7fe-4144-929c-60faacdec6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:34.101213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da87df-d7fe-4144-929c-60faacdec6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:34.121503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-f7da87df-d7fe-4144-929c-60faacdec6f1 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:21:34.121503 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f7da87df-d7fe-4144-929c-60faacdec6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:34.128196 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4477/9059] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 15:21:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:21:34.142731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b07ca-61f5-43b6-8981-c92448eb685c service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:34.154389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051b07ca-61f5-43b6-8981-c92448eb685c service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:34.161502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27962b9c-03e2-46d9-935d-70aa1a3f12cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:34.162187 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27962b9c-03e2-46d9-935d-70aa1a3f12cf service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:34.162481 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27962b9c-03e2-46d9-935d-70aa1a3f12cf service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:34.162758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27962b9c-03e2-46d9-935d-70aa1a3f12cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:34.172652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27962b9c-03e2-46d9-935d-70aa1a3f12cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:34.174302 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27962b9c-03e2-46d9-935d-70aa1a3f12cf service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:34.183284 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4583/9060] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 15:21:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:21:43.319941 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da87df-d7fe-4144-929c-60faacdec6f1 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:43.330031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da87df-d7fe-4144-929c-60faacdec6f1 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:43.333644 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50e5fb-d168-4354-9b70-c4a85c4df273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:43.334327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50e5fb-d168-4354-9b70-c4a85c4df273 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:43.334617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50e5fb-d168-4354-9b70-c4a85c4df273 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:43.334895 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e50e5fb-d168-4354-9b70-c4a85c4df273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:43.336666 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3e50e5fb-d168-4354-9b70-c4a85c4df273 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:43.347133 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50e5fb-d168-4354-9b70-c4a85c4df273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:43.348579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e50e5fb-d168-4354-9b70-c4a85c4df273 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:43.356906 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4478/9061] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:21:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:21:44.180109 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=41 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:21:51.512022 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27962b9c-03e2-46d9-935d-70aa1a3f12cf service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:21:51.515112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-27962b9c-03e2-46d9-935d-70aa1a3f12cf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:51.597860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27962b9c-03e2-46d9-935d-70aa1a3f12cf service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:21:51.603418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778f121-5939-44ef-9d32-0883047ea143 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:21:51.604049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778f121-5939-44ef-9d32-0883047ea143 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:21:51.604335 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778f121-5939-44ef-9d32-0883047ea143 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:21:51.604612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778f121-5939-44ef-9d32-0883047ea143 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:21:51.606405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d778f121-5939-44ef-9d32-0883047ea143 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:21:51.619170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778f121-5939-44ef-9d32-0883047ea143 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:21:51.620748 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778f121-5939-44ef-9d32-0883047ea143 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:21:51.631329 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4584/9062] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:21:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:21:53.353203 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=35 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:01.627132 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=34 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:12.428819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50e5fb-d168-4354-9b70-c4a85c4df273 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:12.437567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e50e5fb-d168-4354-9b70-c4a85c4df273 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:12.441358 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4014f-ccf3-4828-83d0-20dba0072614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:12.442004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4014f-ccf3-4828-83d0-20dba0072614 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:12.442332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4014f-ccf3-4828-83d0-20dba0072614 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:12.442618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c4014f-ccf3-4828-83d0-20dba0072614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:12.451575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4014f-ccf3-4828-83d0-20dba0072614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:12.452990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c4014f-ccf3-4828-83d0-20dba0072614 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:12.464254 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4479/9063] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:22:12 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:22:14.346235 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778f121-5939-44ef-9d32-0883047ea143 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:14.364266 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778f121-5939-44ef-9d32-0883047ea143 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:14.370108 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b9dde-5dfb-48db-ae08-5f77411ec7f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:14.370804 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b9dde-5dfb-48db-ae08-5f77411ec7f2 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:14.371081 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b9dde-5dfb-48db-ae08-5f77411ec7f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:14.371360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b9dde-5dfb-48db-ae08-5f77411ec7f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:14.373396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f31b9dde-5dfb-48db-ae08-5f77411ec7f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:22:14.387723 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b9dde-5dfb-48db-ae08-5f77411ec7f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:14.389314 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b9dde-5dfb-48db-ae08-5f77411ec7f2 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:14.400895 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4585/9064] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:22:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:22:14.786301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4014f-ccf3-4828-83d0-20dba0072614 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:22:14.802498 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c4014f-ccf3-4828-83d0-20dba0072614 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:22:14.810456 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13273c65-887d-4622-8944-3409f6d51161 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:22:14.814063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13273c65-887d-4622-8944-3409f6d51161 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:22:14.814063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13273c65-887d-4622-8944-3409f6d51161 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:22:14.814063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13273c65-887d-4622-8944-3409f6d51161 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:22:14.814063 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-13273c65-887d-4622-8944-3409f6d51161 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:22:14.831316 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13273c65-887d-4622-8944-3409f6d51161 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:22:14.834720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13273c65-887d-4622-8944-3409f6d51161 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:22:14.849960 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4480/9065] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:22:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:22:24.396908 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:22:24.843952 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=12 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:23:23.202849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b9dde-5dfb-48db-ae08-5f77411ec7f2 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:23:23.204396 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f31b9dde-5dfb-48db-ae08-5f77411ec7f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:23.219372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b9dde-5dfb-48db-ae08-5f77411ec7f2 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:23:23.224604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fdf55-d31e-4d99-85ed-040f328e569a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:23:23.225247 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fdf55-d31e-4d99-85ed-040f328e569a service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:23:23.226303 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fdf55-d31e-4d99-85ed-040f328e569a service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:23:23.226592 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fdf55-d31e-4d99-85ed-040f328e569a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:23:23.228401 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9c1fdf55-d31e-4d99-85ed-040f328e569a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:23:23.240336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fdf55-d31e-4d99-85ed-040f328e569a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:23:23.242995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1fdf55-d31e-4d99-85ed-040f328e569a service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:23:23.253422 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4586/9066] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:23:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:23:33.248819 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:04.387824 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13273c65-887d-4622-8944-3409f6d51161 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:04.407291 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13273c65-887d-4622-8944-3409f6d51161 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:04.411682 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e2d95-2c00-4ce7-bc23-3222ee195032 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:04.412347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e2d95-2c00-4ce7-bc23-3222ee195032 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:04.412641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e2d95-2c00-4ce7-bc23-3222ee195032 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:04.412925 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e2d95-2c00-4ce7-bc23-3222ee195032 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:04.415062 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-464e2d95-2c00-4ce7-bc23-3222ee195032 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:04.450218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e2d95-2c00-4ce7-bc23-3222ee195032 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:04.451641 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e2d95-2c00-4ce7-bc23-3222ee195032 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:04.471719 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4481/9067] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:25:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:25:06.401943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fdf55-d31e-4d99-85ed-040f328e569a service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:06.403639 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9c1fdf55-d31e-4d99-85ed-040f328e569a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:06.475566 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1fdf55-d31e-4d99-85ed-040f328e569a service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:06.479718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc052f-df81-4ce0-bbe9-2d885435eb9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:06.480786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc052f-df81-4ce0-bbe9-2d885435eb9d service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:06.480786 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc052f-df81-4ce0-bbe9-2d885435eb9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:06.481035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cc052f-df81-4ce0-bbe9-2d885435eb9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:06.483230 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d5cc052f-df81-4ce0-bbe9-2d885435eb9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:06.498358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc052f-df81-4ce0-bbe9-2d885435eb9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:06.500111 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cc052f-df81-4ce0-bbe9-2d885435eb9d service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:06.514178 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4587/9068] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:25:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:25:14.469078 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=22 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:16.507774 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=26 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:19.501840 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01c749-06f8-413c-8c4b-7166cd6c1916 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:19.502335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01c749-06f8-413c-8c4b-7166cd6c1916 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:19.502524 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01c749-06f8-413c-8c4b-7166cd6c1916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:19.521111 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-df01c749-06f8-413c-8c4b-7166cd6c1916 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:19.522774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-df01c749-06f8-413c-8c4b-7166cd6c1916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:19.529797 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4482/9069] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 15:25:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:25:19.569874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc052f-df81-4ce0-bbe9-2d885435eb9d service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:19.581279 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cc052f-df81-4ce0-bbe9-2d885435eb9d service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:19.587086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9d7a7-21fe-4f9b-9f40-ad89a335bb5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:19.587722 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9d7a7-21fe-4f9b-9f40-ad89a335bb5d service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:19.588007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9d7a7-21fe-4f9b-9f40-ad89a335bb5d service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:19.588287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9d7a7-21fe-4f9b-9f40-ad89a335bb5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:19.596469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9d7a7-21fe-4f9b-9f40-ad89a335bb5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:19.597981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9d7a7-21fe-4f9b-9f40-ad89a335bb5d service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:19.606735 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4588/9070] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 15:25:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:25:20.686988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31c081-c021-4677-82e9-e181050c2df1 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:20.687489 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31c081-c021-4677-82e9-e181050c2df1 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:20.687590 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed31c081-c021-4677-82e9-e181050c2df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:20.714904 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-ed31c081-c021-4677-82e9-e181050c2df1 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:20.716104 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ed31c081-c021-4677-82e9-e181050c2df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:20.723280 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4483/9071] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 15:25:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:25:20.735625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9d7a7-21fe-4f9b-9f40-ad89a335bb5d service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:20.746834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9d7a7-21fe-4f9b-9f40-ad89a335bb5d service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:20.751839 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203398a-a93f-40cc-9f71-779b40d84a0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:20.752475 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203398a-a93f-40cc-9f71-779b40d84a0e service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:20.752763 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203398a-a93f-40cc-9f71-779b40d84a0e service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:20.753046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203398a-a93f-40cc-9f71-779b40d84a0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:20.761573 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203398a-a93f-40cc-9f71-779b40d84a0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:20.763195 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2203398a-a93f-40cc-9f71-779b40d84a0e service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:20.771349 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4589/9072] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 15:25:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:25:30.440737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a15377-55cb-4ce1-bca2-63ebbd0f1036 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:30.441254 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a15377-55cb-4ce1-bca2-63ebbd0f1036 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:30.441359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a15377-55cb-4ce1-bca2-63ebbd0f1036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:30.460095 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-a1a15377-55cb-4ce1-bca2-63ebbd0f1036 None None] MFA Rules not processed for user `5f67158b3b83445899fbefdd4d9d6e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:30.461289 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a1a15377-55cb-4ce1-bca2-63ebbd0f1036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:30.468209 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4484/9073] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:25:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 15:25:30.730634 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203398a-a93f-40cc-9f71-779b40d84a0e service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:30.740850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203398a-a93f-40cc-9f71-779b40d84a0e service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:30.744499 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4d4f29-9077-49ea-81a9-8b7196d988ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:30.745165 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d4f29-9077-49ea-81a9-8b7196d988ea service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:30.745517 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d4f29-9077-49ea-81a9-8b7196d988ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:30.745821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4d4f29-9077-49ea-81a9-8b7196d988ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:30.747642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-8c4d4f29-9077-49ea-81a9-8b7196d988ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:30.757985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d4f29-9077-49ea-81a9-8b7196d988ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:30.760847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4d4f29-9077-49ea-81a9-8b7196d988ea service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:30.767557 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4590/9074] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:25:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:25:31.224447 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a15377-55cb-4ce1-bca2-63ebbd0f1036 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:31.249021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a15377-55cb-4ce1-bca2-63ebbd0f1036 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:31.254853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8754592-1c59-472f-b44f-12f57d459708 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:31.255514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8754592-1c59-472f-b44f-12f57d459708 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:31.255862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8754592-1c59-472f-b44f-12f57d459708 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:31.256068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8754592-1c59-472f-b44f-12f57d459708 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:31.257837 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-f8754592-1c59-472f-b44f-12f57d459708 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:31.269757 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8754592-1c59-472f-b44f-12f57d459708 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:31.271586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8754592-1c59-472f-b44f-12f57d459708 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:31.281548 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4485/9075] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:25:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:25:34.621126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3faa0-6f88-4c78-a409-1c05e7c41797 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:34.621593 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3faa0-6f88-4c78-a409-1c05e7c41797 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:34.621693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3faa0-6f88-4c78-a409-1c05e7c41797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:34.640622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a6e3faa0-6f88-4c78-a409-1c05e7c41797 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:25:34.642036 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a6e3faa0-6f88-4c78-a409-1c05e7c41797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:25:34.650723 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4591/9076] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 15:25:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:25:34.663566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8754592-1c59-472f-b44f-12f57d459708 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:25:34.675086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8754592-1c59-472f-b44f-12f57d459708 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:25:34.680350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b1f3d-5d41-4291-a409-cb68194db562 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:25:34.681131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b1f3d-5d41-4291-a409-cb68194db562 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:25:34.681424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b1f3d-5d41-4291-a409-cb68194db562 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:25:34.681707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b1f3d-5d41-4291-a409-cb68194db562 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:25:34.690218 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b1f3d-5d41-4291-a409-cb68194db562 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:25:34.691801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924b1f3d-5d41-4291-a409-cb68194db562 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:25:34.702509 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4486/9077] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 15:25:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:25:44.635144 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=21 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:25:44.698386 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=29 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:26:27.783079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3faa0-6f88-4c78-a409-1c05e7c41797 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:26:27.784565 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a6e3faa0-6f88-4c78-a409-1c05e7c41797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:26:27.800855 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e3faa0-6f88-4c78-a409-1c05e7c41797 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:26:27.806421 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a171d2-5296-495c-ad71-b16222a7f830 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:26:27.807060 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a171d2-5296-495c-ad71-b16222a7f830 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:26:27.807358 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a171d2-5296-495c-ad71-b16222a7f830 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:26:27.807619 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a171d2-5296-495c-ad71-b16222a7f830 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:26:27.816458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a171d2-5296-495c-ad71-b16222a7f830 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:26:27.818076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a171d2-5296-495c-ad71-b16222a7f830 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:26:27.826939 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4592/9078] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:26:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:26:37.822989 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:27:14.924335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b1f3d-5d41-4291-a409-cb68194db562 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:14.935653 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b1f3d-5d41-4291-a409-cb68194db562 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:14.939754 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2002e4-839a-47b8-aece-be7aac7880ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:14.940427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2002e4-839a-47b8-aece-be7aac7880ee service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:14.940712 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2002e4-839a-47b8-aece-be7aac7880ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:14.940994 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2002e4-839a-47b8-aece-be7aac7880ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:14.948173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2002e4-839a-47b8-aece-be7aac7880ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:14.949580 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2002e4-839a-47b8-aece-be7aac7880ee service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:14.958426 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4487/9079] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:27:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:27:18.097332 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a171d2-5296-495c-ad71-b16222a7f830 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:18.115392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a171d2-5296-495c-ad71-b16222a7f830 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:18.122408 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee1d41-b827-436a-a7cd-d8a95747e8c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:18.123960 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee1d41-b827-436a-a7cd-d8a95747e8c8 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:18.124348 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee1d41-b827-436a-a7cd-d8a95747e8c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:18.124729 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee1d41-b827-436a-a7cd-d8a95747e8c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:18.137735 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee1d41-b827-436a-a7cd-d8a95747e8c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:18.141055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee1d41-b827-436a-a7cd-d8a95747e8c8 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:18.157914 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4593/9080] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:27:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:27:18.816741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2002e4-839a-47b8-aece-be7aac7880ee service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:18.832686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2002e4-839a-47b8-aece-be7aac7880ee service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:18.838579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f8059-b35f-41bf-ac44-e62a389b066c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:18.839278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f8059-b35f-41bf-ac44-e62a389b066c service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:18.839544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f8059-b35f-41bf-ac44-e62a389b066c service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:18.839830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f8059-b35f-41bf-ac44-e62a389b066c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:18.850049 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f8059-b35f-41bf-ac44-e62a389b066c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:18.852198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f8059-b35f-41bf-ac44-e62a389b066c service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:18.862817 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4488/9081] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:27:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:27:28.148982 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:27:28.858178 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=12 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:27:30.951615 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee1d41-b827-436a-a7cd-d8a95747e8c8 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:30.964069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee1d41-b827-436a-a7cd-d8a95747e8c8 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:30.970372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51827223-4c3d-4dd3-89c7-a2b0a450e919 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:30.971094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51827223-4c3d-4dd3-89c7-a2b0a450e919 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:30.971407 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51827223-4c3d-4dd3-89c7-a2b0a450e919 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:30.971695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51827223-4c3d-4dd3-89c7-a2b0a450e919 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:30.973514 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-51827223-4c3d-4dd3-89c7-a2b0a450e919 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:27:30.985784 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51827223-4c3d-4dd3-89c7-a2b0a450e919 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:30.988410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51827223-4c3d-4dd3-89c7-a2b0a450e919 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:30.999272 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4594/9082] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:27:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:27:32.430612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c84279-9f33-4987-b4e7-59fcf39f2f8e None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:32.431127 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c84279-9f33-4987-b4e7-59fcf39f2f8e None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:32.431224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c84279-9f33-4987-b4e7-59fcf39f2f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:32.448774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-02c84279-9f33-4987-b4e7-59fcf39f2f8e None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:27:32.449953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-02c84279-9f33-4987-b4e7-59fcf39f2f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:27:32.457951 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4489/9083] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 15:27:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:27:32.499894 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51827223-4c3d-4dd3-89c7-a2b0a450e919 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:32.512122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51827223-4c3d-4dd3-89c7-a2b0a450e919 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:32.517132 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e2730-e9a0-4548-a734-e3593adebdc7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:32.517772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e2730-e9a0-4548-a734-e3593adebdc7 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:32.518054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e2730-e9a0-4548-a734-e3593adebdc7 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:32.518397 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e2730-e9a0-4548-a734-e3593adebdc7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:32.527773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e2730-e9a0-4548-a734-e3593adebdc7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:32.529343 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e2730-e9a0-4548-a734-e3593adebdc7 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:32.537971 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4595/9084] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 15:27:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:27:33.323319 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c84279-9f33-4987-b4e7-59fcf39f2f8e None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:33.333012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c84279-9f33-4987-b4e7-59fcf39f2f8e None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:33.336557 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fbe2a-fd64-421b-9b47-1059f3edadee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:33.337201 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fbe2a-fd64-421b-9b47-1059f3edadee service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:33.337491 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fbe2a-fd64-421b-9b47-1059f3edadee service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:33.337772 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fbe2a-fd64-421b-9b47-1059f3edadee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:33.398165 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fbe2a-fd64-421b-9b47-1059f3edadee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:33.399526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fbe2a-fd64-421b-9b47-1059f3edadee service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:33.409058 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4490/9085] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:27:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:27:37.027472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e2730-e9a0-4548-a734-e3593adebdc7 service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:37.040645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e2730-e9a0-4548-a734-e3593adebdc7 service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:37.046663 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a7d01-5e7e-46d9-8f9c-782195f8bda7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:37.047264 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a7d01-5e7e-46d9-8f9c-782195f8bda7 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:37.047549 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a7d01-5e7e-46d9-8f9c-782195f8bda7 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:37.047825 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a7d01-5e7e-46d9-8f9c-782195f8bda7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:37.049642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e14a7d01-5e7e-46d9-8f9c-782195f8bda7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:27:37.062173 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a7d01-5e7e-46d9-8f9c-782195f8bda7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:37.063758 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a7d01-5e7e-46d9-8f9c-782195f8bda7 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:37.075690 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4596/9086] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:27:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:27:40.757401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fbe2a-fd64-421b-9b47-1059f3edadee service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:40.768915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fbe2a-fd64-421b-9b47-1059f3edadee service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:40.774535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157b1f3-9568-49e5-906e-4f8b829549cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:40.775188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157b1f3-9568-49e5-906e-4f8b829549cb service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:40.775477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157b1f3-9568-49e5-906e-4f8b829549cb service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:40.775758 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157b1f3-9568-49e5-906e-4f8b829549cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:40.777562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a157b1f3-9568-49e5-906e-4f8b829549cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:27:40.790544 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157b1f3-9568-49e5-906e-4f8b829549cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:40.792125 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157b1f3-9568-49e5-906e-4f8b829549cb service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:40.804319 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4491/9087] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:27:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:27:40.878123 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a7d01-5e7e-46d9-8f9c-782195f8bda7 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:40.889296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a7d01-5e7e-46d9-8f9c-782195f8bda7 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:40.894006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4f25d-ef06-4cf8-a65e-fdbd98f85443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:40.895117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4f25d-ef06-4cf8-a65e-fdbd98f85443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:40.895418 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4f25d-ef06-4cf8-a65e-fdbd98f85443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:40.895721 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4f25d-ef06-4cf8-a65e-fdbd98f85443 admin admin] PATH_INFO: `/v3/users/5f67158b3b83445899fbefdd4d9d6e8b` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:40.896924 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4f25d-ef06-4cf8-a65e-fdbd98f85443 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f67158b3b83445899fbefdd4d9d6e8b)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:40.898943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4f25d-ef06-4cf8-a65e-fdbd98f85443 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:41.056094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2df4f25d-ef06-4cf8-a65e-fdbd98f85443 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f67158b3b83445899fbefdd4d9d6e8b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:27:41.068498 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2df4f25d-ef06-4cf8-a65e-fdbd98f85443 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f67158b3b83445899fbefdd4d9d6e8b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:27:41.078925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2df4f25d-ef06-4cf8-a65e-fdbd98f85443 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f67158b3b83445899fbefdd4d9d6e8b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:27:41.079689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2df4f25d-ef06-4cf8-a65e-fdbd98f85443 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f67158b3b83445899fbefdd4d9d6e8b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:27:41.150073 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-2df4f25d-ef06-4cf8-a65e-fdbd98f85443 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f67158b3b83445899fbefdd4d9d6e8b'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:27:41.156493 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4597/9088] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:27:40 2022] DELETE /identity/v3/users/5f67158b3b83445899fbefdd4d9d6e8b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:27:41.415535 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157b1f3-9568-49e5-906e-4f8b829549cb service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:41.429567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157b1f3-9568-49e5-906e-4f8b829549cb service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:41.488853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed954fab-54ac-4eb0-bcb4-ba0ffc1e680e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:41.489729 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed954fab-54ac-4eb0-bcb4-ba0ffc1e680e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:41.490020 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed954fab-54ac-4eb0-bcb4-ba0ffc1e680e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:41.490338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed954fab-54ac-4eb0-bcb4-ba0ffc1e680e admin admin] PATH_INFO: `/v3/projects/e933229132ec421c9b88f3176d431882` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:41.491550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed954fab-54ac-4eb0-bcb4-ba0ffc1e680e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e933229132ec421c9b88f3176d431882)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:41.493472 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed954fab-54ac-4eb0-bcb4-ba0ffc1e680e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:41.603286 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed954fab-54ac-4eb0-bcb4-ba0ffc1e680e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e933229132ec421c9b88f3176d431882', 'request_id': 'req-ed954fab-54ac-4eb0-bcb4-ba0ffc1e680e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:27:41.658811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed954fab-54ac-4eb0-bcb4-ba0ffc1e680e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e933229132ec421c9b88f3176d431882', 'request_id': 'req-ed954fab-54ac-4eb0-bcb4-ba0ffc1e680e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:27:41.665960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed954fab-54ac-4eb0-bcb4-ba0ffc1e680e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e933229132ec421c9b88f3176d431882', 'request_id': 'req-ed954fab-54ac-4eb0-bcb4-ba0ffc1e680e'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:27:41.677273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed954fab-54ac-4eb0-bcb4-ba0ffc1e680e admin admin] The token cache is being invalidate because project e933229132ec421c9b88f3176d431882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:27:41.677573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed954fab-54ac-4eb0-bcb4-ba0ffc1e680e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:27:41.678274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-ed954fab-54ac-4eb0-bcb4-ba0ffc1e680e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:27:41.679837 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4492/9089] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:27:41 2022] DELETE /identity/v3/projects/e933229132ec421c9b88f3176d431882 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:27:41.683867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4f25d-ef06-4cf8-a65e-fdbd98f85443 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:41.685367 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2df4f25d-ef06-4cf8-a65e-fdbd98f85443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:27:41.699840 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4f25d-ef06-4cf8-a65e-fdbd98f85443 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:41.756819 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c2090-ba00-4a41-943a-3d3f7f0ebbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:41.757691 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c2090-ba00-4a41-943a-3d3f7f0ebbc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:41.757977 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c2090-ba00-4a41-943a-3d3f7f0ebbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:41.758295 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c2090-ba00-4a41-943a-3d3f7f0ebbc9 admin admin] PATH_INFO: `/v3/users/0d31653cd16840fdacd3b4211b245c1e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:41.759491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c2090-ba00-4a41-943a-3d3f7f0ebbc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d31653cd16840fdacd3b4211b245c1e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:41.761395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c2090-ba00-4a41-943a-3d3f7f0ebbc9 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:41.937433 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:27:41.947276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-531c2090-ba00-4a41-943a-3d3f7f0ebbc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d31653cd16840fdacd3b4211b245c1e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:27:41.959710 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-531c2090-ba00-4a41-943a-3d3f7f0ebbc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d31653cd16840fdacd3b4211b245c1e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:27:41.966850 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-531c2090-ba00-4a41-943a-3d3f7f0ebbc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d31653cd16840fdacd3b4211b245c1e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:27:41.967618 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-531c2090-ba00-4a41-943a-3d3f7f0ebbc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d31653cd16840fdacd3b4211b245c1e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:27:42.036069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-531c2090-ba00-4a41-943a-3d3f7f0ebbc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d31653cd16840fdacd3b4211b245c1e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:27:42.042369 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4598/9090] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:27:41 2022] DELETE /identity/v3/users/0d31653cd16840fdacd3b4211b245c1e => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:27:42.272259 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed954fab-54ac-4eb0-bcb4-ba0ffc1e680e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:42.273696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ed954fab-54ac-4eb0-bcb4-ba0ffc1e680e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:27:42.283463 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:27:42.287932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed954fab-54ac-4eb0-bcb4-ba0ffc1e680e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:42.347928 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccfab1-c871-4de4-a797-c30bc808b403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:42.348803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccfab1-c871-4de4-a797-c30bc808b403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:42.349091 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccfab1-c871-4de4-a797-c30bc808b403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:42.349375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccfab1-c871-4de4-a797-c30bc808b403 admin admin] PATH_INFO: `/v3/projects/e07ed00aca3d4fe5812eda65527028f4` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:42.350610 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccfab1-c871-4de4-a797-c30bc808b403 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e07ed00aca3d4fe5812eda65527028f4)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:42.352515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccfab1-c871-4de4-a797-c30bc808b403 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:42.482002 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37ccfab1-c871-4de4-a797-c30bc808b403 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e07ed00aca3d4fe5812eda65527028f4', 'request_id': 'req-37ccfab1-c871-4de4-a797-c30bc808b403'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:27:42.555533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37ccfab1-c871-4de4-a797-c30bc808b403 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e07ed00aca3d4fe5812eda65527028f4', 'request_id': 'req-37ccfab1-c871-4de4-a797-c30bc808b403'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:27:42.562113 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37ccfab1-c871-4de4-a797-c30bc808b403 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e07ed00aca3d4fe5812eda65527028f4', 'request_id': 'req-37ccfab1-c871-4de4-a797-c30bc808b403'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:27:42.573774 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37ccfab1-c871-4de4-a797-c30bc808b403 admin admin] The token cache is being invalidate because project e07ed00aca3d4fe5812eda65527028f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:27:42.577801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37ccfab1-c871-4de4-a797-c30bc808b403 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:27:42.577801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-37ccfab1-c871-4de4-a797-c30bc808b403 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:27:42.577801 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4493/9091] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:27:42 2022] DELETE /identity/v3/projects/e07ed00aca3d4fe5812eda65527028f4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:27:42.582274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73bb4c-a6d0-486e-bc2b-cec43c8a2e9f None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:42.582602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73bb4c-a6d0-486e-bc2b-cec43c8a2e9f None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:42.582908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73bb4c-a6d0-486e-bc2b-cec43c8a2e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:42.601668 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-ae73bb4c-a6d0-486e-bc2b-cec43c8a2e9f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:27:42.603007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ae73bb4c-a6d0-486e-bc2b-cec43c8a2e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:27:42.661800 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4599/9092] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:27:42.670086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bda7f-c40d-4207-8b9a-732fa7b8124f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:42.670414 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bda7f-c40d-4207-8b9a-732fa7b8124f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:42.670698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312bda7f-c40d-4207-8b9a-732fa7b8124f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:42.689538 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-312bda7f-c40d-4207-8b9a-732fa7b8124f None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:27:42.690813 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-312bda7f-c40d-4207-8b9a-732fa7b8124f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:27:42.699577 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4494/9093] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:27:42.703880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73bb4c-a6d0-486e-bc2b-cec43c8a2e9f None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:42.713904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73bb4c-a6d0-486e-bc2b-cec43c8a2e9f None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:42.718623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0af5f-a2bf-445e-a86e-20f577387c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:42.719287 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0af5f-a2bf-445e-a86e-20f577387c4c admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:42.719575 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0af5f-a2bf-445e-a86e-20f577387c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:42.719857 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0af5f-a2bf-445e-a86e-20f577387c4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:42.720591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0af5f-a2bf-445e-a86e-20f577387c4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:27:42.720903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0af5f-a2bf-445e-a86e-20f577387c4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:42.722546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0af5f-a2bf-445e-a86e-20f577387c4c admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:42.734164 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4600/9094] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 15:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:27:42.738960 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bda7f-c40d-4207-8b9a-732fa7b8124f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:42.748129 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312bda7f-c40d-4207-8b9a-732fa7b8124f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:42.752711 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4a025-101d-4c0a-a905-772c9c96420a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:42.753930 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4a025-101d-4c0a-a905-772c9c96420a admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:42.754256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4a025-101d-4c0a-a905-772c9c96420a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:42.754706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b4a025-101d-4c0a-a905-772c9c96420a admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:42.755400 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4a025-101d-4c0a-a905-772c9c96420a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:42.757282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b4a025-101d-4c0a-a905-772c9c96420a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:42.871997 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4495/9095] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 15:27:42 2022] POST /identity/v3/projects => generated 391 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:27:42.876063 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0af5f-a2bf-445e-a86e-20f577387c4c admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:42.887180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0af5f-a2bf-445e-a86e-20f577387c4c admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:42.946728 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1396bc7-afab-43ce-87da-37c470d78a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:42.947423 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1396bc7-afab-43ce-87da-37c470d78a01 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:42.947661 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1396bc7-afab-43ce-87da-37c470d78a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:42.947935 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1396bc7-afab-43ce-87da-37c470d78a01 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:42.948623 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1396bc7-afab-43ce-87da-37c470d78a01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:42.950538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1396bc7-afab-43ce-87da-37c470d78a01 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:43.053747 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4601/9096] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 15:27:42 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:27:43.057722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4a025-101d-4c0a-a905-772c9c96420a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:43.068320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b4a025-101d-4c0a-a905-772c9c96420a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:43.073131 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16e550-5693-4198-9cfa-26a623695241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:43.073797 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16e550-5693-4198-9cfa-26a623695241 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:43.075933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16e550-5693-4198-9cfa-26a623695241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:43.075933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e16e550-5693-4198-9cfa-26a623695241 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:43.075933 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16e550-5693-4198-9cfa-26a623695241 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:43.076826 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e16e550-5693-4198-9cfa-26a623695241 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:43.087902 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4496/9097] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:27:43.091992 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1396bc7-afab-43ce-87da-37c470d78a01 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:43.102794 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1396bc7-afab-43ce-87da-37c470d78a01 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:43.107467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598e8d30-49b2-4cd3-bd50-992b162f5a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:43.108126 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e8d30-49b2-4cd3-bd50-992b162f5a5e admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:43.108412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e8d30-49b2-4cd3-bd50-992b162f5a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:43.108688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598e8d30-49b2-4cd3-bd50-992b162f5a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:43.109414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e8d30-49b2-4cd3-bd50-992b162f5a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:43.111031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598e8d30-49b2-4cd3-bd50-992b162f5a5e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:43.122246 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4602/9098] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:27:43.126550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16e550-5693-4198-9cfa-26a623695241 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:43.138685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e16e550-5693-4198-9cfa-26a623695241 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:43.145594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008544e-239b-4152-bcdc-12ccbb15cc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:43.147067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008544e-239b-4152-bcdc-12ccbb15cc39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:43.147558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008544e-239b-4152-bcdc-12ccbb15cc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:43.147952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008544e-239b-4152-bcdc-12ccbb15cc39 admin admin] PATH_INFO: `/v3/projects/ffb7cb04e799433eaf5b9c3a9122317c/users/2d8eaebce36448849a7271e5468d6957/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:43.166892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008544e-239b-4152-bcdc-12ccbb15cc39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffb7cb04e799433eaf5b9c3a9122317c, user_id=2d8eaebce36448849a7271e5468d6957, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:43.170363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008544e-239b-4152-bcdc-12ccbb15cc39 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:43.288339 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4497/9099] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:27:43 2022] PUT /identity/v3/projects/ffb7cb04e799433eaf5b9c3a9122317c/users/2d8eaebce36448849a7271e5468d6957/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:27:43.298739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76e387-c70c-48b7-a458-cbfb78560665 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:43.300945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76e387-c70c-48b7-a458-cbfb78560665 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:43.300945 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76e387-c70c-48b7-a458-cbfb78560665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:43.478071 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-0b76e387-c70c-48b7-a458-cbfb78560665 None None] MFA Rules not processed for user `2d8eaebce36448849a7271e5468d6957`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:27:43.479307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-0b76e387-c70c-48b7-a458-cbfb78560665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:27:43.484224 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:27:43.543956 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4603/9100] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:27:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:27:43.548611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008544e-239b-4152-bcdc-12ccbb15cc39 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:43.581340 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:27:43.610360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008544e-239b-4152-bcdc-12ccbb15cc39 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:43.616594 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9df92-0531-40b4-a671-3e47ed99cc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:43.617575 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9df92-0531-40b4-a671-3e47ed99cc8b admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:43.618004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9df92-0531-40b4-a671-3e47ed99cc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:43.618463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c9df92-0531-40b4-a671-3e47ed99cc8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:43.619164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9df92-0531-40b4-a671-3e47ed99cc8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:43.621052 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c9df92-0531-40b4-a671-3e47ed99cc8b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:43.734254 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4498/9101] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 15:27:43 2022] POST /identity/v3/projects => generated 391 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:27:43.738392 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76e387-c70c-48b7-a458-cbfb78560665 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:43.749140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76e387-c70c-48b7-a458-cbfb78560665 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:43.805851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422a1b7-3618-4afb-b659-32cb9cb01998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:43.806569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422a1b7-3618-4afb-b659-32cb9cb01998 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:43.806862 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422a1b7-3618-4afb-b659-32cb9cb01998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:43.807134 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422a1b7-3618-4afb-b659-32cb9cb01998 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:43.807833 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422a1b7-3618-4afb-b659-32cb9cb01998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:43.809734 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422a1b7-3618-4afb-b659-32cb9cb01998 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:43.881715 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4604/9102] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 15:27:43 2022] POST /identity/v3/users => generated 302 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:27:43.885965 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9df92-0531-40b4-a671-3e47ed99cc8b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:43.896916 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c9df92-0531-40b4-a671-3e47ed99cc8b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:43.901509 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e8651-032b-4e8d-a87d-c8746687c29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:43.902214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e8651-032b-4e8d-a87d-c8746687c29a admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:43.902505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e8651-032b-4e8d-a87d-c8746687c29a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:43.902789 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e8651-032b-4e8d-a87d-c8746687c29a admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:43.903518 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e8651-032b-4e8d-a87d-c8746687c29a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:43.905107 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e8651-032b-4e8d-a87d-c8746687c29a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:43.915852 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4499/9103] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:27:43.920190 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422a1b7-3618-4afb-b659-32cb9cb01998 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:43.930381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422a1b7-3618-4afb-b659-32cb9cb01998 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:43.934998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594a0a0-f126-4bb4-b2c6-f8fea75600ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:43.935869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594a0a0-f126-4bb4-b2c6-f8fea75600ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:43.936154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594a0a0-f126-4bb4-b2c6-f8fea75600ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:43.936432 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594a0a0-f126-4bb4-b2c6-f8fea75600ea admin admin] PATH_INFO: `/v3/projects/97c610bdb25f4179b4383b6129a7bb6c/users/c957230bfbfa4b69b37999415ac24400/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:43.951282 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594a0a0-f126-4bb4-b2c6-f8fea75600ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c610bdb25f4179b4383b6129a7bb6c, user_id=c957230bfbfa4b69b37999415ac24400, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:43.953907 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594a0a0-f126-4bb4-b2c6-f8fea75600ea admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:44.035696 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4605/9104] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:27:43 2022] PUT /identity/v3/projects/97c610bdb25f4179b4383b6129a7bb6c/users/c957230bfbfa4b69b37999415ac24400/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:27:44.039638 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e8651-032b-4e8d-a87d-c8746687c29a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:44.051335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e8651-032b-4e8d-a87d-c8746687c29a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:44.107433 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe2170f-4925-4d80-a90a-818302b79e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:44.108096 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2170f-4925-4d80-a90a-818302b79e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:44.108379 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2170f-4925-4d80-a90a-818302b79e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:44.108656 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2170f-4925-4d80-a90a-818302b79e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:44.109374 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2170f-4925-4d80-a90a-818302b79e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:44.110980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe2170f-4925-4d80-a90a-818302b79e20 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:44.121532 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4500/9105] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:27:44.125736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594a0a0-f126-4bb4-b2c6-f8fea75600ea admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:44.136112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594a0a0-f126-4bb4-b2c6-f8fea75600ea admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:44.140717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9793e-9dc4-4c20-8260-95a5636a6a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:44.141591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9793e-9dc4-4c20-8260-95a5636a6a09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:44.141872 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9793e-9dc4-4c20-8260-95a5636a6a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:44.142178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb9793e-9dc4-4c20-8260-95a5636a6a09 admin admin] PATH_INFO: `/v3/projects/97c610bdb25f4179b4383b6129a7bb6c/users/c957230bfbfa4b69b37999415ac24400/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:44.144178 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9793e-9dc4-4c20-8260-95a5636a6a09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97c610bdb25f4179b4383b6129a7bb6c, user_id=c957230bfbfa4b69b37999415ac24400, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:44.147413 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb9793e-9dc4-4c20-8260-95a5636a6a09 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:44.157491 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4606/9106] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:27:44 2022] PUT /identity/v3/projects/97c610bdb25f4179b4383b6129a7bb6c/users/c957230bfbfa4b69b37999415ac24400/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:27:44.168686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b0e20-caef-4d88-b8ba-b389ba1aa549 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:44.168983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b0e20-caef-4d88-b8ba-b389ba1aa549 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:44.169269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3b0e20-caef-4d88-b8ba-b389ba1aa549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:44.195380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-9a3b0e20-caef-4d88-b8ba-b389ba1aa549 None None] MFA Rules not processed for user `c957230bfbfa4b69b37999415ac24400`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:27:44.196586 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9a3b0e20-caef-4d88-b8ba-b389ba1aa549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:27:44.264763 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4501/9107] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:27:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:27:44.280915 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9793e-9dc4-4c20-8260-95a5636a6a09 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:44.282646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ddb9793e-9dc4-4c20-8260-95a5636a6a09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:27:44.345257 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:27:44.361772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb9793e-9dc4-4c20-8260-95a5636a6a09 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:44.367867 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ef35a-7d28-481f-9c56-fb9864db2ddc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:44.373997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ef35a-7d28-481f-9c56-fb9864db2ddc service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:44.373997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ef35a-7d28-481f-9c56-fb9864db2ddc service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:44.373997 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ef35a-7d28-481f-9c56-fb9864db2ddc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:44.425005 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ef35a-7d28-481f-9c56-fb9864db2ddc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:44.426694 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ef35a-7d28-481f-9c56-fb9864db2ddc service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:44.435941 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4607/9108] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:27:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:27:49.968167 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b0e20-caef-4d88-b8ba-b389ba1aa549 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:49.973010 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9a3b0e20-caef-4d88-b8ba-b389ba1aa549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:27:50.002742 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:27:50.032376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3b0e20-caef-4d88-b8ba-b389ba1aa549 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:50.036380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63daed-b8ba-41bd-8836-c2b2d61c89d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:50.036990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63daed-b8ba-41bd-8836-c2b2d61c89d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:50.037297 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63daed-b8ba-41bd-8836-c2b2d61c89d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:50.037562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63daed-b8ba-41bd-8836-c2b2d61c89d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:50.048300 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63daed-b8ba-41bd-8836-c2b2d61c89d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:50.049745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63daed-b8ba-41bd-8836-c2b2d61c89d2 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:50.060643 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4502/9109] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:27:49 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:27:53.542141 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16137cab-3ae5-4d4e-a495-051d991e195c None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:53.543797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16137cab-3ae5-4d4e-a495-051d991e195c None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:53.544297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16137cab-3ae5-4d4e-a495-051d991e195c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:53.570444 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-16137cab-3ae5-4d4e-a495-051d991e195c None None] MFA Rules not processed for user `2d8eaebce36448849a7271e5468d6957`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:27:53.571683 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-16137cab-3ae5-4d4e-a495-051d991e195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:27:53.580597 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4608/9110] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:27:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:27:53.928424 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63daed-b8ba-41bd-8836-c2b2d61c89d2 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:53.929940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0a63daed-b8ba-41bd-8836-c2b2d61c89d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:27:53.941251 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63daed-b8ba-41bd-8836-c2b2d61c89d2 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:53.945098 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651377fa-49d9-4019-b7da-1ae708b5bd58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:53.945830 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651377fa-49d9-4019-b7da-1ae708b5bd58 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:53.946360 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651377fa-49d9-4019-b7da-1ae708b5bd58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:53.946718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651377fa-49d9-4019-b7da-1ae708b5bd58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:53.948582 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-651377fa-49d9-4019-b7da-1ae708b5bd58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:27:53.959500 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651377fa-49d9-4019-b7da-1ae708b5bd58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:53.960982 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651377fa-49d9-4019-b7da-1ae708b5bd58 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:53.970382 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4503/9111] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:27:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:27:55.427133 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16137cab-3ae5-4d4e-a495-051d991e195c None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:55.430296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-16137cab-3ae5-4d4e-a495-051d991e195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:27:55.544276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16137cab-3ae5-4d4e-a495-051d991e195c None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:55.552093 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cd4d5-e691-4120-9e7d-03517454dbbf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:55.552837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cd4d5-e691-4120-9e7d-03517454dbbf service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:55.553374 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cd4d5-e691-4120-9e7d-03517454dbbf service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:55.553717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44cd4d5-e691-4120-9e7d-03517454dbbf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:55.556252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a44cd4d5-e691-4120-9e7d-03517454dbbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:27:55.569616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cd4d5-e691-4120-9e7d-03517454dbbf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:55.571267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44cd4d5-e691-4120-9e7d-03517454dbbf service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:55.592994 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4609/9112] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:27:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:27:58.564480 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651377fa-49d9-4019-b7da-1ae708b5bd58 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:27:58.574210 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651377fa-49d9-4019-b7da-1ae708b5bd58 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:27:58.577828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6158b0-fb5a-4e66-a87b-97639edf6328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:27:58.578504 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6158b0-fb5a-4e66-a87b-97639edf6328 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:27:58.578809 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6158b0-fb5a-4e66-a87b-97639edf6328 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:27:58.579082 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6158b0-fb5a-4e66-a87b-97639edf6328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:27:58.580844 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bb6158b0-fb5a-4e66-a87b-97639edf6328 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:27:58.590494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6158b0-fb5a-4e66-a87b-97639edf6328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:27:58.591929 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6158b0-fb5a-4e66-a87b-97639edf6328 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:27:58.600168 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4504/9113] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:27:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:28:04.194959 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cd4d5-e691-4120-9e7d-03517454dbbf service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:28:04.196451 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a44cd4d5-e691-4120-9e7d-03517454dbbf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:28:04.212456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44cd4d5-e691-4120-9e7d-03517454dbbf service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:28:04.219487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab316db-c20d-49d1-9dcd-c3dfec6da80f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:28:04.220198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab316db-c20d-49d1-9dcd-c3dfec6da80f service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:28:04.220433 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab316db-c20d-49d1-9dcd-c3dfec6da80f service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:28:04.220738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab316db-c20d-49d1-9dcd-c3dfec6da80f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:28:04.222678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6ab316db-c20d-49d1-9dcd-c3dfec6da80f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:28:04.235328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab316db-c20d-49d1-9dcd-c3dfec6da80f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:28:04.236900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab316db-c20d-49d1-9dcd-c3dfec6da80f service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:28:04.247434 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4610/9114] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:28:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:28:08.596398 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=26 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:28:14.243031 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=70 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:28:26.156243 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6158b0-fb5a-4e66-a87b-97639edf6328 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:28:26.157662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bb6158b0-fb5a-4e66-a87b-97639edf6328 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:28:26.172780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6158b0-fb5a-4e66-a87b-97639edf6328 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:28:26.178988 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a3b48-ddbb-4553-b003-66f3ffa66ea4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:28:26.179646 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a3b48-ddbb-4553-b003-66f3ffa66ea4 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:28:26.179938 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a3b48-ddbb-4553-b003-66f3ffa66ea4 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:28:26.180224 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a3b48-ddbb-4553-b003-66f3ffa66ea4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:28:26.181993 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-024a3b48-ddbb-4553-b003-66f3ffa66ea4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:28:26.194537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a3b48-ddbb-4553-b003-66f3ffa66ea4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:28:26.196168 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a3b48-ddbb-4553-b003-66f3ffa66ea4 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:28:26.207099 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4505/9115] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:28:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:28:36.202047 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:29:04.161205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c9f85-dcb1-4c4e-8c44-08c2a79ccd46 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:29:04.161690 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c9f85-dcb1-4c4e-8c44-08c2a79ccd46 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:29:04.161813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c9f85-dcb1-4c4e-8c44-08c2a79ccd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:29:04.183014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-894c9f85-dcb1-4c4e-8c44-08c2a79ccd46 None None] MFA Rules not processed for user `2d8eaebce36448849a7271e5468d6957`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:29:04.184209 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-894c9f85-dcb1-4c4e-8c44-08c2a79ccd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:29:04.192312 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4611/9116] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:29:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:29:14.176377 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:30.111734 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a3b48-ddbb-4553-b003-66f3ffa66ea4 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:30:30.131768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a3b48-ddbb-4553-b003-66f3ffa66ea4 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:30:30.136031 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef9617-70c8-424e-9b27-a0d4e3cb7eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:30:30.136684 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef9617-70c8-424e-9b27-a0d4e3cb7eac service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:30.136976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef9617-70c8-424e-9b27-a0d4e3cb7eac service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:30.137249 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef9617-70c8-424e-9b27-a0d4e3cb7eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:30.139025 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d2ef9617-70c8-424e-9b27-a0d4e3cb7eac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:30:30.194365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef9617-70c8-424e-9b27-a0d4e3cb7eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:30:30.195796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef9617-70c8-424e-9b27-a0d4e3cb7eac service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:30:30.208944 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4506/9117] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:30:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:30:31.389495 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c9f85-dcb1-4c4e-8c44-08c2a79ccd46 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:30:31.403652 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c9f85-dcb1-4c4e-8c44-08c2a79ccd46 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:30:31.407704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbcefd-801c-4e17-8654-b26a271f9a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:30:31.408354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbcefd-801c-4e17-8654-b26a271f9a2c service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:31.408641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbcefd-801c-4e17-8654-b26a271f9a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:31.408920 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbcefd-801c-4e17-8654-b26a271f9a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:31.410737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6adbcefd-801c-4e17-8654-b26a271f9a2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:30:31.425271 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbcefd-801c-4e17-8654-b26a271f9a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:30:31.426733 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adbcefd-801c-4e17-8654-b26a271f9a2c service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:30:31.437706 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4612/9118] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:30:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:30:40.203298 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=28 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:41.432903 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=8 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:46.566743 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e0dee-8a90-47dc-80c4-d18e4eed8e03 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:46.567706 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e0dee-8a90-47dc-80c4-d18e4eed8e03 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:46.568448 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e0dee-8a90-47dc-80c4-d18e4eed8e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:46.588573 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-b78e0dee-8a90-47dc-80c4-d18e4eed8e03 None None] MFA Rules not processed for user `2d8eaebce36448849a7271e5468d6957`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:30:46.590247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-b78e0dee-8a90-47dc-80c4-d18e4eed8e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:30:46.604457 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4507/9119] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:30:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:30:46.938467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbcefd-801c-4e17-8654-b26a271f9a2c service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:30:46.948198 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adbcefd-801c-4e17-8654-b26a271f9a2c service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:30:46.952360 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff60d2a-3a09-42ca-8be8-97e10232eb57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:30:46.953316 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff60d2a-3a09-42ca-8be8-97e10232eb57 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:30:46.954395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff60d2a-3a09-42ca-8be8-97e10232eb57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:30:46.954395 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff60d2a-3a09-42ca-8be8-97e10232eb57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:30:46.955818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-4ff60d2a-3a09-42ca-8be8-97e10232eb57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:30:46.967320 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff60d2a-3a09-42ca-8be8-97e10232eb57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:30:46.969783 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff60d2a-3a09-42ca-8be8-97e10232eb57 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:30:46.979826 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4613/9120] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:30:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:30:56.582259 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:30:56.974850 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:36.007140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e0dee-8a90-47dc-80c4-d18e4eed8e03 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:36.017760 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e0dee-8a90-47dc-80c4-d18e4eed8e03 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:36.021841 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84de4a9-0ecf-4e7b-8801-2b3750b61307 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:36.022627 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84de4a9-0ecf-4e7b-8801-2b3750b61307 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:36.023012 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84de4a9-0ecf-4e7b-8801-2b3750b61307 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:36.023382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84de4a9-0ecf-4e7b-8801-2b3750b61307 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:36.025366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-a84de4a9-0ecf-4e7b-8801-2b3750b61307 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:36.047888 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84de4a9-0ecf-4e7b-8801-2b3750b61307 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:36.054263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84de4a9-0ecf-4e7b-8801-2b3750b61307 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:36.057702 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4508/9121] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:31:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:31:36.199228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67573394-a049-45a0-b8ce-4f738296f66b None None] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:36.199792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67573394-a049-45a0-b8ce-4f738296f66b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:36.199792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67573394-a049-45a0-b8ce-4f738296f66b None None] PATH_INFO: `/` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:36.201268 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4614/9122] 10.222.0.43 () {54 vars in 921 bytes} [Tue Jul 19 15:31:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 15:31:36.206187 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8a42a-fad1-47a7-b6bf-af18c5796e13 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:36.206549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8a42a-fad1-47a7-b6bf-af18c5796e13 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:36.206900 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8a42a-fad1-47a7-b6bf-af18c5796e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:36.266720 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-bea8a42a-fad1-47a7-b6bf-af18c5796e13 None None] MFA Rules not processed for user `55426ff3ba7b45d7b270b5374539a461`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:31:36.267766 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bea8a42a-fad1-47a7-b6bf-af18c5796e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:36.276556 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4509/9123] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 15:31:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:31:36.297923 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67573394-a049-45a0-b8ce-4f738296f66b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:36.312182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67573394-a049-45a0-b8ce-4f738296f66b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:36.317323 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8307bc8-7232-4a96-92a5-bcb40c3a2d22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:36.317963 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8307bc8-7232-4a96-92a5-bcb40c3a2d22 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:36.318294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8307bc8-7232-4a96-92a5-bcb40c3a2d22 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:36.318577 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8307bc8-7232-4a96-92a5-bcb40c3a2d22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:36.327818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8307bc8-7232-4a96-92a5-bcb40c3a2d22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:36.329389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8307bc8-7232-4a96-92a5-bcb40c3a2d22 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:36.339215 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4615/9124] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:31:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:31:36.650685 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8a42a-fad1-47a7-b6bf-af18c5796e13 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:36.660175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8a42a-fad1-47a7-b6bf-af18c5796e13 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:36.663680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b91056-d1bd-45a0-8f7c-bc8de56b4d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:36.664335 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b91056-d1bd-45a0-8f7c-bc8de56b4d0c service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:36.664629 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b91056-d1bd-45a0-8f7c-bc8de56b4d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:36.664901 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b91056-d1bd-45a0-8f7c-bc8de56b4d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:36.667219 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-c3b91056-d1bd-45a0-8f7c-bc8de56b4d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:36.680876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b91056-d1bd-45a0-8f7c-bc8de56b4d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:36.683051 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b91056-d1bd-45a0-8f7c-bc8de56b4d0c service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:36.693698 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4510/9125] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:31:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:31:36.754491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8307bc8-7232-4a96-92a5-bcb40c3a2d22 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:31:36.765047 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8307bc8-7232-4a96-92a5-bcb40c3a2d22 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:31:36.770414 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e55c0-4d3d-4e57-a487-8aeca27bff9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:31:36.771055 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e55c0-4d3d-4e57-a487-8aeca27bff9f service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:31:36.771342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e55c0-4d3d-4e57-a487-8aeca27bff9f service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:31:36.771622 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e55c0-4d3d-4e57-a487-8aeca27bff9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:31:36.773410 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-668e55c0-4d3d-4e57-a487-8aeca27bff9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:31:36.785537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e55c0-4d3d-4e57-a487-8aeca27bff9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:31:36.787155 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668e55c0-4d3d-4e57-a487-8aeca27bff9f service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:31:36.797729 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4616/9126] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:31:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:31:46.689078 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=35 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:31:46.793851 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=12 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:19.894375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b91056-d1bd-45a0-8f7c-bc8de56b4d0c service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:19.904139 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b91056-d1bd-45a0-8f7c-bc8de56b4d0c service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:19.907842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be93d05-6de0-4d02-9d99-fabc3b1795ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:19.908505 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be93d05-6de0-4d02-9d99-fabc3b1795ef service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:19.908791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be93d05-6de0-4d02-9d99-fabc3b1795ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:19.909066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be93d05-6de0-4d02-9d99-fabc3b1795ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:19.918873 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-9be93d05-6de0-4d02-9d99-fabc3b1795ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:19.921445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be93d05-6de0-4d02-9d99-fabc3b1795ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:19.923405 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be93d05-6de0-4d02-9d99-fabc3b1795ef service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:19.932184 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4511/9127] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:25.777684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e55c0-4d3d-4e57-a487-8aeca27bff9f service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:25.789281 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668e55c0-4d3d-4e57-a487-8aeca27bff9f service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:25.794322 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876d1d7-acfa-4da4-830f-0a43fa1b7932 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:25.794954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876d1d7-acfa-4da4-830f-0a43fa1b7932 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:25.795236 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876d1d7-acfa-4da4-830f-0a43fa1b7932 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:25.795512 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6876d1d7-acfa-4da4-830f-0a43fa1b7932 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:25.797265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6876d1d7-acfa-4da4-830f-0a43fa1b7932 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:25.809025 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876d1d7-acfa-4da4-830f-0a43fa1b7932 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:25.810626 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6876d1d7-acfa-4da4-830f-0a43fa1b7932 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:25.820324 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4617/9128] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:29.928389 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:31.140206 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be93d05-6de0-4d02-9d99-fabc3b1795ef service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:31.154439 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be93d05-6de0-4d02-9d99-fabc3b1795ef service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:31.168140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf81404-6011-4ab9-a8d2-1bd6af589acc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:31.168140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf81404-6011-4ab9-a8d2-1bd6af589acc service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:31.168140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf81404-6011-4ab9-a8d2-1bd6af589acc service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:31.168140 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf81404-6011-4ab9-a8d2-1bd6af589acc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:31.169983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-faf81404-6011-4ab9-a8d2-1bd6af589acc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:31.185853 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf81404-6011-4ab9-a8d2-1bd6af589acc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:31.187004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf81404-6011-4ab9-a8d2-1bd6af589acc service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:31.199387 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4512/9129] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:33.449660 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876d1d7-acfa-4da4-830f-0a43fa1b7932 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:33.463505 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6876d1d7-acfa-4da4-830f-0a43fa1b7932 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:33.469471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaa6c1-926b-4512-8768-97ef6c037738 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:33.470227 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaa6c1-926b-4512-8768-97ef6c037738 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:33.470515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaa6c1-926b-4512-8768-97ef6c037738 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:33.470797 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eaa6c1-926b-4512-8768-97ef6c037738 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:33.472653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-99eaa6c1-926b-4512-8768-97ef6c037738 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:33.485324 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eaa6c1-926b-4512-8768-97ef6c037738 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:33.486941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eaa6c1-926b-4512-8768-97ef6c037738 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:33.497610 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4618/9130] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:38.888650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf81404-6011-4ab9-a8d2-1bd6af589acc service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:38.900422 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf81404-6011-4ab9-a8d2-1bd6af589acc service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:38.905324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc24371-cf08-40c1-84ed-646318e2e8e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:38.905970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc24371-cf08-40c1-84ed-646318e2e8e2 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:38.906295 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc24371-cf08-40c1-84ed-646318e2e8e2 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:38.906579 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc24371-cf08-40c1-84ed-646318e2e8e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:38.908338 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-2fc24371-cf08-40c1-84ed-646318e2e8e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:38.921506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc24371-cf08-40c1-84ed-646318e2e8e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:38.923307 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc24371-cf08-40c1-84ed-646318e2e8e2 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:38.934586 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4513/9131] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:43.493207 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=12 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:45.010298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaa6c1-926b-4512-8768-97ef6c037738 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:45.020128 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eaa6c1-926b-4512-8768-97ef6c037738 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:45.024779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12343eb4-cc3c-4573-9a42-5492c38269ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:45.025536 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12343eb4-cc3c-4573-9a42-5492c38269ea service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:45.025925 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12343eb4-cc3c-4573-9a42-5492c38269ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:45.026336 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12343eb4-cc3c-4573-9a42-5492c38269ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:45.035364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12343eb4-cc3c-4573-9a42-5492c38269ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:45.037675 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12343eb4-cc3c-4573-9a42-5492c38269ea service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:45.047306 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4619/9132] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:47.641318 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d10c35-a78f-487f-b229-6cf0b7f54d8a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:47.642418 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d10c35-a78f-487f-b229-6cf0b7f54d8a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:47.642773 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d10c35-a78f-487f-b229-6cf0b7f54d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:47.664828 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-98d10c35-a78f-487f-b229-6cf0b7f54d8a None None] MFA Rules not processed for user `2d8eaebce36448849a7271e5468d6957`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:32:47.665995 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-98d10c35-a78f-487f-b229-6cf0b7f54d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:32:47.678881 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4514/9133] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:32:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:32:55.043583 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:57.448695 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12343eb4-cc3c-4573-9a42-5492c38269ea service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:57.457191 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12343eb4-cc3c-4573-9a42-5492c38269ea service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:57.462112 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331fcb6-4ee8-458b-8a2a-e646e876d62f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:57.462765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331fcb6-4ee8-458b-8a2a-e646e876d62f service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:57.463046 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331fcb6-4ee8-458b-8a2a-e646e876d62f service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:57.463329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331fcb6-4ee8-458b-8a2a-e646e876d62f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:57.470836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331fcb6-4ee8-458b-8a2a-e646e876d62f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:57.472260 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331fcb6-4ee8-458b-8a2a-e646e876d62f service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:57.480602 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4620/9134] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:32:57.657804 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=15 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:32:59.327359 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d10c35-a78f-487f-b229-6cf0b7f54d8a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:32:59.337680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d10c35-a78f-487f-b229-6cf0b7f54d8a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:32:59.341427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6d575-8916-42c5-ad8a-59961b97be33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:32:59.342205 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6d575-8916-42c5-ad8a-59961b97be33 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:32:59.342490 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6d575-8916-42c5-ad8a-59961b97be33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:32:59.342768 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6d575-8916-42c5-ad8a-59961b97be33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:32:59.351803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6d575-8916-42c5-ad8a-59961b97be33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:32:59.353213 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6d575-8916-42c5-ad8a-59961b97be33 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:32:59.362665 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4515/9135] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:32:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:07.476967 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:09.358417 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:33:28.169035 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331fcb6-4ee8-458b-8a2a-e646e876d62f service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:33:28.182426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331fcb6-4ee8-458b-8a2a-e646e876d62f service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:33:28.187269 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43bc77-b02d-4b46-aee3-60a1b0b937d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:33:28.187900 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43bc77-b02d-4b46-aee3-60a1b0b937d5 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:33:28.188182 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43bc77-b02d-4b46-aee3-60a1b0b937d5 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:33:28.188455 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43bc77-b02d-4b46-aee3-60a1b0b937d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:33:28.197330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43bc77-b02d-4b46-aee3-60a1b0b937d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:33:28.198930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43bc77-b02d-4b46-aee3-60a1b0b937d5 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:33:28.209458 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4621/9136] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:33:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:33:38.204537 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:31.243887 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6d575-8916-42c5-ad8a-59961b97be33 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:31.256998 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6d575-8916-42c5-ad8a-59961b97be33 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:31.263147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861850d7-1200-484a-8835-6446554bb246 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:31.264188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861850d7-1200-484a-8835-6446554bb246 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:31.264188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861850d7-1200-484a-8835-6446554bb246 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:31.264587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861850d7-1200-484a-8835-6446554bb246 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:31.266399 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-861850d7-1200-484a-8835-6446554bb246 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:31.278409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861850d7-1200-484a-8835-6446554bb246 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:31.279935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861850d7-1200-484a-8835-6446554bb246 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:31.290463 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4516/9137] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:34:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:34:40.719998 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4afcd-ea0c-4740-b21a-c1c388957275 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:40.720516 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4afcd-ea0c-4740-b21a-c1c388957275 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:40.720629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4afcd-ea0c-4740-b21a-c1c388957275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:40.741507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2cd4afcd-ea0c-4740-b21a-c1c388957275 None None] MFA Rules not processed for user `2d8eaebce36448849a7271e5468d6957`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:34:40.742759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2cd4afcd-ea0c-4740-b21a-c1c388957275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:34:40.749650 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4622/9138] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:34:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:34:41.078985 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861850d7-1200-484a-8835-6446554bb246 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:41.089892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861850d7-1200-484a-8835-6446554bb246 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:41.095220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd875e0-07fb-4e97-a429-d0f69b4c9408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:41.097274 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd875e0-07fb-4e97-a429-d0f69b4c9408 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:41.097842 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd875e0-07fb-4e97-a429-d0f69b4c9408 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:41.098416 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd875e0-07fb-4e97-a429-d0f69b4c9408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:41.107631 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd875e0-07fb-4e97-a429-d0f69b4c9408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:41.109234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd875e0-07fb-4e97-a429-d0f69b4c9408 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:41.120283 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4517/9139] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:34:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:34:50.735437 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:51.115963 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=12 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:34:55.973562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4afcd-ea0c-4740-b21a-c1c388957275 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:34:55.987202 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4afcd-ea0c-4740-b21a-c1c388957275 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:34:55.993685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfb2f6-600c-4bb1-8abd-b9b59204d4c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:34:55.994363 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfb2f6-600c-4bb1-8abd-b9b59204d4c9 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:34:55.994656 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfb2f6-600c-4bb1-8abd-b9b59204d4c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:34:55.994938 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfb2f6-600c-4bb1-8abd-b9b59204d4c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:34:56.004383 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfb2f6-600c-4bb1-8abd-b9b59204d4c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:34:56.007299 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dfb2f6-600c-4bb1-8abd-b9b59204d4c9 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:34:56.017462 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4623/9140] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:34:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:35:06.013078 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:36.070692 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd875e0-07fb-4e97-a429-d0f69b4c9408 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:36.089686 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd875e0-07fb-4e97-a429-d0f69b4c9408 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:36.093311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3416c3-ceb7-44a6-b67f-2c6afac4bf2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:36.093981 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3416c3-ceb7-44a6-b67f-2c6afac4bf2d service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:36.094298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3416c3-ceb7-44a6-b67f-2c6afac4bf2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:36.094624 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3416c3-ceb7-44a6-b67f-2c6afac4bf2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:36.112722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3416c3-ceb7-44a6-b67f-2c6afac4bf2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:36.115180 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3416c3-ceb7-44a6-b67f-2c6afac4bf2d service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:36.135864 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4518/9141] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:35:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:35:37.327598 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfb2f6-600c-4bb1-8abd-b9b59204d4c9 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:37.337167 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfb2f6-600c-4bb1-8abd-b9b59204d4c9 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:37.340725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe8445-baf1-4de3-a605-b9853144d0e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:37.341389 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe8445-baf1-4de3-a605-b9853144d0e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:37.341669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe8445-baf1-4de3-a605-b9853144d0e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:37.341949 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe8445-baf1-4de3-a605-b9853144d0e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:37.351981 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe8445-baf1-4de3-a605-b9853144d0e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:37.353394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe8445-baf1-4de3-a605-b9853144d0e1 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:37.364601 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4624/9142] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:35:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:35:46.133217 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=17 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:47.359438 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:51.834477 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3416c3-ceb7-44a6-b67f-2c6afac4bf2d service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:51.920365 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3416c3-ceb7-44a6-b67f-2c6afac4bf2d service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:51.925214 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071ec9b-2041-4e0d-ab1e-a36af00fde6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:51.926970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071ec9b-2041-4e0d-ab1e-a36af00fde6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:51.927275 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071ec9b-2041-4e0d-ab1e-a36af00fde6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:51.927555 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071ec9b-2041-4e0d-ab1e-a36af00fde6e admin admin] PATH_INFO: `/v3/users/2d8eaebce36448849a7271e5468d6957` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:51.928752 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071ec9b-2041-4e0d-ab1e-a36af00fde6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d8eaebce36448849a7271e5468d6957)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:51.930698 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d071ec9b-2041-4e0d-ab1e-a36af00fde6e admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:52.175619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d071ec9b-2041-4e0d-ab1e-a36af00fde6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d8eaebce36448849a7271e5468d6957'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:52.187710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d071ec9b-2041-4e0d-ab1e-a36af00fde6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d8eaebce36448849a7271e5468d6957'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:52.188375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d071ec9b-2041-4e0d-ab1e-a36af00fde6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d8eaebce36448849a7271e5468d6957'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:52.189066 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d071ec9b-2041-4e0d-ab1e-a36af00fde6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d8eaebce36448849a7271e5468d6957'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:52.196050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-d071ec9b-2041-4e0d-ab1e-a36af00fde6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d8eaebce36448849a7271e5468d6957'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:52.328281 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4519/9143] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:35:51 2022] DELETE /identity/v3/users/2d8eaebce36448849a7271e5468d6957 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:35:52.333741 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f977d5-63d1-4619-a33e-63d2064e4fbe None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:52.334267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f977d5-63d1-4619-a33e-63d2064e4fbe None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:52.334381 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f977d5-63d1-4619-a33e-63d2064e4fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:52.373670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-a8f977d5-63d1-4619-a33e-63d2064e4fbe None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:52.374902 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a8f977d5-63d1-4619-a33e-63d2064e4fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:52.433753 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4625/9144] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:35:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:35:52.443745 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071ec9b-2041-4e0d-ab1e-a36af00fde6e admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:52.445147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d071ec9b-2041-4e0d-ab1e-a36af00fde6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:52.502465 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071ec9b-2041-4e0d-ab1e-a36af00fde6e admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:52.507067 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0c718-6753-4c9b-aa6d-c9ee57fb12ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:52.507718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0c718-6753-4c9b-aa6d-c9ee57fb12ac service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:52.508037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0c718-6753-4c9b-aa6d-c9ee57fb12ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:52.508654 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0c718-6753-4c9b-aa6d-c9ee57fb12ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:52.517885 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0c718-6753-4c9b-aa6d-c9ee57fb12ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:52.519346 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0c718-6753-4c9b-aa6d-c9ee57fb12ac service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:52.529615 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4520/9145] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:35:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:35:52.797659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f977d5-63d1-4619-a33e-63d2064e4fbe None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:52.799080 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a8f977d5-63d1-4619-a33e-63d2064e4fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:52.813448 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f977d5-63d1-4619-a33e-63d2064e4fbe None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:52.818941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521afcc7-a6fd-4a0d-8ca2-af18259273cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:52.819809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521afcc7-a6fd-4a0d-8ca2-af18259273cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:52.820094 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521afcc7-a6fd-4a0d-8ca2-af18259273cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:52.820372 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521afcc7-a6fd-4a0d-8ca2-af18259273cc admin admin] PATH_INFO: `/v3/projects/ffb7cb04e799433eaf5b9c3a9122317c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:52.822328 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521afcc7-a6fd-4a0d-8ca2-af18259273cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffb7cb04e799433eaf5b9c3a9122317c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:52.824304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521afcc7-a6fd-4a0d-8ca2-af18259273cc admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:52.934730 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-521afcc7-a6fd-4a0d-8ca2-af18259273cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffb7cb04e799433eaf5b9c3a9122317c', 'request_id': 'req-521afcc7-a6fd-4a0d-8ca2-af18259273cc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:52.940237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-521afcc7-a6fd-4a0d-8ca2-af18259273cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffb7cb04e799433eaf5b9c3a9122317c', 'request_id': 'req-521afcc7-a6fd-4a0d-8ca2-af18259273cc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:52.947290 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-521afcc7-a6fd-4a0d-8ca2-af18259273cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffb7cb04e799433eaf5b9c3a9122317c', 'request_id': 'req-521afcc7-a6fd-4a0d-8ca2-af18259273cc'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:53.053765 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-521afcc7-a6fd-4a0d-8ca2-af18259273cc admin admin] The token cache is being invalidate because project ffb7cb04e799433eaf5b9c3a9122317c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:35:53.053983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-521afcc7-a6fd-4a0d-8ca2-af18259273cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:53.054629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-521afcc7-a6fd-4a0d-8ca2-af18259273cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:53.056183 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4626/9146] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:35:52 2022] DELETE /identity/v3/projects/ffb7cb04e799433eaf5b9c3a9122317c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:35:53.060366 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0c718-6753-4c9b-aa6d-c9ee57fb12ac service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:53.067061 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:53.071202 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0c718-6753-4c9b-aa6d-c9ee57fb12ac service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:53.128350 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc2a5b-2d32-46b8-91a2-443d72332a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:53.129952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc2a5b-2d32-46b8-91a2-443d72332a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:53.130267 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc2a5b-2d32-46b8-91a2-443d72332a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:53.130549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc2a5b-2d32-46b8-91a2-443d72332a42 admin admin] PATH_INFO: `/v3/users/c957230bfbfa4b69b37999415ac24400` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:53.131827 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc2a5b-2d32-46b8-91a2-443d72332a42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c957230bfbfa4b69b37999415ac24400)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:53.133731 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc2a5b-2d32-46b8-91a2-443d72332a42 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:53.409368 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-21dc2a5b-2d32-46b8-91a2-443d72332a42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c957230bfbfa4b69b37999415ac24400'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:53.421258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-21dc2a5b-2d32-46b8-91a2-443d72332a42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c957230bfbfa4b69b37999415ac24400'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:53.421926 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-21dc2a5b-2d32-46b8-91a2-443d72332a42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c957230bfbfa4b69b37999415ac24400'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:53.422562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-21dc2a5b-2d32-46b8-91a2-443d72332a42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c957230bfbfa4b69b37999415ac24400'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:53.430247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-21dc2a5b-2d32-46b8-91a2-443d72332a42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c957230bfbfa4b69b37999415ac24400'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:53.521610 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4521/9147] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:35:53 2022] DELETE /identity/v3/users/c957230bfbfa4b69b37999415ac24400 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:35:54.037334 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521afcc7-a6fd-4a0d-8ca2-af18259273cc admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:54.038893 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-521afcc7-a6fd-4a0d-8ca2-af18259273cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:54.054563 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521afcc7-a6fd-4a0d-8ca2-af18259273cc admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:54.111926 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839b2e9-b9a5-45da-9d29-1bb80ad63724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:54.112789 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839b2e9-b9a5-45da-9d29-1bb80ad63724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:54.113070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839b2e9-b9a5-45da-9d29-1bb80ad63724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:54.113485 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839b2e9-b9a5-45da-9d29-1bb80ad63724 admin admin] PATH_INFO: `/v3/projects/97c610bdb25f4179b4383b6129a7bb6c` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:54.114725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839b2e9-b9a5-45da-9d29-1bb80ad63724 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97c610bdb25f4179b4383b6129a7bb6c)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:54.116597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839b2e9-b9a5-45da-9d29-1bb80ad63724 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:54.124562 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:54.254525 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d839b2e9-b9a5-45da-9d29-1bb80ad63724 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97c610bdb25f4179b4383b6129a7bb6c', 'request_id': 'req-d839b2e9-b9a5-45da-9d29-1bb80ad63724'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:54.260647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d839b2e9-b9a5-45da-9d29-1bb80ad63724 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97c610bdb25f4179b4383b6129a7bb6c', 'request_id': 'req-d839b2e9-b9a5-45da-9d29-1bb80ad63724'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:54.266975 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d839b2e9-b9a5-45da-9d29-1bb80ad63724 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97c610bdb25f4179b4383b6129a7bb6c', 'request_id': 'req-d839b2e9-b9a5-45da-9d29-1bb80ad63724'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:54.361180 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d839b2e9-b9a5-45da-9d29-1bb80ad63724 admin admin] The token cache is being invalidate because project 97c610bdb25f4179b4383b6129a7bb6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80680) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:35:54.361400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d839b2e9-b9a5-45da-9d29-1bb80ad63724 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:54.362045 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-d839b2e9-b9a5-45da-9d29-1bb80ad63724 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:35:54.364135 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4627/9148] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:35:54 2022] DELETE /identity/v3/projects/97c610bdb25f4179b4383b6129a7bb6c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:35:54.369647 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaa60d-7b09-4703-ad3d-9d88df5b7be2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:54.372476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaa60d-7b09-4703-ad3d-9d88df5b7be2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:54.372476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eaa60d-7b09-4703-ad3d-9d88df5b7be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:54.408508 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d9eaa60d-7b09-4703-ad3d-9d88df5b7be2 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:54.409704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d9eaa60d-7b09-4703-ad3d-9d88df5b7be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:54.469098 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4522/9149] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:35:54.478170 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9120964-9bbd-46d5-8c4b-da78ba8469b5 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:54.478466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9120964-9bbd-46d5-8c4b-da78ba8469b5 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:54.478747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9120964-9bbd-46d5-8c4b-da78ba8469b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:54.497422 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-e9120964-9bbd-46d5-8c4b-da78ba8469b5 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:54.498684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e9120964-9bbd-46d5-8c4b-da78ba8469b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:54.507509 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4628/9150] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:35:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:35:54.511718 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eaa60d-7b09-4703-ad3d-9d88df5b7be2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:54.521732 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eaa60d-7b09-4703-ad3d-9d88df5b7be2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:54.526331 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e44d5-82de-4ce6-85d9-f46d029d5d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:54.526989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e44d5-82de-4ce6-85d9-f46d029d5d22 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:54.527278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e44d5-82de-4ce6-85d9-f46d029d5d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:54.527560 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e44d5-82de-4ce6-85d9-f46d029d5d22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:54.528287 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e44d5-82de-4ce6-85d9-f46d029d5d22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80679) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:35:54.528597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e44d5-82de-4ce6-85d9-f46d029d5d22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:54.530215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e44d5-82de-4ce6-85d9-f46d029d5d22 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:54.532548 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:35:54.545568 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4523/9151] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 15:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:35:54.547033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9120964-9bbd-46d5-8c4b-da78ba8469b5 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:54.557033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9120964-9bbd-46d5-8c4b-da78ba8469b5 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:54.561659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a30f9-a392-4740-b7dd-947502b020cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:54.562356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a30f9-a392-4740-b7dd-947502b020cf admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:54.562628 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a30f9-a392-4740-b7dd-947502b020cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:54.562906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a30f9-a392-4740-b7dd-947502b020cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:54.563602 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a30f9-a392-4740-b7dd-947502b020cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:54.565491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a30f9-a392-4740-b7dd-947502b020cf admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:54.706312 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4629/9152] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 15:35:54 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:35:54.711332 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e44d5-82de-4ce6-85d9-f46d029d5d22 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:54.721435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e44d5-82de-4ce6-85d9-f46d029d5d22 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:54.778309 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4260674-b005-48e2-a9c6-1396ce2aaa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:54.779046 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4260674-b005-48e2-a9c6-1396ce2aaa4b admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:54.779336 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4260674-b005-48e2-a9c6-1396ce2aaa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:54.779616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4260674-b005-48e2-a9c6-1396ce2aaa4b admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:54.780315 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4260674-b005-48e2-a9c6-1396ce2aaa4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:54.782247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4260674-b005-48e2-a9c6-1396ce2aaa4b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:54.928596 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4524/9153] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 15:35:54 2022] POST /identity/v3/users => generated 287 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:35:54.932719 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a30f9-a392-4740-b7dd-947502b020cf admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:54.944274 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a30f9-a392-4740-b7dd-947502b020cf admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:54.948891 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38b524-4cdd-4687-bd6d-fe628e16ccb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:54.949562 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38b524-4cdd-4687-bd6d-fe628e16ccb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:54.949849 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38b524-4cdd-4687-bd6d-fe628e16ccb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:54.950159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d38b524-4cdd-4687-bd6d-fe628e16ccb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:54.950912 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38b524-4cdd-4687-bd6d-fe628e16ccb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:54.952513 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d38b524-4cdd-4687-bd6d-fe628e16ccb7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:54.962855 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4630/9154] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:35:54.966859 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4260674-b005-48e2-a9c6-1396ce2aaa4b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:54.977932 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4260674-b005-48e2-a9c6-1396ce2aaa4b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:54.983037 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98abfa5-156a-4ee7-b281-95af9b340896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:54.983755 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98abfa5-156a-4ee7-b281-95af9b340896 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:54.984043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98abfa5-156a-4ee7-b281-95af9b340896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:54.984327 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98abfa5-156a-4ee7-b281-95af9b340896 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:54.985061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98abfa5-156a-4ee7-b281-95af9b340896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:54.986759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98abfa5-156a-4ee7-b281-95af9b340896 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:54.998880 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4525/9155] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:35:55.003052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38b524-4cdd-4687-bd6d-fe628e16ccb7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:55.015612 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d38b524-4cdd-4687-bd6d-fe628e16ccb7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:55.020773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e807cb5-2016-4f9e-9e5e-f853e791614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:55.026681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e807cb5-2016-4f9e-9e5e-f853e791614e admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:55.026681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e807cb5-2016-4f9e-9e5e-f853e791614e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:55.026681 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e807cb5-2016-4f9e-9e5e-f853e791614e admin admin] PATH_INFO: `/v3/projects/18db532817764fb8b9fa4ec941b0e9aa/users/5ed058bfc6604647b50d23b11fe8c603/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:55.038241 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e807cb5-2016-4f9e-9e5e-f853e791614e admin admin] RBAC: Authorizing `identity:create_grant(project_id=18db532817764fb8b9fa4ec941b0e9aa, user_id=5ed058bfc6604647b50d23b11fe8c603, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:55.040956 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e807cb5-2016-4f9e-9e5e-f853e791614e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:55.128231 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4631/9156] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:35:55 2022] PUT /identity/v3/projects/18db532817764fb8b9fa4ec941b0e9aa/users/5ed058bfc6604647b50d23b11fe8c603/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:35:55.133533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39e440-6f95-4991-9e82-69b85fab7607 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:55.133862 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39e440-6f95-4991-9e82-69b85fab7607 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:55.134191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39e440-6f95-4991-9e82-69b85fab7607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:55.154047 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-fd39e440-6f95-4991-9e82-69b85fab7607 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:35:55.155306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fd39e440-6f95-4991-9e82-69b85fab7607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:55.217734 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4526/9157] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:35:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:35:55.228030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e807cb5-2016-4f9e-9e5e-f853e791614e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:35:55.229816 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9e807cb5-2016-4f9e-9e5e-f853e791614e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:35:55.288467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e807cb5-2016-4f9e-9e5e-f853e791614e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:35:55.292265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1695e-9249-4abe-ac79-d02cedd15a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:35:55.292910 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1695e-9249-4abe-ac79-d02cedd15a33 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:35:55.293201 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1695e-9249-4abe-ac79-d02cedd15a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:35:55.293500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1695e-9249-4abe-ac79-d02cedd15a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:35:55.303228 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1695e-9249-4abe-ac79-d02cedd15a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:35:55.304669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1695e-9249-4abe-ac79-d02cedd15a33 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:35:55.314365 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4632/9158] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:35:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:36:00.785018 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500ae62-cee4-4a31-9575-8821143a87d4 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:00.785655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500ae62-cee4-4a31-9575-8821143a87d4 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:00.785655 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500ae62-cee4-4a31-9575-8821143a87d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:00.819166 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-6500ae62-cee4-4a31-9575-8821143a87d4 None None] MFA Rules not processed for user `5ed058bfc6604647b50d23b11fe8c603`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:36:00.825102 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-6500ae62-cee4-4a31-9575-8821143a87d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:00.896528 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4527/9159] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:36:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:36:00.901006 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1695e-9249-4abe-ac79-d02cedd15a33 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:36:00.911704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1695e-9249-4abe-ac79-d02cedd15a33 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:36:00.916580 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afc9d9-26b3-42d3-9d34-4e90753abf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:36:00.917256 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afc9d9-26b3-42d3-9d34-4e90753abf51 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:00.917547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afc9d9-26b3-42d3-9d34-4e90753abf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:00.917879 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18afc9d9-26b3-42d3-9d34-4e90753abf51 admin admin] PATH_INFO: `/v3/projects` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:00.918646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18afc9d9-26b3-42d3-9d34-4e90753abf51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:36:00.920614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18afc9d9-26b3-42d3-9d34-4e90753abf51 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:36:01.003561 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4633/9160] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 15:36:00 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:36:01.009032 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500ae62-cee4-4a31-9575-8821143a87d4 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:36:01.016313 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:01.021434 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500ae62-cee4-4a31-9575-8821143a87d4 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:36:01.084429 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2ed92-30dc-4fef-b4e8-ec6b0db4ea43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:36:01.085119 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2ed92-30dc-4fef-b4e8-ec6b0db4ea43 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:01.085403 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2ed92-30dc-4fef-b4e8-ec6b0db4ea43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:01.085683 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2ed92-30dc-4fef-b4e8-ec6b0db4ea43 admin admin] PATH_INFO: `/v3/users` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:01.086621 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2ed92-30dc-4fef-b4e8-ec6b0db4ea43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:36:01.088377 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a2ed92-30dc-4fef-b4e8-ec6b0db4ea43 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:36:01.173907 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4528/9161] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 15:36:01 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:36:01.179251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afc9d9-26b3-42d3-9d34-4e90753abf51 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:36:01.186281 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:01.190467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18afc9d9-26b3-42d3-9d34-4e90753abf51 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:36:01.196148 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97b2ac-3955-4ece-a5fd-32438e80de6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:36:01.196964 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97b2ac-3955-4ece-a5fd-32438e80de6b admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:01.197257 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97b2ac-3955-4ece-a5fd-32438e80de6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:01.197534 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b97b2ac-3955-4ece-a5fd-32438e80de6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:01.198456 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97b2ac-3955-4ece-a5fd-32438e80de6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:36:01.200059 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b97b2ac-3955-4ece-a5fd-32438e80de6b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:36:01.217837 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4634/9162] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 15:36:01.222036 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2ed92-30dc-4fef-b4e8-ec6b0db4ea43 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:36:01.233999 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2ed92-30dc-4fef-b4e8-ec6b0db4ea43 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:36:01.239707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4b650-657c-4ceb-9ad7-bb316308ee7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:36:01.240836 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4b650-657c-4ceb-9ad7-bb316308ee7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:01.241221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4b650-657c-4ceb-9ad7-bb316308ee7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:01.241576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4b650-657c-4ceb-9ad7-bb316308ee7a admin admin] PATH_INFO: `/v3/projects/63e854d5eac548289a520566c7af57e9/users/a8b9ed682508486eb966207ad1af1f04/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:01.259370 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4b650-657c-4ceb-9ad7-bb316308ee7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e854d5eac548289a520566c7af57e9, user_id=a8b9ed682508486eb966207ad1af1f04, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:36:01.262200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4b650-657c-4ceb-9ad7-bb316308ee7a admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:36:01.340098 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4529/9163] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:36:01 2022] PUT /identity/v3/projects/63e854d5eac548289a520566c7af57e9/users/a8b9ed682508486eb966207ad1af1f04/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 15:36:01.343911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97b2ac-3955-4ece-a5fd-32438e80de6b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:36:01.355091 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b97b2ac-3955-4ece-a5fd-32438e80de6b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:36:01.421412 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac52df5-1f4b-43b5-8131-efed109c522f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:36:01.520701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac52df5-1f4b-43b5-8131-efed109c522f admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:01.520701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac52df5-1f4b-43b5-8131-efed109c522f admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:01.520701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac52df5-1f4b-43b5-8131-efed109c522f admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:01.520701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac52df5-1f4b-43b5-8131-efed109c522f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:36:01.520701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac52df5-1f4b-43b5-8131-efed109c522f admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:36:01.520701 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4635/9164] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:36:01 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:36:01.521883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4b650-657c-4ceb-9ad7-bb316308ee7a admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:36:01.521883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4b650-657c-4ceb-9ad7-bb316308ee7a admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:36:01.521883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2352c-b82a-4f04-9548-3f0ccc64168b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:36:01.521883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2352c-b82a-4f04-9548-3f0ccc64168b admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:01.522304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2352c-b82a-4f04-9548-3f0ccc64168b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:01.522304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb2352c-b82a-4f04-9548-3f0ccc64168b admin admin] PATH_INFO: `/v3/projects/63e854d5eac548289a520566c7af57e9/users/a8b9ed682508486eb966207ad1af1f04/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:01.522304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2352c-b82a-4f04-9548-3f0ccc64168b admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e854d5eac548289a520566c7af57e9, user_id=a8b9ed682508486eb966207ad1af1f04, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:36:01.522304 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb2352c-b82a-4f04-9548-3f0ccc64168b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:36:01.522304 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4530/9165] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:36:01 2022] PUT /identity/v3/projects/63e854d5eac548289a520566c7af57e9/users/a8b9ed682508486eb966207ad1af1f04/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:36:08.120597 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75f12d-0fb6-49df-8245-2818bc8300d1 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:08.121426 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75f12d-0fb6-49df-8245-2818bc8300d1 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:08.121718 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e75f12d-0fb6-49df-8245-2818bc8300d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:08.152708 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5e75f12d-0fb6-49df-8245-2818bc8300d1 None None] MFA Rules not processed for user `a8b9ed682508486eb966207ad1af1f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:36:08.153821 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5e75f12d-0fb6-49df-8245-2818bc8300d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:08.256818 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4636/9166] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:36:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:36:08.266380 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2352c-b82a-4f04-9548-3f0ccc64168b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:36:08.268302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-fcb2352c-b82a-4f04-9548-3f0ccc64168b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:08.371237 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb2352c-b82a-4f04-9548-3f0ccc64168b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:36:08.377292 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec96cbb-280e-4932-a5b9-12cce9fcfc87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:36:08.378045 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec96cbb-280e-4932-a5b9-12cce9fcfc87 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:08.378391 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec96cbb-280e-4932-a5b9-12cce9fcfc87 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:08.378737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec96cbb-280e-4932-a5b9-12cce9fcfc87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:08.427372 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:08.442617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec96cbb-280e-4932-a5b9-12cce9fcfc87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:36:08.444230 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec96cbb-280e-4932-a5b9-12cce9fcfc87 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:36:08.454204 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4531/9167] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:36:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:36:12.164312 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a654878-ead9-444e-b304-9efffd8c2813 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:12.164780 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a654878-ead9-444e-b304-9efffd8c2813 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:12.164874 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a654878-ead9-444e-b304-9efffd8c2813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:12.188018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-5a654878-ead9-444e-b304-9efffd8c2813 None None] MFA Rules not processed for user `5ed058bfc6604647b50d23b11fe8c603`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:36:12.188018 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5a654878-ead9-444e-b304-9efffd8c2813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:12.191869 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4637/9168] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:36:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:36:13.298320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec96cbb-280e-4932-a5b9-12cce9fcfc87 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:36:13.299749 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-5ec96cbb-280e-4932-a5b9-12cce9fcfc87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:13.386006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec96cbb-280e-4932-a5b9-12cce9fcfc87 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:36:13.391388 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa649e3-feaf-42ec-a794-03c092ff9f55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:36:13.392050 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa649e3-feaf-42ec-a794-03c092ff9f55 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:13.392364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa649e3-feaf-42ec-a794-03c092ff9f55 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:13.392681 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa649e3-feaf-42ec-a794-03c092ff9f55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:13.394541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-bfa649e3-feaf-42ec-a794-03c092ff9f55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:13.406688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa649e3-feaf-42ec-a794-03c092ff9f55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:36:13.408409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa649e3-feaf-42ec-a794-03c092ff9f55 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:36:13.418521 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4532/9169] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:36:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:36:22.178317 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=69 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:23.414258 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=44 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:36:26.225042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a654878-ead9-444e-b304-9efffd8c2813 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:36:26.226569 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-5a654878-ead9-444e-b304-9efffd8c2813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:36:26.283297 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a654878-ead9-444e-b304-9efffd8c2813 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:36:26.287653 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f39ad6-481d-4264-9f9b-61c5a973bb42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:36:26.288300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f39ad6-481d-4264-9f9b-61c5a973bb42 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:36:26.288585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f39ad6-481d-4264-9f9b-61c5a973bb42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:36:26.288864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f39ad6-481d-4264-9f9b-61c5a973bb42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:36:26.297983 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f39ad6-481d-4264-9f9b-61c5a973bb42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:36:26.306164 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f39ad6-481d-4264-9f9b-61c5a973bb42 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:36:26.309845 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4638/9170] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:36:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:36:36.305572 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=26 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:27.924823 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa649e3-feaf-42ec-a794-03c092ff9f55 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:27.934375 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa649e3-feaf-42ec-a794-03c092ff9f55 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:27.937905 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c5009-6988-440a-82c3-2f843fc0691d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:27.938585 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c5009-6988-440a-82c3-2f843fc0691d service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:27.938870 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c5009-6988-440a-82c3-2f843fc0691d service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:27.939146 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c5009-6988-440a-82c3-2f843fc0691d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:27.940876 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-858c5009-6988-440a-82c3-2f843fc0691d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:27.950761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c5009-6988-440a-82c3-2f843fc0691d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:27.952171 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c5009-6988-440a-82c3-2f843fc0691d service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:27.959963 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4533/9171] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:29.818135 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f39ad6-481d-4264-9f9b-61c5a973bb42 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:37:29.830186 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f39ad6-481d-4264-9f9b-61c5a973bb42 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:37:29.835354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c6eb3-21cb-4bc2-ab21-a899da4ad923 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:37:29.836087 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c6eb3-21cb-4bc2-ab21-a899da4ad923 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:37:29.836377 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c6eb3-21cb-4bc2-ab21-a899da4ad923 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:37:29.836682 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c6eb3-21cb-4bc2-ab21-a899da4ad923 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:37:29.838521 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-339c6eb3-21cb-4bc2-ab21-a899da4ad923 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:37:29.850137 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c6eb3-21cb-4bc2-ab21-a899da4ad923 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:37:29.852252 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c6eb3-21cb-4bc2-ab21-a899da4ad923 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:37:29.862081 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4639/9172] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:37:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:37:37.956494 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:39.857917 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:34.155476 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c5009-6988-440a-82c3-2f843fc0691d service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:34.156850 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-858c5009-6988-440a-82c3-2f843fc0691d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:34.173357 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c5009-6988-440a-82c3-2f843fc0691d service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:34.179271 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93720331-e3e3-46bb-ad56-fa11d76d62c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:34.179910 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93720331-e3e3-46bb-ad56-fa11d76d62c4 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:34.180194 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93720331-e3e3-46bb-ad56-fa11d76d62c4 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:34.180469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93720331-e3e3-46bb-ad56-fa11d76d62c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:34.182198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-93720331-e3e3-46bb-ad56-fa11d76d62c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:34.193790 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93720331-e3e3-46bb-ad56-fa11d76d62c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:34.195597 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93720331-e3e3-46bb-ad56-fa11d76d62c4 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:34.205428 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4534/9173] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:37.382263 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dee2a-7ae9-44e1-ba30-9458127c5627 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:37.382753 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dee2a-7ae9-44e1-ba30-9458127c5627 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:37.382856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6dee2a-7ae9-44e1-ba30-9458127c5627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:37.441012 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-aa6dee2a-7ae9-44e1-ba30-9458127c5627 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:37.442265 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-aa6dee2a-7ae9-44e1-ba30-9458127c5627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:37.506005 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4640/9174] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 15:38:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:37.672215 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93720331-e3e3-46bb-ad56-fa11d76d62c4 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:37.673645 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-93720331-e3e3-46bb-ad56-fa11d76d62c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:37.764633 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93720331-e3e3-46bb-ad56-fa11d76d62c4 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:37.769665 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1f28f-2e84-4504-9ae6-05f044a4ef1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:37.770347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1f28f-2e84-4504-9ae6-05f044a4ef1f service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:37.770639 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1f28f-2e84-4504-9ae6-05f044a4ef1f service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:37.770924 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1f28f-2e84-4504-9ae6-05f044a4ef1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:37.779339 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1f28f-2e84-4504-9ae6-05f044a4ef1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:37.787310 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1f28f-2e84-4504-9ae6-05f044a4ef1f service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:37.789199 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4535/9175] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 15:38:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:38:47.502947 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=44 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:47.785861 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=47 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:51.426698 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dee2a-7ae9-44e1-ba30-9458127c5627 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:51.436717 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6dee2a-7ae9-44e1-ba30-9458127c5627 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:51.440617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a6ab5-e42f-4a86-9805-f7018c2a2d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:51.441267 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a6ab5-e42f-4a86-9805-f7018c2a2d4c service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:51.441550 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a6ab5-e42f-4a86-9805-f7018c2a2d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:51.441843 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a6ab5-e42f-4a86-9805-f7018c2a2d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:51.443770 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1d5a6ab5-e42f-4a86-9805-f7018c2a2d4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:51.455011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a6ab5-e42f-4a86-9805-f7018c2a2d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:51.456500 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a6ab5-e42f-4a86-9805-f7018c2a2d4c service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:51.466242 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4641/9176] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:51.815737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e73f66-c4d4-406a-b234-10f8469b468f None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:51.816333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e73f66-c4d4-406a-b234-10f8469b468f None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:51.816435 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e73f66-c4d4-406a-b234-10f8469b468f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:51.860478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-71e73f66-c4d4-406a-b234-10f8469b468f None None] MFA Rules not processed for user `dfe9762955004354ab4f1fe02f05a427`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:51.861710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-71e73f66-c4d4-406a-b234-10f8469b468f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:51.872545 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4536/9177] 10.222.0.43 () {58 vars in 1018 bytes} [Tue Jul 19 15:38:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:51.883834 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a6ab5-e42f-4a86-9805-f7018c2a2d4c service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:51.885415 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1d5a6ab5-e42f-4a86-9805-f7018c2a2d4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:51.966947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a6ab5-e42f-4a86-9805-f7018c2a2d4c service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:51.970631 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69814005-fdea-411d-9dfa-b2eaf1e9f09c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '75efea22b2484c1ea79a74e6793050f5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:51.971286 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69814005-fdea-411d-9dfa-b2eaf1e9f09c service glance] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:51.971570 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69814005-fdea-411d-9dfa-b2eaf1e9f09c service glance] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:51.971943 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69814005-fdea-411d-9dfa-b2eaf1e9f09c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:51.983104 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69814005-fdea-411d-9dfa-b2eaf1e9f09c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:51.984467 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69814005-fdea-411d-9dfa-b2eaf1e9f09c service glance] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:51.995676 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4642/9178] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:52.232061 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e73f66-c4d4-406a-b234-10f8469b468f None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:52.241605 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e73f66-c4d4-406a-b234-10f8469b468f None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:52.245170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda6a39-cf9d-4a54-a26a-6386bed5ee6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:52.245814 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda6a39-cf9d-4a54-a26a-6386bed5ee6a service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:52.246124 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda6a39-cf9d-4a54-a26a-6386bed5ee6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:52.246417 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dda6a39-cf9d-4a54-a26a-6386bed5ee6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:52.248175 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3dda6a39-cf9d-4a54-a26a-6386bed5ee6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:52.257741 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda6a39-cf9d-4a54-a26a-6386bed5ee6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:52.259878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dda6a39-cf9d-4a54-a26a-6386bed5ee6a service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:52.267160 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4537/9179] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:53.349771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69814005-fdea-411d-9dfa-b2eaf1e9f09c service glance] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:53.360870 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69814005-fdea-411d-9dfa-b2eaf1e9f09c service glance] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:53.364585 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320d9e5-e3a9-4f9f-99e7-5e2d19dfb778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:53.365219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320d9e5-e3a9-4f9f-99e7-5e2d19dfb778 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:53.365502 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320d9e5-e3a9-4f9f-99e7-5e2d19dfb778 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:53.365818 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320d9e5-e3a9-4f9f-99e7-5e2d19dfb778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:53.367642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6320d9e5-e3a9-4f9f-99e7-5e2d19dfb778 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:53.382079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320d9e5-e3a9-4f9f-99e7-5e2d19dfb778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:53.383518 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6320d9e5-e3a9-4f9f-99e7-5e2d19dfb778 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:53.394973 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4643/9180] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:53.460514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda6a39-cf9d-4a54-a26a-6386bed5ee6a service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:53.472964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dda6a39-cf9d-4a54-a26a-6386bed5ee6a service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:53.478478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b2cdc-b671-4e1b-8d27-adb1695be12a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:53.479153 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b2cdc-b671-4e1b-8d27-adb1695be12a service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:53.479440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b2cdc-b671-4e1b-8d27-adb1695be12a service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:53.479722 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b2cdc-b671-4e1b-8d27-adb1695be12a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:53.481511 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-dd8b2cdc-b671-4e1b-8d27-adb1695be12a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:53.492615 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b2cdc-b671-4e1b-8d27-adb1695be12a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:53.494200 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b2cdc-b671-4e1b-8d27-adb1695be12a service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:53.503868 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4538/9181] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:57.682869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320d9e5-e3a9-4f9f-99e7-5e2d19dfb778 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:57.691901 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6320d9e5-e3a9-4f9f-99e7-5e2d19dfb778 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:57.696542 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb89726-98b0-433f-b853-a875f21f5675 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:57.698515 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb89726-98b0-433f-b853-a875f21f5675 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:57.698799 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb89726-98b0-433f-b853-a875f21f5675 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:57.699074 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb89726-98b0-433f-b853-a875f21f5675 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:57.700869 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-ecb89726-98b0-433f-b853-a875f21f5675 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:57.711293 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb89726-98b0-433f-b853-a875f21f5675 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:57.712842 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb89726-98b0-433f-b853-a875f21f5675 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:57.721251 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4644/9182] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:58.702440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b2cdc-b671-4e1b-8d27-adb1695be12a service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:58.717334 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b2cdc-b671-4e1b-8d27-adb1695be12a service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:58.723263 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b21d8-d0f5-4202-956b-6c8b1b62d1f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:58.724157 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b21d8-d0f5-4202-956b-6c8b1b62d1f6 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:58.724917 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b21d8-d0f5-4202-956b-6c8b1b62d1f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:58.725123 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b21d8-d0f5-4202-956b-6c8b1b62d1f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:58.727915 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-423b21d8-d0f5-4202-956b-6c8b1b62d1f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:58.741967 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b21d8-d0f5-4202-956b-6c8b1b62d1f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:58.743607 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b21d8-d0f5-4202-956b-6c8b1b62d1f6 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:58.766136 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4539/9183] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:38:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:59.531351 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cd319-c1bb-46fa-91e5-2b112d443c9b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:59.531847 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cd319-c1bb-46fa-91e5-2b112d443c9b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:59.532072 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cd319-c1bb-46fa-91e5-2b112d443c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:59.552376 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-df7cd319-c1bb-46fa-91e5-2b112d443c9b None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:38:59.553610 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-df7cd319-c1bb-46fa-91e5-2b112d443c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:38:59.562634 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4645/9184] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 15:38:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:38:59.574710 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b21d8-d0f5-4202-956b-6c8b1b62d1f6 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:38:59.585881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b21d8-d0f5-4202-956b-6c8b1b62d1f6 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:38:59.591003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b399e-f12f-421c-8432-a68c0057a6c1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:38:59.591659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b399e-f12f-421c-8432-a68c0057a6c1 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:38:59.591947 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b399e-f12f-421c-8432-a68c0057a6c1 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:38:59.592227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536b399e-f12f-421c-8432-a68c0057a6c1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:38:59.600959 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b399e-f12f-421c-8432-a68c0057a6c1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:38:59.602587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536b399e-f12f-421c-8432-a68c0057a6c1 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:38:59.611755 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4540/9185] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 15:38:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:39:09.546959 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=56 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:09.608145 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=33 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:16.441048 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0487bd-6007-4ac3-a7cb-2ac95966ba1a None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:16.441538 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0487bd-6007-4ac3-a7cb-2ac95966ba1a None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:16.441642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0487bd-6007-4ac3-a7cb-2ac95966ba1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:16.459595 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-2e0487bd-6007-4ac3-a7cb-2ac95966ba1a None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:39:16.460773 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2e0487bd-6007-4ac3-a7cb-2ac95966ba1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:39:16.468049 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4646/9186] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 15:39:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:39:16.480156 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b399e-f12f-421c-8432-a68c0057a6c1 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:39:16.490769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536b399e-f12f-421c-8432-a68c0057a6c1 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:39:16.495801 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d44efbf-05d4-408f-a2df-315db4f0301d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:39:16.496440 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44efbf-05d4-408f-a2df-315db4f0301d service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:39:16.496726 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44efbf-05d4-408f-a2df-315db4f0301d service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:39:16.497006 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d44efbf-05d4-408f-a2df-315db4f0301d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:39:16.505661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44efbf-05d4-408f-a2df-315db4f0301d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:39:16.507296 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d44efbf-05d4-408f-a2df-315db4f0301d service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:39:16.515913 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4541/9187] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 15:39:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:39:26.454686 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:26.512066 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:40:33.119011 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0487bd-6007-4ac3-a7cb-2ac95966ba1a None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:40:33.120916 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2e0487bd-6007-4ac3-a7cb-2ac95966ba1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:40:33.198859 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0487bd-6007-4ac3-a7cb-2ac95966ba1a None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:40:33.204405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec39fe0-66aa-4d5b-83a0-706c70a3aa85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:40:33.205070 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec39fe0-66aa-4d5b-83a0-706c70a3aa85 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:40:33.205354 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec39fe0-66aa-4d5b-83a0-706c70a3aa85 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:40:33.205630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec39fe0-66aa-4d5b-83a0-706c70a3aa85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:40:33.207587 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1ec39fe0-66aa-4d5b-83a0-706c70a3aa85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:40:33.223731 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec39fe0-66aa-4d5b-83a0-706c70a3aa85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:40:33.225346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec39fe0-66aa-4d5b-83a0-706c70a3aa85 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:40:33.238547 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4647/9188] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:40:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:40:40.629231 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cb563-893d-46a9-a52e-fa6e01afbfa2 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:40:40.629769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cb563-893d-46a9-a52e-fa6e01afbfa2 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:40:40.629769 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cb563-893d-46a9-a52e-fa6e01afbfa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:40:40.649353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-3c5cb563-893d-46a9-a52e-fa6e01afbfa2 None None] MFA Rules not processed for user `5ed058bfc6604647b50d23b11fe8c603`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:40:40.650576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-3c5cb563-893d-46a9-a52e-fa6e01afbfa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:40:40.657502 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4542/9189] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:40:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:40:43.232371 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=28 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:40:50.644676 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:02.565736 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec39fe0-66aa-4d5b-83a0-706c70a3aa85 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:02.567298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1ec39fe0-66aa-4d5b-83a0-706c70a3aa85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:02.645275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec39fe0-66aa-4d5b-83a0-706c70a3aa85 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:02.649908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a685634-ba9e-48ce-be13-11836ac3c881 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef77d9ec7712434287347d959dcf1cc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:02.650591 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a685634-ba9e-48ce-be13-11836ac3c881 service cinder] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:02.650878 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a685634-ba9e-48ce-be13-11836ac3c881 service cinder] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:02.651156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a685634-ba9e-48ce-be13-11836ac3c881 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:02.652904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-7a685634-ba9e-48ce-be13-11836ac3c881 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:02.667050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a685634-ba9e-48ce-be13-11836ac3c881 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:02.668468 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a685634-ba9e-48ce-be13-11836ac3c881 service cinder] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:02.679691 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4648/9190] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:41:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:41:04.801195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cb563-893d-46a9-a52e-fa6e01afbfa2 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:04.813256 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cb563-893d-46a9-a52e-fa6e01afbfa2 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:04.822132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3e99c-43eb-4344-90b7-44b1900a7357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:04.822132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3e99c-43eb-4344-90b7-44b1900a7357 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:04.822132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3e99c-43eb-4344-90b7-44b1900a7357 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:04.822132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3e99c-43eb-4344-90b7-44b1900a7357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:04.822550 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-30d3e99c-43eb-4344-90b7-44b1900a7357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:04.835099 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3e99c-43eb-4344-90b7-44b1900a7357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:04.836533 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3e99c-43eb-4344-90b7-44b1900a7357 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:04.847563 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4543/9191] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:41:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:41:09.155288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a685634-ba9e-48ce-be13-11836ac3c881 service cinder] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:09.166662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a685634-ba9e-48ce-be13-11836ac3c881 service cinder] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:09.172140 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd6aac-95b1-40cd-af41-1f5ff232629b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:09.172779 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd6aac-95b1-40cd-af41-1f5ff232629b service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:09.173061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd6aac-95b1-40cd-af41-1f5ff232629b service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:09.173346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd6aac-95b1-40cd-af41-1f5ff232629b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:09.181801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd6aac-95b1-40cd-af41-1f5ff232629b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:09.183402 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd6aac-95b1-40cd-af41-1f5ff232629b service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:09.192033 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4649/9192] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:41:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:41:14.842750 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:19.188149 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=41 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:28.942495 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3e99c-43eb-4344-90b7-44b1900a7357 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:28.954664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3e99c-43eb-4344-90b7-44b1900a7357 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:28.960392 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2f7c1-a9ae-4b18-8ce0-a4017834f154 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:28.961043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2f7c1-a9ae-4b18-8ce0-a4017834f154 service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:28.961333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2f7c1-a9ae-4b18-8ce0-a4017834f154 service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:28.961619 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2f7c1-a9ae-4b18-8ce0-a4017834f154 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:28.963461 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4eb2f7c1-a9ae-4b18-8ce0-a4017834f154 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:41:28.976003 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2f7c1-a9ae-4b18-8ce0-a4017834f154 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:28.977643 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2f7c1-a9ae-4b18-8ce0-a4017834f154 service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:28.990028 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4544/9193] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:41:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:41:31.668021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd6aac-95b1-40cd-af41-1f5ff232629b service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:41:31.677487 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd6aac-95b1-40cd-af41-1f5ff232629b service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:41:31.681113 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead14d90-14a2-4aa9-84a6-887342022767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:41:31.682026 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead14d90-14a2-4aa9-84a6-887342022767 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:41:31.682339 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead14d90-14a2-4aa9-84a6-887342022767 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:41:31.682637 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead14d90-14a2-4aa9-84a6-887342022767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:41:31.691930 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead14d90-14a2-4aa9-84a6-887342022767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:41:31.693356 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead14d90-14a2-4aa9-84a6-887342022767 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:41:31.703890 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4650/9194] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:41:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:41:38.984838 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:41:41.698587 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:42:32.889611 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2f7c1-a9ae-4b18-8ce0-a4017834f154 service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:42:32.899746 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2f7c1-a9ae-4b18-8ce0-a4017834f154 service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:42:32.903306 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07ae34-18d0-4887-8206-3a2f80f23c18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:42:32.903948 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07ae34-18d0-4887-8206-3a2f80f23c18 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:42:32.904239 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07ae34-18d0-4887-8206-3a2f80f23c18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:42:32.904523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd07ae34-18d0-4887-8206-3a2f80f23c18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:42:32.911792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07ae34-18d0-4887-8206-3a2f80f23c18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:42:32.913747 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd07ae34-18d0-4887-8206-3a2f80f23c18 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:42:32.921840 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4545/9195] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:42:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:42:35.832881 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead14d90-14a2-4aa9-84a6-887342022767 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:42:35.844649 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead14d90-14a2-4aa9-84a6-887342022767 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:42:35.850139 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e73bf-d71f-497f-b0a4-91ddc722aa8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:42:35.851739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e73bf-d71f-497f-b0a4-91ddc722aa8c service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:42:35.851739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e73bf-d71f-497f-b0a4-91ddc722aa8c service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:42:35.851958 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e73bf-d71f-497f-b0a4-91ddc722aa8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:42:35.860604 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e73bf-d71f-497f-b0a4-91ddc722aa8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:42:35.862200 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e73bf-d71f-497f-b0a4-91ddc722aa8c service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:42:35.873077 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4651/9196] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:42:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:42:42.918234 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:42:45.869002 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:43:39.149589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07ae34-18d0-4887-8206-3a2f80f23c18 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:43:39.162163 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd07ae34-18d0-4887-8206-3a2f80f23c18 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:43:39.167581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53434f3-2124-41ea-b8af-3e1a723da6e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:43:39.168227 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53434f3-2124-41ea-b8af-3e1a723da6e0 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:43:39.168514 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53434f3-2124-41ea-b8af-3e1a723da6e0 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:43:39.168796 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53434f3-2124-41ea-b8af-3e1a723da6e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:43:39.178272 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53434f3-2124-41ea-b8af-3e1a723da6e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:43:39.179881 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53434f3-2124-41ea-b8af-3e1a723da6e0 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:43:39.190041 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4546/9197] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:43:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:43:49.185849 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:44:29.523289 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e73bf-d71f-497f-b0a4-91ddc722aa8c service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:29.533175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e73bf-d71f-497f-b0a4-91ddc722aa8c service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:29.537489 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1d68a-ff97-4770-8d8d-b3b3c3eb44be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:29.538171 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1d68a-ff97-4770-8d8d-b3b3c3eb44be service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:29.538460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1d68a-ff97-4770-8d8d-b3b3c3eb44be service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:29.538737 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1d68a-ff97-4770-8d8d-b3b3c3eb44be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:29.546341 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1d68a-ff97-4770-8d8d-b3b3c3eb44be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:29.547769 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f1d68a-ff97-4770-8d8d-b3b3c3eb44be service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:29.556000 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4652/9198] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:44:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:44:30.648401 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53434f3-2124-41ea-b8af-3e1a723da6e0 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:30.657820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53434f3-2124-41ea-b8af-3e1a723da6e0 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:30.662502 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6771b11-62df-4cbf-b42a-1aafadbdd338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:30.663149 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6771b11-62df-4cbf-b42a-1aafadbdd338 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:30.663436 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6771b11-62df-4cbf-b42a-1aafadbdd338 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:30.663714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6771b11-62df-4cbf-b42a-1aafadbdd338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:30.674651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6771b11-62df-4cbf-b42a-1aafadbdd338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:30.676076 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6771b11-62df-4cbf-b42a-1aafadbdd338 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:30.688430 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4547/9199] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:44:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:44:30.750086 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1d68a-ff97-4770-8d8d-b3b3c3eb44be service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:30.762936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f1d68a-ff97-4770-8d8d-b3b3c3eb44be service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:30.767936 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d245ca-59be-471f-b651-33891dd8c180 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:30.768616 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d245ca-59be-471f-b651-33891dd8c180 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:30.768903 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d245ca-59be-471f-b651-33891dd8c180 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:30.769181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d245ca-59be-471f-b651-33891dd8c180 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:30.777776 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d245ca-59be-471f-b651-33891dd8c180 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:30.779382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d245ca-59be-471f-b651-33891dd8c180 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:30.790371 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4653/9200] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:44:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:44:40.683089 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:44:40.743676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6771b11-62df-4cbf-b42a-1aafadbdd338 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:40.752221 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6771b11-62df-4cbf-b42a-1aafadbdd338 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:40.755759 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b899acd-2ee6-4b61-99c3-da95104761de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:40.756393 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b899acd-2ee6-4b61-99c3-da95104761de service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:40.756676 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b899acd-2ee6-4b61-99c3-da95104761de service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:40.756958 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b899acd-2ee6-4b61-99c3-da95104761de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:40.764188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b899acd-2ee6-4b61-99c3-da95104761de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:40.765604 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b899acd-2ee6-4b61-99c3-da95104761de service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:40.774196 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4548/9201] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:44:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:44:40.785103 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=12 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:44:42.127016 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d245ca-59be-471f-b651-33891dd8c180 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:44:42.144258 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d245ca-59be-471f-b651-33891dd8c180 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:44:42.152439 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3a324-9636-495e-8ded-ba17a8a4dd0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:44:42.153158 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3a324-9636-495e-8ded-ba17a8a4dd0c service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:44:42.153459 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3a324-9636-495e-8ded-ba17a8a4dd0c service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:44:42.153820 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3a324-9636-495e-8ded-ba17a8a4dd0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:44:42.167539 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3a324-9636-495e-8ded-ba17a8a4dd0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:44:42.169175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3a324-9636-495e-8ded-ba17a8a4dd0c service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:44:42.182350 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4654/9202] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:44:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:44:50.769995 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:44:52.176615 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:40.731523 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b899acd-2ee6-4b61-99c3-da95104761de service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:40.733114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-4b899acd-2ee6-4b61-99c3-da95104761de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:40.813849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b899acd-2ee6-4b61-99c3-da95104761de service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:40.817572 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ffebe2-9871-4666-b923-eda451c115d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:40.818324 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffebe2-9871-4666-b923-eda451c115d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:40.818618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffebe2-9871-4666-b923-eda451c115d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:40.818935 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ffebe2-9871-4666-b923-eda451c115d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:40.821469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-84ffebe2-9871-4666-b923-eda451c115d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:40.903574 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ffebe2-9871-4666-b923-eda451c115d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:40.905048 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ffebe2-9871-4666-b923-eda451c115d7 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:40.923393 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4549/9203] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:41.884288 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3a324-9636-495e-8ded-ba17a8a4dd0c service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:41.983760 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3a324-9636-495e-8ded-ba17a8a4dd0c service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:41.989435 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a8fa0-eb0c-4296-b552-2d4973c5a16d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:41.990079 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a8fa0-eb0c-4296-b552-2d4973c5a16d service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:41.990394 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a8fa0-eb0c-4296-b552-2d4973c5a16d service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:41.990678 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a8fa0-eb0c-4296-b552-2d4973c5a16d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:42.001205 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a8fa0-eb0c-4296-b552-2d4973c5a16d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:42.002876 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a8fa0-eb0c-4296-b552-2d4973c5a16d service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:42.015146 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4655/9204] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:46:43.289121 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ffebe2-9871-4666-b923-eda451c115d7 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:43.290800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-84ffebe2-9871-4666-b923-eda451c115d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:43.301782 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ffebe2-9871-4666-b923-eda451c115d7 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:43.305927 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b1c49-9e5c-46fc-8b16-c2cb936898d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:43.306612 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b1c49-9e5c-46fc-8b16-c2cb936898d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:43.306906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b1c49-9e5c-46fc-8b16-c2cb936898d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:43.307191 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4b1c49-9e5c-46fc-8b16-c2cb936898d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:43.317595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b1c49-9e5c-46fc-8b16-c2cb936898d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:43.319044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4b1c49-9e5c-46fc-8b16-c2cb936898d0 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:43.330749 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4550/9205] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:44.508471 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a8fa0-eb0c-4296-b552-2d4973c5a16d service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:44.517953 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a8fa0-eb0c-4296-b552-2d4973c5a16d service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:44.521670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6ebf5-e5e3-4671-89b7-5f0238e503b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:44.522342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6ebf5-e5e3-4671-89b7-5f0238e503b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:44.522684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6ebf5-e5e3-4671-89b7-5f0238e503b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:44.523659 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6ebf5-e5e3-4671-89b7-5f0238e503b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:44.533954 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6ebf5-e5e3-4671-89b7-5f0238e503b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:44.535434 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6ebf5-e5e3-4671-89b7-5f0238e503b2 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:44.546546 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4656/9206] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:46:51.550618 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b1c49-9e5c-46fc-8b16-c2cb936898d0 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:51.559371 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4b1c49-9e5c-46fc-8b16-c2cb936898d0 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:51.563348 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb9484-6164-4f5d-95f3-9247b34e9aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:51.563991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb9484-6164-4f5d-95f3-9247b34e9aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:51.564279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb9484-6164-4f5d-95f3-9247b34e9aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:51.564562 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceb9484-6164-4f5d-95f3-9247b34e9aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:51.566438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aceb9484-6164-4f5d-95f3-9247b34e9aa4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:51.625413 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=100 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:51.658553 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb9484-6164-4f5d-95f3-9247b34e9aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:51.660857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceb9484-6164-4f5d-95f3-9247b34e9aa4 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:51.681929 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4551/9207] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:46:54.542183 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=47 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:55.146510 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6ebf5-e5e3-4671-89b7-5f0238e503b2 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:55.148441 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-90c6ebf5-e5e3-4671-89b7-5f0238e503b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:55.242245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6ebf5-e5e3-4671-89b7-5f0238e503b2 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:55.247382 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d881ca9-d47b-46a3-b8f6-e3734ded9624 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:55.248040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d881ca9-d47b-46a3-b8f6-e3734ded9624 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:55.248333 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d881ca9-d47b-46a3-b8f6-e3734ded9624 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:55.248645 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d881ca9-d47b-46a3-b8f6-e3734ded9624 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:55.250504 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1d881ca9-d47b-46a3-b8f6-e3734ded9624 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:55.261969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d881ca9-d47b-46a3-b8f6-e3734ded9624 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:55.263693 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d881ca9-d47b-46a3-b8f6-e3734ded9624 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:55.274528 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4657/9208] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:59.045273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb9484-6164-4f5d-95f3-9247b34e9aa4 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:59.057383 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceb9484-6164-4f5d-95f3-9247b34e9aa4 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:59.062787 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11552dfc-54af-4952-b09f-c66e2b68c729 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:59.063437 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11552dfc-54af-4952-b09f-c66e2b68c729 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:59.063721 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11552dfc-54af-4952-b09f-c66e2b68c729 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:59.064035 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11552dfc-54af-4952-b09f-c66e2b68c729 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:59.065791 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-11552dfc-54af-4952-b09f-c66e2b68c729 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:59.078780 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11552dfc-54af-4952-b09f-c66e2b68c729 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:59.080369 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11552dfc-54af-4952-b09f-c66e2b68c729 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:59.091688 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4552/9209] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:46:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:46:59.193482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d881ca9-d47b-46a3-b8f6-e3734ded9624 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:59.196827 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-1d881ca9-d47b-46a3-b8f6-e3734ded9624 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:46:59.212355 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d881ca9-d47b-46a3-b8f6-e3734ded9624 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:59.217466 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4843833-8148-43cb-a088-8a89853bc286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:59.217871 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4843833-8148-43cb-a088-8a89853bc286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:59.218192 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4843833-8148-43cb-a088-8a89853bc286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:59.218478 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4843833-8148-43cb-a088-8a89853bc286 admin admin] PATH_INFO: `/v3/users/5ed058bfc6604647b50d23b11fe8c603` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:59.219689 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4843833-8148-43cb-a088-8a89853bc286 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed058bfc6604647b50d23b11fe8c603)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:59.221627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4843833-8148-43cb-a088-8a89853bc286 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:59.416342 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f4843833-8148-43cb-a088-8a89853bc286 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed058bfc6604647b50d23b11fe8c603'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:59.428084 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f4843833-8148-43cb-a088-8a89853bc286 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed058bfc6604647b50d23b11fe8c603'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:59.435620 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f4843833-8148-43cb-a088-8a89853bc286 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed058bfc6604647b50d23b11fe8c603'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:59.436304 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f4843833-8148-43cb-a088-8a89853bc286 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed058bfc6604647b50d23b11fe8c603'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:59.516458 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-f4843833-8148-43cb-a088-8a89853bc286 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed058bfc6604647b50d23b11fe8c603'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:46:59.524384 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4658/9210] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:46:59 2022] DELETE /identity/v3/users/5ed058bfc6604647b50d23b11fe8c603 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:46:59.776354 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11552dfc-54af-4952-b09f-c66e2b68c729 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:46:59.789451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11552dfc-54af-4952-b09f-c66e2b68c729 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:46:59.847090 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af4f0d-e918-4f25-a932-f8473292a344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:46:59.847950 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af4f0d-e918-4f25-a932-f8473292a344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:46:59.848234 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af4f0d-e918-4f25-a932-f8473292a344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:46:59.848515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af4f0d-e918-4f25-a932-f8473292a344 admin admin] PATH_INFO: `/v3/projects/18db532817764fb8b9fa4ec941b0e9aa` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:46:59.849687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af4f0d-e918-4f25-a932-f8473292a344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18db532817764fb8b9fa4ec941b0e9aa)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:46:59.852989 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af4f0d-e918-4f25-a932-f8473292a344 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:46:59.951376 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e7af4f0d-e918-4f25-a932-f8473292a344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18db532817764fb8b9fa4ec941b0e9aa', 'request_id': 'req-e7af4f0d-e918-4f25-a932-f8473292a344'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:00.014004 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e7af4f0d-e918-4f25-a932-f8473292a344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18db532817764fb8b9fa4ec941b0e9aa', 'request_id': 'req-e7af4f0d-e918-4f25-a932-f8473292a344'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:00.020650 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e7af4f0d-e918-4f25-a932-f8473292a344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18db532817764fb8b9fa4ec941b0e9aa', 'request_id': 'req-e7af4f0d-e918-4f25-a932-f8473292a344'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:00.031980 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e7af4f0d-e918-4f25-a932-f8473292a344 admin admin] The token cache is being invalidate because project 18db532817764fb8b9fa4ec941b0e9aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:00.032269 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e7af4f0d-e918-4f25-a932-f8473292a344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:00.032906 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-e7af4f0d-e918-4f25-a932-f8473292a344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:00.034493 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4553/9211] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:46:59 2022] DELETE /identity/v3/projects/18db532817764fb8b9fa4ec941b0e9aa => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:00.039156 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4843833-8148-43cb-a088-8a89853bc286 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:00.040657 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-f4843833-8148-43cb-a088-8a89853bc286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:00.054197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4843833-8148-43cb-a088-8a89853bc286 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:00.095332 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:00.112296 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242a0558-7a8c-4ff5-bf50-ebbe23676f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:00.113175 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a0558-7a8c-4ff5-bf50-ebbe23676f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:00.113460 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a0558-7a8c-4ff5-bf50-ebbe23676f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:00.113739 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242a0558-7a8c-4ff5-bf50-ebbe23676f7e admin admin] PATH_INFO: `/v3/users/a8b9ed682508486eb966207ad1af1f04` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:00.127194 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a0558-7a8c-4ff5-bf50-ebbe23676f7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8b9ed682508486eb966207ad1af1f04)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:00.129122 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242a0558-7a8c-4ff5-bf50-ebbe23676f7e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:00.285706 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-242a0558-7a8c-4ff5-bf50-ebbe23676f7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8b9ed682508486eb966207ad1af1f04'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:00.297740 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-242a0558-7a8c-4ff5-bf50-ebbe23676f7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8b9ed682508486eb966207ad1af1f04'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:00.305169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-242a0558-7a8c-4ff5-bf50-ebbe23676f7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8b9ed682508486eb966207ad1af1f04'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:00.305904 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-242a0558-7a8c-4ff5-bf50-ebbe23676f7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8b9ed682508486eb966207ad1af1f04'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:00.372688 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-242a0558-7a8c-4ff5-bf50-ebbe23676f7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8b9ed682508486eb966207ad1af1f04'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:00.378836 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4659/9212] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:47:00 2022] DELETE /identity/v3/users/a8b9ed682508486eb966207ad1af1f04 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:00.673882 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af4f0d-e918-4f25-a932-f8473292a344 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:00.675385 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e7af4f0d-e918-4f25-a932-f8473292a344 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:00.691189 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af4f0d-e918-4f25-a932-f8473292a344 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:00.726449 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:00.750846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584b9b6-3a6f-43b3-9853-eb930b5018b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:00.751714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584b9b6-3a6f-43b3-9853-eb930b5018b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:00.752001 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584b9b6-3a6f-43b3-9853-eb930b5018b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:00.752278 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584b9b6-3a6f-43b3-9853-eb930b5018b9 admin admin] PATH_INFO: `/v3/projects/63e854d5eac548289a520566c7af57e9` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:00.763983 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584b9b6-3a6f-43b3-9853-eb930b5018b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63e854d5eac548289a520566c7af57e9)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:00.765878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584b9b6-3a6f-43b3-9853-eb930b5018b9 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:00.865382 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4584b9b6-3a6f-43b3-9853-eb930b5018b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63e854d5eac548289a520566c7af57e9', 'request_id': 'req-4584b9b6-3a6f-43b3-9853-eb930b5018b9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:00.933545 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4584b9b6-3a6f-43b3-9853-eb930b5018b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63e854d5eac548289a520566c7af57e9', 'request_id': 'req-4584b9b6-3a6f-43b3-9853-eb930b5018b9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:00.941664 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4584b9b6-3a6f-43b3-9853-eb930b5018b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63e854d5eac548289a520566c7af57e9', 'request_id': 'req-4584b9b6-3a6f-43b3-9853-eb930b5018b9'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:00.952964 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4584b9b6-3a6f-43b3-9853-eb930b5018b9 admin admin] The token cache is being invalidate because project 63e854d5eac548289a520566c7af57e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:47:00.953255 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4584b9b6-3a6f-43b3-9853-eb930b5018b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:00.953892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-4584b9b6-3a6f-43b3-9853-eb930b5018b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:47:00.955525 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4554/9213] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:47:00 2022] DELETE /identity/v3/projects/63e854d5eac548289a520566c7af57e9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:00.960700 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7dd6d-78a4-4731-b490-b57ed4f9a559 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:00.961052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7dd6d-78a4-4731-b490-b57ed4f9a559 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:00.961366 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7dd6d-78a4-4731-b490-b57ed4f9a559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:01.019275 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-33f7dd6d-78a4-4731-b490-b57ed4f9a559 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:01.020480 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-33f7dd6d-78a4-4731-b490-b57ed4f9a559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:01.082021 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4660/9214] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:01.090164 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23312e88-aa54-48bf-bc31-5595fca2695a None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:01.090459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23312e88-aa54-48bf-bc31-5595fca2695a None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:01.090744 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23312e88-aa54-48bf-bc31-5595fca2695a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:01.109068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-23312e88-aa54-48bf-bc31-5595fca2695a None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:01.110311 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-23312e88-aa54-48bf-bc31-5595fca2695a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:01.119185 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4555/9215] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:01.123218 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7dd6d-78a4-4731-b490-b57ed4f9a559 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:01.133273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7dd6d-78a4-4731-b490-b57ed4f9a559 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:01.137806 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b4baf-0a72-46ce-825f-4a6743217860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:01.138486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b4baf-0a72-46ce-825f-4a6743217860 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:01.138771 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b4baf-0a72-46ce-825f-4a6743217860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:01.139050 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b4baf-0a72-46ce-825f-4a6743217860 admin admin] PATH_INFO: `/v3/domains` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:01.139767 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b4baf-0a72-46ce-825f-4a6743217860 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80680) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 15:47:01.140101 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b4baf-0a72-46ce-825f-4a6743217860 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:01.141680 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b4baf-0a72-46ce-825f-4a6743217860 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:01.153813 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4661/9216] 10.222.0.43 () {58 vars in 1152 bytes} [Tue Jul 19 15:47:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 15:47:01.157820 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23312e88-aa54-48bf-bc31-5595fca2695a None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:01.167474 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23312e88-aa54-48bf-bc31-5595fca2695a None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:01.172016 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d3607-73f9-4376-bf08-5bb9d74c594b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:01.172659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d3607-73f9-4376-bf08-5bb9d74c594b admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:01.172944 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d3607-73f9-4376-bf08-5bb9d74c594b admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:01.173220 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d3607-73f9-4376-bf08-5bb9d74c594b admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:01.173931 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d3607-73f9-4376-bf08-5bb9d74c594b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:01.175829 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d3607-73f9-4376-bf08-5bb9d74c594b admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:01.314073 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4556/9217] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:01 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:47:01.318021 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b4baf-0a72-46ce-825f-4a6743217860 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:01.329159 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b4baf-0a72-46ce-825f-4a6743217860 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:01.332780 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:01.392405 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd3f9d-e1cd-444a-b378-4f0225e2ecf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:01.393076 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd3f9d-e1cd-444a-b378-4f0225e2ecf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:01.393365 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd3f9d-e1cd-444a-b378-4f0225e2ecf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:01.393642 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd3f9d-e1cd-444a-b378-4f0225e2ecf7 admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:01.394357 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd3f9d-e1cd-444a-b378-4f0225e2ecf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:01.400630 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fd3f9d-e1cd-444a-b378-4f0225e2ecf7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:01.483500 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4662/9218] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:01 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:01.487581 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d3607-73f9-4376-bf08-5bb9d74c594b admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:01.498086 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d3607-73f9-4376-bf08-5bb9d74c594b admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:01.502714 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810483c-317f-481e-963b-612a9ee2fbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:01.503381 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810483c-317f-481e-963b-612a9ee2fbc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:01.503667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810483c-317f-481e-963b-612a9ee2fbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:01.503953 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3810483c-317f-481e-963b-612a9ee2fbc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:01.504680 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810483c-317f-481e-963b-612a9ee2fbc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:01.506301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3810483c-317f-481e-963b-612a9ee2fbc5 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:01.516425 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4557/9219] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:01.520352 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd3f9d-e1cd-444a-b378-4f0225e2ecf7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:01.531491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd3f9d-e1cd-444a-b378-4f0225e2ecf7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:01.536330 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3cab44-a6c6-4873-89ac-426edfd3cdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:01.536987 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cab44-a6c6-4873-89ac-426edfd3cdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:01.537301 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cab44-a6c6-4873-89ac-426edfd3cdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:01.537579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3cab44-a6c6-4873-89ac-426edfd3cdb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:01.539042 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cab44-a6c6-4873-89ac-426edfd3cdb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:01.540669 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3cab44-a6c6-4873-89ac-426edfd3cdb8 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:01.550683 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4663/9220] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:01.555320 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810483c-317f-481e-963b-612a9ee2fbc5 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:01.565512 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3810483c-317f-481e-963b-612a9ee2fbc5 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:01.570080 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0f41e-cd89-429a-b244-b63353b0582c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:01.570973 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0f41e-cd89-429a-b244-b63353b0582c admin admin] REQUEST_METHOD: `PUT` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:01.571258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0f41e-cd89-429a-b244-b63353b0582c admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:01.571537 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0f41e-cd89-429a-b244-b63353b0582c admin admin] PATH_INFO: `/v3/projects/e5bb1f97f5084bfd9c02b8f95656d5dd/users/a7dfa9af95dd4b7c8a41df079dd683c6/roles/e17d8526e56c4d319080a377398b9c74` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:01.586763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0f41e-cd89-429a-b244-b63353b0582c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5bb1f97f5084bfd9c02b8f95656d5dd, user_id=a7dfa9af95dd4b7c8a41df079dd683c6, role_id=e17d8526e56c4d319080a377398b9c74)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:01.593704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c0f41e-cd89-429a-b244-b63353b0582c admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:01.676369 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4558/9221] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:01 2022] PUT /identity/v3/projects/e5bb1f97f5084bfd9c02b8f95656d5dd/users/a7dfa9af95dd4b7c8a41df079dd683c6/roles/e17d8526e56c4d319080a377398b9c74 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:01.683033 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4fece-0b81-405a-87f5-2fd90d8c8cb0 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:01.683307 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4fece-0b81-405a-87f5-2fd90d8c8cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:01.683583 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4fece-0b81-405a-87f5-2fd90d8c8cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:01.703430 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-9ad4fece-0b81-405a-87f5-2fd90d8c8cb0 None None] MFA Rules not processed for user `aee44b6994c447199831be944ec7980c`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:01.704670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-9ad4fece-0b81-405a-87f5-2fd90d8c8cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:01.764796 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4664/9222] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:01.774441 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0f41e-cd89-429a-b244-b63353b0582c admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:01.776298 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-96c0f41e-cd89-429a-b244-b63353b0582c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:01.823572 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:01.834186 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0f41e-cd89-429a-b244-b63353b0582c admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:01.837907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ac9c5-5dc3-4f08-b37e-b84391a7f999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:01.838595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ac9c5-5dc3-4f08-b37e-b84391a7f999 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:01.838886 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ac9c5-5dc3-4f08-b37e-b84391a7f999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:01.839170 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ac9c5-5dc3-4f08-b37e-b84391a7f999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:01.848353 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ac9c5-5dc3-4f08-b37e-b84391a7f999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:01.849775 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544ac9c5-5dc3-4f08-b37e-b84391a7f999 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:01.860515 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4559/9223] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:07.899568 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f65ab-6d74-43b6-a386-d1a2c0680c90 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:07.900054 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f65ab-6d74-43b6-a386-d1a2c0680c90 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:07.900181 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6f65ab-6d74-43b6-a386-d1a2c0680c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:07.931491 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-bf6f65ab-6d74-43b6-a386-d1a2c0680c90 None None] MFA Rules not processed for user `a7dfa9af95dd4b7c8a41df079dd683c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:07.935469 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-bf6f65ab-6d74-43b6-a386-d1a2c0680c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:08.002002 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4665/9224] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:47:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:08.006565 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ac9c5-5dc3-4f08-b37e-b84391a7f999 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:08.016340 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ac9c5-5dc3-4f08-b37e-b84391a7f999 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:08.021326 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0d756-938a-4dfb-8188-9b1b7ebf8c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:08.021996 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0d756-938a-4dfb-8188-9b1b7ebf8c58 admin admin] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:08.022322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0d756-938a-4dfb-8188-9b1b7ebf8c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:08.022763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a0d756-938a-4dfb-8188-9b1b7ebf8c58 admin admin] PATH_INFO: `/v3/projects` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:08.023547 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0d756-938a-4dfb-8188-9b1b7ebf8c58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:08.025469 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a0d756-938a-4dfb-8188-9b1b7ebf8c58 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:08.124043 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4560/9225] 10.222.0.43 () {60 vars in 1152 bytes} [Tue Jul 19 15:47:08 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 15:47:08.128203 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f65ab-6d74-43b6-a386-d1a2c0680c90 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:08.139579 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6f65ab-6d74-43b6-a386-d1a2c0680c90 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:08.151571 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:08.214747 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed77d4-7b7a-4046-a1a3-a6556603481e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:08.215472 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed77d4-7b7a-4046-a1a3-a6556603481e admin admin] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:08.215764 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed77d4-7b7a-4046-a1a3-a6556603481e admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:08.216049 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed77d4-7b7a-4046-a1a3-a6556603481e admin admin] PATH_INFO: `/v3/users` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:08.216792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed77d4-7b7a-4046-a1a3-a6556603481e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:08.218931 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ed77d4-7b7a-4046-a1a3-a6556603481e admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:08.302147 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4666/9226] 10.222.0.43 () {60 vars in 1143 bytes} [Tue Jul 19 15:47:08 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 15:47:08.304246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0d756-938a-4dfb-8188-9b1b7ebf8c58 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:08.315040 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a0d756-938a-4dfb-8188-9b1b7ebf8c58 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:08.319687 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2638b2c-2ce1-496c-a890-663d5dc2cf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:08.320363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2638b2c-2ce1-496c-a890-663d5dc2cf7f admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:08.320651 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2638b2c-2ce1-496c-a890-663d5dc2cf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:08.320970 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2638b2c-2ce1-496c-a890-663d5dc2cf7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:08.321702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2638b2c-2ce1-496c-a890-663d5dc2cf7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:08.323329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2638b2c-2ce1-496c-a890-663d5dc2cf7f admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:08.337072 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4561/9227] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:08.343032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed77d4-7b7a-4046-a1a3-a6556603481e admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:08.354031 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed77d4-7b7a-4046-a1a3-a6556603481e admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:08.359109 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315a46d-8c9f-4092-8393-aedcc2793c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:08.359897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315a46d-8c9f-4092-8393-aedcc2793c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:08.360183 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315a46d-8c9f-4092-8393-aedcc2793c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:08.360851 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2315a46d-8c9f-4092-8393-aedcc2793c0b admin admin] PATH_INFO: `/v3/projects/73acff938be641c692ad5301279611a8/users/ade3e17a947c46a48bf6f31bcd72fa4e/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:08.376251 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315a46d-8c9f-4092-8393-aedcc2793c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=73acff938be641c692ad5301279611a8, user_id=ade3e17a947c46a48bf6f31bcd72fa4e, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:08.378969 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2315a46d-8c9f-4092-8393-aedcc2793c0b admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:08.489122 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4667/9228] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:08 2022] PUT /identity/v3/projects/73acff938be641c692ad5301279611a8/users/ade3e17a947c46a48bf6f31bcd72fa4e/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:08.493343 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2638b2c-2ce1-496c-a890-663d5dc2cf7f admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:08.505173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2638b2c-2ce1-496c-a890-663d5dc2cf7f admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:08.571132 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2636b91a-14eb-4982-8898-3b154c840172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:08.571737 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636b91a-14eb-4982-8898-3b154c840172 admin admin] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:08.572021 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636b91a-14eb-4982-8898-3b154c840172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:08.572301 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2636b91a-14eb-4982-8898-3b154c840172 admin admin] PATH_INFO: `/v3/roles` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:08.573030 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636b91a-14eb-4982-8898-3b154c840172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:08.574661 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2636b91a-14eb-4982-8898-3b154c840172 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:08.584864 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4562/9229] 10.222.0.43 () {58 vars in 1121 bytes} [Tue Jul 19 15:47:08 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 15:47:08.595790 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315a46d-8c9f-4092-8393-aedcc2793c0b admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:08.600877 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2315a46d-8c9f-4092-8393-aedcc2793c0b admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:08.606007 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f9be3-7fdb-4696-8dce-3e950c4bd3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:08.607255 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f9be3-7fdb-4696-8dce-3e950c4bd3b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:08.607672 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f9be3-7fdb-4696-8dce-3e950c4bd3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:08.608040 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f9be3-7fdb-4696-8dce-3e950c4bd3b7 admin admin] PATH_INFO: `/v3/projects/73acff938be641c692ad5301279611a8/users/ade3e17a947c46a48bf6f31bcd72fa4e/roles/bc315edf089d43b18acf9790031f3fcb` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:08.610226 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f9be3-7fdb-4696-8dce-3e950c4bd3b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73acff938be641c692ad5301279611a8, user_id=ade3e17a947c46a48bf6f31bcd72fa4e, role_id=bc315edf089d43b18acf9790031f3fcb)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:08.613146 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f9be3-7fdb-4696-8dce-3e950c4bd3b7 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:08.624681 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4668/9230] 10.222.0.43 () {60 vars in 1482 bytes} [Tue Jul 19 15:47:08 2022] PUT /identity/v3/projects/73acff938be641c692ad5301279611a8/users/ade3e17a947c46a48bf6f31bcd72fa4e/roles/bc315edf089d43b18acf9790031f3fcb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:47:14.411412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90105a97-ac8c-44b5-8b18-651b072b3a32 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:14.411913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90105a97-ac8c-44b5-8b18-651b072b3a32 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:14.411913 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90105a97-ac8c-44b5-8b18-651b072b3a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:14.469363 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-90105a97-ac8c-44b5-8b18-651b072b3a32 None None] MFA Rules not processed for user `ade3e17a947c46a48bf6f31bcd72fa4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:14.470963 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-90105a97-ac8c-44b5-8b18-651b072b3a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:14.549864 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4563/9231] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:47:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:14.566927 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f9be3-7fdb-4696-8dce-3e950c4bd3b7 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:14.568824 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-e48f9be3-7fdb-4696-8dce-3e950c4bd3b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:14.659250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f9be3-7fdb-4696-8dce-3e950c4bd3b7 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:14.666276 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e28674-2005-46b6-8d91-46d66bd8636a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:14.666948 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e28674-2005-46b6-8d91-46d66bd8636a service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:14.667231 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e28674-2005-46b6-8d91-46d66bd8636a service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:14.667507 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e28674-2005-46b6-8d91-46d66bd8636a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:14.729513 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:14.732250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e28674-2005-46b6-8d91-46d66bd8636a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:14.733860 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e28674-2005-46b6-8d91-46d66bd8636a service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:14.744558 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4669/9232] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:17.257957 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cb915-30fd-4a39-91aa-2801a7e97256 None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:17.258592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cb915-30fd-4a39-91aa-2801a7e97256 None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:17.258592 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66cb915-30fd-4a39-91aa-2801a7e97256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:17.276846 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-d66cb915-30fd-4a39-91aa-2801a7e97256 None None] MFA Rules not processed for user `a7dfa9af95dd4b7c8a41df079dd683c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:47:17.278068 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d66cb915-30fd-4a39-91aa-2801a7e97256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:17.285249 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4564/9233] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:47:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:47:17.612556 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e28674-2005-46b6-8d91-46d66bd8636a service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:17.668886 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e28674-2005-46b6-8d91-46d66bd8636a service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:17.673163 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4978cd-20cb-413c-9e69-bae0862fba5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:17.673378 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4978cd-20cb-413c-9e69-bae0862fba5a service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:17.673667 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4978cd-20cb-413c-9e69-bae0862fba5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:17.673973 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4978cd-20cb-413c-9e69-bae0862fba5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:17.675897 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2b4978cd-20cb-413c-9e69-bae0862fba5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:17.686772 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4978cd-20cb-413c-9e69-bae0862fba5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:17.688528 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4978cd-20cb-413c-9e69-bae0862fba5a service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:17.697233 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4670/9234] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:18.122688 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66cb915-30fd-4a39-91aa-2801a7e97256 None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:18.124112 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-d66cb915-30fd-4a39-91aa-2801a7e97256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:18.167854 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:18.264622 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66cb915-30fd-4a39-91aa-2801a7e97256 None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:18.270039 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d03c95-5578-464e-b9fe-737ea694b569 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:18.271528 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d03c95-5578-464e-b9fe-737ea694b569 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:18.271923 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d03c95-5578-464e-b9fe-737ea694b569 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:18.272566 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d03c95-5578-464e-b9fe-737ea694b569 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:18.275333 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e5d03c95-5578-464e-b9fe-737ea694b569 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:18.289288 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d03c95-5578-464e-b9fe-737ea694b569 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:18.291028 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d03c95-5578-464e-b9fe-737ea694b569 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:18.316907 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4565/9235] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:27.695519 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=29 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:28.297879 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=19 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:28.757811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4978cd-20cb-413c-9e69-bae0862fba5a service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:28.757811 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2b4978cd-20cb-413c-9e69-bae0862fba5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:28.769796 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4978cd-20cb-413c-9e69-bae0862fba5a service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:28.775624 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af435c-4c25-459f-a25b-470ff4a98737 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:28.776310 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af435c-4c25-459f-a25b-470ff4a98737 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:28.776589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af435c-4c25-459f-a25b-470ff4a98737 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:28.776866 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af435c-4c25-459f-a25b-470ff4a98737 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:28.778685 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d7af435c-4c25-459f-a25b-470ff4a98737 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:28.791268 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af435c-4c25-459f-a25b-470ff4a98737 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:28.792836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af435c-4c25-459f-a25b-470ff4a98737 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:28.804958 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4671/9236] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:31.123819 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d03c95-5578-464e-b9fe-737ea694b569 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:31.125276 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-e5d03c95-5578-464e-b9fe-737ea694b569 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:31.137279 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d03c95-5578-464e-b9fe-737ea694b569 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:31.141022 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4094e8-850d-4ca1-b03a-b126a194242d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:31.141672 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4094e8-850d-4ca1-b03a-b126a194242d service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:31.141961 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4094e8-850d-4ca1-b03a-b126a194242d service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:31.142282 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4094e8-850d-4ca1-b03a-b126a194242d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:31.151991 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4094e8-850d-4ca1-b03a-b126a194242d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:31.153410 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4094e8-850d-4ca1-b03a-b126a194242d service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:31.162892 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4566/9237] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 15:47:33.130121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af435c-4c25-459f-a25b-470ff4a98737 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:33.141014 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af435c-4c25-459f-a25b-470ff4a98737 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:33.146701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5469d01-4e17-4fe2-bba3-832931ea9d43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:33.147449 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5469d01-4e17-4fe2-bba3-832931ea9d43 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:33.147813 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5469d01-4e17-4fe2-bba3-832931ea9d43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:33.148105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5469d01-4e17-4fe2-bba3-832931ea9d43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:33.149955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-c5469d01-4e17-4fe2-bba3-832931ea9d43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:33.161154 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5469d01-4e17-4fe2-bba3-832931ea9d43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:33.162647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5469d01-4e17-4fe2-bba3-832931ea9d43 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:33.172010 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4672/9238] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:41.158648 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:42.775558 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4094e8-850d-4ca1-b03a-b126a194242d service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:47:42.777134 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ef4094e8-850d-4ca1-b03a-b126a194242d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:42.791483 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4094e8-850d-4ca1-b03a-b126a194242d service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:47:42.796595 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06561edf-47e0-4fde-a662-a9d09b1f8c28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:47:42.797238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06561edf-47e0-4fde-a662-a9d09b1f8c28 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:47:42.797525 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06561edf-47e0-4fde-a662-a9d09b1f8c28 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:47:42.797803 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06561edf-47e0-4fde-a662-a9d09b1f8c28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:47:42.799541 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-06561edf-47e0-4fde-a662-a9d09b1f8c28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:47:42.811188 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06561edf-47e0-4fde-a662-a9d09b1f8c28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:47:42.812751 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06561edf-47e0-4fde-a662-a9d09b1f8c28 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:47:42.822686 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4567/9239] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:47:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:47:43.168286 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=12 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:52.818720 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:43.143882 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5469d01-4e17-4fe2-bba3-832931ea9d43 service neutron] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:48:43.156450 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5469d01-4e17-4fe2-bba3-832931ea9d43 service neutron] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:48:43.161617 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318315e-91a1-4383-92f4-17cf0106a775 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:48:43.162329 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318315e-91a1-4383-92f4-17cf0106a775 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:48:43.162646 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318315e-91a1-4383-92f4-17cf0106a775 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:48:43.162947 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318315e-91a1-4383-92f4-17cf0106a775 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:48:43.164762 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3318315e-91a1-4383-92f4-17cf0106a775 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:48:43.178161 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318315e-91a1-4383-92f4-17cf0106a775 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:48:43.179751 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318315e-91a1-4383-92f4-17cf0106a775 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:48:43.190450 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4673/9240] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:48:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:48:53.185947 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=6 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:33.253763 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53292ed0-e633-43c1-bc3f-7189fecd1e0b None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:49:33.254322 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53292ed0-e633-43c1-bc3f-7189fecd1e0b None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:49:33.254459 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53292ed0-e633-43c1-bc3f-7189fecd1e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:49:33.319911 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-53292ed0-e633-43c1-bc3f-7189fecd1e0b None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:49:33.321044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-53292ed0-e633-43c1-bc3f-7189fecd1e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:49:33.393836 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4568/9241] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 15:49:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:49:33.545921 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318315e-91a1-4383-92f4-17cf0106a775 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:49:33.547346 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3318315e-91a1-4383-92f4-17cf0106a775 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:49:33.638246 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318315e-91a1-4383-92f4-17cf0106a775 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:49:33.643996 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11ce77-55e5-44f7-a866-edbdf646acc4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:49:33.644648 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11ce77-55e5-44f7-a866-edbdf646acc4 service swift] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:49:33.644934 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11ce77-55e5-44f7-a866-edbdf646acc4 service swift] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:49:33.645238 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b11ce77-55e5-44f7-a866-edbdf646acc4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:49:33.653725 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11ce77-55e5-44f7-a866-edbdf646acc4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:49:33.656400 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b11ce77-55e5-44f7-a866-edbdf646acc4 service swift] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:49:33.664380 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4674/9242] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 15:49:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:49:43.390834 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=44 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:43.661113 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=41 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:44.424762 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f303b90-0140-4e73-8128-f6a288acc6bd None None] REQUEST_METHOD: `POST` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:49:44.427761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f303b90-0140-4e73-8128-f6a288acc6bd None None] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:49:44.427761 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f303b90-0140-4e73-8128-f6a288acc6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:49:44.443700 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.auth.core [None req-0f303b90-0140-4e73-8128-f6a288acc6bd None None] MFA Rules not processed for user `a7dfa9af95dd4b7c8a41df079dd683c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80679) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:49:44.444897 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-0f303b90-0140-4e73-8128-f6a288acc6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:49:44.452374 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4569/9243] 10.222.0.43 () {58 vars in 957 bytes} [Tue Jul 19 15:49:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:49:44.778017 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11ce77-55e5-44f7-a866-edbdf646acc4 service swift] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:49:44.787169 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b11ce77-55e5-44f7-a866-edbdf646acc4 service swift] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:49:44.790714 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d484f7e0-fc81-4c3c-b324-af0dc8a0c005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:49:44.791350 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484f7e0-fc81-4c3c-b324-af0dc8a0c005 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:49:44.791638 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484f7e0-fc81-4c3c-b324-af0dc8a0c005 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:49:44.791911 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d484f7e0-fc81-4c3c-b324-af0dc8a0c005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:49:44.793670 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-d484f7e0-fc81-4c3c-b324-af0dc8a0c005 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:49:44.803684 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484f7e0-fc81-4c3c-b324-af0dc8a0c005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:49:44.805526 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d484f7e0-fc81-4c3c-b324-af0dc8a0c005 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:49:44.813908 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4675/9244] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:49:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:49:46.228567 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f303b90-0140-4e73-8128-f6a288acc6bd None None] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:49:46.242705 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f303b90-0140-4e73-8128-f6a288acc6bd None None] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:49:46.246589 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b82cf8-a4a3-40dc-92bd-ce87ee7e4713 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:49:46.247238 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b82cf8-a4a3-40dc-92bd-ce87ee7e4713 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:49:46.247526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b82cf8-a4a3-40dc-92bd-ce87ee7e4713 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:49:46.247800 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b82cf8-a4a3-40dc-92bd-ce87ee7e4713 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:49:46.250529 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-92b82cf8-a4a3-40dc-92bd-ce87ee7e4713 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:49:46.262245 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b82cf8-a4a3-40dc-92bd-ce87ee7e4713 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:49:46.263952 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b82cf8-a4a3-40dc-92bd-ce87ee7e4713 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:49:46.273872 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4570/9245] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:49:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:49:51.640629 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c6d34-5cd8-4bff-acf4-953cb6668b64 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:49:51.641121 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c6d34-5cd8-4bff-acf4-953cb6668b64 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:49:51.641212 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c6d34-5cd8-4bff-acf4-953cb6668b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:49:51.658952 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-063c6d34-5cd8-4bff-acf4-953cb6668b64 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:49:51.660215 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-063c6d34-5cd8-4bff-acf4-953cb6668b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:49:51.667750 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4676/9246] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 15:49:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:49:51.680445 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b82cf8-a4a3-40dc-92bd-ce87ee7e4713 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:49:51.692707 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b82cf8-a4a3-40dc-92bd-ce87ee7e4713 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:49:51.697696 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a0233-e308-4e79-801b-8227ff1cace9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:49:51.698372 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a0233-e308-4e79-801b-8227ff1cace9 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:49:51.698662 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a0233-e308-4e79-801b-8227ff1cace9 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:49:51.698942 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a0233-e308-4e79-801b-8227ff1cace9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:49:51.707390 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a0233-e308-4e79-801b-8227ff1cace9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:49:51.708976 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a0233-e308-4e79-801b-8227ff1cace9 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:49:51.717838 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4571/9247] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 15:49:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:49:59.513219 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c6d34-5cd8-4bff-acf4-953cb6668b64 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:49:59.522944 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c6d34-5cd8-4bff-acf4-953cb6668b64 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:49:59.526856 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303b417-6205-4153-b08b-b1038032e038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:49:59.530032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303b417-6205-4153-b08b-b1038032e038 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:49:59.530032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303b417-6205-4153-b08b-b1038032e038 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:49:59.530032 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303b417-6205-4153-b08b-b1038032e038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:49:59.530742 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-6303b417-6205-4153-b08b-b1038032e038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:49:59.540596 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303b417-6205-4153-b08b-b1038032e038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:49:59.542023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303b417-6205-4153-b08b-b1038032e038 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:49:59.550770 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4677/9248] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:49:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:50:00.309179 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a0233-e308-4e79-801b-8227ff1cace9 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:50:00.322587 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a0233-e308-4e79-801b-8227ff1cace9 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:50:00.337835 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed296f-e56a-40fb-a29c-4ad5ec183dac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:50:00.338549 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed296f-e56a-40fb-a29c-4ad5ec183dac service nova] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:50:00.338834 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed296f-e56a-40fb-a29c-4ad5ec183dac service nova] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:50:00.339114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed296f-e56a-40fb-a29c-4ad5ec183dac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:50:00.340907 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-03ed296f-e56a-40fb-a29c-4ad5ec183dac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:50:00.354857 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed296f-e56a-40fb-a29c-4ad5ec183dac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:50:00.356506 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed296f-e56a-40fb-a29c-4ad5ec183dac service nova] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:50:00.369212 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4572/9249] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:50:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:50:09.547282 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=15 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:50:10.364172 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=21 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:42.496647 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34342d-4c93-4d22-8484-7468528b6a34 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:42.497774 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34342d-4c93-4d22-8484-7468528b6a34 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:42.497883 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34342d-4c93-4d22-8484-7468528b6a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:42.529759 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-3c34342d-4c93-4d22-8484-7468528b6a34 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:42.531001 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-3c34342d-4c93-4d22-8484-7468528b6a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:42.558385 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4678/9250] 10.222.0.43 () {58 vars in 1009 bytes} [Tue Jul 19 15:51:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:42.603717 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed296f-e56a-40fb-a29c-4ad5ec183dac service nova] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:42.653919 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed296f-e56a-40fb-a29c-4ad5ec183dac service nova] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:42.659277 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e7971-6dc2-4dfc-ab4e-8802a7f24806 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:42.659954 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e7971-6dc2-4dfc-ab4e-8802a7f24806 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:42.660248 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e7971-6dc2-4dfc-ab4e-8802a7f24806 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:42.660526 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1e7971-6dc2-4dfc-ab4e-8802a7f24806 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:42.670247 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e7971-6dc2-4dfc-ab4e-8802a7f24806 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:42.671866 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1e7971-6dc2-4dfc-ab4e-8802a7f24806 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:42.681063 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4573/9251] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 15:51:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:51:52.556243 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=16 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:52.677219 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=20 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:52.939537 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e47c18-6935-427b-a083-00d54b0eec10 None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:52.939836 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e47c18-6935-427b-a083-00d54b0eec10 None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:52.940125 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e47c18-6935-427b-a083-00d54b0eec10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:52.959273 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-10e47c18-6935-427b-a083-00d54b0eec10 None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:52.960482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-10e47c18-6935-427b-a083-00d54b0eec10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:52.968671 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4679/9252] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 15:51:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:52.981770 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e7971-6dc2-4dfc-ab4e-8802a7f24806 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:52.992147 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1e7971-6dc2-4dfc-ab4e-8802a7f24806 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:52.997464 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec675e13-c479-4453-abde-1067ba390e13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:52.998087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec675e13-c479-4453-abde-1067ba390e13 service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:52.998428 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec675e13-c479-4453-abde-1067ba390e13 service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:52.998709 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec675e13-c479-4453-abde-1067ba390e13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:53.006792 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec675e13-c479-4453-abde-1067ba390e13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:53.008361 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec675e13-c479-4453-abde-1067ba390e13 service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:53.016678 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4574/9253] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 15:51:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:51:55.347057 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e47c18-6935-427b-a083-00d54b0eec10 None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:55.357120 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e47c18-6935-427b-a083-00d54b0eec10 None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:55.361237 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda0ea9-677e-4d8e-a270-735bc7550426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:55.361815 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda0ea9-677e-4d8e-a270-735bc7550426 service neutron] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:55.362117 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda0ea9-677e-4d8e-a270-735bc7550426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:55.362446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda0ea9-677e-4d8e-a270-735bc7550426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:55.364373 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2dda0ea9-677e-4d8e-a270-735bc7550426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:55.379250 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda0ea9-677e-4d8e-a270-735bc7550426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:55.380701 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda0ea9-677e-4d8e-a270-735bc7550426 service neutron] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:55.392791 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4680/9254] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:51:56.574515 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec675e13-c479-4453-abde-1067ba390e13 service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:56.584451 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec675e13-c479-4453-abde-1067ba390e13 service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:56.589262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae562c28-b7cd-4639-ae07-99aa94a5da33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:56.589262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae562c28-b7cd-4639-ae07-99aa94a5da33 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:56.589262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae562c28-b7cd-4639-ae07-99aa94a5da33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:56.589262 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae562c28-b7cd-4639-ae07-99aa94a5da33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:56.591246 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-ae562c28-b7cd-4639-ae07-99aa94a5da33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:56.604486 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae562c28-b7cd-4639-ae07-99aa94a5da33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:56.606438 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae562c28-b7cd-4639-ae07-99aa94a5da33 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:56.617351 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4575/9255] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:51:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:51:58.962294 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e942e-fad7-4ae8-ae9c-d19606b5342b None None] REQUEST_METHOD: `POST` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:58.962800 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e942e-fad7-4ae8-ae9c-d19606b5342b None None] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:58.962939 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328e942e-fad7-4ae8-ae9c-d19606b5342b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:58.980662 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.auth.core [None req-328e942e-fad7-4ae8-ae9c-d19606b5342b None None] MFA Rules not processed for user `ec07a12b28934ef9b04325404fd3c950`. Rule list: `[]` (Enabled: `True`). {{(pid=80680) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 15:51:58.982069 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-328e942e-fad7-4ae8-ae9c-d19606b5342b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:51:58.989315 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4681/9256] 10.222.0.43 () {58 vars in 967 bytes} [Tue Jul 19 15:51:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 15:51:59.002087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae562c28-b7cd-4639-ae07-99aa94a5da33 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:51:59.013659 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae562c28-b7cd-4639-ae07-99aa94a5da33 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:51:59.018609 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115539b5-f94a-42ba-8965-5f7e36e6e28e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0789b4be9dae4c05bb3ec4a5e0f1f308', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:51:59.019244 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115539b5-f94a-42ba-8965-5f7e36e6e28e service swift] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:51:59.019532 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115539b5-f94a-42ba-8965-5f7e36e6e28e service swift] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:51:59.019811 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115539b5-f94a-42ba-8965-5f7e36e6e28e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:51:59.028043 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115539b5-f94a-42ba-8965-5f7e36e6e28e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:51:59.029667 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115539b5-f94a-42ba-8965-5f7e36e6e28e service swift] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:51:59.037696 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4576/9257] 10.222.0.43 () {60 vars in 1384 bytes} [Tue Jul 19 15:51:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 15:52:03.809574 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e942e-fad7-4ae8-ae9c-d19606b5342b None None] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:03.822625 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328e942e-fad7-4ae8-ae9c-d19606b5342b None None] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:03.828853 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe08d0d-6896-4993-bfca-c7a27c1942d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfe9762955004354ab4f1fe02f05a427', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:03.829589 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe08d0d-6896-4993-bfca-c7a27c1942d4 service nova] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:03.829880 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe08d0d-6896-4993-bfca-c7a27c1942d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:03.830197 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe08d0d-6896-4993-bfca-c7a27c1942d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:03.831990 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-dfe08d0d-6896-4993-bfca-c7a27c1942d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:03.844861 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe08d0d-6896-4993-bfca-c7a27c1942d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:03.846486 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe08d0d-6896-4993-bfca-c7a27c1942d4 service nova] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:03.857255 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4682/9258] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:05.660463 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115539b5-f94a-42ba-8965-5f7e36e6e28e service swift] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:05.671351 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115539b5-f94a-42ba-8965-5f7e36e6e28e service swift] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:05.675057 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7419911-077c-408e-983c-35b4cda51860 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e997b70d7158446daa1dfa225eb7afca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:05.675702 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7419911-077c-408e-983c-35b4cda51860 service neutron] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:05.675990 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7419911-077c-408e-983c-35b4cda51860 service neutron] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:05.676273 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7419911-077c-408e-983c-35b4cda51860 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:05.738849 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7419911-077c-408e-983c-35b4cda51860 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:05.740290 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7419911-077c-408e-983c-35b4cda51860 service neutron] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:05.750082 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4577/9259] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:09.101955 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe08d0d-6896-4993-bfca-c7a27c1942d4 service nova] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:09.114641 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe08d0d-6896-4993-bfca-c7a27c1942d4 service nova] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:09.119792 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fba3a6-e858-42e6-a8ac-4d489c7764e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:09.120446 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fba3a6-e858-42e6-a8ac-4d489c7764e0 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:09.120809 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fba3a6-e858-42e6-a8ac-4d489c7764e0 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:09.121102 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fba3a6-e858-42e6-a8ac-4d489c7764e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:09.123482 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-a7fba3a6-e858-42e6-a8ac-4d489c7764e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:09.135941 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fba3a6-e858-42e6-a8ac-4d489c7764e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:09.137547 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fba3a6-e858-42e6-a8ac-4d489c7764e0 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:09.147742 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4683/9260] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:12.854616 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7419911-077c-408e-983c-35b4cda51860 service neutron] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:12.866494 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7419911-077c-408e-983c-35b4cda51860 service neutron] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:12.871940 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac00c1-52c6-4553-9b56-e691176e27c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:12.872602 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac00c1-52c6-4553-9b56-e691176e27c7 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:12.872892 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac00c1-52c6-4553-9b56-e691176e27c7 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:12.873173 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac00c1-52c6-4553-9b56-e691176e27c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:12.875087 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8cac00c1-52c6-4553-9b56-e691176e27c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:12.887767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac00c1-52c6-4553-9b56-e691176e27c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:12.891024 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cac00c1-52c6-4553-9b56-e691176e27c7 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:12.899706 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4578/9261] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:12.963888 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fba3a6-e858-42e6-a8ac-4d489c7764e0 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:12.976985 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fba3a6-e858-42e6-a8ac-4d489c7764e0 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:12.981801 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976917ca-099f-41b4-b0b5-57a93f5bf9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:12.982704 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976917ca-099f-41b4-b0b5-57a93f5bf9b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:12.982995 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976917ca-099f-41b4-b0b5-57a93f5bf9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:12.983298 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976917ca-099f-41b4-b0b5-57a93f5bf9b1 admin admin] PATH_INFO: `/v3/users/a7dfa9af95dd4b7c8a41df079dd683c6` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:12.984837 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976917ca-099f-41b4-b0b5-57a93f5bf9b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7dfa9af95dd4b7c8a41df079dd683c6)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:12.986991 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976917ca-099f-41b4-b0b5-57a93f5bf9b1 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:13.107245 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-976917ca-099f-41b4-b0b5-57a93f5bf9b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7dfa9af95dd4b7c8a41df079dd683c6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:13.119089 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-976917ca-099f-41b4-b0b5-57a93f5bf9b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7dfa9af95dd4b7c8a41df079dd683c6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:13.129673 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-976917ca-099f-41b4-b0b5-57a93f5bf9b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7dfa9af95dd4b7c8a41df079dd683c6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:13.130424 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-976917ca-099f-41b4-b0b5-57a93f5bf9b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7dfa9af95dd4b7c8a41df079dd683c6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:13.202129 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-976917ca-099f-41b4-b0b5-57a93f5bf9b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7dfa9af95dd4b7c8a41df079dd683c6'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:13.209011 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4684/9262] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:52:12 2022] DELETE /identity/v3/users/a7dfa9af95dd4b7c8a41df079dd683c6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:13.455807 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac00c1-52c6-4553-9b56-e691176e27c7 service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:13.467114 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac00c1-52c6-4553-9b56-e691176e27c7 service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:13.526719 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ce400-bfc2-4db2-9ece-ec1354dc0079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:13.527617 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ce400-bfc2-4db2-9ece-ec1354dc0079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:13.527903 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ce400-bfc2-4db2-9ece-ec1354dc0079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:13.528258 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ce400-bfc2-4db2-9ece-ec1354dc0079 admin admin] PATH_INFO: `/v3/projects/e5bb1f97f5084bfd9c02b8f95656d5dd` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:13.529478 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ce400-bfc2-4db2-9ece-ec1354dc0079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5bb1f97f5084bfd9c02b8f95656d5dd)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:13.531409 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ce400-bfc2-4db2-9ece-ec1354dc0079 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:13.639425 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:13.643229 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-045ce400-bfc2-4db2-9ece-ec1354dc0079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5bb1f97f5084bfd9c02b8f95656d5dd', 'request_id': 'req-045ce400-bfc2-4db2-9ece-ec1354dc0079'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:13.756563 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-045ce400-bfc2-4db2-9ece-ec1354dc0079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5bb1f97f5084bfd9c02b8f95656d5dd', 'request_id': 'req-045ce400-bfc2-4db2-9ece-ec1354dc0079'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:13.763364 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-045ce400-bfc2-4db2-9ece-ec1354dc0079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5bb1f97f5084bfd9c02b8f95656d5dd', 'request_id': 'req-045ce400-bfc2-4db2-9ece-ec1354dc0079'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:13.773874 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-045ce400-bfc2-4db2-9ece-ec1354dc0079 admin admin] The token cache is being invalidate because project e5bb1f97f5084bfd9c02b8f95656d5dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:52:13.774195 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-045ce400-bfc2-4db2-9ece-ec1354dc0079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:13.774839 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-045ce400-bfc2-4db2-9ece-ec1354dc0079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:13.776398 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4579/9263] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:52:13 2022] DELETE /identity/v3/projects/e5bb1f97f5084bfd9c02b8f95656d5dd => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:13.780655 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976917ca-099f-41b4-b0b5-57a93f5bf9b1 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:13.782061 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-976917ca-099f-41b4-b0b5-57a93f5bf9b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:13.795908 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976917ca-099f-41b4-b0b5-57a93f5bf9b1 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:13.853832 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86993dd4-ddf2-4ed4-bf4b-14326eb65586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:13.854738 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86993dd4-ddf2-4ed4-bf4b-14326eb65586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:13.855024 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86993dd4-ddf2-4ed4-bf4b-14326eb65586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:13.855300 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86993dd4-ddf2-4ed4-bf4b-14326eb65586 admin admin] PATH_INFO: `/v3/users/ade3e17a947c46a48bf6f31bcd72fa4e` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:13.857614 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86993dd4-ddf2-4ed4-bf4b-14326eb65586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ade3e17a947c46a48bf6f31bcd72fa4e)` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:13.859553 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86993dd4-ddf2-4ed4-bf4b-14326eb65586 admin admin] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:13.881768 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:14.061254 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-86993dd4-ddf2-4ed4-bf4b-14326eb65586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ade3e17a947c46a48bf6f31bcd72fa4e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:14.073379 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-86993dd4-ddf2-4ed4-bf4b-14326eb65586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ade3e17a947c46a48bf6f31bcd72fa4e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:14.080664 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-86993dd4-ddf2-4ed4-bf4b-14326eb65586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ade3e17a947c46a48bf6f31bcd72fa4e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:14.081345 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-86993dd4-ddf2-4ed4-bf4b-14326eb65586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ade3e17a947c46a48bf6f31bcd72fa4e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:14.144727 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.notifications [None req-86993dd4-ddf2-4ed4-bf4b-14326eb65586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ade3e17a947c46a48bf6f31bcd72fa4e'} {{(pid=80680) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:14.151154 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4685/9264] 10.222.0.43 () {58 vars in 1223 bytes} [Tue Jul 19 15:52:13 2022] DELETE /identity/v3/users/ade3e17a947c46a48bf6f31bcd72fa4e => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:14.415236 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ce400-bfc2-4db2-9ece-ec1354dc0079 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:14.416883 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-045ce400-bfc2-4db2-9ece-ec1354dc0079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:14.430577 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ce400-bfc2-4db2-9ece-ec1354dc0079 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:14.490431 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea093e-8cc9-4405-a2c1-d55b2f8cf2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aee44b6994c447199831be944ec7980c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '11ee5637d3dd4cec833ee8254662fa0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:14.491302 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea093e-8cc9-4405-a2c1-d55b2f8cf2e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:14.491591 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea093e-8cc9-4405-a2c1-d55b2f8cf2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:14.491872 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea093e-8cc9-4405-a2c1-d55b2f8cf2e3 admin admin] PATH_INFO: `/v3/projects/73acff938be641c692ad5301279611a8` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:14.493059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea093e-8cc9-4405-a2c1-d55b2f8cf2e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73acff938be641c692ad5301279611a8)` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:14.495005 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea093e-8cc9-4405-a2c1-d55b2f8cf2e3 admin admin] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:14.637412 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-aeea093e-8cc9-4405-a2c1-d55b2f8cf2e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73acff938be641c692ad5301279611a8', 'request_id': 'req-aeea093e-8cc9-4405-a2c1-d55b2f8cf2e3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:14.716878 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-aeea093e-8cc9-4405-a2c1-d55b2f8cf2e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73acff938be641c692ad5301279611a8', 'request_id': 'req-aeea093e-8cc9-4405-a2c1-d55b2f8cf2e3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:14.723427 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-aeea093e-8cc9-4405-a2c1-d55b2f8cf2e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73acff938be641c692ad5301279611a8', 'request_id': 'req-aeea093e-8cc9-4405-a2c1-d55b2f8cf2e3'} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:14.735329 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-aeea093e-8cc9-4405-a2c1-d55b2f8cf2e3 admin admin] The token cache is being invalidate because project 73acff938be641c692ad5301279611a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80679) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 15:52:14.735625 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-aeea093e-8cc9-4405-a2c1-d55b2f8cf2e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:14.736293 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.notifications [None req-aeea093e-8cc9-4405-a2c1-d55b2f8cf2e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80679) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 15:52:14.737906 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4580/9265] 10.222.0.43 () {58 vars in 1232 bytes} [Tue Jul 19 15:52:14 2022] DELETE /identity/v3/projects/73acff938be641c692ad5301279611a8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 15:52:24.147374 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:24.731498 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=59,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:46.748034 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86993dd4-ddf2-4ed4-bf4b-14326eb65586 admin admin] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:52:46.749496 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-86993dd4-ddf2-4ed4-bf4b-14326eb65586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:46.820051 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86993dd4-ddf2-4ed4-bf4b-14326eb65586 admin admin] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:52:46.878398 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144110f-fe8c-4cc5-89f5-e6af9eae10b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:52:46.879052 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144110f-fe8c-4cc5-89f5-e6af9eae10b9 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:52:46.879364 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144110f-fe8c-4cc5-89f5-e6af9eae10b9 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:52:46.879627 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144110f-fe8c-4cc5-89f5-e6af9eae10b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:52:46.881420 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2144110f-fe8c-4cc5-89f5-e6af9eae10b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:52:46.893023 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144110f-fe8c-4cc5-89f5-e6af9eae10b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:52:46.894636 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144110f-fe8c-4cc5-89f5-e6af9eae10b9 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:52:46.905359 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4686/9266] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:52:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:52:56.900495 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=58 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:45.125152 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea093e-8cc9-4405-a2c1-d55b2f8cf2e3 admin admin] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:53:45.126704 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-aeea093e-8cc9-4405-a2c1-d55b2f8cf2e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:45.142044 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea093e-8cc9-4405-a2c1-d55b2f8cf2e3 admin admin] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:53:45.147120 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7c034-72b0-4912-83ed-0e1f0348bdfe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:53:45.147767 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7c034-72b0-4912-83ed-0e1f0348bdfe service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:53:45.148059 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7c034-72b0-4912-83ed-0e1f0348bdfe service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:53:45.148347 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7c034-72b0-4912-83ed-0e1f0348bdfe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:53:45.150065 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.fernet_utils [None req-8bb7c034-72b0-4912-83ed-0e1f0348bdfe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80679) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:53:45.162060 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7c034-72b0-4912-83ed-0e1f0348bdfe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:53:45.163663 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7c034-72b0-4912-83ed-0e1f0348bdfe service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:53:45.173612 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4581/9267] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:53:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:53:55.169325 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=6 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:57:51.741000 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144110f-fe8c-4cc5-89f5-e6af9eae10b9 service placement] Authenticating user token {{(pid=80680) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:57:51.743030 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.fernet_utils [None req-2144110f-fe8c-4cc5-89f5-e6af9eae10b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80680) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 15:57:51.777864 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144110f-fe8c-4cc5-89f5-e6af9eae10b9 service placement] Validating token access rules against request {{(pid=80680) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:57:51.782906 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84120a99-452e-4211-97bd-d7e2fef4b668 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80680) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:57:51.783546 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84120a99-452e-4211-97bd-d7e2fef4b668 service placement] REQUEST_METHOD: `GET` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:57:51.783829 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84120a99-452e-4211-97bd-d7e2fef4b668 service placement] SCRIPT_NAME: `/identity` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:57:51.784105 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84120a99-452e-4211-97bd-d7e2fef4b668 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80680) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:57:51.793150 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84120a99-452e-4211-97bd-d7e2fef4b668 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:57:51.794778 n-d-master-1 devstack@keystone.service[80680]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84120a99-452e-4211-97bd-d7e2fef4b668 service placement] RBAC: Authorization granted {{(pid=80680) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:57:51.805304 n-d-master-1 devstack@keystone.service[80680]: [pid: 80680|app: 0|req: 4687/9268] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:57:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:58:01.800643 n-d-master-1 devstack@keystone.service[80680]: DEBUG dbcounter [-] [80680] Writing DB stats keystone:SELECT=15 {{(pid=80680) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:58:49.116576 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7c034-72b0-4912-83ed-0e1f0348bdfe service placement] Authenticating user token {{(pid=80679) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 15:58:49.137203 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7c034-72b0-4912-83ed-0e1f0348bdfe service placement] Validating token access rules against request {{(pid=80679) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 15:58:49.142462 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c12c0-e794-44f9-a73f-c210b99e9324 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55426ff3ba7b45d7b270b5374539a461', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dfcbe281a77242bbb3774c4aacef50d4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80679) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 15:58:49.143116 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c12c0-e794-44f9-a73f-c210b99e9324 service placement] REQUEST_METHOD: `GET` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 15:58:49.143406 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c12c0-e794-44f9-a73f-c210b99e9324 service placement] SCRIPT_NAME: `/identity` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 15:58:49.143689 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c12c0-e794-44f9-a73f-c210b99e9324 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80679) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 15:58:49.161198 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c12c0-e794-44f9-a73f-c210b99e9324 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 15:58:49.162812 n-d-master-1 devstack@keystone.service[80679]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c12c0-e794-44f9-a73f-c210b99e9324 service placement] RBAC: Authorization granted {{(pid=80679) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 15:58:49.174281 n-d-master-1 devstack@keystone.service[80679]: [pid: 80679|app: 0|req: 4582/9269] 10.222.0.43 () {60 vars in 1365 bytes} [Tue Jul 19 15:58:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 15:58:59.170008 n-d-master-1 devstack@keystone.service[80679]: DEBUG dbcounter [-] [80679] Writing DB stats keystone:SELECT=10 {{(pid=80679) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}